2024-09-11T23:49:17.510 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T23:49:17.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T23:49:17.645 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901820 branch: wip-cls-rgw-busy-resharding description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} email: null first_in_suite: false job_id: '7901820' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-cls-rgw-busy-resharding ceph: conf: client: rgw relaxed s3 bucket names: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f rgw: frontend: beast s3tests: force-branch: ceph-master thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-67986 sha1: 6a169fc940965ab446a63954fde870aa497efde7 owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 2206 sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f sleep_before_teardown: 0 suite: rgw suite_branch: wip-67986 suite_path: /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa suite_relpath: qa suite_repo: https://github.com/cbodley/ceph.git suite_sha1: 6a169fc940965ab446a63954fde870aa497efde7 targets: smithi019.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLz2p4EKjXM8A8xqdrKptmy3dFYapyHCuQPgLPNbsGU9fNt+rpO5u7MWwrWBA2x/QuhHO/guVkJidEUOgVDEvaE= smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOlp+9e03gsVbePYHbnYOUKKSSSKy1qZKwHWc9oOmQ43S2Us0gQOsRlUqdDDuTxfxXMP27tIq0w/A3bcItf5BlM= tasks: - install: null - ceph: null - rgw: - client.0 - thrashosds: ceph_objectstore_tool: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 chance_test_min_size: 0 op_delay: 30 timeout: 1200 - workunit: clients: client.0: - rgw/s3_bucket_quota.pl teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_23:33:24 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T23:49:17.645 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa; will attempt to use it 2024-09-11T23:49:17.646 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa/tasks 2024-09-11T23:49:17.646 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T23:49:17.647 INFO:teuthology.task.internal:Checking packages... 2024-09-11T23:49:17.669 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd011c522bb171e70fc5782f1e7a71ce5f37e573f' 2024-09-11T23:49:17.669 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T23:49:17.669 INFO:teuthology.packaging:ref: None 2024-09-11T23:49:17.669 INFO:teuthology.packaging:tag: None 2024-09-11T23:49:17.669 INFO:teuthology.packaging:branch: wip-cls-rgw-busy-resharding 2024-09-11T23:49:17.669 INFO:teuthology.packaging:sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-11T23:49:17.670 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-cls-rgw-busy-resharding 2024-09-11T23:49:17.815 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4753-gd011c522-1jammy 2024-09-11T23:49:17.817 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T23:49:17.825 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T23:49:17.825 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T23:49:17.847 INFO:teuthology.task.internal:Saving configuration 2024-09-11T23:49:17.861 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T23:49:17.872 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T23:49:17.906 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901820', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:43:44.501192', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBxRhv6rcZ2sAuTiZw5a91qW2Kb/0eJVG5sLRWVlMkub'} 2024-09-11T23:49:17.937 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901820', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:43:44.499164', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKVSRJvLZYHha7BEvz38R48qv+xMdCFnpraxV3klkKxW'} 2024-09-11T23:49:17.938 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T23:49:17.949 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-11T23:49:17.949 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-11T23:49:17.949 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T23:49:18.034 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f460589f490>, signals=[15]) 2024-09-11T23:49:18.034 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T23:49:18.043 INFO:teuthology.task.internal:Opening connections... 2024-09-11T23:49:18.043 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi019.front.sepia.ceph.com 2024-09-11T23:49:18.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:49:18.156 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2024-09-11T23:49:18.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:49:18.244 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T23:49:18.251 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2024-09-11T23:49:18.256 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2024-09-11T23:49:18.256 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2024-09-11T23:49:18.305 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-11T23:49:18.305 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="Ubuntu" 2024-09-11T23:49:18.305 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="22.04" 2024-09-11T23:49:18.305 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-11T23:49:18.305 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_CODENAME=jammy 2024-09-11T23:49:18.305 INFO:teuthology.orchestra.run.smithi019.stdout:ID=ubuntu 2024-09-11T23:49:18.305 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE=debian 2024-09-11T23:49:18.306 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-11T23:49:18.306 INFO:teuthology.orchestra.run.smithi019.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-11T23:49:18.306 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-11T23:49:18.306 INFO:teuthology.orchestra.run.smithi019.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-11T23:49:18.306 INFO:teuthology.orchestra.run.smithi019.stdout:UBUNTU_CODENAME=jammy 2024-09-11T23:49:18.306 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2024-09-11T23:49:18.352 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-09-11T23:49:18.357 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-09-11T23:49:18.357 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-09-11T23:49:18.402 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-11T23:49:18.402 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Ubuntu" 2024-09-11T23:49:18.402 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="22.04" 2024-09-11T23:49:18.402 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-11T23:49:18.402 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_CODENAME=jammy 2024-09-11T23:49:18.402 INFO:teuthology.orchestra.run.smithi135.stdout:ID=ubuntu 2024-09-11T23:49:18.402 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE=debian 2024-09-11T23:49:18.402 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-11T23:49:18.402 INFO:teuthology.orchestra.run.smithi135.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-11T23:49:18.403 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-11T23:49:18.403 INFO:teuthology.orchestra.run.smithi135.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-11T23:49:18.403 INFO:teuthology.orchestra.run.smithi135.stdout:UBUNTU_CODENAME=jammy 2024-09-11T23:49:18.403 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-09-11T23:49:18.435 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T23:49:18.444 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T23:49:18.453 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T23:49:18.454 DEBUG:teuthology.orchestra.run.smithi019:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:49:18.456 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:49:18.461 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T23:49:18.468 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T23:49:18.468 DEBUG:teuthology.orchestra.run.smithi019:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:49:18.506 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:49:18.520 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T23:49:18.590 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T23:49:18.606 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-11T23:49:18.606 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-11T23:49:18.606 DEBUG:teuthology.orchestra.run.smithi019:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:49:18.607 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:49:18.611 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:49:18.612 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:49:18.612 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-09-11T23:49:18.613 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-09-11T23:49:18.659 INFO:teuthology.orchestra.run.smithi135.stdout:5.15.0-56-generic 2024-09-11T23:49:18.659 INFO:teuthology.task.kernel:Running kernel on smithi135: 5.15.0-56-generic 2024-09-11T23:49:18.660 DEBUG:teuthology.orchestra.run.smithi135:> sudo apt-get clean 2024-09-11T23:49:18.661 INFO:teuthology.orchestra.run.smithi019.stdout:5.15.0-56-generic 2024-09-11T23:49:18.661 INFO:teuthology.task.kernel:Running kernel on smithi019: 5.15.0-56-generic 2024-09-11T23:49:18.662 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-get clean 2024-09-11T23:49:18.792 DEBUG:teuthology.orchestra.run.smithi135:> sudo apt-get update 2024-09-11T23:49:18.887 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-get update 2024-09-11T23:49:18.921 INFO:teuthology.orchestra.run.smithi135.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-11T23:49:19.031 INFO:teuthology.orchestra.run.smithi135.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T23:49:19.039 INFO:teuthology.orchestra.run.smithi019.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-11T23:49:19.113 INFO:teuthology.orchestra.run.smithi135.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-11T23:49:19.122 INFO:teuthology.orchestra.run.smithi135.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-11T23:49:19.147 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T23:49:19.229 INFO:teuthology.orchestra.run.smithi019.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-11T23:49:19.238 INFO:teuthology.orchestra.run.smithi135.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-11T23:49:19.242 INFO:teuthology.orchestra.run.smithi135.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-11T23:49:19.245 INFO:teuthology.orchestra.run.smithi135.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-11T23:49:19.245 INFO:teuthology.orchestra.run.smithi135.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-11T23:49:19.254 INFO:teuthology.orchestra.run.smithi019.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-11T23:49:19.265 INFO:teuthology.orchestra.run.smithi135.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-11T23:49:19.265 INFO:teuthology.orchestra.run.smithi135.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-11T23:49:19.269 INFO:teuthology.orchestra.run.smithi135.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-11T23:49:19.269 INFO:teuthology.orchestra.run.smithi135.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-11T23:49:19.276 INFO:teuthology.orchestra.run.smithi135.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-11T23:49:19.281 INFO:teuthology.orchestra.run.smithi135.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-11T23:49:19.283 INFO:teuthology.orchestra.run.smithi135.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-11T23:49:19.283 INFO:teuthology.orchestra.run.smithi135.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-11T23:49:19.283 INFO:teuthology.orchestra.run.smithi135.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-11T23:49:19.296 INFO:teuthology.orchestra.run.smithi135.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-11T23:49:19.324 INFO:teuthology.orchestra.run.smithi135.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-11T23:49:19.326 INFO:teuthology.orchestra.run.smithi019.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-11T23:49:19.363 INFO:teuthology.orchestra.run.smithi019.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-11T23:49:19.366 INFO:teuthology.orchestra.run.smithi019.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-11T23:49:19.367 INFO:teuthology.orchestra.run.smithi019.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-11T23:49:19.368 INFO:teuthology.orchestra.run.smithi019.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-11T23:49:19.400 INFO:teuthology.orchestra.run.smithi019.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-11T23:49:19.403 INFO:teuthology.orchestra.run.smithi019.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-11T23:49:19.403 INFO:teuthology.orchestra.run.smithi019.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-11T23:49:19.410 INFO:teuthology.orchestra.run.smithi019.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-11T23:49:19.414 INFO:teuthology.orchestra.run.smithi019.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-11T23:49:19.416 INFO:teuthology.orchestra.run.smithi019.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-11T23:49:19.417 INFO:teuthology.orchestra.run.smithi019.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-11T23:49:19.417 INFO:teuthology.orchestra.run.smithi019.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-11T23:49:19.442 INFO:teuthology.orchestra.run.smithi019.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-11T23:49:19.442 INFO:teuthology.orchestra.run.smithi019.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-11T23:49:19.468 INFO:teuthology.orchestra.run.smithi135.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-11T23:49:19.585 INFO:teuthology.orchestra.run.smithi019.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-11T23:49:19.607 INFO:teuthology.orchestra.run.smithi135.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-11T23:49:19.725 INFO:teuthology.orchestra.run.smithi019.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-11T23:49:19.801 INFO:teuthology.orchestra.run.smithi135.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-11T23:49:19.958 INFO:teuthology.orchestra.run.smithi135.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-11T23:49:19.973 INFO:teuthology.orchestra.run.smithi135.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-11T23:49:19.973 INFO:teuthology.orchestra.run.smithi135.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-11T23:49:20.040 INFO:teuthology.orchestra.run.smithi135.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-11T23:49:20.041 INFO:teuthology.orchestra.run.smithi019.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-11T23:49:20.042 INFO:teuthology.orchestra.run.smithi135.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-11T23:49:20.056 INFO:teuthology.orchestra.run.smithi135.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-11T23:49:20.056 INFO:teuthology.orchestra.run.smithi135.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-11T23:49:20.077 INFO:teuthology.orchestra.run.smithi019.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-11T23:49:20.091 INFO:teuthology.orchestra.run.smithi135.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-11T23:49:20.092 INFO:teuthology.orchestra.run.smithi019.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-11T23:49:20.093 INFO:teuthology.orchestra.run.smithi019.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-11T23:49:20.093 INFO:teuthology.orchestra.run.smithi019.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-11T23:49:20.110 INFO:teuthology.orchestra.run.smithi135.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-11T23:49:20.117 INFO:teuthology.orchestra.run.smithi135.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-11T23:49:20.123 INFO:teuthology.orchestra.run.smithi135.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-11T23:49:20.124 INFO:teuthology.orchestra.run.smithi135.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-11T23:49:20.125 INFO:teuthology.orchestra.run.smithi135.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-11T23:49:20.160 INFO:teuthology.orchestra.run.smithi019.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-11T23:49:20.175 INFO:teuthology.orchestra.run.smithi019.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-11T23:49:20.175 INFO:teuthology.orchestra.run.smithi019.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-11T23:49:20.199 INFO:teuthology.orchestra.run.smithi135.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-11T23:49:20.199 INFO:teuthology.orchestra.run.smithi135.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-11T23:49:20.201 INFO:teuthology.orchestra.run.smithi135.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-11T23:49:20.202 INFO:teuthology.orchestra.run.smithi135.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-11T23:49:20.203 INFO:teuthology.orchestra.run.smithi135.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-11T23:49:20.205 INFO:teuthology.orchestra.run.smithi135.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-11T23:49:20.205 INFO:teuthology.orchestra.run.smithi135.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-11T23:49:20.210 INFO:teuthology.orchestra.run.smithi019.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-11T23:49:20.229 INFO:teuthology.orchestra.run.smithi019.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-11T23:49:20.235 INFO:teuthology.orchestra.run.smithi019.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-11T23:49:20.236 INFO:teuthology.orchestra.run.smithi019.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-11T23:49:20.236 INFO:teuthology.orchestra.run.smithi019.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-11T23:49:20.238 INFO:teuthology.orchestra.run.smithi019.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-11T23:49:20.286 INFO:teuthology.orchestra.run.smithi135.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-11T23:49:20.287 INFO:teuthology.orchestra.run.smithi135.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-11T23:49:20.289 INFO:teuthology.orchestra.run.smithi019.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-11T23:49:20.289 INFO:teuthology.orchestra.run.smithi019.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-11T23:49:20.291 INFO:teuthology.orchestra.run.smithi019.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-11T23:49:20.320 INFO:teuthology.orchestra.run.smithi019.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-11T23:49:20.321 INFO:teuthology.orchestra.run.smithi019.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-11T23:49:20.321 INFO:teuthology.orchestra.run.smithi019.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-11T23:49:20.322 INFO:teuthology.orchestra.run.smithi019.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-11T23:49:20.322 INFO:teuthology.orchestra.run.smithi019.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-11T23:49:20.370 INFO:teuthology.orchestra.run.smithi019.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-11T23:49:25.588 INFO:teuthology.orchestra.run.smithi135.stdout:Fetched 15.8 MB in 2s (7,518 kB/s) 2024-09-11T23:49:25.879 INFO:teuthology.orchestra.run.smithi019.stdout:Fetched 15.8 MB in 2s (7,240 kB/s) 2024-09-11T23:49:27.068 INFO:teuthology.orchestra.run.smithi135.stdout:Reading package lists... 2024-09-11T23:49:27.085 DEBUG:teuthology.orchestra.run.smithi135:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T23:49:27.147 INFO:teuthology.orchestra.run.smithi135.stdout:Reading package lists... 2024-09-11T23:49:27.340 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2024-09-11T23:49:27.342 INFO:teuthology.orchestra.run.smithi135.stdout:Building dependency tree... 2024-09-11T23:49:27.343 INFO:teuthology.orchestra.run.smithi135.stdout:Reading state information... 2024-09-11T23:49:27.359 DEBUG:teuthology.orchestra.run.smithi019:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T23:49:27.414 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2024-09-11T23:49:27.513 INFO:teuthology.orchestra.run.smithi135.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:49:27.513 INFO:teuthology.orchestra.run.smithi135.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:49:27.514 INFO:teuthology.orchestra.run.smithi135.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:49:27.514 INFO:teuthology.orchestra.run.smithi135.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:49:27.514 INFO:teuthology.orchestra.run.smithi135.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-11T23:49:27.514 INFO:teuthology.orchestra.run.smithi135.stdout: python2.7-minimal 2024-09-11T23:49:27.515 INFO:teuthology.orchestra.run.smithi135.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:49:27.515 INFO:teuthology.orchestra.run.smithi135.stdout:The following additional packages will be installed: 2024-09-11T23:49:27.516 INFO:teuthology.orchestra.run.smithi135.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T23:49:27.516 INFO:teuthology.orchestra.run.smithi135.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-11T23:49:27.516 INFO:teuthology.orchestra.run.smithi135.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-11T23:49:27.518 INFO:teuthology.orchestra.run.smithi135.stdout:Suggested packages: 2024-09-11T23:49:27.518 INFO:teuthology.orchestra.run.smithi135.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-11T23:49:27.519 INFO:teuthology.orchestra.run.smithi135.stdout:Recommended packages: 2024-09-11T23:49:27.519 INFO:teuthology.orchestra.run.smithi135.stdout: thermald 2024-09-11T23:49:27.564 INFO:teuthology.orchestra.run.smithi135.stdout:The following NEW packages will be installed: 2024-09-11T23:49:27.564 INFO:teuthology.orchestra.run.smithi135.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T23:49:27.564 INFO:teuthology.orchestra.run.smithi135.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-11T23:49:27.564 INFO:teuthology.orchestra.run.smithi135.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-11T23:49:27.565 INFO:teuthology.orchestra.run.smithi135.stdout:The following packages will be upgraded: 2024-09-11T23:49:27.566 INFO:teuthology.orchestra.run.smithi135.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-11T23:49:27.603 INFO:teuthology.orchestra.run.smithi019.stdout:Building dependency tree... 2024-09-11T23:49:27.604 INFO:teuthology.orchestra.run.smithi019.stdout:Reading state information... 2024-09-11T23:49:27.746 INFO:teuthology.orchestra.run.smithi135.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T23:49:27.747 INFO:teuthology.orchestra.run.smithi135.stdout:Need to get 113 MB of archives. 2024-09-11T23:49:27.747 INFO:teuthology.orchestra.run.smithi135.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-11T23:49:27.747 INFO:teuthology.orchestra.run.smithi135.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-11T23:49:27.774 INFO:teuthology.orchestra.run.smithi019.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:49:27.774 INFO:teuthology.orchestra.run.smithi019.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:49:27.774 INFO:teuthology.orchestra.run.smithi019.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:49:27.775 INFO:teuthology.orchestra.run.smithi019.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:49:27.775 INFO:teuthology.orchestra.run.smithi019.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-11T23:49:27.775 INFO:teuthology.orchestra.run.smithi019.stdout: python2.7-minimal 2024-09-11T23:49:27.775 INFO:teuthology.orchestra.run.smithi019.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:49:27.776 INFO:teuthology.orchestra.run.smithi019.stdout:The following additional packages will be installed: 2024-09-11T23:49:27.776 INFO:teuthology.orchestra.run.smithi019.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T23:49:27.777 INFO:teuthology.orchestra.run.smithi019.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-11T23:49:27.777 INFO:teuthology.orchestra.run.smithi019.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-11T23:49:27.778 INFO:teuthology.orchestra.run.smithi019.stdout:Suggested packages: 2024-09-11T23:49:27.778 INFO:teuthology.orchestra.run.smithi019.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-11T23:49:27.778 INFO:teuthology.orchestra.run.smithi019.stdout:Recommended packages: 2024-09-11T23:49:27.778 INFO:teuthology.orchestra.run.smithi019.stdout: thermald 2024-09-11T23:49:27.824 INFO:teuthology.orchestra.run.smithi019.stdout:The following NEW packages will be installed: 2024-09-11T23:49:27.824 INFO:teuthology.orchestra.run.smithi019.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T23:49:27.824 INFO:teuthology.orchestra.run.smithi019.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-11T23:49:27.824 INFO:teuthology.orchestra.run.smithi019.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-11T23:49:27.825 INFO:teuthology.orchestra.run.smithi019.stdout:The following packages will be upgraded: 2024-09-11T23:49:27.826 INFO:teuthology.orchestra.run.smithi019.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-11T23:49:27.878 INFO:teuthology.orchestra.run.smithi019.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T23:49:27.878 INFO:teuthology.orchestra.run.smithi019.stdout:Need to get 113 MB of archives. 2024-09-11T23:49:27.878 INFO:teuthology.orchestra.run.smithi019.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-11T23:49:27.878 INFO:teuthology.orchestra.run.smithi019.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-11T23:49:28.353 INFO:teuthology.orchestra.run.smithi019.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-11T23:49:28.466 INFO:teuthology.orchestra.run.smithi019.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-11T23:49:29.254 INFO:teuthology.orchestra.run.smithi135.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-11T23:49:29.284 INFO:teuthology.orchestra.run.smithi019.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-11T23:49:29.284 INFO:teuthology.orchestra.run.smithi019.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-11T23:49:29.284 INFO:teuthology.orchestra.run.smithi019.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-11T23:49:29.413 INFO:teuthology.orchestra.run.smithi019.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-11T23:49:29.436 INFO:teuthology.orchestra.run.smithi019.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-11T23:49:29.604 INFO:teuthology.orchestra.run.smithi135.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-11T23:49:30.107 INFO:teuthology.orchestra.run.smithi019.stdout:Fetched 113 MB in 2s (67.5 MB/s) 2024-09-11T23:49:30.303 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-11T23:49:31.870 INFO:teuthology.orchestra.run.smithi135.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-11T23:49:31.870 INFO:teuthology.orchestra.run.smithi135.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-11T23:49:31.871 INFO:teuthology.orchestra.run.smithi135.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-11T23:49:32.271 INFO:teuthology.orchestra.run.smithi135.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-11T23:49:32.321 INFO:teuthology.orchestra.run.smithi135.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-11T23:49:32.360 INFO:teuthology.orchestra.run.smithi019.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-11T23:49:32.364 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:49:32.466 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:49:32.716 INFO:teuthology.orchestra.run.smithi135.stdout:Fetched 113 MB in 5s (23.9 MB/s) 2024-09-11T23:49:32.884 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-11T23:49:34.609 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-11T23:49:34.631 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:49:34.753 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:49:34.849 INFO:teuthology.orchestra.run.smithi135.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-11T23:49:34.854 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:49:34.941 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:49:35.187 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-11T23:49:35.208 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:49:35.260 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:49:37.468 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-11T23:49:37.489 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:49:37.585 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:49:38.096 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-11T23:49:38.116 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:49:38.153 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:49:42.054 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:49:42.155 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:49:42.614 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:49:42.742 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:49:43.053 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-11T23:49:43.064 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-11T23:49:43.103 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T23:49:44.541 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:49:44.658 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:49:44.948 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:49:45.045 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:49:45.406 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-11T23:49:45.429 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-11T23:49:45.473 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T23:49:49.110 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-11T23:49:49.148 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:49:49.185 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:49:51.178 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-11T23:49:51.215 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:49:51.244 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:49:51.956 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:49:52.081 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:49:52.431 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T23:49:52.561 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:49:52.687 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-11T23:49:52.816 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:49:53.998 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:49:54.129 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:49:54.170 INFO:teuthology.orchestra.run.smithi019.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:49:54.170 INFO:teuthology.orchestra.run.smithi019.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-11T23:49:54.170 INFO:teuthology.orchestra.run.smithi019.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:49:54.171 INFO:teuthology.orchestra.run.smithi019.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-11T23:49:54.343 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:49:55.339 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T23:49:55.460 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:49:55.577 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-11T23:49:55.689 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:49:55.853 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:49:57.006 INFO:teuthology.orchestra.run.smithi135.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:49:57.006 INFO:teuthology.orchestra.run.smithi135.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-11T23:49:57.006 INFO:teuthology.orchestra.run.smithi135.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:49:57.006 INFO:teuthology.orchestra.run.smithi135.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-11T23:49:57.166 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:49:57.279 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-11T23:49:57.405 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-11T23:49:57.531 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:49:57.603 INFO:teuthology.orchestra.run.smithi019.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-11T23:49:57.603 INFO:teuthology.orchestra.run.smithi019.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:49:58.558 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:49:59.926 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-11T23:50:00.052 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-11T23:50:00.178 INFO:teuthology.orchestra.run.smithi135.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:50:00.245 INFO:teuthology.orchestra.run.smithi135.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-11T23:50:00.245 INFO:teuthology.orchestra.run.smithi135.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:50:12.244 INFO:teuthology.orchestra.run.smithi019.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-11T23:50:12.245 INFO:teuthology.orchestra.run.smithi019.stdout:Sourcing file `/etc/default/grub' 2024-09-11T23:50:12.262 INFO:teuthology.orchestra.run.smithi019.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T23:50:12.277 INFO:teuthology.orchestra.run.smithi019.stdout:Generating grub configuration file ... 2024-09-11T23:50:12.563 INFO:teuthology.orchestra.run.smithi019.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:50:12.586 INFO:teuthology.orchestra.run.smithi019.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:50:12.886 INFO:teuthology.orchestra.run.smithi019.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:50:12.891 INFO:teuthology.orchestra.run.smithi019.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T23:50:12.969 INFO:teuthology.orchestra.run.smithi019.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T23:50:12.975 INFO:teuthology.orchestra.run.smithi019.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T23:50:13.171 INFO:teuthology.orchestra.run.smithi019.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T23:50:13.171 INFO:teuthology.orchestra.run.smithi019.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T23:50:13.171 INFO:teuthology.orchestra.run.smithi019.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T23:50:13.210 INFO:teuthology.orchestra.run.smithi019.stdout:done 2024-09-11T23:50:13.674 DEBUG:teuthology.orchestra.run.smithi019:> dpkg -s linux-image-generic 2024-09-11T23:50:13.689 INFO:teuthology.orchestra.run.smithi019.stdout:Package: linux-image-generic 2024-09-11T23:50:13.689 INFO:teuthology.orchestra.run.smithi019.stdout:Status: install ok installed 2024-09-11T23:50:13.689 INFO:teuthology.orchestra.run.smithi019.stdout:Priority: optional 2024-09-11T23:50:13.690 INFO:teuthology.orchestra.run.smithi019.stdout:Section: kernel 2024-09-11T23:50:13.690 INFO:teuthology.orchestra.run.smithi019.stdout:Installed-Size: 21 2024-09-11T23:50:13.690 INFO:teuthology.orchestra.run.smithi019.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T23:50:13.690 INFO:teuthology.orchestra.run.smithi019.stdout:Architecture: amd64 2024-09-11T23:50:13.690 INFO:teuthology.orchestra.run.smithi019.stdout:Source: linux-meta 2024-09-11T23:50:13.690 INFO:teuthology.orchestra.run.smithi019.stdout:Version: 5.15.0.119.119 2024-09-11T23:50:13.690 INFO:teuthology.orchestra.run.smithi019.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T23:50:13.690 INFO:teuthology.orchestra.run.smithi019.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T23:50:13.690 INFO:teuthology.orchestra.run.smithi019.stdout:Recommends: thermald 2024-09-11T23:50:13.690 INFO:teuthology.orchestra.run.smithi019.stdout:Description: Generic Linux kernel image 2024-09-11T23:50:13.690 INFO:teuthology.orchestra.run.smithi019.stdout: This package will always depend on the latest generic kernel image 2024-09-11T23:50:13.690 INFO:teuthology.orchestra.run.smithi019.stdout: available. 2024-09-11T23:50:13.690 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-11T23:50:13.691 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T23:50:13.691 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T23:50:13.691 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T23:50:13.691 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi019.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T23:50:13.691 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-get clean 2024-09-11T23:50:13.858 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-get update 2024-09-11T23:50:14.107 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-11T23:50:14.107 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T23:50:14.179 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-11T23:50:14.260 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-11T23:50:14.279 INFO:teuthology.orchestra.run.smithi135.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-11T23:50:14.279 INFO:teuthology.orchestra.run.smithi135.stdout:Sourcing file `/etc/default/grub' 2024-09-11T23:50:14.294 INFO:teuthology.orchestra.run.smithi135.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T23:50:14.306 INFO:teuthology.orchestra.run.smithi135.stdout:Generating grub configuration file ... 2024-09-11T23:50:14.542 INFO:teuthology.orchestra.run.smithi135.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:50:14.561 INFO:teuthology.orchestra.run.smithi135.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:50:14.846 INFO:teuthology.orchestra.run.smithi135.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:50:14.852 INFO:teuthology.orchestra.run.smithi135.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T23:50:14.922 INFO:teuthology.orchestra.run.smithi135.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T23:50:14.927 INFO:teuthology.orchestra.run.smithi135.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T23:50:15.082 INFO:teuthology.orchestra.run.smithi135.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T23:50:15.083 INFO:teuthology.orchestra.run.smithi135.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T23:50:15.083 INFO:teuthology.orchestra.run.smithi135.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T23:50:15.129 INFO:teuthology.orchestra.run.smithi135.stdout:done 2024-09-11T23:50:15.565 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2024-09-11T23:50:15.584 DEBUG:teuthology.orchestra.run.smithi019:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T23:50:15.628 DEBUG:teuthology.orchestra.run.smithi135:> dpkg -s linux-image-generic 2024-09-11T23:50:15.639 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2024-09-11T23:50:15.646 INFO:teuthology.orchestra.run.smithi135.stdout:Package: linux-image-generic 2024-09-11T23:50:15.646 INFO:teuthology.orchestra.run.smithi135.stdout:Status: install ok installed 2024-09-11T23:50:15.647 INFO:teuthology.orchestra.run.smithi135.stdout:Priority: optional 2024-09-11T23:50:15.647 INFO:teuthology.orchestra.run.smithi135.stdout:Section: kernel 2024-09-11T23:50:15.647 INFO:teuthology.orchestra.run.smithi135.stdout:Installed-Size: 21 2024-09-11T23:50:15.647 INFO:teuthology.orchestra.run.smithi135.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T23:50:15.647 INFO:teuthology.orchestra.run.smithi135.stdout:Architecture: amd64 2024-09-11T23:50:15.647 INFO:teuthology.orchestra.run.smithi135.stdout:Source: linux-meta 2024-09-11T23:50:15.647 INFO:teuthology.orchestra.run.smithi135.stdout:Version: 5.15.0.119.119 2024-09-11T23:50:15.647 INFO:teuthology.orchestra.run.smithi135.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T23:50:15.647 INFO:teuthology.orchestra.run.smithi135.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T23:50:15.647 INFO:teuthology.orchestra.run.smithi135.stdout:Recommends: thermald 2024-09-11T23:50:15.647 INFO:teuthology.orchestra.run.smithi135.stdout:Description: Generic Linux kernel image 2024-09-11T23:50:15.647 INFO:teuthology.orchestra.run.smithi135.stdout: This package will always depend on the latest generic kernel image 2024-09-11T23:50:15.647 INFO:teuthology.orchestra.run.smithi135.stdout: available. 2024-09-11T23:50:15.648 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-11T23:50:15.648 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T23:50:15.648 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T23:50:15.648 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-11T23:50:15.648 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi135.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T23:50:15.648 DEBUG:teuthology.orchestra.run.smithi135:> sudo apt-get clean 2024-09-11T23:50:15.815 DEBUG:teuthology.orchestra.run.smithi135:> sudo apt-get update 2024-09-11T23:50:15.836 INFO:teuthology.orchestra.run.smithi019.stdout:Building dependency tree... 2024-09-11T23:50:15.837 INFO:teuthology.orchestra.run.smithi019.stdout:Reading state information... 2024-09-11T23:50:15.953 INFO:teuthology.orchestra.run.smithi135.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T23:50:15.953 INFO:teuthology.orchestra.run.smithi135.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-11T23:50:15.962 INFO:teuthology.orchestra.run.smithi135.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-11T23:50:15.979 INFO:teuthology.orchestra.run.smithi135.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-11T23:50:16.017 INFO:teuthology.orchestra.run.smithi019.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-11T23:50:16.017 INFO:teuthology.orchestra.run.smithi019.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:50:16.017 INFO:teuthology.orchestra.run.smithi019.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:50:16.018 INFO:teuthology.orchestra.run.smithi019.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:50:16.018 INFO:teuthology.orchestra.run.smithi019.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:50:16.018 INFO:teuthology.orchestra.run.smithi019.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T23:50:16.018 INFO:teuthology.orchestra.run.smithi019.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T23:50:16.018 INFO:teuthology.orchestra.run.smithi019.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:50:16.059 INFO:teuthology.orchestra.run.smithi019.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T23:50:16.061 DEBUG:teuthology.orchestra.run.smithi019:> dpkg -s linux-image-generic 2024-09-11T23:50:16.119 INFO:teuthology.orchestra.run.smithi019.stdout:Package: linux-image-generic 2024-09-11T23:50:16.119 INFO:teuthology.orchestra.run.smithi019.stdout:Status: install ok installed 2024-09-11T23:50:16.120 INFO:teuthology.orchestra.run.smithi019.stdout:Priority: optional 2024-09-11T23:50:16.120 INFO:teuthology.orchestra.run.smithi019.stdout:Section: kernel 2024-09-11T23:50:16.120 INFO:teuthology.orchestra.run.smithi019.stdout:Installed-Size: 21 2024-09-11T23:50:16.120 INFO:teuthology.orchestra.run.smithi019.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T23:50:16.120 INFO:teuthology.orchestra.run.smithi019.stdout:Architecture: amd64 2024-09-11T23:50:16.120 INFO:teuthology.orchestra.run.smithi019.stdout:Source: linux-meta 2024-09-11T23:50:16.120 INFO:teuthology.orchestra.run.smithi019.stdout:Version: 5.15.0.119.119 2024-09-11T23:50:16.120 INFO:teuthology.orchestra.run.smithi019.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T23:50:16.120 INFO:teuthology.orchestra.run.smithi019.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T23:50:16.120 INFO:teuthology.orchestra.run.smithi019.stdout:Recommends: thermald 2024-09-11T23:50:16.120 INFO:teuthology.orchestra.run.smithi019.stdout:Description: Generic Linux kernel image 2024-09-11T23:50:16.120 INFO:teuthology.orchestra.run.smithi019.stdout: This package will always depend on the latest generic kernel image 2024-09-11T23:50:16.120 INFO:teuthology.orchestra.run.smithi019.stdout: available. 2024-09-11T23:50:16.121 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-09-11T23:50:16.165 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.oYa7XCXqSJ 2024-09-11T23:50:16.165 DEBUG:teuthology.orchestra.run.smithi019:> sudo cp /boot/grub/grub.cfg /tmp/tmp.oYa7XCXqSJ 2024-09-11T23:50:16.220 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.oYa7XCXqSJ 2024-09-11T23:50:16.354 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.oYa7XCXqSJ is 10KB 2024-09-11T23:50:16.366 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.oYa7XCXqSJ 2024-09-11T23:50:16.371 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-11T23:50:16.424 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-11T23:50:16.424 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-11T23:50:16.424 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-11T23:50:16.499 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-11T23:50:16.500 DEBUG:teuthology.orchestra.run.smithi019:> sudo update-grub 2024-09-11T23:50:17.308 INFO:teuthology.orchestra.run.smithi135.stdout:Reading package lists... 2024-09-11T23:50:17.326 DEBUG:teuthology.orchestra.run.smithi135:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T23:50:17.388 INFO:teuthology.orchestra.run.smithi135.stdout:Reading package lists... 2024-09-11T23:50:17.598 INFO:teuthology.orchestra.run.smithi135.stdout:Building dependency tree... 2024-09-11T23:50:17.599 INFO:teuthology.orchestra.run.smithi135.stdout:Reading state information... 2024-09-11T23:50:17.775 INFO:teuthology.orchestra.run.smithi135.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-11T23:50:17.775 INFO:teuthology.orchestra.run.smithi135.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:50:17.776 INFO:teuthology.orchestra.run.smithi135.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:50:17.776 INFO:teuthology.orchestra.run.smithi135.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:50:17.776 INFO:teuthology.orchestra.run.smithi135.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:50:17.776 INFO:teuthology.orchestra.run.smithi135.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T23:50:17.776 INFO:teuthology.orchestra.run.smithi135.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T23:50:17.776 INFO:teuthology.orchestra.run.smithi135.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:50:17.815 INFO:teuthology.orchestra.run.smithi135.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T23:50:17.816 DEBUG:teuthology.orchestra.run.smithi135:> dpkg -s linux-image-generic 2024-09-11T23:50:17.832 INFO:teuthology.orchestra.run.smithi135.stdout:Package: linux-image-generic 2024-09-11T23:50:17.832 INFO:teuthology.orchestra.run.smithi135.stdout:Status: install ok installed 2024-09-11T23:50:17.832 INFO:teuthology.orchestra.run.smithi135.stdout:Priority: optional 2024-09-11T23:50:17.832 INFO:teuthology.orchestra.run.smithi135.stdout:Section: kernel 2024-09-11T23:50:17.832 INFO:teuthology.orchestra.run.smithi135.stdout:Installed-Size: 21 2024-09-11T23:50:17.832 INFO:teuthology.orchestra.run.smithi135.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T23:50:17.832 INFO:teuthology.orchestra.run.smithi135.stdout:Architecture: amd64 2024-09-11T23:50:17.832 INFO:teuthology.orchestra.run.smithi135.stdout:Source: linux-meta 2024-09-11T23:50:17.832 INFO:teuthology.orchestra.run.smithi135.stdout:Version: 5.15.0.119.119 2024-09-11T23:50:17.832 INFO:teuthology.orchestra.run.smithi135.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T23:50:17.833 INFO:teuthology.orchestra.run.smithi135.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T23:50:17.833 INFO:teuthology.orchestra.run.smithi135.stdout:Recommends: thermald 2024-09-11T23:50:17.833 INFO:teuthology.orchestra.run.smithi135.stdout:Description: Generic Linux kernel image 2024-09-11T23:50:17.833 INFO:teuthology.orchestra.run.smithi135.stdout: This package will always depend on the latest generic kernel image 2024-09-11T23:50:17.833 INFO:teuthology.orchestra.run.smithi135.stdout: available. 2024-09-11T23:50:17.833 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-09-11T23:50:17.877 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.kMNtbVK3QV 2024-09-11T23:50:17.877 DEBUG:teuthology.orchestra.run.smithi135:> sudo cp /boot/grub/grub.cfg /tmp/tmp.kMNtbVK3QV 2024-09-11T23:50:17.932 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.kMNtbVK3QV 2024-09-11T23:50:17.979 INFO:teuthology.orchestra.run.smithi019.stderr:Sourcing file `/etc/default/grub' 2024-09-11T23:50:17.980 INFO:teuthology.orchestra.run.smithi019.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T23:50:17.986 INFO:teuthology.orchestra.run.smithi019.stderr:Generating grub configuration file ... 2024-09-11T23:50:18.048 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.kMNtbVK3QV is 10KB 2024-09-11T23:50:18.061 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.kMNtbVK3QV 2024-09-11T23:50:18.066 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-11T23:50:18.120 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-11T23:50:18.121 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-11T23:50:18.121 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-11T23:50:18.179 INFO:teuthology.orchestra.run.smithi019.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:50:18.183 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-11T23:50:18.184 DEBUG:teuthology.orchestra.run.smithi135:> sudo update-grub 2024-09-11T23:50:18.186 INFO:teuthology.orchestra.run.smithi019.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:50:18.417 INFO:teuthology.orchestra.run.smithi019.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:50:18.422 INFO:teuthology.orchestra.run.smithi019.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T23:50:18.461 INFO:teuthology.orchestra.run.smithi019.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T23:50:18.466 INFO:teuthology.orchestra.run.smithi019.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T23:50:18.586 INFO:teuthology.orchestra.run.smithi019.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T23:50:18.586 INFO:teuthology.orchestra.run.smithi019.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T23:50:18.586 INFO:teuthology.orchestra.run.smithi019.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T23:50:18.601 INFO:teuthology.orchestra.run.smithi019.stderr:done 2024-09-11T23:50:18.619 DEBUG:teuthology.orchestra.run.smithi019:> sudo shutdown -r now 2024-09-11T23:50:19.505 INFO:teuthology.orchestra.run.smithi135.stderr:Sourcing file `/etc/default/grub' 2024-09-11T23:50:19.507 INFO:teuthology.orchestra.run.smithi135.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T23:50:19.510 INFO:teuthology.orchestra.run.smithi135.stderr:Generating grub configuration file ... 2024-09-11T23:50:19.691 INFO:teuthology.orchestra.run.smithi135.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:50:19.697 INFO:teuthology.orchestra.run.smithi135.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:50:19.917 INFO:teuthology.orchestra.run.smithi135.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:50:19.923 INFO:teuthology.orchestra.run.smithi135.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T23:50:19.964 INFO:teuthology.orchestra.run.smithi135.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T23:50:19.969 INFO:teuthology.orchestra.run.smithi135.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T23:50:20.082 INFO:teuthology.orchestra.run.smithi135.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T23:50:20.082 INFO:teuthology.orchestra.run.smithi135.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T23:50:20.082 INFO:teuthology.orchestra.run.smithi135.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T23:50:20.098 INFO:teuthology.orchestra.run.smithi135.stderr:done 2024-09-11T23:50:20.107 DEBUG:teuthology.orchestra.run.smithi135:> sudo shutdown -r now 2024-09-11T23:50:48.693 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T23:50:48.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-11T23:50:48.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:50:50.111 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-11T23:50:50.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-11T23:50:50.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:51:07.069 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-09-11T23:51:08.605 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-09-11T23:51:16.076 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-11T23:51:16.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:51:17.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-11T23:51:17.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:51:20.669 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-09-11T23:51:32.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-11T23:51:32.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:52:04.459 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-09-11T23:52:05.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-11T23:52:05.298 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-11T23:52:05.298 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-09-11T23:52:05.344 INFO:teuthology.orchestra.run.smithi135.stdout:5.15.0-119-generic 2024-09-11T23:52:05.344 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-11T23:52:05.345 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T23:52:05.345 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-11T23:52:06.346 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-11T23:52:06.346 DEBUG:teuthology.orchestra.run.smithi135:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T23:52:06.426 INFO:teuthology.orchestra.run.smithi135.stdout:ttyS1 2024-09-11T23:52:06.446 DEBUG:teuthology.parallel:result is None 2024-09-11T23:52:16.088 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T23:52:28.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-11T23:52:28.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:52:28.340 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-09-11T23:52:29.003 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-11T23:52:29.003 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-11T23:52:29.003 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-09-11T23:52:29.050 INFO:teuthology.orchestra.run.smithi019.stdout:5.15.0-119-generic 2024-09-11T23:52:29.050 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-11T23:52:29.050 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T23:52:29.050 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-11T23:52:30.051 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T23:52:30.051 DEBUG:teuthology.orchestra.run.smithi019:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T23:52:30.121 INFO:teuthology.orchestra.run.smithi019.stdout:ttyS1 2024-09-11T23:52:30.152 DEBUG:teuthology.parallel:result is None 2024-09-11T23:52:30.152 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T23:52:30.163 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T23:52:30.163 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:52:30.165 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:52:30.171 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T23:52:30.186 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T23:52:30.198 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T23:52:30.198 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:52:30.211 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:52:30.321 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T23:52:30.334 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T23:52:30.334 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:52:30.338 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:52:30.356 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:52:30.358 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:52:30.365 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:52:30.367 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:52:30.368 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T23:52:30.378 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T23:52:30.378 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:52:30.411 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:52:30.429 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T23:52:30.439 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T23:52:30.440 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:52:30.467 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:52:30.476 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:52:30.518 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:52:30.566 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-11T23:52:30.566 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:52:30.632 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:52:30.637 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:52:30.688 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-11T23:52:30.994 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:52:31.021 DEBUG:teuthology.orchestra.run.smithi019:> sudo service rsyslog restart 2024-09-11T23:52:31.024 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2024-09-11T23:52:31.098 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T23:52:31.134 INFO:teuthology.task.internal:Starting timer... 2024-09-11T23:52:31.134 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T23:52:31.150 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T23:52:31.160 DEBUG:teuthology.task.selinux:Excluding smithi019: OS 'ubuntu' does not support SELinux 2024-09-11T23:52:31.160 DEBUG:teuthology.task.selinux:Excluding smithi135: OS 'ubuntu' does not support SELinux 2024-09-11T23:52:31.160 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T23:52:31.160 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-11T23:52:31.160 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T23:52:31.161 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T23:52:31.174 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T23:52:31.186 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T23:52:31.187 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi019.front.sepia.ceph.com,smithi135.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T00:00:10.582 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi019.front.sepia.ceph.com'), Remote(name='ubuntu@smithi135.front.sepia.ceph.com')] 2024-09-12T00:00:10.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T00:00:10.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:00:10.736 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-09-12T00:00:10.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T00:00:10.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-12T00:00:10.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:00:10.912 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-09-12T00:00:10.993 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-12T00:00:10.994 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T00:00:11.008 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T00:00:11.008 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:00:11.009 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:00:11.011 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:00:11.012 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:00:11.041 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 00:00:11 ntpd[18440]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T00:00:11.041 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 00:00:11 ntpd[18440]: Command line: ntpd -gq 2024-09-12T00:00:11.041 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 00:00:11 ntpd[18440]: ---------------------------------------------------- 2024-09-12T00:00:11.041 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 00:00:11 ntpd[18440]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T00:00:11.042 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 00:00:11 ntpd[18440]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T00:00:11.042 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 00:00:11 ntpd[18440]: corporation. Support and training for ntp-4 are 2024-09-12T00:00:11.042 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 00:00:11 ntpd[18440]: available at https://www.nwtime.org/support 2024-09-12T00:00:11.042 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 00:00:11 ntpd[18440]: ---------------------------------------------------- 2024-09-12T00:00:11.042 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 00:00:11 ntpd[18440]: proto: precision = 0.068 usec (-24) 2024-09-12T00:00:11.043 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 00:00:11 ntpd[18440]: basedate set to 2022-02-04 2024-09-12T00:00:11.043 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 00:00:11 ntpd[18440]: gps base set to 2022-02-06 (week 2196) 2024-09-12T00:00:11.043 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 00:00:11 ntpd[18440]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:00:11.043 INFO:teuthology.orchestra.run.smithi019.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:00:11.043 INFO:teuthology.orchestra.run.smithi019.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:00:11.044 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 00:00:11 ntpd[18440]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:00:11.044 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 00:00:11 ntpd[18440]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T00:00:11.045 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 00:00:11 ntpd[18440]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T00:00:11.045 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 00:00:11 ntpd[18440]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T00:00:11.045 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 00:00:11 ntpd[18440]: Listen normally on 3 ens1f0 172.21.15.19:123 2024-09-12T00:00:11.045 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 00:00:11 ntpd[18440]: Listen normally on 4 lo [::1]:123 2024-09-12T00:00:11.045 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 00:00:11 ntpd[18440]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:161e%4]:123 2024-09-12T00:00:11.045 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 00:00:11 ntpd[18440]: Listening on routing socket on fd #22 for interface updates 2024-09-12T00:00:11.062 INFO:teuthology.orchestra.run.smithi135.stdout:12 Sep 00:00:11 ntpd[18537]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T00:00:11.063 INFO:teuthology.orchestra.run.smithi135.stdout:12 Sep 00:00:11 ntpd[18537]: Command line: ntpd -gq 2024-09-12T00:00:11.063 INFO:teuthology.orchestra.run.smithi135.stdout:12 Sep 00:00:11 ntpd[18537]: ---------------------------------------------------- 2024-09-12T00:00:11.063 INFO:teuthology.orchestra.run.smithi135.stdout:12 Sep 00:00:11 ntpd[18537]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T00:00:11.063 INFO:teuthology.orchestra.run.smithi135.stdout:12 Sep 00:00:11 ntpd[18537]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T00:00:11.063 INFO:teuthology.orchestra.run.smithi135.stdout:12 Sep 00:00:11 ntpd[18537]: corporation. Support and training for ntp-4 are 2024-09-12T00:00:11.064 INFO:teuthology.orchestra.run.smithi135.stdout:12 Sep 00:00:11 ntpd[18537]: available at https://www.nwtime.org/support 2024-09-12T00:00:11.064 INFO:teuthology.orchestra.run.smithi135.stdout:12 Sep 00:00:11 ntpd[18537]: ---------------------------------------------------- 2024-09-12T00:00:11.065 INFO:teuthology.orchestra.run.smithi135.stdout:12 Sep 00:00:11 ntpd[18537]: proto: precision = 0.060 usec (-24) 2024-09-12T00:00:11.065 INFO:teuthology.orchestra.run.smithi135.stdout:12 Sep 00:00:11 ntpd[18537]: basedate set to 2022-02-04 2024-09-12T00:00:11.065 INFO:teuthology.orchestra.run.smithi135.stdout:12 Sep 00:00:11 ntpd[18537]: gps base set to 2022-02-06 (week 2196) 2024-09-12T00:00:11.066 INFO:teuthology.orchestra.run.smithi135.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:00:11.066 INFO:teuthology.orchestra.run.smithi135.stdout:12 Sep 00:00:11 ntpd[18537]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:00:11.066 INFO:teuthology.orchestra.run.smithi135.stdout:12 Sep 00:00:11 ntpd[18537]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:00:11.067 INFO:teuthology.orchestra.run.smithi135.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:00:11.068 INFO:teuthology.orchestra.run.smithi135.stdout:12 Sep 00:00:11 ntpd[18537]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T00:00:11.068 INFO:teuthology.orchestra.run.smithi135.stdout:12 Sep 00:00:11 ntpd[18537]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T00:00:11.068 INFO:teuthology.orchestra.run.smithi135.stdout:12 Sep 00:00:11 ntpd[18537]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T00:00:11.068 INFO:teuthology.orchestra.run.smithi135.stdout:12 Sep 00:00:11 ntpd[18537]: Listen normally on 3 enp3s0f1 172.21.15.135:123 2024-09-12T00:00:11.068 INFO:teuthology.orchestra.run.smithi135.stdout:12 Sep 00:00:11 ntpd[18537]: Listen normally on 4 lo [::1]:123 2024-09-12T00:00:11.069 INFO:teuthology.orchestra.run.smithi135.stdout:12 Sep 00:00:11 ntpd[18537]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8083%5]:123 2024-09-12T00:00:11.069 INFO:teuthology.orchestra.run.smithi135.stdout:12 Sep 00:00:11 ntpd[18537]: Listening on routing socket on fd #22 for interface updates 2024-09-12T00:00:12.063 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:12 ntpd[18537]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:12.063 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:12 ntpd[18537]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:13.042 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:13 ntpd[18440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:13.042 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:13 ntpd[18440]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:13.042 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:13 ntpd[18440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:13.042 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:13 ntpd[18440]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:13.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:13 ntpd[18440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:13.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:13 ntpd[18440]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:13.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:13 ntpd[18440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:00:13.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:13 ntpd[18440]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:00:13.063 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:13 ntpd[18537]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:13.063 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:13 ntpd[18537]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:13.063 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:13 ntpd[18537]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:13.063 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:13 ntpd[18537]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:13.063 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:13 ntpd[18537]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:00:13.063 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:13 ntpd[18537]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:00:14.063 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:14 ntpd[18537]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:14.063 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:14 ntpd[18537]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:14.063 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:14 ntpd[18537]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:14.063 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:14 ntpd[18537]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:14.063 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:14 ntpd[18537]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:00:14.063 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:14 ntpd[18537]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:00:15.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:15 ntpd[18440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:15.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:15 ntpd[18440]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:15.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:15 ntpd[18440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:15.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:15 ntpd[18440]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:15.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:15 ntpd[18440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:15.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:15 ntpd[18440]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:15.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:15 ntpd[18440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:00:15.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:15 ntpd[18440]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:00:15.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:15 ntpd[18440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:15.044 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:15 ntpd[18440]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:15.044 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:15 ntpd[18440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:00:15.044 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:15 ntpd[18440]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:00:15.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:15 ntpd[18537]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:15.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:15 ntpd[18537]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:15.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:15 ntpd[18537]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:15.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:15 ntpd[18537]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:15.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:15 ntpd[18537]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:15.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:15 ntpd[18537]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:15.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:15 ntpd[18537]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:00:15.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:15 ntpd[18537]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:00:15.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:15 ntpd[18537]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:15.065 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:15 ntpd[18537]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:15.071 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:15 ntpd[18537]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:00:15.071 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:15 ntpd[18537]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:00:16.042 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:16 ntpd[18440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:16.042 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:16 ntpd[18440]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:16.042 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:16 ntpd[18440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:16.042 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:16 ntpd[18440]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:16.042 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:16 ntpd[18440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:00:16.042 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:16 ntpd[18440]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:00:16.063 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:16 ntpd[18537]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:16.063 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:16 ntpd[18537]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:16.063 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:16 ntpd[18537]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:16.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:16 ntpd[18537]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:16.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:16 ntpd[18537]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:00:16.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:16 ntpd[18537]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:00:17.042 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:17 ntpd[18440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:17.042 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:17 ntpd[18440]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:17.042 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:17 ntpd[18440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:17.042 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:17 ntpd[18440]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:17.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:17 ntpd[18440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:17.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:17 ntpd[18440]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:17.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:17 ntpd[18440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:00:17.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:17 ntpd[18440]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:00:17.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:17 ntpd[18440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:17.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:17 ntpd[18440]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:17.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:17 ntpd[18440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:00:17.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:17 ntpd[18440]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:00:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:17 ntpd[18537]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:17 ntpd[18537]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:17 ntpd[18537]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:17 ntpd[18537]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:17 ntpd[18537]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:17 ntpd[18537]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:17 ntpd[18537]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:00:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:17 ntpd[18537]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:00:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:17 ntpd[18537]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:17 ntpd[18537]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:17 ntpd[18537]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:00:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:17 ntpd[18537]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:00:18.042 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:18 ntpd[18440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:18.042 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:18 ntpd[18440]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:18.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:18 ntpd[18440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:18.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:18 ntpd[18440]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:18.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:18 ntpd[18440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:00:18.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:18 ntpd[18440]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:00:18.063 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:18 ntpd[18537]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:18.063 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:18 ntpd[18537]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:18.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:18 ntpd[18537]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:18.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:18 ntpd[18537]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:18.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:18 ntpd[18537]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:00:18.064 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:18 ntpd[18537]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:00:19.042 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:19 ntpd[18440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:19.042 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:19 ntpd[18440]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:19.042 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:19 ntpd[18440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:19.042 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:19 ntpd[18440]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:19 ntpd[18440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:19 ntpd[18440]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:19 ntpd[18440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:00:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:19 ntpd[18440]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:00:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:19 ntpd[18440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:19 ntpd[18440]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:19 ntpd[18440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:00:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:19 ntpd[18440]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:00:19.043 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 00:00:19 ntpd[18440]: ntpd: time slew +0.002766 s 2024-09-12T00:00:19.043 INFO:teuthology.orchestra.run.smithi019.stdout:ntpd: time slew +0.002766s 2024-09-12T00:00:19.044 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:19 ntpd[18440]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T00:00:19.044 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 00:00:19 ntpd[18440]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T00:00:19.065 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:19 ntpd[18537]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:19.065 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:19 ntpd[18537]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:19.065 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:19 ntpd[18537]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:19.065 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:19 ntpd[18537]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:19.065 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:19 ntpd[18537]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:19.065 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:19 ntpd[18537]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:19.066 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:19 ntpd[18537]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:00:19.066 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:19 ntpd[18537]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:00:19.066 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:19 ntpd[18537]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:00:19.066 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:19 ntpd[18537]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:00:19.066 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:19 ntpd[18537]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:00:19.066 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:19 ntpd[18537]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:00:19.067 INFO:teuthology.orchestra.run.smithi135.stdout:12 Sep 00:00:19 ntpd[18537]: ntpd: time slew +0.001341 s 2024-09-12T00:00:19.067 INFO:teuthology.orchestra.run.smithi135.stdout:ntpd: time slew +0.001341s 2024-09-12T00:00:19.067 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:19 ntpd[18537]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T00:00:19.068 INFO:teuthology.orchestra.run.smithi135.stderr:12 Sep 00:00:19 ntpd[18537]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T00:00:19.094 INFO:teuthology.orchestra.run.smithi019.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:00:19.094 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================== 2024-09-12T00:00:19.095 INFO:teuthology.orchestra.run.smithi019.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:00:19.095 INFO:teuthology.orchestra.run.smithi019.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:00:19.095 INFO:teuthology.orchestra.run.smithi019.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:00:19.095 INFO:teuthology.orchestra.run.smithi019.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:00:19.115 INFO:teuthology.orchestra.run.smithi135.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:00:19.115 INFO:teuthology.orchestra.run.smithi135.stdout:============================================================================== 2024-09-12T00:00:19.115 INFO:teuthology.orchestra.run.smithi135.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:00:19.115 INFO:teuthology.orchestra.run.smithi135.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:00:19.115 INFO:teuthology.orchestra.run.smithi135.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:00:19.115 INFO:teuthology.orchestra.run.smithi135.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:00:19.115 INFO:teuthology.run_tasks:Running task install... 2024-09-12T00:00:19.122 DEBUG:teuthology.task.install:project ceph 2024-09-12T00:00:19.122 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-12T00:00:19.123 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'} 2024-09-12T00:00:19.123 INFO:teuthology.task.install:Using flavor: default 2024-09-12T00:00:19.128 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T00:00:19.128 INFO:teuthology.task.install:extra packages: [] 2024-09-12T00:00:19.129 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-key list | grep Ceph 2024-09-12T00:00:19.129 DEBUG:teuthology.orchestra.run.smithi135:> sudo apt-key list | grep Ceph 2024-09-12T00:00:19.193 INFO:teuthology.orchestra.run.smithi019.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T00:00:19.215 INFO:teuthology.orchestra.run.smithi135.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T00:00:19.221 INFO:teuthology.orchestra.run.smithi019.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T00:00:19.221 INFO:teuthology.orchestra.run.smithi019.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T00:00:19.222 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T00:00:19.222 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:00:19.242 INFO:teuthology.orchestra.run.smithi135.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T00:00:19.242 INFO:teuthology.orchestra.run.smithi135.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T00:00:19.242 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T00:00:19.243 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:00:19.370 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-12T00:00:19.371 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:00:19.395 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-12T00:00:19.395 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:00:19.494 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:00:19.494 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T00:00:19.509 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-get update 2024-09-12T00:00:19.512 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:00:19.512 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T00:00:19.527 DEBUG:teuthology.orchestra.run.smithi135:> sudo apt-get update 2024-09-12T00:00:19.681 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:00:19.685 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:00:19.692 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:00:19.709 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:00:19.736 INFO:teuthology.orchestra.run.smithi019.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T00:00:19.752 INFO:teuthology.orchestra.run.smithi135.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T00:00:19.757 INFO:teuthology.orchestra.run.smithi019.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T00:00:19.774 INFO:teuthology.orchestra.run.smithi135.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T00:00:19.778 INFO:teuthology.orchestra.run.smithi019.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T00:00:19.797 INFO:teuthology.orchestra.run.smithi135.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T00:00:19.799 INFO:teuthology.orchestra.run.smithi019.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-12T00:00:19.818 INFO:teuthology.orchestra.run.smithi135.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-12T00:00:19.826 INFO:teuthology.orchestra.run.smithi019.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-12T00:00:19.838 INFO:teuthology.orchestra.run.smithi135.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:00:19.838 INFO:teuthology.orchestra.run.smithi135.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:00:19.859 INFO:teuthology.orchestra.run.smithi135.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-12T00:00:19.901 INFO:teuthology.orchestra.run.smithi135.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:00:19.984 INFO:teuthology.orchestra.run.smithi135.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:00:20.045 INFO:teuthology.orchestra.run.smithi019.stdout:Fetched 29.2 kB in 0s (83.4 kB/s) 2024-09-12T00:00:20.191 INFO:teuthology.orchestra.run.smithi135.stdout:Fetched 29.2 kB in 0s (60.8 kB/s) 2024-09-12T00:00:21.073 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2024-09-12T00:00:21.090 DEBUG:teuthology.orchestra.run.smithi019:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-12T00:00:21.157 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2024-09-12T00:00:21.185 INFO:teuthology.orchestra.run.smithi135.stdout:Reading package lists... 2024-09-12T00:00:21.200 DEBUG:teuthology.orchestra.run.smithi135:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-12T00:00:21.254 INFO:teuthology.orchestra.run.smithi135.stdout:Reading package lists... 2024-09-12T00:00:21.367 INFO:teuthology.orchestra.run.smithi019.stdout:Building dependency tree... 2024-09-12T00:00:21.368 INFO:teuthology.orchestra.run.smithi019.stdout:Reading state information... 2024-09-12T00:00:21.441 INFO:teuthology.orchestra.run.smithi135.stdout:Building dependency tree... 2024-09-12T00:00:21.441 INFO:teuthology.orchestra.run.smithi135.stdout:Reading state information... 2024-09-12T00:00:21.582 INFO:teuthology.orchestra.run.smithi019.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:00:21.582 INFO:teuthology.orchestra.run.smithi019.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:00:21.582 INFO:teuthology.orchestra.run.smithi019.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:00:21.583 INFO:teuthology.orchestra.run.smithi019.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:00:21.584 INFO:teuthology.orchestra.run.smithi019.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:00:21.584 INFO:teuthology.orchestra.run.smithi019.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:00:21.584 INFO:teuthology.orchestra.run.smithi019.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:00:21.584 INFO:teuthology.orchestra.run.smithi019.stdout:The following additional packages will be installed: 2024-09-12T00:00:21.585 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T00:00:21.585 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T00:00:21.585 INFO:teuthology.orchestra.run.smithi019.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T00:00:21.585 INFO:teuthology.orchestra.run.smithi019.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T00:00:21.587 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T00:00:21.587 INFO:teuthology.orchestra.run.smithi019.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T00:00:21.587 INFO:teuthology.orchestra.run.smithi019.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T00:00:21.587 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T00:00:21.587 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T00:00:21.587 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:00:21.587 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:00:21.587 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:00:21.587 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:00:21.587 INFO:teuthology.orchestra.run.smithi019.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:00:21.588 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:00:21.588 INFO:teuthology.orchestra.run.smithi019.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:00:21.588 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T00:00:21.588 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T00:00:21.588 INFO:teuthology.orchestra.run.smithi019.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T00:00:21.588 INFO:teuthology.orchestra.run.smithi019.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T00:00:21.588 INFO:teuthology.orchestra.run.smithi019.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T00:00:21.588 INFO:teuthology.orchestra.run.smithi019.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T00:00:21.588 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T00:00:21.588 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet zip 2024-09-12T00:00:21.588 INFO:teuthology.orchestra.run.smithi019.stdout:Suggested packages: 2024-09-12T00:00:21.588 INFO:teuthology.orchestra.run.smithi019.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T00:00:21.589 INFO:teuthology.orchestra.run.smithi019.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T00:00:21.589 INFO:teuthology.orchestra.run.smithi019.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T00:00:21.589 INFO:teuthology.orchestra.run.smithi019.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T00:00:21.589 INFO:teuthology.orchestra.run.smithi019.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T00:00:21.589 INFO:teuthology.orchestra.run.smithi019.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T00:00:21.589 INFO:teuthology.orchestra.run.smithi019.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T00:00:21.589 INFO:teuthology.orchestra.run.smithi019.stdout:Recommended packages: 2024-09-12T00:00:21.589 INFO:teuthology.orchestra.run.smithi019.stdout: btrfs-tools 2024-09-12T00:00:21.626 INFO:teuthology.orchestra.run.smithi135.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:00:21.626 INFO:teuthology.orchestra.run.smithi135.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:00:21.626 INFO:teuthology.orchestra.run.smithi135.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:00:21.626 INFO:teuthology.orchestra.run.smithi135.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:00:21.626 INFO:teuthology.orchestra.run.smithi135.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:00:21.626 INFO:teuthology.orchestra.run.smithi135.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:00:21.626 INFO:teuthology.orchestra.run.smithi135.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:00:21.628 INFO:teuthology.orchestra.run.smithi135.stdout:The following additional packages will be installed: 2024-09-12T00:00:21.629 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T00:00:21.629 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T00:00:21.629 INFO:teuthology.orchestra.run.smithi135.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T00:00:21.629 INFO:teuthology.orchestra.run.smithi135.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T00:00:21.629 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T00:00:21.629 INFO:teuthology.orchestra.run.smithi135.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T00:00:21.629 INFO:teuthology.orchestra.run.smithi135.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T00:00:21.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T00:00:21.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T00:00:21.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:00:21.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:00:21.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:00:21.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:00:21.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:00:21.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:00:21.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:00:21.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T00:00:21.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T00:00:21.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T00:00:21.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T00:00:21.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T00:00:21.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T00:00:21.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T00:00:21.632 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet zip 2024-09-12T00:00:21.632 INFO:teuthology.orchestra.run.smithi135.stdout:Suggested packages: 2024-09-12T00:00:21.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T00:00:21.632 INFO:teuthology.orchestra.run.smithi135.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T00:00:21.632 INFO:teuthology.orchestra.run.smithi135.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T00:00:21.633 INFO:teuthology.orchestra.run.smithi135.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T00:00:21.633 INFO:teuthology.orchestra.run.smithi135.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T00:00:21.633 INFO:teuthology.orchestra.run.smithi135.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T00:00:21.633 INFO:teuthology.orchestra.run.smithi135.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T00:00:21.633 INFO:teuthology.orchestra.run.smithi135.stdout:Recommended packages: 2024-09-12T00:00:21.633 INFO:teuthology.orchestra.run.smithi135.stdout: btrfs-tools 2024-09-12T00:00:21.699 INFO:teuthology.orchestra.run.smithi019.stdout:The following NEW packages will be installed: 2024-09-12T00:00:21.699 INFO:teuthology.orchestra.run.smithi019.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T00:00:21.699 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T00:00:21.699 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T00:00:21.700 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T00:00:21.700 INFO:teuthology.orchestra.run.smithi019.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T00:00:21.700 INFO:teuthology.orchestra.run.smithi019.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T00:00:21.700 INFO:teuthology.orchestra.run.smithi019.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T00:00:21.700 INFO:teuthology.orchestra.run.smithi019.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T00:00:21.700 INFO:teuthology.orchestra.run.smithi019.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T00:00:21.700 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T00:00:21.700 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T00:00:21.700 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:00:21.701 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:00:21.701 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:00:21.701 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:00:21.701 INFO:teuthology.orchestra.run.smithi019.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:00:21.701 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:00:21.701 INFO:teuthology.orchestra.run.smithi019.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:00:21.701 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T00:00:21.701 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T00:00:21.701 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T00:00:21.701 INFO:teuthology.orchestra.run.smithi019.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T00:00:21.702 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T00:00:21.702 INFO:teuthology.orchestra.run.smithi019.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T00:00:21.702 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T00:00:21.702 INFO:teuthology.orchestra.run.smithi019.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T00:00:21.735 INFO:teuthology.orchestra.run.smithi135.stdout:The following NEW packages will be installed: 2024-09-12T00:00:21.736 INFO:teuthology.orchestra.run.smithi135.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T00:00:21.736 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T00:00:21.736 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T00:00:21.736 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T00:00:21.736 INFO:teuthology.orchestra.run.smithi135.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T00:00:21.736 INFO:teuthology.orchestra.run.smithi135.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T00:00:21.736 INFO:teuthology.orchestra.run.smithi135.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T00:00:21.737 INFO:teuthology.orchestra.run.smithi135.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T00:00:21.737 INFO:teuthology.orchestra.run.smithi135.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T00:00:21.737 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T00:00:21.737 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T00:00:21.737 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:00:21.738 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:00:21.738 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:00:21.738 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:00:21.738 INFO:teuthology.orchestra.run.smithi135.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:00:21.738 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:00:21.739 INFO:teuthology.orchestra.run.smithi135.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:00:21.739 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T00:00:21.739 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T00:00:21.739 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T00:00:21.739 INFO:teuthology.orchestra.run.smithi135.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T00:00:21.740 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T00:00:21.740 INFO:teuthology.orchestra.run.smithi135.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T00:00:21.740 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T00:00:21.740 INFO:teuthology.orchestra.run.smithi135.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T00:00:21.841 INFO:teuthology.orchestra.run.smithi019.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:00:21.841 INFO:teuthology.orchestra.run.smithi019.stdout:Need to get 251 MB of archives. 2024-09-12T00:00:21.841 INFO:teuthology.orchestra.run.smithi019.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-12T00:00:21.841 INFO:teuthology.orchestra.run.smithi019.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-12T00:00:21.875 INFO:teuthology.orchestra.run.smithi135.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:00:21.876 INFO:teuthology.orchestra.run.smithi135.stdout:Need to get 251 MB of archives. 2024-09-12T00:00:21.876 INFO:teuthology.orchestra.run.smithi135.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-12T00:00:21.876 INFO:teuthology.orchestra.run.smithi135.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-12T00:00:21.887 INFO:teuthology.orchestra.run.smithi019.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T00:00:21.923 INFO:teuthology.orchestra.run.smithi135.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T00:00:22.187 INFO:teuthology.orchestra.run.smithi019.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-12T00:00:22.308 INFO:teuthology.orchestra.run.smithi019.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T00:00:22.320 INFO:teuthology.orchestra.run.smithi019.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T00:00:22.347 INFO:teuthology.orchestra.run.smithi135.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T00:00:22.353 INFO:teuthology.orchestra.run.smithi135.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-12T00:00:22.359 INFO:teuthology.orchestra.run.smithi135.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T00:00:22.401 INFO:teuthology.orchestra.run.smithi019.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T00:00:22.410 INFO:teuthology.orchestra.run.smithi019.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-12T00:00:22.425 INFO:teuthology.orchestra.run.smithi019.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-12T00:00:22.433 INFO:teuthology.orchestra.run.smithi019.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-12T00:00:22.440 INFO:teuthology.orchestra.run.smithi135.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T00:00:22.485 INFO:teuthology.orchestra.run.smithi019.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-12T00:00:22.489 INFO:teuthology.orchestra.run.smithi019.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-12T00:00:22.491 INFO:teuthology.orchestra.run.smithi019.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-12T00:00:22.500 INFO:teuthology.orchestra.run.smithi019.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-12T00:00:22.630 INFO:teuthology.orchestra.run.smithi019.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T00:00:22.640 INFO:teuthology.orchestra.run.smithi019.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T00:00:22.669 INFO:teuthology.orchestra.run.smithi135.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T00:00:22.670 INFO:teuthology.orchestra.run.smithi019.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T00:00:22.679 INFO:teuthology.orchestra.run.smithi019.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T00:00:22.680 INFO:teuthology.orchestra.run.smithi019.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T00:00:22.680 INFO:teuthology.orchestra.run.smithi135.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T00:00:22.681 INFO:teuthology.orchestra.run.smithi019.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T00:00:22.699 INFO:teuthology.orchestra.run.smithi019.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T00:00:22.704 INFO:teuthology.orchestra.run.smithi019.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T00:00:22.707 INFO:teuthology.orchestra.run.smithi135.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-12T00:00:22.708 INFO:teuthology.orchestra.run.smithi019.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T00:00:22.710 INFO:teuthology.orchestra.run.smithi135.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T00:00:22.712 INFO:teuthology.orchestra.run.smithi019.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T00:00:22.719 INFO:teuthology.orchestra.run.smithi135.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T00:00:22.719 INFO:teuthology.orchestra.run.smithi135.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T00:00:22.721 INFO:teuthology.orchestra.run.smithi135.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T00:00:22.739 INFO:teuthology.orchestra.run.smithi135.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T00:00:22.743 INFO:teuthology.orchestra.run.smithi135.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T00:00:22.747 INFO:teuthology.orchestra.run.smithi135.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T00:00:22.752 INFO:teuthology.orchestra.run.smithi135.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T00:00:22.772 INFO:teuthology.orchestra.run.smithi135.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-12T00:00:22.792 INFO:teuthology.orchestra.run.smithi019.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T00:00:22.796 INFO:teuthology.orchestra.run.smithi019.stdout:Get:25 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-12T00:00:22.796 INFO:teuthology.orchestra.run.smithi019.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T00:00:22.801 INFO:teuthology.orchestra.run.smithi019.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T00:00:22.805 INFO:teuthology.orchestra.run.smithi019.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T00:00:22.805 INFO:teuthology.orchestra.run.smithi019.stdout:Get:29 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-12T00:00:22.832 INFO:teuthology.orchestra.run.smithi135.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T00:00:22.832 INFO:teuthology.orchestra.run.smithi135.stdout:Get:20 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-12T00:00:22.833 INFO:teuthology.orchestra.run.smithi019.stdout:Get:30 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-12T00:00:22.833 INFO:teuthology.orchestra.run.smithi019.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T00:00:22.833 INFO:teuthology.orchestra.run.smithi135.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-12T00:00:22.834 INFO:teuthology.orchestra.run.smithi019.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T00:00:22.836 INFO:teuthology.orchestra.run.smithi135.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T00:00:22.836 INFO:teuthology.orchestra.run.smithi019.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T00:00:22.837 INFO:teuthology.orchestra.run.smithi019.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T00:00:22.837 INFO:teuthology.orchestra.run.smithi019.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T00:00:22.840 INFO:teuthology.orchestra.run.smithi135.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T00:00:22.842 INFO:teuthology.orchestra.run.smithi135.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-12T00:00:22.844 INFO:teuthology.orchestra.run.smithi135.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T00:00:22.845 INFO:teuthology.orchestra.run.smithi135.stdout:Get:26 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-12T00:00:22.845 INFO:teuthology.orchestra.run.smithi135.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T00:00:22.846 INFO:teuthology.orchestra.run.smithi135.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T00:00:22.848 INFO:teuthology.orchestra.run.smithi135.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T00:00:22.848 INFO:teuthology.orchestra.run.smithi135.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T00:00:22.849 INFO:teuthology.orchestra.run.smithi135.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T00:00:22.874 INFO:teuthology.orchestra.run.smithi019.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T00:00:22.899 INFO:teuthology.orchestra.run.smithi135.stdout:Get:32 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-12T00:00:22.915 INFO:teuthology.orchestra.run.smithi135.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T00:00:22.920 INFO:teuthology.orchestra.run.smithi019.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T00:00:22.920 INFO:teuthology.orchestra.run.smithi019.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T00:00:22.921 INFO:teuthology.orchestra.run.smithi019.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T00:00:22.926 INFO:teuthology.orchestra.run.smithi019.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T00:00:22.927 INFO:teuthology.orchestra.run.smithi019.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T00:00:22.928 INFO:teuthology.orchestra.run.smithi019.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T00:00:22.929 INFO:teuthology.orchestra.run.smithi019.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T00:00:22.932 INFO:teuthology.orchestra.run.smithi135.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T00:00:22.933 INFO:teuthology.orchestra.run.smithi135.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T00:00:22.933 INFO:teuthology.orchestra.run.smithi135.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T00:00:22.938 INFO:teuthology.orchestra.run.smithi135.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T00:00:22.939 INFO:teuthology.orchestra.run.smithi135.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T00:00:22.956 INFO:teuthology.orchestra.run.smithi019.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T00:00:22.956 INFO:teuthology.orchestra.run.smithi019.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T00:00:23.008 INFO:teuthology.orchestra.run.smithi135.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T00:00:23.009 INFO:teuthology.orchestra.run.smithi135.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T00:00:23.010 INFO:teuthology.orchestra.run.smithi135.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T00:00:23.011 INFO:teuthology.orchestra.run.smithi135.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T00:00:23.037 INFO:teuthology.orchestra.run.smithi019.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T00:00:23.039 INFO:teuthology.orchestra.run.smithi019.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T00:00:23.040 INFO:teuthology.orchestra.run.smithi019.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T00:00:23.041 INFO:teuthology.orchestra.run.smithi019.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T00:00:23.052 INFO:teuthology.orchestra.run.smithi019.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T00:00:23.053 INFO:teuthology.orchestra.run.smithi019.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T00:00:23.054 INFO:teuthology.orchestra.run.smithi019.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T00:00:23.078 INFO:teuthology.orchestra.run.smithi135.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T00:00:23.080 INFO:teuthology.orchestra.run.smithi135.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T00:00:23.081 INFO:teuthology.orchestra.run.smithi135.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T00:00:23.082 INFO:teuthology.orchestra.run.smithi135.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T00:00:23.093 INFO:teuthology.orchestra.run.smithi135.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T00:00:23.118 INFO:teuthology.orchestra.run.smithi019.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T00:00:23.120 INFO:teuthology.orchestra.run.smithi019.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T00:00:23.124 INFO:teuthology.orchestra.run.smithi019.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T00:00:23.159 INFO:teuthology.orchestra.run.smithi135.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T00:00:23.160 INFO:teuthology.orchestra.run.smithi135.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T00:00:23.161 INFO:teuthology.orchestra.run.smithi135.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T00:00:23.164 INFO:teuthology.orchestra.run.smithi135.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T00:00:23.168 INFO:teuthology.orchestra.run.smithi135.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T00:00:23.199 INFO:teuthology.orchestra.run.smithi019.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T00:00:23.202 INFO:teuthology.orchestra.run.smithi019.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T00:00:23.203 INFO:teuthology.orchestra.run.smithi019.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T00:00:23.208 INFO:teuthology.orchestra.run.smithi019.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T00:00:23.209 INFO:teuthology.orchestra.run.smithi019.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T00:00:23.211 INFO:teuthology.orchestra.run.smithi019.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T00:00:23.215 INFO:teuthology.orchestra.run.smithi019.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T00:00:23.241 INFO:teuthology.orchestra.run.smithi135.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T00:00:23.243 INFO:teuthology.orchestra.run.smithi135.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T00:00:23.245 INFO:teuthology.orchestra.run.smithi135.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T00:00:23.249 INFO:teuthology.orchestra.run.smithi135.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T00:00:23.250 INFO:teuthology.orchestra.run.smithi135.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T00:00:23.323 INFO:teuthology.orchestra.run.smithi135.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T00:00:23.329 INFO:teuthology.orchestra.run.smithi135.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T00:00:23.376 INFO:teuthology.orchestra.run.smithi019.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T00:00:23.378 INFO:teuthology.orchestra.run.smithi019.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T00:00:23.381 INFO:teuthology.orchestra.run.smithi019.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T00:00:23.381 INFO:teuthology.orchestra.run.smithi019.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T00:00:23.384 INFO:teuthology.orchestra.run.smithi019.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T00:00:23.447 INFO:teuthology.orchestra.run.smithi019.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T00:00:23.450 INFO:teuthology.orchestra.run.smithi019.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T00:00:23.451 INFO:teuthology.orchestra.run.smithi019.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T00:00:23.491 INFO:teuthology.orchestra.run.smithi135.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T00:00:23.492 INFO:teuthology.orchestra.run.smithi135.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T00:00:23.495 INFO:teuthology.orchestra.run.smithi135.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T00:00:23.495 INFO:teuthology.orchestra.run.smithi135.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T00:00:23.497 INFO:teuthology.orchestra.run.smithi135.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T00:00:23.526 INFO:teuthology.orchestra.run.smithi019.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T00:00:23.527 INFO:teuthology.orchestra.run.smithi019.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T00:00:23.533 INFO:teuthology.orchestra.run.smithi135.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T00:00:23.536 INFO:teuthology.orchestra.run.smithi135.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T00:00:23.536 INFO:teuthology.orchestra.run.smithi135.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T00:00:23.542 INFO:teuthology.orchestra.run.smithi019.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T00:00:23.543 INFO:teuthology.orchestra.run.smithi019.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T00:00:23.544 INFO:teuthology.orchestra.run.smithi019.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T00:00:23.545 INFO:teuthology.orchestra.run.smithi019.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T00:00:23.546 INFO:teuthology.orchestra.run.smithi019.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T00:00:23.547 INFO:teuthology.orchestra.run.smithi019.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T00:00:23.553 INFO:teuthology.orchestra.run.smithi019.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T00:00:23.595 INFO:teuthology.orchestra.run.smithi135.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T00:00:23.595 INFO:teuthology.orchestra.run.smithi135.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T00:00:23.624 INFO:teuthology.orchestra.run.smithi019.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T00:00:23.627 INFO:teuthology.orchestra.run.smithi019.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T00:00:23.628 INFO:teuthology.orchestra.run.smithi019.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T00:00:23.657 INFO:teuthology.orchestra.run.smithi135.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T00:00:23.658 INFO:teuthology.orchestra.run.smithi135.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T00:00:23.658 INFO:teuthology.orchestra.run.smithi135.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T00:00:23.659 INFO:teuthology.orchestra.run.smithi135.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T00:00:23.660 INFO:teuthology.orchestra.run.smithi135.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T00:00:23.661 INFO:teuthology.orchestra.run.smithi135.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T00:00:23.668 INFO:teuthology.orchestra.run.smithi135.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T00:00:23.705 INFO:teuthology.orchestra.run.smithi019.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T00:00:23.711 INFO:teuthology.orchestra.run.smithi019.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T00:00:23.713 INFO:teuthology.orchestra.run.smithi019.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T00:00:23.714 INFO:teuthology.orchestra.run.smithi019.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T00:00:23.725 INFO:teuthology.orchestra.run.smithi019.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T00:00:23.727 INFO:teuthology.orchestra.run.smithi019.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T00:00:23.734 INFO:teuthology.orchestra.run.smithi019.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T00:00:23.738 INFO:teuthology.orchestra.run.smithi135.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T00:00:23.742 INFO:teuthology.orchestra.run.smithi135.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T00:00:23.743 INFO:teuthology.orchestra.run.smithi135.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T00:00:23.786 INFO:teuthology.orchestra.run.smithi019.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T00:00:23.788 INFO:teuthology.orchestra.run.smithi019.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T00:00:23.820 INFO:teuthology.orchestra.run.smithi135.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T00:00:23.826 INFO:teuthology.orchestra.run.smithi135.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T00:00:23.828 INFO:teuthology.orchestra.run.smithi135.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T00:00:23.830 INFO:teuthology.orchestra.run.smithi135.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T00:00:23.840 INFO:teuthology.orchestra.run.smithi135.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T00:00:23.842 INFO:teuthology.orchestra.run.smithi135.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T00:00:23.849 INFO:teuthology.orchestra.run.smithi135.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T00:00:23.850 INFO:teuthology.orchestra.run.smithi019.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T00:00:23.867 INFO:teuthology.orchestra.run.smithi019.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T00:00:23.874 INFO:teuthology.orchestra.run.smithi019.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T00:00:23.895 INFO:teuthology.orchestra.run.smithi019.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T00:00:23.901 INFO:teuthology.orchestra.run.smithi135.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T00:00:23.903 INFO:teuthology.orchestra.run.smithi135.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T00:00:23.904 INFO:teuthology.orchestra.run.smithi135.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T00:00:23.915 INFO:teuthology.orchestra.run.smithi135.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-12T00:00:23.917 INFO:teuthology.orchestra.run.smithi135.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-12T00:00:23.924 INFO:teuthology.orchestra.run.smithi019.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T00:00:23.949 INFO:teuthology.orchestra.run.smithi135.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-12T00:00:23.950 INFO:teuthology.orchestra.run.smithi019.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T00:00:23.950 INFO:teuthology.orchestra.run.smithi019.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-12T00:00:23.956 INFO:teuthology.orchestra.run.smithi019.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T00:00:23.959 INFO:teuthology.orchestra.run.smithi019.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T00:00:23.983 INFO:teuthology.orchestra.run.smithi135.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T00:00:23.985 INFO:teuthology.orchestra.run.smithi135.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T00:00:24.002 INFO:teuthology.orchestra.run.smithi135.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T00:00:24.003 INFO:teuthology.orchestra.run.smithi135.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T00:00:24.003 INFO:teuthology.orchestra.run.smithi135.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T00:00:24.008 INFO:teuthology.orchestra.run.smithi135.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T00:00:24.009 INFO:teuthology.orchestra.run.smithi135.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T00:00:24.035 INFO:teuthology.orchestra.run.smithi019.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-12T00:00:24.038 INFO:teuthology.orchestra.run.smithi019.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-12T00:00:24.040 INFO:teuthology.orchestra.run.smithi019.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-12T00:00:24.091 INFO:teuthology.orchestra.run.smithi019.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-12T00:00:24.287 INFO:teuthology.orchestra.run.smithi019.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-12T00:00:25.121 INFO:teuthology.orchestra.run.smithi019.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-12T00:00:25.122 INFO:teuthology.orchestra.run.smithi019.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-12T00:00:25.139 INFO:teuthology.orchestra.run.smithi019.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-12T00:00:25.182 INFO:teuthology.orchestra.run.smithi019.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-12T00:00:25.193 INFO:teuthology.orchestra.run.smithi019.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-12T00:00:25.195 INFO:teuthology.orchestra.run.smithi019.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-12T00:00:27.341 INFO:teuthology.orchestra.run.smithi019.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-12T00:00:27.535 INFO:teuthology.orchestra.run.smithi019.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-12T00:00:27.535 INFO:teuthology.orchestra.run.smithi019.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-12T00:00:27.946 INFO:teuthology.orchestra.run.smithi135.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-12T00:00:28.441 INFO:teuthology.orchestra.run.smithi135.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-12T00:00:28.453 INFO:teuthology.orchestra.run.smithi135.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-12T00:00:28.509 INFO:teuthology.orchestra.run.smithi135.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-12T00:00:28.738 INFO:teuthology.orchestra.run.smithi135.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-12T00:00:29.213 INFO:teuthology.orchestra.run.smithi019.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-12T00:00:29.241 INFO:teuthology.orchestra.run.smithi019.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-12T00:00:29.243 INFO:teuthology.orchestra.run.smithi019.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-12T00:00:29.435 INFO:teuthology.orchestra.run.smithi135.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-12T00:00:29.731 INFO:teuthology.orchestra.run.smithi019.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-12T00:00:30.324 INFO:teuthology.orchestra.run.smithi019.stdout:Fetched 251 MB in 8s (31.3 MB/s) 2024-09-12T00:00:30.447 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T00:00:30.547 INFO:teuthology.orchestra.run.smithi019.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T00:00:30.553 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T00:00:30.629 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:00:30.942 INFO:teuthology.orchestra.run.smithi135.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-12T00:00:30.943 INFO:teuthology.orchestra.run.smithi135.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-12T00:00:30.959 INFO:teuthology.orchestra.run.smithi135.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-12T00:00:30.966 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T00:00:30.993 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T00:00:31.032 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:00:31.090 INFO:teuthology.orchestra.run.smithi135.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-12T00:00:31.128 INFO:teuthology.orchestra.run.smithi135.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-12T00:00:31.132 INFO:teuthology.orchestra.run.smithi135.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-12T00:00:31.352 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T00:00:31.379 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T00:00:31.419 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:00:31.814 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T00:00:31.841 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:00:31.881 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:00:32.292 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T00:00:32.319 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:00:32.359 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:00:32.696 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T00:00:32.722 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:00:32.762 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:00:33.107 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T00:00:33.134 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T00:00:33.173 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:00:33.502 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package librados2. 2024-09-12T00:00:33.529 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:33.568 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:33.754 INFO:teuthology.orchestra.run.smithi135.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-12T00:00:33.972 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package librbd1. 2024-09-12T00:00:33.972 INFO:teuthology.orchestra.run.smithi135.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-12T00:00:33.972 INFO:teuthology.orchestra.run.smithi135.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-12T00:00:33.998 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:34.038 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:34.482 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T00:00:34.509 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:34.549 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:34.835 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-rados. 2024-09-12T00:00:34.861 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:34.901 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:35.204 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T00:00:35.233 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:00:35.262 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:35.482 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T00:00:35.509 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:35.564 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:35.884 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T00:00:35.911 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:00:35.951 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:36.104 INFO:teuthology.orchestra.run.smithi135.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-12T00:00:36.106 INFO:teuthology.orchestra.run.smithi135.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-12T00:00:36.166 INFO:teuthology.orchestra.run.smithi135.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-12T00:00:36.271 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T00:00:36.298 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T00:00:36.337 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:00:36.632 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T00:00:36.645 INFO:teuthology.orchestra.run.smithi135.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-12T00:00:36.659 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T00:00:36.699 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T00:00:36.959 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T00:00:36.975 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:37.018 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:37.223 INFO:teuthology.orchestra.run.smithi135.stdout:Fetched 251 MB in 15s (16.8 MB/s) 2024-09-12T00:00:37.338 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T00:00:37.364 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T00:00:37.386 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T00:00:37.404 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:00:37.486 INFO:teuthology.orchestra.run.smithi135.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T00:00:37.491 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T00:00:37.585 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:00:37.690 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T00:00:37.706 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T00:00:37.748 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:00:37.873 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T00:00:37.899 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T00:00:37.931 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:00:38.051 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T00:00:38.067 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T00:00:38.109 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:00:38.260 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T00:00:38.286 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T00:00:38.326 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:00:38.455 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package lua5.1. 2024-09-12T00:00:38.482 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T00:00:38.513 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:00:38.764 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T00:00:38.790 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:00:38.824 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package lua-any. 2024-09-12T00:00:38.838 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:00:38.840 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T00:00:39.056 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T00:00:39.243 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T00:00:39.269 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:00:39.310 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:00:39.419 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package zip. 2024-09-12T00:00:39.435 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T00:00:39.477 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T00:00:39.638 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T00:00:39.665 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:00:39.705 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:00:39.747 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package unzip. 2024-09-12T00:00:39.763 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T00:00:39.797 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:00:40.035 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T00:00:40.061 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T00:00:40.101 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:00:40.177 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package luarocks. 2024-09-12T00:00:40.203 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T00:00:40.243 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:00:40.438 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package librados2. 2024-09-12T00:00:40.464 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:40.504 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:40.626 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package librgw2. 2024-09-12T00:00:40.653 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:40.692 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:40.924 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package librbd1. 2024-09-12T00:00:40.939 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:40.976 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:41.336 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T00:00:41.363 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:41.403 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:41.421 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T00:00:41.447 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:41.487 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:41.689 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T00:00:41.705 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T00:00:41.739 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:00:41.777 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-rados. 2024-09-12T00:00:41.788 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:41.831 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:42.042 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T00:00:42.069 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:42.109 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:42.134 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T00:00:42.160 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:00:42.192 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:42.570 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-common. 2024-09-12T00:00:42.586 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T00:00:42.598 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:42.613 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:42.637 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:42.653 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:42.956 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T00:00:42.982 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:00:43.022 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:43.342 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T00:00:43.368 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T00:00:43.408 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:00:43.703 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T00:00:43.729 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T00:00:43.769 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T00:00:43.997 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T00:00:44.012 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:44.055 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:44.167 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-base. 2024-09-12T00:00:44.194 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:44.243 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:44.425 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T00:00:44.451 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T00:00:44.492 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:00:44.769 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T00:00:44.795 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T00:00:44.835 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:00:44.897 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T00:00:44.924 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T00:00:44.955 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:00:45.121 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T00:00:45.136 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T00:00:45.171 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:00:45.250 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T00:00:45.276 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T00:00:45.316 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:00:45.483 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package lua5.1. 2024-09-12T00:00:45.509 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T00:00:45.549 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:00:45.653 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T00:00:45.680 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T00:00:45.719 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:00:45.869 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package lua-any. 2024-09-12T00:00:45.895 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T00:00:45.975 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T00:00:46.031 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T00:00:46.058 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T00:00:46.097 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:00:46.183 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package zip. 2024-09-12T00:00:46.195 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T00:00:46.238 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T00:00:46.351 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T00:00:46.377 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T00:00:46.409 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:00:46.541 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package unzip. 2024-09-12T00:00:46.567 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T00:00:46.599 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:00:46.711 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T00:00:46.738 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T00:00:46.778 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T00:00:46.961 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package luarocks. 2024-09-12T00:00:46.987 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T00:00:47.028 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:00:47.081 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-portend. 2024-09-12T00:00:47.108 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T00:00:47.156 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T00:00:47.401 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package librgw2. 2024-09-12T00:00:47.428 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:47.434 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T00:00:47.450 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T00:00:47.484 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T00:00:47.540 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:47.753 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T00:00:47.780 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T00:00:47.820 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:00:48.115 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T00:00:48.142 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T00:00:48.162 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T00:00:48.188 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:48.190 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T00:00:48.229 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:48.502 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T00:00:48.529 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T00:00:48.565 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T00:00:48.568 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T00:00:48.591 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T00:00:48.631 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:00:48.897 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T00:00:48.918 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T00:00:48.923 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T00:00:48.933 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:48.963 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:00:48.967 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:49.241 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-mako. 2024-09-12T00:00:49.268 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T00:00:49.299 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:00:49.354 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package ceph-common. 2024-09-12T00:00:49.380 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:49.420 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:49.569 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T00:00:49.582 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T00:00:49.610 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:00:49.905 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T00:00:49.933 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T00:00:49.972 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:00:50.266 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-webob. 2024-09-12T00:00:50.294 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T00:00:50.333 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:00:50.694 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T00:00:50.722 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T00:00:50.764 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:00:50.959 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package ceph-base. 2024-09-12T00:00:50.985 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:51.035 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:51.064 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T00:00:51.091 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T00:00:51.122 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:00:51.375 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-paste. 2024-09-12T00:00:51.402 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T00:00:51.441 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:00:51.638 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T00:00:51.664 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T00:00:51.704 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:00:51.770 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T00:00:51.786 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T00:00:51.819 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:00:52.015 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T00:00:52.042 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T00:00:52.082 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:00:52.098 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T00:00:52.125 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T00:00:52.164 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:00:52.401 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T00:00:52.428 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T00:00:52.467 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T00:00:52.468 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:00:52.494 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T00:00:52.534 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T00:00:52.845 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T00:00:52.872 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T00:00:52.911 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:00:52.930 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T00:00:52.955 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T00:00:53.004 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:00:53.275 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T00:00:53.302 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T00:00:53.307 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T00:00:53.333 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T00:00:53.350 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T00:00:53.373 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:00:53.628 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-idna. 2024-09-12T00:00:53.655 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T00:00:53.659 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T00:00:53.686 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T00:00:53.694 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:00:53.726 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T00:00:53.995 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-portend. 2024-09-12T00:00:54.010 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T00:00:54.014 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T00:00:54.041 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T00:00:54.045 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T00:00:54.081 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:00:54.348 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T00:00:54.374 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T00:00:54.409 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-requests. 2024-09-12T00:00:54.414 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T00:00:54.436 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T00:00:54.475 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:00:54.717 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T00:00:54.744 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T00:00:54.784 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:00:54.895 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T00:00:54.922 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T00:00:54.954 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:00:55.838 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T00:00:55.861 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T00:00:55.897 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T00:00:56.140 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T00:00:56.156 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:00:56.190 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:56.199 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T00:00:56.225 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T00:00:56.266 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T00:00:56.569 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T00:00:56.586 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T00:00:56.595 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T00:00:56.614 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:56.635 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:00:56.686 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:56.938 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-mako. 2024-09-12T00:00:56.964 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T00:00:56.998 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T00:00:57.004 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:00:57.025 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T00:00:57.064 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:00:57.316 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T00:00:57.325 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T00:00:57.331 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T00:00:57.352 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T00:00:57.365 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:00:57.383 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T00:00:57.660 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T00:00:57.686 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T00:00:57.726 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:00:57.736 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T00:00:57.764 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:57.803 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:58.046 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-webob. 2024-09-12T00:00:58.072 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T00:00:58.112 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:00:58.198 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T00:00:58.225 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:58.265 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:58.457 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T00:00:58.483 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T00:00:58.526 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:00:58.826 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T00:00:58.835 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T00:00:58.853 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T00:00:58.862 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:00:58.893 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:00:58.894 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:00:59.196 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-paste. 2024-09-12T00:00:59.222 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T00:00:59.262 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:00:59.607 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T00:00:59.622 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T00:00:59.665 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:00:59.926 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T00:00:59.953 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T00:00:59.993 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:00:59.996 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph. 2024-09-12T00:01:00.023 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:01:00.063 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:00.287 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T00:01:00.315 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T00:01:00.354 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T00:01:00.382 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T00:01:00.409 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:01:00.449 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:00.665 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T00:01:00.692 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T00:01:00.731 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:01:00.802 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T00:01:00.829 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:01:00.868 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:01.095 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T00:01:01.121 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T00:01:01.161 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T00:01:01.205 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package cephadm. 2024-09-12T00:01:01.221 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:01:01.263 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:01.489 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-idna. 2024-09-12T00:01:01.515 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T00:01:01.556 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:01:01.583 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T00:01:01.610 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T00:01:01.650 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T00:01:01.842 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T00:01:01.860 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T00:01:01.892 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:01:01.961 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T00:01:01.977 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:01:02.019 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:01:02.195 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-requests. 2024-09-12T00:01:02.222 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T00:01:02.253 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:01:02.489 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T00:01:02.515 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T00:01:02.555 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:01:02.816 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T00:01:02.832 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:01:02.866 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:03.007 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-babel. 2024-09-12T00:01:03.035 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:01:03.074 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:01:03.393 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T00:01:03.421 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T00:01:03.446 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T00:01:03.460 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:01:03.473 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:01:03.512 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:03.799 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T00:01:03.825 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T00:01:03.830 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T00:01:03.857 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:01:03.865 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:01:03.896 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:04.109 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T00:01:04.125 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T00:01:04.160 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T00:01:04.250 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T00:01:04.278 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T00:01:04.316 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T00:01:04.496 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T00:01:04.522 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:01:04.562 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:04.619 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-routes. 2024-09-12T00:01:04.647 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T00:01:04.685 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:01:04.957 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T00:01:04.983 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:01:05.023 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:05.231 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T00:01:05.258 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:01:05.297 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T00:01:05.637 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:01:05.668 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:06.738 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package ceph. 2024-09-12T00:01:06.754 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:01:06.796 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:07.091 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T00:01:07.106 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:01:07.140 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:07.460 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T00:01:07.486 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:01:07.518 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:07.921 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package cephadm. 2024-09-12T00:01:07.948 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:01:07.987 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:08.178 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T00:01:08.208 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T00:01:08.252 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:01:08.307 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T00:01:08.333 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T00:01:08.373 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T00:01:08.781 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T00:01:08.809 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T00:01:08.843 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T00:01:08.847 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:01:08.869 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:01:08.909 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:01:09.159 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T00:01:09.187 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T00:01:09.226 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:01:09.579 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T00:01:09.606 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T00:01:09.645 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:01:09.931 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-babel. 2024-09-12T00:01:09.958 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:01:09.997 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:01:10.308 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T00:01:10.312 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T00:01:10.335 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T00:01:10.341 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:01:10.375 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:01:10.483 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:10.711 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T00:01:10.738 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:01:10.786 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:11.156 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T00:01:11.183 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T00:01:11.222 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T00:01:11.412 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T00:01:11.441 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T00:01:11.470 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T00:01:11.525 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-routes. 2024-09-12T00:01:11.552 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T00:01:11.592 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:01:11.765 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T00:01:11.793 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T00:01:11.831 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:01:11.878 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T00:01:11.894 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:01:11.945 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:12.151 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T00:01:12.180 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T00:01:12.218 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:01:12.529 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T00:01:12.557 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T00:01:12.595 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T00:01:12.941 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T00:01:12.969 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T00:01:13.007 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T00:01:13.294 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T00:01:13.322 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T00:01:13.352 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:01:13.622 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T00:01:13.650 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T00:01:13.688 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T00:01:14.017 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T00:01:14.045 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T00:01:14.083 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:01:14.688 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T00:01:14.705 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:01:14.746 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:14.766 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T00:01:14.796 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T00:01:14.832 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:01:15.033 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T00:01:15.061 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T00:01:15.091 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:01:15.286 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T00:01:15.313 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T00:01:15.352 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:01:15.778 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T00:01:15.806 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:01:15.844 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:01:15.872 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T00:01:15.899 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T00:01:15.941 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:01:16.122 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package jq. 2024-09-12T00:01:16.150 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:01:16.188 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T00:01:16.258 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T00:01:16.285 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T00:01:16.324 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:01:16.441 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package socat. 2024-09-12T00:01:16.469 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T00:01:16.507 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:01:16.786 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T00:01:16.802 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T00:01:16.835 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:01:16.961 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T00:01:16.986 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:01:17.101 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:17.215 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-test. 2024-09-12T00:01:17.268 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:01:17.273 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:18.063 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T00:01:18.091 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T00:01:18.129 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T00:01:18.432 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T00:01:18.460 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T00:01:18.498 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:01:18.818 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T00:01:18.846 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T00:01:18.877 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:01:19.171 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T00:01:19.201 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T00:01:19.229 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T00:01:19.541 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T00:01:19.569 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T00:01:19.608 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T00:01:19.752 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T00:01:19.781 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:01:19.818 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:19.928 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T00:01:19.955 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T00:01:19.994 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:01:20.139 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T00:01:20.168 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:01:20.205 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:20.306 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T00:01:20.334 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T00:01:20.372 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T00:01:20.500 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T00:01:20.529 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T00:01:20.567 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:01:20.650 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T00:01:20.678 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T00:01:20.708 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:01:20.905 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T00:01:20.933 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T00:01:20.971 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:01:21.342 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T00:01:21.370 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T00:01:21.372 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T00:01:21.400 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:01:21.408 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:01:21.438 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:21.741 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T00:01:21.769 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T00:01:21.807 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:01:21.839 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package pkg-config. 2024-09-12T00:01:21.867 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T00:01:21.905 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:01:22.132 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T00:01:22.144 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T00:01:22.149 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T00:01:22.172 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:01:22.191 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:01:22.210 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:01:22.448 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package jq. 2024-09-12T00:01:22.464 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:01:22.506 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T00:01:22.611 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T00:01:22.639 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T00:01:22.677 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T00:01:22.784 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package socat. 2024-09-12T00:01:22.800 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T00:01:22.842 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:01:22.955 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T00:01:22.984 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T00:01:23.021 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T00:01:23.138 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T00:01:23.165 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T00:01:23.204 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:01:23.341 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T00:01:23.358 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T00:01:23.399 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:01:23.550 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package ceph-test. 2024-09-12T00:01:23.566 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:01:23.608 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:23.711 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T00:01:23.740 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T00:01:23.777 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T00:01:24.106 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-py. 2024-09-12T00:01:24.134 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T00:01:24.172 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T00:01:24.492 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T00:01:24.520 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T00:01:24.558 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:01:25.029 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T00:01:25.058 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T00:01:25.096 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:01:25.373 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-toml. 2024-09-12T00:01:25.390 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T00:01:25.423 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T00:01:25.735 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T00:01:25.763 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T00:01:25.801 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:01:26.246 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T00:01:26.274 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:01:26.312 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:26.404 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T00:01:26.422 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T00:01:26.454 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:01:26.642 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T00:01:26.667 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:01:26.673 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T00:01:26.690 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T00:01:26.708 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:26.731 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:01:27.028 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T00:01:27.057 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T00:01:27.094 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:01:27.416 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T00:01:27.445 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T00:01:27.469 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package radosgw. 2024-09-12T00:01:27.474 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:01:27.498 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:01:27.535 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:27.836 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T00:01:27.865 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T00:01:27.903 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:01:28.317 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package pkg-config. 2024-09-12T00:01:28.345 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T00:01:28.383 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:01:28.464 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T00:01:28.492 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:01:28.530 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:28.644 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T00:01:28.661 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T00:01:28.702 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:01:28.834 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T00:01:29.110 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:01:29.123 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T00:01:29.151 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T00:01:29.189 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T00:01:29.236 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:01:29.484 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T00:01:29.505 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T00:01:29.512 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T00:01:29.542 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T00:01:29.844 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T00:01:29.862 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T00:01:29.890 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T00:01:29.928 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:01:30.190 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T00:01:30.218 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T00:01:30.273 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T00:01:30.295 INFO:teuthology.orchestra.run.smithi019.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T00:01:30.371 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:30.576 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-py. 2024-09-12T00:01:30.604 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T00:01:30.642 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T00:01:30.913 INFO:teuthology.orchestra.run.smithi019.stdout:Adding system user cephadm....done 2024-09-12T00:01:30.929 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T00:01:30.946 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T00:01:30.988 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:01:31.078 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:01:31.354 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:01:31.434 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T00:01:31.462 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T00:01:31.500 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:01:31.605 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:01:31.756 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:01:31.771 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-toml. 2024-09-12T00:01:31.786 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T00:01:31.819 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T00:01:32.015 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T00:01:32.106 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T00:01:32.134 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T00:01:32.172 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:01:32.267 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:01:32.376 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T00:01:32.484 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T00:01:32.512 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T00:01:32.542 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:01:32.678 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:01:32.787 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T00:01:32.804 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T00:01:32.837 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:01:33.055 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T00:01:33.331 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T00:01:33.558 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package radosgw. 2024-09-12T00:01:33.586 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:01:33.607 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:01:33.624 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:33.842 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:01:34.085 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:01:34.344 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:01:34.535 INFO:teuthology.orchestra.run.smithi135.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T00:01:34.552 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:01:34.585 INFO:teuthology.orchestra.run.smithi135.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:34.595 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:34.863 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:01:34.890 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T00:01:34.989 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:01:35.115 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:01:35.141 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:01:35.241 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:01:35.267 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:01:35.508 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:01:35.525 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T00:01:35.667 INFO:teuthology.orchestra.run.smithi019.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T00:01:35.687 INFO:teuthology.orchestra.run.smithi019.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T00:01:35.752 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:01:35.853 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T00:01:35.854 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T00:01:36.213 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:01:36.317 INFO:teuthology.orchestra.run.smithi135.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T00:01:36.339 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T00:01:36.394 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:36.615 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:01:36.882 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:01:36.910 INFO:teuthology.orchestra.run.smithi135.stdout:Adding system user cephadm....done 2024-09-12T00:01:37.066 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:01:37.193 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T00:01:37.318 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:01:37.334 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:01:37.569 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:01:37.695 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:01:37.963 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T00:01:37.995 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:01:38.215 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:01:38.246 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:01:38.341 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T00:01:38.372 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:01:38.498 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:01:38.642 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:01:38.816 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T00:01:39.002 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T00:01:39.201 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T00:01:39.262 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T00:01:39.443 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:01:39.530 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:01:39.773 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:01:39.863 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:01:40.025 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:01:40.154 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:01:40.284 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:01:40.506 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:01:40.527 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:40.765 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:01:40.886 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:01:40.916 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:41.045 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:01:41.171 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:01:41.234 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:01:41.306 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:01:41.560 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:01:41.565 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:01:41.713 INFO:teuthology.orchestra.run.smithi135.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T00:01:41.737 INFO:teuthology.orchestra.run.smithi135.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T00:01:41.810 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:01:41.935 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T00:01:42.295 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:01:42.421 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T00:01:42.680 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:01:42.874 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:01:42.932 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:01:43.102 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:01:43.244 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T00:01:43.250 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T00:01:43.376 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:01:43.503 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:01:43.604 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:01:43.713 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:01:44.031 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:01:44.061 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:01:44.299 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T00:01:44.320 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:01:44.438 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:01:44.539 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:01:44.550 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:01:44.676 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:01:44.824 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T00:01:44.986 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:01:45.225 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T00:01:45.237 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T00:01:45.468 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:01:45.488 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T00:01:45.764 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:01:45.828 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:01:46.023 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T00:01:46.121 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:01:46.291 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:01:46.393 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T00:01:46.514 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:01:46.677 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:01:46.757 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:01:46.786 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:01:46.883 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:47.062 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:01:47.192 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:01:47.372 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:01:47.535 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:01:47.648 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:01:47.773 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:01:47.891 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:01:47.963 INFO:teuthology.orchestra.run.smithi019.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T00:01:48.218 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:01:48.336 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:01:48.646 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:01:48.737 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:01:48.893 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:01:48.996 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T00:01:49.002 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T00:01:49.122 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T00:01:49.262 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:01:49.390 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:01:49.395 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:01:49.508 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:01:49.547 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:01:49.840 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:01:49.859 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:01:50.108 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T00:01:50.160 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:01:50.351 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:01:50.428 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T00:01:50.485 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:01:50.529 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T00:01:50.786 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:01:50.788 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T00:01:51.038 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T00:01:51.064 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:01:51.288 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T00:01:51.426 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:01:51.523 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:01:51.782 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T00:01:51.794 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T00:01:52.067 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:01:52.071 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:01:52.185 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T00:01:52.415 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:01:52.469 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:01:52.541 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:52.595 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:01:52.667 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:52.793 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:01:52.880 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:01:53.071 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:53.181 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:01:53.222 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:53.348 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T00:01:53.457 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:01:53.583 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:01:53.625 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:53.701 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:01:53.734 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:53.790 INFO:teuthology.orchestra.run.smithi135.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T00:01:53.844 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:54.028 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:01:54.072 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:01:54.072 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:01:54.154 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:01:54.538 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:01:54.553 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:54.654 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:54.763 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:54.798 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T00:01:54.889 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:01:54.924 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T00:01:55.183 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:01:55.301 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:01:55.636 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:01:55.920 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:01:56.196 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T00:01:56.201 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:56.322 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T00:01:56.327 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:56.428 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:56.563 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:56.599 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T00:01:56.714 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:56.875 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:01:57.228 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:01:57.250 INFO:teuthology.orchestra.run.smithi019.stdout:Adding group ceph....done 2024-09-12T00:01:57.596 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T00:01:57.652 INFO:teuthology.orchestra.run.smithi019.stdout:Adding system user ceph....done 2024-09-12T00:01:57.820 INFO:teuthology.orchestra.run.smithi019.stdout:Setting system user ceph properties....done 2024-09-12T00:01:57.833 INFO:teuthology.orchestra.run.smithi019.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T00:01:57.882 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:01:57.973 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T00:01:58.217 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:01:58.322 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T00:01:58.326 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:58.445 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:58.570 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:01:58.812 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:58.907 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:58.934 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:59.033 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:59.151 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T00:01:59.413 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:01:59.413 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:01:59.436 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:59.537 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:59.663 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:01:59.878 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:01:59.878 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:01:59.911 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:00.240 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T00:02:00.339 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:00.474 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:00.616 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:00.721 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:00.954 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:02:00.954 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:02:01.097 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:02:01.439 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:01.661 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:02:01.661 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:02:02.149 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:02.329 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:02.415 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:02:02.416 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:02:02.455 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:02.590 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:02.716 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:02.842 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:02.917 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:03.035 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:03.219 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:03.360 INFO:teuthology.orchestra.run.smithi135.stdout:Adding group ceph....done 2024-09-12T00:02:03.436 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:02:03.436 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:02:03.711 INFO:teuthology.orchestra.run.smithi135.stdout:Adding system user ceph....done 2024-09-12T00:02:03.830 INFO:teuthology.orchestra.run.smithi135.stdout:Setting system user ceph properties....done 2024-09-12T00:02:03.847 INFO:teuthology.orchestra.run.smithi135.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T00:02:03.921 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:03.985 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T00:02:04.072 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:04.198 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:04.318 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T00:02:04.366 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:04.794 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:02:04.818 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:04.911 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:02:04.936 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:05.064 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:02:05.457 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:02:05.457 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:02:05.913 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:06.115 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T00:02:06.279 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T00:02:06.732 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:06.812 INFO:teuthology.orchestra.run.smithi019.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:02:06.818 DEBUG:teuthology.parallel:result is None 2024-09-12T00:02:06.964 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:02:06.964 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:02:07.492 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:07.693 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:02:07.694 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:02:08.203 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:08.573 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:02:08.573 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:02:09.030 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:09.165 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:09.316 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:09.527 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:02:09.528 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:02:09.992 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:10.118 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:10.419 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:10.562 INFO:teuthology.orchestra.run.smithi135.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:02:10.924 INFO:teuthology.orchestra.run.smithi135.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:02:11.033 INFO:teuthology.orchestra.run.smithi135.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:02:11.177 INFO:teuthology.orchestra.run.smithi135.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:02:11.913 INFO:teuthology.orchestra.run.smithi135.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T00:02:12.561 INFO:teuthology.orchestra.run.smithi135.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:02:12.571 DEBUG:teuthology.parallel:result is None 2024-09-12T00:02:12.572 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:02:12.723 DEBUG:teuthology.orchestra.run.smithi019:> dpkg-query -W -f '${Version}' ceph 2024-09-12T00:02:12.743 INFO:teuthology.orchestra.run.smithi019.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-12T00:02:12.743 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:02:12.744 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-12T00:02:12.745 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:02:12.900 DEBUG:teuthology.orchestra.run.smithi135:> dpkg-query -W -f '${Version}' ceph 2024-09-12T00:02:12.920 INFO:teuthology.orchestra.run.smithi135.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-12T00:02:12.921 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:02:12.921 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-12T00:02:12.923 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T00:02:12.923 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:02:12.923 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:02:12.938 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:02:12.938 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:02:12.977 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T00:02:12.978 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:02:12.978 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:02:12.997 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:02:13.053 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:02:13.053 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:02:13.066 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:02:13.119 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T00:02:13.119 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:02:13.119 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:02:13.133 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:02:13.193 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:02:13.193 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:02:13.207 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:02:13.260 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T00:02:13.260 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:02:13.260 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:02:13.274 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:02:13.331 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:02:13.331 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:02:13.344 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:02:13.400 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T00:02:13.482 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T00:02:13.482 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 777 /var/log/ceph 2024-09-12T00:02:13.485 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /var/log/ceph 2024-09-12T00:02:13.497 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T00:02:13.498 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:02:13.543 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:02:13.554 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T00:02:13.554 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:02:13.599 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:02:13.621 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T00:02:13.621 INFO:tasks.ceph:config {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T00:02:13.621 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901820', 'branch': 'wip-cls-rgw-busy-resharding', 'description': 'rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota}', 'email': None, 'first_in_suite': False, 'job_id': '7901820', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-67986', 'sha1': '6a169fc940965ab446a63954fde870aa497efde7'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2206, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-67986', 'suite_path': '/home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/cbodley/ceph.git', 'suite_sha1': '6a169fc940965ab446a63954fde870aa497efde7', 'targets': {'smithi019.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLz2p4EKjXM8A8xqdrKptmy3dFYapyHCuQPgLPNbsGU9fNt+rpO5u7MWwrWBA2x/QuhHO/guVkJidEUOgVDEvaE=', 'smithi135.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOlp+9e03gsVbePYHbnYOUKKSSSKy1qZKwHWc9oOmQ43S2Us0gQOsRlUqdDDuTxfxXMP27tIq0w/A3bcItf5BlM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'rgw': ['client.0']}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rgw/s3_bucket_quota.pl']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_23:33:24', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T00:02:13.622 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:02:13.659 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:02:13.664 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:02:13.707 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:02:13.720 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:02:13.720 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:02:13.766 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:02:13.766 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_1 2024-09-12T00:02:13.814 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:02:13.814 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:02:13.814 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-09-12T00:02:13.815 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:02:13.815 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-11 23:56:36.101739376 +0000 2024-09-12T00:02:13.815 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-11 23:56:35.833741772 +0000 2024-09-12T00:02:13.815 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-11 23:56:35.833741772 +0000 2024-09-12T00:02:13.815 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2024-09-12T00:02:13.815 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:02:13.868 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-12T00:02:13.869 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-12T00:02:13.869 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000390881 s, 1.3 MB/s 2024-09-12T00:02:13.870 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:02:13.919 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_2 2024-09-12T00:02:13.972 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:02:13.972 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:02:13.972 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-09-12T00:02:13.972 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:02:13.972 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-11 23:56:36.585735050 +0000 2024-09-12T00:02:13.972 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-11 23:56:36.345737196 +0000 2024-09-12T00:02:13.972 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-11 23:56:36.345737196 +0000 2024-09-12T00:02:13.972 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2024-09-12T00:02:13.973 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:02:14.030 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-12T00:02:14.030 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-12T00:02:14.031 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000329488 s, 1.6 MB/s 2024-09-12T00:02:14.032 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:02:14.098 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_3 2024-09-12T00:02:14.155 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:02:14.156 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:02:14.156 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-09-12T00:02:14.156 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:02:14.156 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-11 23:56:37.057730833 +0000 2024-09-12T00:02:14.156 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-11 23:56:36.813733013 +0000 2024-09-12T00:02:14.156 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-11 23:56:36.813733013 +0000 2024-09-12T00:02:14.156 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2024-09-12T00:02:14.157 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:02:14.437 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-12T00:02:14.437 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-12T00:02:14.437 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000431427 s, 1.2 MB/s 2024-09-12T00:02:14.439 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:02:14.489 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_4 2024-09-12T00:02:14.547 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:02:14.547 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:02:14.547 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-09-12T00:02:14.547 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:02:14.547 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-11 23:56:37.509726791 +0000 2024-09-12T00:02:14.547 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-11 23:56:37.261729008 +0000 2024-09-12T00:02:14.547 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-11 23:56:37.261729008 +0000 2024-09-12T00:02:14.547 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2024-09-12T00:02:14.548 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:02:14.605 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-12T00:02:14.605 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-12T00:02:14.605 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000390748 s, 1.3 MB/s 2024-09-12T00:02:14.605 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:02:14.658 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:02:14.658 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:02:14.658 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:02:14.664 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:02:14.664 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2024-09-12T00:02:14.714 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:02:14.715 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:02:14.715 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 872 Links: 1 2024-09-12T00:02:14.715 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:02:14.715 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-11 23:56:32.281470694 +0000 2024-09-12T00:02:14.715 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-11 23:56:32.025472974 +0000 2024-09-12T00:02:14.715 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-11 23:56:32.025472974 +0000 2024-09-12T00:02:14.715 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2024-09-12T00:02:14.715 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:02:14.767 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-12T00:02:14.767 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-12T00:02:14.768 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000437159 s, 1.2 MB/s 2024-09-12T00:02:14.769 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:02:14.819 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2024-09-12T00:02:14.868 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:02:14.869 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:02:14.869 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-09-12T00:02:14.869 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:02:14.869 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-11 23:56:32.769466346 +0000 2024-09-12T00:02:14.869 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-11 23:56:32.509468661 +0000 2024-09-12T00:02:14.869 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-11 23:56:32.509468661 +0000 2024-09-12T00:02:14.869 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2024-09-12T00:02:14.870 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:02:14.923 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-12T00:02:14.923 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-12T00:02:14.923 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.00044059 s, 1.2 MB/s 2024-09-12T00:02:14.925 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:02:14.979 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2024-09-12T00:02:15.029 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:02:15.029 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:02:15.029 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-09-12T00:02:15.029 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:02:15.029 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-11 23:56:33.021464099 +0000 2024-09-12T00:02:15.029 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-11 23:56:33.017464136 +0000 2024-09-12T00:02:15.029 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-11 23:56:33.017464136 +0000 2024-09-12T00:02:15.030 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2024-09-12T00:02:15.030 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:02:15.083 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-12T00:02:15.083 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-12T00:02:15.083 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.00041765 s, 1.2 MB/s 2024-09-12T00:02:15.084 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:02:15.135 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2024-09-12T00:02:15.180 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:02:15.181 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:02:15.181 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 928 Links: 1 2024-09-12T00:02:15.181 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:02:15.181 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-11 23:56:33.773457401 +0000 2024-09-12T00:02:15.181 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-11 23:56:33.501459823 +0000 2024-09-12T00:02:15.181 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-11 23:56:33.501459823 +0000 2024-09-12T00:02:15.181 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2024-09-12T00:02:15.181 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:02:15.235 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-12T00:02:15.235 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-12T00:02:15.235 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000386727 s, 1.3 MB/s 2024-09-12T00:02:15.237 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:02:15.288 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:02:15.288 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:02:15.288 INFO:tasks.ceph:Generating config... 2024-09-12T00:02:15.290 INFO:tasks.ceph:[client] rgw relaxed s3 bucket names = True 2024-09-12T00:02:15.290 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T00:02:15.290 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T00:02:15.290 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T00:02:15.290 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T00:02:15.290 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T00:02:15.290 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T00:02:15.290 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T00:02:15.290 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T00:02:15.290 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T00:02:15.290 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T00:02:15.291 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T00:02:15.291 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T00:02:15.291 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T00:02:15.291 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T00:02:15.291 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T00:02:15.291 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T00:02:15.291 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T00:02:15.291 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T00:02:15.291 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-12T00:02:15.291 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T00:02:15.291 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-12T00:02:15.291 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T00:02:15.292 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T00:02:15.292 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T00:02:15.292 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T00:02:15.327 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T00:02:15.346 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T00:02:15.429 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:02:15.485 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.19'), ('mon.c', '[v2:172.21.15.19:3301,v1:172.21.15.19:6790]'), ('mon.b', '172.21.15.135')] 2024-09-12T00:02:15.486 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],172.21.15.135'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rgw relaxed s3 bucket names': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T00:02:15.487 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:02:15.487 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:02:15.534 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.19 --addv c '[v2:172.21.15.19:3301,v1:172.21.15.19:6790]' --add b 172.21.15.135 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:02:15.622 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:02:15.622 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: generated fsid e8cc2cf2-4ebe-41fb-ac6a-f09b6fd34589 2024-09-12T00:02:15.623 INFO:teuthology.orchestra.run.smithi019.stdout:setting min_mon_release = quincy 2024-09-12T00:02:15.623 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 0 2024-09-12T00:02:15.623 INFO:teuthology.orchestra.run.smithi019.stdout:fsid e8cc2cf2-4ebe-41fb-ac6a-f09b6fd34589 2024-09-12T00:02:15.623 INFO:teuthology.orchestra.run.smithi019.stdout:last_changed 2024-09-12T00:02:15.626091+0000 2024-09-12T00:02:15.623 INFO:teuthology.orchestra.run.smithi019.stdout:created 2024-09-12T00:02:15.626091+0000 2024-09-12T00:02:15.623 INFO:teuthology.orchestra.run.smithi019.stdout:min_mon_release 17 (quincy) 2024-09-12T00:02:15.623 INFO:teuthology.orchestra.run.smithi019.stdout:election_strategy: 1 2024-09-12T00:02:15.623 INFO:teuthology.orchestra.run.smithi019.stdout:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:02:15.623 INFO:teuthology.orchestra.run.smithi019.stdout:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:02:15.623 INFO:teuthology.orchestra.run.smithi019.stdout:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:02:15.623 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T00:02:15.624 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:02:15.629 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e8cc2cf2-4ebe-41fb-ac6a-f09b6fd34589... 2024-09-12T00:02:15.630 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:02:15.675 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:02:15.703 INFO:teuthology.orchestra.run.smithi019.stdout:[global] 2024-09-12T00:02:15.703 INFO:teuthology.orchestra.run.smithi019.stdout: chdir = "" 2024-09-12T00:02:15.703 INFO:teuthology.orchestra.run.smithi019.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:02:15.703 INFO:teuthology.orchestra.run.smithi019.stdout: auth supported = cephx 2024-09-12T00:02:15.703 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: filestore xattr use omap = true 2024-09-12T00:02:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: mon clock drift allowed = 1.000 2024-09-12T00:02:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: osd crush chooseleaf type = 0 2024-09-12T00:02:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: auth debug = true 2024-09-12T00:02:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on old message = true 2024-09-12T00:02:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on bug = true 2024-09-12T00:02:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:02:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: mon pg warn max object skew = 0 2024-09-12T00:02:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:02:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:02:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default size = 2 2024-09-12T00:02:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow primary affinity = true 2024-09-12T00:02:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow pg remap = true 2024-09-12T00:02:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:02:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:02:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on no sortbitwise = false 2024-09-12T00:02:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:02:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on too few osds = false 2024-09-12T00:02:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:02:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:02:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: mon_allow_pool_size_one = true 2024-09-12T00:02:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:02:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: osd default data pool replay window = 5 2024-09-12T00:02:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: mon allow pool delete = true 2024-09-12T00:02:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: mon cluster log file level = debug 2024-09-12T00:02:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: debug asserts on shutdown = true 2024-09-12T00:02:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: mon health detail to clog = false 2024-09-12T00:02:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: mon host = "172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],172.21.15.135" 2024-09-12T00:02:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: fsid = e8cc2cf2-4ebe-41fb-ac6a-f09b6fd34589 2024-09-12T00:02:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.707 INFO:teuthology.orchestra.run.smithi019.stdout:[osd] 2024-09-12T00:02:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: osd journal size = 100 2024-09-12T00:02:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub load threshold = 5.0 2024-09-12T00:02:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub max interval = 600 2024-09-12T00:02:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:02:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: osd recover clone overlap = true 2024-09-12T00:02:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: osd recovery max chunk = 1048576 2024-09-12T00:02:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug shutdown = true 2024-09-12T00:02:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug op order = true 2024-09-12T00:02:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug verify stray on activate = true 2024-09-12T00:02:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug trim objects = true 2024-09-12T00:02:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: osd open classes on start = true 2024-09-12T00:02:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug pg log writeout = true 2024-09-12T00:02:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:02:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: osd map max advance = 10 2024-09-12T00:02:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: journal zero on create = true 2024-09-12T00:02:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:02:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: filestore apply finisher threads = 3 2024-09-12T00:02:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: bdev debug aio = true 2024-09-12T00:02:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug misdirected ops = true 2024-09-12T00:02:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: bdev async discard = True 2024-09-12T00:02:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: bdev enable discard = True 2024-09-12T00:02:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore allocator = bitmap 2024-09-12T00:02:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore block size = 96636764160 2024-09-12T00:02:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore fsck on mount = True 2024-09-12T00:02:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluefs = 1/20 2024-09-12T00:02:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluestore = 1/20 2024-09-12T00:02:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-09-12T00:02:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: debug osd = 20 2024-09-12T00:02:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: debug rocksdb = 4/10 2024-09-12T00:02:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:02:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd full ratio = 0.9 2024-09-12T00:02:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:02:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: osd blocked scrub grace period = 3600 2024-09-12T00:02:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:02:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: osd max markdown count = 1000 2024-09-12T00:02:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: osd objectstore = bluestore 2024-09-12T00:02:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: osd shutdown pgref assert = True 2024-09-12T00:02:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.710 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr] 2024-09-12T00:02:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-09-12T00:02:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: debug mgr = 20 2024-09-12T00:02:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2024-09-12T00:02:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2024-09-12T00:02:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:02:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:02:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: mgr/telemetry/nag = false 2024-09-12T00:02:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.711 INFO:teuthology.orchestra.run.smithi019.stdout:[mon] 2024-09-12T00:02:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-09-12T00:02:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2024-09-12T00:02:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: debug paxos = 20 2024-09-12T00:02:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2024-09-12T00:02:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: mon data avail warn = 5 2024-09-12T00:02:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: mon mgr mkfs grace = 240 2024-09-12T00:02:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:02:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd reporter subtree level = osd 2024-09-12T00:02:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd prime pg temp = true 2024-09-12T00:02:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:02:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:02:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:02:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:02:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:02:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:02:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:02:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: # 1m isn't quite enough 2024-09-12T00:02:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:02:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:02:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:15.712 INFO:teuthology.orchestra.run.smithi019.stdout:[client] 2024-09-12T00:02:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: rgw cache enabled = true 2024-09-12T00:02:15.713 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable ops log = true 2024-09-12T00:02:15.713 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable usage log = true 2024-09-12T00:02:15.713 INFO:teuthology.orchestra.run.smithi019.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:02:15.713 INFO:teuthology.orchestra.run.smithi019.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:02:15.713 INFO:teuthology.orchestra.run.smithi019.stdout: rgw relaxed s3 bucket names = True 2024-09-12T00:02:15.713 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.a] 2024-09-12T00:02:15.713 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.c] 2024-09-12T00:02:15.713 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.b] 2024-09-12T00:02:15.714 INFO:teuthology.orchestra.run.smithi135.stdout:[global] 2024-09-12T00:02:15.714 INFO:teuthology.orchestra.run.smithi135.stdout: chdir = "" 2024-09-12T00:02:15.714 INFO:teuthology.orchestra.run.smithi135.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:02:15.714 INFO:teuthology.orchestra.run.smithi135.stdout: auth supported = cephx 2024-09-12T00:02:15.714 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.714 INFO:teuthology.orchestra.run.smithi135.stdout: filestore xattr use omap = true 2024-09-12T00:02:15.714 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.714 INFO:teuthology.orchestra.run.smithi135.stdout: mon clock drift allowed = 1.000 2024-09-12T00:02:15.714 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.714 INFO:teuthology.orchestra.run.smithi135.stdout: osd crush chooseleaf type = 0 2024-09-12T00:02:15.714 INFO:teuthology.orchestra.run.smithi135.stdout: auth debug = true 2024-09-12T00:02:15.714 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.714 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on old message = true 2024-09-12T00:02:15.715 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on bug = true 2024-09-12T00:02:15.715 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.715 INFO:teuthology.orchestra.run.smithi135.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:02:15.715 INFO:teuthology.orchestra.run.smithi135.stdout: mon pg warn max object skew = 0 2024-09-12T00:02:15.715 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.715 INFO:teuthology.orchestra.run.smithi135.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:02:15.715 INFO:teuthology.orchestra.run.smithi135.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:02:15.715 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.715 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default size = 2 2024-09-12T00:02:15.715 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.715 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow primary affinity = true 2024-09-12T00:02:15.715 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow pg remap = true 2024-09-12T00:02:15.715 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:02:15.715 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:02:15.716 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on no sortbitwise = false 2024-09-12T00:02:15.716 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:02:15.716 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on too few osds = false 2024-09-12T00:02:15.716 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:02:15.716 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:02:15.716 INFO:teuthology.orchestra.run.smithi135.stdout: mon_allow_pool_size_one = true 2024-09-12T00:02:15.716 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.716 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:02:15.716 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.716 INFO:teuthology.orchestra.run.smithi135.stdout: osd default data pool replay window = 5 2024-09-12T00:02:15.717 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.717 INFO:teuthology.orchestra.run.smithi135.stdout: mon allow pool delete = true 2024-09-12T00:02:15.717 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.717 INFO:teuthology.orchestra.run.smithi135.stdout: mon cluster log file level = debug 2024-09-12T00:02:15.717 INFO:teuthology.orchestra.run.smithi135.stdout: debug asserts on shutdown = true 2024-09-12T00:02:15.717 INFO:teuthology.orchestra.run.smithi135.stdout: mon health detail to clog = false 2024-09-12T00:02:15.717 INFO:teuthology.orchestra.run.smithi135.stdout: mon host = "172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],172.21.15.135" 2024-09-12T00:02:15.717 INFO:teuthology.orchestra.run.smithi135.stdout: fsid = e8cc2cf2-4ebe-41fb-ac6a-f09b6fd34589 2024-09-12T00:02:15.717 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.717 INFO:teuthology.orchestra.run.smithi135.stdout:[osd] 2024-09-12T00:02:15.717 INFO:teuthology.orchestra.run.smithi135.stdout: osd journal size = 100 2024-09-12T00:02:15.717 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.717 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub load threshold = 5.0 2024-09-12T00:02:15.717 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub max interval = 600 2024-09-12T00:02:15.718 INFO:teuthology.orchestra.run.smithi135.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:02:15.718 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.718 INFO:teuthology.orchestra.run.smithi135.stdout: osd recover clone overlap = true 2024-09-12T00:02:15.718 INFO:teuthology.orchestra.run.smithi135.stdout: osd recovery max chunk = 1048576 2024-09-12T00:02:15.718 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.718 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug shutdown = true 2024-09-12T00:02:15.718 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug op order = true 2024-09-12T00:02:15.718 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug verify stray on activate = true 2024-09-12T00:02:15.718 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug trim objects = true 2024-09-12T00:02:15.718 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.718 INFO:teuthology.orchestra.run.smithi135.stdout: osd open classes on start = true 2024-09-12T00:02:15.718 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug pg log writeout = true 2024-09-12T00:02:15.718 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.719 INFO:teuthology.orchestra.run.smithi135.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:02:15.719 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.719 INFO:teuthology.orchestra.run.smithi135.stdout: osd map max advance = 10 2024-09-12T00:02:15.719 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.719 INFO:teuthology.orchestra.run.smithi135.stdout: journal zero on create = true 2024-09-12T00:02:15.719 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.719 INFO:teuthology.orchestra.run.smithi135.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:02:15.719 INFO:teuthology.orchestra.run.smithi135.stdout: filestore apply finisher threads = 3 2024-09-12T00:02:15.719 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.719 INFO:teuthology.orchestra.run.smithi135.stdout: bdev debug aio = true 2024-09-12T00:02:15.719 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug misdirected ops = true 2024-09-12T00:02:15.719 INFO:teuthology.orchestra.run.smithi135.stdout: bdev async discard = True 2024-09-12T00:02:15.719 INFO:teuthology.orchestra.run.smithi135.stdout: bdev enable discard = True 2024-09-12T00:02:15.719 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore allocator = bitmap 2024-09-12T00:02:15.720 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore block size = 96636764160 2024-09-12T00:02:15.720 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore fsck on mount = True 2024-09-12T00:02:15.720 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluefs = 1/20 2024-09-12T00:02:15.720 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluestore = 1/20 2024-09-12T00:02:15.720 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-09-12T00:02:15.720 INFO:teuthology.orchestra.run.smithi135.stdout: debug osd = 20 2024-09-12T00:02:15.720 INFO:teuthology.orchestra.run.smithi135.stdout: debug rocksdb = 4/10 2024-09-12T00:02:15.720 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:02:15.720 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd full ratio = 0.9 2024-09-12T00:02:15.720 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:02:15.720 INFO:teuthology.orchestra.run.smithi135.stdout: osd blocked scrub grace period = 3600 2024-09-12T00:02:15.720 INFO:teuthology.orchestra.run.smithi135.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:02:15.720 INFO:teuthology.orchestra.run.smithi135.stdout: osd max markdown count = 1000 2024-09-12T00:02:15.720 INFO:teuthology.orchestra.run.smithi135.stdout: osd objectstore = bluestore 2024-09-12T00:02:15.721 INFO:teuthology.orchestra.run.smithi135.stdout: osd shutdown pgref assert = True 2024-09-12T00:02:15.721 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.721 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr] 2024-09-12T00:02:15.721 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-09-12T00:02:15.721 INFO:teuthology.orchestra.run.smithi135.stdout: debug mgr = 20 2024-09-12T00:02:15.721 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2024-09-12T00:02:15.721 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2024-09-12T00:02:15.721 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:02:15.721 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:02:15.721 INFO:teuthology.orchestra.run.smithi135.stdout: mgr/telemetry/nag = false 2024-09-12T00:02:15.721 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.721 INFO:teuthology.orchestra.run.smithi135.stdout:[mon] 2024-09-12T00:02:15.721 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-09-12T00:02:15.721 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2024-09-12T00:02:15.722 INFO:teuthology.orchestra.run.smithi135.stdout: debug paxos = 20 2024-09-12T00:02:15.722 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2024-09-12T00:02:15.722 INFO:teuthology.orchestra.run.smithi135.stdout: mon data avail warn = 5 2024-09-12T00:02:15.722 INFO:teuthology.orchestra.run.smithi135.stdout: mon mgr mkfs grace = 240 2024-09-12T00:02:15.722 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:02:15.722 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd reporter subtree level = osd 2024-09-12T00:02:15.722 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd prime pg temp = true 2024-09-12T00:02:15.722 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:02:15.722 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.722 INFO:teuthology.orchestra.run.smithi135.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:02:15.722 INFO:teuthology.orchestra.run.smithi135.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:02:15.722 INFO:teuthology.orchestra.run.smithi135.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:02:15.722 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.722 INFO:teuthology.orchestra.run.smithi135.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:02:15.722 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:02:15.723 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:02:15.723 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.723 INFO:teuthology.orchestra.run.smithi135.stdout: # 1m isn't quite enough 2024-09-12T00:02:15.723 INFO:teuthology.orchestra.run.smithi135.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:02:15.723 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.723 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:02:15.723 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:02:15.723 INFO:teuthology.orchestra.run.smithi135.stdout:[client] 2024-09-12T00:02:15.723 INFO:teuthology.orchestra.run.smithi135.stdout: rgw cache enabled = true 2024-09-12T00:02:15.723 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable ops log = true 2024-09-12T00:02:15.723 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable usage log = true 2024-09-12T00:02:15.723 INFO:teuthology.orchestra.run.smithi135.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:02:15.723 INFO:teuthology.orchestra.run.smithi135.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:02:15.723 INFO:teuthology.orchestra.run.smithi135.stdout: rgw relaxed s3 bucket names = True 2024-09-12T00:02:15.724 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.a] 2024-09-12T00:02:15.724 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.c] 2024-09-12T00:02:15.724 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.b] 2024-09-12T00:02:15.725 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T00:02:15.725 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T00:02:15.815 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T00:02:15.816 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:02:15.816 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T00:02:15.821 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:02:15.821 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T00:02:15.871 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T00:02:15.871 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:02:15.871 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:02:15.871 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:02:15.935 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:02:15.935 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:02:16.019 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T00:02:16.019 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:02:16.019 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:02:16.019 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:02:16.044 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:02:16.044 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:02:16.097 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T00:02:16.097 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T00:02:16.097 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:02:16.141 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:02:16.144 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:02:16.186 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:02:16.199 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T00:02:16.199 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T00:02:16.200 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T00:02:16.234 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T00:02:16.246 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T00:02:16.281 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T00:02:16.291 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T00:02:16.292 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:02:16.292 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T00:02:16.304 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:02:16.304 INFO:tasks.ceph:role: osd.0 2024-09-12T00:02:16.304 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T00:02:16.304 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:02:16.365 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:02:16.365 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:02:16.365 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:02:16.365 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:02:16.365 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:02:16.365 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:02:16.365 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:02:16.365 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:02:16.365 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:02:16.365 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:02:16.834 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-09-12T00:02:16.836 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-09-12T00:02:16.836 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T00:02:16.935 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T00:02:16.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:02:16.947 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:02:16.947 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T00:02:17.005 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:02:17.005 INFO:tasks.ceph:role: osd.1 2024-09-12T00:02:17.006 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T00:02:17.006 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:02:17.070 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:02:17.070 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:02:17.070 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:02:17.070 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:02:17.071 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:02:17.071 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:02:17.071 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:02:17.071 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:02:17.071 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:02:17.071 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:02:17.536 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-09-12T00:02:17.538 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-09-12T00:02:17.538 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T00:02:17.705 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T00:02:17.716 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:02:17.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:02:17.717 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T00:02:17.774 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:02:17.774 INFO:tasks.ceph:role: osd.2 2024-09-12T00:02:17.774 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T00:02:17.775 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:02:17.838 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:02:17.838 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:02:17.838 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:02:17.838 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:02:17.838 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:02:17.838 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:02:17.838 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:02:17.838 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:02:17.839 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:02:17.839 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:02:18.330 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-09-12T00:02:18.332 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-09-12T00:02:18.332 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T00:02:18.469 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T00:02:18.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:02:18.484 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:02:18.484 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T00:02:18.539 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:02:18.540 INFO:tasks.ceph:role: osd.3 2024-09-12T00:02:18.540 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T00:02:18.540 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:02:18.603 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:02:18.604 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:02:18.604 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:02:18.604 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:02:18.604 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:02:18.604 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:02:18.605 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:02:18.605 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:02:18.605 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:02:18.605 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:02:19.041 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-09-12T00:02:19.043 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-09-12T00:02:19.043 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T00:02:19.133 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T00:02:19.143 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:02:19.143 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:02:19.144 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:02:19.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:02:19.250+0000 7f664d72f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T00:02:19.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:02:19.254+0000 7f664d72f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T00:02:19.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:02:19.254+0000 7f664d72f7c0 -1 bdev(0x559dded8b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T00:02:19.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:02:19.254+0000 7f664d72f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T00:02:22.386 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T00:02:22.401 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:02:22.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:02:22.486+0000 7f1d1391e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T00:02:22.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:02:22.486+0000 7f1d1391e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T00:02:22.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:02:22.486+0000 7f1d1391e7c0 -1 bdev(0x55d488aaf800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T00:02:22.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:02:22.486+0000 7f1d1391e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T00:02:25.621 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T00:02:25.682 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:02:25.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:02:25.766+0000 7ff39d8be7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T00:02:25.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:02:25.766+0000 7ff39d8be7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T00:02:25.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:02:25.766+0000 7ff39d8be7c0 -1 bdev(0x55e7c983f800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T00:02:25.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:02:25.766+0000 7ff39d8be7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T00:02:28.901 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T00:02:28.959 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:02:29.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:02:29.042+0000 7f6cfb2f17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T00:02:29.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:02:29.042+0000 7f6cfb2f17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T00:02:29.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:02:29.042+0000 7f6cfb2f17c0 -1 bdev(0x5573a4f2b800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T00:02:29.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:02:29.042+0000 7f6cfb2f17c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T00:02:32.182 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T00:02:32.239 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T00:02:32.253 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:02:32.253 INFO:tasks.ceph:role: osd.4 2024-09-12T00:02:32.254 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T00:02:32.254 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:02:32.316 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:02:32.316 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:02:32.316 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:02:32.316 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:02:32.317 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:02:32.317 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:02:32.317 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:02:32.317 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:02:32.317 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:02:32.317 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:02:32.769 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-09-12T00:02:32.771 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-09-12T00:02:32.771 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T00:02:32.862 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T00:02:32.914 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:02:32.915 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:02:32.915 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T00:02:32.972 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:02:32.972 INFO:tasks.ceph:role: osd.5 2024-09-12T00:02:32.972 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T00:02:32.972 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:02:33.038 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:02:33.038 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:02:33.038 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:02:33.038 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:02:33.038 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:02:33.039 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:02:33.039 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:02:33.039 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:02:33.039 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:02:33.039 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:02:33.514 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-09-12T00:02:33.516 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-09-12T00:02:33.516 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T00:02:33.683 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T00:02:33.694 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:02:33.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:02:33.695 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T00:02:33.747 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:02:33.748 INFO:tasks.ceph:role: osd.6 2024-09-12T00:02:33.748 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T00:02:33.748 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:02:33.815 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:02:33.815 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:02:33.815 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:02:33.815 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:02:33.815 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:02:33.815 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:02:33.816 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:02:33.816 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:02:33.816 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:02:33.816 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:02:34.286 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-09-12T00:02:34.288 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-09-12T00:02:34.288 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T00:02:34.432 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T00:02:34.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:02:34.447 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:02:34.447 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T00:02:34.507 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:02:34.508 INFO:tasks.ceph:role: osd.7 2024-09-12T00:02:34.508 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T00:02:34.508 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:02:34.572 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:02:34.572 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:02:34.572 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:02:34.572 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:02:34.572 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:02:34.572 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:02:34.572 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:02:34.572 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:02:34.573 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:02:34.573 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:02:35.004 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-09-12T00:02:35.007 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-09-12T00:02:35.007 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T00:02:35.094 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T00:02:35.103 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:02:35.103 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:02:35.104 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:02:35.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:02:35.214+0000 7fc25acd97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T00:02:35.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:02:35.218+0000 7fc25acd97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T00:02:35.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:02:35.218+0000 7fc25acd97c0 -1 bdev(0x559240bc3800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T00:02:35.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:02:35.218+0000 7fc25acd97c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T00:02:38.346 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T00:02:38.360 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:02:38.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:02:38.442+0000 7f980a9397c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T00:02:38.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:02:38.442+0000 7f980a9397c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T00:02:38.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:02:38.442+0000 7f980a9397c0 -1 bdev(0x55ddcce9f800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T00:02:38.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:02:38.442+0000 7f980a9397c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T00:02:41.594 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T00:02:41.649 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:02:41.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:02:41.734+0000 7f66949117c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T00:02:41.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:02:41.734+0000 7f66949117c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T00:02:41.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:02:41.734+0000 7f66949117c0 -1 bdev(0x56270d3b3800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T00:02:41.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:02:41.734+0000 7f66949117c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T00:02:44.855 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T00:02:44.908 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:02:44.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:02:44.998+0000 7f56c886e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T00:02:44.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:02:44.998+0000 7f56c886e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T00:02:44.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:02:44.998+0000 7f56c886e7c0 -1 bdev(0x55bf32ce9800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T00:02:44.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:02:44.998+0000 7f56c886e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T00:02:48.128 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T00:02:48.185 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T00:02:48.185 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:02:48.185 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T00:02:48.200 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:02:48.201 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T00:02:48.254 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:02:48.254 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T00:02:48.309 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:02:48.309 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T00:02:48.365 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:02:48.365 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T00:02:48.421 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:02:48.421 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T00:02:48.435 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:02:48.435 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T00:02:48.487 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:02:48.487 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T00:02:48.543 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:02:48.543 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T00:02:48.600 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:02:48.600 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T00:02:48.656 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:02:48.656 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T00:02:48.662 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:02:48.662 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T00:02:48.708 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T00:02:48.709 DEBUG:teuthology.orchestra.run.smithi019:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:02:48.711 DEBUG:teuthology.orchestra.run.smithi135:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:02:48.754 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.y] 2024-09-12T00:02:48.754 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCIL+JmLT6cCBAAYvk++jbyHXaKr7TpIoSDwA== 2024-09-12T00:02:48.754 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.0] 2024-09-12T00:02:48.754 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCLL+Jm5cknDxAA3G5M89vXV1glKP+dTtonbw== 2024-09-12T00:02:48.754 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.1] 2024-09-12T00:02:48.754 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCOL+JmqkgrHRAAfvQX7PbBRUeU5J07Wl/+Ow== 2024-09-12T00:02:48.755 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.2] 2024-09-12T00:02:48.755 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCRL+JmSgXWLRAAF+wdd8RzFjfQKo62+EKrLA== 2024-09-12T00:02:48.755 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.3] 2024-09-12T00:02:48.755 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCVL+Jms1W/AhAAyGcsTysnTENRkUBqMNCbLg== 2024-09-12T00:02:48.755 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.x] 2024-09-12T00:02:48.755 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCIL+Jm31FrCxAAaVM7fPbbds+dlmGknWagfw== 2024-09-12T00:02:48.755 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.4] 2024-09-12T00:02:48.755 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCbL+JmhxgiDRAAlkyKAZPG6cByHloLcLuwlA== 2024-09-12T00:02:48.755 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.5] 2024-09-12T00:02:48.755 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCeL+Jm78aVGhAAEwylIsqUbFnaQwgCr4jhpA== 2024-09-12T00:02:48.755 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.6] 2024-09-12T00:02:48.755 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQChL+JmQkgSLBAAXcws+HNLOnz0txMrgwj/vQ== 2024-09-12T00:02:48.755 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.7] 2024-09-12T00:02:48.755 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQClL+JmHnAYABAAl6OHaU1FK7H77pxbNIZDTQ== 2024-09-12T00:02:48.756 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-09-12T00:02:48.756 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCIL+JmiHQ1DhAAH7WOT3uIzJqUBP77zVVHDg== 2024-09-12T00:02:48.756 INFO:teuthology.orchestra.run.smithi019.stdout:[client.1] 2024-09-12T00:02:48.756 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCIL+Jmqr0JERAAcBd8u/BIras2fA9tVmWUSw== 2024-09-12T00:02:48.762 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.y] 2024-09-12T00:02:48.762 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCIL+JmLT6cCBAAYvk++jbyHXaKr7TpIoSDwA== 2024-09-12T00:02:48.762 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.0] 2024-09-12T00:02:48.762 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCLL+Jm5cknDxAA3G5M89vXV1glKP+dTtonbw== 2024-09-12T00:02:48.762 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.1] 2024-09-12T00:02:48.764 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCOL+JmqkgrHRAAfvQX7PbBRUeU5J07Wl/+Ow== 2024-09-12T00:02:48.764 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.2] 2024-09-12T00:02:48.764 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCRL+JmSgXWLRAAF+wdd8RzFjfQKo62+EKrLA== 2024-09-12T00:02:48.764 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.3] 2024-09-12T00:02:48.764 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCVL+Jms1W/AhAAyGcsTysnTENRkUBqMNCbLg== 2024-09-12T00:02:48.764 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.x] 2024-09-12T00:02:48.764 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCIL+Jm31FrCxAAaVM7fPbbds+dlmGknWagfw== 2024-09-12T00:02:48.764 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.4] 2024-09-12T00:02:48.764 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCbL+JmhxgiDRAAlkyKAZPG6cByHloLcLuwlA== 2024-09-12T00:02:48.764 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.5] 2024-09-12T00:02:48.765 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCeL+Jm78aVGhAAEwylIsqUbFnaQwgCr4jhpA== 2024-09-12T00:02:48.765 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.6] 2024-09-12T00:02:48.765 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQChL+JmQkgSLBAAXcws+HNLOnz0txMrgwj/vQ== 2024-09-12T00:02:48.765 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.7] 2024-09-12T00:02:48.765 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQClL+JmHnAYABAAl6OHaU1FK7H77pxbNIZDTQ== 2024-09-12T00:02:48.765 INFO:teuthology.orchestra.run.smithi135.stdout:[client.0] 2024-09-12T00:02:48.765 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCIL+JmiHQ1DhAAH7WOT3uIzJqUBP77zVVHDg== 2024-09-12T00:02:48.765 INFO:teuthology.orchestra.run.smithi135.stdout:[client.1] 2024-09-12T00:02:48.765 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCIL+Jmqr0JERAAcBd8u/BIras2fA9tVmWUSw== 2024-09-12T00:02:48.766 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:02:48.802 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:02:48.853 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:48.857 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:48.900 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:48.943 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:48.987 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:48.990 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:49.070 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:49.073 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:49.155 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:02:49.158 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:02:49.239 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:49.241 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:49.324 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:49.326 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:49.408 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:49.414 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:49.492 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:49.494 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:49.582 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:02:49.585 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:02:49.673 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:02:49.679 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:02:49.725 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T00:02:49.725 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T00:02:49.737 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:02:49.826 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T00:02:49.879 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T00:02:49.931 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:02:50.024 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T00:02:50.036 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T00:02:50.049 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:02:50.140 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T00:02:50.151 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:02:50.154 DEBUG:teuthology.orchestra.run.smithi135:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:02:50.200 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T00:02:50.200 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T00:02:50.201 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T00:02:50.203 INFO:tasks.ceph.mon.a:Started 2024-09-12T00:02:50.203 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T00:02:50.203 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T00:02:50.206 INFO:tasks.ceph.mon.c:Started 2024-09-12T00:02:50.206 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T00:02:50.206 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T00:02:50.245 INFO:tasks.ceph.mon.b:Started 2024-09-12T00:02:50.245 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T00:02:50.245 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T00:02:50.245 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T00:02:50.247 INFO:tasks.ceph.mgr.y:Started 2024-09-12T00:02:50.247 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T00:02:50.248 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T00:02:50.250 INFO:tasks.ceph.mgr.x:Started 2024-09-12T00:02:50.250 DEBUG:tasks.ceph:set 0 configs 2024-09-12T00:02:50.250 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T00:02:50.250 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T00:02:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:adjusted tunables profile to default 2024-09-12T00:02:56.474 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T00:02:56.475 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T00:02:56.475 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:02:56.475 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T00:02:56.484 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:02:56.484 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T00:02:56.534 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:02:56.535 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T00:02:56.589 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:02:56.589 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T00:02:56.647 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:02:56.647 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T00:02:56.660 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:02:56.660 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T00:02:56.714 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:02:56.714 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T00:02:56.766 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:02:56.766 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T00:02:56.819 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new af1b1898-c45f-43f5-b9c5-26e491625211 0 2024-09-12T00:02:57.094 INFO:teuthology.orchestra.run.smithi135.stdout:0 2024-09-12T00:02:57.110 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new fe1aa63d-8e57-4163-98a5-0131e1a60680 1 2024-09-12T00:02:57.307 INFO:teuthology.orchestra.run.smithi135.stdout:1 2024-09-12T00:02:57.324 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 1c97c435-1516-46e1-8fb9-fab9d7419774 2 2024-09-12T00:02:57.532 INFO:teuthology.orchestra.run.smithi135.stdout:2 2024-09-12T00:02:57.550 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 30dc8f77-54f0-4e5a-8adc-3ef4b1c08f71 3 2024-09-12T00:02:57.751 INFO:teuthology.orchestra.run.smithi135.stdout:3 2024-09-12T00:02:57.768 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 0b4e8ec4-cb09-4c05-9ddb-fe1e664e8f03 4 2024-09-12T00:02:57.971 INFO:teuthology.orchestra.run.smithi135.stdout:4 2024-09-12T00:02:57.989 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 44796deb-5225-490a-a526-e0be07036b8d 5 2024-09-12T00:02:58.231 INFO:teuthology.orchestra.run.smithi135.stdout:5 2024-09-12T00:02:58.247 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new cecfecf3-d6c7-44f3-9c08-259ae76571c7 6 2024-09-12T00:02:58.441 INFO:teuthology.orchestra.run.smithi135.stdout:6 2024-09-12T00:02:58.450 INFO:tasks.ceph.mgr.x.smithi135.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T00:02:58.450 INFO:tasks.ceph.mgr.x.smithi135.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T00:02:58.450 INFO:tasks.ceph.mgr.x.smithi135.stderr: from numpy import show_config as show_numpy_config 2024-09-12T00:02:58.458 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new df0b245a-9a80-4038-8e00-4931eaee68c6 7 2024-09-12T00:02:58.649 INFO:teuthology.orchestra.run.smithi135.stdout:7 2024-09-12T00:02:58.666 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T00:02:58.666 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T00:02:58.669 INFO:tasks.ceph.osd.0:Started 2024-09-12T00:02:58.669 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T00:02:58.669 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T00:02:58.671 INFO:tasks.ceph.osd.1:Started 2024-09-12T00:02:58.672 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T00:02:58.672 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T00:02:58.674 INFO:tasks.ceph.osd.2:Started 2024-09-12T00:02:58.674 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T00:02:58.674 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T00:02:58.677 INFO:tasks.ceph.osd.3:Started 2024-09-12T00:02:58.677 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T00:02:58.677 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T00:02:58.679 INFO:tasks.ceph.osd.4:Started 2024-09-12T00:02:58.680 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T00:02:58.680 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T00:02:58.681 INFO:tasks.ceph.osd.5:Started 2024-09-12T00:02:58.682 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T00:02:58.682 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T00:02:58.683 INFO:tasks.ceph.mgr.y.smithi019.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T00:02:58.683 INFO:tasks.ceph.mgr.y.smithi019.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T00:02:58.683 INFO:tasks.ceph.mgr.y.smithi019.stderr: from numpy import show_config as show_numpy_config 2024-09-12T00:02:58.685 INFO:tasks.ceph.osd.6:Started 2024-09-12T00:02:58.685 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T00:02:58.685 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T00:02:58.687 INFO:tasks.ceph.osd.7:Started 2024-09-12T00:02:58.688 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:02:58.897 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:02:58.897 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":10,"fsid":"e8cc2cf2-4ebe-41fb-ac6a-f09b6fd34589","created":"2024-09-12T00:02:55.594166+0000","modified":"2024-09-12T00:02:58.648554+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:02:58.648554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"af1b1898-c45f-43f5-b9c5-26e491625211","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fe1aa63d-8e57-4163-98a5-0131e1a60680","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1c97c435-1516-46e1-8fb9-fab9d7419774","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"30dc8f77-54f0-4e5a-8adc-3ef4b1c08f71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0b4e8ec4-cb09-4c05-9ddb-fe1e664e8f03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"44796deb-5225-490a-a526-e0be07036b8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cecfecf3-d6c7-44f3-9c08-259ae76571c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"df0b245a-9a80-4038-8e00-4931eaee68c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:02:58.915 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T00:02:58.916 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T00:02:59.723 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:02:59.817 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:02:59.818+0000 7f3cdad6a7c0 -1 Falling back to public interface 2024-09-12T00:02:59.909 INFO:teuthology.misc.health.smithi019.stdout: 2024-09-12T00:02:59.909 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":10,"fsid":"e8cc2cf2-4ebe-41fb-ac6a-f09b6fd34589","created":"2024-09-12T00:02:55.594166+0000","modified":"2024-09-12T00:02:58.648554+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:02:58.648554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"af1b1898-c45f-43f5-b9c5-26e491625211","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fe1aa63d-8e57-4163-98a5-0131e1a60680","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1c97c435-1516-46e1-8fb9-fab9d7419774","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"30dc8f77-54f0-4e5a-8adc-3ef4b1c08f71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0b4e8ec4-cb09-4c05-9ddb-fe1e664e8f03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"44796deb-5225-490a-a526-e0be07036b8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cecfecf3-d6c7-44f3-9c08-259ae76571c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"df0b245a-9a80-4038-8e00-4931eaee68c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:02:59.924 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:03:00.070 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:00.070+0000 7feb067657c0 -1 Falling back to public interface 2024-09-12T00:03:00.306 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:00.306+0000 7f390f31a7c0 -1 Falling back to public interface 2024-09-12T00:03:00.311 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:00.310+0000 7fe82fef17c0 -1 Falling back to public interface 2024-09-12T00:03:00.322 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:03:00.322+0000 7f1c8f7b37c0 -1 Falling back to public interface 2024-09-12T00:03:00.335 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:03:00.334+0000 7f92a1bc47c0 -1 Falling back to public interface 2024-09-12T00:03:00.354 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:00.354+0000 7faf51d6e7c0 -1 Falling back to public interface 2024-09-12T00:03:00.541 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:00.542+0000 7faa938477c0 -1 Falling back to public interface 2024-09-12T00:03:01.385 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T00:03:01.386+0000 7f9d8fb50640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T00:03:01.388 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T00:03:01.390+0000 7f9d8fb50640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T00:03:03.762 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:03:03.762+0000 7f3cdad6a7c0 -1 osd.4 0 log_to_monitors true 2024-09-12T00:03:04.254 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:04.253+0000 7feb067657c0 -1 osd.1 0 log_to_monitors true 2024-09-12T00:03:04.426 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:03:04.426+0000 7f92a1bc47c0 -1 osd.6 0 log_to_monitors true 2024-09-12T00:03:04.480 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:03:04.477+0000 7f1c8f7b37c0 -1 osd.2 0 log_to_monitors true 2024-09-12T00:03:04.498 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:04.497+0000 7faf51d6e7c0 -1 osd.3 0 log_to_monitors true 2024-09-12T00:03:04.579 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:04.578+0000 7f390f31a7c0 -1 osd.7 0 log_to_monitors true 2024-09-12T00:03:04.807 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:04.810+0000 7faa938477c0 -1 osd.5 0 log_to_monitors true 2024-09-12T00:03:05.109 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:05.109+0000 7fe82fef17c0 -1 osd.0 0 log_to_monitors true 2024-09-12T00:03:06.730 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:03:07.252 INFO:teuthology.misc.health.smithi019.stdout: 2024-09-12T00:03:07.252 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":13,"fsid":"e8cc2cf2-4ebe-41fb-ac6a-f09b6fd34589","created":"2024-09-12T00:02:55.594166+0000","modified":"2024-09-12T00:03:06.648510+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:02:58.648554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"af1b1898-c45f-43f5-b9c5-26e491625211","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fe1aa63d-8e57-4163-98a5-0131e1a60680","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1c97c435-1516-46e1-8fb9-fab9d7419774","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"30dc8f77-54f0-4e5a-8adc-3ef4b1c08f71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0b4e8ec4-cb09-4c05-9ddb-fe1e664e8f03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"44796deb-5225-490a-a526-e0be07036b8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cecfecf3-d6c7-44f3-9c08-259ae76571c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"df0b245a-9a80-4038-8e00-4931eaee68c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:03:07.276 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:03:07.426 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:03:07.426+0000 7f929db6d640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T00:03:07.427 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:03:07.426+0000 7f3cd7525640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T00:03:07.448 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:03:07.450+0000 7f3cceb45640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:03:07.449 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:07.445+0000 7feb02f20640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T00:03:07.468 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:03:07.470+0000 7f929599f640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:03:07.472 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:07.474+0000 7f390b2c3640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T00:03:07.478 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:07.477+0000 7feafa540640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:03:07.500 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:07.502+0000 7f39030f5640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:03:07.509 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:03:07.509+0000 7f1c8bf6e640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T00:03:07.538 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:03:07.537+0000 7f1c8358e640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:03:07.563 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:07.561+0000 7faf4dd17640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T00:03:07.586 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:07.585+0000 7faf45b49640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:03:07.840 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:07.842+0000 7faa8f7f0640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T00:03:07.877 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:07.878+0000 7faa87622640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:03:07.927 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:07.925+0000 7fe82be9a640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T00:03:07.946 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:07.945+0000 7fe823ccc640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:03:14.083 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:03:14.399 INFO:teuthology.misc.health.smithi019.stdout: 2024-09-12T00:03:14.399 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":18,"fsid":"e8cc2cf2-4ebe-41fb-ac6a-f09b6fd34589","created":"2024-09-12T00:02:55.594166+0000","modified":"2024-09-12T00:03:12.482511+0000","last_up_change":"2024-09-12T00:03:08.456127+0000","last_in_change":"2024-09-12T00:02:58.648554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:03:10.418576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af1b1898-c45f-43f5-b9c5-26e491625211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6809","nonce":846638970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6811","nonce":846638970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6815","nonce":846638970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6813","nonce":846638970}]},"public_addr":"172.21.15.19:6809/846638970","cluster_addr":"172.21.15.19:6811/846638970","heartbeat_back_addr":"172.21.15.19:6815/846638970","heartbeat_front_addr":"172.21.15.19:6813/846638970","state":["exists","up"]},{"osd":1,"uuid":"fe1aa63d-8e57-4163-98a5-0131e1a60680","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6801","nonce":889703096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6803","nonce":889703096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6807","nonce":889703096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6805","nonce":889703096}]},"public_addr":"172.21.15.19:6801/889703096","cluster_addr":"172.21.15.19:6803/889703096","heartbeat_back_addr":"172.21.15.19:6807/889703096","heartbeat_front_addr":"172.21.15.19:6805/889703096","state":["exists","up"]},{"osd":2,"uuid":"1c97c435-1516-46e1-8fb9-fab9d7419774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6817","nonce":1847757189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6819","nonce":1847757189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6823","nonce":1847757189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6821","nonce":1847757189}]},"public_addr":"172.21.15.19:6817/1847757189","cluster_addr":"172.21.15.19:6819/1847757189","heartbeat_back_addr":"172.21.15.19:6823/1847757189","heartbeat_front_addr":"172.21.15.19:6821/1847757189","state":["exists","up"]},{"osd":3,"uuid":"30dc8f77-54f0-4e5a-8adc-3ef4b1c08f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6825","nonce":2630062148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6827","nonce":2630062148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6831","nonce":2630062148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6829","nonce":2630062148}]},"public_addr":"172.21.15.19:6825/2630062148","cluster_addr":"172.21.15.19:6827/2630062148","heartbeat_back_addr":"172.21.15.19:6831/2630062148","heartbeat_front_addr":"172.21.15.19:6829/2630062148","state":["exists","up"]},{"osd":4,"uuid":"0b4e8ec4-cb09-4c05-9ddb-fe1e664e8f03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6801","nonce":2966848021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6803","nonce":2966848021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6807","nonce":2966848021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6805","nonce":2966848021}]},"public_addr":"172.21.15.135:6801/2966848021","cluster_addr":"172.21.15.135:6803/2966848021","heartbeat_back_addr":"172.21.15.135:6807/2966848021","heartbeat_front_addr":"172.21.15.135:6805/2966848021","state":["exists","up"]},{"osd":5,"uuid":"44796deb-5225-490a-a526-e0be07036b8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6827","nonce":3933885245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6829","nonce":3933885245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6833","nonce":3933885245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6831","nonce":3933885245}]},"public_addr":"172.21.15.135:6827/3933885245","cluster_addr":"172.21.15.135:6829/3933885245","heartbeat_back_addr":"172.21.15.135:6833/3933885245","heartbeat_front_addr":"172.21.15.135:6831/3933885245","state":["exists","up"]},{"osd":6,"uuid":"cecfecf3-d6c7-44f3-9c08-259ae76571c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6817","nonce":951791611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6819","nonce":951791611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6823","nonce":951791611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6821","nonce":951791611}]},"public_addr":"172.21.15.135:6817/951791611","cluster_addr":"172.21.15.135:6819/951791611","heartbeat_back_addr":"172.21.15.135:6823/951791611","heartbeat_front_addr":"172.21.15.135:6821/951791611","state":["exists","up"]},{"osd":7,"uuid":"df0b245a-9a80-4038-8e00-4931eaee68c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6809","nonce":3316717279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6811","nonce":3316717279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6815","nonce":3316717279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6813","nonce":3316717279}]},"public_addr":"172.21.15.135:6809/3316717279","cluster_addr":"172.21.15.135:6811/3316717279","heartbeat_back_addr":"172.21.15.135:6815/3316717279","heartbeat_front_addr":"172.21.15.135:6813/3316717279","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:06.137315+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.222776+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.477878+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.530174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:04.779952+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.847174+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.445765+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.572805+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:03:14.418 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T00:03:14.418 INFO:tasks.ceph:Creating RBD pool 2024-09-12T00:03:14.419 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T00:03:15.524 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'rbd' created 2024-09-12T00:03:15.553 DEBUG:teuthology.orchestra.run.smithi019:> rbd --cluster ceph pool init rbd 2024-09-12T00:03:18.584 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T00:03:18.585 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T00:03:18.585 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T00:03:18.907 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:03:18.927 INFO:teuthology.orchestra.run.smithi019.stdout:[{"version":9,"timestamp":"2024-09-12T00:03:07.931341+0000","name":"","changes":[{"name":"osd.0/osd_mclock_max_capacity_iops_ssd","new_value":"6660.680935"}]}] 2024-09-12T00:03:18.927 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T00:03:18.927 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T00:03:18.927 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T00:03:18.927 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T00:03:19.281 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:03:19.299 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2617924703},{"type":"v1","addr":"172.21.15.135:6825","nonce":2617924703}]},"active_addr":"172.21.15.135:6825/2617924703","active_change":"2024-09-12T00:03:00.361622+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4100,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":3386115925}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":1390486491}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":2188277484}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":2506390201}]}]} 2024-09-12T00:03:19.304 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T00:03:19.304 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T00:03:19.304 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:03:19.611 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:03:19.611 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"fsid":"e8cc2cf2-4ebe-41fb-ac6a-f09b6fd34589","created":"2024-09-12T00:02:55.594166+0000","modified":"2024-09-12T00:03:18.547787+0000","last_up_change":"2024-09-12T00:03:08.456127+0000","last_in_change":"2024-09-12T00:02:58.648554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:03:10.418576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:03:14.745863+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af1b1898-c45f-43f5-b9c5-26e491625211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6809","nonce":846638970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6811","nonce":846638970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6815","nonce":846638970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6813","nonce":846638970}]},"public_addr":"172.21.15.19:6809/846638970","cluster_addr":"172.21.15.19:6811/846638970","heartbeat_back_addr":"172.21.15.19:6815/846638970","heartbeat_front_addr":"172.21.15.19:6813/846638970","state":["exists","up"]},{"osd":1,"uuid":"fe1aa63d-8e57-4163-98a5-0131e1a60680","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6801","nonce":889703096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6803","nonce":889703096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6807","nonce":889703096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6805","nonce":889703096}]},"public_addr":"172.21.15.19:6801/889703096","cluster_addr":"172.21.15.19:6803/889703096","heartbeat_back_addr":"172.21.15.19:6807/889703096","heartbeat_front_addr":"172.21.15.19:6805/889703096","state":["exists","up"]},{"osd":2,"uuid":"1c97c435-1516-46e1-8fb9-fab9d7419774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6817","nonce":1847757189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6819","nonce":1847757189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6823","nonce":1847757189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6821","nonce":1847757189}]},"public_addr":"172.21.15.19:6817/1847757189","cluster_addr":"172.21.15.19:6819/1847757189","heartbeat_back_addr":"172.21.15.19:6823/1847757189","heartbeat_front_addr":"172.21.15.19:6821/1847757189","state":["exists","up"]},{"osd":3,"uuid":"30dc8f77-54f0-4e5a-8adc-3ef4b1c08f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6825","nonce":2630062148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6827","nonce":2630062148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6831","nonce":2630062148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6829","nonce":2630062148}]},"public_addr":"172.21.15.19:6825/2630062148","cluster_addr":"172.21.15.19:6827/2630062148","heartbeat_back_addr":"172.21.15.19:6831/2630062148","heartbeat_front_addr":"172.21.15.19:6829/2630062148","state":["exists","up"]},{"osd":4,"uuid":"0b4e8ec4-cb09-4c05-9ddb-fe1e664e8f03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6801","nonce":2966848021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6803","nonce":2966848021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6807","nonce":2966848021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6805","nonce":2966848021}]},"public_addr":"172.21.15.135:6801/2966848021","cluster_addr":"172.21.15.135:6803/2966848021","heartbeat_back_addr":"172.21.15.135:6807/2966848021","heartbeat_front_addr":"172.21.15.135:6805/2966848021","state":["exists","up"]},{"osd":5,"uuid":"44796deb-5225-490a-a526-e0be07036b8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6827","nonce":3933885245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6829","nonce":3933885245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6833","nonce":3933885245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6831","nonce":3933885245}]},"public_addr":"172.21.15.135:6827/3933885245","cluster_addr":"172.21.15.135:6829/3933885245","heartbeat_back_addr":"172.21.15.135:6833/3933885245","heartbeat_front_addr":"172.21.15.135:6831/3933885245","state":["exists","up"]},{"osd":6,"uuid":"cecfecf3-d6c7-44f3-9c08-259ae76571c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6817","nonce":951791611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6819","nonce":951791611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6823","nonce":951791611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6821","nonce":951791611}]},"public_addr":"172.21.15.135:6817/951791611","cluster_addr":"172.21.15.135:6819/951791611","heartbeat_back_addr":"172.21.15.135:6823/951791611","heartbeat_front_addr":"172.21.15.135:6821/951791611","state":["exists","up"]},{"osd":7,"uuid":"df0b245a-9a80-4038-8e00-4931eaee68c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6809","nonce":3316717279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6811","nonce":3316717279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6815","nonce":3316717279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6813","nonce":3316717279}]},"public_addr":"172.21.15.135:6809/3316717279","cluster_addr":"172.21.15.135:6811/3316717279","heartbeat_back_addr":"172.21.15.135:6815/3316717279","heartbeat_front_addr":"172.21.15.135:6813/3316717279","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:06.137315+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.222776+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.477878+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.530174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:04.779952+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.847174+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.445765+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.572805+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:03:19.629 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T00:03:19.629 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:03:19.925 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:03:19.925 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"fsid":"e8cc2cf2-4ebe-41fb-ac6a-f09b6fd34589","created":"2024-09-12T00:02:55.594166+0000","modified":"2024-09-12T00:03:18.547787+0000","last_up_change":"2024-09-12T00:03:08.456127+0000","last_in_change":"2024-09-12T00:02:58.648554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:03:10.418576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:03:14.745863+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af1b1898-c45f-43f5-b9c5-26e491625211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6809","nonce":846638970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6811","nonce":846638970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6815","nonce":846638970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6813","nonce":846638970}]},"public_addr":"172.21.15.19:6809/846638970","cluster_addr":"172.21.15.19:6811/846638970","heartbeat_back_addr":"172.21.15.19:6815/846638970","heartbeat_front_addr":"172.21.15.19:6813/846638970","state":["exists","up"]},{"osd":1,"uuid":"fe1aa63d-8e57-4163-98a5-0131e1a60680","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6801","nonce":889703096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6803","nonce":889703096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6807","nonce":889703096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6805","nonce":889703096}]},"public_addr":"172.21.15.19:6801/889703096","cluster_addr":"172.21.15.19:6803/889703096","heartbeat_back_addr":"172.21.15.19:6807/889703096","heartbeat_front_addr":"172.21.15.19:6805/889703096","state":["exists","up"]},{"osd":2,"uuid":"1c97c435-1516-46e1-8fb9-fab9d7419774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6817","nonce":1847757189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6819","nonce":1847757189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6823","nonce":1847757189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6821","nonce":1847757189}]},"public_addr":"172.21.15.19:6817/1847757189","cluster_addr":"172.21.15.19:6819/1847757189","heartbeat_back_addr":"172.21.15.19:6823/1847757189","heartbeat_front_addr":"172.21.15.19:6821/1847757189","state":["exists","up"]},{"osd":3,"uuid":"30dc8f77-54f0-4e5a-8adc-3ef4b1c08f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6825","nonce":2630062148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6827","nonce":2630062148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6831","nonce":2630062148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6829","nonce":2630062148}]},"public_addr":"172.21.15.19:6825/2630062148","cluster_addr":"172.21.15.19:6827/2630062148","heartbeat_back_addr":"172.21.15.19:6831/2630062148","heartbeat_front_addr":"172.21.15.19:6829/2630062148","state":["exists","up"]},{"osd":4,"uuid":"0b4e8ec4-cb09-4c05-9ddb-fe1e664e8f03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6801","nonce":2966848021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6803","nonce":2966848021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6807","nonce":2966848021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6805","nonce":2966848021}]},"public_addr":"172.21.15.135:6801/2966848021","cluster_addr":"172.21.15.135:6803/2966848021","heartbeat_back_addr":"172.21.15.135:6807/2966848021","heartbeat_front_addr":"172.21.15.135:6805/2966848021","state":["exists","up"]},{"osd":5,"uuid":"44796deb-5225-490a-a526-e0be07036b8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6827","nonce":3933885245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6829","nonce":3933885245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6833","nonce":3933885245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6831","nonce":3933885245}]},"public_addr":"172.21.15.135:6827/3933885245","cluster_addr":"172.21.15.135:6829/3933885245","heartbeat_back_addr":"172.21.15.135:6833/3933885245","heartbeat_front_addr":"172.21.15.135:6831/3933885245","state":["exists","up"]},{"osd":6,"uuid":"cecfecf3-d6c7-44f3-9c08-259ae76571c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6817","nonce":951791611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6819","nonce":951791611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6823","nonce":951791611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6821","nonce":951791611}]},"public_addr":"172.21.15.135:6817/951791611","cluster_addr":"172.21.15.135:6819/951791611","heartbeat_back_addr":"172.21.15.135:6823/951791611","heartbeat_front_addr":"172.21.15.135:6821/951791611","state":["exists","up"]},{"osd":7,"uuid":"df0b245a-9a80-4038-8e00-4931eaee68c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6809","nonce":3316717279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6811","nonce":3316717279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6815","nonce":3316717279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6813","nonce":3316717279}]},"public_addr":"172.21.15.135:6809/3316717279","cluster_addr":"172.21.15.135:6811/3316717279","heartbeat_back_addr":"172.21.15.135:6815/3316717279","heartbeat_front_addr":"172.21.15.135:6813/3316717279","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:06.137315+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.222776+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.477878+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.530174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:04.779952+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.847174+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.445765+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.572805+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:03:19.943 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T00:03:19.944 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T00:03:19.944 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T00:03:19.944 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T00:03:19.945 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T00:03:19.945 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T00:03:19.946 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T00:03:19.946 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T00:03:20.187 INFO:teuthology.orchestra.run.smithi019.stdout:60129542150 2024-09-12T00:03:20.188 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:03:20.210 INFO:teuthology.orchestra.run.smithi019.stdout:60129542151 2024-09-12T00:03:20.211 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:03:20.212 INFO:teuthology.orchestra.run.smithi019.stdout:60129542150 2024-09-12T00:03:20.213 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:03:20.217 INFO:teuthology.orchestra.run.smithi019.stdout:60129542150 2024-09-12T00:03:20.217 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:03:20.222 INFO:teuthology.orchestra.run.smithi019.stdout:60129542150 2024-09-12T00:03:20.223 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:03:20.224 INFO:teuthology.orchestra.run.smithi019.stdout:60129542149 2024-09-12T00:03:20.225 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:03:20.233 INFO:teuthology.orchestra.run.smithi019.stdout:60129542150 2024-09-12T00:03:20.233 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:03:20.235 INFO:teuthology.orchestra.run.smithi019.stdout:60129542150 2024-09-12T00:03:20.235 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:03:20.716 INFO:teuthology.orchestra.run.smithi019.stdout:60129542150 2024-09-12T00:03:20.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-09-12T00:03:20.739 DEBUG:teuthology.parallel:result is None 2024-09-12T00:03:20.753 INFO:teuthology.orchestra.run.smithi019.stdout:60129542149 2024-09-12T00:03:20.761 INFO:teuthology.orchestra.run.smithi019.stdout:60129542151 2024-09-12T00:03:20.764 INFO:teuthology.orchestra.run.smithi019.stdout:60129542150 2024-09-12T00:03:20.777 INFO:teuthology.orchestra.run.smithi019.stdout:60129542150 2024-09-12T00:03:20.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.2 2024-09-12T00:03:20.786 DEBUG:teuthology.parallel:result is None 2024-09-12T00:03:20.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2024-09-12T00:03:20.786 DEBUG:teuthology.parallel:result is None 2024-09-12T00:03:20.789 INFO:teuthology.orchestra.run.smithi019.stdout:60129542150 2024-09-12T00:03:20.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2024-09-12T00:03:20.798 DEBUG:teuthology.parallel:result is None 2024-09-12T00:03:20.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2024-09-12T00:03:20.808 DEBUG:teuthology.parallel:result is None 2024-09-12T00:03:20.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2024-09-12T00:03:20.813 DEBUG:teuthology.parallel:result is None 2024-09-12T00:03:20.819 INFO:teuthology.orchestra.run.smithi019.stdout:60129542150 2024-09-12T00:03:20.830 INFO:teuthology.orchestra.run.smithi019.stdout:60129542150 2024-09-12T00:03:20.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2024-09-12T00:03:20.837 DEBUG:teuthology.parallel:result is None 2024-09-12T00:03:20.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2024-09-12T00:03:20.847 DEBUG:teuthology.parallel:result is None 2024-09-12T00:03:20.847 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:03:20.848 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:03:21.172 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:03:21.173 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T00:03:21.190 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-12T00:03:20.374213+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223340,"kb_used_data":2916,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751380,"statfs":{"total":773094113280,"available":772865413120,"internally_reserved":0,"allocated":2985984,"data_stored":1789246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.843190"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:03:18.566832+0000","last_change":"2024-09-12T00:03:18.566832+0000","last_active":"2024-09-12T00:03:18.566832+0000","last_peered":"2024-09-12T00:03:18.566832+0000","last_clean":"2024-09-12T00:03:18.566832+0000","last_became_active":"2024-09-12T00:03:16.592377+0000","last_became_peered":"2024-09-12T00:03:16.592377+0000","last_unstale":"2024-09-12T00:03:18.566832+0000","last_undegraded":"2024-09-12T00:03:18.566832+0000","last_fullsized":"2024-09-12T00:03:18.566832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:31.379733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001199625,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:03:18.716204+0000","last_change":"2024-09-12T00:03:18.716648+0000","last_active":"2024-09-12T00:03:18.716204+0000","last_peered":"2024-09-12T00:03:18.716204+0000","last_clean":"2024-09-12T00:03:18.716204+0000","last_became_active":"2024-09-12T00:03:16.594609+0000","last_became_peered":"2024-09-12T00:03:16.594609+0000","last_unstale":"2024-09-12T00:03:18.716204+0000","last_undegraded":"2024-09-12T00:03:18.716204+0000","last_fullsized":"2024-09-12T00:03:18.716204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:34.635008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010254439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:03:18.566691+0000","last_change":"2024-09-12T00:03:18.566691+0000","last_active":"2024-09-12T00:03:18.566691+0000","last_peered":"2024-09-12T00:03:18.566691+0000","last_clean":"2024-09-12T00:03:18.566691+0000","last_became_active":"2024-09-12T00:03:16.553662+0000","last_became_peered":"2024-09-12T00:03:16.553662+0000","last_unstale":"2024-09-12T00:03:18.566691+0000","last_undegraded":"2024-09-12T00:03:18.566691+0000","last_fullsized":"2024-09-12T00:03:18.566691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:14.502459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011030910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:03:18.562010+0000","last_change":"2024-09-12T00:03:18.562010+0000","last_active":"2024-09-12T00:03:18.562010+0000","last_peered":"2024-09-12T00:03:18.562010+0000","last_clean":"2024-09-12T00:03:18.562010+0000","last_became_active":"2024-09-12T00:03:16.561218+0000","last_became_peered":"2024-09-12T00:03:16.561218+0000","last_unstale":"2024-09-12T00:03:18.562010+0000","last_undegraded":"2024-09-12T00:03:18.562010+0000","last_fullsized":"2024-09-12T00:03:18.562010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:43.089686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084170299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:03:18.569309+0000","last_change":"2024-09-12T00:03:18.568246+0000","last_active":"2024-09-12T00:03:18.569309+0000","last_peered":"2024-09-12T00:03:18.569309+0000","last_clean":"2024-09-12T00:03:18.569309+0000","last_became_active":"2024-09-12T00:03:16.554663+0000","last_became_peered":"2024-09-12T00:03:16.554663+0000","last_unstale":"2024-09-12T00:03:18.569309+0000","last_undegraded":"2024-09-12T00:03:18.569309+0000","last_fullsized":"2024-09-12T00:03:18.569309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:52.802404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025471840000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:03:18.891968+0000","last_change":"2024-09-12T00:03:18.892423+0000","last_active":"2024-09-12T00:03:18.891968+0000","last_peered":"2024-09-12T00:03:18.891968+0000","last_clean":"2024-09-12T00:03:18.891968+0000","last_became_active":"2024-09-12T00:03:16.559698+0000","last_became_peered":"2024-09-12T00:03:16.559698+0000","last_unstale":"2024-09-12T00:03:18.891968+0000","last_undegraded":"2024-09-12T00:03:18.891968+0000","last_fullsized":"2024-09-12T00:03:18.891968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:21.453461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082440599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:03:18.567433+0000","last_change":"2024-09-12T00:03:18.567433+0000","last_active":"2024-09-12T00:03:18.567433+0000","last_peered":"2024-09-12T00:03:18.567433+0000","last_clean":"2024-09-12T00:03:18.567433+0000","last_became_active":"2024-09-12T00:03:16.557489+0000","last_became_peered":"2024-09-12T00:03:16.557489+0000","last_unstale":"2024-09-12T00:03:18.567433+0000","last_undegraded":"2024-09-12T00:03:18.567433+0000","last_fullsized":"2024-09-12T00:03:18.567433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:26.187640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001769713,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:03:18.567644+0000","last_change":"2024-09-12T00:03:18.567644+0000","last_active":"2024-09-12T00:03:18.567644+0000","last_peered":"2024-09-12T00:03:18.567644+0000","last_clean":"2024-09-12T00:03:18.567644+0000","last_became_active":"2024-09-12T00:03:16.592765+0000","last_became_peered":"2024-09-12T00:03:16.592765+0000","last_unstale":"2024-09-12T00:03:18.567644+0000","last_undegraded":"2024-09-12T00:03:18.567644+0000","last_fullsized":"2024-09-12T00:03:18.567644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:06.283894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001924708,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:03:18.559352+0000","last_change":"2024-09-12T00:03:11.770141+0000","last_active":"2024-09-12T00:03:18.559352+0000","last_peered":"2024-09-12T00:03:18.559352+0000","last_clean":"2024-09-12T00:03:18.559352+0000","last_became_active":"2024-09-12T00:03:11.767988+0000","last_became_peered":"2024-09-12T00:03:11.767988+0000","last_unstale":"2024-09-12T00:03:18.559352+0000","last_undegraded":"2024-09-12T00:03:18.559352+0000","last_fullsized":"2024-09-12T00:03:18.559352+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_clean_scrub_stamp":"2024-09-12T00:03:10.462069+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:26.289955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":819200,"data_stored":667156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":70956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":819200,"data_stored":667156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:03:21.191 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:03:21.485 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:03:21.485 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T00:03:21.502 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-12T00:03:20.374213+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223340,"kb_used_data":2916,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751380,"statfs":{"total":773094113280,"available":772865413120,"internally_reserved":0,"allocated":2985984,"data_stored":1789246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.843190"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:03:18.566832+0000","last_change":"2024-09-12T00:03:18.566832+0000","last_active":"2024-09-12T00:03:18.566832+0000","last_peered":"2024-09-12T00:03:18.566832+0000","last_clean":"2024-09-12T00:03:18.566832+0000","last_became_active":"2024-09-12T00:03:16.592377+0000","last_became_peered":"2024-09-12T00:03:16.592377+0000","last_unstale":"2024-09-12T00:03:18.566832+0000","last_undegraded":"2024-09-12T00:03:18.566832+0000","last_fullsized":"2024-09-12T00:03:18.566832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:31.379733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001199625,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:03:18.716204+0000","last_change":"2024-09-12T00:03:18.716648+0000","last_active":"2024-09-12T00:03:18.716204+0000","last_peered":"2024-09-12T00:03:18.716204+0000","last_clean":"2024-09-12T00:03:18.716204+0000","last_became_active":"2024-09-12T00:03:16.594609+0000","last_became_peered":"2024-09-12T00:03:16.594609+0000","last_unstale":"2024-09-12T00:03:18.716204+0000","last_undegraded":"2024-09-12T00:03:18.716204+0000","last_fullsized":"2024-09-12T00:03:18.716204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:34.635008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010254439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:03:18.566691+0000","last_change":"2024-09-12T00:03:18.566691+0000","last_active":"2024-09-12T00:03:18.566691+0000","last_peered":"2024-09-12T00:03:18.566691+0000","last_clean":"2024-09-12T00:03:18.566691+0000","last_became_active":"2024-09-12T00:03:16.553662+0000","last_became_peered":"2024-09-12T00:03:16.553662+0000","last_unstale":"2024-09-12T00:03:18.566691+0000","last_undegraded":"2024-09-12T00:03:18.566691+0000","last_fullsized":"2024-09-12T00:03:18.566691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:14.502459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011030910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:03:18.562010+0000","last_change":"2024-09-12T00:03:18.562010+0000","last_active":"2024-09-12T00:03:18.562010+0000","last_peered":"2024-09-12T00:03:18.562010+0000","last_clean":"2024-09-12T00:03:18.562010+0000","last_became_active":"2024-09-12T00:03:16.561218+0000","last_became_peered":"2024-09-12T00:03:16.561218+0000","last_unstale":"2024-09-12T00:03:18.562010+0000","last_undegraded":"2024-09-12T00:03:18.562010+0000","last_fullsized":"2024-09-12T00:03:18.562010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:43.089686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084170299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:03:18.569309+0000","last_change":"2024-09-12T00:03:18.568246+0000","last_active":"2024-09-12T00:03:18.569309+0000","last_peered":"2024-09-12T00:03:18.569309+0000","last_clean":"2024-09-12T00:03:18.569309+0000","last_became_active":"2024-09-12T00:03:16.554663+0000","last_became_peered":"2024-09-12T00:03:16.554663+0000","last_unstale":"2024-09-12T00:03:18.569309+0000","last_undegraded":"2024-09-12T00:03:18.569309+0000","last_fullsized":"2024-09-12T00:03:18.569309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:52.802404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025471840000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:03:18.891968+0000","last_change":"2024-09-12T00:03:18.892423+0000","last_active":"2024-09-12T00:03:18.891968+0000","last_peered":"2024-09-12T00:03:18.891968+0000","last_clean":"2024-09-12T00:03:18.891968+0000","last_became_active":"2024-09-12T00:03:16.559698+0000","last_became_peered":"2024-09-12T00:03:16.559698+0000","last_unstale":"2024-09-12T00:03:18.891968+0000","last_undegraded":"2024-09-12T00:03:18.891968+0000","last_fullsized":"2024-09-12T00:03:18.891968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:21.453461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082440599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:03:18.567433+0000","last_change":"2024-09-12T00:03:18.567433+0000","last_active":"2024-09-12T00:03:18.567433+0000","last_peered":"2024-09-12T00:03:18.567433+0000","last_clean":"2024-09-12T00:03:18.567433+0000","last_became_active":"2024-09-12T00:03:16.557489+0000","last_became_peered":"2024-09-12T00:03:16.557489+0000","last_unstale":"2024-09-12T00:03:18.567433+0000","last_undegraded":"2024-09-12T00:03:18.567433+0000","last_fullsized":"2024-09-12T00:03:18.567433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:26.187640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001769713,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:03:18.567644+0000","last_change":"2024-09-12T00:03:18.567644+0000","last_active":"2024-09-12T00:03:18.567644+0000","last_peered":"2024-09-12T00:03:18.567644+0000","last_clean":"2024-09-12T00:03:18.567644+0000","last_became_active":"2024-09-12T00:03:16.592765+0000","last_became_peered":"2024-09-12T00:03:16.592765+0000","last_unstale":"2024-09-12T00:03:18.567644+0000","last_undegraded":"2024-09-12T00:03:18.567644+0000","last_fullsized":"2024-09-12T00:03:18.567644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:06.283894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001924708,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:03:18.559352+0000","last_change":"2024-09-12T00:03:11.770141+0000","last_active":"2024-09-12T00:03:18.559352+0000","last_peered":"2024-09-12T00:03:18.559352+0000","last_clean":"2024-09-12T00:03:18.559352+0000","last_became_active":"2024-09-12T00:03:11.767988+0000","last_became_peered":"2024-09-12T00:03:11.767988+0000","last_unstale":"2024-09-12T00:03:18.559352+0000","last_undegraded":"2024-09-12T00:03:18.559352+0000","last_fullsized":"2024-09-12T00:03:18.559352+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_clean_scrub_stamp":"2024-09-12T00:03:10.462069+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:26.289955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":819200,"data_stored":667156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":70956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":819200,"data_stored":667156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:03:21.502 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:03:21.503 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T00:03:21.503 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T00:03:21.503 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T00:03:21.840 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:03:21.840 INFO:teuthology.orchestra.run.smithi019.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T00:03:21.857 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T00:03:21.858 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T00:03:22.039 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-12T00:03:22.039 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T00:03:22.039 INFO:tasks.rgw:Creating data pools 2024-09-12T00:03:22.039 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T00:03:22.040 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-12T00:03:22.573 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T00:03:22.605 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T00:03:23.576 INFO:teuthology.orchestra.run.smithi019.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T00:03:23.625 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T00:03:24.581 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T00:03:24.618 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T00:03:25.295 INFO:teuthology.orchestra.run.smithi019.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T00:03:25.332 DEBUG:tasks.rgw:Pools created 2024-09-12T00:03:25.332 INFO:tasks.rgw:Starting rgw... 2024-09-12T00:03:25.332 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-12T00:03:25.332 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T00:03:25.333 DEBUG:teuthology.orchestra.run.smithi019:> sudo echo -n http://smithi019.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T00:03:25.347 INFO:teuthology.orchestra.run.smithi019.stdout:http://smithi019.front.sepia.ceph.com:80 2024-09-12T00:03:25.347 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T00:03:25.400 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T00:03:25.400 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T00:03:25.447 INFO:tasks.rgw.client.0:Started 2024-09-12T00:03:25.447 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi019.front.sepia.ceph.com:80/ 2024-09-12T00:03:25.447 DEBUG:teuthology.orchestra.run.smithi019:> curl http://smithi019.front.sepia.ceph.com:80/ 2024-09-12T00:03:25.470 INFO:teuthology.orchestra.run.smithi019.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:03:25.470 INFO:teuthology.orchestra.run.smithi019.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:03:25.470 INFO:teuthology.orchestra.run.smithi019.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:03:25.470 INFO:teuthology.orchestra.run.smithi019.stderr:curl: (7) Failed to connect to smithi019.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T00:03:25.471 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:03:26.472 DEBUG:teuthology.orchestra.run.smithi019:> curl http://smithi019.front.sepia.ceph.com:80/ 2024-09-12T00:03:26.484 INFO:teuthology.orchestra.run.smithi019.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:03:26.485 INFO:teuthology.orchestra.run.smithi019.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:03:26.485 INFO:teuthology.orchestra.run.smithi019.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:03:26.485 INFO:teuthology.orchestra.run.smithi019.stderr:curl: (7) Failed to connect to smithi019.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T00:03:26.485 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:03:28.486 DEBUG:teuthology.orchestra.run.smithi019:> curl http://smithi019.front.sepia.ceph.com:80/ 2024-09-12T00:03:28.499 INFO:teuthology.orchestra.run.smithi019.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:03:28.499 INFO:teuthology.orchestra.run.smithi019.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:03:28.499 INFO:teuthology.orchestra.run.smithi019.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:03:28.499 INFO:teuthology.orchestra.run.smithi019.stderr:curl: (7) Failed to connect to smithi019.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T00:03:28.499 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:03:32.500 DEBUG:teuthology.orchestra.run.smithi019:> curl http://smithi019.front.sepia.ceph.com:80/ 2024-09-12T00:03:32.512 INFO:teuthology.orchestra.run.smithi019.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:03:32.512 INFO:teuthology.orchestra.run.smithi019.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:03:32.512 INFO:teuthology.orchestra.run.smithi019.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:03:32.512 INFO:teuthology.orchestra.run.smithi019.stderr:curl: (7) Failed to connect to smithi019.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T00:03:32.513 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:03:40.514 DEBUG:teuthology.orchestra.run.smithi019:> curl http://smithi019.front.sepia.ceph.com:80/ 2024-09-12T00:03:40.526 INFO:teuthology.orchestra.run.smithi019.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:03:40.526 INFO:teuthology.orchestra.run.smithi019.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:03:40.529 INFO:teuthology.orchestra.run.smithi019.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 59440 0 --:--:-- --:--:-- --:--:-- 62333 2024-09-12T00:03:40.530 INFO:teuthology.orchestra.run.smithi019.stdout:anonymous 2024-09-12T00:03:40.530 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-12T00:03:40.553 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-12T00:03:40.553 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-67986', 'sha1': '6a169fc940965ab446a63954fde870aa497efde7'}} 2024-09-12T00:03:40.553 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-12T00:03:40.554 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-12T00:03:40.926 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-12T00:03:40.926 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:03:40.926 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:03:41.270 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:03:41.277 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T00:03:41.289 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-09-12T00:03:40.380947+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":228,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":0,"num_read":1046,"num_read_kb":762,"num_write":722,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":678,"ondisk_log_size":678,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229040,"kb_used_data":4496,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745680,"statfs":{"total":773094113280,"available":772859576320,"internally_reserved":0,"allocated":4603904,"data_stored":2564540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":218,"num_whiteouts":0,"num_read":976,"num_read_kb":703,"num_write":609,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002883"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.374239+0000","last_change":"2024-09-12T00:03:23.604218+0000","last_active":"2024-09-12T00:03:34.374239+0000","last_peered":"2024-09-12T00:03:34.374239+0000","last_clean":"2024-09-12T00:03:34.374239+0000","last_became_active":"2024-09-12T00:03:23.603902+0000","last_became_peered":"2024-09-12T00:03:23.603902+0000","last_unstale":"2024-09-12T00:03:34.374239+0000","last_undegraded":"2024-09-12T00:03:34.374239+0000","last_fullsized":"2024-09-12T00:03:34.374239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:35.848041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.366685+0000","last_change":"2024-09-12T00:03:25.337244+0000","last_active":"2024-09-12T00:03:34.366685+0000","last_peered":"2024-09-12T00:03:34.366685+0000","last_clean":"2024-09-12T00:03:34.366685+0000","last_became_active":"2024-09-12T00:03:25.335964+0000","last_became_peered":"2024-09-12T00:03:25.335964+0000","last_unstale":"2024-09-12T00:03:34.366685+0000","last_undegraded":"2024-09-12T00:03:34.366685+0000","last_fullsized":"2024-09-12T00:03:34.366685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.383330+0000","last_change":"2024-09-12T00:03:23.628328+0000","last_active":"2024-09-12T00:03:34.383330+0000","last_peered":"2024-09-12T00:03:34.383330+0000","last_clean":"2024-09-12T00:03:34.383330+0000","last_became_active":"2024-09-12T00:03:23.627630+0000","last_became_peered":"2024-09-12T00:03:23.627630+0000","last_unstale":"2024-09-12T00:03:34.383330+0000","last_undegraded":"2024-09-12T00:03:34.383330+0000","last_fullsized":"2024-09-12T00:03:34.383330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:00.573006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348171+0000","last_change":"2024-09-12T00:03:25.338343+0000","last_active":"2024-09-12T00:03:34.348171+0000","last_peered":"2024-09-12T00:03:34.348171+0000","last_clean":"2024-09-12T00:03:34.348171+0000","last_became_active":"2024-09-12T00:03:25.337994+0000","last_became_peered":"2024-09-12T00:03:25.337994+0000","last_unstale":"2024-09-12T00:03:34.348171+0000","last_undegraded":"2024-09-12T00:03:34.348171+0000","last_fullsized":"2024-09-12T00:03:34.348171+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:39.689763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382868+0000","last_change":"2024-09-12T00:03:23.626533+0000","last_active":"2024-09-12T00:03:34.382868+0000","last_peered":"2024-09-12T00:03:34.382868+0000","last_clean":"2024-09-12T00:03:34.382868+0000","last_became_active":"2024-09-12T00:03:23.625728+0000","last_became_peered":"2024-09-12T00:03:23.625728+0000","last_unstale":"2024-09-12T00:03:34.382868+0000","last_undegraded":"2024-09-12T00:03:34.382868+0000","last_fullsized":"2024-09-12T00:03:34.382868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:31.772442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348548+0000","last_change":"2024-09-12T00:03:25.336667+0000","last_active":"2024-09-12T00:03:34.348548+0000","last_peered":"2024-09-12T00:03:34.348548+0000","last_clean":"2024-09-12T00:03:34.348548+0000","last_became_active":"2024-09-12T00:03:25.336327+0000","last_became_peered":"2024-09-12T00:03:25.336327+0000","last_unstale":"2024-09-12T00:03:34.348548+0000","last_undegraded":"2024-09-12T00:03:34.348548+0000","last_fullsized":"2024-09-12T00:03:34.348548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:45.222842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.407965+0000","last_change":"2024-09-12T00:03:23.609828+0000","last_active":"2024-09-12T00:03:34.407965+0000","last_peered":"2024-09-12T00:03:34.407965+0000","last_clean":"2024-09-12T00:03:34.407965+0000","last_became_active":"2024-09-12T00:03:23.609326+0000","last_became_peered":"2024-09-12T00:03:23.609326+0000","last_unstale":"2024-09-12T00:03:34.407965+0000","last_undegraded":"2024-09-12T00:03:34.407965+0000","last_fullsized":"2024-09-12T00:03:34.407965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:25.491620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.386607+0000","last_change":"2024-09-12T00:03:25.339518+0000","last_active":"2024-09-12T00:03:34.386607+0000","last_peered":"2024-09-12T00:03:34.386607+0000","last_clean":"2024-09-12T00:03:34.386607+0000","last_became_active":"2024-09-12T00:03:25.338805+0000","last_became_peered":"2024-09-12T00:03:25.338805+0000","last_unstale":"2024-09-12T00:03:34.386607+0000","last_undegraded":"2024-09-12T00:03:34.386607+0000","last_fullsized":"2024-09-12T00:03:34.386607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.372895+0000","last_change":"2024-09-12T00:03:23.633978+0000","last_active":"2024-09-12T00:03:34.372895+0000","last_peered":"2024-09-12T00:03:34.372895+0000","last_clean":"2024-09-12T00:03:34.372895+0000","last_became_active":"2024-09-12T00:03:23.633580+0000","last_became_peered":"2024-09-12T00:03:23.633580+0000","last_unstale":"2024-09-12T00:03:34.372895+0000","last_undegraded":"2024-09-12T00:03:34.372895+0000","last_fullsized":"2024-09-12T00:03:34.372895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:01.872688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.372658+0000","last_change":"2024-09-12T00:03:25.324424+0000","last_active":"2024-09-12T00:03:34.372658+0000","last_peered":"2024-09-12T00:03:34.372658+0000","last_clean":"2024-09-12T00:03:34.372658+0000","last_became_active":"2024-09-12T00:03:25.324138+0000","last_became_peered":"2024-09-12T00:03:25.324138+0000","last_unstale":"2024-09-12T00:03:34.372658+0000","last_undegraded":"2024-09-12T00:03:34.372658+0000","last_fullsized":"2024-09-12T00:03:34.372658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:09.954252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.406353+0000","last_change":"2024-09-12T00:03:23.610136+0000","last_active":"2024-09-12T00:03:34.406353+0000","last_peered":"2024-09-12T00:03:34.406353+0000","last_clean":"2024-09-12T00:03:34.406353+0000","last_became_active":"2024-09-12T00:03:23.609509+0000","last_became_peered":"2024-09-12T00:03:23.609509+0000","last_unstale":"2024-09-12T00:03:34.406353+0000","last_undegraded":"2024-09-12T00:03:34.406353+0000","last_fullsized":"2024-09-12T00:03:34.406353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373120+0000","last_change":"2024-09-12T00:03:25.355256+0000","last_active":"2024-09-12T00:03:34.373120+0000","last_peered":"2024-09-12T00:03:34.373120+0000","last_clean":"2024-09-12T00:03:34.373120+0000","last_became_active":"2024-09-12T00:03:25.355002+0000","last_became_peered":"2024-09-12T00:03:25.355002+0000","last_unstale":"2024-09-12T00:03:34.373120+0000","last_undegraded":"2024-09-12T00:03:34.373120+0000","last_fullsized":"2024-09-12T00:03:34.373120+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:50.488869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.372791+0000","last_change":"2024-09-12T00:03:23.606780+0000","last_active":"2024-09-12T00:03:34.372791+0000","last_peered":"2024-09-12T00:03:34.372791+0000","last_clean":"2024-09-12T00:03:34.372791+0000","last_became_active":"2024-09-12T00:03:23.606143+0000","last_became_peered":"2024-09-12T00:03:23.606143+0000","last_unstale":"2024-09-12T00:03:34.372791+0000","last_undegraded":"2024-09-12T00:03:34.372791+0000","last_fullsized":"2024-09-12T00:03:34.372791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:22.889982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.408445+0000","last_change":"2024-09-12T00:03:25.330195+0000","last_active":"2024-09-12T00:03:34.408445+0000","last_peered":"2024-09-12T00:03:34.408445+0000","last_clean":"2024-09-12T00:03:34.408445+0000","last_became_active":"2024-09-12T00:03:25.329625+0000","last_became_peered":"2024-09-12T00:03:25.329625+0000","last_unstale":"2024-09-12T00:03:34.408445+0000","last_undegraded":"2024-09-12T00:03:34.408445+0000","last_fullsized":"2024-09-12T00:03:34.408445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.380771+0000","last_change":"2024-09-12T00:03:23.626723+0000","last_active":"2024-09-12T00:03:34.380771+0000","last_peered":"2024-09-12T00:03:34.380771+0000","last_clean":"2024-09-12T00:03:34.380771+0000","last_became_active":"2024-09-12T00:03:23.626018+0000","last_became_peered":"2024-09-12T00:03:23.626018+0000","last_unstale":"2024-09-12T00:03:34.380771+0000","last_undegraded":"2024-09-12T00:03:34.380771+0000","last_fullsized":"2024-09-12T00:03:34.380771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.383891+0000","last_change":"2024-09-12T00:03:25.352418+0000","last_active":"2024-09-12T00:03:34.383891+0000","last_peered":"2024-09-12T00:03:34.383891+0000","last_clean":"2024-09-12T00:03:34.383891+0000","last_became_active":"2024-09-12T00:03:25.347902+0000","last_became_peered":"2024-09-12T00:03:25.347902+0000","last_unstale":"2024-09-12T00:03:34.383891+0000","last_undegraded":"2024-09-12T00:03:34.383891+0000","last_fullsized":"2024-09-12T00:03:34.383891+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:29.611790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347314+0000","last_change":"2024-09-12T00:03:25.321057+0000","last_active":"2024-09-12T00:03:34.347314+0000","last_peered":"2024-09-12T00:03:34.347314+0000","last_clean":"2024-09-12T00:03:34.347314+0000","last_became_active":"2024-09-12T00:03:25.320611+0000","last_became_peered":"2024-09-12T00:03:25.320611+0000","last_unstale":"2024-09-12T00:03:34.347314+0000","last_undegraded":"2024-09-12T00:03:34.347314+0000","last_fullsized":"2024-09-12T00:03:34.347314+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:46.041829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.369131+0000","last_change":"2024-09-12T00:03:23.594170+0000","last_active":"2024-09-12T00:03:34.369131+0000","last_peered":"2024-09-12T00:03:34.369131+0000","last_clean":"2024-09-12T00:03:34.369131+0000","last_became_active":"2024-09-12T00:03:23.593880+0000","last_became_peered":"2024-09-12T00:03:23.593880+0000","last_unstale":"2024-09-12T00:03:34.369131+0000","last_undegraded":"2024-09-12T00:03:34.369131+0000","last_fullsized":"2024-09-12T00:03:34.369131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:33.234598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.372337+0000","last_change":"2024-09-12T00:03:25.334966+0000","last_active":"2024-09-12T00:03:34.372337+0000","last_peered":"2024-09-12T00:03:34.372337+0000","last_clean":"2024-09-12T00:03:34.372337+0000","last_became_active":"2024-09-12T00:03:25.334375+0000","last_became_peered":"2024-09-12T00:03:25.334375+0000","last_unstale":"2024-09-12T00:03:34.372337+0000","last_undegraded":"2024-09-12T00:03:34.372337+0000","last_fullsized":"2024-09-12T00:03:34.372337+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:52.828056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373941+0000","last_change":"2024-09-12T00:03:23.614289+0000","last_active":"2024-09-12T00:03:34.373941+0000","last_peered":"2024-09-12T00:03:34.373941+0000","last_clean":"2024-09-12T00:03:34.373941+0000","last_became_active":"2024-09-12T00:03:23.614019+0000","last_became_peered":"2024-09-12T00:03:23.614019+0000","last_unstale":"2024-09-12T00:03:34.373941+0000","last_undegraded":"2024-09-12T00:03:34.373941+0000","last_fullsized":"2024-09-12T00:03:34.373941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:00.847027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.367356+0000","last_change":"2024-09-12T00:03:25.357938+0000","last_active":"2024-09-12T00:03:34.367356+0000","last_peered":"2024-09-12T00:03:34.367356+0000","last_clean":"2024-09-12T00:03:34.367356+0000","last_became_active":"2024-09-12T00:03:25.357571+0000","last_became_peered":"2024-09-12T00:03:25.357571+0000","last_unstale":"2024-09-12T00:03:34.367356+0000","last_undegraded":"2024-09-12T00:03:34.367356+0000","last_fullsized":"2024-09-12T00:03:34.367356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:05.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373209+0000","last_change":"2024-09-12T00:03:23.604162+0000","last_active":"2024-09-12T00:03:34.373209+0000","last_peered":"2024-09-12T00:03:34.373209+0000","last_clean":"2024-09-12T00:03:34.373209+0000","last_became_active":"2024-09-12T00:03:23.603466+0000","last_became_peered":"2024-09-12T00:03:23.603466+0000","last_unstale":"2024-09-12T00:03:34.373209+0000","last_undegraded":"2024-09-12T00:03:34.373209+0000","last_fullsized":"2024-09-12T00:03:34.373209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:50.482404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350086+0000","last_change":"2024-09-12T00:03:25.345717+0000","last_active":"2024-09-12T00:03:34.350086+0000","last_peered":"2024-09-12T00:03:34.350086+0000","last_clean":"2024-09-12T00:03:34.350086+0000","last_became_active":"2024-09-12T00:03:25.344959+0000","last_became_peered":"2024-09-12T00:03:25.344959+0000","last_unstale":"2024-09-12T00:03:34.350086+0000","last_undegraded":"2024-09-12T00:03:34.350086+0000","last_fullsized":"2024-09-12T00:03:34.350086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373142+0000","last_change":"2024-09-12T00:03:23.602960+0000","last_active":"2024-09-12T00:03:34.373142+0000","last_peered":"2024-09-12T00:03:34.373142+0000","last_clean":"2024-09-12T00:03:34.373142+0000","last_became_active":"2024-09-12T00:03:23.602640+0000","last_became_peered":"2024-09-12T00:03:23.602640+0000","last_unstale":"2024-09-12T00:03:34.373142+0000","last_undegraded":"2024-09-12T00:03:34.373142+0000","last_fullsized":"2024-09-12T00:03:34.373142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382067+0000","last_change":"2024-09-12T00:03:25.339888+0000","last_active":"2024-09-12T00:03:34.382067+0000","last_peered":"2024-09-12T00:03:34.382067+0000","last_clean":"2024-09-12T00:03:34.382067+0000","last_became_active":"2024-09-12T00:03:25.339092+0000","last_became_peered":"2024-09-12T00:03:25.339092+0000","last_unstale":"2024-09-12T00:03:34.382067+0000","last_undegraded":"2024-09-12T00:03:34.382067+0000","last_fullsized":"2024-09-12T00:03:34.382067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:06.165291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350831+0000","last_change":"2024-09-12T00:03:23.604732+0000","last_active":"2024-09-12T00:03:34.350831+0000","last_peered":"2024-09-12T00:03:34.350831+0000","last_clean":"2024-09-12T00:03:34.350831+0000","last_became_active":"2024-09-12T00:03:23.603932+0000","last_became_peered":"2024-09-12T00:03:23.603932+0000","last_unstale":"2024-09-12T00:03:34.350831+0000","last_undegraded":"2024-09-12T00:03:34.350831+0000","last_fullsized":"2024-09-12T00:03:34.350831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:14.913580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.368083+0000","last_change":"2024-09-12T00:03:25.341332+0000","last_active":"2024-09-12T00:03:34.368083+0000","last_peered":"2024-09-12T00:03:34.368083+0000","last_clean":"2024-09-12T00:03:34.368083+0000","last_became_active":"2024-09-12T00:03:25.340828+0000","last_became_peered":"2024-09-12T00:03:25.340828+0000","last_unstale":"2024-09-12T00:03:34.368083+0000","last_undegraded":"2024-09-12T00:03:34.368083+0000","last_fullsized":"2024-09-12T00:03:34.368083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348991+0000","last_change":"2024-09-12T00:03:23.602687+0000","last_active":"2024-09-12T00:03:34.348991+0000","last_peered":"2024-09-12T00:03:34.348991+0000","last_clean":"2024-09-12T00:03:34.348991+0000","last_became_active":"2024-09-12T00:03:23.601892+0000","last_became_peered":"2024-09-12T00:03:23.601892+0000","last_unstale":"2024-09-12T00:03:34.348991+0000","last_undegraded":"2024-09-12T00:03:34.348991+0000","last_fullsized":"2024-09-12T00:03:34.348991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.371662+0000","last_change":"2024-09-12T00:03:33.354850+0000","last_active":"2024-09-12T00:03:34.371662+0000","last_peered":"2024-09-12T00:03:34.371662+0000","last_clean":"2024-09-12T00:03:34.371662+0000","last_became_active":"2024-09-12T00:03:33.351917+0000","last_became_peered":"2024-09-12T00:03:33.351917+0000","last_unstale":"2024-09-12T00:03:34.371662+0000","last_undegraded":"2024-09-12T00:03:34.371662+0000","last_fullsized":"2024-09-12T00:03:34.371662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:00.466863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349952+0000","last_change":"2024-09-12T00:03:25.323174+0000","last_active":"2024-09-12T00:03:34.349952+0000","last_peered":"2024-09-12T00:03:34.349952+0000","last_clean":"2024-09-12T00:03:34.349952+0000","last_became_active":"2024-09-12T00:03:25.322456+0000","last_became_peered":"2024-09-12T00:03:25.322456+0000","last_unstale":"2024-09-12T00:03:34.349952+0000","last_undegraded":"2024-09-12T00:03:34.349952+0000","last_fullsized":"2024-09-12T00:03:34.349952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347913+0000","last_change":"2024-09-12T00:03:23.606234+0000","last_active":"2024-09-12T00:03:34.347913+0000","last_peered":"2024-09-12T00:03:34.347913+0000","last_clean":"2024-09-12T00:03:34.347913+0000","last_became_active":"2024-09-12T00:03:23.605699+0000","last_became_peered":"2024-09-12T00:03:23.605699+0000","last_unstale":"2024-09-12T00:03:34.347913+0000","last_undegraded":"2024-09-12T00:03:34.347913+0000","last_fullsized":"2024-09-12T00:03:34.347913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:20.775704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350454+0000","last_change":"2024-09-12T00:03:27.341305+0000","last_active":"2024-09-12T00:03:34.350454+0000","last_peered":"2024-09-12T00:03:34.350454+0000","last_clean":"2024-09-12T00:03:34.350454+0000","last_became_active":"2024-09-12T00:03:27.338132+0000","last_became_peered":"2024-09-12T00:03:27.338132+0000","last_unstale":"2024-09-12T00:03:34.350454+0000","last_undegraded":"2024-09-12T00:03:34.350454+0000","last_fullsized":"2024-09-12T00:03:34.350454+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:11.884824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'21","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.780636+0000","last_change":"2024-09-12T00:03:29.347224+0000","last_active":"2024-09-12T00:03:34.780636+0000","last_peered":"2024-09-12T00:03:34.780636+0000","last_clean":"2024-09-12T00:03:34.780636+0000","last_became_active":"2024-09-12T00:03:29.346662+0000","last_became_peered":"2024-09-12T00:03:29.346662+0000","last_unstale":"2024-09-12T00:03:34.780636+0000","last_undegraded":"2024-09-12T00:03:34.780636+0000","last_fullsized":"2024-09-12T00:03:34.780636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:28.258932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.368441+0000","last_change":"2024-09-12T00:03:31.337219+0000","last_active":"2024-09-12T00:03:34.368441+0000","last_peered":"2024-09-12T00:03:34.368441+0000","last_clean":"2024-09-12T00:03:34.368441+0000","last_became_active":"2024-09-12T00:03:31.336317+0000","last_became_peered":"2024-09-12T00:03:31.336317+0000","last_unstale":"2024-09-12T00:03:34.368441+0000","last_undegraded":"2024-09-12T00:03:34.368441+0000","last_fullsized":"2024-09-12T00:03:34.368441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:50.954053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.366332+0000","last_change":"2024-09-12T00:03:33.376628+0000","last_active":"2024-09-12T00:03:34.366332+0000","last_peered":"2024-09-12T00:03:34.366332+0000","last_clean":"2024-09-12T00:03:34.366332+0000","last_became_active":"2024-09-12T00:03:33.375938+0000","last_became_peered":"2024-09-12T00:03:33.375938+0000","last_unstale":"2024-09-12T00:03:34.366332+0000","last_undegraded":"2024-09-12T00:03:34.366332+0000","last_fullsized":"2024-09-12T00:03:34.366332+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:31.105042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349839+0000","last_change":"2024-09-12T00:03:25.326911+0000","last_active":"2024-09-12T00:03:34.349839+0000","last_peered":"2024-09-12T00:03:34.349839+0000","last_clean":"2024-09-12T00:03:34.349839+0000","last_became_active":"2024-09-12T00:03:25.326255+0000","last_became_peered":"2024-09-12T00:03:25.326255+0000","last_unstale":"2024-09-12T00:03:34.349839+0000","last_undegraded":"2024-09-12T00:03:34.349839+0000","last_fullsized":"2024-09-12T00:03:34.349839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:15.491636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349275+0000","last_change":"2024-09-12T00:03:23.596266+0000","last_active":"2024-09-12T00:03:34.349275+0000","last_peered":"2024-09-12T00:03:34.349275+0000","last_clean":"2024-09-12T00:03:34.349275+0000","last_became_active":"2024-09-12T00:03:23.595480+0000","last_became_peered":"2024-09-12T00:03:23.595480+0000","last_unstale":"2024-09-12T00:03:34.349275+0000","last_undegraded":"2024-09-12T00:03:34.349275+0000","last_fullsized":"2024-09-12T00:03:34.349275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:25.491620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.385739+0000","last_change":"2024-09-12T00:03:27.336108+0000","last_active":"2024-09-12T00:03:34.385739+0000","last_peered":"2024-09-12T00:03:34.385739+0000","last_clean":"2024-09-12T00:03:34.385739+0000","last_became_active":"2024-09-12T00:03:27.335308+0000","last_became_peered":"2024-09-12T00:03:27.335308+0000","last_unstale":"2024-09-12T00:03:34.385739+0000","last_undegraded":"2024-09-12T00:03:34.385739+0000","last_fullsized":"2024-09-12T00:03:34.385739+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:39.812803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'12","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.158067+0000","last_change":"2024-09-12T00:03:29.352496+0000","last_active":"2024-09-12T00:03:35.158067+0000","last_peered":"2024-09-12T00:03:35.158067+0000","last_clean":"2024-09-12T00:03:35.158067+0000","last_became_active":"2024-09-12T00:03:29.351783+0000","last_became_peered":"2024-09-12T00:03:29.351783+0000","last_unstale":"2024-09-12T00:03:35.158067+0000","last_undegraded":"2024-09-12T00:03:35.158067+0000","last_fullsized":"2024-09-12T00:03:35.158067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.368037+0000","last_change":"2024-09-12T00:03:31.350279+0000","last_active":"2024-09-12T00:03:34.368037+0000","last_peered":"2024-09-12T00:03:34.368037+0000","last_clean":"2024-09-12T00:03:34.368037+0000","last_became_active":"2024-09-12T00:03:31.349244+0000","last_became_peered":"2024-09-12T00:03:31.349244+0000","last_unstale":"2024-09-12T00:03:34.368037+0000","last_undegraded":"2024-09-12T00:03:34.368037+0000","last_fullsized":"2024-09-12T00:03:34.368037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.420974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348210+0000","last_change":"2024-09-12T00:03:33.382726+0000","last_active":"2024-09-12T00:03:34.348210+0000","last_peered":"2024-09-12T00:03:34.348210+0000","last_clean":"2024-09-12T00:03:34.348210+0000","last_became_active":"2024-09-12T00:03:33.381875+0000","last_became_peered":"2024-09-12T00:03:33.381875+0000","last_unstale":"2024-09-12T00:03:34.348210+0000","last_undegraded":"2024-09-12T00:03:34.348210+0000","last_fullsized":"2024-09-12T00:03:34.348210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.383200+0000","last_change":"2024-09-12T00:03:25.357883+0000","last_active":"2024-09-12T00:03:34.383200+0000","last_peered":"2024-09-12T00:03:34.383200+0000","last_clean":"2024-09-12T00:03:34.383200+0000","last_became_active":"2024-09-12T00:03:25.355174+0000","last_became_peered":"2024-09-12T00:03:25.355174+0000","last_unstale":"2024-09-12T00:03:34.383200+0000","last_undegraded":"2024-09-12T00:03:34.383200+0000","last_fullsized":"2024-09-12T00:03:34.383200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:26.621650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348657+0000","last_change":"2024-09-12T00:03:23.617603+0000","last_active":"2024-09-12T00:03:34.348657+0000","last_peered":"2024-09-12T00:03:34.348657+0000","last_clean":"2024-09-12T00:03:34.348657+0000","last_became_active":"2024-09-12T00:03:23.617317+0000","last_became_peered":"2024-09-12T00:03:23.617317+0000","last_unstale":"2024-09-12T00:03:34.348657+0000","last_undegraded":"2024-09-12T00:03:34.348657+0000","last_fullsized":"2024-09-12T00:03:34.348657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:36.997566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.387068+0000","last_change":"2024-09-12T00:03:27.347098+0000","last_active":"2024-09-12T00:03:34.387068+0000","last_peered":"2024-09-12T00:03:34.387068+0000","last_clean":"2024-09-12T00:03:34.387068+0000","last_became_active":"2024-09-12T00:03:27.346346+0000","last_became_peered":"2024-09-12T00:03:27.346346+0000","last_unstale":"2024-09-12T00:03:34.387068+0000","last_undegraded":"2024-09-12T00:03:34.387068+0000","last_fullsized":"2024-09-12T00:03:34.387068+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:56.250627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'22","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.220659+0000","last_change":"2024-09-12T00:03:29.357080+0000","last_active":"2024-09-12T00:03:35.220659+0000","last_peered":"2024-09-12T00:03:35.220659+0000","last_clean":"2024-09-12T00:03:35.220659+0000","last_became_active":"2024-09-12T00:03:29.356262+0000","last_became_peered":"2024-09-12T00:03:29.356262+0000","last_unstale":"2024-09-12T00:03:35.220659+0000","last_undegraded":"2024-09-12T00:03:35.220659+0000","last_fullsized":"2024-09-12T00:03:35.220659+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:27.790240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"32'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350634+0000","last_change":"2024-09-12T00:03:31.362060+0000","last_active":"2024-09-12T00:03:34.350634+0000","last_peered":"2024-09-12T00:03:34.350634+0000","last_clean":"2024-09-12T00:03:34.350634+0000","last_became_active":"2024-09-12T00:03:31.361330+0000","last_became_peered":"2024-09-12T00:03:31.361330+0000","last_unstale":"2024-09-12T00:03:34.350634+0000","last_undegraded":"2024-09-12T00:03:34.350634+0000","last_fullsized":"2024-09-12T00:03:34.350634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:06.142584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.406389+0000","last_change":"2024-09-12T00:03:33.378439+0000","last_active":"2024-09-12T00:03:34.406389+0000","last_peered":"2024-09-12T00:03:34.406389+0000","last_clean":"2024-09-12T00:03:34.406389+0000","last_became_active":"2024-09-12T00:03:33.374453+0000","last_became_peered":"2024-09-12T00:03:33.374453+0000","last_unstale":"2024-09-12T00:03:34.406389+0000","last_undegraded":"2024-09-12T00:03:34.406389+0000","last_fullsized":"2024-09-12T00:03:34.406389+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.383561+0000","last_change":"2024-09-12T00:03:25.356433+0000","last_active":"2024-09-12T00:03:34.383561+0000","last_peered":"2024-09-12T00:03:34.383561+0000","last_clean":"2024-09-12T00:03:34.383561+0000","last_became_active":"2024-09-12T00:03:25.354803+0000","last_became_peered":"2024-09-12T00:03:25.354803+0000","last_unstale":"2024-09-12T00:03:34.383561+0000","last_undegraded":"2024-09-12T00:03:34.383561+0000","last_fullsized":"2024-09-12T00:03:34.383561+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:00.419686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.367398+0000","last_change":"2024-09-12T00:03:23.630527+0000","last_active":"2024-09-12T00:03:34.367398+0000","last_peered":"2024-09-12T00:03:34.367398+0000","last_clean":"2024-09-12T00:03:34.367398+0000","last_became_active":"2024-09-12T00:03:23.630183+0000","last_became_peered":"2024-09-12T00:03:23.630183+0000","last_unstale":"2024-09-12T00:03:34.367398+0000","last_undegraded":"2024-09-12T00:03:34.367398+0000","last_fullsized":"2024-09-12T00:03:34.367398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348714+0000","last_change":"2024-09-12T00:03:27.334188+0000","last_active":"2024-09-12T00:03:34.348714+0000","last_peered":"2024-09-12T00:03:34.348714+0000","last_clean":"2024-09-12T00:03:34.348714+0000","last_became_active":"2024-09-12T00:03:27.333395+0000","last_became_peered":"2024-09-12T00:03:27.333395+0000","last_unstale":"2024-09-12T00:03:34.348714+0000","last_undegraded":"2024-09-12T00:03:34.348714+0000","last_fullsized":"2024-09-12T00:03:34.348714+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:56.266608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'15","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.225844+0000","last_change":"2024-09-12T00:03:29.339735+0000","last_active":"2024-09-12T00:03:35.225844+0000","last_peered":"2024-09-12T00:03:35.225844+0000","last_clean":"2024-09-12T00:03:35.225844+0000","last_became_active":"2024-09-12T00:03:29.338810+0000","last_became_peered":"2024-09-12T00:03:29.338810+0000","last_unstale":"2024-09-12T00:03:35.225844+0000","last_undegraded":"2024-09-12T00:03:35.225844+0000","last_fullsized":"2024-09-12T00:03:35.225844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382458+0000","last_change":"2024-09-12T00:03:31.364647+0000","last_active":"2024-09-12T00:03:34.382458+0000","last_peered":"2024-09-12T00:03:34.382458+0000","last_clean":"2024-09-12T00:03:34.382458+0000","last_became_active":"2024-09-12T00:03:31.353547+0000","last_became_peered":"2024-09-12T00:03:31.353547+0000","last_unstale":"2024-09-12T00:03:34.382458+0000","last_undegraded":"2024-09-12T00:03:34.382458+0000","last_fullsized":"2024-09-12T00:03:34.382458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:20.795870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347328+0000","last_change":"2024-09-12T00:03:25.329615+0000","last_active":"2024-09-12T00:03:34.347328+0000","last_peered":"2024-09-12T00:03:34.347328+0000","last_clean":"2024-09-12T00:03:34.347328+0000","last_became_active":"2024-09-12T00:03:25.329015+0000","last_became_peered":"2024-09-12T00:03:25.329015+0000","last_unstale":"2024-09-12T00:03:34.347328+0000","last_undegraded":"2024-09-12T00:03:34.347328+0000","last_fullsized":"2024-09-12T00:03:34.347328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:00.170397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.374425+0000","last_change":"2024-09-12T00:03:23.602206+0000","last_active":"2024-09-12T00:03:34.374425+0000","last_peered":"2024-09-12T00:03:34.374425+0000","last_clean":"2024-09-12T00:03:34.374425+0000","last_became_active":"2024-09-12T00:03:23.601898+0000","last_became_peered":"2024-09-12T00:03:23.601898+0000","last_unstale":"2024-09-12T00:03:34.374425+0000","last_undegraded":"2024-09-12T00:03:34.374425+0000","last_fullsized":"2024-09-12T00:03:34.374425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:52.625795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.366812+0000","last_change":"2024-09-12T00:03:27.331111+0000","last_active":"2024-09-12T00:03:34.366812+0000","last_peered":"2024-09-12T00:03:34.366812+0000","last_clean":"2024-09-12T00:03:34.366812+0000","last_became_active":"2024-09-12T00:03:27.329672+0000","last_became_peered":"2024-09-12T00:03:27.329672+0000","last_unstale":"2024-09-12T00:03:34.366812+0000","last_undegraded":"2024-09-12T00:03:34.366812+0000","last_fullsized":"2024-09-12T00:03:34.366812+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'25","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.325784+0000","last_change":"2024-09-12T00:03:29.335931+0000","last_active":"2024-09-12T00:03:35.325784+0000","last_peered":"2024-09-12T00:03:35.325784+0000","last_clean":"2024-09-12T00:03:35.325784+0000","last_became_active":"2024-09-12T00:03:29.335044+0000","last_became_peered":"2024-09-12T00:03:29.335044+0000","last_unstale":"2024-09-12T00:03:35.325784+0000","last_undegraded":"2024-09-12T00:03:35.325784+0000","last_fullsized":"2024-09-12T00:03:35.325784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:57.131209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349488+0000","last_change":"2024-09-12T00:03:31.355001+0000","last_active":"2024-09-12T00:03:34.349488+0000","last_peered":"2024-09-12T00:03:34.349488+0000","last_clean":"2024-09-12T00:03:34.349488+0000","last_became_active":"2024-09-12T00:03:31.354160+0000","last_became_peered":"2024-09-12T00:03:31.354160+0000","last_unstale":"2024-09-12T00:03:34.349488+0000","last_undegraded":"2024-09-12T00:03:34.349488+0000","last_fullsized":"2024-09-12T00:03:34.349488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:29.868141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.407499+0000","last_change":"2024-09-12T00:03:33.387603+0000","last_active":"2024-09-12T00:03:34.407499+0000","last_peered":"2024-09-12T00:03:34.407499+0000","last_clean":"2024-09-12T00:03:34.407499+0000","last_became_active":"2024-09-12T00:03:33.386614+0000","last_became_peered":"2024-09-12T00:03:33.386614+0000","last_unstale":"2024-09-12T00:03:34.407499+0000","last_undegraded":"2024-09-12T00:03:34.407499+0000","last_fullsized":"2024-09-12T00:03:34.407499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:37.428182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.367097+0000","last_change":"2024-09-12T00:03:25.357300+0000","last_active":"2024-09-12T00:03:34.367097+0000","last_peered":"2024-09-12T00:03:34.367097+0000","last_clean":"2024-09-12T00:03:34.367097+0000","last_became_active":"2024-09-12T00:03:25.356970+0000","last_became_peered":"2024-09-12T00:03:25.356970+0000","last_unstale":"2024-09-12T00:03:34.367097+0000","last_undegraded":"2024-09-12T00:03:34.367097+0000","last_fullsized":"2024-09-12T00:03:34.367097+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:04.193738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.408336+0000","last_change":"2024-09-12T00:03:23.609700+0000","last_active":"2024-09-12T00:03:34.408336+0000","last_peered":"2024-09-12T00:03:34.408336+0000","last_clean":"2024-09-12T00:03:34.408336+0000","last_became_active":"2024-09-12T00:03:23.609435+0000","last_became_peered":"2024-09-12T00:03:23.609435+0000","last_unstale":"2024-09-12T00:03:34.408336+0000","last_undegraded":"2024-09-12T00:03:34.408336+0000","last_fullsized":"2024-09-12T00:03:34.408336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348251+0000","last_change":"2024-09-12T00:03:27.339670+0000","last_active":"2024-09-12T00:03:34.348251+0000","last_peered":"2024-09-12T00:03:34.348251+0000","last_clean":"2024-09-12T00:03:34.348251+0000","last_became_active":"2024-09-12T00:03:27.338880+0000","last_became_peered":"2024-09-12T00:03:27.338880+0000","last_unstale":"2024-09-12T00:03:34.348251+0000","last_undegraded":"2024-09-12T00:03:34.348251+0000","last_fullsized":"2024-09-12T00:03:34.348251+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:35.068652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"35'15","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.196702+0000","last_change":"2024-09-12T00:03:29.337666+0000","last_active":"2024-09-12T00:03:35.196702+0000","last_peered":"2024-09-12T00:03:35.196702+0000","last_clean":"2024-09-12T00:03:35.196702+0000","last_became_active":"2024-09-12T00:03:29.336957+0000","last_became_peered":"2024-09-12T00:03:29.336957+0000","last_unstale":"2024-09-12T00:03:35.196702+0000","last_undegraded":"2024-09-12T00:03:35.196702+0000","last_fullsized":"2024-09-12T00:03:35.196702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:58.417315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.384320+0000","last_change":"2024-09-12T00:03:31.348590+0000","last_active":"2024-09-12T00:03:34.384320+0000","last_peered":"2024-09-12T00:03:34.384320+0000","last_clean":"2024-09-12T00:03:34.384320+0000","last_became_active":"2024-09-12T00:03:31.347736+0000","last_became_peered":"2024-09-12T00:03:31.347736+0000","last_unstale":"2024-09-12T00:03:34.384320+0000","last_undegraded":"2024-09-12T00:03:34.384320+0000","last_fullsized":"2024-09-12T00:03:34.384320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:04.962492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.367142+0000","last_change":"2024-09-12T00:03:33.379699+0000","last_active":"2024-09-12T00:03:34.367142+0000","last_peered":"2024-09-12T00:03:34.367142+0000","last_clean":"2024-09-12T00:03:34.367142+0000","last_became_active":"2024-09-12T00:03:33.378945+0000","last_became_peered":"2024-09-12T00:03:33.378945+0000","last_unstale":"2024-09-12T00:03:34.367142+0000","last_undegraded":"2024-09-12T00:03:34.367142+0000","last_fullsized":"2024-09-12T00:03:34.367142+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:23.270488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.406080+0000","last_change":"2024-09-12T00:03:25.333941+0000","last_active":"2024-09-12T00:03:34.406080+0000","last_peered":"2024-09-12T00:03:34.406080+0000","last_clean":"2024-09-12T00:03:34.406080+0000","last_became_active":"2024-09-12T00:03:25.333559+0000","last_became_peered":"2024-09-12T00:03:25.333559+0000","last_unstale":"2024-09-12T00:03:34.406080+0000","last_undegraded":"2024-09-12T00:03:34.406080+0000","last_fullsized":"2024-09-12T00:03:34.406080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349199+0000","last_change":"2024-09-12T00:03:23.596202+0000","last_active":"2024-09-12T00:03:34.349199+0000","last_peered":"2024-09-12T00:03:34.349199+0000","last_clean":"2024-09-12T00:03:34.349199+0000","last_became_active":"2024-09-12T00:03:23.595859+0000","last_became_peered":"2024-09-12T00:03:23.595859+0000","last_unstale":"2024-09-12T00:03:34.349199+0000","last_undegraded":"2024-09-12T00:03:34.349199+0000","last_fullsized":"2024-09-12T00:03:34.349199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:12.001918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.381391+0000","last_change":"2024-09-12T00:03:27.348080+0000","last_active":"2024-09-12T00:03:34.381391+0000","last_peered":"2024-09-12T00:03:34.381391+0000","last_clean":"2024-09-12T00:03:34.381391+0000","last_became_active":"2024-09-12T00:03:27.347288+0000","last_became_peered":"2024-09-12T00:03:27.347288+0000","last_unstale":"2024-09-12T00:03:34.381391+0000","last_undegraded":"2024-09-12T00:03:34.381391+0000","last_fullsized":"2024-09-12T00:03:34.381391+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:37.033224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"35'27","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.105570+0000","last_change":"2024-09-12T00:03:29.349297+0000","last_active":"2024-09-12T00:03:35.105570+0000","last_peered":"2024-09-12T00:03:35.105570+0000","last_clean":"2024-09-12T00:03:35.105570+0000","last_became_active":"2024-09-12T00:03:29.348779+0000","last_became_peered":"2024-09-12T00:03:29.348779+0000","last_unstale":"2024-09-12T00:03:35.105570+0000","last_undegraded":"2024-09-12T00:03:35.105570+0000","last_fullsized":"2024-09-12T00:03:35.105570+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:40.759557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.380425+0000","last_change":"2024-09-12T00:03:31.354114+0000","last_active":"2024-09-12T00:03:34.380425+0000","last_peered":"2024-09-12T00:03:34.380425+0000","last_clean":"2024-09-12T00:03:34.380425+0000","last_became_active":"2024-09-12T00:03:31.353358+0000","last_became_peered":"2024-09-12T00:03:31.353358+0000","last_unstale":"2024-09-12T00:03:34.380425+0000","last_undegraded":"2024-09-12T00:03:34.380425+0000","last_fullsized":"2024-09-12T00:03:34.380425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:56.624718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350407+0000","last_change":"2024-09-12T00:03:33.383917+0000","last_active":"2024-09-12T00:03:34.350407+0000","last_peered":"2024-09-12T00:03:34.350407+0000","last_clean":"2024-09-12T00:03:34.350407+0000","last_became_active":"2024-09-12T00:03:33.383199+0000","last_became_peered":"2024-09-12T00:03:33.383199+0000","last_unstale":"2024-09-12T00:03:34.350407+0000","last_undegraded":"2024-09-12T00:03:34.350407+0000","last_fullsized":"2024-09-12T00:03:34.350407+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:37.428182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382144+0000","last_change":"2024-09-12T00:03:25.356706+0000","last_active":"2024-09-12T00:03:34.382144+0000","last_peered":"2024-09-12T00:03:34.382144+0000","last_clean":"2024-09-12T00:03:34.382144+0000","last_became_active":"2024-09-12T00:03:25.354555+0000","last_became_peered":"2024-09-12T00:03:25.354555+0000","last_unstale":"2024-09-12T00:03:34.382144+0000","last_undegraded":"2024-09-12T00:03:34.382144+0000","last_fullsized":"2024-09-12T00:03:34.382144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:55.543336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373772+0000","last_change":"2024-09-12T00:03:23.612430+0000","last_active":"2024-09-12T00:03:34.373772+0000","last_peered":"2024-09-12T00:03:34.373772+0000","last_clean":"2024-09-12T00:03:34.373772+0000","last_became_active":"2024-09-12T00:03:23.612165+0000","last_became_peered":"2024-09-12T00:03:23.612165+0000","last_unstale":"2024-09-12T00:03:34.373772+0000","last_undegraded":"2024-09-12T00:03:34.373772+0000","last_fullsized":"2024-09-12T00:03:34.373772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:31.444343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348671+0000","last_change":"2024-09-12T00:03:27.329228+0000","last_active":"2024-09-12T00:03:34.348671+0000","last_peered":"2024-09-12T00:03:34.348671+0000","last_clean":"2024-09-12T00:03:34.348671+0000","last_became_active":"2024-09-12T00:03:27.328497+0000","last_became_peered":"2024-09-12T00:03:27.328497+0000","last_unstale":"2024-09-12T00:03:34.348671+0000","last_undegraded":"2024-09-12T00:03:34.348671+0000","last_fullsized":"2024-09-12T00:03:34.348671+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"35'24","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.753584+0000","last_change":"2024-09-12T00:03:29.332778+0000","last_active":"2024-09-12T00:03:34.753584+0000","last_peered":"2024-09-12T00:03:34.753584+0000","last_clean":"2024-09-12T00:03:34.753584+0000","last_became_active":"2024-09-12T00:03:29.332010+0000","last_became_peered":"2024-09-12T00:03:29.332010+0000","last_unstale":"2024-09-12T00:03:34.753584+0000","last_undegraded":"2024-09-12T00:03:34.753584+0000","last_fullsized":"2024-09-12T00:03:34.753584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:13.563107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.381060+0000","last_change":"2024-09-12T00:03:31.354374+0000","last_active":"2024-09-12T00:03:34.381060+0000","last_peered":"2024-09-12T00:03:34.381060+0000","last_clean":"2024-09-12T00:03:34.381060+0000","last_became_active":"2024-09-12T00:03:31.353407+0000","last_became_peered":"2024-09-12T00:03:31.353407+0000","last_unstale":"2024-09-12T00:03:34.381060+0000","last_undegraded":"2024-09-12T00:03:34.381060+0000","last_fullsized":"2024-09-12T00:03:34.381060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:30.520217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.352163+0000","last_change":"2024-09-12T00:03:33.385373+0000","last_active":"2024-09-12T00:03:34.352163+0000","last_peered":"2024-09-12T00:03:34.352163+0000","last_clean":"2024-09-12T00:03:34.352163+0000","last_became_active":"2024-09-12T00:03:33.384559+0000","last_became_peered":"2024-09-12T00:03:33.384559+0000","last_unstale":"2024-09-12T00:03:34.352163+0000","last_undegraded":"2024-09-12T00:03:34.352163+0000","last_fullsized":"2024-09-12T00:03:34.352163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:55.924174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373201+0000","last_change":"2024-09-12T00:03:25.326677+0000","last_active":"2024-09-12T00:03:34.373201+0000","last_peered":"2024-09-12T00:03:34.373201+0000","last_clean":"2024-09-12T00:03:34.373201+0000","last_became_active":"2024-09-12T00:03:25.325840+0000","last_became_peered":"2024-09-12T00:03:25.325840+0000","last_unstale":"2024-09-12T00:03:34.373201+0000","last_undegraded":"2024-09-12T00:03:34.373201+0000","last_fullsized":"2024-09-12T00:03:34.373201+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:07.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.351369+0000","last_change":"2024-09-12T00:03:23.616943+0000","last_active":"2024-09-12T00:03:34.351369+0000","last_peered":"2024-09-12T00:03:34.351369+0000","last_clean":"2024-09-12T00:03:34.351369+0000","last_became_active":"2024-09-12T00:03:23.616200+0000","last_became_peered":"2024-09-12T00:03:23.616200+0000","last_unstale":"2024-09-12T00:03:34.351369+0000","last_undegraded":"2024-09-12T00:03:34.351369+0000","last_fullsized":"2024-09-12T00:03:34.351369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350659+0000","last_change":"2024-09-12T00:03:27.330506+0000","last_active":"2024-09-12T00:03:34.350659+0000","last_peered":"2024-09-12T00:03:34.350659+0000","last_clean":"2024-09-12T00:03:34.350659+0000","last_became_active":"2024-09-12T00:03:27.329830+0000","last_became_peered":"2024-09-12T00:03:27.329830+0000","last_unstale":"2024-09-12T00:03:34.350659+0000","last_undegraded":"2024-09-12T00:03:34.350659+0000","last_fullsized":"2024-09-12T00:03:34.350659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:03.446090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"35'17","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.260142+0000","last_change":"2024-09-12T00:03:29.343655+0000","last_active":"2024-09-12T00:03:35.260142+0000","last_peered":"2024-09-12T00:03:35.260142+0000","last_clean":"2024-09-12T00:03:35.260142+0000","last_became_active":"2024-09-12T00:03:29.343178+0000","last_became_peered":"2024-09-12T00:03:29.343178+0000","last_unstale":"2024-09-12T00:03:35.260142+0000","last_undegraded":"2024-09-12T00:03:35.260142+0000","last_fullsized":"2024-09-12T00:03:35.260142+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.351803+0000","last_change":"2024-09-12T00:03:31.358077+0000","last_active":"2024-09-12T00:03:34.351803+0000","last_peered":"2024-09-12T00:03:34.351803+0000","last_clean":"2024-09-12T00:03:34.351803+0000","last_became_active":"2024-09-12T00:03:31.357272+0000","last_became_peered":"2024-09-12T00:03:31.357272+0000","last_unstale":"2024-09-12T00:03:34.351803+0000","last_undegraded":"2024-09-12T00:03:34.351803+0000","last_fullsized":"2024-09-12T00:03:34.351803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:37.991682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.380144+0000","last_change":"2024-09-12T00:03:33.386299+0000","last_active":"2024-09-12T00:03:34.380144+0000","last_peered":"2024-09-12T00:03:34.380144+0000","last_clean":"2024-09-12T00:03:34.380144+0000","last_became_active":"2024-09-12T00:03:33.385357+0000","last_became_peered":"2024-09-12T00:03:33.385357+0000","last_unstale":"2024-09-12T00:03:34.380144+0000","last_undegraded":"2024-09-12T00:03:34.380144+0000","last_fullsized":"2024-09-12T00:03:34.380144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:17.028373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350223+0000","last_change":"2024-09-12T00:03:25.333772+0000","last_active":"2024-09-12T00:03:34.350223+0000","last_peered":"2024-09-12T00:03:34.350223+0000","last_clean":"2024-09-12T00:03:34.350223+0000","last_became_active":"2024-09-12T00:03:25.333338+0000","last_became_peered":"2024-09-12T00:03:25.333338+0000","last_unstale":"2024-09-12T00:03:34.350223+0000","last_undegraded":"2024-09-12T00:03:34.350223+0000","last_fullsized":"2024-09-12T00:03:34.350223+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:13.572959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349443+0000","last_change":"2024-09-12T00:03:23.598015+0000","last_active":"2024-09-12T00:03:34.349443+0000","last_peered":"2024-09-12T00:03:34.349443+0000","last_clean":"2024-09-12T00:03:34.349443+0000","last_became_active":"2024-09-12T00:03:23.594135+0000","last_became_peered":"2024-09-12T00:03:23.594135+0000","last_unstale":"2024-09-12T00:03:34.349443+0000","last_undegraded":"2024-09-12T00:03:34.349443+0000","last_fullsized":"2024-09-12T00:03:34.349443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:31.336675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.381820+0000","last_change":"2024-09-12T00:03:27.342295+0000","last_active":"2024-09-12T00:03:34.381820+0000","last_peered":"2024-09-12T00:03:34.381820+0000","last_clean":"2024-09-12T00:03:34.381820+0000","last_became_active":"2024-09-12T00:03:27.341619+0000","last_became_peered":"2024-09-12T00:03:27.341619+0000","last_unstale":"2024-09-12T00:03:34.381820+0000","last_undegraded":"2024-09-12T00:03:34.381820+0000","last_fullsized":"2024-09-12T00:03:34.381820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:00.908798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"35'15","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.335470+0000","last_change":"2024-09-12T00:03:29.336391+0000","last_active":"2024-09-12T00:03:35.335470+0000","last_peered":"2024-09-12T00:03:35.335470+0000","last_clean":"2024-09-12T00:03:35.335470+0000","last_became_active":"2024-09-12T00:03:29.335679+0000","last_became_peered":"2024-09-12T00:03:29.335679+0000","last_unstale":"2024-09-12T00:03:35.335470+0000","last_undegraded":"2024-09-12T00:03:35.335470+0000","last_fullsized":"2024-09-12T00:03:35.335470+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:58.540539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"32'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.352098+0000","last_change":"2024-09-12T00:03:31.351170+0000","last_active":"2024-09-12T00:03:34.352098+0000","last_peered":"2024-09-12T00:03:34.352098+0000","last_clean":"2024-09-12T00:03:34.352098+0000","last_became_active":"2024-09-12T00:03:31.350264+0000","last_became_peered":"2024-09-12T00:03:31.350264+0000","last_unstale":"2024-09-12T00:03:34.352098+0000","last_undegraded":"2024-09-12T00:03:34.352098+0000","last_fullsized":"2024-09-12T00:03:34.352098+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:51.368815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348701+0000","last_change":"2024-09-12T00:03:33.368236+0000","last_active":"2024-09-12T00:03:34.348701+0000","last_peered":"2024-09-12T00:03:34.348701+0000","last_clean":"2024-09-12T00:03:34.348701+0000","last_became_active":"2024-09-12T00:03:33.367424+0000","last_became_peered":"2024-09-12T00:03:33.367424+0000","last_unstale":"2024-09-12T00:03:34.348701+0000","last_undegraded":"2024-09-12T00:03:34.348701+0000","last_fullsized":"2024-09-12T00:03:34.348701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.407086+0000","last_change":"2024-09-12T00:03:25.330477+0000","last_active":"2024-09-12T00:03:34.407086+0000","last_peered":"2024-09-12T00:03:34.407086+0000","last_clean":"2024-09-12T00:03:34.407086+0000","last_became_active":"2024-09-12T00:03:25.330069+0000","last_became_peered":"2024-09-12T00:03:25.330069+0000","last_unstale":"2024-09-12T00:03:34.407086+0000","last_undegraded":"2024-09-12T00:03:34.407086+0000","last_fullsized":"2024-09-12T00:03:34.407086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348924+0000","last_change":"2024-09-12T00:03:23.604303+0000","last_active":"2024-09-12T00:03:34.348924+0000","last_peered":"2024-09-12T00:03:34.348924+0000","last_clean":"2024-09-12T00:03:34.348924+0000","last_became_active":"2024-09-12T00:03:23.603937+0000","last_became_peered":"2024-09-12T00:03:23.603937+0000","last_unstale":"2024-09-12T00:03:34.348924+0000","last_undegraded":"2024-09-12T00:03:34.348924+0000","last_fullsized":"2024-09-12T00:03:34.348924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:16.713949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.368917+0000","last_change":"2024-09-12T00:03:27.331569+0000","last_active":"2024-09-12T00:03:34.368917+0000","last_peered":"2024-09-12T00:03:34.368917+0000","last_clean":"2024-09-12T00:03:34.368917+0000","last_became_active":"2024-09-12T00:03:27.330909+0000","last_became_peered":"2024-09-12T00:03:27.330909+0000","last_unstale":"2024-09-12T00:03:34.368917+0000","last_undegraded":"2024-09-12T00:03:34.368917+0000","last_fullsized":"2024-09-12T00:03:34.368917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.115041+0000","last_change":"2024-09-12T00:03:29.338880+0000","last_active":"2024-09-12T00:03:35.115041+0000","last_peered":"2024-09-12T00:03:35.115041+0000","last_clean":"2024-09-12T00:03:35.115041+0000","last_became_active":"2024-09-12T00:03:29.338110+0000","last_became_peered":"2024-09-12T00:03:29.338110+0000","last_unstale":"2024-09-12T00:03:35.115041+0000","last_undegraded":"2024-09-12T00:03:35.115041+0000","last_fullsized":"2024-09-12T00:03:35.115041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.054460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"32'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.368009+0000","last_change":"2024-09-12T00:03:31.339117+0000","last_active":"2024-09-12T00:03:34.368009+0000","last_peered":"2024-09-12T00:03:34.368009+0000","last_clean":"2024-09-12T00:03:34.368009+0000","last_became_active":"2024-09-12T00:03:31.338426+0000","last_became_peered":"2024-09-12T00:03:31.338426+0000","last_unstale":"2024-09-12T00:03:34.368009+0000","last_undegraded":"2024-09-12T00:03:34.368009+0000","last_fullsized":"2024-09-12T00:03:34.368009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:19.304169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.405563+0000","last_change":"2024-09-12T00:03:33.385051+0000","last_active":"2024-09-12T00:03:34.405563+0000","last_peered":"2024-09-12T00:03:34.405563+0000","last_clean":"2024-09-12T00:03:34.405563+0000","last_became_active":"2024-09-12T00:03:33.380088+0000","last_became_peered":"2024-09-12T00:03:33.380088+0000","last_unstale":"2024-09-12T00:03:34.405563+0000","last_undegraded":"2024-09-12T00:03:34.405563+0000","last_fullsized":"2024-09-12T00:03:34.405563+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:02.972871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.352541+0000","last_change":"2024-09-12T00:03:25.336113+0000","last_active":"2024-09-12T00:03:34.352541+0000","last_peered":"2024-09-12T00:03:34.352541+0000","last_clean":"2024-09-12T00:03:34.352541+0000","last_became_active":"2024-09-12T00:03:25.335449+0000","last_became_peered":"2024-09-12T00:03:25.335449+0000","last_unstale":"2024-09-12T00:03:34.352541+0000","last_undegraded":"2024-09-12T00:03:34.352541+0000","last_fullsized":"2024-09-12T00:03:34.352541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:34.277614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.384970+0000","last_change":"2024-09-12T00:03:23.619285+0000","last_active":"2024-09-12T00:03:34.384970+0000","last_peered":"2024-09-12T00:03:34.384970+0000","last_clean":"2024-09-12T00:03:34.384970+0000","last_became_active":"2024-09-12T00:03:23.614187+0000","last_became_peered":"2024-09-12T00:03:23.614187+0000","last_unstale":"2024-09-12T00:03:34.384970+0000","last_undegraded":"2024-09-12T00:03:34.384970+0000","last_fullsized":"2024-09-12T00:03:34.384970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349256+0000","last_change":"2024-09-12T00:03:27.342832+0000","last_active":"2024-09-12T00:03:34.349256+0000","last_peered":"2024-09-12T00:03:34.349256+0000","last_clean":"2024-09-12T00:03:34.349256+0000","last_became_active":"2024-09-12T00:03:27.338764+0000","last_became_peered":"2024-09-12T00:03:27.338764+0000","last_unstale":"2024-09-12T00:03:34.349256+0000","last_undegraded":"2024-09-12T00:03:34.349256+0000","last_fullsized":"2024-09-12T00:03:34.349256+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:24.471349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'17","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.253456+0000","last_change":"2024-09-12T00:03:29.345719+0000","last_active":"2024-09-12T00:03:35.253456+0000","last_peered":"2024-09-12T00:03:35.253456+0000","last_clean":"2024-09-12T00:03:35.253456+0000","last_became_active":"2024-09-12T00:03:29.345243+0000","last_became_peered":"2024-09-12T00:03:29.345243+0000","last_unstale":"2024-09-12T00:03:35.253456+0000","last_undegraded":"2024-09-12T00:03:35.253456+0000","last_fullsized":"2024-09-12T00:03:35.253456+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:41.153263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.407748+0000","last_change":"2024-09-12T00:03:31.360630+0000","last_active":"2024-09-12T00:03:34.407748+0000","last_peered":"2024-09-12T00:03:34.407748+0000","last_clean":"2024-09-12T00:03:34.407748+0000","last_became_active":"2024-09-12T00:03:31.359763+0000","last_became_peered":"2024-09-12T00:03:31.359763+0000","last_unstale":"2024-09-12T00:03:34.407748+0000","last_undegraded":"2024-09-12T00:03:34.407748+0000","last_fullsized":"2024-09-12T00:03:34.407748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347913+0000","last_change":"2024-09-12T00:03:33.372178+0000","last_active":"2024-09-12T00:03:34.347913+0000","last_peered":"2024-09-12T00:03:34.347913+0000","last_clean":"2024-09-12T00:03:34.347913+0000","last_became_active":"2024-09-12T00:03:33.370562+0000","last_became_peered":"2024-09-12T00:03:33.370562+0000","last_unstale":"2024-09-12T00:03:34.347913+0000","last_undegraded":"2024-09-12T00:03:34.347913+0000","last_fullsized":"2024-09-12T00:03:34.347913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:31.888153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349493+0000","last_change":"2024-09-12T00:03:25.329229+0000","last_active":"2024-09-12T00:03:34.349493+0000","last_peered":"2024-09-12T00:03:34.349493+0000","last_clean":"2024-09-12T00:03:34.349493+0000","last_became_active":"2024-09-12T00:03:25.328934+0000","last_became_peered":"2024-09-12T00:03:25.328934+0000","last_unstale":"2024-09-12T00:03:34.349493+0000","last_undegraded":"2024-09-12T00:03:34.349493+0000","last_fullsized":"2024-09-12T00:03:34.349493+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:48.820585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":137,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.367738+0000","last_change":"2024-09-12T00:03:11.770141+0000","last_active":"2024-09-12T00:03:34.367738+0000","last_peered":"2024-09-12T00:03:34.367738+0000","last_clean":"2024-09-12T00:03:34.367738+0000","last_became_active":"2024-09-12T00:03:11.767988+0000","last_became_peered":"2024-09-12T00:03:11.767988+0000","last_unstale":"2024-09-12T00:03:34.367738+0000","last_undegraded":"2024-09-12T00:03:34.367738+0000","last_fullsized":"2024-09-12T00:03:34.367738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_clean_scrub_stamp":"2024-09-12T00:03:10.462069+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:26.289955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348045+0000","last_change":"2024-09-12T00:03:18.567644+0000","last_active":"2024-09-12T00:03:34.348045+0000","last_peered":"2024-09-12T00:03:34.348045+0000","last_clean":"2024-09-12T00:03:34.348045+0000","last_became_active":"2024-09-12T00:03:16.592765+0000","last_became_peered":"2024-09-12T00:03:16.592765+0000","last_unstale":"2024-09-12T00:03:34.348045+0000","last_undegraded":"2024-09-12T00:03:34.348045+0000","last_fullsized":"2024-09-12T00:03:34.348045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:06.283894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001924708,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.385483+0000","last_change":"2024-09-12T00:03:23.621849+0000","last_active":"2024-09-12T00:03:34.385483+0000","last_peered":"2024-09-12T00:03:34.385483+0000","last_clean":"2024-09-12T00:03:34.385483+0000","last_became_active":"2024-09-12T00:03:23.621146+0000","last_became_peered":"2024-09-12T00:03:23.621146+0000","last_unstale":"2024-09-12T00:03:34.385483+0000","last_undegraded":"2024-09-12T00:03:34.385483+0000","last_fullsized":"2024-09-12T00:03:34.385483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:38.426691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.372344+0000","last_change":"2024-09-12T00:03:27.316175+0000","last_active":"2024-09-12T00:03:34.372344+0000","last_peered":"2024-09-12T00:03:34.372344+0000","last_clean":"2024-09-12T00:03:34.372344+0000","last_became_active":"2024-09-12T00:03:27.315502+0000","last_became_peered":"2024-09-12T00:03:27.315502+0000","last_unstale":"2024-09-12T00:03:34.372344+0000","last_undegraded":"2024-09-12T00:03:34.372344+0000","last_fullsized":"2024-09-12T00:03:34.372344+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:21.448686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"35'19","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.042577+0000","last_change":"2024-09-12T00:03:29.348743+0000","last_active":"2024-09-12T00:03:35.042577+0000","last_peered":"2024-09-12T00:03:35.042577+0000","last_clean":"2024-09-12T00:03:35.042577+0000","last_became_active":"2024-09-12T00:03:29.348073+0000","last_became_peered":"2024-09-12T00:03:29.348073+0000","last_unstale":"2024-09-12T00:03:35.042577+0000","last_undegraded":"2024-09-12T00:03:35.042577+0000","last_fullsized":"2024-09-12T00:03:35.042577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:27.315678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382886+0000","last_change":"2024-09-12T00:03:31.361408+0000","last_active":"2024-09-12T00:03:34.382886+0000","last_peered":"2024-09-12T00:03:34.382886+0000","last_clean":"2024-09-12T00:03:34.382886+0000","last_became_active":"2024-09-12T00:03:31.360462+0000","last_became_peered":"2024-09-12T00:03:31.360462+0000","last_unstale":"2024-09-12T00:03:34.382886+0000","last_undegraded":"2024-09-12T00:03:34.382886+0000","last_fullsized":"2024-09-12T00:03:34.382886+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:58.407571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.372331+0000","last_change":"2024-09-12T00:03:33.388253+0000","last_active":"2024-09-12T00:03:34.372331+0000","last_peered":"2024-09-12T00:03:34.372331+0000","last_clean":"2024-09-12T00:03:34.372331+0000","last_became_active":"2024-09-12T00:03:33.387457+0000","last_became_peered":"2024-09-12T00:03:33.387457+0000","last_unstale":"2024-09-12T00:03:34.372331+0000","last_undegraded":"2024-09-12T00:03:34.372331+0000","last_fullsized":"2024-09-12T00:03:34.372331+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:46.021740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.383316+0000","last_change":"2024-09-12T00:03:25.357970+0000","last_active":"2024-09-12T00:03:34.383316+0000","last_peered":"2024-09-12T00:03:34.383316+0000","last_clean":"2024-09-12T00:03:34.383316+0000","last_became_active":"2024-09-12T00:03:25.355306+0000","last_became_peered":"2024-09-12T00:03:25.355306+0000","last_unstale":"2024-09-12T00:03:34.383316+0000","last_undegraded":"2024-09-12T00:03:34.383316+0000","last_fullsized":"2024-09-12T00:03:34.383316+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:17.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347822+0000","last_change":"2024-09-12T00:03:18.567433+0000","last_active":"2024-09-12T00:03:34.347822+0000","last_peered":"2024-09-12T00:03:34.347822+0000","last_clean":"2024-09-12T00:03:34.347822+0000","last_became_active":"2024-09-12T00:03:16.557489+0000","last_became_peered":"2024-09-12T00:03:16.557489+0000","last_unstale":"2024-09-12T00:03:34.347822+0000","last_undegraded":"2024-09-12T00:03:34.347822+0000","last_fullsized":"2024-09-12T00:03:34.347822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:26.187640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001769713,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349231+0000","last_change":"2024-09-12T00:03:23.622111+0000","last_active":"2024-09-12T00:03:34.349231+0000","last_peered":"2024-09-12T00:03:34.349231+0000","last_clean":"2024-09-12T00:03:34.349231+0000","last_became_active":"2024-09-12T00:03:23.621358+0000","last_became_peered":"2024-09-12T00:03:23.621358+0000","last_unstale":"2024-09-12T00:03:34.349231+0000","last_undegraded":"2024-09-12T00:03:34.349231+0000","last_fullsized":"2024-09-12T00:03:34.349231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:02.202230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348610+0000","last_change":"2024-09-12T00:03:27.338241+0000","last_active":"2024-09-12T00:03:34.348610+0000","last_peered":"2024-09-12T00:03:34.348610+0000","last_clean":"2024-09-12T00:03:34.348610+0000","last_became_active":"2024-09-12T00:03:27.337391+0000","last_became_peered":"2024-09-12T00:03:27.337391+0000","last_unstale":"2024-09-12T00:03:34.348610+0000","last_undegraded":"2024-09-12T00:03:34.348610+0000","last_fullsized":"2024-09-12T00:03:34.348610+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:00.949475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'29","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.244342+0000","last_change":"2024-09-12T00:03:29.346819+0000","last_active":"2024-09-12T00:03:35.244342+0000","last_peered":"2024-09-12T00:03:35.244342+0000","last_clean":"2024-09-12T00:03:35.244342+0000","last_became_active":"2024-09-12T00:03:29.346101+0000","last_became_peered":"2024-09-12T00:03:29.346101+0000","last_unstale":"2024-09-12T00:03:35.244342+0000","last_undegraded":"2024-09-12T00:03:35.244342+0000","last_fullsized":"2024-09-12T00:03:35.244342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:27.268327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350143+0000","last_change":"2024-09-12T00:03:31.361817+0000","last_active":"2024-09-12T00:03:34.350143+0000","last_peered":"2024-09-12T00:03:34.350143+0000","last_clean":"2024-09-12T00:03:34.350143+0000","last_became_active":"2024-09-12T00:03:31.361309+0000","last_became_peered":"2024-09-12T00:03:31.361309+0000","last_unstale":"2024-09-12T00:03:34.350143+0000","last_undegraded":"2024-09-12T00:03:34.350143+0000","last_fullsized":"2024-09-12T00:03:34.350143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:19.554189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.380816+0000","last_change":"2024-09-12T00:03:33.386144+0000","last_active":"2024-09-12T00:03:34.380816+0000","last_peered":"2024-09-12T00:03:34.380816+0000","last_clean":"2024-09-12T00:03:34.380816+0000","last_became_active":"2024-09-12T00:03:33.384951+0000","last_became_peered":"2024-09-12T00:03:33.384951+0000","last_unstale":"2024-09-12T00:03:34.380816+0000","last_undegraded":"2024-09-12T00:03:34.380816+0000","last_fullsized":"2024-09-12T00:03:34.380816+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:49.807501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350968+0000","last_change":"2024-09-12T00:03:25.332801+0000","last_active":"2024-09-12T00:03:34.350968+0000","last_peered":"2024-09-12T00:03:34.350968+0000","last_clean":"2024-09-12T00:03:34.350968+0000","last_became_active":"2024-09-12T00:03:25.331652+0000","last_became_peered":"2024-09-12T00:03:25.331652+0000","last_unstale":"2024-09-12T00:03:34.350968+0000","last_undegraded":"2024-09-12T00:03:34.350968+0000","last_fullsized":"2024-09-12T00:03:34.350968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347971+0000","last_change":"2024-09-12T00:03:18.892423+0000","last_active":"2024-09-12T00:03:34.347971+0000","last_peered":"2024-09-12T00:03:34.347971+0000","last_clean":"2024-09-12T00:03:34.347971+0000","last_became_active":"2024-09-12T00:03:16.559698+0000","last_became_peered":"2024-09-12T00:03:16.559698+0000","last_unstale":"2024-09-12T00:03:34.347971+0000","last_undegraded":"2024-09-12T00:03:34.347971+0000","last_fullsized":"2024-09-12T00:03:34.347971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:21.453461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082440599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.380778+0000","last_change":"2024-09-12T00:03:23.633606+0000","last_active":"2024-09-12T00:03:34.380778+0000","last_peered":"2024-09-12T00:03:34.380778+0000","last_clean":"2024-09-12T00:03:34.380778+0000","last_became_active":"2024-09-12T00:03:23.632795+0000","last_became_peered":"2024-09-12T00:03:23.632795+0000","last_unstale":"2024-09-12T00:03:34.380778+0000","last_undegraded":"2024-09-12T00:03:34.380778+0000","last_fullsized":"2024-09-12T00:03:34.380778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:08.214455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.352370+0000","last_change":"2024-09-12T00:03:27.326932+0000","last_active":"2024-09-12T00:03:34.352370+0000","last_peered":"2024-09-12T00:03:34.352370+0000","last_clean":"2024-09-12T00:03:34.352370+0000","last_became_active":"2024-09-12T00:03:27.326173+0000","last_became_peered":"2024-09-12T00:03:27.326173+0000","last_unstale":"2024-09-12T00:03:34.352370+0000","last_undegraded":"2024-09-12T00:03:34.352370+0000","last_fullsized":"2024-09-12T00:03:34.352370+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:12.286539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.249390+0000","last_change":"2024-09-12T00:03:29.338829+0000","last_active":"2024-09-12T00:03:35.249390+0000","last_peered":"2024-09-12T00:03:35.249390+0000","last_clean":"2024-09-12T00:03:35.249390+0000","last_became_active":"2024-09-12T00:03:29.337364+0000","last_became_peered":"2024-09-12T00:03:29.337364+0000","last_unstale":"2024-09-12T00:03:35.249390+0000","last_undegraded":"2024-09-12T00:03:35.249390+0000","last_fullsized":"2024-09-12T00:03:35.249390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:01.584359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.386409+0000","last_change":"2024-09-12T00:03:31.346734+0000","last_active":"2024-09-12T00:03:34.386409+0000","last_peered":"2024-09-12T00:03:34.386409+0000","last_clean":"2024-09-12T00:03:34.386409+0000","last_became_active":"2024-09-12T00:03:31.346035+0000","last_became_peered":"2024-09-12T00:03:31.346035+0000","last_unstale":"2024-09-12T00:03:34.386409+0000","last_undegraded":"2024-09-12T00:03:34.386409+0000","last_fullsized":"2024-09-12T00:03:34.386409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:10.417936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.385592+0000","last_change":"2024-09-12T00:03:33.354171+0000","last_active":"2024-09-12T00:03:34.385592+0000","last_peered":"2024-09-12T00:03:34.385592+0000","last_clean":"2024-09-12T00:03:34.385592+0000","last_became_active":"2024-09-12T00:03:33.353460+0000","last_became_peered":"2024-09-12T00:03:33.353460+0000","last_unstale":"2024-09-12T00:03:34.385592+0000","last_undegraded":"2024-09-12T00:03:34.385592+0000","last_fullsized":"2024-09-12T00:03:34.385592+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:34.356970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350045+0000","last_change":"2024-09-12T00:03:25.336320+0000","last_active":"2024-09-12T00:03:34.350045+0000","last_peered":"2024-09-12T00:03:34.350045+0000","last_clean":"2024-09-12T00:03:34.350045+0000","last_became_active":"2024-09-12T00:03:25.333449+0000","last_became_peered":"2024-09-12T00:03:25.333449+0000","last_unstale":"2024-09-12T00:03:34.350045+0000","last_undegraded":"2024-09-12T00:03:34.350045+0000","last_fullsized":"2024-09-12T00:03:34.350045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350118+0000","last_change":"2024-09-12T00:03:18.568246+0000","last_active":"2024-09-12T00:03:34.350118+0000","last_peered":"2024-09-12T00:03:34.350118+0000","last_clean":"2024-09-12T00:03:34.350118+0000","last_became_active":"2024-09-12T00:03:16.554663+0000","last_became_peered":"2024-09-12T00:03:16.554663+0000","last_unstale":"2024-09-12T00:03:34.350118+0000","last_undegraded":"2024-09-12T00:03:34.350118+0000","last_fullsized":"2024-09-12T00:03:34.350118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:52.802404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025471840000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.372971+0000","last_change":"2024-09-12T00:03:23.611064+0000","last_active":"2024-09-12T00:03:34.372971+0000","last_peered":"2024-09-12T00:03:34.372971+0000","last_clean":"2024-09-12T00:03:34.372971+0000","last_became_active":"2024-09-12T00:03:23.610612+0000","last_became_peered":"2024-09-12T00:03:23.610612+0000","last_unstale":"2024-09-12T00:03:34.372971+0000","last_undegraded":"2024-09-12T00:03:34.372971+0000","last_fullsized":"2024-09-12T00:03:34.372971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:04.201688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350703+0000","last_change":"2024-09-12T00:03:27.339197+0000","last_active":"2024-09-12T00:03:34.350703+0000","last_peered":"2024-09-12T00:03:34.350703+0000","last_clean":"2024-09-12T00:03:34.350703+0000","last_became_active":"2024-09-12T00:03:27.338508+0000","last_became_peered":"2024-09-12T00:03:27.338508+0000","last_unstale":"2024-09-12T00:03:34.350703+0000","last_undegraded":"2024-09-12T00:03:34.350703+0000","last_fullsized":"2024-09-12T00:03:34.350703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:08.306289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.079864+0000","last_change":"2024-09-12T00:03:29.358418+0000","last_active":"2024-09-12T00:03:35.079864+0000","last_peered":"2024-09-12T00:03:35.079864+0000","last_clean":"2024-09-12T00:03:35.079864+0000","last_became_active":"2024-09-12T00:03:29.357949+0000","last_became_peered":"2024-09-12T00:03:29.357949+0000","last_unstale":"2024-09-12T00:03:35.079864+0000","last_undegraded":"2024-09-12T00:03:35.079864+0000","last_fullsized":"2024-09-12T00:03:35.079864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:53.457363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350615+0000","last_change":"2024-09-12T00:03:31.352559+0000","last_active":"2024-09-12T00:03:34.350615+0000","last_peered":"2024-09-12T00:03:34.350615+0000","last_clean":"2024-09-12T00:03:34.350615+0000","last_became_active":"2024-09-12T00:03:31.351663+0000","last_became_peered":"2024-09-12T00:03:31.351663+0000","last_unstale":"2024-09-12T00:03:34.350615+0000","last_undegraded":"2024-09-12T00:03:34.350615+0000","last_fullsized":"2024-09-12T00:03:34.350615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:03.662016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.365986+0000","last_change":"2024-09-12T00:03:33.367035+0000","last_active":"2024-09-12T00:03:34.365986+0000","last_peered":"2024-09-12T00:03:34.365986+0000","last_clean":"2024-09-12T00:03:34.365986+0000","last_became_active":"2024-09-12T00:03:33.366311+0000","last_became_peered":"2024-09-12T00:03:33.366311+0000","last_unstale":"2024-09-12T00:03:34.365986+0000","last_undegraded":"2024-09-12T00:03:34.365986+0000","last_fullsized":"2024-09-12T00:03:34.365986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348757+0000","last_change":"2024-09-12T00:03:25.322258+0000","last_active":"2024-09-12T00:03:34.348757+0000","last_peered":"2024-09-12T00:03:34.348757+0000","last_clean":"2024-09-12T00:03:34.348757+0000","last_became_active":"2024-09-12T00:03:25.320903+0000","last_became_peered":"2024-09-12T00:03:25.320903+0000","last_unstale":"2024-09-12T00:03:34.348757+0000","last_undegraded":"2024-09-12T00:03:34.348757+0000","last_fullsized":"2024-09-12T00:03:34.348757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:05.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.407659+0000","last_change":"2024-09-12T00:03:23.619024+0000","last_active":"2024-09-12T00:03:34.407659+0000","last_peered":"2024-09-12T00:03:34.407659+0000","last_clean":"2024-09-12T00:03:34.407659+0000","last_became_active":"2024-09-12T00:03:23.618716+0000","last_became_peered":"2024-09-12T00:03:23.618716+0000","last_unstale":"2024-09-12T00:03:34.407659+0000","last_undegraded":"2024-09-12T00:03:34.407659+0000","last_fullsized":"2024-09-12T00:03:34.407659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382639+0000","last_change":"2024-09-12T00:03:18.562010+0000","last_active":"2024-09-12T00:03:34.382639+0000","last_peered":"2024-09-12T00:03:34.382639+0000","last_clean":"2024-09-12T00:03:34.382639+0000","last_became_active":"2024-09-12T00:03:16.561218+0000","last_became_peered":"2024-09-12T00:03:16.561218+0000","last_unstale":"2024-09-12T00:03:34.382639+0000","last_undegraded":"2024-09-12T00:03:34.382639+0000","last_fullsized":"2024-09-12T00:03:34.382639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:43.089686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084170299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.386045+0000","last_change":"2024-09-12T00:03:27.341079+0000","last_active":"2024-09-12T00:03:34.386045+0000","last_peered":"2024-09-12T00:03:34.386045+0000","last_clean":"2024-09-12T00:03:34.386045+0000","last_became_active":"2024-09-12T00:03:27.340391+0000","last_became_peered":"2024-09-12T00:03:27.340391+0000","last_unstale":"2024-09-12T00:03:34.386045+0000","last_undegraded":"2024-09-12T00:03:34.386045+0000","last_fullsized":"2024-09-12T00:03:34.386045+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:10.048469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"35'30","reported_seq":77,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.174422+0000","last_change":"2024-09-12T00:03:29.346823+0000","last_active":"2024-09-12T00:03:35.174422+0000","last_peered":"2024-09-12T00:03:35.174422+0000","last_clean":"2024-09-12T00:03:35.174422+0000","last_became_active":"2024-09-12T00:03:29.346066+0000","last_became_peered":"2024-09-12T00:03:29.346066+0000","last_unstale":"2024-09-12T00:03:35.174422+0000","last_undegraded":"2024-09-12T00:03:35.174422+0000","last_fullsized":"2024-09-12T00:03:35.174422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:12.080794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.405435+0000","last_change":"2024-09-12T00:03:31.348574+0000","last_active":"2024-09-12T00:03:34.405435+0000","last_peered":"2024-09-12T00:03:34.405435+0000","last_clean":"2024-09-12T00:03:34.405435+0000","last_became_active":"2024-09-12T00:03:31.346511+0000","last_became_peered":"2024-09-12T00:03:31.346511+0000","last_unstale":"2024-09-12T00:03:34.405435+0000","last_undegraded":"2024-09-12T00:03:34.405435+0000","last_fullsized":"2024-09-12T00:03:34.405435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:14.061486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382914+0000","last_change":"2024-09-12T00:03:33.385232+0000","last_active":"2024-09-12T00:03:34.382914+0000","last_peered":"2024-09-12T00:03:34.382914+0000","last_clean":"2024-09-12T00:03:34.382914+0000","last_became_active":"2024-09-12T00:03:33.384457+0000","last_became_peered":"2024-09-12T00:03:33.384457+0000","last_unstale":"2024-09-12T00:03:34.382914+0000","last_undegraded":"2024-09-12T00:03:34.382914+0000","last_fullsized":"2024-09-12T00:03:34.382914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:34.615256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350334+0000","last_change":"2024-09-12T00:03:25.334767+0000","last_active":"2024-09-12T00:03:34.350334+0000","last_peered":"2024-09-12T00:03:34.350334+0000","last_clean":"2024-09-12T00:03:34.350334+0000","last_became_active":"2024-09-12T00:03:25.332814+0000","last_became_peered":"2024-09-12T00:03:25.332814+0000","last_unstale":"2024-09-12T00:03:34.350334+0000","last_undegraded":"2024-09-12T00:03:34.350334+0000","last_fullsized":"2024-09-12T00:03:34.350334+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350290+0000","last_change":"2024-09-12T00:03:23.628752+0000","last_active":"2024-09-12T00:03:34.350290+0000","last_peered":"2024-09-12T00:03:34.350290+0000","last_clean":"2024-09-12T00:03:34.350290+0000","last_became_active":"2024-09-12T00:03:23.628128+0000","last_became_peered":"2024-09-12T00:03:23.628128+0000","last_unstale":"2024-09-12T00:03:34.350290+0000","last_undegraded":"2024-09-12T00:03:34.350290+0000","last_fullsized":"2024-09-12T00:03:34.350290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348438+0000","last_change":"2024-09-12T00:03:18.566691+0000","last_active":"2024-09-12T00:03:34.348438+0000","last_peered":"2024-09-12T00:03:34.348438+0000","last_clean":"2024-09-12T00:03:34.348438+0000","last_became_active":"2024-09-12T00:03:16.553662+0000","last_became_peered":"2024-09-12T00:03:16.553662+0000","last_unstale":"2024-09-12T00:03:34.348438+0000","last_undegraded":"2024-09-12T00:03:34.348438+0000","last_fullsized":"2024-09-12T00:03:34.348438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:14.502459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011030910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.372024+0000","last_change":"2024-09-12T00:03:27.316317+0000","last_active":"2024-09-12T00:03:34.372024+0000","last_peered":"2024-09-12T00:03:34.372024+0000","last_clean":"2024-09-12T00:03:34.372024+0000","last_became_active":"2024-09-12T00:03:27.315704+0000","last_became_peered":"2024-09-12T00:03:27.315704+0000","last_unstale":"2024-09-12T00:03:34.372024+0000","last_undegraded":"2024-09-12T00:03:34.372024+0000","last_fullsized":"2024-09-12T00:03:34.372024+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:07.883485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'20","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.275368+0000","last_change":"2024-09-12T00:03:29.357640+0000","last_active":"2024-09-12T00:03:35.275368+0000","last_peered":"2024-09-12T00:03:35.275368+0000","last_clean":"2024-09-12T00:03:35.275368+0000","last_became_active":"2024-09-12T00:03:29.356183+0000","last_became_peered":"2024-09-12T00:03:29.356183+0000","last_unstale":"2024-09-12T00:03:35.275368+0000","last_undegraded":"2024-09-12T00:03:35.275368+0000","last_fullsized":"2024-09-12T00:03:35.275368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:41.818794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"32'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.366123+0000","last_change":"2024-09-12T00:03:31.357011+0000","last_active":"2024-09-12T00:03:34.366123+0000","last_peered":"2024-09-12T00:03:34.366123+0000","last_clean":"2024-09-12T00:03:34.366123+0000","last_became_active":"2024-09-12T00:03:31.356108+0000","last_became_peered":"2024-09-12T00:03:31.356108+0000","last_unstale":"2024-09-12T00:03:34.366123+0000","last_undegraded":"2024-09-12T00:03:34.366123+0000","last_fullsized":"2024-09-12T00:03:34.366123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.351646+0000","last_change":"2024-09-12T00:03:33.372465+0000","last_active":"2024-09-12T00:03:34.351646+0000","last_peered":"2024-09-12T00:03:34.351646+0000","last_clean":"2024-09-12T00:03:34.351646+0000","last_became_active":"2024-09-12T00:03:33.371214+0000","last_became_peered":"2024-09-12T00:03:33.371214+0000","last_unstale":"2024-09-12T00:03:34.351646+0000","last_undegraded":"2024-09-12T00:03:34.351646+0000","last_fullsized":"2024-09-12T00:03:34.351646+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:40.880933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.384721+0000","last_change":"2024-09-12T00:03:25.332405+0000","last_active":"2024-09-12T00:03:34.384721+0000","last_peered":"2024-09-12T00:03:34.384721+0000","last_clean":"2024-09-12T00:03:34.384721+0000","last_became_active":"2024-09-12T00:03:25.331250+0000","last_became_peered":"2024-09-12T00:03:25.331250+0000","last_unstale":"2024-09-12T00:03:34.384721+0000","last_undegraded":"2024-09-12T00:03:34.384721+0000","last_fullsized":"2024-09-12T00:03:34.384721+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.387506+0000","last_change":"2024-09-12T00:03:23.602222+0000","last_active":"2024-09-12T00:03:34.387506+0000","last_peered":"2024-09-12T00:03:34.387506+0000","last_clean":"2024-09-12T00:03:34.387506+0000","last_became_active":"2024-09-12T00:03:23.601481+0000","last_became_peered":"2024-09-12T00:03:23.601481+0000","last_unstale":"2024-09-12T00:03:34.387506+0000","last_undegraded":"2024-09-12T00:03:34.387506+0000","last_fullsized":"2024-09-12T00:03:34.387506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:56.636638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.387821+0000","last_change":"2024-09-12T00:03:18.716648+0000","last_active":"2024-09-12T00:03:34.387821+0000","last_peered":"2024-09-12T00:03:34.387821+0000","last_clean":"2024-09-12T00:03:34.387821+0000","last_became_active":"2024-09-12T00:03:16.594609+0000","last_became_peered":"2024-09-12T00:03:16.594609+0000","last_unstale":"2024-09-12T00:03:34.387821+0000","last_undegraded":"2024-09-12T00:03:34.387821+0000","last_fullsized":"2024-09-12T00:03:34.387821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:34.635008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010254439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347623+0000","last_change":"2024-09-12T00:03:27.337871+0000","last_active":"2024-09-12T00:03:34.347623+0000","last_peered":"2024-09-12T00:03:34.347623+0000","last_clean":"2024-09-12T00:03:34.347623+0000","last_became_active":"2024-09-12T00:03:27.337299+0000","last_became_peered":"2024-09-12T00:03:27.337299+0000","last_unstale":"2024-09-12T00:03:34.347623+0000","last_undegraded":"2024-09-12T00:03:34.347623+0000","last_fullsized":"2024-09-12T00:03:34.347623+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:37.289387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'17","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.232478+0000","last_change":"2024-09-12T00:03:29.354380+0000","last_active":"2024-09-12T00:03:35.232478+0000","last_peered":"2024-09-12T00:03:35.232478+0000","last_clean":"2024-09-12T00:03:35.232478+0000","last_became_active":"2024-09-12T00:03:29.353644+0000","last_became_peered":"2024-09-12T00:03:29.353644+0000","last_unstale":"2024-09-12T00:03:35.232478+0000","last_undegraded":"2024-09-12T00:03:35.232478+0000","last_fullsized":"2024-09-12T00:03:35.232478+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:15.452219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382235+0000","last_change":"2024-09-12T00:03:31.361616+0000","last_active":"2024-09-12T00:03:34.382235+0000","last_peered":"2024-09-12T00:03:34.382235+0000","last_clean":"2024-09-12T00:03:34.382235+0000","last_became_active":"2024-09-12T00:03:31.360518+0000","last_became_peered":"2024-09-12T00:03:31.360518+0000","last_unstale":"2024-09-12T00:03:34.382235+0000","last_undegraded":"2024-09-12T00:03:34.382235+0000","last_fullsized":"2024-09-12T00:03:34.382235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:40.640537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.381854+0000","last_change":"2024-09-12T00:03:33.378417+0000","last_active":"2024-09-12T00:03:34.381854+0000","last_peered":"2024-09-12T00:03:34.381854+0000","last_clean":"2024-09-12T00:03:34.381854+0000","last_became_active":"2024-09-12T00:03:33.377669+0000","last_became_peered":"2024-09-12T00:03:33.377669+0000","last_unstale":"2024-09-12T00:03:34.381854+0000","last_undegraded":"2024-09-12T00:03:34.381854+0000","last_fullsized":"2024-09-12T00:03:34.381854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:04.623906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.405894+0000","last_change":"2024-09-12T00:03:25.318286+0000","last_active":"2024-09-12T00:03:34.405894+0000","last_peered":"2024-09-12T00:03:34.405894+0000","last_clean":"2024-09-12T00:03:34.405894+0000","last_became_active":"2024-09-12T00:03:25.317820+0000","last_became_peered":"2024-09-12T00:03:25.317820+0000","last_unstale":"2024-09-12T00:03:34.405894+0000","last_undegraded":"2024-09-12T00:03:34.405894+0000","last_fullsized":"2024-09-12T00:03:34.405894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:05.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.387344+0000","last_change":"2024-09-12T00:03:23.616319+0000","last_active":"2024-09-12T00:03:34.387344+0000","last_peered":"2024-09-12T00:03:34.387344+0000","last_clean":"2024-09-12T00:03:34.387344+0000","last_became_active":"2024-09-12T00:03:23.615158+0000","last_became_peered":"2024-09-12T00:03:23.615158+0000","last_unstale":"2024-09-12T00:03:34.387344+0000","last_undegraded":"2024-09-12T00:03:34.387344+0000","last_fullsized":"2024-09-12T00:03:34.387344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:15.677228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350853+0000","last_change":"2024-09-12T00:03:18.566832+0000","last_active":"2024-09-12T00:03:34.350853+0000","last_peered":"2024-09-12T00:03:34.350853+0000","last_clean":"2024-09-12T00:03:34.350853+0000","last_became_active":"2024-09-12T00:03:16.592377+0000","last_became_peered":"2024-09-12T00:03:16.592377+0000","last_unstale":"2024-09-12T00:03:34.350853+0000","last_undegraded":"2024-09-12T00:03:34.350853+0000","last_fullsized":"2024-09-12T00:03:34.350853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:31.379733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001199625,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.384269+0000","last_change":"2024-09-12T00:03:27.337359+0000","last_active":"2024-09-12T00:03:34.384269+0000","last_peered":"2024-09-12T00:03:34.384269+0000","last_clean":"2024-09-12T00:03:34.384269+0000","last_became_active":"2024-09-12T00:03:27.336289+0000","last_became_peered":"2024-09-12T00:03:27.336289+0000","last_unstale":"2024-09-12T00:03:34.384269+0000","last_undegraded":"2024-09-12T00:03:34.384269+0000","last_fullsized":"2024-09-12T00:03:34.384269+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:39.147272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"35'25","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.210123+0000","last_change":"2024-09-12T00:03:29.344621+0000","last_active":"2024-09-12T00:03:35.210123+0000","last_peered":"2024-09-12T00:03:35.210123+0000","last_clean":"2024-09-12T00:03:35.210123+0000","last_became_active":"2024-09-12T00:03:29.343779+0000","last_became_peered":"2024-09-12T00:03:29.343779+0000","last_unstale":"2024-09-12T00:03:35.210123+0000","last_undegraded":"2024-09-12T00:03:35.210123+0000","last_fullsized":"2024-09-12T00:03:35.210123+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:49.518432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.384904+0000","last_change":"2024-09-12T00:03:31.335460+0000","last_active":"2024-09-12T00:03:34.384904+0000","last_peered":"2024-09-12T00:03:34.384904+0000","last_clean":"2024-09-12T00:03:34.384904+0000","last_became_active":"2024-09-12T00:03:31.334701+0000","last_became_peered":"2024-09-12T00:03:31.334701+0000","last_unstale":"2024-09-12T00:03:34.384904+0000","last_undegraded":"2024-09-12T00:03:34.384904+0000","last_fullsized":"2024-09-12T00:03:34.384904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:28.484366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.407382+0000","last_change":"2024-09-12T00:03:33.386404+0000","last_active":"2024-09-12T00:03:34.407382+0000","last_peered":"2024-09-12T00:03:34.407382+0000","last_clean":"2024-09-12T00:03:34.407382+0000","last_became_active":"2024-09-12T00:03:33.385090+0000","last_became_peered":"2024-09-12T00:03:33.385090+0000","last_unstale":"2024-09-12T00:03:34.407382+0000","last_undegraded":"2024-09-12T00:03:34.407382+0000","last_fullsized":"2024-09-12T00:03:34.407382+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.386662+0000","last_change":"2024-09-12T00:03:33.361690+0000","last_active":"2024-09-12T00:03:34.386662+0000","last_peered":"2024-09-12T00:03:34.386662+0000","last_clean":"2024-09-12T00:03:34.386662+0000","last_became_active":"2024-09-12T00:03:33.360980+0000","last_became_peered":"2024-09-12T00:03:33.360980+0000","last_unstale":"2024-09-12T00:03:34.386662+0000","last_undegraded":"2024-09-12T00:03:34.386662+0000","last_fullsized":"2024-09-12T00:03:34.386662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:24.954577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.406975+0000","last_change":"2024-09-12T00:03:25.335027+0000","last_active":"2024-09-12T00:03:34.406975+0000","last_peered":"2024-09-12T00:03:34.406975+0000","last_clean":"2024-09-12T00:03:34.406975+0000","last_became_active":"2024-09-12T00:03:25.334530+0000","last_became_peered":"2024-09-12T00:03:25.334530+0000","last_unstale":"2024-09-12T00:03:34.406975+0000","last_undegraded":"2024-09-12T00:03:34.406975+0000","last_fullsized":"2024-09-12T00:03:34.406975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348636+0000","last_change":"2024-09-12T00:03:23.618114+0000","last_active":"2024-09-12T00:03:34.348636+0000","last_peered":"2024-09-12T00:03:34.348636+0000","last_clean":"2024-09-12T00:03:34.348636+0000","last_became_active":"2024-09-12T00:03:23.617781+0000","last_became_peered":"2024-09-12T00:03:23.617781+0000","last_unstale":"2024-09-12T00:03:34.348636+0000","last_undegraded":"2024-09-12T00:03:34.348636+0000","last_fullsized":"2024-09-12T00:03:34.348636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:30.629135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"28'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348917+0000","last_change":"2024-09-12T00:03:27.332281+0000","last_active":"2024-09-12T00:03:34.348917+0000","last_peered":"2024-09-12T00:03:34.348917+0000","last_clean":"2024-09-12T00:03:34.348917+0000","last_became_active":"2024-09-12T00:03:27.331527+0000","last_became_peered":"2024-09-12T00:03:27.331527+0000","last_unstale":"2024-09-12T00:03:34.348917+0000","last_undegraded":"2024-09-12T00:03:34.348917+0000","last_fullsized":"2024-09-12T00:03:34.348917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"35'17","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.282413+0000","last_change":"2024-09-12T00:03:29.338655+0000","last_active":"2024-09-12T00:03:35.282413+0000","last_peered":"2024-09-12T00:03:35.282413+0000","last_clean":"2024-09-12T00:03:35.282413+0000","last_became_active":"2024-09-12T00:03:29.337905+0000","last_became_peered":"2024-09-12T00:03:29.337905+0000","last_unstale":"2024-09-12T00:03:35.282413+0000","last_undegraded":"2024-09-12T00:03:35.282413+0000","last_fullsized":"2024-09-12T00:03:35.282413+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347275+0000","last_change":"2024-09-12T00:03:31.351716+0000","last_active":"2024-09-12T00:03:34.347275+0000","last_peered":"2024-09-12T00:03:34.347275+0000","last_clean":"2024-09-12T00:03:34.347275+0000","last_became_active":"2024-09-12T00:03:31.350917+0000","last_became_peered":"2024-09-12T00:03:31.350917+0000","last_unstale":"2024-09-12T00:03:34.347275+0000","last_undegraded":"2024-09-12T00:03:34.347275+0000","last_fullsized":"2024-09-12T00:03:34.347275+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:45.880820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.351601+0000","last_change":"2024-09-12T00:03:33.374233+0000","last_active":"2024-09-12T00:03:34.351601+0000","last_peered":"2024-09-12T00:03:34.351601+0000","last_clean":"2024-09-12T00:03:34.351601+0000","last_became_active":"2024-09-12T00:03:33.373466+0000","last_became_peered":"2024-09-12T00:03:33.373466+0000","last_unstale":"2024-09-12T00:03:34.351601+0000","last_undegraded":"2024-09-12T00:03:34.351601+0000","last_fullsized":"2024-09-12T00:03:34.351601+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:55.598892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.384782+0000","last_change":"2024-09-12T00:03:25.319144+0000","last_active":"2024-09-12T00:03:34.384782+0000","last_peered":"2024-09-12T00:03:34.384782+0000","last_clean":"2024-09-12T00:03:34.384782+0000","last_became_active":"2024-09-12T00:03:25.318362+0000","last_became_peered":"2024-09-12T00:03:25.318362+0000","last_unstale":"2024-09-12T00:03:34.384782+0000","last_undegraded":"2024-09-12T00:03:34.384782+0000","last_fullsized":"2024-09-12T00:03:34.384782+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373449+0000","last_change":"2024-09-12T00:03:23.613274+0000","last_active":"2024-09-12T00:03:34.373449+0000","last_peered":"2024-09-12T00:03:34.373449+0000","last_clean":"2024-09-12T00:03:34.373449+0000","last_became_active":"2024-09-12T00:03:23.612941+0000","last_became_peered":"2024-09-12T00:03:23.612941+0000","last_unstale":"2024-09-12T00:03:34.373449+0000","last_undegraded":"2024-09-12T00:03:34.373449+0000","last_fullsized":"2024-09-12T00:03:34.373449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:56.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.385747+0000","last_change":"2024-09-12T00:03:27.336144+0000","last_active":"2024-09-12T00:03:34.385747+0000","last_peered":"2024-09-12T00:03:34.385747+0000","last_clean":"2024-09-12T00:03:34.385747+0000","last_became_active":"2024-09-12T00:03:27.335372+0000","last_became_peered":"2024-09-12T00:03:27.335372+0000","last_unstale":"2024-09-12T00:03:34.385747+0000","last_undegraded":"2024-09-12T00:03:34.385747+0000","last_fullsized":"2024-09-12T00:03:34.385747+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:33.978665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"35'4","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.759002+0000","last_change":"2024-09-12T00:03:29.332051+0000","last_active":"2024-09-12T00:03:34.759002+0000","last_peered":"2024-09-12T00:03:34.759002+0000","last_clean":"2024-09-12T00:03:34.759002+0000","last_became_active":"2024-09-12T00:03:29.331243+0000","last_became_peered":"2024-09-12T00:03:29.331243+0000","last_unstale":"2024-09-12T00:03:34.759002+0000","last_undegraded":"2024-09-12T00:03:34.759002+0000","last_fullsized":"2024-09-12T00:03:34.759002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:52.544770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.405214+0000","last_change":"2024-09-12T00:03:31.347021+0000","last_active":"2024-09-12T00:03:34.405214+0000","last_peered":"2024-09-12T00:03:34.405214+0000","last_clean":"2024-09-12T00:03:34.405214+0000","last_became_active":"2024-09-12T00:03:31.344407+0000","last_became_peered":"2024-09-12T00:03:31.344407+0000","last_unstale":"2024-09-12T00:03:34.405214+0000","last_undegraded":"2024-09-12T00:03:34.405214+0000","last_fullsized":"2024-09-12T00:03:34.405214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:32.139742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.351225+0000","last_change":"2024-09-12T00:03:33.370271+0000","last_active":"2024-09-12T00:03:34.351225+0000","last_peered":"2024-09-12T00:03:34.351225+0000","last_clean":"2024-09-12T00:03:34.351225+0000","last_became_active":"2024-09-12T00:03:33.369538+0000","last_became_peered":"2024-09-12T00:03:33.369538+0000","last_unstale":"2024-09-12T00:03:34.351225+0000","last_undegraded":"2024-09-12T00:03:34.351225+0000","last_fullsized":"2024-09-12T00:03:34.351225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.384987+0000","last_change":"2024-09-12T00:03:25.341025+0000","last_active":"2024-09-12T00:03:34.384987+0000","last_peered":"2024-09-12T00:03:34.384987+0000","last_clean":"2024-09-12T00:03:34.384987+0000","last_became_active":"2024-09-12T00:03:25.340288+0000","last_became_peered":"2024-09-12T00:03:25.340288+0000","last_unstale":"2024-09-12T00:03:34.384987+0000","last_undegraded":"2024-09-12T00:03:34.384987+0000","last_fullsized":"2024-09-12T00:03:34.384987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.408218+0000","last_change":"2024-09-12T00:03:23.612814+0000","last_active":"2024-09-12T00:03:34.408218+0000","last_peered":"2024-09-12T00:03:34.408218+0000","last_clean":"2024-09-12T00:03:34.408218+0000","last_became_active":"2024-09-12T00:03:23.612332+0000","last_became_peered":"2024-09-12T00:03:23.612332+0000","last_unstale":"2024-09-12T00:03:34.408218+0000","last_undegraded":"2024-09-12T00:03:34.408218+0000","last_fullsized":"2024-09-12T00:03:34.408218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:02.202230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.405164+0000","last_change":"2024-09-12T00:03:27.329869+0000","last_active":"2024-09-12T00:03:34.405164+0000","last_peered":"2024-09-12T00:03:34.405164+0000","last_clean":"2024-09-12T00:03:34.405164+0000","last_became_active":"2024-09-12T00:03:27.329077+0000","last_became_peered":"2024-09-12T00:03:27.329077+0000","last_unstale":"2024-09-12T00:03:34.405164+0000","last_undegraded":"2024-09-12T00:03:34.405164+0000","last_fullsized":"2024-09-12T00:03:34.405164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'11","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.189153+0000","last_change":"2024-09-12T00:03:29.346878+0000","last_active":"2024-09-12T00:03:35.189153+0000","last_peered":"2024-09-12T00:03:35.189153+0000","last_clean":"2024-09-12T00:03:35.189153+0000","last_became_active":"2024-09-12T00:03:29.345990+0000","last_became_peered":"2024-09-12T00:03:29.345990+0000","last_unstale":"2024-09-12T00:03:35.189153+0000","last_undegraded":"2024-09-12T00:03:35.189153+0000","last_fullsized":"2024-09-12T00:03:35.189153+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:06.398979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.366597+0000","last_change":"2024-09-12T00:03:31.363658+0000","last_active":"2024-09-12T00:03:34.366597+0000","last_peered":"2024-09-12T00:03:34.366597+0000","last_clean":"2024-09-12T00:03:34.366597+0000","last_became_active":"2024-09-12T00:03:31.363080+0000","last_became_peered":"2024-09-12T00:03:31.363080+0000","last_unstale":"2024-09-12T00:03:34.366597+0000","last_undegraded":"2024-09-12T00:03:34.366597+0000","last_fullsized":"2024-09-12T00:03:34.366597+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:05.901608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348058+0000","last_change":"2024-09-12T00:03:33.380447+0000","last_active":"2024-09-12T00:03:34.348058+0000","last_peered":"2024-09-12T00:03:34.348058+0000","last_clean":"2024-09-12T00:03:34.348058+0000","last_became_active":"2024-09-12T00:03:33.379701+0000","last_became_peered":"2024-09-12T00:03:33.379701+0000","last_unstale":"2024-09-12T00:03:34.348058+0000","last_undegraded":"2024-09-12T00:03:34.348058+0000","last_fullsized":"2024-09-12T00:03:34.348058+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:55.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347591+0000","last_change":"2024-09-12T00:03:25.330916+0000","last_active":"2024-09-12T00:03:34.347591+0000","last_peered":"2024-09-12T00:03:34.347591+0000","last_clean":"2024-09-12T00:03:34.347591+0000","last_became_active":"2024-09-12T00:03:25.330181+0000","last_became_peered":"2024-09-12T00:03:25.330181+0000","last_unstale":"2024-09-12T00:03:34.347591+0000","last_undegraded":"2024-09-12T00:03:34.347591+0000","last_fullsized":"2024-09-12T00:03:34.347591+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:03.153020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.383907+0000","last_change":"2024-09-12T00:03:23.618613+0000","last_active":"2024-09-12T00:03:34.383907+0000","last_peered":"2024-09-12T00:03:34.383907+0000","last_clean":"2024-09-12T00:03:34.383907+0000","last_became_active":"2024-09-12T00:03:23.617587+0000","last_became_peered":"2024-09-12T00:03:23.617587+0000","last_unstale":"2024-09-12T00:03:34.383907+0000","last_undegraded":"2024-09-12T00:03:34.383907+0000","last_fullsized":"2024-09-12T00:03:34.383907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:54.211904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347370+0000","last_change":"2024-09-12T00:03:27.330320+0000","last_active":"2024-09-12T00:03:34.347370+0000","last_peered":"2024-09-12T00:03:34.347370+0000","last_clean":"2024-09-12T00:03:34.347370+0000","last_became_active":"2024-09-12T00:03:27.329236+0000","last_became_peered":"2024-09-12T00:03:27.329236+0000","last_unstale":"2024-09-12T00:03:34.347370+0000","last_undegraded":"2024-09-12T00:03:34.347370+0000","last_fullsized":"2024-09-12T00:03:34.347370+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:57.407947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'9","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.960252+0000","last_change":"2024-09-12T00:03:29.346312+0000","last_active":"2024-09-12T00:03:34.960252+0000","last_peered":"2024-09-12T00:03:34.960252+0000","last_clean":"2024-09-12T00:03:34.960252+0000","last_became_active":"2024-09-12T00:03:29.345883+0000","last_became_peered":"2024-09-12T00:03:29.345883+0000","last_unstale":"2024-09-12T00:03:34.960252+0000","last_undegraded":"2024-09-12T00:03:34.960252+0000","last_fullsized":"2024-09-12T00:03:34.960252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:46.723370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350524+0000","last_change":"2024-09-12T00:03:31.358786+0000","last_active":"2024-09-12T00:03:34.350524+0000","last_peered":"2024-09-12T00:03:34.350524+0000","last_clean":"2024-09-12T00:03:34.350524+0000","last_became_active":"2024-09-12T00:03:31.358011+0000","last_became_peered":"2024-09-12T00:03:31.358011+0000","last_unstale":"2024-09-12T00:03:34.350524+0000","last_undegraded":"2024-09-12T00:03:34.350524+0000","last_fullsized":"2024-09-12T00:03:34.350524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:29.394163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350013+0000","last_change":"2024-09-12T00:03:25.351065+0000","last_active":"2024-09-12T00:03:34.350013+0000","last_peered":"2024-09-12T00:03:34.350013+0000","last_clean":"2024-09-12T00:03:34.350013+0000","last_became_active":"2024-09-12T00:03:25.350719+0000","last_became_peered":"2024-09-12T00:03:25.350719+0000","last_unstale":"2024-09-12T00:03:34.350013+0000","last_undegraded":"2024-09-12T00:03:34.350013+0000","last_fullsized":"2024-09-12T00:03:34.350013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:54.693130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.381210+0000","last_change":"2024-09-12T00:03:23.627584+0000","last_active":"2024-09-12T00:03:34.381210+0000","last_peered":"2024-09-12T00:03:34.381210+0000","last_clean":"2024-09-12T00:03:34.381210+0000","last_became_active":"2024-09-12T00:03:23.626026+0000","last_became_peered":"2024-09-12T00:03:23.626026+0000","last_unstale":"2024-09-12T00:03:34.381210+0000","last_undegraded":"2024-09-12T00:03:34.381210+0000","last_fullsized":"2024-09-12T00:03:34.381210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:38.192583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350366+0000","last_change":"2024-09-12T00:03:27.335297+0000","last_active":"2024-09-12T00:03:34.350366+0000","last_peered":"2024-09-12T00:03:34.350366+0000","last_clean":"2024-09-12T00:03:34.350366+0000","last_became_active":"2024-09-12T00:03:27.334570+0000","last_became_peered":"2024-09-12T00:03:27.334570+0000","last_unstale":"2024-09-12T00:03:34.350366+0000","last_undegraded":"2024-09-12T00:03:34.350366+0000","last_fullsized":"2024-09-12T00:03:34.350366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"35'18","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.311724+0000","last_change":"2024-09-12T00:03:29.340387+0000","last_active":"2024-09-12T00:03:35.311724+0000","last_peered":"2024-09-12T00:03:35.311724+0000","last_clean":"2024-09-12T00:03:35.311724+0000","last_became_active":"2024-09-12T00:03:29.339781+0000","last_became_peered":"2024-09-12T00:03:29.339781+0000","last_unstale":"2024-09-12T00:03:35.311724+0000","last_undegraded":"2024-09-12T00:03:35.311724+0000","last_fullsized":"2024-09-12T00:03:35.311724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:30.132716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.406766+0000","last_change":"2024-09-12T00:03:31.350303+0000","last_active":"2024-09-12T00:03:34.406766+0000","last_peered":"2024-09-12T00:03:34.406766+0000","last_clean":"2024-09-12T00:03:34.406766+0000","last_became_active":"2024-09-12T00:03:31.349591+0000","last_became_peered":"2024-09-12T00:03:31.349591+0000","last_unstale":"2024-09-12T00:03:34.406766+0000","last_undegraded":"2024-09-12T00:03:34.406766+0000","last_fullsized":"2024-09-12T00:03:34.406766+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:00.263644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.380699+0000","last_change":"2024-09-12T00:03:33.385028+0000","last_active":"2024-09-12T00:03:34.380699+0000","last_peered":"2024-09-12T00:03:34.380699+0000","last_clean":"2024-09-12T00:03:34.380699+0000","last_became_active":"2024-09-12T00:03:33.384274+0000","last_became_peered":"2024-09-12T00:03:33.384274+0000","last_unstale":"2024-09-12T00:03:34.380699+0000","last_undegraded":"2024-09-12T00:03:34.380699+0000","last_fullsized":"2024-09-12T00:03:34.380699+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:11.634604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.387099+0000","last_change":"2024-09-12T00:03:25.329888+0000","last_active":"2024-09-12T00:03:34.387099+0000","last_peered":"2024-09-12T00:03:34.387099+0000","last_clean":"2024-09-12T00:03:34.387099+0000","last_became_active":"2024-09-12T00:03:25.329151+0000","last_became_peered":"2024-09-12T00:03:25.329151+0000","last_unstale":"2024-09-12T00:03:34.387099+0000","last_undegraded":"2024-09-12T00:03:34.387099+0000","last_fullsized":"2024-09-12T00:03:34.387099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:47.272383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.386163+0000","last_change":"2024-09-12T00:03:23.600146+0000","last_active":"2024-09-12T00:03:34.386163+0000","last_peered":"2024-09-12T00:03:34.386163+0000","last_clean":"2024-09-12T00:03:34.386163+0000","last_became_active":"2024-09-12T00:03:23.598862+0000","last_became_peered":"2024-09-12T00:03:23.598862+0000","last_unstale":"2024-09-12T00:03:34.386163+0000","last_undegraded":"2024-09-12T00:03:34.386163+0000","last_fullsized":"2024-09-12T00:03:34.386163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:13.330852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.407413+0000","last_change":"2024-09-12T00:03:27.341032+0000","last_active":"2024-09-12T00:03:34.407413+0000","last_peered":"2024-09-12T00:03:34.407413+0000","last_clean":"2024-09-12T00:03:34.407413+0000","last_became_active":"2024-09-12T00:03:27.340199+0000","last_became_peered":"2024-09-12T00:03:27.340199+0000","last_unstale":"2024-09-12T00:03:34.407413+0000","last_undegraded":"2024-09-12T00:03:34.407413+0000","last_fullsized":"2024-09-12T00:03:34.407413+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:23.673080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'15","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.084908+0000","last_change":"2024-09-12T00:03:29.349125+0000","last_active":"2024-09-12T00:03:35.084908+0000","last_peered":"2024-09-12T00:03:35.084908+0000","last_clean":"2024-09-12T00:03:35.084908+0000","last_became_active":"2024-09-12T00:03:29.348145+0000","last_became_peered":"2024-09-12T00:03:29.348145+0000","last_unstale":"2024-09-12T00:03:35.084908+0000","last_undegraded":"2024-09-12T00:03:35.084908+0000","last_fullsized":"2024-09-12T00:03:35.084908+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:55.699040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.381993+0000","last_change":"2024-09-12T00:03:31.363427+0000","last_active":"2024-09-12T00:03:34.381993+0000","last_peered":"2024-09-12T00:03:34.381993+0000","last_clean":"2024-09-12T00:03:34.381993+0000","last_became_active":"2024-09-12T00:03:31.362578+0000","last_became_peered":"2024-09-12T00:03:31.362578+0000","last_unstale":"2024-09-12T00:03:34.381993+0000","last_undegraded":"2024-09-12T00:03:34.381993+0000","last_fullsized":"2024-09-12T00:03:34.381993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:17.357647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349828+0000","last_change":"2024-09-12T00:03:33.375115+0000","last_active":"2024-09-12T00:03:34.349828+0000","last_peered":"2024-09-12T00:03:34.349828+0000","last_clean":"2024-09-12T00:03:34.349828+0000","last_became_active":"2024-09-12T00:03:33.374310+0000","last_became_peered":"2024-09-12T00:03:33.374310+0000","last_unstale":"2024-09-12T00:03:34.349828+0000","last_undegraded":"2024-09-12T00:03:34.349828+0000","last_fullsized":"2024-09-12T00:03:34.349828+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:46.466723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350900+0000","last_change":"2024-09-12T00:03:25.360355+0000","last_active":"2024-09-12T00:03:34.350900+0000","last_peered":"2024-09-12T00:03:34.350900+0000","last_clean":"2024-09-12T00:03:34.350900+0000","last_became_active":"2024-09-12T00:03:25.359682+0000","last_became_peered":"2024-09-12T00:03:25.359682+0000","last_unstale":"2024-09-12T00:03:34.350900+0000","last_undegraded":"2024-09-12T00:03:34.350900+0000","last_fullsized":"2024-09-12T00:03:34.350900+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:11.808081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.368060+0000","last_change":"2024-09-12T00:03:23.621199+0000","last_active":"2024-09-12T00:03:34.368060+0000","last_peered":"2024-09-12T00:03:34.368060+0000","last_clean":"2024-09-12T00:03:34.368060+0000","last_became_active":"2024-09-12T00:03:23.620961+0000","last_became_peered":"2024-09-12T00:03:23.620961+0000","last_unstale":"2024-09-12T00:03:34.368060+0000","last_undegraded":"2024-09-12T00:03:34.368060+0000","last_fullsized":"2024-09-12T00:03:34.368060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.407090+0000","last_change":"2024-09-12T00:03:27.336918+0000","last_active":"2024-09-12T00:03:34.407090+0000","last_peered":"2024-09-12T00:03:34.407090+0000","last_clean":"2024-09-12T00:03:34.407090+0000","last_became_active":"2024-09-12T00:03:27.336045+0000","last_became_peered":"2024-09-12T00:03:27.336045+0000","last_unstale":"2024-09-12T00:03:34.407090+0000","last_undegraded":"2024-09-12T00:03:34.407090+0000","last_fullsized":"2024-09-12T00:03:34.407090+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'17","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.289928+0000","last_change":"2024-09-12T00:03:29.338667+0000","last_active":"2024-09-12T00:03:35.289928+0000","last_peered":"2024-09-12T00:03:35.289928+0000","last_clean":"2024-09-12T00:03:35.289928+0000","last_became_active":"2024-09-12T00:03:29.338010+0000","last_became_peered":"2024-09-12T00:03:29.338010+0000","last_unstale":"2024-09-12T00:03:35.289928+0000","last_undegraded":"2024-09-12T00:03:35.289928+0000","last_fullsized":"2024-09-12T00:03:35.289928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:58.256619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.351382+0000","last_change":"2024-09-12T00:03:31.352823+0000","last_active":"2024-09-12T00:03:34.351382+0000","last_peered":"2024-09-12T00:03:34.351382+0000","last_clean":"2024-09-12T00:03:34.351382+0000","last_became_active":"2024-09-12T00:03:31.352143+0000","last_became_peered":"2024-09-12T00:03:31.352143+0000","last_unstale":"2024-09-12T00:03:34.351382+0000","last_undegraded":"2024-09-12T00:03:34.351382+0000","last_fullsized":"2024-09-12T00:03:34.351382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:25.168692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347155+0000","last_change":"2024-09-12T00:03:33.379330+0000","last_active":"2024-09-12T00:03:34.347155+0000","last_peered":"2024-09-12T00:03:34.347155+0000","last_clean":"2024-09-12T00:03:34.347155+0000","last_became_active":"2024-09-12T00:03:33.376228+0000","last_became_peered":"2024-09-12T00:03:33.376228+0000","last_unstale":"2024-09-12T00:03:34.347155+0000","last_undegraded":"2024-09-12T00:03:34.347155+0000","last_fullsized":"2024-09-12T00:03:34.347155+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:44.364562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.386866+0000","last_change":"2024-09-12T00:03:25.325094+0000","last_active":"2024-09-12T00:03:34.386866+0000","last_peered":"2024-09-12T00:03:34.386866+0000","last_clean":"2024-09-12T00:03:34.386866+0000","last_became_active":"2024-09-12T00:03:25.324315+0000","last_became_peered":"2024-09-12T00:03:25.324315+0000","last_unstale":"2024-09-12T00:03:34.386866+0000","last_undegraded":"2024-09-12T00:03:34.386866+0000","last_fullsized":"2024-09-12T00:03:34.386866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:18.727732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.386715+0000","last_change":"2024-09-12T00:03:23.606163+0000","last_active":"2024-09-12T00:03:34.386715+0000","last_peered":"2024-09-12T00:03:34.386715+0000","last_clean":"2024-09-12T00:03:34.386715+0000","last_became_active":"2024-09-12T00:03:23.605402+0000","last_became_peered":"2024-09-12T00:03:23.605402+0000","last_unstale":"2024-09-12T00:03:34.386715+0000","last_undegraded":"2024-09-12T00:03:34.386715+0000","last_fullsized":"2024-09-12T00:03:34.386715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:02.432313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.385473+0000","last_change":"2024-09-12T00:03:27.336716+0000","last_active":"2024-09-12T00:03:34.385473+0000","last_peered":"2024-09-12T00:03:34.385473+0000","last_clean":"2024-09-12T00:03:34.385473+0000","last_became_active":"2024-09-12T00:03:27.335658+0000","last_became_peered":"2024-09-12T00:03:27.335658+0000","last_unstale":"2024-09-12T00:03:34.385473+0000","last_undegraded":"2024-09-12T00:03:34.385473+0000","last_fullsized":"2024-09-12T00:03:34.385473+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:47.355798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"35'16","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.266588+0000","last_change":"2024-09-12T00:03:29.354481+0000","last_active":"2024-09-12T00:03:35.266588+0000","last_peered":"2024-09-12T00:03:35.266588+0000","last_clean":"2024-09-12T00:03:35.266588+0000","last_became_active":"2024-09-12T00:03:29.353656+0000","last_became_peered":"2024-09-12T00:03:29.353656+0000","last_unstale":"2024-09-12T00:03:35.266588+0000","last_undegraded":"2024-09-12T00:03:35.266588+0000","last_fullsized":"2024-09-12T00:03:35.266588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:42.984798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373596+0000","last_change":"2024-09-12T00:03:31.351362+0000","last_active":"2024-09-12T00:03:34.373596+0000","last_peered":"2024-09-12T00:03:34.373596+0000","last_clean":"2024-09-12T00:03:34.373596+0000","last_became_active":"2024-09-12T00:03:31.350925+0000","last_became_peered":"2024-09-12T00:03:31.350925+0000","last_unstale":"2024-09-12T00:03:34.373596+0000","last_undegraded":"2024-09-12T00:03:34.373596+0000","last_fullsized":"2024-09-12T00:03:34.373596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:03.147968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.346802+0000","last_change":"2024-09-12T00:03:33.374932+0000","last_active":"2024-09-12T00:03:34.346802+0000","last_peered":"2024-09-12T00:03:34.346802+0000","last_clean":"2024-09-12T00:03:34.346802+0000","last_became_active":"2024-09-12T00:03:33.374185+0000","last_became_peered":"2024-09-12T00:03:33.374185+0000","last_unstale":"2024-09-12T00:03:34.346802+0000","last_undegraded":"2024-09-12T00:03:34.346802+0000","last_fullsized":"2024-09-12T00:03:34.346802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:54.883339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.406911+0000","last_change":"2024-09-12T00:03:25.357999+0000","last_active":"2024-09-12T00:03:34.406911+0000","last_peered":"2024-09-12T00:03:34.406911+0000","last_clean":"2024-09-12T00:03:34.406911+0000","last_became_active":"2024-09-12T00:03:25.357623+0000","last_became_peered":"2024-09-12T00:03:25.357623+0000","last_unstale":"2024-09-12T00:03:34.406911+0000","last_undegraded":"2024-09-12T00:03:34.406911+0000","last_fullsized":"2024-09-12T00:03:34.406911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.367672+0000","last_change":"2024-09-12T00:03:23.605954+0000","last_active":"2024-09-12T00:03:34.367672+0000","last_peered":"2024-09-12T00:03:34.367672+0000","last_clean":"2024-09-12T00:03:34.367672+0000","last_became_active":"2024-09-12T00:03:23.604773+0000","last_became_peered":"2024-09-12T00:03:23.604773+0000","last_unstale":"2024-09-12T00:03:34.367672+0000","last_undegraded":"2024-09-12T00:03:34.367672+0000","last_fullsized":"2024-09-12T00:03:34.367672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.366916+0000","last_change":"2024-09-12T00:03:27.346785+0000","last_active":"2024-09-12T00:03:34.366916+0000","last_peered":"2024-09-12T00:03:34.366916+0000","last_clean":"2024-09-12T00:03:34.366916+0000","last_became_active":"2024-09-12T00:03:27.346168+0000","last_became_peered":"2024-09-12T00:03:27.346168+0000","last_unstale":"2024-09-12T00:03:34.366916+0000","last_undegraded":"2024-09-12T00:03:34.366916+0000","last_fullsized":"2024-09-12T00:03:34.366916+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'40","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.301663+0000","last_change":"2024-09-12T00:03:29.343942+0000","last_active":"2024-09-12T00:03:35.301663+0000","last_peered":"2024-09-12T00:03:35.301663+0000","last_clean":"2024-09-12T00:03:35.301663+0000","last_became_active":"2024-09-12T00:03:29.343238+0000","last_became_peered":"2024-09-12T00:03:29.343238+0000","last_unstale":"2024-09-12T00:03:35.301663+0000","last_undegraded":"2024-09-12T00:03:35.301663+0000","last_fullsized":"2024-09-12T00:03:35.301663+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:30.949892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.384203+0000","last_change":"2024-09-12T00:03:31.348120+0000","last_active":"2024-09-12T00:03:34.384203+0000","last_peered":"2024-09-12T00:03:34.384203+0000","last_clean":"2024-09-12T00:03:34.384203+0000","last_became_active":"2024-09-12T00:03:31.344599+0000","last_became_peered":"2024-09-12T00:03:31.344599+0000","last_unstale":"2024-09-12T00:03:34.384203+0000","last_undegraded":"2024-09-12T00:03:34.384203+0000","last_fullsized":"2024-09-12T00:03:34.384203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:00.279625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.368227+0000","last_change":"2024-09-12T00:03:33.363188+0000","last_active":"2024-09-12T00:03:34.368227+0000","last_peered":"2024-09-12T00:03:34.368227+0000","last_clean":"2024-09-12T00:03:34.368227+0000","last_became_active":"2024-09-12T00:03:33.360672+0000","last_became_peered":"2024-09-12T00:03:33.360672+0000","last_unstale":"2024-09-12T00:03:34.368227+0000","last_undegraded":"2024-09-12T00:03:34.368227+0000","last_fullsized":"2024-09-12T00:03:34.368227+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:33.646117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.405748+0000","last_change":"2024-09-12T00:03:25.336626+0000","last_active":"2024-09-12T00:03:34.405748+0000","last_peered":"2024-09-12T00:03:34.405748+0000","last_clean":"2024-09-12T00:03:34.405748+0000","last_became_active":"2024-09-12T00:03:25.336095+0000","last_became_peered":"2024-09-12T00:03:25.336095+0000","last_unstale":"2024-09-12T00:03:34.405748+0000","last_undegraded":"2024-09-12T00:03:34.405748+0000","last_fullsized":"2024-09-12T00:03:34.405748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349586+0000","last_change":"2024-09-12T00:03:23.601889+0000","last_active":"2024-09-12T00:03:34.349586+0000","last_peered":"2024-09-12T00:03:34.349586+0000","last_clean":"2024-09-12T00:03:34.349586+0000","last_became_active":"2024-09-12T00:03:23.601553+0000","last_became_peered":"2024-09-12T00:03:23.601553+0000","last_unstale":"2024-09-12T00:03:34.349586+0000","last_undegraded":"2024-09-12T00:03:34.349586+0000","last_fullsized":"2024-09-12T00:03:34.349586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:08.758769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.406689+0000","last_change":"2024-09-12T00:03:27.326174+0000","last_active":"2024-09-12T00:03:34.406689+0000","last_peered":"2024-09-12T00:03:34.406689+0000","last_clean":"2024-09-12T00:03:34.406689+0000","last_became_active":"2024-09-12T00:03:27.325336+0000","last_became_peered":"2024-09-12T00:03:27.325336+0000","last_unstale":"2024-09-12T00:03:34.406689+0000","last_undegraded":"2024-09-12T00:03:34.406689+0000","last_fullsized":"2024-09-12T00:03:34.406689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:08.659813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'15","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.717618+0000","last_change":"2024-09-12T00:03:29.335957+0000","last_active":"2024-09-12T00:03:34.717618+0000","last_peered":"2024-09-12T00:03:34.717618+0000","last_clean":"2024-09-12T00:03:34.717618+0000","last_became_active":"2024-09-12T00:03:29.335186+0000","last_became_peered":"2024-09-12T00:03:29.335186+0000","last_unstale":"2024-09-12T00:03:34.717618+0000","last_undegraded":"2024-09-12T00:03:34.717618+0000","last_fullsized":"2024-09-12T00:03:34.717618+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:20.551758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347606+0000","last_change":"2024-09-12T00:03:31.350287+0000","last_active":"2024-09-12T00:03:34.347606+0000","last_peered":"2024-09-12T00:03:34.347606+0000","last_clean":"2024-09-12T00:03:34.347606+0000","last_became_active":"2024-09-12T00:03:31.349890+0000","last_became_peered":"2024-09-12T00:03:31.349890+0000","last_unstale":"2024-09-12T00:03:34.347606+0000","last_undegraded":"2024-09-12T00:03:34.347606+0000","last_fullsized":"2024-09-12T00:03:34.347606+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:33.081032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382134+0000","last_change":"2024-09-12T00:03:33.385037+0000","last_active":"2024-09-12T00:03:34.382134+0000","last_peered":"2024-09-12T00:03:34.382134+0000","last_clean":"2024-09-12T00:03:34.382134+0000","last_became_active":"2024-09-12T00:03:33.384379+0000","last_became_peered":"2024-09-12T00:03:33.384379+0000","last_unstale":"2024-09-12T00:03:34.382134+0000","last_undegraded":"2024-09-12T00:03:34.382134+0000","last_fullsized":"2024-09-12T00:03:34.382134+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:00.153475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347800+0000","last_change":"2024-09-12T00:03:25.339110+0000","last_active":"2024-09-12T00:03:34.347800+0000","last_peered":"2024-09-12T00:03:34.347800+0000","last_clean":"2024-09-12T00:03:34.347800+0000","last_became_active":"2024-09-12T00:03:25.338417+0000","last_became_peered":"2024-09-12T00:03:25.338417+0000","last_unstale":"2024-09-12T00:03:34.347800+0000","last_undegraded":"2024-09-12T00:03:34.347800+0000","last_fullsized":"2024-09-12T00:03:34.347800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:48.866021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.383459+0000","last_change":"2024-09-12T00:03:23.625514+0000","last_active":"2024-09-12T00:03:34.383459+0000","last_peered":"2024-09-12T00:03:34.383459+0000","last_clean":"2024-09-12T00:03:34.383459+0000","last_became_active":"2024-09-12T00:03:23.621654+0000","last_became_peered":"2024-09-12T00:03:23.621654+0000","last_unstale":"2024-09-12T00:03:34.383459+0000","last_undegraded":"2024-09-12T00:03:34.383459+0000","last_fullsized":"2024-09-12T00:03:34.383459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:43.784497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.366269+0000","last_change":"2024-09-12T00:03:27.330377+0000","last_active":"2024-09-12T00:03:34.366269+0000","last_peered":"2024-09-12T00:03:34.366269+0000","last_clean":"2024-09-12T00:03:34.366269+0000","last_became_active":"2024-09-12T00:03:27.329713+0000","last_became_peered":"2024-09-12T00:03:27.329713+0000","last_unstale":"2024-09-12T00:03:34.366269+0000","last_undegraded":"2024-09-12T00:03:34.366269+0000","last_fullsized":"2024-09-12T00:03:34.366269+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'11","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.915054+0000","last_change":"2024-09-12T00:03:29.337028+0000","last_active":"2024-09-12T00:03:34.915054+0000","last_peered":"2024-09-12T00:03:34.915054+0000","last_clean":"2024-09-12T00:03:34.915054+0000","last_became_active":"2024-09-12T00:03:29.335440+0000","last_became_peered":"2024-09-12T00:03:29.335440+0000","last_unstale":"2024-09-12T00:03:34.915054+0000","last_undegraded":"2024-09-12T00:03:34.915054+0000","last_fullsized":"2024-09-12T00:03:34.915054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:19.288395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347581+0000","last_change":"2024-09-12T00:03:31.351990+0000","last_active":"2024-09-12T00:03:34.347581+0000","last_peered":"2024-09-12T00:03:34.347581+0000","last_clean":"2024-09-12T00:03:34.347581+0000","last_became_active":"2024-09-12T00:03:31.351580+0000","last_became_peered":"2024-09-12T00:03:31.351580+0000","last_unstale":"2024-09-12T00:03:34.347581+0000","last_undegraded":"2024-09-12T00:03:34.347581+0000","last_fullsized":"2024-09-12T00:03:34.347581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:38.095033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348723+0000","last_change":"2024-09-12T00:03:33.383008+0000","last_active":"2024-09-12T00:03:34.348723+0000","last_peered":"2024-09-12T00:03:34.348723+0000","last_clean":"2024-09-12T00:03:34.348723+0000","last_became_active":"2024-09-12T00:03:33.381496+0000","last_became_peered":"2024-09-12T00:03:33.381496+0000","last_unstale":"2024-09-12T00:03:34.348723+0000","last_undegraded":"2024-09-12T00:03:34.348723+0000","last_fullsized":"2024-09-12T00:03:34.348723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:44.996509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.405434+0000","last_change":"2024-09-12T00:03:25.337999+0000","last_active":"2024-09-12T00:03:34.405434+0000","last_peered":"2024-09-12T00:03:34.405434+0000","last_clean":"2024-09-12T00:03:34.405434+0000","last_became_active":"2024-09-12T00:03:25.337237+0000","last_became_peered":"2024-09-12T00:03:25.337237+0000","last_unstale":"2024-09-12T00:03:34.405434+0000","last_undegraded":"2024-09-12T00:03:34.405434+0000","last_fullsized":"2024-09-12T00:03:34.405434+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.383789+0000","last_change":"2024-09-12T00:03:23.631744+0000","last_active":"2024-09-12T00:03:34.383789+0000","last_peered":"2024-09-12T00:03:34.383789+0000","last_clean":"2024-09-12T00:03:34.383789+0000","last_became_active":"2024-09-12T00:03:23.630928+0000","last_became_peered":"2024-09-12T00:03:23.630928+0000","last_unstale":"2024-09-12T00:03:34.383789+0000","last_undegraded":"2024-09-12T00:03:34.383789+0000","last_fullsized":"2024-09-12T00:03:34.383789+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:35.772832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.384778+0000","last_change":"2024-09-12T00:03:27.345980+0000","last_active":"2024-09-12T00:03:34.384778+0000","last_peered":"2024-09-12T00:03:34.384778+0000","last_clean":"2024-09-12T00:03:34.384778+0000","last_became_active":"2024-09-12T00:03:27.345225+0000","last_became_peered":"2024-09-12T00:03:27.345225+0000","last_unstale":"2024-09-12T00:03:34.384778+0000","last_undegraded":"2024-09-12T00:03:34.384778+0000","last_fullsized":"2024-09-12T00:03:34.384778+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:47.990032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"35'21","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.980478+0000","last_change":"2024-09-12T00:03:29.359254+0000","last_active":"2024-09-12T00:03:34.980478+0000","last_peered":"2024-09-12T00:03:34.980478+0000","last_clean":"2024-09-12T00:03:34.980478+0000","last_became_active":"2024-09-12T00:03:29.355711+0000","last_became_peered":"2024-09-12T00:03:29.355711+0000","last_unstale":"2024-09-12T00:03:34.980478+0000","last_undegraded":"2024-09-12T00:03:34.980478+0000","last_fullsized":"2024-09-12T00:03:34.980478+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:49.919008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.386157+0000","last_change":"2024-09-12T00:03:31.355300+0000","last_active":"2024-09-12T00:03:34.386157+0000","last_peered":"2024-09-12T00:03:34.386157+0000","last_clean":"2024-09-12T00:03:34.386157+0000","last_became_active":"2024-09-12T00:03:31.354506+0000","last_became_peered":"2024-09-12T00:03:31.354506+0000","last_unstale":"2024-09-12T00:03:34.386157+0000","last_undegraded":"2024-09-12T00:03:34.386157+0000","last_fullsized":"2024-09-12T00:03:34.386157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:51.564710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373664+0000","last_change":"2024-09-12T00:03:33.384262+0000","last_active":"2024-09-12T00:03:34.373664+0000","last_peered":"2024-09-12T00:03:34.373664+0000","last_clean":"2024-09-12T00:03:34.373664+0000","last_became_active":"2024-09-12T00:03:33.383358+0000","last_became_peered":"2024-09-12T00:03:33.383358+0000","last_unstale":"2024-09-12T00:03:34.373664+0000","last_undegraded":"2024-09-12T00:03:34.373664+0000","last_fullsized":"2024-09-12T00:03:34.373664+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:45.060131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.387343+0000","last_change":"2024-09-12T00:03:25.321452+0000","last_active":"2024-09-12T00:03:34.387343+0000","last_peered":"2024-09-12T00:03:34.387343+0000","last_clean":"2024-09-12T00:03:34.387343+0000","last_became_active":"2024-09-12T00:03:25.320503+0000","last_became_peered":"2024-09-12T00:03:25.320503+0000","last_unstale":"2024-09-12T00:03:34.387343+0000","last_undegraded":"2024-09-12T00:03:34.387343+0000","last_fullsized":"2024-09-12T00:03:34.387343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:22.789487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.405769+0000","last_change":"2024-09-12T00:03:23.617643+0000","last_active":"2024-09-12T00:03:34.405769+0000","last_peered":"2024-09-12T00:03:34.405769+0000","last_clean":"2024-09-12T00:03:34.405769+0000","last_became_active":"2024-09-12T00:03:23.617138+0000","last_became_peered":"2024-09-12T00:03:23.617138+0000","last_unstale":"2024-09-12T00:03:34.405769+0000","last_undegraded":"2024-09-12T00:03:34.405769+0000","last_fullsized":"2024-09-12T00:03:34.405769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.352616+0000","last_change":"2024-09-12T00:03:25.335650+0000","last_active":"2024-09-12T00:03:34.352616+0000","last_peered":"2024-09-12T00:03:34.352616+0000","last_clean":"2024-09-12T00:03:34.352616+0000","last_became_active":"2024-09-12T00:03:25.334965+0000","last_became_peered":"2024-09-12T00:03:25.334965+0000","last_unstale":"2024-09-12T00:03:34.352616+0000","last_undegraded":"2024-09-12T00:03:34.352616+0000","last_fullsized":"2024-09-12T00:03:34.352616+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:13.501672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347562+0000","last_change":"2024-09-12T00:03:23.618651+0000","last_active":"2024-09-12T00:03:34.347562+0000","last_peered":"2024-09-12T00:03:34.347562+0000","last_clean":"2024-09-12T00:03:34.347562+0000","last_became_active":"2024-09-12T00:03:23.612542+0000","last_became_peered":"2024-09-12T00:03:23.612542+0000","last_unstale":"2024-09-12T00:03:34.347562+0000","last_undegraded":"2024-09-12T00:03:34.347562+0000","last_fullsized":"2024-09-12T00:03:34.347562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348904+0000","last_change":"2024-09-12T00:03:25.327224+0000","last_active":"2024-09-12T00:03:34.348904+0000","last_peered":"2024-09-12T00:03:34.348904+0000","last_clean":"2024-09-12T00:03:34.348904+0000","last_became_active":"2024-09-12T00:03:25.326635+0000","last_became_peered":"2024-09-12T00:03:25.326635+0000","last_unstale":"2024-09-12T00:03:34.348904+0000","last_undegraded":"2024-09-12T00:03:34.348904+0000","last_fullsized":"2024-09-12T00:03:34.348904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:16.827573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349213+0000","last_change":"2024-09-12T00:03:23.626043+0000","last_active":"2024-09-12T00:03:34.349213+0000","last_peered":"2024-09-12T00:03:34.349213+0000","last_clean":"2024-09-12T00:03:34.349213+0000","last_became_active":"2024-09-12T00:03:23.625717+0000","last_became_peered":"2024-09-12T00:03:23.625717+0000","last_unstale":"2024-09-12T00:03:34.349213+0000","last_undegraded":"2024-09-12T00:03:34.349213+0000","last_fullsized":"2024-09-12T00:03:34.349213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:45.258601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382434+0000","last_change":"2024-09-12T00:03:25.354015+0000","last_active":"2024-09-12T00:03:34.382434+0000","last_peered":"2024-09-12T00:03:34.382434+0000","last_clean":"2024-09-12T00:03:34.382434+0000","last_became_active":"2024-09-12T00:03:25.352319+0000","last_became_peered":"2024-09-12T00:03:25.352319+0000","last_unstale":"2024-09-12T00:03:34.382434+0000","last_undegraded":"2024-09-12T00:03:34.382434+0000","last_fullsized":"2024-09-12T00:03:34.382434+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:08.033834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382411+0000","last_change":"2024-09-12T00:03:23.633614+0000","last_active":"2024-09-12T00:03:34.382411+0000","last_peered":"2024-09-12T00:03:34.382411+0000","last_clean":"2024-09-12T00:03:34.382411+0000","last_became_active":"2024-09-12T00:03:23.632850+0000","last_became_peered":"2024-09-12T00:03:23.632850+0000","last_unstale":"2024-09-12T00:03:34.382411+0000","last_undegraded":"2024-09-12T00:03:34.382411+0000","last_fullsized":"2024-09-12T00:03:34.382411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.381974+0000","last_change":"2024-09-12T00:03:25.357453+0000","last_active":"2024-09-12T00:03:34.381974+0000","last_peered":"2024-09-12T00:03:34.381974+0000","last_clean":"2024-09-12T00:03:34.381974+0000","last_became_active":"2024-09-12T00:03:25.353815+0000","last_became_peered":"2024-09-12T00:03:25.353815+0000","last_unstale":"2024-09-12T00:03:34.381974+0000","last_undegraded":"2024-09-12T00:03:34.381974+0000","last_fullsized":"2024-09-12T00:03:34.381974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:27.562174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350215+0000","last_change":"2024-09-12T00:03:23.609055+0000","last_active":"2024-09-12T00:03:34.350215+0000","last_peered":"2024-09-12T00:03:34.350215+0000","last_clean":"2024-09-12T00:03:34.350215+0000","last_became_active":"2024-09-12T00:03:23.608101+0000","last_became_peered":"2024-09-12T00:03:23.608101+0000","last_unstale":"2024-09-12T00:03:34.350215+0000","last_undegraded":"2024-09-12T00:03:34.350215+0000","last_fullsized":"2024-09-12T00:03:34.350215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.372521+0000","last_change":"2024-09-12T00:03:25.324744+0000","last_active":"2024-09-12T00:03:34.372521+0000","last_peered":"2024-09-12T00:03:34.372521+0000","last_clean":"2024-09-12T00:03:34.372521+0000","last_became_active":"2024-09-12T00:03:25.324199+0000","last_became_peered":"2024-09-12T00:03:25.324199+0000","last_unstale":"2024-09-12T00:03:34.372521+0000","last_undegraded":"2024-09-12T00:03:34.372521+0000","last_fullsized":"2024-09-12T00:03:34.372521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:12.547802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.352220+0000","last_change":"2024-09-12T00:03:23.616706+0000","last_active":"2024-09-12T00:03:34.352220+0000","last_peered":"2024-09-12T00:03:34.352220+0000","last_clean":"2024-09-12T00:03:34.352220+0000","last_became_active":"2024-09-12T00:03:23.615970+0000","last_became_peered":"2024-09-12T00:03:23.615970+0000","last_unstale":"2024-09-12T00:03:34.352220+0000","last_undegraded":"2024-09-12T00:03:34.352220+0000","last_fullsized":"2024-09-12T00:03:34.352220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349160+0000","last_change":"2024-09-12T00:03:25.343716+0000","last_active":"2024-09-12T00:03:34.349160+0000","last_peered":"2024-09-12T00:03:34.349160+0000","last_clean":"2024-09-12T00:03:34.349160+0000","last_became_active":"2024-09-12T00:03:25.342930+0000","last_became_peered":"2024-09-12T00:03:25.342930+0000","last_unstale":"2024-09-12T00:03:34.349160+0000","last_undegraded":"2024-09-12T00:03:34.349160+0000","last_fullsized":"2024-09-12T00:03:34.349160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.408099+0000","last_change":"2024-09-12T00:03:23.612903+0000","last_active":"2024-09-12T00:03:34.408099+0000","last_peered":"2024-09-12T00:03:34.408099+0000","last_clean":"2024-09-12T00:03:34.408099+0000","last_became_active":"2024-09-12T00:03:23.612448+0000","last_became_peered":"2024-09-12T00:03:23.612448+0000","last_unstale":"2024-09-12T00:03:34.408099+0000","last_undegraded":"2024-09-12T00:03:34.408099+0000","last_fullsized":"2024-09-12T00:03:34.408099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:14.913580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.367162+0000","last_change":"2024-09-12T00:03:25.326620+0000","last_active":"2024-09-12T00:03:34.367162+0000","last_peered":"2024-09-12T00:03:34.367162+0000","last_clean":"2024-09-12T00:03:34.367162+0000","last_became_active":"2024-09-12T00:03:25.326262+0000","last_became_peered":"2024-09-12T00:03:25.326262+0000","last_unstale":"2024-09-12T00:03:34.367162+0000","last_undegraded":"2024-09-12T00:03:34.367162+0000","last_fullsized":"2024-09-12T00:03:34.367162+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.383665+0000","last_change":"2024-09-12T00:03:23.632200+0000","last_active":"2024-09-12T00:03:34.383665+0000","last_peered":"2024-09-12T00:03:34.383665+0000","last_clean":"2024-09-12T00:03:34.383665+0000","last_became_active":"2024-09-12T00:03:23.631510+0000","last_became_peered":"2024-09-12T00:03:23.631510+0000","last_unstale":"2024-09-12T00:03:34.383665+0000","last_undegraded":"2024-09-12T00:03:34.383665+0000","last_fullsized":"2024-09-12T00:03:34.383665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:07.177242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.352346+0000","last_change":"2024-09-12T00:03:25.342763+0000","last_active":"2024-09-12T00:03:34.352346+0000","last_peered":"2024-09-12T00:03:34.352346+0000","last_clean":"2024-09-12T00:03:34.352346+0000","last_became_active":"2024-09-12T00:03:25.337834+0000","last_became_peered":"2024-09-12T00:03:25.337834+0000","last_unstale":"2024-09-12T00:03:34.352346+0000","last_undegraded":"2024-09-12T00:03:34.352346+0000","last_fullsized":"2024-09-12T00:03:34.352346+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:35.920599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347658+0000","last_change":"2024-09-12T00:03:23.630533+0000","last_active":"2024-09-12T00:03:34.347658+0000","last_peered":"2024-09-12T00:03:34.347658+0000","last_clean":"2024-09-12T00:03:34.347658+0000","last_became_active":"2024-09-12T00:03:23.630187+0000","last_became_peered":"2024-09-12T00:03:23.630187+0000","last_unstale":"2024-09-12T00:03:34.347658+0000","last_undegraded":"2024-09-12T00:03:34.347658+0000","last_fullsized":"2024-09-12T00:03:34.347658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:18.692638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373671+0000","last_change":"2024-09-12T00:03:25.339910+0000","last_active":"2024-09-12T00:03:34.373671+0000","last_peered":"2024-09-12T00:03:34.373671+0000","last_clean":"2024-09-12T00:03:34.373671+0000","last_became_active":"2024-09-12T00:03:25.336511+0000","last_became_peered":"2024-09-12T00:03:25.336511+0000","last_unstale":"2024-09-12T00:03:34.373671+0000","last_undegraded":"2024-09-12T00:03:34.373671+0000","last_fullsized":"2024-09-12T00:03:34.373671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:30.647474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.381605+0000","last_change":"2024-09-12T00:03:23.626232+0000","last_active":"2024-09-12T00:03:34.381605+0000","last_peered":"2024-09-12T00:03:34.381605+0000","last_clean":"2024-09-12T00:03:34.381605+0000","last_became_active":"2024-09-12T00:03:23.621761+0000","last_became_peered":"2024-09-12T00:03:23.621761+0000","last_unstale":"2024-09-12T00:03:34.381605+0000","last_undegraded":"2024-09-12T00:03:34.381605+0000","last_fullsized":"2024-09-12T00:03:34.381605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:31.587668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382856+0000","last_change":"2024-09-12T00:03:25.341017+0000","last_active":"2024-09-12T00:03:34.382856+0000","last_peered":"2024-09-12T00:03:34.382856+0000","last_clean":"2024-09-12T00:03:34.382856+0000","last_became_active":"2024-09-12T00:03:25.340279+0000","last_became_peered":"2024-09-12T00:03:25.340279+0000","last_unstale":"2024-09-12T00:03:34.382856+0000","last_undegraded":"2024-09-12T00:03:34.382856+0000","last_fullsized":"2024-09-12T00:03:34.382856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:08.066950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.367745+0000","last_change":"2024-09-12T00:03:23.600956+0000","last_active":"2024-09-12T00:03:34.367745+0000","last_peered":"2024-09-12T00:03:34.367745+0000","last_clean":"2024-09-12T00:03:34.367745+0000","last_became_active":"2024-09-12T00:03:23.600673+0000","last_became_peered":"2024-09-12T00:03:23.600673+0000","last_unstale":"2024-09-12T00:03:34.367745+0000","last_undegraded":"2024-09-12T00:03:34.367745+0000","last_fullsized":"2024-09-12T00:03:34.367745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.367310+0000","last_change":"2024-09-12T00:03:25.325088+0000","last_active":"2024-09-12T00:03:34.367310+0000","last_peered":"2024-09-12T00:03:34.367310+0000","last_clean":"2024-09-12T00:03:34.367310+0000","last_became_active":"2024-09-12T00:03:25.324597+0000","last_became_peered":"2024-09-12T00:03:25.324597+0000","last_unstale":"2024-09-12T00:03:34.367310+0000","last_undegraded":"2024-09-12T00:03:34.367310+0000","last_fullsized":"2024-09-12T00:03:34.367310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.386480+0000","last_change":"2024-09-12T00:03:23.621791+0000","last_active":"2024-09-12T00:03:34.386480+0000","last_peered":"2024-09-12T00:03:34.386480+0000","last_clean":"2024-09-12T00:03:34.386480+0000","last_became_active":"2024-09-12T00:03:23.621063+0000","last_became_peered":"2024-09-12T00:03:23.621063+0000","last_unstale":"2024-09-12T00:03:34.386480+0000","last_undegraded":"2024-09-12T00:03:34.386480+0000","last_fullsized":"2024-09-12T00:03:34.386480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:33.234598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.366847+0000","last_change":"2024-09-12T00:03:25.357605+0000","last_active":"2024-09-12T00:03:34.366847+0000","last_peered":"2024-09-12T00:03:34.366847+0000","last_clean":"2024-09-12T00:03:34.366847+0000","last_became_active":"2024-09-12T00:03:25.357286+0000","last_became_peered":"2024-09-12T00:03:25.357286+0000","last_unstale":"2024-09-12T00:03:34.366847+0000","last_undegraded":"2024-09-12T00:03:34.366847+0000","last_fullsized":"2024-09-12T00:03:34.366847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373401+0000","last_change":"2024-09-12T00:03:23.600931+0000","last_active":"2024-09-12T00:03:34.373401+0000","last_peered":"2024-09-12T00:03:34.373401+0000","last_clean":"2024-09-12T00:03:34.373401+0000","last_became_active":"2024-09-12T00:03:23.600591+0000","last_became_peered":"2024-09-12T00:03:23.600591+0000","last_unstale":"2024-09-12T00:03:34.373401+0000","last_undegraded":"2024-09-12T00:03:34.373401+0000","last_fullsized":"2024-09-12T00:03:34.373401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348035+0000","last_change":"2024-09-12T00:03:25.330869+0000","last_active":"2024-09-12T00:03:34.348035+0000","last_peered":"2024-09-12T00:03:34.348035+0000","last_clean":"2024-09-12T00:03:34.348035+0000","last_became_active":"2024-09-12T00:03:25.329742+0000","last_became_peered":"2024-09-12T00:03:25.329742+0000","last_unstale":"2024-09-12T00:03:34.348035+0000","last_undegraded":"2024-09-12T00:03:34.348035+0000","last_fullsized":"2024-09-12T00:03:34.348035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:01.365985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349760+0000","last_change":"2024-09-12T00:03:23.604388+0000","last_active":"2024-09-12T00:03:34.349760+0000","last_peered":"2024-09-12T00:03:34.349760+0000","last_clean":"2024-09-12T00:03:34.349760+0000","last_became_active":"2024-09-12T00:03:23.603608+0000","last_became_peered":"2024-09-12T00:03:23.603608+0000","last_unstale":"2024-09-12T00:03:34.349760+0000","last_undegraded":"2024-09-12T00:03:34.349760+0000","last_fullsized":"2024-09-12T00:03:34.349760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:19.941103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.385650+0000","last_change":"2024-09-12T00:03:25.347570+0000","last_active":"2024-09-12T00:03:34.385650+0000","last_peered":"2024-09-12T00:03:34.385650+0000","last_clean":"2024-09-12T00:03:34.385650+0000","last_became_active":"2024-09-12T00:03:25.346874+0000","last_became_peered":"2024-09-12T00:03:25.346874+0000","last_unstale":"2024-09-12T00:03:34.385650+0000","last_undegraded":"2024-09-12T00:03:34.385650+0000","last_fullsized":"2024-09-12T00:03:34.385650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.352875+0000","last_change":"2024-09-12T00:03:23.623417+0000","last_active":"2024-09-12T00:03:34.352875+0000","last_peered":"2024-09-12T00:03:34.352875+0000","last_clean":"2024-09-12T00:03:34.352875+0000","last_became_active":"2024-09-12T00:03:23.620261+0000","last_became_peered":"2024-09-12T00:03:23.620261+0000","last_unstale":"2024-09-12T00:03:34.352875+0000","last_undegraded":"2024-09-12T00:03:34.352875+0000","last_fullsized":"2024-09-12T00:03:34.352875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.366966+0000","last_change":"2024-09-12T00:03:25.357492+0000","last_active":"2024-09-12T00:03:34.366966+0000","last_peered":"2024-09-12T00:03:34.366966+0000","last_clean":"2024-09-12T00:03:34.366966+0000","last_became_active":"2024-09-12T00:03:25.357186+0000","last_became_peered":"2024-09-12T00:03:25.357186+0000","last_unstale":"2024-09-12T00:03:34.366966+0000","last_undegraded":"2024-09-12T00:03:34.366966+0000","last_fullsized":"2024-09-12T00:03:34.366966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350738+0000","last_change":"2024-09-12T00:03:23.607247+0000","last_active":"2024-09-12T00:03:34.350738+0000","last_peered":"2024-09-12T00:03:34.350738+0000","last_clean":"2024-09-12T00:03:34.350738+0000","last_became_active":"2024-09-12T00:03:23.606625+0000","last_became_peered":"2024-09-12T00:03:23.606625+0000","last_unstale":"2024-09-12T00:03:34.350738+0000","last_undegraded":"2024-09-12T00:03:34.350738+0000","last_fullsized":"2024-09-12T00:03:34.350738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:04.927836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347567+0000","last_change":"2024-09-12T00:03:23.611398+0000","last_active":"2024-09-12T00:03:34.347567+0000","last_peered":"2024-09-12T00:03:34.347567+0000","last_clean":"2024-09-12T00:03:34.347567+0000","last_became_active":"2024-09-12T00:03:23.610918+0000","last_became_peered":"2024-09-12T00:03:23.610918+0000","last_unstale":"2024-09-12T00:03:34.347567+0000","last_undegraded":"2024-09-12T00:03:34.347567+0000","last_fullsized":"2024-09-12T00:03:34.347567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:28.688159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.387253+0000","last_change":"2024-09-12T00:03:25.350116+0000","last_active":"2024-09-12T00:03:34.387253+0000","last_peered":"2024-09-12T00:03:34.387253+0000","last_clean":"2024-09-12T00:03:34.387253+0000","last_became_active":"2024-09-12T00:03:25.349281+0000","last_became_peered":"2024-09-12T00:03:25.349281+0000","last_unstale":"2024-09-12T00:03:34.387253+0000","last_undegraded":"2024-09-12T00:03:34.387253+0000","last_fullsized":"2024-09-12T00:03:34.387253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:33.350458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.381360+0000","last_change":"2024-09-12T00:03:23.619574+0000","last_active":"2024-09-12T00:03:34.381360+0000","last_peered":"2024-09-12T00:03:34.381360+0000","last_clean":"2024-09-12T00:03:34.381360+0000","last_became_active":"2024-09-12T00:03:23.616154+0000","last_became_peered":"2024-09-12T00:03:23.616154+0000","last_unstale":"2024-09-12T00:03:34.381360+0000","last_undegraded":"2024-09-12T00:03:34.381360+0000","last_fullsized":"2024-09-12T00:03:34.381360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:46.335775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.368337+0000","last_change":"2024-09-12T00:03:25.345327+0000","last_active":"2024-09-12T00:03:34.368337+0000","last_peered":"2024-09-12T00:03:34.368337+0000","last_clean":"2024-09-12T00:03:34.368337+0000","last_became_active":"2024-09-12T00:03:25.344917+0000","last_became_peered":"2024-09-12T00:03:25.344917+0000","last_unstale":"2024-09-12T00:03:34.368337+0000","last_undegraded":"2024-09-12T00:03:34.368337+0000","last_fullsized":"2024-09-12T00:03:34.368337+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":210,"num_whiteouts":0,"num_read":976,"num_read_kb":703,"num_write":609,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":581,"ondisk_log_size":581,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":172486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":173970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1015808,"data_stored":763000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":425984,"data_stored":172678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":172367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":171972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1048576,"data_stored":764923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":446464,"data_stored":173144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:03:41.304 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:03:41.674 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:03:41.702 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T00:03:41.707 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-09-12T00:03:40.380947+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":228,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":0,"num_read":1046,"num_read_kb":762,"num_write":722,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":678,"ondisk_log_size":678,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229040,"kb_used_data":4496,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745680,"statfs":{"total":773094113280,"available":772859576320,"internally_reserved":0,"allocated":4603904,"data_stored":2564540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":218,"num_whiteouts":0,"num_read":976,"num_read_kb":703,"num_write":609,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002883"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.374239+0000","last_change":"2024-09-12T00:03:23.604218+0000","last_active":"2024-09-12T00:03:34.374239+0000","last_peered":"2024-09-12T00:03:34.374239+0000","last_clean":"2024-09-12T00:03:34.374239+0000","last_became_active":"2024-09-12T00:03:23.603902+0000","last_became_peered":"2024-09-12T00:03:23.603902+0000","last_unstale":"2024-09-12T00:03:34.374239+0000","last_undegraded":"2024-09-12T00:03:34.374239+0000","last_fullsized":"2024-09-12T00:03:34.374239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:35.848041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.366685+0000","last_change":"2024-09-12T00:03:25.337244+0000","last_active":"2024-09-12T00:03:34.366685+0000","last_peered":"2024-09-12T00:03:34.366685+0000","last_clean":"2024-09-12T00:03:34.366685+0000","last_became_active":"2024-09-12T00:03:25.335964+0000","last_became_peered":"2024-09-12T00:03:25.335964+0000","last_unstale":"2024-09-12T00:03:34.366685+0000","last_undegraded":"2024-09-12T00:03:34.366685+0000","last_fullsized":"2024-09-12T00:03:34.366685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.383330+0000","last_change":"2024-09-12T00:03:23.628328+0000","last_active":"2024-09-12T00:03:34.383330+0000","last_peered":"2024-09-12T00:03:34.383330+0000","last_clean":"2024-09-12T00:03:34.383330+0000","last_became_active":"2024-09-12T00:03:23.627630+0000","last_became_peered":"2024-09-12T00:03:23.627630+0000","last_unstale":"2024-09-12T00:03:34.383330+0000","last_undegraded":"2024-09-12T00:03:34.383330+0000","last_fullsized":"2024-09-12T00:03:34.383330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:00.573006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348171+0000","last_change":"2024-09-12T00:03:25.338343+0000","last_active":"2024-09-12T00:03:34.348171+0000","last_peered":"2024-09-12T00:03:34.348171+0000","last_clean":"2024-09-12T00:03:34.348171+0000","last_became_active":"2024-09-12T00:03:25.337994+0000","last_became_peered":"2024-09-12T00:03:25.337994+0000","last_unstale":"2024-09-12T00:03:34.348171+0000","last_undegraded":"2024-09-12T00:03:34.348171+0000","last_fullsized":"2024-09-12T00:03:34.348171+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:39.689763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382868+0000","last_change":"2024-09-12T00:03:23.626533+0000","last_active":"2024-09-12T00:03:34.382868+0000","last_peered":"2024-09-12T00:03:34.382868+0000","last_clean":"2024-09-12T00:03:34.382868+0000","last_became_active":"2024-09-12T00:03:23.625728+0000","last_became_peered":"2024-09-12T00:03:23.625728+0000","last_unstale":"2024-09-12T00:03:34.382868+0000","last_undegraded":"2024-09-12T00:03:34.382868+0000","last_fullsized":"2024-09-12T00:03:34.382868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:31.772442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348548+0000","last_change":"2024-09-12T00:03:25.336667+0000","last_active":"2024-09-12T00:03:34.348548+0000","last_peered":"2024-09-12T00:03:34.348548+0000","last_clean":"2024-09-12T00:03:34.348548+0000","last_became_active":"2024-09-12T00:03:25.336327+0000","last_became_peered":"2024-09-12T00:03:25.336327+0000","last_unstale":"2024-09-12T00:03:34.348548+0000","last_undegraded":"2024-09-12T00:03:34.348548+0000","last_fullsized":"2024-09-12T00:03:34.348548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:45.222842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.407965+0000","last_change":"2024-09-12T00:03:23.609828+0000","last_active":"2024-09-12T00:03:34.407965+0000","last_peered":"2024-09-12T00:03:34.407965+0000","last_clean":"2024-09-12T00:03:34.407965+0000","last_became_active":"2024-09-12T00:03:23.609326+0000","last_became_peered":"2024-09-12T00:03:23.609326+0000","last_unstale":"2024-09-12T00:03:34.407965+0000","last_undegraded":"2024-09-12T00:03:34.407965+0000","last_fullsized":"2024-09-12T00:03:34.407965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:25.491620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.386607+0000","last_change":"2024-09-12T00:03:25.339518+0000","last_active":"2024-09-12T00:03:34.386607+0000","last_peered":"2024-09-12T00:03:34.386607+0000","last_clean":"2024-09-12T00:03:34.386607+0000","last_became_active":"2024-09-12T00:03:25.338805+0000","last_became_peered":"2024-09-12T00:03:25.338805+0000","last_unstale":"2024-09-12T00:03:34.386607+0000","last_undegraded":"2024-09-12T00:03:34.386607+0000","last_fullsized":"2024-09-12T00:03:34.386607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.372895+0000","last_change":"2024-09-12T00:03:23.633978+0000","last_active":"2024-09-12T00:03:34.372895+0000","last_peered":"2024-09-12T00:03:34.372895+0000","last_clean":"2024-09-12T00:03:34.372895+0000","last_became_active":"2024-09-12T00:03:23.633580+0000","last_became_peered":"2024-09-12T00:03:23.633580+0000","last_unstale":"2024-09-12T00:03:34.372895+0000","last_undegraded":"2024-09-12T00:03:34.372895+0000","last_fullsized":"2024-09-12T00:03:34.372895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:01.872688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.372658+0000","last_change":"2024-09-12T00:03:25.324424+0000","last_active":"2024-09-12T00:03:34.372658+0000","last_peered":"2024-09-12T00:03:34.372658+0000","last_clean":"2024-09-12T00:03:34.372658+0000","last_became_active":"2024-09-12T00:03:25.324138+0000","last_became_peered":"2024-09-12T00:03:25.324138+0000","last_unstale":"2024-09-12T00:03:34.372658+0000","last_undegraded":"2024-09-12T00:03:34.372658+0000","last_fullsized":"2024-09-12T00:03:34.372658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:09.954252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.406353+0000","last_change":"2024-09-12T00:03:23.610136+0000","last_active":"2024-09-12T00:03:34.406353+0000","last_peered":"2024-09-12T00:03:34.406353+0000","last_clean":"2024-09-12T00:03:34.406353+0000","last_became_active":"2024-09-12T00:03:23.609509+0000","last_became_peered":"2024-09-12T00:03:23.609509+0000","last_unstale":"2024-09-12T00:03:34.406353+0000","last_undegraded":"2024-09-12T00:03:34.406353+0000","last_fullsized":"2024-09-12T00:03:34.406353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373120+0000","last_change":"2024-09-12T00:03:25.355256+0000","last_active":"2024-09-12T00:03:34.373120+0000","last_peered":"2024-09-12T00:03:34.373120+0000","last_clean":"2024-09-12T00:03:34.373120+0000","last_became_active":"2024-09-12T00:03:25.355002+0000","last_became_peered":"2024-09-12T00:03:25.355002+0000","last_unstale":"2024-09-12T00:03:34.373120+0000","last_undegraded":"2024-09-12T00:03:34.373120+0000","last_fullsized":"2024-09-12T00:03:34.373120+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:50.488869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.372791+0000","last_change":"2024-09-12T00:03:23.606780+0000","last_active":"2024-09-12T00:03:34.372791+0000","last_peered":"2024-09-12T00:03:34.372791+0000","last_clean":"2024-09-12T00:03:34.372791+0000","last_became_active":"2024-09-12T00:03:23.606143+0000","last_became_peered":"2024-09-12T00:03:23.606143+0000","last_unstale":"2024-09-12T00:03:34.372791+0000","last_undegraded":"2024-09-12T00:03:34.372791+0000","last_fullsized":"2024-09-12T00:03:34.372791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:22.889982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.408445+0000","last_change":"2024-09-12T00:03:25.330195+0000","last_active":"2024-09-12T00:03:34.408445+0000","last_peered":"2024-09-12T00:03:34.408445+0000","last_clean":"2024-09-12T00:03:34.408445+0000","last_became_active":"2024-09-12T00:03:25.329625+0000","last_became_peered":"2024-09-12T00:03:25.329625+0000","last_unstale":"2024-09-12T00:03:34.408445+0000","last_undegraded":"2024-09-12T00:03:34.408445+0000","last_fullsized":"2024-09-12T00:03:34.408445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.380771+0000","last_change":"2024-09-12T00:03:23.626723+0000","last_active":"2024-09-12T00:03:34.380771+0000","last_peered":"2024-09-12T00:03:34.380771+0000","last_clean":"2024-09-12T00:03:34.380771+0000","last_became_active":"2024-09-12T00:03:23.626018+0000","last_became_peered":"2024-09-12T00:03:23.626018+0000","last_unstale":"2024-09-12T00:03:34.380771+0000","last_undegraded":"2024-09-12T00:03:34.380771+0000","last_fullsized":"2024-09-12T00:03:34.380771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.383891+0000","last_change":"2024-09-12T00:03:25.352418+0000","last_active":"2024-09-12T00:03:34.383891+0000","last_peered":"2024-09-12T00:03:34.383891+0000","last_clean":"2024-09-12T00:03:34.383891+0000","last_became_active":"2024-09-12T00:03:25.347902+0000","last_became_peered":"2024-09-12T00:03:25.347902+0000","last_unstale":"2024-09-12T00:03:34.383891+0000","last_undegraded":"2024-09-12T00:03:34.383891+0000","last_fullsized":"2024-09-12T00:03:34.383891+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:29.611790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347314+0000","last_change":"2024-09-12T00:03:25.321057+0000","last_active":"2024-09-12T00:03:34.347314+0000","last_peered":"2024-09-12T00:03:34.347314+0000","last_clean":"2024-09-12T00:03:34.347314+0000","last_became_active":"2024-09-12T00:03:25.320611+0000","last_became_peered":"2024-09-12T00:03:25.320611+0000","last_unstale":"2024-09-12T00:03:34.347314+0000","last_undegraded":"2024-09-12T00:03:34.347314+0000","last_fullsized":"2024-09-12T00:03:34.347314+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:46.041829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.369131+0000","last_change":"2024-09-12T00:03:23.594170+0000","last_active":"2024-09-12T00:03:34.369131+0000","last_peered":"2024-09-12T00:03:34.369131+0000","last_clean":"2024-09-12T00:03:34.369131+0000","last_became_active":"2024-09-12T00:03:23.593880+0000","last_became_peered":"2024-09-12T00:03:23.593880+0000","last_unstale":"2024-09-12T00:03:34.369131+0000","last_undegraded":"2024-09-12T00:03:34.369131+0000","last_fullsized":"2024-09-12T00:03:34.369131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:33.234598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.372337+0000","last_change":"2024-09-12T00:03:25.334966+0000","last_active":"2024-09-12T00:03:34.372337+0000","last_peered":"2024-09-12T00:03:34.372337+0000","last_clean":"2024-09-12T00:03:34.372337+0000","last_became_active":"2024-09-12T00:03:25.334375+0000","last_became_peered":"2024-09-12T00:03:25.334375+0000","last_unstale":"2024-09-12T00:03:34.372337+0000","last_undegraded":"2024-09-12T00:03:34.372337+0000","last_fullsized":"2024-09-12T00:03:34.372337+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:52.828056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373941+0000","last_change":"2024-09-12T00:03:23.614289+0000","last_active":"2024-09-12T00:03:34.373941+0000","last_peered":"2024-09-12T00:03:34.373941+0000","last_clean":"2024-09-12T00:03:34.373941+0000","last_became_active":"2024-09-12T00:03:23.614019+0000","last_became_peered":"2024-09-12T00:03:23.614019+0000","last_unstale":"2024-09-12T00:03:34.373941+0000","last_undegraded":"2024-09-12T00:03:34.373941+0000","last_fullsized":"2024-09-12T00:03:34.373941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:00.847027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.367356+0000","last_change":"2024-09-12T00:03:25.357938+0000","last_active":"2024-09-12T00:03:34.367356+0000","last_peered":"2024-09-12T00:03:34.367356+0000","last_clean":"2024-09-12T00:03:34.367356+0000","last_became_active":"2024-09-12T00:03:25.357571+0000","last_became_peered":"2024-09-12T00:03:25.357571+0000","last_unstale":"2024-09-12T00:03:34.367356+0000","last_undegraded":"2024-09-12T00:03:34.367356+0000","last_fullsized":"2024-09-12T00:03:34.367356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:05.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373209+0000","last_change":"2024-09-12T00:03:23.604162+0000","last_active":"2024-09-12T00:03:34.373209+0000","last_peered":"2024-09-12T00:03:34.373209+0000","last_clean":"2024-09-12T00:03:34.373209+0000","last_became_active":"2024-09-12T00:03:23.603466+0000","last_became_peered":"2024-09-12T00:03:23.603466+0000","last_unstale":"2024-09-12T00:03:34.373209+0000","last_undegraded":"2024-09-12T00:03:34.373209+0000","last_fullsized":"2024-09-12T00:03:34.373209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:50.482404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350086+0000","last_change":"2024-09-12T00:03:25.345717+0000","last_active":"2024-09-12T00:03:34.350086+0000","last_peered":"2024-09-12T00:03:34.350086+0000","last_clean":"2024-09-12T00:03:34.350086+0000","last_became_active":"2024-09-12T00:03:25.344959+0000","last_became_peered":"2024-09-12T00:03:25.344959+0000","last_unstale":"2024-09-12T00:03:34.350086+0000","last_undegraded":"2024-09-12T00:03:34.350086+0000","last_fullsized":"2024-09-12T00:03:34.350086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373142+0000","last_change":"2024-09-12T00:03:23.602960+0000","last_active":"2024-09-12T00:03:34.373142+0000","last_peered":"2024-09-12T00:03:34.373142+0000","last_clean":"2024-09-12T00:03:34.373142+0000","last_became_active":"2024-09-12T00:03:23.602640+0000","last_became_peered":"2024-09-12T00:03:23.602640+0000","last_unstale":"2024-09-12T00:03:34.373142+0000","last_undegraded":"2024-09-12T00:03:34.373142+0000","last_fullsized":"2024-09-12T00:03:34.373142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382067+0000","last_change":"2024-09-12T00:03:25.339888+0000","last_active":"2024-09-12T00:03:34.382067+0000","last_peered":"2024-09-12T00:03:34.382067+0000","last_clean":"2024-09-12T00:03:34.382067+0000","last_became_active":"2024-09-12T00:03:25.339092+0000","last_became_peered":"2024-09-12T00:03:25.339092+0000","last_unstale":"2024-09-12T00:03:34.382067+0000","last_undegraded":"2024-09-12T00:03:34.382067+0000","last_fullsized":"2024-09-12T00:03:34.382067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:06.165291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350831+0000","last_change":"2024-09-12T00:03:23.604732+0000","last_active":"2024-09-12T00:03:34.350831+0000","last_peered":"2024-09-12T00:03:34.350831+0000","last_clean":"2024-09-12T00:03:34.350831+0000","last_became_active":"2024-09-12T00:03:23.603932+0000","last_became_peered":"2024-09-12T00:03:23.603932+0000","last_unstale":"2024-09-12T00:03:34.350831+0000","last_undegraded":"2024-09-12T00:03:34.350831+0000","last_fullsized":"2024-09-12T00:03:34.350831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:14.913580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.368083+0000","last_change":"2024-09-12T00:03:25.341332+0000","last_active":"2024-09-12T00:03:34.368083+0000","last_peered":"2024-09-12T00:03:34.368083+0000","last_clean":"2024-09-12T00:03:34.368083+0000","last_became_active":"2024-09-12T00:03:25.340828+0000","last_became_peered":"2024-09-12T00:03:25.340828+0000","last_unstale":"2024-09-12T00:03:34.368083+0000","last_undegraded":"2024-09-12T00:03:34.368083+0000","last_fullsized":"2024-09-12T00:03:34.368083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348991+0000","last_change":"2024-09-12T00:03:23.602687+0000","last_active":"2024-09-12T00:03:34.348991+0000","last_peered":"2024-09-12T00:03:34.348991+0000","last_clean":"2024-09-12T00:03:34.348991+0000","last_became_active":"2024-09-12T00:03:23.601892+0000","last_became_peered":"2024-09-12T00:03:23.601892+0000","last_unstale":"2024-09-12T00:03:34.348991+0000","last_undegraded":"2024-09-12T00:03:34.348991+0000","last_fullsized":"2024-09-12T00:03:34.348991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.371662+0000","last_change":"2024-09-12T00:03:33.354850+0000","last_active":"2024-09-12T00:03:34.371662+0000","last_peered":"2024-09-12T00:03:34.371662+0000","last_clean":"2024-09-12T00:03:34.371662+0000","last_became_active":"2024-09-12T00:03:33.351917+0000","last_became_peered":"2024-09-12T00:03:33.351917+0000","last_unstale":"2024-09-12T00:03:34.371662+0000","last_undegraded":"2024-09-12T00:03:34.371662+0000","last_fullsized":"2024-09-12T00:03:34.371662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:00.466863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349952+0000","last_change":"2024-09-12T00:03:25.323174+0000","last_active":"2024-09-12T00:03:34.349952+0000","last_peered":"2024-09-12T00:03:34.349952+0000","last_clean":"2024-09-12T00:03:34.349952+0000","last_became_active":"2024-09-12T00:03:25.322456+0000","last_became_peered":"2024-09-12T00:03:25.322456+0000","last_unstale":"2024-09-12T00:03:34.349952+0000","last_undegraded":"2024-09-12T00:03:34.349952+0000","last_fullsized":"2024-09-12T00:03:34.349952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347913+0000","last_change":"2024-09-12T00:03:23.606234+0000","last_active":"2024-09-12T00:03:34.347913+0000","last_peered":"2024-09-12T00:03:34.347913+0000","last_clean":"2024-09-12T00:03:34.347913+0000","last_became_active":"2024-09-12T00:03:23.605699+0000","last_became_peered":"2024-09-12T00:03:23.605699+0000","last_unstale":"2024-09-12T00:03:34.347913+0000","last_undegraded":"2024-09-12T00:03:34.347913+0000","last_fullsized":"2024-09-12T00:03:34.347913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:20.775704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350454+0000","last_change":"2024-09-12T00:03:27.341305+0000","last_active":"2024-09-12T00:03:34.350454+0000","last_peered":"2024-09-12T00:03:34.350454+0000","last_clean":"2024-09-12T00:03:34.350454+0000","last_became_active":"2024-09-12T00:03:27.338132+0000","last_became_peered":"2024-09-12T00:03:27.338132+0000","last_unstale":"2024-09-12T00:03:34.350454+0000","last_undegraded":"2024-09-12T00:03:34.350454+0000","last_fullsized":"2024-09-12T00:03:34.350454+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:11.884824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'21","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.780636+0000","last_change":"2024-09-12T00:03:29.347224+0000","last_active":"2024-09-12T00:03:34.780636+0000","last_peered":"2024-09-12T00:03:34.780636+0000","last_clean":"2024-09-12T00:03:34.780636+0000","last_became_active":"2024-09-12T00:03:29.346662+0000","last_became_peered":"2024-09-12T00:03:29.346662+0000","last_unstale":"2024-09-12T00:03:34.780636+0000","last_undegraded":"2024-09-12T00:03:34.780636+0000","last_fullsized":"2024-09-12T00:03:34.780636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:28.258932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.368441+0000","last_change":"2024-09-12T00:03:31.337219+0000","last_active":"2024-09-12T00:03:34.368441+0000","last_peered":"2024-09-12T00:03:34.368441+0000","last_clean":"2024-09-12T00:03:34.368441+0000","last_became_active":"2024-09-12T00:03:31.336317+0000","last_became_peered":"2024-09-12T00:03:31.336317+0000","last_unstale":"2024-09-12T00:03:34.368441+0000","last_undegraded":"2024-09-12T00:03:34.368441+0000","last_fullsized":"2024-09-12T00:03:34.368441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:50.954053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.366332+0000","last_change":"2024-09-12T00:03:33.376628+0000","last_active":"2024-09-12T00:03:34.366332+0000","last_peered":"2024-09-12T00:03:34.366332+0000","last_clean":"2024-09-12T00:03:34.366332+0000","last_became_active":"2024-09-12T00:03:33.375938+0000","last_became_peered":"2024-09-12T00:03:33.375938+0000","last_unstale":"2024-09-12T00:03:34.366332+0000","last_undegraded":"2024-09-12T00:03:34.366332+0000","last_fullsized":"2024-09-12T00:03:34.366332+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:31.105042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349839+0000","last_change":"2024-09-12T00:03:25.326911+0000","last_active":"2024-09-12T00:03:34.349839+0000","last_peered":"2024-09-12T00:03:34.349839+0000","last_clean":"2024-09-12T00:03:34.349839+0000","last_became_active":"2024-09-12T00:03:25.326255+0000","last_became_peered":"2024-09-12T00:03:25.326255+0000","last_unstale":"2024-09-12T00:03:34.349839+0000","last_undegraded":"2024-09-12T00:03:34.349839+0000","last_fullsized":"2024-09-12T00:03:34.349839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:15.491636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349275+0000","last_change":"2024-09-12T00:03:23.596266+0000","last_active":"2024-09-12T00:03:34.349275+0000","last_peered":"2024-09-12T00:03:34.349275+0000","last_clean":"2024-09-12T00:03:34.349275+0000","last_became_active":"2024-09-12T00:03:23.595480+0000","last_became_peered":"2024-09-12T00:03:23.595480+0000","last_unstale":"2024-09-12T00:03:34.349275+0000","last_undegraded":"2024-09-12T00:03:34.349275+0000","last_fullsized":"2024-09-12T00:03:34.349275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:25.491620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.385739+0000","last_change":"2024-09-12T00:03:27.336108+0000","last_active":"2024-09-12T00:03:34.385739+0000","last_peered":"2024-09-12T00:03:34.385739+0000","last_clean":"2024-09-12T00:03:34.385739+0000","last_became_active":"2024-09-12T00:03:27.335308+0000","last_became_peered":"2024-09-12T00:03:27.335308+0000","last_unstale":"2024-09-12T00:03:34.385739+0000","last_undegraded":"2024-09-12T00:03:34.385739+0000","last_fullsized":"2024-09-12T00:03:34.385739+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:39.812803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'12","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.158067+0000","last_change":"2024-09-12T00:03:29.352496+0000","last_active":"2024-09-12T00:03:35.158067+0000","last_peered":"2024-09-12T00:03:35.158067+0000","last_clean":"2024-09-12T00:03:35.158067+0000","last_became_active":"2024-09-12T00:03:29.351783+0000","last_became_peered":"2024-09-12T00:03:29.351783+0000","last_unstale":"2024-09-12T00:03:35.158067+0000","last_undegraded":"2024-09-12T00:03:35.158067+0000","last_fullsized":"2024-09-12T00:03:35.158067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.368037+0000","last_change":"2024-09-12T00:03:31.350279+0000","last_active":"2024-09-12T00:03:34.368037+0000","last_peered":"2024-09-12T00:03:34.368037+0000","last_clean":"2024-09-12T00:03:34.368037+0000","last_became_active":"2024-09-12T00:03:31.349244+0000","last_became_peered":"2024-09-12T00:03:31.349244+0000","last_unstale":"2024-09-12T00:03:34.368037+0000","last_undegraded":"2024-09-12T00:03:34.368037+0000","last_fullsized":"2024-09-12T00:03:34.368037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.420974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348210+0000","last_change":"2024-09-12T00:03:33.382726+0000","last_active":"2024-09-12T00:03:34.348210+0000","last_peered":"2024-09-12T00:03:34.348210+0000","last_clean":"2024-09-12T00:03:34.348210+0000","last_became_active":"2024-09-12T00:03:33.381875+0000","last_became_peered":"2024-09-12T00:03:33.381875+0000","last_unstale":"2024-09-12T00:03:34.348210+0000","last_undegraded":"2024-09-12T00:03:34.348210+0000","last_fullsized":"2024-09-12T00:03:34.348210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.383200+0000","last_change":"2024-09-12T00:03:25.357883+0000","last_active":"2024-09-12T00:03:34.383200+0000","last_peered":"2024-09-12T00:03:34.383200+0000","last_clean":"2024-09-12T00:03:34.383200+0000","last_became_active":"2024-09-12T00:03:25.355174+0000","last_became_peered":"2024-09-12T00:03:25.355174+0000","last_unstale":"2024-09-12T00:03:34.383200+0000","last_undegraded":"2024-09-12T00:03:34.383200+0000","last_fullsized":"2024-09-12T00:03:34.383200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:26.621650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348657+0000","last_change":"2024-09-12T00:03:23.617603+0000","last_active":"2024-09-12T00:03:34.348657+0000","last_peered":"2024-09-12T00:03:34.348657+0000","last_clean":"2024-09-12T00:03:34.348657+0000","last_became_active":"2024-09-12T00:03:23.617317+0000","last_became_peered":"2024-09-12T00:03:23.617317+0000","last_unstale":"2024-09-12T00:03:34.348657+0000","last_undegraded":"2024-09-12T00:03:34.348657+0000","last_fullsized":"2024-09-12T00:03:34.348657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:36.997566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.387068+0000","last_change":"2024-09-12T00:03:27.347098+0000","last_active":"2024-09-12T00:03:34.387068+0000","last_peered":"2024-09-12T00:03:34.387068+0000","last_clean":"2024-09-12T00:03:34.387068+0000","last_became_active":"2024-09-12T00:03:27.346346+0000","last_became_peered":"2024-09-12T00:03:27.346346+0000","last_unstale":"2024-09-12T00:03:34.387068+0000","last_undegraded":"2024-09-12T00:03:34.387068+0000","last_fullsized":"2024-09-12T00:03:34.387068+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:56.250627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'22","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.220659+0000","last_change":"2024-09-12T00:03:29.357080+0000","last_active":"2024-09-12T00:03:35.220659+0000","last_peered":"2024-09-12T00:03:35.220659+0000","last_clean":"2024-09-12T00:03:35.220659+0000","last_became_active":"2024-09-12T00:03:29.356262+0000","last_became_peered":"2024-09-12T00:03:29.356262+0000","last_unstale":"2024-09-12T00:03:35.220659+0000","last_undegraded":"2024-09-12T00:03:35.220659+0000","last_fullsized":"2024-09-12T00:03:35.220659+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:27.790240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"32'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350634+0000","last_change":"2024-09-12T00:03:31.362060+0000","last_active":"2024-09-12T00:03:34.350634+0000","last_peered":"2024-09-12T00:03:34.350634+0000","last_clean":"2024-09-12T00:03:34.350634+0000","last_became_active":"2024-09-12T00:03:31.361330+0000","last_became_peered":"2024-09-12T00:03:31.361330+0000","last_unstale":"2024-09-12T00:03:34.350634+0000","last_undegraded":"2024-09-12T00:03:34.350634+0000","last_fullsized":"2024-09-12T00:03:34.350634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:06.142584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.406389+0000","last_change":"2024-09-12T00:03:33.378439+0000","last_active":"2024-09-12T00:03:34.406389+0000","last_peered":"2024-09-12T00:03:34.406389+0000","last_clean":"2024-09-12T00:03:34.406389+0000","last_became_active":"2024-09-12T00:03:33.374453+0000","last_became_peered":"2024-09-12T00:03:33.374453+0000","last_unstale":"2024-09-12T00:03:34.406389+0000","last_undegraded":"2024-09-12T00:03:34.406389+0000","last_fullsized":"2024-09-12T00:03:34.406389+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.383561+0000","last_change":"2024-09-12T00:03:25.356433+0000","last_active":"2024-09-12T00:03:34.383561+0000","last_peered":"2024-09-12T00:03:34.383561+0000","last_clean":"2024-09-12T00:03:34.383561+0000","last_became_active":"2024-09-12T00:03:25.354803+0000","last_became_peered":"2024-09-12T00:03:25.354803+0000","last_unstale":"2024-09-12T00:03:34.383561+0000","last_undegraded":"2024-09-12T00:03:34.383561+0000","last_fullsized":"2024-09-12T00:03:34.383561+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:00.419686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.367398+0000","last_change":"2024-09-12T00:03:23.630527+0000","last_active":"2024-09-12T00:03:34.367398+0000","last_peered":"2024-09-12T00:03:34.367398+0000","last_clean":"2024-09-12T00:03:34.367398+0000","last_became_active":"2024-09-12T00:03:23.630183+0000","last_became_peered":"2024-09-12T00:03:23.630183+0000","last_unstale":"2024-09-12T00:03:34.367398+0000","last_undegraded":"2024-09-12T00:03:34.367398+0000","last_fullsized":"2024-09-12T00:03:34.367398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348714+0000","last_change":"2024-09-12T00:03:27.334188+0000","last_active":"2024-09-12T00:03:34.348714+0000","last_peered":"2024-09-12T00:03:34.348714+0000","last_clean":"2024-09-12T00:03:34.348714+0000","last_became_active":"2024-09-12T00:03:27.333395+0000","last_became_peered":"2024-09-12T00:03:27.333395+0000","last_unstale":"2024-09-12T00:03:34.348714+0000","last_undegraded":"2024-09-12T00:03:34.348714+0000","last_fullsized":"2024-09-12T00:03:34.348714+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:56.266608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'15","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.225844+0000","last_change":"2024-09-12T00:03:29.339735+0000","last_active":"2024-09-12T00:03:35.225844+0000","last_peered":"2024-09-12T00:03:35.225844+0000","last_clean":"2024-09-12T00:03:35.225844+0000","last_became_active":"2024-09-12T00:03:29.338810+0000","last_became_peered":"2024-09-12T00:03:29.338810+0000","last_unstale":"2024-09-12T00:03:35.225844+0000","last_undegraded":"2024-09-12T00:03:35.225844+0000","last_fullsized":"2024-09-12T00:03:35.225844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382458+0000","last_change":"2024-09-12T00:03:31.364647+0000","last_active":"2024-09-12T00:03:34.382458+0000","last_peered":"2024-09-12T00:03:34.382458+0000","last_clean":"2024-09-12T00:03:34.382458+0000","last_became_active":"2024-09-12T00:03:31.353547+0000","last_became_peered":"2024-09-12T00:03:31.353547+0000","last_unstale":"2024-09-12T00:03:34.382458+0000","last_undegraded":"2024-09-12T00:03:34.382458+0000","last_fullsized":"2024-09-12T00:03:34.382458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:20.795870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347328+0000","last_change":"2024-09-12T00:03:25.329615+0000","last_active":"2024-09-12T00:03:34.347328+0000","last_peered":"2024-09-12T00:03:34.347328+0000","last_clean":"2024-09-12T00:03:34.347328+0000","last_became_active":"2024-09-12T00:03:25.329015+0000","last_became_peered":"2024-09-12T00:03:25.329015+0000","last_unstale":"2024-09-12T00:03:34.347328+0000","last_undegraded":"2024-09-12T00:03:34.347328+0000","last_fullsized":"2024-09-12T00:03:34.347328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:00.170397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.374425+0000","last_change":"2024-09-12T00:03:23.602206+0000","last_active":"2024-09-12T00:03:34.374425+0000","last_peered":"2024-09-12T00:03:34.374425+0000","last_clean":"2024-09-12T00:03:34.374425+0000","last_became_active":"2024-09-12T00:03:23.601898+0000","last_became_peered":"2024-09-12T00:03:23.601898+0000","last_unstale":"2024-09-12T00:03:34.374425+0000","last_undegraded":"2024-09-12T00:03:34.374425+0000","last_fullsized":"2024-09-12T00:03:34.374425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:52.625795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.366812+0000","last_change":"2024-09-12T00:03:27.331111+0000","last_active":"2024-09-12T00:03:34.366812+0000","last_peered":"2024-09-12T00:03:34.366812+0000","last_clean":"2024-09-12T00:03:34.366812+0000","last_became_active":"2024-09-12T00:03:27.329672+0000","last_became_peered":"2024-09-12T00:03:27.329672+0000","last_unstale":"2024-09-12T00:03:34.366812+0000","last_undegraded":"2024-09-12T00:03:34.366812+0000","last_fullsized":"2024-09-12T00:03:34.366812+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'25","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.325784+0000","last_change":"2024-09-12T00:03:29.335931+0000","last_active":"2024-09-12T00:03:35.325784+0000","last_peered":"2024-09-12T00:03:35.325784+0000","last_clean":"2024-09-12T00:03:35.325784+0000","last_became_active":"2024-09-12T00:03:29.335044+0000","last_became_peered":"2024-09-12T00:03:29.335044+0000","last_unstale":"2024-09-12T00:03:35.325784+0000","last_undegraded":"2024-09-12T00:03:35.325784+0000","last_fullsized":"2024-09-12T00:03:35.325784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:57.131209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349488+0000","last_change":"2024-09-12T00:03:31.355001+0000","last_active":"2024-09-12T00:03:34.349488+0000","last_peered":"2024-09-12T00:03:34.349488+0000","last_clean":"2024-09-12T00:03:34.349488+0000","last_became_active":"2024-09-12T00:03:31.354160+0000","last_became_peered":"2024-09-12T00:03:31.354160+0000","last_unstale":"2024-09-12T00:03:34.349488+0000","last_undegraded":"2024-09-12T00:03:34.349488+0000","last_fullsized":"2024-09-12T00:03:34.349488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:29.868141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.407499+0000","last_change":"2024-09-12T00:03:33.387603+0000","last_active":"2024-09-12T00:03:34.407499+0000","last_peered":"2024-09-12T00:03:34.407499+0000","last_clean":"2024-09-12T00:03:34.407499+0000","last_became_active":"2024-09-12T00:03:33.386614+0000","last_became_peered":"2024-09-12T00:03:33.386614+0000","last_unstale":"2024-09-12T00:03:34.407499+0000","last_undegraded":"2024-09-12T00:03:34.407499+0000","last_fullsized":"2024-09-12T00:03:34.407499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:37.428182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.367097+0000","last_change":"2024-09-12T00:03:25.357300+0000","last_active":"2024-09-12T00:03:34.367097+0000","last_peered":"2024-09-12T00:03:34.367097+0000","last_clean":"2024-09-12T00:03:34.367097+0000","last_became_active":"2024-09-12T00:03:25.356970+0000","last_became_peered":"2024-09-12T00:03:25.356970+0000","last_unstale":"2024-09-12T00:03:34.367097+0000","last_undegraded":"2024-09-12T00:03:34.367097+0000","last_fullsized":"2024-09-12T00:03:34.367097+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:04.193738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.408336+0000","last_change":"2024-09-12T00:03:23.609700+0000","last_active":"2024-09-12T00:03:34.408336+0000","last_peered":"2024-09-12T00:03:34.408336+0000","last_clean":"2024-09-12T00:03:34.408336+0000","last_became_active":"2024-09-12T00:03:23.609435+0000","last_became_peered":"2024-09-12T00:03:23.609435+0000","last_unstale":"2024-09-12T00:03:34.408336+0000","last_undegraded":"2024-09-12T00:03:34.408336+0000","last_fullsized":"2024-09-12T00:03:34.408336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348251+0000","last_change":"2024-09-12T00:03:27.339670+0000","last_active":"2024-09-12T00:03:34.348251+0000","last_peered":"2024-09-12T00:03:34.348251+0000","last_clean":"2024-09-12T00:03:34.348251+0000","last_became_active":"2024-09-12T00:03:27.338880+0000","last_became_peered":"2024-09-12T00:03:27.338880+0000","last_unstale":"2024-09-12T00:03:34.348251+0000","last_undegraded":"2024-09-12T00:03:34.348251+0000","last_fullsized":"2024-09-12T00:03:34.348251+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:35.068652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"35'15","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.196702+0000","last_change":"2024-09-12T00:03:29.337666+0000","last_active":"2024-09-12T00:03:35.196702+0000","last_peered":"2024-09-12T00:03:35.196702+0000","last_clean":"2024-09-12T00:03:35.196702+0000","last_became_active":"2024-09-12T00:03:29.336957+0000","last_became_peered":"2024-09-12T00:03:29.336957+0000","last_unstale":"2024-09-12T00:03:35.196702+0000","last_undegraded":"2024-09-12T00:03:35.196702+0000","last_fullsized":"2024-09-12T00:03:35.196702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:58.417315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.384320+0000","last_change":"2024-09-12T00:03:31.348590+0000","last_active":"2024-09-12T00:03:34.384320+0000","last_peered":"2024-09-12T00:03:34.384320+0000","last_clean":"2024-09-12T00:03:34.384320+0000","last_became_active":"2024-09-12T00:03:31.347736+0000","last_became_peered":"2024-09-12T00:03:31.347736+0000","last_unstale":"2024-09-12T00:03:34.384320+0000","last_undegraded":"2024-09-12T00:03:34.384320+0000","last_fullsized":"2024-09-12T00:03:34.384320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:04.962492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.367142+0000","last_change":"2024-09-12T00:03:33.379699+0000","last_active":"2024-09-12T00:03:34.367142+0000","last_peered":"2024-09-12T00:03:34.367142+0000","last_clean":"2024-09-12T00:03:34.367142+0000","last_became_active":"2024-09-12T00:03:33.378945+0000","last_became_peered":"2024-09-12T00:03:33.378945+0000","last_unstale":"2024-09-12T00:03:34.367142+0000","last_undegraded":"2024-09-12T00:03:34.367142+0000","last_fullsized":"2024-09-12T00:03:34.367142+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:23.270488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.406080+0000","last_change":"2024-09-12T00:03:25.333941+0000","last_active":"2024-09-12T00:03:34.406080+0000","last_peered":"2024-09-12T00:03:34.406080+0000","last_clean":"2024-09-12T00:03:34.406080+0000","last_became_active":"2024-09-12T00:03:25.333559+0000","last_became_peered":"2024-09-12T00:03:25.333559+0000","last_unstale":"2024-09-12T00:03:34.406080+0000","last_undegraded":"2024-09-12T00:03:34.406080+0000","last_fullsized":"2024-09-12T00:03:34.406080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349199+0000","last_change":"2024-09-12T00:03:23.596202+0000","last_active":"2024-09-12T00:03:34.349199+0000","last_peered":"2024-09-12T00:03:34.349199+0000","last_clean":"2024-09-12T00:03:34.349199+0000","last_became_active":"2024-09-12T00:03:23.595859+0000","last_became_peered":"2024-09-12T00:03:23.595859+0000","last_unstale":"2024-09-12T00:03:34.349199+0000","last_undegraded":"2024-09-12T00:03:34.349199+0000","last_fullsized":"2024-09-12T00:03:34.349199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:12.001918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.381391+0000","last_change":"2024-09-12T00:03:27.348080+0000","last_active":"2024-09-12T00:03:34.381391+0000","last_peered":"2024-09-12T00:03:34.381391+0000","last_clean":"2024-09-12T00:03:34.381391+0000","last_became_active":"2024-09-12T00:03:27.347288+0000","last_became_peered":"2024-09-12T00:03:27.347288+0000","last_unstale":"2024-09-12T00:03:34.381391+0000","last_undegraded":"2024-09-12T00:03:34.381391+0000","last_fullsized":"2024-09-12T00:03:34.381391+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:37.033224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"35'27","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.105570+0000","last_change":"2024-09-12T00:03:29.349297+0000","last_active":"2024-09-12T00:03:35.105570+0000","last_peered":"2024-09-12T00:03:35.105570+0000","last_clean":"2024-09-12T00:03:35.105570+0000","last_became_active":"2024-09-12T00:03:29.348779+0000","last_became_peered":"2024-09-12T00:03:29.348779+0000","last_unstale":"2024-09-12T00:03:35.105570+0000","last_undegraded":"2024-09-12T00:03:35.105570+0000","last_fullsized":"2024-09-12T00:03:35.105570+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:40.759557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.380425+0000","last_change":"2024-09-12T00:03:31.354114+0000","last_active":"2024-09-12T00:03:34.380425+0000","last_peered":"2024-09-12T00:03:34.380425+0000","last_clean":"2024-09-12T00:03:34.380425+0000","last_became_active":"2024-09-12T00:03:31.353358+0000","last_became_peered":"2024-09-12T00:03:31.353358+0000","last_unstale":"2024-09-12T00:03:34.380425+0000","last_undegraded":"2024-09-12T00:03:34.380425+0000","last_fullsized":"2024-09-12T00:03:34.380425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:56.624718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350407+0000","last_change":"2024-09-12T00:03:33.383917+0000","last_active":"2024-09-12T00:03:34.350407+0000","last_peered":"2024-09-12T00:03:34.350407+0000","last_clean":"2024-09-12T00:03:34.350407+0000","last_became_active":"2024-09-12T00:03:33.383199+0000","last_became_peered":"2024-09-12T00:03:33.383199+0000","last_unstale":"2024-09-12T00:03:34.350407+0000","last_undegraded":"2024-09-12T00:03:34.350407+0000","last_fullsized":"2024-09-12T00:03:34.350407+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:37.428182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382144+0000","last_change":"2024-09-12T00:03:25.356706+0000","last_active":"2024-09-12T00:03:34.382144+0000","last_peered":"2024-09-12T00:03:34.382144+0000","last_clean":"2024-09-12T00:03:34.382144+0000","last_became_active":"2024-09-12T00:03:25.354555+0000","last_became_peered":"2024-09-12T00:03:25.354555+0000","last_unstale":"2024-09-12T00:03:34.382144+0000","last_undegraded":"2024-09-12T00:03:34.382144+0000","last_fullsized":"2024-09-12T00:03:34.382144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:55.543336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373772+0000","last_change":"2024-09-12T00:03:23.612430+0000","last_active":"2024-09-12T00:03:34.373772+0000","last_peered":"2024-09-12T00:03:34.373772+0000","last_clean":"2024-09-12T00:03:34.373772+0000","last_became_active":"2024-09-12T00:03:23.612165+0000","last_became_peered":"2024-09-12T00:03:23.612165+0000","last_unstale":"2024-09-12T00:03:34.373772+0000","last_undegraded":"2024-09-12T00:03:34.373772+0000","last_fullsized":"2024-09-12T00:03:34.373772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:31.444343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348671+0000","last_change":"2024-09-12T00:03:27.329228+0000","last_active":"2024-09-12T00:03:34.348671+0000","last_peered":"2024-09-12T00:03:34.348671+0000","last_clean":"2024-09-12T00:03:34.348671+0000","last_became_active":"2024-09-12T00:03:27.328497+0000","last_became_peered":"2024-09-12T00:03:27.328497+0000","last_unstale":"2024-09-12T00:03:34.348671+0000","last_undegraded":"2024-09-12T00:03:34.348671+0000","last_fullsized":"2024-09-12T00:03:34.348671+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"35'24","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.753584+0000","last_change":"2024-09-12T00:03:29.332778+0000","last_active":"2024-09-12T00:03:34.753584+0000","last_peered":"2024-09-12T00:03:34.753584+0000","last_clean":"2024-09-12T00:03:34.753584+0000","last_became_active":"2024-09-12T00:03:29.332010+0000","last_became_peered":"2024-09-12T00:03:29.332010+0000","last_unstale":"2024-09-12T00:03:34.753584+0000","last_undegraded":"2024-09-12T00:03:34.753584+0000","last_fullsized":"2024-09-12T00:03:34.753584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:13.563107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.381060+0000","last_change":"2024-09-12T00:03:31.354374+0000","last_active":"2024-09-12T00:03:34.381060+0000","last_peered":"2024-09-12T00:03:34.381060+0000","last_clean":"2024-09-12T00:03:34.381060+0000","last_became_active":"2024-09-12T00:03:31.353407+0000","last_became_peered":"2024-09-12T00:03:31.353407+0000","last_unstale":"2024-09-12T00:03:34.381060+0000","last_undegraded":"2024-09-12T00:03:34.381060+0000","last_fullsized":"2024-09-12T00:03:34.381060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:30.520217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.352163+0000","last_change":"2024-09-12T00:03:33.385373+0000","last_active":"2024-09-12T00:03:34.352163+0000","last_peered":"2024-09-12T00:03:34.352163+0000","last_clean":"2024-09-12T00:03:34.352163+0000","last_became_active":"2024-09-12T00:03:33.384559+0000","last_became_peered":"2024-09-12T00:03:33.384559+0000","last_unstale":"2024-09-12T00:03:34.352163+0000","last_undegraded":"2024-09-12T00:03:34.352163+0000","last_fullsized":"2024-09-12T00:03:34.352163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:55.924174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373201+0000","last_change":"2024-09-12T00:03:25.326677+0000","last_active":"2024-09-12T00:03:34.373201+0000","last_peered":"2024-09-12T00:03:34.373201+0000","last_clean":"2024-09-12T00:03:34.373201+0000","last_became_active":"2024-09-12T00:03:25.325840+0000","last_became_peered":"2024-09-12T00:03:25.325840+0000","last_unstale":"2024-09-12T00:03:34.373201+0000","last_undegraded":"2024-09-12T00:03:34.373201+0000","last_fullsized":"2024-09-12T00:03:34.373201+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:07.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.351369+0000","last_change":"2024-09-12T00:03:23.616943+0000","last_active":"2024-09-12T00:03:34.351369+0000","last_peered":"2024-09-12T00:03:34.351369+0000","last_clean":"2024-09-12T00:03:34.351369+0000","last_became_active":"2024-09-12T00:03:23.616200+0000","last_became_peered":"2024-09-12T00:03:23.616200+0000","last_unstale":"2024-09-12T00:03:34.351369+0000","last_undegraded":"2024-09-12T00:03:34.351369+0000","last_fullsized":"2024-09-12T00:03:34.351369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350659+0000","last_change":"2024-09-12T00:03:27.330506+0000","last_active":"2024-09-12T00:03:34.350659+0000","last_peered":"2024-09-12T00:03:34.350659+0000","last_clean":"2024-09-12T00:03:34.350659+0000","last_became_active":"2024-09-12T00:03:27.329830+0000","last_became_peered":"2024-09-12T00:03:27.329830+0000","last_unstale":"2024-09-12T00:03:34.350659+0000","last_undegraded":"2024-09-12T00:03:34.350659+0000","last_fullsized":"2024-09-12T00:03:34.350659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:03.446090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"35'17","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.260142+0000","last_change":"2024-09-12T00:03:29.343655+0000","last_active":"2024-09-12T00:03:35.260142+0000","last_peered":"2024-09-12T00:03:35.260142+0000","last_clean":"2024-09-12T00:03:35.260142+0000","last_became_active":"2024-09-12T00:03:29.343178+0000","last_became_peered":"2024-09-12T00:03:29.343178+0000","last_unstale":"2024-09-12T00:03:35.260142+0000","last_undegraded":"2024-09-12T00:03:35.260142+0000","last_fullsized":"2024-09-12T00:03:35.260142+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.351803+0000","last_change":"2024-09-12T00:03:31.358077+0000","last_active":"2024-09-12T00:03:34.351803+0000","last_peered":"2024-09-12T00:03:34.351803+0000","last_clean":"2024-09-12T00:03:34.351803+0000","last_became_active":"2024-09-12T00:03:31.357272+0000","last_became_peered":"2024-09-12T00:03:31.357272+0000","last_unstale":"2024-09-12T00:03:34.351803+0000","last_undegraded":"2024-09-12T00:03:34.351803+0000","last_fullsized":"2024-09-12T00:03:34.351803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:37.991682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.380144+0000","last_change":"2024-09-12T00:03:33.386299+0000","last_active":"2024-09-12T00:03:34.380144+0000","last_peered":"2024-09-12T00:03:34.380144+0000","last_clean":"2024-09-12T00:03:34.380144+0000","last_became_active":"2024-09-12T00:03:33.385357+0000","last_became_peered":"2024-09-12T00:03:33.385357+0000","last_unstale":"2024-09-12T00:03:34.380144+0000","last_undegraded":"2024-09-12T00:03:34.380144+0000","last_fullsized":"2024-09-12T00:03:34.380144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:17.028373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350223+0000","last_change":"2024-09-12T00:03:25.333772+0000","last_active":"2024-09-12T00:03:34.350223+0000","last_peered":"2024-09-12T00:03:34.350223+0000","last_clean":"2024-09-12T00:03:34.350223+0000","last_became_active":"2024-09-12T00:03:25.333338+0000","last_became_peered":"2024-09-12T00:03:25.333338+0000","last_unstale":"2024-09-12T00:03:34.350223+0000","last_undegraded":"2024-09-12T00:03:34.350223+0000","last_fullsized":"2024-09-12T00:03:34.350223+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:13.572959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349443+0000","last_change":"2024-09-12T00:03:23.598015+0000","last_active":"2024-09-12T00:03:34.349443+0000","last_peered":"2024-09-12T00:03:34.349443+0000","last_clean":"2024-09-12T00:03:34.349443+0000","last_became_active":"2024-09-12T00:03:23.594135+0000","last_became_peered":"2024-09-12T00:03:23.594135+0000","last_unstale":"2024-09-12T00:03:34.349443+0000","last_undegraded":"2024-09-12T00:03:34.349443+0000","last_fullsized":"2024-09-12T00:03:34.349443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:31.336675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.381820+0000","last_change":"2024-09-12T00:03:27.342295+0000","last_active":"2024-09-12T00:03:34.381820+0000","last_peered":"2024-09-12T00:03:34.381820+0000","last_clean":"2024-09-12T00:03:34.381820+0000","last_became_active":"2024-09-12T00:03:27.341619+0000","last_became_peered":"2024-09-12T00:03:27.341619+0000","last_unstale":"2024-09-12T00:03:34.381820+0000","last_undegraded":"2024-09-12T00:03:34.381820+0000","last_fullsized":"2024-09-12T00:03:34.381820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:00.908798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"35'15","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.335470+0000","last_change":"2024-09-12T00:03:29.336391+0000","last_active":"2024-09-12T00:03:35.335470+0000","last_peered":"2024-09-12T00:03:35.335470+0000","last_clean":"2024-09-12T00:03:35.335470+0000","last_became_active":"2024-09-12T00:03:29.335679+0000","last_became_peered":"2024-09-12T00:03:29.335679+0000","last_unstale":"2024-09-12T00:03:35.335470+0000","last_undegraded":"2024-09-12T00:03:35.335470+0000","last_fullsized":"2024-09-12T00:03:35.335470+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:58.540539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"32'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.352098+0000","last_change":"2024-09-12T00:03:31.351170+0000","last_active":"2024-09-12T00:03:34.352098+0000","last_peered":"2024-09-12T00:03:34.352098+0000","last_clean":"2024-09-12T00:03:34.352098+0000","last_became_active":"2024-09-12T00:03:31.350264+0000","last_became_peered":"2024-09-12T00:03:31.350264+0000","last_unstale":"2024-09-12T00:03:34.352098+0000","last_undegraded":"2024-09-12T00:03:34.352098+0000","last_fullsized":"2024-09-12T00:03:34.352098+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:51.368815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348701+0000","last_change":"2024-09-12T00:03:33.368236+0000","last_active":"2024-09-12T00:03:34.348701+0000","last_peered":"2024-09-12T00:03:34.348701+0000","last_clean":"2024-09-12T00:03:34.348701+0000","last_became_active":"2024-09-12T00:03:33.367424+0000","last_became_peered":"2024-09-12T00:03:33.367424+0000","last_unstale":"2024-09-12T00:03:34.348701+0000","last_undegraded":"2024-09-12T00:03:34.348701+0000","last_fullsized":"2024-09-12T00:03:34.348701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.407086+0000","last_change":"2024-09-12T00:03:25.330477+0000","last_active":"2024-09-12T00:03:34.407086+0000","last_peered":"2024-09-12T00:03:34.407086+0000","last_clean":"2024-09-12T00:03:34.407086+0000","last_became_active":"2024-09-12T00:03:25.330069+0000","last_became_peered":"2024-09-12T00:03:25.330069+0000","last_unstale":"2024-09-12T00:03:34.407086+0000","last_undegraded":"2024-09-12T00:03:34.407086+0000","last_fullsized":"2024-09-12T00:03:34.407086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348924+0000","last_change":"2024-09-12T00:03:23.604303+0000","last_active":"2024-09-12T00:03:34.348924+0000","last_peered":"2024-09-12T00:03:34.348924+0000","last_clean":"2024-09-12T00:03:34.348924+0000","last_became_active":"2024-09-12T00:03:23.603937+0000","last_became_peered":"2024-09-12T00:03:23.603937+0000","last_unstale":"2024-09-12T00:03:34.348924+0000","last_undegraded":"2024-09-12T00:03:34.348924+0000","last_fullsized":"2024-09-12T00:03:34.348924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:16.713949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.368917+0000","last_change":"2024-09-12T00:03:27.331569+0000","last_active":"2024-09-12T00:03:34.368917+0000","last_peered":"2024-09-12T00:03:34.368917+0000","last_clean":"2024-09-12T00:03:34.368917+0000","last_became_active":"2024-09-12T00:03:27.330909+0000","last_became_peered":"2024-09-12T00:03:27.330909+0000","last_unstale":"2024-09-12T00:03:34.368917+0000","last_undegraded":"2024-09-12T00:03:34.368917+0000","last_fullsized":"2024-09-12T00:03:34.368917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.115041+0000","last_change":"2024-09-12T00:03:29.338880+0000","last_active":"2024-09-12T00:03:35.115041+0000","last_peered":"2024-09-12T00:03:35.115041+0000","last_clean":"2024-09-12T00:03:35.115041+0000","last_became_active":"2024-09-12T00:03:29.338110+0000","last_became_peered":"2024-09-12T00:03:29.338110+0000","last_unstale":"2024-09-12T00:03:35.115041+0000","last_undegraded":"2024-09-12T00:03:35.115041+0000","last_fullsized":"2024-09-12T00:03:35.115041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.054460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"32'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.368009+0000","last_change":"2024-09-12T00:03:31.339117+0000","last_active":"2024-09-12T00:03:34.368009+0000","last_peered":"2024-09-12T00:03:34.368009+0000","last_clean":"2024-09-12T00:03:34.368009+0000","last_became_active":"2024-09-12T00:03:31.338426+0000","last_became_peered":"2024-09-12T00:03:31.338426+0000","last_unstale":"2024-09-12T00:03:34.368009+0000","last_undegraded":"2024-09-12T00:03:34.368009+0000","last_fullsized":"2024-09-12T00:03:34.368009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:19.304169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.405563+0000","last_change":"2024-09-12T00:03:33.385051+0000","last_active":"2024-09-12T00:03:34.405563+0000","last_peered":"2024-09-12T00:03:34.405563+0000","last_clean":"2024-09-12T00:03:34.405563+0000","last_became_active":"2024-09-12T00:03:33.380088+0000","last_became_peered":"2024-09-12T00:03:33.380088+0000","last_unstale":"2024-09-12T00:03:34.405563+0000","last_undegraded":"2024-09-12T00:03:34.405563+0000","last_fullsized":"2024-09-12T00:03:34.405563+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:02.972871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.352541+0000","last_change":"2024-09-12T00:03:25.336113+0000","last_active":"2024-09-12T00:03:34.352541+0000","last_peered":"2024-09-12T00:03:34.352541+0000","last_clean":"2024-09-12T00:03:34.352541+0000","last_became_active":"2024-09-12T00:03:25.335449+0000","last_became_peered":"2024-09-12T00:03:25.335449+0000","last_unstale":"2024-09-12T00:03:34.352541+0000","last_undegraded":"2024-09-12T00:03:34.352541+0000","last_fullsized":"2024-09-12T00:03:34.352541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:34.277614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.384970+0000","last_change":"2024-09-12T00:03:23.619285+0000","last_active":"2024-09-12T00:03:34.384970+0000","last_peered":"2024-09-12T00:03:34.384970+0000","last_clean":"2024-09-12T00:03:34.384970+0000","last_became_active":"2024-09-12T00:03:23.614187+0000","last_became_peered":"2024-09-12T00:03:23.614187+0000","last_unstale":"2024-09-12T00:03:34.384970+0000","last_undegraded":"2024-09-12T00:03:34.384970+0000","last_fullsized":"2024-09-12T00:03:34.384970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349256+0000","last_change":"2024-09-12T00:03:27.342832+0000","last_active":"2024-09-12T00:03:34.349256+0000","last_peered":"2024-09-12T00:03:34.349256+0000","last_clean":"2024-09-12T00:03:34.349256+0000","last_became_active":"2024-09-12T00:03:27.338764+0000","last_became_peered":"2024-09-12T00:03:27.338764+0000","last_unstale":"2024-09-12T00:03:34.349256+0000","last_undegraded":"2024-09-12T00:03:34.349256+0000","last_fullsized":"2024-09-12T00:03:34.349256+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:24.471349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'17","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.253456+0000","last_change":"2024-09-12T00:03:29.345719+0000","last_active":"2024-09-12T00:03:35.253456+0000","last_peered":"2024-09-12T00:03:35.253456+0000","last_clean":"2024-09-12T00:03:35.253456+0000","last_became_active":"2024-09-12T00:03:29.345243+0000","last_became_peered":"2024-09-12T00:03:29.345243+0000","last_unstale":"2024-09-12T00:03:35.253456+0000","last_undegraded":"2024-09-12T00:03:35.253456+0000","last_fullsized":"2024-09-12T00:03:35.253456+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:41.153263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.407748+0000","last_change":"2024-09-12T00:03:31.360630+0000","last_active":"2024-09-12T00:03:34.407748+0000","last_peered":"2024-09-12T00:03:34.407748+0000","last_clean":"2024-09-12T00:03:34.407748+0000","last_became_active":"2024-09-12T00:03:31.359763+0000","last_became_peered":"2024-09-12T00:03:31.359763+0000","last_unstale":"2024-09-12T00:03:34.407748+0000","last_undegraded":"2024-09-12T00:03:34.407748+0000","last_fullsized":"2024-09-12T00:03:34.407748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347913+0000","last_change":"2024-09-12T00:03:33.372178+0000","last_active":"2024-09-12T00:03:34.347913+0000","last_peered":"2024-09-12T00:03:34.347913+0000","last_clean":"2024-09-12T00:03:34.347913+0000","last_became_active":"2024-09-12T00:03:33.370562+0000","last_became_peered":"2024-09-12T00:03:33.370562+0000","last_unstale":"2024-09-12T00:03:34.347913+0000","last_undegraded":"2024-09-12T00:03:34.347913+0000","last_fullsized":"2024-09-12T00:03:34.347913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:31.888153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349493+0000","last_change":"2024-09-12T00:03:25.329229+0000","last_active":"2024-09-12T00:03:34.349493+0000","last_peered":"2024-09-12T00:03:34.349493+0000","last_clean":"2024-09-12T00:03:34.349493+0000","last_became_active":"2024-09-12T00:03:25.328934+0000","last_became_peered":"2024-09-12T00:03:25.328934+0000","last_unstale":"2024-09-12T00:03:34.349493+0000","last_undegraded":"2024-09-12T00:03:34.349493+0000","last_fullsized":"2024-09-12T00:03:34.349493+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:48.820585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":137,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.367738+0000","last_change":"2024-09-12T00:03:11.770141+0000","last_active":"2024-09-12T00:03:34.367738+0000","last_peered":"2024-09-12T00:03:34.367738+0000","last_clean":"2024-09-12T00:03:34.367738+0000","last_became_active":"2024-09-12T00:03:11.767988+0000","last_became_peered":"2024-09-12T00:03:11.767988+0000","last_unstale":"2024-09-12T00:03:34.367738+0000","last_undegraded":"2024-09-12T00:03:34.367738+0000","last_fullsized":"2024-09-12T00:03:34.367738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_clean_scrub_stamp":"2024-09-12T00:03:10.462069+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:26.289955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348045+0000","last_change":"2024-09-12T00:03:18.567644+0000","last_active":"2024-09-12T00:03:34.348045+0000","last_peered":"2024-09-12T00:03:34.348045+0000","last_clean":"2024-09-12T00:03:34.348045+0000","last_became_active":"2024-09-12T00:03:16.592765+0000","last_became_peered":"2024-09-12T00:03:16.592765+0000","last_unstale":"2024-09-12T00:03:34.348045+0000","last_undegraded":"2024-09-12T00:03:34.348045+0000","last_fullsized":"2024-09-12T00:03:34.348045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:06.283894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001924708,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.385483+0000","last_change":"2024-09-12T00:03:23.621849+0000","last_active":"2024-09-12T00:03:34.385483+0000","last_peered":"2024-09-12T00:03:34.385483+0000","last_clean":"2024-09-12T00:03:34.385483+0000","last_became_active":"2024-09-12T00:03:23.621146+0000","last_became_peered":"2024-09-12T00:03:23.621146+0000","last_unstale":"2024-09-12T00:03:34.385483+0000","last_undegraded":"2024-09-12T00:03:34.385483+0000","last_fullsized":"2024-09-12T00:03:34.385483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:38.426691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.372344+0000","last_change":"2024-09-12T00:03:27.316175+0000","last_active":"2024-09-12T00:03:34.372344+0000","last_peered":"2024-09-12T00:03:34.372344+0000","last_clean":"2024-09-12T00:03:34.372344+0000","last_became_active":"2024-09-12T00:03:27.315502+0000","last_became_peered":"2024-09-12T00:03:27.315502+0000","last_unstale":"2024-09-12T00:03:34.372344+0000","last_undegraded":"2024-09-12T00:03:34.372344+0000","last_fullsized":"2024-09-12T00:03:34.372344+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:21.448686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"35'19","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.042577+0000","last_change":"2024-09-12T00:03:29.348743+0000","last_active":"2024-09-12T00:03:35.042577+0000","last_peered":"2024-09-12T00:03:35.042577+0000","last_clean":"2024-09-12T00:03:35.042577+0000","last_became_active":"2024-09-12T00:03:29.348073+0000","last_became_peered":"2024-09-12T00:03:29.348073+0000","last_unstale":"2024-09-12T00:03:35.042577+0000","last_undegraded":"2024-09-12T00:03:35.042577+0000","last_fullsized":"2024-09-12T00:03:35.042577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:27.315678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382886+0000","last_change":"2024-09-12T00:03:31.361408+0000","last_active":"2024-09-12T00:03:34.382886+0000","last_peered":"2024-09-12T00:03:34.382886+0000","last_clean":"2024-09-12T00:03:34.382886+0000","last_became_active":"2024-09-12T00:03:31.360462+0000","last_became_peered":"2024-09-12T00:03:31.360462+0000","last_unstale":"2024-09-12T00:03:34.382886+0000","last_undegraded":"2024-09-12T00:03:34.382886+0000","last_fullsized":"2024-09-12T00:03:34.382886+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:58.407571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.372331+0000","last_change":"2024-09-12T00:03:33.388253+0000","last_active":"2024-09-12T00:03:34.372331+0000","last_peered":"2024-09-12T00:03:34.372331+0000","last_clean":"2024-09-12T00:03:34.372331+0000","last_became_active":"2024-09-12T00:03:33.387457+0000","last_became_peered":"2024-09-12T00:03:33.387457+0000","last_unstale":"2024-09-12T00:03:34.372331+0000","last_undegraded":"2024-09-12T00:03:34.372331+0000","last_fullsized":"2024-09-12T00:03:34.372331+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:46.021740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.383316+0000","last_change":"2024-09-12T00:03:25.357970+0000","last_active":"2024-09-12T00:03:34.383316+0000","last_peered":"2024-09-12T00:03:34.383316+0000","last_clean":"2024-09-12T00:03:34.383316+0000","last_became_active":"2024-09-12T00:03:25.355306+0000","last_became_peered":"2024-09-12T00:03:25.355306+0000","last_unstale":"2024-09-12T00:03:34.383316+0000","last_undegraded":"2024-09-12T00:03:34.383316+0000","last_fullsized":"2024-09-12T00:03:34.383316+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:17.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347822+0000","last_change":"2024-09-12T00:03:18.567433+0000","last_active":"2024-09-12T00:03:34.347822+0000","last_peered":"2024-09-12T00:03:34.347822+0000","last_clean":"2024-09-12T00:03:34.347822+0000","last_became_active":"2024-09-12T00:03:16.557489+0000","last_became_peered":"2024-09-12T00:03:16.557489+0000","last_unstale":"2024-09-12T00:03:34.347822+0000","last_undegraded":"2024-09-12T00:03:34.347822+0000","last_fullsized":"2024-09-12T00:03:34.347822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:26.187640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001769713,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349231+0000","last_change":"2024-09-12T00:03:23.622111+0000","last_active":"2024-09-12T00:03:34.349231+0000","last_peered":"2024-09-12T00:03:34.349231+0000","last_clean":"2024-09-12T00:03:34.349231+0000","last_became_active":"2024-09-12T00:03:23.621358+0000","last_became_peered":"2024-09-12T00:03:23.621358+0000","last_unstale":"2024-09-12T00:03:34.349231+0000","last_undegraded":"2024-09-12T00:03:34.349231+0000","last_fullsized":"2024-09-12T00:03:34.349231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:02.202230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348610+0000","last_change":"2024-09-12T00:03:27.338241+0000","last_active":"2024-09-12T00:03:34.348610+0000","last_peered":"2024-09-12T00:03:34.348610+0000","last_clean":"2024-09-12T00:03:34.348610+0000","last_became_active":"2024-09-12T00:03:27.337391+0000","last_became_peered":"2024-09-12T00:03:27.337391+0000","last_unstale":"2024-09-12T00:03:34.348610+0000","last_undegraded":"2024-09-12T00:03:34.348610+0000","last_fullsized":"2024-09-12T00:03:34.348610+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:00.949475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'29","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.244342+0000","last_change":"2024-09-12T00:03:29.346819+0000","last_active":"2024-09-12T00:03:35.244342+0000","last_peered":"2024-09-12T00:03:35.244342+0000","last_clean":"2024-09-12T00:03:35.244342+0000","last_became_active":"2024-09-12T00:03:29.346101+0000","last_became_peered":"2024-09-12T00:03:29.346101+0000","last_unstale":"2024-09-12T00:03:35.244342+0000","last_undegraded":"2024-09-12T00:03:35.244342+0000","last_fullsized":"2024-09-12T00:03:35.244342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:27.268327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350143+0000","last_change":"2024-09-12T00:03:31.361817+0000","last_active":"2024-09-12T00:03:34.350143+0000","last_peered":"2024-09-12T00:03:34.350143+0000","last_clean":"2024-09-12T00:03:34.350143+0000","last_became_active":"2024-09-12T00:03:31.361309+0000","last_became_peered":"2024-09-12T00:03:31.361309+0000","last_unstale":"2024-09-12T00:03:34.350143+0000","last_undegraded":"2024-09-12T00:03:34.350143+0000","last_fullsized":"2024-09-12T00:03:34.350143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:19.554189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.380816+0000","last_change":"2024-09-12T00:03:33.386144+0000","last_active":"2024-09-12T00:03:34.380816+0000","last_peered":"2024-09-12T00:03:34.380816+0000","last_clean":"2024-09-12T00:03:34.380816+0000","last_became_active":"2024-09-12T00:03:33.384951+0000","last_became_peered":"2024-09-12T00:03:33.384951+0000","last_unstale":"2024-09-12T00:03:34.380816+0000","last_undegraded":"2024-09-12T00:03:34.380816+0000","last_fullsized":"2024-09-12T00:03:34.380816+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:49.807501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350968+0000","last_change":"2024-09-12T00:03:25.332801+0000","last_active":"2024-09-12T00:03:34.350968+0000","last_peered":"2024-09-12T00:03:34.350968+0000","last_clean":"2024-09-12T00:03:34.350968+0000","last_became_active":"2024-09-12T00:03:25.331652+0000","last_became_peered":"2024-09-12T00:03:25.331652+0000","last_unstale":"2024-09-12T00:03:34.350968+0000","last_undegraded":"2024-09-12T00:03:34.350968+0000","last_fullsized":"2024-09-12T00:03:34.350968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347971+0000","last_change":"2024-09-12T00:03:18.892423+0000","last_active":"2024-09-12T00:03:34.347971+0000","last_peered":"2024-09-12T00:03:34.347971+0000","last_clean":"2024-09-12T00:03:34.347971+0000","last_became_active":"2024-09-12T00:03:16.559698+0000","last_became_peered":"2024-09-12T00:03:16.559698+0000","last_unstale":"2024-09-12T00:03:34.347971+0000","last_undegraded":"2024-09-12T00:03:34.347971+0000","last_fullsized":"2024-09-12T00:03:34.347971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:21.453461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082440599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.380778+0000","last_change":"2024-09-12T00:03:23.633606+0000","last_active":"2024-09-12T00:03:34.380778+0000","last_peered":"2024-09-12T00:03:34.380778+0000","last_clean":"2024-09-12T00:03:34.380778+0000","last_became_active":"2024-09-12T00:03:23.632795+0000","last_became_peered":"2024-09-12T00:03:23.632795+0000","last_unstale":"2024-09-12T00:03:34.380778+0000","last_undegraded":"2024-09-12T00:03:34.380778+0000","last_fullsized":"2024-09-12T00:03:34.380778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:08.214455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.352370+0000","last_change":"2024-09-12T00:03:27.326932+0000","last_active":"2024-09-12T00:03:34.352370+0000","last_peered":"2024-09-12T00:03:34.352370+0000","last_clean":"2024-09-12T00:03:34.352370+0000","last_became_active":"2024-09-12T00:03:27.326173+0000","last_became_peered":"2024-09-12T00:03:27.326173+0000","last_unstale":"2024-09-12T00:03:34.352370+0000","last_undegraded":"2024-09-12T00:03:34.352370+0000","last_fullsized":"2024-09-12T00:03:34.352370+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:12.286539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.249390+0000","last_change":"2024-09-12T00:03:29.338829+0000","last_active":"2024-09-12T00:03:35.249390+0000","last_peered":"2024-09-12T00:03:35.249390+0000","last_clean":"2024-09-12T00:03:35.249390+0000","last_became_active":"2024-09-12T00:03:29.337364+0000","last_became_peered":"2024-09-12T00:03:29.337364+0000","last_unstale":"2024-09-12T00:03:35.249390+0000","last_undegraded":"2024-09-12T00:03:35.249390+0000","last_fullsized":"2024-09-12T00:03:35.249390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:01.584359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.386409+0000","last_change":"2024-09-12T00:03:31.346734+0000","last_active":"2024-09-12T00:03:34.386409+0000","last_peered":"2024-09-12T00:03:34.386409+0000","last_clean":"2024-09-12T00:03:34.386409+0000","last_became_active":"2024-09-12T00:03:31.346035+0000","last_became_peered":"2024-09-12T00:03:31.346035+0000","last_unstale":"2024-09-12T00:03:34.386409+0000","last_undegraded":"2024-09-12T00:03:34.386409+0000","last_fullsized":"2024-09-12T00:03:34.386409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:10.417936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.385592+0000","last_change":"2024-09-12T00:03:33.354171+0000","last_active":"2024-09-12T00:03:34.385592+0000","last_peered":"2024-09-12T00:03:34.385592+0000","last_clean":"2024-09-12T00:03:34.385592+0000","last_became_active":"2024-09-12T00:03:33.353460+0000","last_became_peered":"2024-09-12T00:03:33.353460+0000","last_unstale":"2024-09-12T00:03:34.385592+0000","last_undegraded":"2024-09-12T00:03:34.385592+0000","last_fullsized":"2024-09-12T00:03:34.385592+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:34.356970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350045+0000","last_change":"2024-09-12T00:03:25.336320+0000","last_active":"2024-09-12T00:03:34.350045+0000","last_peered":"2024-09-12T00:03:34.350045+0000","last_clean":"2024-09-12T00:03:34.350045+0000","last_became_active":"2024-09-12T00:03:25.333449+0000","last_became_peered":"2024-09-12T00:03:25.333449+0000","last_unstale":"2024-09-12T00:03:34.350045+0000","last_undegraded":"2024-09-12T00:03:34.350045+0000","last_fullsized":"2024-09-12T00:03:34.350045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350118+0000","last_change":"2024-09-12T00:03:18.568246+0000","last_active":"2024-09-12T00:03:34.350118+0000","last_peered":"2024-09-12T00:03:34.350118+0000","last_clean":"2024-09-12T00:03:34.350118+0000","last_became_active":"2024-09-12T00:03:16.554663+0000","last_became_peered":"2024-09-12T00:03:16.554663+0000","last_unstale":"2024-09-12T00:03:34.350118+0000","last_undegraded":"2024-09-12T00:03:34.350118+0000","last_fullsized":"2024-09-12T00:03:34.350118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:52.802404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025471840000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.372971+0000","last_change":"2024-09-12T00:03:23.611064+0000","last_active":"2024-09-12T00:03:34.372971+0000","last_peered":"2024-09-12T00:03:34.372971+0000","last_clean":"2024-09-12T00:03:34.372971+0000","last_became_active":"2024-09-12T00:03:23.610612+0000","last_became_peered":"2024-09-12T00:03:23.610612+0000","last_unstale":"2024-09-12T00:03:34.372971+0000","last_undegraded":"2024-09-12T00:03:34.372971+0000","last_fullsized":"2024-09-12T00:03:34.372971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:04.201688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350703+0000","last_change":"2024-09-12T00:03:27.339197+0000","last_active":"2024-09-12T00:03:34.350703+0000","last_peered":"2024-09-12T00:03:34.350703+0000","last_clean":"2024-09-12T00:03:34.350703+0000","last_became_active":"2024-09-12T00:03:27.338508+0000","last_became_peered":"2024-09-12T00:03:27.338508+0000","last_unstale":"2024-09-12T00:03:34.350703+0000","last_undegraded":"2024-09-12T00:03:34.350703+0000","last_fullsized":"2024-09-12T00:03:34.350703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:08.306289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.079864+0000","last_change":"2024-09-12T00:03:29.358418+0000","last_active":"2024-09-12T00:03:35.079864+0000","last_peered":"2024-09-12T00:03:35.079864+0000","last_clean":"2024-09-12T00:03:35.079864+0000","last_became_active":"2024-09-12T00:03:29.357949+0000","last_became_peered":"2024-09-12T00:03:29.357949+0000","last_unstale":"2024-09-12T00:03:35.079864+0000","last_undegraded":"2024-09-12T00:03:35.079864+0000","last_fullsized":"2024-09-12T00:03:35.079864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:53.457363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350615+0000","last_change":"2024-09-12T00:03:31.352559+0000","last_active":"2024-09-12T00:03:34.350615+0000","last_peered":"2024-09-12T00:03:34.350615+0000","last_clean":"2024-09-12T00:03:34.350615+0000","last_became_active":"2024-09-12T00:03:31.351663+0000","last_became_peered":"2024-09-12T00:03:31.351663+0000","last_unstale":"2024-09-12T00:03:34.350615+0000","last_undegraded":"2024-09-12T00:03:34.350615+0000","last_fullsized":"2024-09-12T00:03:34.350615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:03.662016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.365986+0000","last_change":"2024-09-12T00:03:33.367035+0000","last_active":"2024-09-12T00:03:34.365986+0000","last_peered":"2024-09-12T00:03:34.365986+0000","last_clean":"2024-09-12T00:03:34.365986+0000","last_became_active":"2024-09-12T00:03:33.366311+0000","last_became_peered":"2024-09-12T00:03:33.366311+0000","last_unstale":"2024-09-12T00:03:34.365986+0000","last_undegraded":"2024-09-12T00:03:34.365986+0000","last_fullsized":"2024-09-12T00:03:34.365986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348757+0000","last_change":"2024-09-12T00:03:25.322258+0000","last_active":"2024-09-12T00:03:34.348757+0000","last_peered":"2024-09-12T00:03:34.348757+0000","last_clean":"2024-09-12T00:03:34.348757+0000","last_became_active":"2024-09-12T00:03:25.320903+0000","last_became_peered":"2024-09-12T00:03:25.320903+0000","last_unstale":"2024-09-12T00:03:34.348757+0000","last_undegraded":"2024-09-12T00:03:34.348757+0000","last_fullsized":"2024-09-12T00:03:34.348757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:05.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.407659+0000","last_change":"2024-09-12T00:03:23.619024+0000","last_active":"2024-09-12T00:03:34.407659+0000","last_peered":"2024-09-12T00:03:34.407659+0000","last_clean":"2024-09-12T00:03:34.407659+0000","last_became_active":"2024-09-12T00:03:23.618716+0000","last_became_peered":"2024-09-12T00:03:23.618716+0000","last_unstale":"2024-09-12T00:03:34.407659+0000","last_undegraded":"2024-09-12T00:03:34.407659+0000","last_fullsized":"2024-09-12T00:03:34.407659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382639+0000","last_change":"2024-09-12T00:03:18.562010+0000","last_active":"2024-09-12T00:03:34.382639+0000","last_peered":"2024-09-12T00:03:34.382639+0000","last_clean":"2024-09-12T00:03:34.382639+0000","last_became_active":"2024-09-12T00:03:16.561218+0000","last_became_peered":"2024-09-12T00:03:16.561218+0000","last_unstale":"2024-09-12T00:03:34.382639+0000","last_undegraded":"2024-09-12T00:03:34.382639+0000","last_fullsized":"2024-09-12T00:03:34.382639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:43.089686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084170299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.386045+0000","last_change":"2024-09-12T00:03:27.341079+0000","last_active":"2024-09-12T00:03:34.386045+0000","last_peered":"2024-09-12T00:03:34.386045+0000","last_clean":"2024-09-12T00:03:34.386045+0000","last_became_active":"2024-09-12T00:03:27.340391+0000","last_became_peered":"2024-09-12T00:03:27.340391+0000","last_unstale":"2024-09-12T00:03:34.386045+0000","last_undegraded":"2024-09-12T00:03:34.386045+0000","last_fullsized":"2024-09-12T00:03:34.386045+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:10.048469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"35'30","reported_seq":77,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.174422+0000","last_change":"2024-09-12T00:03:29.346823+0000","last_active":"2024-09-12T00:03:35.174422+0000","last_peered":"2024-09-12T00:03:35.174422+0000","last_clean":"2024-09-12T00:03:35.174422+0000","last_became_active":"2024-09-12T00:03:29.346066+0000","last_became_peered":"2024-09-12T00:03:29.346066+0000","last_unstale":"2024-09-12T00:03:35.174422+0000","last_undegraded":"2024-09-12T00:03:35.174422+0000","last_fullsized":"2024-09-12T00:03:35.174422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:12.080794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.405435+0000","last_change":"2024-09-12T00:03:31.348574+0000","last_active":"2024-09-12T00:03:34.405435+0000","last_peered":"2024-09-12T00:03:34.405435+0000","last_clean":"2024-09-12T00:03:34.405435+0000","last_became_active":"2024-09-12T00:03:31.346511+0000","last_became_peered":"2024-09-12T00:03:31.346511+0000","last_unstale":"2024-09-12T00:03:34.405435+0000","last_undegraded":"2024-09-12T00:03:34.405435+0000","last_fullsized":"2024-09-12T00:03:34.405435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:14.061486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382914+0000","last_change":"2024-09-12T00:03:33.385232+0000","last_active":"2024-09-12T00:03:34.382914+0000","last_peered":"2024-09-12T00:03:34.382914+0000","last_clean":"2024-09-12T00:03:34.382914+0000","last_became_active":"2024-09-12T00:03:33.384457+0000","last_became_peered":"2024-09-12T00:03:33.384457+0000","last_unstale":"2024-09-12T00:03:34.382914+0000","last_undegraded":"2024-09-12T00:03:34.382914+0000","last_fullsized":"2024-09-12T00:03:34.382914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:34.615256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350334+0000","last_change":"2024-09-12T00:03:25.334767+0000","last_active":"2024-09-12T00:03:34.350334+0000","last_peered":"2024-09-12T00:03:34.350334+0000","last_clean":"2024-09-12T00:03:34.350334+0000","last_became_active":"2024-09-12T00:03:25.332814+0000","last_became_peered":"2024-09-12T00:03:25.332814+0000","last_unstale":"2024-09-12T00:03:34.350334+0000","last_undegraded":"2024-09-12T00:03:34.350334+0000","last_fullsized":"2024-09-12T00:03:34.350334+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350290+0000","last_change":"2024-09-12T00:03:23.628752+0000","last_active":"2024-09-12T00:03:34.350290+0000","last_peered":"2024-09-12T00:03:34.350290+0000","last_clean":"2024-09-12T00:03:34.350290+0000","last_became_active":"2024-09-12T00:03:23.628128+0000","last_became_peered":"2024-09-12T00:03:23.628128+0000","last_unstale":"2024-09-12T00:03:34.350290+0000","last_undegraded":"2024-09-12T00:03:34.350290+0000","last_fullsized":"2024-09-12T00:03:34.350290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348438+0000","last_change":"2024-09-12T00:03:18.566691+0000","last_active":"2024-09-12T00:03:34.348438+0000","last_peered":"2024-09-12T00:03:34.348438+0000","last_clean":"2024-09-12T00:03:34.348438+0000","last_became_active":"2024-09-12T00:03:16.553662+0000","last_became_peered":"2024-09-12T00:03:16.553662+0000","last_unstale":"2024-09-12T00:03:34.348438+0000","last_undegraded":"2024-09-12T00:03:34.348438+0000","last_fullsized":"2024-09-12T00:03:34.348438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:14.502459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011030910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.372024+0000","last_change":"2024-09-12T00:03:27.316317+0000","last_active":"2024-09-12T00:03:34.372024+0000","last_peered":"2024-09-12T00:03:34.372024+0000","last_clean":"2024-09-12T00:03:34.372024+0000","last_became_active":"2024-09-12T00:03:27.315704+0000","last_became_peered":"2024-09-12T00:03:27.315704+0000","last_unstale":"2024-09-12T00:03:34.372024+0000","last_undegraded":"2024-09-12T00:03:34.372024+0000","last_fullsized":"2024-09-12T00:03:34.372024+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:07.883485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'20","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.275368+0000","last_change":"2024-09-12T00:03:29.357640+0000","last_active":"2024-09-12T00:03:35.275368+0000","last_peered":"2024-09-12T00:03:35.275368+0000","last_clean":"2024-09-12T00:03:35.275368+0000","last_became_active":"2024-09-12T00:03:29.356183+0000","last_became_peered":"2024-09-12T00:03:29.356183+0000","last_unstale":"2024-09-12T00:03:35.275368+0000","last_undegraded":"2024-09-12T00:03:35.275368+0000","last_fullsized":"2024-09-12T00:03:35.275368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:41.818794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"32'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.366123+0000","last_change":"2024-09-12T00:03:31.357011+0000","last_active":"2024-09-12T00:03:34.366123+0000","last_peered":"2024-09-12T00:03:34.366123+0000","last_clean":"2024-09-12T00:03:34.366123+0000","last_became_active":"2024-09-12T00:03:31.356108+0000","last_became_peered":"2024-09-12T00:03:31.356108+0000","last_unstale":"2024-09-12T00:03:34.366123+0000","last_undegraded":"2024-09-12T00:03:34.366123+0000","last_fullsized":"2024-09-12T00:03:34.366123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.351646+0000","last_change":"2024-09-12T00:03:33.372465+0000","last_active":"2024-09-12T00:03:34.351646+0000","last_peered":"2024-09-12T00:03:34.351646+0000","last_clean":"2024-09-12T00:03:34.351646+0000","last_became_active":"2024-09-12T00:03:33.371214+0000","last_became_peered":"2024-09-12T00:03:33.371214+0000","last_unstale":"2024-09-12T00:03:34.351646+0000","last_undegraded":"2024-09-12T00:03:34.351646+0000","last_fullsized":"2024-09-12T00:03:34.351646+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:40.880933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.384721+0000","last_change":"2024-09-12T00:03:25.332405+0000","last_active":"2024-09-12T00:03:34.384721+0000","last_peered":"2024-09-12T00:03:34.384721+0000","last_clean":"2024-09-12T00:03:34.384721+0000","last_became_active":"2024-09-12T00:03:25.331250+0000","last_became_peered":"2024-09-12T00:03:25.331250+0000","last_unstale":"2024-09-12T00:03:34.384721+0000","last_undegraded":"2024-09-12T00:03:34.384721+0000","last_fullsized":"2024-09-12T00:03:34.384721+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.387506+0000","last_change":"2024-09-12T00:03:23.602222+0000","last_active":"2024-09-12T00:03:34.387506+0000","last_peered":"2024-09-12T00:03:34.387506+0000","last_clean":"2024-09-12T00:03:34.387506+0000","last_became_active":"2024-09-12T00:03:23.601481+0000","last_became_peered":"2024-09-12T00:03:23.601481+0000","last_unstale":"2024-09-12T00:03:34.387506+0000","last_undegraded":"2024-09-12T00:03:34.387506+0000","last_fullsized":"2024-09-12T00:03:34.387506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:56.636638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.387821+0000","last_change":"2024-09-12T00:03:18.716648+0000","last_active":"2024-09-12T00:03:34.387821+0000","last_peered":"2024-09-12T00:03:34.387821+0000","last_clean":"2024-09-12T00:03:34.387821+0000","last_became_active":"2024-09-12T00:03:16.594609+0000","last_became_peered":"2024-09-12T00:03:16.594609+0000","last_unstale":"2024-09-12T00:03:34.387821+0000","last_undegraded":"2024-09-12T00:03:34.387821+0000","last_fullsized":"2024-09-12T00:03:34.387821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:34.635008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010254439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347623+0000","last_change":"2024-09-12T00:03:27.337871+0000","last_active":"2024-09-12T00:03:34.347623+0000","last_peered":"2024-09-12T00:03:34.347623+0000","last_clean":"2024-09-12T00:03:34.347623+0000","last_became_active":"2024-09-12T00:03:27.337299+0000","last_became_peered":"2024-09-12T00:03:27.337299+0000","last_unstale":"2024-09-12T00:03:34.347623+0000","last_undegraded":"2024-09-12T00:03:34.347623+0000","last_fullsized":"2024-09-12T00:03:34.347623+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:37.289387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'17","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.232478+0000","last_change":"2024-09-12T00:03:29.354380+0000","last_active":"2024-09-12T00:03:35.232478+0000","last_peered":"2024-09-12T00:03:35.232478+0000","last_clean":"2024-09-12T00:03:35.232478+0000","last_became_active":"2024-09-12T00:03:29.353644+0000","last_became_peered":"2024-09-12T00:03:29.353644+0000","last_unstale":"2024-09-12T00:03:35.232478+0000","last_undegraded":"2024-09-12T00:03:35.232478+0000","last_fullsized":"2024-09-12T00:03:35.232478+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:15.452219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382235+0000","last_change":"2024-09-12T00:03:31.361616+0000","last_active":"2024-09-12T00:03:34.382235+0000","last_peered":"2024-09-12T00:03:34.382235+0000","last_clean":"2024-09-12T00:03:34.382235+0000","last_became_active":"2024-09-12T00:03:31.360518+0000","last_became_peered":"2024-09-12T00:03:31.360518+0000","last_unstale":"2024-09-12T00:03:34.382235+0000","last_undegraded":"2024-09-12T00:03:34.382235+0000","last_fullsized":"2024-09-12T00:03:34.382235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:40.640537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.381854+0000","last_change":"2024-09-12T00:03:33.378417+0000","last_active":"2024-09-12T00:03:34.381854+0000","last_peered":"2024-09-12T00:03:34.381854+0000","last_clean":"2024-09-12T00:03:34.381854+0000","last_became_active":"2024-09-12T00:03:33.377669+0000","last_became_peered":"2024-09-12T00:03:33.377669+0000","last_unstale":"2024-09-12T00:03:34.381854+0000","last_undegraded":"2024-09-12T00:03:34.381854+0000","last_fullsized":"2024-09-12T00:03:34.381854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:04.623906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.405894+0000","last_change":"2024-09-12T00:03:25.318286+0000","last_active":"2024-09-12T00:03:34.405894+0000","last_peered":"2024-09-12T00:03:34.405894+0000","last_clean":"2024-09-12T00:03:34.405894+0000","last_became_active":"2024-09-12T00:03:25.317820+0000","last_became_peered":"2024-09-12T00:03:25.317820+0000","last_unstale":"2024-09-12T00:03:34.405894+0000","last_undegraded":"2024-09-12T00:03:34.405894+0000","last_fullsized":"2024-09-12T00:03:34.405894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:05.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.387344+0000","last_change":"2024-09-12T00:03:23.616319+0000","last_active":"2024-09-12T00:03:34.387344+0000","last_peered":"2024-09-12T00:03:34.387344+0000","last_clean":"2024-09-12T00:03:34.387344+0000","last_became_active":"2024-09-12T00:03:23.615158+0000","last_became_peered":"2024-09-12T00:03:23.615158+0000","last_unstale":"2024-09-12T00:03:34.387344+0000","last_undegraded":"2024-09-12T00:03:34.387344+0000","last_fullsized":"2024-09-12T00:03:34.387344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:15.677228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350853+0000","last_change":"2024-09-12T00:03:18.566832+0000","last_active":"2024-09-12T00:03:34.350853+0000","last_peered":"2024-09-12T00:03:34.350853+0000","last_clean":"2024-09-12T00:03:34.350853+0000","last_became_active":"2024-09-12T00:03:16.592377+0000","last_became_peered":"2024-09-12T00:03:16.592377+0000","last_unstale":"2024-09-12T00:03:34.350853+0000","last_undegraded":"2024-09-12T00:03:34.350853+0000","last_fullsized":"2024-09-12T00:03:34.350853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:31.379733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001199625,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.384269+0000","last_change":"2024-09-12T00:03:27.337359+0000","last_active":"2024-09-12T00:03:34.384269+0000","last_peered":"2024-09-12T00:03:34.384269+0000","last_clean":"2024-09-12T00:03:34.384269+0000","last_became_active":"2024-09-12T00:03:27.336289+0000","last_became_peered":"2024-09-12T00:03:27.336289+0000","last_unstale":"2024-09-12T00:03:34.384269+0000","last_undegraded":"2024-09-12T00:03:34.384269+0000","last_fullsized":"2024-09-12T00:03:34.384269+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:39.147272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"35'25","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.210123+0000","last_change":"2024-09-12T00:03:29.344621+0000","last_active":"2024-09-12T00:03:35.210123+0000","last_peered":"2024-09-12T00:03:35.210123+0000","last_clean":"2024-09-12T00:03:35.210123+0000","last_became_active":"2024-09-12T00:03:29.343779+0000","last_became_peered":"2024-09-12T00:03:29.343779+0000","last_unstale":"2024-09-12T00:03:35.210123+0000","last_undegraded":"2024-09-12T00:03:35.210123+0000","last_fullsized":"2024-09-12T00:03:35.210123+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:49.518432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.384904+0000","last_change":"2024-09-12T00:03:31.335460+0000","last_active":"2024-09-12T00:03:34.384904+0000","last_peered":"2024-09-12T00:03:34.384904+0000","last_clean":"2024-09-12T00:03:34.384904+0000","last_became_active":"2024-09-12T00:03:31.334701+0000","last_became_peered":"2024-09-12T00:03:31.334701+0000","last_unstale":"2024-09-12T00:03:34.384904+0000","last_undegraded":"2024-09-12T00:03:34.384904+0000","last_fullsized":"2024-09-12T00:03:34.384904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:28.484366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.407382+0000","last_change":"2024-09-12T00:03:33.386404+0000","last_active":"2024-09-12T00:03:34.407382+0000","last_peered":"2024-09-12T00:03:34.407382+0000","last_clean":"2024-09-12T00:03:34.407382+0000","last_became_active":"2024-09-12T00:03:33.385090+0000","last_became_peered":"2024-09-12T00:03:33.385090+0000","last_unstale":"2024-09-12T00:03:34.407382+0000","last_undegraded":"2024-09-12T00:03:34.407382+0000","last_fullsized":"2024-09-12T00:03:34.407382+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.386662+0000","last_change":"2024-09-12T00:03:33.361690+0000","last_active":"2024-09-12T00:03:34.386662+0000","last_peered":"2024-09-12T00:03:34.386662+0000","last_clean":"2024-09-12T00:03:34.386662+0000","last_became_active":"2024-09-12T00:03:33.360980+0000","last_became_peered":"2024-09-12T00:03:33.360980+0000","last_unstale":"2024-09-12T00:03:34.386662+0000","last_undegraded":"2024-09-12T00:03:34.386662+0000","last_fullsized":"2024-09-12T00:03:34.386662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:24.954577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.406975+0000","last_change":"2024-09-12T00:03:25.335027+0000","last_active":"2024-09-12T00:03:34.406975+0000","last_peered":"2024-09-12T00:03:34.406975+0000","last_clean":"2024-09-12T00:03:34.406975+0000","last_became_active":"2024-09-12T00:03:25.334530+0000","last_became_peered":"2024-09-12T00:03:25.334530+0000","last_unstale":"2024-09-12T00:03:34.406975+0000","last_undegraded":"2024-09-12T00:03:34.406975+0000","last_fullsized":"2024-09-12T00:03:34.406975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348636+0000","last_change":"2024-09-12T00:03:23.618114+0000","last_active":"2024-09-12T00:03:34.348636+0000","last_peered":"2024-09-12T00:03:34.348636+0000","last_clean":"2024-09-12T00:03:34.348636+0000","last_became_active":"2024-09-12T00:03:23.617781+0000","last_became_peered":"2024-09-12T00:03:23.617781+0000","last_unstale":"2024-09-12T00:03:34.348636+0000","last_undegraded":"2024-09-12T00:03:34.348636+0000","last_fullsized":"2024-09-12T00:03:34.348636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:30.629135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"28'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348917+0000","last_change":"2024-09-12T00:03:27.332281+0000","last_active":"2024-09-12T00:03:34.348917+0000","last_peered":"2024-09-12T00:03:34.348917+0000","last_clean":"2024-09-12T00:03:34.348917+0000","last_became_active":"2024-09-12T00:03:27.331527+0000","last_became_peered":"2024-09-12T00:03:27.331527+0000","last_unstale":"2024-09-12T00:03:34.348917+0000","last_undegraded":"2024-09-12T00:03:34.348917+0000","last_fullsized":"2024-09-12T00:03:34.348917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"35'17","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.282413+0000","last_change":"2024-09-12T00:03:29.338655+0000","last_active":"2024-09-12T00:03:35.282413+0000","last_peered":"2024-09-12T00:03:35.282413+0000","last_clean":"2024-09-12T00:03:35.282413+0000","last_became_active":"2024-09-12T00:03:29.337905+0000","last_became_peered":"2024-09-12T00:03:29.337905+0000","last_unstale":"2024-09-12T00:03:35.282413+0000","last_undegraded":"2024-09-12T00:03:35.282413+0000","last_fullsized":"2024-09-12T00:03:35.282413+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347275+0000","last_change":"2024-09-12T00:03:31.351716+0000","last_active":"2024-09-12T00:03:34.347275+0000","last_peered":"2024-09-12T00:03:34.347275+0000","last_clean":"2024-09-12T00:03:34.347275+0000","last_became_active":"2024-09-12T00:03:31.350917+0000","last_became_peered":"2024-09-12T00:03:31.350917+0000","last_unstale":"2024-09-12T00:03:34.347275+0000","last_undegraded":"2024-09-12T00:03:34.347275+0000","last_fullsized":"2024-09-12T00:03:34.347275+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:45.880820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.351601+0000","last_change":"2024-09-12T00:03:33.374233+0000","last_active":"2024-09-12T00:03:34.351601+0000","last_peered":"2024-09-12T00:03:34.351601+0000","last_clean":"2024-09-12T00:03:34.351601+0000","last_became_active":"2024-09-12T00:03:33.373466+0000","last_became_peered":"2024-09-12T00:03:33.373466+0000","last_unstale":"2024-09-12T00:03:34.351601+0000","last_undegraded":"2024-09-12T00:03:34.351601+0000","last_fullsized":"2024-09-12T00:03:34.351601+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:55.598892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.384782+0000","last_change":"2024-09-12T00:03:25.319144+0000","last_active":"2024-09-12T00:03:34.384782+0000","last_peered":"2024-09-12T00:03:34.384782+0000","last_clean":"2024-09-12T00:03:34.384782+0000","last_became_active":"2024-09-12T00:03:25.318362+0000","last_became_peered":"2024-09-12T00:03:25.318362+0000","last_unstale":"2024-09-12T00:03:34.384782+0000","last_undegraded":"2024-09-12T00:03:34.384782+0000","last_fullsized":"2024-09-12T00:03:34.384782+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373449+0000","last_change":"2024-09-12T00:03:23.613274+0000","last_active":"2024-09-12T00:03:34.373449+0000","last_peered":"2024-09-12T00:03:34.373449+0000","last_clean":"2024-09-12T00:03:34.373449+0000","last_became_active":"2024-09-12T00:03:23.612941+0000","last_became_peered":"2024-09-12T00:03:23.612941+0000","last_unstale":"2024-09-12T00:03:34.373449+0000","last_undegraded":"2024-09-12T00:03:34.373449+0000","last_fullsized":"2024-09-12T00:03:34.373449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:56.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.385747+0000","last_change":"2024-09-12T00:03:27.336144+0000","last_active":"2024-09-12T00:03:34.385747+0000","last_peered":"2024-09-12T00:03:34.385747+0000","last_clean":"2024-09-12T00:03:34.385747+0000","last_became_active":"2024-09-12T00:03:27.335372+0000","last_became_peered":"2024-09-12T00:03:27.335372+0000","last_unstale":"2024-09-12T00:03:34.385747+0000","last_undegraded":"2024-09-12T00:03:34.385747+0000","last_fullsized":"2024-09-12T00:03:34.385747+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:33.978665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"35'4","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.759002+0000","last_change":"2024-09-12T00:03:29.332051+0000","last_active":"2024-09-12T00:03:34.759002+0000","last_peered":"2024-09-12T00:03:34.759002+0000","last_clean":"2024-09-12T00:03:34.759002+0000","last_became_active":"2024-09-12T00:03:29.331243+0000","last_became_peered":"2024-09-12T00:03:29.331243+0000","last_unstale":"2024-09-12T00:03:34.759002+0000","last_undegraded":"2024-09-12T00:03:34.759002+0000","last_fullsized":"2024-09-12T00:03:34.759002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:52.544770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.405214+0000","last_change":"2024-09-12T00:03:31.347021+0000","last_active":"2024-09-12T00:03:34.405214+0000","last_peered":"2024-09-12T00:03:34.405214+0000","last_clean":"2024-09-12T00:03:34.405214+0000","last_became_active":"2024-09-12T00:03:31.344407+0000","last_became_peered":"2024-09-12T00:03:31.344407+0000","last_unstale":"2024-09-12T00:03:34.405214+0000","last_undegraded":"2024-09-12T00:03:34.405214+0000","last_fullsized":"2024-09-12T00:03:34.405214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:32.139742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.351225+0000","last_change":"2024-09-12T00:03:33.370271+0000","last_active":"2024-09-12T00:03:34.351225+0000","last_peered":"2024-09-12T00:03:34.351225+0000","last_clean":"2024-09-12T00:03:34.351225+0000","last_became_active":"2024-09-12T00:03:33.369538+0000","last_became_peered":"2024-09-12T00:03:33.369538+0000","last_unstale":"2024-09-12T00:03:34.351225+0000","last_undegraded":"2024-09-12T00:03:34.351225+0000","last_fullsized":"2024-09-12T00:03:34.351225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.384987+0000","last_change":"2024-09-12T00:03:25.341025+0000","last_active":"2024-09-12T00:03:34.384987+0000","last_peered":"2024-09-12T00:03:34.384987+0000","last_clean":"2024-09-12T00:03:34.384987+0000","last_became_active":"2024-09-12T00:03:25.340288+0000","last_became_peered":"2024-09-12T00:03:25.340288+0000","last_unstale":"2024-09-12T00:03:34.384987+0000","last_undegraded":"2024-09-12T00:03:34.384987+0000","last_fullsized":"2024-09-12T00:03:34.384987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.408218+0000","last_change":"2024-09-12T00:03:23.612814+0000","last_active":"2024-09-12T00:03:34.408218+0000","last_peered":"2024-09-12T00:03:34.408218+0000","last_clean":"2024-09-12T00:03:34.408218+0000","last_became_active":"2024-09-12T00:03:23.612332+0000","last_became_peered":"2024-09-12T00:03:23.612332+0000","last_unstale":"2024-09-12T00:03:34.408218+0000","last_undegraded":"2024-09-12T00:03:34.408218+0000","last_fullsized":"2024-09-12T00:03:34.408218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:02.202230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.405164+0000","last_change":"2024-09-12T00:03:27.329869+0000","last_active":"2024-09-12T00:03:34.405164+0000","last_peered":"2024-09-12T00:03:34.405164+0000","last_clean":"2024-09-12T00:03:34.405164+0000","last_became_active":"2024-09-12T00:03:27.329077+0000","last_became_peered":"2024-09-12T00:03:27.329077+0000","last_unstale":"2024-09-12T00:03:34.405164+0000","last_undegraded":"2024-09-12T00:03:34.405164+0000","last_fullsized":"2024-09-12T00:03:34.405164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'11","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.189153+0000","last_change":"2024-09-12T00:03:29.346878+0000","last_active":"2024-09-12T00:03:35.189153+0000","last_peered":"2024-09-12T00:03:35.189153+0000","last_clean":"2024-09-12T00:03:35.189153+0000","last_became_active":"2024-09-12T00:03:29.345990+0000","last_became_peered":"2024-09-12T00:03:29.345990+0000","last_unstale":"2024-09-12T00:03:35.189153+0000","last_undegraded":"2024-09-12T00:03:35.189153+0000","last_fullsized":"2024-09-12T00:03:35.189153+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:06.398979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.366597+0000","last_change":"2024-09-12T00:03:31.363658+0000","last_active":"2024-09-12T00:03:34.366597+0000","last_peered":"2024-09-12T00:03:34.366597+0000","last_clean":"2024-09-12T00:03:34.366597+0000","last_became_active":"2024-09-12T00:03:31.363080+0000","last_became_peered":"2024-09-12T00:03:31.363080+0000","last_unstale":"2024-09-12T00:03:34.366597+0000","last_undegraded":"2024-09-12T00:03:34.366597+0000","last_fullsized":"2024-09-12T00:03:34.366597+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:05.901608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348058+0000","last_change":"2024-09-12T00:03:33.380447+0000","last_active":"2024-09-12T00:03:34.348058+0000","last_peered":"2024-09-12T00:03:34.348058+0000","last_clean":"2024-09-12T00:03:34.348058+0000","last_became_active":"2024-09-12T00:03:33.379701+0000","last_became_peered":"2024-09-12T00:03:33.379701+0000","last_unstale":"2024-09-12T00:03:34.348058+0000","last_undegraded":"2024-09-12T00:03:34.348058+0000","last_fullsized":"2024-09-12T00:03:34.348058+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:55.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347591+0000","last_change":"2024-09-12T00:03:25.330916+0000","last_active":"2024-09-12T00:03:34.347591+0000","last_peered":"2024-09-12T00:03:34.347591+0000","last_clean":"2024-09-12T00:03:34.347591+0000","last_became_active":"2024-09-12T00:03:25.330181+0000","last_became_peered":"2024-09-12T00:03:25.330181+0000","last_unstale":"2024-09-12T00:03:34.347591+0000","last_undegraded":"2024-09-12T00:03:34.347591+0000","last_fullsized":"2024-09-12T00:03:34.347591+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:03.153020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.383907+0000","last_change":"2024-09-12T00:03:23.618613+0000","last_active":"2024-09-12T00:03:34.383907+0000","last_peered":"2024-09-12T00:03:34.383907+0000","last_clean":"2024-09-12T00:03:34.383907+0000","last_became_active":"2024-09-12T00:03:23.617587+0000","last_became_peered":"2024-09-12T00:03:23.617587+0000","last_unstale":"2024-09-12T00:03:34.383907+0000","last_undegraded":"2024-09-12T00:03:34.383907+0000","last_fullsized":"2024-09-12T00:03:34.383907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:54.211904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347370+0000","last_change":"2024-09-12T00:03:27.330320+0000","last_active":"2024-09-12T00:03:34.347370+0000","last_peered":"2024-09-12T00:03:34.347370+0000","last_clean":"2024-09-12T00:03:34.347370+0000","last_became_active":"2024-09-12T00:03:27.329236+0000","last_became_peered":"2024-09-12T00:03:27.329236+0000","last_unstale":"2024-09-12T00:03:34.347370+0000","last_undegraded":"2024-09-12T00:03:34.347370+0000","last_fullsized":"2024-09-12T00:03:34.347370+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:57.407947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'9","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.960252+0000","last_change":"2024-09-12T00:03:29.346312+0000","last_active":"2024-09-12T00:03:34.960252+0000","last_peered":"2024-09-12T00:03:34.960252+0000","last_clean":"2024-09-12T00:03:34.960252+0000","last_became_active":"2024-09-12T00:03:29.345883+0000","last_became_peered":"2024-09-12T00:03:29.345883+0000","last_unstale":"2024-09-12T00:03:34.960252+0000","last_undegraded":"2024-09-12T00:03:34.960252+0000","last_fullsized":"2024-09-12T00:03:34.960252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:46.723370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350524+0000","last_change":"2024-09-12T00:03:31.358786+0000","last_active":"2024-09-12T00:03:34.350524+0000","last_peered":"2024-09-12T00:03:34.350524+0000","last_clean":"2024-09-12T00:03:34.350524+0000","last_became_active":"2024-09-12T00:03:31.358011+0000","last_became_peered":"2024-09-12T00:03:31.358011+0000","last_unstale":"2024-09-12T00:03:34.350524+0000","last_undegraded":"2024-09-12T00:03:34.350524+0000","last_fullsized":"2024-09-12T00:03:34.350524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:29.394163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350013+0000","last_change":"2024-09-12T00:03:25.351065+0000","last_active":"2024-09-12T00:03:34.350013+0000","last_peered":"2024-09-12T00:03:34.350013+0000","last_clean":"2024-09-12T00:03:34.350013+0000","last_became_active":"2024-09-12T00:03:25.350719+0000","last_became_peered":"2024-09-12T00:03:25.350719+0000","last_unstale":"2024-09-12T00:03:34.350013+0000","last_undegraded":"2024-09-12T00:03:34.350013+0000","last_fullsized":"2024-09-12T00:03:34.350013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:54.693130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.381210+0000","last_change":"2024-09-12T00:03:23.627584+0000","last_active":"2024-09-12T00:03:34.381210+0000","last_peered":"2024-09-12T00:03:34.381210+0000","last_clean":"2024-09-12T00:03:34.381210+0000","last_became_active":"2024-09-12T00:03:23.626026+0000","last_became_peered":"2024-09-12T00:03:23.626026+0000","last_unstale":"2024-09-12T00:03:34.381210+0000","last_undegraded":"2024-09-12T00:03:34.381210+0000","last_fullsized":"2024-09-12T00:03:34.381210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:38.192583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350366+0000","last_change":"2024-09-12T00:03:27.335297+0000","last_active":"2024-09-12T00:03:34.350366+0000","last_peered":"2024-09-12T00:03:34.350366+0000","last_clean":"2024-09-12T00:03:34.350366+0000","last_became_active":"2024-09-12T00:03:27.334570+0000","last_became_peered":"2024-09-12T00:03:27.334570+0000","last_unstale":"2024-09-12T00:03:34.350366+0000","last_undegraded":"2024-09-12T00:03:34.350366+0000","last_fullsized":"2024-09-12T00:03:34.350366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"35'18","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.311724+0000","last_change":"2024-09-12T00:03:29.340387+0000","last_active":"2024-09-12T00:03:35.311724+0000","last_peered":"2024-09-12T00:03:35.311724+0000","last_clean":"2024-09-12T00:03:35.311724+0000","last_became_active":"2024-09-12T00:03:29.339781+0000","last_became_peered":"2024-09-12T00:03:29.339781+0000","last_unstale":"2024-09-12T00:03:35.311724+0000","last_undegraded":"2024-09-12T00:03:35.311724+0000","last_fullsized":"2024-09-12T00:03:35.311724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:30.132716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.406766+0000","last_change":"2024-09-12T00:03:31.350303+0000","last_active":"2024-09-12T00:03:34.406766+0000","last_peered":"2024-09-12T00:03:34.406766+0000","last_clean":"2024-09-12T00:03:34.406766+0000","last_became_active":"2024-09-12T00:03:31.349591+0000","last_became_peered":"2024-09-12T00:03:31.349591+0000","last_unstale":"2024-09-12T00:03:34.406766+0000","last_undegraded":"2024-09-12T00:03:34.406766+0000","last_fullsized":"2024-09-12T00:03:34.406766+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:00.263644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.380699+0000","last_change":"2024-09-12T00:03:33.385028+0000","last_active":"2024-09-12T00:03:34.380699+0000","last_peered":"2024-09-12T00:03:34.380699+0000","last_clean":"2024-09-12T00:03:34.380699+0000","last_became_active":"2024-09-12T00:03:33.384274+0000","last_became_peered":"2024-09-12T00:03:33.384274+0000","last_unstale":"2024-09-12T00:03:34.380699+0000","last_undegraded":"2024-09-12T00:03:34.380699+0000","last_fullsized":"2024-09-12T00:03:34.380699+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:11.634604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.387099+0000","last_change":"2024-09-12T00:03:25.329888+0000","last_active":"2024-09-12T00:03:34.387099+0000","last_peered":"2024-09-12T00:03:34.387099+0000","last_clean":"2024-09-12T00:03:34.387099+0000","last_became_active":"2024-09-12T00:03:25.329151+0000","last_became_peered":"2024-09-12T00:03:25.329151+0000","last_unstale":"2024-09-12T00:03:34.387099+0000","last_undegraded":"2024-09-12T00:03:34.387099+0000","last_fullsized":"2024-09-12T00:03:34.387099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:47.272383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.386163+0000","last_change":"2024-09-12T00:03:23.600146+0000","last_active":"2024-09-12T00:03:34.386163+0000","last_peered":"2024-09-12T00:03:34.386163+0000","last_clean":"2024-09-12T00:03:34.386163+0000","last_became_active":"2024-09-12T00:03:23.598862+0000","last_became_peered":"2024-09-12T00:03:23.598862+0000","last_unstale":"2024-09-12T00:03:34.386163+0000","last_undegraded":"2024-09-12T00:03:34.386163+0000","last_fullsized":"2024-09-12T00:03:34.386163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:13.330852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.407413+0000","last_change":"2024-09-12T00:03:27.341032+0000","last_active":"2024-09-12T00:03:34.407413+0000","last_peered":"2024-09-12T00:03:34.407413+0000","last_clean":"2024-09-12T00:03:34.407413+0000","last_became_active":"2024-09-12T00:03:27.340199+0000","last_became_peered":"2024-09-12T00:03:27.340199+0000","last_unstale":"2024-09-12T00:03:34.407413+0000","last_undegraded":"2024-09-12T00:03:34.407413+0000","last_fullsized":"2024-09-12T00:03:34.407413+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:23.673080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'15","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.084908+0000","last_change":"2024-09-12T00:03:29.349125+0000","last_active":"2024-09-12T00:03:35.084908+0000","last_peered":"2024-09-12T00:03:35.084908+0000","last_clean":"2024-09-12T00:03:35.084908+0000","last_became_active":"2024-09-12T00:03:29.348145+0000","last_became_peered":"2024-09-12T00:03:29.348145+0000","last_unstale":"2024-09-12T00:03:35.084908+0000","last_undegraded":"2024-09-12T00:03:35.084908+0000","last_fullsized":"2024-09-12T00:03:35.084908+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:55.699040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.381993+0000","last_change":"2024-09-12T00:03:31.363427+0000","last_active":"2024-09-12T00:03:34.381993+0000","last_peered":"2024-09-12T00:03:34.381993+0000","last_clean":"2024-09-12T00:03:34.381993+0000","last_became_active":"2024-09-12T00:03:31.362578+0000","last_became_peered":"2024-09-12T00:03:31.362578+0000","last_unstale":"2024-09-12T00:03:34.381993+0000","last_undegraded":"2024-09-12T00:03:34.381993+0000","last_fullsized":"2024-09-12T00:03:34.381993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:17.357647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349828+0000","last_change":"2024-09-12T00:03:33.375115+0000","last_active":"2024-09-12T00:03:34.349828+0000","last_peered":"2024-09-12T00:03:34.349828+0000","last_clean":"2024-09-12T00:03:34.349828+0000","last_became_active":"2024-09-12T00:03:33.374310+0000","last_became_peered":"2024-09-12T00:03:33.374310+0000","last_unstale":"2024-09-12T00:03:34.349828+0000","last_undegraded":"2024-09-12T00:03:34.349828+0000","last_fullsized":"2024-09-12T00:03:34.349828+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:46.466723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350900+0000","last_change":"2024-09-12T00:03:25.360355+0000","last_active":"2024-09-12T00:03:34.350900+0000","last_peered":"2024-09-12T00:03:34.350900+0000","last_clean":"2024-09-12T00:03:34.350900+0000","last_became_active":"2024-09-12T00:03:25.359682+0000","last_became_peered":"2024-09-12T00:03:25.359682+0000","last_unstale":"2024-09-12T00:03:34.350900+0000","last_undegraded":"2024-09-12T00:03:34.350900+0000","last_fullsized":"2024-09-12T00:03:34.350900+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:11.808081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.368060+0000","last_change":"2024-09-12T00:03:23.621199+0000","last_active":"2024-09-12T00:03:34.368060+0000","last_peered":"2024-09-12T00:03:34.368060+0000","last_clean":"2024-09-12T00:03:34.368060+0000","last_became_active":"2024-09-12T00:03:23.620961+0000","last_became_peered":"2024-09-12T00:03:23.620961+0000","last_unstale":"2024-09-12T00:03:34.368060+0000","last_undegraded":"2024-09-12T00:03:34.368060+0000","last_fullsized":"2024-09-12T00:03:34.368060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.407090+0000","last_change":"2024-09-12T00:03:27.336918+0000","last_active":"2024-09-12T00:03:34.407090+0000","last_peered":"2024-09-12T00:03:34.407090+0000","last_clean":"2024-09-12T00:03:34.407090+0000","last_became_active":"2024-09-12T00:03:27.336045+0000","last_became_peered":"2024-09-12T00:03:27.336045+0000","last_unstale":"2024-09-12T00:03:34.407090+0000","last_undegraded":"2024-09-12T00:03:34.407090+0000","last_fullsized":"2024-09-12T00:03:34.407090+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'17","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.289928+0000","last_change":"2024-09-12T00:03:29.338667+0000","last_active":"2024-09-12T00:03:35.289928+0000","last_peered":"2024-09-12T00:03:35.289928+0000","last_clean":"2024-09-12T00:03:35.289928+0000","last_became_active":"2024-09-12T00:03:29.338010+0000","last_became_peered":"2024-09-12T00:03:29.338010+0000","last_unstale":"2024-09-12T00:03:35.289928+0000","last_undegraded":"2024-09-12T00:03:35.289928+0000","last_fullsized":"2024-09-12T00:03:35.289928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:58.256619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.351382+0000","last_change":"2024-09-12T00:03:31.352823+0000","last_active":"2024-09-12T00:03:34.351382+0000","last_peered":"2024-09-12T00:03:34.351382+0000","last_clean":"2024-09-12T00:03:34.351382+0000","last_became_active":"2024-09-12T00:03:31.352143+0000","last_became_peered":"2024-09-12T00:03:31.352143+0000","last_unstale":"2024-09-12T00:03:34.351382+0000","last_undegraded":"2024-09-12T00:03:34.351382+0000","last_fullsized":"2024-09-12T00:03:34.351382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:25.168692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347155+0000","last_change":"2024-09-12T00:03:33.379330+0000","last_active":"2024-09-12T00:03:34.347155+0000","last_peered":"2024-09-12T00:03:34.347155+0000","last_clean":"2024-09-12T00:03:34.347155+0000","last_became_active":"2024-09-12T00:03:33.376228+0000","last_became_peered":"2024-09-12T00:03:33.376228+0000","last_unstale":"2024-09-12T00:03:34.347155+0000","last_undegraded":"2024-09-12T00:03:34.347155+0000","last_fullsized":"2024-09-12T00:03:34.347155+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:44.364562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.386866+0000","last_change":"2024-09-12T00:03:25.325094+0000","last_active":"2024-09-12T00:03:34.386866+0000","last_peered":"2024-09-12T00:03:34.386866+0000","last_clean":"2024-09-12T00:03:34.386866+0000","last_became_active":"2024-09-12T00:03:25.324315+0000","last_became_peered":"2024-09-12T00:03:25.324315+0000","last_unstale":"2024-09-12T00:03:34.386866+0000","last_undegraded":"2024-09-12T00:03:34.386866+0000","last_fullsized":"2024-09-12T00:03:34.386866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:18.727732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.386715+0000","last_change":"2024-09-12T00:03:23.606163+0000","last_active":"2024-09-12T00:03:34.386715+0000","last_peered":"2024-09-12T00:03:34.386715+0000","last_clean":"2024-09-12T00:03:34.386715+0000","last_became_active":"2024-09-12T00:03:23.605402+0000","last_became_peered":"2024-09-12T00:03:23.605402+0000","last_unstale":"2024-09-12T00:03:34.386715+0000","last_undegraded":"2024-09-12T00:03:34.386715+0000","last_fullsized":"2024-09-12T00:03:34.386715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:02.432313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.385473+0000","last_change":"2024-09-12T00:03:27.336716+0000","last_active":"2024-09-12T00:03:34.385473+0000","last_peered":"2024-09-12T00:03:34.385473+0000","last_clean":"2024-09-12T00:03:34.385473+0000","last_became_active":"2024-09-12T00:03:27.335658+0000","last_became_peered":"2024-09-12T00:03:27.335658+0000","last_unstale":"2024-09-12T00:03:34.385473+0000","last_undegraded":"2024-09-12T00:03:34.385473+0000","last_fullsized":"2024-09-12T00:03:34.385473+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:47.355798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"35'16","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.266588+0000","last_change":"2024-09-12T00:03:29.354481+0000","last_active":"2024-09-12T00:03:35.266588+0000","last_peered":"2024-09-12T00:03:35.266588+0000","last_clean":"2024-09-12T00:03:35.266588+0000","last_became_active":"2024-09-12T00:03:29.353656+0000","last_became_peered":"2024-09-12T00:03:29.353656+0000","last_unstale":"2024-09-12T00:03:35.266588+0000","last_undegraded":"2024-09-12T00:03:35.266588+0000","last_fullsized":"2024-09-12T00:03:35.266588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:42.984798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373596+0000","last_change":"2024-09-12T00:03:31.351362+0000","last_active":"2024-09-12T00:03:34.373596+0000","last_peered":"2024-09-12T00:03:34.373596+0000","last_clean":"2024-09-12T00:03:34.373596+0000","last_became_active":"2024-09-12T00:03:31.350925+0000","last_became_peered":"2024-09-12T00:03:31.350925+0000","last_unstale":"2024-09-12T00:03:34.373596+0000","last_undegraded":"2024-09-12T00:03:34.373596+0000","last_fullsized":"2024-09-12T00:03:34.373596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:03.147968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.346802+0000","last_change":"2024-09-12T00:03:33.374932+0000","last_active":"2024-09-12T00:03:34.346802+0000","last_peered":"2024-09-12T00:03:34.346802+0000","last_clean":"2024-09-12T00:03:34.346802+0000","last_became_active":"2024-09-12T00:03:33.374185+0000","last_became_peered":"2024-09-12T00:03:33.374185+0000","last_unstale":"2024-09-12T00:03:34.346802+0000","last_undegraded":"2024-09-12T00:03:34.346802+0000","last_fullsized":"2024-09-12T00:03:34.346802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:54.883339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.406911+0000","last_change":"2024-09-12T00:03:25.357999+0000","last_active":"2024-09-12T00:03:34.406911+0000","last_peered":"2024-09-12T00:03:34.406911+0000","last_clean":"2024-09-12T00:03:34.406911+0000","last_became_active":"2024-09-12T00:03:25.357623+0000","last_became_peered":"2024-09-12T00:03:25.357623+0000","last_unstale":"2024-09-12T00:03:34.406911+0000","last_undegraded":"2024-09-12T00:03:34.406911+0000","last_fullsized":"2024-09-12T00:03:34.406911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.367672+0000","last_change":"2024-09-12T00:03:23.605954+0000","last_active":"2024-09-12T00:03:34.367672+0000","last_peered":"2024-09-12T00:03:34.367672+0000","last_clean":"2024-09-12T00:03:34.367672+0000","last_became_active":"2024-09-12T00:03:23.604773+0000","last_became_peered":"2024-09-12T00:03:23.604773+0000","last_unstale":"2024-09-12T00:03:34.367672+0000","last_undegraded":"2024-09-12T00:03:34.367672+0000","last_fullsized":"2024-09-12T00:03:34.367672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.366916+0000","last_change":"2024-09-12T00:03:27.346785+0000","last_active":"2024-09-12T00:03:34.366916+0000","last_peered":"2024-09-12T00:03:34.366916+0000","last_clean":"2024-09-12T00:03:34.366916+0000","last_became_active":"2024-09-12T00:03:27.346168+0000","last_became_peered":"2024-09-12T00:03:27.346168+0000","last_unstale":"2024-09-12T00:03:34.366916+0000","last_undegraded":"2024-09-12T00:03:34.366916+0000","last_fullsized":"2024-09-12T00:03:34.366916+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'40","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:35.301663+0000","last_change":"2024-09-12T00:03:29.343942+0000","last_active":"2024-09-12T00:03:35.301663+0000","last_peered":"2024-09-12T00:03:35.301663+0000","last_clean":"2024-09-12T00:03:35.301663+0000","last_became_active":"2024-09-12T00:03:29.343238+0000","last_became_peered":"2024-09-12T00:03:29.343238+0000","last_unstale":"2024-09-12T00:03:35.301663+0000","last_undegraded":"2024-09-12T00:03:35.301663+0000","last_fullsized":"2024-09-12T00:03:35.301663+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:30.949892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.384203+0000","last_change":"2024-09-12T00:03:31.348120+0000","last_active":"2024-09-12T00:03:34.384203+0000","last_peered":"2024-09-12T00:03:34.384203+0000","last_clean":"2024-09-12T00:03:34.384203+0000","last_became_active":"2024-09-12T00:03:31.344599+0000","last_became_peered":"2024-09-12T00:03:31.344599+0000","last_unstale":"2024-09-12T00:03:34.384203+0000","last_undegraded":"2024-09-12T00:03:34.384203+0000","last_fullsized":"2024-09-12T00:03:34.384203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:00.279625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.368227+0000","last_change":"2024-09-12T00:03:33.363188+0000","last_active":"2024-09-12T00:03:34.368227+0000","last_peered":"2024-09-12T00:03:34.368227+0000","last_clean":"2024-09-12T00:03:34.368227+0000","last_became_active":"2024-09-12T00:03:33.360672+0000","last_became_peered":"2024-09-12T00:03:33.360672+0000","last_unstale":"2024-09-12T00:03:34.368227+0000","last_undegraded":"2024-09-12T00:03:34.368227+0000","last_fullsized":"2024-09-12T00:03:34.368227+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:33.646117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.405748+0000","last_change":"2024-09-12T00:03:25.336626+0000","last_active":"2024-09-12T00:03:34.405748+0000","last_peered":"2024-09-12T00:03:34.405748+0000","last_clean":"2024-09-12T00:03:34.405748+0000","last_became_active":"2024-09-12T00:03:25.336095+0000","last_became_peered":"2024-09-12T00:03:25.336095+0000","last_unstale":"2024-09-12T00:03:34.405748+0000","last_undegraded":"2024-09-12T00:03:34.405748+0000","last_fullsized":"2024-09-12T00:03:34.405748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349586+0000","last_change":"2024-09-12T00:03:23.601889+0000","last_active":"2024-09-12T00:03:34.349586+0000","last_peered":"2024-09-12T00:03:34.349586+0000","last_clean":"2024-09-12T00:03:34.349586+0000","last_became_active":"2024-09-12T00:03:23.601553+0000","last_became_peered":"2024-09-12T00:03:23.601553+0000","last_unstale":"2024-09-12T00:03:34.349586+0000","last_undegraded":"2024-09-12T00:03:34.349586+0000","last_fullsized":"2024-09-12T00:03:34.349586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:08.758769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.406689+0000","last_change":"2024-09-12T00:03:27.326174+0000","last_active":"2024-09-12T00:03:34.406689+0000","last_peered":"2024-09-12T00:03:34.406689+0000","last_clean":"2024-09-12T00:03:34.406689+0000","last_became_active":"2024-09-12T00:03:27.325336+0000","last_became_peered":"2024-09-12T00:03:27.325336+0000","last_unstale":"2024-09-12T00:03:34.406689+0000","last_undegraded":"2024-09-12T00:03:34.406689+0000","last_fullsized":"2024-09-12T00:03:34.406689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:08.659813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'15","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.717618+0000","last_change":"2024-09-12T00:03:29.335957+0000","last_active":"2024-09-12T00:03:34.717618+0000","last_peered":"2024-09-12T00:03:34.717618+0000","last_clean":"2024-09-12T00:03:34.717618+0000","last_became_active":"2024-09-12T00:03:29.335186+0000","last_became_peered":"2024-09-12T00:03:29.335186+0000","last_unstale":"2024-09-12T00:03:34.717618+0000","last_undegraded":"2024-09-12T00:03:34.717618+0000","last_fullsized":"2024-09-12T00:03:34.717618+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:20.551758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347606+0000","last_change":"2024-09-12T00:03:31.350287+0000","last_active":"2024-09-12T00:03:34.347606+0000","last_peered":"2024-09-12T00:03:34.347606+0000","last_clean":"2024-09-12T00:03:34.347606+0000","last_became_active":"2024-09-12T00:03:31.349890+0000","last_became_peered":"2024-09-12T00:03:31.349890+0000","last_unstale":"2024-09-12T00:03:34.347606+0000","last_undegraded":"2024-09-12T00:03:34.347606+0000","last_fullsized":"2024-09-12T00:03:34.347606+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:33.081032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382134+0000","last_change":"2024-09-12T00:03:33.385037+0000","last_active":"2024-09-12T00:03:34.382134+0000","last_peered":"2024-09-12T00:03:34.382134+0000","last_clean":"2024-09-12T00:03:34.382134+0000","last_became_active":"2024-09-12T00:03:33.384379+0000","last_became_peered":"2024-09-12T00:03:33.384379+0000","last_unstale":"2024-09-12T00:03:34.382134+0000","last_undegraded":"2024-09-12T00:03:34.382134+0000","last_fullsized":"2024-09-12T00:03:34.382134+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:00.153475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347800+0000","last_change":"2024-09-12T00:03:25.339110+0000","last_active":"2024-09-12T00:03:34.347800+0000","last_peered":"2024-09-12T00:03:34.347800+0000","last_clean":"2024-09-12T00:03:34.347800+0000","last_became_active":"2024-09-12T00:03:25.338417+0000","last_became_peered":"2024-09-12T00:03:25.338417+0000","last_unstale":"2024-09-12T00:03:34.347800+0000","last_undegraded":"2024-09-12T00:03:34.347800+0000","last_fullsized":"2024-09-12T00:03:34.347800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:48.866021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.383459+0000","last_change":"2024-09-12T00:03:23.625514+0000","last_active":"2024-09-12T00:03:34.383459+0000","last_peered":"2024-09-12T00:03:34.383459+0000","last_clean":"2024-09-12T00:03:34.383459+0000","last_became_active":"2024-09-12T00:03:23.621654+0000","last_became_peered":"2024-09-12T00:03:23.621654+0000","last_unstale":"2024-09-12T00:03:34.383459+0000","last_undegraded":"2024-09-12T00:03:34.383459+0000","last_fullsized":"2024-09-12T00:03:34.383459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:43.784497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.366269+0000","last_change":"2024-09-12T00:03:27.330377+0000","last_active":"2024-09-12T00:03:34.366269+0000","last_peered":"2024-09-12T00:03:34.366269+0000","last_clean":"2024-09-12T00:03:34.366269+0000","last_became_active":"2024-09-12T00:03:27.329713+0000","last_became_peered":"2024-09-12T00:03:27.329713+0000","last_unstale":"2024-09-12T00:03:34.366269+0000","last_undegraded":"2024-09-12T00:03:34.366269+0000","last_fullsized":"2024-09-12T00:03:34.366269+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'11","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.915054+0000","last_change":"2024-09-12T00:03:29.337028+0000","last_active":"2024-09-12T00:03:34.915054+0000","last_peered":"2024-09-12T00:03:34.915054+0000","last_clean":"2024-09-12T00:03:34.915054+0000","last_became_active":"2024-09-12T00:03:29.335440+0000","last_became_peered":"2024-09-12T00:03:29.335440+0000","last_unstale":"2024-09-12T00:03:34.915054+0000","last_undegraded":"2024-09-12T00:03:34.915054+0000","last_fullsized":"2024-09-12T00:03:34.915054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:19.288395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347581+0000","last_change":"2024-09-12T00:03:31.351990+0000","last_active":"2024-09-12T00:03:34.347581+0000","last_peered":"2024-09-12T00:03:34.347581+0000","last_clean":"2024-09-12T00:03:34.347581+0000","last_became_active":"2024-09-12T00:03:31.351580+0000","last_became_peered":"2024-09-12T00:03:31.351580+0000","last_unstale":"2024-09-12T00:03:34.347581+0000","last_undegraded":"2024-09-12T00:03:34.347581+0000","last_fullsized":"2024-09-12T00:03:34.347581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:38.095033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348723+0000","last_change":"2024-09-12T00:03:33.383008+0000","last_active":"2024-09-12T00:03:34.348723+0000","last_peered":"2024-09-12T00:03:34.348723+0000","last_clean":"2024-09-12T00:03:34.348723+0000","last_became_active":"2024-09-12T00:03:33.381496+0000","last_became_peered":"2024-09-12T00:03:33.381496+0000","last_unstale":"2024-09-12T00:03:34.348723+0000","last_undegraded":"2024-09-12T00:03:34.348723+0000","last_fullsized":"2024-09-12T00:03:34.348723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:44.996509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.405434+0000","last_change":"2024-09-12T00:03:25.337999+0000","last_active":"2024-09-12T00:03:34.405434+0000","last_peered":"2024-09-12T00:03:34.405434+0000","last_clean":"2024-09-12T00:03:34.405434+0000","last_became_active":"2024-09-12T00:03:25.337237+0000","last_became_peered":"2024-09-12T00:03:25.337237+0000","last_unstale":"2024-09-12T00:03:34.405434+0000","last_undegraded":"2024-09-12T00:03:34.405434+0000","last_fullsized":"2024-09-12T00:03:34.405434+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.383789+0000","last_change":"2024-09-12T00:03:23.631744+0000","last_active":"2024-09-12T00:03:34.383789+0000","last_peered":"2024-09-12T00:03:34.383789+0000","last_clean":"2024-09-12T00:03:34.383789+0000","last_became_active":"2024-09-12T00:03:23.630928+0000","last_became_peered":"2024-09-12T00:03:23.630928+0000","last_unstale":"2024-09-12T00:03:34.383789+0000","last_undegraded":"2024-09-12T00:03:34.383789+0000","last_fullsized":"2024-09-12T00:03:34.383789+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:35.772832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.384778+0000","last_change":"2024-09-12T00:03:27.345980+0000","last_active":"2024-09-12T00:03:34.384778+0000","last_peered":"2024-09-12T00:03:34.384778+0000","last_clean":"2024-09-12T00:03:34.384778+0000","last_became_active":"2024-09-12T00:03:27.345225+0000","last_became_peered":"2024-09-12T00:03:27.345225+0000","last_unstale":"2024-09-12T00:03:34.384778+0000","last_undegraded":"2024-09-12T00:03:34.384778+0000","last_fullsized":"2024-09-12T00:03:34.384778+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:47.990032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"35'21","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.980478+0000","last_change":"2024-09-12T00:03:29.359254+0000","last_active":"2024-09-12T00:03:34.980478+0000","last_peered":"2024-09-12T00:03:34.980478+0000","last_clean":"2024-09-12T00:03:34.980478+0000","last_became_active":"2024-09-12T00:03:29.355711+0000","last_became_peered":"2024-09-12T00:03:29.355711+0000","last_unstale":"2024-09-12T00:03:34.980478+0000","last_undegraded":"2024-09-12T00:03:34.980478+0000","last_fullsized":"2024-09-12T00:03:34.980478+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:49.919008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.386157+0000","last_change":"2024-09-12T00:03:31.355300+0000","last_active":"2024-09-12T00:03:34.386157+0000","last_peered":"2024-09-12T00:03:34.386157+0000","last_clean":"2024-09-12T00:03:34.386157+0000","last_became_active":"2024-09-12T00:03:31.354506+0000","last_became_peered":"2024-09-12T00:03:31.354506+0000","last_unstale":"2024-09-12T00:03:34.386157+0000","last_undegraded":"2024-09-12T00:03:34.386157+0000","last_fullsized":"2024-09-12T00:03:34.386157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:51.564710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373664+0000","last_change":"2024-09-12T00:03:33.384262+0000","last_active":"2024-09-12T00:03:34.373664+0000","last_peered":"2024-09-12T00:03:34.373664+0000","last_clean":"2024-09-12T00:03:34.373664+0000","last_became_active":"2024-09-12T00:03:33.383358+0000","last_became_peered":"2024-09-12T00:03:33.383358+0000","last_unstale":"2024-09-12T00:03:34.373664+0000","last_undegraded":"2024-09-12T00:03:34.373664+0000","last_fullsized":"2024-09-12T00:03:34.373664+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:45.060131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.387343+0000","last_change":"2024-09-12T00:03:25.321452+0000","last_active":"2024-09-12T00:03:34.387343+0000","last_peered":"2024-09-12T00:03:34.387343+0000","last_clean":"2024-09-12T00:03:34.387343+0000","last_became_active":"2024-09-12T00:03:25.320503+0000","last_became_peered":"2024-09-12T00:03:25.320503+0000","last_unstale":"2024-09-12T00:03:34.387343+0000","last_undegraded":"2024-09-12T00:03:34.387343+0000","last_fullsized":"2024-09-12T00:03:34.387343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:22.789487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.405769+0000","last_change":"2024-09-12T00:03:23.617643+0000","last_active":"2024-09-12T00:03:34.405769+0000","last_peered":"2024-09-12T00:03:34.405769+0000","last_clean":"2024-09-12T00:03:34.405769+0000","last_became_active":"2024-09-12T00:03:23.617138+0000","last_became_peered":"2024-09-12T00:03:23.617138+0000","last_unstale":"2024-09-12T00:03:34.405769+0000","last_undegraded":"2024-09-12T00:03:34.405769+0000","last_fullsized":"2024-09-12T00:03:34.405769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.352616+0000","last_change":"2024-09-12T00:03:25.335650+0000","last_active":"2024-09-12T00:03:34.352616+0000","last_peered":"2024-09-12T00:03:34.352616+0000","last_clean":"2024-09-12T00:03:34.352616+0000","last_became_active":"2024-09-12T00:03:25.334965+0000","last_became_peered":"2024-09-12T00:03:25.334965+0000","last_unstale":"2024-09-12T00:03:34.352616+0000","last_undegraded":"2024-09-12T00:03:34.352616+0000","last_fullsized":"2024-09-12T00:03:34.352616+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:13.501672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347562+0000","last_change":"2024-09-12T00:03:23.618651+0000","last_active":"2024-09-12T00:03:34.347562+0000","last_peered":"2024-09-12T00:03:34.347562+0000","last_clean":"2024-09-12T00:03:34.347562+0000","last_became_active":"2024-09-12T00:03:23.612542+0000","last_became_peered":"2024-09-12T00:03:23.612542+0000","last_unstale":"2024-09-12T00:03:34.347562+0000","last_undegraded":"2024-09-12T00:03:34.347562+0000","last_fullsized":"2024-09-12T00:03:34.347562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348904+0000","last_change":"2024-09-12T00:03:25.327224+0000","last_active":"2024-09-12T00:03:34.348904+0000","last_peered":"2024-09-12T00:03:34.348904+0000","last_clean":"2024-09-12T00:03:34.348904+0000","last_became_active":"2024-09-12T00:03:25.326635+0000","last_became_peered":"2024-09-12T00:03:25.326635+0000","last_unstale":"2024-09-12T00:03:34.348904+0000","last_undegraded":"2024-09-12T00:03:34.348904+0000","last_fullsized":"2024-09-12T00:03:34.348904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:16.827573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349213+0000","last_change":"2024-09-12T00:03:23.626043+0000","last_active":"2024-09-12T00:03:34.349213+0000","last_peered":"2024-09-12T00:03:34.349213+0000","last_clean":"2024-09-12T00:03:34.349213+0000","last_became_active":"2024-09-12T00:03:23.625717+0000","last_became_peered":"2024-09-12T00:03:23.625717+0000","last_unstale":"2024-09-12T00:03:34.349213+0000","last_undegraded":"2024-09-12T00:03:34.349213+0000","last_fullsized":"2024-09-12T00:03:34.349213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:45.258601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382434+0000","last_change":"2024-09-12T00:03:25.354015+0000","last_active":"2024-09-12T00:03:34.382434+0000","last_peered":"2024-09-12T00:03:34.382434+0000","last_clean":"2024-09-12T00:03:34.382434+0000","last_became_active":"2024-09-12T00:03:25.352319+0000","last_became_peered":"2024-09-12T00:03:25.352319+0000","last_unstale":"2024-09-12T00:03:34.382434+0000","last_undegraded":"2024-09-12T00:03:34.382434+0000","last_fullsized":"2024-09-12T00:03:34.382434+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:08.033834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382411+0000","last_change":"2024-09-12T00:03:23.633614+0000","last_active":"2024-09-12T00:03:34.382411+0000","last_peered":"2024-09-12T00:03:34.382411+0000","last_clean":"2024-09-12T00:03:34.382411+0000","last_became_active":"2024-09-12T00:03:23.632850+0000","last_became_peered":"2024-09-12T00:03:23.632850+0000","last_unstale":"2024-09-12T00:03:34.382411+0000","last_undegraded":"2024-09-12T00:03:34.382411+0000","last_fullsized":"2024-09-12T00:03:34.382411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.381974+0000","last_change":"2024-09-12T00:03:25.357453+0000","last_active":"2024-09-12T00:03:34.381974+0000","last_peered":"2024-09-12T00:03:34.381974+0000","last_clean":"2024-09-12T00:03:34.381974+0000","last_became_active":"2024-09-12T00:03:25.353815+0000","last_became_peered":"2024-09-12T00:03:25.353815+0000","last_unstale":"2024-09-12T00:03:34.381974+0000","last_undegraded":"2024-09-12T00:03:34.381974+0000","last_fullsized":"2024-09-12T00:03:34.381974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:27.562174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350215+0000","last_change":"2024-09-12T00:03:23.609055+0000","last_active":"2024-09-12T00:03:34.350215+0000","last_peered":"2024-09-12T00:03:34.350215+0000","last_clean":"2024-09-12T00:03:34.350215+0000","last_became_active":"2024-09-12T00:03:23.608101+0000","last_became_peered":"2024-09-12T00:03:23.608101+0000","last_unstale":"2024-09-12T00:03:34.350215+0000","last_undegraded":"2024-09-12T00:03:34.350215+0000","last_fullsized":"2024-09-12T00:03:34.350215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.372521+0000","last_change":"2024-09-12T00:03:25.324744+0000","last_active":"2024-09-12T00:03:34.372521+0000","last_peered":"2024-09-12T00:03:34.372521+0000","last_clean":"2024-09-12T00:03:34.372521+0000","last_became_active":"2024-09-12T00:03:25.324199+0000","last_became_peered":"2024-09-12T00:03:25.324199+0000","last_unstale":"2024-09-12T00:03:34.372521+0000","last_undegraded":"2024-09-12T00:03:34.372521+0000","last_fullsized":"2024-09-12T00:03:34.372521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:12.547802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.352220+0000","last_change":"2024-09-12T00:03:23.616706+0000","last_active":"2024-09-12T00:03:34.352220+0000","last_peered":"2024-09-12T00:03:34.352220+0000","last_clean":"2024-09-12T00:03:34.352220+0000","last_became_active":"2024-09-12T00:03:23.615970+0000","last_became_peered":"2024-09-12T00:03:23.615970+0000","last_unstale":"2024-09-12T00:03:34.352220+0000","last_undegraded":"2024-09-12T00:03:34.352220+0000","last_fullsized":"2024-09-12T00:03:34.352220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349160+0000","last_change":"2024-09-12T00:03:25.343716+0000","last_active":"2024-09-12T00:03:34.349160+0000","last_peered":"2024-09-12T00:03:34.349160+0000","last_clean":"2024-09-12T00:03:34.349160+0000","last_became_active":"2024-09-12T00:03:25.342930+0000","last_became_peered":"2024-09-12T00:03:25.342930+0000","last_unstale":"2024-09-12T00:03:34.349160+0000","last_undegraded":"2024-09-12T00:03:34.349160+0000","last_fullsized":"2024-09-12T00:03:34.349160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.408099+0000","last_change":"2024-09-12T00:03:23.612903+0000","last_active":"2024-09-12T00:03:34.408099+0000","last_peered":"2024-09-12T00:03:34.408099+0000","last_clean":"2024-09-12T00:03:34.408099+0000","last_became_active":"2024-09-12T00:03:23.612448+0000","last_became_peered":"2024-09-12T00:03:23.612448+0000","last_unstale":"2024-09-12T00:03:34.408099+0000","last_undegraded":"2024-09-12T00:03:34.408099+0000","last_fullsized":"2024-09-12T00:03:34.408099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:14.913580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.367162+0000","last_change":"2024-09-12T00:03:25.326620+0000","last_active":"2024-09-12T00:03:34.367162+0000","last_peered":"2024-09-12T00:03:34.367162+0000","last_clean":"2024-09-12T00:03:34.367162+0000","last_became_active":"2024-09-12T00:03:25.326262+0000","last_became_peered":"2024-09-12T00:03:25.326262+0000","last_unstale":"2024-09-12T00:03:34.367162+0000","last_undegraded":"2024-09-12T00:03:34.367162+0000","last_fullsized":"2024-09-12T00:03:34.367162+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.383665+0000","last_change":"2024-09-12T00:03:23.632200+0000","last_active":"2024-09-12T00:03:34.383665+0000","last_peered":"2024-09-12T00:03:34.383665+0000","last_clean":"2024-09-12T00:03:34.383665+0000","last_became_active":"2024-09-12T00:03:23.631510+0000","last_became_peered":"2024-09-12T00:03:23.631510+0000","last_unstale":"2024-09-12T00:03:34.383665+0000","last_undegraded":"2024-09-12T00:03:34.383665+0000","last_fullsized":"2024-09-12T00:03:34.383665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:07.177242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.352346+0000","last_change":"2024-09-12T00:03:25.342763+0000","last_active":"2024-09-12T00:03:34.352346+0000","last_peered":"2024-09-12T00:03:34.352346+0000","last_clean":"2024-09-12T00:03:34.352346+0000","last_became_active":"2024-09-12T00:03:25.337834+0000","last_became_peered":"2024-09-12T00:03:25.337834+0000","last_unstale":"2024-09-12T00:03:34.352346+0000","last_undegraded":"2024-09-12T00:03:34.352346+0000","last_fullsized":"2024-09-12T00:03:34.352346+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:35.920599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347658+0000","last_change":"2024-09-12T00:03:23.630533+0000","last_active":"2024-09-12T00:03:34.347658+0000","last_peered":"2024-09-12T00:03:34.347658+0000","last_clean":"2024-09-12T00:03:34.347658+0000","last_became_active":"2024-09-12T00:03:23.630187+0000","last_became_peered":"2024-09-12T00:03:23.630187+0000","last_unstale":"2024-09-12T00:03:34.347658+0000","last_undegraded":"2024-09-12T00:03:34.347658+0000","last_fullsized":"2024-09-12T00:03:34.347658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:18.692638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373671+0000","last_change":"2024-09-12T00:03:25.339910+0000","last_active":"2024-09-12T00:03:34.373671+0000","last_peered":"2024-09-12T00:03:34.373671+0000","last_clean":"2024-09-12T00:03:34.373671+0000","last_became_active":"2024-09-12T00:03:25.336511+0000","last_became_peered":"2024-09-12T00:03:25.336511+0000","last_unstale":"2024-09-12T00:03:34.373671+0000","last_undegraded":"2024-09-12T00:03:34.373671+0000","last_fullsized":"2024-09-12T00:03:34.373671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:30.647474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.381605+0000","last_change":"2024-09-12T00:03:23.626232+0000","last_active":"2024-09-12T00:03:34.381605+0000","last_peered":"2024-09-12T00:03:34.381605+0000","last_clean":"2024-09-12T00:03:34.381605+0000","last_became_active":"2024-09-12T00:03:23.621761+0000","last_became_peered":"2024-09-12T00:03:23.621761+0000","last_unstale":"2024-09-12T00:03:34.381605+0000","last_undegraded":"2024-09-12T00:03:34.381605+0000","last_fullsized":"2024-09-12T00:03:34.381605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:31.587668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.382856+0000","last_change":"2024-09-12T00:03:25.341017+0000","last_active":"2024-09-12T00:03:34.382856+0000","last_peered":"2024-09-12T00:03:34.382856+0000","last_clean":"2024-09-12T00:03:34.382856+0000","last_became_active":"2024-09-12T00:03:25.340279+0000","last_became_peered":"2024-09-12T00:03:25.340279+0000","last_unstale":"2024-09-12T00:03:34.382856+0000","last_undegraded":"2024-09-12T00:03:34.382856+0000","last_fullsized":"2024-09-12T00:03:34.382856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:08.066950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.367745+0000","last_change":"2024-09-12T00:03:23.600956+0000","last_active":"2024-09-12T00:03:34.367745+0000","last_peered":"2024-09-12T00:03:34.367745+0000","last_clean":"2024-09-12T00:03:34.367745+0000","last_became_active":"2024-09-12T00:03:23.600673+0000","last_became_peered":"2024-09-12T00:03:23.600673+0000","last_unstale":"2024-09-12T00:03:34.367745+0000","last_undegraded":"2024-09-12T00:03:34.367745+0000","last_fullsized":"2024-09-12T00:03:34.367745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.367310+0000","last_change":"2024-09-12T00:03:25.325088+0000","last_active":"2024-09-12T00:03:34.367310+0000","last_peered":"2024-09-12T00:03:34.367310+0000","last_clean":"2024-09-12T00:03:34.367310+0000","last_became_active":"2024-09-12T00:03:25.324597+0000","last_became_peered":"2024-09-12T00:03:25.324597+0000","last_unstale":"2024-09-12T00:03:34.367310+0000","last_undegraded":"2024-09-12T00:03:34.367310+0000","last_fullsized":"2024-09-12T00:03:34.367310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.386480+0000","last_change":"2024-09-12T00:03:23.621791+0000","last_active":"2024-09-12T00:03:34.386480+0000","last_peered":"2024-09-12T00:03:34.386480+0000","last_clean":"2024-09-12T00:03:34.386480+0000","last_became_active":"2024-09-12T00:03:23.621063+0000","last_became_peered":"2024-09-12T00:03:23.621063+0000","last_unstale":"2024-09-12T00:03:34.386480+0000","last_undegraded":"2024-09-12T00:03:34.386480+0000","last_fullsized":"2024-09-12T00:03:34.386480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:33.234598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.366847+0000","last_change":"2024-09-12T00:03:25.357605+0000","last_active":"2024-09-12T00:03:34.366847+0000","last_peered":"2024-09-12T00:03:34.366847+0000","last_clean":"2024-09-12T00:03:34.366847+0000","last_became_active":"2024-09-12T00:03:25.357286+0000","last_became_peered":"2024-09-12T00:03:25.357286+0000","last_unstale":"2024-09-12T00:03:34.366847+0000","last_undegraded":"2024-09-12T00:03:34.366847+0000","last_fullsized":"2024-09-12T00:03:34.366847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.373401+0000","last_change":"2024-09-12T00:03:23.600931+0000","last_active":"2024-09-12T00:03:34.373401+0000","last_peered":"2024-09-12T00:03:34.373401+0000","last_clean":"2024-09-12T00:03:34.373401+0000","last_became_active":"2024-09-12T00:03:23.600591+0000","last_became_peered":"2024-09-12T00:03:23.600591+0000","last_unstale":"2024-09-12T00:03:34.373401+0000","last_undegraded":"2024-09-12T00:03:34.373401+0000","last_fullsized":"2024-09-12T00:03:34.373401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.348035+0000","last_change":"2024-09-12T00:03:25.330869+0000","last_active":"2024-09-12T00:03:34.348035+0000","last_peered":"2024-09-12T00:03:34.348035+0000","last_clean":"2024-09-12T00:03:34.348035+0000","last_became_active":"2024-09-12T00:03:25.329742+0000","last_became_peered":"2024-09-12T00:03:25.329742+0000","last_unstale":"2024-09-12T00:03:34.348035+0000","last_undegraded":"2024-09-12T00:03:34.348035+0000","last_fullsized":"2024-09-12T00:03:34.348035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:01.365985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.349760+0000","last_change":"2024-09-12T00:03:23.604388+0000","last_active":"2024-09-12T00:03:34.349760+0000","last_peered":"2024-09-12T00:03:34.349760+0000","last_clean":"2024-09-12T00:03:34.349760+0000","last_became_active":"2024-09-12T00:03:23.603608+0000","last_became_peered":"2024-09-12T00:03:23.603608+0000","last_unstale":"2024-09-12T00:03:34.349760+0000","last_undegraded":"2024-09-12T00:03:34.349760+0000","last_fullsized":"2024-09-12T00:03:34.349760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:19.941103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.385650+0000","last_change":"2024-09-12T00:03:25.347570+0000","last_active":"2024-09-12T00:03:34.385650+0000","last_peered":"2024-09-12T00:03:34.385650+0000","last_clean":"2024-09-12T00:03:34.385650+0000","last_became_active":"2024-09-12T00:03:25.346874+0000","last_became_peered":"2024-09-12T00:03:25.346874+0000","last_unstale":"2024-09-12T00:03:34.385650+0000","last_undegraded":"2024-09-12T00:03:34.385650+0000","last_fullsized":"2024-09-12T00:03:34.385650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.352875+0000","last_change":"2024-09-12T00:03:23.623417+0000","last_active":"2024-09-12T00:03:34.352875+0000","last_peered":"2024-09-12T00:03:34.352875+0000","last_clean":"2024-09-12T00:03:34.352875+0000","last_became_active":"2024-09-12T00:03:23.620261+0000","last_became_peered":"2024-09-12T00:03:23.620261+0000","last_unstale":"2024-09-12T00:03:34.352875+0000","last_undegraded":"2024-09-12T00:03:34.352875+0000","last_fullsized":"2024-09-12T00:03:34.352875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.366966+0000","last_change":"2024-09-12T00:03:25.357492+0000","last_active":"2024-09-12T00:03:34.366966+0000","last_peered":"2024-09-12T00:03:34.366966+0000","last_clean":"2024-09-12T00:03:34.366966+0000","last_became_active":"2024-09-12T00:03:25.357186+0000","last_became_peered":"2024-09-12T00:03:25.357186+0000","last_unstale":"2024-09-12T00:03:34.366966+0000","last_undegraded":"2024-09-12T00:03:34.366966+0000","last_fullsized":"2024-09-12T00:03:34.366966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.350738+0000","last_change":"2024-09-12T00:03:23.607247+0000","last_active":"2024-09-12T00:03:34.350738+0000","last_peered":"2024-09-12T00:03:34.350738+0000","last_clean":"2024-09-12T00:03:34.350738+0000","last_became_active":"2024-09-12T00:03:23.606625+0000","last_became_peered":"2024-09-12T00:03:23.606625+0000","last_unstale":"2024-09-12T00:03:34.350738+0000","last_undegraded":"2024-09-12T00:03:34.350738+0000","last_fullsized":"2024-09-12T00:03:34.350738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:04.927836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.347567+0000","last_change":"2024-09-12T00:03:23.611398+0000","last_active":"2024-09-12T00:03:34.347567+0000","last_peered":"2024-09-12T00:03:34.347567+0000","last_clean":"2024-09-12T00:03:34.347567+0000","last_became_active":"2024-09-12T00:03:23.610918+0000","last_became_peered":"2024-09-12T00:03:23.610918+0000","last_unstale":"2024-09-12T00:03:34.347567+0000","last_undegraded":"2024-09-12T00:03:34.347567+0000","last_fullsized":"2024-09-12T00:03:34.347567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:28.688159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.387253+0000","last_change":"2024-09-12T00:03:25.350116+0000","last_active":"2024-09-12T00:03:34.387253+0000","last_peered":"2024-09-12T00:03:34.387253+0000","last_clean":"2024-09-12T00:03:34.387253+0000","last_became_active":"2024-09-12T00:03:25.349281+0000","last_became_peered":"2024-09-12T00:03:25.349281+0000","last_unstale":"2024-09-12T00:03:34.387253+0000","last_undegraded":"2024-09-12T00:03:34.387253+0000","last_fullsized":"2024-09-12T00:03:34.387253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:33.350458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.381360+0000","last_change":"2024-09-12T00:03:23.619574+0000","last_active":"2024-09-12T00:03:34.381360+0000","last_peered":"2024-09-12T00:03:34.381360+0000","last_clean":"2024-09-12T00:03:34.381360+0000","last_became_active":"2024-09-12T00:03:23.616154+0000","last_became_peered":"2024-09-12T00:03:23.616154+0000","last_unstale":"2024-09-12T00:03:34.381360+0000","last_undegraded":"2024-09-12T00:03:34.381360+0000","last_fullsized":"2024-09-12T00:03:34.381360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:46.335775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T00:03:34.368337+0000","last_change":"2024-09-12T00:03:25.345327+0000","last_active":"2024-09-12T00:03:34.368337+0000","last_peered":"2024-09-12T00:03:34.368337+0000","last_clean":"2024-09-12T00:03:34.368337+0000","last_became_active":"2024-09-12T00:03:25.344917+0000","last_became_peered":"2024-09-12T00:03:25.344917+0000","last_unstale":"2024-09-12T00:03:34.368337+0000","last_undegraded":"2024-09-12T00:03:34.368337+0000","last_fullsized":"2024-09-12T00:03:34.368337+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":210,"num_whiteouts":0,"num_read":976,"num_read_kb":703,"num_write":609,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":581,"ondisk_log_size":581,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":172486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":173970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1015808,"data_stored":763000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":425984,"data_stored":172678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":172367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":171972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1048576,"data_stored":764923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":446464,"data_stored":173144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:03:41.717 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:03:41.717 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-12T00:03:42.071 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 35 2024-09-12T00:03:42.072 INFO:teuthology.orchestra.run.smithi019.stdout:fsid e8cc2cf2-4ebe-41fb-ac6a-f09b6fd34589 2024-09-12T00:03:42.072 INFO:teuthology.orchestra.run.smithi019.stdout:created 2024-09-12T00:02:55.594166+0000 2024-09-12T00:03:42.072 INFO:teuthology.orchestra.run.smithi019.stdout:modified 2024-09-12T00:03:34.337706+0000 2024-09-12T00:03:42.072 INFO:teuthology.orchestra.run.smithi019.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T00:03:42.072 INFO:teuthology.orchestra.run.smithi019.stdout:crush_version 5 2024-09-12T00:03:42.072 INFO:teuthology.orchestra.run.smithi019.stdout:full_ratio 0.95 2024-09-12T00:03:42.072 INFO:teuthology.orchestra.run.smithi019.stdout:backfillfull_ratio 0.9 2024-09-12T00:03:42.072 INFO:teuthology.orchestra.run.smithi019.stdout:nearfull_ratio 0.85 2024-09-12T00:03:42.072 INFO:teuthology.orchestra.run.smithi019.stdout:require_min_compat_client luminous 2024-09-12T00:03:42.072 INFO:teuthology.orchestra.run.smithi019.stdout:min_compat_client jewel 2024-09-12T00:03:42.072 INFO:teuthology.orchestra.run.smithi019.stdout:require_osd_release squid 2024-09-12T00:03:42.073 INFO:teuthology.orchestra.run.smithi019.stdout:stretch_mode_enabled false 2024-09-12T00:03:42.073 INFO:teuthology.orchestra.run.smithi019.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-12T00:03:42.073 INFO:teuthology.orchestra.run.smithi019.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 22 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 4.98 2024-09-12T00:03:42.073 INFO:teuthology.orchestra.run.smithi019.stdout:pool 3 'default.rgw.buckets.data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 25 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-09-12T00:03:42.073 INFO:teuthology.orchestra.run.smithi019.stdout:pool 4 'default.rgw.buckets.index' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 27 flags hashpspool stripe_width 0 application rgw read_balance_score 1.13 2024-09-12T00:03:42.073 INFO:teuthology.orchestra.run.smithi019.stdout:pool 5 '.rgw.root' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 29 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-09-12T00:03:42.073 INFO:teuthology.orchestra.run.smithi019.stdout:pool 6 'default.rgw.log' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 31 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-09-12T00:03:42.073 INFO:teuthology.orchestra.run.smithi019.stdout:pool 7 'default.rgw.control' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 33 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-09-12T00:03:42.073 INFO:teuthology.orchestra.run.smithi019.stdout:pool 8 'default.rgw.meta' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 35 flags hashpspool stripe_width 0 pg_autoscale_bias 4 application rgw read_balance_score 1.50 2024-09-12T00:03:42.073 INFO:teuthology.orchestra.run.smithi019.stdout:max_osd 8 2024-09-12T00:03:42.073 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0 up in weight 1 up_from 14 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.19:6808/846638970,v1:172.21.15.19:6809/846638970] [v2:172.21.15.19:6810/846638970,v1:172.21.15.19:6811/846638970] exists,up af1b1898-c45f-43f5-b9c5-26e491625211 2024-09-12T00:03:42.073 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1 up in weight 1 up_from 14 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.19:6800/889703096,v1:172.21.15.19:6801/889703096] [v2:172.21.15.19:6802/889703096,v1:172.21.15.19:6803/889703096] exists,up fe1aa63d-8e57-4163-98a5-0131e1a60680 2024-09-12T00:03:42.073 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2 up in weight 1 up_from 14 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.19:6816/1847757189,v1:172.21.15.19:6817/1847757189] [v2:172.21.15.19:6818/1847757189,v1:172.21.15.19:6819/1847757189] exists,up 1c97c435-1516-46e1-8fb9-fab9d7419774 2024-09-12T00:03:42.074 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3 up in weight 1 up_from 14 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.19:6824/2630062148,v1:172.21.15.19:6825/2630062148] [v2:172.21.15.19:6826/2630062148,v1:172.21.15.19:6827/2630062148] exists,up 30dc8f77-54f0-4e5a-8adc-3ef4b1c08f71 2024-09-12T00:03:42.074 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4 up in weight 1 up_from 14 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6800/2966848021,v1:172.21.15.135:6801/2966848021] [v2:172.21.15.135:6802/2966848021,v1:172.21.15.135:6803/2966848021] exists,up 0b4e8ec4-cb09-4c05-9ddb-fe1e664e8f03 2024-09-12T00:03:42.074 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5 up in weight 1 up_from 14 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6826/3933885245,v1:172.21.15.135:6827/3933885245] [v2:172.21.15.135:6828/3933885245,v1:172.21.15.135:6829/3933885245] exists,up 44796deb-5225-490a-a526-e0be07036b8d 2024-09-12T00:03:42.074 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6 up in weight 1 up_from 14 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6816/951791611,v1:172.21.15.135:6817/951791611] [v2:172.21.15.135:6818/951791611,v1:172.21.15.135:6819/951791611] exists,up cecfecf3-d6c7-44f3-9c08-259ae76571c7 2024-09-12T00:03:42.074 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7 up in weight 1 up_from 14 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6808/3316717279,v1:172.21.15.135:6809/3316717279] [v2:172.21.15.135:6810/3316717279,v1:172.21.15.135:6811/3316717279] exists,up df0b245a-9a80-4038-8e00-4931eaee68c6 2024-09-12T00:03:42.091 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 14 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.19:6808/846638970,v1:172.21.15.19:6809/846638970] [v2:172.21.15.19:6810/846638970,v1:172.21.15.19:6811/846638970] exists,up af1b1898-c45f-43f5-b9c5-26e491625211', 'osd.1 up in weight 1 up_from 14 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.19:6800/889703096,v1:172.21.15.19:6801/889703096] [v2:172.21.15.19:6802/889703096,v1:172.21.15.19:6803/889703096] exists,up fe1aa63d-8e57-4163-98a5-0131e1a60680', 'osd.2 up in weight 1 up_from 14 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.19:6816/1847757189,v1:172.21.15.19:6817/1847757189] [v2:172.21.15.19:6818/1847757189,v1:172.21.15.19:6819/1847757189] exists,up 1c97c435-1516-46e1-8fb9-fab9d7419774', 'osd.3 up in weight 1 up_from 14 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.19:6824/2630062148,v1:172.21.15.19:6825/2630062148] [v2:172.21.15.19:6826/2630062148,v1:172.21.15.19:6827/2630062148] exists,up 30dc8f77-54f0-4e5a-8adc-3ef4b1c08f71', 'osd.4 up in weight 1 up_from 14 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6800/2966848021,v1:172.21.15.135:6801/2966848021] [v2:172.21.15.135:6802/2966848021,v1:172.21.15.135:6803/2966848021] exists,up 0b4e8ec4-cb09-4c05-9ddb-fe1e664e8f03', 'osd.5 up in weight 1 up_from 14 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6826/3933885245,v1:172.21.15.135:6827/3933885245] [v2:172.21.15.135:6828/3933885245,v1:172.21.15.135:6829/3933885245] exists,up 44796deb-5225-490a-a526-e0be07036b8d', 'osd.6 up in weight 1 up_from 14 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6816/951791611,v1:172.21.15.135:6817/951791611] [v2:172.21.15.135:6818/951791611,v1:172.21.15.135:6819/951791611] exists,up cecfecf3-d6c7-44f3-9c08-259ae76571c7', 'osd.7 up in weight 1 up_from 14 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6808/3316717279,v1:172.21.15.135:6809/3316717279] [v2:172.21.15.135:6810/3316717279,v1:172.21.15.135:6811/3316717279] exists,up df0b245a-9a80-4038-8e00-4931eaee68c6'] 2024-09-12T00:03:42.091 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-12T00:03:42.215 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:03:42.215 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mon.a", 2024-09-12T00:03:42.216 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster": "ceph", 2024-09-12T00:03:42.216 INFO:teuthology.orchestra.run.smithi019.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-12T00:03:42.216 INFO:teuthology.orchestra.run.smithi019.stdout: "admin_socket_mode": "", 2024-09-12T00:03:42.216 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-12T00:03:42.216 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_client_required": "cephx, none", 2024-09-12T00:03:42.216 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_cluster_required": "cephx", 2024-09-12T00:03:42.216 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_debug": "true", 2024-09-12T00:03:42.216 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-12T00:03:42.216 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-12T00:03:42.216 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_service_required": "cephx", 2024-09-12T00:03:42.216 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-12T00:03:42.216 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_supported": "cephx", 2024-09-12T00:03:42.217 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_aio": "true", 2024-09-12T00:03:42.217 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-12T00:03:42.217 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_aio_poll_ms": "250", 2024-09-12T00:03:42.217 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_aio_reap_max": "16", 2024-09-12T00:03:42.217 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_async_discard_threads": "0", 2024-09-12T00:03:42.217 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_block_size": "4096", 2024-09-12T00:03:42.217 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_debug_aio": "false", 2024-09-12T00:03:42.217 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-12T00:03:42.217 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-12T00:03:42.217 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_debug_inflight_ios": "false", 2024-09-12T00:03:42.217 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_enable_discard": "false", 2024-09-12T00:03:42.217 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_flock_retry": "3", 2024-09-12T00:03:42.218 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-12T00:03:42.218 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_inject_crash": "0", 2024-09-12T00:03:42.218 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-12T00:03:42.218 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_ioring": "false", 2024-09-12T00:03:42.218 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_ioring_hipri": "false", 2024-09-12T00:03:42.218 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-12T00:03:42.218 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-12T00:03:42.218 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-12T00:03:42.218 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-12T00:03:42.218 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-12T00:03:42.218 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-12T00:03:42.218 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_type": "", 2024-09-12T00:03:42.218 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_alloc_size": "1048576", 2024-09-12T00:03:42.218 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_allocator": "hybrid", 2024-09-12T00:03:42.219 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_buffered_io": "true", 2024-09-12T00:03:42.219 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_check_for_zeros": "false", 2024-09-12T00:03:42.219 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-12T00:03:42.219 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-12T00:03:42.219 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_compact_log_sync": "false", 2024-09-12T00:03:42.219 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-12T00:03:42.219 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-12T00:03:42.219 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-12T00:03:42.219 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-12T00:03:42.219 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_max_log_runway": "4194304", 2024-09-12T00:03:42.219 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_max_prefetch": "1048576", 2024-09-12T00:03:42.219 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_min_flush_size": "524288", 2024-09-12T00:03:42.219 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_min_log_runway": "1048576", 2024-09-12T00:03:42.220 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_replay_recovery": "false", 2024-09-12T00:03:42.220 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-12T00:03:42.220 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-12T00:03:42.220 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_sync_write": "false", 2024-09-12T00:03:42.220 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-12T00:03:42.220 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-12T00:03:42.220 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-12T00:03:42.220 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_allocation_from_file": "true", 2024-09-12T00:03:42.220 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_allocator": "hybrid", 2024-09-12T00:03:42.220 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_async_db_compaction": "true", 2024-09-12T00:03:42.220 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-12T00:03:42.220 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-12T00:03:42.220 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-12T00:03:42.221 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-12T00:03:42.221 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bdev_label_multi": "true", 2024-09-12T00:03:42.221 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-12T00:03:42.221 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-12T00:03:42.221 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-12T00:03:42.221 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-12T00:03:42.221 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-12T00:03:42.221 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_create": "true", 2024-09-12T00:03:42.221 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_db_create": "false", 2024-09-12T00:03:42.221 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_db_path": "", 2024-09-12T00:03:42.221 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_db_size": "0", 2024-09-12T00:03:42.221 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_path": "", 2024-09-12T00:03:42.221 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_preallocate_file": "false", 2024-09-12T00:03:42.221 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_size": "107374182400", 2024-09-12T00:03:42.222 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_wal_create": "false", 2024-09-12T00:03:42.222 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_wal_path": "", 2024-09-12T00:03:42.222 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_wal_size": "100663296", 2024-09-12T00:03:42.222 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bluefs": "true", 2024-09-12T00:03:42.222 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-12T00:03:42.222 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-12T00:03:42.222 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-12T00:03:42.222 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-12T00:03:42.222 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-12T00:03:42.222 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T00:03:42.222 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T00:03:42.222 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-12T00:03:42.222 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T00:03:42.223 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_autotune": "true", 2024-09-12T00:03:42.223 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-12T00:03:42.223 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-12T00:03:42.223 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-12T00:03:42.223 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-12T00:03:42.223 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_size": "0", 2024-09-12T00:03:42.223 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-12T00:03:42.223 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-12T00:03:42.223 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-12T00:03:42.223 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-12T00:03:42.223 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_type": "2q", 2024-09-12T00:03:42.223 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-12T00:03:42.223 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_clone_cow": "true", 2024-09-12T00:03:42.223 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-12T00:03:42.224 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-12T00:03:42.224 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-12T00:03:42.224 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-12T00:03:42.224 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-12T00:03:42.224 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-12T00:03:42.224 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-12T00:03:42.224 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_mode": "none", 2024-09-12T00:03:42.224 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-12T00:03:42.224 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_csum_type": "crc32c", 2024-09-12T00:03:42.224 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-12T00:03:42.224 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-12T00:03:42.224 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_freelist": "false", 2024-09-12T00:03:42.225 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-12T00:03:42.225 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-12T00:03:42.225 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-12T00:03:42.225 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-12T00:03:42.225 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-12T00:03:42.225 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-12T00:03:42.225 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-12T00:03:42.225 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-12T00:03:42.225 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-12T00:03:42.225 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-12T00:03:42.225 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-12T00:03:42.225 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-12T00:03:42.226 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_small_allocations": "0", 2024-09-12T00:03:42.226 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-12T00:03:42.226 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_default_buffered_read": "true", 2024-09-12T00:03:42.226 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_default_buffered_write": "false", 2024-09-12T00:03:42.226 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-12T00:03:42.226 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-12T00:03:42.226 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-12T00:03:42.226 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-12T00:03:42.226 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-12T00:03:42.227 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-12T00:03:42.227 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-12T00:03:42.227 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-12T00:03:42.227 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-12T00:03:42.227 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fail_eio": "false", 2024-09-12T00:03:42.227 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-12T00:03:42.227 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-12T00:03:42.227 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-12T00:03:42.227 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-12T00:03:42.227 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-12T00:03:42.227 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-12T00:03:42.227 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_mount": "false", 2024-09-12T00:03:42.227 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-12T00:03:42.228 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_umount": "false", 2024-09-12T00:03:42.228 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-12T00:03:42.228 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-12T00:03:42.228 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-12T00:03:42.228 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-12T00:03:42.228 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-12T00:03:42.228 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-12T00:03:42.228 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-12T00:03:42.228 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-12T00:03:42.228 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_ignore_data_csum": "false", 2024-09-12T00:03:42.228 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-12T00:03:42.228 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-12T00:03:42.228 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-12T00:03:42.229 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-12T00:03:42.229 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_log_op_age": "5.000000", 2024-09-12T00:03:42.229 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_alloc_size": "0", 2024-09-12T00:03:42.229 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_blob_size": "0", 2024-09-12T00:03:42.229 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-12T00:03:42.229 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-12T00:03:42.229 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-12T00:03:42.229 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_deferred_txc": "32", 2024-09-12T00:03:42.229 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_min_alloc_size": "0", 2024-09-12T00:03:42.229 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-12T00:03:42.229 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-12T00:03:42.229 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_nid_prealloc": "1024", 2024-09-12T00:03:42.229 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-12T00:03:42.229 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-12T00:03:42.230 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-12T00:03:42.230 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-12T00:03:42.230 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_retry_disk_reads": "3", 2024-09-12T00:03:42.230 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_rocksdb_cf": "true", 2024-09-12T00:03:42.230 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-12T00:03:42.230 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-12T00:03:42.230 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-12T00:03:42.230 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-12T00:03:42.230 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-12T00:03:42.230 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-12T00:03:42.230 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-12T00:03:42.230 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-12T00:03:42.230 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_spdk_mem": "512", 2024-09-12T00:03:42.231 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-12T00:03:42.231 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-12T00:03:42.231 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-12T00:03:42.231 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-12T00:03:42.231 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-12T00:03:42.231 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-12T00:03:42.231 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-12T00:03:42.231 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_tracing": "false", 2024-09-12T00:03:42.231 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-12T00:03:42.231 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-12T00:03:42.231 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-12T00:03:42.231 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-12T00:03:42.231 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-12T00:03:42.231 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-12T00:03:42.232 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-12T00:03:42.232 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-12T00:03:42.232 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-12T00:03:42.232 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_write_v2": "false", 2024-09-12T00:03:42.232 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_write_v2_random": "false", 2024-09-12T00:03:42.232 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_zero_block_detection": "false", 2024-09-12T00:03:42.232 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-12T00:03:42.232 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-12T00:03:42.232 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-12T00:03:42.232 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-12T00:03:42.233 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-12T00:03:42.233 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-12T00:03:42.233 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-12T00:03:42.233 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-12T00:03:42.233 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-12T00:03:42.233 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-12T00:03:42.233 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-12T00:03:42.233 INFO:teuthology.orchestra.run.smithi019.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-12T00:03:42.233 INFO:teuthology.orchestra.run.smithi019.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-12T00:03:42.233 INFO:teuthology.orchestra.run.smithi019.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-12T00:03:42.233 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_cluster_require_signatures": "false", 2024-09-12T00:03:42.234 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_cluster_require_version": "2", 2024-09-12T00:03:42.234 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_require_signatures": "false", 2024-09-12T00:03:42.234 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_require_version": "2", 2024-09-12T00:03:42.234 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_service_require_signatures": "false", 2024-09-12T00:03:42.234 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_service_require_version": "2", 2024-09-12T00:03:42.234 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_sign_messages": "true", 2024-09-12T00:03:42.234 INFO:teuthology.orchestra.run.smithi019.stdout: "chdir": "", 2024-09-12T00:03:42.234 INFO:teuthology.orchestra.run.smithi019.stdout: "client_acl_type": "", 2024-09-12T00:03:42.234 INFO:teuthology.orchestra.run.smithi019.stdout: "client_asio_thread_count": "2", 2024-09-12T00:03:42.234 INFO:teuthology.orchestra.run.smithi019.stdout: "client_cache_mid": "0.750000", 2024-09-12T00:03:42.234 INFO:teuthology.orchestra.run.smithi019.stdout: "client_cache_size": "16384", 2024-09-12T00:03:42.234 INFO:teuthology.orchestra.run.smithi019.stdout: "client_caps_release_delay": "5", 2024-09-12T00:03:42.234 INFO:teuthology.orchestra.run.smithi019.stdout: "client_check_pool_perm": "true", 2024-09-12T00:03:42.234 INFO:teuthology.orchestra.run.smithi019.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-12T00:03:42.235 INFO:teuthology.orchestra.run.smithi019.stdout: "client_debug_force_sync_read": "false", 2024-09-12T00:03:42.235 INFO:teuthology.orchestra.run.smithi019.stdout: "client_debug_getattr_caps": "false", 2024-09-12T00:03:42.235 INFO:teuthology.orchestra.run.smithi019.stdout: "client_debug_inject_features": "", 2024-09-12T00:03:42.235 INFO:teuthology.orchestra.run.smithi019.stdout: "client_debug_inject_tick_delay": "0", 2024-09-12T00:03:42.235 INFO:teuthology.orchestra.run.smithi019.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-12T00:03:42.235 INFO:teuthology.orchestra.run.smithi019.stdout: "client_die_on_failed_remount": "false", 2024-09-12T00:03:42.235 INFO:teuthology.orchestra.run.smithi019.stdout: "client_dirsize_rbytes": "true", 2024-09-12T00:03:42.235 INFO:teuthology.orchestra.run.smithi019.stdout: "client_force_lazyio": "false", 2024-09-12T00:03:42.235 INFO:teuthology.orchestra.run.smithi019.stdout: "client_fs": "", 2024-09-12T00:03:42.235 INFO:teuthology.orchestra.run.smithi019.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-12T00:03:42.235 INFO:teuthology.orchestra.run.smithi019.stdout: "client_inject_release_failure": "false", 2024-09-12T00:03:42.235 INFO:teuthology.orchestra.run.smithi019.stdout: "client_max_inline_size": "4096", 2024-09-12T00:03:42.235 INFO:teuthology.orchestra.run.smithi019.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-12T00:03:42.236 INFO:teuthology.orchestra.run.smithi019.stdout: "client_mds_namespace": "", 2024-09-12T00:03:42.236 INFO:teuthology.orchestra.run.smithi019.stdout: "client_metadata": "", 2024-09-12T00:03:42.236 INFO:teuthology.orchestra.run.smithi019.stdout: "client_mount_gid": "-1", 2024-09-12T00:03:42.236 INFO:teuthology.orchestra.run.smithi019.stdout: "client_mount_timeout": "300", 2024-09-12T00:03:42.236 INFO:teuthology.orchestra.run.smithi019.stdout: "client_mount_uid": "-1", 2024-09-12T00:03:42.236 INFO:teuthology.orchestra.run.smithi019.stdout: "client_mountpoint": "/", 2024-09-12T00:03:42.236 INFO:teuthology.orchestra.run.smithi019.stdout: "client_notify_timeout": "10", 2024-09-12T00:03:42.236 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc": "true", 2024-09-12T00:03:42.236 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc_max_dirty": "104857600", 2024-09-12T00:03:42.236 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-12T00:03:42.236 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc_max_objects": "1000", 2024-09-12T00:03:42.236 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc_size": "209715200", 2024-09-12T00:03:42.236 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc_target_dirty": "8388608", 2024-09-12T00:03:42.237 INFO:teuthology.orchestra.run.smithi019.stdout: "client_permissions": "true", 2024-09-12T00:03:42.237 INFO:teuthology.orchestra.run.smithi019.stdout: "client_quota": "true", 2024-09-12T00:03:42.237 INFO:teuthology.orchestra.run.smithi019.stdout: "client_quota_df": "true", 2024-09-12T00:03:42.237 INFO:teuthology.orchestra.run.smithi019.stdout: "client_readahead_max_bytes": "0", 2024-09-12T00:03:42.237 INFO:teuthology.orchestra.run.smithi019.stdout: "client_readahead_max_periods": "4", 2024-09-12T00:03:42.237 INFO:teuthology.orchestra.run.smithi019.stdout: "client_readahead_min": "131072", 2024-09-12T00:03:42.237 INFO:teuthology.orchestra.run.smithi019.stdout: "client_reconnect_stale": "false", 2024-09-12T00:03:42.237 INFO:teuthology.orchestra.run.smithi019.stdout: "client_shutdown_timeout": "30", 2024-09-12T00:03:42.237 INFO:teuthology.orchestra.run.smithi019.stdout: "client_snapdir": ".snap", 2024-09-12T00:03:42.237 INFO:teuthology.orchestra.run.smithi019.stdout: "client_tick_interval": "1", 2024-09-12T00:03:42.237 INFO:teuthology.orchestra.run.smithi019.stdout: "client_trace": "", 2024-09-12T00:03:42.237 INFO:teuthology.orchestra.run.smithi019.stdout: "client_try_dentry_invalidate": "false", 2024-09-12T00:03:42.237 INFO:teuthology.orchestra.run.smithi019.stdout: "client_use_faked_inos": "false", 2024-09-12T00:03:42.237 INFO:teuthology.orchestra.run.smithi019.stdout: "client_use_random_mds": "false", 2024-09-12T00:03:42.238 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_graylog": "false", 2024-09-12T00:03:42.238 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-12T00:03:42.238 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_graylog_port": "12201", 2024-09-12T00:03:42.238 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_monitors": "default=true", 2024-09-12T00:03:42.238 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_syslog": "false", 2024-09-12T00:03:42.238 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-12T00:03:42.238 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_syslog_level": "info", 2024-09-12T00:03:42.238 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "-", 2024-09-12T00:03:42.238 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_network": "", 2024-09-12T00:03:42.238 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_network_interface": "", 2024-09-12T00:03:42.238 INFO:teuthology.orchestra.run.smithi019.stdout: "compressor_zlib_isal": "false", 2024-09-12T00:03:42.238 INFO:teuthology.orchestra.run.smithi019.stdout: "compressor_zlib_level": "5", 2024-09-12T00:03:42.238 INFO:teuthology.orchestra.run.smithi019.stdout: "compressor_zlib_winsize": "-15", 2024-09-12T00:03:42.239 INFO:teuthology.orchestra.run.smithi019.stdout: "compressor_zstd_level": "1", 2024-09-12T00:03:42.239 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-12T00:03:42.239 INFO:teuthology.orchestra.run.smithi019.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-12T00:03:42.239 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_alien_op_num_threads": "6", 2024-09-12T00:03:42.239 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-12T00:03:42.239 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-12T00:03:42.239 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-12T00:03:42.239 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_osd_stat_interval": "0", 2024-09-12T00:03:42.239 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_seastar_cpu_cores": "", 2024-09-12T00:03:42.239 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_seastar_num_threads": "0", 2024-09-12T00:03:42.239 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_location": "", 2024-09-12T00:03:42.239 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_location_hook": "", 2024-09-12T00:03:42.239 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_location_hook_timeout": "10", 2024-09-12T00:03:42.240 INFO:teuthology.orchestra.run.smithi019.stdout: "daemonize": "false", 2024-09-12T00:03:42.240 INFO:teuthology.orchestra.run.smithi019.stdout: "daos_pool": "tank", 2024-09-12T00:03:42.240 INFO:teuthology.orchestra.run.smithi019.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-12T00:03:42.240 INFO:teuthology.orchestra.run.smithi019.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-12T00:03:42.240 INFO:teuthology.orchestra.run.smithi019.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-12T00:03:42.240 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_alienstore": "0/5", 2024-09-12T00:03:42.240 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_allow_any_pool_priority": "false", 2024-09-12T00:03:42.240 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_asok": "1/5", 2024-09-12T00:03:42.240 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_asok_assert_abort": "false", 2024-09-12T00:03:42.240 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_asserts_on_shutdown": "true", 2024-09-12T00:03:42.240 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_auth": "20/20", 2024-09-12T00:03:42.240 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_bdev": "1/3", 2024-09-12T00:03:42.241 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_bluefs": "1/5", 2024-09-12T00:03:42.241 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_bluestore": "1/5", 2024-09-12T00:03:42.241 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_buffer": "0/1", 2024-09-12T00:03:42.241 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_ceph_dedup": "0/5", 2024-09-12T00:03:42.241 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_ceph_exporter": "1/5", 2024-09-12T00:03:42.241 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_cephfs_mirror": "0/5", 2024-09-12T00:03:42.241 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_cephsqlite": "0/5", 2024-09-12T00:03:42.241 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_client": "0/5", 2024-09-12T00:03:42.241 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_compressor": "1/5", 2024-09-12T00:03:42.241 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_context": "0/1", 2024-09-12T00:03:42.241 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_crimson_interrupt": "0/5", 2024-09-12T00:03:42.241 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_crush": "1/1", 2024-09-12T00:03:42.242 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_crypto": "1/5", 2024-09-12T00:03:42.242 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_cyanstore": "0/5", 2024-09-12T00:03:42.242 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_deliberately_leak_memory": "false", 2024-09-12T00:03:42.242 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_disable_randomized_ping": "false", 2024-09-12T00:03:42.242 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_dpdk": "1/5", 2024-09-12T00:03:42.242 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_eventtrace": "1/5", 2024-09-12T00:03:42.242 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_filer": "0/1", 2024-09-12T00:03:42.242 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_filestore": "1/3", 2024-09-12T00:03:42.242 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_finisher": "1/1", 2024-09-12T00:03:42.242 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_fuse": "1/5", 2024-09-12T00:03:42.242 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_heartbeat_testing_span": "0", 2024-09-12T00:03:42.242 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_heartbeatmap": "1/5", 2024-09-12T00:03:42.242 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-12T00:03:42.243 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_javaclient": "1/5", 2024-09-12T00:03:42.243 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_journal": "1/3", 2024-09-12T00:03:42.243 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_journaler": "0/5", 2024-09-12T00:03:42.243 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_kstore": "1/5", 2024-09-12T00:03:42.243 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_lockdep": "0/1", 2024-09-12T00:03:42.243 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mclock": "1/5", 2024-09-12T00:03:42.243 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds": "1/5", 2024-09-12T00:03:42.243 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_balancer": "1/5", 2024-09-12T00:03:42.243 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_locker": "1/5", 2024-09-12T00:03:42.243 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_log": "1/5", 2024-09-12T00:03:42.243 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_log_expire": "1/5", 2024-09-12T00:03:42.243 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_migrator": "1/5", 2024-09-12T00:03:42.243 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_quiesce": "3/5", 2024-09-12T00:03:42.243 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_memstore": "1/5", 2024-09-12T00:03:42.244 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mgr": "2/5", 2024-09-12T00:03:42.244 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mgrc": "1/5", 2024-09-12T00:03:42.244 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mon": "20/20", 2024-09-12T00:03:42.244 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_monc": "0/10", 2024-09-12T00:03:42.244 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_ms": "1/1", 2024-09-12T00:03:42.244 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_none": "0/5", 2024-09-12T00:03:42.244 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_objclass": "0/5", 2024-09-12T00:03:42.244 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_objectcacher": "0/5", 2024-09-12T00:03:42.244 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_objecter": "0/1", 2024-09-12T00:03:42.244 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_optracker": "0/5", 2024-09-12T00:03:42.244 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_osd": "1/5", 2024-09-12T00:03:42.244 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_paxos": "20/20", 2024-09-12T00:03:42.244 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_perfcounter": "1/5", 2024-09-12T00:03:42.245 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_prioritycache": "1/5", 2024-09-12T00:03:42.245 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rados": "0/5", 2024-09-12T00:03:42.245 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rbd": "0/5", 2024-09-12T00:03:42.245 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rbd_mirror": "0/5", 2024-09-12T00:03:42.245 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rbd_pwl": "0/5", 2024-09-12T00:03:42.245 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rbd_replay": "0/5", 2024-09-12T00:03:42.245 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_refs": "0/0", 2024-09-12T00:03:42.245 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_reserver": "1/1", 2024-09-12T00:03:42.245 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw": "1/5", 2024-09-12T00:03:42.245 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_access": "1/5", 2024-09-12T00:03:42.245 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_datacache": "1/5", 2024-09-12T00:03:42.245 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_dbstore": "1/5", 2024-09-12T00:03:42.245 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_flight": "1/5", 2024-09-12T00:03:42.245 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-12T00:03:42.246 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_notification": "1/5", 2024-09-12T00:03:42.246 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_sync": "1/5", 2024-09-12T00:03:42.246 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rocksdb": "4/5", 2024-09-12T00:03:42.246 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore": "0/5", 2024-09-12T00:03:42.246 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_backref": "0/5", 2024-09-12T00:03:42.246 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_cache": "0/5", 2024-09-12T00:03:42.246 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_cleaner": "0/5", 2024-09-12T00:03:42.246 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_device": "0/5", 2024-09-12T00:03:42.246 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_epm": "0/5", 2024-09-12T00:03:42.246 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-12T00:03:42.246 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_journal": "0/5", 2024-09-12T00:03:42.246 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_lba": "0/5", 2024-09-12T00:03:42.246 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_odata": "0/5", 2024-09-12T00:03:42.247 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_omap": "0/5", 2024-09-12T00:03:42.247 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_onode": "0/5", 2024-09-12T00:03:42.247 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_t": "0/5", 2024-09-12T00:03:42.247 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_tm": "0/5", 2024-09-12T00:03:42.247 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_striper": "0/1", 2024-09-12T00:03:42.247 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_test": "0/5", 2024-09-12T00:03:42.247 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_throttle": "1/1", 2024-09-12T00:03:42.247 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_timer": "0/1", 2024-09-12T00:03:42.247 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_tp": "0/5", 2024-09-12T00:03:42.247 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_trace": "1/5", 2024-09-12T00:03:42.247 INFO:teuthology.orchestra.run.smithi019.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-12T00:03:42.247 INFO:teuthology.orchestra.run.smithi019.stdout: "device_failure_prediction_mode": "none", 2024-09-12T00:03:42.247 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-12T00:03:42.248 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-12T00:03:42.248 INFO:teuthology.orchestra.run.smithi019.stdout: "err_to_graylog": "false", 2024-09-12T00:03:42.248 INFO:teuthology.orchestra.run.smithi019.stdout: "err_to_journald": "false", 2024-09-12T00:03:42.248 INFO:teuthology.orchestra.run.smithi019.stdout: "err_to_stderr": "true", 2024-09-12T00:03:42.248 INFO:teuthology.orchestra.run.smithi019.stdout: "err_to_syslog": "false", 2024-09-12T00:03:42.248 INFO:teuthology.orchestra.run.smithi019.stdout: "event_tracing": "false", 2024-09-12T00:03:42.248 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_addr": "0.0.0.0", 2024-09-12T00:03:42.248 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_cert_file": "", 2024-09-12T00:03:42.248 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_http_port": "9926", 2024-09-12T00:03:42.248 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_key_file": "", 2024-09-12T00:03:42.248 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_prio_limit": "5", 2024-09-12T00:03:42.248 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-12T00:03:42.248 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_sort_metrics": "true", 2024-09-12T00:03:42.248 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_stats_period": "5", 2024-09-12T00:03:42.249 INFO:teuthology.orchestra.run.smithi019.stdout: "fake_statfs_for_testing": "0", 2024-09-12T00:03:42.249 INFO:teuthology.orchestra.run.smithi019.stdout: "fatal_signal_handlers": "true", 2024-09-12T00:03:42.249 INFO:teuthology.orchestra.run.smithi019.stdout: "filer_max_purge_ops": "10", 2024-09-12T00:03:42.249 INFO:teuthology.orchestra.run.smithi019.stdout: "filer_max_truncate_ops": "128", 2024-09-12T00:03:42.249 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_apply_finisher_threads": "1", 2024-09-12T00:03:42.249 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_blackhole": "false", 2024-09-12T00:03:42.249 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_btrfs_clone_range": "true", 2024-09-12T00:03:42.249 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_btrfs_snap": "true", 2024-09-12T00:03:42.249 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_caller_concurrency": "10", 2024-09-12T00:03:42.249 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_collect_device_partition_information": "true", 2024-09-12T00:03:42.249 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_commit_timeout": "600.000000", 2024-09-12T00:03:42.249 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_debug_inject_read_err": "false", 2024-09-12T00:03:42.249 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_debug_omap_check": "false", 2024-09-12T00:03:42.250 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_debug_verify_split": "false", 2024-09-12T00:03:42.250 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_dump_file": "", 2024-09-12T00:03:42.250 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-12T00:03:42.250 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-12T00:03:42.250 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fadvise": "true", 2024-09-12T00:03:42.250 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fail_eio": "true", 2024-09-12T00:03:42.250 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fd_cache_shards": "16", 2024-09-12T00:03:42.250 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fd_cache_size": "128", 2024-09-12T00:03:42.250 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fiemap": "false", 2024-09-12T00:03:42.250 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fiemap_threshold": "4096", 2024-09-12T00:03:42.250 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-12T00:03:42.250 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-12T00:03:42.250 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_inject_stall": "0", 2024-09-12T00:03:42.250 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_journal_parallel": "false", 2024-09-12T00:03:42.251 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_journal_trailing": "false", 2024-09-12T00:03:42.251 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_journal_writeahead": "false", 2024-09-12T00:03:42.251 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_kill_at": "0", 2024-09-12T00:03:42.251 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-12T00:03:42.251 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-12T00:03:42.251 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-12T00:03:42.251 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-12T00:03:42.251 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-12T00:03:42.251 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattrs": "0", 2024-09-12T00:03:42.251 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-12T00:03:42.251 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-12T00:03:42.251 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-12T00:03:42.251 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-12T00:03:42.251 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_xattr_value_size": "0", 2024-09-12T00:03:42.252 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-12T00:03:42.252 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-12T00:03:42.252 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-12T00:03:42.252 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_merge_threshold": "-10", 2024-09-12T00:03:42.252 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-12T00:03:42.252 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_odsync_write": "false", 2024-09-12T00:03:42.252 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_omap_backend": "rocksdb", 2024-09-12T00:03:42.252 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_omap_backend_path": "", 2024-09-12T00:03:42.252 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-12T00:03:42.252 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-12T00:03:42.252 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-12T00:03:42.252 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_op_thread_timeout": "60", 2024-09-12T00:03:42.252 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_op_threads": "2", 2024-09-12T00:03:42.253 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_punch_hole": "false", 2024-09-12T00:03:42.253 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-12T00:03:42.253 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-12T00:03:42.253 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-12T00:03:42.253 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-12T00:03:42.253 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-12T00:03:42.253 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-12T00:03:42.253 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-12T00:03:42.253 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-12T00:03:42.253 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-12T00:03:42.253 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_max_ops": "50", 2024-09-12T00:03:42.253 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-12T00:03:42.253 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_seek_data_hole": "false", 2024-09-12T00:03:42.254 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_sloppy_crc": "false", 2024-09-12T00:03:42.254 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-12T00:03:42.254 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_splice": "false", 2024-09-12T00:03:42.254 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_split_multiple": "2", 2024-09-12T00:03:42.254 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_split_rand_factor": "20", 2024-09-12T00:03:42.254 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_update_to": "1000", 2024-09-12T00:03:42.254 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-12T00:03:42.254 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-12T00:03:42.254 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-12T00:03:42.254 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-12T00:03:42.254 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-12T00:03:42.254 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-12T00:03:42.254 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_enable": "true", 2024-09-12T00:03:42.254 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-12T00:03:42.255 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-12T00:03:42.255 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-12T00:03:42.255 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-12T00:03:42.255 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-12T00:03:42.255 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-12T00:03:42.255 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_xfs_extsize": "false", 2024-09-12T00:03:42.255 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_zfs_snap": "false", 2024-09-12T00:03:42.255 INFO:teuthology.orchestra.run.smithi019.stdout: "fio_dir": "/tmp/fio", 2024-09-12T00:03:42.255 INFO:teuthology.orchestra.run.smithi019.stdout: "fsid": "e8cc2cf2-4ebe-41fb-ac6a-f09b6fd34589", 2024-09-12T00:03:42.255 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_allow_other": "true", 2024-09-12T00:03:42.255 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_atomic_o_trunc": "true", 2024-09-12T00:03:42.255 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_big_writes": "true", 2024-09-12T00:03:42.255 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_debug": "false", 2024-09-12T00:03:42.256 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_default_permissions": "false", 2024-09-12T00:03:42.256 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_disable_pagecache": "false", 2024-09-12T00:03:42.256 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_max_write": "0", 2024-09-12T00:03:42.256 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_multithreaded": "true", 2024-09-12T00:03:42.256 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_require_active_mds": "true", 2024-09-12T00:03:42.256 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_set_user_groups": "true", 2024-09-12T00:03:42.256 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_splice_move": "true", 2024-09-12T00:03:42.256 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_splice_read": "true", 2024-09-12T00:03:42.256 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_splice_write": "true", 2024-09-12T00:03:42.256 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-12T00:03:42.256 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_use_invalidate_cb": "true", 2024-09-12T00:03:42.256 INFO:teuthology.orchestra.run.smithi019.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-12T00:03:42.256 INFO:teuthology.orchestra.run.smithi019.stdout: "gss_target_name": "ceph", 2024-09-12T00:03:42.256 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_file": "", 2024-09-12T00:03:42.257 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_inject_failure": "0", 2024-09-12T00:03:42.257 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_interval": "5", 2024-09-12T00:03:42.257 INFO:teuthology.orchestra.run.smithi019.stdout: "host": "smithi019", 2024-09-12T00:03:42.257 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-12T00:03:42.257 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-12T00:03:42.257 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-12T00:03:42.257 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-12T00:03:42.257 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-12T00:03:42.257 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-12T00:03:42.257 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-12T00:03:42.257 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-12T00:03:42.257 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-12T00:03:42.257 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-12T00:03:42.258 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-12T00:03:42.258 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-12T00:03:42.258 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-12T00:03:42.258 INFO:teuthology.orchestra.run.smithi019.stdout: "inject_early_sigterm": "false", 2024-09-12T00:03:42.258 INFO:teuthology.orchestra.run.smithi019.stdout: "jaeger_agent_port": "6799", 2024-09-12T00:03:42.258 INFO:teuthology.orchestra.run.smithi019.stdout: "jaeger_tracing_enable": "false", 2024-09-12T00:03:42.258 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_aio": "true", 2024-09-12T00:03:42.258 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_align_min_size": "65536", 2024-09-12T00:03:42.258 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_block_align": "true", 2024-09-12T00:03:42.258 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_block_size": "4096", 2024-09-12T00:03:42.258 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_dio": "true", 2024-09-12T00:03:42.258 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_discard": "false", 2024-09-12T00:03:42.258 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_force_aio": "false", 2024-09-12T00:03:42.258 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_ignore_corruption": "false", 2024-09-12T00:03:42.259 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_max_write_bytes": "10485760", 2024-09-12T00:03:42.259 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_max_write_entries": "100", 2024-09-12T00:03:42.259 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_replay_from": "0", 2024-09-12T00:03:42.259 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-12T00:03:42.259 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-12T00:03:42.259 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-12T00:03:42.259 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-12T00:03:42.259 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_write_header_frequency": "0", 2024-09-12T00:03:42.259 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_zero_on_create": "false", 2024-09-12T00:03:42.259 INFO:teuthology.orchestra.run.smithi019.stdout: "journaler_prefetch_periods": "10", 2024-09-12T00:03:42.259 INFO:teuthology.orchestra.run.smithi019.stdout: "journaler_prezero_periods": "5", 2024-09-12T00:03:42.259 INFO:teuthology.orchestra.run.smithi019.stdout: "journaler_write_head_interval": "15", 2024-09-12T00:03:42.259 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "", 2024-09-12T00:03:42.259 INFO:teuthology.orchestra.run.smithi019.stdout: "keyfile": "", 2024-09-12T00:03:42.260 INFO:teuthology.orchestra.run.smithi019.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-12T00:03:42.260 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_backend": "rocksdb", 2024-09-12T00:03:42.260 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_default_stripe_size": "65536", 2024-09-12T00:03:42.260 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_fsck_on_mount": "false", 2024-09-12T00:03:42.260 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-12T00:03:42.260 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_max_bytes": "67108864", 2024-09-12T00:03:42.260 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_max_ops": "512", 2024-09-12T00:03:42.260 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_nid_prealloc": "1024", 2024-09-12T00:03:42.260 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_onode_map_size": "1024", 2024-09-12T00:03:42.260 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-12T00:03:42.260 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_sync_submit_transaction": "false", 2024-09-12T00:03:42.260 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_sync_transaction": "false", 2024-09-12T00:03:42.261 INFO:teuthology.orchestra.run.smithi019.stdout: "librados_thread_count": "2", 2024-09-12T00:03:42.261 INFO:teuthology.orchestra.run.smithi019.stdout: "lockdep": "false", 2024-09-12T00:03:42.261 INFO:teuthology.orchestra.run.smithi019.stdout: "lockdep_force_backtrace": "false", 2024-09-12T00:03:42.261 INFO:teuthology.orchestra.run.smithi019.stdout: "log_coarse_timestamps": "true", 2024-09-12T00:03:42.261 INFO:teuthology.orchestra.run.smithi019.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-12T00:03:42.261 INFO:teuthology.orchestra.run.smithi019.stdout: "log_flush_on_exit": "false", 2024-09-12T00:03:42.261 INFO:teuthology.orchestra.run.smithi019.stdout: "log_graylog_host": "127.0.0.1", 2024-09-12T00:03:42.261 INFO:teuthology.orchestra.run.smithi019.stdout: "log_graylog_port": "12201", 2024-09-12T00:03:42.261 INFO:teuthology.orchestra.run.smithi019.stdout: "log_max_new": "1000", 2024-09-12T00:03:42.261 INFO:teuthology.orchestra.run.smithi019.stdout: "log_max_recent": "10000", 2024-09-12T00:03:42.261 INFO:teuthology.orchestra.run.smithi019.stdout: "log_stderr_prefix": "", 2024-09-12T00:03:42.261 INFO:teuthology.orchestra.run.smithi019.stdout: "log_stop_at_utilization": "0.970000", 2024-09-12T00:03:42.261 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": "true", 2024-09-12T00:03:42.261 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_graylog": "false", 2024-09-12T00:03:42.262 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_journald": "false", 2024-09-12T00:03:42.262 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_stderr": "false", 2024-09-12T00:03:42.262 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_syslog": "false", 2024-09-12T00:03:42.262 INFO:teuthology.orchestra.run.smithi019.stdout: "max_rotating_auth_attempts": "10", 2024-09-12T00:03:42.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-12T00:03:42.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_action_on_write_error": "1", 2024-09-12T00:03:42.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_alternate_name_max": "8192", 2024-09-12T00:03:42.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_asio_thread_count": "2", 2024-09-12T00:03:42.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_export_pin": "true", 2024-09-12T00:03:42.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_fragment_dirs": "true", 2024-09-12T00:03:42.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-12T00:03:42.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_fragment_interval": "5", 2024-09-12T00:03:42.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-12T00:03:42.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-12T00:03:42.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_interval": "10", 2024-09-12T00:03:42.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_max": "-1", 2024-09-12T00:03:42.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_max_until": "-1", 2024-09-12T00:03:42.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_merge_size": "50", 2024-09-12T00:03:42.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_midchunk": "0.300000", 2024-09-12T00:03:42.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-12T00:03:42.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_min_start": "0.200000", 2024-09-12T00:03:42.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_minchunk": "0.001000", 2024-09-12T00:03:42.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_mode": "0", 2024-09-12T00:03:42.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_need_max": "1.200000", 2024-09-12T00:03:42.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_need_min": "0.800000", 2024-09-12T00:03:42.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_overload_epochs": "2", 2024-09-12T00:03:42.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-12T00:03:42.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-12T00:03:42.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_split_bits": "3", 2024-09-12T00:03:42.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-12T00:03:42.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_split_size": "10000", 2024-09-12T00:03:42.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-12T00:03:42.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_target_decay": "10.000000", 2024-09-12T00:03:42.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-12T00:03:42.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_beacon_grace": "15.000000", 2024-09-12T00:03:42.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_beacon_interval": "4.000000", 2024-09-12T00:03:42.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-12T00:03:42.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-12T00:03:42.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_mid": "0.700000", 2024-09-12T00:03:42.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-12T00:03:42.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_quiesce_delay": "0", 2024-09-12T00:03:42.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-12T00:03:42.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-12T00:03:42.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-12T00:03:42.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_release_free_interval": "10", 2024-09-12T00:03:42.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_reservation": "0.050000", 2024-09-12T00:03:42.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-12T00:03:42.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_trim_interval": "1", 2024-09-12T00:03:42.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_trim_threshold": "262144", 2024-09-12T00:03:42.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-12T00:03:42.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-12T00:03:42.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-12T00:03:42.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_client_prealloc_inos": "1000", 2024-09-12T00:03:42.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-12T00:03:42.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_connect_bootstrapping": "false", 2024-09-12T00:03:42.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_damage_table_max_entries": "10000", 2024-09-12T00:03:42.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-12T00:03:42.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_debug_auth_pins": "false", 2024-09-12T00:03:42.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_debug_frag": "false", 2024-09-12T00:03:42.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_debug_scatterstat": "false", 2024-09-12T00:03:42.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_debug_subtrees": "false", 2024-09-12T00:03:42.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_decay_halflife": "5.000000", 2024-09-12T00:03:42.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_default_dir_hash": "2", 2024-09-12T00:03:42.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_defer_session_stale": "true", 2024-09-12T00:03:42.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_deny_all_reconnect": "false", 2024-09-12T00:03:42.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dir_keys_per_op": "16384", 2024-09-12T00:03:42.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dir_max_commit_size": "10", 2024-09-12T00:03:42.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dir_max_entries": "0", 2024-09-12T00:03:42.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dir_prefetch": "true", 2024-09-12T00:03:42.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-12T00:03:42.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-12T00:03:42.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dump_cache_on_map": "false", 2024-09-12T00:03:42.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-12T00:03:42.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-12T00:03:42.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_early_reply": "true", 2024-09-12T00:03:42.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_enable_op_tracker": "true", 2024-09-12T00:03:42.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_enforce_unique_name": "true", 2024-09-12T00:03:42.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-12T00:03:42.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-12T00:03:42.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_export_ephemeral_random": "true", 2024-09-12T00:03:42.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-12T00:03:42.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-12T00:03:42.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-12T00:03:42.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-12T00:03:42.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-12T00:03:42.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-12T00:03:42.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-12T00:03:42.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-12T00:03:42.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_health_summarize_threshold": "10", 2024-09-12T00:03:42.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-12T00:03:42.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-12T00:03:42.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_inject_health_dummy": "false", 2024-09-12T00:03:42.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-12T00:03:42.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_inject_migrator_session_race": "false", 2024-09-12T00:03:42.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-12T00:03:42.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-12T00:03:42.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-12T00:03:42.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_join_fs": "", 2024-09-12T00:03:42.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_journal_format": "1", 2024-09-12T00:03:42.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-12T00:03:42.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_create_at": "0", 2024-09-12T00:03:42.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_dirfrag_at": "0", 2024-09-12T00:03:42.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_export_at": "0", 2024-09-12T00:03:42.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_import_at": "0", 2024-09-12T00:03:42.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_journal_at": "0", 2024-09-12T00:03:42.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_journal_expire_at": "0", 2024-09-12T00:03:42.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_journal_replay_at": "0", 2024-09-12T00:03:42.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_link_at": "0", 2024-09-12T00:03:42.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_mdstable_at": "0", 2024-09-12T00:03:42.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_openc_at": "0", 2024-09-12T00:03:42.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_rename_at": "0", 2024-09-12T00:03:42.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_shutdown_at": "0", 2024-09-12T00:03:42.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_event_large_threshold": "524288", 2024-09-12T00:03:42.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_events_per_segment": "1024", 2024-09-12T00:03:42.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-12T00:03:42.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_max_events": "-1", 2024-09-12T00:03:42.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_max_segments": "128", 2024-09-12T00:03:42.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_pause": "false", 2024-09-12T00:03:42.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_segment_size": "0", 2024-09-12T00:03:42.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-12T00:03:42.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-12T00:03:42.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-12T00:03:42.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_trim_threshold": "128", 2024-09-12T00:03:42.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-12T00:03:42.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_warn_factor": "2.000000", 2024-09-12T00:03:42.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_caps_per_client": "1048576", 2024-09-12T00:03:42.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_completed_flushes": "100000", 2024-09-12T00:03:42.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_completed_requests": "100000", 2024-09-12T00:03:42.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_export_size": "20971520", 2024-09-12T00:03:42.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_file_recover": "32", 2024-09-12T00:03:42.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_purge_files": "64", 2024-09-12T00:03:42.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_purge_ops": "8192", 2024-09-12T00:03:42.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-12T00:03:42.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-12T00:03:42.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_snaps_per_dir": "100", 2024-09-12T00:03:42.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_metrics_update_interval": "2", 2024-09-12T00:03:42.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_min_caps_per_client": "100", 2024-09-12T00:03:42.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_min_caps_working_set": "10000", 2024-09-12T00:03:42.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-12T00:03:42.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_numa_node": "-1", 2024-09-12T00:03:42.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-12T00:03:42.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_complaint_time": "30.000000", 2024-09-12T00:03:42.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_history_duration": "600", 2024-09-12T00:03:42.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_history_size": "20", 2024-09-12T00:03:42.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_history_slow_op_size": "20", 2024-09-12T00:03:42.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-12T00:03:42.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_log_threshold": "5", 2024-09-12T00:03:42.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_ping_grace": "15", 2024-09-12T00:03:42.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_ping_interval": "5", 2024-09-12T00:03:42.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-12T00:03:42.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-12T00:03:42.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_max_caps": "30000", 2024-09-12T00:03:42.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-12T00:03:42.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-12T00:03:42.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-12T00:03:42.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_warning_threshold": "262144", 2024-09-12T00:03:42.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-12T00:03:42.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_replay_interval": "1.000000", 2024-09-12T00:03:42.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-12T00:03:42.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-12T00:03:42.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_root_ino_gid": "0", 2024-09-12T00:03:42.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_root_ino_uid": "0", 2024-09-12T00:03:42.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-12T00:03:42.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-12T00:03:42.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-12T00:03:42.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-12T00:03:42.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-12T00:03:42.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-12T00:03:42.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-12T00:03:42.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-12T00:03:42.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-12T00:03:42.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-12T00:03:42.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-12T00:03:42.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-12T00:03:42.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_shutdown_check": "0", 2024-09-12T00:03:42.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_skip_ino": "0", 2024-09-12T00:03:42.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-12T00:03:42.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_snap_max_uid": "4294967294", 2024-09-12T00:03:42.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_snap_min_uid": "0", 2024-09-12T00:03:42.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_snap_rstat": "false", 2024-09-12T00:03:42.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_standby_replay_damaged": "false", 2024-09-12T00:03:42.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_symlink_recovery": "true", 2024-09-12T00:03:42.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-12T00:03:42.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_thrash_exports": "0", 2024-09-12T00:03:42.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_thrash_fragments": "0", 2024-09-12T00:03:42.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_tick_interval": "5.000000", 2024-09-12T00:03:42.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_valgrind_exit": "false", 2024-09-12T00:03:42.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_verify_backtrace": "1", 2024-09-12T00:03:42.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_verify_scatter": "false", 2024-09-12T00:03:42.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-12T00:03:42.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_wipe_sessions": "false", 2024-09-12T00:03:42.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mempool_debug": "false", 2024-09-12T00:03:42.276 INFO:teuthology.orchestra.run.smithi019.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-12T00:03:42.276 INFO:teuthology.orchestra.run.smithi019.stdout: "memstore_device_bytes": "1073741824", 2024-09-12T00:03:42.276 INFO:teuthology.orchestra.run.smithi019.stdout: "memstore_page_set": "false", 2024-09-12T00:03:42.276 INFO:teuthology.orchestra.run.smithi019.stdout: "memstore_page_size": "65536", 2024-09-12T00:03:42.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_client_bytes": "134217728", 2024-09-12T00:03:42.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_client_messages": "512", 2024-09-12T00:03:42.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-12T00:03:42.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-12T00:03:42.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-12T00:03:42.277 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-12T00:03:42.277 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_disabled_modules": "", 2024-09-12T00:03:42.277 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_enable_op_tracker": "true", 2024-09-12T00:03:42.277 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-12T00:03:42.277 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_max_pg_creating": "1024", 2024-09-12T00:03:42.277 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_max_pg_num_change": "128", 2024-09-12T00:03:42.277 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_mds_bytes": "134217728", 2024-09-12T00:03:42.277 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_mds_messages": "128", 2024-09-12T00:03:42.277 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-12T00:03:42.277 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_mon_bytes": "134217728", 2024-09-12T00:03:42.277 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_mon_messages": "128", 2024-09-12T00:03:42.277 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-12T00:03:42.277 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-12T00:03:42.277 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_op_history_duration": "600", 2024-09-12T00:03:42.278 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_op_history_size": "20", 2024-09-12T00:03:42.278 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-12T00:03:42.278 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-12T00:03:42.278 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_op_log_threshold": "5", 2024-09-12T00:03:42.278 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_osd_bytes": "536870912", 2024-09-12T00:03:42.278 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_osd_messages": "8192", 2024-09-12T00:03:42.278 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_pool": "true", 2024-09-12T00:03:42.278 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-12T00:03:42.278 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_standby_modules": "true", 2024-09-12T00:03:42.278 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_stats_period": "5", 2024-09-12T00:03:42.278 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_stats_threshold": "5", 2024-09-12T00:03:42.278 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_tick_period": "2", 2024-09-12T00:03:42.278 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-12T00:03:42.278 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-12T00:03:42.279 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_allow_pool_delete": "true", 2024-09-12T00:03:42.279 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_allow_pool_size_one": "true", 2024-09-12T00:03:42.279 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_auth_validate_all_caps": "true", 2024-09-12T00:03:42.279 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-12T00:03:42.279 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-12T00:03:42.279 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_bytes": "104857600", 2024-09-12T00:03:42.279 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_directed_command_retry": "2", 2024-09-12T00:03:42.279 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-12T00:03:42.279 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-12T00:03:42.279 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-12T00:03:42.279 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-12T00:03:42.279 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_hunt_parallel": "3", 2024-09-12T00:03:42.279 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_log_interval": "1.000000", 2024-09-12T00:03:42.279 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-12T00:03:42.280 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_ping_interval": "10.000000", 2024-09-12T00:03:42.280 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-12T00:03:42.280 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_target_rank": "-1", 2024-09-12T00:03:42.280 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-12T00:03:42.280 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-12T00:03:42.280 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-12T00:03:42.280 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_level": "debug", 2024-09-12T00:03:42.280 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_file": "true", 2024-09-12T00:03:42.280 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-12T00:03:42.280 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-12T00:03:42.280 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-12T00:03:42.280 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_journald": "false", 2024-09-12T00:03:42.280 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-12T00:03:42.281 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-12T00:03:42.281 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-12T00:03:42.281 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_compact_on_bootstrap": "false", 2024-09-12T00:03:42.281 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_compact_on_start": "false", 2024-09-12T00:03:42.281 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_compact_on_trim": "true", 2024-09-12T00:03:42.281 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-12T00:03:42.281 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-12T00:03:42.281 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-12T00:03:42.281 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cpu_threads": "4", 2024-09-12T00:03:42.281 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_crush_min_required_version": "hammer", 2024-09-12T00:03:42.281 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_daemon_bytes": "419430400", 2024-09-12T00:03:42.282 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-12T00:03:42.282 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_data_avail_crit": "5", 2024-09-12T00:03:42.282 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_data_avail_warn": "5", 2024-09-12T00:03:42.282 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_data_size_warn": "16106127360", 2024-09-12T00:03:42.282 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-12T00:03:42.282 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-12T00:03:42.282 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_dump_json": "false", 2024-09-12T00:03:42.282 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-12T00:03:42.282 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_dump_transactions": "false", 2024-09-12T00:03:42.282 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_extra_checks": "false", 2024-09-12T00:03:42.282 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-12T00:03:42.282 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-12T00:03:42.282 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_no_require_reef": "false", 2024-09-12T00:03:42.283 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_no_require_squid": "false", 2024-09-12T00:03:42.283 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-12T00:03:42.283 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-12T00:03:42.283 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-12T00:03:42.283 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_down_mkfs_grace": "120", 2024-09-12T00:03:42.283 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_down_uptime_grace": "60", 2024-09-12T00:03:42.283 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_election_default_strategy": "1", 2024-09-12T00:03:42.283 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_election_timeout": "5.000000", 2024-09-12T00:03:42.283 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-12T00:03:42.283 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_elector_ping_divisor": "2", 2024-09-12T00:03:42.283 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-12T00:03:42.283 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_enable_op_tracker": "true", 2024-09-12T00:03:42.283 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_fake_pool_delete": "false", 2024-09-12T00:03:42.284 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_force_quorum_join": "false", 2024-09-12T00:03:42.284 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-12T00:03:42.284 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_globalid_prealloc": "10000", 2024-09-12T00:03:42.284 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_detail_to_clog": "false", 2024-09-12T00:03:42.284 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_log_update_period": "5", 2024-09-12T00:03:42.284 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_max_detail": "50", 2024-09-12T00:03:42.284 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_to_clog": "true", 2024-09-12T00:03:42.284 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_to_clog_interval": "600", 2024-09-12T00:03:42.284 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-12T00:03:42.284 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_host": "172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],172.21.15.135", 2024-09-12T00:03:42.284 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_host_override": "", 2024-09-12T00:03:42.284 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_initial_members": "", 2024-09-12T00:03:42.284 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-12T00:03:42.285 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-12T00:03:42.285 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-12T00:03:42.285 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-12T00:03:42.285 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-12T00:03:42.285 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_lease": "5.000000", 2024-09-12T00:03:42.285 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-12T00:03:42.285 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-12T00:03:42.285 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_log_full_interval": "50", 2024-09-12T00:03:42.285 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_log_max": "10000", 2024-09-12T00:03:42.285 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_log_max_summary": "50", 2024-09-12T00:03:42.285 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-12T00:03:42.285 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_log_epochs": "500", 2024-09-12T00:03:42.285 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-12T00:03:42.285 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-12T00:03:42.286 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-12T00:03:42.286 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_osd": "10000", 2024-09-12T00:03:42.286 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_pg_per_osd": "10000", 2024-09-12T00:03:42.286 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_pool_pg_num": "65536", 2024-09-12T00:03:42.286 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-12T00:03:42.286 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-12T00:03:42.286 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mds_force_trim_to": "0", 2024-09-12T00:03:42.286 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mds_skip_sanity": "false", 2024-09-12T00:03:42.286 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_memory_autotune": "true", 2024-09-12T00:03:42.286 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_memory_target": "2147483648", 2024-09-12T00:03:42.286 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_beacon_grace": "30", 2024-09-12T00:03:42.286 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-12T00:03:42.286 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_digest_period": "5", 2024-09-12T00:03:42.286 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_inactive_grace": "60", 2024-09-12T00:03:42.287 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-12T00:03:42.287 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-12T00:03:42.287 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_min_osdmap_epochs": "500", 2024-09-12T00:03:42.287 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-12T00:03:42.287 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-12T00:03:42.287 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_complaint_time": "30", 2024-09-12T00:03:42.287 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_history_duration": "600", 2024-09-12T00:03:42.287 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_history_size": "20", 2024-09-12T00:03:42.287 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_history_slow_op_size": "20", 2024-09-12T00:03:42.287 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-12T00:03:42.287 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_log_threshold": "5", 2024-09-12T00:03:42.287 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-12T00:03:42.287 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-12T00:03:42.288 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-12T00:03:42.288 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_auto_mark_in": "false", 2024-09-12T00:03:42.288 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-12T00:03:42.288 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-12T00:03:42.288 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-12T00:03:42.288 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_cache_size": "500", 2024-09-12T00:03:42.288 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-12T00:03:42.288 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-12T00:03:42.288 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-12T00:03:42.288 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_down_out_interval": "600", 2024-09-12T00:03:42.288 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-12T00:03:42.288 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-12T00:03:42.288 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_force_trim_to": "0", 2024-09-12T00:03:42.289 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-12T00:03:42.289 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-12T00:03:42.289 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-12T00:03:42.289 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-12T00:03:42.289 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-12T00:03:42.289 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-12T00:03:42.289 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-12T00:03:42.289 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_min_down_reporters": "2", 2024-09-12T00:03:42.289 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-12T00:03:42.289 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-12T00:03:42.290 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-12T00:03:42.290 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-12T00:03:42.290 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-12T00:03:42.290 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-12T00:03:42.290 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_report_timeout": "900", 2024-09-12T00:03:42.290 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-12T00:03:42.290 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-12T00:03:42.290 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-12T00:03:42.290 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-12T00:03:42.290 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-12T00:03:42.291 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-12T00:03:42.291 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-12T00:03:42.291 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-12T00:03:42.291 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-12T00:03:42.291 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_stuck_threshold": "60", 2024-09-12T00:03:42.291 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-12T00:03:42.291 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-12T00:03:42.291 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-12T00:03:42.291 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-12T00:03:42.291 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-12T00:03:42.291 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-12T00:03:42.292 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_probe_timeout": "2.000000", 2024-09-12T00:03:42.292 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_reweight_max_change": "0.050000", 2024-09-12T00:03:42.292 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_reweight_max_osds": "4", 2024-09-12T00:03:42.292 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-12T00:03:42.292 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-12T00:03:42.292 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-12T00:03:42.292 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-12T00:03:42.292 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-12T00:03:42.292 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_scrub_interval": "86400", 2024-09-12T00:03:42.292 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_scrub_max_keys": "100", 2024-09-12T00:03:42.292 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_scrub_timeout": "300", 2024-09-12T00:03:42.292 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_session_timeout": "300", 2024-09-12T00:03:42.293 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_smart_report_timeout": "5", 2024-09-12T00:03:42.293 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_stat_smooth_intervals": "6", 2024-09-12T00:03:42.293 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-12T00:03:42.293 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_stretch_pool_min_size": "2", 2024-09-12T00:03:42.293 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_stretch_pool_size": "4", 2024-09-12T00:03:42.293 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-12T00:03:42.293 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-12T00:03:42.293 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_debug": "false", 2024-09-12T00:03:42.293 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-12T00:03:42.293 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-12T00:03:42.293 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_provider_kill_at": "0", 2024-09-12T00:03:42.294 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_requester_kill_at": "0", 2024-09-12T00:03:42.294 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_timeout": "60.000000", 2024-09-12T00:03:42.294 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_target_pg_per_osd": "100", 2024-09-12T00:03:42.294 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_tick_interval": "5", 2024-09-12T00:03:42.294 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_timecheck_interval": "300.000000", 2024-09-12T00:03:42.294 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-12T00:03:42.294 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_use_min_delay_socket": "false", 2024-09-12T00:03:42.294 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_older_version_delay": "604800", 2024-09-12T00:03:42.294 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-12T00:03:42.294 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-12T00:03:42.294 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-12T00:03:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-12T00:03:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-12T00:03:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-12T00:03:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-12T00:03:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_misplaced": "false", 2024-09-12T00:03:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-12T00:03:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_older_version": "true", 2024-09-12T00:03:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-12T00:03:42.295 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-12T00:03:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-12T00:03:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-12T00:03:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-12T00:03:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-12T00:03:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-12T00:03:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-12T00:03:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-12T00:03:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "monmap": "", 2024-09-12T00:03:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T00:03:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-12T00:03:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-12T00:03:42.296 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T00:03:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-12T00:03:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-12T00:03:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_tracing_enabled": "false", 2024-09-12T00:03:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_op_threads": "3", 2024-09-12T00:03:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-12T00:03:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_cm": "false", 2024-09-12T00:03:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_device_name": "", 2024-09-12T00:03:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_dscp": "96", 2024-09-12T00:03:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-12T00:03:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-12T00:03:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_local_gid": "", 2024-09-12T00:03:42.298 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-12T00:03:42.298 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_port_num": "1", 2024-09-12T00:03:42.298 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-12T00:03:42.298 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-12T00:03:42.298 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-12T00:03:42.298 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-12T00:03:42.298 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_sl": "3", 2024-09-12T00:03:42.298 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_support_srq": "true", 2024-09-12T00:03:42.298 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_type": "ib", 2024-09-12T00:03:42.298 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_reap_threshold": "5", 2024-09-12T00:03:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_before_connect": "false", 2024-09-12T00:03:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_ipv4": "true", 2024-09-12T00:03:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_ipv6": "false", 2024-09-12T00:03:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_msgr1": "true", 2024-09-12T00:03:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_msgr2": "true", 2024-09-12T00:03:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_port_max": "7568", 2024-09-12T00:03:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_port_min": "6800", 2024-09-12T00:03:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-12T00:03:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_retry_count": "3", 2024-09-12T00:03:42.299 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_retry_delay": "5", 2024-09-12T00:03:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_blackhole_client": "false", 2024-09-12T00:03:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_blackhole_mds": "false", 2024-09-12T00:03:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_blackhole_mgr": "false", 2024-09-12T00:03:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_blackhole_mon": "false", 2024-09-12T00:03:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_blackhole_osd": "false", 2024-09-12T00:03:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_client_mode": "crc secure", 2024-09-12T00:03:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-12T00:03:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_cluster_mode": "crc secure", 2024-09-12T00:03:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_cluster_type": "", 2024-09-12T00:03:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_compress_secure": "false", 2024-09-12T00:03:42.300 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_connection_idle_timeout": "900", 2024-09-12T00:03:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_connection_ready_timeout": "10", 2024-09-12T00:03:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_crc_data": "true", 2024-09-12T00:03:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_crc_header": "true", 2024-09-12T00:03:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_die_on_bad_msg": "false", 2024-09-12T00:03:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_die_on_bug": "true", 2024-09-12T00:03:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_die_on_old_message": "true", 2024-09-12T00:03:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_die_on_skipped_message": "false", 2024-09-12T00:03:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-12T00:03:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-12T00:03:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_coremask": "0xF", 2024-09-12T00:03:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-12T00:03:42.301 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-12T00:03:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_enable_tso": "true", 2024-09-12T00:03:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-12T00:03:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-12T00:03:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_hugepages": "", 2024-09-12T00:03:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-12T00:03:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-12T00:03:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_lro": "true", 2024-09-12T00:03:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_memory_channel": "4", 2024-09-12T00:03:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-12T00:03:42.302 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_pmd": "", 2024-09-12T00:03:42.303 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_port_id": "0", 2024-09-12T00:03:42.303 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-12T00:03:42.303 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-12T00:03:42.303 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dump_on_send": "false", 2024-09-12T00:03:42.303 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_initial_backoff": "0.200000", 2024-09-12T00:03:42.303 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_delay_max": "1.000000", 2024-09-12T00:03:42.303 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-12T00:03:42.303 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_delay_type": "", 2024-09-12T00:03:42.303 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-12T00:03:42.303 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_network_congestion": "0", 2024-09-12T00:03:42.303 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_socket_failures": "0", 2024-09-12T00:03:42.304 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_learn_addr_from_peer": "true", 2024-09-12T00:03:42.304 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_max_accept_failures": "4", 2024-09-12T00:03:42.304 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_max_backoff": "15.000000", 2024-09-12T00:03:42.304 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_mon_client_mode": "secure crc", 2024-09-12T00:03:42.304 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-12T00:03:42.304 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_mon_service_mode": "secure crc", 2024-09-12T00:03:42.304 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_osd_compress_min_size": "1024", 2024-09-12T00:03:42.304 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_osd_compress_mode": "none", 2024-09-12T00:03:42.304 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-12T00:03:42.305 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-12T00:03:42.305 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_pq_min_cost": "65536", 2024-09-12T00:03:42.305 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_public_type": "", 2024-09-12T00:03:42.305 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_service_mode": "crc secure", 2024-09-12T00:03:42.305 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_tcp_listen_backlog": "512", 2024-09-12T00:03:42.305 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_tcp_nodelay": "true", 2024-09-12T00:03:42.305 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-12T00:03:42.305 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_tcp_rcvbuf": "0", 2024-09-12T00:03:42.305 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-12T00:03:42.305 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_type": "async+posix", 2024-09-12T00:03:42.305 INFO:teuthology.orchestra.run.smithi019.stdout: "no_config_file": "false", 2024-09-12T00:03:42.305 INFO:teuthology.orchestra.run.smithi019.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-12T00:03:42.305 INFO:teuthology.orchestra.run.smithi019.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-12T00:03:42.306 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_completion_locks_per_session": "32", 2024-09-12T00:03:42.306 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-12T00:03:42.306 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-12T00:03:42.306 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_inflight_ops": "1024", 2024-09-12T00:03:42.306 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-12T00:03:42.306 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-12T00:03:42.306 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_tick_interval": "5.000000", 2024-09-12T00:03:42.306 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_timeout": "10.000000", 2024-09-12T00:03:42.306 INFO:teuthology.orchestra.run.smithi019.stdout: "objectstore_blackhole": "false", 2024-09-12T00:03:42.306 INFO:teuthology.orchestra.run.smithi019.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-12T00:03:42.306 INFO:teuthology.orchestra.run.smithi019.stdout: "openssl_engine_opts": "", 2024-09-12T00:03:42.306 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_delay_time": "5.000000", 2024-09-12T00:03:42.306 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_hist_halflife": "1000", 2024-09-12T00:03:42.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_max_low_ops": "2", 2024-09-12T00:03:42.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_max_ops": "4", 2024-09-12T00:03:42.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-12T00:03:42.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-12T00:03:42.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_slop": "0.020000", 2024-09-12T00:03:42.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-12T00:03:42.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-12T00:03:42.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_asio_thread_count": "2", 2024-09-12T00:03:42.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_async_recovery_min_cost": "100", 2024-09-12T00:03:42.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-12T00:03:42.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-12T00:03:42.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backfill_scan_max": "512", 2024-09-12T00:03:42.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backfill_scan_min": "64", 2024-09-12T00:03:42.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backoff_on_degraded": "false", 2024-09-12T00:03:42.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backoff_on_peering": "false", 2024-09-12T00:03:42.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backoff_on_unfound": "true", 2024-09-12T00:03:42.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_beacon_report_interval": "300", 2024-09-12T00:03:42.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bench_duration": "30", 2024-09-12T00:03:42.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-12T00:03:42.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bench_max_block_size": "67108864", 2024-09-12T00:03:42.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-12T00:03:42.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_blkin_trace_all": "false", 2024-09-12T00:03:42.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-12T00:03:42.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-12T00:03:42.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-12T00:03:42.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-12T00:03:42.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_check_for_log_corruption": "false", 2024-09-12T00:03:42.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-12T00:03:42.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T00:03:42.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-12T00:03:42.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T00:03:42.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_class_update_on_start": "true", 2024-09-12T00:03:42.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_client_message_cap": "256", 2024-09-12T00:03:42.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_client_message_size_cap": "524288000", 2024-09-12T00:03:42.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_client_op_priority": "63", 2024-09-12T00:03:42.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_client_watch_timeout": "30", 2024-09-12T00:03:42.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_command_max_records": "256", 2024-09-12T00:03:42.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_compact_on_start": "false", 2024-09-12T00:03:42.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-12T00:03:42.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-12T00:03:42.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-12T00:03:42.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_crush_update_on_start": "true", 2024-09-12T00:03:42.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_crush_update_weight_set": "true", 2024-09-12T00:03:42.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-12T00:03:42.311 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-12T00:03:42.311 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-12T00:03:42.311 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-12T00:03:42.311 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-12T00:03:42.311 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_feed_pullee": "-1", 2024-09-12T00:03:42.311 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-12T00:03:42.311 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-12T00:03:42.311 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-12T00:03:42.311 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_misdirected_ops": "false", 2024-09-12T00:03:42.311 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_no_acting_change": "false", 2024-09-12T00:03:42.312 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_no_purge_strays": "false", 2024-09-12T00:03:42.312 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_op_order": "false", 2024-09-12T00:03:42.312 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-12T00:03:42.312 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-12T00:03:42.312 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-12T00:03:42.312 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-12T00:03:42.312 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_shutdown": "false", 2024-09-12T00:03:42.312 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-12T00:03:42.312 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-12T00:03:42.313 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_trim_objects": "false", 2024-09-12T00:03:42.313 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-12T00:03:42.313 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-12T00:03:42.313 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_verify_snaps": "false", 2024-09-12T00:03:42.313 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-12T00:03:42.313 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-12T00:03:42.313 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_keys": "1024", 2024-09-12T00:03:42.313 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-12T00:03:42.313 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-12T00:03:42.313 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-12T00:03:42.313 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_stride": "524288", 2024-09-12T00:03:42.313 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-12T00:03:42.314 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-12T00:03:42.314 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_default_notify_timeout": "30", 2024-09-12T00:03:42.314 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_delete_sleep": "0.000000", 2024-09-12T00:03:42.314 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-12T00:03:42.314 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-12T00:03:42.314 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-12T00:03:42.314 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_discard_disconnected_ops": "true", 2024-09-12T00:03:42.314 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_ec_partial_reads": "true", 2024-09-12T00:03:42.314 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_enable_op_tracker": "true", 2024-09-12T00:03:42.314 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-12T00:03:42.314 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-12T00:03:42.314 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-12T00:03:42.315 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-12T00:03:42.315 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_fast_info": "true", 2024-09-12T00:03:42.315 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_fast_shutdown": "true", 2024-09-12T00:03:42.315 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-12T00:03:42.315 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-12T00:03:42.315 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-12T00:03:42.315 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-12T00:03:42.315 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-12T00:03:42.315 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_function_tracing": "false", 2024-09-12T00:03:42.315 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_grace": "20", 2024-09-12T00:03:42.315 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_interval": "6", 2024-09-12T00:03:42.316 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-12T00:03:42.316 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_min_peers": "10", 2024-09-12T00:03:42.316 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_min_size": "2000", 2024-09-12T00:03:42.316 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_stale": "600", 2024-09-12T00:03:42.316 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-12T00:03:42.316 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_hit_set_max_size": "100000", 2024-09-12T00:03:42.316 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_hit_set_min_size": "1000", 2024-09-12T00:03:42.316 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-12T00:03:42.316 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-12T00:03:42.316 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-12T00:03:42.317 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-12T00:03:42.317 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-12T00:03:42.317 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-12T00:03:42.317 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_journal_size": "5120", 2024-09-12T00:03:42.317 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_kill_backfill_at": "0", 2024-09-12T00:03:42.317 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-12T00:03:42.317 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_map_cache_size": "50", 2024-09-12T00:03:42.317 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_map_dedup": "true", 2024-09-12T00:03:42.317 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_map_message_max": "40", 2024-09-12T00:03:42.317 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-12T00:03:42.318 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_map_share_max_epochs": "40", 2024-09-12T00:03:42.318 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_attr_name_len": "100", 2024-09-12T00:03:42.318 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_attr_size": "0", 2024-09-12T00:03:42.318 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_backfills": "1", 2024-09-12T00:03:42.318 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_markdown_count": "5", 2024-09-12T00:03:42.318 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_markdown_period": "600", 2024-09-12T00:03:42.318 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_object_name_len": "2048", 2024-09-12T00:03:42.318 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_object_namespace_len": "256", 2024-09-12T00:03:42.318 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_object_size": "134217728", 2024-09-12T00:03:42.318 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-12T00:03:42.318 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-12T00:03:42.318 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_pg_blocked_by": "16", 2024-09-12T00:03:42.319 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_pg_log_entries": "10000", 2024-09-12T00:03:42.319 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-12T00:03:42.319 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_pgls": "1024", 2024-09-12T00:03:42.319 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_push_cost": "8388608", 2024-09-12T00:03:42.319 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_push_objects": "10", 2024-09-12T00:03:42.319 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_scrubs": "3", 2024-09-12T00:03:42.319 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-12T00:03:42.319 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_trimming_pgs": "2", 2024-09-12T00:03:42.319 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_write_op_reply_len": "64", 2024-09-12T00:03:42.319 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_write_size": "90", 2024-09-12T00:03:42.319 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-12T00:03:42.319 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-12T00:03:42.319 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-12T00:03:42.320 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-12T00:03:42.320 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-12T00:03:42.320 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-12T00:03:42.320 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-12T00:03:42.320 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-12T00:03:42.320 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_profile": "balanced", 2024-09-12T00:03:42.320 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-12T00:03:42.320 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-12T00:03:42.320 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-12T00:03:42.321 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-12T00:03:42.321 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-12T00:03:42.321 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-12T00:03:42.321 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-12T00:03:42.321 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-12T00:03:42.321 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-12T00:03:42.321 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-12T00:03:42.321 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-12T00:03:42.321 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_base": "805306368", 2024-09-12T00:03:42.321 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_cache_min": "134217728", 2024-09-12T00:03:42.322 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-12T00:03:42.322 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-12T00:03:42.322 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_target": "4294967296", 2024-09-12T00:03:42.322 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_target_autotune": "false", 2024-09-12T00:03:42.322 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-12T00:03:42.322 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_min_pg_log_entries": "250", 2024-09-12T00:03:42.322 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_min_recovery_priority": "0", 2024-09-12T00:03:42.322 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-12T00:03:42.322 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-12T00:03:42.322 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mon_report_interval": "5", 2024-09-12T00:03:42.322 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-12T00:03:42.322 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-12T00:03:42.323 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_num_cache_shards": "32", 2024-09-12T00:03:42.323 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_num_op_tracker_shard": "32", 2024-09-12T00:03:42.323 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_numa_auto_affinity": "true", 2024-09-12T00:03:42.323 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_numa_node": "-1", 2024-09-12T00:03:42.323 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_numa_prefer_iface": "true", 2024-09-12T00:03:42.323 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-12T00:03:42.323 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_objecter_finishers": "1", 2024-09-12T00:03:42.323 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_objectstore": "bluestore", 2024-09-12T00:03:42.323 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_objectstore_fuse": "false", 2024-09-12T00:03:42.323 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-12T00:03:42.323 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_objectstore_tracing": "false", 2024-09-12T00:03:42.323 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_complaint_time": "30.000000", 2024-09-12T00:03:42.323 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_history_duration": "600", 2024-09-12T00:03:42.323 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_history_size": "20", 2024-09-12T00:03:42.324 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_history_slow_op_size": "20", 2024-09-12T00:03:42.324 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-12T00:03:42.324 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_log_threshold": "5", 2024-09-12T00:03:42.324 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_shards": "0", 2024-09-12T00:03:42.324 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_shards_hdd": "5", 2024-09-12T00:03:42.324 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_shards_ssd": "8", 2024-09-12T00:03:42.324 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-12T00:03:42.324 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-12T00:03:42.324 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-12T00:03:42.324 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-12T00:03:42.325 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_pq_min_cost": "65536", 2024-09-12T00:03:42.325 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-12T00:03:42.325 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_queue_cut_off": "high", 2024-09-12T00:03:42.325 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-12T00:03:42.325 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_thread_timeout": "15", 2024-09-12T00:03:42.325 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_open_classes_on_start": "true", 2024-09-12T00:03:42.325 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_os_flags": "0", 2024-09-12T00:03:42.325 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_peering_op_priority": "255", 2024-09-12T00:03:42.325 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_delete_cost": "1048576", 2024-09-12T00:03:42.325 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_delete_priority": "5", 2024-09-12T00:03:42.326 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-12T00:03:42.326 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-12T00:03:42.326 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-12T00:03:42.326 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_log_trim_max": "10000", 2024-09-12T00:03:42.326 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_log_trim_min": "100", 2024-09-12T00:03:42.326 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-12T00:03:42.326 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-12T00:03:42.326 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-12T00:03:42.326 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-12T00:03:42.326 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-12T00:03:42.326 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-12T00:03:42.327 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-12T00:03:42.327 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-12T00:03:42.327 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-12T00:03:42.327 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-12T00:03:42.327 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_crimson": "false", 2024-09-12T00:03:42.327 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-12T00:03:42.327 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-12T00:03:42.327 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-12T00:03:42.327 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-12T00:03:42.327 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-12T00:03:42.327 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-12T00:03:42.327 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-12T00:03:42.328 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-12T00:03:42.328 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flags": "0", 2024-09-12T00:03:42.328 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-12T00:03:42.328 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_min_size": "0", 2024-09-12T00:03:42.328 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-12T00:03:42.328 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_pg_num": "32", 2024-09-12T00:03:42.328 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_pgp_num": "0", 2024-09-12T00:03:42.328 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-12T00:03:42.328 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_read_ratio": "70", 2024-09-12T00:03:42.328 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_size": "2", 2024-09-12T00:03:42.328 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_type": "replicated", 2024-09-12T00:03:42.328 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-12T00:03:42.329 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-12T00:03:42.329 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_push_per_object_cost": "1000", 2024-09-12T00:03:42.329 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-12T00:03:42.329 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recover_clone_overlap": "true", 2024-09-12T00:03:42.329 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-12T00:03:42.329 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_cost": "20971520", 2024-09-12T00:03:42.329 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-12T00:03:42.329 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_active": "0", 2024-09-12T00:03:42.329 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-12T00:03:42.329 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-12T00:03:42.329 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-12T00:03:42.329 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-12T00:03:42.330 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_single_start": "1", 2024-09-12T00:03:42.330 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_op_priority": "3", 2024-09-12T00:03:42.330 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-12T00:03:42.330 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_priority": "5", 2024-09-12T00:03:42.330 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-12T00:03:42.330 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_sleep": "0.000000", 2024-09-12T00:03:42.330 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-12T00:03:42.330 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-12T00:03:42.330 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-12T00:03:42.330 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_repair_during_recovery": "false", 2024-09-12T00:03:42.331 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_requested_scrub_priority": "120", 2024-09-12T00:03:42.331 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-12T00:03:42.331 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-12T00:03:42.331 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_auto_repair": "false", 2024-09-12T00:03:42.331 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-12T00:03:42.331 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-12T00:03:42.331 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_begin_hour": "0", 2024-09-12T00:03:42.331 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_begin_week_day": "0", 2024-09-12T00:03:42.331 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_chunk_max": "25", 2024-09-12T00:03:42.331 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_chunk_min": "5", 2024-09-12T00:03:42.331 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_cost": "52428800", 2024-09-12T00:03:42.332 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-12T00:03:42.332 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_during_recovery": "false", 2024-09-12T00:03:42.332 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_end_hour": "0", 2024-09-12T00:03:42.332 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_end_week_day": "0", 2024-09-12T00:03:42.332 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_event_cost": "4096", 2024-09-12T00:03:42.332 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-12T00:03:42.332 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-12T00:03:42.332 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_invalid_stats": "true", 2024-09-12T00:03:42.332 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-12T00:03:42.333 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-12T00:03:42.333 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_max_preemptions": "5", 2024-09-12T00:03:42.333 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-12T00:03:42.333 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_priority": "5", 2024-09-12T00:03:42.333 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_sleep": "0.000000", 2024-09-12T00:03:42.333 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-12T00:03:42.333 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-12T00:03:42.333 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-12T00:03:42.333 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-12T00:03:42.333 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_skip_data_digest": "false", 2024-09-12T00:03:42.333 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_smart_report_timeout": "5", 2024-09-12T00:03:42.333 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_snap_trim_cost": "1048576", 2024-09-12T00:03:42.333 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_snap_trim_priority": "5", 2024-09-12T00:03:42.334 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-12T00:03:42.334 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-12T00:03:42.334 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-12T00:03:42.334 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-12T00:03:42.334 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-12T00:03:42.334 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-12T00:03:42.334 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-12T00:03:42.334 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_target_transaction_size": "30", 2024-09-12T00:03:42.334 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-12T00:03:42.334 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-12T00:03:42.334 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-12T00:03:42.335 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-12T00:03:42.335 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-12T00:03:42.335 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-12T00:03:42.335 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-12T00:03:42.335 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-12T00:03:42.335 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-12T00:03:42.335 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-12T00:03:42.335 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tracing": "false", 2024-09-12T00:03:42.335 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_use_stale_snap": "false", 2024-09-12T00:03:42.335 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T00:03:42.336 INFO:teuthology.orchestra.run.smithi019.stdout: "osdc_blkin_trace_all": "false", 2024-09-12T00:03:42.336 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_kill_at": "0", 2024-09-12T00:03:42.336 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_max_join_drift": "10", 2024-09-12T00:03:42.336 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_min": "500", 2024-09-12T00:03:42.336 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_min_wait": "0.050000", 2024-09-12T00:03:42.336 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_propose_interval": "1.000000", 2024-09-12T00:03:42.336 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_service_trim_max": "500", 2024-09-12T00:03:42.336 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-12T00:03:42.336 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_service_trim_min": "250", 2024-09-12T00:03:42.336 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_stash_full_interval": "25", 2024-09-12T00:03:42.337 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_trim_max": "500", 2024-09-12T00:03:42.337 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_trim_min": "250", 2024-09-12T00:03:42.337 INFO:teuthology.orchestra.run.smithi019.stdout: "perf": "true", 2024-09-12T00:03:42.337 INFO:teuthology.orchestra.run.smithi019.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-12T00:03:42.337 INFO:teuthology.orchestra.run.smithi019.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-12T00:03:42.337 INFO:teuthology.orchestra.run.smithi019.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-12T00:03:42.337 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "-", 2024-09-12T00:03:42.337 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrv": "", 2024-09-12T00:03:42.337 INFO:teuthology.orchestra.run.smithi019.stdout: "public_bind_addr": "-", 2024-09-12T00:03:42.337 INFO:teuthology.orchestra.run.smithi019.stdout: "public_network": "", 2024-09-12T00:03:42.337 INFO:teuthology.orchestra.run.smithi019.stdout: "public_network_interface": "", 2024-09-12T00:03:42.337 INFO:teuthology.orchestra.run.smithi019.stdout: "qat_compressor_busy_polling": "false", 2024-09-12T00:03:42.337 INFO:teuthology.orchestra.run.smithi019.stdout: "qat_compressor_enabled": "false", 2024-09-12T00:03:42.338 INFO:teuthology.orchestra.run.smithi019.stdout: "qat_compressor_session_max_number": "256", 2024-09-12T00:03:42.338 INFO:teuthology.orchestra.run.smithi019.stdout: "rados_mon_op_timeout": "0", 2024-09-12T00:03:42.338 INFO:teuthology.orchestra.run.smithi019.stdout: "rados_osd_op_timeout": "0", 2024-09-12T00:03:42.338 INFO:teuthology.orchestra.run.smithi019.stdout: "rados_tracing": "false", 2024-09-12T00:03:42.338 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_atime_update_interval": "60", 2024-09-12T00:03:42.338 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-12T00:03:42.338 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_balance_parent_reads": "false", 2024-09-12T00:03:42.338 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_balance_snap_reads": "false", 2024-09-12T00:03:42.338 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_blkin_trace_all": "false", 2024-09-12T00:03:42.338 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-12T00:03:42.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-12T00:03:42.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache": "true", 2024-09-12T00:03:42.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-12T00:03:42.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-12T00:03:42.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-12T00:03:42.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-12T00:03:42.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_policy": "writearound", 2024-09-12T00:03:42.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_size": "33554432", 2024-09-12T00:03:42.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-12T00:03:42.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-12T00:03:42.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_clone_copy_on_read": "false", 2024-09-12T00:03:42.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_compression_hint": "none", 2024-09-12T00:03:42.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_concurrent_management_ops": "10", 2024-09-12T00:03:42.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-12T00:03:42.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_clone_format": "auto", 2024-09-12T00:03:42.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_data_pool": "", 2024-09-12T00:03:42.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_features": "61", 2024-09-12T00:03:42.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_format": "2", 2024-09-12T00:03:42.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_map_options": "", 2024-09-12T00:03:42.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_order": "22", 2024-09-12T00:03:42.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_pool": "rbd", 2024-09-12T00:03:42.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-12T00:03:42.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_stripe_count": "0", 2024-09-12T00:03:42.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_stripe_unit": "0", 2024-09-12T00:03:42.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-12T00:03:42.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-12T00:03:42.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-12T00:03:42.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_enable_alloc_hint": "true", 2024-09-12T00:03:42.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-12T00:03:42.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_io_scheduler": "simple", 2024-09-12T00:03:42.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-12T00:03:42.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-12T00:03:42.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-12T00:03:42.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-12T00:03:42.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-12T00:03:42.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-12T00:03:42.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-12T00:03:42.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-12T00:03:42.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-12T00:03:42.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_order": "24", 2024-09-12T00:03:42.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_pool": "", 2024-09-12T00:03:42.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_splay_width": "4", 2024-09-12T00:03:42.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_localize_parent_reads": "false", 2024-09-12T00:03:42.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_localize_snap_reads": "false", 2024-09-12T00:03:42.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-12T00:03:42.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-12T00:03:42.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-12T00:03:42.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-12T00:03:42.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-12T00:03:42.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-12T00:03:42.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-12T00:03:42.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-12T00:03:42.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-12T00:03:42.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-12T00:03:42.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-12T00:03:42.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-12T00:03:42.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-12T00:03:42.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-12T00:03:42.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-12T00:03:42.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-12T00:03:42.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-12T00:03:42.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-12T00:03:42.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-12T00:03:42.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-12T00:03:42.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-12T00:03:42.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-12T00:03:42.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-12T00:03:42.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-12T00:03:42.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-12T00:03:42.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-12T00:03:42.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-12T00:03:42.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-12T00:03:42.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-12T00:03:42.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-12T00:03:42.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-12T00:03:42.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mtime_update_interval": "60", 2024-09-12T00:03:42.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_non_blocking_aio": "true", 2024-09-12T00:03:42.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_op_thread_timeout": "60", 2024-09-12T00:03:42.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_op_threads": "1", 2024-09-12T00:03:42.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_parent_cache_enabled": "false", 2024-09-12T00:03:42.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-12T00:03:42.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-12T00:03:42.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-12T00:03:42.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_plugins": "", 2024-09-12T00:03:42.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_bps_burst": "0", 2024-09-12T00:03:42.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-12T00:03:42.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_bps_limit": "0", 2024-09-12T00:03:42.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_exclude_ops": "0", 2024-09-12T00:03:42.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_iops_burst": "0", 2024-09-12T00:03:42.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-12T00:03:42.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_iops_limit": "0", 2024-09-12T00:03:42.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-12T00:03:42.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-12T00:03:42.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-12T00:03:42.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-12T00:03:42.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-12T00:03:42.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-12T00:03:42.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-12T00:03:42.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-12T00:03:42.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-12T00:03:42.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-12T00:03:42.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-12T00:03:42.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-12T00:03:42.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-12T00:03:42.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-12T00:03:42.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_read_from_replica_policy": "default", 2024-09-12T00:03:42.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-12T00:03:42.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-12T00:03:42.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-12T00:03:42.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-12T00:03:42.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_skip_partial_discard": "true", 2024-09-12T00:03:42.349 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-12T00:03:42.349 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_tracing": "false", 2024-09-12T00:03:42.349 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_validate_names": "true", 2024-09-12T00:03:42.349 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_validate_pool": "true", 2024-09-12T00:03:42.349 INFO:teuthology.orchestra.run.smithi019.stdout: "restapi_base_url": "", 2024-09-12T00:03:42.349 INFO:teuthology.orchestra.run.smithi019.stdout: "restapi_log_level": "", 2024-09-12T00:03:42.349 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-12T00:03:42.349 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-12T00:03:42.349 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_acl_grants_max_num": "100", 2024-09-12T00:03:42.349 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_admin_entry": "admin", 2024-09-12T00:03:42.349 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-12T00:03:42.350 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_asio_assert_yielding": "false", 2024-09-12T00:03:42.350 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_backend_store": "rados", 2024-09-12T00:03:42.350 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_barbican_url": "", 2024-09-12T00:03:42.350 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_beast_enable_async": "true", 2024-09-12T00:03:42.350 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_counters_cache": "false", 2024-09-12T00:03:42.350 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-12T00:03:42.350 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-12T00:03:42.350 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-12T00:03:42.350 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-12T00:03:42.350 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-12T00:03:42.350 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-12T00:03:42.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-12T00:03:42.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-12T00:03:42.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_cache_enabled": "true", 2024-09-12T00:03:42.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_cache_expiry_interval": "900", 2024-09-12T00:03:42.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_cache_lru_size": "25000", 2024-09-12T00:03:42.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_config_store": "rados", 2024-09-12T00:03:42.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_content_length_compat": "false", 2024-09-12T00:03:42.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_copy_obj_progress": "true", 2024-09-12T00:03:42.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-12T00:03:42.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_cors_rules_max_num": "100", 2024-09-12T00:03:42.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_cross_domain_policy": "", 2024-09-12T00:03:42.352 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-12T00:03:42.352 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_addr": "", 2024-09-12T00:03:42.352 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-12T00:03:42.352 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-12T00:03:42.352 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-12T00:03:42.352 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-12T00:03:42.352 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_password": "", 2024-09-12T00:03:42.352 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-12T00:03:42.352 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_username": "", 2024-09-12T00:03:42.352 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_require_ssl": "true", 2024-09-12T00:03:42.352 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-12T00:03:42.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-12T00:03:42.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-12T00:03:42.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-12T00:03:42.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-12T00:03:42.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-12T00:03:42.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-12T00:03:42.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-12T00:03:42.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-12T00:03:42.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-12T00:03:42.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-12T00:03:42.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-12T00:03:42.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-12T00:03:42.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-12T00:03:42.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-12T00:03:42.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_addr": "", 2024-09-12T00:03:42.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_auth": "token", 2024-09-12T00:03:42.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_namespace": "", 2024-09-12T00:03:42.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_prefix": "", 2024-09-12T00:03:42.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-12T00:03:42.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-12T00:03:42.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-12T00:03:42.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-12T00:03:42.355 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_token_file": "", 2024-09-12T00:03:42.355 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-12T00:03:42.355 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_curl_buffersize": "524288", 2024-09-12T00:03:42.355 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-12T00:03:42.355 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_curl_low_speed_time": "300", 2024-09-12T00:03:42.355 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-12T00:03:42.355 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-12T00:03:42.355 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-12T00:03:42.355 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-12T00:03:42.355 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-12T00:03:42.355 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-12T00:03:42.356 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-12T00:03:42.356 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-12T00:03:42.356 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-12T00:03:42.356 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-12T00:03:42.356 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-12T00:03:42.356 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-12T00:03:42.356 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-12T00:03:42.356 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-12T00:03:42.356 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-12T00:03:42.356 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-12T00:03:42.357 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-12T00:03:42.357 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-12T00:03:42.357 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-12T00:03:42.357 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data_log_changes_size": "1000", 2024-09-12T00:03:42.357 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data_log_num_shards": "128", 2024-09-12T00:03:42.357 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-12T00:03:42.357 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data_log_window": "30", 2024-09-12T00:03:42.357 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-12T00:03:42.357 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-12T00:03:42.357 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-12T00:03:42.357 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-12T00:03:42.358 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-12T00:03:42.358 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-12T00:03:42.358 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-12T00:03:42.358 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-12T00:03:42.358 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-12T00:03:42.358 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-12T00:03:42.358 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-12T00:03:42.358 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-12T00:03:42.358 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-12T00:03:42.358 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_disable_s3select": "false", 2024-09-12T00:03:42.359 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-12T00:03:42.359 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-12T00:03:42.359 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-12T00:03:42.359 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-12T00:03:42.359 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-12T00:03:42.359 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-12T00:03:42.359 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-12T00:03:42.359 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-12T00:03:42.359 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-12T00:03:42.359 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-12T00:03:42.360 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-12T00:03:42.360 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-12T00:03:42.360 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dns_name": "", 2024-09-12T00:03:42.360 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dns_s3website_name": "", 2024-09-12T00:03:42.360 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dynamic_resharding": "true", 2024-09-12T00:03:42.360 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-12T00:03:42.360 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-12T00:03:42.360 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-12T00:03:42.360 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_gc_threads": "true", 2024-09-12T00:03:42.360 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_lc_threads": "true", 2024-09-12T00:03:42.360 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_mdsearch": "true", 2024-09-12T00:03:42.361 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_ops_log": "false", 2024-09-12T00:03:42.361 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_quota_threads": "true", 2024-09-12T00:03:42.361 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_static_website": "false", 2024-09-12T00:03:42.361 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_usage_log": "false", 2024-09-12T00:03:42.361 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enforce_swift_acls": "true", 2024-09-12T00:03:42.361 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_exit_timeout_secs": "120", 2024-09-12T00:03:42.361 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_expose_bucket": "false", 2024-09-12T00:03:42.361 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_extended_http_attrs": "", 2024-09-12T00:03:42.361 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_filter": "none", 2024-09-12T00:03:42.361 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-12T00:03:42.361 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_frontends": "beast port=7480", 2024-09-12T00:03:42.361 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-12T00:03:42.361 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_max_deferred": "50", 2024-09-12T00:03:42.362 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-12T00:03:42.362 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_max_objs": "32", 2024-09-12T00:03:42.362 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-12T00:03:42.362 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-12T00:03:42.362 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-12T00:03:42.362 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-12T00:03:42.362 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_processor_period": "3600", 2024-09-12T00:03:42.362 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-12T00:03:42.362 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-12T00:03:42.362 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-12T00:03:42.362 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-12T00:03:42.362 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_init_timeout": "300", 2024-09-12T00:03:42.362 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-12T00:03:42.363 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-12T00:03:42.363 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_kafka_connection_idle": "300", 2024-09-12T00:03:42.363 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-12T00:03:42.363 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-12T00:03:42.363 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-12T00:03:42.363 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-12T00:03:42.363 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-12T00:03:42.363 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_domain": "", 2024-09-12T00:03:42.363 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_password": "", 2024-09-12T00:03:42.363 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_password_path": "", 2024-09-12T00:03:42.363 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_project": "", 2024-09-12T00:03:42.363 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_tenant": "", 2024-09-12T00:03:42.363 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_token": "", 2024-09-12T00:03:42.364 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_token_path": "", 2024-09-12T00:03:42.364 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_user": "", 2024-09-12T00:03:42.364 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_barbican_domain": "", 2024-09-12T00:03:42.364 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_barbican_password": "", 2024-09-12T00:03:42.364 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_barbican_project": "", 2024-09-12T00:03:42.364 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-12T00:03:42.364 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_barbican_user": "", 2024-09-12T00:03:42.364 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-12T00:03:42.364 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-12T00:03:42.364 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-12T00:03:42.364 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-12T00:03:42.364 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-12T00:03:42.364 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_url": "", 2024-09-12T00:03:42.365 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-12T00:03:42.365 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lc_debug_interval": "-1", 2024-09-12T00:03:42.365 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lc_lock_max_time": "90", 2024-09-12T00:03:42.365 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lc_max_objs": "32", 2024-09-12T00:03:42.365 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lc_max_rules": "1000", 2024-09-12T00:03:42.365 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lc_max_worker": "3", 2024-09-12T00:03:42.365 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-12T00:03:42.365 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lc_thread_delay": "0", 2024-09-12T00:03:42.365 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-12T00:03:42.365 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ldap_dnattr": "uid", 2024-09-12T00:03:42.365 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-12T00:03:42.365 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ldap_searchfilter": "", 2024-09-12T00:03:42.365 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-12T00:03:42.365 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ldap_uri": "", 2024-09-12T00:03:42.366 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-12T00:03:42.366 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-12T00:03:42.366 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-12T00:03:42.366 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-12T00:03:42.366 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_log_http_headers": "", 2024-09-12T00:03:42.366 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-12T00:03:42.366 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-12T00:03:42.366 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_log_object_name_utc": "false", 2024-09-12T00:03:42.366 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-12T00:03:42.366 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-12T00:03:42.366 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_attr_name_len": "0", 2024-09-12T00:03:42.366 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_attr_size": "0", 2024-09-12T00:03:42.366 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-12T00:03:42.366 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_chunk_size": "4194304", 2024-09-12T00:03:42.367 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-12T00:03:42.367 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-12T00:03:42.367 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-12T00:03:42.367 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_listing_results": "1000", 2024-09-12T00:03:42.367 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_notify_retries": "10", 2024-09-12T00:03:42.367 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-12T00:03:42.367 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_put_param_size": "1048576", 2024-09-12T00:03:42.367 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_put_size": "5368709120", 2024-09-12T00:03:42.367 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_slo_entries": "1000", 2024-09-12T00:03:42.367 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_md_log_max_shards": "64", 2024-09-12T00:03:42.367 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-12T00:03:42.367 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-12T00:03:42.367 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-12T00:03:42.367 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-12T00:03:42.368 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_mp_lock_max_time": "600", 2024-09-12T00:03:42.368 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-12T00:03:42.368 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-12T00:03:42.368 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-12T00:03:42.368 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-12T00:03:42.368 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-12T00:03:42.368 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-12T00:03:42.368 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-12T00:03:42.368 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-12T00:03:42.368 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_max_gc": "300", 2024-09-12T00:03:42.368 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-12T00:03:42.368 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-12T00:03:42.368 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-12T00:03:42.369 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-12T00:03:42.369 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-12T00:03:42.369 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-12T00:03:42.369 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-12T00:03:42.369 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_num_async_rados_threads": "32", 2024-09-12T00:03:42.369 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_num_control_oids": "8", 2024-09-12T00:03:42.369 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_numa_node": "-1", 2024-09-12T00:03:42.369 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-12T00:03:42.369 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-12T00:03:42.369 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_objexp_chunk_size": "100", 2024-09-12T00:03:42.369 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_objexp_gc_interval": "600", 2024-09-12T00:03:42.369 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-12T00:03:42.369 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-12T00:03:42.369 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-12T00:03:42.370 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_op_thread_timeout": "600", 2024-09-12T00:03:42.370 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_op_tracing": "false", 2024-09-12T00:03:42.370 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_opa_token": "", 2024-09-12T00:03:42.370 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_opa_url": "", 2024-09-12T00:03:42.370 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_opa_verify_ssl": "true", 2024-09-12T00:03:42.370 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-12T00:03:42.370 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-12T00:03:42.370 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ops_log_rados": "false", 2024-09-12T00:03:42.370 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ops_log_socket_path": "", 2024-09-12T00:03:42.370 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-12T00:03:42.370 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-12T00:03:42.370 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-12T00:03:42.370 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_period_push_interval": "2.000000", 2024-09-12T00:03:42.370 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-12T00:03:42.371 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-12T00:03:42.371 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-12T00:03:42.371 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-12T00:03:42.371 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_posix_cache_lanes": "3", 2024-09-12T00:03:42.371 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-12T00:03:42.371 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-12T00:03:42.371 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_posix_cache_partitions": "3", 2024-09-12T00:03:42.371 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-12T00:03:42.371 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_print_continue": "true", 2024-09-12T00:03:42.371 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-12T00:03:42.371 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-12T00:03:42.371 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-12T00:03:42.371 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-12T00:03:42.371 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-12T00:03:42.372 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_rados_tracing": "false", 2024-09-12T00:03:42.372 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_realm": "", 2024-09-12T00:03:42.372 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_realm_id": "", 2024-09-12T00:03:42.372 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-12T00:03:42.372 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_region": "", 2024-09-12T00:03:42.372 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-12T00:03:42.372 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-12T00:03:42.372 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-12T00:03:42.372 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-12T00:03:42.372 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_request_uri": "", 2024-09-12T00:03:42.372 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_reshard_batch_size": "64", 2024-09-12T00:03:42.372 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-12T00:03:42.372 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-12T00:03:42.372 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_reshard_max_aio": "128", 2024-09-12T00:03:42.373 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_reshard_num_logs": "16", 2024-09-12T00:03:42.373 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-12T00:03:42.373 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-12T00:03:42.373 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_reshard_thread_interval": "600", 2024-09-12T00:03:42.373 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-12T00:03:42.373 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_resolve_cname": "false", 2024-09-12T00:03:42.373 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-12T00:03:42.373 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_run_sync_thread": "true", 2024-09-12T00:03:42.373 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-12T00:03:42.373 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-12T00:03:42.373 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-12T00:03:42.373 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-12T00:03:42.373 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-12T00:03:42.373 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-12T00:03:42.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-12T00:03:42.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-12T00:03:42.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-12T00:03:42.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_scheduler_type": "throttler", 2024-09-12T00:03:42.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_script_uri": "", 2024-09-12T00:03:42.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_service_provider_name": "", 2024-09-12T00:03:42.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-12T00:03:42.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sts_client_id": "", 2024-09-12T00:03:42.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sts_client_secret": "", 2024-09-12T00:03:42.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sts_entry": "sts", 2024-09-12T00:03:42.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sts_key": "sts", 2024-09-12T00:03:42.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-12T00:03:42.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sts_min_session_duration": "900", 2024-09-12T00:03:42.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sts_token_introspection_url": "", 2024-09-12T00:03:42.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_account_in_url": "false", 2024-09-12T00:03:42.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_auth_entry": "auth", 2024-09-12T00:03:42.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_auth_url": "", 2024-09-12T00:03:42.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_custom_header": "", 2024-09-12T00:03:42.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-12T00:03:42.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_need_stats": "true", 2024-09-12T00:03:42.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_tenant_name": "", 2024-09-12T00:03:42.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_token_expiration": "86400", 2024-09-12T00:03:42.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_url": "", 2024-09-12T00:03:42.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_url_prefix": "swift", 2024-09-12T00:03:42.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-12T00:03:42.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-12T00:03:42.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-12T00:03:42.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_lease_period": "120", 2024-09-12T00:03:42.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-12T00:03:42.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-12T00:03:42.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-12T00:03:42.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-12T00:03:42.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-12T00:03:42.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-12T00:03:42.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-12T00:03:42.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-12T00:03:42.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-12T00:03:42.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_thread_pool_size": "512", 2024-09-12T00:03:42.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-12T00:03:42.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-12T00:03:42.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-12T00:03:42.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-12T00:03:42.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_comment": "", 2024-09-12T00:03:42.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_createby": "", 2024-09-12T00:03:42.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_encoding": "", 2024-09-12T00:03:42.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_flag": "false", 2024-09-12T00:03:42.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-12T00:03:42.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_origin": "", 2024-09-12T00:03:42.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-12T00:03:42.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_tracker": "", 2024-09-12T00:03:42.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_trust_forwarded_https": "false", 2024-09-12T00:03:42.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-12T00:03:42.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-12T00:03:42.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_usage_max_shards": "32", 2024-09-12T00:03:42.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_usage_max_user_shards": "1", 2024-09-12T00:03:42.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_use_opa_authz": "false", 2024-09-12T00:03:42.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_counters_cache": "false", 2024-09-12T00:03:42.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-12T00:03:42.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-12T00:03:42.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-12T00:03:42.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_max_buckets": "1000", 2024-09-12T00:03:42.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_policies_max_num": "100", 2024-09-12T00:03:42.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-12T00:03:42.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-12T00:03:42.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-12T00:03:42.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-12T00:03:42.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_unique_email": "true", 2024-09-12T00:03:42.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_verify_ssl": "true", 2024-09-12T00:03:42.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-12T00:03:42.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_zone": "", 2024-09-12T00:03:42.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_zone_id": "", 2024-09-12T00:03:42.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-12T00:03:42.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_zonegroup": "", 2024-09-12T00:03:42.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_zonegroup_id": "", 2024-09-12T00:03:42.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-12T00:03:42.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rgwlc_auto_session_clear": "true", 2024-09-12T00:03:42.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-12T00:03:42.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_block_size": "4096", 2024-09-12T00:03:42.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-12T00:03:42.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-12T00:03:42.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-12T00:03:42.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-12T00:03:42.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-12T00:03:42.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cache_size": "536870912", 2024-09-12T00:03:42.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-12T00:03:42.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-12T00:03:42.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-12T00:03:42.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-12T00:03:42.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-12T00:03:42.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-12T00:03:42.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-12T00:03:42.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-12T00:03:42.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_index_type": "binary_search", 2024-09-12T00:03:42.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-12T00:03:42.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-12T00:03:42.381 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_partition_filters": "false", 2024-09-12T00:03:42.381 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_perf": "false", 2024-09-12T00:03:42.381 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-12T00:03:42.381 INFO:teuthology.orchestra.run.smithi019.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-12T00:03:42.381 INFO:teuthology.orchestra.run.smithi019.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-12T00:03:42.381 INFO:teuthology.orchestra.run.smithi019.stdout: "run_dir": "/var/run/ceph", 2024-09-12T00:03:42.381 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_block_create": "true", 2024-09-12T00:03:42.381 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_cache_lru_size": "67108864", 2024-09-12T00:03:42.381 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-12T00:03:42.381 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-12T00:03:42.381 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_default_max_object_size": "16777216", 2024-09-12T00:03:42.381 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-12T00:03:42.381 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_device_size": "53687091200", 2024-09-12T00:03:42.381 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-12T00:03:42.382 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_full_integrity_check": "false", 2024-09-12T00:03:42.382 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_journal_batch_capacity": "16", 2024-09-12T00:03:42.382 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-12T00:03:42.382 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-12T00:03:42.382 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-12T00:03:42.382 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_main_device_type": "SSD", 2024-09-12T00:03:42.382 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-12T00:03:42.382 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-12T00:03:42.382 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-12T00:03:42.382 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-12T00:03:42.382 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-12T00:03:42.382 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-12T00:03:42.382 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_segment_size": "67108864", 2024-09-12T00:03:42.382 INFO:teuthology.orchestra.run.smithi019.stdout: "set_keepcaps": "false", 2024-09-12T00:03:42.383 INFO:teuthology.orchestra.run.smithi019.stdout: "setgroup": "", 2024-09-12T00:03:42.383 INFO:teuthology.orchestra.run.smithi019.stdout: "setuser": "", 2024-09-12T00:03:42.383 INFO:teuthology.orchestra.run.smithi019.stdout: "setuser_match_path": "", 2024-09-12T00:03:42.383 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-12T00:03:42.383 INFO:teuthology.orchestra.run.smithi019.stdout: "thp": "false", 2024-09-12T00:03:42.383 INFO:teuthology.orchestra.run.smithi019.stdout: "threadpool_default_timeout": "60", 2024-09-12T00:03:42.383 INFO:teuthology.orchestra.run.smithi019.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-12T00:03:42.383 INFO:teuthology.orchestra.run.smithi019.stdout: "throttler_perf_counter": "true", 2024-09-12T00:03:42.383 INFO:teuthology.orchestra.run.smithi019.stdout: "tmp_dir": "/tmp", 2024-09-12T00:03:42.383 INFO:teuthology.orchestra.run.smithi019.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-12T00:03:42.383 INFO:teuthology.orchestra.run.smithi019.stdout: "uadk_compressor_enabled": "false", 2024-09-12T00:03:42.383 INFO:teuthology.orchestra.run.smithi019.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-12T00:03:42.383 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:03:42.386 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-12T00:03:42.537 INFO:teuthology.orchestra.run.smithi019.stdout:mon.a: {} 2024-09-12T00:03:42.537 INFO:teuthology.orchestra.run.smithi019.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T00:03:42.550 INFO:teuthology.orchestra.run.smithi019.stdout:mon.b: {} 2024-09-12T00:03:42.550 INFO:teuthology.orchestra.run.smithi019.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T00:03:42.560 INFO:teuthology.orchestra.run.smithi019.stdout:mon.c: {} 2024-09-12T00:03:42.560 INFO:teuthology.orchestra.run.smithi019.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T00:03:42.577 DEBUG:teuthology.orchestra.run.smithi135:> type ceph-objectstore-tool 2024-09-12T00:03:42.582 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-12T00:03:42.583 DEBUG:teuthology.orchestra.run.smithi019:> type ceph-objectstore-tool 2024-09-12T00:03:42.586 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-12T00:03:42.587 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:03:42.598 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:03:42.599 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:03:42.599 DEBUG:teuthology.orchestra.run.smithi019:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:03:42.600 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-12T00:03:42.600 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T00:03:42.600 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T00:03:42.601 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-12T00:03:42.601 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-12T00:03:42.601 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:03:42.601 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-12T00:03:42.602 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:03:42.602 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-12T00:03:42.602 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T00:03:42.630 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:42.629+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:42.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:03:42.633 INFO:teuthology.orchestra.run.smithi019.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:03:42.634 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:03:42.677 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:03:42.677 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:03:42.722 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:03:42.721+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:03:42.725 INFO:tasks.workunit:timeout=3h 2024-09-12T00:03:42.725 INFO:tasks.workunit:cleanup=True 2024-09-12T00:03:42.726 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:03:42.757 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:03:42.757 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:03:42.757 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:03:42.757 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:03:42.762 INFO:tasks.workunit.client.0.smithi019.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:03:42.774 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:03:42.774 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:03:42.776 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:03:42.792 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:03:42.792 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:03:42.825 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:03:42.825 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:03:42.825 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:42.825+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:42.841 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:03:42.842 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:03:42.863 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:03:42.863 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:03:42.884 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:03:42.884 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:03:42.905 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:42.905+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:03:42.905 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:03:42.905 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:03:42.908 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:42.908 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:42.923 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:03:42.926 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:03:42.926 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:03:43.005 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:43.005+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:43.044 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:43.044 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:43.059 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:03:43.107 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:03:43.105+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:03:43.208 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:43.205+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:43.225 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:43.225 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:43.240 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:03:43.309 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:43.313+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:03:43.410 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:43.409+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:43.412 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:43.412 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:43.427 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:03:43.452 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T00:03:43.525 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:43.525+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:43.572 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:43.572 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:43.586 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:03:43.611 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:43.613+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:03:43.712 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:43.709+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:43.763 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:43.763 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:43.778 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:03:43.814 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:03:43.813+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:03:43.915 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:03:43.913+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:03:43.950 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:43.951 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:43.964 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:03:44.015 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:44.013+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:44.086 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:44.086 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:44.100 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:03:44.141 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:44.141+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:44.217 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:44.217+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:44.270 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:44.270 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:44.285 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:03:44.325 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:44.325+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:44.419 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:44.417+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:44.453 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:44.454 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:44.469 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:03:44.520 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:03:44.521+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:03:44.621 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:03:44.621+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:03:44.644 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:44.644 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:44.658 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:03:44.722 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:44.721+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:44.790 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:44.790 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:44.804 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:03:44.823 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:44.821+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:44.922 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:44.922 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:44.924 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:03:44.925+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:03:44.936 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:03:44.952 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:03:45.025 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:03:45.025+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:03:45.054 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:45.054 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:45.068 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:03:45.110 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:03:45.110 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:03:45.126 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:03:45.127 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:03:45.127 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:03:45.125+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:03:45.143 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:03:45.143 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:03:45.161 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:03:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:03:45.181 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:03:45.181 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:03:45.201 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:03:45.201 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:03:45.223 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:03:45.223 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:03:45.227 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:45.229+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:03:45.236 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:45.236 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:03:45.236 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:03:45.236 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:45.246 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:03:45.246 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:03:45.250 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:03:45.329 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:45.329+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:45.414 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:45.415 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:03:45.415 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:03:45.415 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:03:45.415 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:45.429 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:03:45.430 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:45.433+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:45.481 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T00:03:45.531 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:45.529+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:03:45.554 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:45.554 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:03:45.554 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:03:45.554 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:03:45.554 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.555 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-09-12T00:03:45.555 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:31.361468+0000", 2024-09-12T00:03:45.555 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.193320373000001, 2024-09-12T00:03:45.555 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054146239999999998, 2024-09-12T00:03:45.555 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:45.556 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:45.556 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:45.556 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:45.556 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.556 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:45.556 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.361468+0000", 2024-09-12T00:03:45.557 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.557 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:45.557 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.361468+0000", 2024-09-12T00:03:45.557 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.558 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.558 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:45.558 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.361469+0000", 2024-09-12T00:03:45.558 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.167e-06 2024-09-12T00:03:45.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.559 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.559 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:45.560 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.361478+0000", 2024-09-12T00:03:45.560 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1730000000000001e-06 2024-09-12T00:03:45.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.560 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.560 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:45.561 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.361498+0000", 2024-09-12T00:03:45.561 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.916e-05 2024-09-12T00:03:45.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.561 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.561 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:45.561 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.361516+0000", 2024-09-12T00:03:45.562 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8312999999999999e-05 2024-09-12T00:03:45.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.562 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:45.562 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.363052+0000", 2024-09-12T00:03:45.562 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015364300000000001 2024-09-12T00:03:45.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.562 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:45.562 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.363097+0000", 2024-09-12T00:03:45.562 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4209999999999999e-05 2024-09-12T00:03:45.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.562 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:45.563 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.366801+0000", 2024-09-12T00:03:45.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037042540000000001 2024-09-12T00:03:45.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.563 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.563 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:45.563 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.366883+0000", 2024-09-12T00:03:45.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1916999999999995e-05 2024-09-12T00:03:45.563 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.563 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:45.563 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.563 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.563 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:56 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:03:45.563 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:31.377519+0000", 2024-09-12T00:03:45.564 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.177269926999999, 2024-09-12T00:03:45.564 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043036230000000003, 2024-09-12T00:03:45.564 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:45.564 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:45.564 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:45.564 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:45.564 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:45.564 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:45.564 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 56 2024-09-12T00:03:45.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.564 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:45.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.564 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:45.565 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.377519+0000", 2024-09-12T00:03:45.565 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.565 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.565 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:45.565 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.377519+0000", 2024-09-12T00:03:45.565 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.565 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.565 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:45.565 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.377522+0000", 2024-09-12T00:03:45.565 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0280000000000001e-06 2024-09-12T00:03:45.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.565 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.565 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:45.566 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.377539+0000", 2024-09-12T00:03:45.566 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7159999999999998e-05 2024-09-12T00:03:45.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.566 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:45.566 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.377567+0000", 2024-09-12T00:03:45.566 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7994e-05 2024-09-12T00:03:45.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.566 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:45.566 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.377582+0000", 2024-09-12T00:03:45.566 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5656999999999999e-05 2024-09-12T00:03:45.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.567 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:45.567 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.377725+0000", 2024-09-12T00:03:45.567 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014292600000000001 2024-09-12T00:03:45.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.567 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.567 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:45.567 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.377942+0000", 2024-09-12T00:03:45.567 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021662499999999999 2024-09-12T00:03:45.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.567 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.567 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:03:45.567 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.378162+0000", 2024-09-12T00:03:45.567 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000220144 2024-09-12T00:03:45.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.568 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:45.568 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.379306+0000", 2024-09-12T00:03:45.568 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0011436059999999999 2024-09-12T00:03:45.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.568 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:45.568 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.381675+0000", 2024-09-12T00:03:45.568 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0023691910000000001 2024-09-12T00:03:45.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.568 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:45.568 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.381761+0000", 2024-09-12T00:03:45.568 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.5945999999999993e-05 2024-09-12T00:03:45.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.569 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.569 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:45.569 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.381822+0000", 2024-09-12T00:03:45.569 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1346000000000005e-05 2024-09-12T00:03:45.569 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.569 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:45.569 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.569 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.569 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:59 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94232268055680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:03:45.569 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:31.385295+0000", 2024-09-12T00:03:45.569 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.169494016, 2024-09-12T00:03:45.569 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033629950000000001, 2024-09-12T00:03:45.570 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:45.570 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:45.570 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:45.570 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:45.570 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:45.570 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:45.570 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 59 2024-09-12T00:03:45.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.570 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:45.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:45.570 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.385295+0000", 2024-09-12T00:03:45.570 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.571 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:45.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.385295+0000", 2024-09-12T00:03:45.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.571 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:45.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.385297+0000", 2024-09-12T00:03:45.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2330000000000001e-06 2024-09-12T00:03:45.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.571 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:45.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.385313+0000", 2024-09-12T00:03:45.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6520000000000001e-05 2024-09-12T00:03:45.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.572 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.572 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:45.572 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.385339+0000", 2024-09-12T00:03:45.572 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5959e-05 2024-09-12T00:03:45.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.572 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.572 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:45.572 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.385353+0000", 2024-09-12T00:03:45.572 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4083999999999999e-05 2024-09-12T00:03:45.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.572 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.572 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:45.572 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.385477+0000", 2024-09-12T00:03:45.572 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000124039 2024-09-12T00:03:45.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.573 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:45.573 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.385674+0000", 2024-09-12T00:03:45.573 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00019636100000000001 2024-09-12T00:03:45.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.573 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:45.573 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.386066+0000", 2024-09-12T00:03:45.573 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039180699999999998 2024-09-12T00:03:45.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.573 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:45.573 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.387807+0000", 2024-09-12T00:03:45.574 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0017412020000000001 2024-09-12T00:03:45.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.574 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:45.574 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.388364+0000", 2024-09-12T00:03:45.574 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00055770699999999995 2024-09-12T00:03:45.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.574 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:45.574 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.388493+0000", 2024-09-12T00:03:45.574 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000129033 2024-09-12T00:03:45.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.574 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:45.575 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.388658+0000", 2024-09-12T00:03:45.575 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016405 2024-09-12T00:03:45.575 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.575 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:45.575 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.575 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.575 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:238 6.18 e35/29 6:1a734c59:::obj_delete_at_hint.0000000000:head v 35'2, mlcod=0'0)", 2024-09-12T00:03:45.575 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.486341+0000", 2024-09-12T00:03:45.575 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.068447358, 2024-09-12T00:03:45.575 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046975569999999998, 2024-09-12T00:03:45.575 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:45.575 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:45.575 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:45.576 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:45.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.576 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:45.576 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486341+0000", 2024-09-12T00:03:45.576 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.576 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:45.576 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486341+0000", 2024-09-12T00:03:45.576 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.576 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:45.576 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486343+0000", 2024-09-12T00:03:45.577 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.243e-06 2024-09-12T00:03:45.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.577 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.577 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:45.577 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486357+0000", 2024-09-12T00:03:45.577 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3767e-05 2024-09-12T00:03:45.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.577 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.577 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:45.577 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486394+0000", 2024-09-12T00:03:45.577 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6539999999999999e-05 2024-09-12T00:03:45.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.577 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.577 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:45.578 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486412+0000", 2024-09-12T00:03:45.578 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8618999999999999e-05 2024-09-12T00:03:45.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.578 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:45.578 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486650+0000", 2024-09-12T00:03:45.578 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023717500000000001 2024-09-12T00:03:45.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.578 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:45.578 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486702+0000", 2024-09-12T00:03:45.578 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2509999999999997e-05 2024-09-12T00:03:45.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.579 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:45.579 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.490920+0000", 2024-09-12T00:03:45.579 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042180239999999999 2024-09-12T00:03:45.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.579 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.579 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:45.579 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491039+0000", 2024-09-12T00:03:45.579 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011867900000000001 2024-09-12T00:03:45.579 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.579 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:45.579 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.579 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.579 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:240 6.19 e35/29 6:9f626c48:lc::lc.21:head v 35'2, mlcod=0'0)", 2024-09-12T00:03:45.579 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.486746+0000", 2024-09-12T00:03:45.580 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.068042808, 2024-09-12T00:03:45.580 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049978369999999998, 2024-09-12T00:03:45.580 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:45.580 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:45.580 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:45.580 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:45.580 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.580 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:45.580 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486746+0000", 2024-09-12T00:03:45.580 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.580 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.580 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:45.580 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486746+0000", 2024-09-12T00:03:45.581 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.581 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.581 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:45.581 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486747+0000", 2024-09-12T00:03:45.581 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.593e-06 2024-09-12T00:03:45.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.581 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.581 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:45.581 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486760+0000", 2024-09-12T00:03:45.581 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2223e-05 2024-09-12T00:03:45.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.581 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.581 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:45.582 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486786+0000", 2024-09-12T00:03:45.582 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6953000000000001e-05 2024-09-12T00:03:45.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.582 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:45.582 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486803+0000", 2024-09-12T00:03:45.582 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6184e-05 2024-09-12T00:03:45.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.582 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:45.582 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486947+0000", 2024-09-12T00:03:45.582 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000144699 2024-09-12T00:03:45.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.582 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:45.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487012+0000", 2024-09-12T00:03:45.583 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4288999999999994e-05 2024-09-12T00:03:45.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.583 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.583 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:45.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491648+0000", 2024-09-12T00:03:45.583 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046367709999999996 2024-09-12T00:03:45.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.583 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.583 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:45.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491744+0000", 2024-09-12T00:03:45.583 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5124999999999995e-05 2024-09-12T00:03:45.583 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.583 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:45.584 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.584 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.584 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:241 6.7 e35/29 6:e31d3d5f:lc::lc.28:head v 35'4, mlcod=35'2)", 2024-09-12T00:03:45.584 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.487305+0000", 2024-09-12T00:03:45.584 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.067483039000001, 2024-09-12T00:03:45.584 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044902809999999996, 2024-09-12T00:03:45.584 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:45.584 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:45.584 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:45.584 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:45.584 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.584 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:45.584 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487305+0000", 2024-09-12T00:03:45.585 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.585 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.585 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:45.585 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487305+0000", 2024-09-12T00:03:45.585 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.585 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.585 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:45.585 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487308+0000", 2024-09-12T00:03:45.585 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1830000000000001e-06 2024-09-12T00:03:45.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.585 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.585 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:45.585 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487323+0000", 2024-09-12T00:03:45.586 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5583e-05 2024-09-12T00:03:45.586 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.586 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.586 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:45.586 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487355+0000", 2024-09-12T00:03:45.586 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1749999999999999e-05 2024-09-12T00:03:45.586 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.586 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.586 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:45.586 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487374+0000", 2024-09-12T00:03:45.586 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9318999999999999e-05 2024-09-12T00:03:45.586 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.586 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.586 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:45.587 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487509+0000", 2024-09-12T00:03:45.587 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013491299999999999 2024-09-12T00:03:45.587 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.587 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.587 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:45.587 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487560+0000", 2024-09-12T00:03:45.587 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1239999999999997e-05 2024-09-12T00:03:45.587 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.587 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.587 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:45.587 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491674+0000", 2024-09-12T00:03:45.587 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041137639999999998 2024-09-12T00:03:45.587 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.587 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.588 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:45.588 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491796+0000", 2024-09-12T00:03:45.588 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012152899999999999 2024-09-12T00:03:45.588 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.588 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:45.588 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.588 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.588 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:276 6.7 e35/29 6:e31d3d5f:lc::lc.28:head v 35'5, mlcod=35'3)", 2024-09-12T00:03:45.588 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.493883+0000", 2024-09-12T00:03:45.588 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.060905052000001, 2024-09-12T00:03:45.588 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047682760000000001, 2024-09-12T00:03:45.588 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:45.588 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:45.589 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:45.589 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:45.589 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.589 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:45.589 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.493883+0000", 2024-09-12T00:03:45.589 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.589 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.589 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:45.589 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.493883+0000", 2024-09-12T00:03:45.589 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.589 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.589 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:45.590 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.493886+0000", 2024-09-12T00:03:45.590 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5830000000000001e-06 2024-09-12T00:03:45.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.590 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.590 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:45.590 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.493901+0000", 2024-09-12T00:03:45.590 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.49e-05 2024-09-12T00:03:45.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.590 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.590 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:45.590 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.493957+0000", 2024-09-12T00:03:45.590 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6399e-05 2024-09-12T00:03:45.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.590 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.591 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:45.591 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.493983+0000", 2024-09-12T00:03:45.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5177e-05 2024-09-12T00:03:45.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.591 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:45.591 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.494116+0000", 2024-09-12T00:03:45.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013304199999999999 2024-09-12T00:03:45.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.591 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:45.591 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.494167+0000", 2024-09-12T00:03:45.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1199000000000002e-05 2024-09-12T00:03:45.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.592 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:45.592 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498556+0000", 2024-09-12T00:03:45.592 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043889100000000002 2024-09-12T00:03:45.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.592 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.592 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:45.592 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498652+0000", 2024-09-12T00:03:45.592 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.6065999999999998e-05 2024-09-12T00:03:45.592 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.592 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:45.592 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.592 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.592 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:272 6.18 e35/29 6:1a734c59:::obj_delete_at_hint.0000000000:head v 35'3, mlcod=34'1)", 2024-09-12T00:03:45.593 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.494479+0000", 2024-09-12T00:03:45.593 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.060309501000001, 2024-09-12T00:03:45.593 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00427328, 2024-09-12T00:03:45.593 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:45.593 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:45.593 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:45.593 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:45.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.593 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:45.593 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.494479+0000", 2024-09-12T00:03:45.593 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.593 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:45.594 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.494479+0000", 2024-09-12T00:03:45.594 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.594 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.594 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:45.594 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.494481+0000", 2024-09-12T00:03:45.594 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.717e-06 2024-09-12T00:03:45.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.594 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.594 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:45.594 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.494496+0000", 2024-09-12T00:03:45.594 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4973e-05 2024-09-12T00:03:45.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.594 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.594 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:45.595 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.494521+0000", 2024-09-12T00:03:45.595 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5703000000000001e-05 2024-09-12T00:03:45.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.595 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:45.595 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.494538+0000", 2024-09-12T00:03:45.595 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6937000000000001e-05 2024-09-12T00:03:45.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.595 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:45.595 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.494666+0000", 2024-09-12T00:03:45.595 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012796500000000001 2024-09-12T00:03:45.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.596 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:45.596 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.494718+0000", 2024-09-12T00:03:45.596 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1895999999999999e-05 2024-09-12T00:03:45.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.596 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.596 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:45.596 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498644+0000", 2024-09-12T00:03:45.596 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039253739999999997 2024-09-12T00:03:45.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.596 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.596 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:45.596 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498752+0000", 2024-09-12T00:03:45.596 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010871500000000001 2024-09-12T00:03:45.596 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.597 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:45.597 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.597 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.597 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:290 6.7 e35/29 6:e31d3d5f:lc::lc.28:head v 35'6, mlcod=35'3)", 2024-09-12T00:03:45.597 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.496964+0000", 2024-09-12T00:03:45.597 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.057824421999999, 2024-09-12T00:03:45.597 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044308159999999997, 2024-09-12T00:03:45.597 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:45.597 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:45.597 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:45.597 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:45.597 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.597 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:45.597 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.496964+0000", 2024-09-12T00:03:45.598 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.598 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.598 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:45.598 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.496964+0000", 2024-09-12T00:03:45.598 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.598 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.598 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:45.598 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.496966+0000", 2024-09-12T00:03:45.598 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3130000000000001e-06 2024-09-12T00:03:45.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.598 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.598 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:45.599 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.496980+0000", 2024-09-12T00:03:45.599 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3813e-05 2024-09-12T00:03:45.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.599 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.599 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:45.599 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497009+0000", 2024-09-12T00:03:45.599 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9162999999999998e-05 2024-09-12T00:03:45.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.599 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.599 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:45.599 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497027+0000", 2024-09-12T00:03:45.599 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7223000000000001e-05 2024-09-12T00:03:45.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.599 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.599 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:45.600 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497157+0000", 2024-09-12T00:03:45.600 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013062300000000001 2024-09-12T00:03:45.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.600 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.600 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:45.600 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497206+0000", 2024-09-12T00:03:45.600 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.8976e-05 2024-09-12T00:03:45.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.600 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.600 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:45.600 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.501280+0000", 2024-09-12T00:03:45.600 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040734159999999998 2024-09-12T00:03:45.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.601 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.601 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:45.601 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.501395+0000", 2024-09-12T00:03:45.601 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000115289 2024-09-12T00:03:45.601 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.601 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:45.601 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.601 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.601 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:300 6.f 6:f1983ba0:::obj_delete_at_hint.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:45.601 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.499721+0000", 2024-09-12T00:03:45.601 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.055067944999999, 2024-09-12T00:03:45.601 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010117055999999999, 2024-09-12T00:03:45.601 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:45.602 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:45.602 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:45.602 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:45.602 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:45.602 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:45.602 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 300 2024-09-12T00:03:45.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.602 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:45.602 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.602 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:45.602 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499721+0000", 2024-09-12T00:03:45.602 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.602 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.602 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:45.603 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499721+0000", 2024-09-12T00:03:45.603 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.603 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.603 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:45.603 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499724+0000", 2024-09-12T00:03:45.603 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2229999999999999e-06 2024-09-12T00:03:45.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.603 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.603 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:45.603 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499738+0000", 2024-09-12T00:03:45.603 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4353e-05 2024-09-12T00:03:45.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.603 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:45.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499779+0000", 2024-09-12T00:03:45.604 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0902999999999998e-05 2024-09-12T00:03:45.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:45.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499801+0000", 2024-09-12T00:03:45.604 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2103000000000002e-05 2024-09-12T00:03:45.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:45.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499952+0000", 2024-09-12T00:03:45.604 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000151302 2024-09-12T00:03:45.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:45.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.500163+0000", 2024-09-12T00:03:45.605 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000210998 2024-09-12T00:03:45.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:45.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.500484+0000", 2024-09-12T00:03:45.605 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00032035800000000003 2024-09-12T00:03:45.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:45.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.504369+0000", 2024-09-12T00:03:45.605 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003885346 2024-09-12T00:03:45.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.606 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.606 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:45.606 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509604+0000", 2024-09-12T00:03:45.606 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052348150000000003 2024-09-12T00:03:45.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.606 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.606 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:45.606 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509726+0000", 2024-09-12T00:03:45.606 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000121623 2024-09-12T00:03:45.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.606 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.606 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:45.606 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509838+0000", 2024-09-12T00:03:45.607 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000112032 2024-09-12T00:03:45.607 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.607 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:45.607 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.607 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.607 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:322 6.7 e35/29 6:e31d3d5f:lc::lc.28:head v 35'7, mlcod=35'5)", 2024-09-12T00:03:45.607 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.503234+0000", 2024-09-12T00:03:45.607 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.051554295000001, 2024-09-12T00:03:45.607 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059122549999999999, 2024-09-12T00:03:45.607 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:45.607 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:45.607 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:45.607 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:45.607 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.608 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:45.608 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503234+0000", 2024-09-12T00:03:45.608 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.608 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.608 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:45.608 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503234+0000", 2024-09-12T00:03:45.608 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.608 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.608 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:45.608 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503235+0000", 2024-09-12T00:03:45.608 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2529999999999999e-06 2024-09-12T00:03:45.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.609 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.609 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:45.609 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503248+0000", 2024-09-12T00:03:45.609 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2053e-05 2024-09-12T00:03:45.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.609 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.609 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:45.609 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503271+0000", 2024-09-12T00:03:45.609 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.315e-05 2024-09-12T00:03:45.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.609 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.609 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:45.609 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503286+0000", 2024-09-12T00:03:45.610 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5676e-05 2024-09-12T00:03:45.610 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.610 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.610 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:45.610 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503413+0000", 2024-09-12T00:03:45.610 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012694900000000001 2024-09-12T00:03:45.610 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.610 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.610 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:45.611 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503467+0000", 2024-09-12T00:03:45.611 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3847000000000001e-05 2024-09-12T00:03:45.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.611 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.611 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:45.611 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509043+0000", 2024-09-12T00:03:45.611 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0055757580000000001 2024-09-12T00:03:45.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.611 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.611 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:45.611 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509146+0000", 2024-09-12T00:03:45.611 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000103569 2024-09-12T00:03:45.611 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.611 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:45.612 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.612 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:332 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:45.612 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.505367+0000", 2024-09-12T00:03:45.612 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.049421227, 2024-09-12T00:03:45.612 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0073947600000000002, 2024-09-12T00:03:45.612 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:45.612 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:45.612 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:45.612 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:45.612 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:45.612 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:45.613 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 332 2024-09-12T00:03:45.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.613 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:45.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.613 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:45.613 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505367+0000", 2024-09-12T00:03:45.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.613 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:45.613 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505367+0000", 2024-09-12T00:03:45.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.613 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:45.614 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505370+0000", 2024-09-12T00:03:45.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.373e-06 2024-09-12T00:03:45.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.614 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:45.614 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505384+0000", 2024-09-12T00:03:45.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4073000000000001e-05 2024-09-12T00:03:45.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.614 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:45.614 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505423+0000", 2024-09-12T00:03:45.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8896999999999997e-05 2024-09-12T00:03:45.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:45.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505444+0000", 2024-09-12T00:03:45.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1336e-05 2024-09-12T00:03:45.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:45.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505591+0000", 2024-09-12T00:03:45.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000147026 2024-09-12T00:03:45.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:45.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505727+0000", 2024-09-12T00:03:45.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013580100000000001 2024-09-12T00:03:45.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.616 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.616 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:45.616 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.506024+0000", 2024-09-12T00:03:45.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00029733500000000003 2024-09-12T00:03:45.616 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.616 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.616 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:45.616 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509986+0000", 2024-09-12T00:03:45.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039623530000000001 2024-09-12T00:03:45.616 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.616 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.616 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:45.616 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.512500+0000", 2024-09-12T00:03:45.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0025136080000000001 2024-09-12T00:03:45.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:45.617 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.512650+0000", 2024-09-12T00:03:45.617 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015033200000000001 2024-09-12T00:03:45.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:45.617 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.512762+0000", 2024-09-12T00:03:45.617 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000111626 2024-09-12T00:03:45.617 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.617 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:45.617 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.618 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:347 6.f 6:f1983ba0:::obj_delete_at_hint.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:45.618 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.511060+0000", 2024-09-12T00:03:45.618 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.043728666, 2024-09-12T00:03:45.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041594079999999999, 2024-09-12T00:03:45.618 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:45.618 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:45.618 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:45.618 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:45.618 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:45.618 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:45.618 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 347 2024-09-12T00:03:45.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.618 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:45.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.619 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:45.619 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.511060+0000", 2024-09-12T00:03:45.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.619 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:45.619 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.511060+0000", 2024-09-12T00:03:45.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.619 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:45.619 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.511062+0000", 2024-09-12T00:03:45.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4760000000000001e-06 2024-09-12T00:03:45.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.620 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:45.620 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.511077+0000", 2024-09-12T00:03:45.620 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4936999999999999e-05 2024-09-12T00:03:45.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.620 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:45.620 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.511106+0000", 2024-09-12T00:03:45.620 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8496e-05 2024-09-12T00:03:45.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.620 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:45.620 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.511120+0000", 2024-09-12T00:03:45.620 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4687e-05 2024-09-12T00:03:45.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.621 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:45.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.511227+0000", 2024-09-12T00:03:45.621 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010655899999999999 2024-09-12T00:03:45.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.621 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:45.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.511358+0000", 2024-09-12T00:03:45.621 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013116899999999999 2024-09-12T00:03:45.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.621 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:45.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.511833+0000", 2024-09-12T00:03:45.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00047467899999999999 2024-09-12T00:03:45.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.622 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:45.622 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514900+0000", 2024-09-12T00:03:45.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0030671309999999999 2024-09-12T00:03:45.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.622 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:45.622 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.515020+0000", 2024-09-12T00:03:45.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120489 2024-09-12T00:03:45.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.622 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:45.623 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.515124+0000", 2024-09-12T00:03:45.623 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000103702 2024-09-12T00:03:45.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.623 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:45.623 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.515219+0000", 2024-09-12T00:03:45.623 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5082999999999997e-05 2024-09-12T00:03:45.623 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.623 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:45.623 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.623 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:369 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:45.623 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.517345+0000", 2024-09-12T00:03:45.623 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.037443536, 2024-09-12T00:03:45.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037629540000000002, 2024-09-12T00:03:45.624 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:45.624 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:45.624 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:45.624 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:45.624 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:45.624 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:45.624 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 369 2024-09-12T00:03:45.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.624 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:45.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:45.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517345+0000", 2024-09-12T00:03:45.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:45.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517345+0000", 2024-09-12T00:03:45.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:45.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517348+0000", 2024-09-12T00:03:45.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5299999999999999e-06 2024-09-12T00:03:45.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:45.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517363+0000", 2024-09-12T00:03:45.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5203e-05 2024-09-12T00:03:45.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:45.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517392+0000", 2024-09-12T00:03:45.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9397e-05 2024-09-12T00:03:45.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:45.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517414+0000", 2024-09-12T00:03:45.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1443000000000001e-05 2024-09-12T00:03:45.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:45.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517568+0000", 2024-09-12T00:03:45.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015393500000000001 2024-09-12T00:03:45.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:45.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517805+0000", 2024-09-12T00:03:45.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023741100000000001 2024-09-12T00:03:45.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:45.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.518296+0000", 2024-09-12T00:03:45.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00049103600000000003 2024-09-12T00:03:45.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:45.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519648+0000", 2024-09-12T00:03:45.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0013518950000000001 2024-09-12T00:03:45.628 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.628 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.628 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:45.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520914+0000", 2024-09-12T00:03:45.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001265756 2024-09-12T00:03:45.628 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.628 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.628 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:45.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.521004+0000", 2024-09-12T00:03:45.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0022e-05 2024-09-12T00:03:45.628 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.628 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.629 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:45.629 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.521108+0000", 2024-09-12T00:03:45.629 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000104326 2024-09-12T00:03:45.629 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.629 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:45.629 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.629 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.629 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:408 6.7 e35/29 6:e31d3d5f:lc::lc.28:head v 35'8, mlcod=35'6)", 2024-09-12T00:03:45.629 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.527804+0000", 2024-09-12T00:03:45.629 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.026984202, 2024-09-12T00:03:45.629 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053562820000000004, 2024-09-12T00:03:45.629 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:45.629 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:45.630 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:45.630 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:45.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.630 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:45.630 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.527804+0000", 2024-09-12T00:03:45.630 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.630 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:45.630 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.527804+0000", 2024-09-12T00:03:45.630 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.630 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:45.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.527807+0000", 2024-09-12T00:03:45.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4739999999999999e-06 2024-09-12T00:03:45.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.631 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.631 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:45.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.527821+0000", 2024-09-12T00:03:45.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4174e-05 2024-09-12T00:03:45.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.631 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.631 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:45.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.527849+0000", 2024-09-12T00:03:45.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8254000000000001e-05 2024-09-12T00:03:45.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.632 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:45.632 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.527867+0000", 2024-09-12T00:03:45.632 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7600000000000001e-05 2024-09-12T00:03:45.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.632 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:45.632 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.527987+0000", 2024-09-12T00:03:45.632 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120343 2024-09-12T00:03:45.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.632 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:45.632 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528039+0000", 2024-09-12T00:03:45.633 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.223e-05 2024-09-12T00:03:45.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.633 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:45.633 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533072+0000", 2024-09-12T00:03:45.633 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005032346 2024-09-12T00:03:45.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.633 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:45.633 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533161+0000", 2024-09-12T00:03:45.633 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8861000000000002e-05 2024-09-12T00:03:45.633 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.633 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:45.633 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.634 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:412 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'4, mlcod=35'2)", 2024-09-12T00:03:45.634 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.529093+0000", 2024-09-12T00:03:45.634 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.025695333, 2024-09-12T00:03:45.634 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004137801, 2024-09-12T00:03:45.634 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:45.634 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:45.634 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:45.634 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:45.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.634 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:45.634 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529093+0000", 2024-09-12T00:03:45.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.635 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.635 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:45.635 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529093+0000", 2024-09-12T00:03:45.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.635 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.635 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:45.635 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529101+0000", 2024-09-12T00:03:45.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3200000000000002e-06 2024-09-12T00:03:45.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.635 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.635 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:45.635 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529112+0000", 2024-09-12T00:03:45.636 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1143e-05 2024-09-12T00:03:45.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.636 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.636 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:45.636 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529137+0000", 2024-09-12T00:03:45.636 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5503e-05 2024-09-12T00:03:45.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.636 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.636 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:45.636 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529155+0000", 2024-09-12T00:03:45.636 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7802999999999999e-05 2024-09-12T00:03:45.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.636 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.637 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:45.637 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529301+0000", 2024-09-12T00:03:45.637 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000146036 2024-09-12T00:03:45.637 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.637 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.637 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:45.637 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529364+0000", 2024-09-12T00:03:45.637 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2922000000000005e-05 2024-09-12T00:03:45.637 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.637 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.637 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:45.637 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533060+0000", 2024-09-12T00:03:45.637 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0036959689999999999 2024-09-12T00:03:45.637 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.637 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.638 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:45.638 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533231+0000", 2024-09-12T00:03:45.638 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017110500000000001 2024-09-12T00:03:45.638 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.638 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:45.638 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.638 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.638 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.638 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:442 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:45.638 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.536937+0000", 2024-09-12T00:03:45.638 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.017851845999999, 2024-09-12T00:03:45.638 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00340465, 2024-09-12T00:03:45.638 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:45.638 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:45.639 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:45.639 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:45.639 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:45.639 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:45.639 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 442 2024-09-12T00:03:45.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.639 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:45.639 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.639 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:45.639 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536937+0000", 2024-09-12T00:03:45.639 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.639 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.639 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:45.639 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536937+0000", 2024-09-12T00:03:45.640 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.640 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.640 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:45.640 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536939+0000", 2024-09-12T00:03:45.640 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.491e-06 2024-09-12T00:03:45.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.640 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.640 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:45.640 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536952+0000", 2024-09-12T00:03:45.640 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3043e-05 2024-09-12T00:03:45.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.640 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.640 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:45.641 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536994+0000", 2024-09-12T00:03:45.641 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1839999999999999e-05 2024-09-12T00:03:45.641 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.641 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.641 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:45.641 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.537012+0000", 2024-09-12T00:03:45.641 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8425000000000001e-05 2024-09-12T00:03:45.641 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.641 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.641 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:45.641 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.537124+0000", 2024-09-12T00:03:45.641 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011175600000000001 2024-09-12T00:03:45.641 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.641 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.642 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:45.642 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.537360+0000", 2024-09-12T00:03:45.642 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023553300000000001 2024-09-12T00:03:45.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.642 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.642 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:03:45.642 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.537750+0000", 2024-09-12T00:03:45.642 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039065900000000001 2024-09-12T00:03:45.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.642 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.642 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:45.642 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539049+0000", 2024-09-12T00:03:45.642 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001298537 2024-09-12T00:03:45.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.643 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.643 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:45.643 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.540099+0000", 2024-09-12T00:03:45.643 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001050294 2024-09-12T00:03:45.643 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.643 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.643 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:45.643 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.540230+0000", 2024-09-12T00:03:45.643 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000130591 2024-09-12T00:03:45.643 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.643 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.643 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:45.643 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.540341+0000", 2024-09-12T00:03:45.643 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000111481 2024-09-12T00:03:45.643 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.644 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:45.644 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.644 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.644 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.644 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:826 6.18 e35/29 6:1902608e:::obj_delete_at_hint.0000000024:head v 35'10, mlcod=35'8)", 2024-09-12T00:03:45.644 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.667764+0000", 2024-09-12T00:03:45.644 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.88702449, 2024-09-12T00:03:45.644 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046882099999999999, 2024-09-12T00:03:45.644 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:45.644 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:45.644 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:45.644 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:45.644 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.645 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:45.645 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667764+0000", 2024-09-12T00:03:45.645 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.645 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.645 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.645 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:45.645 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667764+0000", 2024-09-12T00:03:45.645 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.645 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.645 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.645 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:45.645 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667765+0000", 2024-09-12T00:03:45.645 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4079999999999999e-06 2024-09-12T00:03:45.645 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.645 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.646 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:45.646 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667775+0000", 2024-09-12T00:03:45.646 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5959999999999993e-06 2024-09-12T00:03:45.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.646 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.646 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:45.646 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667795+0000", 2024-09-12T00:03:45.646 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0369000000000001e-05 2024-09-12T00:03:45.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.646 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.646 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:45.646 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667807+0000", 2024-09-12T00:03:45.646 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2009e-05 2024-09-12T00:03:45.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.647 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.647 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:45.647 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667890+0000", 2024-09-12T00:03:45.647 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2934000000000003e-05 2024-09-12T00:03:45.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.647 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.647 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:45.647 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667925+0000", 2024-09-12T00:03:45.647 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5046000000000003e-05 2024-09-12T00:03:45.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.647 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.647 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:45.647 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.672355+0000", 2024-09-12T00:03:45.647 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044299099999999996 2024-09-12T00:03:45.648 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.648 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.648 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:45.648 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.672452+0000", 2024-09-12T00:03:45.648 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.6937999999999999e-05 2024-09-12T00:03:45.648 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.648 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:45.648 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.648 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.648 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.648 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:831 6.19 e35/29 6:9d23f22c:lc::lc.15:head v 35'19, mlcod=35'17)", 2024-09-12T00:03:45.648 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.668735+0000", 2024-09-12T00:03:45.648 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.886053301, 2024-09-12T00:03:45.648 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037047669999999999, 2024-09-12T00:03:45.649 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:45.649 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:45.649 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:45.649 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:45.649 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.649 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:45.649 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.668735+0000", 2024-09-12T00:03:45.649 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.649 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.649 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.649 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:45.649 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.668735+0000", 2024-09-12T00:03:45.649 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.649 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.650 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.650 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:45.650 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.668736+0000", 2024-09-12T00:03:45.650 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3799999999999996e-07 2024-09-12T00:03:45.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.650 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.650 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:45.650 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.668744+0000", 2024-09-12T00:03:45.650 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6699999999999994e-06 2024-09-12T00:03:45.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.650 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.650 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:45.650 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.668756+0000", 2024-09-12T00:03:45.650 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2147000000000001e-05 2024-09-12T00:03:45.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.651 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.651 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:45.651 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.668766+0000", 2024-09-12T00:03:45.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7899999999999994e-06 2024-09-12T00:03:45.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.651 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.651 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:45.651 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.668835+0000", 2024-09-12T00:03:45.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9004000000000005e-05 2024-09-12T00:03:45.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.651 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.651 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:45.651 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.668854+0000", 2024-09-12T00:03:45.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9783999999999999e-05 2024-09-12T00:03:45.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.652 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.652 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:45.652 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.672379+0000", 2024-09-12T00:03:45.652 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0035240649999999998 2024-09-12T00:03:45.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.652 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.652 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:45.652 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.672440+0000", 2024-09-12T00:03:45.652 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1469000000000004e-05 2024-09-12T00:03:45.652 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.652 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:45.652 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.653 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.653 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:834 6.19 e35/29 6:9f626c48:lc::lc.21:head v 35'20, mlcod=35'17)", 2024-09-12T00:03:45.653 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.669537+0000", 2024-09-12T00:03:45.653 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.885251240000001, 2024-09-12T00:03:45.653 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003355163, 2024-09-12T00:03:45.653 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:45.653 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:45.653 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:45.653 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:45.653 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.653 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:45.653 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.669537+0000", 2024-09-12T00:03:45.653 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.653 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.654 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:45.654 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.669537+0000", 2024-09-12T00:03:45.654 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:45.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.654 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.654 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:45.654 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.669538+0000", 2024-09-12T00:03:45.654 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0750000000000001e-06 2024-09-12T00:03:45.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.654 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.654 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:45.654 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.669547+0000", 2024-09-12T00:03:45.654 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2239999999999995e-06 2024-09-12T00:03:45.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.655 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.655 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:45.655 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.669564+0000", 2024-09-12T00:03:45.655 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7513999999999999e-05 2024-09-12T00:03:45.655 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.655 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.655 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:45.655 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.669573+0000", 2024-09-12T00:03:45.655 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2080000000000006e-06 2024-09-12T00:03:45.655 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.655 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.655 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:45.655 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.669678+0000", 2024-09-12T00:03:45.655 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000104409 2024-09-12T00:03:45.655 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.656 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.656 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:45.656 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.669707+0000", 2024-09-12T00:03:45.656 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9006999999999999e-05 2024-09-12T00:03:45.656 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.656 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.656 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:45.656 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.672830+0000", 2024-09-12T00:03:45.656 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0031234399999999999 2024-09-12T00:03:45.656 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:45.656 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:45.656 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:45.656 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.672892+0000", 2024-09-12T00:03:45.656 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2286000000000006e-05 2024-09-12T00:03:45.657 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.657 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:45.657 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.657 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:45.657 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:45.657 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:45.658 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:03:45.659 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:03:45.657+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:03:45.759 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:03:45.757+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:03:45.822 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:45.822 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:03:45.823 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:03:45.823 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:45.835 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:03:45.860 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:45.857+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:45.961 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:45.961+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:03:46.003 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:46.003 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:03:46.003 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:03:46.004 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:03:46.004 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:46.017 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:03:46.062 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:46.061+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:03:46.162 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:46.161+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:03:46.186 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:46.186 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:03:46.186 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:03:46.186 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:03:46.186 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.186 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.186 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.463033+0000", 2024-09-12T00:03:46.186 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.723919143, 2024-09-12T00:03:46.187 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037134049999999999, 2024-09-12T00:03:46.187 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.187 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.187 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.187 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.187 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.187 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.187 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 231 2024-09-12T00:03:46.187 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.187 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.188 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.188 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.188 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463033+0000", 2024-09-12T00:03:46.188 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.188 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.188 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.188 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.188 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463033+0000", 2024-09-12T00:03:46.188 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.188 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.189 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.189 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.189 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463036+0000", 2024-09-12T00:03:46.189 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5270000000000001e-06 2024-09-12T00:03:46.189 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.189 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.189 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.189 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463047+0000", 2024-09-12T00:03:46.189 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1389999999999999e-05 2024-09-12T00:03:46.189 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.190 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.190 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.190 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463077+0000", 2024-09-12T00:03:46.190 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9706e-05 2024-09-12T00:03:46.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.190 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.190 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.191 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463091+0000", 2024-09-12T00:03:46.191 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4447000000000001e-05 2024-09-12T00:03:46.191 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.191 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.191 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.191 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463243+0000", 2024-09-12T00:03:46.191 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000151392 2024-09-12T00:03:46.191 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.191 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.191 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.191 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463602+0000", 2024-09-12T00:03:46.192 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00035878700000000001 2024-09-12T00:03:46.192 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.192 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.192 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:03:46.192 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.464299+0000", 2024-09-12T00:03:46.192 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00069704100000000002 2024-09-12T00:03:46.192 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.192 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.192 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.192 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.466067+0000", 2024-09-12T00:03:46.193 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001768141 2024-09-12T00:03:46.193 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.193 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.193 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.193 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.466593+0000", 2024-09-12T00:03:46.193 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052655499999999995 2024-09-12T00:03:46.193 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.193 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.193 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.193 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.466679+0000", 2024-09-12T00:03:46.193 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.5682999999999999e-05 2024-09-12T00:03:46.194 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.194 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.194 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.194 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.466747+0000", 2024-09-12T00:03:46.194 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.7736000000000003e-05 2024-09-12T00:03:46.194 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.194 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.194 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.194 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.194 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.194 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:297 6.8 e35/29 6:162a24ce:lc::lc.8:head v 35'2, mlcod=0'0)", 2024-09-12T00:03:46.194 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.499608+0000", 2024-09-12T00:03:46.195 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.687344502, 2024-09-12T00:03:46.195 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004805269, 2024-09-12T00:03:46.195 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.195 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.195 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.195 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.195 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.195 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.195 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499608+0000", 2024-09-12T00:03:46.195 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.195 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.196 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.196 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.196 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499608+0000", 2024-09-12T00:03:46.196 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.196 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.196 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.196 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499610+0000", 2024-09-12T00:03:46.196 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3269999999999999e-06 2024-09-12T00:03:46.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.196 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.196 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.197 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499625+0000", 2024-09-12T00:03:46.197 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.519e-05 2024-09-12T00:03:46.197 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.197 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.197 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.197 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499659+0000", 2024-09-12T00:03:46.197 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3251999999999999e-05 2024-09-12T00:03:46.197 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.197 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.197 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.198 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499711+0000", 2024-09-12T00:03:46.198 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1983e-05 2024-09-12T00:03:46.198 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.198 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.198 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.198 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499869+0000", 2024-09-12T00:03:46.198 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015835600000000001 2024-09-12T00:03:46.198 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.198 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.198 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.198 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499913+0000", 2024-09-12T00:03:46.198 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4305999999999999e-05 2024-09-12T00:03:46.198 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.198 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.199 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.199 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.504301+0000", 2024-09-12T00:03:46.199 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043874659999999996 2024-09-12T00:03:46.199 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.199 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.199 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.199 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.504413+0000", 2024-09-12T00:03:46.199 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000112389 2024-09-12T00:03:46.199 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.199 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.199 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.199 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.199 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.199 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:323 6.e e35/29 6:71a6e5bc:lc::lc.2:head v 35'3, mlcod=35'1)", 2024-09-12T00:03:46.200 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.503252+0000", 2024-09-12T00:03:46.200 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.68370021, 2024-09-12T00:03:46.200 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038149070000000002, 2024-09-12T00:03:46.200 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.200 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.200 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.200 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.200 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.200 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.200 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503252+0000", 2024-09-12T00:03:46.200 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.200 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.201 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.201 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.201 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503252+0000", 2024-09-12T00:03:46.201 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.201 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.201 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.201 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.201 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503254+0000", 2024-09-12T00:03:46.201 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8840000000000001e-06 2024-09-12T00:03:46.201 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.201 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.201 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.202 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503267+0000", 2024-09-12T00:03:46.202 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3098999999999999e-05 2024-09-12T00:03:46.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.202 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.202 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.202 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503304+0000", 2024-09-12T00:03:46.202 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6473000000000001e-05 2024-09-12T00:03:46.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.202 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.202 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.202 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503324+0000", 2024-09-12T00:03:46.202 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0582999999999999e-05 2024-09-12T00:03:46.203 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.203 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.203 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.203 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503478+0000", 2024-09-12T00:03:46.203 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015380299999999999 2024-09-12T00:03:46.203 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.203 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.203 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.203 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503531+0000", 2024-09-12T00:03:46.203 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3078999999999998e-05 2024-09-12T00:03:46.203 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.203 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.203 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.204 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.506959+0000", 2024-09-12T00:03:46.204 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0034275909999999998 2024-09-12T00:03:46.204 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.204 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.204 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.204 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.507067+0000", 2024-09-12T00:03:46.204 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010839499999999999 2024-09-12T00:03:46.204 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.204 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.204 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.204 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.204 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.204 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:344 6.1b 6:dabbc408:lc::lc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.204 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.509665+0000", 2024-09-12T00:03:46.205 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.677287029, 2024-09-12T00:03:46.205 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052648319999999997, 2024-09-12T00:03:46.205 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.205 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.205 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.205 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.205 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.205 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.205 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 344 2024-09-12T00:03:46.205 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.205 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.205 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.205 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.206 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509665+0000", 2024-09-12T00:03:46.206 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.206 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.206 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.206 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.206 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509665+0000", 2024-09-12T00:03:46.206 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.206 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.206 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.206 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.206 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509667+0000", 2024-09-12T00:03:46.206 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.717e-06 2024-09-12T00:03:46.206 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.207 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.207 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.207 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509677+0000", 2024-09-12T00:03:46.207 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9029999999999999e-06 2024-09-12T00:03:46.207 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.207 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.207 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.207 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509703+0000", 2024-09-12T00:03:46.207 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5510000000000001e-05 2024-09-12T00:03:46.207 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.207 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.207 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.207 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509719+0000", 2024-09-12T00:03:46.207 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6163000000000001e-05 2024-09-12T00:03:46.208 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.208 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.208 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.208 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509913+0000", 2024-09-12T00:03:46.208 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000194432 2024-09-12T00:03:46.208 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.208 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.208 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.208 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510307+0000", 2024-09-12T00:03:46.208 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039409299999999998 2024-09-12T00:03:46.208 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.208 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.208 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:03:46.209 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510805+0000", 2024-09-12T00:03:46.209 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00049770599999999999 2024-09-12T00:03:46.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.209 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.209 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.209 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.512288+0000", 2024-09-12T00:03:46.209 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001483364 2024-09-12T00:03:46.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.209 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.209 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.209 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514621+0000", 2024-09-12T00:03:46.209 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002332883 2024-09-12T00:03:46.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.209 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.210 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.210 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514775+0000", 2024-09-12T00:03:46.210 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000153573 2024-09-12T00:03:46.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.210 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.210 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.210 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514930+0000", 2024-09-12T00:03:46.210 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015548800000000001 2024-09-12T00:03:46.210 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.210 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.210 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.211 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.211 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:346 6.8 e35/29 6:10010070:lc::lc.29:head v 35'4, mlcod=35'2)", 2024-09-12T00:03:46.211 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.510411+0000", 2024-09-12T00:03:46.211 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.676541742, 2024-09-12T00:03:46.211 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041988340000000002, 2024-09-12T00:03:46.211 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.211 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.211 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.211 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.211 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.211 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.212 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510411+0000", 2024-09-12T00:03:46.212 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.212 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.212 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.212 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.212 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510411+0000", 2024-09-12T00:03:46.212 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.212 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.212 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.213 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.213 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510412+0000", 2024-09-12T00:03:46.213 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.72e-06 2024-09-12T00:03:46.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.213 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.213 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.213 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510424+0000", 2024-09-12T00:03:46.213 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2089999999999999e-05 2024-09-12T00:03:46.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.213 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.213 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.214 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510450+0000", 2024-09-12T00:03:46.214 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5797000000000001e-05 2024-09-12T00:03:46.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.214 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.214 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.214 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510465+0000", 2024-09-12T00:03:46.214 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.446e-05 2024-09-12T00:03:46.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.214 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.214 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.214 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510591+0000", 2024-09-12T00:03:46.214 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012610799999999999 2024-09-12T00:03:46.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.215 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.215 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.215 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510639+0000", 2024-09-12T00:03:46.215 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.8457e-05 2024-09-12T00:03:46.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.215 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.215 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.215 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514519+0000", 2024-09-12T00:03:46.215 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038796529999999998 2024-09-12T00:03:46.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.216 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.216 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.216 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514610+0000", 2024-09-12T00:03:46.216 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0549000000000003e-05 2024-09-12T00:03:46.216 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.216 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.216 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.216 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.216 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:352 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.217 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.513324+0000", 2024-09-12T00:03:46.217 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.673628613, 2024-09-12T00:03:46.217 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052898679999999997, 2024-09-12T00:03:46.217 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.217 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.217 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.217 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.217 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.217 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.217 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 352 2024-09-12T00:03:46.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.218 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.218 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.218 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.218 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513324+0000", 2024-09-12T00:03:46.218 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.218 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.218 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.218 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.218 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513324+0000", 2024-09-12T00:03:46.218 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.218 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.219 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.219 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.219 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513326+0000", 2024-09-12T00:03:46.219 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4200000000000001e-06 2024-09-12T00:03:46.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.219 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.219 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.219 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513360+0000", 2024-09-12T00:03:46.219 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3413e-05 2024-09-12T00:03:46.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.219 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.219 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.220 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513395+0000", 2024-09-12T00:03:46.220 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5519000000000003e-05 2024-09-12T00:03:46.220 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.220 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.220 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.220 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513417+0000", 2024-09-12T00:03:46.220 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1710000000000001e-05 2024-09-12T00:03:46.220 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.220 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.221 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.221 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513577+0000", 2024-09-12T00:03:46.221 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015987900000000001 2024-09-12T00:03:46.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.221 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.221 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.221 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513809+0000", 2024-09-12T00:03:46.221 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000231855 2024-09-12T00:03:46.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.221 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.222 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:03:46.222 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514261+0000", 2024-09-12T00:03:46.222 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00045238599999999999 2024-09-12T00:03:46.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.222 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.222 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.222 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.515784+0000", 2024-09-12T00:03:46.222 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015229569999999999 2024-09-12T00:03:46.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.223 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.223 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.223 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.518352+0000", 2024-09-12T00:03:46.223 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0025684850000000001 2024-09-12T00:03:46.223 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.223 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.223 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.223 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.518501+0000", 2024-09-12T00:03:46.223 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014815499999999999 2024-09-12T00:03:46.223 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.223 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.223 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.224 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.518614+0000", 2024-09-12T00:03:46.224 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113089 2024-09-12T00:03:46.224 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.224 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.224 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.224 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.224 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:359 6.e e35/29 6:703a9e16:::obj_delete_at_hint.0000000002:head v 35'4, mlcod=35'2)", 2024-09-12T00:03:46.224 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.516147+0000", 2024-09-12T00:03:46.224 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.670805896999999, 2024-09-12T00:03:46.224 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045436039999999997, 2024-09-12T00:03:46.224 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.225 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.225 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.225 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.225 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.225 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.225 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516147+0000", 2024-09-12T00:03:46.225 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.225 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.225 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.225 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516147+0000", 2024-09-12T00:03:46.226 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.226 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.226 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.226 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516154+0000", 2024-09-12T00:03:46.226 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.8229999999999995e-06 2024-09-12T00:03:46.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.226 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.226 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.226 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516165+0000", 2024-09-12T00:03:46.227 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0190000000000001e-05 2024-09-12T00:03:46.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.227 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.227 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.227 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516182+0000", 2024-09-12T00:03:46.227 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.732e-05 2024-09-12T00:03:46.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.227 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.227 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.227 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516198+0000", 2024-09-12T00:03:46.227 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6379999999999999e-05 2024-09-12T00:03:46.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.228 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.228 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.228 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516344+0000", 2024-09-12T00:03:46.228 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014533499999999999 2024-09-12T00:03:46.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.228 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.228 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.228 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516377+0000", 2024-09-12T00:03:46.228 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3426000000000002e-05 2024-09-12T00:03:46.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.228 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.228 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.228 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520590+0000", 2024-09-12T00:03:46.229 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042129810000000002 2024-09-12T00:03:46.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.229 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.229 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.229 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520690+0000", 2024-09-12T00:03:46.229 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010014900000000001 2024-09-12T00:03:46.229 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.229 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.229 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.229 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.229 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:362 6.8 e35/29 6:10010070:lc::lc.29:head v 35'5, mlcod=35'3)", 2024-09-12T00:03:46.229 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.516504+0000", 2024-09-12T00:03:46.230 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.670448434000001, 2024-09-12T00:03:46.230 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043050099999999997, 2024-09-12T00:03:46.230 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.230 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.230 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.230 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.230 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.230 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.230 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516504+0000", 2024-09-12T00:03:46.230 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.230 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.230 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.230 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516504+0000", 2024-09-12T00:03:46.231 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.231 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516506+0000", 2024-09-12T00:03:46.231 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9e-06 2024-09-12T00:03:46.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.231 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516519+0000", 2024-09-12T00:03:46.231 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.322e-05 2024-09-12T00:03:46.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516547+0000", 2024-09-12T00:03:46.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8289999999999998e-05 2024-09-12T00:03:46.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.232 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516565+0000", 2024-09-12T00:03:46.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7737e-05 2024-09-12T00:03:46.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.232 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516723+0000", 2024-09-12T00:03:46.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015814799999999999 2024-09-12T00:03:46.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.233 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.233 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516782+0000", 2024-09-12T00:03:46.233 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8353000000000002e-05 2024-09-12T00:03:46.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.233 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.233 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.233 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520695+0000", 2024-09-12T00:03:46.233 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003912886 2024-09-12T00:03:46.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.233 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.233 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.233 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520809+0000", 2024-09-12T00:03:46.233 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011447600000000001 2024-09-12T00:03:46.234 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.234 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.234 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.234 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.234 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:367 6.1b 6:dabbc408:lc::lc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.234 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.516992+0000", 2024-09-12T00:03:46.234 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.669960504000001, 2024-09-12T00:03:46.234 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004051158, 2024-09-12T00:03:46.234 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.234 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.234 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.234 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.235 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.235 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.235 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 367 2024-09-12T00:03:46.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.235 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.235 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.235 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.235 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516992+0000", 2024-09-12T00:03:46.235 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.235 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.235 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.235 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516992+0000", 2024-09-12T00:03:46.235 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.236 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.236 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.236 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516994+0000", 2024-09-12T00:03:46.236 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5629999999999999e-06 2024-09-12T00:03:46.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.236 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.236 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.236 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517009+0000", 2024-09-12T00:03:46.236 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4973e-05 2024-09-12T00:03:46.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.236 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.236 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.237 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517039+0000", 2024-09-12T00:03:46.237 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9544e-05 2024-09-12T00:03:46.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.237 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.237 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.237 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517060+0000", 2024-09-12T00:03:46.237 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1369000000000002e-05 2024-09-12T00:03:46.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.237 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.237 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.237 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517208+0000", 2024-09-12T00:03:46.237 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014785500000000001 2024-09-12T00:03:46.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.237 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.238 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.238 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517522+0000", 2024-09-12T00:03:46.238 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00031421800000000001 2024-09-12T00:03:46.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.238 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.238 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:03:46.238 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517825+0000", 2024-09-12T00:03:46.238 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00030275700000000002 2024-09-12T00:03:46.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.238 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.238 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.238 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519023+0000", 2024-09-12T00:03:46.238 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001197474 2024-09-12T00:03:46.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.239 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.239 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520717+0000", 2024-09-12T00:03:46.239 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0016939209999999999 2024-09-12T00:03:46.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.239 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.239 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520834+0000", 2024-09-12T00:03:46.239 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117773 2024-09-12T00:03:46.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.239 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.240 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.521043+0000", 2024-09-12T00:03:46.240 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020871099999999999 2024-09-12T00:03:46.240 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.240 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.240 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.240 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.240 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:375 6.11 6:8f661e56:lc::lc.12:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.240 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.519365+0000", 2024-09-12T00:03:46.240 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.667587098, 2024-09-12T00:03:46.240 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0036610010000000001, 2024-09-12T00:03:46.240 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.240 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.241 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.241 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.241 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.241 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.241 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 375 2024-09-12T00:03:46.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.241 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.241 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.241 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.241 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519365+0000", 2024-09-12T00:03:46.241 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.242 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.242 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.242 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.242 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519365+0000", 2024-09-12T00:03:46.242 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.242 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.242 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.242 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.242 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519368+0000", 2024-09-12T00:03:46.242 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7870000000000002e-06 2024-09-12T00:03:46.242 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.242 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.243 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.243 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519382+0000", 2024-09-12T00:03:46.243 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3393e-05 2024-09-12T00:03:46.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.243 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.243 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.243 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519460+0000", 2024-09-12T00:03:46.243 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.8033000000000003e-05 2024-09-12T00:03:46.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.243 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.243 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.243 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519485+0000", 2024-09-12T00:03:46.244 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5136000000000001e-05 2024-09-12T00:03:46.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.244 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.244 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.244 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519637+0000", 2024-09-12T00:03:46.244 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000151972 2024-09-12T00:03:46.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.244 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.244 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.244 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519992+0000", 2024-09-12T00:03:46.244 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00035536699999999999 2024-09-12T00:03:46.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.245 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.245 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:46.245 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520591+0000", 2024-09-12T00:03:46.245 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000599101 2024-09-12T00:03:46.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.245 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.245 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.245 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.522600+0000", 2024-09-12T00:03:46.245 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00200921 2024-09-12T00:03:46.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.246 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.246 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.246 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.522809+0000", 2024-09-12T00:03:46.246 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000208521 2024-09-12T00:03:46.246 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.246 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.246 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.246 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.522953+0000", 2024-09-12T00:03:46.246 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014383899999999999 2024-09-12T00:03:46.246 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.246 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.247 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.247 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.523026+0000", 2024-09-12T00:03:46.247 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3641999999999997e-05 2024-09-12T00:03:46.247 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.247 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.247 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.247 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.247 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.247 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:403 6.8 e35/29 6:11d93ab7:::obj_delete_at_hint.0000000003:head v 35'6, mlcod=35'4)", 2024-09-12T00:03:46.247 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.526734+0000", 2024-09-12T00:03:46.247 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.660218727, 2024-09-12T00:03:46.248 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003881813, 2024-09-12T00:03:46.248 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.248 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.248 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.248 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.248 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.248 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.248 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526734+0000", 2024-09-12T00:03:46.248 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.248 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.248 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.249 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.249 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526734+0000", 2024-09-12T00:03:46.249 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.249 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.249 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.249 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.249 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526735+0000", 2024-09-12T00:03:46.249 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6169999999999999e-06 2024-09-12T00:03:46.249 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.249 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.249 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.250 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526745+0000", 2024-09-12T00:03:46.250 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7769999999999997e-06 2024-09-12T00:03:46.250 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.250 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.250 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.250 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526768+0000", 2024-09-12T00:03:46.250 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3156999999999999e-05 2024-09-12T00:03:46.250 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.250 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.250 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.250 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526780+0000", 2024-09-12T00:03:46.250 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2043e-05 2024-09-12T00:03:46.251 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.251 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.251 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.251 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526892+0000", 2024-09-12T00:03:46.251 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011140499999999999 2024-09-12T00:03:46.251 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.251 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.251 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.251 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526925+0000", 2024-09-12T00:03:46.251 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3670999999999997e-05 2024-09-12T00:03:46.251 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.252 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.252 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.252 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.530524+0000", 2024-09-12T00:03:46.252 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0035983769999999998 2024-09-12T00:03:46.252 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.252 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.252 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.252 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.530616+0000", 2024-09-12T00:03:46.252 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1766000000000002e-05 2024-09-12T00:03:46.252 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.252 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.253 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.253 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.253 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.253 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:462 6.1f 6:ffe20264:lc::lc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.253 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.543661+0000", 2024-09-12T00:03:46.253 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.643291606, 2024-09-12T00:03:46.253 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037941450000000001, 2024-09-12T00:03:46.253 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.253 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.253 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.254 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.254 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.254 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.254 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 462 2024-09-12T00:03:46.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.254 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.254 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.254 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.254 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543661+0000", 2024-09-12T00:03:46.254 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.255 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.255 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.255 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543661+0000", 2024-09-12T00:03:46.255 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.255 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.255 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.255 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.255 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543663+0000", 2024-09-12T00:03:46.255 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.644e-06 2024-09-12T00:03:46.255 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.255 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.255 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.256 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543674+0000", 2024-09-12T00:03:46.256 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0710000000000001e-05 2024-09-12T00:03:46.256 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.256 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.256 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.256 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543704+0000", 2024-09-12T00:03:46.256 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9856e-05 2024-09-12T00:03:46.256 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.256 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.256 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.256 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543719+0000", 2024-09-12T00:03:46.257 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5265999999999999e-05 2024-09-12T00:03:46.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.257 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.257 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.257 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543865+0000", 2024-09-12T00:03:46.257 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014598700000000001 2024-09-12T00:03:46.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.257 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.257 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.257 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544116+0000", 2024-09-12T00:03:46.257 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025093199999999999 2024-09-12T00:03:46.258 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.258 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.258 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:03:46.258 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544588+0000", 2024-09-12T00:03:46.258 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00047173899999999999 2024-09-12T00:03:46.258 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.258 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.258 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.258 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.545735+0000", 2024-09-12T00:03:46.258 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0011470320000000001 2024-09-12T00:03:46.258 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.259 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.259 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.259 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.547257+0000", 2024-09-12T00:03:46.259 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015221379999999999 2024-09-12T00:03:46.259 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.259 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.259 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.259 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.547369+0000", 2024-09-12T00:03:46.259 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011215899999999999 2024-09-12T00:03:46.259 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.259 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.259 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.260 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.547455+0000", 2024-09-12T00:03:46.260 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.5681999999999997e-05 2024-09-12T00:03:46.260 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.260 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.260 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.260 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.260 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.260 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:497 6.11 6:8f661e56:lc::lc.12:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.260 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.557693+0000", 2024-09-12T00:03:46.260 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.629259896000001, 2024-09-12T00:03:46.260 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039061030000000002, 2024-09-12T00:03:46.260 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.260 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.260 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.261 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.261 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.261 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.261 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 497 2024-09-12T00:03:46.261 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.261 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.261 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.261 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.261 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.557693+0000", 2024-09-12T00:03:46.261 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.261 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.261 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.261 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.262 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.557693+0000", 2024-09-12T00:03:46.262 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.262 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.262 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.262 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.262 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.557694+0000", 2024-09-12T00:03:46.262 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.894e-06 2024-09-12T00:03:46.262 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.262 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.262 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.262 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.557702+0000", 2024-09-12T00:03:46.262 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7200000000000006e-06 2024-09-12T00:03:46.262 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.263 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.263 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.263 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.557722+0000", 2024-09-12T00:03:46.263 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0162000000000001e-05 2024-09-12T00:03:46.263 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.263 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.263 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.263 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.557732+0000", 2024-09-12T00:03:46.263 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0088000000000001e-05 2024-09-12T00:03:46.263 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.263 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.263 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.263 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.557860+0000", 2024-09-12T00:03:46.263 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012722300000000001 2024-09-12T00:03:46.264 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.264 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.264 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.264 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.558018+0000", 2024-09-12T00:03:46.264 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015807399999999999 2024-09-12T00:03:46.264 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.264 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.264 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:46.264 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.558284+0000", 2024-09-12T00:03:46.264 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026614400000000001 2024-09-12T00:03:46.264 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.264 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.264 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.265 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.559371+0000", 2024-09-12T00:03:46.265 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001087113 2024-09-12T00:03:46.265 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.265 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.265 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.265 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.561454+0000", 2024-09-12T00:03:46.265 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020826439999999998 2024-09-12T00:03:46.265 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.265 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.265 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.265 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.561533+0000", 2024-09-12T00:03:46.265 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9177000000000004e-05 2024-09-12T00:03:46.265 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.266 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.266 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.266 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.561599+0000", 2024-09-12T00:03:46.266 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5864000000000005e-05 2024-09-12T00:03:46.266 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.266 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.266 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.266 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.266 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:638 6.1f 6:ffe20264:lc::lc.0:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.266 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.593253+0000", 2024-09-12T00:03:46.266 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.593699694, 2024-09-12T00:03:46.266 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052360990000000001, 2024-09-12T00:03:46.267 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.267 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.267 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.267 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.267 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.267 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.267 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 638 2024-09-12T00:03:46.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.267 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.267 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.267 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.267 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593253+0000", 2024-09-12T00:03:46.267 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.268 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.268 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.268 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593253+0000", 2024-09-12T00:03:46.268 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.268 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.268 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.268 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.268 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593255+0000", 2024-09-12T00:03:46.268 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0540000000000002e-06 2024-09-12T00:03:46.268 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.268 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.268 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.268 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593265+0000", 2024-09-12T00:03:46.269 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0028e-05 2024-09-12T00:03:46.269 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.269 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.269 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.269 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593282+0000", 2024-09-12T00:03:46.269 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6762999999999999e-05 2024-09-12T00:03:46.269 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.269 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.269 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.269 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593293+0000", 2024-09-12T00:03:46.269 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1691999999999999e-05 2024-09-12T00:03:46.269 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.270 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.270 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.270 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593376+0000", 2024-09-12T00:03:46.270 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3195999999999994e-05 2024-09-12T00:03:46.270 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.270 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.270 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.270 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593463+0000", 2024-09-12T00:03:46.270 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6421000000000005e-05 2024-09-12T00:03:46.270 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.270 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.271 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:03:46.271 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593680+0000", 2024-09-12T00:03:46.271 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000216698 2024-09-12T00:03:46.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.271 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.271 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.271 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.594516+0000", 2024-09-12T00:03:46.271 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00083619200000000003 2024-09-12T00:03:46.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.271 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.271 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.272 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598310+0000", 2024-09-12T00:03:46.272 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037941030000000001 2024-09-12T00:03:46.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.272 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.272 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.272 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598420+0000", 2024-09-12T00:03:46.272 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110163 2024-09-12T00:03:46.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.272 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.272 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.272 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598489+0000", 2024-09-12T00:03:46.273 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8788999999999995e-05 2024-09-12T00:03:46.273 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.273 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.273 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.273 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.273 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:717 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.273 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.625210+0000", 2024-09-12T00:03:46.273 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.561742904999999, 2024-09-12T00:03:46.273 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052809140000000003, 2024-09-12T00:03:46.273 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.274 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.274 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.274 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.274 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.274 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.274 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 717 2024-09-12T00:03:46.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.274 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.274 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.274 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.275 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625210+0000", 2024-09-12T00:03:46.275 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.275 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.275 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.275 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625210+0000", 2024-09-12T00:03:46.275 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.275 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.275 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.275 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625211+0000", 2024-09-12T00:03:46.275 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5960000000000001e-06 2024-09-12T00:03:46.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.276 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.276 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.276 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625228+0000", 2024-09-12T00:03:46.276 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6849000000000001e-05 2024-09-12T00:03:46.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.276 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.276 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.276 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625242+0000", 2024-09-12T00:03:46.276 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3730999999999999e-05 2024-09-12T00:03:46.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.277 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.277 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.277 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625250+0000", 2024-09-12T00:03:46.277 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3979999999999999e-06 2024-09-12T00:03:46.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.277 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.277 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.277 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625333+0000", 2024-09-12T00:03:46.277 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3096999999999994e-05 2024-09-12T00:03:46.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.277 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.278 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.278 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625472+0000", 2024-09-12T00:03:46.278 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013836499999999999 2024-09-12T00:03:46.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.278 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.278 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:03:46.278 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625769+0000", 2024-09-12T00:03:46.278 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00029780900000000001 2024-09-12T00:03:46.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.278 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.278 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.279 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.626719+0000", 2024-09-12T00:03:46.279 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00095007800000000003 2024-09-12T00:03:46.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.279 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.279 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.279 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.630313+0000", 2024-09-12T00:03:46.279 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0035937690000000001 2024-09-12T00:03:46.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.279 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.279 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.279 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.630410+0000", 2024-09-12T00:03:46.280 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7246999999999999e-05 2024-09-12T00:03:46.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.280 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.280 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.280 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.630490+0000", 2024-09-12T00:03:46.280 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9975000000000006e-05 2024-09-12T00:03:46.280 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.280 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.280 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.280 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.281 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:735 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.281 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.631579+0000", 2024-09-12T00:03:46.281 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.555373638000001, 2024-09-12T00:03:46.281 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064619990000000004, 2024-09-12T00:03:46.281 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.281 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.281 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.281 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.281 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.281 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.281 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 735 2024-09-12T00:03:46.282 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.282 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.282 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.282 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.282 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631579+0000", 2024-09-12T00:03:46.282 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.282 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.282 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.282 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.282 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631579+0000", 2024-09-12T00:03:46.282 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.282 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.283 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.283 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.283 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631580+0000", 2024-09-12T00:03:46.283 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.206e-06 2024-09-12T00:03:46.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.283 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.283 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.283 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631586+0000", 2024-09-12T00:03:46.283 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8799999999999996e-06 2024-09-12T00:03:46.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.283 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.283 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.284 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631606+0000", 2024-09-12T00:03:46.284 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0557999999999999e-05 2024-09-12T00:03:46.284 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.284 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.284 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.284 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631622+0000", 2024-09-12T00:03:46.284 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5758000000000001e-05 2024-09-12T00:03:46.284 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.285 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.285 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.285 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631726+0000", 2024-09-12T00:03:46.285 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000103717 2024-09-12T00:03:46.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.285 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.285 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.285 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631885+0000", 2024-09-12T00:03:46.285 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015954200000000001 2024-09-12T00:03:46.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.285 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.286 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:03:46.286 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.632177+0000", 2024-09-12T00:03:46.286 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00029183799999999999 2024-09-12T00:03:46.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.286 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.286 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.286 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.635740+0000", 2024-09-12T00:03:46.286 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0035623809999999999 2024-09-12T00:03:46.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.286 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.286 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.286 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.637872+0000", 2024-09-12T00:03:46.287 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002132494 2024-09-12T00:03:46.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.287 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.287 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.287 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.637968+0000", 2024-09-12T00:03:46.287 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5727e-05 2024-09-12T00:03:46.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.287 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.287 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.287 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638041+0000", 2024-09-12T00:03:46.287 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2898000000000006e-05 2024-09-12T00:03:46.287 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.287 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.288 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.288 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.288 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.288 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:852 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.288 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.675779+0000", 2024-09-12T00:03:46.288 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.511173806, 2024-09-12T00:03:46.288 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0070622760000000001, 2024-09-12T00:03:46.288 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.288 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.288 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.288 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.288 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.288 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.288 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 852 2024-09-12T00:03:46.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.289 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.289 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.289 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.675779+0000", 2024-09-12T00:03:46.289 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.289 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.289 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.675779+0000", 2024-09-12T00:03:46.289 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.289 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.290 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.675781+0000", 2024-09-12T00:03:46.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0729999999999999e-06 2024-09-12T00:03:46.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.290 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.290 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.290 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.675789+0000", 2024-09-12T00:03:46.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3389999999999993e-06 2024-09-12T00:03:46.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.290 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.290 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.290 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.675807+0000", 2024-09-12T00:03:46.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8275e-05 2024-09-12T00:03:46.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.291 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.291 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.675817+0000", 2024-09-12T00:03:46.291 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9620000000000005e-06 2024-09-12T00:03:46.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.291 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.291 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.675924+0000", 2024-09-12T00:03:46.291 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000107124 2024-09-12T00:03:46.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.291 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.291 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.676168+0000", 2024-09-12T00:03:46.291 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024318199999999999 2024-09-12T00:03:46.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.292 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.292 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:03:46.292 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.676432+0000", 2024-09-12T00:03:46.292 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026431499999999999 2024-09-12T00:03:46.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.292 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.292 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.292 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.677274+0000", 2024-09-12T00:03:46.292 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00084212999999999996 2024-09-12T00:03:46.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.292 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.292 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.293 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.682573+0000", 2024-09-12T00:03:46.293 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052988439999999996 2024-09-12T00:03:46.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.293 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.293 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.293 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.682727+0000", 2024-09-12T00:03:46.293 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000153893 2024-09-12T00:03:46.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.293 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.293 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.293 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.682841+0000", 2024-09-12T00:03:46.293 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000114139 2024-09-12T00:03:46.293 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.293 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.294 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.294 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.294 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:940 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.294 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.706022+0000", 2024-09-12T00:03:46.294 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.480930689999999, 2024-09-12T00:03:46.294 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0055103579999999999, 2024-09-12T00:03:46.294 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.294 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.294 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.294 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.294 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.294 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.294 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 940 2024-09-12T00:03:46.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.295 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.295 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.295 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.295 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706022+0000", 2024-09-12T00:03:46.295 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.295 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.295 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.295 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706022+0000", 2024-09-12T00:03:46.295 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.295 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.295 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.296 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706023+0000", 2024-09-12T00:03:46.296 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.294e-06 2024-09-12T00:03:46.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.296 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706029+0000", 2024-09-12T00:03:46.296 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.9859999999999999e-06 2024-09-12T00:03:46.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.296 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706044+0000", 2024-09-12T00:03:46.296 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5124e-05 2024-09-12T00:03:46.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.297 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.297 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706052+0000", 2024-09-12T00:03:46.297 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7810000000000005e-06 2024-09-12T00:03:46.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.297 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.297 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.297 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706143+0000", 2024-09-12T00:03:46.297 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0882000000000002e-05 2024-09-12T00:03:46.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.297 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.297 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.298 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706282+0000", 2024-09-12T00:03:46.298 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013932699999999999 2024-09-12T00:03:46.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.298 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.298 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:03:46.298 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706520+0000", 2024-09-12T00:03:46.298 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023770200000000001 2024-09-12T00:03:46.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.298 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.298 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.298 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.707334+0000", 2024-09-12T00:03:46.298 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00081372300000000003 2024-09-12T00:03:46.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.299 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.711430+0000", 2024-09-12T00:03:46.299 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040969140000000001 2024-09-12T00:03:46.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.299 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.711487+0000", 2024-09-12T00:03:46.299 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6641999999999997e-05 2024-09-12T00:03:46.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.299 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.711532+0000", 2024-09-12T00:03:46.300 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4982999999999999e-05 2024-09-12T00:03:46.300 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.300 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.300 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.300 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.300 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1257 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.300 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:35.124959+0000", 2024-09-12T00:03:46.300 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.061992979999999, 2024-09-12T00:03:46.300 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054452789999999999, 2024-09-12T00:03:46.300 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.300 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.300 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.301 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.301 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.301 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.301 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1257 2024-09-12T00:03:46.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.301 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.301 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.301 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.124959+0000", 2024-09-12T00:03:46.301 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.301 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.301 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.124959+0000", 2024-09-12T00:03:46.302 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.302 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.124962+0000", 2024-09-12T00:03:46.302 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4959999999999999e-06 2024-09-12T00:03:46.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.302 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.124973+0000", 2024-09-12T00:03:46.302 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1457000000000001e-05 2024-09-12T00:03:46.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.125005+0000", 2024-09-12T00:03:46.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1163e-05 2024-09-12T00:03:46.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.125019+0000", 2024-09-12T00:03:46.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4780000000000001e-05 2024-09-12T00:03:46.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.125141+0000", 2024-09-12T00:03:46.304 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000121555 2024-09-12T00:03:46.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.304 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.304 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.304 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.125362+0000", 2024-09-12T00:03:46.304 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000221375 2024-09-12T00:03:46.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.304 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.304 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:46.304 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.125671+0000", 2024-09-12T00:03:46.304 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00030850400000000003 2024-09-12T00:03:46.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.305 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.305 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.305 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.126746+0000", 2024-09-12T00:03:46.305 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001075051 2024-09-12T00:03:46.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.305 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.305 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.305 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.130141+0000", 2024-09-12T00:03:46.305 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033952240000000001 2024-09-12T00:03:46.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.306 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.306 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.130293+0000", 2024-09-12T00:03:46.306 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015235499999999999 2024-09-12T00:03:46.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.306 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.306 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.130405+0000", 2024-09-12T00:03:46.306 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000111319 2024-09-12T00:03:46.306 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.306 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.307 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.307 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.307 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1334 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.307 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:35.312239+0000", 2024-09-12T00:03:46.307 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.87471296, 2024-09-12T00:03:46.307 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048064800000000001, 2024-09-12T00:03:46.307 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.307 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.307 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.307 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.308 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.308 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.308 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1334 2024-09-12T00:03:46.308 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.308 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.308 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.308 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.308 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312239+0000", 2024-09-12T00:03:46.308 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.308 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.308 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.309 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.309 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312239+0000", 2024-09-12T00:03:46.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.309 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.309 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.309 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312242+0000", 2024-09-12T00:03:46.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7300000000000001e-06 2024-09-12T00:03:46.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.309 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.309 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.309 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312253+0000", 2024-09-12T00:03:46.310 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1107000000000001e-05 2024-09-12T00:03:46.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.310 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.310 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.310 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312285+0000", 2024-09-12T00:03:46.310 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1210000000000001e-05 2024-09-12T00:03:46.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.310 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.310 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.310 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312303+0000", 2024-09-12T00:03:46.310 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8003e-05 2024-09-12T00:03:46.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.311 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.311 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312422+0000", 2024-09-12T00:03:46.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000119426 2024-09-12T00:03:46.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.311 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.311 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312640+0000", 2024-09-12T00:03:46.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021851100000000001 2024-09-12T00:03:46.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:03:46.312 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.313115+0000", 2024-09-12T00:03:46.312 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000474146 2024-09-12T00:03:46.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.312 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.315280+0000", 2024-09-12T00:03:46.312 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0021658889999999998 2024-09-12T00:03:46.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.316889+0000", 2024-09-12T00:03:46.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0016087759999999999 2024-09-12T00:03:46.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.313 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.316980+0000", 2024-09-12T00:03:46.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0575999999999995e-05 2024-09-12T00:03:46.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.313 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.317046+0000", 2024-09-12T00:03:46.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6105999999999994e-05 2024-09-12T00:03:46.314 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.314 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.314 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.314 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.314 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.314 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:46.316 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:03:46.316 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:03:46.317+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:03:46.416 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:46.413+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:46.467 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T00:03:46.493 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:46.493 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:03:46.493 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:03:46.494 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:46.504 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:03:46.533 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:46.533+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:46.617 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:46.617+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:46.629 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:46.629 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:03:46.629 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:03:46.629 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:03:46.629 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:46.644 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:03:46.718 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:46.717+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:46.768 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:46.768 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:03:46.768 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:03:46.768 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:03:46.768 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.769 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:03:46.769 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:03:46.769 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.281297438999999, 2024-09-12T00:03:46.769 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0032495720000000001, 2024-09-12T00:03:46.769 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.769 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.769 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.769 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.769 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.769 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.769 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 193 2024-09-12T00:03:46.769 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.769 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.770 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.770 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.770 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:03:46.770 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.770 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.770 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.770 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.770 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:03:46.770 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.770 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.770 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.770 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.770 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486926+0000", 2024-09-12T00:03:46.771 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.463e-06 2024-09-12T00:03:46.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.771 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.771 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.771 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486937+0000", 2024-09-12T00:03:46.771 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1147e-05 2024-09-12T00:03:46.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.771 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.771 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.771 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486968+0000", 2024-09-12T00:03:46.771 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1077000000000001e-05 2024-09-12T00:03:46.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.771 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.772 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.772 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486985+0000", 2024-09-12T00:03:46.772 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6399e-05 2024-09-12T00:03:46.772 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.772 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.772 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.772 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487139+0000", 2024-09-12T00:03:46.772 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015403199999999999 2024-09-12T00:03:46.772 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.772 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.772 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.772 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487375+0000", 2024-09-12T00:03:46.772 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023621499999999999 2024-09-12T00:03:46.772 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.773 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.773 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:46.773 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487634+0000", 2024-09-12T00:03:46.773 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000259351 2024-09-12T00:03:46.773 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.773 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.773 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.773 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.489156+0000", 2024-09-12T00:03:46.773 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015213869999999999 2024-09-12T00:03:46.773 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.773 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.773 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.774 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.489974+0000", 2024-09-12T00:03:46.774 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00081855600000000001 2024-09-12T00:03:46.774 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.774 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.774 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.774 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.490064+0000", 2024-09-12T00:03:46.774 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9205999999999999e-05 2024-09-12T00:03:46.774 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.774 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.774 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.774 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.490173+0000", 2024-09-12T00:03:46.774 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109739 2024-09-12T00:03:46.774 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.774 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.775 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.775 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.775 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.775 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:03:46.775 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:03:46.775 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.404857895999999, 2024-09-12T00:03:46.775 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039523630000000004, 2024-09-12T00:03:46.775 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.775 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.775 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.775 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.775 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.775 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.775 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 208 2024-09-12T00:03:46.776 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.776 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.776 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.776 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.776 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:03:46.776 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.776 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.776 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.776 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.776 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:03:46.776 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.776 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.776 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.777 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.777 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363366+0000", 2024-09-12T00:03:46.777 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.004e-06 2024-09-12T00:03:46.777 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.777 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.777 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.777 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363379+0000", 2024-09-12T00:03:46.777 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2943e-05 2024-09-12T00:03:46.777 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.777 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.777 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.777 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363412+0000", 2024-09-12T00:03:46.777 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2808999999999997e-05 2024-09-12T00:03:46.777 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.777 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.778 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.778 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363430+0000", 2024-09-12T00:03:46.778 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8003e-05 2024-09-12T00:03:46.778 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.778 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.778 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.778 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363654+0000", 2024-09-12T00:03:46.778 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022394900000000001 2024-09-12T00:03:46.778 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.778 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.778 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.778 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363897+0000", 2024-09-12T00:03:46.778 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024272399999999999 2024-09-12T00:03:46.778 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.779 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.779 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:46.779 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.364326+0000", 2024-09-12T00:03:46.779 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042963399999999997 2024-09-12T00:03:46.779 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.779 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.779 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.779 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.365757+0000", 2024-09-12T00:03:46.779 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014303969999999999 2024-09-12T00:03:46.779 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.779 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.779 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.779 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367031+0000", 2024-09-12T00:03:46.779 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001274269 2024-09-12T00:03:46.780 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.780 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.780 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.780 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367197+0000", 2024-09-12T00:03:46.780 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016645900000000001 2024-09-12T00:03:46.780 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.780 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.780 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.780 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367316+0000", 2024-09-12T00:03:46.780 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011817200000000001 2024-09-12T00:03:46.780 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.780 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.780 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.780 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.781 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.781 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.781 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:03:46.781 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.347599592, 2024-09-12T00:03:46.781 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033190419999999999, 2024-09-12T00:03:46.781 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.781 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.781 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.781 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.781 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.781 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.781 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 219 2024-09-12T00:03:46.781 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.781 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.782 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.782 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.782 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:03:46.782 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.782 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.782 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.782 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.782 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:03:46.782 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.782 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.782 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.782 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.782 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420624+0000", 2024-09-12T00:03:46.782 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0829999999999998e-06 2024-09-12T00:03:46.783 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.783 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.783 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.783 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420633+0000", 2024-09-12T00:03:46.783 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8500000000000006e-06 2024-09-12T00:03:46.783 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.783 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.783 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.783 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420663+0000", 2024-09-12T00:03:46.784 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9597000000000001e-05 2024-09-12T00:03:46.784 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.784 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.784 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.784 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420681+0000", 2024-09-12T00:03:46.784 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7646e-05 2024-09-12T00:03:46.784 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.784 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.784 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.784 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420791+0000", 2024-09-12T00:03:46.784 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109979 2024-09-12T00:03:46.784 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.784 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.785 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.785 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.421042+0000", 2024-09-12T00:03:46.785 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025117199999999997 2024-09-12T00:03:46.785 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.785 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.785 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:46.785 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.421487+0000", 2024-09-12T00:03:46.785 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00044476599999999998 2024-09-12T00:03:46.785 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.785 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.785 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.785 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.422884+0000", 2024-09-12T00:03:46.785 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0013975109999999999 2024-09-12T00:03:46.785 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.786 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.786 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.786 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423797+0000", 2024-09-12T00:03:46.786 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00091310899999999995 2024-09-12T00:03:46.786 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.786 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.786 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.786 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423879+0000", 2024-09-12T00:03:46.786 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1829000000000005e-05 2024-09-12T00:03:46.786 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.786 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.786 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.786 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423941+0000", 2024-09-12T00:03:46.786 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1500000000000004e-05 2024-09-12T00:03:46.787 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.787 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.787 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.787 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.787 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.787 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.787 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:03:46.787 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.329958993, 2024-09-12T00:03:46.787 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003232782, 2024-09-12T00:03:46.787 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.787 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.787 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.787 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.787 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.787 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.788 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 224 2024-09-12T00:03:46.788 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.788 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.788 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.788 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.788 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:03:46.788 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.788 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.788 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.788 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.788 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:03:46.788 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.788 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.789 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.789 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.789 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438265+0000", 2024-09-12T00:03:46.789 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.666e-06 2024-09-12T00:03:46.789 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.789 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.789 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.789 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438276+0000", 2024-09-12T00:03:46.789 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1387e-05 2024-09-12T00:03:46.789 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.789 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.789 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.789 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438306+0000", 2024-09-12T00:03:46.789 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0069999999999998e-05 2024-09-12T00:03:46.789 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.790 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.790 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.790 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438321+0000", 2024-09-12T00:03:46.790 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.517e-05 2024-09-12T00:03:46.790 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.790 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.790 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.790 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438459+0000", 2024-09-12T00:03:46.790 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013781899999999999 2024-09-12T00:03:46.790 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.790 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.790 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.790 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438671+0000", 2024-09-12T00:03:46.790 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021214500000000001 2024-09-12T00:03:46.791 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.791 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.791 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:46.791 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.439093+0000", 2024-09-12T00:03:46.791 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042117899999999999 2024-09-12T00:03:46.791 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.791 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.791 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.791 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.440400+0000", 2024-09-12T00:03:46.791 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0013072719999999999 2024-09-12T00:03:46.791 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.791 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.791 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.791 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441339+0000", 2024-09-12T00:03:46.792 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00093906600000000001 2024-09-12T00:03:46.792 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.792 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.792 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.792 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441429+0000", 2024-09-12T00:03:46.792 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0358999999999993e-05 2024-09-12T00:03:46.792 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.792 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.792 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.792 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441495+0000", 2024-09-12T00:03:46.792 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5648999999999994e-05 2024-09-12T00:03:46.792 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.792 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.792 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.792 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.793 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.793 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.793 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:03:46.793 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.290460020999999, 2024-09-12T00:03:46.793 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003225716, 2024-09-12T00:03:46.793 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.793 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.793 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.793 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.793 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.793 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.793 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 235 2024-09-12T00:03:46.793 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.793 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.794 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.794 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.794 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:03:46.794 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.794 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.794 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.794 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.794 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:03:46.794 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.794 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.795 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.795 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.795 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477764+0000", 2024-09-12T00:03:46.795 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.48e-06 2024-09-12T00:03:46.795 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.795 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.795 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.795 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477775+0000", 2024-09-12T00:03:46.795 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1163e-05 2024-09-12T00:03:46.795 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.795 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.795 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.795 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477807+0000", 2024-09-12T00:03:46.795 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1860000000000003e-05 2024-09-12T00:03:46.795 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.796 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.796 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.796 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477822+0000", 2024-09-12T00:03:46.796 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5302999999999999e-05 2024-09-12T00:03:46.796 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.796 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.796 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.796 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477959+0000", 2024-09-12T00:03:46.796 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013695600000000001 2024-09-12T00:03:46.796 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.796 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.796 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.796 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.478184+0000", 2024-09-12T00:03:46.797 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022484800000000001 2024-09-12T00:03:46.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.797 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.797 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:46.797 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.478657+0000", 2024-09-12T00:03:46.797 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000473413 2024-09-12T00:03:46.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.797 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.797 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.797 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480162+0000", 2024-09-12T00:03:46.797 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00150454 2024-09-12T00:03:46.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.797 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.797 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.798 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480792+0000", 2024-09-12T00:03:46.798 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00063012400000000003 2024-09-12T00:03:46.798 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.798 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.798 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.798 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480906+0000", 2024-09-12T00:03:46.798 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113909 2024-09-12T00:03:46.798 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.798 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.798 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.799 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480987+0000", 2024-09-12T00:03:46.799 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1119999999999996e-05 2024-09-12T00:03:46.799 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.799 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.799 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.799 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.799 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.799 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:237 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.799 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:03:46.799 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.28313865, 2024-09-12T00:03:46.799 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0074291790000000002, 2024-09-12T00:03:46.799 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.799 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.799 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.800 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.800 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.800 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.800 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 237 2024-09-12T00:03:46.800 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.800 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.800 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.800 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.800 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:03:46.800 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.800 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.800 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.800 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.800 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:03:46.801 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.801 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.801 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.801 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485086+0000", 2024-09-12T00:03:46.801 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.05e-06 2024-09-12T00:03:46.801 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.801 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.801 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485101+0000", 2024-09-12T00:03:46.801 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5186e-05 2024-09-12T00:03:46.801 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.802 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.802 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485140+0000", 2024-09-12T00:03:46.802 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8896000000000002e-05 2024-09-12T00:03:46.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.802 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.802 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.802 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485162+0000", 2024-09-12T00:03:46.802 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2654e-05 2024-09-12T00:03:46.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.802 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.802 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.802 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485314+0000", 2024-09-12T00:03:46.802 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015150799999999999 2024-09-12T00:03:46.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.802 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.803 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.803 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485549+0000", 2024-09-12T00:03:46.803 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000235665 2024-09-12T00:03:46.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.803 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:46.803 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486064+0000", 2024-09-12T00:03:46.803 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00051418899999999997 2024-09-12T00:03:46.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.803 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.803 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.488211+0000", 2024-09-12T00:03:46.803 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0021470819999999998 2024-09-12T00:03:46.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.804 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.804 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.804 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492273+0000", 2024-09-12T00:03:46.804 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040617980000000001 2024-09-12T00:03:46.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.804 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.804 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.804 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492391+0000", 2024-09-12T00:03:46.804 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118613 2024-09-12T00:03:46.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.804 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.804 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.804 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492512+0000", 2024-09-12T00:03:46.805 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120538 2024-09-12T00:03:46.805 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.805 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.805 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.805 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:244 6.17 e35/29 6:e9187ab8:reshard::reshard.0000000000:head v 35'1, mlcod=0'0)", 2024-09-12T00:03:46.805 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:03:46.805 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.280556415, 2024-09-12T00:03:46.805 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0034313239999999999, 2024-09-12T00:03:46.805 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.805 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.805 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.805 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.806 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.806 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.806 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:03:46.806 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.806 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.806 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.806 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:03:46.806 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.806 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.806 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.806 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487667+0000", 2024-09-12T00:03:46.806 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4899999999999999e-06 2024-09-12T00:03:46.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.807 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.807 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487682+0000", 2024-09-12T00:03:46.807 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4929999999999999e-05 2024-09-12T00:03:46.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.807 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.807 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487740+0000", 2024-09-12T00:03:46.807 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8075000000000002e-05 2024-09-12T00:03:46.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.807 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.807 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487761+0000", 2024-09-12T00:03:46.807 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0769999999999999e-05 2024-09-12T00:03:46.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.808 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.808 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.808 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487966+0000", 2024-09-12T00:03:46.808 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020516800000000001 2024-09-12T00:03:46.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.808 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.808 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.808 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.488012+0000", 2024-09-12T00:03:46.808 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5794000000000002e-05 2024-09-12T00:03:46.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.808 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.808 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.809 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.490965+0000", 2024-09-12T00:03:46.809 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0029530609999999999 2024-09-12T00:03:46.809 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.809 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.809 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.809 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491096+0000", 2024-09-12T00:03:46.809 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013103600000000001 2024-09-12T00:03:46.809 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.809 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.809 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.809 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.809 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.809 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:293 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.809 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:03:46.810 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.270604594, 2024-09-12T00:03:46.810 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0075915649999999998, 2024-09-12T00:03:46.810 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.810 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.810 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.810 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.810 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.810 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.810 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 293 2024-09-12T00:03:46.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.810 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.810 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.810 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.810 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:03:46.811 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.811 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.811 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.811 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:03:46.811 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.811 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.811 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.811 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497626+0000", 2024-09-12T00:03:46.811 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2499999999999995e-06 2024-09-12T00:03:46.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.811 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.811 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.812 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497636+0000", 2024-09-12T00:03:46.812 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0139999999999999e-05 2024-09-12T00:03:46.812 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.812 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.812 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.812 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497660+0000", 2024-09-12T00:03:46.812 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4015999999999998e-05 2024-09-12T00:03:46.812 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.812 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.812 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.812 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497675+0000", 2024-09-12T00:03:46.812 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5339999999999999e-05 2024-09-12T00:03:46.812 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.813 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.813 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.813 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497839+0000", 2024-09-12T00:03:46.813 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016347900000000001 2024-09-12T00:03:46.813 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.813 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.813 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.813 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498097+0000", 2024-09-12T00:03:46.813 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025825700000000002 2024-09-12T00:03:46.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.814 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.814 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:46.814 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498618+0000", 2024-09-12T00:03:46.814 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052051300000000001 2024-09-12T00:03:46.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.814 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.814 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.814 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.501282+0000", 2024-09-12T00:03:46.814 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026646840000000001 2024-09-12T00:03:46.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.814 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.814 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.814 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505057+0000", 2024-09-12T00:03:46.815 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037747710000000001 2024-09-12T00:03:46.815 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.815 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.815 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.815 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505144+0000", 2024-09-12T00:03:46.815 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7466000000000006e-05 2024-09-12T00:03:46.815 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.815 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.815 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.815 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505208+0000", 2024-09-12T00:03:46.815 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3649e-05 2024-09-12T00:03:46.815 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.815 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.816 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.816 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.816 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:413 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.816 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:03:46.816 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.239564981999999, 2024-09-12T00:03:46.816 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005252049, 2024-09-12T00:03:46.816 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.816 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.816 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.816 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.817 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.817 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.817 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 413 2024-09-12T00:03:46.817 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.817 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.817 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.817 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.817 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:03:46.818 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.818 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.818 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.818 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:03:46.818 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.818 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.818 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.818 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528659+0000", 2024-09-12T00:03:46.818 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4739999999999999e-06 2024-09-12T00:03:46.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.818 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.818 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.819 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528669+0000", 2024-09-12T00:03:46.819 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0694e-05 2024-09-12T00:03:46.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.819 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.819 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.819 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528696+0000", 2024-09-12T00:03:46.819 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6846e-05 2024-09-12T00:03:46.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.819 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.819 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.819 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528711+0000", 2024-09-12T00:03:46.819 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4397e-05 2024-09-12T00:03:46.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.820 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.820 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.820 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528884+0000", 2024-09-12T00:03:46.820 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017304700000000001 2024-09-12T00:03:46.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.820 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.820 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.820 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529162+0000", 2024-09-12T00:03:46.820 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027861999999999999 2024-09-12T00:03:46.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.820 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.820 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:46.820 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529688+0000", 2024-09-12T00:03:46.820 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052593900000000001 2024-09-12T00:03:46.821 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.821 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.821 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.821 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.531480+0000", 2024-09-12T00:03:46.821 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0017920740000000001 2024-09-12T00:03:46.821 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.821 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.821 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.821 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533734+0000", 2024-09-12T00:03:46.821 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002254191 2024-09-12T00:03:46.821 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.821 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.821 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.821 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533845+0000", 2024-09-12T00:03:46.822 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110559 2024-09-12T00:03:46.822 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.822 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.822 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.822 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533908+0000", 2024-09-12T00:03:46.822 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3207999999999995e-05 2024-09-12T00:03:46.822 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.822 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.822 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.822 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.822 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.822 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:437 6.0 6:05588ce8:lc::lc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.822 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:03:46.822 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.232389492999999, 2024-09-12T00:03:46.823 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039419659999999999, 2024-09-12T00:03:46.823 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.823 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.823 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.823 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.823 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.823 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.823 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 437 2024-09-12T00:03:46.823 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.823 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.823 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.823 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.823 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:03:46.823 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.824 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.824 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.824 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.824 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:03:46.824 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.824 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.824 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.824 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.824 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535834+0000", 2024-09-12T00:03:46.824 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2859999999999998e-06 2024-09-12T00:03:46.824 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.824 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.824 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.824 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535846+0000", 2024-09-12T00:03:46.825 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1643e-05 2024-09-12T00:03:46.825 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.825 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.825 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.825 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535877+0000", 2024-09-12T00:03:46.825 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1457000000000001e-05 2024-09-12T00:03:46.825 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.825 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.825 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.825 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535894+0000", 2024-09-12T00:03:46.825 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.668e-05 2024-09-12T00:03:46.825 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.825 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.827 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.827 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535981+0000", 2024-09-12T00:03:46.827 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6823000000000005e-05 2024-09-12T00:03:46.827 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.827 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.827 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.827 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536086+0000", 2024-09-12T00:03:46.827 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010566200000000001 2024-09-12T00:03:46.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.828 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.828 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:46.828 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536330+0000", 2024-09-12T00:03:46.828 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024399999999999999 2024-09-12T00:03:46.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.828 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.828 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.828 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538288+0000", 2024-09-12T00:03:46.828 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0019575740000000001 2024-09-12T00:03:46.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.828 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.828 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.828 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539574+0000", 2024-09-12T00:03:46.829 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012862259999999999 2024-09-12T00:03:46.829 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.829 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.829 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.829 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539696+0000", 2024-09-12T00:03:46.829 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012190599999999999 2024-09-12T00:03:46.829 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.829 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.829 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.829 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539774+0000", 2024-09-12T00:03:46.829 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7708999999999997e-05 2024-09-12T00:03:46.829 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.829 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.830 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.830 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.830 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.830 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:464 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.830 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:03:46.830 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.223828511000001, 2024-09-12T00:03:46.830 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048192310000000002, 2024-09-12T00:03:46.830 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.830 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.830 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.830 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.830 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.830 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.830 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 464 2024-09-12T00:03:46.831 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.831 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.831 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.831 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.831 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:03:46.831 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.831 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.831 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.831 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.831 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:03:46.831 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.831 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.831 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.831 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.832 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544395+0000", 2024-09-12T00:03:46.832 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.905e-06 2024-09-12T00:03:46.832 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.832 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.832 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.832 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544405+0000", 2024-09-12T00:03:46.832 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0583e-05 2024-09-12T00:03:46.832 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.832 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.832 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.832 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544435+0000", 2024-09-12T00:03:46.832 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9431e-05 2024-09-12T00:03:46.832 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.833 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.833 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.833 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544468+0000", 2024-09-12T00:03:46.833 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2978999999999997e-05 2024-09-12T00:03:46.833 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.833 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.833 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.833 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544573+0000", 2024-09-12T00:03:46.833 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105165 2024-09-12T00:03:46.833 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.833 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.833 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.833 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544714+0000", 2024-09-12T00:03:46.833 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000141061 2024-09-12T00:03:46.834 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.834 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.834 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:46.834 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.545414+0000", 2024-09-12T00:03:46.834 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00070066200000000001 2024-09-12T00:03:46.834 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.834 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.834 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.834 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.547475+0000", 2024-09-12T00:03:46.834 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020609119999999998 2024-09-12T00:03:46.834 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.834 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.834 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.834 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549067+0000", 2024-09-12T00:03:46.834 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015914989999999999 2024-09-12T00:03:46.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.835 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.835 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.835 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549143+0000", 2024-09-12T00:03:46.835 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5795000000000002e-05 2024-09-12T00:03:46.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.835 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.835 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.835 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549212+0000", 2024-09-12T00:03:46.835 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9239000000000006e-05 2024-09-12T00:03:46.835 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.835 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.835 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.836 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.836 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:495 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.836 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:03:46.836 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.212759012999999, 2024-09-12T00:03:46.836 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052520209999999999, 2024-09-12T00:03:46.836 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.836 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.836 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.836 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.836 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.836 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.836 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 495 2024-09-12T00:03:46.836 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.837 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.837 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.837 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.837 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:03:46.837 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.837 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.837 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.837 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.837 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:03:46.837 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.837 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.837 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.837 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.837 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555464+0000", 2024-09-12T00:03:46.837 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8870000000000001e-06 2024-09-12T00:03:46.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.838 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.838 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.838 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555473+0000", 2024-09-12T00:03:46.838 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2399999999999996e-06 2024-09-12T00:03:46.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.838 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.838 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.838 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555496+0000", 2024-09-12T00:03:46.838 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2952e-05 2024-09-12T00:03:46.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.838 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.838 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.838 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555508+0000", 2024-09-12T00:03:46.839 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1548e-05 2024-09-12T00:03:46.839 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.839 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.839 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.839 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555596+0000", 2024-09-12T00:03:46.839 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8295999999999996e-05 2024-09-12T00:03:46.839 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.839 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.839 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.839 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555683+0000", 2024-09-12T00:03:46.839 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7267000000000003e-05 2024-09-12T00:03:46.839 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.839 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.839 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:46.840 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555862+0000", 2024-09-12T00:03:46.840 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017910699999999999 2024-09-12T00:03:46.840 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.840 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.840 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.840 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.556696+0000", 2024-09-12T00:03:46.840 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000833353 2024-09-12T00:03:46.840 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.840 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.840 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.840 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560563+0000", 2024-09-12T00:03:46.840 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038672089999999999 2024-09-12T00:03:46.840 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.840 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.841 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.841 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560642+0000", 2024-09-12T00:03:46.841 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.8909e-05 2024-09-12T00:03:46.841 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.841 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.841 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.841 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560714+0000", 2024-09-12T00:03:46.841 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2253000000000001e-05 2024-09-12T00:03:46.841 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.841 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.841 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.841 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.841 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.841 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:631 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.842 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:03:46.842 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.176931459, 2024-09-12T00:03:46.842 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0072389480000000003, 2024-09-12T00:03:46.842 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.842 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.842 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.842 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.842 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.842 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.842 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 631 2024-09-12T00:03:46.842 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.842 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.842 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.842 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.843 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:03:46.843 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.843 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.843 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.843 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.843 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:03:46.843 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.843 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.843 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.843 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.843 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591292+0000", 2024-09-12T00:03:46.843 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0760000000000001e-06 2024-09-12T00:03:46.843 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.844 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.844 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.844 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591301+0000", 2024-09-12T00:03:46.844 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3880000000000006e-06 2024-09-12T00:03:46.844 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.844 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.844 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.844 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591323+0000", 2024-09-12T00:03:46.844 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2121999999999999e-05 2024-09-12T00:03:46.844 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.844 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.844 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.844 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591338+0000", 2024-09-12T00:03:46.844 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5126999999999999e-05 2024-09-12T00:03:46.845 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.845 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.845 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.845 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591449+0000", 2024-09-12T00:03:46.845 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011054500000000001 2024-09-12T00:03:46.845 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.845 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.845 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.845 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591682+0000", 2024-09-12T00:03:46.845 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023258 2024-09-12T00:03:46.845 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.845 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.845 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:46.845 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.592011+0000", 2024-09-12T00:03:46.846 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00032941699999999998 2024-09-12T00:03:46.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.846 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.846 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.846 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593493+0000", 2024-09-12T00:03:46.846 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014821599999999999 2024-09-12T00:03:46.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.846 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.846 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.846 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598356+0000", 2024-09-12T00:03:46.846 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048625329999999996 2024-09-12T00:03:46.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.846 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.846 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.847 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598456+0000", 2024-09-12T00:03:46.847 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9878999999999997e-05 2024-09-12T00:03:46.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.847 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.847 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.847 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598529+0000", 2024-09-12T00:03:46.847 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3120999999999993e-05 2024-09-12T00:03:46.847 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.847 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.847 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.847 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.847 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:650 6.4 6:26625e58:lc::lc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.847 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:03:46.848 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.168533914999999, 2024-09-12T00:03:46.848 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042727010000000003, 2024-09-12T00:03:46.848 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.848 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.848 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.848 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.848 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.848 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.848 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 650 2024-09-12T00:03:46.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.848 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.848 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.848 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.849 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:03:46.849 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.849 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.849 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.849 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:03:46.849 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.849 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.849 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.849 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599689+0000", 2024-09-12T00:03:46.849 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3179999999999999e-06 2024-09-12T00:03:46.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.850 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.850 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.850 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599696+0000", 2024-09-12T00:03:46.850 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9580000000000001e-06 2024-09-12T00:03:46.850 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.850 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.850 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.850 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599714+0000", 2024-09-12T00:03:46.850 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8099999999999999e-05 2024-09-12T00:03:46.850 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.850 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.850 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.850 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599724+0000", 2024-09-12T00:03:46.850 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0492999999999999e-05 2024-09-12T00:03:46.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.851 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.851 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.851 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599799+0000", 2024-09-12T00:03:46.851 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5228999999999994e-05 2024-09-12T00:03:46.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.851 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.851 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.851 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599897+0000", 2024-09-12T00:03:46.851 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7476e-05 2024-09-12T00:03:46.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.851 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.851 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:46.851 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.600047+0000", 2024-09-12T00:03:46.852 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015028 2024-09-12T00:03:46.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.852 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.852 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.852 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.602604+0000", 2024-09-12T00:03:46.852 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0025571729999999998 2024-09-12T00:03:46.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.852 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.852 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.852 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603880+0000", 2024-09-12T00:03:46.852 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012753700000000001 2024-09-12T00:03:46.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.852 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.852 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.853 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603923+0000", 2024-09-12T00:03:46.853 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3758999999999999e-05 2024-09-12T00:03:46.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.853 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.853 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.853 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603960+0000", 2024-09-12T00:03:46.853 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6545000000000003e-05 2024-09-12T00:03:46.853 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.853 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.853 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.853 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.853 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:744 6.0 6:0651570b:lc::lc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.854 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:03:46.854 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.134242487, 2024-09-12T00:03:46.854 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048046149999999999, 2024-09-12T00:03:46.854 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.854 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.854 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.854 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.854 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.854 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.854 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 744 2024-09-12T00:03:46.854 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.854 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.854 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.854 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.854 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:03:46.855 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.855 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.855 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.855 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:03:46.855 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.855 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.855 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.855 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633981+0000", 2024-09-12T00:03:46.855 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3740000000000001e-06 2024-09-12T00:03:46.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.855 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.856 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.856 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633991+0000", 2024-09-12T00:03:46.856 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7839999999999998e-06 2024-09-12T00:03:46.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.856 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.856 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.856 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634016+0000", 2024-09-12T00:03:46.856 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5075999999999998e-05 2024-09-12T00:03:46.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.856 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.856 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.856 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634031+0000", 2024-09-12T00:03:46.856 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5124e-05 2024-09-12T00:03:46.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.857 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.857 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.857 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634105+0000", 2024-09-12T00:03:46.857 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3595000000000003e-05 2024-09-12T00:03:46.857 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.857 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.857 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.857 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634183+0000", 2024-09-12T00:03:46.857 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7936999999999996e-05 2024-09-12T00:03:46.857 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.857 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.857 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:46.857 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634342+0000", 2024-09-12T00:03:46.857 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015910499999999999 2024-09-12T00:03:46.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.858 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.858 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.858 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.635262+0000", 2024-09-12T00:03:46.858 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00092051000000000003 2024-09-12T00:03:46.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.858 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.858 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.858 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638638+0000", 2024-09-12T00:03:46.858 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033756419999999999 2024-09-12T00:03:46.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.858 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.858 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.858 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638722+0000", 2024-09-12T00:03:46.859 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.4029000000000005e-05 2024-09-12T00:03:46.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.859 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.859 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.859 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638783+0000", 2024-09-12T00:03:46.859 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1439000000000006e-05 2024-09-12T00:03:46.859 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.859 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.859 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.859 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.859 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:875 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.859 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:03:46.859 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.084603056000001, 2024-09-12T00:03:46.860 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004522295, 2024-09-12T00:03:46.860 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.860 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.860 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.860 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.860 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.860 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.860 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 875 2024-09-12T00:03:46.860 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.860 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.860 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.860 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.860 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:03:46.861 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.861 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.861 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.861 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:03:46.861 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.861 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.861 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.861 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683623+0000", 2024-09-12T00:03:46.861 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7140000000000001e-06 2024-09-12T00:03:46.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.861 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.861 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.861 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683639+0000", 2024-09-12T00:03:46.862 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6203000000000001e-05 2024-09-12T00:03:46.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.862 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.862 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.862 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683677+0000", 2024-09-12T00:03:46.862 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8470999999999998e-05 2024-09-12T00:03:46.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.862 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.862 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.862 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683708+0000", 2024-09-12T00:03:46.862 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0793999999999997e-05 2024-09-12T00:03:46.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.862 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.862 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.863 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683827+0000", 2024-09-12T00:03:46.863 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011832699999999999 2024-09-12T00:03:46.863 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.863 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.863 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.863 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683945+0000", 2024-09-12T00:03:46.863 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118301 2024-09-12T00:03:46.863 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.863 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.863 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:46.863 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.684226+0000", 2024-09-12T00:03:46.863 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000280604 2024-09-12T00:03:46.863 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.863 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.864 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.864 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685790+0000", 2024-09-12T00:03:46.864 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001564651 2024-09-12T00:03:46.864 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.864 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.864 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.864 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688028+0000", 2024-09-12T00:03:46.864 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0022381129999999999 2024-09-12T00:03:46.864 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.864 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.864 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.864 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688093+0000", 2024-09-12T00:03:46.864 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4329e-05 2024-09-12T00:03:46.864 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.865 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.865 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.865 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688140+0000", 2024-09-12T00:03:46.865 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7787999999999997e-05 2024-09-12T00:03:46.865 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.865 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.865 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.865 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.865 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:878 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.865 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:03:46.865 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.082958927, 2024-09-12T00:03:46.865 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037933009999999998, 2024-09-12T00:03:46.865 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.866 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.866 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.866 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.866 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.866 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.866 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 878 2024-09-12T00:03:46.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.866 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.866 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.866 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.866 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:03:46.866 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.866 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.866 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.867 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:03:46.867 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.867 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.867 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.867 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685265+0000", 2024-09-12T00:03:46.867 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.525e-06 2024-09-12T00:03:46.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.867 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.867 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.867 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685276+0000", 2024-09-12T00:03:46.867 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.076e-05 2024-09-12T00:03:46.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.867 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.868 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.868 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685306+0000", 2024-09-12T00:03:46.868 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0803000000000003e-05 2024-09-12T00:03:46.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.868 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.868 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.868 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685327+0000", 2024-09-12T00:03:46.868 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1061e-05 2024-09-12T00:03:46.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.868 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.868 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.868 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685429+0000", 2024-09-12T00:03:46.868 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000102015 2024-09-12T00:03:46.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.869 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.869 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.869 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685580+0000", 2024-09-12T00:03:46.869 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000151096 2024-09-12T00:03:46.869 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.869 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.869 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:46.869 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685861+0000", 2024-09-12T00:03:46.869 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028068100000000002 2024-09-12T00:03:46.869 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.869 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.869 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.869 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688647+0000", 2024-09-12T00:03:46.870 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0027860979999999999 2024-09-12T00:03:46.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.870 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.870 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.870 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688909+0000", 2024-09-12T00:03:46.870 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026159600000000001 2024-09-12T00:03:46.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.870 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.870 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.870 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688991+0000", 2024-09-12T00:03:46.870 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2429999999999995e-05 2024-09-12T00:03:46.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.870 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.870 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.871 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689056+0000", 2024-09-12T00:03:46.871 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4236e-05 2024-09-12T00:03:46.871 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.871 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.871 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.871 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.871 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:881 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.871 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:03:46.871 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.082324743999999, 2024-09-12T00:03:46.871 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003307979, 2024-09-12T00:03:46.871 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.871 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.871 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 881 2024-09-12T00:03:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:03:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.872 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:03:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685898+0000", 2024-09-12T00:03:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4249999999999999e-06 2024-09-12T00:03:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685904+0000", 2024-09-12T00:03:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1290000000000001e-06 2024-09-12T00:03:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.873 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685917+0000", 2024-09-12T00:03:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2825e-05 2024-09-12T00:03:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685925+0000", 2024-09-12T00:03:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6589999999999996e-06 2024-09-12T00:03:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686156+0000", 2024-09-12T00:03:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023017299999999999 2024-09-12T00:03:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.874 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686365+0000", 2024-09-12T00:03:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000209442 2024-09-12T00:03:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686567+0000", 2024-09-12T00:03:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020237400000000001 2024-09-12T00:03:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689076+0000", 2024-09-12T00:03:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002508957 2024-09-12T00:03:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.876 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.876 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689121+0000", 2024-09-12T00:03:46.876 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4561999999999998e-05 2024-09-12T00:03:46.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.876 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.876 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.876 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689168+0000", 2024-09-12T00:03:46.876 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7000999999999999e-05 2024-09-12T00:03:46.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.876 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.876 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.876 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689204+0000", 2024-09-12T00:03:46.876 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6431999999999999e-05 2024-09-12T00:03:46.877 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.877 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.877 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.877 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:894 6.0 6:05588ce8:lc::lc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:03:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.077968778000001, 2024-09-12T00:03:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040691010000000003, 2024-09-12T00:03:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 894 2024-09-12T00:03:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.878 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:03:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:03:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690253+0000", 2024-09-12T00:03:46.879 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.026e-06 2024-09-12T00:03:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690259+0000", 2024-09-12T00:03:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7389999999999996e-06 2024-09-12T00:03:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690273+0000", 2024-09-12T00:03:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3749e-05 2024-09-12T00:03:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.880 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690282+0000", 2024-09-12T00:03:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2520000000000005e-06 2024-09-12T00:03:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690704+0000", 2024-09-12T00:03:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042222199999999998 2024-09-12T00:03:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.881 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690826+0000", 2024-09-12T00:03:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012141099999999999 2024-09-12T00:03:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.691094+0000", 2024-09-12T00:03:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000268344 2024-09-12T00:03:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.693007+0000", 2024-09-12T00:03:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001912495 2024-09-12T00:03:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.882 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694184+0000", 2024-09-12T00:03:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00117786 2024-09-12T00:03:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694259+0000", 2024-09-12T00:03:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4091000000000006e-05 2024-09-12T00:03:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694321+0000", 2024-09-12T00:03:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2911999999999997e-05 2024-09-12T00:03:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.883 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1283 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:03:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.578650242, 2024-09-12T00:03:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00320967, 2024-09-12T00:03:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:46.884 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1283 2024-09-12T00:03:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:03:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:03:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.885 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.886 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:46.886 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189573+0000", 2024-09-12T00:03:46.886 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3130000000000001e-06 2024-09-12T00:03:46.886 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.886 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.886 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:46.886 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189583+0000", 2024-09-12T00:03:46.886 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4129999999999995e-06 2024-09-12T00:03:46.886 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.886 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.886 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:46.886 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189608+0000", 2024-09-12T00:03:46.886 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5863e-05 2024-09-12T00:03:46.886 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189628+0000", 2024-09-12T00:03:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9644e-05 2024-09-12T00:03:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189747+0000", 2024-09-12T00:03:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118999 2024-09-12T00:03:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189874+0000", 2024-09-12T00:03:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012674499999999999 2024-09-12T00:03:46.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.888 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:03:46.888 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.190148+0000", 2024-09-12T00:03:46.888 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000274431 2024-09-12T00:03:46.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.888 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:46.888 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.191174+0000", 2024-09-12T00:03:46.888 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001025855 2024-09-12T00:03:46.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.888 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:46.888 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192627+0000", 2024-09-12T00:03:46.888 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014527979999999999 2024-09-12T00:03:46.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.889 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.889 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:46.889 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192710+0000", 2024-09-12T00:03:46.889 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3146000000000007e-05 2024-09-12T00:03:46.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:46.889 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:46.889 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:46.889 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192781+0000", 2024-09-12T00:03:46.889 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.0463000000000006e-05 2024-09-12T00:03:46.889 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.889 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.889 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.889 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:46.890 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:46.890 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:46.890 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:03:46.891 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:46.825+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:46.927 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:03:46.925+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:03:47.015 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:03:47.016 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:03:47.016 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:03:47.016 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:03:47.028 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:47.025+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:47.030 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:03:47.129 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:03:47.133+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:03:47.200 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:03:47.200 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:03:47.200 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:03:47.200 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:03:47.200 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:03:47.214 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:03:47.257 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:47.257+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:47.267 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:03:47.331 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:03:47.329+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:03:47.337 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:03:47.337 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:03:47.337 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:03:47.337 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:03:47.338 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.338 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:03:47.338 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:03:47.338 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 16.008676068, 2024-09-12T00:03:47.338 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.027441031000000001, 2024-09-12T00:03:47.338 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:47.338 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:47.338 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:47.338 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:47.338 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:47.338 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:47.338 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:03:47.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.338 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:47.339 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.339 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:47.339 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:03:47.339 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.339 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.339 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.339 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:47.339 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:03:47.339 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.339 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.339 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.339 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:47.339 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330357+0000", 2024-09-12T00:03:47.340 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2339999999999996e-06 2024-09-12T00:03:47.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.340 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.340 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:47.340 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330381+0000", 2024-09-12T00:03:47.340 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4626000000000001e-05 2024-09-12T00:03:47.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.340 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.340 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:47.340 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330417+0000", 2024-09-12T00:03:47.340 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5886000000000002e-05 2024-09-12T00:03:47.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.341 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.341 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:47.341 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330442+0000", 2024-09-12T00:03:47.341 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4522999999999999e-05 2024-09-12T00:03:47.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.341 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.341 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.341 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335485+0000", 2024-09-12T00:03:47.341 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050432589999999996 2024-09-12T00:03:47.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.341 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.342 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:03:47.343 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335507+0000", 2024-09-12T00:03:47.343 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2013000000000001e-05 2024-09-12T00:03:47.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.343 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.343 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.343 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.351747+0000", 2024-09-12T00:03:47.343 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016240451999999999 2024-09-12T00:03:47.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.343 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.343 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:47.343 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352062+0000", 2024-09-12T00:03:47.343 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031433399999999999 2024-09-12T00:03:47.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.344 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.344 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:03:47.344 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352378+0000", 2024-09-12T00:03:47.344 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031586400000000001 2024-09-12T00:03:47.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.344 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.344 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:47.344 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.355074+0000", 2024-09-12T00:03:47.344 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026962919999999999 2024-09-12T00:03:47.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.344 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.344 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:47.344 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357537+0000", 2024-09-12T00:03:47.345 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024634689999999998 2024-09-12T00:03:47.345 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.345 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.345 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:47.346 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357680+0000", 2024-09-12T00:03:47.346 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014314899999999999 2024-09-12T00:03:47.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.346 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.346 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:47.346 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357793+0000", 2024-09-12T00:03:47.346 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011293 2024-09-12T00:03:47.346 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.346 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:47.346 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.346 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.346 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94232250902656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:03:47.347 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:03:47.347 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 15.980760908000001, 2024-09-12T00:03:47.347 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052696050000000001, 2024-09-12T00:03:47.347 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:47.347 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:47.347 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:47.347 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:47.347 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:47.347 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:47.347 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:03:47.347 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.347 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:47.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.347 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:47.348 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:03:47.348 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.348 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.348 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:47.348 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:03:47.348 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.348 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.348 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:47.348 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358270+0000", 2024-09-12T00:03:47.348 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.17e-06 2024-09-12T00:03:47.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.348 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.349 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:47.349 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358278+0000", 2024-09-12T00:03:47.349 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3529999999999995e-06 2024-09-12T00:03:47.349 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.349 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.349 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:47.349 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358306+0000", 2024-09-12T00:03:47.349 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7763000000000002e-05 2024-09-12T00:03:47.349 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.349 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.349 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:47.349 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358324+0000", 2024-09-12T00:03:47.349 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7861000000000001e-05 2024-09-12T00:03:47.349 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.350 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.350 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.350 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358447+0000", 2024-09-12T00:03:47.350 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012334299999999999 2024-09-12T00:03:47.350 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.350 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.350 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:47.350 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358624+0000", 2024-09-12T00:03:47.351 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017684999999999999 2024-09-12T00:03:47.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.351 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.351 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:03:47.351 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358964+0000", 2024-09-12T00:03:47.351 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00033991199999999999 2024-09-12T00:03:47.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.351 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.351 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:47.351 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.362920+0000", 2024-09-12T00:03:47.351 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039564600000000002 2024-09-12T00:03:47.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.351 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.351 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:47.352 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363016+0000", 2024-09-12T00:03:47.352 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5612999999999994e-05 2024-09-12T00:03:47.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.352 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.352 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:47.352 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363244+0000", 2024-09-12T00:03:47.352 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000228385 2024-09-12T00:03:47.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.352 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.352 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:47.352 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363537+0000", 2024-09-12T00:03:47.352 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00029289499999999999 2024-09-12T00:03:47.352 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.352 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:47.353 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.353 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.353 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:47.353 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:03:47.353 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 12.973383391, 2024-09-12T00:03:47.353 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011415537, 2024-09-12T00:03:47.353 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:47.353 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:47.353 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:47.353 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:47.353 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:47.353 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:47.354 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 209 2024-09-12T00:03:47.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.354 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:47.354 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.354 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:47.354 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:03:47.354 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.354 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.354 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:47.354 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:03:47.354 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.355 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.355 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:47.355 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365648+0000", 2024-09-12T00:03:47.355 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7360000000000001e-06 2024-09-12T00:03:47.355 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.355 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.355 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:47.355 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365660+0000", 2024-09-12T00:03:47.355 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2089999999999999e-05 2024-09-12T00:03:47.355 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.355 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.355 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:47.355 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365690+0000", 2024-09-12T00:03:47.356 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0320000000000001e-05 2024-09-12T00:03:47.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.356 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.356 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:47.356 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365708+0000", 2024-09-12T00:03:47.356 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7520000000000002e-05 2024-09-12T00:03:47.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.356 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.356 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.356 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365870+0000", 2024-09-12T00:03:47.356 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016208600000000001 2024-09-12T00:03:47.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.356 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.357 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:03:47.357 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365885+0000", 2024-09-12T00:03:47.357 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5119999999999999e-05 2024-09-12T00:03:47.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.357 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.357 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.357 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373482+0000", 2024-09-12T00:03:47.357 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075970279999999996 2024-09-12T00:03:47.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.357 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.357 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:47.357 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373805+0000", 2024-09-12T00:03:47.357 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032262799999999999 2024-09-12T00:03:47.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.358 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.358 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:47.358 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.374297+0000", 2024-09-12T00:03:47.358 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00049250599999999998 2024-09-12T00:03:47.358 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.358 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.358 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:47.358 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.375670+0000", 2024-09-12T00:03:47.358 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001373333 2024-09-12T00:03:47.358 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.358 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.358 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:47.358 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.376923+0000", 2024-09-12T00:03:47.358 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012525640000000001 2024-09-12T00:03:47.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:47.359 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377000+0000", 2024-09-12T00:03:47.359 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6732999999999999e-05 2024-09-12T00:03:47.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:47.359 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377061+0000", 2024-09-12T00:03:47.359 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0872999999999998e-05 2024-09-12T00:03:47.359 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.359 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:47.359 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.360 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.360 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:240 6.19 6:9f626c48:lc::lc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:47.360 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:03:47.360 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 12.854797638000001, 2024-09-12T00:03:47.360 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058545680000000001, 2024-09-12T00:03:47.360 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:47.360 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:47.360 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:47.360 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:47.360 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:47.360 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:47.360 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 240 2024-09-12T00:03:47.361 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.361 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:47.361 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.361 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:47.361 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:03:47.361 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.361 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.361 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.361 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:47.361 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:03:47.361 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.361 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.361 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.362 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:47.362 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484233+0000", 2024-09-12T00:03:47.362 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.973e-06 2024-09-12T00:03:47.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.362 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.362 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:47.362 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484241+0000", 2024-09-12T00:03:47.362 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8210000000000002e-06 2024-09-12T00:03:47.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.362 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.362 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:47.362 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484260+0000", 2024-09-12T00:03:47.362 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9148999999999999e-05 2024-09-12T00:03:47.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.363 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:47.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484268+0000", 2024-09-12T00:03:47.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5120000000000008e-06 2024-09-12T00:03:47.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.363 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484371+0000", 2024-09-12T00:03:47.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102501 2024-09-12T00:03:47.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.363 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:47.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484450+0000", 2024-09-12T00:03:47.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9122999999999994e-05 2024-09-12T00:03:47.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:47.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484578+0000", 2024-09-12T00:03:47.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000128095 2024-09-12T00:03:47.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:47.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.485336+0000", 2024-09-12T00:03:47.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00075754000000000001 2024-09-12T00:03:47.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:47.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.489975+0000", 2024-09-12T00:03:47.365 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004639738 2024-09-12T00:03:47.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.365 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:47.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490043+0000", 2024-09-12T00:03:47.365 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7923999999999995e-05 2024-09-12T00:03:47.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.365 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:47.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490085+0000", 2024-09-12T00:03:47.365 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2191999999999999e-05 2024-09-12T00:03:47.365 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.365 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:47.366 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.366 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.366 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:412 6.3 6:c3a682d4:reshard::reshard.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:47.366 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:03:47.366 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 12.812402232, 2024-09-12T00:03:47.366 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049075530000000003, 2024-09-12T00:03:47.366 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:47.366 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:47.366 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:47.366 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:47.367 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:47.367 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:47.367 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 412 2024-09-12T00:03:47.367 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.367 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:47.367 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.367 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:47.367 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:03:47.367 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.367 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.367 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.367 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:47.367 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:03:47.367 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.368 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:47.368 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526628+0000", 2024-09-12T00:03:47.368 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.513e-06 2024-09-12T00:03:47.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.368 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:47.368 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526634+0000", 2024-09-12T00:03:47.368 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1279999999999996e-06 2024-09-12T00:03:47.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.368 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:47.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526649+0000", 2024-09-12T00:03:47.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4997999999999999e-05 2024-09-12T00:03:47.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:47.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526658+0000", 2024-09-12T00:03:47.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1589999999999999e-06 2024-09-12T00:03:47.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526728+0000", 2024-09-12T00:03:47.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0203999999999994e-05 2024-09-12T00:03:47.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:47.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526839+0000", 2024-09-12T00:03:47.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011055 2024-09-12T00:03:47.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:47.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526979+0000", 2024-09-12T00:03:47.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139863 2024-09-12T00:03:47.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:47.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.527616+0000", 2024-09-12T00:03:47.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00063707900000000003 2024-09-12T00:03:47.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.371 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:47.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531450+0000", 2024-09-12T00:03:47.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003833819 2024-09-12T00:03:47.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.371 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:47.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531490+0000", 2024-09-12T00:03:47.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0129000000000002e-05 2024-09-12T00:03:47.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.371 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:47.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531534+0000", 2024-09-12T00:03:47.372 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4110999999999998e-05 2024-09-12T00:03:47.372 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.372 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:47.372 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.372 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.372 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.372 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:490 6.19 6:9dc32cef:lc::lc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:47.372 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:03:47.372 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 12.788204858, 2024-09-12T00:03:47.372 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047438380000000002, 2024-09-12T00:03:47.372 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:47.372 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:47.372 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:47.373 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:47.373 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:47.373 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:47.373 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 490 2024-09-12T00:03:47.373 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.373 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:47.373 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.373 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:47.373 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:03:47.373 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.373 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.373 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.373 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:47.374 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:03:47.374 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.374 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.374 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:47.374 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550825+0000", 2024-09-12T00:03:47.374 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0589999999999999e-06 2024-09-12T00:03:47.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.374 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.374 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:47.374 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550830+0000", 2024-09-12T00:03:47.374 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2140000000000004e-06 2024-09-12T00:03:47.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.375 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:47.375 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550843+0000", 2024-09-12T00:03:47.375 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3404000000000001e-05 2024-09-12T00:03:47.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.375 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:47.375 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550852+0000", 2024-09-12T00:03:47.375 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1549999999999996e-06 2024-09-12T00:03:47.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.375 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.375 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550910+0000", 2024-09-12T00:03:47.376 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7636000000000002e-05 2024-09-12T00:03:47.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.376 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.376 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:47.376 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550977+0000", 2024-09-12T00:03:47.376 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6636000000000004e-05 2024-09-12T00:03:47.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.376 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.376 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:47.376 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.551135+0000", 2024-09-12T00:03:47.377 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015852999999999999 2024-09-12T00:03:47.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.377 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:47.377 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552939+0000", 2024-09-12T00:03:47.377 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001803643 2024-09-12T00:03:47.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.377 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:47.377 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555471+0000", 2024-09-12T00:03:47.377 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002532327 2024-09-12T00:03:47.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.378 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.378 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:47.378 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555526+0000", 2024-09-12T00:03:47.378 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4728000000000002e-05 2024-09-12T00:03:47.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.378 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.378 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:47.378 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555567+0000", 2024-09-12T00:03:47.378 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1505999999999999e-05 2024-09-12T00:03:47.378 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.378 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:47.378 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.379 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.379 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:492 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'6, mlcod=35'4)", 2024-09-12T00:03:47.379 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:03:47.379 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 12.786428794000001, 2024-09-12T00:03:47.379 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056118790000000002, 2024-09-12T00:03:47.379 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:47.379 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:47.379 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:47.379 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:47.379 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.379 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:47.379 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:03:47.379 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.379 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.380 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.380 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:47.380 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:03:47.380 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.380 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.380 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:47.380 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552601+0000", 2024-09-12T00:03:47.380 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6899999999999996e-07 2024-09-12T00:03:47.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.380 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.380 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:47.380 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552608+0000", 2024-09-12T00:03:47.380 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4529999999999996e-06 2024-09-12T00:03:47.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.381 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.381 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:47.381 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552624+0000", 2024-09-12T00:03:47.381 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5885000000000001e-05 2024-09-12T00:03:47.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.381 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.381 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:47.381 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552632+0000", 2024-09-12T00:03:47.381 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2220000000000002e-06 2024-09-12T00:03:47.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.381 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.381 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.381 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552716+0000", 2024-09-12T00:03:47.382 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4060999999999994e-05 2024-09-12T00:03:47.382 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.382 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.382 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:47.382 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552735+0000", 2024-09-12T00:03:47.382 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9170000000000001e-05 2024-09-12T00:03:47.382 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.382 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.382 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:47.382 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558164+0000", 2024-09-12T00:03:47.382 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054289899999999999 2024-09-12T00:03:47.382 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.382 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.382 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:47.383 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558212+0000", 2024-09-12T00:03:47.383 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7129000000000002e-05 2024-09-12T00:03:47.383 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.383 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:47.383 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.383 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.383 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:496 6.3 6:c134263f:lc::lc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:47.383 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:03:47.383 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 12.785321506000001, 2024-09-12T00:03:47.383 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045956260000000002, 2024-09-12T00:03:47.383 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:47.383 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:47.384 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:47.384 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:47.384 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:47.384 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:47.384 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 496 2024-09-12T00:03:47.384 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.384 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:47.384 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.384 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:47.384 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:03:47.384 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.384 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.384 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.385 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:47.385 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:03:47.385 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.385 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.385 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.385 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:47.385 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553708+0000", 2024-09-12T00:03:47.385 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2359999999999999e-06 2024-09-12T00:03:47.385 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.385 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.385 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:47.385 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553714+0000", 2024-09-12T00:03:47.385 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4960000000000004e-06 2024-09-12T00:03:47.385 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.386 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.386 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:47.386 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553726+0000", 2024-09-12T00:03:47.386 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2618e-05 2024-09-12T00:03:47.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.386 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.386 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:47.386 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553734+0000", 2024-09-12T00:03:47.386 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4159999999999998e-06 2024-09-12T00:03:47.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.386 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.386 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.386 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553771+0000", 2024-09-12T00:03:47.386 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7095999999999999e-05 2024-09-12T00:03:47.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.387 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:47.387 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553815+0000", 2024-09-12T00:03:47.387 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3986999999999997e-05 2024-09-12T00:03:47.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.387 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:47.387 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553922+0000", 2024-09-12T00:03:47.387 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000107534 2024-09-12T00:03:47.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.387 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:47.388 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555052+0000", 2024-09-12T00:03:47.388 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011298359999999999 2024-09-12T00:03:47.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.388 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.388 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:47.388 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558197+0000", 2024-09-12T00:03:47.388 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0031450269999999999 2024-09-12T00:03:47.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.388 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.388 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:47.388 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558256+0000", 2024-09-12T00:03:47.388 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8403999999999999e-05 2024-09-12T00:03:47.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.388 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.389 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:47.389 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558303+0000", 2024-09-12T00:03:47.389 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6975999999999999e-05 2024-09-12T00:03:47.389 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.389 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:47.389 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.389 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.389 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.389 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:641 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:47.389 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:03:47.389 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 12.745251179, 2024-09-12T00:03:47.389 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052824789999999996, 2024-09-12T00:03:47.389 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:47.390 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:47.390 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:47.390 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:47.390 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:47.390 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:47.390 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 641 2024-09-12T00:03:47.390 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.390 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:47.390 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.390 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:47.390 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:03:47.390 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.390 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.390 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.391 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:47.391 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:03:47.391 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.391 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.391 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:47.391 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593778+0000", 2024-09-12T00:03:47.391 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0920000000000001e-06 2024-09-12T00:03:47.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.391 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.391 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:47.391 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593783+0000", 2024-09-12T00:03:47.391 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9490000000000004e-06 2024-09-12T00:03:47.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.392 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:47.392 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593795+0000", 2024-09-12T00:03:47.392 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2048999999999999e-05 2024-09-12T00:03:47.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.392 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:47.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593801+0000", 2024-09-12T00:03:47.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8989999999999998e-06 2024-09-12T00:03:47.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.393 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593852+0000", 2024-09-12T00:03:47.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1057999999999998e-05 2024-09-12T00:03:47.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.393 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:47.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593905+0000", 2024-09-12T00:03:47.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2196e-05 2024-09-12T00:03:47.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.394 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:03:47.394 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594017+0000", 2024-09-12T00:03:47.394 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000112816 2024-09-12T00:03:47.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.394 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.394 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:47.394 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.595190+0000", 2024-09-12T00:03:47.394 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011727199999999999 2024-09-12T00:03:47.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.394 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.394 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:47.394 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.598998+0000", 2024-09-12T00:03:47.394 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038081320000000001 2024-09-12T00:03:47.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.395 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.395 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:47.395 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599032+0000", 2024-09-12T00:03:47.395 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4283999999999999e-05 2024-09-12T00:03:47.395 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.395 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.395 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:47.395 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599060+0000", 2024-09-12T00:03:47.395 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7284000000000002e-05 2024-09-12T00:03:47.395 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.395 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:47.395 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.395 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.395 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.396 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:643 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'8, mlcod=35'6)", 2024-09-12T00:03:47.396 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:03:47.396 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 12.744753072, 2024-09-12T00:03:47.396 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048211260000000002, 2024-09-12T00:03:47.396 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:47.396 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:47.396 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:47.396 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:47.396 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.396 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:47.396 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:03:47.396 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.397 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:47.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:03:47.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.397 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:47.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594276+0000", 2024-09-12T00:03:47.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5899999999999995e-07 2024-09-12T00:03:47.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.397 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:47.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594283+0000", 2024-09-12T00:03:47.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6019999999999996e-06 2024-09-12T00:03:47.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.398 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:47.398 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594295+0000", 2024-09-12T00:03:47.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1683e-05 2024-09-12T00:03:47.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:47.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594303+0000", 2024-09-12T00:03:47.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0439999999999996e-06 2024-09-12T00:03:47.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594353+0000", 2024-09-12T00:03:47.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0698000000000001e-05 2024-09-12T00:03:47.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:47.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594380+0000", 2024-09-12T00:03:47.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7089000000000001e-05 2024-09-12T00:03:47.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.400 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:47.400 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599063+0000", 2024-09-12T00:03:47.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046824739999999998 2024-09-12T00:03:47.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.401 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:47.401 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599096+0000", 2024-09-12T00:03:47.401 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3677000000000003e-05 2024-09-12T00:03:47.401 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.401 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:47.401 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.401 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:647 6.a 6:5395e6f3:lc::lc.4:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:47.401 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:03:47.401 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 12.742402438999999, 2024-09-12T00:03:47.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049071770000000004, 2024-09-12T00:03:47.402 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:47.402 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:47.402 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:47.402 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:47.402 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:47.402 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:47.402 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 647 2024-09-12T00:03:47.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.402 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:47.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.402 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:47.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:03:47.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.403 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:47.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:03:47.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.403 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:47.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596627+0000", 2024-09-12T00:03:47.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1149999999999999e-06 2024-09-12T00:03:47.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:47.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596632+0000", 2024-09-12T00:03:47.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7060000000000003e-06 2024-09-12T00:03:47.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:47.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596645+0000", 2024-09-12T00:03:47.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2791e-05 2024-09-12T00:03:47.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:47.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596653+0000", 2024-09-12T00:03:47.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9230000000000002e-06 2024-09-12T00:03:47.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596705+0000", 2024-09-12T00:03:47.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2250000000000003e-05 2024-09-12T00:03:47.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:47.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596758+0000", 2024-09-12T00:03:47.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2964000000000003e-05 2024-09-12T00:03:47.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:47.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596873+0000", 2024-09-12T00:03:47.406 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011501 2024-09-12T00:03:47.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.406 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:47.406 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599088+0000", 2024-09-12T00:03:47.406 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002215135 2024-09-12T00:03:47.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.406 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:47.406 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601456+0000", 2024-09-12T00:03:47.406 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023684719999999999 2024-09-12T00:03:47.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:47.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601507+0000", 2024-09-12T00:03:47.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0933999999999997e-05 2024-09-12T00:03:47.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:47.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601533+0000", 2024-09-12T00:03:47.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5877e-05 2024-09-12T00:03:47.407 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.407 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:47.407 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.407 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:657 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'10, mlcod=35'7)", 2024-09-12T00:03:47.408 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:03:47.408 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 12.738578899, 2024-09-12T00:03:47.408 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066410239999999997, 2024-09-12T00:03:47.408 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:47.408 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:47.408 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:47.408 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:47.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.408 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:47.408 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:03:47.408 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:47.409 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:03:47.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:47.409 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:03:47.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6099999999999999e-07 2024-09-12T00:03:47.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:47.409 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600457+0000", 2024-09-12T00:03:47.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8700000000000003e-06 2024-09-12T00:03:47.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:47.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600470+0000", 2024-09-12T00:03:47.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3186999999999999e-05 2024-09-12T00:03:47.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:47.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600478+0000", 2024-09-12T00:03:47.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5310000000000004e-06 2024-09-12T00:03:47.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600521+0000", 2024-09-12T00:03:47.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2574000000000003e-05 2024-09-12T00:03:47.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.411 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:47.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600535+0000", 2024-09-12T00:03:47.411 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4151000000000001e-05 2024-09-12T00:03:47.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.411 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:47.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.606997+0000", 2024-09-12T00:03:47.411 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064626099999999997 2024-09-12T00:03:47.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.411 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:47.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607091+0000", 2024-09-12T00:03:47.412 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3239999999999995e-05 2024-09-12T00:03:47.412 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.412 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:47.412 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.412 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.412 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:659 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:47.412 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:03:47.412 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 12.738406567, 2024-09-12T00:03:47.412 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0065340989999999998, 2024-09-12T00:03:47.412 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:47.412 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:47.412 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:47.413 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:47.413 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:47.413 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:47.413 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 659 2024-09-12T00:03:47.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.413 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:47.413 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:47.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:03:47.413 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.413 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:47.414 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:03:47.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.414 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:47.414 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600623+0000", 2024-09-12T00:03:47.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.085e-06 2024-09-12T00:03:47.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.414 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:47.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600630+0000", 2024-09-12T00:03:47.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0029999999999997e-06 2024-09-12T00:03:47.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:47.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600647+0000", 2024-09-12T00:03:47.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6566999999999999e-05 2024-09-12T00:03:47.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:47.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600658+0000", 2024-09-12T00:03:47.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0992000000000001e-05 2024-09-12T00:03:47.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600717+0000", 2024-09-12T00:03:47.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9925e-05 2024-09-12T00:03:47.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.417 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:47.417 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600773+0000", 2024-09-12T00:03:47.417 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5766000000000001e-05 2024-09-12T00:03:47.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.417 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:03:47.417 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600889+0000", 2024-09-12T00:03:47.417 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115906 2024-09-12T00:03:47.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.418 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.418 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:47.418 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603483+0000", 2024-09-12T00:03:47.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025940799999999999 2024-09-12T00:03:47.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.418 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.418 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:47.418 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607098+0000", 2024-09-12T00:03:47.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036150459999999998 2024-09-12T00:03:47.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.418 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.418 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:47.419 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607133+0000", 2024-09-12T00:03:47.419 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4615e-05 2024-09-12T00:03:47.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.419 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.419 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:47.419 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607156+0000", 2024-09-12T00:03:47.419 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3113999999999999e-05 2024-09-12T00:03:47.419 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.419 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:47.419 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.420 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.420 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:666 6.a 6:5395e6f3:lc::lc.4:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:47.420 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:03:47.420 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 12.736659438, 2024-09-12T00:03:47.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.005127174, 2024-09-12T00:03:47.420 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:47.420 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:47.420 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:47.420 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:47.420 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:47.420 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:47.420 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 666 2024-09-12T00:03:47.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.421 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:47.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:47.421 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:03:47.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:47.421 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:03:47.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:47.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602370+0000", 2024-09-12T00:03:47.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0720000000000001e-06 2024-09-12T00:03:47.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:47.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602376+0000", 2024-09-12T00:03:47.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5489999999999997e-06 2024-09-12T00:03:47.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:47.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602391+0000", 2024-09-12T00:03:47.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5301000000000001e-05 2024-09-12T00:03:47.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:47.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602399+0000", 2024-09-12T00:03:47.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9179999999999994e-06 2024-09-12T00:03:47.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602456+0000", 2024-09-12T00:03:47.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7099999999999999e-05 2024-09-12T00:03:47.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:47.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602508+0000", 2024-09-12T00:03:47.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2476999999999999e-05 2024-09-12T00:03:47.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:47.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602606+0000", 2024-09-12T00:03:47.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7823000000000002e-05 2024-09-12T00:03:47.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:47.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.604653+0000", 2024-09-12T00:03:47.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002047068 2024-09-12T00:03:47.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.425 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:47.425 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607401+0000", 2024-09-12T00:03:47.425 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027477700000000001 2024-09-12T00:03:47.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.425 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:47.425 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607453+0000", 2024-09-12T00:03:47.425 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2092999999999997e-05 2024-09-12T00:03:47.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.425 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:47.425 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607496+0000", 2024-09-12T00:03:47.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3003000000000001e-05 2024-09-12T00:03:47.426 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.426 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:47.426 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.426 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.426 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:665 6.1a e35/29 6:5c7e8a6d:reshard::reshard.0000000015:head v 35'11, mlcod=35'8)", 2024-09-12T00:03:47.426 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:03:47.426 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 12.736287752999999, 2024-09-12T00:03:47.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048593209999999998, 2024-09-12T00:03:47.426 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:47.426 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:47.426 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:47.426 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:47.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:47.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:03:47.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:47.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:03:47.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:47.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602742+0000", 2024-09-12T00:03:47.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1069999999999999e-06 2024-09-12T00:03:47.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.428 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:47.428 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602749+0000", 2024-09-12T00:03:47.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9609999999999999e-06 2024-09-12T00:03:47.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.428 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:47.428 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602763+0000", 2024-09-12T00:03:47.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4086e-05 2024-09-12T00:03:47.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.428 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:47.429 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602772+0000", 2024-09-12T00:03:47.429 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8470000000000002e-06 2024-09-12T00:03:47.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.429 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.429 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602826+0000", 2024-09-12T00:03:47.429 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3885000000000003e-05 2024-09-12T00:03:47.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.429 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:47.429 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602837+0000", 2024-09-12T00:03:47.429 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1601e-05 2024-09-12T00:03:47.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.430 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:47.430 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607500+0000", 2024-09-12T00:03:47.430 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046627509999999997 2024-09-12T00:03:47.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.430 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:47.430 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607600+0000", 2024-09-12T00:03:47.430 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100083 2024-09-12T00:03:47.430 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.430 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:47.430 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.431 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:831 6.19 6:9d23f22c:lc::lc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:47.431 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:03:47.431 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 12.673003073, 2024-09-12T00:03:47.431 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047044610000000001, 2024-09-12T00:03:47.431 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:47.431 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:47.431 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:47.431 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:47.431 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:47.431 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:47.431 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 831 2024-09-12T00:03:47.431 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.431 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:47.431 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.432 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:47.432 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:03:47.432 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.432 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.432 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.432 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:47.432 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:03:47.432 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.432 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.432 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.432 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:47.432 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666026+0000", 2024-09-12T00:03:47.432 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.02e-06 2024-09-12T00:03:47.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:47.433 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666032+0000", 2024-09-12T00:03:47.433 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8850000000000004e-06 2024-09-12T00:03:47.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:47.433 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666047+0000", 2024-09-12T00:03:47.433 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4647999999999999e-05 2024-09-12T00:03:47.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:47.433 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666058+0000", 2024-09-12T00:03:47.434 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0905e-05 2024-09-12T00:03:47.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.434 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.434 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666376+0000", 2024-09-12T00:03:47.434 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031824899999999999 2024-09-12T00:03:47.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.434 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:47.434 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666479+0000", 2024-09-12T00:03:47.434 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102814 2024-09-12T00:03:47.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.434 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:47.435 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666635+0000", 2024-09-12T00:03:47.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000156343 2024-09-12T00:03:47.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.435 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:47.435 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.667611+0000", 2024-09-12T00:03:47.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000975671 2024-09-12T00:03:47.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.435 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:47.435 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670662+0000", 2024-09-12T00:03:47.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003050863 2024-09-12T00:03:47.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.436 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.436 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:47.436 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670701+0000", 2024-09-12T00:03:47.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9338000000000002e-05 2024-09-12T00:03:47.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.436 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.436 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:47.436 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670730+0000", 2024-09-12T00:03:47.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8725e-05 2024-09-12T00:03:47.436 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.436 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:47.436 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.436 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:852 6.1d e35/29 6:bbf2d10c:::obj_delete_at_hint.0000000025:head v 35'9, mlcod=35'7)", 2024-09-12T00:03:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:03:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 12.664426020000001, 2024-09-12T00:03:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00569595, 2024-09-12T00:03:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:03:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.438 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.438 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:47.438 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:03:47.438 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.438 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.438 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.438 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:47.438 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674604+0000", 2024-09-12T00:03:47.438 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2079999999999999e-06 2024-09-12T00:03:47.438 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.438 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.438 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:47.438 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674611+0000", 2024-09-12T00:03:47.438 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.973e-06 2024-09-12T00:03:47.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.439 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.439 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:47.439 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674625+0000", 2024-09-12T00:03:47.439 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3916e-05 2024-09-12T00:03:47.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.439 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.439 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:47.439 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674633+0000", 2024-09-12T00:03:47.439 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8580000000000006e-06 2024-09-12T00:03:47.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.439 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.439 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.439 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674697+0000", 2024-09-12T00:03:47.440 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4004999999999995e-05 2024-09-12T00:03:47.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.440 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.440 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:47.440 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674713+0000", 2024-09-12T00:03:47.440 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5835e-05 2024-09-12T00:03:47.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.440 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.440 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:47.440 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680245+0000", 2024-09-12T00:03:47.440 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055320250000000003 2024-09-12T00:03:47.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.441 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.441 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:47.441 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680298+0000", 2024-09-12T00:03:47.441 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3130000000000001e-05 2024-09-12T00:03:47.441 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.441 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:47.441 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.441 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.441 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:925 6.1a e35/29 6:5f2e3d26:lc::lc.18:head v 35'15, mlcod=35'12)", 2024-09-12T00:03:47.441 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:03:47.441 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 12.64089819, 2024-09-12T00:03:47.441 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055640999999999998, 2024-09-12T00:03:47.441 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:47.442 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:47.442 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:47.442 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:47.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.442 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:47.442 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:03:47.442 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.442 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:47.442 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:03:47.442 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.443 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:47.443 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698131+0000", 2024-09-12T00:03:47.443 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:03:47.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.443 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.443 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:47.443 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698140+0000", 2024-09-12T00:03:47.443 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3139999999999993e-06 2024-09-12T00:03:47.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.443 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.443 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:47.444 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698155+0000", 2024-09-12T00:03:47.444 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:03:47.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.444 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:47.444 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698164+0000", 2024-09-12T00:03:47.444 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1419999999999999e-06 2024-09-12T00:03:47.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.444 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.444 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698228+0000", 2024-09-12T00:03:47.445 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3380000000000006e-05 2024-09-12T00:03:47.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.445 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.445 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:47.445 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698252+0000", 2024-09-12T00:03:47.445 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4111e-05 2024-09-12T00:03:47.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.445 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.445 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:47.445 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703646+0000", 2024-09-12T00:03:47.445 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0053937840000000004 2024-09-12T00:03:47.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.445 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.445 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:47.446 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703694+0000", 2024-09-12T00:03:47.446 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8776999999999997e-05 2024-09-12T00:03:47.446 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.446 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:47.446 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.446 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.446 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:927 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:47.446 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:03:47.446 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 12.640379166000001, 2024-09-12T00:03:47.446 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050914949999999997, 2024-09-12T00:03:47.446 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:47.446 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:47.447 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:47.447 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:47.447 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:47.447 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:47.447 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 927 2024-09-12T00:03:47.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.447 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:47.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.447 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:47.447 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:03:47.447 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.447 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:47.448 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:03:47.448 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.448 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.448 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:47.448 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698651+0000", 2024-09-12T00:03:47.448 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3740000000000001e-06 2024-09-12T00:03:47.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.448 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.448 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:47.448 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698657+0000", 2024-09-12T00:03:47.448 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5239999999999997e-06 2024-09-12T00:03:47.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.449 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:47.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698673+0000", 2024-09-12T00:03:47.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5345999999999998e-05 2024-09-12T00:03:47.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.449 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:47.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698680+0000", 2024-09-12T00:03:47.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4649999999999997e-06 2024-09-12T00:03:47.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.449 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699009+0000", 2024-09-12T00:03:47.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032934000000000001 2024-09-12T00:03:47.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:47.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699213+0000", 2024-09-12T00:03:47.450 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020361500000000001 2024-09-12T00:03:47.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:47.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699450+0000", 2024-09-12T00:03:47.450 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023670399999999999 2024-09-12T00:03:47.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:47.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.700678+0000", 2024-09-12T00:03:47.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012285519999999999 2024-09-12T00:03:47.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.451 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:47.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703666+0000", 2024-09-12T00:03:47.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029876130000000001 2024-09-12T00:03:47.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.451 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:47.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703708+0000", 2024-09-12T00:03:47.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2361999999999999e-05 2024-09-12T00:03:47.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.452 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:47.452 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703741+0000", 2024-09-12T00:03:47.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.26e-05 2024-09-12T00:03:47.452 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.452 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:47.452 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.452 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:941 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:47.452 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:03:47.452 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 12.634885712999999, 2024-09-12T00:03:47.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0051476960000000002, 2024-09-12T00:03:47.453 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:47.453 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:47.453 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "started", 2024-09-12T00:03:47.453 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:47.453 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:47.453 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:47.453 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 941 2024-09-12T00:03:47.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.453 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:47.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.453 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:47.453 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:03:47.453 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.454 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:47.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:03:47.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:47.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.454 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:47.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704144+0000", 2024-09-12T00:03:47.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.514e-06 2024-09-12T00:03:47.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.454 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:47.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704152+0000", 2024-09-12T00:03:47.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2830000000000004e-06 2024-09-12T00:03:47.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.455 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:47.455 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704168+0000", 2024-09-12T00:03:47.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6835999999999999e-05 2024-09-12T00:03:47.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.455 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:47.455 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704178+0000", 2024-09-12T00:03:47.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7569999999999999e-06 2024-09-12T00:03:47.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.455 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:47.455 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704240+0000", 2024-09-12T00:03:47.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2193000000000006e-05 2024-09-12T00:03:47.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:47.456 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704308+0000", 2024-09-12T00:03:47.456 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7840000000000001e-05 2024-09-12T00:03:47.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:47.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:47.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:47.456 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.709290+0000", 2024-09-12T00:03:47.456 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049822729999999997 2024-09-12T00:03:47.456 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.456 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:47.456 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.456 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:47.457 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:47.457 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:03:47.458 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:03:47.459 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:03:47.459 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:03:47.459 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:03:47.459 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:03:47.460 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:03:47.460 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:03:47.460 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:47.457+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:47.461 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:03:47.461 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:03:47.482 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:03:47.483 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:03:47.503 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:03:47.503 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:03:47.523 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:03:47.523 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:03:47.544 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:03:47.544 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:03:47.558 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:47.557+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:03:47.576 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:47.576 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:47.590 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:03:47.660 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:03:47.661+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:03:47.743 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:47.743 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:47.756 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:03:47.801 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:47.801+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:47.861 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:47.857+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:47.879 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:47.879 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:47.892 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:03:47.977 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:03:47.977+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:03:48.054 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:48.054 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:48.062 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:48.061+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:48.067 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:03:48.164 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:48.165+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:03:48.241 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:48.241 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:48.254 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:03:48.297 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:48.297+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:48.366 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:48.365+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:03:48.387 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:48.388 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:48.402 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:03:48.489 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:48.489+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:48.494 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:03:48.567 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:48.565+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:48.576 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:48.576 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:48.591 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:03:48.668 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:48.669+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:03:48.751 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:48.751 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:48.766 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:03:48.768 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:48.765+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:48.869 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:48.869+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:48.891 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:48.891 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:48.905 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:03:48.971 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:48.969+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:03:49.039 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:49.039 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:49.053 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:03:49.072 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:03:49.069+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:03:49.172 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:03:49.173+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:03:49.221 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:49.222 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:49.236 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:03:49.273 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:49.273+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:49.374 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:49.373+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:03:49.409 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:49.409 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:49.423 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:03:49.483 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T00:03:49.512 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:03:49.513+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:03:49.561 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:03:49.587 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:49.587 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:49.601 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:03:49.605 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:49.605+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:49.677 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:49.677+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:49.714 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:03:49.714 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:03:49.731 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:03:49.731 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:03:49.748 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:03:49.748 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:03:49.765 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:03:49.765 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:03:49.769 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:49.769 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:49.778 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:49.777+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:49.783 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:03:49.785 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:03:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:03:49.804 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:03:49.805 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:03:49.822 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:03:49.823 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:03:49.842 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:03:49.842 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:03:49.879 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:49.877+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:03:49.911 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:49.911 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:03:49.911 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:03:49.911 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:03:49.911 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.911 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:48 7.0 e32/31 7:05bf5b68:::notify.1:head v 32'1, mlcod=0'0)", 2024-09-12T00:03:49.912 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:31.361468+0000", 2024-09-12T00:03:49.912 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 18.552808596999999, 2024-09-12T00:03:49.912 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054146239999999998, 2024-09-12T00:03:49.912 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:49.912 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:49.912 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:49.912 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:49.912 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.912 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:49.912 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.361468+0000", 2024-09-12T00:03:49.912 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.912 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.912 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.913 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:49.913 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.361468+0000", 2024-09-12T00:03:49.913 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.913 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.913 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.913 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:49.913 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.361469+0000", 2024-09-12T00:03:49.913 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.167e-06 2024-09-12T00:03:49.913 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.913 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.913 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:49.913 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.361478+0000", 2024-09-12T00:03:49.913 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1730000000000001e-06 2024-09-12T00:03:49.913 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.914 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.914 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:49.914 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.361498+0000", 2024-09-12T00:03:49.914 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.916e-05 2024-09-12T00:03:49.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.914 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.914 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:49.914 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.361516+0000", 2024-09-12T00:03:49.914 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8312999999999999e-05 2024-09-12T00:03:49.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.914 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.914 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:49.914 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.363052+0000", 2024-09-12T00:03:49.914 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015364300000000001 2024-09-12T00:03:49.915 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.915 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.915 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:49.915 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.363097+0000", 2024-09-12T00:03:49.915 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4209999999999999e-05 2024-09-12T00:03:49.915 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.915 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.915 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:49.915 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.366801+0000", 2024-09-12T00:03:49.915 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037042540000000001 2024-09-12T00:03:49.915 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.915 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.915 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:49.915 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.366883+0000", 2024-09-12T00:03:49.916 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1916999999999995e-05 2024-09-12T00:03:49.916 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.916 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:49.916 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.916 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.916 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.916 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:56 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:03:49.916 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:31.377519+0000", 2024-09-12T00:03:49.916 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 18.536758151000001, 2024-09-12T00:03:49.916 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043036230000000003, 2024-09-12T00:03:49.916 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:49.916 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:49.916 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:49.916 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:49.917 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:49.917 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:49.917 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 56 2024-09-12T00:03:49.917 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.917 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:49.917 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.917 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:49.917 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.377519+0000", 2024-09-12T00:03:49.917 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.917 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.917 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.917 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:49.917 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.377519+0000", 2024-09-12T00:03:49.917 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.918 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.918 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.918 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:49.918 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.377522+0000", 2024-09-12T00:03:49.918 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0280000000000001e-06 2024-09-12T00:03:49.918 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.918 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.918 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:49.918 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.377539+0000", 2024-09-12T00:03:49.918 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7159999999999998e-05 2024-09-12T00:03:49.918 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.918 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.918 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:49.918 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.377567+0000", 2024-09-12T00:03:49.919 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7994e-05 2024-09-12T00:03:49.919 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.919 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.919 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:49.919 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.377582+0000", 2024-09-12T00:03:49.919 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5656999999999999e-05 2024-09-12T00:03:49.919 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.919 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.919 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:49.919 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.377725+0000", 2024-09-12T00:03:49.919 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014292600000000001 2024-09-12T00:03:49.919 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.919 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.919 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:49.920 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.377942+0000", 2024-09-12T00:03:49.920 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021662499999999999 2024-09-12T00:03:49.920 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.920 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.920 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:03:49.920 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.378162+0000", 2024-09-12T00:03:49.920 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000220144 2024-09-12T00:03:49.920 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.920 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.920 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:49.920 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.379306+0000", 2024-09-12T00:03:49.920 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0011436059999999999 2024-09-12T00:03:49.920 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.920 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.921 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:49.921 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.381675+0000", 2024-09-12T00:03:49.921 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0023691910000000001 2024-09-12T00:03:49.921 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.921 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.921 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:49.921 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.381761+0000", 2024-09-12T00:03:49.921 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.5945999999999993e-05 2024-09-12T00:03:49.921 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.921 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.921 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:49.921 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.381822+0000", 2024-09-12T00:03:49.921 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1346000000000005e-05 2024-09-12T00:03:49.921 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.922 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:49.922 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.922 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.922 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.922 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:59 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94232268055680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:03:49.922 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:31.385295+0000", 2024-09-12T00:03:49.922 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 18.528982240000001, 2024-09-12T00:03:49.922 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033629950000000001, 2024-09-12T00:03:49.922 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:49.922 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:49.922 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:49.922 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:49.922 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:49.922 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:49.923 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 59 2024-09-12T00:03:49.923 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.923 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:49.923 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.923 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:49.923 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.385295+0000", 2024-09-12T00:03:49.923 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.923 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.923 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.923 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:49.923 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.385295+0000", 2024-09-12T00:03:49.923 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.923 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.923 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.924 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:49.924 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.385297+0000", 2024-09-12T00:03:49.924 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2330000000000001e-06 2024-09-12T00:03:49.924 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.924 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.924 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:49.924 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.385313+0000", 2024-09-12T00:03:49.924 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6520000000000001e-05 2024-09-12T00:03:49.924 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.924 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.924 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:49.924 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.385339+0000", 2024-09-12T00:03:49.924 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5959e-05 2024-09-12T00:03:49.924 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.925 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.925 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:49.925 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.385353+0000", 2024-09-12T00:03:49.925 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4083999999999999e-05 2024-09-12T00:03:49.925 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.925 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.925 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:49.925 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.385477+0000", 2024-09-12T00:03:49.925 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000124039 2024-09-12T00:03:49.925 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.925 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.925 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:49.925 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.385674+0000", 2024-09-12T00:03:49.925 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00019636100000000001 2024-09-12T00:03:49.926 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.926 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.926 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:49.926 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.386066+0000", 2024-09-12T00:03:49.926 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039180699999999998 2024-09-12T00:03:49.926 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.926 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.926 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:49.926 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.387807+0000", 2024-09-12T00:03:49.926 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0017412020000000001 2024-09-12T00:03:49.926 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.926 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.926 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:49.926 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.388364+0000", 2024-09-12T00:03:49.927 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00055770699999999995 2024-09-12T00:03:49.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.927 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.927 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:49.927 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.388493+0000", 2024-09-12T00:03:49.927 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000129033 2024-09-12T00:03:49.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.927 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.927 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:49.927 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.388658+0000", 2024-09-12T00:03:49.927 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016405 2024-09-12T00:03:49.927 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.927 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:49.927 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.928 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.928 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.928 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:238 6.18 e35/29 6:1a734c59:::obj_delete_at_hint.0000000000:head v 35'2, mlcod=0'0)", 2024-09-12T00:03:49.928 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.486341+0000", 2024-09-12T00:03:49.928 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.427935582, 2024-09-12T00:03:49.928 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046975569999999998, 2024-09-12T00:03:49.928 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:49.928 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:49.928 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:49.928 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:49.928 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.928 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:49.928 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486341+0000", 2024-09-12T00:03:49.929 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.929 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.929 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:49.929 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486341+0000", 2024-09-12T00:03:49.929 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.929 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.929 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:49.929 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486343+0000", 2024-09-12T00:03:49.929 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.243e-06 2024-09-12T00:03:49.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.929 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.929 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:49.930 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486357+0000", 2024-09-12T00:03:49.930 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3767e-05 2024-09-12T00:03:49.930 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.930 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.930 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:49.930 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486394+0000", 2024-09-12T00:03:49.930 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6539999999999999e-05 2024-09-12T00:03:49.930 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.930 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.930 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:49.930 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486412+0000", 2024-09-12T00:03:49.930 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8618999999999999e-05 2024-09-12T00:03:49.930 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.930 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.931 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:49.931 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486650+0000", 2024-09-12T00:03:49.931 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023717500000000001 2024-09-12T00:03:49.931 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.931 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.931 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:49.931 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486702+0000", 2024-09-12T00:03:49.931 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2509999999999997e-05 2024-09-12T00:03:49.931 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.931 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.931 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:49.931 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.490920+0000", 2024-09-12T00:03:49.931 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042180239999999999 2024-09-12T00:03:49.931 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.932 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.932 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:49.932 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491039+0000", 2024-09-12T00:03:49.932 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011867900000000001 2024-09-12T00:03:49.932 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.932 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:49.932 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.932 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.932 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.932 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:240 6.19 e35/29 6:9f626c48:lc::lc.21:head v 35'2, mlcod=0'0)", 2024-09-12T00:03:49.932 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.486746+0000", 2024-09-12T00:03:49.932 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.427531031999999, 2024-09-12T00:03:49.932 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049978369999999998, 2024-09-12T00:03:49.932 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:49.933 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:49.933 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:49.933 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:49.933 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.933 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:49.933 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486746+0000", 2024-09-12T00:03:49.933 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.933 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.933 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.933 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:49.933 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486746+0000", 2024-09-12T00:03:49.933 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.933 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.933 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.934 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:49.934 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486747+0000", 2024-09-12T00:03:49.934 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.593e-06 2024-09-12T00:03:49.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.934 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.934 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:49.934 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486760+0000", 2024-09-12T00:03:49.934 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2223e-05 2024-09-12T00:03:49.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.934 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.934 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:49.934 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486786+0000", 2024-09-12T00:03:49.934 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6953000000000001e-05 2024-09-12T00:03:49.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.935 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.935 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:49.935 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486803+0000", 2024-09-12T00:03:49.935 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6184e-05 2024-09-12T00:03:49.935 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.935 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.935 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:49.935 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486947+0000", 2024-09-12T00:03:49.935 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000144699 2024-09-12T00:03:49.935 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.935 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.935 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:49.935 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487012+0000", 2024-09-12T00:03:49.935 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4288999999999994e-05 2024-09-12T00:03:49.935 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.936 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.936 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:49.936 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491648+0000", 2024-09-12T00:03:49.936 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046367709999999996 2024-09-12T00:03:49.936 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.936 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.936 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:49.936 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491744+0000", 2024-09-12T00:03:49.936 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5124999999999995e-05 2024-09-12T00:03:49.936 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.936 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:49.936 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.936 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.937 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.937 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:241 6.7 e35/29 6:e31d3d5f:lc::lc.28:head v 35'4, mlcod=35'2)", 2024-09-12T00:03:49.937 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.487305+0000", 2024-09-12T00:03:49.937 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.426971263, 2024-09-12T00:03:49.937 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044902809999999996, 2024-09-12T00:03:49.937 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:49.937 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:49.937 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:49.937 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:49.937 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.937 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:49.937 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487305+0000", 2024-09-12T00:03:49.937 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.937 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.938 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.938 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:49.938 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487305+0000", 2024-09-12T00:03:49.938 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.938 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.938 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:49.938 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487308+0000", 2024-09-12T00:03:49.938 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1830000000000001e-06 2024-09-12T00:03:49.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.938 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.938 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:49.938 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487323+0000", 2024-09-12T00:03:49.938 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5583e-05 2024-09-12T00:03:49.939 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.939 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.939 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:49.939 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487355+0000", 2024-09-12T00:03:49.939 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1749999999999999e-05 2024-09-12T00:03:49.939 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.939 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.939 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:49.939 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487374+0000", 2024-09-12T00:03:49.939 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9318999999999999e-05 2024-09-12T00:03:49.939 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.939 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.939 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:49.939 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487509+0000", 2024-09-12T00:03:49.940 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013491299999999999 2024-09-12T00:03:49.940 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.940 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.940 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:49.940 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487560+0000", 2024-09-12T00:03:49.940 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1239999999999997e-05 2024-09-12T00:03:49.940 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.940 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.940 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:49.940 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491674+0000", 2024-09-12T00:03:49.940 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041137639999999998 2024-09-12T00:03:49.940 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.940 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.941 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:49.941 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491796+0000", 2024-09-12T00:03:49.941 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012152899999999999 2024-09-12T00:03:49.941 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.941 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:49.941 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.941 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.941 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.941 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:276 6.7 e35/29 6:e31d3d5f:lc::lc.28:head v 35'5, mlcod=35'3)", 2024-09-12T00:03:49.941 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.493883+0000", 2024-09-12T00:03:49.941 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.420393276, 2024-09-12T00:03:49.941 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047682760000000001, 2024-09-12T00:03:49.941 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:49.941 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:49.942 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:49.942 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:49.942 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.942 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:49.942 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.493883+0000", 2024-09-12T00:03:49.942 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.942 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.942 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.942 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:49.942 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.493883+0000", 2024-09-12T00:03:49.942 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.942 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.942 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.942 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:49.943 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.493886+0000", 2024-09-12T00:03:49.943 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5830000000000001e-06 2024-09-12T00:03:49.943 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.943 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.943 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:49.943 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.493901+0000", 2024-09-12T00:03:49.943 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.49e-05 2024-09-12T00:03:49.943 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.943 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.943 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:49.943 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.493957+0000", 2024-09-12T00:03:49.943 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6399e-05 2024-09-12T00:03:49.943 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.944 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.944 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:49.944 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.493983+0000", 2024-09-12T00:03:49.944 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5177e-05 2024-09-12T00:03:49.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.944 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.944 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:49.944 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.494116+0000", 2024-09-12T00:03:49.944 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013304199999999999 2024-09-12T00:03:49.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.944 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.944 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:49.944 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.494167+0000", 2024-09-12T00:03:49.944 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1199000000000002e-05 2024-09-12T00:03:49.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.945 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:49.945 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498556+0000", 2024-09-12T00:03:49.945 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043889100000000002 2024-09-12T00:03:49.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.945 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:49.945 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498652+0000", 2024-09-12T00:03:49.945 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.6065999999999998e-05 2024-09-12T00:03:49.945 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.945 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:49.945 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.946 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.946 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:272 6.18 e35/29 6:1a734c59:::obj_delete_at_hint.0000000000:head v 35'3, mlcod=34'1)", 2024-09-12T00:03:49.946 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.494479+0000", 2024-09-12T00:03:49.946 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.419797725, 2024-09-12T00:03:49.946 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00427328, 2024-09-12T00:03:49.946 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:49.946 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:49.946 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:49.946 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:49.946 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.946 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:49.946 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.494479+0000", 2024-09-12T00:03:49.946 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.947 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.947 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:49.947 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.494479+0000", 2024-09-12T00:03:49.947 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.947 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.947 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:49.947 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.494481+0000", 2024-09-12T00:03:49.947 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.717e-06 2024-09-12T00:03:49.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.947 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.947 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:49.947 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.494496+0000", 2024-09-12T00:03:49.948 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4973e-05 2024-09-12T00:03:49.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.948 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:49.948 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.494521+0000", 2024-09-12T00:03:49.948 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5703000000000001e-05 2024-09-12T00:03:49.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.948 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:49.948 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.494538+0000", 2024-09-12T00:03:49.948 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6937000000000001e-05 2024-09-12T00:03:49.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.949 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:49.949 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.494666+0000", 2024-09-12T00:03:49.949 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012796500000000001 2024-09-12T00:03:49.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.949 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:49.949 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.494718+0000", 2024-09-12T00:03:49.949 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1895999999999999e-05 2024-09-12T00:03:49.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.949 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:49.949 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498644+0000", 2024-09-12T00:03:49.949 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039253739999999997 2024-09-12T00:03:49.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.950 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.950 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:49.950 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498752+0000", 2024-09-12T00:03:49.950 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010871500000000001 2024-09-12T00:03:49.950 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.950 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:49.950 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.950 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.950 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:290 6.7 e35/29 6:e31d3d5f:lc::lc.28:head v 35'6, mlcod=35'3)", 2024-09-12T00:03:49.950 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.496964+0000", 2024-09-12T00:03:49.950 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.417312645999999, 2024-09-12T00:03:49.950 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044308159999999997, 2024-09-12T00:03:49.950 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:49.951 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:49.951 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:49.951 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:49.951 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.951 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:49.951 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.496964+0000", 2024-09-12T00:03:49.951 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.951 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.951 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:49.951 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.496964+0000", 2024-09-12T00:03:49.951 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.951 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.952 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:49.952 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.496966+0000", 2024-09-12T00:03:49.952 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3130000000000001e-06 2024-09-12T00:03:49.952 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.952 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.952 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:49.952 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.496980+0000", 2024-09-12T00:03:49.952 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3813e-05 2024-09-12T00:03:49.952 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.952 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.952 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:49.952 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497009+0000", 2024-09-12T00:03:49.952 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9162999999999998e-05 2024-09-12T00:03:49.952 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.953 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.953 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:49.953 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497027+0000", 2024-09-12T00:03:49.953 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7223000000000001e-05 2024-09-12T00:03:49.953 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.953 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.953 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:49.953 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497157+0000", 2024-09-12T00:03:49.953 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013062300000000001 2024-09-12T00:03:49.953 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.953 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.953 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:49.953 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497206+0000", 2024-09-12T00:03:49.953 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.8976e-05 2024-09-12T00:03:49.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.954 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.954 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:49.954 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.501280+0000", 2024-09-12T00:03:49.954 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040734159999999998 2024-09-12T00:03:49.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.954 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.954 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:49.954 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.501395+0000", 2024-09-12T00:03:49.954 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000115289 2024-09-12T00:03:49.954 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.954 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:49.954 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.955 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.955 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.955 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:300 6.f 6:f1983ba0:::obj_delete_at_hint.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:49.955 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.499721+0000", 2024-09-12T00:03:49.955 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.414556169000001, 2024-09-12T00:03:49.955 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010117055999999999, 2024-09-12T00:03:49.955 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:49.955 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:49.955 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:49.955 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:49.955 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:49.955 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:49.955 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 300 2024-09-12T00:03:49.955 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.956 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:49.956 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.956 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:49.956 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499721+0000", 2024-09-12T00:03:49.956 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.956 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.956 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.956 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:49.956 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499721+0000", 2024-09-12T00:03:49.956 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.956 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.956 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.956 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:49.956 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499724+0000", 2024-09-12T00:03:49.957 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2229999999999999e-06 2024-09-12T00:03:49.957 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.957 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.957 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:49.957 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499738+0000", 2024-09-12T00:03:49.957 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4353e-05 2024-09-12T00:03:49.957 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.957 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.957 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:49.957 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499779+0000", 2024-09-12T00:03:49.957 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0902999999999998e-05 2024-09-12T00:03:49.957 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.957 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.957 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:49.960 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499801+0000", 2024-09-12T00:03:49.960 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2103000000000002e-05 2024-09-12T00:03:49.960 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.960 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.960 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:49.960 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499952+0000", 2024-09-12T00:03:49.960 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000151302 2024-09-12T00:03:49.961 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.961 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.961 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:49.961 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.500163+0000", 2024-09-12T00:03:49.961 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000210998 2024-09-12T00:03:49.961 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.961 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.961 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:49.961 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.500484+0000", 2024-09-12T00:03:49.961 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00032035800000000003 2024-09-12T00:03:49.961 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.961 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.961 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:49.962 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.504369+0000", 2024-09-12T00:03:49.962 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003885346 2024-09-12T00:03:49.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.962 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.962 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:49.962 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509604+0000", 2024-09-12T00:03:49.962 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052348150000000003 2024-09-12T00:03:49.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.962 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.962 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:49.962 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509726+0000", 2024-09-12T00:03:49.962 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000121623 2024-09-12T00:03:49.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.963 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.963 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:49.963 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509838+0000", 2024-09-12T00:03:49.963 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000112032 2024-09-12T00:03:49.963 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.963 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:49.963 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.963 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.963 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.963 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:322 6.7 e35/29 6:e31d3d5f:lc::lc.28:head v 35'7, mlcod=35'5)", 2024-09-12T00:03:49.963 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.503234+0000", 2024-09-12T00:03:49.963 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.411042519, 2024-09-12T00:03:49.963 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059122549999999999, 2024-09-12T00:03:49.963 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:49.964 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:49.964 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:49.964 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:49.964 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.964 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:49.964 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503234+0000", 2024-09-12T00:03:49.964 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.964 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.964 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.964 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:49.964 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503234+0000", 2024-09-12T00:03:49.964 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.964 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.965 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.965 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:49.965 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503235+0000", 2024-09-12T00:03:49.965 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2529999999999999e-06 2024-09-12T00:03:49.965 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.965 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.965 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:49.965 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503248+0000", 2024-09-12T00:03:49.965 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2053e-05 2024-09-12T00:03:49.965 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.965 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.965 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:49.965 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503271+0000", 2024-09-12T00:03:49.966 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.315e-05 2024-09-12T00:03:49.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.966 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.966 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:49.966 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503286+0000", 2024-09-12T00:03:49.966 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5676e-05 2024-09-12T00:03:49.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.966 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.966 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:49.966 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503413+0000", 2024-09-12T00:03:49.966 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012694900000000001 2024-09-12T00:03:49.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.966 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.966 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:49.966 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503467+0000", 2024-09-12T00:03:49.967 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3847000000000001e-05 2024-09-12T00:03:49.967 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.967 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.967 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:49.967 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509043+0000", 2024-09-12T00:03:49.967 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0055757580000000001 2024-09-12T00:03:49.967 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.967 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.967 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:49.967 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509146+0000", 2024-09-12T00:03:49.967 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000103569 2024-09-12T00:03:49.967 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.967 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:49.967 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.968 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.968 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:332 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:49.968 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.505367+0000", 2024-09-12T00:03:49.968 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.408909451, 2024-09-12T00:03:49.968 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0073947600000000002, 2024-09-12T00:03:49.968 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:49.968 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:49.968 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:49.968 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:49.968 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:49.968 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:49.968 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 332 2024-09-12T00:03:49.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.969 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:49.969 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.969 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:49.969 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505367+0000", 2024-09-12T00:03:49.969 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.969 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.969 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:49.969 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505367+0000", 2024-09-12T00:03:49.969 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.969 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.969 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:49.969 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505370+0000", 2024-09-12T00:03:49.970 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.373e-06 2024-09-12T00:03:49.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.970 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.970 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:49.970 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505384+0000", 2024-09-12T00:03:49.970 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4073000000000001e-05 2024-09-12T00:03:49.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.970 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.970 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:49.970 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505423+0000", 2024-09-12T00:03:49.970 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8896999999999997e-05 2024-09-12T00:03:49.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.971 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.971 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:49.971 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505444+0000", 2024-09-12T00:03:49.971 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1336e-05 2024-09-12T00:03:49.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.971 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.971 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:49.971 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505591+0000", 2024-09-12T00:03:49.971 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000147026 2024-09-12T00:03:49.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.971 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.971 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:49.971 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505727+0000", 2024-09-12T00:03:49.971 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013580100000000001 2024-09-12T00:03:49.972 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.972 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.972 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:49.972 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.506024+0000", 2024-09-12T00:03:49.972 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00029733500000000003 2024-09-12T00:03:49.972 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.972 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.972 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:49.972 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509986+0000", 2024-09-12T00:03:49.972 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039623530000000001 2024-09-12T00:03:49.972 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.972 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.972 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:49.973 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.512500+0000", 2024-09-12T00:03:49.973 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0025136080000000001 2024-09-12T00:03:49.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.973 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:49.973 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.512650+0000", 2024-09-12T00:03:49.973 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015033200000000001 2024-09-12T00:03:49.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.973 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:49.973 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.512762+0000", 2024-09-12T00:03:49.973 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000111626 2024-09-12T00:03:49.973 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.974 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:49.974 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.974 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:347 6.f 6:f1983ba0:::obj_delete_at_hint.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:49.974 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.511060+0000", 2024-09-12T00:03:49.974 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.403216889999999, 2024-09-12T00:03:49.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041594079999999999, 2024-09-12T00:03:49.974 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:49.974 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:49.974 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:49.974 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:49.974 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:49.974 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:49.975 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 347 2024-09-12T00:03:49.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.975 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:49.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.975 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:49.975 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.511060+0000", 2024-09-12T00:03:49.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.975 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:49.975 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.511060+0000", 2024-09-12T00:03:49.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.976 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:49.976 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.511062+0000", 2024-09-12T00:03:49.976 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4760000000000001e-06 2024-09-12T00:03:49.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.976 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.976 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:49.976 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.511077+0000", 2024-09-12T00:03:49.976 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4936999999999999e-05 2024-09-12T00:03:49.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.976 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.976 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:49.976 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.511106+0000", 2024-09-12T00:03:49.976 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8496e-05 2024-09-12T00:03:49.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.977 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:49.977 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.511120+0000", 2024-09-12T00:03:49.977 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4687e-05 2024-09-12T00:03:49.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.977 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:49.977 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.511227+0000", 2024-09-12T00:03:49.977 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010655899999999999 2024-09-12T00:03:49.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.977 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:49.978 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.511358+0000", 2024-09-12T00:03:49.978 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013116899999999999 2024-09-12T00:03:49.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.978 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:49.978 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.511833+0000", 2024-09-12T00:03:49.978 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00047467899999999999 2024-09-12T00:03:49.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.978 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:49.978 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514900+0000", 2024-09-12T00:03:49.978 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0030671309999999999 2024-09-12T00:03:49.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.979 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:49.979 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.515020+0000", 2024-09-12T00:03:49.979 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120489 2024-09-12T00:03:49.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.979 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.979 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:49.979 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.515124+0000", 2024-09-12T00:03:49.979 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000103702 2024-09-12T00:03:49.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.979 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.979 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:49.979 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.515219+0000", 2024-09-12T00:03:49.979 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5082999999999997e-05 2024-09-12T00:03:49.979 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.980 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:49.980 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.980 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:369 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:49.980 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.517345+0000", 2024-09-12T00:03:49.980 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.396931759999999, 2024-09-12T00:03:49.980 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037629540000000002, 2024-09-12T00:03:49.980 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:49.980 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:49.980 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:49.980 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:49.980 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:49.980 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:49.981 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 369 2024-09-12T00:03:49.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.981 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:49.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.981 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:49.981 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517345+0000", 2024-09-12T00:03:49.981 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.981 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:49.981 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517345+0000", 2024-09-12T00:03:49.981 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.982 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:49.982 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517348+0000", 2024-09-12T00:03:49.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5299999999999999e-06 2024-09-12T00:03:49.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.982 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:49.982 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517363+0000", 2024-09-12T00:03:49.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5203e-05 2024-09-12T00:03:49.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.982 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:49.982 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517392+0000", 2024-09-12T00:03:49.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9397e-05 2024-09-12T00:03:49.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.983 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.983 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:49.983 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517414+0000", 2024-09-12T00:03:49.983 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1443000000000001e-05 2024-09-12T00:03:49.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.983 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.983 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:49.983 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517568+0000", 2024-09-12T00:03:49.983 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015393500000000001 2024-09-12T00:03:49.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.983 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.983 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:49.983 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517805+0000", 2024-09-12T00:03:49.983 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023741100000000001 2024-09-12T00:03:49.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.984 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.984 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:49.984 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.518296+0000", 2024-09-12T00:03:49.984 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00049103600000000003 2024-09-12T00:03:49.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.984 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.984 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:49.984 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519648+0000", 2024-09-12T00:03:49.984 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0013518950000000001 2024-09-12T00:03:49.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.984 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.984 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:49.984 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520914+0000", 2024-09-12T00:03:49.985 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001265756 2024-09-12T00:03:49.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.985 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:49.985 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.521004+0000", 2024-09-12T00:03:49.985 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0022e-05 2024-09-12T00:03:49.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.985 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:49.985 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.521108+0000", 2024-09-12T00:03:49.985 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000104326 2024-09-12T00:03:49.985 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.985 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:49.985 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.986 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:408 6.7 e35/29 6:e31d3d5f:lc::lc.28:head v 35'8, mlcod=35'6)", 2024-09-12T00:03:49.986 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.527804+0000", 2024-09-12T00:03:49.986 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.386472425999999, 2024-09-12T00:03:49.986 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053562820000000004, 2024-09-12T00:03:49.986 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:49.986 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:49.986 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:49.986 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:49.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.986 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:49.986 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.527804+0000", 2024-09-12T00:03:49.986 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.987 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:49.987 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.527804+0000", 2024-09-12T00:03:49.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.987 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:49.987 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.527807+0000", 2024-09-12T00:03:49.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4739999999999999e-06 2024-09-12T00:03:49.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.987 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:49.987 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.527821+0000", 2024-09-12T00:03:49.988 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4174e-05 2024-09-12T00:03:49.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.988 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:49.988 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.527849+0000", 2024-09-12T00:03:49.988 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8254000000000001e-05 2024-09-12T00:03:49.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.988 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:49.988 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.527867+0000", 2024-09-12T00:03:49.988 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7600000000000001e-05 2024-09-12T00:03:49.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.988 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:49.989 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.527987+0000", 2024-09-12T00:03:49.989 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120343 2024-09-12T00:03:49.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.989 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:49.989 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528039+0000", 2024-09-12T00:03:49.989 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.223e-05 2024-09-12T00:03:49.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.989 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:49.989 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533072+0000", 2024-09-12T00:03:49.989 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005032346 2024-09-12T00:03:49.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.990 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:49.990 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533161+0000", 2024-09-12T00:03:49.990 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8861000000000002e-05 2024-09-12T00:03:49.990 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.990 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:49.990 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.990 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.990 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.990 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:412 6.3 e35/29 6:c3a682d4:reshard::reshard.0000000004:head v 35'4, mlcod=35'2)", 2024-09-12T00:03:49.990 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.529093+0000", 2024-09-12T00:03:49.990 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.385183557, 2024-09-12T00:03:49.990 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004137801, 2024-09-12T00:03:49.990 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:49.991 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:49.991 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:49.991 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:49.991 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.991 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:49.991 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529093+0000", 2024-09-12T00:03:49.991 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.991 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.991 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:49.991 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529093+0000", 2024-09-12T00:03:49.991 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.991 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.992 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:49.992 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529101+0000", 2024-09-12T00:03:49.992 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3200000000000002e-06 2024-09-12T00:03:49.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.992 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.992 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:49.992 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529112+0000", 2024-09-12T00:03:49.992 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1143e-05 2024-09-12T00:03:49.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.992 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.992 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:49.992 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529137+0000", 2024-09-12T00:03:49.992 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5503e-05 2024-09-12T00:03:49.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.993 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:49.993 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529155+0000", 2024-09-12T00:03:49.993 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7802999999999999e-05 2024-09-12T00:03:49.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.993 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:49.993 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529301+0000", 2024-09-12T00:03:49.993 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000146036 2024-09-12T00:03:49.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.993 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:49.993 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529364+0000", 2024-09-12T00:03:49.993 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2922000000000005e-05 2024-09-12T00:03:49.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.994 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:49.994 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533060+0000", 2024-09-12T00:03:49.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0036959689999999999 2024-09-12T00:03:49.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.994 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:49.994 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533231+0000", 2024-09-12T00:03:49.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017110500000000001 2024-09-12T00:03:49.994 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.994 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:49.994 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:49.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.995 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.995 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:442 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:49.995 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.536937+0000", 2024-09-12T00:03:49.995 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.377340070000001, 2024-09-12T00:03:49.995 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00340465, 2024-09-12T00:03:49.995 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:49.995 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:49.995 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:49.995 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:49.995 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:49.995 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:49.995 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 442 2024-09-12T00:03:49.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.995 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:49.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.996 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:49.996 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536937+0000", 2024-09-12T00:03:49.996 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.996 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:49.996 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536937+0000", 2024-09-12T00:03:49.996 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:49.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.996 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:49.996 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536939+0000", 2024-09-12T00:03:49.996 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.491e-06 2024-09-12T00:03:49.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.997 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.997 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:49.997 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536952+0000", 2024-09-12T00:03:49.997 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3043e-05 2024-09-12T00:03:49.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.997 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.997 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:49.997 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536994+0000", 2024-09-12T00:03:49.997 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1839999999999999e-05 2024-09-12T00:03:49.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.997 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.997 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:49.997 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.537012+0000", 2024-09-12T00:03:49.997 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8425000000000001e-05 2024-09-12T00:03:49.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.998 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.998 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:49.998 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.537124+0000", 2024-09-12T00:03:49.998 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011175600000000001 2024-09-12T00:03:49.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.998 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.998 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:49.998 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.537360+0000", 2024-09-12T00:03:49.998 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023553300000000001 2024-09-12T00:03:49.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.999 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:03:49.999 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.537750+0000", 2024-09-12T00:03:49.999 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039065900000000001 2024-09-12T00:03:49.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.999 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:49.999 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539049+0000", 2024-09-12T00:03:49.999 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001298537 2024-09-12T00:03:49.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:49.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:49.999 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:49.999 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.540099+0000", 2024-09-12T00:03:50.000 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001050294 2024-09-12T00:03:50.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.000 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.000 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.000 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.540230+0000", 2024-09-12T00:03:50.000 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000130591 2024-09-12T00:03:50.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.000 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.000 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.000 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.540341+0000", 2024-09-12T00:03:50.000 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000111481 2024-09-12T00:03:50.000 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.000 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.000 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.001 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.001 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.001 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:826 6.18 e35/29 6:1902608e:::obj_delete_at_hint.0000000024:head v 35'10, mlcod=35'8)", 2024-09-12T00:03:50.001 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.667764+0000", 2024-09-12T00:03:50.001 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.246512714, 2024-09-12T00:03:50.001 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046882099999999999, 2024-09-12T00:03:50.001 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.001 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.001 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.001 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.001 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.001 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.001 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667764+0000", 2024-09-12T00:03:50.001 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.002 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.002 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.002 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667764+0000", 2024-09-12T00:03:50.002 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.002 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.002 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.002 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667765+0000", 2024-09-12T00:03:50.002 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4079999999999999e-06 2024-09-12T00:03:50.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.002 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.002 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.002 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667775+0000", 2024-09-12T00:03:50.003 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5959999999999993e-06 2024-09-12T00:03:50.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.003 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.003 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667795+0000", 2024-09-12T00:03:50.003 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0369000000000001e-05 2024-09-12T00:03:50.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.003 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.003 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667807+0000", 2024-09-12T00:03:50.003 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2009e-05 2024-09-12T00:03:50.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.003 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.004 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667890+0000", 2024-09-12T00:03:50.004 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2934000000000003e-05 2024-09-12T00:03:50.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.004 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.004 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667925+0000", 2024-09-12T00:03:50.004 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5046000000000003e-05 2024-09-12T00:03:50.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.005 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.672355+0000", 2024-09-12T00:03:50.005 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044299099999999996 2024-09-12T00:03:50.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.005 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.005 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.672452+0000", 2024-09-12T00:03:50.005 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.6937999999999999e-05 2024-09-12T00:03:50.005 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.005 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.005 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.005 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.005 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:831 6.19 e35/29 6:9d23f22c:lc::lc.15:head v 35'19, mlcod=35'17)", 2024-09-12T00:03:50.006 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.668735+0000", 2024-09-12T00:03:50.006 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.245541525, 2024-09-12T00:03:50.006 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037047669999999999, 2024-09-12T00:03:50.006 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.006 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.006 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.006 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.006 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.006 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.668735+0000", 2024-09-12T00:03:50.006 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.006 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.007 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.668735+0000", 2024-09-12T00:03:50.007 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.007 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.007 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.007 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.007 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.668736+0000", 2024-09-12T00:03:50.007 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3799999999999996e-07 2024-09-12T00:03:50.007 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.007 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.007 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.007 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.668744+0000", 2024-09-12T00:03:50.007 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6699999999999994e-06 2024-09-12T00:03:50.007 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.007 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.008 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.008 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.668756+0000", 2024-09-12T00:03:50.008 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2147000000000001e-05 2024-09-12T00:03:50.008 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.008 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.008 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.008 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.668766+0000", 2024-09-12T00:03:50.008 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7899999999999994e-06 2024-09-12T00:03:50.008 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.008 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.008 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.008 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.668835+0000", 2024-09-12T00:03:50.008 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9004000000000005e-05 2024-09-12T00:03:50.008 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.009 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.009 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.009 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.668854+0000", 2024-09-12T00:03:50.009 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9783999999999999e-05 2024-09-12T00:03:50.009 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.009 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.009 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.009 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.672379+0000", 2024-09-12T00:03:50.009 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0035240649999999998 2024-09-12T00:03:50.009 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.009 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.009 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.009 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.672440+0000", 2024-09-12T00:03:50.009 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1469000000000004e-05 2024-09-12T00:03:50.010 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.010 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.010 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.010 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.010 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:834 6.19 e35/29 6:9f626c48:lc::lc.21:head v 35'20, mlcod=35'17)", 2024-09-12T00:03:50.010 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.669537+0000", 2024-09-12T00:03:50.010 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.244739464, 2024-09-12T00:03:50.010 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003355163, 2024-09-12T00:03:50.010 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.010 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.010 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.010 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.010 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.011 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.011 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.669537+0000", 2024-09-12T00:03:50.011 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.011 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.011 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.011 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.669537+0000", 2024-09-12T00:03:50.011 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.011 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.011 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.011 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.669538+0000", 2024-09-12T00:03:50.011 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0750000000000001e-06 2024-09-12T00:03:50.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.011 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.012 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.012 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.669547+0000", 2024-09-12T00:03:50.012 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2239999999999995e-06 2024-09-12T00:03:50.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.012 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.012 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.669564+0000", 2024-09-12T00:03:50.012 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7513999999999999e-05 2024-09-12T00:03:50.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.012 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.012 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.669573+0000", 2024-09-12T00:03:50.012 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2080000000000006e-06 2024-09-12T00:03:50.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.013 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.013 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.013 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.669678+0000", 2024-09-12T00:03:50.013 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000104409 2024-09-12T00:03:50.013 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.013 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.013 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.013 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.669707+0000", 2024-09-12T00:03:50.013 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9006999999999999e-05 2024-09-12T00:03:50.013 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.013 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.013 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.013 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.672830+0000", 2024-09-12T00:03:50.013 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0031234399999999999 2024-09-12T00:03:50.014 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.014 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.014 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.014 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.672892+0000", 2024-09-12T00:03:50.014 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2286000000000006e-05 2024-09-12T00:03:50.014 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.014 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.014 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.014 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.014 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.014 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:50.016 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:03:50.016 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:50.013+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:50.117 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:03:50.117+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:03:50.194 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:50.194 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:03:50.194 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:03:50.194 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:50.208 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:03:50.252 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:50.253+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:03:50.319 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:03:50.317+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:03:50.372 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:50.372 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:03:50.372 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:03:50.372 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:03:50.372 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:50.386 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:03:50.428 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:50.429+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:03:50.521 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:50.521+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:50.559 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:50.559 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:03:50.559 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:03:50.560 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:03:50.560 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.560 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:50.560 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.463033+0000", 2024-09-12T00:03:50.560 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.096977327000001, 2024-09-12T00:03:50.560 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037134049999999999, 2024-09-12T00:03:50.561 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.561 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.561 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.561 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:50.561 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:50.561 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:50.561 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 231 2024-09-12T00:03:50.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.562 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.562 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.562 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463033+0000", 2024-09-12T00:03:50.562 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.563 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.563 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463033+0000", 2024-09-12T00:03:50.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.563 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.563 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.563 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463036+0000", 2024-09-12T00:03:50.564 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5270000000000001e-06 2024-09-12T00:03:50.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.564 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.564 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463047+0000", 2024-09-12T00:03:50.564 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1389999999999999e-05 2024-09-12T00:03:50.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.565 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.565 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.565 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463077+0000", 2024-09-12T00:03:50.565 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9706e-05 2024-09-12T00:03:50.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.566 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.566 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463091+0000", 2024-09-12T00:03:50.566 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4447000000000001e-05 2024-09-12T00:03:50.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.567 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.567 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463243+0000", 2024-09-12T00:03:50.567 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000151392 2024-09-12T00:03:50.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.567 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.567 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.567 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463602+0000", 2024-09-12T00:03:50.568 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00035878700000000001 2024-09-12T00:03:50.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.568 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:03:50.568 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.464299+0000", 2024-09-12T00:03:50.568 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00069704100000000002 2024-09-12T00:03:50.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.569 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.569 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:50.569 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.466067+0000", 2024-09-12T00:03:50.569 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001768141 2024-09-12T00:03:50.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.569 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.569 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:50.570 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.466593+0000", 2024-09-12T00:03:50.570 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052655499999999995 2024-09-12T00:03:50.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.571 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.466679+0000", 2024-09-12T00:03:50.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.5682999999999999e-05 2024-09-12T00:03:50.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.571 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.572 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.466747+0000", 2024-09-12T00:03:50.572 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.7736000000000003e-05 2024-09-12T00:03:50.572 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.572 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.572 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.572 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.573 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:297 6.8 e35/29 6:162a24ce:lc::lc.8:head v 35'2, mlcod=0'0)", 2024-09-12T00:03:50.573 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.499608+0000", 2024-09-12T00:03:50.573 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.060402686, 2024-09-12T00:03:50.573 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004805269, 2024-09-12T00:03:50.573 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.573 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.573 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.574 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.574 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.574 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499608+0000", 2024-09-12T00:03:50.574 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.574 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.574 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499608+0000", 2024-09-12T00:03:50.575 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.575 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.575 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.575 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499610+0000", 2024-09-12T00:03:50.575 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3269999999999999e-06 2024-09-12T00:03:50.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.575 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.575 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.576 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499625+0000", 2024-09-12T00:03:50.576 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.519e-05 2024-09-12T00:03:50.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.576 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.576 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499659+0000", 2024-09-12T00:03:50.576 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3251999999999999e-05 2024-09-12T00:03:50.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.577 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.577 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.577 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499711+0000", 2024-09-12T00:03:50.577 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1983e-05 2024-09-12T00:03:50.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.577 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.577 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.577 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499869+0000", 2024-09-12T00:03:50.577 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015835600000000001 2024-09-12T00:03:50.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.578 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.578 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499913+0000", 2024-09-12T00:03:50.578 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4305999999999999e-05 2024-09-12T00:03:50.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.578 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.579 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.504301+0000", 2024-09-12T00:03:50.579 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043874659999999996 2024-09-12T00:03:50.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.579 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.579 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.580 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.504413+0000", 2024-09-12T00:03:50.580 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000112389 2024-09-12T00:03:50.580 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.580 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.580 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.580 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.580 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:323 6.e e35/29 6:71a6e5bc:lc::lc.2:head v 35'3, mlcod=35'1)", 2024-09-12T00:03:50.580 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.503252+0000", 2024-09-12T00:03:50.580 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.056758393999999, 2024-09-12T00:03:50.581 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038149070000000002, 2024-09-12T00:03:50.581 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.581 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.581 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.581 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.581 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.581 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.581 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503252+0000", 2024-09-12T00:03:50.581 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.581 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.581 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.582 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503252+0000", 2024-09-12T00:03:50.582 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.582 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.582 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503254+0000", 2024-09-12T00:03:50.582 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8840000000000001e-06 2024-09-12T00:03:50.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.582 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.582 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503267+0000", 2024-09-12T00:03:50.582 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3098999999999999e-05 2024-09-12T00:03:50.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.583 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503304+0000", 2024-09-12T00:03:50.583 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6473000000000001e-05 2024-09-12T00:03:50.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.583 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.583 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503324+0000", 2024-09-12T00:03:50.583 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0582999999999999e-05 2024-09-12T00:03:50.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.583 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.583 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503478+0000", 2024-09-12T00:03:50.583 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015380299999999999 2024-09-12T00:03:50.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.584 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.584 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.584 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503531+0000", 2024-09-12T00:03:50.584 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3078999999999998e-05 2024-09-12T00:03:50.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.584 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.584 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.584 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.506959+0000", 2024-09-12T00:03:50.584 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0034275909999999998 2024-09-12T00:03:50.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.584 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.585 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.585 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.507067+0000", 2024-09-12T00:03:50.585 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010839499999999999 2024-09-12T00:03:50.585 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.585 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.585 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.585 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.585 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:344 6.1b 6:dabbc408:lc::lc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:50.585 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.509665+0000", 2024-09-12T00:03:50.585 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.050345213, 2024-09-12T00:03:50.585 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052648319999999997, 2024-09-12T00:03:50.586 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.586 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.586 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.586 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:50.586 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:50.586 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:50.586 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 344 2024-09-12T00:03:50.586 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.586 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.586 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.586 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.586 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509665+0000", 2024-09-12T00:03:50.587 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.587 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.587 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.587 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.587 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509665+0000", 2024-09-12T00:03:50.587 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.587 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.587 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.587 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.587 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509667+0000", 2024-09-12T00:03:50.587 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.717e-06 2024-09-12T00:03:50.587 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.588 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.588 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.588 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509677+0000", 2024-09-12T00:03:50.588 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9029999999999999e-06 2024-09-12T00:03:50.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.588 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.588 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.588 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509703+0000", 2024-09-12T00:03:50.588 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5510000000000001e-05 2024-09-12T00:03:50.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.588 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.588 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.588 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509719+0000", 2024-09-12T00:03:50.589 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6163000000000001e-05 2024-09-12T00:03:50.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.589 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.589 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.589 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509913+0000", 2024-09-12T00:03:50.589 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000194432 2024-09-12T00:03:50.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.589 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.589 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.589 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510307+0000", 2024-09-12T00:03:50.589 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039409299999999998 2024-09-12T00:03:50.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.590 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.590 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:03:50.590 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510805+0000", 2024-09-12T00:03:50.590 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00049770599999999999 2024-09-12T00:03:50.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.590 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.590 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:50.590 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.512288+0000", 2024-09-12T00:03:50.590 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001483364 2024-09-12T00:03:50.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.590 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.590 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:50.591 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514621+0000", 2024-09-12T00:03:50.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002332883 2024-09-12T00:03:50.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.591 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.591 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514775+0000", 2024-09-12T00:03:50.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000153573 2024-09-12T00:03:50.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.591 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.591 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514930+0000", 2024-09-12T00:03:50.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015548800000000001 2024-09-12T00:03:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:346 6.8 e35/29 6:10010070:lc::lc.29:head v 35'4, mlcod=35'2)", 2024-09-12T00:03:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.510411+0000", 2024-09-12T00:03:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.049599925999999, 2024-09-12T00:03:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041988340000000002, 2024-09-12T00:03:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510411+0000", 2024-09-12T00:03:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510411+0000", 2024-09-12T00:03:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510412+0000", 2024-09-12T00:03:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.72e-06 2024-09-12T00:03:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510424+0000", 2024-09-12T00:03:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2089999999999999e-05 2024-09-12T00:03:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510450+0000", 2024-09-12T00:03:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5797000000000001e-05 2024-09-12T00:03:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510465+0000", 2024-09-12T00:03:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.446e-05 2024-09-12T00:03:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510591+0000", 2024-09-12T00:03:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012610799999999999 2024-09-12T00:03:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510639+0000", 2024-09-12T00:03:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.8457e-05 2024-09-12T00:03:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514519+0000", 2024-09-12T00:03:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038796529999999998 2024-09-12T00:03:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514610+0000", 2024-09-12T00:03:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0549000000000003e-05 2024-09-12T00:03:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.597 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.597 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:352 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:50.597 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.513324+0000", 2024-09-12T00:03:50.597 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.046686797, 2024-09-12T00:03:50.597 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052898679999999997, 2024-09-12T00:03:50.597 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.597 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.597 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.598 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:50.598 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:50.598 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:50.598 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 352 2024-09-12T00:03:50.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.598 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.599 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.599 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.599 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513324+0000", 2024-09-12T00:03:50.599 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.599 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.600 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.600 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513324+0000", 2024-09-12T00:03:50.600 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.600 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.600 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.601 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513326+0000", 2024-09-12T00:03:50.601 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4200000000000001e-06 2024-09-12T00:03:50.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.601 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.601 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.601 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513360+0000", 2024-09-12T00:03:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3413e-05 2024-09-12T00:03:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513395+0000", 2024-09-12T00:03:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5519000000000003e-05 2024-09-12T00:03:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513417+0000", 2024-09-12T00:03:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1710000000000001e-05 2024-09-12T00:03:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513577+0000", 2024-09-12T00:03:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015987900000000001 2024-09-12T00:03:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513809+0000", 2024-09-12T00:03:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000231855 2024-09-12T00:03:50.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:03:50.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514261+0000", 2024-09-12T00:03:50.604 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00045238599999999999 2024-09-12T00:03:50.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:50.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.515784+0000", 2024-09-12T00:03:50.604 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015229569999999999 2024-09-12T00:03:50.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:50.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.518352+0000", 2024-09-12T00:03:50.605 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0025684850000000001 2024-09-12T00:03:50.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.518501+0000", 2024-09-12T00:03:50.605 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014815499999999999 2024-09-12T00:03:50.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.518614+0000", 2024-09-12T00:03:50.605 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113089 2024-09-12T00:03:50.605 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.606 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.606 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.606 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.606 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:359 6.e e35/29 6:703a9e16:::obj_delete_at_hint.0000000002:head v 35'4, mlcod=35'2)", 2024-09-12T00:03:50.606 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.516147+0000", 2024-09-12T00:03:50.606 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.043864080999999, 2024-09-12T00:03:50.606 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045436039999999997, 2024-09-12T00:03:50.606 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.606 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.606 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.606 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.606 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.607 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.607 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516147+0000", 2024-09-12T00:03:50.607 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.607 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.607 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.607 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516147+0000", 2024-09-12T00:03:50.607 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.607 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.607 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.607 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516154+0000", 2024-09-12T00:03:50.607 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.8229999999999995e-06 2024-09-12T00:03:50.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.608 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.608 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.608 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516165+0000", 2024-09-12T00:03:50.608 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0190000000000001e-05 2024-09-12T00:03:50.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.608 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.608 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.608 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516182+0000", 2024-09-12T00:03:50.608 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.732e-05 2024-09-12T00:03:50.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.608 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.608 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.608 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516198+0000", 2024-09-12T00:03:50.609 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6379999999999999e-05 2024-09-12T00:03:50.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.609 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.609 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.609 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516344+0000", 2024-09-12T00:03:50.609 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014533499999999999 2024-09-12T00:03:50.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.609 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.609 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.609 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516377+0000", 2024-09-12T00:03:50.609 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3426000000000002e-05 2024-09-12T00:03:50.610 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.610 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.610 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.610 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520590+0000", 2024-09-12T00:03:50.610 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042129810000000002 2024-09-12T00:03:50.610 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.610 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.610 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.610 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520690+0000", 2024-09-12T00:03:50.610 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010014900000000001 2024-09-12T00:03:50.610 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.610 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.610 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.611 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.611 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:362 6.8 e35/29 6:10010070:lc::lc.29:head v 35'5, mlcod=35'3)", 2024-09-12T00:03:50.611 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.516504+0000", 2024-09-12T00:03:50.611 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.043506617999999, 2024-09-12T00:03:50.611 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043050099999999997, 2024-09-12T00:03:50.611 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.611 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.612 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.612 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.612 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.612 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516504+0000", 2024-09-12T00:03:50.612 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.612 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.612 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516504+0000", 2024-09-12T00:03:50.612 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.612 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.613 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516506+0000", 2024-09-12T00:03:50.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9e-06 2024-09-12T00:03:50.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.613 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.613 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516519+0000", 2024-09-12T00:03:50.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.322e-05 2024-09-12T00:03:50.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.613 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.613 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516547+0000", 2024-09-12T00:03:50.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8289999999999998e-05 2024-09-12T00:03:50.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.614 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.614 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516565+0000", 2024-09-12T00:03:50.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7737e-05 2024-09-12T00:03:50.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.614 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.614 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516723+0000", 2024-09-12T00:03:50.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015814799999999999 2024-09-12T00:03:50.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.614 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.614 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516782+0000", 2024-09-12T00:03:50.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8353000000000002e-05 2024-09-12T00:03:50.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520695+0000", 2024-09-12T00:03:50.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003912886 2024-09-12T00:03:50.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520809+0000", 2024-09-12T00:03:50.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011447600000000001 2024-09-12T00:03:50.615 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.615 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.615 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.616 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.616 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:367 6.1b 6:dabbc408:lc::lc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:50.616 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.516992+0000", 2024-09-12T00:03:50.616 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.043018688, 2024-09-12T00:03:50.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004051158, 2024-09-12T00:03:50.616 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.616 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.616 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.616 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:50.616 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:50.616 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:50.616 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 367 2024-09-12T00:03:50.616 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.617 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.617 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516992+0000", 2024-09-12T00:03:50.617 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.617 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516992+0000", 2024-09-12T00:03:50.617 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.617 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516994+0000", 2024-09-12T00:03:50.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5629999999999999e-06 2024-09-12T00:03:50.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.618 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517009+0000", 2024-09-12T00:03:50.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4973e-05 2024-09-12T00:03:50.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.618 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517039+0000", 2024-09-12T00:03:50.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9544e-05 2024-09-12T00:03:50.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.619 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.619 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517060+0000", 2024-09-12T00:03:50.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1369000000000002e-05 2024-09-12T00:03:50.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.619 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.619 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517208+0000", 2024-09-12T00:03:50.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014785500000000001 2024-09-12T00:03:50.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.619 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.620 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517522+0000", 2024-09-12T00:03:50.620 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00031421800000000001 2024-09-12T00:03:50.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.620 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:03:50.620 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517825+0000", 2024-09-12T00:03:50.620 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00030275700000000002 2024-09-12T00:03:50.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.621 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:50.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519023+0000", 2024-09-12T00:03:50.621 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001197474 2024-09-12T00:03:50.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.621 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:50.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520717+0000", 2024-09-12T00:03:50.621 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0016939209999999999 2024-09-12T00:03:50.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.621 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520834+0000", 2024-09-12T00:03:50.621 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117773 2024-09-12T00:03:50.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.622 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.622 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.521043+0000", 2024-09-12T00:03:50.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020871099999999999 2024-09-12T00:03:50.622 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.622 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.622 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.622 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:375 6.11 6:8f661e56:lc::lc.12:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:50.622 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.519365+0000", 2024-09-12T00:03:50.622 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.040645282, 2024-09-12T00:03:50.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0036610010000000001, 2024-09-12T00:03:50.623 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.623 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.623 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.623 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:50.623 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:50.623 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:50.623 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 375 2024-09-12T00:03:50.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.623 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.623 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.623 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519365+0000", 2024-09-12T00:03:50.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519365+0000", 2024-09-12T00:03:50.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519368+0000", 2024-09-12T00:03:50.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7870000000000002e-06 2024-09-12T00:03:50.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519382+0000", 2024-09-12T00:03:50.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3393e-05 2024-09-12T00:03:50.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519460+0000", 2024-09-12T00:03:50.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.8033000000000003e-05 2024-09-12T00:03:50.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519485+0000", 2024-09-12T00:03:50.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5136000000000001e-05 2024-09-12T00:03:50.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519637+0000", 2024-09-12T00:03:50.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000151972 2024-09-12T00:03:50.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519992+0000", 2024-09-12T00:03:50.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00035536699999999999 2024-09-12T00:03:50.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:50.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520591+0000", 2024-09-12T00:03:50.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000599101 2024-09-12T00:03:50.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:50.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.522600+0000", 2024-09-12T00:03:50.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00200921 2024-09-12T00:03:50.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:50.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.522809+0000", 2024-09-12T00:03:50.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000208521 2024-09-12T00:03:50.628 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.628 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.628 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.522953+0000", 2024-09-12T00:03:50.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014383899999999999 2024-09-12T00:03:50.628 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.628 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.628 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.523026+0000", 2024-09-12T00:03:50.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3641999999999997e-05 2024-09-12T00:03:50.628 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.629 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.629 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.629 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.629 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:403 6.8 e35/29 6:11d93ab7:::obj_delete_at_hint.0000000003:head v 35'6, mlcod=35'4)", 2024-09-12T00:03:50.629 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.526734+0000", 2024-09-12T00:03:50.629 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.033276911000002, 2024-09-12T00:03:50.629 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003881813, 2024-09-12T00:03:50.629 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.629 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.629 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.629 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.629 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.630 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.630 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526734+0000", 2024-09-12T00:03:50.630 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.630 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.630 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526734+0000", 2024-09-12T00:03:50.630 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.630 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.630 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526735+0000", 2024-09-12T00:03:50.630 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6169999999999999e-06 2024-09-12T00:03:50.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.631 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.631 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526745+0000", 2024-09-12T00:03:50.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7769999999999997e-06 2024-09-12T00:03:50.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.631 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.631 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526768+0000", 2024-09-12T00:03:50.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3156999999999999e-05 2024-09-12T00:03:50.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.631 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.631 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526780+0000", 2024-09-12T00:03:50.632 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2043e-05 2024-09-12T00:03:50.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.632 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.632 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526892+0000", 2024-09-12T00:03:50.632 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011140499999999999 2024-09-12T00:03:50.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.632 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.632 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526925+0000", 2024-09-12T00:03:50.632 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3670999999999997e-05 2024-09-12T00:03:50.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.633 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.530524+0000", 2024-09-12T00:03:50.633 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0035983769999999998 2024-09-12T00:03:50.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.633 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.633 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.530616+0000", 2024-09-12T00:03:50.633 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1766000000000002e-05 2024-09-12T00:03:50.633 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.633 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.633 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.633 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.634 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:462 6.1f 6:ffe20264:lc::lc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:50.634 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.543661+0000", 2024-09-12T00:03:50.634 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.01634979, 2024-09-12T00:03:50.634 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037941450000000001, 2024-09-12T00:03:50.634 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.634 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.634 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.634 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:50.634 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:50.634 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:50.634 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 462 2024-09-12T00:03:50.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.634 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.635 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.635 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.635 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543661+0000", 2024-09-12T00:03:50.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.635 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.635 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.635 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543661+0000", 2024-09-12T00:03:50.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.635 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.635 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.635 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543663+0000", 2024-09-12T00:03:50.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.644e-06 2024-09-12T00:03:50.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.636 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.636 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.636 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543674+0000", 2024-09-12T00:03:50.636 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0710000000000001e-05 2024-09-12T00:03:50.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.636 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.636 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.636 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543704+0000", 2024-09-12T00:03:50.636 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9856e-05 2024-09-12T00:03:50.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.636 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.636 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.637 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543719+0000", 2024-09-12T00:03:50.637 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5265999999999999e-05 2024-09-12T00:03:50.637 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.637 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.637 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.637 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543865+0000", 2024-09-12T00:03:50.637 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014598700000000001 2024-09-12T00:03:50.637 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.637 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.637 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.637 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544116+0000", 2024-09-12T00:03:50.637 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025093199999999999 2024-09-12T00:03:50.637 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.638 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.638 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:03:50.638 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544588+0000", 2024-09-12T00:03:50.638 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00047173899999999999 2024-09-12T00:03:50.638 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.638 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.638 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:50.638 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.545735+0000", 2024-09-12T00:03:50.638 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0011470320000000001 2024-09-12T00:03:50.638 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.638 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.639 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:50.639 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.547257+0000", 2024-09-12T00:03:50.639 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015221379999999999 2024-09-12T00:03:50.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.639 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.639 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.639 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.547369+0000", 2024-09-12T00:03:50.639 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011215899999999999 2024-09-12T00:03:50.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.639 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.639 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.639 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.547455+0000", 2024-09-12T00:03:50.640 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.5681999999999997e-05 2024-09-12T00:03:50.640 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.640 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.640 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.640 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.640 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:497 6.11 6:8f661e56:lc::lc.12:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:50.640 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.557693+0000", 2024-09-12T00:03:50.640 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.002318079999998, 2024-09-12T00:03:50.641 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039061030000000002, 2024-09-12T00:03:50.641 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.641 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.641 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.641 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:50.641 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:50.642 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:50.642 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 497 2024-09-12T00:03:50.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.642 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.642 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.642 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.642 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.557693+0000", 2024-09-12T00:03:50.643 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.643 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.643 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.643 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.643 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.557693+0000", 2024-09-12T00:03:50.643 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.644 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.644 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.644 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.644 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.557694+0000", 2024-09-12T00:03:50.644 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.894e-06 2024-09-12T00:03:50.645 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.645 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.645 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.645 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.557702+0000", 2024-09-12T00:03:50.645 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7200000000000006e-06 2024-09-12T00:03:50.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.646 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.646 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.646 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.557722+0000", 2024-09-12T00:03:50.646 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0162000000000001e-05 2024-09-12T00:03:50.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.647 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.647 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.647 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.557732+0000", 2024-09-12T00:03:50.647 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0088000000000001e-05 2024-09-12T00:03:50.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.648 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.648 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.648 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.557860+0000", 2024-09-12T00:03:50.648 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012722300000000001 2024-09-12T00:03:50.648 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.649 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.649 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.649 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.558018+0000", 2024-09-12T00:03:50.649 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015807399999999999 2024-09-12T00:03:50.649 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.649 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.650 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:50.650 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.558284+0000", 2024-09-12T00:03:50.650 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026614400000000001 2024-09-12T00:03:50.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.650 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.650 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:50.651 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.559371+0000", 2024-09-12T00:03:50.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001087113 2024-09-12T00:03:50.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.651 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.651 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:50.652 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.561454+0000", 2024-09-12T00:03:50.652 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020826439999999998 2024-09-12T00:03:50.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.652 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.652 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.653 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.561533+0000", 2024-09-12T00:03:50.653 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9177000000000004e-05 2024-09-12T00:03:50.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.653 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.653 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.653 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.561599+0000", 2024-09-12T00:03:50.654 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5864000000000005e-05 2024-09-12T00:03:50.654 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.654 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.654 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.655 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.655 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:638 6.1f 6:ffe20264:lc::lc.0:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:50.655 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.593253+0000", 2024-09-12T00:03:50.655 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.966757877999999, 2024-09-12T00:03:50.655 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052360990000000001, 2024-09-12T00:03:50.656 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.656 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.656 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.656 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:50.656 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:50.656 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:50.657 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 638 2024-09-12T00:03:50.657 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.657 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.657 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.657 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.657 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593253+0000", 2024-09-12T00:03:50.657 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.658 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.658 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.658 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.658 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593253+0000", 2024-09-12T00:03:50.658 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.658 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.658 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.659 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.659 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593255+0000", 2024-09-12T00:03:50.659 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0540000000000002e-06 2024-09-12T00:03:50.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.659 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.659 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593265+0000", 2024-09-12T00:03:50.659 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0028e-05 2024-09-12T00:03:50.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.659 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.660 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593282+0000", 2024-09-12T00:03:50.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6762999999999999e-05 2024-09-12T00:03:50.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.660 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.660 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593293+0000", 2024-09-12T00:03:50.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1691999999999999e-05 2024-09-12T00:03:50.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.660 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.660 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593376+0000", 2024-09-12T00:03:50.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3195999999999994e-05 2024-09-12T00:03:50.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.661 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.661 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.661 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593463+0000", 2024-09-12T00:03:50.661 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6421000000000005e-05 2024-09-12T00:03:50.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.661 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.661 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:03:50.661 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593680+0000", 2024-09-12T00:03:50.661 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000216698 2024-09-12T00:03:50.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.661 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:50.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.594516+0000", 2024-09-12T00:03:50.662 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00083619200000000003 2024-09-12T00:03:50.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:50.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598310+0000", 2024-09-12T00:03:50.662 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037941030000000001 2024-09-12T00:03:50.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598420+0000", 2024-09-12T00:03:50.662 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110163 2024-09-12T00:03:50.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.663 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598489+0000", 2024-09-12T00:03:50.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8788999999999995e-05 2024-09-12T00:03:50.663 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.663 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.663 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.663 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:717 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:50.663 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.625210+0000", 2024-09-12T00:03:50.663 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.934801089, 2024-09-12T00:03:50.664 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052809140000000003, 2024-09-12T00:03:50.664 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.664 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.664 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.664 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:50.664 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:50.664 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:50.664 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 717 2024-09-12T00:03:50.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.664 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.664 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.664 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.665 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625210+0000", 2024-09-12T00:03:50.665 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.665 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.665 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.665 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625210+0000", 2024-09-12T00:03:50.665 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.666 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.666 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.666 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625211+0000", 2024-09-12T00:03:50.666 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5960000000000001e-06 2024-09-12T00:03:50.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.666 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.666 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.666 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625228+0000", 2024-09-12T00:03:50.666 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6849000000000001e-05 2024-09-12T00:03:50.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625242+0000", 2024-09-12T00:03:50.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3730999999999999e-05 2024-09-12T00:03:50.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625250+0000", 2024-09-12T00:03:50.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3979999999999999e-06 2024-09-12T00:03:50.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625333+0000", 2024-09-12T00:03:50.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3096999999999994e-05 2024-09-12T00:03:50.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.668 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625472+0000", 2024-09-12T00:03:50.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013836499999999999 2024-09-12T00:03:50.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.668 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:03:50.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625769+0000", 2024-09-12T00:03:50.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00029780900000000001 2024-09-12T00:03:50.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.669 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.669 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:50.669 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.626719+0000", 2024-09-12T00:03:50.669 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00095007800000000003 2024-09-12T00:03:50.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.669 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.669 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:50.669 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.630313+0000", 2024-09-12T00:03:50.669 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0035937690000000001 2024-09-12T00:03:50.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.630410+0000", 2024-09-12T00:03:50.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7246999999999999e-05 2024-09-12T00:03:50.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.630490+0000", 2024-09-12T00:03:50.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9975000000000006e-05 2024-09-12T00:03:50.670 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.670 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.670 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.671 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:735 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:50.671 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.631579+0000", 2024-09-12T00:03:50.671 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.928431822, 2024-09-12T00:03:50.671 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064619990000000004, 2024-09-12T00:03:50.671 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.671 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.671 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.671 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:50.671 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:50.671 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:50.671 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 735 2024-09-12T00:03:50.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.672 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.672 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.672 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.672 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631579+0000", 2024-09-12T00:03:50.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.672 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.672 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.672 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631579+0000", 2024-09-12T00:03:50.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631580+0000", 2024-09-12T00:03:50.673 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.206e-06 2024-09-12T00:03:50.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631586+0000", 2024-09-12T00:03:50.673 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8799999999999996e-06 2024-09-12T00:03:50.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631606+0000", 2024-09-12T00:03:50.673 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0557999999999999e-05 2024-09-12T00:03:50.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.674 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.674 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.674 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631622+0000", 2024-09-12T00:03:50.674 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5758000000000001e-05 2024-09-12T00:03:50.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.674 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.674 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.674 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631726+0000", 2024-09-12T00:03:50.674 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000103717 2024-09-12T00:03:50.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.675 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.675 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631885+0000", 2024-09-12T00:03:50.675 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015954200000000001 2024-09-12T00:03:50.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.675 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:03:50.675 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.632177+0000", 2024-09-12T00:03:50.675 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00029183799999999999 2024-09-12T00:03:50.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.676 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:50.676 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.635740+0000", 2024-09-12T00:03:50.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0035623809999999999 2024-09-12T00:03:50.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.676 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.676 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:50.676 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.637872+0000", 2024-09-12T00:03:50.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002132494 2024-09-12T00:03:50.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.676 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.637968+0000", 2024-09-12T00:03:50.677 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5727e-05 2024-09-12T00:03:50.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638041+0000", 2024-09-12T00:03:50.677 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2898000000000006e-05 2024-09-12T00:03:50.678 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.678 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.678 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.678 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.678 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:852 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:50.678 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.675779+0000", 2024-09-12T00:03:50.678 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.88423199, 2024-09-12T00:03:50.678 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0070622760000000001, 2024-09-12T00:03:50.678 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.679 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.679 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.679 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:50.679 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:50.679 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:50.679 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 852 2024-09-12T00:03:50.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.679 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.679 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.679 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.675779+0000", 2024-09-12T00:03:50.679 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.680 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.680 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.680 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.675779+0000", 2024-09-12T00:03:50.680 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.680 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.680 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.680 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.675781+0000", 2024-09-12T00:03:50.680 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0729999999999999e-06 2024-09-12T00:03:50.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.681 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.681 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.681 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.675789+0000", 2024-09-12T00:03:50.681 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3389999999999993e-06 2024-09-12T00:03:50.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.681 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.681 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.681 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.675807+0000", 2024-09-12T00:03:50.681 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8275e-05 2024-09-12T00:03:50.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.681 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.681 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.681 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.675817+0000", 2024-09-12T00:03:50.681 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9620000000000005e-06 2024-09-12T00:03:50.682 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.682 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.682 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.682 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.675924+0000", 2024-09-12T00:03:50.682 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000107124 2024-09-12T00:03:50.682 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.682 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.682 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.682 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.676168+0000", 2024-09-12T00:03:50.682 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024318199999999999 2024-09-12T00:03:50.682 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.682 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.683 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:03:50.683 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.676432+0000", 2024-09-12T00:03:50.683 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026431499999999999 2024-09-12T00:03:50.683 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.683 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.683 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:50.683 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.677274+0000", 2024-09-12T00:03:50.683 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00084212999999999996 2024-09-12T00:03:50.683 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.683 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.683 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:50.683 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.682573+0000", 2024-09-12T00:03:50.683 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052988439999999996 2024-09-12T00:03:50.683 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.684 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.684 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.684 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.682727+0000", 2024-09-12T00:03:50.684 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000153893 2024-09-12T00:03:50.684 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.684 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.684 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.684 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.682841+0000", 2024-09-12T00:03:50.684 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000114139 2024-09-12T00:03:50.684 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.684 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.684 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.685 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.685 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:940 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:50.685 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.706022+0000", 2024-09-12T00:03:50.685 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.853988874000001, 2024-09-12T00:03:50.685 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0055103579999999999, 2024-09-12T00:03:50.685 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.685 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.685 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.685 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:50.686 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:50.686 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:50.686 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 940 2024-09-12T00:03:50.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.686 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.686 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.686 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.686 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706022+0000", 2024-09-12T00:03:50.686 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.686 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.687 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.687 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706022+0000", 2024-09-12T00:03:50.687 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.687 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.687 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.687 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.687 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706023+0000", 2024-09-12T00:03:50.687 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.294e-06 2024-09-12T00:03:50.687 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.687 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.687 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.688 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706029+0000", 2024-09-12T00:03:50.688 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.9859999999999999e-06 2024-09-12T00:03:50.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.688 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.688 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.688 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706044+0000", 2024-09-12T00:03:50.688 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5124e-05 2024-09-12T00:03:50.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.688 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.688 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.688 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706052+0000", 2024-09-12T00:03:50.688 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7810000000000005e-06 2024-09-12T00:03:50.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.689 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.689 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706143+0000", 2024-09-12T00:03:50.689 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0882000000000002e-05 2024-09-12T00:03:50.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.689 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.689 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706282+0000", 2024-09-12T00:03:50.689 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013932699999999999 2024-09-12T00:03:50.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.689 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:03:50.689 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706520+0000", 2024-09-12T00:03:50.690 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023770200000000001 2024-09-12T00:03:50.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.690 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.690 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:50.690 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.707334+0000", 2024-09-12T00:03:50.690 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00081372300000000003 2024-09-12T00:03:50.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.690 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.690 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:50.690 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.711430+0000", 2024-09-12T00:03:50.690 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040969140000000001 2024-09-12T00:03:50.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.691 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.691 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.691 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.711487+0000", 2024-09-12T00:03:50.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6641999999999997e-05 2024-09-12T00:03:50.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.691 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.691 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.691 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.711532+0000", 2024-09-12T00:03:50.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4982999999999999e-05 2024-09-12T00:03:50.691 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.691 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.691 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.692 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.692 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1257 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:50.692 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:35.124959+0000", 2024-09-12T00:03:50.692 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.435051164000001, 2024-09-12T00:03:50.692 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054452789999999999, 2024-09-12T00:03:50.692 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.692 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.692 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.692 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:50.692 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:50.692 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:50.692 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1257 2024-09-12T00:03:50.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.693 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.693 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.693 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.693 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.124959+0000", 2024-09-12T00:03:50.693 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.693 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.693 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.693 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.124959+0000", 2024-09-12T00:03:50.693 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.694 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.694 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.694 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.124962+0000", 2024-09-12T00:03:50.694 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4959999999999999e-06 2024-09-12T00:03:50.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.694 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.694 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.694 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.124973+0000", 2024-09-12T00:03:50.694 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1457000000000001e-05 2024-09-12T00:03:50.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.694 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.694 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.694 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.125005+0000", 2024-09-12T00:03:50.695 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1163e-05 2024-09-12T00:03:50.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.695 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.695 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.125019+0000", 2024-09-12T00:03:50.695 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4780000000000001e-05 2024-09-12T00:03:50.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.695 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.695 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.125141+0000", 2024-09-12T00:03:50.695 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000121555 2024-09-12T00:03:50.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.695 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.696 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.125362+0000", 2024-09-12T00:03:50.696 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000221375 2024-09-12T00:03:50.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.696 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.696 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:50.696 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.125671+0000", 2024-09-12T00:03:50.696 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00030850400000000003 2024-09-12T00:03:50.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.696 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.696 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:50.696 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.126746+0000", 2024-09-12T00:03:50.696 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001075051 2024-09-12T00:03:50.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.697 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.697 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:50.697 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.130141+0000", 2024-09-12T00:03:50.697 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033952240000000001 2024-09-12T00:03:50.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.697 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.697 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.697 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.130293+0000", 2024-09-12T00:03:50.697 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015235499999999999 2024-09-12T00:03:50.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.697 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.697 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.697 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.130405+0000", 2024-09-12T00:03:50.698 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000111319 2024-09-12T00:03:50.698 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.698 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.698 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.698 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.698 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1334 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:50.698 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:35.312239+0000", 2024-09-12T00:03:50.698 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.247771144, 2024-09-12T00:03:50.698 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048064800000000001, 2024-09-12T00:03:50.698 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:50.698 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:50.699 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:50.699 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:50.699 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:50.699 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:50.699 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1334 2024-09-12T00:03:50.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.699 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:50.699 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.699 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:50.699 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312239+0000", 2024-09-12T00:03:50.699 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.699 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.700 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:50.700 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312239+0000", 2024-09-12T00:03:50.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:50.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.700 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:50.700 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312242+0000", 2024-09-12T00:03:50.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7300000000000001e-06 2024-09-12T00:03:50.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.700 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:50.700 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312253+0000", 2024-09-12T00:03:50.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1107000000000001e-05 2024-09-12T00:03:50.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:50.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312285+0000", 2024-09-12T00:03:50.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1210000000000001e-05 2024-09-12T00:03:50.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:50.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312303+0000", 2024-09-12T00:03:50.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8003e-05 2024-09-12T00:03:50.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:50.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312422+0000", 2024-09-12T00:03:50.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000119426 2024-09-12T00:03:50.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:50.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312640+0000", 2024-09-12T00:03:50.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021851100000000001 2024-09-12T00:03:50.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:03:50.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.313115+0000", 2024-09-12T00:03:50.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000474146 2024-09-12T00:03:50.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:50.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.315280+0000", 2024-09-12T00:03:50.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0021658889999999998 2024-09-12T00:03:50.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:50.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.316889+0000", 2024-09-12T00:03:50.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0016087759999999999 2024-09-12T00:03:50.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.704 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:50.704 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.316980+0000", 2024-09-12T00:03:50.704 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0575999999999995e-05 2024-09-12T00:03:50.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:50.704 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:50.704 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:50.704 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.317046+0000", 2024-09-12T00:03:50.704 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6105999999999994e-05 2024-09-12T00:03:50.704 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.704 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.704 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.704 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:50.705 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:50.705 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:50.706 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:03:50.707 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:50.705+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:50.808 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:50.805+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:50.835 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:50.836 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:03:50.836 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:03:50.836 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:50.851 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:03:50.909 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:50.909+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:50.973 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:50.973 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:03:50.973 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:03:50.973 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:03:50.973 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:50.987 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:03:51.032 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:03:51.033+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:03:51.111 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:51.109+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:03:51.115 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:51.115 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:03:51.115 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:03:51.115 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:03:51.115 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.115 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:03:51.115 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:03:51.115 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.629301263999999, 2024-09-12T00:03:51.115 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0032495720000000001, 2024-09-12T00:03:51.116 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:51.116 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:51.116 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.116 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:51.116 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:51.116 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.116 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 193 2024-09-12T00:03:51.116 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.116 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:51.116 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.116 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:51.116 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:03:51.116 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.117 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.117 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:51.117 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:03:51.117 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.117 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.117 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:51.117 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486926+0000", 2024-09-12T00:03:51.117 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.463e-06 2024-09-12T00:03:51.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.117 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.117 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:51.118 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486937+0000", 2024-09-12T00:03:51.118 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1147e-05 2024-09-12T00:03:51.118 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.118 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.118 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:51.118 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486968+0000", 2024-09-12T00:03:51.118 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1077000000000001e-05 2024-09-12T00:03:51.118 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.118 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.118 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.118 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486985+0000", 2024-09-12T00:03:51.118 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6399e-05 2024-09-12T00:03:51.118 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.118 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.119 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:51.119 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487139+0000", 2024-09-12T00:03:51.119 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015403199999999999 2024-09-12T00:03:51.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.119 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.119 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:51.119 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487375+0000", 2024-09-12T00:03:51.119 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023621499999999999 2024-09-12T00:03:51.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.119 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.119 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:51.119 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487634+0000", 2024-09-12T00:03:51.119 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000259351 2024-09-12T00:03:51.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.120 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.120 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:51.120 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.489156+0000", 2024-09-12T00:03:51.120 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015213869999999999 2024-09-12T00:03:51.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.120 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.120 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.120 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.489974+0000", 2024-09-12T00:03:51.120 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00081855600000000001 2024-09-12T00:03:51.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.120 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.120 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:51.120 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.490064+0000", 2024-09-12T00:03:51.121 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9205999999999999e-05 2024-09-12T00:03:51.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.121 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.121 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:51.121 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.490173+0000", 2024-09-12T00:03:51.121 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109739 2024-09-12T00:03:51.121 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.121 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:51.121 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.121 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.121 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:03:51.121 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:03:51.122 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.752861720999999, 2024-09-12T00:03:51.122 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039523630000000004, 2024-09-12T00:03:51.122 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:51.122 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:51.122 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.122 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:51.122 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:51.122 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.122 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 208 2024-09-12T00:03:51.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.122 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:51.122 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.122 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:51.123 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:03:51.123 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.123 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:51.123 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:03:51.123 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.123 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:51.123 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363366+0000", 2024-09-12T00:03:51.123 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.004e-06 2024-09-12T00:03:51.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.123 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:51.124 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363379+0000", 2024-09-12T00:03:51.124 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2943e-05 2024-09-12T00:03:51.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.124 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.124 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:51.124 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363412+0000", 2024-09-12T00:03:51.124 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2808999999999997e-05 2024-09-12T00:03:51.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.124 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.124 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.124 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363430+0000", 2024-09-12T00:03:51.124 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8003e-05 2024-09-12T00:03:51.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.125 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.125 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:51.125 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363654+0000", 2024-09-12T00:03:51.125 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022394900000000001 2024-09-12T00:03:51.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.125 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.125 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:51.125 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363897+0000", 2024-09-12T00:03:51.125 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024272399999999999 2024-09-12T00:03:51.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.125 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.125 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:51.125 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.364326+0000", 2024-09-12T00:03:51.125 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042963399999999997 2024-09-12T00:03:51.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.126 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.126 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:51.126 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.365757+0000", 2024-09-12T00:03:51.126 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014303969999999999 2024-09-12T00:03:51.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.126 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.126 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.126 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367031+0000", 2024-09-12T00:03:51.126 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001274269 2024-09-12T00:03:51.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.126 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.126 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:51.127 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367197+0000", 2024-09-12T00:03:51.127 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016645900000000001 2024-09-12T00:03:51.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.127 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.127 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:51.127 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367316+0000", 2024-09-12T00:03:51.127 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011817200000000001 2024-09-12T00:03:51.127 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.127 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:51.127 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.127 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.127 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.127 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:03:51.128 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.695603417000001, 2024-09-12T00:03:51.128 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033190419999999999, 2024-09-12T00:03:51.128 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:51.128 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:51.128 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.128 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:51.128 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:51.128 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.128 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 219 2024-09-12T00:03:51.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.128 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:51.128 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.128 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:51.128 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:03:51.129 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.129 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.129 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:51.129 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:03:51.129 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.129 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.129 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:51.129 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420624+0000", 2024-09-12T00:03:51.129 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0829999999999998e-06 2024-09-12T00:03:51.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.129 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.130 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:51.130 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420633+0000", 2024-09-12T00:03:51.130 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8500000000000006e-06 2024-09-12T00:03:51.130 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.130 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.130 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:51.130 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420663+0000", 2024-09-12T00:03:51.130 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9597000000000001e-05 2024-09-12T00:03:51.130 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.130 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.130 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.130 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420681+0000", 2024-09-12T00:03:51.130 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7646e-05 2024-09-12T00:03:51.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.131 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.131 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:51.131 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420791+0000", 2024-09-12T00:03:51.131 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109979 2024-09-12T00:03:51.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.131 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.131 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:51.131 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.421042+0000", 2024-09-12T00:03:51.131 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025117199999999997 2024-09-12T00:03:51.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.132 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.132 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:51.132 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.421487+0000", 2024-09-12T00:03:51.132 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00044476599999999998 2024-09-12T00:03:51.132 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.132 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.132 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:51.132 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.422884+0000", 2024-09-12T00:03:51.132 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0013975109999999999 2024-09-12T00:03:51.132 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.132 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.132 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.133 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423797+0000", 2024-09-12T00:03:51.133 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00091310899999999995 2024-09-12T00:03:51.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.133 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.133 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:51.133 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423879+0000", 2024-09-12T00:03:51.133 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1829000000000005e-05 2024-09-12T00:03:51.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.133 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.133 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:51.133 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423941+0000", 2024-09-12T00:03:51.133 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1500000000000004e-05 2024-09-12T00:03:51.133 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.133 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:51.134 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.134 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.134 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.134 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.134 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:03:51.134 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.677962818000001, 2024-09-12T00:03:51.134 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003232782, 2024-09-12T00:03:51.134 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:51.134 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:51.134 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.134 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:51.134 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:51.134 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.135 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 224 2024-09-12T00:03:51.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.135 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:51.135 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.135 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:51.135 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:03:51.135 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.135 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.135 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:51.135 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:03:51.135 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.135 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.136 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:51.136 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438265+0000", 2024-09-12T00:03:51.136 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.666e-06 2024-09-12T00:03:51.136 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.136 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.136 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:51.136 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438276+0000", 2024-09-12T00:03:51.136 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1387e-05 2024-09-12T00:03:51.136 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.136 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.136 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:51.136 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438306+0000", 2024-09-12T00:03:51.136 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0069999999999998e-05 2024-09-12T00:03:51.136 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.137 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.137 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.137 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438321+0000", 2024-09-12T00:03:51.137 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.517e-05 2024-09-12T00:03:51.137 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.137 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.137 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:51.137 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438459+0000", 2024-09-12T00:03:51.137 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013781899999999999 2024-09-12T00:03:51.137 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.137 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.137 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:51.137 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438671+0000", 2024-09-12T00:03:51.138 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021214500000000001 2024-09-12T00:03:51.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.138 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.138 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:51.138 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.439093+0000", 2024-09-12T00:03:51.138 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042117899999999999 2024-09-12T00:03:51.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.138 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.138 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:51.138 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.440400+0000", 2024-09-12T00:03:51.138 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0013072719999999999 2024-09-12T00:03:51.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.138 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.138 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.138 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441339+0000", 2024-09-12T00:03:51.139 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00093906600000000001 2024-09-12T00:03:51.139 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.139 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.139 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:51.139 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441429+0000", 2024-09-12T00:03:51.139 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0358999999999993e-05 2024-09-12T00:03:51.139 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.139 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.139 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:51.139 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441495+0000", 2024-09-12T00:03:51.139 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5648999999999994e-05 2024-09-12T00:03:51.139 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.139 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:51.140 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.140 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.140 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.140 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.140 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:03:51.140 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.638463846000001, 2024-09-12T00:03:51.140 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003225716, 2024-09-12T00:03:51.140 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:51.140 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:51.140 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.140 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:51.140 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:51.140 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.140 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 235 2024-09-12T00:03:51.141 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.141 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:51.141 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.141 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:51.141 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:03:51.141 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.141 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.141 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.141 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:51.141 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:03:51.141 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.141 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.141 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.142 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:51.142 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477764+0000", 2024-09-12T00:03:51.142 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.48e-06 2024-09-12T00:03:51.142 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.142 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.142 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:51.142 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477775+0000", 2024-09-12T00:03:51.142 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1163e-05 2024-09-12T00:03:51.142 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.142 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.142 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:51.142 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477807+0000", 2024-09-12T00:03:51.142 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1860000000000003e-05 2024-09-12T00:03:51.142 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.143 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.143 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.143 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477822+0000", 2024-09-12T00:03:51.143 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5302999999999999e-05 2024-09-12T00:03:51.143 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.143 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.143 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:51.143 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477959+0000", 2024-09-12T00:03:51.143 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013695600000000001 2024-09-12T00:03:51.143 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.143 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.143 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:51.143 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.478184+0000", 2024-09-12T00:03:51.143 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022484800000000001 2024-09-12T00:03:51.144 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.144 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.144 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:51.144 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.478657+0000", 2024-09-12T00:03:51.144 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000473413 2024-09-12T00:03:51.144 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.144 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.144 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:51.144 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480162+0000", 2024-09-12T00:03:51.144 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00150454 2024-09-12T00:03:51.144 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.144 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.144 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.144 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480792+0000", 2024-09-12T00:03:51.145 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00063012400000000003 2024-09-12T00:03:51.145 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.145 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.145 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:51.145 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480906+0000", 2024-09-12T00:03:51.145 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113909 2024-09-12T00:03:51.145 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.145 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.145 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:51.145 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480987+0000", 2024-09-12T00:03:51.145 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1119999999999996e-05 2024-09-12T00:03:51.145 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.145 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:51.146 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.146 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.146 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.146 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:237 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.146 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:03:51.146 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.631142475000001, 2024-09-12T00:03:51.146 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0074291790000000002, 2024-09-12T00:03:51.146 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:51.146 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:51.146 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.146 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:51.146 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:51.146 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.147 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 237 2024-09-12T00:03:51.147 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.147 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:51.147 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.147 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:51.147 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:03:51.147 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.147 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.147 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.147 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:51.147 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:03:51.147 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.147 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.147 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.148 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:51.148 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485086+0000", 2024-09-12T00:03:51.148 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.05e-06 2024-09-12T00:03:51.148 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.148 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.148 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:51.148 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485101+0000", 2024-09-12T00:03:51.148 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5186e-05 2024-09-12T00:03:51.148 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.148 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.148 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:51.148 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485140+0000", 2024-09-12T00:03:51.148 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8896000000000002e-05 2024-09-12T00:03:51.149 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.149 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.149 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.149 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485162+0000", 2024-09-12T00:03:51.149 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2654e-05 2024-09-12T00:03:51.149 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.149 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.149 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:51.149 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485314+0000", 2024-09-12T00:03:51.149 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015150799999999999 2024-09-12T00:03:51.149 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.149 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.149 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:51.149 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485549+0000", 2024-09-12T00:03:51.150 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000235665 2024-09-12T00:03:51.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.150 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.150 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:51.150 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486064+0000", 2024-09-12T00:03:51.150 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00051418899999999997 2024-09-12T00:03:51.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.150 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.150 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:51.150 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.488211+0000", 2024-09-12T00:03:51.150 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0021470819999999998 2024-09-12T00:03:51.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.150 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.151 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.151 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492273+0000", 2024-09-12T00:03:51.151 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040617980000000001 2024-09-12T00:03:51.151 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.151 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.151 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:51.151 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492391+0000", 2024-09-12T00:03:51.151 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118613 2024-09-12T00:03:51.151 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.151 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.151 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:51.151 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492512+0000", 2024-09-12T00:03:51.151 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120538 2024-09-12T00:03:51.152 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.152 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:51.152 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.152 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.152 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.152 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:244 6.17 e35/29 6:e9187ab8:reshard::reshard.0000000000:head v 35'1, mlcod=0'0)", 2024-09-12T00:03:51.152 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:03:51.152 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.628560239999999, 2024-09-12T00:03:51.152 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0034313239999999999, 2024-09-12T00:03:51.152 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:51.152 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:51.152 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.152 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:51.152 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.153 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:51.153 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:03:51.153 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.153 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.153 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.153 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:51.153 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:03:51.153 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.153 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.153 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.153 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:51.153 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487667+0000", 2024-09-12T00:03:51.153 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4899999999999999e-06 2024-09-12T00:03:51.154 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.154 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.154 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:51.154 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487682+0000", 2024-09-12T00:03:51.154 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4929999999999999e-05 2024-09-12T00:03:51.154 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.154 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.154 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:51.154 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487740+0000", 2024-09-12T00:03:51.154 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8075000000000002e-05 2024-09-12T00:03:51.154 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.154 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.154 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.155 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487761+0000", 2024-09-12T00:03:51.155 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0769999999999999e-05 2024-09-12T00:03:51.155 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.155 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.155 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:51.155 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487966+0000", 2024-09-12T00:03:51.155 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020516800000000001 2024-09-12T00:03:51.155 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.155 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.155 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:51.155 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.488012+0000", 2024-09-12T00:03:51.155 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5794000000000002e-05 2024-09-12T00:03:51.155 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.155 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.156 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:51.156 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.490965+0000", 2024-09-12T00:03:51.156 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0029530609999999999 2024-09-12T00:03:51.156 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.156 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.156 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:51.156 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491096+0000", 2024-09-12T00:03:51.156 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013103600000000001 2024-09-12T00:03:51.156 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.156 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:51.156 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.156 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.156 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.156 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:293 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.157 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:03:51.157 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.618608419000001, 2024-09-12T00:03:51.157 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0075915649999999998, 2024-09-12T00:03:51.157 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:51.157 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:51.157 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.157 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:51.157 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:51.157 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.157 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 293 2024-09-12T00:03:51.157 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.157 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:51.157 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.158 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:51.158 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:03:51.158 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.158 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.158 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.158 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:51.158 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:03:51.158 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.158 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.158 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.158 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:51.158 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497626+0000", 2024-09-12T00:03:51.158 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2499999999999995e-06 2024-09-12T00:03:51.158 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.159 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.159 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:51.159 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497636+0000", 2024-09-12T00:03:51.159 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0139999999999999e-05 2024-09-12T00:03:51.159 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.159 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.159 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:51.159 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497660+0000", 2024-09-12T00:03:51.159 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4015999999999998e-05 2024-09-12T00:03:51.159 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.159 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.159 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.159 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497675+0000", 2024-09-12T00:03:51.160 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5339999999999999e-05 2024-09-12T00:03:51.160 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.160 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.160 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:51.160 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497839+0000", 2024-09-12T00:03:51.160 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016347900000000001 2024-09-12T00:03:51.160 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.160 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.160 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:51.160 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498097+0000", 2024-09-12T00:03:51.160 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025825700000000002 2024-09-12T00:03:51.160 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.160 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.161 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:51.161 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498618+0000", 2024-09-12T00:03:51.161 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052051300000000001 2024-09-12T00:03:51.161 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.161 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.161 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:51.161 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.501282+0000", 2024-09-12T00:03:51.161 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026646840000000001 2024-09-12T00:03:51.161 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.161 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.161 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.161 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505057+0000", 2024-09-12T00:03:51.161 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037747710000000001 2024-09-12T00:03:51.162 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.162 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.162 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:51.162 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505144+0000", 2024-09-12T00:03:51.162 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7466000000000006e-05 2024-09-12T00:03:51.162 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.162 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.162 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:51.162 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505208+0000", 2024-09-12T00:03:51.162 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3649e-05 2024-09-12T00:03:51.162 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.162 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:51.162 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.162 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.163 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.163 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:413 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.163 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:03:51.163 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.587568807, 2024-09-12T00:03:51.163 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005252049, 2024-09-12T00:03:51.163 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:51.163 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:51.163 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.163 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:51.163 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:51.163 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.163 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 413 2024-09-12T00:03:51.163 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.164 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:51.164 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.164 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:51.164 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:03:51.164 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.164 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.164 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.164 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:51.164 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:03:51.164 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.164 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.164 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.164 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:51.165 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528659+0000", 2024-09-12T00:03:51.165 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4739999999999999e-06 2024-09-12T00:03:51.165 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.165 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.165 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:51.165 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528669+0000", 2024-09-12T00:03:51.165 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0694e-05 2024-09-12T00:03:51.165 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.165 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.165 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:51.165 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528696+0000", 2024-09-12T00:03:51.165 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6846e-05 2024-09-12T00:03:51.165 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.165 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.166 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.166 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528711+0000", 2024-09-12T00:03:51.166 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4397e-05 2024-09-12T00:03:51.166 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.166 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.166 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:51.166 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528884+0000", 2024-09-12T00:03:51.166 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017304700000000001 2024-09-12T00:03:51.166 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.166 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.166 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:51.166 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529162+0000", 2024-09-12T00:03:51.166 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027861999999999999 2024-09-12T00:03:51.166 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.167 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.167 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:51.167 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529688+0000", 2024-09-12T00:03:51.167 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052593900000000001 2024-09-12T00:03:51.167 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.167 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.167 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:51.167 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.531480+0000", 2024-09-12T00:03:51.167 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0017920740000000001 2024-09-12T00:03:51.167 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.167 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.167 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.167 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533734+0000", 2024-09-12T00:03:51.168 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002254191 2024-09-12T00:03:51.168 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.168 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.168 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:51.168 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533845+0000", 2024-09-12T00:03:51.168 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110559 2024-09-12T00:03:51.168 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.168 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.168 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:51.168 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533908+0000", 2024-09-12T00:03:51.168 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3207999999999995e-05 2024-09-12T00:03:51.168 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.168 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:51.169 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.169 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.169 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.169 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:437 6.0 6:05588ce8:lc::lc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.169 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:03:51.169 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.580393317999999, 2024-09-12T00:03:51.169 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039419659999999999, 2024-09-12T00:03:51.169 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:51.169 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:51.169 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.169 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:51.169 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:51.169 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.170 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 437 2024-09-12T00:03:51.170 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.170 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:51.170 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.170 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:51.170 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:03:51.170 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.170 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.170 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.170 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:51.170 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:03:51.170 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.170 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.171 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.171 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:51.171 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535834+0000", 2024-09-12T00:03:51.171 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2859999999999998e-06 2024-09-12T00:03:51.171 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.171 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.171 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:51.171 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535846+0000", 2024-09-12T00:03:51.171 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1643e-05 2024-09-12T00:03:51.171 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.171 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.171 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:51.171 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535877+0000", 2024-09-12T00:03:51.171 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1457000000000001e-05 2024-09-12T00:03:51.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.172 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.172 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.172 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535894+0000", 2024-09-12T00:03:51.172 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.668e-05 2024-09-12T00:03:51.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.172 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.172 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:51.172 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535981+0000", 2024-09-12T00:03:51.172 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6823000000000005e-05 2024-09-12T00:03:51.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.172 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.172 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:51.173 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536086+0000", 2024-09-12T00:03:51.173 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010566200000000001 2024-09-12T00:03:51.173 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.173 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.173 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:51.173 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536330+0000", 2024-09-12T00:03:51.173 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024399999999999999 2024-09-12T00:03:51.173 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.173 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.173 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:51.173 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538288+0000", 2024-09-12T00:03:51.173 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0019575740000000001 2024-09-12T00:03:51.173 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.173 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.173 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.174 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539574+0000", 2024-09-12T00:03:51.174 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012862259999999999 2024-09-12T00:03:51.174 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.174 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.174 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:51.174 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539696+0000", 2024-09-12T00:03:51.174 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012190599999999999 2024-09-12T00:03:51.174 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.174 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.174 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:51.174 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539774+0000", 2024-09-12T00:03:51.174 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7708999999999997e-05 2024-09-12T00:03:51.174 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.174 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:51.175 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.175 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.175 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.175 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:464 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.175 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:03:51.175 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.571832336, 2024-09-12T00:03:51.175 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048192310000000002, 2024-09-12T00:03:51.175 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:51.175 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:51.175 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.175 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:51.175 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:51.175 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.176 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 464 2024-09-12T00:03:51.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.176 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:51.176 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.176 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:51.176 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:03:51.176 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.176 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.176 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:51.176 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:03:51.176 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.177 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.177 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:51.177 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544395+0000", 2024-09-12T00:03:51.177 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.905e-06 2024-09-12T00:03:51.177 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.177 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.177 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:51.177 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544405+0000", 2024-09-12T00:03:51.177 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0583e-05 2024-09-12T00:03:51.177 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.177 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.177 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:51.177 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544435+0000", 2024-09-12T00:03:51.177 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9431e-05 2024-09-12T00:03:51.178 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.178 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.178 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.178 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544468+0000", 2024-09-12T00:03:51.178 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2978999999999997e-05 2024-09-12T00:03:51.178 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.178 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.178 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:51.178 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544573+0000", 2024-09-12T00:03:51.178 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105165 2024-09-12T00:03:51.178 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.178 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.178 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:51.178 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544714+0000", 2024-09-12T00:03:51.179 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000141061 2024-09-12T00:03:51.179 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.179 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.179 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:51.179 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.545414+0000", 2024-09-12T00:03:51.179 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00070066200000000001 2024-09-12T00:03:51.179 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.179 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.179 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:51.179 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.547475+0000", 2024-09-12T00:03:51.179 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020609119999999998 2024-09-12T00:03:51.179 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.179 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.179 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.180 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549067+0000", 2024-09-12T00:03:51.180 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015914989999999999 2024-09-12T00:03:51.180 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.180 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.180 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:51.180 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549143+0000", 2024-09-12T00:03:51.180 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5795000000000002e-05 2024-09-12T00:03:51.180 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.180 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.180 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:51.180 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549212+0000", 2024-09-12T00:03:51.180 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9239000000000006e-05 2024-09-12T00:03:51.180 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.181 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:51.181 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.181 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.181 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.181 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:495 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.181 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:03:51.181 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.560762837999999, 2024-09-12T00:03:51.181 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052520209999999999, 2024-09-12T00:03:51.182 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:51.182 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:51.182 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.182 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:51.182 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:51.182 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.182 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 495 2024-09-12T00:03:51.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.182 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:51.182 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.182 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:51.182 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:03:51.182 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.183 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.183 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:51.183 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:03:51.183 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.183 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.183 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:51.183 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555464+0000", 2024-09-12T00:03:51.183 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8870000000000001e-06 2024-09-12T00:03:51.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.183 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.183 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:51.183 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555473+0000", 2024-09-12T00:03:51.183 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2399999999999996e-06 2024-09-12T00:03:51.184 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.184 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.184 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:51.184 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555496+0000", 2024-09-12T00:03:51.184 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2952e-05 2024-09-12T00:03:51.184 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.184 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.184 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.184 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555508+0000", 2024-09-12T00:03:51.184 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1548e-05 2024-09-12T00:03:51.184 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.184 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.184 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:51.185 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555596+0000", 2024-09-12T00:03:51.185 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8295999999999996e-05 2024-09-12T00:03:51.185 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.185 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.185 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:51.185 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555683+0000", 2024-09-12T00:03:51.185 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7267000000000003e-05 2024-09-12T00:03:51.185 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.185 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.185 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:51.185 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555862+0000", 2024-09-12T00:03:51.185 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017910699999999999 2024-09-12T00:03:51.185 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.185 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.186 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:51.186 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.556696+0000", 2024-09-12T00:03:51.186 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000833353 2024-09-12T00:03:51.186 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.186 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.186 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.186 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560563+0000", 2024-09-12T00:03:51.186 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038672089999999999 2024-09-12T00:03:51.186 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.186 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.186 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:51.186 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560642+0000", 2024-09-12T00:03:51.186 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.8909e-05 2024-09-12T00:03:51.186 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.187 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.187 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:51.187 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560714+0000", 2024-09-12T00:03:51.187 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2253000000000001e-05 2024-09-12T00:03:51.187 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.187 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:51.187 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.187 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.187 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.187 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:631 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.187 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:03:51.187 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.524935284000001, 2024-09-12T00:03:51.187 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0072389480000000003, 2024-09-12T00:03:51.187 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:51.188 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:51.188 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.188 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:51.188 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:51.188 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.188 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 631 2024-09-12T00:03:51.188 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.188 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:51.188 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.188 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:51.188 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:03:51.188 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.188 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.189 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.189 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:51.189 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:03:51.189 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.189 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.189 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.189 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:51.189 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591292+0000", 2024-09-12T00:03:51.189 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0760000000000001e-06 2024-09-12T00:03:51.189 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.189 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.189 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:51.189 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591301+0000", 2024-09-12T00:03:51.189 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3880000000000006e-06 2024-09-12T00:03:51.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.190 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.190 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:51.190 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591323+0000", 2024-09-12T00:03:51.190 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2121999999999999e-05 2024-09-12T00:03:51.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.190 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.190 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.190 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591338+0000", 2024-09-12T00:03:51.190 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5126999999999999e-05 2024-09-12T00:03:51.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.190 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.190 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:51.191 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591449+0000", 2024-09-12T00:03:51.191 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011054500000000001 2024-09-12T00:03:51.191 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.191 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.191 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:51.191 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591682+0000", 2024-09-12T00:03:51.191 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023258 2024-09-12T00:03:51.191 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.191 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.191 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:51.191 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.592011+0000", 2024-09-12T00:03:51.191 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00032941699999999998 2024-09-12T00:03:51.191 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.191 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.192 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:51.192 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593493+0000", 2024-09-12T00:03:51.192 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014821599999999999 2024-09-12T00:03:51.192 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.192 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.192 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.192 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598356+0000", 2024-09-12T00:03:51.192 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048625329999999996 2024-09-12T00:03:51.192 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.192 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.192 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:51.192 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598456+0000", 2024-09-12T00:03:51.192 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9878999999999997e-05 2024-09-12T00:03:51.193 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.193 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.193 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:51.193 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598529+0000", 2024-09-12T00:03:51.193 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3120999999999993e-05 2024-09-12T00:03:51.193 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.193 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:51.193 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.193 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.193 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.193 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:650 6.4 6:26625e58:lc::lc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.193 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:03:51.193 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.51653774, 2024-09-12T00:03:51.193 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042727010000000003, 2024-09-12T00:03:51.194 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:51.194 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:51.194 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.194 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:51.194 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:51.194 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.194 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 650 2024-09-12T00:03:51.194 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.194 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:51.194 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.194 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:51.194 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:03:51.194 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.194 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.195 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.195 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:51.195 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:03:51.195 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.195 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.195 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.195 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:51.195 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599689+0000", 2024-09-12T00:03:51.195 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3179999999999999e-06 2024-09-12T00:03:51.195 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.195 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.195 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:51.195 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599696+0000", 2024-09-12T00:03:51.195 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9580000000000001e-06 2024-09-12T00:03:51.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.196 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.196 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:51.196 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599714+0000", 2024-09-12T00:03:51.196 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8099999999999999e-05 2024-09-12T00:03:51.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.196 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.196 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.196 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599724+0000", 2024-09-12T00:03:51.196 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0492999999999999e-05 2024-09-12T00:03:51.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.196 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.196 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:51.197 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599799+0000", 2024-09-12T00:03:51.197 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5228999999999994e-05 2024-09-12T00:03:51.197 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.197 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.197 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:51.197 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599897+0000", 2024-09-12T00:03:51.197 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7476e-05 2024-09-12T00:03:51.197 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.197 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.197 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:51.197 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.600047+0000", 2024-09-12T00:03:51.197 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015028 2024-09-12T00:03:51.197 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.197 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.198 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:51.198 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.602604+0000", 2024-09-12T00:03:51.198 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0025571729999999998 2024-09-12T00:03:51.198 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.198 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.198 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.198 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603880+0000", 2024-09-12T00:03:51.198 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012753700000000001 2024-09-12T00:03:51.198 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.198 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.198 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:51.198 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603923+0000", 2024-09-12T00:03:51.198 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3758999999999999e-05 2024-09-12T00:03:51.198 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.199 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.199 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:51.199 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603960+0000", 2024-09-12T00:03:51.199 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6545000000000003e-05 2024-09-12T00:03:51.199 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.199 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:51.199 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.199 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.199 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.199 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:744 6.0 6:0651570b:lc::lc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.199 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:03:51.199 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.482246312000001, 2024-09-12T00:03:51.199 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048046149999999999, 2024-09-12T00:03:51.200 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:51.200 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:51.200 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.200 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:51.200 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:51.200 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.200 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 744 2024-09-12T00:03:51.200 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.200 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:51.200 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.200 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:51.200 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:03:51.200 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.201 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.201 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.201 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:51.201 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:03:51.201 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.201 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.201 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.201 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:51.201 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633981+0000", 2024-09-12T00:03:51.201 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3740000000000001e-06 2024-09-12T00:03:51.201 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.201 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.201 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:51.202 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633991+0000", 2024-09-12T00:03:51.202 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7839999999999998e-06 2024-09-12T00:03:51.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.202 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.202 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:51.202 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634016+0000", 2024-09-12T00:03:51.202 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5075999999999998e-05 2024-09-12T00:03:51.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.202 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.202 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.202 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634031+0000", 2024-09-12T00:03:51.202 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5124e-05 2024-09-12T00:03:51.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.202 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.203 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:51.203 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634105+0000", 2024-09-12T00:03:51.203 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3595000000000003e-05 2024-09-12T00:03:51.203 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.203 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.203 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:51.203 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634183+0000", 2024-09-12T00:03:51.203 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7936999999999996e-05 2024-09-12T00:03:51.203 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.203 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.203 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:51.203 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634342+0000", 2024-09-12T00:03:51.203 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015910499999999999 2024-09-12T00:03:51.203 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.204 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.204 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:51.204 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.635262+0000", 2024-09-12T00:03:51.204 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00092051000000000003 2024-09-12T00:03:51.204 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.204 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.204 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.204 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638638+0000", 2024-09-12T00:03:51.204 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033756419999999999 2024-09-12T00:03:51.204 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.204 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.204 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:51.204 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638722+0000", 2024-09-12T00:03:51.205 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.4029000000000005e-05 2024-09-12T00:03:51.205 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.205 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.205 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:51.205 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638783+0000", 2024-09-12T00:03:51.205 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1439000000000006e-05 2024-09-12T00:03:51.205 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.205 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:51.205 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.205 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.205 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.205 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:875 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.205 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:03:51.206 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.432606881000002, 2024-09-12T00:03:51.206 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004522295, 2024-09-12T00:03:51.206 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:51.206 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:51.206 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.206 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:51.206 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:51.206 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.206 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 875 2024-09-12T00:03:51.206 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.206 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:51.206 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.206 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:51.206 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:03:51.207 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.207 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.207 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.207 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:51.207 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:03:51.207 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.207 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.207 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.207 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:51.207 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683623+0000", 2024-09-12T00:03:51.207 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7140000000000001e-06 2024-09-12T00:03:51.207 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.207 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.208 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:51.208 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683639+0000", 2024-09-12T00:03:51.208 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6203000000000001e-05 2024-09-12T00:03:51.208 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.208 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.208 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:51.208 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683677+0000", 2024-09-12T00:03:51.208 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8470999999999998e-05 2024-09-12T00:03:51.208 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.208 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.208 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.208 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683708+0000", 2024-09-12T00:03:51.208 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0793999999999997e-05 2024-09-12T00:03:51.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.209 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.209 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:51.209 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683827+0000", 2024-09-12T00:03:51.209 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011832699999999999 2024-09-12T00:03:51.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.209 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.209 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:51.209 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683945+0000", 2024-09-12T00:03:51.209 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118301 2024-09-12T00:03:51.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.209 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.209 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:51.210 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.684226+0000", 2024-09-12T00:03:51.210 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000280604 2024-09-12T00:03:51.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.210 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.210 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.210 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685790+0000", 2024-09-12T00:03:51.210 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001564651 2024-09-12T00:03:51.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.210 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.210 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:51.210 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688028+0000", 2024-09-12T00:03:51.210 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0022381129999999999 2024-09-12T00:03:51.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.210 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.211 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:51.211 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688093+0000", 2024-09-12T00:03:51.211 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4329e-05 2024-09-12T00:03:51.211 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.211 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.211 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:51.211 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688140+0000", 2024-09-12T00:03:51.211 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7787999999999997e-05 2024-09-12T00:03:51.211 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.211 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:51.211 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.211 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.211 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.212 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:878 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.212 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:03:51.212 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.430962751999999, 2024-09-12T00:03:51.212 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037933009999999998, 2024-09-12T00:03:51.212 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:51.212 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:51.212 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.212 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:51.212 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:51.212 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.212 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 878 2024-09-12T00:03:51.212 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.212 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:51.212 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.213 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:51.213 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:03:51.213 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.213 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.213 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:51.213 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:03:51.213 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.213 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.213 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:51.213 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685265+0000", 2024-09-12T00:03:51.213 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.525e-06 2024-09-12T00:03:51.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.214 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.214 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:51.214 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685276+0000", 2024-09-12T00:03:51.214 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.076e-05 2024-09-12T00:03:51.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.214 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.214 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:51.214 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685306+0000", 2024-09-12T00:03:51.214 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0803000000000003e-05 2024-09-12T00:03:51.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.214 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.214 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.214 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685327+0000", 2024-09-12T00:03:51.214 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1061e-05 2024-09-12T00:03:51.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.215 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.215 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:51.215 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685429+0000", 2024-09-12T00:03:51.215 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000102015 2024-09-12T00:03:51.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.215 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.215 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:51.215 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685580+0000", 2024-09-12T00:03:51.215 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000151096 2024-09-12T00:03:51.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.215 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.215 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:51.216 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685861+0000", 2024-09-12T00:03:51.216 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028068100000000002 2024-09-12T00:03:51.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.216 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.216 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.216 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688647+0000", 2024-09-12T00:03:51.216 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0027860979999999999 2024-09-12T00:03:51.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.216 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.216 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:51.216 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688909+0000", 2024-09-12T00:03:51.216 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026159600000000001 2024-09-12T00:03:51.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.217 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.217 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:51.217 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688991+0000", 2024-09-12T00:03:51.217 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2429999999999995e-05 2024-09-12T00:03:51.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.217 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.217 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:51.217 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689056+0000", 2024-09-12T00:03:51.217 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4236e-05 2024-09-12T00:03:51.217 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.217 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:51.217 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.217 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.218 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:881 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.218 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:03:51.218 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.430328569, 2024-09-12T00:03:51.218 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003307979, 2024-09-12T00:03:51.218 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:51.218 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:51.218 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.218 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:51.218 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:51.218 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.218 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 881 2024-09-12T00:03:51.218 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.218 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:51.218 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.219 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:51.219 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:03:51.219 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.219 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.219 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:51.219 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:03:51.219 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.219 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.219 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:51.219 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685898+0000", 2024-09-12T00:03:51.219 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4249999999999999e-06 2024-09-12T00:03:51.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.220 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.220 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:51.220 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685904+0000", 2024-09-12T00:03:51.220 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1290000000000001e-06 2024-09-12T00:03:51.220 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.220 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.220 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:51.220 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685917+0000", 2024-09-12T00:03:51.220 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2825e-05 2024-09-12T00:03:51.220 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.220 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.220 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.220 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685925+0000", 2024-09-12T00:03:51.220 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6589999999999996e-06 2024-09-12T00:03:51.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.221 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.221 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:51.221 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686156+0000", 2024-09-12T00:03:51.221 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023017299999999999 2024-09-12T00:03:51.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.221 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.221 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:51.221 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686365+0000", 2024-09-12T00:03:51.221 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000209442 2024-09-12T00:03:51.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.221 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.221 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:51.222 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686567+0000", 2024-09-12T00:03:51.222 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020237400000000001 2024-09-12T00:03:51.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.222 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.222 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:51.222 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689076+0000", 2024-09-12T00:03:51.222 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002508957 2024-09-12T00:03:51.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.222 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.222 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.222 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689121+0000", 2024-09-12T00:03:51.222 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4561999999999998e-05 2024-09-12T00:03:51.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.222 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.222 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:51.223 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689168+0000", 2024-09-12T00:03:51.223 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7000999999999999e-05 2024-09-12T00:03:51.223 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.223 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.223 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:51.223 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689204+0000", 2024-09-12T00:03:51.223 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6431999999999999e-05 2024-09-12T00:03:51.223 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.223 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:51.223 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.223 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.223 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.223 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:894 6.0 6:05588ce8:lc::lc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.223 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:03:51.224 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.425972603000002, 2024-09-12T00:03:51.224 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040691010000000003, 2024-09-12T00:03:51.224 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:51.224 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:51.224 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.224 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:51.224 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:51.224 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.224 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 894 2024-09-12T00:03:51.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.224 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:51.224 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.224 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:51.224 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:03:51.225 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.225 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.225 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:51.225 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:03:51.225 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.225 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.225 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:51.225 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690253+0000", 2024-09-12T00:03:51.225 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.026e-06 2024-09-12T00:03:51.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.225 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.225 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:51.226 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690259+0000", 2024-09-12T00:03:51.226 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7389999999999996e-06 2024-09-12T00:03:51.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.226 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.226 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:51.226 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690273+0000", 2024-09-12T00:03:51.226 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3749e-05 2024-09-12T00:03:51.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.226 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.226 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.226 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690282+0000", 2024-09-12T00:03:51.226 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2520000000000005e-06 2024-09-12T00:03:51.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.227 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.227 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:51.227 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690704+0000", 2024-09-12T00:03:51.227 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042222199999999998 2024-09-12T00:03:51.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.227 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.227 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:51.227 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690826+0000", 2024-09-12T00:03:51.227 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012141099999999999 2024-09-12T00:03:51.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.227 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.227 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:51.227 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.691094+0000", 2024-09-12T00:03:51.227 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000268344 2024-09-12T00:03:51.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.228 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.228 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:51.228 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.693007+0000", 2024-09-12T00:03:51.228 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001912495 2024-09-12T00:03:51.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.228 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.228 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.228 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694184+0000", 2024-09-12T00:03:51.228 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00117786 2024-09-12T00:03:51.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.228 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.228 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:51.228 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694259+0000", 2024-09-12T00:03:51.229 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4091000000000006e-05 2024-09-12T00:03:51.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.229 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.229 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:51.229 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694321+0000", 2024-09-12T00:03:51.229 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2911999999999997e-05 2024-09-12T00:03:51.229 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.229 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:51.229 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.229 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.229 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1283 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.229 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:03:51.229 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.926654066999999, 2024-09-12T00:03:51.230 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00320967, 2024-09-12T00:03:51.230 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:51.230 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:51.230 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.230 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:51.230 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:51.230 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.230 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1283 2024-09-12T00:03:51.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.230 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:51.230 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.230 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:51.230 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:03:51.230 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:51.231 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:03:51.231 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:51.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:51.231 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189573+0000", 2024-09-12T00:03:51.231 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3130000000000001e-06 2024-09-12T00:03:51.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:51.231 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189583+0000", 2024-09-12T00:03:51.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4129999999999995e-06 2024-09-12T00:03:51.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.232 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:51.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189608+0000", 2024-09-12T00:03:51.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5863e-05 2024-09-12T00:03:51.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.232 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189628+0000", 2024-09-12T00:03:51.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9644e-05 2024-09-12T00:03:51.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.233 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:51.233 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189747+0000", 2024-09-12T00:03:51.233 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118999 2024-09-12T00:03:51.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.233 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.233 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:51.233 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189874+0000", 2024-09-12T00:03:51.233 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012674499999999999 2024-09-12T00:03:51.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.233 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.233 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:03:51.233 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.190148+0000", 2024-09-12T00:03:51.233 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000274431 2024-09-12T00:03:51.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.234 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.234 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:51.234 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.191174+0000", 2024-09-12T00:03:51.234 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001025855 2024-09-12T00:03:51.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.234 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.234 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.234 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192627+0000", 2024-09-12T00:03:51.234 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014527979999999999 2024-09-12T00:03:51.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.234 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.234 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:51.234 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192710+0000", 2024-09-12T00:03:51.235 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3146000000000007e-05 2024-09-12T00:03:51.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:51.235 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:51.235 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:51.235 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192781+0000", 2024-09-12T00:03:51.235 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.0463000000000006e-05 2024-09-12T00:03:51.235 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.235 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:51.235 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.235 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:51.235 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:51.235 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:51.237 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:51.237+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:03:51.237 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:03:51.338 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:51.337+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:51.370 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:03:51.370 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:03:51.370 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:03:51.370 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:03:51.384 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:03:51.469 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:03:51.469+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:03:51.505 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:03:51.539 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:03:51.537+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:03:51.557 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:03:51.557 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:03:51.557 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:03:51.557 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:03:51.557 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:03:51.571 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:03:51.641 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:51.637+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:51.702 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:03:51.702 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:03:51.702 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:03:51.702 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:03:51.702 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.702 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:03:51.702 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:03:51.702 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 20.372556413000002, 2024-09-12T00:03:51.703 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.027441031000000001, 2024-09-12T00:03:51.703 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:51.703 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:51.703 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.703 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:51.703 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:51.703 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.703 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:03:51.703 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.703 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:51.703 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.703 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:51.703 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:03:51.704 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.704 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.704 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.704 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:51.704 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:03:51.704 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.704 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.704 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.704 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:51.704 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330357+0000", 2024-09-12T00:03:51.704 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2339999999999996e-06 2024-09-12T00:03:51.704 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.704 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.704 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:51.705 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330381+0000", 2024-09-12T00:03:51.705 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4626000000000001e-05 2024-09-12T00:03:51.705 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.705 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.705 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:51.705 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330417+0000", 2024-09-12T00:03:51.705 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5886000000000002e-05 2024-09-12T00:03:51.705 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.705 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.705 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.705 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330442+0000", 2024-09-12T00:03:51.705 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4522999999999999e-05 2024-09-12T00:03:51.705 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.706 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.706 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.706 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335485+0000", 2024-09-12T00:03:51.706 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050432589999999996 2024-09-12T00:03:51.706 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.706 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.706 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:03:51.706 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335507+0000", 2024-09-12T00:03:51.706 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2013000000000001e-05 2024-09-12T00:03:51.706 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.706 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.706 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.706 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.351747+0000", 2024-09-12T00:03:51.706 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016240451999999999 2024-09-12T00:03:51.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.707 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.707 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:51.707 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352062+0000", 2024-09-12T00:03:51.707 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031433399999999999 2024-09-12T00:03:51.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.707 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.707 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:03:51.707 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352378+0000", 2024-09-12T00:03:51.707 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031586400000000001 2024-09-12T00:03:51.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.707 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.707 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:51.707 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.355074+0000", 2024-09-12T00:03:51.708 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026962919999999999 2024-09-12T00:03:51.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.708 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.708 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.708 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357537+0000", 2024-09-12T00:03:51.708 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024634689999999998 2024-09-12T00:03:51.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.708 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.708 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:51.708 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357680+0000", 2024-09-12T00:03:51.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014314899999999999 2024-09-12T00:03:51.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:51.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357793+0000", 2024-09-12T00:03:51.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011293 2024-09-12T00:03:51.709 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.709 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:51.709 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.710 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.710 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94232250902656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:03:51.710 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:03:51.710 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 20.344641252999999, 2024-09-12T00:03:51.710 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052696050000000001, 2024-09-12T00:03:51.710 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:51.710 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:51.710 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.710 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:51.710 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:51.710 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.710 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:03:51.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.711 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:51.711 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.711 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:51.711 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:03:51.711 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.711 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.711 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:51.711 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:03:51.711 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.711 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.711 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:51.711 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358270+0000", 2024-09-12T00:03:51.711 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.17e-06 2024-09-12T00:03:51.712 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.712 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.712 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:51.712 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358278+0000", 2024-09-12T00:03:51.712 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3529999999999995e-06 2024-09-12T00:03:51.712 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.712 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.712 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:51.712 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358306+0000", 2024-09-12T00:03:51.712 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7763000000000002e-05 2024-09-12T00:03:51.712 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.712 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.712 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.712 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358324+0000", 2024-09-12T00:03:51.713 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7861000000000001e-05 2024-09-12T00:03:51.713 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.713 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.713 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.713 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358447+0000", 2024-09-12T00:03:51.713 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012334299999999999 2024-09-12T00:03:51.713 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.713 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.713 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:51.713 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358624+0000", 2024-09-12T00:03:51.713 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017684999999999999 2024-09-12T00:03:51.713 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.713 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.713 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:03:51.713 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358964+0000", 2024-09-12T00:03:51.714 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00033991199999999999 2024-09-12T00:03:51.714 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.714 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.714 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.714 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.362920+0000", 2024-09-12T00:03:51.714 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039564600000000002 2024-09-12T00:03:51.714 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.714 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.714 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:51.714 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363016+0000", 2024-09-12T00:03:51.714 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5612999999999994e-05 2024-09-12T00:03:51.715 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.715 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.715 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:51.715 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363244+0000", 2024-09-12T00:03:51.715 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000228385 2024-09-12T00:03:51.715 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.716 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.716 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:51.716 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363537+0000", 2024-09-12T00:03:51.716 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00029289499999999999 2024-09-12T00:03:51.716 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.716 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:51.716 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.716 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.716 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.716 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.716 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:03:51.716 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 17.337263736000001, 2024-09-12T00:03:51.716 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011415537, 2024-09-12T00:03:51.716 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:51.717 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:51.717 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.717 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:51.717 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:51.717 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.717 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 209 2024-09-12T00:03:51.717 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.717 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:51.717 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.717 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:51.717 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:03:51.717 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.717 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.718 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.718 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:51.718 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:03:51.718 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.718 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.718 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.718 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:51.718 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365648+0000", 2024-09-12T00:03:51.718 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7360000000000001e-06 2024-09-12T00:03:51.718 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.718 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.718 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:51.718 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365660+0000", 2024-09-12T00:03:51.718 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2089999999999999e-05 2024-09-12T00:03:51.719 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.719 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.719 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:51.719 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365690+0000", 2024-09-12T00:03:51.719 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0320000000000001e-05 2024-09-12T00:03:51.719 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.719 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.719 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.719 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365708+0000", 2024-09-12T00:03:51.719 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7520000000000002e-05 2024-09-12T00:03:51.719 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.719 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.719 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.719 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365870+0000", 2024-09-12T00:03:51.719 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016208600000000001 2024-09-12T00:03:51.720 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.720 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.720 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:03:51.720 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365885+0000", 2024-09-12T00:03:51.720 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5119999999999999e-05 2024-09-12T00:03:51.720 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.720 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.720 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.720 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373482+0000", 2024-09-12T00:03:51.720 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075970279999999996 2024-09-12T00:03:51.720 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.720 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.720 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:51.720 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373805+0000", 2024-09-12T00:03:51.721 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032262799999999999 2024-09-12T00:03:51.721 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.721 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.721 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:51.721 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.374297+0000", 2024-09-12T00:03:51.721 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00049250599999999998 2024-09-12T00:03:51.721 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.721 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.721 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:51.721 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.375670+0000", 2024-09-12T00:03:51.721 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001373333 2024-09-12T00:03:51.721 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.721 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.721 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.722 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.376923+0000", 2024-09-12T00:03:51.722 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012525640000000001 2024-09-12T00:03:51.722 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.722 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.722 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:51.722 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377000+0000", 2024-09-12T00:03:51.722 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6732999999999999e-05 2024-09-12T00:03:51.722 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.722 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.722 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:51.722 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377061+0000", 2024-09-12T00:03:51.722 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0872999999999998e-05 2024-09-12T00:03:51.722 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.722 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:51.723 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.723 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.723 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.723 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:240 6.19 6:9f626c48:lc::lc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.723 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:03:51.723 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 17.218677982999999, 2024-09-12T00:03:51.723 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058545680000000001, 2024-09-12T00:03:51.723 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:51.723 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:51.723 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.723 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:51.723 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:51.723 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.723 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 240 2024-09-12T00:03:51.724 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.724 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:51.724 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.724 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:51.724 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:03:51.724 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.724 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.724 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.724 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:51.724 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:03:51.724 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.724 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.724 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.724 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:51.725 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484233+0000", 2024-09-12T00:03:51.725 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.973e-06 2024-09-12T00:03:51.725 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.725 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.725 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:51.725 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484241+0000", 2024-09-12T00:03:51.725 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8210000000000002e-06 2024-09-12T00:03:51.725 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.725 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.725 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:51.725 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484260+0000", 2024-09-12T00:03:51.725 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9148999999999999e-05 2024-09-12T00:03:51.725 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.725 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.725 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.726 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484268+0000", 2024-09-12T00:03:51.726 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5120000000000008e-06 2024-09-12T00:03:51.726 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.726 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.726 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.726 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484371+0000", 2024-09-12T00:03:51.726 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102501 2024-09-12T00:03:51.726 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.726 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.726 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:51.726 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484450+0000", 2024-09-12T00:03:51.726 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9122999999999994e-05 2024-09-12T00:03:51.726 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.726 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:51.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484578+0000", 2024-09-12T00:03:51.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000128095 2024-09-12T00:03:51.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:51.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.485336+0000", 2024-09-12T00:03:51.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00075754000000000001 2024-09-12T00:03:51.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.489975+0000", 2024-09-12T00:03:51.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004639738 2024-09-12T00:03:51.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.728 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:51.728 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490043+0000", 2024-09-12T00:03:51.728 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7923999999999995e-05 2024-09-12T00:03:51.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.728 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:51.728 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490085+0000", 2024-09-12T00:03:51.728 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2191999999999999e-05 2024-09-12T00:03:51.728 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.728 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:51.728 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.728 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:412 6.3 6:c3a682d4:reshard::reshard.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.729 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:03:51.729 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 17.176282576999998, 2024-09-12T00:03:51.729 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049075530000000003, 2024-09-12T00:03:51.729 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:51.729 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:51.729 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.729 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:51.729 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:51.729 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.729 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 412 2024-09-12T00:03:51.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.729 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:51.729 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.729 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:51.730 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:03:51.730 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.730 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.730 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.730 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:51.730 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:03:51.730 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.730 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.730 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.730 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:51.730 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526628+0000", 2024-09-12T00:03:51.730 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.513e-06 2024-09-12T00:03:51.730 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.730 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.730 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:51.731 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526634+0000", 2024-09-12T00:03:51.731 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1279999999999996e-06 2024-09-12T00:03:51.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.731 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.731 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:51.731 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526649+0000", 2024-09-12T00:03:51.731 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4997999999999999e-05 2024-09-12T00:03:51.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.731 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.731 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.731 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526658+0000", 2024-09-12T00:03:51.731 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1589999999999999e-06 2024-09-12T00:03:51.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.732 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526728+0000", 2024-09-12T00:03:51.732 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0203999999999994e-05 2024-09-12T00:03:51.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:51.732 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526839+0000", 2024-09-12T00:03:51.732 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011055 2024-09-12T00:03:51.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:51.732 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526979+0000", 2024-09-12T00:03:51.732 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139863 2024-09-12T00:03:51.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.733 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:51.733 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.527616+0000", 2024-09-12T00:03:51.733 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00063707900000000003 2024-09-12T00:03:51.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.733 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.733 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531450+0000", 2024-09-12T00:03:51.733 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003833819 2024-09-12T00:03:51.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.733 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:51.733 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531490+0000", 2024-09-12T00:03:51.734 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0129000000000002e-05 2024-09-12T00:03:51.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.734 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.734 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:51.734 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531534+0000", 2024-09-12T00:03:51.734 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4110999999999998e-05 2024-09-12T00:03:51.734 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.734 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:51.734 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.734 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.734 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:490 6.19 6:9dc32cef:lc::lc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.734 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:03:51.734 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 17.152085202999999, 2024-09-12T00:03:51.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047438380000000002, 2024-09-12T00:03:51.735 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:51.735 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:51.735 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.735 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:51.735 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:51.735 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.735 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 490 2024-09-12T00:03:51.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.735 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:51.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:51.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:03:51.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.736 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:51.736 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:03:51.736 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.736 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:51.736 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550825+0000", 2024-09-12T00:03:51.736 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0589999999999999e-06 2024-09-12T00:03:51.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.736 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:51.736 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550830+0000", 2024-09-12T00:03:51.737 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2140000000000004e-06 2024-09-12T00:03:51.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.737 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:51.737 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550843+0000", 2024-09-12T00:03:51.737 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3404000000000001e-05 2024-09-12T00:03:51.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.737 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.737 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550852+0000", 2024-09-12T00:03:51.737 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1549999999999996e-06 2024-09-12T00:03:51.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.737 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550910+0000", 2024-09-12T00:03:51.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7636000000000002e-05 2024-09-12T00:03:51.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.738 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:51.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550977+0000", 2024-09-12T00:03:51.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6636000000000004e-05 2024-09-12T00:03:51.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.738 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:51.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.551135+0000", 2024-09-12T00:03:51.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015852999999999999 2024-09-12T00:03:51.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.739 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552939+0000", 2024-09-12T00:03:51.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001803643 2024-09-12T00:03:51.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.739 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:51.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555471+0000", 2024-09-12T00:03:51.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002532327 2024-09-12T00:03:51.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.739 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:51.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555526+0000", 2024-09-12T00:03:51.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4728000000000002e-05 2024-09-12T00:03:51.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.740 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:51.740 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555567+0000", 2024-09-12T00:03:51.740 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1505999999999999e-05 2024-09-12T00:03:51.740 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.740 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:51.740 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.740 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.740 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.740 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:492 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'6, mlcod=35'4)", 2024-09-12T00:03:51.740 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:03:51.740 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 17.150309139000001, 2024-09-12T00:03:51.740 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056118790000000002, 2024-09-12T00:03:51.740 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:51.740 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:51.741 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.741 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:51.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:51.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:03:51.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:51.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:03:51.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:51.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552601+0000", 2024-09-12T00:03:51.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6899999999999996e-07 2024-09-12T00:03:51.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:51.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552608+0000", 2024-09-12T00:03:51.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4529999999999996e-06 2024-09-12T00:03:51.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:51.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552624+0000", 2024-09-12T00:03:51.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5885000000000001e-05 2024-09-12T00:03:51.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.743 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.743 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552632+0000", 2024-09-12T00:03:51.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2220000000000002e-06 2024-09-12T00:03:51.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.743 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.743 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552716+0000", 2024-09-12T00:03:51.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4060999999999994e-05 2024-09-12T00:03:51.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.743 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:51.743 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552735+0000", 2024-09-12T00:03:51.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9170000000000001e-05 2024-09-12T00:03:51.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.744 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:51.744 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558164+0000", 2024-09-12T00:03:51.744 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054289899999999999 2024-09-12T00:03:51.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.744 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:51.744 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558212+0000", 2024-09-12T00:03:51.744 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7129000000000002e-05 2024-09-12T00:03:51.744 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.744 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:51.744 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.745 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:496 6.3 6:c134263f:lc::lc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.745 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:03:51.745 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 17.149201851000001, 2024-09-12T00:03:51.745 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045956260000000002, 2024-09-12T00:03:51.745 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:51.745 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:51.745 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.745 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:51.745 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:51.745 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.745 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 496 2024-09-12T00:03:51.745 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.745 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:51.745 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.746 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:51.746 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:03:51.746 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.746 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.746 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:51.746 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:03:51.746 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.746 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.746 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:51.746 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553708+0000", 2024-09-12T00:03:51.746 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2359999999999999e-06 2024-09-12T00:03:51.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:51.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553714+0000", 2024-09-12T00:03:51.747 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4960000000000004e-06 2024-09-12T00:03:51.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:51.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553726+0000", 2024-09-12T00:03:51.747 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2618e-05 2024-09-12T00:03:51.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553734+0000", 2024-09-12T00:03:51.747 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4159999999999998e-06 2024-09-12T00:03:51.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.748 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553771+0000", 2024-09-12T00:03:51.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7095999999999999e-05 2024-09-12T00:03:51.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:51.748 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553815+0000", 2024-09-12T00:03:51.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3986999999999997e-05 2024-09-12T00:03:51.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:51.749 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553922+0000", 2024-09-12T00:03:51.749 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000107534 2024-09-12T00:03:51.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.749 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.749 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.749 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555052+0000", 2024-09-12T00:03:51.749 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011298359999999999 2024-09-12T00:03:51.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.749 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.749 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:51.749 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558197+0000", 2024-09-12T00:03:51.749 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0031450269999999999 2024-09-12T00:03:51.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.749 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.750 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:51.750 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558256+0000", 2024-09-12T00:03:51.750 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8403999999999999e-05 2024-09-12T00:03:51.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.750 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:51.750 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558303+0000", 2024-09-12T00:03:51.750 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6975999999999999e-05 2024-09-12T00:03:51.750 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.750 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:51.750 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.750 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:641 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.751 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:03:51.751 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 17.109131523999999, 2024-09-12T00:03:51.751 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052824789999999996, 2024-09-12T00:03:51.751 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:51.751 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:51.751 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.751 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:51.751 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:51.751 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.751 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 641 2024-09-12T00:03:51.751 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.751 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:51.751 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.751 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:51.752 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:03:51.752 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.752 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.752 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:51.752 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:03:51.752 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.752 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.752 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:51.752 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593778+0000", 2024-09-12T00:03:51.752 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0920000000000001e-06 2024-09-12T00:03:51.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.752 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:51.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593783+0000", 2024-09-12T00:03:51.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9490000000000004e-06 2024-09-12T00:03:51.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:51.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593795+0000", 2024-09-12T00:03:51.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2048999999999999e-05 2024-09-12T00:03:51.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593801+0000", 2024-09-12T00:03:51.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8989999999999998e-06 2024-09-12T00:03:51.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.754 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593852+0000", 2024-09-12T00:03:51.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1057999999999998e-05 2024-09-12T00:03:51.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.754 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:51.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593905+0000", 2024-09-12T00:03:51.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2196e-05 2024-09-12T00:03:51.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.754 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:03:51.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594017+0000", 2024-09-12T00:03:51.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000112816 2024-09-12T00:03:51.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.755 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.755 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.755 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.595190+0000", 2024-09-12T00:03:51.755 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011727199999999999 2024-09-12T00:03:51.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.755 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.755 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:51.755 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.598998+0000", 2024-09-12T00:03:51.755 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038081320000000001 2024-09-12T00:03:51.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.755 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.755 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:51.755 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599032+0000", 2024-09-12T00:03:51.756 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4283999999999999e-05 2024-09-12T00:03:51.756 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.756 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.756 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:51.756 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599060+0000", 2024-09-12T00:03:51.756 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7284000000000002e-05 2024-09-12T00:03:51.756 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.756 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:51.756 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.756 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.756 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.756 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:643 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'8, mlcod=35'6)", 2024-09-12T00:03:51.756 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:03:51.756 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 17.108633417, 2024-09-12T00:03:51.757 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048211260000000002, 2024-09-12T00:03:51.757 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:51.757 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:51.757 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.757 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:51.757 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.757 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:51.757 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:03:51.757 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.757 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.757 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.757 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:51.757 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:03:51.757 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.758 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.758 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:51.758 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594276+0000", 2024-09-12T00:03:51.758 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5899999999999995e-07 2024-09-12T00:03:51.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.758 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.758 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:51.758 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594283+0000", 2024-09-12T00:03:51.758 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6019999999999996e-06 2024-09-12T00:03:51.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.758 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.758 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:51.758 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594295+0000", 2024-09-12T00:03:51.759 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1683e-05 2024-09-12T00:03:51.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.759 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.759 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.759 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594303+0000", 2024-09-12T00:03:51.759 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0439999999999996e-06 2024-09-12T00:03:51.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.759 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.759 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.759 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594353+0000", 2024-09-12T00:03:51.759 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0698000000000001e-05 2024-09-12T00:03:51.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.759 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.759 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:51.760 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594380+0000", 2024-09-12T00:03:51.760 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7089000000000001e-05 2024-09-12T00:03:51.760 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.760 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.760 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:51.760 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599063+0000", 2024-09-12T00:03:51.760 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046824739999999998 2024-09-12T00:03:51.760 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.760 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.760 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:51.760 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599096+0000", 2024-09-12T00:03:51.760 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3677000000000003e-05 2024-09-12T00:03:51.760 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.760 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:51.761 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.761 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.761 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:647 6.a 6:5395e6f3:lc::lc.4:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.761 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:03:51.761 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 17.106282784000001, 2024-09-12T00:03:51.761 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049071770000000004, 2024-09-12T00:03:51.761 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:51.761 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:51.761 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.761 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:51.761 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:51.761 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.762 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 647 2024-09-12T00:03:51.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.762 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:51.762 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.762 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:51.762 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:03:51.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.762 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.762 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:51.762 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:03:51.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.762 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.763 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:51.763 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596627+0000", 2024-09-12T00:03:51.763 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1149999999999999e-06 2024-09-12T00:03:51.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.763 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:51.763 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596632+0000", 2024-09-12T00:03:51.763 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7060000000000003e-06 2024-09-12T00:03:51.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.763 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:51.763 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596645+0000", 2024-09-12T00:03:51.763 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2791e-05 2024-09-12T00:03:51.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.764 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596653+0000", 2024-09-12T00:03:51.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9230000000000002e-06 2024-09-12T00:03:51.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.764 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596705+0000", 2024-09-12T00:03:51.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2250000000000003e-05 2024-09-12T00:03:51.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.764 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:51.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596758+0000", 2024-09-12T00:03:51.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2964000000000003e-05 2024-09-12T00:03:51.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.765 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:51.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596873+0000", 2024-09-12T00:03:51.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011501 2024-09-12T00:03:51.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.765 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599088+0000", 2024-09-12T00:03:51.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002215135 2024-09-12T00:03:51.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.765 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:51.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601456+0000", 2024-09-12T00:03:51.766 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023684719999999999 2024-09-12T00:03:51.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.766 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:51.766 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601507+0000", 2024-09-12T00:03:51.766 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0933999999999997e-05 2024-09-12T00:03:51.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.766 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:51.766 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601533+0000", 2024-09-12T00:03:51.766 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5877e-05 2024-09-12T00:03:51.766 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.766 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:51.766 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.767 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:657 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'10, mlcod=35'7)", 2024-09-12T00:03:51.767 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:03:51.767 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 17.102459243999999, 2024-09-12T00:03:51.767 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066410239999999997, 2024-09-12T00:03:51.767 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:51.767 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:51.767 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.767 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:51.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.767 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:51.767 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:03:51.767 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:51.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:03:51.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:51.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:03:51.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6099999999999999e-07 2024-09-12T00:03:51.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.769 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:51.769 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600457+0000", 2024-09-12T00:03:51.769 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8700000000000003e-06 2024-09-12T00:03:51.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.769 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.769 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:51.769 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600470+0000", 2024-09-12T00:03:51.769 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3186999999999999e-05 2024-09-12T00:03:51.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.769 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.769 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.769 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600478+0000", 2024-09-12T00:03:51.769 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5310000000000004e-06 2024-09-12T00:03:51.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.770 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600521+0000", 2024-09-12T00:03:51.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2574000000000003e-05 2024-09-12T00:03:51.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:51.770 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600535+0000", 2024-09-12T00:03:51.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4151000000000001e-05 2024-09-12T00:03:51.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:51.770 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.606997+0000", 2024-09-12T00:03:51.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064626099999999997 2024-09-12T00:03:51.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.771 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:51.771 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607091+0000", 2024-09-12T00:03:51.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3239999999999995e-05 2024-09-12T00:03:51.771 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.771 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:51.771 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.771 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:659 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.771 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:03:51.771 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 17.102286912, 2024-09-12T00:03:51.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0065340989999999998, 2024-09-12T00:03:51.771 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:51.772 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:51.772 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.772 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:51.772 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:51.772 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.772 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 659 2024-09-12T00:03:51.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.772 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:51.772 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.772 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:51.772 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:03:51.772 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.773 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:51.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:03:51.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.773 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:51.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600623+0000", 2024-09-12T00:03:51.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.085e-06 2024-09-12T00:03:51.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.773 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:51.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600630+0000", 2024-09-12T00:03:51.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0029999999999997e-06 2024-09-12T00:03:51.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.774 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:51.774 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600647+0000", 2024-09-12T00:03:51.774 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6566999999999999e-05 2024-09-12T00:03:51.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.774 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.774 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600658+0000", 2024-09-12T00:03:51.774 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0992000000000001e-05 2024-09-12T00:03:51.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.774 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.774 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600717+0000", 2024-09-12T00:03:51.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9925e-05 2024-09-12T00:03:51.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.775 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.775 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:51.775 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600773+0000", 2024-09-12T00:03:51.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5766000000000001e-05 2024-09-12T00:03:51.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.775 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.775 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:03:51.775 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600889+0000", 2024-09-12T00:03:51.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115906 2024-09-12T00:03:51.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.775 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603483+0000", 2024-09-12T00:03:51.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025940799999999999 2024-09-12T00:03:51.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:51.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607098+0000", 2024-09-12T00:03:51.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036150459999999998 2024-09-12T00:03:51.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:51.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607133+0000", 2024-09-12T00:03:51.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4615e-05 2024-09-12T00:03:51.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:51.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607156+0000", 2024-09-12T00:03:51.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3113999999999999e-05 2024-09-12T00:03:51.777 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.777 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:51.777 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.777 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:666 6.a 6:5395e6f3:lc::lc.4:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.777 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:03:51.777 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 17.100539782999999, 2024-09-12T00:03:51.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.005127174, 2024-09-12T00:03:51.777 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:51.778 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:51.778 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.778 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:51.778 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:51.778 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.778 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 666 2024-09-12T00:03:51.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.778 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:51.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.778 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:51.778 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:03:51.778 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:51.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:03:51.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:51.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602370+0000", 2024-09-12T00:03:51.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0720000000000001e-06 2024-09-12T00:03:51.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:51.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602376+0000", 2024-09-12T00:03:51.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5489999999999997e-06 2024-09-12T00:03:51.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:51.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602391+0000", 2024-09-12T00:03:51.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5301000000000001e-05 2024-09-12T00:03:51.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602399+0000", 2024-09-12T00:03:51.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9179999999999994e-06 2024-09-12T00:03:51.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602456+0000", 2024-09-12T00:03:51.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7099999999999999e-05 2024-09-12T00:03:51.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.781 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:51.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602508+0000", 2024-09-12T00:03:51.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2476999999999999e-05 2024-09-12T00:03:51.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.781 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:51.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602606+0000", 2024-09-12T00:03:51.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7823000000000002e-05 2024-09-12T00:03:51.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.782 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.782 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.604653+0000", 2024-09-12T00:03:51.782 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002047068 2024-09-12T00:03:51.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.782 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:51.782 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607401+0000", 2024-09-12T00:03:51.782 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027477700000000001 2024-09-12T00:03:51.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.782 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:51.782 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607453+0000", 2024-09-12T00:03:51.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2092999999999997e-05 2024-09-12T00:03:51.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:51.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607496+0000", 2024-09-12T00:03:51.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3003000000000001e-05 2024-09-12T00:03:51.783 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.783 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:51.783 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.783 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:665 6.1a e35/29 6:5c7e8a6d:reshard::reshard.0000000015:head v 35'11, mlcod=35'8)", 2024-09-12T00:03:51.783 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:03:51.783 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 17.100168098000001, 2024-09-12T00:03:51.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048593209999999998, 2024-09-12T00:03:51.784 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:51.784 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:51.784 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.784 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:51.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:51.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:03:51.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:51.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:03:51.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:51.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602742+0000", 2024-09-12T00:03:51.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1069999999999999e-06 2024-09-12T00:03:51.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:51.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602749+0000", 2024-09-12T00:03:51.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9609999999999999e-06 2024-09-12T00:03:51.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.786 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:51.786 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602763+0000", 2024-09-12T00:03:51.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4086e-05 2024-09-12T00:03:51.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.786 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.786 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602772+0000", 2024-09-12T00:03:51.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8470000000000002e-06 2024-09-12T00:03:51.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.786 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.786 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602826+0000", 2024-09-12T00:03:51.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3885000000000003e-05 2024-09-12T00:03:51.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.787 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:51.787 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602837+0000", 2024-09-12T00:03:51.787 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1601e-05 2024-09-12T00:03:51.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.787 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.787 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:51.787 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607500+0000", 2024-09-12T00:03:51.787 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046627509999999997 2024-09-12T00:03:51.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.787 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.787 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:51.787 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607600+0000", 2024-09-12T00:03:51.787 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100083 2024-09-12T00:03:51.787 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.788 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:51.788 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.788 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:831 6.19 6:9d23f22c:lc::lc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.788 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:03:51.788 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 17.036883417999999, 2024-09-12T00:03:51.788 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047044610000000001, 2024-09-12T00:03:51.788 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:51.788 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:51.788 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.788 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:51.788 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:51.788 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.789 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 831 2024-09-12T00:03:51.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.789 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:51.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:51.789 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:03:51.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:51.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:03:51.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:51.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666026+0000", 2024-09-12T00:03:51.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.02e-06 2024-09-12T00:03:51.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:51.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666032+0000", 2024-09-12T00:03:51.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8850000000000004e-06 2024-09-12T00:03:51.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:51.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666047+0000", 2024-09-12T00:03:51.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4647999999999999e-05 2024-09-12T00:03:51.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666058+0000", 2024-09-12T00:03:51.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0905e-05 2024-09-12T00:03:51.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666376+0000", 2024-09-12T00:03:51.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031824899999999999 2024-09-12T00:03:51.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:51.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666479+0000", 2024-09-12T00:03:51.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102814 2024-09-12T00:03:51.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:51.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666635+0000", 2024-09-12T00:03:51.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000156343 2024-09-12T00:03:51.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:51.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.667611+0000", 2024-09-12T00:03:51.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000975671 2024-09-12T00:03:51.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.793 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.793 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.793 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670662+0000", 2024-09-12T00:03:51.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003050863 2024-09-12T00:03:51.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.793 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.793 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:51.793 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670701+0000", 2024-09-12T00:03:51.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9338000000000002e-05 2024-09-12T00:03:51.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.793 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.793 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:51.793 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670730+0000", 2024-09-12T00:03:51.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8725e-05 2024-09-12T00:03:51.794 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.794 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:51.794 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.794 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:852 6.1d e35/29 6:bbf2d10c:::obj_delete_at_hint.0000000025:head v 35'9, mlcod=35'7)", 2024-09-12T00:03:51.794 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:03:51.794 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 17.028306364999999, 2024-09-12T00:03:51.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00569595, 2024-09-12T00:03:51.794 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:51.794 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:51.794 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.794 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:51.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:51.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:03:51.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:51.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:03:51.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:51.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674604+0000", 2024-09-12T00:03:51.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2079999999999999e-06 2024-09-12T00:03:51.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:51.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674611+0000", 2024-09-12T00:03:51.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.973e-06 2024-09-12T00:03:51.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:51.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674625+0000", 2024-09-12T00:03:51.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3916e-05 2024-09-12T00:03:51.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674633+0000", 2024-09-12T00:03:51.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8580000000000006e-06 2024-09-12T00:03:51.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674697+0000", 2024-09-12T00:03:51.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4004999999999995e-05 2024-09-12T00:03:51.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:51.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674713+0000", 2024-09-12T00:03:51.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5835e-05 2024-09-12T00:03:51.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:51.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680245+0000", 2024-09-12T00:03:51.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055320250000000003 2024-09-12T00:03:51.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:51.798 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680298+0000", 2024-09-12T00:03:51.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3130000000000001e-05 2024-09-12T00:03:51.798 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.798 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:51.798 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.798 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:925 6.1a e35/29 6:5f2e3d26:lc::lc.18:head v 35'15, mlcod=35'12)", 2024-09-12T00:03:51.798 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:03:51.798 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 17.004778535, 2024-09-12T00:03:51.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055640999999999998, 2024-09-12T00:03:51.799 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:51.799 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:51.799 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.799 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:51.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.799 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:51.799 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:03:51.799 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.799 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:51.799 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:03:51.799 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:51.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698131+0000", 2024-09-12T00:03:51.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:03:51.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:51.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698140+0000", 2024-09-12T00:03:51.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3139999999999993e-06 2024-09-12T00:03:51.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:51.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698155+0000", 2024-09-12T00:03:51.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:03:51.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698164+0000", 2024-09-12T00:03:51.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1419999999999999e-06 2024-09-12T00:03:51.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698228+0000", 2024-09-12T00:03:51.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3380000000000006e-05 2024-09-12T00:03:51.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:51.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698252+0000", 2024-09-12T00:03:51.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4111e-05 2024-09-12T00:03:51.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:51.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703646+0000", 2024-09-12T00:03:51.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0053937840000000004 2024-09-12T00:03:51.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:51.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703694+0000", 2024-09-12T00:03:51.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8776999999999997e-05 2024-09-12T00:03:51.802 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.802 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:51.802 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.803 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:927 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.803 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:03:51.803 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 17.004259511000001, 2024-09-12T00:03:51.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050914949999999997, 2024-09-12T00:03:51.803 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:51.803 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:51.803 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:51.803 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:51.803 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:51.803 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.803 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 927 2024-09-12T00:03:51.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.803 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:51.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:51.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:03:51.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:51.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:03:51.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:51.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698651+0000", 2024-09-12T00:03:51.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3740000000000001e-06 2024-09-12T00:03:51.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.805 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.805 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:51.805 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698657+0000", 2024-09-12T00:03:51.805 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5239999999999997e-06 2024-09-12T00:03:51.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.805 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.805 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:51.805 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698673+0000", 2024-09-12T00:03:51.805 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5345999999999998e-05 2024-09-12T00:03:51.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698680+0000", 2024-09-12T00:03:51.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4649999999999997e-06 2024-09-12T00:03:51.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699009+0000", 2024-09-12T00:03:51.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032934000000000001 2024-09-12T00:03:51.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:51.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699213+0000", 2024-09-12T00:03:51.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020361500000000001 2024-09-12T00:03:51.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:51.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699450+0000", 2024-09-12T00:03:51.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023670399999999999 2024-09-12T00:03:51.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:51.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.700678+0000", 2024-09-12T00:03:51.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012285519999999999 2024-09-12T00:03:51.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:51.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703666+0000", 2024-09-12T00:03:51.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029876130000000001 2024-09-12T00:03:51.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:51.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703708+0000", 2024-09-12T00:03:51.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2361999999999999e-05 2024-09-12T00:03:51.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:51.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703741+0000", 2024-09-12T00:03:51.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.26e-05 2024-09-12T00:03:51.809 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.809 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:51.809 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.809 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.809 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:941 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:51.809 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:03:51.809 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 16.998766058000001, 2024-09-12T00:03:51.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0051476960000000002, 2024-09-12T00:03:51.809 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:51.809 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:51.809 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "started", 2024-09-12T00:03:51.809 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:51.809 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:51.810 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:51.810 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 941 2024-09-12T00:03:51.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.810 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:51.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.810 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:51.810 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:03:51.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.810 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:51.810 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:03:51.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:51.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.811 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:51.811 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704144+0000", 2024-09-12T00:03:51.811 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.514e-06 2024-09-12T00:03:51.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:51.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704152+0000", 2024-09-12T00:03:51.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2830000000000004e-06 2024-09-12T00:03:51.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:51.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704168+0000", 2024-09-12T00:03:51.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6835999999999999e-05 2024-09-12T00:03:51.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:51.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704178+0000", 2024-09-12T00:03:51.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7569999999999999e-06 2024-09-12T00:03:51.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.813 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.813 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:51.813 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704240+0000", 2024-09-12T00:03:51.813 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2193000000000006e-05 2024-09-12T00:03:51.813 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.813 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.813 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:51.813 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704308+0000", 2024-09-12T00:03:51.813 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7840000000000001e-05 2024-09-12T00:03:51.813 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:51.813 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:51.813 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:51.813 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.709290+0000", 2024-09-12T00:03:51.813 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049822729999999997 2024-09-12T00:03:51.813 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.814 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:51.814 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.814 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:51.814 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:51.814 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:03:51.816 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:03:51.816 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:51.813+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:51.861 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:03:51.945 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:51.945+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:51.981 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:03:51.981 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:03:51.981 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:03:51.981 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:03:51.995 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:03:52.017 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:03:52.020+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:03:52.063 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:03:52.064 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:03:52.080 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:03:52.081 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:03:52.098 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:03:52.098 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:03:52.115 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:03:52.115 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:03:52.118 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:52.117+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:52.136 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:03:52.136 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:03:52.156 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:03:52.157 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:03:52.172 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:52.173 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:52.178 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:03:52.178 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:03:52.190 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:03:52.200 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:03:52.201 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:03:52.218 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:52.217+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:52.319 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:03:52.316+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:03:52.344 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:52.344 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:52.357 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:03:52.420 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:52.416+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:03:52.470 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:52.470 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:52.483 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:03:52.509 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T00:03:52.521 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:52.520+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:03:52.604 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:52.604 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:52.617 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:03:52.622 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:03:52.620+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:03:52.723 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:03:52.724+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:03:52.732 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:52.732 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:52.746 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:03:52.824 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:52.821+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:52.873 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:52.874 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:52.889 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:03:52.925 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:52.928+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:03:53.026 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:53.025+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:53.055 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:53.056 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:53.070 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:03:53.128 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:53.124+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:03:53.229 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:53.232+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:03:53.229 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:53.229 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:53.242 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:03:53.330 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:53.329+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:53.375 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:53.376 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:53.390 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:03:53.430 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:53.429+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:53.514 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:53.515 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:53.529 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:03:53.530 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:03:53.529+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:03:53.633 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:03:53.632+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:03:53.653 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:53.653 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:53.668 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:03:53.756 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:53.760+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:03:53.835 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:53.836+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:03:53.836 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:53.836 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:53.852 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:03:53.936 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:53.933+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:54.018 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:54.018 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:54.032 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:03:54.076 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:03:54.080+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:03:54.137 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:54.137+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:54.157 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:54.157 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:54.171 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:03:54.219 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:03:54.265 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:03:54.265+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:03:54.339 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:54.339 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:54.340 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:54.337+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:54.352 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:03:54.380 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:03:54.381 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:03:54.397 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:03:54.397 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:03:54.414 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:03:54.414 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:03:54.432 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:03:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:03:54.441 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:54.437+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:54.455 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:03:54.455 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:03:54.474 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:54.475 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:54.479 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:03:54.480 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:03:54.489 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:03:54.502 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:03:54.503 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:03:54.526 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:03:54.526 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:03:54.531 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T00:03:54.542 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:03:54.544+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:03:54.610 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:54.610 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:03:54.611 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:03:54.611 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:03:54.611 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.611 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:54.611 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.463033+0000", 2024-09-12T00:03:54.611 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.148484557, 2024-09-12T00:03:54.611 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037134049999999999, 2024-09-12T00:03:54.611 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:54.611 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:54.611 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:54.611 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:54.611 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:54.611 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:54.612 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 231 2024-09-12T00:03:54.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.612 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:54.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.612 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:54.612 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463033+0000", 2024-09-12T00:03:54.612 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.612 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:54.612 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463033+0000", 2024-09-12T00:03:54.612 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.613 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:54.613 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463036+0000", 2024-09-12T00:03:54.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5270000000000001e-06 2024-09-12T00:03:54.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.613 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:54.613 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463047+0000", 2024-09-12T00:03:54.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1389999999999999e-05 2024-09-12T00:03:54.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.613 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:54.613 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463077+0000", 2024-09-12T00:03:54.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9706e-05 2024-09-12T00:03:54.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.614 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:54.614 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463091+0000", 2024-09-12T00:03:54.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4447000000000001e-05 2024-09-12T00:03:54.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.614 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:54.614 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463243+0000", 2024-09-12T00:03:54.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000151392 2024-09-12T00:03:54.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.614 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:54.614 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.463602+0000", 2024-09-12T00:03:54.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00035878700000000001 2024-09-12T00:03:54.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:03:54.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.464299+0000", 2024-09-12T00:03:54.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00069704100000000002 2024-09-12T00:03:54.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:54.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.466067+0000", 2024-09-12T00:03:54.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001768141 2024-09-12T00:03:54.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.616 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:54.616 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.466593+0000", 2024-09-12T00:03:54.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052655499999999995 2024-09-12T00:03:54.616 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.616 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.616 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:54.616 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.466679+0000", 2024-09-12T00:03:54.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.5682999999999999e-05 2024-09-12T00:03:54.616 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.616 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.616 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:54.616 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.466747+0000", 2024-09-12T00:03:54.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.7736000000000003e-05 2024-09-12T00:03:54.616 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.617 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:54.617 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.617 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:297 6.8 e35/29 6:162a24ce:lc::lc.8:head v 35'2, mlcod=0'0)", 2024-09-12T00:03:54.617 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.499608+0000", 2024-09-12T00:03:54.617 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.111909915999998, 2024-09-12T00:03:54.617 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004805269, 2024-09-12T00:03:54.617 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:54.617 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:54.617 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:54.617 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:54.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:54.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499608+0000", 2024-09-12T00:03:54.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.618 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:54.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499608+0000", 2024-09-12T00:03:54.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.618 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:54.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499610+0000", 2024-09-12T00:03:54.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3269999999999999e-06 2024-09-12T00:03:54.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.619 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:54.619 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499625+0000", 2024-09-12T00:03:54.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.519e-05 2024-09-12T00:03:54.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.619 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:54.619 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499659+0000", 2024-09-12T00:03:54.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3251999999999999e-05 2024-09-12T00:03:54.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.619 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:54.619 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499711+0000", 2024-09-12T00:03:54.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1983e-05 2024-09-12T00:03:54.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.620 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:54.620 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499869+0000", 2024-09-12T00:03:54.620 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015835600000000001 2024-09-12T00:03:54.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.620 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:54.620 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499913+0000", 2024-09-12T00:03:54.620 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4305999999999999e-05 2024-09-12T00:03:54.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.620 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:54.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.504301+0000", 2024-09-12T00:03:54.621 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043874659999999996 2024-09-12T00:03:54.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.621 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:54.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.504413+0000", 2024-09-12T00:03:54.621 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000112389 2024-09-12T00:03:54.621 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.621 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:54.621 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.621 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:323 6.e e35/29 6:71a6e5bc:lc::lc.2:head v 35'3, mlcod=35'1)", 2024-09-12T00:03:54.621 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.503252+0000", 2024-09-12T00:03:54.622 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.108265624000001, 2024-09-12T00:03:54.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038149070000000002, 2024-09-12T00:03:54.622 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:54.622 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:54.622 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:54.622 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:54.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.622 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:54.622 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503252+0000", 2024-09-12T00:03:54.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.622 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:54.622 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503252+0000", 2024-09-12T00:03:54.623 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.623 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:54.623 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503254+0000", 2024-09-12T00:03:54.623 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8840000000000001e-06 2024-09-12T00:03:54.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.623 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:54.623 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503267+0000", 2024-09-12T00:03:54.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3098999999999999e-05 2024-09-12T00:03:54.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:54.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503304+0000", 2024-09-12T00:03:54.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6473000000000001e-05 2024-09-12T00:03:54.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:54.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503324+0000", 2024-09-12T00:03:54.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0582999999999999e-05 2024-09-12T00:03:54.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:54.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503478+0000", 2024-09-12T00:03:54.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015380299999999999 2024-09-12T00:03:54.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:54.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.503531+0000", 2024-09-12T00:03:54.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3078999999999998e-05 2024-09-12T00:03:54.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:54.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.506959+0000", 2024-09-12T00:03:54.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0034275909999999998 2024-09-12T00:03:54.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:54.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.507067+0000", 2024-09-12T00:03:54.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010839499999999999 2024-09-12T00:03:54.626 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.626 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:54.626 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.626 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:344 6.1b 6:dabbc408:lc::lc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:54.626 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.509665+0000", 2024-09-12T00:03:54.626 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.101852442999999, 2024-09-12T00:03:54.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052648319999999997, 2024-09-12T00:03:54.626 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:54.627 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:54.627 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:54.627 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:54.627 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:54.627 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:54.627 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 344 2024-09-12T00:03:54.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.627 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:54.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:54.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509665+0000", 2024-09-12T00:03:54.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.628 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:54.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509665+0000", 2024-09-12T00:03:54.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.628 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.628 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.628 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:54.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509667+0000", 2024-09-12T00:03:54.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.717e-06 2024-09-12T00:03:54.628 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.628 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.628 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:54.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509677+0000", 2024-09-12T00:03:54.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9029999999999999e-06 2024-09-12T00:03:54.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.629 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.629 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:54.629 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509703+0000", 2024-09-12T00:03:54.629 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5510000000000001e-05 2024-09-12T00:03:54.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.629 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.629 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:54.629 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509719+0000", 2024-09-12T00:03:54.629 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6163000000000001e-05 2024-09-12T00:03:54.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.629 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.629 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:54.629 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509913+0000", 2024-09-12T00:03:54.630 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000194432 2024-09-12T00:03:54.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.630 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:54.630 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510307+0000", 2024-09-12T00:03:54.630 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039409299999999998 2024-09-12T00:03:54.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.630 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:03:54.630 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510805+0000", 2024-09-12T00:03:54.630 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00049770599999999999 2024-09-12T00:03:54.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.631 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:54.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.512288+0000", 2024-09-12T00:03:54.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001483364 2024-09-12T00:03:54.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.631 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.631 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:54.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514621+0000", 2024-09-12T00:03:54.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002332883 2024-09-12T00:03:54.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.631 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.631 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:54.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514775+0000", 2024-09-12T00:03:54.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000153573 2024-09-12T00:03:54.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.632 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:54.632 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514930+0000", 2024-09-12T00:03:54.632 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015548800000000001 2024-09-12T00:03:54.632 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.632 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:54.632 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.632 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:346 6.8 e35/29 6:10010070:lc::lc.29:head v 35'4, mlcod=35'2)", 2024-09-12T00:03:54.632 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.510411+0000", 2024-09-12T00:03:54.632 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.101107156000001, 2024-09-12T00:03:54.632 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041988340000000002, 2024-09-12T00:03:54.632 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:54.633 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:54.633 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:54.633 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:54.633 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:54.633 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510411+0000", 2024-09-12T00:03:54.633 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.633 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:54.634 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510411+0000", 2024-09-12T00:03:54.634 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.634 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:54.634 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510412+0000", 2024-09-12T00:03:54.634 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.72e-06 2024-09-12T00:03:54.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.634 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:54.634 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510424+0000", 2024-09-12T00:03:54.634 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2089999999999999e-05 2024-09-12T00:03:54.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.635 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:54.635 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510450+0000", 2024-09-12T00:03:54.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5797000000000001e-05 2024-09-12T00:03:54.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.635 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.635 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:54.635 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510465+0000", 2024-09-12T00:03:54.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.446e-05 2024-09-12T00:03:54.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.635 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.635 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:54.635 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510591+0000", 2024-09-12T00:03:54.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012610799999999999 2024-09-12T00:03:54.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.636 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.636 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:54.636 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.510639+0000", 2024-09-12T00:03:54.636 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.8457e-05 2024-09-12T00:03:54.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.636 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.636 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:54.636 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514519+0000", 2024-09-12T00:03:54.636 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038796529999999998 2024-09-12T00:03:54.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.636 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.636 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:54.636 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514610+0000", 2024-09-12T00:03:54.637 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0549000000000003e-05 2024-09-12T00:03:54.637 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.637 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:54.637 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.637 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.637 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.637 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:352 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:54.637 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.513324+0000", 2024-09-12T00:03:54.637 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.098194027000002, 2024-09-12T00:03:54.637 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052898679999999997, 2024-09-12T00:03:54.637 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:54.637 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:54.637 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:54.637 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:54.638 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:54.638 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:54.638 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 352 2024-09-12T00:03:54.638 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.638 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:54.638 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.638 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:54.638 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513324+0000", 2024-09-12T00:03:54.638 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.638 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.638 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.638 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:54.638 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513324+0000", 2024-09-12T00:03:54.638 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.639 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.639 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:54.639 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513326+0000", 2024-09-12T00:03:54.639 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4200000000000001e-06 2024-09-12T00:03:54.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.639 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.639 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:54.639 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513360+0000", 2024-09-12T00:03:54.639 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3413e-05 2024-09-12T00:03:54.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.639 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.639 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:54.640 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513395+0000", 2024-09-12T00:03:54.640 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5519000000000003e-05 2024-09-12T00:03:54.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.640 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.640 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:54.640 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513417+0000", 2024-09-12T00:03:54.640 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1710000000000001e-05 2024-09-12T00:03:54.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.640 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.640 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:54.640 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513577+0000", 2024-09-12T00:03:54.640 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015987900000000001 2024-09-12T00:03:54.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.641 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.641 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:54.641 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513809+0000", 2024-09-12T00:03:54.641 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000231855 2024-09-12T00:03:54.641 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.641 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.641 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:03:54.641 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514261+0000", 2024-09-12T00:03:54.641 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00045238599999999999 2024-09-12T00:03:54.641 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.642 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.642 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:54.642 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.515784+0000", 2024-09-12T00:03:54.642 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015229569999999999 2024-09-12T00:03:54.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.642 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.642 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:54.642 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.518352+0000", 2024-09-12T00:03:54.642 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0025684850000000001 2024-09-12T00:03:54.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.642 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.642 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:54.642 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.518501+0000", 2024-09-12T00:03:54.643 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014815499999999999 2024-09-12T00:03:54.643 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.643 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.643 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:54.643 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.518614+0000", 2024-09-12T00:03:54.643 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113089 2024-09-12T00:03:54.643 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.643 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:54.643 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.643 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.643 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.644 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:359 6.e e35/29 6:703a9e16:::obj_delete_at_hint.0000000002:head v 35'4, mlcod=35'2)", 2024-09-12T00:03:54.644 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.516147+0000", 2024-09-12T00:03:54.644 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.095371311000001, 2024-09-12T00:03:54.644 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045436039999999997, 2024-09-12T00:03:54.644 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:54.644 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:54.644 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:54.644 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:54.644 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.645 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:54.645 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516147+0000", 2024-09-12T00:03:54.645 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.645 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.645 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.645 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:54.645 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516147+0000", 2024-09-12T00:03:54.645 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.645 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.645 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.645 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:54.645 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516154+0000", 2024-09-12T00:03:54.645 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.8229999999999995e-06 2024-09-12T00:03:54.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.646 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.646 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:54.646 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516165+0000", 2024-09-12T00:03:54.646 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0190000000000001e-05 2024-09-12T00:03:54.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.646 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.646 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:54.646 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516182+0000", 2024-09-12T00:03:54.646 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.732e-05 2024-09-12T00:03:54.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.646 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.646 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:54.646 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516198+0000", 2024-09-12T00:03:54.647 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6379999999999999e-05 2024-09-12T00:03:54.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.647 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.647 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:54.647 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516344+0000", 2024-09-12T00:03:54.647 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014533499999999999 2024-09-12T00:03:54.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.647 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.647 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:54.647 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516377+0000", 2024-09-12T00:03:54.647 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3426000000000002e-05 2024-09-12T00:03:54.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.647 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.647 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:54.648 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520590+0000", 2024-09-12T00:03:54.648 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042129810000000002 2024-09-12T00:03:54.648 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.648 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.648 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:54.648 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520690+0000", 2024-09-12T00:03:54.648 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010014900000000001 2024-09-12T00:03:54.648 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.648 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:54.648 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.648 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.648 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.648 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:362 6.8 e35/29 6:10010070:lc::lc.29:head v 35'5, mlcod=35'3)", 2024-09-12T00:03:54.649 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.516504+0000", 2024-09-12T00:03:54.649 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.095013848000001, 2024-09-12T00:03:54.649 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043050099999999997, 2024-09-12T00:03:54.649 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:54.649 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:54.649 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:54.649 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:54.649 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.649 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:54.649 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516504+0000", 2024-09-12T00:03:54.649 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.649 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.649 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.649 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:54.650 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516504+0000", 2024-09-12T00:03:54.650 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.650 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.650 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:54.650 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516506+0000", 2024-09-12T00:03:54.650 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9e-06 2024-09-12T00:03:54.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.650 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.650 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:54.650 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516519+0000", 2024-09-12T00:03:54.650 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.322e-05 2024-09-12T00:03:54.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.650 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.651 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:54.651 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516547+0000", 2024-09-12T00:03:54.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8289999999999998e-05 2024-09-12T00:03:54.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.652 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.652 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:54.652 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516565+0000", 2024-09-12T00:03:54.652 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7737e-05 2024-09-12T00:03:54.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.653 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.653 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:54.653 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516723+0000", 2024-09-12T00:03:54.653 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015814799999999999 2024-09-12T00:03:54.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.653 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.653 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:54.653 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516782+0000", 2024-09-12T00:03:54.653 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8353000000000002e-05 2024-09-12T00:03:54.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.653 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.653 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:54.653 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520695+0000", 2024-09-12T00:03:54.653 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003912886 2024-09-12T00:03:54.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.654 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.654 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:54.654 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520809+0000", 2024-09-12T00:03:54.654 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011447600000000001 2024-09-12T00:03:54.654 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.654 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:54.654 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.654 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.654 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:367 6.1b 6:dabbc408:lc::lc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:54.654 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.516992+0000", 2024-09-12T00:03:54.654 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.094525917999999, 2024-09-12T00:03:54.655 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004051158, 2024-09-12T00:03:54.655 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:54.655 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:54.655 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:54.655 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:54.655 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:54.655 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:54.655 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 367 2024-09-12T00:03:54.655 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.655 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:54.655 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.655 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:54.655 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516992+0000", 2024-09-12T00:03:54.655 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.655 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.656 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.656 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:54.656 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516992+0000", 2024-09-12T00:03:54.656 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.656 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.656 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.656 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:54.656 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.516994+0000", 2024-09-12T00:03:54.656 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5629999999999999e-06 2024-09-12T00:03:54.656 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.656 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.656 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:54.656 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517009+0000", 2024-09-12T00:03:54.657 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4973e-05 2024-09-12T00:03:54.657 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.657 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.657 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:54.657 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517039+0000", 2024-09-12T00:03:54.657 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9544e-05 2024-09-12T00:03:54.657 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.657 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.657 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:54.657 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517060+0000", 2024-09-12T00:03:54.657 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1369000000000002e-05 2024-09-12T00:03:54.657 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.657 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.658 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:54.658 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517208+0000", 2024-09-12T00:03:54.658 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014785500000000001 2024-09-12T00:03:54.658 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.658 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.658 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:54.658 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517522+0000", 2024-09-12T00:03:54.658 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00031421800000000001 2024-09-12T00:03:54.658 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.658 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.658 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:03:54.658 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517825+0000", 2024-09-12T00:03:54.658 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00030275700000000002 2024-09-12T00:03:54.658 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.659 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:54.659 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519023+0000", 2024-09-12T00:03:54.659 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001197474 2024-09-12T00:03:54.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.659 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:54.659 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520717+0000", 2024-09-12T00:03:54.659 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0016939209999999999 2024-09-12T00:03:54.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.659 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:54.659 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520834+0000", 2024-09-12T00:03:54.659 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117773 2024-09-12T00:03:54.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.660 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:54.660 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.521043+0000", 2024-09-12T00:03:54.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020871099999999999 2024-09-12T00:03:54.660 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.660 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:54.660 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.660 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:375 6.11 6:8f661e56:lc::lc.12:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:54.660 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.519365+0000", 2024-09-12T00:03:54.660 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.092152511999998, 2024-09-12T00:03:54.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0036610010000000001, 2024-09-12T00:03:54.661 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:54.661 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:54.661 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:54.661 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:54.661 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:54.661 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:54.661 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 375 2024-09-12T00:03:54.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.661 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:54.661 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.661 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:54.661 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519365+0000", 2024-09-12T00:03:54.661 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:54.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519365+0000", 2024-09-12T00:03:54.662 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:54.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519368+0000", 2024-09-12T00:03:54.662 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7870000000000002e-06 2024-09-12T00:03:54.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:54.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519382+0000", 2024-09-12T00:03:54.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3393e-05 2024-09-12T00:03:54.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.663 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:54.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519460+0000", 2024-09-12T00:03:54.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.8033000000000003e-05 2024-09-12T00:03:54.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.663 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:54.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519485+0000", 2024-09-12T00:03:54.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5136000000000001e-05 2024-09-12T00:03:54.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.663 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:54.664 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519637+0000", 2024-09-12T00:03:54.664 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000151972 2024-09-12T00:03:54.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.664 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.664 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:54.664 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519992+0000", 2024-09-12T00:03:54.664 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00035536699999999999 2024-09-12T00:03:54.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.664 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.664 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:54.664 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.520591+0000", 2024-09-12T00:03:54.664 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000599101 2024-09-12T00:03:54.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.664 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.665 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:54.665 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.522600+0000", 2024-09-12T00:03:54.665 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00200921 2024-09-12T00:03:54.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.665 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.665 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:54.665 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.522809+0000", 2024-09-12T00:03:54.665 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000208521 2024-09-12T00:03:54.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.665 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.665 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:54.665 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.522953+0000", 2024-09-12T00:03:54.665 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014383899999999999 2024-09-12T00:03:54.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.666 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.666 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:54.666 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.523026+0000", 2024-09-12T00:03:54.666 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3641999999999997e-05 2024-09-12T00:03:54.666 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.666 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:54.666 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.666 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.666 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:403 6.8 e35/29 6:11d93ab7:::obj_delete_at_hint.0000000003:head v 35'6, mlcod=35'4)", 2024-09-12T00:03:54.666 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.526734+0000", 2024-09-12T00:03:54.666 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.084784141, 2024-09-12T00:03:54.666 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003881813, 2024-09-12T00:03:54.667 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:54.667 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:54.667 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:54.667 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:54.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:54.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526734+0000", 2024-09-12T00:03:54.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:54.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526734+0000", 2024-09-12T00:03:54.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.668 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:54.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526735+0000", 2024-09-12T00:03:54.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6169999999999999e-06 2024-09-12T00:03:54.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.668 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:54.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526745+0000", 2024-09-12T00:03:54.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7769999999999997e-06 2024-09-12T00:03:54.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.669 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.669 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:54.669 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526768+0000", 2024-09-12T00:03:54.669 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3156999999999999e-05 2024-09-12T00:03:54.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.669 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.669 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:54.669 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526780+0000", 2024-09-12T00:03:54.669 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2043e-05 2024-09-12T00:03:54.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.669 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.669 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:54.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526892+0000", 2024-09-12T00:03:54.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011140499999999999 2024-09-12T00:03:54.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:54.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.526925+0000", 2024-09-12T00:03:54.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3670999999999997e-05 2024-09-12T00:03:54.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:54.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.530524+0000", 2024-09-12T00:03:54.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0035983769999999998 2024-09-12T00:03:54.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.671 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:54.671 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.530616+0000", 2024-09-12T00:03:54.671 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1766000000000002e-05 2024-09-12T00:03:54.671 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.671 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:54.671 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.671 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:462 6.1f 6:ffe20264:lc::lc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:54.671 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.543661+0000", 2024-09-12T00:03:54.671 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.067857020000002, 2024-09-12T00:03:54.671 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037941450000000001, 2024-09-12T00:03:54.671 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:54.672 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:54.672 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:54.672 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:54.672 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:54.672 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:54.672 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 462 2024-09-12T00:03:54.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.672 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:54.672 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.672 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:54.672 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543661+0000", 2024-09-12T00:03:54.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.672 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:54.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543661+0000", 2024-09-12T00:03:54.673 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:54.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543663+0000", 2024-09-12T00:03:54.673 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.644e-06 2024-09-12T00:03:54.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:54.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543674+0000", 2024-09-12T00:03:54.673 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0710000000000001e-05 2024-09-12T00:03:54.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.674 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.674 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:54.674 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543704+0000", 2024-09-12T00:03:54.674 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9856e-05 2024-09-12T00:03:54.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.674 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.674 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:54.674 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543719+0000", 2024-09-12T00:03:54.674 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5265999999999999e-05 2024-09-12T00:03:54.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.674 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.674 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:54.674 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543865+0000", 2024-09-12T00:03:54.675 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014598700000000001 2024-09-12T00:03:54.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.675 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:54.675 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544116+0000", 2024-09-12T00:03:54.675 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025093199999999999 2024-09-12T00:03:54.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.675 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:03:54.675 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544588+0000", 2024-09-12T00:03:54.675 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00047173899999999999 2024-09-12T00:03:54.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.675 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:54.676 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.545735+0000", 2024-09-12T00:03:54.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0011470320000000001 2024-09-12T00:03:54.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.676 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.676 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:54.676 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.547257+0000", 2024-09-12T00:03:54.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015221379999999999 2024-09-12T00:03:54.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.676 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.676 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:54.676 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.547369+0000", 2024-09-12T00:03:54.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011215899999999999 2024-09-12T00:03:54.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:54.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.547455+0000", 2024-09-12T00:03:54.677 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.5681999999999997e-05 2024-09-12T00:03:54.677 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.677 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:54.677 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.677 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:497 6.11 6:8f661e56:lc::lc.12:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:54.677 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.557693+0000", 2024-09-12T00:03:54.677 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.053825310000001, 2024-09-12T00:03:54.677 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039061030000000002, 2024-09-12T00:03:54.677 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:54.678 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:54.678 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:54.678 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:54.678 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:54.678 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:54.678 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 497 2024-09-12T00:03:54.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.678 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:54.678 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.678 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:54.678 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.557693+0000", 2024-09-12T00:03:54.678 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.679 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:54.679 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.557693+0000", 2024-09-12T00:03:54.679 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.679 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:54.679 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.557694+0000", 2024-09-12T00:03:54.679 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.894e-06 2024-09-12T00:03:54.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.679 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:54.679 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.557702+0000", 2024-09-12T00:03:54.679 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7200000000000006e-06 2024-09-12T00:03:54.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.680 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.680 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:54.680 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.557722+0000", 2024-09-12T00:03:54.680 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0162000000000001e-05 2024-09-12T00:03:54.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.680 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.680 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:54.680 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.557732+0000", 2024-09-12T00:03:54.680 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0088000000000001e-05 2024-09-12T00:03:54.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.680 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.680 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:54.681 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.557860+0000", 2024-09-12T00:03:54.681 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012722300000000001 2024-09-12T00:03:54.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.681 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.681 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:54.681 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.558018+0000", 2024-09-12T00:03:54.681 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015807399999999999 2024-09-12T00:03:54.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.681 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.681 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:54.681 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.558284+0000", 2024-09-12T00:03:54.681 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026614400000000001 2024-09-12T00:03:54.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.682 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.682 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:54.682 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.559371+0000", 2024-09-12T00:03:54.682 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001087113 2024-09-12T00:03:54.682 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.682 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.682 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:54.682 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.561454+0000", 2024-09-12T00:03:54.682 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020826439999999998 2024-09-12T00:03:54.682 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.682 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.682 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:54.682 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.561533+0000", 2024-09-12T00:03:54.682 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9177000000000004e-05 2024-09-12T00:03:54.683 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.683 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.683 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:54.683 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.561599+0000", 2024-09-12T00:03:54.683 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5864000000000005e-05 2024-09-12T00:03:54.683 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.683 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:54.683 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.683 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.683 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.683 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:638 6.1f 6:ffe20264:lc::lc.0:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:54.683 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.593253+0000", 2024-09-12T00:03:54.683 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.018265108000001, 2024-09-12T00:03:54.684 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052360990000000001, 2024-09-12T00:03:54.684 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:54.684 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:54.684 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:54.684 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:54.684 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:54.684 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:54.684 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 638 2024-09-12T00:03:54.684 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.684 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:54.684 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.684 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:54.684 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593253+0000", 2024-09-12T00:03:54.684 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.685 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.685 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:54.685 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593253+0000", 2024-09-12T00:03:54.685 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.685 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.685 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:54.685 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593255+0000", 2024-09-12T00:03:54.685 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0540000000000002e-06 2024-09-12T00:03:54.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.685 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.685 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:54.686 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593265+0000", 2024-09-12T00:03:54.686 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0028e-05 2024-09-12T00:03:54.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.686 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.686 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:54.686 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593282+0000", 2024-09-12T00:03:54.686 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6762999999999999e-05 2024-09-12T00:03:54.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.686 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.686 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:54.686 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593293+0000", 2024-09-12T00:03:54.686 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1691999999999999e-05 2024-09-12T00:03:54.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.687 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.687 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:54.687 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593376+0000", 2024-09-12T00:03:54.687 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3195999999999994e-05 2024-09-12T00:03:54.687 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.687 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.687 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:54.687 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593463+0000", 2024-09-12T00:03:54.687 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6421000000000005e-05 2024-09-12T00:03:54.687 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.687 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.687 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:03:54.687 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593680+0000", 2024-09-12T00:03:54.687 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000216698 2024-09-12T00:03:54.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.688 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.688 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:54.688 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.594516+0000", 2024-09-12T00:03:54.688 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00083619200000000003 2024-09-12T00:03:54.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.688 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.688 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:54.688 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598310+0000", 2024-09-12T00:03:54.688 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037941030000000001 2024-09-12T00:03:54.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.688 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.688 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:54.689 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598420+0000", 2024-09-12T00:03:54.689 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110163 2024-09-12T00:03:54.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.689 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:54.689 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598489+0000", 2024-09-12T00:03:54.689 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8788999999999995e-05 2024-09-12T00:03:54.689 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.689 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:54.689 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.689 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:717 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:54.689 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.625210+0000", 2024-09-12T00:03:54.690 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.986308318999999, 2024-09-12T00:03:54.690 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052809140000000003, 2024-09-12T00:03:54.690 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:54.690 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:54.690 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:54.690 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:54.690 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:54.690 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:54.690 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 717 2024-09-12T00:03:54.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.690 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:54.690 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.690 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:54.691 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625210+0000", 2024-09-12T00:03:54.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.691 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.691 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:54.691 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625210+0000", 2024-09-12T00:03:54.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.691 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.691 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:54.691 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625211+0000", 2024-09-12T00:03:54.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5960000000000001e-06 2024-09-12T00:03:54.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.691 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.692 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:54.692 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625228+0000", 2024-09-12T00:03:54.692 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6849000000000001e-05 2024-09-12T00:03:54.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.692 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.692 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:54.692 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625242+0000", 2024-09-12T00:03:54.692 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3730999999999999e-05 2024-09-12T00:03:54.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.692 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.692 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:54.692 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625250+0000", 2024-09-12T00:03:54.692 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3979999999999999e-06 2024-09-12T00:03:54.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.693 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.693 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:54.693 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625333+0000", 2024-09-12T00:03:54.693 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3096999999999994e-05 2024-09-12T00:03:54.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.693 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.693 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:54.693 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625472+0000", 2024-09-12T00:03:54.693 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013836499999999999 2024-09-12T00:03:54.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.693 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.693 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:03:54.693 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.625769+0000", 2024-09-12T00:03:54.693 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00029780900000000001 2024-09-12T00:03:54.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.694 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.694 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:54.694 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.626719+0000", 2024-09-12T00:03:54.694 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00095007800000000003 2024-09-12T00:03:54.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.694 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.694 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:54.694 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.630313+0000", 2024-09-12T00:03:54.694 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0035937690000000001 2024-09-12T00:03:54.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.694 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.694 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:54.694 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.630410+0000", 2024-09-12T00:03:54.695 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7246999999999999e-05 2024-09-12T00:03:54.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.695 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:54.695 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.630490+0000", 2024-09-12T00:03:54.695 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9975000000000006e-05 2024-09-12T00:03:54.695 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.695 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:54.695 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.695 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:735 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:54.695 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.631579+0000", 2024-09-12T00:03:54.695 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.979939051999999, 2024-09-12T00:03:54.696 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064619990000000004, 2024-09-12T00:03:54.696 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:54.696 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:54.696 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:54.696 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:54.696 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:54.696 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:54.696 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 735 2024-09-12T00:03:54.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.696 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:54.696 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.696 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:54.696 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631579+0000", 2024-09-12T00:03:54.697 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.697 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.697 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:54.697 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631579+0000", 2024-09-12T00:03:54.697 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.697 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.697 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:54.697 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631580+0000", 2024-09-12T00:03:54.697 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.206e-06 2024-09-12T00:03:54.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.697 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.697 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:54.698 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631586+0000", 2024-09-12T00:03:54.698 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8799999999999996e-06 2024-09-12T00:03:54.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.698 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.698 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:54.698 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631606+0000", 2024-09-12T00:03:54.698 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0557999999999999e-05 2024-09-12T00:03:54.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.698 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.698 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:54.698 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631622+0000", 2024-09-12T00:03:54.698 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5758000000000001e-05 2024-09-12T00:03:54.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.698 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.699 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:54.699 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631726+0000", 2024-09-12T00:03:54.699 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000103717 2024-09-12T00:03:54.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.699 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.699 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:54.699 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.631885+0000", 2024-09-12T00:03:54.699 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015954200000000001 2024-09-12T00:03:54.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.699 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.699 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:03:54.699 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.632177+0000", 2024-09-12T00:03:54.699 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00029183799999999999 2024-09-12T00:03:54.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.700 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:54.700 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.635740+0000", 2024-09-12T00:03:54.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0035623809999999999 2024-09-12T00:03:54.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.700 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:54.700 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.637872+0000", 2024-09-12T00:03:54.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002132494 2024-09-12T00:03:54.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.700 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:54.700 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.637968+0000", 2024-09-12T00:03:54.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5727e-05 2024-09-12T00:03:54.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:54.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638041+0000", 2024-09-12T00:03:54.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2898000000000006e-05 2024-09-12T00:03:54.701 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.701 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:54.701 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.701 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:852 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:54.701 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.675779+0000", 2024-09-12T00:03:54.702 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.935739219999999, 2024-09-12T00:03:54.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0070622760000000001, 2024-09-12T00:03:54.702 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:54.702 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:54.702 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:54.702 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:54.702 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:54.702 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:54.702 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 852 2024-09-12T00:03:54.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.702 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:54.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:54.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.675779+0000", 2024-09-12T00:03:54.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:54.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.675779+0000", 2024-09-12T00:03:54.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:54.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.675781+0000", 2024-09-12T00:03:54.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0729999999999999e-06 2024-09-12T00:03:54.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:54.704 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.675789+0000", 2024-09-12T00:03:54.704 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3389999999999993e-06 2024-09-12T00:03:54.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.704 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.704 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:54.704 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.675807+0000", 2024-09-12T00:03:54.704 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8275e-05 2024-09-12T00:03:54.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.704 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.704 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:54.704 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.675817+0000", 2024-09-12T00:03:54.704 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9620000000000005e-06 2024-09-12T00:03:54.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.705 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:54.705 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.675924+0000", 2024-09-12T00:03:54.705 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000107124 2024-09-12T00:03:54.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.705 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:54.705 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.676168+0000", 2024-09-12T00:03:54.705 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024318199999999999 2024-09-12T00:03:54.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.705 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:03:54.705 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.676432+0000", 2024-09-12T00:03:54.705 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026431499999999999 2024-09-12T00:03:54.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.706 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:54.706 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.677274+0000", 2024-09-12T00:03:54.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00084212999999999996 2024-09-12T00:03:54.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.706 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:54.706 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.682573+0000", 2024-09-12T00:03:54.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052988439999999996 2024-09-12T00:03:54.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.706 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:54.706 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.682727+0000", 2024-09-12T00:03:54.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000153893 2024-09-12T00:03:54.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:54.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.682841+0000", 2024-09-12T00:03:54.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000114139 2024-09-12T00:03:54.707 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.707 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:54.707 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.707 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:940 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:54.707 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.706022+0000", 2024-09-12T00:03:54.707 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.905496104000001, 2024-09-12T00:03:54.708 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0055103579999999999, 2024-09-12T00:03:54.708 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:54.708 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:54.708 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:54.708 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:54.708 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:54.708 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:54.708 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 940 2024-09-12T00:03:54.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.708 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:54.708 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.708 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:54.708 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706022+0000", 2024-09-12T00:03:54.708 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.709 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.709 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:54.709 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706022+0000", 2024-09-12T00:03:54.709 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.709 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.709 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:54.709 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706023+0000", 2024-09-12T00:03:54.709 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.294e-06 2024-09-12T00:03:54.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.709 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.709 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:54.709 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706029+0000", 2024-09-12T00:03:54.710 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.9859999999999999e-06 2024-09-12T00:03:54.710 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.710 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.710 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:54.710 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706044+0000", 2024-09-12T00:03:54.710 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5124e-05 2024-09-12T00:03:54.710 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.710 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.710 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:54.710 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706052+0000", 2024-09-12T00:03:54.710 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7810000000000005e-06 2024-09-12T00:03:54.710 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.710 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.710 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:54.711 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706143+0000", 2024-09-12T00:03:54.711 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0882000000000002e-05 2024-09-12T00:03:54.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.711 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.711 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:54.711 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706282+0000", 2024-09-12T00:03:54.711 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013932699999999999 2024-09-12T00:03:54.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.711 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.711 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:03:54.711 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.706520+0000", 2024-09-12T00:03:54.711 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023770200000000001 2024-09-12T00:03:54.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.711 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:54.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.707334+0000", 2024-09-12T00:03:54.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00081372300000000003 2024-09-12T00:03:54.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:54.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.711430+0000", 2024-09-12T00:03:54.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040969140000000001 2024-09-12T00:03:54.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:54.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.711487+0000", 2024-09-12T00:03:54.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6641999999999997e-05 2024-09-12T00:03:54.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.713 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.713 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:54.713 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.711532+0000", 2024-09-12T00:03:54.713 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4982999999999999e-05 2024-09-12T00:03:54.713 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.713 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:54.713 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.713 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.713 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1257 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:54.713 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:35.124959+0000", 2024-09-12T00:03:54.713 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.486558393999999, 2024-09-12T00:03:54.713 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054452789999999999, 2024-09-12T00:03:54.714 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:54.714 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:54.714 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:54.714 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:54.714 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:54.714 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:54.714 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1257 2024-09-12T00:03:54.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.714 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:54.714 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.714 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:54.714 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.124959+0000", 2024-09-12T00:03:54.714 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.715 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.715 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:54.715 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.124959+0000", 2024-09-12T00:03:54.715 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.715 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.715 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:54.715 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.124962+0000", 2024-09-12T00:03:54.715 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4959999999999999e-06 2024-09-12T00:03:54.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.715 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.715 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:54.715 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.124973+0000", 2024-09-12T00:03:54.715 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1457000000000001e-05 2024-09-12T00:03:54.716 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.716 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.716 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:54.716 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.125005+0000", 2024-09-12T00:03:54.716 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1163e-05 2024-09-12T00:03:54.716 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.716 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.716 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:54.716 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.125019+0000", 2024-09-12T00:03:54.716 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4780000000000001e-05 2024-09-12T00:03:54.716 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.716 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.716 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:54.717 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.125141+0000", 2024-09-12T00:03:54.717 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000121555 2024-09-12T00:03:54.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.717 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.717 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:54.717 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.125362+0000", 2024-09-12T00:03:54.717 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000221375 2024-09-12T00:03:54.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.717 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.717 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:54.717 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.125671+0000", 2024-09-12T00:03:54.717 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00030850400000000003 2024-09-12T00:03:54.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.717 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:54.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.126746+0000", 2024-09-12T00:03:54.718 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001075051 2024-09-12T00:03:54.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:54.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.130141+0000", 2024-09-12T00:03:54.718 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033952240000000001 2024-09-12T00:03:54.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:54.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.130293+0000", 2024-09-12T00:03:54.718 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015235499999999999 2024-09-12T00:03:54.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.719 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:54.719 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.130405+0000", 2024-09-12T00:03:54.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000111319 2024-09-12T00:03:54.719 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.719 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:54.719 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.719 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1334 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:54.719 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:35.312239+0000", 2024-09-12T00:03:54.719 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.299278374, 2024-09-12T00:03:54.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048064800000000001, 2024-09-12T00:03:54.719 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:54.720 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:54.720 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:54.720 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:54.720 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:54.720 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:54.720 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1334 2024-09-12T00:03:54.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.720 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:54.720 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.720 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:54.720 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312239+0000", 2024-09-12T00:03:54.720 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.720 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.721 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:54.721 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312239+0000", 2024-09-12T00:03:54.721 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:54.721 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.721 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.721 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:54.721 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312242+0000", 2024-09-12T00:03:54.721 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7300000000000001e-06 2024-09-12T00:03:54.721 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.721 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.721 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:54.721 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312253+0000", 2024-09-12T00:03:54.721 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1107000000000001e-05 2024-09-12T00:03:54.721 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.722 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.722 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:54.722 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312285+0000", 2024-09-12T00:03:54.722 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1210000000000001e-05 2024-09-12T00:03:54.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.722 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.722 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:54.722 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312303+0000", 2024-09-12T00:03:54.722 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8003e-05 2024-09-12T00:03:54.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.722 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.722 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:54.722 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312422+0000", 2024-09-12T00:03:54.722 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000119426 2024-09-12T00:03:54.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.723 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:54.723 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.312640+0000", 2024-09-12T00:03:54.723 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021851100000000001 2024-09-12T00:03:54.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.723 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:03:54.723 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.313115+0000", 2024-09-12T00:03:54.723 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000474146 2024-09-12T00:03:54.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.723 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:54.723 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.315280+0000", 2024-09-12T00:03:54.724 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0021658889999999998 2024-09-12T00:03:54.724 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.724 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.724 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:54.724 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.316889+0000", 2024-09-12T00:03:54.724 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0016087759999999999 2024-09-12T00:03:54.724 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.724 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.724 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:54.724 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.316980+0000", 2024-09-12T00:03:54.724 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0575999999999995e-05 2024-09-12T00:03:54.724 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:54.724 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:54.724 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:54.725 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.317046+0000", 2024-09-12T00:03:54.725 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6105999999999994e-05 2024-09-12T00:03:54.725 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.725 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:54.725 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.725 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:54.725 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:54.725 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:54.726 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:03:54.727 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:54.725+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:54.827 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:54.825+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:54.896 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:54.896 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:03:54.896 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:03:54.896 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:54.910 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:03:54.928 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:54.925+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:55.029 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:55.025+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:55.035 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:55.035 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:03:55.035 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:03:55.035 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:03:55.035 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:55.049 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:03:55.130 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:55.129+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:55.173 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:55.173 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:03:55.173 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:03:55.174 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:03:55.174 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.174 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:03:55.174 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:03:55.174 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 23.687109633999999, 2024-09-12T00:03:55.174 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0032495720000000001, 2024-09-12T00:03:55.174 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:55.174 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:55.174 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.174 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:55.174 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:55.174 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.174 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 193 2024-09-12T00:03:55.174 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.175 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:55.175 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.175 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:55.175 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:03:55.175 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.175 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.175 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.175 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:55.175 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:03:55.175 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.175 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.175 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.175 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:55.176 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486926+0000", 2024-09-12T00:03:55.176 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.463e-06 2024-09-12T00:03:55.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.176 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.176 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:55.176 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486937+0000", 2024-09-12T00:03:55.176 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1147e-05 2024-09-12T00:03:55.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.176 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.176 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:55.176 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486968+0000", 2024-09-12T00:03:55.176 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1077000000000001e-05 2024-09-12T00:03:55.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.176 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.177 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.177 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486985+0000", 2024-09-12T00:03:55.177 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6399e-05 2024-09-12T00:03:55.177 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.177 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.177 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:55.177 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487139+0000", 2024-09-12T00:03:55.177 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015403199999999999 2024-09-12T00:03:55.177 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.178 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.178 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:55.178 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487375+0000", 2024-09-12T00:03:55.178 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023621499999999999 2024-09-12T00:03:55.178 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.178 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.178 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:55.178 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487634+0000", 2024-09-12T00:03:55.178 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000259351 2024-09-12T00:03:55.178 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.178 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.178 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:55.178 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.489156+0000", 2024-09-12T00:03:55.179 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015213869999999999 2024-09-12T00:03:55.179 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.179 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.179 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.179 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.489974+0000", 2024-09-12T00:03:55.179 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00081855600000000001 2024-09-12T00:03:55.179 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.179 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.179 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:55.179 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.490064+0000", 2024-09-12T00:03:55.179 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9205999999999999e-05 2024-09-12T00:03:55.179 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.180 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.180 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:55.180 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.490173+0000", 2024-09-12T00:03:55.180 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109739 2024-09-12T00:03:55.180 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.180 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:55.180 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.180 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.180 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.181 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:03:55.181 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:03:55.181 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.810670090999999, 2024-09-12T00:03:55.181 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039523630000000004, 2024-09-12T00:03:55.181 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:55.181 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:55.181 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.181 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:55.181 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:55.181 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.181 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 208 2024-09-12T00:03:55.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.182 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:55.182 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.182 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:55.182 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:03:55.182 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.182 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.182 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:55.182 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:03:55.182 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.183 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.183 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:55.183 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363366+0000", 2024-09-12T00:03:55.183 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.004e-06 2024-09-12T00:03:55.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.183 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.183 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:55.183 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363379+0000", 2024-09-12T00:03:55.183 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2943e-05 2024-09-12T00:03:55.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.183 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.183 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:55.184 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363412+0000", 2024-09-12T00:03:55.184 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2808999999999997e-05 2024-09-12T00:03:55.184 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.184 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.184 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.184 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363430+0000", 2024-09-12T00:03:55.184 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8003e-05 2024-09-12T00:03:55.184 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.184 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.184 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:55.184 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363654+0000", 2024-09-12T00:03:55.185 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022394900000000001 2024-09-12T00:03:55.185 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.185 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.185 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:55.185 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363897+0000", 2024-09-12T00:03:55.185 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024272399999999999 2024-09-12T00:03:55.185 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.185 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.185 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:55.185 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.364326+0000", 2024-09-12T00:03:55.185 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042963399999999997 2024-09-12T00:03:55.185 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.186 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.186 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:55.186 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.365757+0000", 2024-09-12T00:03:55.186 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014303969999999999 2024-09-12T00:03:55.186 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.186 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.186 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.186 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367031+0000", 2024-09-12T00:03:55.186 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001274269 2024-09-12T00:03:55.187 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.187 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.187 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:55.187 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367197+0000", 2024-09-12T00:03:55.187 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016645900000000001 2024-09-12T00:03:55.187 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.187 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.187 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:55.188 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367316+0000", 2024-09-12T00:03:55.188 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011817200000000001 2024-09-12T00:03:55.188 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.188 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:55.188 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.188 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.188 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.188 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.188 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:03:55.188 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.753411787000001, 2024-09-12T00:03:55.189 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033190419999999999, 2024-09-12T00:03:55.189 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:55.189 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:55.189 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.189 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:55.189 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:55.189 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.189 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 219 2024-09-12T00:03:55.189 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.189 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:55.189 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.190 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:55.190 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:03:55.190 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.190 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.190 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:55.190 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:03:55.190 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.190 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.190 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:55.191 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420624+0000", 2024-09-12T00:03:55.191 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0829999999999998e-06 2024-09-12T00:03:55.191 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.191 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.191 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:55.191 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420633+0000", 2024-09-12T00:03:55.191 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8500000000000006e-06 2024-09-12T00:03:55.191 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.191 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.191 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:55.191 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420663+0000", 2024-09-12T00:03:55.192 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9597000000000001e-05 2024-09-12T00:03:55.192 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.192 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.192 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.192 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420681+0000", 2024-09-12T00:03:55.192 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7646e-05 2024-09-12T00:03:55.192 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.192 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.192 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:55.192 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420791+0000", 2024-09-12T00:03:55.193 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109979 2024-09-12T00:03:55.193 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.193 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.193 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:55.193 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.421042+0000", 2024-09-12T00:03:55.193 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025117199999999997 2024-09-12T00:03:55.193 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.193 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.193 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:55.193 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.421487+0000", 2024-09-12T00:03:55.193 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00044476599999999998 2024-09-12T00:03:55.194 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.194 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.194 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:55.194 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.422884+0000", 2024-09-12T00:03:55.194 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0013975109999999999 2024-09-12T00:03:55.194 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.194 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.194 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.194 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423797+0000", 2024-09-12T00:03:55.194 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00091310899999999995 2024-09-12T00:03:55.194 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.195 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.195 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:55.195 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423879+0000", 2024-09-12T00:03:55.195 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1829000000000005e-05 2024-09-12T00:03:55.195 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.195 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.195 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:55.195 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423941+0000", 2024-09-12T00:03:55.195 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1500000000000004e-05 2024-09-12T00:03:55.195 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.195 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:55.196 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.196 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.196 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.196 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:03:55.196 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.735771188000001, 2024-09-12T00:03:55.196 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003232782, 2024-09-12T00:03:55.196 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:55.196 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:55.196 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.196 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:55.197 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:55.197 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.197 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 224 2024-09-12T00:03:55.197 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.197 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:55.197 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.197 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:55.197 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:03:55.197 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.197 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.197 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.197 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:55.198 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:03:55.198 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.198 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.198 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.198 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:55.198 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438265+0000", 2024-09-12T00:03:55.198 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.666e-06 2024-09-12T00:03:55.198 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.198 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.198 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:55.198 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438276+0000", 2024-09-12T00:03:55.199 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1387e-05 2024-09-12T00:03:55.199 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.199 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.199 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:55.199 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438306+0000", 2024-09-12T00:03:55.199 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0069999999999998e-05 2024-09-12T00:03:55.199 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.199 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.199 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.199 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438321+0000", 2024-09-12T00:03:55.199 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.517e-05 2024-09-12T00:03:55.199 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.200 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.200 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:55.200 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438459+0000", 2024-09-12T00:03:55.200 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013781899999999999 2024-09-12T00:03:55.200 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.200 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.200 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:55.200 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438671+0000", 2024-09-12T00:03:55.200 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021214500000000001 2024-09-12T00:03:55.200 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.200 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.201 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:55.201 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.439093+0000", 2024-09-12T00:03:55.201 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042117899999999999 2024-09-12T00:03:55.201 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.201 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.201 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:55.201 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.440400+0000", 2024-09-12T00:03:55.201 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0013072719999999999 2024-09-12T00:03:55.201 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.201 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.201 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.201 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441339+0000", 2024-09-12T00:03:55.202 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00093906600000000001 2024-09-12T00:03:55.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.202 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.202 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:55.202 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441429+0000", 2024-09-12T00:03:55.202 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0358999999999993e-05 2024-09-12T00:03:55.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.202 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.202 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:55.202 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441495+0000", 2024-09-12T00:03:55.202 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5648999999999994e-05 2024-09-12T00:03:55.202 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.203 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:55.203 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.203 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.203 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.203 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.203 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:03:55.203 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.696272216000001, 2024-09-12T00:03:55.203 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003225716, 2024-09-12T00:03:55.203 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:55.203 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:55.203 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.203 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:55.204 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:55.204 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.204 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 235 2024-09-12T00:03:55.204 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.204 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:55.204 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.204 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:55.204 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:03:55.204 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.204 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.204 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.205 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:55.205 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:03:55.205 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.205 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.205 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.205 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:55.205 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477764+0000", 2024-09-12T00:03:55.205 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.48e-06 2024-09-12T00:03:55.205 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.205 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.205 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:55.205 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477775+0000", 2024-09-12T00:03:55.206 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1163e-05 2024-09-12T00:03:55.206 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.206 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.206 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:55.206 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477807+0000", 2024-09-12T00:03:55.206 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1860000000000003e-05 2024-09-12T00:03:55.206 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.206 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.206 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.206 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477822+0000", 2024-09-12T00:03:55.206 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5302999999999999e-05 2024-09-12T00:03:55.206 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.207 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.207 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:55.207 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477959+0000", 2024-09-12T00:03:55.207 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013695600000000001 2024-09-12T00:03:55.207 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.207 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.207 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:55.207 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.478184+0000", 2024-09-12T00:03:55.207 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022484800000000001 2024-09-12T00:03:55.207 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.207 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.207 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:55.208 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.478657+0000", 2024-09-12T00:03:55.208 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000473413 2024-09-12T00:03:55.208 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.208 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.208 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:55.208 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480162+0000", 2024-09-12T00:03:55.208 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00150454 2024-09-12T00:03:55.208 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.208 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.208 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.208 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480792+0000", 2024-09-12T00:03:55.208 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00063012400000000003 2024-09-12T00:03:55.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.209 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.209 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:55.209 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480906+0000", 2024-09-12T00:03:55.209 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113909 2024-09-12T00:03:55.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.209 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.209 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:55.209 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480987+0000", 2024-09-12T00:03:55.209 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1119999999999996e-05 2024-09-12T00:03:55.209 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.210 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:55.210 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.210 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.210 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:237 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.210 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:03:55.210 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.688950845000001, 2024-09-12T00:03:55.210 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0074291790000000002, 2024-09-12T00:03:55.210 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:55.210 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:55.210 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.210 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:55.211 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:55.211 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.211 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 237 2024-09-12T00:03:55.211 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.211 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:55.211 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.211 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:55.211 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:03:55.211 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.211 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.211 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.211 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:55.212 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:03:55.212 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.212 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.212 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.212 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:55.212 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485086+0000", 2024-09-12T00:03:55.212 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.05e-06 2024-09-12T00:03:55.212 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.212 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.212 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:55.212 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485101+0000", 2024-09-12T00:03:55.213 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5186e-05 2024-09-12T00:03:55.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.213 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.213 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:55.213 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485140+0000", 2024-09-12T00:03:55.213 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8896000000000002e-05 2024-09-12T00:03:55.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.213 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.213 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.213 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485162+0000", 2024-09-12T00:03:55.213 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2654e-05 2024-09-12T00:03:55.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.214 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.214 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:55.214 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485314+0000", 2024-09-12T00:03:55.214 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015150799999999999 2024-09-12T00:03:55.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.214 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.214 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:55.214 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485549+0000", 2024-09-12T00:03:55.214 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000235665 2024-09-12T00:03:55.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.214 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.214 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:55.214 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486064+0000", 2024-09-12T00:03:55.215 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00051418899999999997 2024-09-12T00:03:55.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.215 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.215 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:55.215 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.488211+0000", 2024-09-12T00:03:55.215 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0021470819999999998 2024-09-12T00:03:55.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.215 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.215 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.215 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492273+0000", 2024-09-12T00:03:55.215 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040617980000000001 2024-09-12T00:03:55.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.216 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.216 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:55.216 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492391+0000", 2024-09-12T00:03:55.216 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118613 2024-09-12T00:03:55.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.216 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.216 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:55.216 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492512+0000", 2024-09-12T00:03:55.216 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120538 2024-09-12T00:03:55.216 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.216 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:55.217 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.217 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.217 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:244 6.17 e35/29 6:e9187ab8:reshard::reshard.0000000000:head v 35'1, mlcod=0'0)", 2024-09-12T00:03:55.217 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:03:55.217 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.686368609999999, 2024-09-12T00:03:55.217 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0034313239999999999, 2024-09-12T00:03:55.217 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:55.217 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:55.217 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.217 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:55.217 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.218 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:55.218 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:03:55.218 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.218 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.218 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.218 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:55.218 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:03:55.218 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.218 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.218 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.218 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:55.219 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487667+0000", 2024-09-12T00:03:55.219 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4899999999999999e-06 2024-09-12T00:03:55.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.219 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.219 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:55.219 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487682+0000", 2024-09-12T00:03:55.219 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4929999999999999e-05 2024-09-12T00:03:55.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.219 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.219 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:55.219 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487740+0000", 2024-09-12T00:03:55.220 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8075000000000002e-05 2024-09-12T00:03:55.220 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.220 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.220 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.220 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487761+0000", 2024-09-12T00:03:55.220 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0769999999999999e-05 2024-09-12T00:03:55.220 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.220 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.220 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:55.220 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487966+0000", 2024-09-12T00:03:55.220 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020516800000000001 2024-09-12T00:03:55.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.221 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.221 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:55.221 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.488012+0000", 2024-09-12T00:03:55.221 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5794000000000002e-05 2024-09-12T00:03:55.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.221 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.221 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:55.221 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.490965+0000", 2024-09-12T00:03:55.221 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0029530609999999999 2024-09-12T00:03:55.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.222 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.222 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:55.222 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491096+0000", 2024-09-12T00:03:55.222 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013103600000000001 2024-09-12T00:03:55.222 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.222 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:55.222 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.222 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.222 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:293 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.222 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:03:55.222 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.676416789000001, 2024-09-12T00:03:55.223 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0075915649999999998, 2024-09-12T00:03:55.223 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:55.223 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:55.223 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.223 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:55.223 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:55.223 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.223 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 293 2024-09-12T00:03:55.223 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.223 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:55.224 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.224 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:55.224 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:03:55.224 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.224 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.224 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:55.224 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:03:55.224 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.224 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.225 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:55.225 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497626+0000", 2024-09-12T00:03:55.225 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2499999999999995e-06 2024-09-12T00:03:55.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.225 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.225 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:55.225 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497636+0000", 2024-09-12T00:03:55.225 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0139999999999999e-05 2024-09-12T00:03:55.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.225 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.225 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:55.226 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497660+0000", 2024-09-12T00:03:55.226 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4015999999999998e-05 2024-09-12T00:03:55.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.226 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.226 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.226 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497675+0000", 2024-09-12T00:03:55.226 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5339999999999999e-05 2024-09-12T00:03:55.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.226 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.226 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:55.227 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497839+0000", 2024-09-12T00:03:55.227 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016347900000000001 2024-09-12T00:03:55.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.227 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.227 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:55.227 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498097+0000", 2024-09-12T00:03:55.227 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025825700000000002 2024-09-12T00:03:55.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.227 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.227 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:55.227 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498618+0000", 2024-09-12T00:03:55.228 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052051300000000001 2024-09-12T00:03:55.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.228 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.228 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:55.228 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.501282+0000", 2024-09-12T00:03:55.228 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026646840000000001 2024-09-12T00:03:55.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.228 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.228 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.228 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505057+0000", 2024-09-12T00:03:55.228 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037747710000000001 2024-09-12T00:03:55.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.229 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.229 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:55.229 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505144+0000", 2024-09-12T00:03:55.229 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7466000000000006e-05 2024-09-12T00:03:55.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.229 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.229 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:55.229 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505208+0000", 2024-09-12T00:03:55.229 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3649e-05 2024-09-12T00:03:55.229 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.229 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:55.230 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.230 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.230 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:413 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.230 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:03:55.230 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.645377177, 2024-09-12T00:03:55.230 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005252049, 2024-09-12T00:03:55.230 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:55.230 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:55.230 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.230 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:55.230 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:55.231 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.231 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 413 2024-09-12T00:03:55.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.231 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:55.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:55.231 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:03:55.231 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:55.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:03:55.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.232 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:55.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528659+0000", 2024-09-12T00:03:55.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4739999999999999e-06 2024-09-12T00:03:55.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.232 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:55.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528669+0000", 2024-09-12T00:03:55.233 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0694e-05 2024-09-12T00:03:55.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.233 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.233 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:55.233 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528696+0000", 2024-09-12T00:03:55.233 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6846e-05 2024-09-12T00:03:55.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.233 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.233 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.233 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528711+0000", 2024-09-12T00:03:55.233 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4397e-05 2024-09-12T00:03:55.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.234 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.234 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:55.234 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528884+0000", 2024-09-12T00:03:55.234 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017304700000000001 2024-09-12T00:03:55.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.234 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.234 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:55.234 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529162+0000", 2024-09-12T00:03:55.234 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027861999999999999 2024-09-12T00:03:55.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.234 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.235 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:55.235 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529688+0000", 2024-09-12T00:03:55.235 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052593900000000001 2024-09-12T00:03:55.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.235 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.235 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:55.235 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.531480+0000", 2024-09-12T00:03:55.235 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0017920740000000001 2024-09-12T00:03:55.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.235 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.235 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.235 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533734+0000", 2024-09-12T00:03:55.236 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002254191 2024-09-12T00:03:55.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.236 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.236 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:55.236 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533845+0000", 2024-09-12T00:03:55.236 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110559 2024-09-12T00:03:55.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.236 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.236 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:55.236 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533908+0000", 2024-09-12T00:03:55.236 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3207999999999995e-05 2024-09-12T00:03:55.237 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.237 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:55.237 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.237 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.237 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:437 6.0 6:05588ce8:lc::lc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.237 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:03:55.237 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.638201687999999, 2024-09-12T00:03:55.237 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039419659999999999, 2024-09-12T00:03:55.237 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:55.237 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:55.237 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.238 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:55.238 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:55.238 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.238 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 437 2024-09-12T00:03:55.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.238 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:55.238 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.238 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:55.238 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:03:55.238 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.239 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:55.239 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:03:55.239 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.239 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:55.239 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535834+0000", 2024-09-12T00:03:55.239 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2859999999999998e-06 2024-09-12T00:03:55.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.240 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:55.240 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535846+0000", 2024-09-12T00:03:55.240 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1643e-05 2024-09-12T00:03:55.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.240 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.240 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:55.240 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535877+0000", 2024-09-12T00:03:55.240 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1457000000000001e-05 2024-09-12T00:03:55.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.240 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.240 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.240 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535894+0000", 2024-09-12T00:03:55.241 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.668e-05 2024-09-12T00:03:55.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.241 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.241 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:55.241 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535981+0000", 2024-09-12T00:03:55.241 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6823000000000005e-05 2024-09-12T00:03:55.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.241 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.241 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:55.241 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536086+0000", 2024-09-12T00:03:55.242 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010566200000000001 2024-09-12T00:03:55.242 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.242 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.242 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:55.242 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536330+0000", 2024-09-12T00:03:55.242 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024399999999999999 2024-09-12T00:03:55.242 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.242 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.242 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:55.242 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538288+0000", 2024-09-12T00:03:55.242 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0019575740000000001 2024-09-12T00:03:55.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.243 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.243 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.243 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539574+0000", 2024-09-12T00:03:55.243 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012862259999999999 2024-09-12T00:03:55.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.243 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.243 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:55.243 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539696+0000", 2024-09-12T00:03:55.243 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012190599999999999 2024-09-12T00:03:55.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.243 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.244 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:55.244 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539774+0000", 2024-09-12T00:03:55.244 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7708999999999997e-05 2024-09-12T00:03:55.244 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.244 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:55.244 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.244 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.244 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:464 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.244 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:03:55.244 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.629640706, 2024-09-12T00:03:55.244 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048192310000000002, 2024-09-12T00:03:55.245 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:55.245 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:55.245 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.245 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:55.245 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:55.245 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.245 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 464 2024-09-12T00:03:55.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.245 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:55.245 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.245 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:55.246 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:03:55.246 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.246 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.246 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.246 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:55.246 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:03:55.246 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.246 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.246 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.246 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:55.247 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544395+0000", 2024-09-12T00:03:55.247 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.905e-06 2024-09-12T00:03:55.247 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.247 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.247 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:55.247 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544405+0000", 2024-09-12T00:03:55.247 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0583e-05 2024-09-12T00:03:55.247 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.247 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.247 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:55.247 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544435+0000", 2024-09-12T00:03:55.248 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9431e-05 2024-09-12T00:03:55.248 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.248 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.248 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.248 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544468+0000", 2024-09-12T00:03:55.248 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2978999999999997e-05 2024-09-12T00:03:55.248 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.248 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.248 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:55.248 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544573+0000", 2024-09-12T00:03:55.248 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105165 2024-09-12T00:03:55.249 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.249 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.249 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:55.249 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544714+0000", 2024-09-12T00:03:55.249 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000141061 2024-09-12T00:03:55.249 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.249 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.249 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:55.249 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.545414+0000", 2024-09-12T00:03:55.249 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00070066200000000001 2024-09-12T00:03:55.249 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.249 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.250 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:55.250 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.547475+0000", 2024-09-12T00:03:55.250 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020609119999999998 2024-09-12T00:03:55.250 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.250 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.250 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.250 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549067+0000", 2024-09-12T00:03:55.250 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015914989999999999 2024-09-12T00:03:55.250 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.250 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.250 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:55.251 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549143+0000", 2024-09-12T00:03:55.251 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5795000000000002e-05 2024-09-12T00:03:55.251 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.251 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.251 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:55.251 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549212+0000", 2024-09-12T00:03:55.251 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9239000000000006e-05 2024-09-12T00:03:55.251 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.251 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:55.251 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.251 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.252 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.252 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:495 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.252 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:03:55.252 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.618571207999999, 2024-09-12T00:03:55.252 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052520209999999999, 2024-09-12T00:03:55.252 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:55.252 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:55.252 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.252 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:55.252 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:55.252 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.252 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 495 2024-09-12T00:03:55.253 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.253 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:55.253 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.253 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:55.253 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:03:55.253 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.253 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.253 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.253 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:55.253 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:03:55.253 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.254 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.254 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:55.254 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555464+0000", 2024-09-12T00:03:55.254 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8870000000000001e-06 2024-09-12T00:03:55.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.254 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.254 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:55.254 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555473+0000", 2024-09-12T00:03:55.254 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2399999999999996e-06 2024-09-12T00:03:55.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.255 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.255 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:55.255 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555496+0000", 2024-09-12T00:03:55.255 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2952e-05 2024-09-12T00:03:55.255 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.255 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.255 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.255 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555508+0000", 2024-09-12T00:03:55.255 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1548e-05 2024-09-12T00:03:55.255 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.255 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.255 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:55.256 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555596+0000", 2024-09-12T00:03:55.256 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8295999999999996e-05 2024-09-12T00:03:55.256 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.256 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.256 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:55.256 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555683+0000", 2024-09-12T00:03:55.256 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7267000000000003e-05 2024-09-12T00:03:55.256 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.256 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.256 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:55.256 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555862+0000", 2024-09-12T00:03:55.256 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017910699999999999 2024-09-12T00:03:55.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.257 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.257 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:55.257 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.556696+0000", 2024-09-12T00:03:55.257 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000833353 2024-09-12T00:03:55.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.257 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.257 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.257 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560563+0000", 2024-09-12T00:03:55.257 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038672089999999999 2024-09-12T00:03:55.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.258 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.258 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:55.258 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560642+0000", 2024-09-12T00:03:55.258 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.8909e-05 2024-09-12T00:03:55.258 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.258 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.258 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:55.258 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560714+0000", 2024-09-12T00:03:55.258 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2253000000000001e-05 2024-09-12T00:03:55.258 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.258 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:55.259 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.259 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.259 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.259 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:631 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.259 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:03:55.259 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.582743654000001, 2024-09-12T00:03:55.259 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0072389480000000003, 2024-09-12T00:03:55.259 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:55.259 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:55.259 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.259 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:55.259 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:55.260 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.260 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 631 2024-09-12T00:03:55.260 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.260 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:55.260 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.260 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:55.260 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:03:55.260 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.260 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.260 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.260 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:55.261 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:03:55.261 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.261 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.264 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.264 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:55.264 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591292+0000", 2024-09-12T00:03:55.264 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0760000000000001e-06 2024-09-12T00:03:55.265 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.265 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.265 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:55.265 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591301+0000", 2024-09-12T00:03:55.265 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3880000000000006e-06 2024-09-12T00:03:55.265 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.265 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.265 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:55.265 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591323+0000", 2024-09-12T00:03:55.265 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2121999999999999e-05 2024-09-12T00:03:55.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.266 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.266 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.266 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591338+0000", 2024-09-12T00:03:55.266 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5126999999999999e-05 2024-09-12T00:03:55.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.266 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.266 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:55.266 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591449+0000", 2024-09-12T00:03:55.266 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011054500000000001 2024-09-12T00:03:55.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.266 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.267 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:55.267 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591682+0000", 2024-09-12T00:03:55.267 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023258 2024-09-12T00:03:55.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.267 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.267 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:55.267 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.592011+0000", 2024-09-12T00:03:55.267 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00032941699999999998 2024-09-12T00:03:55.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.267 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.267 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:55.267 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593493+0000", 2024-09-12T00:03:55.268 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014821599999999999 2024-09-12T00:03:55.268 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.268 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.268 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.268 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598356+0000", 2024-09-12T00:03:55.268 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048625329999999996 2024-09-12T00:03:55.268 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.268 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.268 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:55.268 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598456+0000", 2024-09-12T00:03:55.268 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9878999999999997e-05 2024-09-12T00:03:55.269 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.269 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.269 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:55.269 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598529+0000", 2024-09-12T00:03:55.269 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3120999999999993e-05 2024-09-12T00:03:55.269 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.269 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:55.269 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.269 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.269 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.269 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:650 6.4 6:26625e58:lc::lc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.270 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:03:55.270 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.57434611, 2024-09-12T00:03:55.270 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042727010000000003, 2024-09-12T00:03:55.270 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:55.270 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:55.270 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.270 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:55.270 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:55.270 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.270 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 650 2024-09-12T00:03:55.270 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.270 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:55.271 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.271 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:55.271 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:03:55.271 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.271 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.271 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:55.271 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:03:55.271 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.271 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.271 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:55.272 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599689+0000", 2024-09-12T00:03:55.272 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3179999999999999e-06 2024-09-12T00:03:55.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.272 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.272 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:55.272 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599696+0000", 2024-09-12T00:03:55.272 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9580000000000001e-06 2024-09-12T00:03:55.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.272 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.272 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:55.272 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599714+0000", 2024-09-12T00:03:55.272 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8099999999999999e-05 2024-09-12T00:03:55.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.273 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.273 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.273 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599724+0000", 2024-09-12T00:03:55.273 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0492999999999999e-05 2024-09-12T00:03:55.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.273 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.273 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:55.273 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599799+0000", 2024-09-12T00:03:55.273 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5228999999999994e-05 2024-09-12T00:03:55.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.273 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.274 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:55.274 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599897+0000", 2024-09-12T00:03:55.274 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7476e-05 2024-09-12T00:03:55.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.274 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.274 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:55.274 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.600047+0000", 2024-09-12T00:03:55.274 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015028 2024-09-12T00:03:55.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.274 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.274 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:55.274 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.602604+0000", 2024-09-12T00:03:55.275 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0025571729999999998 2024-09-12T00:03:55.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.275 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.275 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.275 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603880+0000", 2024-09-12T00:03:55.275 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012753700000000001 2024-09-12T00:03:55.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.275 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.275 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:55.275 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603923+0000", 2024-09-12T00:03:55.275 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3758999999999999e-05 2024-09-12T00:03:55.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.275 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.276 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:55.276 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603960+0000", 2024-09-12T00:03:55.276 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6545000000000003e-05 2024-09-12T00:03:55.276 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.276 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:55.276 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.276 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.276 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:744 6.0 6:0651570b:lc::lc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.276 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:03:55.276 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.540054682000001, 2024-09-12T00:03:55.277 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048046149999999999, 2024-09-12T00:03:55.277 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:55.277 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:55.277 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.277 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:55.277 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:55.277 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.277 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 744 2024-09-12T00:03:55.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.277 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:55.277 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.277 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:55.278 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:03:55.278 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.278 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.278 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:55.278 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:03:55.278 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.278 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.278 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:55.278 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633981+0000", 2024-09-12T00:03:55.278 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3740000000000001e-06 2024-09-12T00:03:55.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.279 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.279 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:55.279 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633991+0000", 2024-09-12T00:03:55.279 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7839999999999998e-06 2024-09-12T00:03:55.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.279 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.279 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:55.279 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634016+0000", 2024-09-12T00:03:55.279 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5075999999999998e-05 2024-09-12T00:03:55.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.279 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.280 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.280 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634031+0000", 2024-09-12T00:03:55.280 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5124e-05 2024-09-12T00:03:55.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.280 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.280 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:55.280 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634105+0000", 2024-09-12T00:03:55.280 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3595000000000003e-05 2024-09-12T00:03:55.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.280 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.280 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:55.281 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634183+0000", 2024-09-12T00:03:55.281 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7936999999999996e-05 2024-09-12T00:03:55.281 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.281 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.281 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:55.281 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634342+0000", 2024-09-12T00:03:55.281 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015910499999999999 2024-09-12T00:03:55.281 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.281 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.281 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:55.281 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.635262+0000", 2024-09-12T00:03:55.281 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00092051000000000003 2024-09-12T00:03:55.282 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.282 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.282 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.282 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638638+0000", 2024-09-12T00:03:55.282 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033756419999999999 2024-09-12T00:03:55.282 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.282 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.282 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:55.282 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638722+0000", 2024-09-12T00:03:55.282 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.4029000000000005e-05 2024-09-12T00:03:55.282 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.282 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.283 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:55.283 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638783+0000", 2024-09-12T00:03:55.283 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1439000000000006e-05 2024-09-12T00:03:55.283 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.283 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:55.283 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.283 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.283 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:875 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.283 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:03:55.283 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.490415251000002, 2024-09-12T00:03:55.283 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004522295, 2024-09-12T00:03:55.284 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:55.284 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:55.284 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.284 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:55.284 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:55.284 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.284 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 875 2024-09-12T00:03:55.284 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.284 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:55.284 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.284 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:55.285 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:03:55.285 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.285 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.285 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:55.285 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:03:55.285 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.285 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.285 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:55.285 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683623+0000", 2024-09-12T00:03:55.285 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7140000000000001e-06 2024-09-12T00:03:55.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.286 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.286 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:55.286 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683639+0000", 2024-09-12T00:03:55.286 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6203000000000001e-05 2024-09-12T00:03:55.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.286 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.286 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:55.286 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683677+0000", 2024-09-12T00:03:55.286 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8470999999999998e-05 2024-09-12T00:03:55.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.286 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.287 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.287 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683708+0000", 2024-09-12T00:03:55.287 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0793999999999997e-05 2024-09-12T00:03:55.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.287 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.287 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:55.287 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683827+0000", 2024-09-12T00:03:55.287 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011832699999999999 2024-09-12T00:03:55.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.287 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.287 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:55.287 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683945+0000", 2024-09-12T00:03:55.288 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118301 2024-09-12T00:03:55.288 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.288 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.288 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:55.288 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.684226+0000", 2024-09-12T00:03:55.288 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000280604 2024-09-12T00:03:55.288 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.288 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.288 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.288 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685790+0000", 2024-09-12T00:03:55.288 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001564651 2024-09-12T00:03:55.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.289 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:55.289 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688028+0000", 2024-09-12T00:03:55.289 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0022381129999999999 2024-09-12T00:03:55.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.289 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:55.289 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688093+0000", 2024-09-12T00:03:55.289 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4329e-05 2024-09-12T00:03:55.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.290 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:55.290 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688140+0000", 2024-09-12T00:03:55.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7787999999999997e-05 2024-09-12T00:03:55.290 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.290 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:55.290 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.290 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.290 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:878 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.290 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:03:55.290 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.488771121999999, 2024-09-12T00:03:55.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037933009999999998, 2024-09-12T00:03:55.291 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:55.291 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:55.291 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.291 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:55.291 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:55.291 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.291 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 878 2024-09-12T00:03:55.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.291 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:55.291 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.291 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:55.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:03:55.292 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.292 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.292 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:55.292 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:03:55.292 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.292 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.292 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:55.292 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685265+0000", 2024-09-12T00:03:55.292 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.525e-06 2024-09-12T00:03:55.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.293 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.293 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:55.293 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685276+0000", 2024-09-12T00:03:55.293 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.076e-05 2024-09-12T00:03:55.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.293 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.293 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:55.293 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685306+0000", 2024-09-12T00:03:55.293 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0803000000000003e-05 2024-09-12T00:03:55.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.293 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.293 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.294 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685327+0000", 2024-09-12T00:03:55.294 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1061e-05 2024-09-12T00:03:55.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.294 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.294 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:55.294 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685429+0000", 2024-09-12T00:03:55.294 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000102015 2024-09-12T00:03:55.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.294 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.294 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:55.294 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685580+0000", 2024-09-12T00:03:55.294 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000151096 2024-09-12T00:03:55.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.295 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.295 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:55.295 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685861+0000", 2024-09-12T00:03:55.295 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028068100000000002 2024-09-12T00:03:55.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.295 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.295 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.295 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688647+0000", 2024-09-12T00:03:55.295 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0027860979999999999 2024-09-12T00:03:55.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.295 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:55.296 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688909+0000", 2024-09-12T00:03:55.296 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026159600000000001 2024-09-12T00:03:55.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:55.296 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688991+0000", 2024-09-12T00:03:55.296 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2429999999999995e-05 2024-09-12T00:03:55.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:55.296 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689056+0000", 2024-09-12T00:03:55.297 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4236e-05 2024-09-12T00:03:55.297 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.297 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:55.297 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.297 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.297 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:881 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.297 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:03:55.297 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.488136939, 2024-09-12T00:03:55.297 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003307979, 2024-09-12T00:03:55.297 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:55.297 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:55.298 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.298 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:55.298 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:55.298 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.298 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 881 2024-09-12T00:03:55.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.298 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:55.298 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.298 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:55.298 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:03:55.298 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:55.299 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:03:55.299 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:55.299 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685898+0000", 2024-09-12T00:03:55.299 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4249999999999999e-06 2024-09-12T00:03:55.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:55.299 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685904+0000", 2024-09-12T00:03:55.300 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1290000000000001e-06 2024-09-12T00:03:55.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.300 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.300 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:55.300 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685917+0000", 2024-09-12T00:03:55.300 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2825e-05 2024-09-12T00:03:55.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.300 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.300 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.300 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685925+0000", 2024-09-12T00:03:55.300 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6589999999999996e-06 2024-09-12T00:03:55.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.301 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:55.301 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686156+0000", 2024-09-12T00:03:55.301 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023017299999999999 2024-09-12T00:03:55.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.301 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:55.301 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686365+0000", 2024-09-12T00:03:55.301 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000209442 2024-09-12T00:03:55.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.301 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:55.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686567+0000", 2024-09-12T00:03:55.302 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020237400000000001 2024-09-12T00:03:55.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.302 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:55.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689076+0000", 2024-09-12T00:03:55.302 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002508957 2024-09-12T00:03:55.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.302 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689121+0000", 2024-09-12T00:03:55.302 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4561999999999998e-05 2024-09-12T00:03:55.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:55.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689168+0000", 2024-09-12T00:03:55.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7000999999999999e-05 2024-09-12T00:03:55.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:55.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689204+0000", 2024-09-12T00:03:55.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6431999999999999e-05 2024-09-12T00:03:55.303 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.304 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:55.304 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.304 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.304 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:894 6.0 6:05588ce8:lc::lc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.304 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:03:55.304 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.483780973000002, 2024-09-12T00:03:55.304 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040691010000000003, 2024-09-12T00:03:55.304 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:55.304 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:55.304 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.304 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:55.305 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:55.305 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.305 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 894 2024-09-12T00:03:55.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.305 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:55.305 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.305 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:55.305 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:03:55.305 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.305 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.305 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:55.306 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:03:55.306 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.306 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:55.306 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690253+0000", 2024-09-12T00:03:55.306 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.026e-06 2024-09-12T00:03:55.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.306 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:55.306 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690259+0000", 2024-09-12T00:03:55.306 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7389999999999996e-06 2024-09-12T00:03:55.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.307 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.307 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:55.307 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690273+0000", 2024-09-12T00:03:55.307 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3749e-05 2024-09-12T00:03:55.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.307 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.307 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.307 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690282+0000", 2024-09-12T00:03:55.307 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2520000000000005e-06 2024-09-12T00:03:55.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.307 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.308 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:55.308 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690704+0000", 2024-09-12T00:03:55.308 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042222199999999998 2024-09-12T00:03:55.308 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.308 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.308 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:55.308 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690826+0000", 2024-09-12T00:03:55.308 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012141099999999999 2024-09-12T00:03:55.308 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.308 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.308 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:55.308 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.691094+0000", 2024-09-12T00:03:55.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000268344 2024-09-12T00:03:55.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.309 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.309 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:55.309 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.693007+0000", 2024-09-12T00:03:55.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001912495 2024-09-12T00:03:55.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.309 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.309 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.309 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694184+0000", 2024-09-12T00:03:55.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00117786 2024-09-12T00:03:55.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.310 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.310 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:55.310 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694259+0000", 2024-09-12T00:03:55.310 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4091000000000006e-05 2024-09-12T00:03:55.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.310 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.310 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:55.310 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694321+0000", 2024-09-12T00:03:55.310 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2911999999999997e-05 2024-09-12T00:03:55.310 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.310 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:55.311 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.311 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1283 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.311 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:03:55.311 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.984462437000001, 2024-09-12T00:03:55.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00320967, 2024-09-12T00:03:55.311 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:55.311 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:55.311 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.311 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:55.311 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:55.312 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.312 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1283 2024-09-12T00:03:55.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.312 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:55.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:55.312 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:03:55.312 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:55.312 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:03:55.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:55.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.313 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:55.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189573+0000", 2024-09-12T00:03:55.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3130000000000001e-06 2024-09-12T00:03:55.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.313 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:55.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189583+0000", 2024-09-12T00:03:55.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4129999999999995e-06 2024-09-12T00:03:55.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.314 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:55.314 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189608+0000", 2024-09-12T00:03:55.314 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5863e-05 2024-09-12T00:03:55.314 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.314 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.314 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.314 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189628+0000", 2024-09-12T00:03:55.314 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9644e-05 2024-09-12T00:03:55.314 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.314 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.314 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:55.314 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189747+0000", 2024-09-12T00:03:55.314 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118999 2024-09-12T00:03:55.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.315 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.315 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:55.315 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189874+0000", 2024-09-12T00:03:55.315 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012674499999999999 2024-09-12T00:03:55.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.315 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.315 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:03:55.315 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.190148+0000", 2024-09-12T00:03:55.315 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000274431 2024-09-12T00:03:55.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.316 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.316 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:55.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.191174+0000", 2024-09-12T00:03:55.316 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001025855 2024-09-12T00:03:55.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.316 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.316 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192627+0000", 2024-09-12T00:03:55.316 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014527979999999999 2024-09-12T00:03:55.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.316 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.317 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:55.317 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192710+0000", 2024-09-12T00:03:55.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3146000000000007e-05 2024-09-12T00:03:55.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:55.317 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:55.317 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:55.317 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192781+0000", 2024-09-12T00:03:55.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.0463000000000006e-05 2024-09-12T00:03:55.317 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.317 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:55.317 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.318 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:55.318 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:55.318 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:55.319 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:03:55.320 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:03:55.317+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:03:55.421 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:55.424+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:03:55.456 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:03:55.457 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:03:55.457 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:03:55.457 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:03:55.471 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:03:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T00:03:55.522 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:55.521+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:55.595 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:03:55.595 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:03:55.596 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:03:55.596 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:03:55.596 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:03:55.610 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:03:55.622 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:55.624+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:03:55.723 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:03:55.724+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:03:55.730 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:03:55.730 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:03:55.730 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:03:55.730 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:03:55.730 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.730 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:03:55.730 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:03:55.730 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 24.399611520000001, 2024-09-12T00:03:55.730 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.027441031000000001, 2024-09-12T00:03:55.731 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:55.731 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:55.731 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.731 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:55.731 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:55.731 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.731 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:03:55.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.731 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:55.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:55.732 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:03:55.732 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:55.733 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:03:55.733 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.733 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:55.733 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330357+0000", 2024-09-12T00:03:55.733 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2339999999999996e-06 2024-09-12T00:03:55.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.734 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:55.734 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330381+0000", 2024-09-12T00:03:55.734 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4626000000000001e-05 2024-09-12T00:03:55.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.734 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.734 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:55.734 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330417+0000", 2024-09-12T00:03:55.734 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5886000000000002e-05 2024-09-12T00:03:55.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330442+0000", 2024-09-12T00:03:55.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4522999999999999e-05 2024-09-12T00:03:55.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.736 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335485+0000", 2024-09-12T00:03:55.736 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050432589999999996 2024-09-12T00:03:55.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.736 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:03:55.736 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335507+0000", 2024-09-12T00:03:55.736 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2013000000000001e-05 2024-09-12T00:03:55.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.737 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.737 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.351747+0000", 2024-09-12T00:03:55.737 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016240451999999999 2024-09-12T00:03:55.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.737 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:55.737 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352062+0000", 2024-09-12T00:03:55.737 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031433399999999999 2024-09-12T00:03:55.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.737 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:03:55.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352378+0000", 2024-09-12T00:03:55.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031586400000000001 2024-09-12T00:03:55.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.738 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:55.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.355074+0000", 2024-09-12T00:03:55.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026962919999999999 2024-09-12T00:03:55.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.738 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357537+0000", 2024-09-12T00:03:55.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024634689999999998 2024-09-12T00:03:55.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.739 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:55.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357680+0000", 2024-09-12T00:03:55.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014314899999999999 2024-09-12T00:03:55.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.739 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:55.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357793+0000", 2024-09-12T00:03:55.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011293 2024-09-12T00:03:55.739 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.739 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:55.739 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.739 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94232250902656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:03:55.740 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:03:55.740 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 24.371696360000001, 2024-09-12T00:03:55.740 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052696050000000001, 2024-09-12T00:03:55.740 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:55.740 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:55.740 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.740 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:55.740 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:55.740 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.740 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:03:55.740 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.740 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:55.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:55.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:03:55.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:55.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:03:55.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:55.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358270+0000", 2024-09-12T00:03:55.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.17e-06 2024-09-12T00:03:55.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:55.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358278+0000", 2024-09-12T00:03:55.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3529999999999995e-06 2024-09-12T00:03:55.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:55.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358306+0000", 2024-09-12T00:03:55.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7763000000000002e-05 2024-09-12T00:03:55.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358324+0000", 2024-09-12T00:03:55.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7861000000000001e-05 2024-09-12T00:03:55.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.743 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.743 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358447+0000", 2024-09-12T00:03:55.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012334299999999999 2024-09-12T00:03:55.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.743 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:55.743 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358624+0000", 2024-09-12T00:03:55.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017684999999999999 2024-09-12T00:03:55.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.744 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:03:55.744 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358964+0000", 2024-09-12T00:03:55.744 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00033991199999999999 2024-09-12T00:03:55.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.744 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.744 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.362920+0000", 2024-09-12T00:03:55.744 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039564600000000002 2024-09-12T00:03:55.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.744 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:55.745 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363016+0000", 2024-09-12T00:03:55.745 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5612999999999994e-05 2024-09-12T00:03:55.745 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.745 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.745 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:55.745 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363244+0000", 2024-09-12T00:03:55.745 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000228385 2024-09-12T00:03:55.745 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.745 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.745 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:55.745 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363537+0000", 2024-09-12T00:03:55.745 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00029289499999999999 2024-09-12T00:03:55.745 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.745 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:55.746 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.746 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.746 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.746 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:03:55.746 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 21.364318843, 2024-09-12T00:03:55.746 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011415537, 2024-09-12T00:03:55.746 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:55.747 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:55.747 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.747 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:55.747 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:55.747 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.747 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 209 2024-09-12T00:03:55.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.747 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:55.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:55.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:03:55.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:55.748 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:03:55.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:55.748 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365648+0000", 2024-09-12T00:03:55.749 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7360000000000001e-06 2024-09-12T00:03:55.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.749 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.749 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:55.749 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365660+0000", 2024-09-12T00:03:55.749 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2089999999999999e-05 2024-09-12T00:03:55.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.750 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:55.750 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365690+0000", 2024-09-12T00:03:55.750 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0320000000000001e-05 2024-09-12T00:03:55.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.750 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.751 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365708+0000", 2024-09-12T00:03:55.751 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7520000000000002e-05 2024-09-12T00:03:55.751 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.751 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.752 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.752 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365870+0000", 2024-09-12T00:03:55.752 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016208600000000001 2024-09-12T00:03:55.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.752 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:03:55.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365885+0000", 2024-09-12T00:03:55.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5119999999999999e-05 2024-09-12T00:03:55.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373482+0000", 2024-09-12T00:03:55.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075970279999999996 2024-09-12T00:03:55.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.754 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:55.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373805+0000", 2024-09-12T00:03:55.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032262799999999999 2024-09-12T00:03:55.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.755 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.755 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:55.755 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.374297+0000", 2024-09-12T00:03:55.755 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00049250599999999998 2024-09-12T00:03:55.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.755 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.755 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:55.755 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.375670+0000", 2024-09-12T00:03:55.755 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001373333 2024-09-12T00:03:55.756 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.756 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.756 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.756 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.376923+0000", 2024-09-12T00:03:55.756 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012525640000000001 2024-09-12T00:03:55.756 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.757 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.757 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:55.757 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377000+0000", 2024-09-12T00:03:55.757 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6732999999999999e-05 2024-09-12T00:03:55.757 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.757 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.757 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:55.757 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377061+0000", 2024-09-12T00:03:55.757 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0872999999999998e-05 2024-09-12T00:03:55.758 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.758 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:55.758 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.758 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.758 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:240 6.19 6:9f626c48:lc::lc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.758 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:03:55.758 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 21.245733090000002, 2024-09-12T00:03:55.758 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058545680000000001, 2024-09-12T00:03:55.758 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:55.758 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:55.758 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.758 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 240 2024-09-12T00:03:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:03:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:55.759 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:03:55.760 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.760 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.760 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.760 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:55.760 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484233+0000", 2024-09-12T00:03:55.760 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.973e-06 2024-09-12T00:03:55.760 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.761 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.761 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:55.761 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484241+0000", 2024-09-12T00:03:55.761 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8210000000000002e-06 2024-09-12T00:03:55.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.761 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.761 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:55.761 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484260+0000", 2024-09-12T00:03:55.761 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9148999999999999e-05 2024-09-12T00:03:55.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.761 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.761 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.762 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484268+0000", 2024-09-12T00:03:55.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5120000000000008e-06 2024-09-12T00:03:55.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.762 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.762 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.762 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484371+0000", 2024-09-12T00:03:55.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102501 2024-09-12T00:03:55.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.762 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.762 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:55.763 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484450+0000", 2024-09-12T00:03:55.763 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9122999999999994e-05 2024-09-12T00:03:55.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.763 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:55.763 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484578+0000", 2024-09-12T00:03:55.763 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000128095 2024-09-12T00:03:55.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.763 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:55.763 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.485336+0000", 2024-09-12T00:03:55.763 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00075754000000000001 2024-09-12T00:03:55.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.489975+0000", 2024-09-12T00:03:55.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004639738 2024-09-12T00:03:55.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.764 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:55.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490043+0000", 2024-09-12T00:03:55.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7923999999999995e-05 2024-09-12T00:03:55.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.764 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:55.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490085+0000", 2024-09-12T00:03:55.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2191999999999999e-05 2024-09-12T00:03:55.765 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.765 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:55.765 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.765 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:412 6.3 6:c3a682d4:reshard::reshard.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.765 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:03:55.765 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 21.203337684000001, 2024-09-12T00:03:55.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049075530000000003, 2024-09-12T00:03:55.765 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:55.766 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:55.766 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.766 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:55.766 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:55.766 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.766 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 412 2024-09-12T00:03:55.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.766 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:55.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.766 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:55.766 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:03:55.767 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.767 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:55.767 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:03:55.767 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:55.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526628+0000", 2024-09-12T00:03:55.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.513e-06 2024-09-12T00:03:55.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:55.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526634+0000", 2024-09-12T00:03:55.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1279999999999996e-06 2024-09-12T00:03:55.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.769 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:55.769 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526649+0000", 2024-09-12T00:03:55.769 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4997999999999999e-05 2024-09-12T00:03:55.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.769 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.769 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.769 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526658+0000", 2024-09-12T00:03:55.769 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1589999999999999e-06 2024-09-12T00:03:55.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.769 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.769 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.770 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526728+0000", 2024-09-12T00:03:55.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0203999999999994e-05 2024-09-12T00:03:55.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:55.770 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526839+0000", 2024-09-12T00:03:55.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011055 2024-09-12T00:03:55.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.771 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:55.771 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526979+0000", 2024-09-12T00:03:55.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139863 2024-09-12T00:03:55.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.771 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:55.771 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.527616+0000", 2024-09-12T00:03:55.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00063707900000000003 2024-09-12T00:03:55.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.772 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.772 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531450+0000", 2024-09-12T00:03:55.772 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003833819 2024-09-12T00:03:55.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.772 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.772 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:55.772 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531490+0000", 2024-09-12T00:03:55.772 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0129000000000002e-05 2024-09-12T00:03:55.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.772 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.772 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:55.772 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531534+0000", 2024-09-12T00:03:55.772 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4110999999999998e-05 2024-09-12T00:03:55.773 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.773 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:55.773 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.774 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:490 6.19 6:9dc32cef:lc::lc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.774 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:03:55.774 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 21.179140310000001, 2024-09-12T00:03:55.774 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047438380000000002, 2024-09-12T00:03:55.774 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:55.774 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:55.774 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.775 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:55.775 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:55.775 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.775 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 490 2024-09-12T00:03:55.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.775 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:55.775 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.775 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:55.775 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:03:55.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.775 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.775 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:55.775 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:03:55.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:55.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550825+0000", 2024-09-12T00:03:55.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0589999999999999e-06 2024-09-12T00:03:55.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:55.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550830+0000", 2024-09-12T00:03:55.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2140000000000004e-06 2024-09-12T00:03:55.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:55.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550843+0000", 2024-09-12T00:03:55.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3404000000000001e-05 2024-09-12T00:03:55.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550852+0000", 2024-09-12T00:03:55.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1549999999999996e-06 2024-09-12T00:03:55.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550910+0000", 2024-09-12T00:03:55.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7636000000000002e-05 2024-09-12T00:03:55.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.778 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:55.778 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550977+0000", 2024-09-12T00:03:55.778 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6636000000000004e-05 2024-09-12T00:03:55.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.778 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:55.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.551135+0000", 2024-09-12T00:03:55.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015852999999999999 2024-09-12T00:03:55.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552939+0000", 2024-09-12T00:03:55.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001803643 2024-09-12T00:03:55.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:55.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555471+0000", 2024-09-12T00:03:55.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002532327 2024-09-12T00:03:55.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:55.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555526+0000", 2024-09-12T00:03:55.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4728000000000002e-05 2024-09-12T00:03:55.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.781 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:55.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555567+0000", 2024-09-12T00:03:55.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1505999999999999e-05 2024-09-12T00:03:55.781 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.781 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:55.782 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.782 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:492 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'6, mlcod=35'4)", 2024-09-12T00:03:55.782 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:03:55.782 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 21.177364246, 2024-09-12T00:03:55.782 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056118790000000002, 2024-09-12T00:03:55.782 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:55.782 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:55.782 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.782 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:55.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:55.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:03:55.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:55.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:03:55.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:55.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552601+0000", 2024-09-12T00:03:55.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6899999999999996e-07 2024-09-12T00:03:55.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:55.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552608+0000", 2024-09-12T00:03:55.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4529999999999996e-06 2024-09-12T00:03:55.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:55.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552624+0000", 2024-09-12T00:03:55.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5885000000000001e-05 2024-09-12T00:03:55.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552632+0000", 2024-09-12T00:03:55.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2220000000000002e-06 2024-09-12T00:03:55.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552716+0000", 2024-09-12T00:03:55.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4060999999999994e-05 2024-09-12T00:03:55.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:55.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552735+0000", 2024-09-12T00:03:55.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9170000000000001e-05 2024-09-12T00:03:55.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.786 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:55.786 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558164+0000", 2024-09-12T00:03:55.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054289899999999999 2024-09-12T00:03:55.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.786 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:55.786 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558212+0000", 2024-09-12T00:03:55.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7129000000000002e-05 2024-09-12T00:03:55.786 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.786 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:55.786 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.787 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.787 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:496 6.3 6:c134263f:lc::lc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.787 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:03:55.787 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 21.176256958, 2024-09-12T00:03:55.787 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045956260000000002, 2024-09-12T00:03:55.787 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:55.787 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:55.787 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.787 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:55.787 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:55.787 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.787 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 496 2024-09-12T00:03:55.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.788 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:55.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.788 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:55.788 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:03:55.788 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.788 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:55.789 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:03:55.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:55.789 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553708+0000", 2024-09-12T00:03:55.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2359999999999999e-06 2024-09-12T00:03:55.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:55.789 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553714+0000", 2024-09-12T00:03:55.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4960000000000004e-06 2024-09-12T00:03:55.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:55.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553726+0000", 2024-09-12T00:03:55.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2618e-05 2024-09-12T00:03:55.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553734+0000", 2024-09-12T00:03:55.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4159999999999998e-06 2024-09-12T00:03:55.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553771+0000", 2024-09-12T00:03:55.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7095999999999999e-05 2024-09-12T00:03:55.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:55.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553815+0000", 2024-09-12T00:03:55.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3986999999999997e-05 2024-09-12T00:03:55.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:55.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553922+0000", 2024-09-12T00:03:55.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000107534 2024-09-12T00:03:55.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555052+0000", 2024-09-12T00:03:55.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011298359999999999 2024-09-12T00:03:55.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:55.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558197+0000", 2024-09-12T00:03:55.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0031450269999999999 2024-09-12T00:03:55.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.793 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:55.793 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558256+0000", 2024-09-12T00:03:55.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8403999999999999e-05 2024-09-12T00:03:55.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.793 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.793 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:55.793 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558303+0000", 2024-09-12T00:03:55.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6975999999999999e-05 2024-09-12T00:03:55.793 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.793 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:55.793 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.794 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:641 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.794 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:03:55.794 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 21.136186631000001, 2024-09-12T00:03:55.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052824789999999996, 2024-09-12T00:03:55.794 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:55.794 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:55.794 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.794 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:55.794 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:55.794 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.794 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 641 2024-09-12T00:03:55.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.794 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:55.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:55.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:03:55.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:55.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:03:55.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:55.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593778+0000", 2024-09-12T00:03:55.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0920000000000001e-06 2024-09-12T00:03:55.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:55.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593783+0000", 2024-09-12T00:03:55.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9490000000000004e-06 2024-09-12T00:03:55.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:55.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593795+0000", 2024-09-12T00:03:55.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2048999999999999e-05 2024-09-12T00:03:55.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593801+0000", 2024-09-12T00:03:55.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8989999999999998e-06 2024-09-12T00:03:55.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593852+0000", 2024-09-12T00:03:55.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1057999999999998e-05 2024-09-12T00:03:55.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:55.798 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593905+0000", 2024-09-12T00:03:55.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2196e-05 2024-09-12T00:03:55.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:03:55.798 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594017+0000", 2024-09-12T00:03:55.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000112816 2024-09-12T00:03:55.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.799 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.595190+0000", 2024-09-12T00:03:55.799 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011727199999999999 2024-09-12T00:03:55.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.799 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:55.799 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.598998+0000", 2024-09-12T00:03:55.799 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038081320000000001 2024-09-12T00:03:55.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:55.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599032+0000", 2024-09-12T00:03:55.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4283999999999999e-05 2024-09-12T00:03:55.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:55.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599060+0000", 2024-09-12T00:03:55.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7284000000000002e-05 2024-09-12T00:03:55.800 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.800 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:55.800 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.800 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:643 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'8, mlcod=35'6)", 2024-09-12T00:03:55.801 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:03:55.801 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 21.135688523999999, 2024-09-12T00:03:55.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048211260000000002, 2024-09-12T00:03:55.801 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:55.801 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:55.801 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.801 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:55.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:55.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:03:55.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:55.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:03:55.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:55.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594276+0000", 2024-09-12T00:03:55.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5899999999999995e-07 2024-09-12T00:03:55.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.803 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:55.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594283+0000", 2024-09-12T00:03:55.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6019999999999996e-06 2024-09-12T00:03:55.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.803 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:55.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594295+0000", 2024-09-12T00:03:55.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1683e-05 2024-09-12T00:03:55.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594303+0000", 2024-09-12T00:03:55.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0439999999999996e-06 2024-09-12T00:03:55.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594353+0000", 2024-09-12T00:03:55.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0698000000000001e-05 2024-09-12T00:03:55.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:55.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594380+0000", 2024-09-12T00:03:55.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7089000000000001e-05 2024-09-12T00:03:55.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.805 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.805 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:55.805 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599063+0000", 2024-09-12T00:03:55.805 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046824739999999998 2024-09-12T00:03:55.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.805 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.805 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:55.805 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599096+0000", 2024-09-12T00:03:55.805 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3677000000000003e-05 2024-09-12T00:03:55.805 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.805 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:55.805 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.806 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:647 6.a 6:5395e6f3:lc::lc.4:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.806 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:03:55.806 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 21.133337891, 2024-09-12T00:03:55.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049071770000000004, 2024-09-12T00:03:55.806 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:55.806 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:55.806 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.806 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:55.806 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:55.806 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.806 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 647 2024-09-12T00:03:55.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.806 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:55.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:55.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:03:55.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:55.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:03:55.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:55.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596627+0000", 2024-09-12T00:03:55.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1149999999999999e-06 2024-09-12T00:03:55.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:55.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596632+0000", 2024-09-12T00:03:55.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7060000000000003e-06 2024-09-12T00:03:55.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:55.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596645+0000", 2024-09-12T00:03:55.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2791e-05 2024-09-12T00:03:55.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.809 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596653+0000", 2024-09-12T00:03:55.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9230000000000002e-06 2024-09-12T00:03:55.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.809 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.809 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.809 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596705+0000", 2024-09-12T00:03:55.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2250000000000003e-05 2024-09-12T00:03:55.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.809 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.809 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:55.810 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596758+0000", 2024-09-12T00:03:55.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2964000000000003e-05 2024-09-12T00:03:55.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.810 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:55.810 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596873+0000", 2024-09-12T00:03:55.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011501 2024-09-12T00:03:55.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.810 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.810 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599088+0000", 2024-09-12T00:03:55.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002215135 2024-09-12T00:03:55.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.811 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:55.811 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601456+0000", 2024-09-12T00:03:55.811 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023684719999999999 2024-09-12T00:03:55.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.811 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:55.811 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601507+0000", 2024-09-12T00:03:55.811 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0933999999999997e-05 2024-09-12T00:03:55.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:55.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601533+0000", 2024-09-12T00:03:55.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5877e-05 2024-09-12T00:03:55.812 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.812 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:55.812 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.812 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:657 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'10, mlcod=35'7)", 2024-09-12T00:03:55.813 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:03:55.813 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 21.129514351000001, 2024-09-12T00:03:55.813 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066410239999999997, 2024-09-12T00:03:55.813 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:55.813 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:55.813 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.813 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:55.813 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.813 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:55.813 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:03:55.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:55.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:03:55.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:55.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:03:55.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6099999999999999e-07 2024-09-12T00:03:55.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:55.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600457+0000", 2024-09-12T00:03:55.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8700000000000003e-06 2024-09-12T00:03:55.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:55.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600470+0000", 2024-09-12T00:03:55.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3186999999999999e-05 2024-09-12T00:03:55.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600478+0000", 2024-09-12T00:03:55.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5310000000000004e-06 2024-09-12T00:03:55.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.816 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.816 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.816 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600521+0000", 2024-09-12T00:03:55.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2574000000000003e-05 2024-09-12T00:03:55.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.816 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.816 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:55.816 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600535+0000", 2024-09-12T00:03:55.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4151000000000001e-05 2024-09-12T00:03:55.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.816 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.817 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:55.817 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.606997+0000", 2024-09-12T00:03:55.817 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064626099999999997 2024-09-12T00:03:55.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.817 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.817 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:55.817 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607091+0000", 2024-09-12T00:03:55.817 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3239999999999995e-05 2024-09-12T00:03:55.817 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.817 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:55.817 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.817 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.817 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:659 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.818 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:03:55.818 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 21.129342018999999, 2024-09-12T00:03:55.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0065340989999999998, 2024-09-12T00:03:55.818 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:55.818 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:55.818 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.818 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:55.818 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:55.818 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.818 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 659 2024-09-12T00:03:55.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.818 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:55.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.819 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:55.819 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:03:55.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.819 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:55.819 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:03:55.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.819 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:55.819 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600623+0000", 2024-09-12T00:03:55.820 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.085e-06 2024-09-12T00:03:55.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:55.820 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600630+0000", 2024-09-12T00:03:55.820 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0029999999999997e-06 2024-09-12T00:03:55.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:55.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600647+0000", 2024-09-12T00:03:55.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6566999999999999e-05 2024-09-12T00:03:55.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600658+0000", 2024-09-12T00:03:55.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0992000000000001e-05 2024-09-12T00:03:55.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.822 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600717+0000", 2024-09-12T00:03:55.822 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9925e-05 2024-09-12T00:03:55.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.822 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:55.822 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600773+0000", 2024-09-12T00:03:55.822 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5766000000000001e-05 2024-09-12T00:03:55.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:03:55.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600889+0000", 2024-09-12T00:03:55.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115906 2024-09-12T00:03:55.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603483+0000", 2024-09-12T00:03:55.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025940799999999999 2024-09-12T00:03:55.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:55.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607098+0000", 2024-09-12T00:03:55.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036150459999999998 2024-09-12T00:03:55.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.824 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:55.824 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607133+0000", 2024-09-12T00:03:55.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4615e-05 2024-09-12T00:03:55.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.824 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:55.824 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607156+0000", 2024-09-12T00:03:55.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3113999999999999e-05 2024-09-12T00:03:55.824 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.824 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:55.824 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.825 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.825 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:666 6.a 6:5395e6f3:lc::lc.4:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.825 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:03:55.825 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 21.127594890000001, 2024-09-12T00:03:55.825 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.005127174, 2024-09-12T00:03:55.825 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:55.825 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:55.825 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.825 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:55.825 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:55.825 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.825 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 666 2024-09-12T00:03:55.825 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.826 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:55.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:55.826 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:03:55.826 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:55.826 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:03:55.826 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:55.826 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602370+0000", 2024-09-12T00:03:55.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0720000000000001e-06 2024-09-12T00:03:55.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:55.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602376+0000", 2024-09-12T00:03:55.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5489999999999997e-06 2024-09-12T00:03:55.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:55.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602391+0000", 2024-09-12T00:03:55.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5301000000000001e-05 2024-09-12T00:03:55.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602399+0000", 2024-09-12T00:03:55.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9179999999999994e-06 2024-09-12T00:03:55.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602456+0000", 2024-09-12T00:03:55.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7099999999999999e-05 2024-09-12T00:03:55.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:55.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602508+0000", 2024-09-12T00:03:55.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2476999999999999e-05 2024-09-12T00:03:55.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:55.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602606+0000", 2024-09-12T00:03:55.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7823000000000002e-05 2024-09-12T00:03:55.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.604653+0000", 2024-09-12T00:03:55.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002047068 2024-09-12T00:03:55.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:55.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607401+0000", 2024-09-12T00:03:55.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027477700000000001 2024-09-12T00:03:55.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:55.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607453+0000", 2024-09-12T00:03:55.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2092999999999997e-05 2024-09-12T00:03:55.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:55.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607496+0000", 2024-09-12T00:03:55.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3003000000000001e-05 2024-09-12T00:03:55.831 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.831 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:55.831 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.831 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:665 6.1a e35/29 6:5c7e8a6d:reshard::reshard.0000000015:head v 35'11, mlcod=35'8)", 2024-09-12T00:03:55.831 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:03:55.831 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 21.127223205, 2024-09-12T00:03:55.832 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048593209999999998, 2024-09-12T00:03:55.832 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:55.832 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:55.832 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.832 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:55.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.832 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:55.832 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:03:55.832 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:55.833 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:03:55.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:55.833 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602742+0000", 2024-09-12T00:03:55.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1069999999999999e-06 2024-09-12T00:03:55.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:55.833 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602749+0000", 2024-09-12T00:03:55.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9609999999999999e-06 2024-09-12T00:03:55.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:55.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602763+0000", 2024-09-12T00:03:55.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4086e-05 2024-09-12T00:03:55.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602772+0000", 2024-09-12T00:03:55.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8470000000000002e-06 2024-09-12T00:03:55.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602826+0000", 2024-09-12T00:03:55.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3885000000000003e-05 2024-09-12T00:03:55.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:55.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602837+0000", 2024-09-12T00:03:55.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1601e-05 2024-09-12T00:03:55.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:55.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607500+0000", 2024-09-12T00:03:55.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046627509999999997 2024-09-12T00:03:55.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.836 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:55.836 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607600+0000", 2024-09-12T00:03:55.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100083 2024-09-12T00:03:55.836 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.836 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:55.836 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.836 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:831 6.19 6:9d23f22c:lc::lc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.836 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:03:55.836 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 21.063938525000001, 2024-09-12T00:03:55.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047044610000000001, 2024-09-12T00:03:55.836 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:55.837 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:55.837 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.837 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:55.837 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:55.837 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.837 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 831 2024-09-12T00:03:55.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.837 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:55.837 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.837 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:55.837 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:03:55.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:55.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:03:55.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:55.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666026+0000", 2024-09-12T00:03:55.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.02e-06 2024-09-12T00:03:55.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:55.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666032+0000", 2024-09-12T00:03:55.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8850000000000004e-06 2024-09-12T00:03:55.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:55.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666047+0000", 2024-09-12T00:03:55.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4647999999999999e-05 2024-09-12T00:03:55.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666058+0000", 2024-09-12T00:03:55.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0905e-05 2024-09-12T00:03:55.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666376+0000", 2024-09-12T00:03:55.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031824899999999999 2024-09-12T00:03:55.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:55.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666479+0000", 2024-09-12T00:03:55.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102814 2024-09-12T00:03:55.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:55.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666635+0000", 2024-09-12T00:03:55.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000156343 2024-09-12T00:03:55.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.841 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:55.841 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.667611+0000", 2024-09-12T00:03:55.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000975671 2024-09-12T00:03:55.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.841 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.841 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.841 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670662+0000", 2024-09-12T00:03:55.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003050863 2024-09-12T00:03:55.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.841 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:55.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670701+0000", 2024-09-12T00:03:55.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9338000000000002e-05 2024-09-12T00:03:55.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:55.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670730+0000", 2024-09-12T00:03:55.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8725e-05 2024-09-12T00:03:55.842 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.842 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:55.842 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:852 6.1d e35/29 6:bbf2d10c:::obj_delete_at_hint.0000000025:head v 35'9, mlcod=35'7)", 2024-09-12T00:03:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:03:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 21.055361472000001, 2024-09-12T00:03:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00569595, 2024-09-12T00:03:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:55.844 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:03:55.844 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.844 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.844 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:55.844 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:03:55.844 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.844 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.844 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:55.845 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674604+0000", 2024-09-12T00:03:55.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2079999999999999e-06 2024-09-12T00:03:55.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.845 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.845 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:55.845 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674611+0000", 2024-09-12T00:03:55.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.973e-06 2024-09-12T00:03:55.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.845 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.845 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:55.845 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674625+0000", 2024-09-12T00:03:55.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3916e-05 2024-09-12T00:03:55.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.846 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.846 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.846 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674633+0000", 2024-09-12T00:03:55.846 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8580000000000006e-06 2024-09-12T00:03:55.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.846 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.846 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.846 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674697+0000", 2024-09-12T00:03:55.846 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4004999999999995e-05 2024-09-12T00:03:55.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.847 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.847 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:55.847 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674713+0000", 2024-09-12T00:03:55.847 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5835e-05 2024-09-12T00:03:55.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.847 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.847 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:55.847 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680245+0000", 2024-09-12T00:03:55.847 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055320250000000003 2024-09-12T00:03:55.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.847 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.847 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:55.847 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680298+0000", 2024-09-12T00:03:55.847 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3130000000000001e-05 2024-09-12T00:03:55.848 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.848 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:55.848 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.848 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.848 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:925 6.1a e35/29 6:5f2e3d26:lc::lc.18:head v 35'15, mlcod=35'12)", 2024-09-12T00:03:55.848 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:03:55.848 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 21.031833641999999, 2024-09-12T00:03:55.848 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055640999999999998, 2024-09-12T00:03:55.848 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:55.849 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:55.849 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.849 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:55.849 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.849 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:55.849 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:03:55.849 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.849 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.849 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.850 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:55.850 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:03:55.850 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.850 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.850 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.850 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:55.850 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698131+0000", 2024-09-12T00:03:55.850 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:03:55.850 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.850 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.850 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:55.850 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698140+0000", 2024-09-12T00:03:55.850 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3139999999999993e-06 2024-09-12T00:03:55.850 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.851 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.851 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:55.851 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698155+0000", 2024-09-12T00:03:55.851 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:03:55.851 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.851 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.851 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.851 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698164+0000", 2024-09-12T00:03:55.851 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1419999999999999e-06 2024-09-12T00:03:55.852 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.852 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.852 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.852 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698228+0000", 2024-09-12T00:03:55.852 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3380000000000006e-05 2024-09-12T00:03:55.852 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.852 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.852 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:55.852 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698252+0000", 2024-09-12T00:03:55.853 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4111e-05 2024-09-12T00:03:55.853 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.853 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.853 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:55.853 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703646+0000", 2024-09-12T00:03:55.853 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0053937840000000004 2024-09-12T00:03:55.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.854 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.854 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:55.854 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703694+0000", 2024-09-12T00:03:55.854 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8776999999999997e-05 2024-09-12T00:03:55.854 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.854 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:55.854 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.855 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.855 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.855 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:927 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.855 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:03:55.855 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 21.031314618, 2024-09-12T00:03:55.855 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050914949999999997, 2024-09-12T00:03:55.855 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:55.855 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:55.855 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:55.855 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:55.855 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:55.856 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.856 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 927 2024-09-12T00:03:55.856 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.856 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:55.856 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.856 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:55.856 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:03:55.856 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.856 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.856 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.856 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:55.857 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:03:55.857 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.857 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.857 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.857 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:55.857 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698651+0000", 2024-09-12T00:03:55.857 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3740000000000001e-06 2024-09-12T00:03:55.857 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.857 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.857 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:55.857 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698657+0000", 2024-09-12T00:03:55.857 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5239999999999997e-06 2024-09-12T00:03:55.857 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.858 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:55.858 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698673+0000", 2024-09-12T00:03:55.858 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5345999999999998e-05 2024-09-12T00:03:55.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.858 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.858 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698680+0000", 2024-09-12T00:03:55.858 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4649999999999997e-06 2024-09-12T00:03:55.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.858 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.858 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699009+0000", 2024-09-12T00:03:55.858 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032934000000000001 2024-09-12T00:03:55.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.859 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:55.859 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699213+0000", 2024-09-12T00:03:55.859 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020361500000000001 2024-09-12T00:03:55.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.859 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:55.859 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699450+0000", 2024-09-12T00:03:55.859 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023670399999999999 2024-09-12T00:03:55.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.859 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:55.860 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.700678+0000", 2024-09-12T00:03:55.860 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012285519999999999 2024-09-12T00:03:55.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.860 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.860 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:55.860 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703666+0000", 2024-09-12T00:03:55.860 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029876130000000001 2024-09-12T00:03:55.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.861 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.861 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:55.861 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703708+0000", 2024-09-12T00:03:55.861 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2361999999999999e-05 2024-09-12T00:03:55.861 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.861 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.861 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:55.861 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703741+0000", 2024-09-12T00:03:55.861 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.26e-05 2024-09-12T00:03:55.861 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.862 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:55.862 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.862 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.862 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.862 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:941 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:55.862 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:03:55.862 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 21.025821165, 2024-09-12T00:03:55.862 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0051476960000000002, 2024-09-12T00:03:55.862 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:55.862 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:55.863 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "started", 2024-09-12T00:03:55.863 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:55.863 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:03:55.863 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:55.863 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 941 2024-09-12T00:03:55.863 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.863 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:55.863 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.863 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:55.863 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:03:55.863 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.863 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.863 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.863 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:55.864 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:03:55.864 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:55.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.864 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.864 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:55.864 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704144+0000", 2024-09-12T00:03:55.864 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.514e-06 2024-09-12T00:03:55.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.864 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.864 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:55.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704152+0000", 2024-09-12T00:03:55.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2830000000000004e-06 2024-09-12T00:03:55.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:55.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704168+0000", 2024-09-12T00:03:55.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6835999999999999e-05 2024-09-12T00:03:55.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:55.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704178+0000", 2024-09-12T00:03:55.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7569999999999999e-06 2024-09-12T00:03:55.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:55.866 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704240+0000", 2024-09-12T00:03:55.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2193000000000006e-05 2024-09-12T00:03:55.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:55.866 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704308+0000", 2024-09-12T00:03:55.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7840000000000001e-05 2024-09-12T00:03:55.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:55.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:55.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:55.866 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.709290+0000", 2024-09-12T00:03:55.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049822729999999997 2024-09-12T00:03:55.866 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.867 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:55.867 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.867 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:55.867 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:55.867 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:03:55.869 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:03:55.869 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:55.865+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:55.969 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:55.969+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:56.039 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:03:56.039 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:03:56.040 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:03:56.040 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:03:56.054 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:03:56.098 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:56.097+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:56.171 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:56.169+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:56.218 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:03:56.219 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:03:56.219 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:03:56.219 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:03:56.219 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:03:56.232 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:03:56.273 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:56.273+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:56.372 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:56.369+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:56.395 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:03:56.395 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:03:56.395 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:03:56.395 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:03:56.395 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.395 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:03:56.396 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:03:56.396 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.897748558000004, 2024-09-12T00:03:56.396 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.278479906, 2024-09-12T00:03:56.396 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:56.396 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:56.396 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:56.396 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:56.396 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:03:56.396 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:03:56.396 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:03:56.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.396 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:56.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.397 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:56.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:03:56.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.397 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:56.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:03:56.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.397 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:56.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493422+0000", 2024-09-12T00:03:56.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.807e-06 2024-09-12T00:03:56.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.398 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:56.398 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493435+0000", 2024-09-12T00:03:56.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.375e-05 2024-09-12T00:03:56.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.398 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:56.398 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493457+0000", 2024-09-12T00:03:56.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2166000000000001e-05 2024-09-12T00:03:56.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.398 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:56.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493475+0000", 2024-09-12T00:03:56.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7184e-05 2024-09-12T00:03:56.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:56.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493617+0000", 2024-09-12T00:03:56.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014274200000000001 2024-09-12T00:03:56.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:03:56.400 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493632+0000", 2024-09-12T00:03:56.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4293e-05 2024-09-12T00:03:56.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.400 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:56.400 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.768657+0000", 2024-09-12T00:03:56.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.27502575400000001 2024-09-12T00:03:56.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.400 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:56.400 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769042+0000", 2024-09-12T00:03:56.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00038463700000000001 2024-09-12T00:03:56.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.401 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:56.401 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769430+0000", 2024-09-12T00:03:56.401 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000388014 2024-09-12T00:03:56.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.401 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:56.401 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.770784+0000", 2024-09-12T00:03:56.401 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00135402 2024-09-12T00:03:56.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.401 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:56.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771735+0000", 2024-09-12T00:03:56.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00095068599999999996 2024-09-12T00:03:56.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.402 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:56.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771828+0000", 2024-09-12T00:03:56.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3468999999999996e-05 2024-09-12T00:03:56.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.402 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:56.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771899+0000", 2024-09-12T00:03:56.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0383999999999996e-05 2024-09-12T00:03:56.403 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.403 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:56.403 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.403 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:03:56.403 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:03:56.403 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.469524802000002, 2024-09-12T00:03:56.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013402304, 2024-09-12T00:03:56.404 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:56.404 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:56.404 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:56.404 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:56.404 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:03:56.404 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:03:56.404 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 44 2024-09-12T00:03:56.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.404 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:56.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:56.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:03:56.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:56.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:03:56.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:56.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:03:56.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7100000000000001e-07 2024-09-12T00:03:56.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.406 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:56.406 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921706+0000", 2024-09-12T00:03:56.406 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2374999999999998e-05 2024-09-12T00:03:56.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.406 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:56.406 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921726+0000", 2024-09-12T00:03:56.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0373999999999998e-05 2024-09-12T00:03:56.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:56.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921733+0000", 2024-09-12T00:03:56.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8929999999999999e-06 2024-09-12T00:03:56.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:56.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927137+0000", 2024-09-12T00:03:56.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054037410000000001 2024-09-12T00:03:56.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.408 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:56.408 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927274+0000", 2024-09-12T00:03:56.408 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013697899999999999 2024-09-12T00:03:56.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.408 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:56.408 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927504+0000", 2024-09-12T00:03:56.408 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023005399999999999 2024-09-12T00:03:56.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.408 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:56.408 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.931848+0000", 2024-09-12T00:03:56.408 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0043445269999999999 2024-09-12T00:03:56.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:56.409 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934770+0000", 2024-09-12T00:03:56.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002922319 2024-09-12T00:03:56.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:56.409 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934901+0000", 2024-09-12T00:03:56.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013034599999999999 2024-09-12T00:03:56.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:56.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935045+0000", 2024-09-12T00:03:56.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014402499999999999 2024-09-12T00:03:56.410 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.410 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:56.410 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.410 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:03:56.411 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:03:56.411 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.469421836999999, 2024-09-12T00:03:56.411 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013456684999999999, 2024-09-12T00:03:56.411 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:56.411 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:56.411 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:56.411 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:56.411 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:03:56.412 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:03:56.412 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 45 2024-09-12T00:03:56.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.412 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:56.412 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.412 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:56.412 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:03:56.412 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.412 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:56.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:03:56.413 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.413 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:56.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921746+0000", 2024-09-12T00:03:56.413 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9800000000000003e-07 2024-09-12T00:03:56.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.413 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.414 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:56.414 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921751+0000", 2024-09-12T00:03:56.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7099999999999998e-06 2024-09-12T00:03:56.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.414 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:56.414 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921766+0000", 2024-09-12T00:03:56.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5633000000000001e-05 2024-09-12T00:03:56.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.414 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:56.414 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921786+0000", 2024-09-12T00:03:56.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9658000000000001e-05 2024-09-12T00:03:56.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:56.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929539+0000", 2024-09-12T00:03:56.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0077533120000000001 2024-09-12T00:03:56.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:56.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929706+0000", 2024-09-12T00:03:56.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016664199999999999 2024-09-12T00:03:56.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:56.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929933+0000", 2024-09-12T00:03:56.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000226658 2024-09-12T00:03:56.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:56.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934721+0000", 2024-09-12T00:03:56.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047886439999999999 2024-09-12T00:03:56.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:56.417 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935062+0000", 2024-09-12T00:03:56.417 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00034072399999999999 2024-09-12T00:03:56.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.417 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:56.417 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935141+0000", 2024-09-12T00:03:56.417 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8570000000000002e-05 2024-09-12T00:03:56.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.417 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:56.417 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935202+0000", 2024-09-12T00:03:56.417 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1536000000000002e-05 2024-09-12T00:03:56.418 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.418 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:56.418 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.418 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.418 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:03:56.418 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:03:56.418 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.469371604999999, 2024-09-12T00:03:56.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014633617, 2024-09-12T00:03:56.418 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:56.418 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:56.418 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:56.418 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:56.419 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:03:56.419 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:03:56.419 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:03:56.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.419 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:56.419 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.419 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:56.419 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:03:56.419 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.419 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.419 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:56.420 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:03:56.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.420 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.420 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:56.420 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:03:56.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3599999999999999e-07 2024-09-12T00:03:56.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.420 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.420 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:56.420 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921800+0000", 2024-09-12T00:03:56.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3850000000000002e-06 2024-09-12T00:03:56.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:56.421 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921805+0000", 2024-09-12T00:03:56.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9460000000000003e-06 2024-09-12T00:03:56.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:56.421 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921819+0000", 2024-09-12T00:03:56.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.325e-05 2024-09-12T00:03:56.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:56.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930627+0000", 2024-09-12T00:03:56.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00880827 2024-09-12T00:03:56.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:56.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930805+0000", 2024-09-12T00:03:56.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000177992 2024-09-12T00:03:56.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:56.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.931028+0000", 2024-09-12T00:03:56.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000223122 2024-09-12T00:03:56.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:56.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935258+0000", 2024-09-12T00:03:56.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0042302709999999999 2024-09-12T00:03:56.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:56.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936282+0000", 2024-09-12T00:03:56.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00102345 2024-09-12T00:03:56.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:56.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936367+0000", 2024-09-12T00:03:56.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4869000000000003e-05 2024-09-12T00:03:56.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:56.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936429+0000", 2024-09-12T00:03:56.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2626000000000007e-05 2024-09-12T00:03:56.424 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.424 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:56.424 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.425 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:03:56.425 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:03:56.425 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.469335354999998, 2024-09-12T00:03:56.425 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016022492999999999, 2024-09-12T00:03:56.425 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:56.425 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:56.425 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:56.425 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:56.425 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:03:56.426 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:03:56.426 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:03:56.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.426 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:56.426 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.426 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:56.426 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:03:56.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.426 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:56.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:03:56.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:56.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:03:56.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4000000000000002e-07 2024-09-12T00:03:56.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:56.428 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921891+0000", 2024-09-12T00:03:56.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8298000000000003e-05 2024-09-12T00:03:56.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.428 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:56.428 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921899+0000", 2024-09-12T00:03:56.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7059999999999993e-06 2024-09-12T00:03:56.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.428 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:56.428 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921904+0000", 2024-09-12T00:03:56.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9799999999999998e-06 2024-09-12T00:03:56.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.429 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:56.429 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932144+0000", 2024-09-12T00:03:56.429 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010239817999999999 2024-09-12T00:03:56.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.429 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:56.429 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932284+0000", 2024-09-12T00:03:56.429 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139436 2024-09-12T00:03:56.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.429 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:56.430 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932498+0000", 2024-09-12T00:03:56.430 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000214408 2024-09-12T00:03:56.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.430 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:56.430 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936444+0000", 2024-09-12T00:03:56.430 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039464169999999998 2024-09-12T00:03:56.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.430 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:56.430 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937702+0000", 2024-09-12T00:03:56.430 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012571679999999999 2024-09-12T00:03:56.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.431 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:56.431 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937793+0000", 2024-09-12T00:03:56.431 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1489000000000004e-05 2024-09-12T00:03:56.431 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.431 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.431 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:56.431 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937854+0000", 2024-09-12T00:03:56.431 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1333000000000004e-05 2024-09-12T00:03:56.431 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.431 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:56.432 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.432 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.432 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.432 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:03:56.432 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:03:56.432 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.469253487000003, 2024-09-12T00:03:56.432 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017189138999999999, 2024-09-12T00:03:56.432 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:56.432 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:56.432 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:56.433 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:56.433 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:03:56.433 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:03:56.433 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 48 2024-09-12T00:03:56.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.433 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:56.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:56.433 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:03:56.433 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.434 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:56.434 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:03:56.434 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.434 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:56.434 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:03:56.434 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7399999999999998e-07 2024-09-12T00:03:56.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.434 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:56.434 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921918+0000", 2024-09-12T00:03:56.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6399999999999999e-06 2024-09-12T00:03:56.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.435 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:56.435 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921925+0000", 2024-09-12T00:03:56.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7190000000000004e-06 2024-09-12T00:03:56.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.435 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:56.435 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921931+0000", 2024-09-12T00:03:56.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2519999999999996e-06 2024-09-12T00:03:56.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.435 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:56.436 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933475+0000", 2024-09-12T00:03:56.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011543759000000001 2024-09-12T00:03:56.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.436 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.436 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:56.436 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933617+0000", 2024-09-12T00:03:56.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000142282 2024-09-12T00:03:56.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.436 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.436 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:56.436 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933860+0000", 2024-09-12T00:03:56.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024276199999999999 2024-09-12T00:03:56.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.436 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.437 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:56.437 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937933+0000", 2024-09-12T00:03:56.437 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040734680000000002 2024-09-12T00:03:56.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.437 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:56.437 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938955+0000", 2024-09-12T00:03:56.437 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001021987 2024-09-12T00:03:56.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.437 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:56.438 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939038+0000", 2024-09-12T00:03:56.438 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2449999999999998e-05 2024-09-12T00:03:56.438 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.438 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.438 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:56.438 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939103+0000", 2024-09-12T00:03:56.438 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5345999999999994e-05 2024-09-12T00:03:56.438 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.438 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:56.438 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.439 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.439 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:03:56.439 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:03:56.439 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.469227945, 2024-09-12T00:03:56.439 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018247975, 2024-09-12T00:03:56.439 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:56.439 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:56.439 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:56.439 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:56.439 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:03:56.439 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:03:56.439 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 49 2024-09-12T00:03:56.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.440 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:56.440 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.440 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:56.440 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:03:56.440 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.440 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.440 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:56.440 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:03:56.440 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.440 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.440 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:56.440 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921940+0000", 2024-09-12T00:03:56.441 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7e-07 2024-09-12T00:03:56.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.441 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.441 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:56.441 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921943+0000", 2024-09-12T00:03:56.441 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1889999999999999e-06 2024-09-12T00:03:56.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.441 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.441 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:56.441 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921952+0000", 2024-09-12T00:03:56.441 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0010000000000007e-06 2024-09-12T00:03:56.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.441 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.441 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:56.441 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921959+0000", 2024-09-12T00:03:56.442 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2570000000000001e-06 2024-09-12T00:03:56.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.442 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:56.442 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935333+0000", 2024-09-12T00:03:56.442 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013373368 2024-09-12T00:03:56.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.442 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:56.442 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935472+0000", 2024-09-12T00:03:56.442 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013987900000000001 2024-09-12T00:03:56.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.442 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:56.443 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935700+0000", 2024-09-12T00:03:56.443 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000227922 2024-09-12T00:03:56.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.443 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.443 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:56.443 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939858+0000", 2024-09-12T00:03:56.443 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041571300000000002 2024-09-12T00:03:56.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.444 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:56.444 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940018+0000", 2024-09-12T00:03:56.444 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016060400000000001 2024-09-12T00:03:56.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.444 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:56.444 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940114+0000", 2024-09-12T00:03:56.444 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5692999999999993e-05 2024-09-12T00:03:56.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.444 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:56.445 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940187+0000", 2024-09-12T00:03:56.445 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3561999999999998e-05 2024-09-12T00:03:56.445 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.445 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:56.445 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.445 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.445 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:03:56.445 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:03:56.445 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.469185158000002, 2024-09-12T00:03:56.445 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021018614000000001, 2024-09-12T00:03:56.445 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:56.445 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:56.446 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:56.446 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:56.446 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:03:56.446 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:03:56.446 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 50 2024-09-12T00:03:56.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.446 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:56.446 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.446 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:56.446 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:03:56.446 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.446 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.447 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:56.447 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:03:56.447 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.448 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:56.448 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921983+0000", 2024-09-12T00:03:56.448 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4499999999999996e-07 2024-09-12T00:03:56.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.449 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:56.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922071+0000", 2024-09-12T00:03:56.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8010000000000006e-05 2024-09-12T00:03:56.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.449 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:56.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922084+0000", 2024-09-12T00:03:56.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3275000000000001e-05 2024-09-12T00:03:56.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.449 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:56.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922093+0000", 2024-09-12T00:03:56.450 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0580000000000004e-06 2024-09-12T00:03:56.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:56.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936515+0000", 2024-09-12T00:03:56.450 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014421270999999999 2024-09-12T00:03:56.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:56.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936677+0000", 2024-09-12T00:03:56.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162003 2024-09-12T00:03:56.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.451 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:56.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936908+0000", 2024-09-12T00:03:56.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023115700000000001 2024-09-12T00:03:56.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.451 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:56.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939985+0000", 2024-09-12T00:03:56.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030773879999999999 2024-09-12T00:03:56.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.452 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:56.452 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942623+0000", 2024-09-12T00:03:56.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026377929999999998 2024-09-12T00:03:56.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.452 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:56.452 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942818+0000", 2024-09-12T00:03:56.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019556200000000001 2024-09-12T00:03:56.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.452 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:56.452 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943001+0000", 2024-09-12T00:03:56.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018235199999999999 2024-09-12T00:03:56.452 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.453 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:56.453 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.453 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:03:56.453 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:03:56.453 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.469050766000002, 2024-09-12T00:03:56.453 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021092493, 2024-09-12T00:03:56.453 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:56.453 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:56.453 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:56.454 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:56.454 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:03:56.454 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:03:56.454 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 51 2024-09-12T00:03:56.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.454 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:56.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.454 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:56.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:03:56.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.455 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:56.455 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:03:56.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.455 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:56.455 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922118+0000", 2024-09-12T00:03:56.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0389999999999999e-06 2024-09-12T00:03:56.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.455 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:56.455 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922124+0000", 2024-09-12T00:03:56.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5409999999999997e-06 2024-09-12T00:03:56.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:56.456 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922136+0000", 2024-09-12T00:03:56.456 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.205e-05 2024-09-12T00:03:56.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:56.456 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922147+0000", 2024-09-12T00:03:56.456 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0451e-05 2024-09-12T00:03:56.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:56.457 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938000+0000", 2024-09-12T00:03:56.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015853682000000001 2024-09-12T00:03:56.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.457 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.457 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:56.457 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938142+0000", 2024-09-12T00:03:56.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014148899999999999 2024-09-12T00:03:56.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.457 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.457 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:56.457 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938362+0000", 2024-09-12T00:03:56.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022034800000000001 2024-09-12T00:03:56.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.457 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.458 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:56.458 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940330+0000", 2024-09-12T00:03:56.458 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001967459 2024-09-12T00:03:56.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.458 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.458 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:56.458 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943064+0000", 2024-09-12T00:03:56.458 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027346219999999999 2024-09-12T00:03:56.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.458 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.458 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:56.458 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943152+0000", 2024-09-12T00:03:56.458 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7563000000000002e-05 2024-09-12T00:03:56.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.459 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:56.459 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943209+0000", 2024-09-12T00:03:56.459 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7249e-05 2024-09-12T00:03:56.459 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.459 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:56.459 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.459 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:03:56.460 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:03:56.460 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.469001273000003, 2024-09-12T00:03:56.460 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021175616000000001, 2024-09-12T00:03:56.460 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:56.460 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:56.460 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:56.460 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:56.460 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:03:56.460 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:03:56.460 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 52 2024-09-12T00:03:56.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.460 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:56.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.461 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:56.461 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:03:56.461 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.461 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:56.461 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:03:56.461 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.461 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:56.461 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922167+0000", 2024-09-12T00:03:56.461 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3300000000000001e-07 2024-09-12T00:03:56.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.462 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:56.462 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922174+0000", 2024-09-12T00:03:56.462 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7070000000000003e-06 2024-09-12T00:03:56.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.462 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:56.462 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922184+0000", 2024-09-12T00:03:56.462 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682e-05 2024-09-12T00:03:56.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.462 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:56.463 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922195+0000", 2024-09-12T00:03:56.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0489000000000001e-05 2024-09-12T00:03:56.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.463 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:56.463 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939166+0000", 2024-09-12T00:03:56.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016971245999999999 2024-09-12T00:03:56.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.463 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:56.463 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939243+0000", 2024-09-12T00:03:56.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7201999999999997e-05 2024-09-12T00:03:56.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.464 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:56.464 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939381+0000", 2024-09-12T00:03:56.464 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013770699999999999 2024-09-12T00:03:56.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.464 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:56.464 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940923+0000", 2024-09-12T00:03:56.464 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001542302 2024-09-12T00:03:56.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.465 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:56.465 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943221+0000", 2024-09-12T00:03:56.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022979720000000001 2024-09-12T00:03:56.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.465 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:56.465 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943295+0000", 2024-09-12T00:03:56.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3317000000000003e-05 2024-09-12T00:03:56.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.465 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:56.465 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943342+0000", 2024-09-12T00:03:56.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7159e-05 2024-09-12T00:03:56.466 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.466 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:56.466 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.466 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:03:56.466 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:03:56.466 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.220056307, 2024-09-12T00:03:56.466 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015229411999999999, 2024-09-12T00:03:56.466 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:56.466 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:56.466 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:56.466 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:56.466 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:03:56.467 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:03:56.467 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 67 2024-09-12T00:03:56.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.467 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:56.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.467 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:56.467 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:03:56.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.467 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:56.467 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:03:56.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.468 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:56.468 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171112+0000", 2024-09-12T00:03:56.468 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2899999999999999e-06 2024-09-12T00:03:56.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.468 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:56.468 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171119+0000", 2024-09-12T00:03:56.468 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8870000000000003e-06 2024-09-12T00:03:56.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.468 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:56.468 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171131+0000", 2024-09-12T00:03:56.469 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1902999999999999e-05 2024-09-12T00:03:56.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:56.469 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171147+0000", 2024-09-12T00:03:56.469 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6203000000000001e-05 2024-09-12T00:03:56.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:56.470 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175044+0000", 2024-09-12T00:03:56.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038967310000000001 2024-09-12T00:03:56.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.470 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:56.470 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175172+0000", 2024-09-12T00:03:56.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012784100000000001 2024-09-12T00:03:56.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.470 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:56.470 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175372+0000", 2024-09-12T00:03:56.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019978500000000001 2024-09-12T00:03:56.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.471 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:56.471 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179276+0000", 2024-09-12T00:03:56.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039042149999999999 2024-09-12T00:03:56.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.471 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:56.471 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186150+0000", 2024-09-12T00:03:56.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0068740019999999997 2024-09-12T00:03:56.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.471 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:56.471 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186266+0000", 2024-09-12T00:03:56.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115742 2024-09-12T00:03:56.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.472 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.472 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:56.472 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186340+0000", 2024-09-12T00:03:56.472 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4813000000000004e-05 2024-09-12T00:03:56.472 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.472 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:56.472 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.472 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.472 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.472 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:03:56.472 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:03:56.472 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.219995230999999, 2024-09-12T00:03:56.472 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015308448000000001, 2024-09-12T00:03:56.472 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:56.473 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:56.473 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:56.473 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:56.473 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:03:56.473 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:03:56.473 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 68 2024-09-12T00:03:56.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.473 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:56.473 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.473 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:56.474 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:03:56.474 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.474 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:56.474 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:03:56.474 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.474 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:56.474 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171173+0000", 2024-09-12T00:03:56.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:03:56.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.475 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:56.475 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171182+0000", 2024-09-12T00:03:56.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2359999999999993e-06 2024-09-12T00:03:56.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.475 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:56.475 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171193+0000", 2024-09-12T00:03:56.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.095e-05 2024-09-12T00:03:56.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.476 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.476 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:56.476 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171207+0000", 2024-09-12T00:03:56.476 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3339999999999999e-05 2024-09-12T00:03:56.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.476 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.476 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:56.476 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176753+0000", 2024-09-12T00:03:56.476 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055460240000000001 2024-09-12T00:03:56.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.476 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.476 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:56.476 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176921+0000", 2024-09-12T00:03:56.476 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000168503 2024-09-12T00:03:56.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.477 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:56.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177112+0000", 2024-09-12T00:03:56.477 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019113999999999999 2024-09-12T00:03:56.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.477 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:56.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179382+0000", 2024-09-12T00:03:56.477 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022697099999999999 2024-09-12T00:03:56.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.478 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:56.478 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186356+0000", 2024-09-12T00:03:56.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069741919999999997 2024-09-12T00:03:56.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.478 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:56.478 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186422+0000", 2024-09-12T00:03:56.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6387e-05 2024-09-12T00:03:56.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.478 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:56.478 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186481+0000", 2024-09-12T00:03:56.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8059000000000001e-05 2024-09-12T00:03:56.479 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.479 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:56.479 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.479 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.479 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.479 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:03:56.479 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:03:56.480 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.219943461, 2024-09-12T00:03:56.480 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020001835999999999, 2024-09-12T00:03:56.480 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:56.480 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:56.480 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:56.480 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:56.480 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:03:56.480 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:03:56.480 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 69 2024-09-12T00:03:56.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.481 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:56.481 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.481 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:56.481 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:03:56.481 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.481 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.481 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:56.481 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:03:56.481 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.482 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.482 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:56.482 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171225+0000", 2024-09-12T00:03:56.482 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0599999999999999e-07 2024-09-12T00:03:56.482 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.482 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.482 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:56.482 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171349+0000", 2024-09-12T00:03:56.482 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012407299999999999 2024-09-12T00:03:56.482 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.482 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.482 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:56.483 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171367+0000", 2024-09-12T00:03:56.483 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8413000000000001e-05 2024-09-12T00:03:56.483 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.483 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.483 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:56.483 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171376+0000", 2024-09-12T00:03:56.483 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8170000000000005e-06 2024-09-12T00:03:56.483 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.483 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.483 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:56.483 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177692+0000", 2024-09-12T00:03:56.483 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063156729999999999 2024-09-12T00:03:56.483 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.484 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.484 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:56.484 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177817+0000", 2024-09-12T00:03:56.484 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012581499999999999 2024-09-12T00:03:56.484 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.484 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.484 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:56.484 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.178015+0000", 2024-09-12T00:03:56.484 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019715100000000001 2024-09-12T00:03:56.484 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.484 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.484 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:56.484 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181798+0000", 2024-09-12T00:03:56.484 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003783308 2024-09-12T00:03:56.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.485 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.485 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:56.485 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190976+0000", 2024-09-12T00:03:56.485 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091776519999999997 2024-09-12T00:03:56.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.485 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.485 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:56.485 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191122+0000", 2024-09-12T00:03:56.486 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000145966 2024-09-12T00:03:56.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.486 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.486 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:56.486 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191226+0000", 2024-09-12T00:03:56.486 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104162 2024-09-12T00:03:56.486 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.486 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:56.486 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.486 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.486 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:03:56.486 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:03:56.486 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.219774725999997, 2024-09-12T00:03:56.487 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019997773, 2024-09-12T00:03:56.487 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:56.487 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:56.487 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:56.487 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:56.487 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:03:56.487 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:03:56.487 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 70 2024-09-12T00:03:56.487 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.487 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:56.487 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.487 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:56.487 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:03:56.487 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.488 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.488 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:56.488 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:03:56.488 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.488 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.488 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:56.488 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:03:56.488 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3699999999999999e-07 2024-09-12T00:03:56.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.488 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.489 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:56.489 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171403+0000", 2024-09-12T00:03:56.489 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6199999999999994e-06 2024-09-12T00:03:56.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.489 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.489 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:56.489 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171416+0000", 2024-09-12T00:03:56.489 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2636000000000001e-05 2024-09-12T00:03:56.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.489 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.489 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:56.489 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171423+0000", 2024-09-12T00:03:56.489 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5440000000000001e-06 2024-09-12T00:03:56.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.490 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.490 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:56.490 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179458+0000", 2024-09-12T00:03:56.490 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080351989999999998 2024-09-12T00:03:56.490 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.490 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.490 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:56.490 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179604+0000", 2024-09-12T00:03:56.490 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014519899999999999 2024-09-12T00:03:56.490 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.491 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.491 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:56.491 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179831+0000", 2024-09-12T00:03:56.491 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022704800000000001 2024-09-12T00:03:56.491 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.491 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.491 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:56.491 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181918+0000", 2024-09-12T00:03:56.491 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020873950000000001 2024-09-12T00:03:56.491 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.491 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.491 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:56.491 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191243+0000", 2024-09-12T00:03:56.491 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0093244729999999998 2024-09-12T00:03:56.492 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.492 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.492 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:56.492 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191309+0000", 2024-09-12T00:03:56.492 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6116000000000002e-05 2024-09-12T00:03:56.492 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.492 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.492 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:56.492 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191390+0000", 2024-09-12T00:03:56.492 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1705999999999993e-05 2024-09-12T00:03:56.492 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.492 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:56.492 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.493 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.493 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:03:56.493 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:03:56.493 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.219728652999997, 2024-09-12T00:03:56.493 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020263554, 2024-09-12T00:03:56.493 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:56.493 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:56.493 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:56.493 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:56.493 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:03:56.493 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:03:56.493 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 71 2024-09-12T00:03:56.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.494 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:56.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.494 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:56.494 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:03:56.494 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.494 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:56.494 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:03:56.494 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.495 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:56.495 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:03:56.495 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5000000000000002e-07 2024-09-12T00:03:56.495 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.495 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.495 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:56.495 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171454+0000", 2024-09-12T00:03:56.495 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5046e-05 2024-09-12T00:03:56.495 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.495 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.495 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:56.496 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171471+0000", 2024-09-12T00:03:56.496 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6923999999999999e-05 2024-09-12T00:03:56.496 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.496 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.496 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:56.496 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171487+0000", 2024-09-12T00:03:56.496 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5823000000000001e-05 2024-09-12T00:03:56.496 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.496 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.496 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:56.496 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180765+0000", 2024-09-12T00:03:56.496 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0092774399999999996 2024-09-12T00:03:56.496 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.497 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.497 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:56.497 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180900+0000", 2024-09-12T00:03:56.497 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013556700000000001 2024-09-12T00:03:56.497 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.497 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.497 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:56.497 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181108+0000", 2024-09-12T00:03:56.497 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020727899999999999 2024-09-12T00:03:56.497 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.497 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.497 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:56.497 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184725+0000", 2024-09-12T00:03:56.497 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036171340000000001 2024-09-12T00:03:56.498 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.498 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.498 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:56.498 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191413+0000", 2024-09-12T00:03:56.498 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066881830000000003 2024-09-12T00:03:56.498 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.498 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.498 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:56.498 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191540+0000", 2024-09-12T00:03:56.498 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000126823 2024-09-12T00:03:56.498 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.498 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.498 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:56.498 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191702+0000", 2024-09-12T00:03:56.499 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162585 2024-09-12T00:03:56.499 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.499 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:56.499 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.499 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.499 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:03:56.499 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:03:56.499 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.219650076999997, 2024-09-12T00:03:56.499 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020448573000000001, 2024-09-12T00:03:56.499 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:56.499 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:56.499 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:56.499 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:56.500 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:03:56.500 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:03:56.500 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 72 2024-09-12T00:03:56.500 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.500 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:56.500 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.500 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:56.500 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:03:56.500 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.500 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.501 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.501 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:56.501 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:03:56.501 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.501 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.501 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.501 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:56.501 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171518+0000", 2024-09-12T00:03:56.501 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0440000000000001e-06 2024-09-12T00:03:56.502 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.502 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.502 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:56.502 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171647+0000", 2024-09-12T00:03:56.502 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012912899999999999 2024-09-12T00:03:56.502 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.502 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.502 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:56.502 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171664+0000", 2024-09-12T00:03:56.502 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6079999999999999e-05 2024-09-12T00:03:56.502 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.502 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.502 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:56.502 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171675+0000", 2024-09-12T00:03:56.503 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1223000000000001e-05 2024-09-12T00:03:56.503 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.503 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.503 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:56.503 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182000+0000", 2024-09-12T00:03:56.503 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010324949 2024-09-12T00:03:56.503 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.503 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.503 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:56.503 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182178+0000", 2024-09-12T00:03:56.503 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017808799999999999 2024-09-12T00:03:56.503 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.503 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.503 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:56.504 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182402+0000", 2024-09-12T00:03:56.504 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022381199999999999 2024-09-12T00:03:56.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.504 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.504 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:56.504 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190935+0000", 2024-09-12T00:03:56.504 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085331560000000001 2024-09-12T00:03:56.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.504 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.504 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:56.504 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191728+0000", 2024-09-12T00:03:56.504 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079325700000000001 2024-09-12T00:03:56.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.504 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.505 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:56.505 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191864+0000", 2024-09-12T00:03:56.505 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013606299999999999 2024-09-12T00:03:56.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.505 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.505 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:56.505 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191966+0000", 2024-09-12T00:03:56.505 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101772 2024-09-12T00:03:56.505 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.505 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:56.505 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.505 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.505 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:03:56.506 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:03:56.506 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.219466881999999, 2024-09-12T00:03:56.506 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020675235, 2024-09-12T00:03:56.506 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:56.506 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:56.506 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:56.506 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:56.506 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:03:56.506 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:03:56.506 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 73 2024-09-12T00:03:56.506 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.506 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:56.506 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.507 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:56.507 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:03:56.507 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.507 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.507 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.507 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:56.507 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:03:56.507 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.507 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.507 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.507 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:56.507 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171701+0000", 2024-09-12T00:03:56.507 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0999999999999997e-07 2024-09-12T00:03:56.507 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.508 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.508 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:56.508 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171709+0000", 2024-09-12T00:03:56.508 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2540000000000003e-06 2024-09-12T00:03:56.508 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.508 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.508 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:56.508 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171724+0000", 2024-09-12T00:03:56.508 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5569e-05 2024-09-12T00:03:56.508 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.508 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.508 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:56.508 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171734+0000", 2024-09-12T00:03:56.508 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6139999999999998e-06 2024-09-12T00:03:56.509 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.509 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.509 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:56.509 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183774+0000", 2024-09-12T00:03:56.509 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012040444000000001 2024-09-12T00:03:56.509 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.509 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.509 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:56.509 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183896+0000", 2024-09-12T00:03:56.509 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012204199999999999 2024-09-12T00:03:56.509 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.509 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.509 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:56.509 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184084+0000", 2024-09-12T00:03:56.510 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018792599999999999 2024-09-12T00:03:56.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.510 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.510 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:56.510 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191984+0000", 2024-09-12T00:03:56.510 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079003790000000008 2024-09-12T00:03:56.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.510 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.510 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:56.510 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192093+0000", 2024-09-12T00:03:56.510 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000108942 2024-09-12T00:03:56.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.510 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.510 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:56.511 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192250+0000", 2024-09-12T00:03:56.511 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015637600000000001 2024-09-12T00:03:56.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.511 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.511 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:56.511 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192376+0000", 2024-09-12T00:03:56.511 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012587899999999999 2024-09-12T00:03:56.511 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.511 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:56.511 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.512 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.512 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.512 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:03:56.512 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:03:56.512 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.219418672000003, 2024-09-12T00:03:56.512 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021088828, 2024-09-12T00:03:56.512 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:56.512 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:56.512 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:56.512 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:56.512 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:03:56.512 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:03:56.512 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 74 2024-09-12T00:03:56.513 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.513 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:56.513 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.513 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:56.513 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:03:56.513 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.513 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.514 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.514 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:56.514 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:03:56.514 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.514 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.514 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.514 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:56.514 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:03:56.514 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1699999999999997e-07 2024-09-12T00:03:56.514 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.515 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.515 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:56.515 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171758+0000", 2024-09-12T00:03:56.515 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0860000000000008e-06 2024-09-12T00:03:56.515 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.515 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.515 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:56.515 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171774+0000", 2024-09-12T00:03:56.515 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:03:56.515 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.516 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.516 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:56.516 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171788+0000", 2024-09-12T00:03:56.516 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4793999999999999e-05 2024-09-12T00:03:56.516 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.517 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.517 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:56.517 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184842+0000", 2024-09-12T00:03:56.517 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013053607 2024-09-12T00:03:56.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.517 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.517 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:56.517 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185130+0000", 2024-09-12T00:03:56.517 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00028779199999999998 2024-09-12T00:03:56.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.517 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.518 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:56.518 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185378+0000", 2024-09-12T00:03:56.518 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024780100000000002 2024-09-12T00:03:56.518 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.518 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.518 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:56.518 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192513+0000", 2024-09-12T00:03:56.519 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071350770000000001 2024-09-12T00:03:56.519 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.519 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.519 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:56.519 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192690+0000", 2024-09-12T00:03:56.519 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000176892 2024-09-12T00:03:56.519 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.519 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.519 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:56.519 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192769+0000", 2024-09-12T00:03:56.519 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9466000000000001e-05 2024-09-12T00:03:56.519 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.519 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.520 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:56.520 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192837+0000", 2024-09-12T00:03:56.520 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8466000000000005e-05 2024-09-12T00:03:56.520 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.520 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:56.520 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.520 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.520 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.520 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:03:56.520 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:03:56.520 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.219366094999998, 2024-09-12T00:03:56.520 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.02121994, 2024-09-12T00:03:56.520 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:56.521 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:56.521 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:56.521 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:56.521 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:03:56.521 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:03:56.521 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 75 2024-09-12T00:03:56.521 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.521 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:56.521 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.521 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:56.522 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:03:56.522 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.522 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.522 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.522 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:56.522 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:03:56.522 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.522 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.522 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.522 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:56.522 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171802+0000", 2024-09-12T00:03:56.522 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5000000000000002e-07 2024-09-12T00:03:56.522 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.522 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.523 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:56.523 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171954+0000", 2024-09-12T00:03:56.523 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015215500000000001 2024-09-12T00:03:56.523 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.523 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.523 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:56.523 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171966+0000", 2024-09-12T00:03:56.523 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1548e-05 2024-09-12T00:03:56.523 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.523 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.523 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:56.523 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171970+0000", 2024-09-12T00:03:56.523 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8729999999999998e-06 2024-09-12T00:03:56.523 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.524 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.524 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:56.524 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186552+0000", 2024-09-12T00:03:56.524 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014581775 2024-09-12T00:03:56.524 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.524 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.524 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:56.524 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186702+0000", 2024-09-12T00:03:56.524 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014946 2024-09-12T00:03:56.524 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.524 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.524 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:56.524 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186897+0000", 2024-09-12T00:03:56.525 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000195071 2024-09-12T00:03:56.525 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.525 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.525 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:56.525 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192666+0000", 2024-09-12T00:03:56.525 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057693470000000002 2024-09-12T00:03:56.525 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.525 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.525 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:56.525 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192857+0000", 2024-09-12T00:03:56.525 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191149 2024-09-12T00:03:56.525 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.526 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.526 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:56.526 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192967+0000", 2024-09-12T00:03:56.526 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110202 2024-09-12T00:03:56.526 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.526 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.526 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:56.526 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193021+0000", 2024-09-12T00:03:56.526 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3709999999999999e-05 2024-09-12T00:03:56.526 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.527 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:56.527 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.527 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.527 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.527 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:03:56.527 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:03:56.527 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.219186800000003, 2024-09-12T00:03:56.527 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026297425999999999, 2024-09-12T00:03:56.527 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:03:56.527 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:03:56.527 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:56.527 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:03:56.527 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:03:56.527 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:03:56.528 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 76 2024-09-12T00:03:56.528 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.528 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:03:56.528 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.528 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:03:56.528 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:03:56.528 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.528 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.528 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.528 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:03:56.529 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:03:56.529 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:03:56.529 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.529 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.529 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:03:56.529 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:03:56.529 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9399999999999995e-07 2024-09-12T00:03:56.529 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.529 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.529 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:03:56.529 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171987+0000", 2024-09-12T00:03:56.529 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5230000000000003e-06 2024-09-12T00:03:56.529 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.529 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.530 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:03:56.530 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172005+0000", 2024-09-12T00:03:56.530 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8788e-05 2024-09-12T00:03:56.530 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.530 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.530 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:03:56.530 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172010+0000", 2024-09-12T00:03:56.530 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7570000000000004e-06 2024-09-12T00:03:56.530 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.530 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.530 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:03:56.530 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193104+0000", 2024-09-12T00:03:56.530 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021094112000000002 2024-09-12T00:03:56.530 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.531 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.531 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:03:56.531 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193334+0000", 2024-09-12T00:03:56.531 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000229855 2024-09-12T00:03:56.531 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.531 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.531 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:03:56.531 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193697+0000", 2024-09-12T00:03:56.531 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00036272399999999998 2024-09-12T00:03:56.531 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.531 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.531 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:56.531 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.195602+0000", 2024-09-12T00:03:56.531 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019049620000000001 2024-09-12T00:03:56.532 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.532 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.532 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:03:56.532 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198123+0000", 2024-09-12T00:03:56.532 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025216520000000001 2024-09-12T00:03:56.532 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.532 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.532 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:03:56.532 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198213+0000", 2024-09-12T00:03:56.532 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0008999999999998e-05 2024-09-12T00:03:56.532 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:03:56.533 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:03:56.533 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:03:56.533 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198278+0000", 2024-09-12T00:03:56.533 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4549999999999997e-05 2024-09-12T00:03:56.533 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.533 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:56.533 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.533 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:03:56.533 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:03:56.533 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:03:56.535 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:03:56.535 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:03:56.536+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:03:56.544 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:03:56.636 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:03:56.633+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:03:56.718 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:03:56.718 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:03:56.727 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:03:56.727 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:03:56.727 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:03:56.727 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:03:56.735 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:03:56.735 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:03:56.737 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:56.740+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:03:56.741 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:03:56.753 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:03:56.754 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:03:56.771 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:03:56.772 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:03:56.792 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:03:56.793 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:03:56.813 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:03:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:03:56.838 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:56.840+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:03:56.848 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:03:56.848 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:03:56.872 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:56.872 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:56.873 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:03:56.874 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:03:56.887 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:03:56.939 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:56.940+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:03:57.040 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:57.037+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:57.091 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:57.091 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:57.101 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:03:57.143 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:57.144+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:03:57.242 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:57.244+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:03:57.271 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:57.271 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:57.284 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:03:57.342 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:57.341+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:57.408 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:57.408 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:57.422 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:03:57.443 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:57.444+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:03:57.544 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T00:03:57.545 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:03:57.548+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:03:57.583 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:57.583 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:57.598 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:03:57.645 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:03:57.648+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:03:57.732 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:57.732 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:57.746 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:03:57.747 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:03:57.745+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:03:57.847 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:57.845+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:57.907 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:57.907 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:57.924 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:03:57.969 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:57.972+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:03:58.049 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:58.049 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:58.049 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:03:58.049+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:03:58.063 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:03:58.150 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:58.152+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:03:58.229 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:58.229 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:58.243 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:03:58.250 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:03:58.249+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:03:58.351 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:03:58.352+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:03:58.410 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:58.410 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:58.424 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:03:58.452 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:58.449+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:58.541 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T00:03:58.553 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:58.556+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:03:58.601 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:58.601 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:58.615 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:03:58.654 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:58.653+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:58.756 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:03:58.756+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:03:58.782 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:58.783 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:58.797 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:03:58.893 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:58.896+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:03:58.899 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:03:58.957 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:03:58.957+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:03:58.969 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:58.969 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:58.984 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:03:59.058 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:59.057+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:59.069 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:03:59.070 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:03:59.086 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:03:59.087 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:03:59.106 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:03:59.106 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:03:59.124 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:03:59.124 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:03:59.144 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:03:59.144 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:03:59.155 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:03:59.156 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:03:59.159 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:03:59.160+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:03:59.164 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:03:59.164 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:03:59.171 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:03:59.186 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:03:59.186 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:03:59.204 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:03:59.204 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:03:59.261 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:59.261+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:59.340 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:59.340 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:03:59.340 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:03:59.340 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:59.355 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:03:59.362 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:03:59.361+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:03:59.463 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:03:59.464+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:03:59.475 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:59.475 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:03:59.475 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:03:59.475 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:03:59.475 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:59.489 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:03:59.563 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:03:59.561+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:03:59.657 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:03:59.657 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:03:59.657 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:03:59.657 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:03:59.658 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.658 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:03:59.658 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:03:59.658 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.171055810999999, 2024-09-12T00:03:59.658 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0032495720000000001, 2024-09-12T00:03:59.658 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:59.658 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:59.658 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:59.658 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:59.658 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:59.658 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:59.658 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 193 2024-09-12T00:03:59.658 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.659 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:59.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.659 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:59.659 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:03:59.659 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.659 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:59.659 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:03:59.659 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.659 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:59.659 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486926+0000", 2024-09-12T00:03:59.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.463e-06 2024-09-12T00:03:59.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.660 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:59.660 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486937+0000", 2024-09-12T00:03:59.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1147e-05 2024-09-12T00:03:59.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.660 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:59.660 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486968+0000", 2024-09-12T00:03:59.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1077000000000001e-05 2024-09-12T00:03:59.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.660 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:59.661 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486985+0000", 2024-09-12T00:03:59.661 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6399e-05 2024-09-12T00:03:59.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.661 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.661 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:59.661 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487139+0000", 2024-09-12T00:03:59.661 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015403199999999999 2024-09-12T00:03:59.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.661 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.661 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:59.661 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487375+0000", 2024-09-12T00:03:59.661 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023621499999999999 2024-09-12T00:03:59.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:59.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487634+0000", 2024-09-12T00:03:59.662 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000259351 2024-09-12T00:03:59.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:59.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.489156+0000", 2024-09-12T00:03:59.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015213869999999999 2024-09-12T00:03:59.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.663 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:59.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.489974+0000", 2024-09-12T00:03:59.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00081855600000000001 2024-09-12T00:03:59.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.663 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:59.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.490064+0000", 2024-09-12T00:03:59.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9205999999999999e-05 2024-09-12T00:03:59.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.664 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:59.664 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.490173+0000", 2024-09-12T00:03:59.664 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109739 2024-09-12T00:03:59.664 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.664 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:59.664 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.664 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.664 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:03:59.664 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:03:59.664 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 25.294616267999999, 2024-09-12T00:03:59.664 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039523630000000004, 2024-09-12T00:03:59.664 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:59.665 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:59.665 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:59.665 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:59.665 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:59.665 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:59.665 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 208 2024-09-12T00:03:59.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.665 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:59.665 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.665 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:59.665 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:03:59.665 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.665 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.666 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:59.666 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:03:59.666 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.666 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.666 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:59.666 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363366+0000", 2024-09-12T00:03:59.666 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.004e-06 2024-09-12T00:03:59.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.666 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.666 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:59.666 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363379+0000", 2024-09-12T00:03:59.666 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2943e-05 2024-09-12T00:03:59.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:59.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363412+0000", 2024-09-12T00:03:59.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2808999999999997e-05 2024-09-12T00:03:59.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:59.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363430+0000", 2024-09-12T00:03:59.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8003e-05 2024-09-12T00:03:59.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:59.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363654+0000", 2024-09-12T00:03:59.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022394900000000001 2024-09-12T00:03:59.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.668 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:59.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363897+0000", 2024-09-12T00:03:59.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024272399999999999 2024-09-12T00:03:59.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.668 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:59.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.364326+0000", 2024-09-12T00:03:59.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042963399999999997 2024-09-12T00:03:59.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.668 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:59.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.365757+0000", 2024-09-12T00:03:59.669 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014303969999999999 2024-09-12T00:03:59.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.669 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.669 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:59.669 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367031+0000", 2024-09-12T00:03:59.669 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001274269 2024-09-12T00:03:59.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.669 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.669 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:59.669 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367197+0000", 2024-09-12T00:03:59.669 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016645900000000001 2024-09-12T00:03:59.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:59.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367316+0000", 2024-09-12T00:03:59.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011817200000000001 2024-09-12T00:03:59.670 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.670 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:59.670 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.670 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:59.670 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:03:59.670 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 25.237357964000001, 2024-09-12T00:03:59.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033190419999999999, 2024-09-12T00:03:59.671 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:59.671 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:59.671 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:59.671 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:59.671 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:59.671 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:59.671 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 219 2024-09-12T00:03:59.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.671 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:59.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.671 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:59.671 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:03:59.671 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.672 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:59.672 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:03:59.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.672 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.672 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:59.672 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420624+0000", 2024-09-12T00:03:59.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0829999999999998e-06 2024-09-12T00:03:59.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.672 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.672 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:59.672 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420633+0000", 2024-09-12T00:03:59.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8500000000000006e-06 2024-09-12T00:03:59.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:59.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420663+0000", 2024-09-12T00:03:59.673 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9597000000000001e-05 2024-09-12T00:03:59.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:59.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420681+0000", 2024-09-12T00:03:59.673 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7646e-05 2024-09-12T00:03:59.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:59.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420791+0000", 2024-09-12T00:03:59.674 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109979 2024-09-12T00:03:59.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.674 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.674 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:59.674 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.421042+0000", 2024-09-12T00:03:59.674 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025117199999999997 2024-09-12T00:03:59.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.674 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.674 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:59.674 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.421487+0000", 2024-09-12T00:03:59.674 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00044476599999999998 2024-09-12T00:03:59.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.674 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.674 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:59.674 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.422884+0000", 2024-09-12T00:03:59.675 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0013975109999999999 2024-09-12T00:03:59.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.675 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:59.675 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423797+0000", 2024-09-12T00:03:59.675 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00091310899999999995 2024-09-12T00:03:59.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.675 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:59.675 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423879+0000", 2024-09-12T00:03:59.675 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1829000000000005e-05 2024-09-12T00:03:59.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.676 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:59.676 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423941+0000", 2024-09-12T00:03:59.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1500000000000004e-05 2024-09-12T00:03:59.676 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.676 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:59.676 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.676 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.676 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:59.676 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:03:59.676 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 25.219717365000001, 2024-09-12T00:03:59.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003232782, 2024-09-12T00:03:59.676 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:59.676 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:59.676 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:59.677 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:59.677 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:59.677 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:59.677 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 224 2024-09-12T00:03:59.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.677 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:59.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:59.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:03:59.677 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:59.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:03:59.678 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.678 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.678 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:59.678 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438265+0000", 2024-09-12T00:03:59.678 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.666e-06 2024-09-12T00:03:59.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.678 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.678 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:59.678 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438276+0000", 2024-09-12T00:03:59.678 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1387e-05 2024-09-12T00:03:59.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.678 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.678 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:59.679 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438306+0000", 2024-09-12T00:03:59.679 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0069999999999998e-05 2024-09-12T00:03:59.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.679 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:59.679 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438321+0000", 2024-09-12T00:03:59.679 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.517e-05 2024-09-12T00:03:59.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.679 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:59.679 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438459+0000", 2024-09-12T00:03:59.679 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013781899999999999 2024-09-12T00:03:59.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.680 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:59.680 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438671+0000", 2024-09-12T00:03:59.680 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021214500000000001 2024-09-12T00:03:59.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.680 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.680 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:59.680 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.439093+0000", 2024-09-12T00:03:59.680 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042117899999999999 2024-09-12T00:03:59.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.680 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.680 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:59.680 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.440400+0000", 2024-09-12T00:03:59.680 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0013072719999999999 2024-09-12T00:03:59.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.681 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.681 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:59.681 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441339+0000", 2024-09-12T00:03:59.681 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00093906600000000001 2024-09-12T00:03:59.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.681 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.681 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:59.681 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441429+0000", 2024-09-12T00:03:59.681 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0358999999999993e-05 2024-09-12T00:03:59.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.681 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.681 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:59.681 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441495+0000", 2024-09-12T00:03:59.681 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5648999999999994e-05 2024-09-12T00:03:59.682 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.682 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:59.682 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.682 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.682 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.682 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:59.682 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:03:59.682 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 25.180218393000001, 2024-09-12T00:03:59.682 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003225716, 2024-09-12T00:03:59.682 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:59.682 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:59.682 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:59.682 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:59.682 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:59.683 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:59.683 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 235 2024-09-12T00:03:59.683 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.683 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:59.683 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.683 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:59.683 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:03:59.683 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.683 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.683 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.683 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:59.683 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:03:59.683 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.683 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.683 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.684 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:59.684 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477764+0000", 2024-09-12T00:03:59.684 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.48e-06 2024-09-12T00:03:59.684 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.684 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.684 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:59.684 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477775+0000", 2024-09-12T00:03:59.684 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1163e-05 2024-09-12T00:03:59.684 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.684 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.684 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:59.684 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477807+0000", 2024-09-12T00:03:59.684 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1860000000000003e-05 2024-09-12T00:03:59.684 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.685 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.685 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:59.685 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477822+0000", 2024-09-12T00:03:59.685 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5302999999999999e-05 2024-09-12T00:03:59.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.685 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.685 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:59.685 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477959+0000", 2024-09-12T00:03:59.685 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013695600000000001 2024-09-12T00:03:59.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.685 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.685 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:59.685 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.478184+0000", 2024-09-12T00:03:59.686 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022484800000000001 2024-09-12T00:03:59.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.686 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.686 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:59.686 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.478657+0000", 2024-09-12T00:03:59.686 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000473413 2024-09-12T00:03:59.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.686 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.686 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:59.686 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480162+0000", 2024-09-12T00:03:59.686 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00150454 2024-09-12T00:03:59.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.686 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.686 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:59.686 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480792+0000", 2024-09-12T00:03:59.687 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00063012400000000003 2024-09-12T00:03:59.687 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.687 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.687 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:59.687 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480906+0000", 2024-09-12T00:03:59.687 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113909 2024-09-12T00:03:59.687 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.687 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.687 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:59.687 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480987+0000", 2024-09-12T00:03:59.687 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1119999999999996e-05 2024-09-12T00:03:59.687 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.687 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:59.687 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.688 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.688 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:237 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:59.688 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:03:59.688 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 25.172897022000001, 2024-09-12T00:03:59.688 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0074291790000000002, 2024-09-12T00:03:59.688 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:59.688 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:59.688 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:59.688 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:59.688 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:59.688 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:59.688 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 237 2024-09-12T00:03:59.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.689 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:59.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.689 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:59.689 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:03:59.689 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.689 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:59.689 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:03:59.689 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.689 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:59.689 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485086+0000", 2024-09-12T00:03:59.690 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.05e-06 2024-09-12T00:03:59.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.690 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.690 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:59.690 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485101+0000", 2024-09-12T00:03:59.690 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5186e-05 2024-09-12T00:03:59.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.690 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.690 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:59.690 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485140+0000", 2024-09-12T00:03:59.690 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8896000000000002e-05 2024-09-12T00:03:59.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.690 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.690 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:59.691 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485162+0000", 2024-09-12T00:03:59.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2654e-05 2024-09-12T00:03:59.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.691 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.691 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:59.691 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485314+0000", 2024-09-12T00:03:59.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015150799999999999 2024-09-12T00:03:59.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.691 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.691 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:59.691 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485549+0000", 2024-09-12T00:03:59.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000235665 2024-09-12T00:03:59.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.691 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.691 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:59.692 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486064+0000", 2024-09-12T00:03:59.692 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00051418899999999997 2024-09-12T00:03:59.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.692 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.692 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:59.692 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.488211+0000", 2024-09-12T00:03:59.692 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0021470819999999998 2024-09-12T00:03:59.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.692 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.692 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:59.692 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492273+0000", 2024-09-12T00:03:59.692 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040617980000000001 2024-09-12T00:03:59.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.692 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.693 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:59.693 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492391+0000", 2024-09-12T00:03:59.693 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118613 2024-09-12T00:03:59.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.693 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.693 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:59.693 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492512+0000", 2024-09-12T00:03:59.693 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120538 2024-09-12T00:03:59.693 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.693 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:59.693 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.693 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.693 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:244 6.17 e35/29 6:e9187ab8:reshard::reshard.0000000000:head v 35'1, mlcod=0'0)", 2024-09-12T00:03:59.694 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:03:59.694 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 25.170314786999999, 2024-09-12T00:03:59.694 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0034313239999999999, 2024-09-12T00:03:59.694 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:59.694 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:59.694 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:59.694 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:59.694 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.694 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:59.694 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:03:59.694 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.694 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.694 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:59.694 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:03:59.695 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.695 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:59.695 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487667+0000", 2024-09-12T00:03:59.695 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4899999999999999e-06 2024-09-12T00:03:59.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.695 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:59.695 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487682+0000", 2024-09-12T00:03:59.695 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4929999999999999e-05 2024-09-12T00:03:59.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.696 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:59.696 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487740+0000", 2024-09-12T00:03:59.696 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8075000000000002e-05 2024-09-12T00:03:59.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.696 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.696 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:59.696 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487761+0000", 2024-09-12T00:03:59.696 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0769999999999999e-05 2024-09-12T00:03:59.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.696 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.696 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:59.696 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487966+0000", 2024-09-12T00:03:59.696 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020516800000000001 2024-09-12T00:03:59.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.696 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.697 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:59.697 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.488012+0000", 2024-09-12T00:03:59.697 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5794000000000002e-05 2024-09-12T00:03:59.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.697 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.697 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:59.697 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.490965+0000", 2024-09-12T00:03:59.697 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0029530609999999999 2024-09-12T00:03:59.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.697 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.697 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:59.697 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491096+0000", 2024-09-12T00:03:59.697 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013103600000000001 2024-09-12T00:03:59.697 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.698 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:59.698 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.698 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.698 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:293 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:59.698 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:03:59.698 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 25.160362966000001, 2024-09-12T00:03:59.698 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0075915649999999998, 2024-09-12T00:03:59.698 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:59.698 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:59.698 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:59.698 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:59.698 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:59.698 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:59.699 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 293 2024-09-12T00:03:59.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.699 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:59.699 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.699 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:59.699 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:03:59.699 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.699 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.699 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:59.699 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:03:59.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.700 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:59.700 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497626+0000", 2024-09-12T00:03:59.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2499999999999995e-06 2024-09-12T00:03:59.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.700 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:59.700 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497636+0000", 2024-09-12T00:03:59.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0139999999999999e-05 2024-09-12T00:03:59.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.700 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:59.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497660+0000", 2024-09-12T00:03:59.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4015999999999998e-05 2024-09-12T00:03:59.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:59.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497675+0000", 2024-09-12T00:03:59.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5339999999999999e-05 2024-09-12T00:03:59.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:59.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497839+0000", 2024-09-12T00:03:59.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016347900000000001 2024-09-12T00:03:59.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:59.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498097+0000", 2024-09-12T00:03:59.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025825700000000002 2024-09-12T00:03:59.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:59.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498618+0000", 2024-09-12T00:03:59.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052051300000000001 2024-09-12T00:03:59.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:59.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.501282+0000", 2024-09-12T00:03:59.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026646840000000001 2024-09-12T00:03:59.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:59.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505057+0000", 2024-09-12T00:03:59.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037747710000000001 2024-09-12T00:03:59.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:59.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505144+0000", 2024-09-12T00:03:59.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7466000000000006e-05 2024-09-12T00:03:59.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:59.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505208+0000", 2024-09-12T00:03:59.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3649e-05 2024-09-12T00:03:59.704 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.704 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:59.704 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.704 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.704 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:413 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:59.704 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:03:59.704 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 25.129323354, 2024-09-12T00:03:59.704 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005252049, 2024-09-12T00:03:59.704 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:59.704 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:59.704 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:59.704 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:59.704 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:59.705 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:59.705 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 413 2024-09-12T00:03:59.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.705 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:59.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.705 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:59.705 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:03:59.705 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.705 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:59.705 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:03:59.705 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.706 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:59.706 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528659+0000", 2024-09-12T00:03:59.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4739999999999999e-06 2024-09-12T00:03:59.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.706 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:59.706 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528669+0000", 2024-09-12T00:03:59.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0694e-05 2024-09-12T00:03:59.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.706 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:59.706 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528696+0000", 2024-09-12T00:03:59.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6846e-05 2024-09-12T00:03:59.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:59.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528711+0000", 2024-09-12T00:03:59.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4397e-05 2024-09-12T00:03:59.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:59.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528884+0000", 2024-09-12T00:03:59.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017304700000000001 2024-09-12T00:03:59.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:59.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529162+0000", 2024-09-12T00:03:59.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027861999999999999 2024-09-12T00:03:59.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.708 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.708 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:59.708 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529688+0000", 2024-09-12T00:03:59.708 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052593900000000001 2024-09-12T00:03:59.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.708 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.708 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:59.708 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.531480+0000", 2024-09-12T00:03:59.708 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0017920740000000001 2024-09-12T00:03:59.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.708 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.708 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:59.709 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533734+0000", 2024-09-12T00:03:59.709 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002254191 2024-09-12T00:03:59.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.709 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.709 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:59.709 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533845+0000", 2024-09-12T00:03:59.709 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110559 2024-09-12T00:03:59.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.709 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.709 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:59.709 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533908+0000", 2024-09-12T00:03:59.709 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3207999999999995e-05 2024-09-12T00:03:59.709 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.709 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:59.709 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.710 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.710 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.710 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:437 6.0 6:05588ce8:lc::lc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:59.710 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:03:59.710 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 25.122147864999999, 2024-09-12T00:03:59.710 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039419659999999999, 2024-09-12T00:03:59.710 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:59.710 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:59.710 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:59.710 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:59.710 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:59.710 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:59.710 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 437 2024-09-12T00:03:59.710 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.711 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:59.711 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.711 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:59.711 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:03:59.711 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.711 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.711 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:59.711 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:03:59.711 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.711 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.711 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:59.711 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535834+0000", 2024-09-12T00:03:59.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2859999999999998e-06 2024-09-12T00:03:59.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:59.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535846+0000", 2024-09-12T00:03:59.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1643e-05 2024-09-12T00:03:59.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:59.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535877+0000", 2024-09-12T00:03:59.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1457000000000001e-05 2024-09-12T00:03:59.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:59.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535894+0000", 2024-09-12T00:03:59.713 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.668e-05 2024-09-12T00:03:59.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.713 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.713 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:59.713 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535981+0000", 2024-09-12T00:03:59.713 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6823000000000005e-05 2024-09-12T00:03:59.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.713 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.713 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:59.713 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536086+0000", 2024-09-12T00:03:59.713 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010566200000000001 2024-09-12T00:03:59.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.713 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.714 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:59.714 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536330+0000", 2024-09-12T00:03:59.714 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024399999999999999 2024-09-12T00:03:59.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.714 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.714 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:59.714 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538288+0000", 2024-09-12T00:03:59.714 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0019575740000000001 2024-09-12T00:03:59.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.714 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.714 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:59.714 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539574+0000", 2024-09-12T00:03:59.714 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012862259999999999 2024-09-12T00:03:59.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.715 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.715 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:59.715 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539696+0000", 2024-09-12T00:03:59.715 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012190599999999999 2024-09-12T00:03:59.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.715 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.715 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:59.715 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539774+0000", 2024-09-12T00:03:59.715 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7708999999999997e-05 2024-09-12T00:03:59.715 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.715 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:59.715 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.716 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.716 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:464 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:59.716 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:03:59.716 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 25.113586883, 2024-09-12T00:03:59.716 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048192310000000002, 2024-09-12T00:03:59.716 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:59.716 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:59.716 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:59.716 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:59.716 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:59.716 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:59.716 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 464 2024-09-12T00:03:59.716 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.716 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:59.717 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.717 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:59.717 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:03:59.717 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.717 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.717 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:59.717 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:03:59.717 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.717 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.717 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:59.717 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544395+0000", 2024-09-12T00:03:59.717 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.905e-06 2024-09-12T00:03:59.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:59.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544405+0000", 2024-09-12T00:03:59.718 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0583e-05 2024-09-12T00:03:59.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:59.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544435+0000", 2024-09-12T00:03:59.718 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9431e-05 2024-09-12T00:03:59.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:59.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544468+0000", 2024-09-12T00:03:59.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2978999999999997e-05 2024-09-12T00:03:59.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.719 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:59.719 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544573+0000", 2024-09-12T00:03:59.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105165 2024-09-12T00:03:59.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.719 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:59.719 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544714+0000", 2024-09-12T00:03:59.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000141061 2024-09-12T00:03:59.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.720 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:59.720 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.545414+0000", 2024-09-12T00:03:59.720 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00070066200000000001 2024-09-12T00:03:59.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.720 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.720 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:59.720 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.547475+0000", 2024-09-12T00:03:59.720 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020609119999999998 2024-09-12T00:03:59.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.720 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.720 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:59.720 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549067+0000", 2024-09-12T00:03:59.720 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015914989999999999 2024-09-12T00:03:59.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.721 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.721 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:59.721 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549143+0000", 2024-09-12T00:03:59.721 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5795000000000002e-05 2024-09-12T00:03:59.721 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.721 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.721 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:59.721 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549212+0000", 2024-09-12T00:03:59.721 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9239000000000006e-05 2024-09-12T00:03:59.721 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.721 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:59.721 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.721 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.721 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.722 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:495 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:59.722 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:03:59.722 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 25.102517384999999, 2024-09-12T00:03:59.722 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052520209999999999, 2024-09-12T00:03:59.722 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:59.722 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:59.722 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:59.722 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:59.722 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:59.722 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:59.722 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 495 2024-09-12T00:03:59.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.722 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:59.722 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.722 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:59.723 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:03:59.723 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.723 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:59.723 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:03:59.723 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.723 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:59.723 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555464+0000", 2024-09-12T00:03:59.723 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8870000000000001e-06 2024-09-12T00:03:59.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.724 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:59.724 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555473+0000", 2024-09-12T00:03:59.724 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2399999999999996e-06 2024-09-12T00:03:59.724 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.724 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.724 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:59.724 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555496+0000", 2024-09-12T00:03:59.724 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2952e-05 2024-09-12T00:03:59.724 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.724 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.724 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:59.724 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555508+0000", 2024-09-12T00:03:59.724 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1548e-05 2024-09-12T00:03:59.724 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.724 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.725 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:59.725 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555596+0000", 2024-09-12T00:03:59.725 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8295999999999996e-05 2024-09-12T00:03:59.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.725 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.725 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:59.725 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555683+0000", 2024-09-12T00:03:59.725 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7267000000000003e-05 2024-09-12T00:03:59.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.725 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.725 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:59.725 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555862+0000", 2024-09-12T00:03:59.725 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017910699999999999 2024-09-12T00:03:59.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.726 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.726 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:59.726 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.556696+0000", 2024-09-12T00:03:59.726 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000833353 2024-09-12T00:03:59.726 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.726 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.726 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:59.726 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560563+0000", 2024-09-12T00:03:59.726 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038672089999999999 2024-09-12T00:03:59.726 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.726 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.726 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:59.726 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560642+0000", 2024-09-12T00:03:59.726 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.8909e-05 2024-09-12T00:03:59.727 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.727 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.727 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:59.727 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560714+0000", 2024-09-12T00:03:59.727 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2253000000000001e-05 2024-09-12T00:03:59.727 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.727 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:59.727 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.727 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.727 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.727 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:631 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:59.727 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:03:59.727 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 25.066689831000001, 2024-09-12T00:03:59.727 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0072389480000000003, 2024-09-12T00:03:59.727 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:59.728 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:59.728 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:59.728 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:59.728 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:59.728 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:59.728 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 631 2024-09-12T00:03:59.728 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.728 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:59.728 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.728 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:59.728 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:03:59.728 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.728 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.728 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.729 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:59.729 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:03:59.729 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.729 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.729 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:59.729 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591292+0000", 2024-09-12T00:03:59.729 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0760000000000001e-06 2024-09-12T00:03:59.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.729 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.729 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:59.729 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591301+0000", 2024-09-12T00:03:59.729 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3880000000000006e-06 2024-09-12T00:03:59.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.730 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.730 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:59.730 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591323+0000", 2024-09-12T00:03:59.730 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2121999999999999e-05 2024-09-12T00:03:59.730 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.730 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.730 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:59.730 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591338+0000", 2024-09-12T00:03:59.730 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5126999999999999e-05 2024-09-12T00:03:59.730 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.730 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.730 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:59.730 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591449+0000", 2024-09-12T00:03:59.730 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011054500000000001 2024-09-12T00:03:59.731 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.731 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.731 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:59.731 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591682+0000", 2024-09-12T00:03:59.731 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023258 2024-09-12T00:03:59.731 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.731 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.731 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:59.731 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.592011+0000", 2024-09-12T00:03:59.731 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00032941699999999998 2024-09-12T00:03:59.731 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.731 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.731 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:59.731 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593493+0000", 2024-09-12T00:03:59.731 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014821599999999999 2024-09-12T00:03:59.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.732 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.732 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:59.732 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598356+0000", 2024-09-12T00:03:59.732 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048625329999999996 2024-09-12T00:03:59.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.732 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.732 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:59.732 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598456+0000", 2024-09-12T00:03:59.732 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9878999999999997e-05 2024-09-12T00:03:59.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.732 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.732 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:59.732 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598529+0000", 2024-09-12T00:03:59.733 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3120999999999993e-05 2024-09-12T00:03:59.733 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.733 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:59.733 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.733 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.733 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.733 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:650 6.4 6:26625e58:lc::lc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:59.733 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:03:59.733 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 25.058292287, 2024-09-12T00:03:59.733 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042727010000000003, 2024-09-12T00:03:59.733 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:59.733 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:59.733 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:59.733 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:59.734 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:59.734 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:59.734 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 650 2024-09-12T00:03:59.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.734 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:59.734 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.734 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:59.734 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:03:59.734 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.734 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.734 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:59.734 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:03:59.734 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.735 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.735 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.735 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:59.735 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599689+0000", 2024-09-12T00:03:59.735 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3179999999999999e-06 2024-09-12T00:03:59.735 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.735 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.735 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:59.735 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599696+0000", 2024-09-12T00:03:59.735 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9580000000000001e-06 2024-09-12T00:03:59.735 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.735 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.735 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:59.735 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599714+0000", 2024-09-12T00:03:59.735 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8099999999999999e-05 2024-09-12T00:03:59.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.736 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.736 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:59.736 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599724+0000", 2024-09-12T00:03:59.736 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0492999999999999e-05 2024-09-12T00:03:59.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.736 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.736 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:59.736 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599799+0000", 2024-09-12T00:03:59.736 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5228999999999994e-05 2024-09-12T00:03:59.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.736 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.736 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:59.736 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599897+0000", 2024-09-12T00:03:59.737 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7476e-05 2024-09-12T00:03:59.737 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.737 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.737 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:59.737 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.600047+0000", 2024-09-12T00:03:59.737 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015028 2024-09-12T00:03:59.737 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.737 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.737 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:59.737 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.602604+0000", 2024-09-12T00:03:59.737 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0025571729999999998 2024-09-12T00:03:59.737 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.737 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.737 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:59.737 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603880+0000", 2024-09-12T00:03:59.738 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012753700000000001 2024-09-12T00:03:59.738 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.738 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.738 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:59.738 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603923+0000", 2024-09-12T00:03:59.738 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3758999999999999e-05 2024-09-12T00:03:59.738 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.738 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.738 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:59.738 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603960+0000", 2024-09-12T00:03:59.738 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6545000000000003e-05 2024-09-12T00:03:59.738 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.738 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:59.738 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.739 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.739 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:744 6.0 6:0651570b:lc::lc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:59.739 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:03:59.739 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 25.024000859000001, 2024-09-12T00:03:59.739 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048046149999999999, 2024-09-12T00:03:59.739 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:59.739 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:59.739 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:59.739 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:59.739 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:59.739 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:59.739 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 744 2024-09-12T00:03:59.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.739 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:59.740 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.740 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:59.740 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:03:59.740 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.740 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.740 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:59.740 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:03:59.740 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.740 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.740 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:59.740 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633981+0000", 2024-09-12T00:03:59.741 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3740000000000001e-06 2024-09-12T00:03:59.741 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.741 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.741 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:59.741 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633991+0000", 2024-09-12T00:03:59.741 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7839999999999998e-06 2024-09-12T00:03:59.741 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.741 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.741 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:59.741 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634016+0000", 2024-09-12T00:03:59.741 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5075999999999998e-05 2024-09-12T00:03:59.741 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.741 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.741 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:59.742 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634031+0000", 2024-09-12T00:03:59.742 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5124e-05 2024-09-12T00:03:59.742 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.742 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.742 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:59.742 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634105+0000", 2024-09-12T00:03:59.742 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3595000000000003e-05 2024-09-12T00:03:59.742 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.742 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.742 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:59.742 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634183+0000", 2024-09-12T00:03:59.742 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7936999999999996e-05 2024-09-12T00:03:59.742 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.742 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.742 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:59.743 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634342+0000", 2024-09-12T00:03:59.743 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015910499999999999 2024-09-12T00:03:59.743 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.743 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.743 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:59.743 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.635262+0000", 2024-09-12T00:03:59.743 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00092051000000000003 2024-09-12T00:03:59.743 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.743 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.743 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:59.743 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638638+0000", 2024-09-12T00:03:59.743 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033756419999999999 2024-09-12T00:03:59.743 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.743 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.743 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:59.744 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638722+0000", 2024-09-12T00:03:59.744 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.4029000000000005e-05 2024-09-12T00:03:59.744 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.744 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.744 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:59.744 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638783+0000", 2024-09-12T00:03:59.744 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1439000000000006e-05 2024-09-12T00:03:59.744 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.744 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:59.744 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.744 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.744 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.744 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:875 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:59.744 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:03:59.745 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.974361428000002, 2024-09-12T00:03:59.745 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004522295, 2024-09-12T00:03:59.745 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:59.745 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:59.745 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:59.745 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:59.745 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:59.745 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:59.745 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 875 2024-09-12T00:03:59.745 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.745 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:59.745 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.745 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:59.745 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:03:59.746 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.746 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.746 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.746 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:59.746 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:03:59.746 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.746 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.746 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.746 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:59.746 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683623+0000", 2024-09-12T00:03:59.746 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7140000000000001e-06 2024-09-12T00:03:59.746 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.746 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.746 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:59.747 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683639+0000", 2024-09-12T00:03:59.747 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6203000000000001e-05 2024-09-12T00:03:59.747 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.747 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.747 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:59.747 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683677+0000", 2024-09-12T00:03:59.747 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8470999999999998e-05 2024-09-12T00:03:59.747 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.747 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.747 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:59.747 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683708+0000", 2024-09-12T00:03:59.747 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0793999999999997e-05 2024-09-12T00:03:59.747 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.747 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.747 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:59.748 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683827+0000", 2024-09-12T00:03:59.748 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011832699999999999 2024-09-12T00:03:59.748 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.748 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.748 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:59.748 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683945+0000", 2024-09-12T00:03:59.748 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118301 2024-09-12T00:03:59.748 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.748 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.748 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:03:59.748 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.684226+0000", 2024-09-12T00:03:59.748 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000280604 2024-09-12T00:03:59.748 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.749 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.749 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:59.749 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685790+0000", 2024-09-12T00:03:59.749 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001564651 2024-09-12T00:03:59.749 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.749 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.749 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:59.749 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688028+0000", 2024-09-12T00:03:59.749 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0022381129999999999 2024-09-12T00:03:59.749 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.749 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.749 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:59.749 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688093+0000", 2024-09-12T00:03:59.749 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4329e-05 2024-09-12T00:03:59.749 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.750 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.750 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:59.750 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688140+0000", 2024-09-12T00:03:59.750 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7787999999999997e-05 2024-09-12T00:03:59.750 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.750 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:59.750 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.750 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.750 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.750 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:878 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:59.750 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:03:59.750 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.972717298999999, 2024-09-12T00:03:59.750 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037933009999999998, 2024-09-12T00:03:59.750 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:59.751 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:59.751 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:59.751 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:59.751 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:59.751 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:59.751 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 878 2024-09-12T00:03:59.751 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.751 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:59.751 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.751 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:59.751 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:03:59.751 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.751 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.751 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.751 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:59.752 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:03:59.752 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.752 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.752 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.752 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:59.752 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685265+0000", 2024-09-12T00:03:59.752 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.525e-06 2024-09-12T00:03:59.752 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.752 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.752 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:59.752 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685276+0000", 2024-09-12T00:03:59.752 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.076e-05 2024-09-12T00:03:59.752 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.752 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.753 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:59.753 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685306+0000", 2024-09-12T00:03:59.753 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0803000000000003e-05 2024-09-12T00:03:59.753 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.753 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.753 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:59.753 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685327+0000", 2024-09-12T00:03:59.753 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1061e-05 2024-09-12T00:03:59.753 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.753 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.753 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:59.753 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685429+0000", 2024-09-12T00:03:59.753 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000102015 2024-09-12T00:03:59.753 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.754 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.754 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:59.754 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685580+0000", 2024-09-12T00:03:59.754 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000151096 2024-09-12T00:03:59.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.754 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.754 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:59.754 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685861+0000", 2024-09-12T00:03:59.754 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028068100000000002 2024-09-12T00:03:59.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.754 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.754 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:59.754 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688647+0000", 2024-09-12T00:03:59.754 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0027860979999999999 2024-09-12T00:03:59.755 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.755 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.755 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:59.755 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688909+0000", 2024-09-12T00:03:59.755 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026159600000000001 2024-09-12T00:03:59.755 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.755 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.755 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:59.755 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688991+0000", 2024-09-12T00:03:59.755 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2429999999999995e-05 2024-09-12T00:03:59.755 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.755 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.755 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:59.755 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689056+0000", 2024-09-12T00:03:59.755 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4236e-05 2024-09-12T00:03:59.756 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.756 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:59.756 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.756 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.756 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.756 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:881 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:59.756 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:03:59.756 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.972083116, 2024-09-12T00:03:59.756 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003307979, 2024-09-12T00:03:59.756 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:59.756 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:59.756 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:59.756 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:59.756 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:59.757 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:59.757 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 881 2024-09-12T00:03:59.757 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.757 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:59.757 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.757 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:59.757 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:03:59.757 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.757 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.757 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.757 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:59.757 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:03:59.757 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.757 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.758 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.758 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:59.758 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685898+0000", 2024-09-12T00:03:59.758 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4249999999999999e-06 2024-09-12T00:03:59.758 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.758 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.758 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:59.758 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685904+0000", 2024-09-12T00:03:59.758 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1290000000000001e-06 2024-09-12T00:03:59.758 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.758 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.758 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:59.758 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685917+0000", 2024-09-12T00:03:59.758 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2825e-05 2024-09-12T00:03:59.759 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.759 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.759 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:59.759 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685925+0000", 2024-09-12T00:03:59.759 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6589999999999996e-06 2024-09-12T00:03:59.759 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.759 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.759 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:59.759 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686156+0000", 2024-09-12T00:03:59.759 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023017299999999999 2024-09-12T00:03:59.759 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.759 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.759 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:59.759 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686365+0000", 2024-09-12T00:03:59.759 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000209442 2024-09-12T00:03:59.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.760 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.760 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:59.760 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686567+0000", 2024-09-12T00:03:59.760 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020237400000000001 2024-09-12T00:03:59.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.760 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.760 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:59.760 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689076+0000", 2024-09-12T00:03:59.760 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002508957 2024-09-12T00:03:59.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.760 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.760 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:59.760 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689121+0000", 2024-09-12T00:03:59.761 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4561999999999998e-05 2024-09-12T00:03:59.761 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.761 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.761 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:59.761 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689168+0000", 2024-09-12T00:03:59.761 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7000999999999999e-05 2024-09-12T00:03:59.761 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.761 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.761 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:59.761 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689204+0000", 2024-09-12T00:03:59.761 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6431999999999999e-05 2024-09-12T00:03:59.761 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.761 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:59.761 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.762 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.762 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.762 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:894 6.0 6:05588ce8:lc::lc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:59.762 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:03:59.762 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.967727150000002, 2024-09-12T00:03:59.762 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040691010000000003, 2024-09-12T00:03:59.762 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:59.762 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:59.762 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:59.762 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:59.763 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:59.763 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:59.763 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 894 2024-09-12T00:03:59.763 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.763 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:59.763 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.763 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:59.763 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:03:59.763 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.763 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.763 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.763 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:59.763 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:03:59.763 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.764 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.764 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.764 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:59.764 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690253+0000", 2024-09-12T00:03:59.764 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.026e-06 2024-09-12T00:03:59.764 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.764 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.764 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:59.764 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690259+0000", 2024-09-12T00:03:59.764 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7389999999999996e-06 2024-09-12T00:03:59.764 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.764 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.764 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:59.764 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690273+0000", 2024-09-12T00:03:59.765 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3749e-05 2024-09-12T00:03:59.765 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.765 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.765 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:59.765 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690282+0000", 2024-09-12T00:03:59.765 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2520000000000005e-06 2024-09-12T00:03:59.765 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.765 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.765 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:59.765 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690704+0000", 2024-09-12T00:03:59.765 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042222199999999998 2024-09-12T00:03:59.765 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.765 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.765 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:59.766 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690826+0000", 2024-09-12T00:03:59.766 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012141099999999999 2024-09-12T00:03:59.766 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.766 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.766 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:03:59.766 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.691094+0000", 2024-09-12T00:03:59.766 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000268344 2024-09-12T00:03:59.766 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.766 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.766 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:59.766 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.693007+0000", 2024-09-12T00:03:59.766 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001912495 2024-09-12T00:03:59.766 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.766 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.767 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:59.767 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694184+0000", 2024-09-12T00:03:59.767 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00117786 2024-09-12T00:03:59.767 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.767 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.767 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:59.767 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694259+0000", 2024-09-12T00:03:59.767 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4091000000000006e-05 2024-09-12T00:03:59.767 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.767 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.767 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:59.767 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694321+0000", 2024-09-12T00:03:59.767 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2911999999999997e-05 2024-09-12T00:03:59.767 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.768 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:59.768 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.768 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.768 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.768 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1283 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:03:59.768 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:03:59.768 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.468408614000001, 2024-09-12T00:03:59.768 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00320967, 2024-09-12T00:03:59.768 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:03:59.768 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:03:59.768 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:03:59.768 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:03:59.768 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:03:59.768 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:03:59.769 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1283 2024-09-12T00:03:59.769 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.769 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:03:59.769 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.769 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:03:59.769 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:03:59.769 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.769 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.769 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.769 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:03:59.769 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:03:59.769 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:03:59.769 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.769 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.770 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:03:59.770 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189573+0000", 2024-09-12T00:03:59.770 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3130000000000001e-06 2024-09-12T00:03:59.770 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.770 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.770 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:03:59.770 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189583+0000", 2024-09-12T00:03:59.770 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4129999999999995e-06 2024-09-12T00:03:59.770 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.770 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.770 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:03:59.770 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189608+0000", 2024-09-12T00:03:59.770 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5863e-05 2024-09-12T00:03:59.770 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.771 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.771 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:03:59.771 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189628+0000", 2024-09-12T00:03:59.771 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9644e-05 2024-09-12T00:03:59.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.771 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.771 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:03:59.773 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189747+0000", 2024-09-12T00:03:59.773 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118999 2024-09-12T00:03:59.773 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.774 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.774 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:03:59.774 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189874+0000", 2024-09-12T00:03:59.774 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012674499999999999 2024-09-12T00:03:59.774 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.774 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.774 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:03:59.774 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.190148+0000", 2024-09-12T00:03:59.774 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000274431 2024-09-12T00:03:59.774 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.774 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.774 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:03:59.774 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.191174+0000", 2024-09-12T00:03:59.774 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001025855 2024-09-12T00:03:59.775 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.775 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.775 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:03:59.775 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192627+0000", 2024-09-12T00:03:59.775 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014527979999999999 2024-09-12T00:03:59.775 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.775 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.775 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:03:59.775 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192710+0000", 2024-09-12T00:03:59.775 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3146000000000007e-05 2024-09-12T00:03:59.775 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:03:59.775 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:03:59.775 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:03:59.775 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192781+0000", 2024-09-12T00:03:59.775 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.0463000000000006e-05 2024-09-12T00:03:59.776 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.776 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:59.776 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.776 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:03:59.776 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:03:59.776 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:03:59.777 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:03:59.778 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:03:59.777+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:03:59.878 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:03:59.877+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:03:59.917 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:03:59.917 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:03:59.917 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:03:59.917 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:03:59.931 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:03:59.979 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:03:59.980+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:00.079 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:00.080+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:00.114 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:00.115 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:00.115 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:00.115 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:00.115 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:00.130 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:04:00.183 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:00.181+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:00.260 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:00.261 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:00.261 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:00.261 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:00.261 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.261 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:00.261 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 28.930554394000001, 2024-09-12T00:04:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.027441031000000001, 2024-09-12T00:04:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:04:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:00.263 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.263 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.263 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.263 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.263 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:00.264 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.264 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.265 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.265 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.265 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330357+0000", 2024-09-12T00:04:00.265 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2339999999999996e-06 2024-09-12T00:04:00.265 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.265 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.265 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.265 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330381+0000", 2024-09-12T00:04:00.265 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4626000000000001e-05 2024-09-12T00:04:00.265 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.265 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.265 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330417+0000", 2024-09-12T00:04:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5886000000000002e-05 2024-09-12T00:04:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330442+0000", 2024-09-12T00:04:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4522999999999999e-05 2024-09-12T00:04:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335485+0000", 2024-09-12T00:04:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050432589999999996 2024-09-12T00:04:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.267 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:00.267 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335507+0000", 2024-09-12T00:04:00.267 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2013000000000001e-05 2024-09-12T00:04:00.267 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.267 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.267 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.267 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.351747+0000", 2024-09-12T00:04:00.267 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016240451999999999 2024-09-12T00:04:00.267 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.267 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.267 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.267 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352062+0000", 2024-09-12T00:04:00.267 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031433399999999999 2024-09-12T00:04:00.268 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.268 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.268 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:00.268 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352378+0000", 2024-09-12T00:04:00.268 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031586400000000001 2024-09-12T00:04:00.268 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.268 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.268 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.268 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.355074+0000", 2024-09-12T00:04:00.268 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026962919999999999 2024-09-12T00:04:00.268 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.268 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.268 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.268 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357537+0000", 2024-09-12T00:04:00.269 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024634689999999998 2024-09-12T00:04:00.269 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.269 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.269 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.269 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357680+0000", 2024-09-12T00:04:00.269 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014314899999999999 2024-09-12T00:04:00.269 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.269 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.269 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.269 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357793+0000", 2024-09-12T00:04:00.269 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011293 2024-09-12T00:04:00.269 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.270 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.270 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.270 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.270 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.270 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94232250902656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:00.270 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:00.270 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 28.902639233999999, 2024-09-12T00:04:00.271 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052696050000000001, 2024-09-12T00:04:00.271 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.271 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.271 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.271 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.271 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:00.271 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:00.271 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:04:00.271 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.272 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.272 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.272 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.272 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:00.272 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.272 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.272 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.272 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358270+0000", 2024-09-12T00:04:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.17e-06 2024-09-12T00:04:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358278+0000", 2024-09-12T00:04:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3529999999999995e-06 2024-09-12T00:04:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.274 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.274 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358306+0000", 2024-09-12T00:04:00.274 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7763000000000002e-05 2024-09-12T00:04:00.274 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.274 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.274 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.274 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358324+0000", 2024-09-12T00:04:00.274 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7861000000000001e-05 2024-09-12T00:04:00.274 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.274 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.274 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.274 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358447+0000", 2024-09-12T00:04:00.274 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012334299999999999 2024-09-12T00:04:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358624+0000", 2024-09-12T00:04:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017684999999999999 2024-09-12T00:04:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358964+0000", 2024-09-12T00:04:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00033991199999999999 2024-09-12T00:04:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.362920+0000", 2024-09-12T00:04:00.276 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039564600000000002 2024-09-12T00:04:00.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.276 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.276 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.276 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363016+0000", 2024-09-12T00:04:00.276 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5612999999999994e-05 2024-09-12T00:04:00.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.276 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.276 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.276 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363244+0000", 2024-09-12T00:04:00.276 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000228385 2024-09-12T00:04:00.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.276 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.276 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363537+0000", 2024-09-12T00:04:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00029289499999999999 2024-09-12T00:04:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 25.895261717, 2024-09-12T00:04:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011415537, 2024-09-12T00:04:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 209 2024-09-12T00:04:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365648+0000", 2024-09-12T00:04:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7360000000000001e-06 2024-09-12T00:04:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365660+0000", 2024-09-12T00:04:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2089999999999999e-05 2024-09-12T00:04:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365690+0000", 2024-09-12T00:04:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0320000000000001e-05 2024-09-12T00:04:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365708+0000", 2024-09-12T00:04:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7520000000000002e-05 2024-09-12T00:04:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365870+0000", 2024-09-12T00:04:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016208600000000001 2024-09-12T00:04:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.281 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.281 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:00.281 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365885+0000", 2024-09-12T00:04:00.281 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5119999999999999e-05 2024-09-12T00:04:00.281 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.281 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.281 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.281 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373482+0000", 2024-09-12T00:04:00.281 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075970279999999996 2024-09-12T00:04:00.281 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.281 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.281 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.281 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373805+0000", 2024-09-12T00:04:00.282 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032262799999999999 2024-09-12T00:04:00.282 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.282 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.282 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:00.282 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.374297+0000", 2024-09-12T00:04:00.282 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00049250599999999998 2024-09-12T00:04:00.282 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.282 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.282 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.282 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.375670+0000", 2024-09-12T00:04:00.283 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001373333 2024-09-12T00:04:00.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.283 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.283 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.283 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.376923+0000", 2024-09-12T00:04:00.283 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012525640000000001 2024-09-12T00:04:00.284 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.284 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.284 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.284 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377000+0000", 2024-09-12T00:04:00.284 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6732999999999999e-05 2024-09-12T00:04:00.284 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.284 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.285 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.285 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377061+0000", 2024-09-12T00:04:00.285 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0872999999999998e-05 2024-09-12T00:04:00.285 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.285 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.285 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.285 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.285 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.286 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:240 6.19 6:9f626c48:lc::lc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:00.286 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:00.286 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 25.776675963999999, 2024-09-12T00:04:00.286 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058545680000000001, 2024-09-12T00:04:00.286 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.286 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.286 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.286 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.286 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:00.286 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:00.286 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 240 2024-09-12T00:04:00.287 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.287 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.287 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.287 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.287 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:00.287 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.287 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.287 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.287 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.287 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:00.287 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.288 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.288 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.288 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.288 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484233+0000", 2024-09-12T00:04:00.288 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.973e-06 2024-09-12T00:04:00.288 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.288 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.288 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.288 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484241+0000", 2024-09-12T00:04:00.288 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8210000000000002e-06 2024-09-12T00:04:00.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.289 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.289 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.289 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484260+0000", 2024-09-12T00:04:00.289 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9148999999999999e-05 2024-09-12T00:04:00.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.289 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.289 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.290 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484268+0000", 2024-09-12T00:04:00.290 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5120000000000008e-06 2024-09-12T00:04:00.290 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.290 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.290 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.290 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484371+0000", 2024-09-12T00:04:00.290 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102501 2024-09-12T00:04:00.290 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.290 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.291 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.291 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484450+0000", 2024-09-12T00:04:00.291 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9122999999999994e-05 2024-09-12T00:04:00.291 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.291 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.291 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:00.291 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484578+0000", 2024-09-12T00:04:00.291 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000128095 2024-09-12T00:04:00.291 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.291 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.291 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.292 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.485336+0000", 2024-09-12T00:04:00.292 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00075754000000000001 2024-09-12T00:04:00.292 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.292 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.292 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.292 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.489975+0000", 2024-09-12T00:04:00.292 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004639738 2024-09-12T00:04:00.292 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.292 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.293 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.293 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490043+0000", 2024-09-12T00:04:00.293 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7923999999999995e-05 2024-09-12T00:04:00.293 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.293 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.293 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.293 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490085+0000", 2024-09-12T00:04:00.293 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2191999999999999e-05 2024-09-12T00:04:00.293 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.294 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.294 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.294 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.294 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.294 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:412 6.3 6:c3a682d4:reshard::reshard.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:00.294 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:00.294 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 25.734280558000002, 2024-09-12T00:04:00.294 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049075530000000003, 2024-09-12T00:04:00.294 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.294 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.294 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.294 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.295 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:00.295 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:00.295 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 412 2024-09-12T00:04:00.295 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.295 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.295 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.295 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.295 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:00.296 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.296 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.296 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.296 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.296 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:00.296 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.296 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.296 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.297 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.297 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526628+0000", 2024-09-12T00:04:00.297 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.513e-06 2024-09-12T00:04:00.297 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.297 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.297 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.297 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526634+0000", 2024-09-12T00:04:00.298 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1279999999999996e-06 2024-09-12T00:04:00.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.298 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.298 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.298 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526649+0000", 2024-09-12T00:04:00.298 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4997999999999999e-05 2024-09-12T00:04:00.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.298 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.299 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.299 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526658+0000", 2024-09-12T00:04:00.299 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1589999999999999e-06 2024-09-12T00:04:00.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.299 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.299 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.299 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526728+0000", 2024-09-12T00:04:00.299 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0203999999999994e-05 2024-09-12T00:04:00.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.300 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.300 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.300 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526839+0000", 2024-09-12T00:04:00.300 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011055 2024-09-12T00:04:00.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.300 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.300 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:00.300 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526979+0000", 2024-09-12T00:04:00.301 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139863 2024-09-12T00:04:00.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.301 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.301 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.301 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.527616+0000", 2024-09-12T00:04:00.301 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00063707900000000003 2024-09-12T00:04:00.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.302 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.302 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.302 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531450+0000", 2024-09-12T00:04:00.302 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003833819 2024-09-12T00:04:00.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.302 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.302 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.302 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531490+0000", 2024-09-12T00:04:00.302 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0129000000000002e-05 2024-09-12T00:04:00.303 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.303 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.303 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.303 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531534+0000", 2024-09-12T00:04:00.303 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4110999999999998e-05 2024-09-12T00:04:00.303 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.303 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.304 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.304 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.304 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.304 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:490 6.19 6:9dc32cef:lc::lc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:00.304 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:00.304 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 25.710083183999998, 2024-09-12T00:04:00.304 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047438380000000002, 2024-09-12T00:04:00.304 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.304 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.304 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.304 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.305 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:00.305 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:00.305 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 490 2024-09-12T00:04:00.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.305 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.305 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.305 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.305 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:00.305 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.305 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.305 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.306 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:00.306 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.306 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.306 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.306 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.306 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550825+0000", 2024-09-12T00:04:00.306 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0589999999999999e-06 2024-09-12T00:04:00.306 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.306 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.307 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.307 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550830+0000", 2024-09-12T00:04:00.307 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2140000000000004e-06 2024-09-12T00:04:00.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.307 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.307 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.307 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550843+0000", 2024-09-12T00:04:00.307 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3404000000000001e-05 2024-09-12T00:04:00.308 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.308 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.308 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.308 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550852+0000", 2024-09-12T00:04:00.308 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1549999999999996e-06 2024-09-12T00:04:00.308 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.309 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.309 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.309 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550910+0000", 2024-09-12T00:04:00.309 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7636000000000002e-05 2024-09-12T00:04:00.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.309 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.309 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550977+0000", 2024-09-12T00:04:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6636000000000004e-05 2024-09-12T00:04:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.551135+0000", 2024-09-12T00:04:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015852999999999999 2024-09-12T00:04:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552939+0000", 2024-09-12T00:04:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001803643 2024-09-12T00:04:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.311 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.311 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.311 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555471+0000", 2024-09-12T00:04:00.311 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002532327 2024-09-12T00:04:00.311 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.311 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.311 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.311 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555526+0000", 2024-09-12T00:04:00.311 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4728000000000002e-05 2024-09-12T00:04:00.311 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.312 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.312 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.312 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555567+0000", 2024-09-12T00:04:00.312 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1505999999999999e-05 2024-09-12T00:04:00.312 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.312 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.312 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.312 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.313 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.313 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:492 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'6, mlcod=35'4)", 2024-09-12T00:04:00.313 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:00.313 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 25.708307120000001, 2024-09-12T00:04:00.313 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056118790000000002, 2024-09-12T00:04:00.313 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.313 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.313 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.313 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.313 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.313 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.313 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552601+0000", 2024-09-12T00:04:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6899999999999996e-07 2024-09-12T00:04:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.315 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552608+0000", 2024-09-12T00:04:00.315 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4529999999999996e-06 2024-09-12T00:04:00.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.315 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.315 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.315 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552624+0000", 2024-09-12T00:04:00.315 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5885000000000001e-05 2024-09-12T00:04:00.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.315 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.315 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.315 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552632+0000", 2024-09-12T00:04:00.315 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2220000000000002e-06 2024-09-12T00:04:00.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.316 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.316 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.316 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552716+0000", 2024-09-12T00:04:00.316 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4060999999999994e-05 2024-09-12T00:04:00.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.316 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.316 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.316 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552735+0000", 2024-09-12T00:04:00.316 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9170000000000001e-05 2024-09-12T00:04:00.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.316 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.317 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.317 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558164+0000", 2024-09-12T00:04:00.317 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054289899999999999 2024-09-12T00:04:00.317 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.317 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.317 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.317 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558212+0000", 2024-09-12T00:04:00.317 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7129000000000002e-05 2024-09-12T00:04:00.317 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.317 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.317 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.318 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.318 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.318 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:496 6.3 6:c134263f:lc::lc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:00.318 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:00.318 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 25.707199832000001, 2024-09-12T00:04:00.318 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045956260000000002, 2024-09-12T00:04:00.318 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.318 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.319 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.319 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.319 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:00.319 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:00.319 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 496 2024-09-12T00:04:00.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.319 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.319 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.320 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.320 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:00.320 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.320 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.320 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.320 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.320 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:00.320 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.320 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.321 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.321 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.321 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553708+0000", 2024-09-12T00:04:00.321 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2359999999999999e-06 2024-09-12T00:04:00.321 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.321 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.321 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.321 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553714+0000", 2024-09-12T00:04:00.321 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4960000000000004e-06 2024-09-12T00:04:00.321 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.322 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.322 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.322 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553726+0000", 2024-09-12T00:04:00.322 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2618e-05 2024-09-12T00:04:00.322 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.322 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.322 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.322 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553734+0000", 2024-09-12T00:04:00.322 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4159999999999998e-06 2024-09-12T00:04:00.322 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.323 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.323 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.323 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553771+0000", 2024-09-12T00:04:00.323 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7095999999999999e-05 2024-09-12T00:04:00.323 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.323 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.323 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.323 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553815+0000", 2024-09-12T00:04:00.323 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3986999999999997e-05 2024-09-12T00:04:00.324 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.324 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.324 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:00.324 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553922+0000", 2024-09-12T00:04:00.324 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000107534 2024-09-12T00:04:00.324 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.324 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.324 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.324 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555052+0000", 2024-09-12T00:04:00.325 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011298359999999999 2024-09-12T00:04:00.325 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.325 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.325 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.325 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558197+0000", 2024-09-12T00:04:00.325 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0031450269999999999 2024-09-12T00:04:00.325 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.326 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.326 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.326 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558256+0000", 2024-09-12T00:04:00.326 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8403999999999999e-05 2024-09-12T00:04:00.326 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.326 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.326 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.326 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558303+0000", 2024-09-12T00:04:00.326 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6975999999999999e-05 2024-09-12T00:04:00.327 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.327 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.327 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.327 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.327 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.327 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:641 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:00.327 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:00.327 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 25.667129504999998, 2024-09-12T00:04:00.327 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052824789999999996, 2024-09-12T00:04:00.327 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.328 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.328 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.328 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.328 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:00.328 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:00.328 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 641 2024-09-12T00:04:00.328 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.329 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.329 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.329 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.329 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:00.329 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.329 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.329 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.330 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.330 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:00.330 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.330 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.330 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.330 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.330 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593778+0000", 2024-09-12T00:04:00.331 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0920000000000001e-06 2024-09-12T00:04:00.331 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.331 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.331 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.331 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593783+0000", 2024-09-12T00:04:00.331 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9490000000000004e-06 2024-09-12T00:04:00.331 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.331 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.331 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.332 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593795+0000", 2024-09-12T00:04:00.332 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2048999999999999e-05 2024-09-12T00:04:00.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.332 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.332 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.332 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593801+0000", 2024-09-12T00:04:00.332 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8989999999999998e-06 2024-09-12T00:04:00.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.332 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.332 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.333 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593852+0000", 2024-09-12T00:04:00.333 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1057999999999998e-05 2024-09-12T00:04:00.333 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.333 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.333 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.333 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593905+0000", 2024-09-12T00:04:00.333 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2196e-05 2024-09-12T00:04:00.333 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.333 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.333 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:00.334 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594017+0000", 2024-09-12T00:04:00.334 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000112816 2024-09-12T00:04:00.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.334 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.334 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.334 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.595190+0000", 2024-09-12T00:04:00.334 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011727199999999999 2024-09-12T00:04:00.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.334 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.335 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.335 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.598998+0000", 2024-09-12T00:04:00.335 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038081320000000001 2024-09-12T00:04:00.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.335 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.335 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.335 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599032+0000", 2024-09-12T00:04:00.335 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4283999999999999e-05 2024-09-12T00:04:00.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.335 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.335 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.335 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599060+0000", 2024-09-12T00:04:00.335 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7284000000000002e-05 2024-09-12T00:04:00.336 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.336 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.336 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.336 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.336 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.336 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:643 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'8, mlcod=35'6)", 2024-09-12T00:04:00.336 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:00.336 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 25.666631398, 2024-09-12T00:04:00.336 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048211260000000002, 2024-09-12T00:04:00.336 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.336 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.336 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.336 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594276+0000", 2024-09-12T00:04:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5899999999999995e-07 2024-09-12T00:04:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594283+0000", 2024-09-12T00:04:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6019999999999996e-06 2024-09-12T00:04:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594295+0000", 2024-09-12T00:04:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1683e-05 2024-09-12T00:04:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594303+0000", 2024-09-12T00:04:00.339 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0439999999999996e-06 2024-09-12T00:04:00.339 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.339 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.339 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.339 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594353+0000", 2024-09-12T00:04:00.339 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0698000000000001e-05 2024-09-12T00:04:00.339 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.339 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.339 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.339 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594380+0000", 2024-09-12T00:04:00.340 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7089000000000001e-05 2024-09-12T00:04:00.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.340 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.340 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.340 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599063+0000", 2024-09-12T00:04:00.340 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046824739999999998 2024-09-12T00:04:00.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.340 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.340 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.340 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599096+0000", 2024-09-12T00:04:00.341 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3677000000000003e-05 2024-09-12T00:04:00.341 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.341 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.341 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.341 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.341 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:647 6.a 6:5395e6f3:lc::lc.4:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:00.341 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:00.341 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 25.664280765000001, 2024-09-12T00:04:00.341 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049071770000000004, 2024-09-12T00:04:00.341 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.341 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.341 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.341 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.342 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:00.342 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:00.342 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 647 2024-09-12T00:04:00.342 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.342 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.342 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.342 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.342 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:00.342 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.342 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.343 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.343 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.343 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:00.343 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.343 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.343 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.343 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596627+0000", 2024-09-12T00:04:00.344 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1149999999999999e-06 2024-09-12T00:04:00.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.344 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.344 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.344 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596632+0000", 2024-09-12T00:04:00.344 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7060000000000003e-06 2024-09-12T00:04:00.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.344 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.344 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.345 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596645+0000", 2024-09-12T00:04:00.345 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2791e-05 2024-09-12T00:04:00.345 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.345 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.345 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.345 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596653+0000", 2024-09-12T00:04:00.345 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9230000000000002e-06 2024-09-12T00:04:00.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.346 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.346 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.346 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596705+0000", 2024-09-12T00:04:00.346 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2250000000000003e-05 2024-09-12T00:04:00.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.346 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.346 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.347 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596758+0000", 2024-09-12T00:04:00.347 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2964000000000003e-05 2024-09-12T00:04:00.347 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.347 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:00.347 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596873+0000", 2024-09-12T00:04:00.347 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011501 2024-09-12T00:04:00.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.348 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.348 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.348 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599088+0000", 2024-09-12T00:04:00.348 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002215135 2024-09-12T00:04:00.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.348 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.349 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.349 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601456+0000", 2024-09-12T00:04:00.349 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023684719999999999 2024-09-12T00:04:00.349 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.349 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.349 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.349 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601507+0000", 2024-09-12T00:04:00.349 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0933999999999997e-05 2024-09-12T00:04:00.350 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.350 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.350 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.350 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601533+0000", 2024-09-12T00:04:00.350 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5877e-05 2024-09-12T00:04:00.350 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.350 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.350 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.350 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.350 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.350 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:657 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'10, mlcod=35'7)", 2024-09-12T00:04:00.350 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:00.350 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 25.660457225000002, 2024-09-12T00:04:00.350 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066410239999999997, 2024-09-12T00:04:00.351 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.351 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.351 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.351 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.351 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.351 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.351 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:00.351 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.351 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.351 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.351 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:00.351 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.352 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.352 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.352 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:00.352 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6099999999999999e-07 2024-09-12T00:04:00.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.352 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.352 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.352 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600457+0000", 2024-09-12T00:04:00.352 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8700000000000003e-06 2024-09-12T00:04:00.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.352 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.352 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.352 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600470+0000", 2024-09-12T00:04:00.353 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3186999999999999e-05 2024-09-12T00:04:00.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.353 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.353 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.353 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600478+0000", 2024-09-12T00:04:00.353 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5310000000000004e-06 2024-09-12T00:04:00.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.353 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.353 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.353 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600521+0000", 2024-09-12T00:04:00.353 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2574000000000003e-05 2024-09-12T00:04:00.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.353 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.353 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.354 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600535+0000", 2024-09-12T00:04:00.354 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4151000000000001e-05 2024-09-12T00:04:00.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.354 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.354 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.354 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.606997+0000", 2024-09-12T00:04:00.354 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064626099999999997 2024-09-12T00:04:00.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.354 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.354 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.354 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607091+0000", 2024-09-12T00:04:00.354 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3239999999999995e-05 2024-09-12T00:04:00.354 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.354 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.354 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.355 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.355 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.355 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:659 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:00.355 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:00.355 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 25.660284893, 2024-09-12T00:04:00.355 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0065340989999999998, 2024-09-12T00:04:00.355 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.355 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.355 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.355 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.355 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:00.355 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:00.355 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 659 2024-09-12T00:04:00.355 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.356 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.356 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.356 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.356 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:00.356 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.356 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.356 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.356 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:00.356 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.356 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.356 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.357 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600623+0000", 2024-09-12T00:04:00.357 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.085e-06 2024-09-12T00:04:00.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.357 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.357 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.357 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600630+0000", 2024-09-12T00:04:00.357 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0029999999999997e-06 2024-09-12T00:04:00.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.357 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.357 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.357 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600647+0000", 2024-09-12T00:04:00.357 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6566999999999999e-05 2024-09-12T00:04:00.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.357 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.358 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.358 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600658+0000", 2024-09-12T00:04:00.358 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0992000000000001e-05 2024-09-12T00:04:00.358 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.358 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.358 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.358 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600717+0000", 2024-09-12T00:04:00.358 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9925e-05 2024-09-12T00:04:00.358 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.358 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.358 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.358 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600773+0000", 2024-09-12T00:04:00.358 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5766000000000001e-05 2024-09-12T00:04:00.358 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:00.359 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600889+0000", 2024-09-12T00:04:00.359 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115906 2024-09-12T00:04:00.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.359 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603483+0000", 2024-09-12T00:04:00.359 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025940799999999999 2024-09-12T00:04:00.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.359 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607098+0000", 2024-09-12T00:04:00.360 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036150459999999998 2024-09-12T00:04:00.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.360 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.360 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.360 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607133+0000", 2024-09-12T00:04:00.360 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4615e-05 2024-09-12T00:04:00.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.360 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.360 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.360 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607156+0000", 2024-09-12T00:04:00.360 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3113999999999999e-05 2024-09-12T00:04:00.360 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.360 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.360 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.361 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.361 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.361 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:666 6.a 6:5395e6f3:lc::lc.4:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:00.361 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:00.361 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 25.658537763999998, 2024-09-12T00:04:00.361 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.005127174, 2024-09-12T00:04:00.361 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.361 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.361 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.361 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.361 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:00.361 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:00.361 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 666 2024-09-12T00:04:00.361 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.362 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.362 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.362 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.362 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:00.362 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.362 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.362 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.362 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:00.362 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.362 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.362 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602370+0000", 2024-09-12T00:04:00.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0720000000000001e-06 2024-09-12T00:04:00.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.363 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602376+0000", 2024-09-12T00:04:00.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5489999999999997e-06 2024-09-12T00:04:00.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.363 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602391+0000", 2024-09-12T00:04:00.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5301000000000001e-05 2024-09-12T00:04:00.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602399+0000", 2024-09-12T00:04:00.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9179999999999994e-06 2024-09-12T00:04:00.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602456+0000", 2024-09-12T00:04:00.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7099999999999999e-05 2024-09-12T00:04:00.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602508+0000", 2024-09-12T00:04:00.365 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2476999999999999e-05 2024-09-12T00:04:00.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.365 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:00.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602606+0000", 2024-09-12T00:04:00.365 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7823000000000002e-05 2024-09-12T00:04:00.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.365 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.604653+0000", 2024-09-12T00:04:00.366 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002047068 2024-09-12T00:04:00.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.366 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.366 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.366 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607401+0000", 2024-09-12T00:04:00.366 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027477700000000001 2024-09-12T00:04:00.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.366 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.366 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.366 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607453+0000", 2024-09-12T00:04:00.366 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2092999999999997e-05 2024-09-12T00:04:00.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.366 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.366 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607496+0000", 2024-09-12T00:04:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3003000000000001e-05 2024-09-12T00:04:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:665 6.1a e35/29 6:5c7e8a6d:reshard::reshard.0000000015:head v 35'11, mlcod=35'8)", 2024-09-12T00:04:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 25.658166079000001, 2024-09-12T00:04:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048593209999999998, 2024-09-12T00:04:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.368 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.368 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.368 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:00.368 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.368 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.368 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:00.368 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.368 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.368 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602742+0000", 2024-09-12T00:04:00.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1069999999999999e-06 2024-09-12T00:04:00.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602749+0000", 2024-09-12T00:04:00.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9609999999999999e-06 2024-09-12T00:04:00.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602763+0000", 2024-09-12T00:04:00.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4086e-05 2024-09-12T00:04:00.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602772+0000", 2024-09-12T00:04:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8470000000000002e-06 2024-09-12T00:04:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602826+0000", 2024-09-12T00:04:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3885000000000003e-05 2024-09-12T00:04:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602837+0000", 2024-09-12T00:04:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1601e-05 2024-09-12T00:04:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607500+0000", 2024-09-12T00:04:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046627509999999997 2024-09-12T00:04:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607600+0000", 2024-09-12T00:04:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100083 2024-09-12T00:04:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.372 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.372 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:831 6.19 6:9d23f22c:lc::lc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:00.372 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:00.372 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 25.594881398999998, 2024-09-12T00:04:00.372 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047044610000000001, 2024-09-12T00:04:00.372 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.372 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.372 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.372 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.372 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:00.372 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:00.372 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 831 2024-09-12T00:04:00.372 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666026+0000", 2024-09-12T00:04:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.02e-06 2024-09-12T00:04:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666032+0000", 2024-09-12T00:04:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8850000000000004e-06 2024-09-12T00:04:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666047+0000", 2024-09-12T00:04:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4647999999999999e-05 2024-09-12T00:04:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.375 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666058+0000", 2024-09-12T00:04:00.375 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0905e-05 2024-09-12T00:04:00.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.375 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.375 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666376+0000", 2024-09-12T00:04:00.375 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031824899999999999 2024-09-12T00:04:00.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.375 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.375 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666479+0000", 2024-09-12T00:04:00.375 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102814 2024-09-12T00:04:00.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.376 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.376 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:00.376 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666635+0000", 2024-09-12T00:04:00.376 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000156343 2024-09-12T00:04:00.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.376 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.376 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.376 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.667611+0000", 2024-09-12T00:04:00.376 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000975671 2024-09-12T00:04:00.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.376 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.376 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.376 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670662+0000", 2024-09-12T00:04:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003050863 2024-09-12T00:04:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670701+0000", 2024-09-12T00:04:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9338000000000002e-05 2024-09-12T00:04:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670730+0000", 2024-09-12T00:04:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8725e-05 2024-09-12T00:04:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:852 6.1d e35/29 6:bbf2d10c:::obj_delete_at_hint.0000000025:head v 35'9, mlcod=35'7)", 2024-09-12T00:04:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 25.586304345999999, 2024-09-12T00:04:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00569595, 2024-09-12T00:04:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674604+0000", 2024-09-12T00:04:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2079999999999999e-06 2024-09-12T00:04:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674611+0000", 2024-09-12T00:04:00.380 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.973e-06 2024-09-12T00:04:00.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.380 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.380 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.380 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674625+0000", 2024-09-12T00:04:00.380 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3916e-05 2024-09-12T00:04:00.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.380 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.380 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.380 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674633+0000", 2024-09-12T00:04:00.380 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8580000000000006e-06 2024-09-12T00:04:00.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.380 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.381 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.381 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674697+0000", 2024-09-12T00:04:00.381 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4004999999999995e-05 2024-09-12T00:04:00.384 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.384 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.384 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.384 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674713+0000", 2024-09-12T00:04:00.384 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5835e-05 2024-09-12T00:04:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680245+0000", 2024-09-12T00:04:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055320250000000003 2024-09-12T00:04:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680298+0000", 2024-09-12T00:04:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3130000000000001e-05 2024-09-12T00:04:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.386 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.386 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:925 6.1a e35/29 6:5f2e3d26:lc::lc.18:head v 35'15, mlcod=35'12)", 2024-09-12T00:04:00.386 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:00.386 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 25.562776516, 2024-09-12T00:04:00.386 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055640999999999998, 2024-09-12T00:04:00.386 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.386 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.386 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.386 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.386 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.386 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.386 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698131+0000", 2024-09-12T00:04:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:04:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698140+0000", 2024-09-12T00:04:00.388 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3139999999999993e-06 2024-09-12T00:04:00.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.388 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.388 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.388 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698155+0000", 2024-09-12T00:04:00.388 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:04:00.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.388 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.388 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.388 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698164+0000", 2024-09-12T00:04:00.388 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1419999999999999e-06 2024-09-12T00:04:00.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.388 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698228+0000", 2024-09-12T00:04:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3380000000000006e-05 2024-09-12T00:04:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698252+0000", 2024-09-12T00:04:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4111e-05 2024-09-12T00:04:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703646+0000", 2024-09-12T00:04:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0053937840000000004 2024-09-12T00:04:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.390 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.390 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.390 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703694+0000", 2024-09-12T00:04:00.390 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8776999999999997e-05 2024-09-12T00:04:00.390 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.390 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.390 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.390 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.390 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.390 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:927 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:00.390 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:00.390 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 25.562257492000001, 2024-09-12T00:04:00.390 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050914949999999997, 2024-09-12T00:04:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 927 2024-09-12T00:04:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.392 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.392 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:00.392 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.392 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.392 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698651+0000", 2024-09-12T00:04:00.392 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3740000000000001e-06 2024-09-12T00:04:00.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.392 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698657+0000", 2024-09-12T00:04:00.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5239999999999997e-06 2024-09-12T00:04:00.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.393 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698673+0000", 2024-09-12T00:04:00.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5345999999999998e-05 2024-09-12T00:04:00.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.393 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698680+0000", 2024-09-12T00:04:00.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4649999999999997e-06 2024-09-12T00:04:00.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699009+0000", 2024-09-12T00:04:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032934000000000001 2024-09-12T00:04:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699213+0000", 2024-09-12T00:04:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020361500000000001 2024-09-12T00:04:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699450+0000", 2024-09-12T00:04:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023670399999999999 2024-09-12T00:04:00.395 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.395 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.395 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.395 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.700678+0000", 2024-09-12T00:04:00.395 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012285519999999999 2024-09-12T00:04:00.395 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.395 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.395 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.395 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703666+0000", 2024-09-12T00:04:00.395 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029876130000000001 2024-09-12T00:04:00.395 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.395 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.395 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.396 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703708+0000", 2024-09-12T00:04:00.396 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2361999999999999e-05 2024-09-12T00:04:00.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.396 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.396 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.396 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703741+0000", 2024-09-12T00:04:00.396 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.26e-05 2024-09-12T00:04:00.396 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.396 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.396 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.396 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.396 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:941 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:00.397 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:00.397 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 25.556764039000001, 2024-09-12T00:04:00.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0051476960000000002, 2024-09-12T00:04:00.397 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.397 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.397 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "started", 2024-09-12T00:04:00.397 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.397 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:00.397 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:00.397 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 941 2024-09-12T00:04:00.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.397 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704144+0000", 2024-09-12T00:04:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.514e-06 2024-09-12T00:04:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704152+0000", 2024-09-12T00:04:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2830000000000004e-06 2024-09-12T00:04:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704168+0000", 2024-09-12T00:04:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6835999999999999e-05 2024-09-12T00:04:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704178+0000", 2024-09-12T00:04:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7569999999999999e-06 2024-09-12T00:04:00.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.400 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.400 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704240+0000", 2024-09-12T00:04:00.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2193000000000006e-05 2024-09-12T00:04:00.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.400 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.400 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704308+0000", 2024-09-12T00:04:00.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7840000000000001e-05 2024-09-12T00:04:00.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.401 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.401 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.709290+0000", 2024-09-12T00:04:00.401 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049822729999999997 2024-09-12T00:04:00.401 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.401 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.401 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.401 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.401 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.401 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:00.403 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:04:00.403 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:00.401+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:00.503 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:00.501+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:00.561 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:04:00.605 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:00.608+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:00.627 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:00.627 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:00.628 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:00.628 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:00.641 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:04:00.706 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:00.705+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:00.758 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:00.758 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:00.759 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:00.759 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:00.759 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:00.772 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:04:00.813 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:00.813+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:00.909 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:00.912+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:00.926 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:00.926 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:00.926 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:00.926 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:00.926 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.926 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:00.926 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:00.926 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.434275825, 2024-09-12T00:04:00.926 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.278479906, 2024-09-12T00:04:00.926 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.927 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.927 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.927 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.927 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:00.927 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:00.927 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:04:00.927 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.927 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.927 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.927 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.927 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:00.927 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.927 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.927 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493422+0000", 2024-09-12T00:04:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.807e-06 2024-09-12T00:04:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493435+0000", 2024-09-12T00:04:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.375e-05 2024-09-12T00:04:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493457+0000", 2024-09-12T00:04:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2166000000000001e-05 2024-09-12T00:04:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493475+0000", 2024-09-12T00:04:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7184e-05 2024-09-12T00:04:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493617+0000", 2024-09-12T00:04:00.930 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014274200000000001 2024-09-12T00:04:00.930 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.930 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.930 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:00.930 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493632+0000", 2024-09-12T00:04:00.930 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4293e-05 2024-09-12T00:04:00.930 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.930 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.930 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.930 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.768657+0000", 2024-09-12T00:04:00.930 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.27502575400000001 2024-09-12T00:04:00.930 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.930 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769042+0000", 2024-09-12T00:04:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00038463700000000001 2024-09-12T00:04:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769430+0000", 2024-09-12T00:04:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000388014 2024-09-12T00:04:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.770784+0000", 2024-09-12T00:04:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00135402 2024-09-12T00:04:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771735+0000", 2024-09-12T00:04:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00095068599999999996 2024-09-12T00:04:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771828+0000", 2024-09-12T00:04:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3468999999999996e-05 2024-09-12T00:04:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771899+0000", 2024-09-12T00:04:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0383999999999996e-05 2024-09-12T00:04:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.006052068999999, 2024-09-12T00:04:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013402304, 2024-09-12T00:04:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 44 2024-09-12T00:04:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7100000000000001e-07 2024-09-12T00:04:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921706+0000", 2024-09-12T00:04:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2374999999999998e-05 2024-09-12T00:04:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.936 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921726+0000", 2024-09-12T00:04:00.936 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0373999999999998e-05 2024-09-12T00:04:00.936 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.936 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.936 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.936 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921733+0000", 2024-09-12T00:04:00.936 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8929999999999999e-06 2024-09-12T00:04:00.936 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.936 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.936 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.936 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927137+0000", 2024-09-12T00:04:00.936 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054037410000000001 2024-09-12T00:04:00.936 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.937 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.937 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.937 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927274+0000", 2024-09-12T00:04:00.937 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013697899999999999 2024-09-12T00:04:00.937 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.937 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.937 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:00.937 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927504+0000", 2024-09-12T00:04:00.937 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023005399999999999 2024-09-12T00:04:00.937 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.937 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.938 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.938 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.931848+0000", 2024-09-12T00:04:00.938 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0043445269999999999 2024-09-12T00:04:00.938 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.938 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.938 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.938 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934770+0000", 2024-09-12T00:04:00.938 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002922319 2024-09-12T00:04:00.938 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.938 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.938 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.938 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934901+0000", 2024-09-12T00:04:00.938 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013034599999999999 2024-09-12T00:04:00.939 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.939 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.939 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.939 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935045+0000", 2024-09-12T00:04:00.939 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014402499999999999 2024-09-12T00:04:00.939 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.939 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.939 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.939 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.939 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.939 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:00.940 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:00.940 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.005949104000003, 2024-09-12T00:04:00.940 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013456684999999999, 2024-09-12T00:04:00.940 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.940 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.940 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.940 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.940 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:00.940 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:00.940 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 45 2024-09-12T00:04:00.940 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.940 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921746+0000", 2024-09-12T00:04:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9800000000000003e-07 2024-09-12T00:04:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921751+0000", 2024-09-12T00:04:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7099999999999998e-06 2024-09-12T00:04:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921766+0000", 2024-09-12T00:04:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5633000000000001e-05 2024-09-12T00:04:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921786+0000", 2024-09-12T00:04:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9658000000000001e-05 2024-09-12T00:04:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929539+0000", 2024-09-12T00:04:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0077533120000000001 2024-09-12T00:04:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929706+0000", 2024-09-12T00:04:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016664199999999999 2024-09-12T00:04:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929933+0000", 2024-09-12T00:04:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000226658 2024-09-12T00:04:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934721+0000", 2024-09-12T00:04:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047886439999999999 2024-09-12T00:04:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935062+0000", 2024-09-12T00:04:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00034072399999999999 2024-09-12T00:04:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935141+0000", 2024-09-12T00:04:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8570000000000002e-05 2024-09-12T00:04:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935202+0000", 2024-09-12T00:04:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1536000000000002e-05 2024-09-12T00:04:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.946 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:00.946 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:00.946 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.005898872000003, 2024-09-12T00:04:00.946 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014633617, 2024-09-12T00:04:00.946 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.946 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.946 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.946 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.946 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:00.946 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:00.946 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:04:00.946 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.946 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3599999999999999e-07 2024-09-12T00:04:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921800+0000", 2024-09-12T00:04:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3850000000000002e-06 2024-09-12T00:04:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921805+0000", 2024-09-12T00:04:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9460000000000003e-06 2024-09-12T00:04:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921819+0000", 2024-09-12T00:04:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.325e-05 2024-09-12T00:04:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930627+0000", 2024-09-12T00:04:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00880827 2024-09-12T00:04:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930805+0000", 2024-09-12T00:04:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000177992 2024-09-12T00:04:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.931028+0000", 2024-09-12T00:04:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000223122 2024-09-12T00:04:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935258+0000", 2024-09-12T00:04:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0042302709999999999 2024-09-12T00:04:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936282+0000", 2024-09-12T00:04:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00102345 2024-09-12T00:04:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936367+0000", 2024-09-12T00:04:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4869000000000003e-05 2024-09-12T00:04:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936429+0000", 2024-09-12T00:04:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2626000000000007e-05 2024-09-12T00:04:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:00.952 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:00.952 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.005862622000002, 2024-09-12T00:04:00.952 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016022492999999999, 2024-09-12T00:04:00.952 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.952 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.952 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.952 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.952 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:00.952 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:00.952 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:04:00.952 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.952 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.952 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.953 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.953 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:00.953 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.953 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.953 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.953 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.953 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:00.953 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.953 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.953 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.953 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.953 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:00.953 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4000000000000002e-07 2024-09-12T00:04:00.954 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.954 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.954 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.954 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921891+0000", 2024-09-12T00:04:00.954 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8298000000000003e-05 2024-09-12T00:04:00.954 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.954 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.954 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.954 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921899+0000", 2024-09-12T00:04:00.954 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7059999999999993e-06 2024-09-12T00:04:00.954 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921904+0000", 2024-09-12T00:04:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9799999999999998e-06 2024-09-12T00:04:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932144+0000", 2024-09-12T00:04:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010239817999999999 2024-09-12T00:04:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932284+0000", 2024-09-12T00:04:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139436 2024-09-12T00:04:00.956 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.956 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.956 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:00.956 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932498+0000", 2024-09-12T00:04:00.956 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000214408 2024-09-12T00:04:00.956 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.956 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.956 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.956 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936444+0000", 2024-09-12T00:04:00.956 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039464169999999998 2024-09-12T00:04:00.956 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.956 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.957 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.957 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937702+0000", 2024-09-12T00:04:00.957 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012571679999999999 2024-09-12T00:04:00.957 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.957 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.957 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.957 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937793+0000", 2024-09-12T00:04:00.957 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1489000000000004e-05 2024-09-12T00:04:00.957 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.957 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.957 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.957 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937854+0000", 2024-09-12T00:04:00.958 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1333000000000004e-05 2024-09-12T00:04:00.958 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.958 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.958 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.958 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.958 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.958 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:00.958 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:00.958 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.005780754, 2024-09-12T00:04:00.958 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017189138999999999, 2024-09-12T00:04:00.958 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.958 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.958 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.959 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.959 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:00.959 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:00.959 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 48 2024-09-12T00:04:00.959 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.959 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.959 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.959 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.959 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:00.959 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.959 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.959 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7399999999999998e-07 2024-09-12T00:04:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921918+0000", 2024-09-12T00:04:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6399999999999999e-06 2024-09-12T00:04:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921925+0000", 2024-09-12T00:04:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7190000000000004e-06 2024-09-12T00:04:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921931+0000", 2024-09-12T00:04:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2519999999999996e-06 2024-09-12T00:04:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933475+0000", 2024-09-12T00:04:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011543759000000001 2024-09-12T00:04:00.962 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.962 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.962 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.962 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933617+0000", 2024-09-12T00:04:00.962 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000142282 2024-09-12T00:04:00.962 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.962 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.962 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:00.962 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933860+0000", 2024-09-12T00:04:00.962 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024276199999999999 2024-09-12T00:04:00.962 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.962 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.962 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937933+0000", 2024-09-12T00:04:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040734680000000002 2024-09-12T00:04:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938955+0000", 2024-09-12T00:04:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001021987 2024-09-12T00:04:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939038+0000", 2024-09-12T00:04:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2449999999999998e-05 2024-09-12T00:04:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939103+0000", 2024-09-12T00:04:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5345999999999994e-05 2024-09-12T00:04:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.005755211999997, 2024-09-12T00:04:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018247975, 2024-09-12T00:04:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.965 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.965 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.965 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:00.965 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:00.965 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 49 2024-09-12T00:04:00.965 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.965 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.965 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.965 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.965 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:00.965 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.965 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.965 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.966 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.966 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:00.966 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.966 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.966 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.966 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.966 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921940+0000", 2024-09-12T00:04:00.966 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7e-07 2024-09-12T00:04:00.966 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.966 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.966 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.966 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921943+0000", 2024-09-12T00:04:00.966 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1889999999999999e-06 2024-09-12T00:04:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921952+0000", 2024-09-12T00:04:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0010000000000007e-06 2024-09-12T00:04:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921959+0000", 2024-09-12T00:04:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2570000000000001e-06 2024-09-12T00:04:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935333+0000", 2024-09-12T00:04:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013373368 2024-09-12T00:04:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935472+0000", 2024-09-12T00:04:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013987900000000001 2024-09-12T00:04:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935700+0000", 2024-09-12T00:04:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000227922 2024-09-12T00:04:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939858+0000", 2024-09-12T00:04:00.969 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041571300000000002 2024-09-12T00:04:00.969 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.969 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.969 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.969 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940018+0000", 2024-09-12T00:04:00.969 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016060400000000001 2024-09-12T00:04:00.969 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.969 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.969 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.969 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940114+0000", 2024-09-12T00:04:00.969 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5692999999999993e-05 2024-09-12T00:04:00.969 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.969 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940187+0000", 2024-09-12T00:04:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3561999999999998e-05 2024-09-12T00:04:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.005712424999999, 2024-09-12T00:04:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021018614000000001, 2024-09-12T00:04:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 50 2024-09-12T00:04:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.972 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.972 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:00.972 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.972 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.972 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.972 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.972 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921983+0000", 2024-09-12T00:04:00.972 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4499999999999996e-07 2024-09-12T00:04:00.972 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.972 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.972 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.972 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922071+0000", 2024-09-12T00:04:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8010000000000006e-05 2024-09-12T00:04:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922084+0000", 2024-09-12T00:04:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3275000000000001e-05 2024-09-12T00:04:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922093+0000", 2024-09-12T00:04:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0580000000000004e-06 2024-09-12T00:04:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.974 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936515+0000", 2024-09-12T00:04:00.974 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014421270999999999 2024-09-12T00:04:00.974 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.974 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.974 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.974 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936677+0000", 2024-09-12T00:04:00.974 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162003 2024-09-12T00:04:00.974 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.974 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.974 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:00.974 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936908+0000", 2024-09-12T00:04:00.974 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023115700000000001 2024-09-12T00:04:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939985+0000", 2024-09-12T00:04:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030773879999999999 2024-09-12T00:04:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942623+0000", 2024-09-12T00:04:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026377929999999998 2024-09-12T00:04:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942818+0000", 2024-09-12T00:04:00.976 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019556200000000001 2024-09-12T00:04:00.976 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.976 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.976 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.976 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943001+0000", 2024-09-12T00:04:00.976 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018235199999999999 2024-09-12T00:04:00.976 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.976 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.976 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.976 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.976 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.976 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:00.976 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.005578032999999, 2024-09-12T00:04:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021092493, 2024-09-12T00:04:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 51 2024-09-12T00:04:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922118+0000", 2024-09-12T00:04:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0389999999999999e-06 2024-09-12T00:04:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.979 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.979 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922124+0000", 2024-09-12T00:04:00.979 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5409999999999997e-06 2024-09-12T00:04:00.979 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.979 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.979 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.979 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922136+0000", 2024-09-12T00:04:00.979 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.205e-05 2024-09-12T00:04:00.979 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.979 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.979 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.979 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922147+0000", 2024-09-12T00:04:00.979 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0451e-05 2024-09-12T00:04:00.980 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.980 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.980 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.980 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938000+0000", 2024-09-12T00:04:00.980 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015853682000000001 2024-09-12T00:04:00.980 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.980 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.980 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.980 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938142+0000", 2024-09-12T00:04:00.980 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014148899999999999 2024-09-12T00:04:00.980 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.980 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.980 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938362+0000", 2024-09-12T00:04:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022034800000000001 2024-09-12T00:04:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940330+0000", 2024-09-12T00:04:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001967459 2024-09-12T00:04:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943064+0000", 2024-09-12T00:04:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027346219999999999 2024-09-12T00:04:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943152+0000", 2024-09-12T00:04:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7563000000000002e-05 2024-09-12T00:04:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943209+0000", 2024-09-12T00:04:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7249e-05 2024-09-12T00:04:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:00.983 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.00552854, 2024-09-12T00:04:00.983 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021175616000000001, 2024-09-12T00:04:00.983 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.983 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.983 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.983 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.983 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:00.983 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:00.983 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 52 2024-09-12T00:04:00.983 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.983 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.983 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.983 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.984 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:00.984 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.984 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.984 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.984 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:00.984 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.984 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.984 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.984 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922167+0000", 2024-09-12T00:04:00.984 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3300000000000001e-07 2024-09-12T00:04:00.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922174+0000", 2024-09-12T00:04:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7070000000000003e-06 2024-09-12T00:04:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922184+0000", 2024-09-12T00:04:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682e-05 2024-09-12T00:04:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922195+0000", 2024-09-12T00:04:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0489000000000001e-05 2024-09-12T00:04:00.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.986 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.986 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.986 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939166+0000", 2024-09-12T00:04:00.986 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016971245999999999 2024-09-12T00:04:00.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.986 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.986 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.986 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939243+0000", 2024-09-12T00:04:00.986 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7201999999999997e-05 2024-09-12T00:04:00.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.986 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.986 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:00.987 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939381+0000", 2024-09-12T00:04:00.987 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013770699999999999 2024-09-12T00:04:00.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.987 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.987 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.987 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940923+0000", 2024-09-12T00:04:00.987 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001542302 2024-09-12T00:04:00.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.987 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.987 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.987 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943221+0000", 2024-09-12T00:04:00.987 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022979720000000001 2024-09-12T00:04:00.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943295+0000", 2024-09-12T00:04:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3317000000000003e-05 2024-09-12T00:04:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943342+0000", 2024-09-12T00:04:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7159e-05 2024-09-12T00:04:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.989 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.989 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:00.989 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:00.989 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.756583573999997, 2024-09-12T00:04:00.989 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015229411999999999, 2024-09-12T00:04:00.989 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.989 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.989 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.989 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.989 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:00.989 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:00.989 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 67 2024-09-12T00:04:00.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.989 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.990 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.990 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.990 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:00.990 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.990 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.990 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.990 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.990 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:00.990 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.990 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.990 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.990 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171112+0000", 2024-09-12T00:04:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2899999999999999e-06 2024-09-12T00:04:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171119+0000", 2024-09-12T00:04:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8870000000000003e-06 2024-09-12T00:04:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171131+0000", 2024-09-12T00:04:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1902999999999999e-05 2024-09-12T00:04:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171147+0000", 2024-09-12T00:04:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6203000000000001e-05 2024-09-12T00:04:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175044+0000", 2024-09-12T00:04:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038967310000000001 2024-09-12T00:04:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175172+0000", 2024-09-12T00:04:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012784100000000001 2024-09-12T00:04:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175372+0000", 2024-09-12T00:04:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019978500000000001 2024-09-12T00:04:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179276+0000", 2024-09-12T00:04:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039042149999999999 2024-09-12T00:04:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186150+0000", 2024-09-12T00:04:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0068740019999999997 2024-09-12T00:04:00.994 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.994 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.997 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:00.997 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186266+0000", 2024-09-12T00:04:00.997 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115742 2024-09-12T00:04:00.997 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.997 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.997 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:00.997 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186340+0000", 2024-09-12T00:04:00.997 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4813000000000004e-05 2024-09-12T00:04:00.997 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.997 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:00.998 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:00.998 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.998 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.998 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:00.998 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:00.998 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.756522498000002, 2024-09-12T00:04:00.998 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015308448000000001, 2024-09-12T00:04:00.998 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:00.998 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:00.998 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:00.998 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:00.998 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:00.998 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:00.999 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 68 2024-09-12T00:04:00.999 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.999 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:00.999 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.999 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:00.999 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:00.999 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.999 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:00.999 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:00.999 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:00.999 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:00.999 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:00.999 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171173+0000", 2024-09-12T00:04:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:04:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171182+0000", 2024-09-12T00:04:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2359999999999993e-06 2024-09-12T00:04:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171193+0000", 2024-09-12T00:04:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.095e-05 2024-09-12T00:04:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171207+0000", 2024-09-12T00:04:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3339999999999999e-05 2024-09-12T00:04:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176753+0000", 2024-09-12T00:04:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055460240000000001 2024-09-12T00:04:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176921+0000", 2024-09-12T00:04:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000168503 2024-09-12T00:04:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177112+0000", 2024-09-12T00:04:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019113999999999999 2024-09-12T00:04:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179382+0000", 2024-09-12T00:04:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022697099999999999 2024-09-12T00:04:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186356+0000", 2024-09-12T00:04:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069741919999999997 2024-09-12T00:04:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186422+0000", 2024-09-12T00:04:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6387e-05 2024-09-12T00:04:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186481+0000", 2024-09-12T00:04:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8059000000000001e-05 2024-09-12T00:04:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:01.004 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:01.004 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:01.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.004 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.004 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:01.004 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:01.004 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.756470727999996, 2024-09-12T00:04:01.004 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020001835999999999, 2024-09-12T00:04:01.004 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:01.004 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:01.004 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:01.004 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:01.004 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 69 2024-09-12T00:04:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171225+0000", 2024-09-12T00:04:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0599999999999999e-07 2024-09-12T00:04:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171349+0000", 2024-09-12T00:04:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012407299999999999 2024-09-12T00:04:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171367+0000", 2024-09-12T00:04:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8413000000000001e-05 2024-09-12T00:04:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171376+0000", 2024-09-12T00:04:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8170000000000005e-06 2024-09-12T00:04:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177692+0000", 2024-09-12T00:04:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063156729999999999 2024-09-12T00:04:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177817+0000", 2024-09-12T00:04:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012581499999999999 2024-09-12T00:04:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.178015+0000", 2024-09-12T00:04:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019715100000000001 2024-09-12T00:04:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181798+0000", 2024-09-12T00:04:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003783308 2024-09-12T00:04:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190976+0000", 2024-09-12T00:04:01.009 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091776519999999997 2024-09-12T00:04:01.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.009 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.009 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:01.009 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191122+0000", 2024-09-12T00:04:01.009 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000145966 2024-09-12T00:04:01.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.009 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.009 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:01.009 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191226+0000", 2024-09-12T00:04:01.009 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104162 2024-09-12T00:04:01.009 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:01.009 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.756301993000001, 2024-09-12T00:04:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019997773, 2024-09-12T00:04:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 70 2024-09-12T00:04:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3699999999999999e-07 2024-09-12T00:04:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171403+0000", 2024-09-12T00:04:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6199999999999994e-06 2024-09-12T00:04:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171416+0000", 2024-09-12T00:04:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2636000000000001e-05 2024-09-12T00:04:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171423+0000", 2024-09-12T00:04:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5440000000000001e-06 2024-09-12T00:04:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179458+0000", 2024-09-12T00:04:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080351989999999998 2024-09-12T00:04:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179604+0000", 2024-09-12T00:04:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014519899999999999 2024-09-12T00:04:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179831+0000", 2024-09-12T00:04:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022704800000000001 2024-09-12T00:04:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181918+0000", 2024-09-12T00:04:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020873950000000001 2024-09-12T00:04:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191243+0000", 2024-09-12T00:04:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0093244729999999998 2024-09-12T00:04:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191309+0000", 2024-09-12T00:04:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6116000000000002e-05 2024-09-12T00:04:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191390+0000", 2024-09-12T00:04:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1705999999999993e-05 2024-09-12T00:04:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.756255920000001, 2024-09-12T00:04:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020263554, 2024-09-12T00:04:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 71 2024-09-12T00:04:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5000000000000002e-07 2024-09-12T00:04:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171454+0000", 2024-09-12T00:04:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5046e-05 2024-09-12T00:04:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171471+0000", 2024-09-12T00:04:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6923999999999999e-05 2024-09-12T00:04:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171487+0000", 2024-09-12T00:04:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5823000000000001e-05 2024-09-12T00:04:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180765+0000", 2024-09-12T00:04:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0092774399999999996 2024-09-12T00:04:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180900+0000", 2024-09-12T00:04:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013556700000000001 2024-09-12T00:04:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181108+0000", 2024-09-12T00:04:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020727899999999999 2024-09-12T00:04:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184725+0000", 2024-09-12T00:04:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036171340000000001 2024-09-12T00:04:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191413+0000", 2024-09-12T00:04:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066881830000000003 2024-09-12T00:04:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191540+0000", 2024-09-12T00:04:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000126823 2024-09-12T00:04:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191702+0000", 2024-09-12T00:04:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162585 2024-09-12T00:04:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.756177344000001, 2024-09-12T00:04:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020448573000000001, 2024-09-12T00:04:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 72 2024-09-12T00:04:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171518+0000", 2024-09-12T00:04:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0440000000000001e-06 2024-09-12T00:04:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.024 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.024 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:01.024 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171647+0000", 2024-09-12T00:04:01.024 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012912899999999999 2024-09-12T00:04:01.024 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.024 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.024 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:01.024 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171664+0000", 2024-09-12T00:04:01.024 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6079999999999999e-05 2024-09-12T00:04:01.024 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.024 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.024 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:01.024 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171675+0000", 2024-09-12T00:04:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1223000000000001e-05 2024-09-12T00:04:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182000+0000", 2024-09-12T00:04:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010324949 2024-09-12T00:04:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182178+0000", 2024-09-12T00:04:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017808799999999999 2024-09-12T00:04:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182402+0000", 2024-09-12T00:04:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022381199999999999 2024-09-12T00:04:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190935+0000", 2024-09-12T00:04:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085331560000000001 2024-09-12T00:04:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191728+0000", 2024-09-12T00:04:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079325700000000001 2024-09-12T00:04:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.027 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.027 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:01.027 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191864+0000", 2024-09-12T00:04:01.027 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013606299999999999 2024-09-12T00:04:01.027 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.027 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.027 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:01.027 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191966+0000", 2024-09-12T00:04:01.027 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101772 2024-09-12T00:04:01.027 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:01.027 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:01.027 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:01.027 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.028 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.028 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:01.028 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:01.028 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.755994149000003, 2024-09-12T00:04:01.028 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020675235, 2024-09-12T00:04:01.028 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:01.028 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:01.028 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:01.028 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:01.028 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:01.028 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:01.029 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 73 2024-09-12T00:04:01.029 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.029 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:01.029 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.029 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:01.029 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:01.029 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:01.029 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.029 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.029 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:01.029 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:01.029 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171701+0000", 2024-09-12T00:04:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0999999999999997e-07 2024-09-12T00:04:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171709+0000", 2024-09-12T00:04:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2540000000000003e-06 2024-09-12T00:04:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171724+0000", 2024-09-12T00:04:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5569e-05 2024-09-12T00:04:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171734+0000", 2024-09-12T00:04:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6139999999999998e-06 2024-09-12T00:04:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183774+0000", 2024-09-12T00:04:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012040444000000001 2024-09-12T00:04:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183896+0000", 2024-09-12T00:04:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012204199999999999 2024-09-12T00:04:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184084+0000", 2024-09-12T00:04:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018792599999999999 2024-09-12T00:04:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191984+0000", 2024-09-12T00:04:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079003790000000008 2024-09-12T00:04:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192093+0000", 2024-09-12T00:04:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000108942 2024-09-12T00:04:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192250+0000", 2024-09-12T00:04:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015637600000000001 2024-09-12T00:04:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192376+0000", 2024-09-12T00:04:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012587899999999999 2024-09-12T00:04:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.755945939, 2024-09-12T00:04:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021088828, 2024-09-12T00:04:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 74 2024-09-12T00:04:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1699999999999997e-07 2024-09-12T00:04:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171758+0000", 2024-09-12T00:04:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0860000000000008e-06 2024-09-12T00:04:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171774+0000", 2024-09-12T00:04:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:04:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171788+0000", 2024-09-12T00:04:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4793999999999999e-05 2024-09-12T00:04:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184842+0000", 2024-09-12T00:04:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013053607 2024-09-12T00:04:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185130+0000", 2024-09-12T00:04:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00028779199999999998 2024-09-12T00:04:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185378+0000", 2024-09-12T00:04:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024780100000000002 2024-09-12T00:04:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192513+0000", 2024-09-12T00:04:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071350770000000001 2024-09-12T00:04:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192690+0000", 2024-09-12T00:04:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000176892 2024-09-12T00:04:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192769+0000", 2024-09-12T00:04:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9466000000000001e-05 2024-09-12T00:04:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192837+0000", 2024-09-12T00:04:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8466000000000005e-05 2024-09-12T00:04:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.755893362000002, 2024-09-12T00:04:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.02121994, 2024-09-12T00:04:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 75 2024-09-12T00:04:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:01.042 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.042 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:01.042 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:01.042 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:01.042 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.042 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.042 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:01.042 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:01.042 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:01.042 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.042 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.042 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:01.043 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171802+0000", 2024-09-12T00:04:01.043 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5000000000000002e-07 2024-09-12T00:04:01.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.043 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.043 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:01.043 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171954+0000", 2024-09-12T00:04:01.043 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015215500000000001 2024-09-12T00:04:01.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.043 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.043 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:01.043 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171966+0000", 2024-09-12T00:04:01.043 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1548e-05 2024-09-12T00:04:01.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.044 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.044 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:01.044 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171970+0000", 2024-09-12T00:04:01.044 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8729999999999998e-06 2024-09-12T00:04:01.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.044 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.044 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:01.044 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186552+0000", 2024-09-12T00:04:01.044 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014581775 2024-09-12T00:04:01.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.044 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.044 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186702+0000", 2024-09-12T00:04:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014946 2024-09-12T00:04:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186897+0000", 2024-09-12T00:04:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000195071 2024-09-12T00:04:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192666+0000", 2024-09-12T00:04:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057693470000000002 2024-09-12T00:04:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192857+0000", 2024-09-12T00:04:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191149 2024-09-12T00:04:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192967+0000", 2024-09-12T00:04:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110202 2024-09-12T00:04:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193021+0000", 2024-09-12T00:04:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3709999999999999e-05 2024-09-12T00:04:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.755714067, 2024-09-12T00:04:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026297425999999999, 2024-09-12T00:04:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 76 2024-09-12T00:04:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9399999999999995e-07 2024-09-12T00:04:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171987+0000", 2024-09-12T00:04:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5230000000000003e-06 2024-09-12T00:04:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172005+0000", 2024-09-12T00:04:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8788e-05 2024-09-12T00:04:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172010+0000", 2024-09-12T00:04:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7570000000000004e-06 2024-09-12T00:04:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193104+0000", 2024-09-12T00:04:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021094112000000002 2024-09-12T00:04:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193334+0000", 2024-09-12T00:04:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000229855 2024-09-12T00:04:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193697+0000", 2024-09-12T00:04:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00036272399999999998 2024-09-12T00:04:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.195602+0000", 2024-09-12T00:04:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019049620000000001 2024-09-12T00:04:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198123+0000", 2024-09-12T00:04:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025216520000000001 2024-09-12T00:04:01.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.052 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.052 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:01.052 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198213+0000", 2024-09-12T00:04:01.052 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0008999999999998e-05 2024-09-12T00:04:01.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:01.052 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:01.052 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:01.052 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198278+0000", 2024-09-12T00:04:01.052 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4549999999999997e-05 2024-09-12T00:04:01.052 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:01.052 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:01.052 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:01.053 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:01.053 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:01.053 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:01.054 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:04:01.055 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:01.056+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:01.155 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:01.156+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:01.221 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:04:01.225 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:01.226 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:01.226 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:01.226 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:01.244 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:04:01.255 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:01.256+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:01.357 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:01.353+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:01.423 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:01.423 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:01.454 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:01.455 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:01.458 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:01.457+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:01.461 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:01.461 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:01.480 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:04:01.485 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:01.485 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:01.516 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:01.516 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:01.549 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T00:04:01.561 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:01.561+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:01.591 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:01.591 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:01.626 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:01.627 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:01.660 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:01.660 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:01.661 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:01.664+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:01.662 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:01.662 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:01.684 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:04:01.773 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:01.773+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:01.862 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:01.864+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:01.901 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:01.901 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:01.919 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:04:01.963 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:01.961+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:02.063 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:02.061+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:02.102 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:02.102 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:02.115 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:04:02.164 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:02.164+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:02.265 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:02.268+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:02.326 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:02.326 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:02.344 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:04:02.365 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:02.365+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:02.466 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:02.465+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:02.476 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:02.477 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:02.491 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:04:02.567 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:02.568+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:02.617 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:02.617 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:02.632 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:04:02.668 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:02.665+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:02.770 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:02.769+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:02.798 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:02.798 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:02.812 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:04:02.870 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:02.869+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:02.933 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:02.934 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:02.948 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:04:02.971 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:02.969+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:03.066 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:03.066 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:03.072 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:03.069+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:03.080 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:04:03.174 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:03.173+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:03.204 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:03.205 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:03.219 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:04:03.275 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:03.276+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:03.341 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:03.341 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:03.357 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:04:03.401 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:03.404+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:03.478 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:03.480+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:03.527 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:03.527 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:03.541 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:04:03.580 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:03.577+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:03.583 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:04:03.681 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:03.677+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:03.687 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:04:03.707 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:03.707 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:03.722 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:04:03.782 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:03.784+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:03.846 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:03.846 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:03.853 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:03.853 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:03.860 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:04:03.869 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:03.870 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:03.883 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:03.881+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:03.886 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:03.886 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:03.902 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:03.902 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:03.920 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:03.920 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:03.937 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:03.937 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:03.955 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:03.955 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:03.972 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:03.973 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:03.984 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:03.984+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:04.024 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:04.025 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:04:04.025 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:04:04.025 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:04:04.025 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:04.039 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:04:04.125 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:04.128+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:04.186 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:04.188+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:04.210 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:04.210 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:04:04.210 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:04:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:04:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:04:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.723652631999997, 2024-09-12T00:04:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0032495720000000001, 2024-09-12T00:04:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 193 2024-09-12T00:04:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:04:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:04:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486926+0000", 2024-09-12T00:04:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.463e-06 2024-09-12T00:04:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486937+0000", 2024-09-12T00:04:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1147e-05 2024-09-12T00:04:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486968+0000", 2024-09-12T00:04:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1077000000000001e-05 2024-09-12T00:04:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486985+0000", 2024-09-12T00:04:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6399e-05 2024-09-12T00:04:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487139+0000", 2024-09-12T00:04:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015403199999999999 2024-09-12T00:04:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487375+0000", 2024-09-12T00:04:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023621499999999999 2024-09-12T00:04:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487634+0000", 2024-09-12T00:04:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000259351 2024-09-12T00:04:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.489156+0000", 2024-09-12T00:04:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015213869999999999 2024-09-12T00:04:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.489974+0000", 2024-09-12T00:04:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00081855600000000001 2024-09-12T00:04:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.490064+0000", 2024-09-12T00:04:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9205999999999999e-05 2024-09-12T00:04:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.490173+0000", 2024-09-12T00:04:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109739 2024-09-12T00:04:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:04:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:04:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.847213089, 2024-09-12T00:04:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039523630000000004, 2024-09-12T00:04:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 208 2024-09-12T00:04:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:04:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:04:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363366+0000", 2024-09-12T00:04:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.004e-06 2024-09-12T00:04:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363379+0000", 2024-09-12T00:04:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2943e-05 2024-09-12T00:04:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363412+0000", 2024-09-12T00:04:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2808999999999997e-05 2024-09-12T00:04:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363430+0000", 2024-09-12T00:04:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8003e-05 2024-09-12T00:04:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363654+0000", 2024-09-12T00:04:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022394900000000001 2024-09-12T00:04:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363897+0000", 2024-09-12T00:04:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024272399999999999 2024-09-12T00:04:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.364326+0000", 2024-09-12T00:04:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042963399999999997 2024-09-12T00:04:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.365757+0000", 2024-09-12T00:04:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014303969999999999 2024-09-12T00:04:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367031+0000", 2024-09-12T00:04:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001274269 2024-09-12T00:04:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367197+0000", 2024-09-12T00:04:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016645900000000001 2024-09-12T00:04:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367316+0000", 2024-09-12T00:04:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011817200000000001 2024-09-12T00:04:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:04:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.789954784999999, 2024-09-12T00:04:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033190419999999999, 2024-09-12T00:04:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 219 2024-09-12T00:04:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:04:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:04:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420624+0000", 2024-09-12T00:04:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0829999999999998e-06 2024-09-12T00:04:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420633+0000", 2024-09-12T00:04:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8500000000000006e-06 2024-09-12T00:04:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420663+0000", 2024-09-12T00:04:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9597000000000001e-05 2024-09-12T00:04:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420681+0000", 2024-09-12T00:04:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7646e-05 2024-09-12T00:04:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420791+0000", 2024-09-12T00:04:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109979 2024-09-12T00:04:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.421042+0000", 2024-09-12T00:04:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025117199999999997 2024-09-12T00:04:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.421487+0000", 2024-09-12T00:04:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00044476599999999998 2024-09-12T00:04:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.422884+0000", 2024-09-12T00:04:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0013975109999999999 2024-09-12T00:04:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423797+0000", 2024-09-12T00:04:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00091310899999999995 2024-09-12T00:04:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423879+0000", 2024-09-12T00:04:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1829000000000005e-05 2024-09-12T00:04:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423941+0000", 2024-09-12T00:04:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1500000000000004e-05 2024-09-12T00:04:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:04:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.772314185999999, 2024-09-12T00:04:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003232782, 2024-09-12T00:04:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 224 2024-09-12T00:04:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:04:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:04:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438265+0000", 2024-09-12T00:04:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.666e-06 2024-09-12T00:04:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438276+0000", 2024-09-12T00:04:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1387e-05 2024-09-12T00:04:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438306+0000", 2024-09-12T00:04:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0069999999999998e-05 2024-09-12T00:04:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438321+0000", 2024-09-12T00:04:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.517e-05 2024-09-12T00:04:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438459+0000", 2024-09-12T00:04:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013781899999999999 2024-09-12T00:04:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438671+0000", 2024-09-12T00:04:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021214500000000001 2024-09-12T00:04:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.439093+0000", 2024-09-12T00:04:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042117899999999999 2024-09-12T00:04:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.440400+0000", 2024-09-12T00:04:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0013072719999999999 2024-09-12T00:04:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441339+0000", 2024-09-12T00:04:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00093906600000000001 2024-09-12T00:04:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441429+0000", 2024-09-12T00:04:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0358999999999993e-05 2024-09-12T00:04:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441495+0000", 2024-09-12T00:04:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5648999999999994e-05 2024-09-12T00:04:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:04:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.732815213999999, 2024-09-12T00:04:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003225716, 2024-09-12T00:04:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 235 2024-09-12T00:04:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:04:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:04:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477764+0000", 2024-09-12T00:04:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.48e-06 2024-09-12T00:04:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477775+0000", 2024-09-12T00:04:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1163e-05 2024-09-12T00:04:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477807+0000", 2024-09-12T00:04:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1860000000000003e-05 2024-09-12T00:04:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477822+0000", 2024-09-12T00:04:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5302999999999999e-05 2024-09-12T00:04:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477959+0000", 2024-09-12T00:04:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013695600000000001 2024-09-12T00:04:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.478184+0000", 2024-09-12T00:04:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022484800000000001 2024-09-12T00:04:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.478657+0000", 2024-09-12T00:04:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000473413 2024-09-12T00:04:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480162+0000", 2024-09-12T00:04:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00150454 2024-09-12T00:04:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480792+0000", 2024-09-12T00:04:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00063012400000000003 2024-09-12T00:04:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480906+0000", 2024-09-12T00:04:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113909 2024-09-12T00:04:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480987+0000", 2024-09-12T00:04:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1119999999999996e-05 2024-09-12T00:04:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:237 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:04:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.725493842999999, 2024-09-12T00:04:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0074291790000000002, 2024-09-12T00:04:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 237 2024-09-12T00:04:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:04:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:04:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485086+0000", 2024-09-12T00:04:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.05e-06 2024-09-12T00:04:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485101+0000", 2024-09-12T00:04:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5186e-05 2024-09-12T00:04:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485140+0000", 2024-09-12T00:04:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8896000000000002e-05 2024-09-12T00:04:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485162+0000", 2024-09-12T00:04:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2654e-05 2024-09-12T00:04:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485314+0000", 2024-09-12T00:04:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015150799999999999 2024-09-12T00:04:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485549+0000", 2024-09-12T00:04:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000235665 2024-09-12T00:04:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486064+0000", 2024-09-12T00:04:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00051418899999999997 2024-09-12T00:04:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.488211+0000", 2024-09-12T00:04:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0021470819999999998 2024-09-12T00:04:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492273+0000", 2024-09-12T00:04:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040617980000000001 2024-09-12T00:04:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492391+0000", 2024-09-12T00:04:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118613 2024-09-12T00:04:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492512+0000", 2024-09-12T00:04:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120538 2024-09-12T00:04:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:244 6.17 e35/29 6:e9187ab8:reshard::reshard.0000000000:head v 35'1, mlcod=0'0)", 2024-09-12T00:04:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:04:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.722911608, 2024-09-12T00:04:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0034313239999999999, 2024-09-12T00:04:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:04:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:04:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487667+0000", 2024-09-12T00:04:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4899999999999999e-06 2024-09-12T00:04:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487682+0000", 2024-09-12T00:04:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4929999999999999e-05 2024-09-12T00:04:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487740+0000", 2024-09-12T00:04:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8075000000000002e-05 2024-09-12T00:04:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487761+0000", 2024-09-12T00:04:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0769999999999999e-05 2024-09-12T00:04:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487966+0000", 2024-09-12T00:04:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020516800000000001 2024-09-12T00:04:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.488012+0000", 2024-09-12T00:04:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5794000000000002e-05 2024-09-12T00:04:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.490965+0000", 2024-09-12T00:04:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0029530609999999999 2024-09-12T00:04:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491096+0000", 2024-09-12T00:04:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013103600000000001 2024-09-12T00:04:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:293 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:04:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.712959786999999, 2024-09-12T00:04:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0075915649999999998, 2024-09-12T00:04:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 293 2024-09-12T00:04:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:04:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:04:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497626+0000", 2024-09-12T00:04:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2499999999999995e-06 2024-09-12T00:04:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497636+0000", 2024-09-12T00:04:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0139999999999999e-05 2024-09-12T00:04:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497660+0000", 2024-09-12T00:04:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4015999999999998e-05 2024-09-12T00:04:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497675+0000", 2024-09-12T00:04:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5339999999999999e-05 2024-09-12T00:04:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497839+0000", 2024-09-12T00:04:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016347900000000001 2024-09-12T00:04:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498097+0000", 2024-09-12T00:04:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025825700000000002 2024-09-12T00:04:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498618+0000", 2024-09-12T00:04:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052051300000000001 2024-09-12T00:04:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.501282+0000", 2024-09-12T00:04:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026646840000000001 2024-09-12T00:04:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.258 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505057+0000", 2024-09-12T00:04:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037747710000000001 2024-09-12T00:04:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505144+0000", 2024-09-12T00:04:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7466000000000006e-05 2024-09-12T00:04:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505208+0000", 2024-09-12T00:04:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3649e-05 2024-09-12T00:04:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:413 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:04:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.681920174999998, 2024-09-12T00:04:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005252049, 2024-09-12T00:04:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 413 2024-09-12T00:04:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:04:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:04:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528659+0000", 2024-09-12T00:04:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4739999999999999e-06 2024-09-12T00:04:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528669+0000", 2024-09-12T00:04:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0694e-05 2024-09-12T00:04:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528696+0000", 2024-09-12T00:04:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6846e-05 2024-09-12T00:04:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528711+0000", 2024-09-12T00:04:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4397e-05 2024-09-12T00:04:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528884+0000", 2024-09-12T00:04:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017304700000000001 2024-09-12T00:04:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529162+0000", 2024-09-12T00:04:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027861999999999999 2024-09-12T00:04:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529688+0000", 2024-09-12T00:04:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052593900000000001 2024-09-12T00:04:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.531480+0000", 2024-09-12T00:04:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0017920740000000001 2024-09-12T00:04:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533734+0000", 2024-09-12T00:04:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002254191 2024-09-12T00:04:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533845+0000", 2024-09-12T00:04:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110559 2024-09-12T00:04:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533908+0000", 2024-09-12T00:04:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3207999999999995e-05 2024-09-12T00:04:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:437 6.0 6:05588ce8:lc::lc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:04:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.674744686, 2024-09-12T00:04:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039419659999999999, 2024-09-12T00:04:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 437 2024-09-12T00:04:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:04:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:04:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535834+0000", 2024-09-12T00:04:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2859999999999998e-06 2024-09-12T00:04:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535846+0000", 2024-09-12T00:04:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1643e-05 2024-09-12T00:04:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535877+0000", 2024-09-12T00:04:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1457000000000001e-05 2024-09-12T00:04:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535894+0000", 2024-09-12T00:04:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.668e-05 2024-09-12T00:04:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535981+0000", 2024-09-12T00:04:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6823000000000005e-05 2024-09-12T00:04:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536086+0000", 2024-09-12T00:04:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010566200000000001 2024-09-12T00:04:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536330+0000", 2024-09-12T00:04:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024399999999999999 2024-09-12T00:04:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538288+0000", 2024-09-12T00:04:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0019575740000000001 2024-09-12T00:04:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539574+0000", 2024-09-12T00:04:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012862259999999999 2024-09-12T00:04:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539696+0000", 2024-09-12T00:04:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012190599999999999 2024-09-12T00:04:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539774+0000", 2024-09-12T00:04:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7708999999999997e-05 2024-09-12T00:04:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:464 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:04:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.666183704000002, 2024-09-12T00:04:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048192310000000002, 2024-09-12T00:04:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 464 2024-09-12T00:04:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:04:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:04:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544395+0000", 2024-09-12T00:04:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.905e-06 2024-09-12T00:04:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544405+0000", 2024-09-12T00:04:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0583e-05 2024-09-12T00:04:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544435+0000", 2024-09-12T00:04:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9431e-05 2024-09-12T00:04:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544468+0000", 2024-09-12T00:04:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2978999999999997e-05 2024-09-12T00:04:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544573+0000", 2024-09-12T00:04:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105165 2024-09-12T00:04:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544714+0000", 2024-09-12T00:04:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000141061 2024-09-12T00:04:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.545414+0000", 2024-09-12T00:04:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00070066200000000001 2024-09-12T00:04:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.547475+0000", 2024-09-12T00:04:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020609119999999998 2024-09-12T00:04:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549067+0000", 2024-09-12T00:04:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015914989999999999 2024-09-12T00:04:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549143+0000", 2024-09-12T00:04:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5795000000000002e-05 2024-09-12T00:04:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549212+0000", 2024-09-12T00:04:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9239000000000006e-05 2024-09-12T00:04:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:495 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:04:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.655114206, 2024-09-12T00:04:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052520209999999999, 2024-09-12T00:04:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 495 2024-09-12T00:04:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:04:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:04:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555464+0000", 2024-09-12T00:04:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8870000000000001e-06 2024-09-12T00:04:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555473+0000", 2024-09-12T00:04:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2399999999999996e-06 2024-09-12T00:04:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555496+0000", 2024-09-12T00:04:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2952e-05 2024-09-12T00:04:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555508+0000", 2024-09-12T00:04:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1548e-05 2024-09-12T00:04:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555596+0000", 2024-09-12T00:04:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8295999999999996e-05 2024-09-12T00:04:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555683+0000", 2024-09-12T00:04:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7267000000000003e-05 2024-09-12T00:04:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555862+0000", 2024-09-12T00:04:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017910699999999999 2024-09-12T00:04:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.556696+0000", 2024-09-12T00:04:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000833353 2024-09-12T00:04:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560563+0000", 2024-09-12T00:04:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038672089999999999 2024-09-12T00:04:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560642+0000", 2024-09-12T00:04:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.8909e-05 2024-09-12T00:04:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560714+0000", 2024-09-12T00:04:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2253000000000001e-05 2024-09-12T00:04:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:631 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:04:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.619286652, 2024-09-12T00:04:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0072389480000000003, 2024-09-12T00:04:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 631 2024-09-12T00:04:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:04:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:04:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591292+0000", 2024-09-12T00:04:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0760000000000001e-06 2024-09-12T00:04:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591301+0000", 2024-09-12T00:04:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3880000000000006e-06 2024-09-12T00:04:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591323+0000", 2024-09-12T00:04:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2121999999999999e-05 2024-09-12T00:04:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591338+0000", 2024-09-12T00:04:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5126999999999999e-05 2024-09-12T00:04:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591449+0000", 2024-09-12T00:04:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011054500000000001 2024-09-12T00:04:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591682+0000", 2024-09-12T00:04:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023258 2024-09-12T00:04:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.592011+0000", 2024-09-12T00:04:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00032941699999999998 2024-09-12T00:04:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593493+0000", 2024-09-12T00:04:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014821599999999999 2024-09-12T00:04:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598356+0000", 2024-09-12T00:04:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048625329999999996 2024-09-12T00:04:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598456+0000", 2024-09-12T00:04:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9878999999999997e-05 2024-09-12T00:04:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598529+0000", 2024-09-12T00:04:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3120999999999993e-05 2024-09-12T00:04:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:650 6.4 6:26625e58:lc::lc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:04:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.610889107999999, 2024-09-12T00:04:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042727010000000003, 2024-09-12T00:04:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 650 2024-09-12T00:04:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:04:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:04:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599689+0000", 2024-09-12T00:04:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3179999999999999e-06 2024-09-12T00:04:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599696+0000", 2024-09-12T00:04:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9580000000000001e-06 2024-09-12T00:04:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599714+0000", 2024-09-12T00:04:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8099999999999999e-05 2024-09-12T00:04:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599724+0000", 2024-09-12T00:04:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0492999999999999e-05 2024-09-12T00:04:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599799+0000", 2024-09-12T00:04:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5228999999999994e-05 2024-09-12T00:04:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599897+0000", 2024-09-12T00:04:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7476e-05 2024-09-12T00:04:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.600047+0000", 2024-09-12T00:04:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015028 2024-09-12T00:04:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.602604+0000", 2024-09-12T00:04:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0025571729999999998 2024-09-12T00:04:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603880+0000", 2024-09-12T00:04:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012753700000000001 2024-09-12T00:04:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603923+0000", 2024-09-12T00:04:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3758999999999999e-05 2024-09-12T00:04:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603960+0000", 2024-09-12T00:04:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6545000000000003e-05 2024-09-12T00:04:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:744 6.0 6:0651570b:lc::lc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:04:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.576597679999999, 2024-09-12T00:04:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048046149999999999, 2024-09-12T00:04:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 744 2024-09-12T00:04:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:04:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:04:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633981+0000", 2024-09-12T00:04:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3740000000000001e-06 2024-09-12T00:04:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633991+0000", 2024-09-12T00:04:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7839999999999998e-06 2024-09-12T00:04:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634016+0000", 2024-09-12T00:04:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5075999999999998e-05 2024-09-12T00:04:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634031+0000", 2024-09-12T00:04:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5124e-05 2024-09-12T00:04:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634105+0000", 2024-09-12T00:04:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3595000000000003e-05 2024-09-12T00:04:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634183+0000", 2024-09-12T00:04:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7936999999999996e-05 2024-09-12T00:04:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634342+0000", 2024-09-12T00:04:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015910499999999999 2024-09-12T00:04:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.635262+0000", 2024-09-12T00:04:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00092051000000000003 2024-09-12T00:04:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638638+0000", 2024-09-12T00:04:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033756419999999999 2024-09-12T00:04:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638722+0000", 2024-09-12T00:04:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.4029000000000005e-05 2024-09-12T00:04:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638783+0000", 2024-09-12T00:04:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1439000000000006e-05 2024-09-12T00:04:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:875 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:04:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.526958249, 2024-09-12T00:04:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004522295, 2024-09-12T00:04:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 875 2024-09-12T00:04:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:04:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:04:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683623+0000", 2024-09-12T00:04:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7140000000000001e-06 2024-09-12T00:04:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683639+0000", 2024-09-12T00:04:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6203000000000001e-05 2024-09-12T00:04:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683677+0000", 2024-09-12T00:04:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8470999999999998e-05 2024-09-12T00:04:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683708+0000", 2024-09-12T00:04:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0793999999999997e-05 2024-09-12T00:04:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683827+0000", 2024-09-12T00:04:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011832699999999999 2024-09-12T00:04:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683945+0000", 2024-09-12T00:04:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118301 2024-09-12T00:04:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.684226+0000", 2024-09-12T00:04:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000280604 2024-09-12T00:04:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685790+0000", 2024-09-12T00:04:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001564651 2024-09-12T00:04:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688028+0000", 2024-09-12T00:04:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0022381129999999999 2024-09-12T00:04:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688093+0000", 2024-09-12T00:04:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4329e-05 2024-09-12T00:04:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688140+0000", 2024-09-12T00:04:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7787999999999997e-05 2024-09-12T00:04:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:878 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:04:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.525314120000001, 2024-09-12T00:04:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037933009999999998, 2024-09-12T00:04:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 878 2024-09-12T00:04:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:04:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:04:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685265+0000", 2024-09-12T00:04:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.525e-06 2024-09-12T00:04:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685276+0000", 2024-09-12T00:04:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.076e-05 2024-09-12T00:04:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685306+0000", 2024-09-12T00:04:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0803000000000003e-05 2024-09-12T00:04:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685327+0000", 2024-09-12T00:04:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1061e-05 2024-09-12T00:04:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685429+0000", 2024-09-12T00:04:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000102015 2024-09-12T00:04:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685580+0000", 2024-09-12T00:04:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000151096 2024-09-12T00:04:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685861+0000", 2024-09-12T00:04:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028068100000000002 2024-09-12T00:04:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688647+0000", 2024-09-12T00:04:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0027860979999999999 2024-09-12T00:04:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688909+0000", 2024-09-12T00:04:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026159600000000001 2024-09-12T00:04:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688991+0000", 2024-09-12T00:04:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2429999999999995e-05 2024-09-12T00:04:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689056+0000", 2024-09-12T00:04:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4236e-05 2024-09-12T00:04:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:881 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:04:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.524679936999998, 2024-09-12T00:04:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003307979, 2024-09-12T00:04:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 881 2024-09-12T00:04:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:04:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:04:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685898+0000", 2024-09-12T00:04:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4249999999999999e-06 2024-09-12T00:04:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685904+0000", 2024-09-12T00:04:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1290000000000001e-06 2024-09-12T00:04:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685917+0000", 2024-09-12T00:04:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2825e-05 2024-09-12T00:04:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685925+0000", 2024-09-12T00:04:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6589999999999996e-06 2024-09-12T00:04:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686156+0000", 2024-09-12T00:04:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023017299999999999 2024-09-12T00:04:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686365+0000", 2024-09-12T00:04:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000209442 2024-09-12T00:04:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686567+0000", 2024-09-12T00:04:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020237400000000001 2024-09-12T00:04:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689076+0000", 2024-09-12T00:04:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002508957 2024-09-12T00:04:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689121+0000", 2024-09-12T00:04:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4561999999999998e-05 2024-09-12T00:04:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689168+0000", 2024-09-12T00:04:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7000999999999999e-05 2024-09-12T00:04:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689204+0000", 2024-09-12T00:04:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6431999999999999e-05 2024-09-12T00:04:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:894 6.0 6:05588ce8:lc::lc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:04:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.520323971, 2024-09-12T00:04:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040691010000000003, 2024-09-12T00:04:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 894 2024-09-12T00:04:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:04:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:04:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690253+0000", 2024-09-12T00:04:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.026e-06 2024-09-12T00:04:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690259+0000", 2024-09-12T00:04:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7389999999999996e-06 2024-09-12T00:04:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690273+0000", 2024-09-12T00:04:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3749e-05 2024-09-12T00:04:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690282+0000", 2024-09-12T00:04:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2520000000000005e-06 2024-09-12T00:04:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690704+0000", 2024-09-12T00:04:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042222199999999998 2024-09-12T00:04:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690826+0000", 2024-09-12T00:04:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012141099999999999 2024-09-12T00:04:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.691094+0000", 2024-09-12T00:04:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000268344 2024-09-12T00:04:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.693007+0000", 2024-09-12T00:04:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001912495 2024-09-12T00:04:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694184+0000", 2024-09-12T00:04:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00117786 2024-09-12T00:04:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694259+0000", 2024-09-12T00:04:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4091000000000006e-05 2024-09-12T00:04:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694321+0000", 2024-09-12T00:04:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2911999999999997e-05 2024-09-12T00:04:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1283 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:04:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.021005434999999, 2024-09-12T00:04:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00320967, 2024-09-12T00:04:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1283 2024-09-12T00:04:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:04:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:04:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189573+0000", 2024-09-12T00:04:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3130000000000001e-06 2024-09-12T00:04:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189583+0000", 2024-09-12T00:04:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4129999999999995e-06 2024-09-12T00:04:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189608+0000", 2024-09-12T00:04:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5863e-05 2024-09-12T00:04:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189628+0000", 2024-09-12T00:04:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9644e-05 2024-09-12T00:04:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189747+0000", 2024-09-12T00:04:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118999 2024-09-12T00:04:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189874+0000", 2024-09-12T00:04:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012674499999999999 2024-09-12T00:04:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.190148+0000", 2024-09-12T00:04:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000274431 2024-09-12T00:04:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.191174+0000", 2024-09-12T00:04:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001025855 2024-09-12T00:04:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192627+0000", 2024-09-12T00:04:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014527979999999999 2024-09-12T00:04:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192710+0000", 2024-09-12T00:04:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3146000000000007e-05 2024-09-12T00:04:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192781+0000", 2024-09-12T00:04:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.0463000000000006e-05 2024-09-12T00:04:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:04.337 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:04.338 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:04:04.339 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:04.337+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:04.439 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:04.437+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:04.469 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:04.469 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:04.469 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:04.469 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:04.483 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:04:04.564 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T00:04:04.565 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:04.561+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:04.642 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:04.641+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:04.698 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:04.698 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:04.698 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:04.698 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:04.698 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:04.716 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:04:04.743 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:04.744+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:04.843 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:04.841+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:04.929 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:04.929 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:04.929 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:04.929 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:04.929 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.930 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:04.930 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:04.930 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 33.599348896000002, 2024-09-12T00:04:04.930 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.027441031000000001, 2024-09-12T00:04:04.930 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:04.930 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:04.931 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.931 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:04.931 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:04.931 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.931 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:04:04.931 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.931 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:04.931 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.931 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:04.931 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:04.932 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:04.932 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.932 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.932 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:04.932 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:04.932 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:04.932 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330357+0000", 2024-09-12T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2339999999999996e-06 2024-09-12T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330381+0000", 2024-09-12T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4626000000000001e-05 2024-09-12T00:04:04.933 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330417+0000", 2024-09-12T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5886000000000002e-05 2024-09-12T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330442+0000", 2024-09-12T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4522999999999999e-05 2024-09-12T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335485+0000", 2024-09-12T00:04:04.934 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050432589999999996 2024-09-12T00:04:04.935 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.935 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.935 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:04.935 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335507+0000", 2024-09-12T00:04:04.935 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2013000000000001e-05 2024-09-12T00:04:04.935 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.935 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.935 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:04.935 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.351747+0000", 2024-09-12T00:04:04.935 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016240451999999999 2024-09-12T00:04:04.935 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.936 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.936 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:04.936 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352062+0000", 2024-09-12T00:04:04.936 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031433399999999999 2024-09-12T00:04:04.936 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.936 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.936 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:04.936 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352378+0000", 2024-09-12T00:04:04.936 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031586400000000001 2024-09-12T00:04:04.936 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.355074+0000", 2024-09-12T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026962919999999999 2024-09-12T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357537+0000", 2024-09-12T00:04:04.937 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024634689999999998 2024-09-12T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357680+0000", 2024-09-12T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014314899999999999 2024-09-12T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:04.938 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357793+0000", 2024-09-12T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011293 2024-09-12T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94232250902656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:04.939 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 33.571433736000003, 2024-09-12T00:04:04.940 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052696050000000001, 2024-09-12T00:04:04.940 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:04.940 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:04.940 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.940 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:04.940 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:04.940 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.940 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:04:04.940 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.941 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:04.941 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.941 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:04.941 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:04.941 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:04.941 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.941 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.941 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:04.941 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:04.942 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:04.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.942 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.942 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:04.942 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358270+0000", 2024-09-12T00:04:04.942 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.17e-06 2024-09-12T00:04:04.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.942 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.942 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:04.942 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358278+0000", 2024-09-12T00:04:04.942 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3529999999999995e-06 2024-09-12T00:04:04.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.943 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.943 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:04.943 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358306+0000", 2024-09-12T00:04:04.943 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7763000000000002e-05 2024-09-12T00:04:04.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.943 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.943 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.943 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358324+0000", 2024-09-12T00:04:04.944 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7861000000000001e-05 2024-09-12T00:04:04.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.944 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.944 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:04.944 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358447+0000", 2024-09-12T00:04:04.944 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012334299999999999 2024-09-12T00:04:04.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.945 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.945 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:04.945 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358624+0000", 2024-09-12T00:04:04.945 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017684999999999999 2024-09-12T00:04:04.945 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.945 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.945 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:04.945 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358964+0000", 2024-09-12T00:04:04.945 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00033991199999999999 2024-09-12T00:04:04.946 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.946 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.946 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.946 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.362920+0000", 2024-09-12T00:04:04.946 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039564600000000002 2024-09-12T00:04:04.946 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.946 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.946 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:04.946 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363016+0000", 2024-09-12T00:04:04.947 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5612999999999994e-05 2024-09-12T00:04:04.947 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.947 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.947 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:04.947 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363244+0000", 2024-09-12T00:04:04.947 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000228385 2024-09-12T00:04:04.947 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.947 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.947 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:04.947 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363537+0000", 2024-09-12T00:04:04.948 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00029289499999999999 2024-09-12T00:04:04.948 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:04.948 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:04.948 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:04.948 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.948 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.948 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.948 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:04.949 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 30.564056219000001, 2024-09-12T00:04:04.949 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011415537, 2024-09-12T00:04:04.949 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:04.949 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:04.949 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.949 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:04.949 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:04.949 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.950 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 209 2024-09-12T00:04:04.950 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.950 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:04.950 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.950 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:04.950 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:04.950 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:04.951 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.951 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.951 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:04.951 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:04.951 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:04.951 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.951 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.952 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:04.952 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365648+0000", 2024-09-12T00:04:04.952 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7360000000000001e-06 2024-09-12T00:04:04.952 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.952 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.952 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:04.952 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365660+0000", 2024-09-12T00:04:04.953 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2089999999999999e-05 2024-09-12T00:04:04.953 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.953 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.953 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:04.953 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365690+0000", 2024-09-12T00:04:04.953 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0320000000000001e-05 2024-09-12T00:04:04.953 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.953 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.953 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.953 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365708+0000", 2024-09-12T00:04:04.953 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7520000000000002e-05 2024-09-12T00:04:04.953 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.953 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.953 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:04.954 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365870+0000", 2024-09-12T00:04:04.954 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016208600000000001 2024-09-12T00:04:04.954 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.954 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.954 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:04.954 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365885+0000", 2024-09-12T00:04:04.954 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5119999999999999e-05 2024-09-12T00:04:04.954 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.954 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.954 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:04.954 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373482+0000", 2024-09-12T00:04:04.954 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075970279999999996 2024-09-12T00:04:04.954 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.955 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.955 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:04.955 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373805+0000", 2024-09-12T00:04:04.955 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032262799999999999 2024-09-12T00:04:04.955 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.955 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.955 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:04.955 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.374297+0000", 2024-09-12T00:04:04.955 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00049250599999999998 2024-09-12T00:04:04.955 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.955 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.955 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:04.956 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.375670+0000", 2024-09-12T00:04:04.956 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001373333 2024-09-12T00:04:04.956 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.956 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.956 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.956 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.376923+0000", 2024-09-12T00:04:04.956 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012525640000000001 2024-09-12T00:04:04.956 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.956 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.956 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:04.956 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377000+0000", 2024-09-12T00:04:04.957 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6732999999999999e-05 2024-09-12T00:04:04.957 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.957 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.957 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:04.957 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377061+0000", 2024-09-12T00:04:04.957 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0872999999999998e-05 2024-09-12T00:04:04.957 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:04.957 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:04.957 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:04.957 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.958 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.958 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:240 6.19 6:9f626c48:lc::lc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.958 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:04.958 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 30.445470466, 2024-09-12T00:04:04.958 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058545680000000001, 2024-09-12T00:04:04.958 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:04.958 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:04.958 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.958 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:04.958 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:04.958 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.959 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 240 2024-09-12T00:04:04.959 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.959 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:04.959 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.959 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:04.959 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:04.959 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:04.959 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.959 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.959 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:04.959 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:04.960 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:04.960 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.960 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.960 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:04.960 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484233+0000", 2024-09-12T00:04:04.960 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.973e-06 2024-09-12T00:04:04.960 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.961 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.961 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:04.961 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484241+0000", 2024-09-12T00:04:04.961 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8210000000000002e-06 2024-09-12T00:04:04.961 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.961 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.961 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:04.961 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484260+0000", 2024-09-12T00:04:04.962 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9148999999999999e-05 2024-09-12T00:04:04.962 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.962 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.962 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.962 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484268+0000", 2024-09-12T00:04:04.962 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5120000000000008e-06 2024-09-12T00:04:04.963 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.963 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.963 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:04.963 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484371+0000", 2024-09-12T00:04:04.963 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102501 2024-09-12T00:04:04.963 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.964 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.964 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:04.964 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484450+0000", 2024-09-12T00:04:04.964 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9122999999999994e-05 2024-09-12T00:04:04.964 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.964 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.965 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:04.965 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484578+0000", 2024-09-12T00:04:04.965 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000128095 2024-09-12T00:04:04.965 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.965 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.965 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:04.965 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.485336+0000", 2024-09-12T00:04:04.966 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00075754000000000001 2024-09-12T00:04:04.966 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.966 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.966 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.966 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.489975+0000", 2024-09-12T00:04:04.966 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004639738 2024-09-12T00:04:04.966 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.967 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.967 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:04.967 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490043+0000", 2024-09-12T00:04:04.967 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7923999999999995e-05 2024-09-12T00:04:04.967 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.967 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.967 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:04.967 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490085+0000", 2024-09-12T00:04:04.967 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2191999999999999e-05 2024-09-12T00:04:04.968 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:04.968 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:04.968 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:04.968 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.968 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.968 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:412 6.3 6:c3a682d4:reshard::reshard.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.968 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:04.968 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 30.403075059999999, 2024-09-12T00:04:04.968 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049075530000000003, 2024-09-12T00:04:04.968 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:04.968 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:04.968 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.968 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:04.969 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:04.969 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.969 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 412 2024-09-12T00:04:04.969 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.969 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:04.969 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.969 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:04.969 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:04.969 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:04.969 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.969 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.969 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:04.969 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:04.969 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:04.969 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.970 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.970 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:04.970 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526628+0000", 2024-09-12T00:04:04.970 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.513e-06 2024-09-12T00:04:04.970 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.970 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.970 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:04.970 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526634+0000", 2024-09-12T00:04:04.970 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1279999999999996e-06 2024-09-12T00:04:04.970 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.970 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.970 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:04.970 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526649+0000", 2024-09-12T00:04:04.971 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4997999999999999e-05 2024-09-12T00:04:04.971 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.971 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.971 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.971 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526658+0000", 2024-09-12T00:04:04.971 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1589999999999999e-06 2024-09-12T00:04:04.971 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.971 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.971 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:04.971 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526728+0000", 2024-09-12T00:04:04.971 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0203999999999994e-05 2024-09-12T00:04:04.971 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.971 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.971 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:04.972 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526839+0000", 2024-09-12T00:04:04.972 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011055 2024-09-12T00:04:04.972 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.972 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.972 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:04.972 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526979+0000", 2024-09-12T00:04:04.972 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139863 2024-09-12T00:04:04.972 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.972 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.972 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:04.972 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.527616+0000", 2024-09-12T00:04:04.972 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00063707900000000003 2024-09-12T00:04:04.972 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.972 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.973 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.973 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531450+0000", 2024-09-12T00:04:04.973 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003833819 2024-09-12T00:04:04.973 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.973 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.973 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:04.973 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531490+0000", 2024-09-12T00:04:04.973 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0129000000000002e-05 2024-09-12T00:04:04.973 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.973 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.973 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:04.973 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531534+0000", 2024-09-12T00:04:04.973 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4110999999999998e-05 2024-09-12T00:04:04.974 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:04.974 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:04.974 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:04.974 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.974 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.974 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:490 6.19 6:9dc32cef:lc::lc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.974 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:04.974 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 30.378877685999999, 2024-09-12T00:04:04.974 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047438380000000002, 2024-09-12T00:04:04.974 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:04.974 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:04.974 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.974 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:04.974 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:04.975 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.975 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 490 2024-09-12T00:04:04.975 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.975 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:04.975 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.975 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:04.975 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:04.975 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:04.975 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.975 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.975 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:04.975 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:04.975 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:04.975 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.976 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.976 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:04.976 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550825+0000", 2024-09-12T00:04:04.976 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0589999999999999e-06 2024-09-12T00:04:04.976 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.976 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.976 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:04.976 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550830+0000", 2024-09-12T00:04:04.976 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2140000000000004e-06 2024-09-12T00:04:04.976 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.976 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.976 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:04.976 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550843+0000", 2024-09-12T00:04:04.976 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3404000000000001e-05 2024-09-12T00:04:04.977 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.977 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.977 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.977 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550852+0000", 2024-09-12T00:04:04.977 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1549999999999996e-06 2024-09-12T00:04:04.977 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.977 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.977 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:04.977 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550910+0000", 2024-09-12T00:04:04.977 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7636000000000002e-05 2024-09-12T00:04:04.977 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.977 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.977 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:04.977 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550977+0000", 2024-09-12T00:04:04.978 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6636000000000004e-05 2024-09-12T00:04:04.978 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.978 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.978 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:04.978 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.551135+0000", 2024-09-12T00:04:04.978 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015852999999999999 2024-09-12T00:04:04.978 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.978 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.978 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.978 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552939+0000", 2024-09-12T00:04:04.978 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001803643 2024-09-12T00:04:04.978 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.978 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.978 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:04.979 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555471+0000", 2024-09-12T00:04:04.979 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002532327 2024-09-12T00:04:04.979 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.979 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.979 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:04.979 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555526+0000", 2024-09-12T00:04:04.979 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4728000000000002e-05 2024-09-12T00:04:04.979 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.979 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.979 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:04.979 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555567+0000", 2024-09-12T00:04:04.979 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1505999999999999e-05 2024-09-12T00:04:04.979 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:04.979 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:04.980 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:04.980 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.980 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.980 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:492 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'6, mlcod=35'4)", 2024-09-12T00:04:04.980 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:04.980 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 30.377101622000001, 2024-09-12T00:04:04.980 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056118790000000002, 2024-09-12T00:04:04.980 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:04.980 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:04.980 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.980 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:04.980 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.980 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:04.980 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:04.981 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:04.981 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.981 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.981 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:04.981 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:04.981 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:04.981 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.981 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.981 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:04.981 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552601+0000", 2024-09-12T00:04:04.981 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6899999999999996e-07 2024-09-12T00:04:04.981 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.981 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.981 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:04.982 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552608+0000", 2024-09-12T00:04:04.982 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4529999999999996e-06 2024-09-12T00:04:04.982 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.982 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.982 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:04.982 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552624+0000", 2024-09-12T00:04:04.982 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5885000000000001e-05 2024-09-12T00:04:04.982 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.982 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.982 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.982 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552632+0000", 2024-09-12T00:04:04.982 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2220000000000002e-06 2024-09-12T00:04:04.982 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.983 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.983 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:04.983 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552716+0000", 2024-09-12T00:04:04.983 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4060999999999994e-05 2024-09-12T00:04:04.983 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.983 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.983 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:04.983 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552735+0000", 2024-09-12T00:04:04.983 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9170000000000001e-05 2024-09-12T00:04:04.983 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.983 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.983 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:04.983 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558164+0000", 2024-09-12T00:04:04.983 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054289899999999999 2024-09-12T00:04:04.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.984 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.984 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:04.984 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558212+0000", 2024-09-12T00:04:04.984 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7129000000000002e-05 2024-09-12T00:04:04.984 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:04.984 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:04.984 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:04.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.984 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.984 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:496 6.3 6:c134263f:lc::lc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.984 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:04.984 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 30.375994334000001, 2024-09-12T00:04:04.985 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045956260000000002, 2024-09-12T00:04:04.985 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:04.985 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:04.985 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.985 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:04.985 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:04.985 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.985 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 496 2024-09-12T00:04:04.985 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.985 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:04.985 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.985 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:04.985 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:04.985 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:04.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.986 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.986 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:04.986 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:04.986 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:04.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.986 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.986 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:04.986 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553708+0000", 2024-09-12T00:04:04.986 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2359999999999999e-06 2024-09-12T00:04:04.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.986 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.986 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:04.986 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553714+0000", 2024-09-12T00:04:04.987 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4960000000000004e-06 2024-09-12T00:04:04.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.987 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.987 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:04.987 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553726+0000", 2024-09-12T00:04:04.987 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2618e-05 2024-09-12T00:04:04.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.987 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.987 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.987 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553734+0000", 2024-09-12T00:04:04.987 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4159999999999998e-06 2024-09-12T00:04:04.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.987 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.988 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:04.988 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553771+0000", 2024-09-12T00:04:04.988 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7095999999999999e-05 2024-09-12T00:04:04.988 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.988 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.988 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:04.988 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553815+0000", 2024-09-12T00:04:04.988 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3986999999999997e-05 2024-09-12T00:04:04.988 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.988 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.988 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:04.988 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553922+0000", 2024-09-12T00:04:04.988 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000107534 2024-09-12T00:04:04.988 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.989 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.989 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.989 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555052+0000", 2024-09-12T00:04:04.989 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011298359999999999 2024-09-12T00:04:04.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.989 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.989 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:04.989 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558197+0000", 2024-09-12T00:04:04.989 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0031450269999999999 2024-09-12T00:04:04.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.989 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.989 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:04.989 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558256+0000", 2024-09-12T00:04:04.989 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8403999999999999e-05 2024-09-12T00:04:04.990 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.990 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.990 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:04.990 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558303+0000", 2024-09-12T00:04:04.990 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6975999999999999e-05 2024-09-12T00:04:04.990 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:04.990 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:04.990 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:04.990 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.990 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.990 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:641 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:04.990 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:04.990 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 30.335924006999999, 2024-09-12T00:04:04.990 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052824789999999996, 2024-09-12T00:04:04.991 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:04.991 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:04.991 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.991 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:04.991 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:04.991 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:04.991 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 641 2024-09-12T00:04:04.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.991 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:04.991 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.991 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:04.991 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:04.991 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:04.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.992 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.992 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:04.992 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:04.992 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:04.992 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.992 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.992 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:04.992 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593778+0000", 2024-09-12T00:04:04.992 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0920000000000001e-06 2024-09-12T00:04:04.992 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.992 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.992 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:04.992 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593783+0000", 2024-09-12T00:04:04.992 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9490000000000004e-06 2024-09-12T00:04:04.993 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.993 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.993 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:04.993 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593795+0000", 2024-09-12T00:04:04.993 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2048999999999999e-05 2024-09-12T00:04:04.993 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.993 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.993 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.993 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593801+0000", 2024-09-12T00:04:04.993 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8989999999999998e-06 2024-09-12T00:04:04.993 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.993 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.993 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:04.993 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593852+0000", 2024-09-12T00:04:04.994 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1057999999999998e-05 2024-09-12T00:04:04.994 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.994 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.994 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:04.994 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593905+0000", 2024-09-12T00:04:04.994 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2196e-05 2024-09-12T00:04:04.994 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.994 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.994 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:04.994 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594017+0000", 2024-09-12T00:04:04.994 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000112816 2024-09-12T00:04:04.994 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.994 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.994 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:04.995 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.595190+0000", 2024-09-12T00:04:04.995 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011727199999999999 2024-09-12T00:04:04.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.995 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.995 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:04.995 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.598998+0000", 2024-09-12T00:04:04.995 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038081320000000001 2024-09-12T00:04:04.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.995 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.995 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:04.995 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599032+0000", 2024-09-12T00:04:04.995 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4283999999999999e-05 2024-09-12T00:04:04.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.995 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.996 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:04.996 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599060+0000", 2024-09-12T00:04:04.996 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7284000000000002e-05 2024-09-12T00:04:04.996 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:04.996 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:04.996 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:04.996 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.996 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.996 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:643 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'8, mlcod=35'6)", 2024-09-12T00:04:04.996 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:04.996 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 30.335425900000001, 2024-09-12T00:04:04.996 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048211260000000002, 2024-09-12T00:04:04.996 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:04.996 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:04.997 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:04.997 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:04.997 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.997 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:04.997 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:04.997 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:04.997 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.997 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.997 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:04.997 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:04.997 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:04.997 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.997 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.997 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:04.997 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594276+0000", 2024-09-12T00:04:04.998 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5899999999999995e-07 2024-09-12T00:04:04.998 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.998 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.998 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:04.998 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594283+0000", 2024-09-12T00:04:04.998 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6019999999999996e-06 2024-09-12T00:04:04.998 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.998 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.998 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:04.998 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594295+0000", 2024-09-12T00:04:04.998 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1683e-05 2024-09-12T00:04:04.998 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.998 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.999 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:04.999 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594303+0000", 2024-09-12T00:04:04.999 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0439999999999996e-06 2024-09-12T00:04:04.999 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.999 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.999 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:04.999 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594353+0000", 2024-09-12T00:04:04.999 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0698000000000001e-05 2024-09-12T00:04:04.999 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:04.999 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:04.999 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:04.999 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594380+0000", 2024-09-12T00:04:04.999 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7089000000000001e-05 2024-09-12T00:04:04.999 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.000 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.000 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.000 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599063+0000", 2024-09-12T00:04:05.000 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046824739999999998 2024-09-12T00:04:05.000 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.000 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.000 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.000 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599096+0000", 2024-09-12T00:04:05.000 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3677000000000003e-05 2024-09-12T00:04:05.000 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.000 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.000 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.001 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.001 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.001 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:647 6.a 6:5395e6f3:lc::lc.4:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:05.001 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:05.001 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 30.333075267000002, 2024-09-12T00:04:05.001 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049071770000000004, 2024-09-12T00:04:05.001 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.001 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.001 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.001 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.001 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:05.001 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:05.001 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 647 2024-09-12T00:04:05.001 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.002 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.002 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.002 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.002 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:05.002 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.002 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.002 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.002 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.002 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:05.002 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.002 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.002 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.002 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.002 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596627+0000", 2024-09-12T00:04:05.003 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1149999999999999e-06 2024-09-12T00:04:05.003 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.003 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.003 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.003 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596632+0000", 2024-09-12T00:04:05.003 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7060000000000003e-06 2024-09-12T00:04:05.003 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.003 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.003 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.003 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596645+0000", 2024-09-12T00:04:05.003 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2791e-05 2024-09-12T00:04:05.003 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.003 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.003 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.004 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596653+0000", 2024-09-12T00:04:05.004 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9230000000000002e-06 2024-09-12T00:04:05.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.004 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.004 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.004 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596705+0000", 2024-09-12T00:04:05.004 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2250000000000003e-05 2024-09-12T00:04:05.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.004 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.004 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.004 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596758+0000", 2024-09-12T00:04:05.004 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2964000000000003e-05 2024-09-12T00:04:05.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.004 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.005 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:05.005 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596873+0000", 2024-09-12T00:04:05.005 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011501 2024-09-12T00:04:05.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.005 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.005 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.005 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599088+0000", 2024-09-12T00:04:05.005 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002215135 2024-09-12T00:04:05.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.005 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.005 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.005 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601456+0000", 2024-09-12T00:04:05.005 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023684719999999999 2024-09-12T00:04:05.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.006 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.006 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.006 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601507+0000", 2024-09-12T00:04:05.006 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0933999999999997e-05 2024-09-12T00:04:05.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.006 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.006 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.006 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601533+0000", 2024-09-12T00:04:05.006 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5877e-05 2024-09-12T00:04:05.006 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.006 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.006 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.007 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.007 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:657 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'10, mlcod=35'7)", 2024-09-12T00:04:05.007 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:05.007 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 30.329251726999999, 2024-09-12T00:04:05.007 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066410239999999997, 2024-09-12T00:04:05.007 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.007 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.007 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.007 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.007 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.007 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.007 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:05.007 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.007 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.008 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.008 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:05.008 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.008 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.008 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.008 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:05.008 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6099999999999999e-07 2024-09-12T00:04:05.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.008 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.008 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.008 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600457+0000", 2024-09-12T00:04:05.008 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8700000000000003e-06 2024-09-12T00:04:05.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.009 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.009 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.009 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600470+0000", 2024-09-12T00:04:05.009 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3186999999999999e-05 2024-09-12T00:04:05.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.009 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.009 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.009 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600478+0000", 2024-09-12T00:04:05.009 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5310000000000004e-06 2024-09-12T00:04:05.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.009 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.009 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.009 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600521+0000", 2024-09-12T00:04:05.010 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2574000000000003e-05 2024-09-12T00:04:05.010 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.010 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.010 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.010 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600535+0000", 2024-09-12T00:04:05.010 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4151000000000001e-05 2024-09-12T00:04:05.010 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.010 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.010 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.010 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.606997+0000", 2024-09-12T00:04:05.010 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064626099999999997 2024-09-12T00:04:05.010 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.010 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.010 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.011 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607091+0000", 2024-09-12T00:04:05.011 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3239999999999995e-05 2024-09-12T00:04:05.011 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.011 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.011 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.011 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.011 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:659 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:05.011 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:05.011 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 30.329079395000001, 2024-09-12T00:04:05.011 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0065340989999999998, 2024-09-12T00:04:05.011 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.011 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.011 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.011 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.012 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:05.012 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:05.012 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 659 2024-09-12T00:04:05.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.012 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.012 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.012 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.012 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:05.012 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.012 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.012 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.012 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:05.013 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.013 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.013 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.013 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.013 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600623+0000", 2024-09-12T00:04:05.013 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.085e-06 2024-09-12T00:04:05.013 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.013 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.013 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.013 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600630+0000", 2024-09-12T00:04:05.013 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0029999999999997e-06 2024-09-12T00:04:05.013 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.013 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.013 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.014 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600647+0000", 2024-09-12T00:04:05.014 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6566999999999999e-05 2024-09-12T00:04:05.014 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.014 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.014 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.014 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600658+0000", 2024-09-12T00:04:05.014 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0992000000000001e-05 2024-09-12T00:04:05.014 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.014 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.014 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.014 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600717+0000", 2024-09-12T00:04:05.014 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9925e-05 2024-09-12T00:04:05.014 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.014 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.015 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.015 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600773+0000", 2024-09-12T00:04:05.015 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5766000000000001e-05 2024-09-12T00:04:05.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.015 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.015 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:05.015 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600889+0000", 2024-09-12T00:04:05.015 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115906 2024-09-12T00:04:05.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.015 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.015 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.015 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603483+0000", 2024-09-12T00:04:05.015 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025940799999999999 2024-09-12T00:04:05.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.016 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.016 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.016 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607098+0000", 2024-09-12T00:04:05.016 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036150459999999998 2024-09-12T00:04:05.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.016 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.016 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.016 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607133+0000", 2024-09-12T00:04:05.016 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4615e-05 2024-09-12T00:04:05.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.016 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.016 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.016 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607156+0000", 2024-09-12T00:04:05.016 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3113999999999999e-05 2024-09-12T00:04:05.017 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.017 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.017 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.017 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.017 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.017 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:666 6.a 6:5395e6f3:lc::lc.4:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:05.017 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:05.017 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 30.327332265999999, 2024-09-12T00:04:05.017 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.005127174, 2024-09-12T00:04:05.017 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.017 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.017 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.017 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.017 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:05.018 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:05.018 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 666 2024-09-12T00:04:05.018 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.018 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.018 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.018 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.018 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:05.018 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.018 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.018 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.018 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.018 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:05.018 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.018 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.019 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.019 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.019 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602370+0000", 2024-09-12T00:04:05.019 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0720000000000001e-06 2024-09-12T00:04:05.019 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.019 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.019 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.019 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602376+0000", 2024-09-12T00:04:05.019 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5489999999999997e-06 2024-09-12T00:04:05.019 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.019 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.019 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.019 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602391+0000", 2024-09-12T00:04:05.019 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5301000000000001e-05 2024-09-12T00:04:05.020 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.020 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.020 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.020 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602399+0000", 2024-09-12T00:04:05.020 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9179999999999994e-06 2024-09-12T00:04:05.020 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.020 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.020 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.020 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602456+0000", 2024-09-12T00:04:05.020 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7099999999999999e-05 2024-09-12T00:04:05.020 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.020 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.020 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.020 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602508+0000", 2024-09-12T00:04:05.021 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2476999999999999e-05 2024-09-12T00:04:05.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.021 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.021 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:05.021 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602606+0000", 2024-09-12T00:04:05.021 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7823000000000002e-05 2024-09-12T00:04:05.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.021 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.021 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.021 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.604653+0000", 2024-09-12T00:04:05.021 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002047068 2024-09-12T00:04:05.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.021 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.021 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.022 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607401+0000", 2024-09-12T00:04:05.022 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027477700000000001 2024-09-12T00:04:05.022 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.022 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.022 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.022 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607453+0000", 2024-09-12T00:04:05.022 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2092999999999997e-05 2024-09-12T00:04:05.022 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.022 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.022 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.022 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607496+0000", 2024-09-12T00:04:05.022 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3003000000000001e-05 2024-09-12T00:04:05.022 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.022 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.023 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.023 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.023 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.023 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:665 6.1a e35/29 6:5c7e8a6d:reshard::reshard.0000000015:head v 35'11, mlcod=35'8)", 2024-09-12T00:04:05.023 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:05.023 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 30.326960581000002, 2024-09-12T00:04:05.023 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048593209999999998, 2024-09-12T00:04:05.023 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.023 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.023 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.023 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.023 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.023 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.023 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:05.024 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.024 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.024 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.024 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.024 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:05.024 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.024 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.024 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.024 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.024 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602742+0000", 2024-09-12T00:04:05.024 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1069999999999999e-06 2024-09-12T00:04:05.024 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.024 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.024 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.025 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602749+0000", 2024-09-12T00:04:05.025 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9609999999999999e-06 2024-09-12T00:04:05.025 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.025 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.025 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.025 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602763+0000", 2024-09-12T00:04:05.025 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4086e-05 2024-09-12T00:04:05.025 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.025 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.025 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.025 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602772+0000", 2024-09-12T00:04:05.025 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8470000000000002e-06 2024-09-12T00:04:05.025 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.025 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.025 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.026 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602826+0000", 2024-09-12T00:04:05.026 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3885000000000003e-05 2024-09-12T00:04:05.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.026 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.026 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.026 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602837+0000", 2024-09-12T00:04:05.026 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1601e-05 2024-09-12T00:04:05.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.026 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.026 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.026 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607500+0000", 2024-09-12T00:04:05.026 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046627509999999997 2024-09-12T00:04:05.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.027 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.027 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.027 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607600+0000", 2024-09-12T00:04:05.027 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100083 2024-09-12T00:04:05.027 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.027 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.027 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.027 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.027 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.027 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:831 6.19 6:9d23f22c:lc::lc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:05.027 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:05.027 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 30.263675900999999, 2024-09-12T00:04:05.027 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047044610000000001, 2024-09-12T00:04:05.027 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.028 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.028 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.028 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.028 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:05.028 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:05.028 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 831 2024-09-12T00:04:05.028 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.028 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.028 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.028 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.028 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:05.028 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.028 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.029 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.029 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.029 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:05.029 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.029 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.029 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.029 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.029 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666026+0000", 2024-09-12T00:04:05.029 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.02e-06 2024-09-12T00:04:05.029 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.029 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.029 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.029 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666032+0000", 2024-09-12T00:04:05.029 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8850000000000004e-06 2024-09-12T00:04:05.030 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.030 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.030 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.030 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666047+0000", 2024-09-12T00:04:05.030 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4647999999999999e-05 2024-09-12T00:04:05.030 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.030 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.030 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.030 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666058+0000", 2024-09-12T00:04:05.030 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0905e-05 2024-09-12T00:04:05.030 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.030 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.030 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.030 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666376+0000", 2024-09-12T00:04:05.031 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031824899999999999 2024-09-12T00:04:05.031 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.031 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.031 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.031 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666479+0000", 2024-09-12T00:04:05.031 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102814 2024-09-12T00:04:05.031 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.031 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.031 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.031 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666635+0000", 2024-09-12T00:04:05.031 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000156343 2024-09-12T00:04:05.031 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.031 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.031 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.031 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.667611+0000", 2024-09-12T00:04:05.032 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000975671 2024-09-12T00:04:05.032 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.032 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.032 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.032 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670662+0000", 2024-09-12T00:04:05.032 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003050863 2024-09-12T00:04:05.032 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.032 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.032 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.032 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670701+0000", 2024-09-12T00:04:05.032 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9338000000000002e-05 2024-09-12T00:04:05.032 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.032 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.032 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.033 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670730+0000", 2024-09-12T00:04:05.033 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8725e-05 2024-09-12T00:04:05.033 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.033 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.033 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.033 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.033 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.033 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:852 6.1d e35/29 6:bbf2d10c:::obj_delete_at_hint.0000000025:head v 35'9, mlcod=35'7)", 2024-09-12T00:04:05.033 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:05.033 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 30.255098847999999, 2024-09-12T00:04:05.033 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00569595, 2024-09-12T00:04:05.033 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.033 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.033 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.034 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.034 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.034 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.034 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:05.034 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.034 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.034 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.034 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.034 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:05.034 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.034 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.034 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.034 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.034 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674604+0000", 2024-09-12T00:04:05.035 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2079999999999999e-06 2024-09-12T00:04:05.035 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.035 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.035 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.035 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674611+0000", 2024-09-12T00:04:05.035 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.973e-06 2024-09-12T00:04:05.035 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.035 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.035 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.035 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674625+0000", 2024-09-12T00:04:05.035 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3916e-05 2024-09-12T00:04:05.035 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.035 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.035 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.036 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674633+0000", 2024-09-12T00:04:05.036 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8580000000000006e-06 2024-09-12T00:04:05.036 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.036 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.036 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.036 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674697+0000", 2024-09-12T00:04:05.036 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4004999999999995e-05 2024-09-12T00:04:05.036 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.036 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.036 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.036 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674713+0000", 2024-09-12T00:04:05.036 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5835e-05 2024-09-12T00:04:05.036 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.036 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.037 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.037 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680245+0000", 2024-09-12T00:04:05.037 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055320250000000003 2024-09-12T00:04:05.037 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.037 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.037 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.037 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680298+0000", 2024-09-12T00:04:05.037 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3130000000000001e-05 2024-09-12T00:04:05.037 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.037 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.037 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.037 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.037 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.037 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:925 6.1a e35/29 6:5f2e3d26:lc::lc.18:head v 35'15, mlcod=35'12)", 2024-09-12T00:04:05.038 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:05.038 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 30.231571018, 2024-09-12T00:04:05.038 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055640999999999998, 2024-09-12T00:04:05.038 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.038 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.038 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.038 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.038 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.038 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.038 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:05.038 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.038 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.038 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.038 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.039 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:05.039 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.039 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.039 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.039 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.039 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698131+0000", 2024-09-12T00:04:05.039 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:04:05.039 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.039 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.039 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.039 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698140+0000", 2024-09-12T00:04:05.039 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3139999999999993e-06 2024-09-12T00:04:05.039 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.039 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.039 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.040 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698155+0000", 2024-09-12T00:04:05.040 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:04:05.040 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.040 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.040 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.040 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698164+0000", 2024-09-12T00:04:05.040 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1419999999999999e-06 2024-09-12T00:04:05.040 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.040 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.040 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.040 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698228+0000", 2024-09-12T00:04:05.040 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3380000000000006e-05 2024-09-12T00:04:05.040 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.041 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.041 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.041 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698252+0000", 2024-09-12T00:04:05.041 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4111e-05 2024-09-12T00:04:05.041 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.041 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.041 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.041 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703646+0000", 2024-09-12T00:04:05.041 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0053937840000000004 2024-09-12T00:04:05.041 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.041 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.041 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.041 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703694+0000", 2024-09-12T00:04:05.041 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8776999999999997e-05 2024-09-12T00:04:05.042 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.042 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.042 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.042 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.042 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.042 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:927 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:05.042 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:05.042 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 30.231051994000001, 2024-09-12T00:04:05.042 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050914949999999997, 2024-09-12T00:04:05.042 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.042 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.042 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.042 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.042 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:05.043 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:05.043 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 927 2024-09-12T00:04:05.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.043 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.043 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.043 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.043 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:05.043 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.043 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.043 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.043 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:05.043 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.044 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.044 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.044 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698651+0000", 2024-09-12T00:04:05.044 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3740000000000001e-06 2024-09-12T00:04:05.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.044 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.044 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.044 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698657+0000", 2024-09-12T00:04:05.044 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5239999999999997e-06 2024-09-12T00:04:05.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.044 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.044 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.044 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698673+0000", 2024-09-12T00:04:05.044 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5345999999999998e-05 2024-09-12T00:04:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698680+0000", 2024-09-12T00:04:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4649999999999997e-06 2024-09-12T00:04:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699009+0000", 2024-09-12T00:04:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032934000000000001 2024-09-12T00:04:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699213+0000", 2024-09-12T00:04:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020361500000000001 2024-09-12T00:04:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699450+0000", 2024-09-12T00:04:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023670399999999999 2024-09-12T00:04:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.700678+0000", 2024-09-12T00:04:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012285519999999999 2024-09-12T00:04:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703666+0000", 2024-09-12T00:04:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029876130000000001 2024-09-12T00:04:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703708+0000", 2024-09-12T00:04:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2361999999999999e-05 2024-09-12T00:04:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703741+0000", 2024-09-12T00:04:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.26e-05 2024-09-12T00:04:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.048 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.048 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:941 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:05.048 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:05.048 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 30.225558541000002, 2024-09-12T00:04:05.048 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0051476960000000002, 2024-09-12T00:04:05.048 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.048 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.048 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "started", 2024-09-12T00:04:05.048 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.048 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:05.048 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:05.048 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 941 2024-09-12T00:04:05.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.049 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.049 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.049 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.049 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:05.049 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.049 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.049 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.049 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:05.049 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.049 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.049 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.050 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704144+0000", 2024-09-12T00:04:05.050 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.514e-06 2024-09-12T00:04:05.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.050 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.050 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.050 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704152+0000", 2024-09-12T00:04:05.050 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2830000000000004e-06 2024-09-12T00:04:05.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.050 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.050 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.050 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704168+0000", 2024-09-12T00:04:05.050 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6835999999999999e-05 2024-09-12T00:04:05.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.050 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.050 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704178+0000", 2024-09-12T00:04:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7569999999999999e-06 2024-09-12T00:04:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704240+0000", 2024-09-12T00:04:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2193000000000006e-05 2024-09-12T00:04:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704308+0000", 2024-09-12T00:04:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7840000000000001e-05 2024-09-12T00:04:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.051 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.052 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.052 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.709290+0000", 2024-09-12T00:04:05.052 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049822729999999997 2024-09-12T00:04:05.052 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.052 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.052 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.052 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.052 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.052 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:05.054 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:04:05.054 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:05.053+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:05.155 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:05.156+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:05.255 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:05.253+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:05.266 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:05.266 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:05.266 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:05.266 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:05.283 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:04:05.373 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:05.373+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:05.457 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:05.457+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:05.495 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:05.495 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:05.495 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:05.495 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:05.495 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:05.512 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:04:05.601 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:05.601+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:05.660 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:05.657+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:05.725 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:05.725 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:05.725 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:05.726 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:05.726 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.726 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:05.726 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:05.726 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 54.232200380999998, 2024-09-12T00:04:05.726 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.278479906, 2024-09-12T00:04:05.726 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.726 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.726 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.726 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.726 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:05.726 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:05.726 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:04:05.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.727 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:05.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:05.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.728 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493422+0000", 2024-09-12T00:04:05.728 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.807e-06 2024-09-12T00:04:05.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.728 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.728 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493435+0000", 2024-09-12T00:04:05.728 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.375e-05 2024-09-12T00:04:05.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.728 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.728 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493457+0000", 2024-09-12T00:04:05.728 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2166000000000001e-05 2024-09-12T00:04:05.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.729 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.729 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493475+0000", 2024-09-12T00:04:05.729 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7184e-05 2024-09-12T00:04:05.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.729 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.729 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.729 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493617+0000", 2024-09-12T00:04:05.729 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014274200000000001 2024-09-12T00:04:05.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.729 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.729 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:05.729 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493632+0000", 2024-09-12T00:04:05.729 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4293e-05 2024-09-12T00:04:05.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.730 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.730 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.730 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.768657+0000", 2024-09-12T00:04:05.730 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.27502575400000001 2024-09-12T00:04:05.730 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.730 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.730 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.730 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769042+0000", 2024-09-12T00:04:05.730 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00038463700000000001 2024-09-12T00:04:05.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.731 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.731 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.731 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769430+0000", 2024-09-12T00:04:05.731 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000388014 2024-09-12T00:04:05.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.731 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.731 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.731 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.770784+0000", 2024-09-12T00:04:05.731 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00135402 2024-09-12T00:04:05.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.731 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.731 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.732 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771735+0000", 2024-09-12T00:04:05.732 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00095068599999999996 2024-09-12T00:04:05.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.732 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771828+0000", 2024-09-12T00:04:05.732 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3468999999999996e-05 2024-09-12T00:04:05.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.732 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771899+0000", 2024-09-12T00:04:05.732 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0383999999999996e-05 2024-09-12T00:04:05.732 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.732 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.733 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.733 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:05.733 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:05.733 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.803976624999997, 2024-09-12T00:04:05.733 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013402304, 2024-09-12T00:04:05.733 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.733 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.733 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.734 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.734 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:05.734 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:05.734 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 44 2024-09-12T00:04:05.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.734 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.734 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.734 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.734 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:05.734 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.734 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:05.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:05.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7100000000000001e-07 2024-09-12T00:04:05.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921706+0000", 2024-09-12T00:04:05.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2374999999999998e-05 2024-09-12T00:04:05.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.736 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.736 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921726+0000", 2024-09-12T00:04:05.736 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0373999999999998e-05 2024-09-12T00:04:05.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.736 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.736 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921733+0000", 2024-09-12T00:04:05.736 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8929999999999999e-06 2024-09-12T00:04:05.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.736 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.737 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927137+0000", 2024-09-12T00:04:05.737 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054037410000000001 2024-09-12T00:04:05.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.737 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.737 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927274+0000", 2024-09-12T00:04:05.737 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013697899999999999 2024-09-12T00:04:05.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.737 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.737 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927504+0000", 2024-09-12T00:04:05.737 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023005399999999999 2024-09-12T00:04:05.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.738 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.931848+0000", 2024-09-12T00:04:05.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0043445269999999999 2024-09-12T00:04:05.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.738 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934770+0000", 2024-09-12T00:04:05.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002922319 2024-09-12T00:04:05.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.738 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934901+0000", 2024-09-12T00:04:05.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013034599999999999 2024-09-12T00:04:05.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.739 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935045+0000", 2024-09-12T00:04:05.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014402499999999999 2024-09-12T00:04:05.739 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.739 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.739 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.739 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:05.739 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:05.739 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.803873660000001, 2024-09-12T00:04:05.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013456684999999999, 2024-09-12T00:04:05.740 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.740 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.740 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.740 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.740 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:05.740 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:05.740 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 45 2024-09-12T00:04:05.740 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.740 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.740 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.740 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.740 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:05.740 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.740 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:05.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921746+0000", 2024-09-12T00:04:05.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9800000000000003e-07 2024-09-12T00:04:05.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921751+0000", 2024-09-12T00:04:05.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7099999999999998e-06 2024-09-12T00:04:05.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921766+0000", 2024-09-12T00:04:05.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5633000000000001e-05 2024-09-12T00:04:05.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921786+0000", 2024-09-12T00:04:05.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9658000000000001e-05 2024-09-12T00:04:05.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929539+0000", 2024-09-12T00:04:05.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0077533120000000001 2024-09-12T00:04:05.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.743 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.743 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929706+0000", 2024-09-12T00:04:05.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016664199999999999 2024-09-12T00:04:05.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.743 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.743 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929933+0000", 2024-09-12T00:04:05.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000226658 2024-09-12T00:04:05.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.743 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.744 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934721+0000", 2024-09-12T00:04:05.744 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047886439999999999 2024-09-12T00:04:05.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.744 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.744 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935062+0000", 2024-09-12T00:04:05.744 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00034072399999999999 2024-09-12T00:04:05.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.744 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.744 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935141+0000", 2024-09-12T00:04:05.744 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8570000000000002e-05 2024-09-12T00:04:05.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.745 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.745 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935202+0000", 2024-09-12T00:04:05.745 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1536000000000002e-05 2024-09-12T00:04:05.745 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.745 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.745 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.745 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.745 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.745 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:05.745 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:05.745 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.803823428000001, 2024-09-12T00:04:05.745 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014633617, 2024-09-12T00:04:05.745 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.745 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.746 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.746 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.746 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:05.746 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:05.746 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:04:05.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.746 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.746 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.746 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.746 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:05.746 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.746 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.746 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:05.747 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:05.747 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3599999999999999e-07 2024-09-12T00:04:05.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921800+0000", 2024-09-12T00:04:05.747 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3850000000000002e-06 2024-09-12T00:04:05.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.748 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921805+0000", 2024-09-12T00:04:05.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9460000000000003e-06 2024-09-12T00:04:05.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.748 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921819+0000", 2024-09-12T00:04:05.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.325e-05 2024-09-12T00:04:05.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.748 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930627+0000", 2024-09-12T00:04:05.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00880827 2024-09-12T00:04:05.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.749 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.749 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.749 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930805+0000", 2024-09-12T00:04:05.749 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000177992 2024-09-12T00:04:05.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.749 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.749 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.749 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.931028+0000", 2024-09-12T00:04:05.749 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000223122 2024-09-12T00:04:05.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.749 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.749 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.749 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935258+0000", 2024-09-12T00:04:05.750 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0042302709999999999 2024-09-12T00:04:05.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.750 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.750 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936282+0000", 2024-09-12T00:04:05.750 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00102345 2024-09-12T00:04:05.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.750 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.750 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936367+0000", 2024-09-12T00:04:05.750 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4869000000000003e-05 2024-09-12T00:04:05.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.750 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.750 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936429+0000", 2024-09-12T00:04:05.751 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2626000000000007e-05 2024-09-12T00:04:05.751 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.751 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.751 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.751 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.751 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.751 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:05.751 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:05.751 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.803787178, 2024-09-12T00:04:05.751 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016022492999999999, 2024-09-12T00:04:05.751 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.751 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.751 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.751 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.752 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:05.752 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:05.752 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:04:05.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.752 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.752 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.752 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.752 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:05.752 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.752 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.752 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.752 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:05.752 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:05.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4000000000000002e-07 2024-09-12T00:04:05.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921891+0000", 2024-09-12T00:04:05.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8298000000000003e-05 2024-09-12T00:04:05.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921899+0000", 2024-09-12T00:04:05.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7059999999999993e-06 2024-09-12T00:04:05.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.754 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921904+0000", 2024-09-12T00:04:05.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9799999999999998e-06 2024-09-12T00:04:05.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.754 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932144+0000", 2024-09-12T00:04:05.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010239817999999999 2024-09-12T00:04:05.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.755 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.755 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932284+0000", 2024-09-12T00:04:05.755 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139436 2024-09-12T00:04:05.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.755 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.755 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.755 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932498+0000", 2024-09-12T00:04:05.755 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000214408 2024-09-12T00:04:05.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.755 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.755 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.755 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936444+0000", 2024-09-12T00:04:05.755 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039464169999999998 2024-09-12T00:04:05.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.755 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.756 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.756 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937702+0000", 2024-09-12T00:04:05.756 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012571679999999999 2024-09-12T00:04:05.756 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.756 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.756 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.756 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937793+0000", 2024-09-12T00:04:05.756 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1489000000000004e-05 2024-09-12T00:04:05.756 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.756 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.756 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.756 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937854+0000", 2024-09-12T00:04:05.756 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1333000000000004e-05 2024-09-12T00:04:05.757 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.757 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.757 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.757 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.757 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.757 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:05.757 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:05.757 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.803705309999998, 2024-09-12T00:04:05.757 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017189138999999999, 2024-09-12T00:04:05.757 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.757 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.757 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.757 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.758 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:05.758 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:05.758 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 48 2024-09-12T00:04:05.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.758 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.758 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.758 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.758 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:05.758 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.758 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.758 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.758 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:05.758 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.759 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.759 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.759 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:05.759 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7399999999999998e-07 2024-09-12T00:04:05.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.759 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.759 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.759 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921918+0000", 2024-09-12T00:04:05.759 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6399999999999999e-06 2024-09-12T00:04:05.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.759 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.759 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.759 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921925+0000", 2024-09-12T00:04:05.760 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7190000000000004e-06 2024-09-12T00:04:05.760 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.760 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.760 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.760 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921931+0000", 2024-09-12T00:04:05.760 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2519999999999996e-06 2024-09-12T00:04:05.760 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.760 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.760 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.760 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933475+0000", 2024-09-12T00:04:05.760 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011543759000000001 2024-09-12T00:04:05.760 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.760 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.760 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.761 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933617+0000", 2024-09-12T00:04:05.761 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000142282 2024-09-12T00:04:05.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.761 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.761 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.761 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933860+0000", 2024-09-12T00:04:05.761 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024276199999999999 2024-09-12T00:04:05.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.761 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.761 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.762 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937933+0000", 2024-09-12T00:04:05.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040734680000000002 2024-09-12T00:04:05.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.762 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.762 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.762 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938955+0000", 2024-09-12T00:04:05.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001021987 2024-09-12T00:04:05.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.762 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.762 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.762 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939038+0000", 2024-09-12T00:04:05.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2449999999999998e-05 2024-09-12T00:04:05.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.763 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.763 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939103+0000", 2024-09-12T00:04:05.763 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5345999999999994e-05 2024-09-12T00:04:05.763 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.763 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.763 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.763 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:05.763 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:05.763 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.803679768000002, 2024-09-12T00:04:05.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018247975, 2024-09-12T00:04:05.764 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.764 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.764 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.764 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.764 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:05.764 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:05.764 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 49 2024-09-12T00:04:05.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.764 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.764 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:05.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.765 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:05.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.765 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921940+0000", 2024-09-12T00:04:05.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7e-07 2024-09-12T00:04:05.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.765 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921943+0000", 2024-09-12T00:04:05.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1889999999999999e-06 2024-09-12T00:04:05.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.766 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.766 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921952+0000", 2024-09-12T00:04:05.766 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0010000000000007e-06 2024-09-12T00:04:05.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.766 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.766 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921959+0000", 2024-09-12T00:04:05.766 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2570000000000001e-06 2024-09-12T00:04:05.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.766 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.766 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935333+0000", 2024-09-12T00:04:05.767 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013373368 2024-09-12T00:04:05.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.767 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.767 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935472+0000", 2024-09-12T00:04:05.767 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013987900000000001 2024-09-12T00:04:05.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.767 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.767 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935700+0000", 2024-09-12T00:04:05.767 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000227922 2024-09-12T00:04:05.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.767 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939858+0000", 2024-09-12T00:04:05.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041571300000000002 2024-09-12T00:04:05.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940018+0000", 2024-09-12T00:04:05.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016060400000000001 2024-09-12T00:04:05.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940114+0000", 2024-09-12T00:04:05.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5692999999999993e-05 2024-09-12T00:04:05.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.769 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.769 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940187+0000", 2024-09-12T00:04:05.769 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3561999999999998e-05 2024-09-12T00:04:05.769 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.769 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.769 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.769 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.769 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:05.769 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:05.769 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.803636980999997, 2024-09-12T00:04:05.769 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021018614000000001, 2024-09-12T00:04:05.769 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.769 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.770 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.770 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.770 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:05.770 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:05.770 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 50 2024-09-12T00:04:05.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.770 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.770 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:05.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.771 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:05.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.771 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.771 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921983+0000", 2024-09-12T00:04:05.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4499999999999996e-07 2024-09-12T00:04:05.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.771 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.771 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922071+0000", 2024-09-12T00:04:05.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8010000000000006e-05 2024-09-12T00:04:05.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.772 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.772 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922084+0000", 2024-09-12T00:04:05.772 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3275000000000001e-05 2024-09-12T00:04:05.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.772 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.772 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.772 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922093+0000", 2024-09-12T00:04:05.772 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0580000000000004e-06 2024-09-12T00:04:05.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.772 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.772 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.772 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936515+0000", 2024-09-12T00:04:05.772 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014421270999999999 2024-09-12T00:04:05.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.773 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936677+0000", 2024-09-12T00:04:05.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162003 2024-09-12T00:04:05.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.773 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936908+0000", 2024-09-12T00:04:05.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023115700000000001 2024-09-12T00:04:05.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.773 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939985+0000", 2024-09-12T00:04:05.774 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030773879999999999 2024-09-12T00:04:05.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.774 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.774 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942623+0000", 2024-09-12T00:04:05.774 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026377929999999998 2024-09-12T00:04:05.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.774 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.774 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942818+0000", 2024-09-12T00:04:05.774 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019556200000000001 2024-09-12T00:04:05.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.774 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.775 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943001+0000", 2024-09-12T00:04:05.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018235199999999999 2024-09-12T00:04:05.775 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.775 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.775 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.775 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.775 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:05.775 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:05.775 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.803502588999997, 2024-09-12T00:04:05.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021092493, 2024-09-12T00:04:05.775 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.775 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.775 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.776 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.776 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:05.776 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:05.776 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 51 2024-09-12T00:04:05.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.776 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:05.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:05.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922118+0000", 2024-09-12T00:04:05.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0389999999999999e-06 2024-09-12T00:04:05.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922124+0000", 2024-09-12T00:04:05.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5409999999999997e-06 2024-09-12T00:04:05.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.778 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922136+0000", 2024-09-12T00:04:05.778 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.205e-05 2024-09-12T00:04:05.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.778 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.778 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922147+0000", 2024-09-12T00:04:05.778 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0451e-05 2024-09-12T00:04:05.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.778 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.778 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938000+0000", 2024-09-12T00:04:05.778 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015853682000000001 2024-09-12T00:04:05.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938142+0000", 2024-09-12T00:04:05.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014148899999999999 2024-09-12T00:04:05.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938362+0000", 2024-09-12T00:04:05.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022034800000000001 2024-09-12T00:04:05.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940330+0000", 2024-09-12T00:04:05.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001967459 2024-09-12T00:04:05.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943064+0000", 2024-09-12T00:04:05.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027346219999999999 2024-09-12T00:04:05.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943152+0000", 2024-09-12T00:04:05.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7563000000000002e-05 2024-09-12T00:04:05.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943209+0000", 2024-09-12T00:04:05.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7249e-05 2024-09-12T00:04:05.781 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.781 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.781 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.781 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:05.781 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:05.781 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.803453095999998, 2024-09-12T00:04:05.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021175616000000001, 2024-09-12T00:04:05.781 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.781 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.781 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.781 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.781 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:05.782 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:05.782 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 52 2024-09-12T00:04:05.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.782 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.782 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.782 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:05.782 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.782 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.782 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:05.782 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922167+0000", 2024-09-12T00:04:05.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3300000000000001e-07 2024-09-12T00:04:05.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922174+0000", 2024-09-12T00:04:05.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7070000000000003e-06 2024-09-12T00:04:05.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922184+0000", 2024-09-12T00:04:05.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682e-05 2024-09-12T00:04:05.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922195+0000", 2024-09-12T00:04:05.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0489000000000001e-05 2024-09-12T00:04:05.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939166+0000", 2024-09-12T00:04:05.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016971245999999999 2024-09-12T00:04:05.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939243+0000", 2024-09-12T00:04:05.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7201999999999997e-05 2024-09-12T00:04:05.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939381+0000", 2024-09-12T00:04:05.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013770699999999999 2024-09-12T00:04:05.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940923+0000", 2024-09-12T00:04:05.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001542302 2024-09-12T00:04:05.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943221+0000", 2024-09-12T00:04:05.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022979720000000001 2024-09-12T00:04:05.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.786 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.786 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943295+0000", 2024-09-12T00:04:05.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3317000000000003e-05 2024-09-12T00:04:05.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.786 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.786 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943342+0000", 2024-09-12T00:04:05.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7159e-05 2024-09-12T00:04:05.786 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.786 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.786 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.787 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.787 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:05.787 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:05.787 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.554508130000002, 2024-09-12T00:04:05.787 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015229411999999999, 2024-09-12T00:04:05.787 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.787 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.787 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.787 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.787 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:05.787 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:05.787 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 67 2024-09-12T00:04:05.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.787 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.788 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.788 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:05.788 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.788 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.788 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:05.788 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.788 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.788 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171112+0000", 2024-09-12T00:04:05.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2899999999999999e-06 2024-09-12T00:04:05.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.789 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171119+0000", 2024-09-12T00:04:05.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8870000000000003e-06 2024-09-12T00:04:05.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.789 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171131+0000", 2024-09-12T00:04:05.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1902999999999999e-05 2024-09-12T00:04:05.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171147+0000", 2024-09-12T00:04:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6203000000000001e-05 2024-09-12T00:04:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175044+0000", 2024-09-12T00:04:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038967310000000001 2024-09-12T00:04:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175172+0000", 2024-09-12T00:04:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012784100000000001 2024-09-12T00:04:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175372+0000", 2024-09-12T00:04:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019978500000000001 2024-09-12T00:04:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179276+0000", 2024-09-12T00:04:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039042149999999999 2024-09-12T00:04:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186150+0000", 2024-09-12T00:04:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0068740019999999997 2024-09-12T00:04:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186266+0000", 2024-09-12T00:04:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115742 2024-09-12T00:04:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186340+0000", 2024-09-12T00:04:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4813000000000004e-05 2024-09-12T00:04:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.554447054000001, 2024-09-12T00:04:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015308448000000001, 2024-09-12T00:04:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 68 2024-09-12T00:04:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.794 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:05.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.794 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:05.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.794 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171173+0000", 2024-09-12T00:04:05.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:04:05.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171182+0000", 2024-09-12T00:04:05.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2359999999999993e-06 2024-09-12T00:04:05.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171193+0000", 2024-09-12T00:04:05.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.095e-05 2024-09-12T00:04:05.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171207+0000", 2024-09-12T00:04:05.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3339999999999999e-05 2024-09-12T00:04:05.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176753+0000", 2024-09-12T00:04:05.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055460240000000001 2024-09-12T00:04:05.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176921+0000", 2024-09-12T00:04:05.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000168503 2024-09-12T00:04:05.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177112+0000", 2024-09-12T00:04:05.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019113999999999999 2024-09-12T00:04:05.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179382+0000", 2024-09-12T00:04:05.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022697099999999999 2024-09-12T00:04:05.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186356+0000", 2024-09-12T00:04:05.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069741919999999997 2024-09-12T00:04:05.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.798 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186422+0000", 2024-09-12T00:04:05.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6387e-05 2024-09-12T00:04:05.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.798 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186481+0000", 2024-09-12T00:04:05.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8059000000000001e-05 2024-09-12T00:04:05.798 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.798 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.798 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.799 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:05.799 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:05.799 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.554395284000002, 2024-09-12T00:04:05.799 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020001835999999999, 2024-09-12T00:04:05.799 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.799 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.799 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.799 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.799 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:05.799 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:05.799 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 69 2024-09-12T00:04:05.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.799 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:05.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:05.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171225+0000", 2024-09-12T00:04:05.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0599999999999999e-07 2024-09-12T00:04:05.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171349+0000", 2024-09-12T00:04:05.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012407299999999999 2024-09-12T00:04:05.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171367+0000", 2024-09-12T00:04:05.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8413000000000001e-05 2024-09-12T00:04:05.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171376+0000", 2024-09-12T00:04:05.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8170000000000005e-06 2024-09-12T00:04:05.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177692+0000", 2024-09-12T00:04:05.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063156729999999999 2024-09-12T00:04:05.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177817+0000", 2024-09-12T00:04:05.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012581499999999999 2024-09-12T00:04:05.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.178015+0000", 2024-09-12T00:04:05.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019715100000000001 2024-09-12T00:04:05.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.803 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181798+0000", 2024-09-12T00:04:05.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003783308 2024-09-12T00:04:05.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.803 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190976+0000", 2024-09-12T00:04:05.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091776519999999997 2024-09-12T00:04:05.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191122+0000", 2024-09-12T00:04:05.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000145966 2024-09-12T00:04:05.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191226+0000", 2024-09-12T00:04:05.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104162 2024-09-12T00:04:05.804 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.804 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.804 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.804 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:05.805 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:05.805 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.554226548999999, 2024-09-12T00:04:05.805 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019997773, 2024-09-12T00:04:05.805 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.805 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.805 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.805 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.805 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:05.805 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:05.805 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 70 2024-09-12T00:04:05.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.805 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.805 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.805 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:05.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:05.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:05.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3699999999999999e-07 2024-09-12T00:04:05.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171403+0000", 2024-09-12T00:04:05.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6199999999999994e-06 2024-09-12T00:04:05.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171416+0000", 2024-09-12T00:04:05.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2636000000000001e-05 2024-09-12T00:04:05.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171423+0000", 2024-09-12T00:04:05.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5440000000000001e-06 2024-09-12T00:04:05.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179458+0000", 2024-09-12T00:04:05.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080351989999999998 2024-09-12T00:04:05.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179604+0000", 2024-09-12T00:04:05.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014519899999999999 2024-09-12T00:04:05.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179831+0000", 2024-09-12T00:04:05.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022704800000000001 2024-09-12T00:04:05.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.809 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.809 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.809 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181918+0000", 2024-09-12T00:04:05.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020873950000000001 2024-09-12T00:04:05.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.809 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.809 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.809 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191243+0000", 2024-09-12T00:04:05.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0093244729999999998 2024-09-12T00:04:05.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.809 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.809 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.810 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191309+0000", 2024-09-12T00:04:05.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6116000000000002e-05 2024-09-12T00:04:05.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.810 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.810 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191390+0000", 2024-09-12T00:04:05.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1705999999999993e-05 2024-09-12T00:04:05.810 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.810 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.810 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.810 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:05.810 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:05.811 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.554180475999999, 2024-09-12T00:04:05.811 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020263554, 2024-09-12T00:04:05.811 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.811 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.811 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.811 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.811 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:05.811 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:05.811 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 71 2024-09-12T00:04:05.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.811 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.811 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.811 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:05.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:05.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:05.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5000000000000002e-07 2024-09-12T00:04:05.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.813 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.813 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.813 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171454+0000", 2024-09-12T00:04:05.813 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5046e-05 2024-09-12T00:04:05.813 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.813 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.813 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.813 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171471+0000", 2024-09-12T00:04:05.813 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6923999999999999e-05 2024-09-12T00:04:05.813 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.813 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.813 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.813 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171487+0000", 2024-09-12T00:04:05.813 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5823000000000001e-05 2024-09-12T00:04:05.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180765+0000", 2024-09-12T00:04:05.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0092774399999999996 2024-09-12T00:04:05.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180900+0000", 2024-09-12T00:04:05.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013556700000000001 2024-09-12T00:04:05.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181108+0000", 2024-09-12T00:04:05.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020727899999999999 2024-09-12T00:04:05.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184725+0000", 2024-09-12T00:04:05.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036171340000000001 2024-09-12T00:04:05.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191413+0000", 2024-09-12T00:04:05.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066881830000000003 2024-09-12T00:04:05.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.816 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191540+0000", 2024-09-12T00:04:05.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000126823 2024-09-12T00:04:05.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.816 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.816 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.816 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191702+0000", 2024-09-12T00:04:05.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162585 2024-09-12T00:04:05.816 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.816 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.816 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.816 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.816 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:05.816 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:05.816 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.554101899999999, 2024-09-12T00:04:05.817 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020448573000000001, 2024-09-12T00:04:05.817 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.817 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.817 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.817 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.817 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:05.817 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:05.817 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 72 2024-09-12T00:04:05.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.817 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.817 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.817 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.817 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:05.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.818 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.818 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:05.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.818 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.818 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171518+0000", 2024-09-12T00:04:05.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0440000000000001e-06 2024-09-12T00:04:05.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.818 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.819 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171647+0000", 2024-09-12T00:04:05.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012912899999999999 2024-09-12T00:04:05.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.819 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.819 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171664+0000", 2024-09-12T00:04:05.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6079999999999999e-05 2024-09-12T00:04:05.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.819 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.819 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171675+0000", 2024-09-12T00:04:05.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1223000000000001e-05 2024-09-12T00:04:05.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.820 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182000+0000", 2024-09-12T00:04:05.820 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010324949 2024-09-12T00:04:05.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.820 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182178+0000", 2024-09-12T00:04:05.820 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017808799999999999 2024-09-12T00:04:05.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182402+0000", 2024-09-12T00:04:05.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022381199999999999 2024-09-12T00:04:05.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190935+0000", 2024-09-12T00:04:05.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085331560000000001 2024-09-12T00:04:05.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191728+0000", 2024-09-12T00:04:05.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079325700000000001 2024-09-12T00:04:05.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.822 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.822 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191864+0000", 2024-09-12T00:04:05.822 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013606299999999999 2024-09-12T00:04:05.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.822 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.822 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191966+0000", 2024-09-12T00:04:05.822 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101772 2024-09-12T00:04:05.822 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.822 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.822 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.823 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:05.823 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:05.823 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.553918705000001, 2024-09-12T00:04:05.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020675235, 2024-09-12T00:04:05.823 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.823 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.823 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.823 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.823 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:05.823 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:05.824 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 73 2024-09-12T00:04:05.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.824 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.824 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.824 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:05.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.824 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.824 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:05.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.825 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.825 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.825 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171701+0000", 2024-09-12T00:04:05.825 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0999999999999997e-07 2024-09-12T00:04:05.825 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.825 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.825 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.825 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171709+0000", 2024-09-12T00:04:05.825 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2540000000000003e-06 2024-09-12T00:04:05.825 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.825 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.825 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.825 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171724+0000", 2024-09-12T00:04:05.826 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5569e-05 2024-09-12T00:04:05.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.826 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171734+0000", 2024-09-12T00:04:05.826 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6139999999999998e-06 2024-09-12T00:04:05.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.826 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183774+0000", 2024-09-12T00:04:05.826 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012040444000000001 2024-09-12T00:04:05.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183896+0000", 2024-09-12T00:04:05.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012204199999999999 2024-09-12T00:04:05.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184084+0000", 2024-09-12T00:04:05.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018792599999999999 2024-09-12T00:04:05.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191984+0000", 2024-09-12T00:04:05.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079003790000000008 2024-09-12T00:04:05.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192093+0000", 2024-09-12T00:04:05.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000108942 2024-09-12T00:04:05.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192250+0000", 2024-09-12T00:04:05.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015637600000000001 2024-09-12T00:04:05.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192376+0000", 2024-09-12T00:04:05.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012587899999999999 2024-09-12T00:04:05.829 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.829 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.829 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.829 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:05.829 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:05.829 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.553870494999998, 2024-09-12T00:04:05.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021088828, 2024-09-12T00:04:05.829 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.829 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.829 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.829 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.830 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:05.830 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:05.830 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 74 2024-09-12T00:04:05.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.830 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:05.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:05.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:05.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1699999999999997e-07 2024-09-12T00:04:05.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171758+0000", 2024-09-12T00:04:05.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0860000000000008e-06 2024-09-12T00:04:05.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.832 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171774+0000", 2024-09-12T00:04:05.832 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:04:05.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.832 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.832 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171788+0000", 2024-09-12T00:04:05.832 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4793999999999999e-05 2024-09-12T00:04:05.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.832 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.832 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184842+0000", 2024-09-12T00:04:05.832 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013053607 2024-09-12T00:04:05.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.833 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185130+0000", 2024-09-12T00:04:05.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00028779199999999998 2024-09-12T00:04:05.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.833 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185378+0000", 2024-09-12T00:04:05.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024780100000000002 2024-09-12T00:04:05.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.833 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192513+0000", 2024-09-12T00:04:05.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071350770000000001 2024-09-12T00:04:05.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192690+0000", 2024-09-12T00:04:05.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000176892 2024-09-12T00:04:05.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192769+0000", 2024-09-12T00:04:05.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9466000000000001e-05 2024-09-12T00:04:05.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192837+0000", 2024-09-12T00:04:05.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8466000000000005e-05 2024-09-12T00:04:05.835 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.835 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.835 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.835 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:05.835 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:05.835 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.553817918, 2024-09-12T00:04:05.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.02121994, 2024-09-12T00:04:05.835 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.835 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.835 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.835 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.835 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:05.835 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:05.836 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 75 2024-09-12T00:04:05.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.836 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.836 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.836 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:05.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.836 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.836 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:05.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.837 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.837 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171802+0000", 2024-09-12T00:04:05.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5000000000000002e-07 2024-09-12T00:04:05.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.837 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.837 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.837 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171954+0000", 2024-09-12T00:04:05.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015215500000000001 2024-09-12T00:04:05.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.837 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.837 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.837 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171966+0000", 2024-09-12T00:04:05.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1548e-05 2024-09-12T00:04:05.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171970+0000", 2024-09-12T00:04:05.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8729999999999998e-06 2024-09-12T00:04:05.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186552+0000", 2024-09-12T00:04:05.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014581775 2024-09-12T00:04:05.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186702+0000", 2024-09-12T00:04:05.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014946 2024-09-12T00:04:05.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186897+0000", 2024-09-12T00:04:05.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000195071 2024-09-12T00:04:05.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192666+0000", 2024-09-12T00:04:05.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057693470000000002 2024-09-12T00:04:05.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192857+0000", 2024-09-12T00:04:05.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191149 2024-09-12T00:04:05.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192967+0000", 2024-09-12T00:04:05.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110202 2024-09-12T00:04:05.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193021+0000", 2024-09-12T00:04:05.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3709999999999999e-05 2024-09-12T00:04:05.841 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.841 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.841 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.841 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.841 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:05.841 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:05.841 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.553638622999998, 2024-09-12T00:04:05.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026297425999999999, 2024-09-12T00:04:05.841 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:05.841 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:05.841 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:05.842 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:05.842 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:05.842 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:05.842 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 76 2024-09-12T00:04:05.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.842 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:05.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:05.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:05.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:05.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:05.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:05.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.843 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:05.843 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:05.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9399999999999995e-07 2024-09-12T00:04:05.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.843 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:05.843 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171987+0000", 2024-09-12T00:04:05.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5230000000000003e-06 2024-09-12T00:04:05.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.844 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.844 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:05.844 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172005+0000", 2024-09-12T00:04:05.844 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8788e-05 2024-09-12T00:04:05.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.844 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.844 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:05.844 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172010+0000", 2024-09-12T00:04:05.844 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7570000000000004e-06 2024-09-12T00:04:05.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.844 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.844 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:05.845 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193104+0000", 2024-09-12T00:04:05.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021094112000000002 2024-09-12T00:04:05.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.845 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.845 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:05.845 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193334+0000", 2024-09-12T00:04:05.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000229855 2024-09-12T00:04:05.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.845 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.845 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:05.845 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193697+0000", 2024-09-12T00:04:05.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00036272399999999998 2024-09-12T00:04:05.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.845 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.846 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:05.846 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.195602+0000", 2024-09-12T00:04:05.846 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019049620000000001 2024-09-12T00:04:05.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.846 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.846 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:05.846 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198123+0000", 2024-09-12T00:04:05.846 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025216520000000001 2024-09-12T00:04:05.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.846 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.846 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:05.847 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198213+0000", 2024-09-12T00:04:05.847 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0008999999999998e-05 2024-09-12T00:04:05.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:05.847 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:05.847 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:05.847 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198278+0000", 2024-09-12T00:04:05.847 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4549999999999997e-05 2024-09-12T00:04:05.847 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.847 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.847 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.847 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:05.847 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:05.847 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:05.849 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:04:05.849 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:05.852+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:05.949 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:05.949+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:05.990 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:04:06.051 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:06.049+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:06.068 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:06.068 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:06.069 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:06.069 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:06.089 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:04:06.151 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:06.152+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:06.191 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:06.192 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:06.223 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:06.223 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:06.252 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:06.252+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:06.254 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:06.254 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:06.285 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:06.286 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:06.305 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:06.305 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:06.319 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:06.319 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:06.322 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:04:06.353 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:06.353 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:06.353 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:06.356+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:06.386 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:06.386 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:06.420 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:06.420 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:06.454 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:06.456+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:06.494 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:06.494 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:06.512 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:04:06.555 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:06.556+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:06.588 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T00:04:06.656 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:06.653+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:06.684 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:06.684 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:06.709 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:04:06.758 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:06.760+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:06.858 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:06.860+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:06.917 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:06.917 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:06.935 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:04:06.981 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:06.981+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:07.060 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:07.057+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:07.104 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:07.412 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:07.414 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:04:07.414 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:07.415+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:07.515 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:07.515+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:07.545 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:07.546 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:07.559 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:04:07.571 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T00:04:07.615 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:07.613+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:07.715 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:07.713+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:07.718 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:07.718 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:07.732 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:04:07.817 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:07.815+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:07.849 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:07.849 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:07.863 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:04:07.917 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:07.917+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:08.019 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:08.019+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:08.029 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:08.029 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:08.043 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:04:08.119 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:08.117+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:08.210 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:08.210 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:08.219 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:08.217+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:08.225 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:04:08.320 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:08.317+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:08.345 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:08.345 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:08.356 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:04:08.421 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:08.423+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:08.445 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:04:08.475 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:08.476 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:08.491 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:04:08.533 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:08.535+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:08.622 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:08.621+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:08.646 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:08.646 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:08.655 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:08.655 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:08.670 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:04:08.677 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:08.677 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:08.707 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:08.708 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:08.723 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:08.723+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:08.738 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:08.738 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:08.770 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:08.770 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:08.786 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:08.786 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:08.800 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:08.800 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:08.801 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:04:08.831 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:08.831 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:08.845 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:08.847+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:08.862 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:08.863 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:08.925 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:08.927+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:08.962 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:08.962 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:04:08.963 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:04:08.963 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:08.976 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:04:09.026 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:09.025+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:09.127 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:09.127+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:09.130 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:09.130 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:04:09.130 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:04:09.130 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:04:09.130 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:09.143 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:04:09.227 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:09.225+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:09.306 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:09.306 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:04:09.306 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:04:09.306 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:04:09.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.306 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:09.306 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:04:09.306 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 37.818778702000003, 2024-09-12T00:04:09.306 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0032495720000000001, 2024-09-12T00:04:09.306 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:09.307 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:09.307 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:09.307 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:09.307 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:09.307 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:09.307 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 193 2024-09-12T00:04:09.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.307 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:09.307 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.307 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:09.307 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:04:09.307 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.308 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.308 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.308 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:09.308 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:04:09.308 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.308 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.308 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.308 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:09.308 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486926+0000", 2024-09-12T00:04:09.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.463e-06 2024-09-12T00:04:09.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.309 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.309 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:09.309 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486937+0000", 2024-09-12T00:04:09.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1147e-05 2024-09-12T00:04:09.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.309 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.309 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:09.309 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486968+0000", 2024-09-12T00:04:09.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1077000000000001e-05 2024-09-12T00:04:09.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.309 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.310 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:09.310 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486985+0000", 2024-09-12T00:04:09.310 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6399e-05 2024-09-12T00:04:09.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.310 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.310 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:09.310 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487139+0000", 2024-09-12T00:04:09.310 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015403199999999999 2024-09-12T00:04:09.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.311 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:09.311 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487375+0000", 2024-09-12T00:04:09.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023621499999999999 2024-09-12T00:04:09.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.311 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:09.311 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487634+0000", 2024-09-12T00:04:09.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000259351 2024-09-12T00:04:09.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.311 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:09.312 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.489156+0000", 2024-09-12T00:04:09.312 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015213869999999999 2024-09-12T00:04:09.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:09.312 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.489974+0000", 2024-09-12T00:04:09.312 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00081855600000000001 2024-09-12T00:04:09.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:09.312 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.490064+0000", 2024-09-12T00:04:09.312 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9205999999999999e-05 2024-09-12T00:04:09.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.313 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:09.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.490173+0000", 2024-09-12T00:04:09.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109739 2024-09-12T00:04:09.313 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.313 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:09.313 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.313 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:04:09.313 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:04:09.313 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.942339158999999, 2024-09-12T00:04:09.314 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039523630000000004, 2024-09-12T00:04:09.314 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:09.314 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:09.314 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:09.314 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:09.314 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:09.314 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:09.314 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 208 2024-09-12T00:04:09.314 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.314 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:09.314 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.314 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:09.314 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:04:09.314 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.315 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.315 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:09.315 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:04:09.315 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.315 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.315 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:09.315 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363366+0000", 2024-09-12T00:04:09.315 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.004e-06 2024-09-12T00:04:09.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.315 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.315 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:09.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363379+0000", 2024-09-12T00:04:09.316 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2943e-05 2024-09-12T00:04:09.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.316 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.316 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:09.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363412+0000", 2024-09-12T00:04:09.316 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2808999999999997e-05 2024-09-12T00:04:09.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.316 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.316 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:09.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363430+0000", 2024-09-12T00:04:09.316 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8003e-05 2024-09-12T00:04:09.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.317 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.317 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:09.317 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363654+0000", 2024-09-12T00:04:09.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022394900000000001 2024-09-12T00:04:09.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.317 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.317 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:09.317 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363897+0000", 2024-09-12T00:04:09.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024272399999999999 2024-09-12T00:04:09.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.317 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.317 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:09.317 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.364326+0000", 2024-09-12T00:04:09.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042963399999999997 2024-09-12T00:04:09.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.318 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.318 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:09.318 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.365757+0000", 2024-09-12T00:04:09.318 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014303969999999999 2024-09-12T00:04:09.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.318 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.318 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:09.318 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367031+0000", 2024-09-12T00:04:09.318 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001274269 2024-09-12T00:04:09.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.318 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.318 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:09.319 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367197+0000", 2024-09-12T00:04:09.319 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016645900000000001 2024-09-12T00:04:09.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.319 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.319 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:09.319 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367316+0000", 2024-09-12T00:04:09.319 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011817200000000001 2024-09-12T00:04:09.319 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.319 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:09.319 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.319 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.319 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:09.319 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:04:09.320 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.885080854999998, 2024-09-12T00:04:09.320 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033190419999999999, 2024-09-12T00:04:09.320 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:09.320 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:09.320 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:09.320 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:09.320 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:09.320 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:09.320 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 219 2024-09-12T00:04:09.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.321 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:09.321 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.321 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:09.321 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:04:09.321 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.321 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.321 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:09.321 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:04:09.321 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.321 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.322 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:09.322 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420624+0000", 2024-09-12T00:04:09.322 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0829999999999998e-06 2024-09-12T00:04:09.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.322 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.322 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:09.322 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420633+0000", 2024-09-12T00:04:09.322 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8500000000000006e-06 2024-09-12T00:04:09.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.322 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.322 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:09.322 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420663+0000", 2024-09-12T00:04:09.322 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9597000000000001e-05 2024-09-12T00:04:09.323 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.323 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.323 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:09.323 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420681+0000", 2024-09-12T00:04:09.323 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7646e-05 2024-09-12T00:04:09.323 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.323 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.323 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:09.323 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420791+0000", 2024-09-12T00:04:09.323 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109979 2024-09-12T00:04:09.323 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.323 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.324 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:09.324 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.421042+0000", 2024-09-12T00:04:09.324 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025117199999999997 2024-09-12T00:04:09.324 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.324 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.324 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:09.324 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.421487+0000", 2024-09-12T00:04:09.324 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00044476599999999998 2024-09-12T00:04:09.324 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.324 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.324 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:09.324 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.422884+0000", 2024-09-12T00:04:09.324 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0013975109999999999 2024-09-12T00:04:09.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.325 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.325 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:09.325 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423797+0000", 2024-09-12T00:04:09.325 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00091310899999999995 2024-09-12T00:04:09.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.325 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.325 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:09.325 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423879+0000", 2024-09-12T00:04:09.325 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1829000000000005e-05 2024-09-12T00:04:09.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.325 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.325 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:09.326 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423941+0000", 2024-09-12T00:04:09.326 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1500000000000004e-05 2024-09-12T00:04:09.326 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.326 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:09.326 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.326 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.326 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.326 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:09.327 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:04:09.327 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.867440256000002, 2024-09-12T00:04:09.327 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003232782, 2024-09-12T00:04:09.327 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:09.327 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:09.327 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:09.327 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:09.327 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:09.327 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:09.327 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 224 2024-09-12T00:04:09.327 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.327 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:09.327 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.328 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:09.328 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:04:09.328 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.328 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.328 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.328 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:09.328 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:04:09.328 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.328 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.328 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.328 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:09.328 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438265+0000", 2024-09-12T00:04:09.328 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.666e-06 2024-09-12T00:04:09.329 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.329 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.329 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:09.329 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438276+0000", 2024-09-12T00:04:09.329 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1387e-05 2024-09-12T00:04:09.329 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.329 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.329 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:09.329 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438306+0000", 2024-09-12T00:04:09.329 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0069999999999998e-05 2024-09-12T00:04:09.329 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.329 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.329 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:09.329 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438321+0000", 2024-09-12T00:04:09.330 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.517e-05 2024-09-12T00:04:09.330 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.330 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.330 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:09.330 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438459+0000", 2024-09-12T00:04:09.330 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013781899999999999 2024-09-12T00:04:09.330 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.330 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.330 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:09.330 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438671+0000", 2024-09-12T00:04:09.330 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021214500000000001 2024-09-12T00:04:09.330 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.330 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.331 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:09.331 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.439093+0000", 2024-09-12T00:04:09.331 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042117899999999999 2024-09-12T00:04:09.331 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.331 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.331 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:09.331 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.440400+0000", 2024-09-12T00:04:09.331 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0013072719999999999 2024-09-12T00:04:09.331 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.331 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.332 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:09.332 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441339+0000", 2024-09-12T00:04:09.332 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00093906600000000001 2024-09-12T00:04:09.332 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.332 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.332 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:09.332 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441429+0000", 2024-09-12T00:04:09.332 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0358999999999993e-05 2024-09-12T00:04:09.332 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.332 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.332 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:09.332 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441495+0000", 2024-09-12T00:04:09.332 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5648999999999994e-05 2024-09-12T00:04:09.333 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.333 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:09.333 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.333 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.333 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.333 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:09.333 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:04:09.333 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.827941283999998, 2024-09-12T00:04:09.333 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003225716, 2024-09-12T00:04:09.333 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:09.333 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:09.333 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:09.334 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:09.334 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:09.334 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:09.334 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 235 2024-09-12T00:04:09.334 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.334 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:09.334 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.334 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:09.334 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:04:09.334 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.334 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.334 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.334 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:09.335 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:04:09.335 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.335 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.335 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:09.335 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477764+0000", 2024-09-12T00:04:09.335 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.48e-06 2024-09-12T00:04:09.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.335 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.335 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:09.335 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477775+0000", 2024-09-12T00:04:09.335 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1163e-05 2024-09-12T00:04:09.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.335 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.336 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:09.336 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477807+0000", 2024-09-12T00:04:09.336 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1860000000000003e-05 2024-09-12T00:04:09.336 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.336 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.336 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:09.336 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477822+0000", 2024-09-12T00:04:09.336 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5302999999999999e-05 2024-09-12T00:04:09.336 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.336 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.336 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:09.336 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477959+0000", 2024-09-12T00:04:09.337 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013695600000000001 2024-09-12T00:04:09.337 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.337 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.337 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:09.337 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.478184+0000", 2024-09-12T00:04:09.337 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022484800000000001 2024-09-12T00:04:09.337 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.337 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.337 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:09.337 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.478657+0000", 2024-09-12T00:04:09.337 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000473413 2024-09-12T00:04:09.337 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.338 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.338 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:09.338 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480162+0000", 2024-09-12T00:04:09.338 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00150454 2024-09-12T00:04:09.338 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.338 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.338 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:09.338 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480792+0000", 2024-09-12T00:04:09.338 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00063012400000000003 2024-09-12T00:04:09.338 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.338 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.338 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:09.338 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480906+0000", 2024-09-12T00:04:09.338 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113909 2024-09-12T00:04:09.339 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.339 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.339 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:09.339 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480987+0000", 2024-09-12T00:04:09.339 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1119999999999996e-05 2024-09-12T00:04:09.339 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.339 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:09.339 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.339 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.339 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.339 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:237 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:09.339 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:04:09.339 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.820619913000002, 2024-09-12T00:04:09.340 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0074291790000000002, 2024-09-12T00:04:09.340 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:09.340 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:09.340 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:09.340 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:09.340 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:09.340 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:09.340 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 237 2024-09-12T00:04:09.340 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.340 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:09.340 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.340 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:09.340 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:04:09.341 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.341 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.341 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.341 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:09.341 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:04:09.341 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.341 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.341 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.341 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:09.342 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485086+0000", 2024-09-12T00:04:09.342 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.05e-06 2024-09-12T00:04:09.342 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.342 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.342 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:09.342 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485101+0000", 2024-09-12T00:04:09.342 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5186e-05 2024-09-12T00:04:09.342 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.342 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.342 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:09.342 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485140+0000", 2024-09-12T00:04:09.342 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8896000000000002e-05 2024-09-12T00:04:09.343 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.343 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.343 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:09.343 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485162+0000", 2024-09-12T00:04:09.343 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2654e-05 2024-09-12T00:04:09.343 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.343 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.343 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:09.343 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485314+0000", 2024-09-12T00:04:09.343 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015150799999999999 2024-09-12T00:04:09.343 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.343 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.344 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:09.344 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485549+0000", 2024-09-12T00:04:09.344 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000235665 2024-09-12T00:04:09.344 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.344 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.344 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:09.344 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486064+0000", 2024-09-12T00:04:09.344 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00051418899999999997 2024-09-12T00:04:09.344 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.344 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.344 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:09.344 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.488211+0000", 2024-09-12T00:04:09.344 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0021470819999999998 2024-09-12T00:04:09.345 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.345 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.345 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:09.345 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492273+0000", 2024-09-12T00:04:09.345 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040617980000000001 2024-09-12T00:04:09.345 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.345 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.345 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:09.345 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492391+0000", 2024-09-12T00:04:09.345 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118613 2024-09-12T00:04:09.345 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.345 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.345 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:09.346 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492512+0000", 2024-09-12T00:04:09.346 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120538 2024-09-12T00:04:09.346 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.346 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:09.346 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.346 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.346 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.346 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:244 6.17 e35/29 6:e9187ab8:reshard::reshard.0000000000:head v 35'1, mlcod=0'0)", 2024-09-12T00:04:09.346 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:04:09.346 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.818037678000003, 2024-09-12T00:04:09.346 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0034313239999999999, 2024-09-12T00:04:09.346 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:09.346 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:09.346 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:09.347 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:09.347 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.347 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:09.347 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:04:09.347 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.347 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.347 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.347 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:09.347 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:04:09.347 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.347 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.347 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.347 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:09.347 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487667+0000", 2024-09-12T00:04:09.348 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4899999999999999e-06 2024-09-12T00:04:09.348 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.348 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.348 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:09.348 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487682+0000", 2024-09-12T00:04:09.348 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4929999999999999e-05 2024-09-12T00:04:09.348 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.348 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.348 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:09.348 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487740+0000", 2024-09-12T00:04:09.348 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8075000000000002e-05 2024-09-12T00:04:09.348 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.348 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.349 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:09.349 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487761+0000", 2024-09-12T00:04:09.349 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0769999999999999e-05 2024-09-12T00:04:09.349 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.349 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.349 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:09.349 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487966+0000", 2024-09-12T00:04:09.349 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020516800000000001 2024-09-12T00:04:09.349 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.349 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.349 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:09.349 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.488012+0000", 2024-09-12T00:04:09.349 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5794000000000002e-05 2024-09-12T00:04:09.349 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.350 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.350 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:09.350 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.490965+0000", 2024-09-12T00:04:09.350 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0029530609999999999 2024-09-12T00:04:09.350 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.350 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.350 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:09.350 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491096+0000", 2024-09-12T00:04:09.350 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013103600000000001 2024-09-12T00:04:09.350 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.350 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:09.350 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.350 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.350 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.351 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:293 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:09.351 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:04:09.351 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.808085857000002, 2024-09-12T00:04:09.351 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0075915649999999998, 2024-09-12T00:04:09.351 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:09.351 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:09.351 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:09.351 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:09.351 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:09.352 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:09.352 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 293 2024-09-12T00:04:09.352 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.352 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:09.352 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.352 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:09.352 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:04:09.352 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.352 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.352 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.352 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:09.352 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:04:09.353 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.353 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.353 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.353 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:09.353 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497626+0000", 2024-09-12T00:04:09.353 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2499999999999995e-06 2024-09-12T00:04:09.353 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.353 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.353 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:09.353 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497636+0000", 2024-09-12T00:04:09.353 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0139999999999999e-05 2024-09-12T00:04:09.353 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.353 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.353 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:09.354 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497660+0000", 2024-09-12T00:04:09.354 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4015999999999998e-05 2024-09-12T00:04:09.354 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.354 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.354 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:09.354 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497675+0000", 2024-09-12T00:04:09.354 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5339999999999999e-05 2024-09-12T00:04:09.354 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.354 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.354 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:09.354 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497839+0000", 2024-09-12T00:04:09.354 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016347900000000001 2024-09-12T00:04:09.354 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.355 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.355 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:09.355 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498097+0000", 2024-09-12T00:04:09.355 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025825700000000002 2024-09-12T00:04:09.355 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.355 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.355 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:09.355 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498618+0000", 2024-09-12T00:04:09.355 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052051300000000001 2024-09-12T00:04:09.355 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.355 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.355 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:09.355 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.501282+0000", 2024-09-12T00:04:09.355 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026646840000000001 2024-09-12T00:04:09.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.356 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.356 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:09.356 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505057+0000", 2024-09-12T00:04:09.356 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037747710000000001 2024-09-12T00:04:09.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.356 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.356 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:09.356 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505144+0000", 2024-09-12T00:04:09.356 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7466000000000006e-05 2024-09-12T00:04:09.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.356 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.356 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:09.357 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505208+0000", 2024-09-12T00:04:09.357 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3649e-05 2024-09-12T00:04:09.357 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.357 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:09.357 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.357 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.357 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.357 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:413 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:09.357 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:04:09.357 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.777046245000001, 2024-09-12T00:04:09.357 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005252049, 2024-09-12T00:04:09.357 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:09.357 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:09.357 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:09.358 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:09.358 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:09.358 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:09.358 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 413 2024-09-12T00:04:09.358 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.358 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:09.358 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.358 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:09.358 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:04:09.358 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.358 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.358 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.358 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:09.359 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:04:09.359 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.359 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.359 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.359 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:09.359 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528659+0000", 2024-09-12T00:04:09.359 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4739999999999999e-06 2024-09-12T00:04:09.359 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.359 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.359 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:09.359 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528669+0000", 2024-09-12T00:04:09.359 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0694e-05 2024-09-12T00:04:09.359 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.359 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.360 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:09.360 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528696+0000", 2024-09-12T00:04:09.360 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6846e-05 2024-09-12T00:04:09.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.360 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.360 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:09.360 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528711+0000", 2024-09-12T00:04:09.360 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4397e-05 2024-09-12T00:04:09.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.360 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.360 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:09.360 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528884+0000", 2024-09-12T00:04:09.360 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017304700000000001 2024-09-12T00:04:09.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.361 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.361 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:09.361 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529162+0000", 2024-09-12T00:04:09.361 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027861999999999999 2024-09-12T00:04:09.361 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.361 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.361 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:09.361 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529688+0000", 2024-09-12T00:04:09.361 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052593900000000001 2024-09-12T00:04:09.361 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.361 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.362 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:09.362 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.531480+0000", 2024-09-12T00:04:09.362 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0017920740000000001 2024-09-12T00:04:09.362 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.362 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.362 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:09.366 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533734+0000", 2024-09-12T00:04:09.366 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002254191 2024-09-12T00:04:09.366 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.366 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.366 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:09.366 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533845+0000", 2024-09-12T00:04:09.366 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110559 2024-09-12T00:04:09.367 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.367 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.367 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:09.367 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533908+0000", 2024-09-12T00:04:09.367 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3207999999999995e-05 2024-09-12T00:04:09.367 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.367 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:09.367 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.367 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.367 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.367 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:437 6.0 6:05588ce8:lc::lc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:09.367 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:04:09.367 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.769870756000003, 2024-09-12T00:04:09.367 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039419659999999999, 2024-09-12T00:04:09.367 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:09.368 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:09.368 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:09.368 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:09.368 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:09.368 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:09.368 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 437 2024-09-12T00:04:09.368 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.368 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:09.368 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.368 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:09.368 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:04:09.368 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.368 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.369 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.369 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:09.369 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:04:09.369 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.369 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.369 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.369 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:09.369 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535834+0000", 2024-09-12T00:04:09.369 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2859999999999998e-06 2024-09-12T00:04:09.369 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.369 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.369 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:09.369 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535846+0000", 2024-09-12T00:04:09.369 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1643e-05 2024-09-12T00:04:09.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.370 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.370 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:09.370 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535877+0000", 2024-09-12T00:04:09.370 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1457000000000001e-05 2024-09-12T00:04:09.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.370 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.370 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:09.370 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535894+0000", 2024-09-12T00:04:09.370 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.668e-05 2024-09-12T00:04:09.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.370 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.370 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:09.371 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535981+0000", 2024-09-12T00:04:09.371 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6823000000000005e-05 2024-09-12T00:04:09.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.371 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.371 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:09.371 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536086+0000", 2024-09-12T00:04:09.371 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010566200000000001 2024-09-12T00:04:09.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.371 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.371 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:09.371 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536330+0000", 2024-09-12T00:04:09.371 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024399999999999999 2024-09-12T00:04:09.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.371 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.372 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:09.372 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538288+0000", 2024-09-12T00:04:09.372 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0019575740000000001 2024-09-12T00:04:09.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.372 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.372 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:09.372 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539574+0000", 2024-09-12T00:04:09.372 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012862259999999999 2024-09-12T00:04:09.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.372 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.372 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:09.372 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539696+0000", 2024-09-12T00:04:09.372 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012190599999999999 2024-09-12T00:04:09.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.373 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.373 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:09.373 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539774+0000", 2024-09-12T00:04:09.373 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7708999999999997e-05 2024-09-12T00:04:09.373 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.373 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:09.373 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.373 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.373 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:464 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:09.373 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:04:09.373 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.761309773999997, 2024-09-12T00:04:09.374 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048192310000000002, 2024-09-12T00:04:09.374 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:09.374 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:09.374 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:09.374 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:09.374 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:09.374 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:09.374 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 464 2024-09-12T00:04:09.374 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.374 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:09.374 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.374 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:09.374 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:04:09.375 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.375 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.375 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.375 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:09.375 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:04:09.375 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.375 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.375 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.375 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:09.375 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544395+0000", 2024-09-12T00:04:09.375 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.905e-06 2024-09-12T00:04:09.375 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.375 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.375 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:09.376 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544405+0000", 2024-09-12T00:04:09.376 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0583e-05 2024-09-12T00:04:09.376 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.376 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.376 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:09.376 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544435+0000", 2024-09-12T00:04:09.376 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9431e-05 2024-09-12T00:04:09.376 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.376 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.376 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:09.376 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544468+0000", 2024-09-12T00:04:09.376 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2978999999999997e-05 2024-09-12T00:04:09.376 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.377 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.377 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:09.377 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544573+0000", 2024-09-12T00:04:09.377 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105165 2024-09-12T00:04:09.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.377 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.377 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:09.377 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544714+0000", 2024-09-12T00:04:09.377 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000141061 2024-09-12T00:04:09.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.377 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.378 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:09.378 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.545414+0000", 2024-09-12T00:04:09.378 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00070066200000000001 2024-09-12T00:04:09.378 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.378 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.378 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:09.378 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.547475+0000", 2024-09-12T00:04:09.378 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020609119999999998 2024-09-12T00:04:09.378 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.378 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.378 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:09.378 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549067+0000", 2024-09-12T00:04:09.378 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015914989999999999 2024-09-12T00:04:09.379 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.379 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.379 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:09.379 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549143+0000", 2024-09-12T00:04:09.379 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5795000000000002e-05 2024-09-12T00:04:09.379 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.379 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.379 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:09.379 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549212+0000", 2024-09-12T00:04:09.379 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9239000000000006e-05 2024-09-12T00:04:09.379 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.379 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:09.379 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.379 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.380 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.380 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:495 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:09.380 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:04:09.380 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.750240276, 2024-09-12T00:04:09.380 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052520209999999999, 2024-09-12T00:04:09.380 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:09.380 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:09.380 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:09.380 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:09.380 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:09.380 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:09.380 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 495 2024-09-12T00:04:09.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.381 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:09.381 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.381 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:09.381 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:04:09.381 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.381 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.381 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:09.381 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:04:09.381 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.381 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.381 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:09.381 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555464+0000", 2024-09-12T00:04:09.382 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8870000000000001e-06 2024-09-12T00:04:09.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.382 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.382 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:09.382 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555473+0000", 2024-09-12T00:04:09.382 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2399999999999996e-06 2024-09-12T00:04:09.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.382 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.382 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:09.382 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555496+0000", 2024-09-12T00:04:09.382 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2952e-05 2024-09-12T00:04:09.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.382 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.382 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:09.383 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555508+0000", 2024-09-12T00:04:09.383 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1548e-05 2024-09-12T00:04:09.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.383 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.383 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:09.383 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555596+0000", 2024-09-12T00:04:09.383 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8295999999999996e-05 2024-09-12T00:04:09.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.383 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.383 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:09.383 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555683+0000", 2024-09-12T00:04:09.383 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7267000000000003e-05 2024-09-12T00:04:09.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.383 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.384 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:09.384 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555862+0000", 2024-09-12T00:04:09.384 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017910699999999999 2024-09-12T00:04:09.384 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.384 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.384 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:09.384 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.556696+0000", 2024-09-12T00:04:09.384 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000833353 2024-09-12T00:04:09.384 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.384 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.384 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:09.384 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560563+0000", 2024-09-12T00:04:09.384 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038672089999999999 2024-09-12T00:04:09.384 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.385 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.385 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:09.385 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560642+0000", 2024-09-12T00:04:09.385 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.8909e-05 2024-09-12T00:04:09.385 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.385 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.385 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:09.385 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560714+0000", 2024-09-12T00:04:09.385 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2253000000000001e-05 2024-09-12T00:04:09.385 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.385 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:09.385 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.385 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.385 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.386 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:631 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:09.386 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:04:09.386 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.714412721999999, 2024-09-12T00:04:09.386 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0072389480000000003, 2024-09-12T00:04:09.386 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:09.386 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:09.386 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:09.386 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:09.386 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:09.386 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:09.386 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 631 2024-09-12T00:04:09.386 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.386 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:09.387 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.387 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:09.387 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:04:09.387 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.387 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.387 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.387 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:09.387 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:04:09.387 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.388 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.388 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.388 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:09.388 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591292+0000", 2024-09-12T00:04:09.388 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0760000000000001e-06 2024-09-12T00:04:09.388 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.388 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.388 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:09.388 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591301+0000", 2024-09-12T00:04:09.388 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3880000000000006e-06 2024-09-12T00:04:09.388 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.388 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.388 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:09.388 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591323+0000", 2024-09-12T00:04:09.389 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2121999999999999e-05 2024-09-12T00:04:09.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.389 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.389 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:09.389 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591338+0000", 2024-09-12T00:04:09.389 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5126999999999999e-05 2024-09-12T00:04:09.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.389 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.389 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:09.389 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591449+0000", 2024-09-12T00:04:09.389 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011054500000000001 2024-09-12T00:04:09.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.389 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.389 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:09.390 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591682+0000", 2024-09-12T00:04:09.390 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023258 2024-09-12T00:04:09.390 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.390 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.390 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:09.390 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.592011+0000", 2024-09-12T00:04:09.390 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00032941699999999998 2024-09-12T00:04:09.390 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.390 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.390 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:09.390 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593493+0000", 2024-09-12T00:04:09.390 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014821599999999999 2024-09-12T00:04:09.390 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.391 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.391 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:09.391 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598356+0000", 2024-09-12T00:04:09.391 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048625329999999996 2024-09-12T00:04:09.391 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.391 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.391 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:09.391 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598456+0000", 2024-09-12T00:04:09.391 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9878999999999997e-05 2024-09-12T00:04:09.391 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.391 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.391 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:09.391 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598529+0000", 2024-09-12T00:04:09.391 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3120999999999993e-05 2024-09-12T00:04:09.392 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.392 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:09.392 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.392 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.392 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.392 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:650 6.4 6:26625e58:lc::lc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:09.392 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:04:09.392 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.706015178000001, 2024-09-12T00:04:09.392 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042727010000000003, 2024-09-12T00:04:09.392 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:09.392 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:09.392 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:09.392 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:09.393 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:09.393 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:09.393 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 650 2024-09-12T00:04:09.393 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.393 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:09.393 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.393 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:09.393 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:04:09.393 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.393 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.393 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.393 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:09.393 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:04:09.393 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.394 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.394 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:09.394 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599689+0000", 2024-09-12T00:04:09.394 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3179999999999999e-06 2024-09-12T00:04:09.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.394 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.394 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:09.394 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599696+0000", 2024-09-12T00:04:09.394 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9580000000000001e-06 2024-09-12T00:04:09.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.394 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.394 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:09.395 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599714+0000", 2024-09-12T00:04:09.395 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8099999999999999e-05 2024-09-12T00:04:09.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.395 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.395 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:09.395 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599724+0000", 2024-09-12T00:04:09.395 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0492999999999999e-05 2024-09-12T00:04:09.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.395 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.395 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:09.395 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599799+0000", 2024-09-12T00:04:09.395 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5228999999999994e-05 2024-09-12T00:04:09.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.395 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.396 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:09.396 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599897+0000", 2024-09-12T00:04:09.396 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7476e-05 2024-09-12T00:04:09.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.396 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.396 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:09.396 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.600047+0000", 2024-09-12T00:04:09.396 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015028 2024-09-12T00:04:09.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.396 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.396 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:09.396 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.602604+0000", 2024-09-12T00:04:09.396 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0025571729999999998 2024-09-12T00:04:09.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.397 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.397 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:09.397 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603880+0000", 2024-09-12T00:04:09.397 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012753700000000001 2024-09-12T00:04:09.397 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.397 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.397 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:09.397 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603923+0000", 2024-09-12T00:04:09.397 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3758999999999999e-05 2024-09-12T00:04:09.397 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.397 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.397 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:09.397 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603960+0000", 2024-09-12T00:04:09.397 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6545000000000003e-05 2024-09-12T00:04:09.397 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.398 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:09.398 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.398 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.398 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.398 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:744 6.0 6:0651570b:lc::lc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:09.398 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:04:09.398 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.671723749999998, 2024-09-12T00:04:09.398 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048046149999999999, 2024-09-12T00:04:09.398 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:09.398 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:09.398 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:09.398 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:09.398 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:09.398 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:09.399 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 744 2024-09-12T00:04:09.399 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.399 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:09.399 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.399 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:09.399 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:04:09.399 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.399 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.399 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.399 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:09.399 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:04:09.399 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.399 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.399 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.400 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:09.400 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633981+0000", 2024-09-12T00:04:09.400 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3740000000000001e-06 2024-09-12T00:04:09.400 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.400 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.400 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:09.400 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633991+0000", 2024-09-12T00:04:09.400 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7839999999999998e-06 2024-09-12T00:04:09.400 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.400 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.400 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:09.400 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634016+0000", 2024-09-12T00:04:09.401 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5075999999999998e-05 2024-09-12T00:04:09.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.401 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.401 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:09.401 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634031+0000", 2024-09-12T00:04:09.401 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5124e-05 2024-09-12T00:04:09.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.401 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.401 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:09.401 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634105+0000", 2024-09-12T00:04:09.401 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3595000000000003e-05 2024-09-12T00:04:09.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.401 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.401 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:09.402 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634183+0000", 2024-09-12T00:04:09.402 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7936999999999996e-05 2024-09-12T00:04:09.402 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.402 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.402 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:09.402 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634342+0000", 2024-09-12T00:04:09.402 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015910499999999999 2024-09-12T00:04:09.402 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.402 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.402 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:09.402 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.635262+0000", 2024-09-12T00:04:09.402 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00092051000000000003 2024-09-12T00:04:09.402 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.402 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.403 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:09.403 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638638+0000", 2024-09-12T00:04:09.403 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033756419999999999 2024-09-12T00:04:09.403 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.403 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.403 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:09.403 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638722+0000", 2024-09-12T00:04:09.403 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.4029000000000005e-05 2024-09-12T00:04:09.403 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.403 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.403 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:09.403 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638783+0000", 2024-09-12T00:04:09.403 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1439000000000006e-05 2024-09-12T00:04:09.403 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.404 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:09.404 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.404 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.404 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.404 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:875 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:09.404 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:04:09.404 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.622084319000002, 2024-09-12T00:04:09.404 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004522295, 2024-09-12T00:04:09.404 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:09.404 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:09.404 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:09.404 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:09.404 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:09.405 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:09.405 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 875 2024-09-12T00:04:09.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.405 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:09.405 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.405 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:09.405 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:04:09.405 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.405 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.405 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:09.405 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:04:09.405 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.405 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.406 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:09.406 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683623+0000", 2024-09-12T00:04:09.406 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7140000000000001e-06 2024-09-12T00:04:09.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.406 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.406 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:09.406 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683639+0000", 2024-09-12T00:04:09.406 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6203000000000001e-05 2024-09-12T00:04:09.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.406 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.406 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:09.406 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683677+0000", 2024-09-12T00:04:09.406 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8470999999999998e-05 2024-09-12T00:04:09.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.407 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.407 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:09.407 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683708+0000", 2024-09-12T00:04:09.407 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0793999999999997e-05 2024-09-12T00:04:09.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.407 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.407 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:09.407 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683827+0000", 2024-09-12T00:04:09.407 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011832699999999999 2024-09-12T00:04:09.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.407 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.407 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:09.407 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683945+0000", 2024-09-12T00:04:09.408 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118301 2024-09-12T00:04:09.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.408 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.408 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:09.408 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.684226+0000", 2024-09-12T00:04:09.408 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000280604 2024-09-12T00:04:09.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.408 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.408 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:09.408 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685790+0000", 2024-09-12T00:04:09.408 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001564651 2024-09-12T00:04:09.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.408 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.409 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:09.409 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688028+0000", 2024-09-12T00:04:09.409 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0022381129999999999 2024-09-12T00:04:09.409 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.409 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.409 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:09.409 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688093+0000", 2024-09-12T00:04:09.409 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4329e-05 2024-09-12T00:04:09.409 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.409 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.409 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:09.409 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688140+0000", 2024-09-12T00:04:09.409 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7787999999999997e-05 2024-09-12T00:04:09.410 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.410 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:09.410 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.410 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.410 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:878 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:09.410 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:04:09.410 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.620440189999997, 2024-09-12T00:04:09.410 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037933009999999998, 2024-09-12T00:04:09.410 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:09.410 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:09.410 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:09.410 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:09.411 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:09.411 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:09.411 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 878 2024-09-12T00:04:09.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.411 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:09.411 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.411 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:09.411 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:04:09.411 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.411 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.411 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:09.411 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:04:09.411 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.412 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.412 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:09.412 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685265+0000", 2024-09-12T00:04:09.412 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.525e-06 2024-09-12T00:04:09.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.412 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.412 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:09.412 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685276+0000", 2024-09-12T00:04:09.412 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.076e-05 2024-09-12T00:04:09.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.412 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.413 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:09.413 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685306+0000", 2024-09-12T00:04:09.413 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0803000000000003e-05 2024-09-12T00:04:09.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.413 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.413 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:09.413 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685327+0000", 2024-09-12T00:04:09.413 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1061e-05 2024-09-12T00:04:09.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.413 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.413 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:09.413 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685429+0000", 2024-09-12T00:04:09.413 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000102015 2024-09-12T00:04:09.414 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.414 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.414 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:09.414 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685580+0000", 2024-09-12T00:04:09.414 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000151096 2024-09-12T00:04:09.414 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.414 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.414 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:09.414 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685861+0000", 2024-09-12T00:04:09.414 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028068100000000002 2024-09-12T00:04:09.414 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.414 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.414 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:09.414 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688647+0000", 2024-09-12T00:04:09.415 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0027860979999999999 2024-09-12T00:04:09.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.415 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.415 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:09.415 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688909+0000", 2024-09-12T00:04:09.415 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026159600000000001 2024-09-12T00:04:09.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.415 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.415 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:09.415 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688991+0000", 2024-09-12T00:04:09.415 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2429999999999995e-05 2024-09-12T00:04:09.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.415 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.415 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:09.415 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689056+0000", 2024-09-12T00:04:09.416 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4236e-05 2024-09-12T00:04:09.416 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.416 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:09.416 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.416 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.416 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:881 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:09.416 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:04:09.416 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.619806007000001, 2024-09-12T00:04:09.416 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003307979, 2024-09-12T00:04:09.416 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:09.416 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:09.416 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:09.416 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:09.416 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:09.417 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:09.417 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 881 2024-09-12T00:04:09.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.417 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:09.417 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.417 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:09.417 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:04:09.417 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.417 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.417 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:09.417 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:04:09.417 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.418 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.418 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:09.418 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685898+0000", 2024-09-12T00:04:09.418 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4249999999999999e-06 2024-09-12T00:04:09.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.418 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.418 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:09.418 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685904+0000", 2024-09-12T00:04:09.418 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1290000000000001e-06 2024-09-12T00:04:09.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.418 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.418 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:09.418 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685917+0000", 2024-09-12T00:04:09.419 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2825e-05 2024-09-12T00:04:09.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.419 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.419 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:09.419 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685925+0000", 2024-09-12T00:04:09.419 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6589999999999996e-06 2024-09-12T00:04:09.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.419 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.419 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:09.419 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686156+0000", 2024-09-12T00:04:09.419 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023017299999999999 2024-09-12T00:04:09.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.419 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.420 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:09.420 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686365+0000", 2024-09-12T00:04:09.420 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000209442 2024-09-12T00:04:09.420 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.420 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.420 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:09.420 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686567+0000", 2024-09-12T00:04:09.420 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020237400000000001 2024-09-12T00:04:09.420 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.420 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.420 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:09.420 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689076+0000", 2024-09-12T00:04:09.420 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002508957 2024-09-12T00:04:09.420 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.421 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.421 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:09.421 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689121+0000", 2024-09-12T00:04:09.421 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4561999999999998e-05 2024-09-12T00:04:09.421 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.421 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.421 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:09.421 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689168+0000", 2024-09-12T00:04:09.421 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7000999999999999e-05 2024-09-12T00:04:09.421 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.421 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.421 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:09.421 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689204+0000", 2024-09-12T00:04:09.421 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6431999999999999e-05 2024-09-12T00:04:09.422 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.422 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:09.422 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.422 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.422 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.422 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:894 6.0 6:05588ce8:lc::lc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:09.422 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:04:09.422 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.615450041000003, 2024-09-12T00:04:09.422 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040691010000000003, 2024-09-12T00:04:09.422 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:09.422 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:09.422 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:09.422 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:09.422 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:09.423 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:09.423 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 894 2024-09-12T00:04:09.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.423 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:09.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.423 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:09.423 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:04:09.423 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.423 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:09.423 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:04:09.423 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.424 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.424 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:09.424 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690253+0000", 2024-09-12T00:04:09.424 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.026e-06 2024-09-12T00:04:09.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.424 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.424 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:09.424 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690259+0000", 2024-09-12T00:04:09.424 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7389999999999996e-06 2024-09-12T00:04:09.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.424 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.424 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:09.425 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690273+0000", 2024-09-12T00:04:09.425 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3749e-05 2024-09-12T00:04:09.425 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.425 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.425 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:09.425 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690282+0000", 2024-09-12T00:04:09.425 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2520000000000005e-06 2024-09-12T00:04:09.425 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.425 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.425 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:09.425 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690704+0000", 2024-09-12T00:04:09.425 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042222199999999998 2024-09-12T00:04:09.425 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.425 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.426 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:09.426 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690826+0000", 2024-09-12T00:04:09.426 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012141099999999999 2024-09-12T00:04:09.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.426 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.426 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:09.426 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.691094+0000", 2024-09-12T00:04:09.426 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000268344 2024-09-12T00:04:09.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.426 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.426 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:09.426 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.693007+0000", 2024-09-12T00:04:09.426 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001912495 2024-09-12T00:04:09.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.426 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.427 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:09.427 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694184+0000", 2024-09-12T00:04:09.427 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00117786 2024-09-12T00:04:09.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.427 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.427 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:09.427 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694259+0000", 2024-09-12T00:04:09.427 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4091000000000006e-05 2024-09-12T00:04:09.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.427 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.427 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:09.427 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694321+0000", 2024-09-12T00:04:09.427 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2911999999999997e-05 2024-09-12T00:04:09.428 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.428 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:09.428 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.428 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.428 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.428 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1283 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:09.428 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:04:09.428 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.116131504999998, 2024-09-12T00:04:09.428 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00320967, 2024-09-12T00:04:09.428 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:09.428 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:09.428 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:09.428 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:09.428 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:09.429 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:09.429 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1283 2024-09-12T00:04:09.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.429 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:09.429 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.429 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:09.429 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:04:09.429 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.429 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.429 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:09.429 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:04:09.429 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:09.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.430 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.430 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:09.430 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189573+0000", 2024-09-12T00:04:09.430 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3130000000000001e-06 2024-09-12T00:04:09.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.430 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.430 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:09.430 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189583+0000", 2024-09-12T00:04:09.430 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4129999999999995e-06 2024-09-12T00:04:09.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.430 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.430 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:09.431 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189608+0000", 2024-09-12T00:04:09.431 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5863e-05 2024-09-12T00:04:09.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.431 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.431 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:09.431 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189628+0000", 2024-09-12T00:04:09.431 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9644e-05 2024-09-12T00:04:09.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.431 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.432 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:09.432 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189747+0000", 2024-09-12T00:04:09.432 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118999 2024-09-12T00:04:09.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.432 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.432 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:09.432 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189874+0000", 2024-09-12T00:04:09.432 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012674499999999999 2024-09-12T00:04:09.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.432 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.432 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:09.432 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.190148+0000", 2024-09-12T00:04:09.432 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000274431 2024-09-12T00:04:09.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.433 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.433 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:09.433 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.191174+0000", 2024-09-12T00:04:09.433 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001025855 2024-09-12T00:04:09.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.433 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.433 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:09.433 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192627+0000", 2024-09-12T00:04:09.433 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014527979999999999 2024-09-12T00:04:09.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.433 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.433 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:09.433 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192710+0000", 2024-09-12T00:04:09.433 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3146000000000007e-05 2024-09-12T00:04:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192781+0000", 2024-09-12T00:04:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.0463000000000006e-05 2024-09-12T00:04:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:09.434 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:09.436 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:09.435+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:09.436 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:04:09.536 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:09.533+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:09.606 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T00:04:09.607 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:09.607 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:09.607 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:09.607 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:09.627 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:04:09.671 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:09.669+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:09.739 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:09.737+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:09.840 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:09.837+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:09.846 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:09.846 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:09.846 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:09.846 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:09.847 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:09.864 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:04:09.949 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:09.949+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:10.042 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:10.041+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:10.077 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:10.077 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:10.077 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:10.077 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:10.077 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.077 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:10.077 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:10.078 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 38.747200145000001, 2024-09-12T00:04:10.078 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.027441031000000001, 2024-09-12T00:04:10.078 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.078 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.078 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.078 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.078 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:10.078 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:10.078 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:04:10.079 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.079 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.079 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.079 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.079 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:10.079 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.079 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.079 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.079 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.079 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:10.079 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.079 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.079 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.079 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.080 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330357+0000", 2024-09-12T00:04:10.080 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2339999999999996e-06 2024-09-12T00:04:10.080 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.080 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.080 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.080 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330381+0000", 2024-09-12T00:04:10.080 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4626000000000001e-05 2024-09-12T00:04:10.080 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.080 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.080 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.080 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330417+0000", 2024-09-12T00:04:10.081 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5886000000000002e-05 2024-09-12T00:04:10.081 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.081 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.081 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.081 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330442+0000", 2024-09-12T00:04:10.081 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4522999999999999e-05 2024-09-12T00:04:10.081 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.081 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.081 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.081 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335485+0000", 2024-09-12T00:04:10.081 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050432589999999996 2024-09-12T00:04:10.081 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.081 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.082 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:10.082 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335507+0000", 2024-09-12T00:04:10.082 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2013000000000001e-05 2024-09-12T00:04:10.082 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.082 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.082 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.082 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.351747+0000", 2024-09-12T00:04:10.082 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016240451999999999 2024-09-12T00:04:10.082 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.082 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.082 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.082 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352062+0000", 2024-09-12T00:04:10.082 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031433399999999999 2024-09-12T00:04:10.082 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.083 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.083 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:10.083 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352378+0000", 2024-09-12T00:04:10.083 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031586400000000001 2024-09-12T00:04:10.083 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.083 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.083 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.083 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.355074+0000", 2024-09-12T00:04:10.083 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026962919999999999 2024-09-12T00:04:10.083 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.083 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.083 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.084 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357537+0000", 2024-09-12T00:04:10.084 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024634689999999998 2024-09-12T00:04:10.084 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.084 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.084 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.084 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357680+0000", 2024-09-12T00:04:10.084 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014314899999999999 2024-09-12T00:04:10.084 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.084 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.085 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.085 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357793+0000", 2024-09-12T00:04:10.085 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011293 2024-09-12T00:04:10.085 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.085 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.085 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.085 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.085 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.085 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94232250902656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:10.085 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:10.085 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 38.719284985000002, 2024-09-12T00:04:10.085 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052696050000000001, 2024-09-12T00:04:10.086 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.086 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.086 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.086 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.086 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:10.086 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:10.086 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:04:10.086 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.086 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.086 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.087 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.087 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:10.087 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.087 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.087 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.087 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.087 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:10.087 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.087 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.087 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.087 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.087 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358270+0000", 2024-09-12T00:04:10.087 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.17e-06 2024-09-12T00:04:10.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.088 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.088 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.088 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358278+0000", 2024-09-12T00:04:10.088 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3529999999999995e-06 2024-09-12T00:04:10.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.088 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.088 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.088 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358306+0000", 2024-09-12T00:04:10.088 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7763000000000002e-05 2024-09-12T00:04:10.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.089 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.089 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.089 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358324+0000", 2024-09-12T00:04:10.089 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7861000000000001e-05 2024-09-12T00:04:10.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.089 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.089 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.089 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358447+0000", 2024-09-12T00:04:10.089 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012334299999999999 2024-09-12T00:04:10.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.090 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358624+0000", 2024-09-12T00:04:10.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017684999999999999 2024-09-12T00:04:10.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:10.090 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358964+0000", 2024-09-12T00:04:10.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00033991199999999999 2024-09-12T00:04:10.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.091 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.362920+0000", 2024-09-12T00:04:10.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039564600000000002 2024-09-12T00:04:10.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.091 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.091 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363016+0000", 2024-09-12T00:04:10.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5612999999999994e-05 2024-09-12T00:04:10.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.091 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.092 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363244+0000", 2024-09-12T00:04:10.092 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000228385 2024-09-12T00:04:10.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.092 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.092 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.092 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363537+0000", 2024-09-12T00:04:10.092 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00029289499999999999 2024-09-12T00:04:10.093 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.093 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.093 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.093 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.093 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:10.093 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:10.093 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 35.711907468, 2024-09-12T00:04:10.093 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011415537, 2024-09-12T00:04:10.093 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.093 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.094 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.094 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.094 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:10.094 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:10.094 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 209 2024-09-12T00:04:10.094 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.094 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.094 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.094 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.094 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:10.094 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.095 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.095 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.095 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.095 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:10.095 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.095 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.095 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.096 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.096 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365648+0000", 2024-09-12T00:04:10.096 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7360000000000001e-06 2024-09-12T00:04:10.096 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.096 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.096 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.096 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365660+0000", 2024-09-12T00:04:10.096 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2089999999999999e-05 2024-09-12T00:04:10.096 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.096 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.097 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.097 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365690+0000", 2024-09-12T00:04:10.097 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0320000000000001e-05 2024-09-12T00:04:10.097 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.097 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.097 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.098 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365708+0000", 2024-09-12T00:04:10.098 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7520000000000002e-05 2024-09-12T00:04:10.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.098 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.098 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.098 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365870+0000", 2024-09-12T00:04:10.098 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016208600000000001 2024-09-12T00:04:10.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.098 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.098 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:10.099 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365885+0000", 2024-09-12T00:04:10.099 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5119999999999999e-05 2024-09-12T00:04:10.099 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.099 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.099 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.099 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373482+0000", 2024-09-12T00:04:10.099 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075970279999999996 2024-09-12T00:04:10.099 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.099 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.099 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.099 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373805+0000", 2024-09-12T00:04:10.100 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032262799999999999 2024-09-12T00:04:10.100 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.100 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.100 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.100 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.374297+0000", 2024-09-12T00:04:10.100 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00049250599999999998 2024-09-12T00:04:10.100 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.100 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.100 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.100 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.375670+0000", 2024-09-12T00:04:10.100 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001373333 2024-09-12T00:04:10.101 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.101 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.101 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.101 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.376923+0000", 2024-09-12T00:04:10.101 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012525640000000001 2024-09-12T00:04:10.101 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.101 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.101 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.101 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377000+0000", 2024-09-12T00:04:10.101 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6732999999999999e-05 2024-09-12T00:04:10.102 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.102 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.102 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.102 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377061+0000", 2024-09-12T00:04:10.102 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0872999999999998e-05 2024-09-12T00:04:10.102 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.102 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.102 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.102 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.102 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.103 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:240 6.19 6:9f626c48:lc::lc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:10.103 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:10.103 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 35.593321715000002, 2024-09-12T00:04:10.103 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058545680000000001, 2024-09-12T00:04:10.103 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.103 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.103 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.103 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.103 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:10.103 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:10.103 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 240 2024-09-12T00:04:10.103 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.103 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.103 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.103 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.104 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:10.104 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.104 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.104 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.104 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.104 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:10.104 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.104 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.104 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.104 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.104 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484233+0000", 2024-09-12T00:04:10.104 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.973e-06 2024-09-12T00:04:10.104 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.105 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.105 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.105 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484241+0000", 2024-09-12T00:04:10.105 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8210000000000002e-06 2024-09-12T00:04:10.106 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.106 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.106 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.106 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484260+0000", 2024-09-12T00:04:10.106 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9148999999999999e-05 2024-09-12T00:04:10.106 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.106 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.106 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.107 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484268+0000", 2024-09-12T00:04:10.107 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5120000000000008e-06 2024-09-12T00:04:10.107 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.107 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.107 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.107 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484371+0000", 2024-09-12T00:04:10.107 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102501 2024-09-12T00:04:10.107 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.107 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.107 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.107 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484450+0000", 2024-09-12T00:04:10.108 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9122999999999994e-05 2024-09-12T00:04:10.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.108 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.108 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.108 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484578+0000", 2024-09-12T00:04:10.108 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000128095 2024-09-12T00:04:10.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.108 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.108 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.108 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.485336+0000", 2024-09-12T00:04:10.109 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00075754000000000001 2024-09-12T00:04:10.109 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.109 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.109 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.109 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.489975+0000", 2024-09-12T00:04:10.109 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004639738 2024-09-12T00:04:10.109 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.109 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.109 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.109 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490043+0000", 2024-09-12T00:04:10.109 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7923999999999995e-05 2024-09-12T00:04:10.110 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.110 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.110 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.110 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490085+0000", 2024-09-12T00:04:10.110 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2191999999999999e-05 2024-09-12T00:04:10.110 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.110 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.110 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.110 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.110 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.110 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:412 6.3 6:c3a682d4:reshard::reshard.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:10.110 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:10.110 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 35.550926308999998, 2024-09-12T00:04:10.110 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049075530000000003, 2024-09-12T00:04:10.110 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.110 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.111 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.111 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.111 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:10.111 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:10.111 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 412 2024-09-12T00:04:10.111 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.111 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.111 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.111 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.111 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:10.111 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.112 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.112 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.112 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.112 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:10.112 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.112 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.112 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.112 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.112 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526628+0000", 2024-09-12T00:04:10.113 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.513e-06 2024-09-12T00:04:10.113 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.113 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.113 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.113 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526634+0000", 2024-09-12T00:04:10.113 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1279999999999996e-06 2024-09-12T00:04:10.113 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.114 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.114 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.114 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526649+0000", 2024-09-12T00:04:10.114 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4997999999999999e-05 2024-09-12T00:04:10.114 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.114 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.114 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.114 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526658+0000", 2024-09-12T00:04:10.114 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1589999999999999e-06 2024-09-12T00:04:10.114 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.114 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.115 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.115 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526728+0000", 2024-09-12T00:04:10.115 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0203999999999994e-05 2024-09-12T00:04:10.115 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.115 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.115 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.115 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526839+0000", 2024-09-12T00:04:10.115 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011055 2024-09-12T00:04:10.115 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.115 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.115 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.115 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526979+0000", 2024-09-12T00:04:10.116 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139863 2024-09-12T00:04:10.116 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.116 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.116 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.116 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.527616+0000", 2024-09-12T00:04:10.117 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00063707900000000003 2024-09-12T00:04:10.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.117 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.117 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.117 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531450+0000", 2024-09-12T00:04:10.117 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003833819 2024-09-12T00:04:10.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.117 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.117 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.117 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531490+0000", 2024-09-12T00:04:10.117 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0129000000000002e-05 2024-09-12T00:04:10.118 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.118 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.118 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.118 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531534+0000", 2024-09-12T00:04:10.118 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4110999999999998e-05 2024-09-12T00:04:10.118 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.118 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.118 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.118 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.118 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.118 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:490 6.19 6:9dc32cef:lc::lc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:10.118 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:10.118 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 35.526728935000001, 2024-09-12T00:04:10.118 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047438380000000002, 2024-09-12T00:04:10.119 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.119 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.119 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.119 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.119 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:10.119 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:10.119 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 490 2024-09-12T00:04:10.119 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.119 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.119 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.120 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.120 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:10.120 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.120 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.120 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.120 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.120 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:10.120 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.120 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.120 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.120 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.121 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550825+0000", 2024-09-12T00:04:10.121 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0589999999999999e-06 2024-09-12T00:04:10.121 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.121 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.121 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.121 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550830+0000", 2024-09-12T00:04:10.121 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2140000000000004e-06 2024-09-12T00:04:10.121 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.121 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.121 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.121 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550843+0000", 2024-09-12T00:04:10.121 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3404000000000001e-05 2024-09-12T00:04:10.122 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.122 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.122 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.122 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550852+0000", 2024-09-12T00:04:10.122 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1549999999999996e-06 2024-09-12T00:04:10.122 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.122 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.122 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.122 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550910+0000", 2024-09-12T00:04:10.122 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7636000000000002e-05 2024-09-12T00:04:10.122 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.123 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.123 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.123 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550977+0000", 2024-09-12T00:04:10.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6636000000000004e-05 2024-09-12T00:04:10.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.123 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.123 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.123 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.551135+0000", 2024-09-12T00:04:10.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015852999999999999 2024-09-12T00:04:10.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.124 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.124 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552939+0000", 2024-09-12T00:04:10.124 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001803643 2024-09-12T00:04:10.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.124 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.124 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555471+0000", 2024-09-12T00:04:10.124 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002532327 2024-09-12T00:04:10.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.125 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.125 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.125 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555526+0000", 2024-09-12T00:04:10.125 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4728000000000002e-05 2024-09-12T00:04:10.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.125 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.125 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.125 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555567+0000", 2024-09-12T00:04:10.125 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1505999999999999e-05 2024-09-12T00:04:10.125 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.125 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.126 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.126 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.126 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.126 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:492 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'6, mlcod=35'4)", 2024-09-12T00:04:10.126 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:10.126 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 35.524952870999996, 2024-09-12T00:04:10.126 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056118790000000002, 2024-09-12T00:04:10.126 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.126 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.127 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.127 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.127 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.127 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.127 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:10.127 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.127 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.127 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.127 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:10.127 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.128 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.128 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.128 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552601+0000", 2024-09-12T00:04:10.128 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6899999999999996e-07 2024-09-12T00:04:10.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.128 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.128 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.129 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552608+0000", 2024-09-12T00:04:10.129 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4529999999999996e-06 2024-09-12T00:04:10.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.129 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.129 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552624+0000", 2024-09-12T00:04:10.129 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5885000000000001e-05 2024-09-12T00:04:10.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552632+0000", 2024-09-12T00:04:10.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2220000000000002e-06 2024-09-12T00:04:10.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.131 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.131 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.131 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552716+0000", 2024-09-12T00:04:10.131 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4060999999999994e-05 2024-09-12T00:04:10.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.131 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.131 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.132 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552735+0000", 2024-09-12T00:04:10.132 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9170000000000001e-05 2024-09-12T00:04:10.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.132 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.132 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.132 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558164+0000", 2024-09-12T00:04:10.133 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054289899999999999 2024-09-12T00:04:10.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.133 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.133 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.133 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558212+0000", 2024-09-12T00:04:10.133 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7129000000000002e-05 2024-09-12T00:04:10.133 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.133 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.134 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.134 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.134 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:496 6.3 6:c134263f:lc::lc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:10.134 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:10.134 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 35.523845582999996, 2024-09-12T00:04:10.134 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045956260000000002, 2024-09-12T00:04:10.134 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.135 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.135 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.135 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.135 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:10.135 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:10.135 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 496 2024-09-12T00:04:10.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.135 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.136 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.136 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.136 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:10.136 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.136 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.136 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.136 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:10.136 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.137 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.137 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.137 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553708+0000", 2024-09-12T00:04:10.137 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2359999999999999e-06 2024-09-12T00:04:10.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.138 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.138 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.138 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553714+0000", 2024-09-12T00:04:10.138 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4960000000000004e-06 2024-09-12T00:04:10.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.138 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.138 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.138 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553726+0000", 2024-09-12T00:04:10.139 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2618e-05 2024-09-12T00:04:10.139 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.139 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.139 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.139 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553734+0000", 2024-09-12T00:04:10.139 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4159999999999998e-06 2024-09-12T00:04:10.139 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.139 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.139 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.140 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553771+0000", 2024-09-12T00:04:10.140 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7095999999999999e-05 2024-09-12T00:04:10.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.140 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.140 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.140 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553815+0000", 2024-09-12T00:04:10.140 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3986999999999997e-05 2024-09-12T00:04:10.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.140 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.141 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.141 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553922+0000", 2024-09-12T00:04:10.141 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000107534 2024-09-12T00:04:10.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.141 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.141 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.141 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555052+0000", 2024-09-12T00:04:10.141 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011298359999999999 2024-09-12T00:04:10.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558197+0000", 2024-09-12T00:04:10.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0031450269999999999 2024-09-12T00:04:10.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558256+0000", 2024-09-12T00:04:10.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8403999999999999e-05 2024-09-12T00:04:10.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558303+0000", 2024-09-12T00:04:10.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6975999999999999e-05 2024-09-12T00:04:10.142 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.143 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.143 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.143 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.143 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:641 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:10.143 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:10.143 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 35.483775256000001, 2024-09-12T00:04:10.143 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052824789999999996, 2024-09-12T00:04:10.143 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.143 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.143 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.144 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.144 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:10.144 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:10.144 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 641 2024-09-12T00:04:10.144 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.144 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.144 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.144 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.144 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:10.144 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.144 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.144 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.144 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.144 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:10.144 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.145 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.145 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.145 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593778+0000", 2024-09-12T00:04:10.145 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0920000000000001e-06 2024-09-12T00:04:10.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.145 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.145 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.145 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593783+0000", 2024-09-12T00:04:10.145 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9490000000000004e-06 2024-09-12T00:04:10.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.145 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.145 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.146 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593795+0000", 2024-09-12T00:04:10.146 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2048999999999999e-05 2024-09-12T00:04:10.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.146 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.146 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.146 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593801+0000", 2024-09-12T00:04:10.146 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8989999999999998e-06 2024-09-12T00:04:10.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.146 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.146 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.146 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593852+0000", 2024-09-12T00:04:10.146 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1057999999999998e-05 2024-09-12T00:04:10.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.146 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.147 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.147 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593905+0000", 2024-09-12T00:04:10.147 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2196e-05 2024-09-12T00:04:10.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.147 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:10.147 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594017+0000", 2024-09-12T00:04:10.147 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000112816 2024-09-12T00:04:10.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.148 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.148 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.148 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.595190+0000", 2024-09-12T00:04:10.148 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011727199999999999 2024-09-12T00:04:10.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.148 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.148 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.148 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.598998+0000", 2024-09-12T00:04:10.148 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038081320000000001 2024-09-12T00:04:10.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.149 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.149 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.149 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599032+0000", 2024-09-12T00:04:10.149 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4283999999999999e-05 2024-09-12T00:04:10.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.149 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.149 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.149 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599060+0000", 2024-09-12T00:04:10.149 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7284000000000002e-05 2024-09-12T00:04:10.149 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.149 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.149 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.150 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.150 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:643 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'8, mlcod=35'6)", 2024-09-12T00:04:10.150 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:10.150 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 35.483277149000003, 2024-09-12T00:04:10.150 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048211260000000002, 2024-09-12T00:04:10.151 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.151 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.151 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.151 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.151 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.151 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:10.151 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.152 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.152 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:10.152 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.152 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.152 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.152 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.152 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594276+0000", 2024-09-12T00:04:10.152 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5899999999999995e-07 2024-09-12T00:04:10.152 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.152 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.152 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.153 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594283+0000", 2024-09-12T00:04:10.153 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6019999999999996e-06 2024-09-12T00:04:10.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.153 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.153 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.153 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594295+0000", 2024-09-12T00:04:10.153 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1683e-05 2024-09-12T00:04:10.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.153 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.153 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.154 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594303+0000", 2024-09-12T00:04:10.154 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0439999999999996e-06 2024-09-12T00:04:10.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.154 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.154 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594353+0000", 2024-09-12T00:04:10.154 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0698000000000001e-05 2024-09-12T00:04:10.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.154 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.154 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594380+0000", 2024-09-12T00:04:10.155 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7089000000000001e-05 2024-09-12T00:04:10.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.155 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.155 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.155 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599063+0000", 2024-09-12T00:04:10.155 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046824739999999998 2024-09-12T00:04:10.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.155 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.156 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.156 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599096+0000", 2024-09-12T00:04:10.156 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3677000000000003e-05 2024-09-12T00:04:10.156 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.156 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.156 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.156 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.156 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.156 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:647 6.a 6:5395e6f3:lc::lc.4:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:10.157 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:10.157 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 35.480926515999997, 2024-09-12T00:04:10.157 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049071770000000004, 2024-09-12T00:04:10.157 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.157 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.157 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.157 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.157 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:10.158 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:10.158 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 647 2024-09-12T00:04:10.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.158 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.158 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.158 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.158 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:10.158 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.158 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.159 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.159 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:10.159 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.159 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.159 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596627+0000", 2024-09-12T00:04:10.159 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1149999999999999e-06 2024-09-12T00:04:10.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.160 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.160 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596632+0000", 2024-09-12T00:04:10.160 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7060000000000003e-06 2024-09-12T00:04:10.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.160 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.160 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.160 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596645+0000", 2024-09-12T00:04:10.160 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2791e-05 2024-09-12T00:04:10.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.160 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.161 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.161 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596653+0000", 2024-09-12T00:04:10.161 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9230000000000002e-06 2024-09-12T00:04:10.161 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.161 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.161 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.162 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596705+0000", 2024-09-12T00:04:10.162 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2250000000000003e-05 2024-09-12T00:04:10.162 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.162 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.162 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.162 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596758+0000", 2024-09-12T00:04:10.162 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2964000000000003e-05 2024-09-12T00:04:10.162 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.162 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.163 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:10.163 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596873+0000", 2024-09-12T00:04:10.163 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011501 2024-09-12T00:04:10.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.163 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.163 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.163 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599088+0000", 2024-09-12T00:04:10.163 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002215135 2024-09-12T00:04:10.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.163 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.164 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.164 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601456+0000", 2024-09-12T00:04:10.164 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023684719999999999 2024-09-12T00:04:10.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.164 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.164 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601507+0000", 2024-09-12T00:04:10.164 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0933999999999997e-05 2024-09-12T00:04:10.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.164 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.164 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601533+0000", 2024-09-12T00:04:10.165 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5877e-05 2024-09-12T00:04:10.165 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.165 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.165 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.165 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.165 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:657 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'10, mlcod=35'7)", 2024-09-12T00:04:10.165 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:10.165 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 35.477102975999998, 2024-09-12T00:04:10.165 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066410239999999997, 2024-09-12T00:04:10.166 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.166 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.166 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.166 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.166 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.167 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.167 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:10.167 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.167 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.167 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.167 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.168 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:10.168 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.168 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.168 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.169 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.169 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:10.169 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6099999999999999e-07 2024-09-12T00:04:10.169 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.169 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.169 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.170 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600457+0000", 2024-09-12T00:04:10.170 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8700000000000003e-06 2024-09-12T00:04:10.170 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.170 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.170 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.170 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600470+0000", 2024-09-12T00:04:10.170 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3186999999999999e-05 2024-09-12T00:04:10.171 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.171 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.171 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.171 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600478+0000", 2024-09-12T00:04:10.171 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5310000000000004e-06 2024-09-12T00:04:10.171 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.172 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.172 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.172 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600521+0000", 2024-09-12T00:04:10.172 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2574000000000003e-05 2024-09-12T00:04:10.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.172 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.172 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.173 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600535+0000", 2024-09-12T00:04:10.173 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4151000000000001e-05 2024-09-12T00:04:10.173 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.173 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.173 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.173 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.606997+0000", 2024-09-12T00:04:10.174 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064626099999999997 2024-09-12T00:04:10.174 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.174 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.174 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.174 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607091+0000", 2024-09-12T00:04:10.174 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3239999999999995e-05 2024-09-12T00:04:10.174 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.174 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.175 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.175 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.175 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.175 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:659 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:10.175 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:10.175 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 35.476930643999999, 2024-09-12T00:04:10.175 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0065340989999999998, 2024-09-12T00:04:10.175 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.176 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.176 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.176 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.176 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:10.176 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:10.176 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 659 2024-09-12T00:04:10.176 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.176 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.177 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.177 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.182 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:10.182 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.182 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.182 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.182 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.182 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:10.183 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.183 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.183 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.183 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.183 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600623+0000", 2024-09-12T00:04:10.183 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.085e-06 2024-09-12T00:04:10.183 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.184 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.184 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.184 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600630+0000", 2024-09-12T00:04:10.184 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0029999999999997e-06 2024-09-12T00:04:10.184 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.184 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.184 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.184 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600647+0000", 2024-09-12T00:04:10.185 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6566999999999999e-05 2024-09-12T00:04:10.185 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.185 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.185 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.185 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600658+0000", 2024-09-12T00:04:10.185 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0992000000000001e-05 2024-09-12T00:04:10.185 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.185 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.185 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.186 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600717+0000", 2024-09-12T00:04:10.186 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9925e-05 2024-09-12T00:04:10.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.186 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.186 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.186 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600773+0000", 2024-09-12T00:04:10.186 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5766000000000001e-05 2024-09-12T00:04:10.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.187 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.187 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:10.187 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600889+0000", 2024-09-12T00:04:10.188 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115906 2024-09-12T00:04:10.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.188 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.188 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603483+0000", 2024-09-12T00:04:10.188 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025940799999999999 2024-09-12T00:04:10.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.189 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.189 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.189 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607098+0000", 2024-09-12T00:04:10.189 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036150459999999998 2024-09-12T00:04:10.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.189 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.189 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.190 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607133+0000", 2024-09-12T00:04:10.190 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4615e-05 2024-09-12T00:04:10.190 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.190 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.190 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.190 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607156+0000", 2024-09-12T00:04:10.190 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3113999999999999e-05 2024-09-12T00:04:10.191 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.191 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.191 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.191 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.191 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:666 6.a 6:5395e6f3:lc::lc.4:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:10.192 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:10.192 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 35.475183514999998, 2024-09-12T00:04:10.192 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.005127174, 2024-09-12T00:04:10.192 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.192 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.193 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.193 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.193 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:10.193 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:10.193 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 666 2024-09-12T00:04:10.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.194 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.194 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.194 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.194 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:10.194 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.195 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.195 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.195 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:10.195 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.195 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.196 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.196 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602370+0000", 2024-09-12T00:04:10.196 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0720000000000001e-06 2024-09-12T00:04:10.196 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.196 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.196 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.197 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602376+0000", 2024-09-12T00:04:10.197 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5489999999999997e-06 2024-09-12T00:04:10.197 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.197 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.197 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.197 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602391+0000", 2024-09-12T00:04:10.197 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5301000000000001e-05 2024-09-12T00:04:10.197 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.198 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.198 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.198 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602399+0000", 2024-09-12T00:04:10.198 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9179999999999994e-06 2024-09-12T00:04:10.198 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.198 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.198 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.199 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602456+0000", 2024-09-12T00:04:10.199 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7099999999999999e-05 2024-09-12T00:04:10.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.199 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.199 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.199 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602508+0000", 2024-09-12T00:04:10.199 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2476999999999999e-05 2024-09-12T00:04:10.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.199 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.199 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:10.199 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602606+0000", 2024-09-12T00:04:10.199 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7823000000000002e-05 2024-09-12T00:04:10.200 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.200 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.200 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.200 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.604653+0000", 2024-09-12T00:04:10.200 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002047068 2024-09-12T00:04:10.200 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.200 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.200 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.200 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607401+0000", 2024-09-12T00:04:10.200 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027477700000000001 2024-09-12T00:04:10.200 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.200 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.200 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.201 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607453+0000", 2024-09-12T00:04:10.201 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2092999999999997e-05 2024-09-12T00:04:10.201 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.201 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.201 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.201 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607496+0000", 2024-09-12T00:04:10.201 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3003000000000001e-05 2024-09-12T00:04:10.201 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.201 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.201 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.201 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.201 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.201 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:665 6.1a e35/29 6:5c7e8a6d:reshard::reshard.0000000015:head v 35'11, mlcod=35'8)", 2024-09-12T00:04:10.202 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:10.202 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 35.47481183, 2024-09-12T00:04:10.202 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048593209999999998, 2024-09-12T00:04:10.202 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.202 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.202 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.202 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.202 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.202 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.202 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:10.202 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.202 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.202 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.202 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.203 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:10.203 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.203 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.203 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.203 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.203 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602742+0000", 2024-09-12T00:04:10.203 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1069999999999999e-06 2024-09-12T00:04:10.203 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.203 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.203 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.203 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602749+0000", 2024-09-12T00:04:10.203 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9609999999999999e-06 2024-09-12T00:04:10.203 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.203 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.204 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.204 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602763+0000", 2024-09-12T00:04:10.204 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4086e-05 2024-09-12T00:04:10.204 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.204 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.204 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.204 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602772+0000", 2024-09-12T00:04:10.204 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8470000000000002e-06 2024-09-12T00:04:10.204 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.204 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.204 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.204 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602826+0000", 2024-09-12T00:04:10.204 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3885000000000003e-05 2024-09-12T00:04:10.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.205 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.205 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.205 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602837+0000", 2024-09-12T00:04:10.205 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1601e-05 2024-09-12T00:04:10.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.205 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.205 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.205 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607500+0000", 2024-09-12T00:04:10.205 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046627509999999997 2024-09-12T00:04:10.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.205 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.205 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.206 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607600+0000", 2024-09-12T00:04:10.206 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100083 2024-09-12T00:04:10.206 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.206 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.206 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.206 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.206 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.206 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:831 6.19 6:9d23f22c:lc::lc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:10.206 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:10.206 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 35.411527149999998, 2024-09-12T00:04:10.206 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047044610000000001, 2024-09-12T00:04:10.206 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.206 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.207 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.207 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.207 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:10.207 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:10.207 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 831 2024-09-12T00:04:10.207 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.207 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.207 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.207 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.207 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:10.207 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.207 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.207 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.207 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.208 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:10.208 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.208 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.208 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.208 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.208 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666026+0000", 2024-09-12T00:04:10.208 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.02e-06 2024-09-12T00:04:10.208 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.208 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.208 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.208 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666032+0000", 2024-09-12T00:04:10.208 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8850000000000004e-06 2024-09-12T00:04:10.209 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.209 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.209 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.209 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666047+0000", 2024-09-12T00:04:10.209 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4647999999999999e-05 2024-09-12T00:04:10.209 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.209 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.209 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.209 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666058+0000", 2024-09-12T00:04:10.209 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0905e-05 2024-09-12T00:04:10.209 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.209 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.209 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.209 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666376+0000", 2024-09-12T00:04:10.210 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031824899999999999 2024-09-12T00:04:10.210 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.210 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.210 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.210 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666479+0000", 2024-09-12T00:04:10.210 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102814 2024-09-12T00:04:10.210 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.210 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.210 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.210 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666635+0000", 2024-09-12T00:04:10.210 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000156343 2024-09-12T00:04:10.210 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.210 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.211 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.211 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.667611+0000", 2024-09-12T00:04:10.211 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000975671 2024-09-12T00:04:10.211 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.211 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.211 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.211 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670662+0000", 2024-09-12T00:04:10.211 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003050863 2024-09-12T00:04:10.211 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.211 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.211 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.211 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670701+0000", 2024-09-12T00:04:10.211 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9338000000000002e-05 2024-09-12T00:04:10.212 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.212 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.212 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.212 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670730+0000", 2024-09-12T00:04:10.212 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8725e-05 2024-09-12T00:04:10.212 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.212 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.212 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.212 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.212 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.212 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:852 6.1d e35/29 6:bbf2d10c:::obj_delete_at_hint.0000000025:head v 35'9, mlcod=35'7)", 2024-09-12T00:04:10.212 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:10.212 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 35.402950097000002, 2024-09-12T00:04:10.212 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00569595, 2024-09-12T00:04:10.213 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.213 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.213 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.213 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.213 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.213 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.213 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:10.213 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.213 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.213 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.213 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.213 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:10.213 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.214 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.214 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.214 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674604+0000", 2024-09-12T00:04:10.214 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2079999999999999e-06 2024-09-12T00:04:10.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.214 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.214 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.214 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674611+0000", 2024-09-12T00:04:10.214 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.973e-06 2024-09-12T00:04:10.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.214 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.214 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.215 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674625+0000", 2024-09-12T00:04:10.215 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3916e-05 2024-09-12T00:04:10.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.215 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.215 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.215 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674633+0000", 2024-09-12T00:04:10.215 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8580000000000006e-06 2024-09-12T00:04:10.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.215 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.215 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.215 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674697+0000", 2024-09-12T00:04:10.215 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4004999999999995e-05 2024-09-12T00:04:10.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.216 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.216 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.216 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674713+0000", 2024-09-12T00:04:10.216 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5835e-05 2024-09-12T00:04:10.216 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.216 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.216 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.216 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680245+0000", 2024-09-12T00:04:10.216 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055320250000000003 2024-09-12T00:04:10.216 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.217 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.217 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.217 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680298+0000", 2024-09-12T00:04:10.217 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3130000000000001e-05 2024-09-12T00:04:10.217 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.217 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.217 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.217 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.217 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.217 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:925 6.1a e35/29 6:5f2e3d26:lc::lc.18:head v 35'15, mlcod=35'12)", 2024-09-12T00:04:10.217 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:10.217 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 35.379422267000002, 2024-09-12T00:04:10.217 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055640999999999998, 2024-09-12T00:04:10.218 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.218 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.218 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.218 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.218 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.218 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.218 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:10.218 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.218 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.218 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.218 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.218 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:10.218 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.219 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.219 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.219 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.219 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698131+0000", 2024-09-12T00:04:10.219 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:04:10.219 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.219 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.219 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.219 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698140+0000", 2024-09-12T00:04:10.219 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3139999999999993e-06 2024-09-12T00:04:10.219 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.219 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.219 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.219 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698155+0000", 2024-09-12T00:04:10.219 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:04:10.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.220 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.220 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.220 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698164+0000", 2024-09-12T00:04:10.220 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1419999999999999e-06 2024-09-12T00:04:10.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.220 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.220 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.220 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698228+0000", 2024-09-12T00:04:10.220 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3380000000000006e-05 2024-09-12T00:04:10.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.220 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.221 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.221 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698252+0000", 2024-09-12T00:04:10.221 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4111e-05 2024-09-12T00:04:10.221 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.221 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.221 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.221 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703646+0000", 2024-09-12T00:04:10.221 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0053937840000000004 2024-09-12T00:04:10.221 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.221 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.221 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.221 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703694+0000", 2024-09-12T00:04:10.221 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8776999999999997e-05 2024-09-12T00:04:10.222 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.222 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.222 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.222 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.222 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.222 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:927 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:10.222 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:10.222 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 35.378903243000003, 2024-09-12T00:04:10.222 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050914949999999997, 2024-09-12T00:04:10.222 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.222 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.222 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.222 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.222 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:10.223 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:10.223 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 927 2024-09-12T00:04:10.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.223 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.223 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.223 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.223 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:10.223 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.223 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.223 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.223 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:10.223 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.224 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.224 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.224 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698651+0000", 2024-09-12T00:04:10.224 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3740000000000001e-06 2024-09-12T00:04:10.224 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.224 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.224 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.224 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698657+0000", 2024-09-12T00:04:10.224 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5239999999999997e-06 2024-09-12T00:04:10.224 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.224 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.224 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.224 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698673+0000", 2024-09-12T00:04:10.225 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5345999999999998e-05 2024-09-12T00:04:10.225 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.225 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.225 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.225 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698680+0000", 2024-09-12T00:04:10.225 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4649999999999997e-06 2024-09-12T00:04:10.225 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.225 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.225 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.225 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699009+0000", 2024-09-12T00:04:10.225 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032934000000000001 2024-09-12T00:04:10.225 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.225 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.225 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.226 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699213+0000", 2024-09-12T00:04:10.226 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020361500000000001 2024-09-12T00:04:10.226 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.226 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.226 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.226 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699450+0000", 2024-09-12T00:04:10.226 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023670399999999999 2024-09-12T00:04:10.226 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.226 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.226 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.226 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.700678+0000", 2024-09-12T00:04:10.226 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012285519999999999 2024-09-12T00:04:10.226 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.226 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.227 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.227 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703666+0000", 2024-09-12T00:04:10.227 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029876130000000001 2024-09-12T00:04:10.227 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.227 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.227 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.227 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703708+0000", 2024-09-12T00:04:10.227 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2361999999999999e-05 2024-09-12T00:04:10.227 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.227 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.227 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.227 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703741+0000", 2024-09-12T00:04:10.227 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.26e-05 2024-09-12T00:04:10.227 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.228 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.228 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.228 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.228 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:941 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:10.228 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:10.228 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 35.373409789999997, 2024-09-12T00:04:10.228 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0051476960000000002, 2024-09-12T00:04:10.228 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.228 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.228 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "started", 2024-09-12T00:04:10.228 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.229 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:10.229 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:10.229 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 941 2024-09-12T00:04:10.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.229 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.229 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.229 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.229 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:10.229 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.229 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.229 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.229 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:10.229 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.230 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.230 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.230 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.230 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704144+0000", 2024-09-12T00:04:10.230 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.514e-06 2024-09-12T00:04:10.230 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.230 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.230 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.230 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704152+0000", 2024-09-12T00:04:10.230 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2830000000000004e-06 2024-09-12T00:04:10.230 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.230 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.230 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.230 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704168+0000", 2024-09-12T00:04:10.231 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6835999999999999e-05 2024-09-12T00:04:10.231 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.231 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.231 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.231 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704178+0000", 2024-09-12T00:04:10.231 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7569999999999999e-06 2024-09-12T00:04:10.231 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.231 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.231 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.231 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704240+0000", 2024-09-12T00:04:10.231 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2193000000000006e-05 2024-09-12T00:04:10.231 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.232 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.232 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.232 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704308+0000", 2024-09-12T00:04:10.232 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7840000000000001e-05 2024-09-12T00:04:10.232 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.232 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.232 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.232 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.709290+0000", 2024-09-12T00:04:10.232 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049822729999999997 2024-09-12T00:04:10.232 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.232 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.232 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.232 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.232 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.233 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:10.234 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:04:10.235 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:10.233+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:10.335 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:10.335+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:10.389 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:10.389 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:10.389 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:10.389 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:10.402 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:04:10.436 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:10.435+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:10.511 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:10.511 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:10.511 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:10.512 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:10.512 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:10.525 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:04:10.569 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:10.569+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T00:04:10.638 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:10.639+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:10.641 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 59.149931033000001, 2024-09-12T00:04:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.278479906, 2024-09-12T00:04:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:04:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493422+0000", 2024-09-12T00:04:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.807e-06 2024-09-12T00:04:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493435+0000", 2024-09-12T00:04:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.375e-05 2024-09-12T00:04:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493457+0000", 2024-09-12T00:04:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2166000000000001e-05 2024-09-12T00:04:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493475+0000", 2024-09-12T00:04:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7184e-05 2024-09-12T00:04:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493617+0000", 2024-09-12T00:04:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014274200000000001 2024-09-12T00:04:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493632+0000", 2024-09-12T00:04:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4293e-05 2024-09-12T00:04:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.768657+0000", 2024-09-12T00:04:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.27502575400000001 2024-09-12T00:04:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769042+0000", 2024-09-12T00:04:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00038463700000000001 2024-09-12T00:04:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769430+0000", 2024-09-12T00:04:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000388014 2024-09-12T00:04:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.770784+0000", 2024-09-12T00:04:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00135402 2024-09-12T00:04:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771735+0000", 2024-09-12T00:04:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00095068599999999996 2024-09-12T00:04:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771828+0000", 2024-09-12T00:04:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3468999999999996e-05 2024-09-12T00:04:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771899+0000", 2024-09-12T00:04:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0383999999999996e-05 2024-09-12T00:04:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.721707277, 2024-09-12T00:04:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013402304, 2024-09-12T00:04:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 44 2024-09-12T00:04:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7100000000000001e-07 2024-09-12T00:04:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921706+0000", 2024-09-12T00:04:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2374999999999998e-05 2024-09-12T00:04:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921726+0000", 2024-09-12T00:04:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0373999999999998e-05 2024-09-12T00:04:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921733+0000", 2024-09-12T00:04:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8929999999999999e-06 2024-09-12T00:04:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927137+0000", 2024-09-12T00:04:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054037410000000001 2024-09-12T00:04:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927274+0000", 2024-09-12T00:04:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013697899999999999 2024-09-12T00:04:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927504+0000", 2024-09-12T00:04:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023005399999999999 2024-09-12T00:04:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.931848+0000", 2024-09-12T00:04:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0043445269999999999 2024-09-12T00:04:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934770+0000", 2024-09-12T00:04:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002922319 2024-09-12T00:04:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934901+0000", 2024-09-12T00:04:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013034599999999999 2024-09-12T00:04:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935045+0000", 2024-09-12T00:04:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014402499999999999 2024-09-12T00:04:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.721604311999997, 2024-09-12T00:04:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013456684999999999, 2024-09-12T00:04:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 45 2024-09-12T00:04:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921746+0000", 2024-09-12T00:04:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9800000000000003e-07 2024-09-12T00:04:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921751+0000", 2024-09-12T00:04:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7099999999999998e-06 2024-09-12T00:04:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921766+0000", 2024-09-12T00:04:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5633000000000001e-05 2024-09-12T00:04:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921786+0000", 2024-09-12T00:04:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9658000000000001e-05 2024-09-12T00:04:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929539+0000", 2024-09-12T00:04:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0077533120000000001 2024-09-12T00:04:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929706+0000", 2024-09-12T00:04:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016664199999999999 2024-09-12T00:04:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929933+0000", 2024-09-12T00:04:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000226658 2024-09-12T00:04:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934721+0000", 2024-09-12T00:04:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047886439999999999 2024-09-12T00:04:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935062+0000", 2024-09-12T00:04:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00034072399999999999 2024-09-12T00:04:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935141+0000", 2024-09-12T00:04:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8570000000000002e-05 2024-09-12T00:04:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935202+0000", 2024-09-12T00:04:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1536000000000002e-05 2024-09-12T00:04:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.721554079999997, 2024-09-12T00:04:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014633617, 2024-09-12T00:04:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:04:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3599999999999999e-07 2024-09-12T00:04:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921800+0000", 2024-09-12T00:04:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3850000000000002e-06 2024-09-12T00:04:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921805+0000", 2024-09-12T00:04:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9460000000000003e-06 2024-09-12T00:04:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921819+0000", 2024-09-12T00:04:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.325e-05 2024-09-12T00:04:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930627+0000", 2024-09-12T00:04:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00880827 2024-09-12T00:04:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930805+0000", 2024-09-12T00:04:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000177992 2024-09-12T00:04:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.931028+0000", 2024-09-12T00:04:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000223122 2024-09-12T00:04:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935258+0000", 2024-09-12T00:04:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0042302709999999999 2024-09-12T00:04:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936282+0000", 2024-09-12T00:04:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00102345 2024-09-12T00:04:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936367+0000", 2024-09-12T00:04:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4869000000000003e-05 2024-09-12T00:04:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936429+0000", 2024-09-12T00:04:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2626000000000007e-05 2024-09-12T00:04:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.721517830000003, 2024-09-12T00:04:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016022492999999999, 2024-09-12T00:04:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:04:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4000000000000002e-07 2024-09-12T00:04:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921891+0000", 2024-09-12T00:04:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8298000000000003e-05 2024-09-12T00:04:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921899+0000", 2024-09-12T00:04:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7059999999999993e-06 2024-09-12T00:04:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921904+0000", 2024-09-12T00:04:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9799999999999998e-06 2024-09-12T00:04:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932144+0000", 2024-09-12T00:04:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010239817999999999 2024-09-12T00:04:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932284+0000", 2024-09-12T00:04:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139436 2024-09-12T00:04:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932498+0000", 2024-09-12T00:04:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000214408 2024-09-12T00:04:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936444+0000", 2024-09-12T00:04:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039464169999999998 2024-09-12T00:04:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937702+0000", 2024-09-12T00:04:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012571679999999999 2024-09-12T00:04:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937793+0000", 2024-09-12T00:04:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1489000000000004e-05 2024-09-12T00:04:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937854+0000", 2024-09-12T00:04:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1333000000000004e-05 2024-09-12T00:04:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.721435962000001, 2024-09-12T00:04:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017189138999999999, 2024-09-12T00:04:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 48 2024-09-12T00:04:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7399999999999998e-07 2024-09-12T00:04:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921918+0000", 2024-09-12T00:04:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6399999999999999e-06 2024-09-12T00:04:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921925+0000", 2024-09-12T00:04:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7190000000000004e-06 2024-09-12T00:04:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921931+0000", 2024-09-12T00:04:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2519999999999996e-06 2024-09-12T00:04:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933475+0000", 2024-09-12T00:04:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011543759000000001 2024-09-12T00:04:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933617+0000", 2024-09-12T00:04:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000142282 2024-09-12T00:04:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933860+0000", 2024-09-12T00:04:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024276199999999999 2024-09-12T00:04:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937933+0000", 2024-09-12T00:04:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040734680000000002 2024-09-12T00:04:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938955+0000", 2024-09-12T00:04:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001021987 2024-09-12T00:04:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939038+0000", 2024-09-12T00:04:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2449999999999998e-05 2024-09-12T00:04:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939103+0000", 2024-09-12T00:04:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5345999999999994e-05 2024-09-12T00:04:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.721410419999998, 2024-09-12T00:04:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018247975, 2024-09-12T00:04:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 49 2024-09-12T00:04:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921940+0000", 2024-09-12T00:04:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7e-07 2024-09-12T00:04:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921943+0000", 2024-09-12T00:04:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1889999999999999e-06 2024-09-12T00:04:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921952+0000", 2024-09-12T00:04:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0010000000000007e-06 2024-09-12T00:04:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921959+0000", 2024-09-12T00:04:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2570000000000001e-06 2024-09-12T00:04:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935333+0000", 2024-09-12T00:04:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013373368 2024-09-12T00:04:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935472+0000", 2024-09-12T00:04:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013987900000000001 2024-09-12T00:04:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935700+0000", 2024-09-12T00:04:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000227922 2024-09-12T00:04:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939858+0000", 2024-09-12T00:04:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041571300000000002 2024-09-12T00:04:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940018+0000", 2024-09-12T00:04:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016060400000000001 2024-09-12T00:04:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940114+0000", 2024-09-12T00:04:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5692999999999993e-05 2024-09-12T00:04:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940187+0000", 2024-09-12T00:04:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3561999999999998e-05 2024-09-12T00:04:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.721367633, 2024-09-12T00:04:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021018614000000001, 2024-09-12T00:04:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 50 2024-09-12T00:04:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921983+0000", 2024-09-12T00:04:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4499999999999996e-07 2024-09-12T00:04:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922071+0000", 2024-09-12T00:04:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8010000000000006e-05 2024-09-12T00:04:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922084+0000", 2024-09-12T00:04:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3275000000000001e-05 2024-09-12T00:04:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922093+0000", 2024-09-12T00:04:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0580000000000004e-06 2024-09-12T00:04:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936515+0000", 2024-09-12T00:04:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014421270999999999 2024-09-12T00:04:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936677+0000", 2024-09-12T00:04:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162003 2024-09-12T00:04:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936908+0000", 2024-09-12T00:04:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023115700000000001 2024-09-12T00:04:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939985+0000", 2024-09-12T00:04:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030773879999999999 2024-09-12T00:04:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942623+0000", 2024-09-12T00:04:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026377929999999998 2024-09-12T00:04:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942818+0000", 2024-09-12T00:04:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019556200000000001 2024-09-12T00:04:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943001+0000", 2024-09-12T00:04:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018235199999999999 2024-09-12T00:04:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.721233241, 2024-09-12T00:04:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021092493, 2024-09-12T00:04:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 51 2024-09-12T00:04:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922118+0000", 2024-09-12T00:04:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0389999999999999e-06 2024-09-12T00:04:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922124+0000", 2024-09-12T00:04:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5409999999999997e-06 2024-09-12T00:04:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922136+0000", 2024-09-12T00:04:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.205e-05 2024-09-12T00:04:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922147+0000", 2024-09-12T00:04:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0451e-05 2024-09-12T00:04:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938000+0000", 2024-09-12T00:04:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015853682000000001 2024-09-12T00:04:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938142+0000", 2024-09-12T00:04:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014148899999999999 2024-09-12T00:04:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938362+0000", 2024-09-12T00:04:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022034800000000001 2024-09-12T00:04:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940330+0000", 2024-09-12T00:04:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001967459 2024-09-12T00:04:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943064+0000", 2024-09-12T00:04:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027346219999999999 2024-09-12T00:04:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943152+0000", 2024-09-12T00:04:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7563000000000002e-05 2024-09-12T00:04:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943209+0000", 2024-09-12T00:04:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7249e-05 2024-09-12T00:04:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.721183748000001, 2024-09-12T00:04:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021175616000000001, 2024-09-12T00:04:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 52 2024-09-12T00:04:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922167+0000", 2024-09-12T00:04:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3300000000000001e-07 2024-09-12T00:04:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922174+0000", 2024-09-12T00:04:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7070000000000003e-06 2024-09-12T00:04:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922184+0000", 2024-09-12T00:04:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682e-05 2024-09-12T00:04:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922195+0000", 2024-09-12T00:04:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0489000000000001e-05 2024-09-12T00:04:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939166+0000", 2024-09-12T00:04:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016971245999999999 2024-09-12T00:04:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939243+0000", 2024-09-12T00:04:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7201999999999997e-05 2024-09-12T00:04:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939381+0000", 2024-09-12T00:04:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013770699999999999 2024-09-12T00:04:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940923+0000", 2024-09-12T00:04:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001542302 2024-09-12T00:04:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943221+0000", 2024-09-12T00:04:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022979720000000001 2024-09-12T00:04:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943295+0000", 2024-09-12T00:04:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3317000000000003e-05 2024-09-12T00:04:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943342+0000", 2024-09-12T00:04:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7159e-05 2024-09-12T00:04:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.472238781999998, 2024-09-12T00:04:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015229411999999999, 2024-09-12T00:04:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 67 2024-09-12T00:04:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171112+0000", 2024-09-12T00:04:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2899999999999999e-06 2024-09-12T00:04:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171119+0000", 2024-09-12T00:04:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8870000000000003e-06 2024-09-12T00:04:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171131+0000", 2024-09-12T00:04:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1902999999999999e-05 2024-09-12T00:04:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171147+0000", 2024-09-12T00:04:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6203000000000001e-05 2024-09-12T00:04:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175044+0000", 2024-09-12T00:04:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038967310000000001 2024-09-12T00:04:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175172+0000", 2024-09-12T00:04:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012784100000000001 2024-09-12T00:04:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175372+0000", 2024-09-12T00:04:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019978500000000001 2024-09-12T00:04:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179276+0000", 2024-09-12T00:04:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039042149999999999 2024-09-12T00:04:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186150+0000", 2024-09-12T00:04:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0068740019999999997 2024-09-12T00:04:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186266+0000", 2024-09-12T00:04:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115742 2024-09-12T00:04:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186340+0000", 2024-09-12T00:04:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4813000000000004e-05 2024-09-12T00:04:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.472177705999997, 2024-09-12T00:04:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015308448000000001, 2024-09-12T00:04:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 68 2024-09-12T00:04:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.712 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.712 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:10.712 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.712 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.712 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.712 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.712 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:10.712 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.712 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.712 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.712 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.712 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171173+0000", 2024-09-12T00:04:10.712 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:04:10.713 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.713 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.713 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.713 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171182+0000", 2024-09-12T00:04:10.713 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2359999999999993e-06 2024-09-12T00:04:10.713 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.713 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.713 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.714 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171193+0000", 2024-09-12T00:04:10.714 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.095e-05 2024-09-12T00:04:10.714 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.714 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.715 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.715 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171207+0000", 2024-09-12T00:04:10.715 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3339999999999999e-05 2024-09-12T00:04:10.715 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.715 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.715 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.715 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176753+0000", 2024-09-12T00:04:10.715 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055460240000000001 2024-09-12T00:04:10.715 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.715 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.715 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.715 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176921+0000", 2024-09-12T00:04:10.715 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000168503 2024-09-12T00:04:10.716 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.716 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.716 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.716 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177112+0000", 2024-09-12T00:04:10.716 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019113999999999999 2024-09-12T00:04:10.716 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.716 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.716 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.716 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179382+0000", 2024-09-12T00:04:10.716 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022697099999999999 2024-09-12T00:04:10.716 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.716 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.716 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.717 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186356+0000", 2024-09-12T00:04:10.717 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069741919999999997 2024-09-12T00:04:10.717 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.717 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.717 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.717 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186422+0000", 2024-09-12T00:04:10.717 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6387e-05 2024-09-12T00:04:10.717 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.717 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.717 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.717 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186481+0000", 2024-09-12T00:04:10.717 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8059000000000001e-05 2024-09-12T00:04:10.717 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.718 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.718 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.718 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.718 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.718 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:10.718 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:10.718 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.472125935999998, 2024-09-12T00:04:10.718 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020001835999999999, 2024-09-12T00:04:10.718 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.718 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.718 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.718 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.718 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:10.719 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:10.719 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 69 2024-09-12T00:04:10.719 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.719 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.719 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.719 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.719 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:10.719 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.719 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.719 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.719 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.719 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:10.719 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.719 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.720 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.720 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.720 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171225+0000", 2024-09-12T00:04:10.720 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0599999999999999e-07 2024-09-12T00:04:10.720 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.720 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.720 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.720 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171349+0000", 2024-09-12T00:04:10.720 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012407299999999999 2024-09-12T00:04:10.720 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.720 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.720 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.720 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171367+0000", 2024-09-12T00:04:10.721 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8413000000000001e-05 2024-09-12T00:04:10.721 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.721 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.721 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.721 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171376+0000", 2024-09-12T00:04:10.721 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8170000000000005e-06 2024-09-12T00:04:10.721 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.721 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.721 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.721 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177692+0000", 2024-09-12T00:04:10.721 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063156729999999999 2024-09-12T00:04:10.721 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.721 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.721 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.722 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177817+0000", 2024-09-12T00:04:10.722 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012581499999999999 2024-09-12T00:04:10.722 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.722 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.722 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.722 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.178015+0000", 2024-09-12T00:04:10.722 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019715100000000001 2024-09-12T00:04:10.722 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.722 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.722 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.722 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181798+0000", 2024-09-12T00:04:10.722 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003783308 2024-09-12T00:04:10.722 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.722 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.723 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.723 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190976+0000", 2024-09-12T00:04:10.723 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091776519999999997 2024-09-12T00:04:10.723 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.723 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.723 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.723 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191122+0000", 2024-09-12T00:04:10.723 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000145966 2024-09-12T00:04:10.723 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.723 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.723 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.723 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191226+0000", 2024-09-12T00:04:10.723 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104162 2024-09-12T00:04:10.723 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.724 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.724 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.724 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.724 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.724 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:10.724 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:10.724 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.471957201000002, 2024-09-12T00:04:10.724 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019997773, 2024-09-12T00:04:10.724 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.724 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.724 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.724 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.724 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:10.724 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:10.725 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 70 2024-09-12T00:04:10.725 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.725 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.725 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.725 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.725 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:10.725 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.725 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.725 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.725 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.725 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:10.725 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.725 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.725 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.726 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.726 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:10.726 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3699999999999999e-07 2024-09-12T00:04:10.726 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.726 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.726 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.726 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171403+0000", 2024-09-12T00:04:10.726 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6199999999999994e-06 2024-09-12T00:04:10.726 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.726 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.726 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.726 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171416+0000", 2024-09-12T00:04:10.726 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2636000000000001e-05 2024-09-12T00:04:10.726 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171423+0000", 2024-09-12T00:04:10.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5440000000000001e-06 2024-09-12T00:04:10.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179458+0000", 2024-09-12T00:04:10.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080351989999999998 2024-09-12T00:04:10.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179604+0000", 2024-09-12T00:04:10.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014519899999999999 2024-09-12T00:04:10.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.728 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.728 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179831+0000", 2024-09-12T00:04:10.728 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022704800000000001 2024-09-12T00:04:10.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.728 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.728 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181918+0000", 2024-09-12T00:04:10.728 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020873950000000001 2024-09-12T00:04:10.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.728 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.729 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191243+0000", 2024-09-12T00:04:10.729 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0093244729999999998 2024-09-12T00:04:10.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.729 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.729 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.729 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191309+0000", 2024-09-12T00:04:10.729 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6116000000000002e-05 2024-09-12T00:04:10.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.729 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.729 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.729 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191390+0000", 2024-09-12T00:04:10.729 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1705999999999993e-05 2024-09-12T00:04:10.729 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.729 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.730 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.730 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.730 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.730 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:10.730 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:10.730 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.471911128000002, 2024-09-12T00:04:10.730 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020263554, 2024-09-12T00:04:10.730 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.730 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.730 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.730 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.730 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:10.730 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:10.730 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 71 2024-09-12T00:04:10.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.731 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.731 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.731 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.731 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:10.731 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.731 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.731 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.731 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:10.731 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.731 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.732 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:10.732 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5000000000000002e-07 2024-09-12T00:04:10.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.732 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171454+0000", 2024-09-12T00:04:10.732 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5046e-05 2024-09-12T00:04:10.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.732 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171471+0000", 2024-09-12T00:04:10.733 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6923999999999999e-05 2024-09-12T00:04:10.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.733 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.733 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171487+0000", 2024-09-12T00:04:10.733 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5823000000000001e-05 2024-09-12T00:04:10.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.733 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.733 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180765+0000", 2024-09-12T00:04:10.733 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0092774399999999996 2024-09-12T00:04:10.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.733 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.734 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180900+0000", 2024-09-12T00:04:10.734 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013556700000000001 2024-09-12T00:04:10.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.734 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.734 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.734 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181108+0000", 2024-09-12T00:04:10.734 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020727899999999999 2024-09-12T00:04:10.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.734 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.734 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.734 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184725+0000", 2024-09-12T00:04:10.734 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036171340000000001 2024-09-12T00:04:10.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191413+0000", 2024-09-12T00:04:10.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066881830000000003 2024-09-12T00:04:10.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191540+0000", 2024-09-12T00:04:10.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000126823 2024-09-12T00:04:10.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191702+0000", 2024-09-12T00:04:10.736 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162585 2024-09-12T00:04:10.736 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.736 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.736 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.736 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:10.736 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:10.736 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.471832552000002, 2024-09-12T00:04:10.736 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020448573000000001, 2024-09-12T00:04:10.736 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.736 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.737 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.737 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.737 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:10.737 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:10.737 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 72 2024-09-12T00:04:10.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.737 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.737 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.737 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:10.737 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.737 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:10.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.738 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171518+0000", 2024-09-12T00:04:10.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0440000000000001e-06 2024-09-12T00:04:10.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.738 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171647+0000", 2024-09-12T00:04:10.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012912899999999999 2024-09-12T00:04:10.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.739 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171664+0000", 2024-09-12T00:04:10.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6079999999999999e-05 2024-09-12T00:04:10.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.739 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171675+0000", 2024-09-12T00:04:10.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1223000000000001e-05 2024-09-12T00:04:10.740 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.740 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.740 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.740 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182000+0000", 2024-09-12T00:04:10.740 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010324949 2024-09-12T00:04:10.740 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.740 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.740 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.740 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182178+0000", 2024-09-12T00:04:10.740 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017808799999999999 2024-09-12T00:04:10.740 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.740 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.740 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182402+0000", 2024-09-12T00:04:10.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022381199999999999 2024-09-12T00:04:10.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190935+0000", 2024-09-12T00:04:10.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085331560000000001 2024-09-12T00:04:10.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191728+0000", 2024-09-12T00:04:10.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079325700000000001 2024-09-12T00:04:10.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191864+0000", 2024-09-12T00:04:10.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013606299999999999 2024-09-12T00:04:10.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191966+0000", 2024-09-12T00:04:10.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101772 2024-09-12T00:04:10.742 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.742 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.742 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.743 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:10.743 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:10.743 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.471649356999997, 2024-09-12T00:04:10.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020675235, 2024-09-12T00:04:10.743 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.743 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.743 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.743 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.743 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:10.743 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:10.743 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 73 2024-09-12T00:04:10.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.744 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.744 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.744 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:10.744 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.744 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.744 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:10.744 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.744 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.745 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171701+0000", 2024-09-12T00:04:10.745 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0999999999999997e-07 2024-09-12T00:04:10.745 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.745 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.745 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.745 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171709+0000", 2024-09-12T00:04:10.745 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2540000000000003e-06 2024-09-12T00:04:10.745 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.745 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.745 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.745 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171724+0000", 2024-09-12T00:04:10.745 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5569e-05 2024-09-12T00:04:10.745 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.746 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.746 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.746 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171734+0000", 2024-09-12T00:04:10.746 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6139999999999998e-06 2024-09-12T00:04:10.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.746 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.746 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.746 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183774+0000", 2024-09-12T00:04:10.746 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012040444000000001 2024-09-12T00:04:10.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.746 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.746 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.746 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183896+0000", 2024-09-12T00:04:10.746 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012204199999999999 2024-09-12T00:04:10.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184084+0000", 2024-09-12T00:04:10.747 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018792599999999999 2024-09-12T00:04:10.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191984+0000", 2024-09-12T00:04:10.747 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079003790000000008 2024-09-12T00:04:10.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192093+0000", 2024-09-12T00:04:10.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000108942 2024-09-12T00:04:10.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.748 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192250+0000", 2024-09-12T00:04:10.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015637600000000001 2024-09-12T00:04:10.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.748 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192376+0000", 2024-09-12T00:04:10.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012587899999999999 2024-09-12T00:04:10.748 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.748 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.749 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.749 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.749 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:10.749 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:10.749 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.471601147000001, 2024-09-12T00:04:10.749 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021088828, 2024-09-12T00:04:10.749 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.749 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.749 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.749 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.749 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:10.749 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:10.749 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 74 2024-09-12T00:04:10.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.750 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.750 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.750 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:10.750 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.750 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.750 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:10.750 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.750 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.751 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:10.751 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1699999999999997e-07 2024-09-12T00:04:10.751 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.751 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.751 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.751 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171758+0000", 2024-09-12T00:04:10.751 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0860000000000008e-06 2024-09-12T00:04:10.751 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.751 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.751 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.751 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171774+0000", 2024-09-12T00:04:10.751 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:04:10.751 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.751 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.752 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.752 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171788+0000", 2024-09-12T00:04:10.752 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4793999999999999e-05 2024-09-12T00:04:10.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.752 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.752 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.752 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184842+0000", 2024-09-12T00:04:10.752 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013053607 2024-09-12T00:04:10.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.752 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.752 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.752 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185130+0000", 2024-09-12T00:04:10.752 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00028779199999999998 2024-09-12T00:04:10.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185378+0000", 2024-09-12T00:04:10.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024780100000000002 2024-09-12T00:04:10.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192513+0000", 2024-09-12T00:04:10.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071350770000000001 2024-09-12T00:04:10.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192690+0000", 2024-09-12T00:04:10.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000176892 2024-09-12T00:04:10.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.754 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192769+0000", 2024-09-12T00:04:10.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9466000000000001e-05 2024-09-12T00:04:10.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.754 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192837+0000", 2024-09-12T00:04:10.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8466000000000005e-05 2024-09-12T00:04:10.754 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.754 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.754 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.755 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.755 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:10.755 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:10.755 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.471548570000003, 2024-09-12T00:04:10.755 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.02121994, 2024-09-12T00:04:10.755 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.755 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.755 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.755 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.755 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:10.755 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:10.755 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 75 2024-09-12T00:04:10.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.756 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.756 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.756 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.756 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:10.756 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.756 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.756 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.756 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.756 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:10.756 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.756 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.756 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.756 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.756 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171802+0000", 2024-09-12T00:04:10.757 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5000000000000002e-07 2024-09-12T00:04:10.757 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.757 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.757 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.757 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171954+0000", 2024-09-12T00:04:10.757 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015215500000000001 2024-09-12T00:04:10.757 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.757 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.757 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.757 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171966+0000", 2024-09-12T00:04:10.757 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1548e-05 2024-09-12T00:04:10.757 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.757 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.758 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.758 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171970+0000", 2024-09-12T00:04:10.758 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8729999999999998e-06 2024-09-12T00:04:10.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.758 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.758 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.758 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186552+0000", 2024-09-12T00:04:10.758 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014581775 2024-09-12T00:04:10.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.758 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.758 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.758 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186702+0000", 2024-09-12T00:04:10.758 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014946 2024-09-12T00:04:10.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.759 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.759 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.759 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186897+0000", 2024-09-12T00:04:10.759 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000195071 2024-09-12T00:04:10.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.759 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.759 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.759 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192666+0000", 2024-09-12T00:04:10.759 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057693470000000002 2024-09-12T00:04:10.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.759 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.759 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.759 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192857+0000", 2024-09-12T00:04:10.759 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191149 2024-09-12T00:04:10.760 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.760 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.760 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.760 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192967+0000", 2024-09-12T00:04:10.760 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110202 2024-09-12T00:04:10.760 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.760 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.760 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.760 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193021+0000", 2024-09-12T00:04:10.760 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3709999999999999e-05 2024-09-12T00:04:10.760 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.760 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.760 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.761 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.761 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:10.761 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:10.761 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.471369275000001, 2024-09-12T00:04:10.761 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026297425999999999, 2024-09-12T00:04:10.761 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:10.761 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:10.761 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:10.761 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:10.761 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:10.761 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:10.761 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 76 2024-09-12T00:04:10.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.762 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:10.762 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.762 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:10.762 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:10.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.762 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.762 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:10.762 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:10.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:10.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.762 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.762 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:10.762 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:10.763 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9399999999999995e-07 2024-09-12T00:04:10.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.763 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:10.763 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171987+0000", 2024-09-12T00:04:10.763 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5230000000000003e-06 2024-09-12T00:04:10.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.763 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:10.763 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172005+0000", 2024-09-12T00:04:10.763 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8788e-05 2024-09-12T00:04:10.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.763 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:10.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172010+0000", 2024-09-12T00:04:10.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7570000000000004e-06 2024-09-12T00:04:10.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.764 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:10.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193104+0000", 2024-09-12T00:04:10.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021094112000000002 2024-09-12T00:04:10.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.764 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:10.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193334+0000", 2024-09-12T00:04:10.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000229855 2024-09-12T00:04:10.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.765 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:10.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193697+0000", 2024-09-12T00:04:10.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00036272399999999998 2024-09-12T00:04:10.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.765 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:10.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.195602+0000", 2024-09-12T00:04:10.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019049620000000001 2024-09-12T00:04:10.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.765 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:10.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198123+0000", 2024-09-12T00:04:10.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025216520000000001 2024-09-12T00:04:10.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.766 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:10.766 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198213+0000", 2024-09-12T00:04:10.766 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0008999999999998e-05 2024-09-12T00:04:10.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:10.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:10.766 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:10.766 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198278+0000", 2024-09-12T00:04:10.766 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4549999999999997e-05 2024-09-12T00:04:10.766 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.766 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.766 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.767 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:10.767 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:10.767 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:10.768 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:04:10.769 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:10.767+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:10.869 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:10.871+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:10.883 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:04:10.970 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:10.969+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:10.981 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:10.981 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:10.981 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:10.981 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:11.001 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:04:11.085 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:11.085 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:11.085 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:11.081+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:11.117 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:11.118 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:11.148 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:11.148 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:11.173 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:11.175+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:11.178 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:11.179 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:11.211 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:11.212 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:11.213 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:11.213 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:11.231 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:04:11.245 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:11.245 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:11.279 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:11.280 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:11.280 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:11.277+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:11.313 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:11.313 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:11.375 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:11.375+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:11.416 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:11.416 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:11.433 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:04:11.477 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:11.477+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:11.577 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:11.577+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:11.609 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:11.609 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:11.626 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:04:11.678 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:11.679+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:11.779 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:11.779+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:11.838 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:11.838 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:11.855 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:04:11.880 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:11.879+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:11.981 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:11.983+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:12.025 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:12.025 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:12.042 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:04:12.082 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:12.081+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:12.175 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:12.175 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:12.183 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:12.183+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:12.189 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:04:12.285 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:12.287+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:12.356 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:12.356 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:12.370 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:04:12.413 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:12.415+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:12.486 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:12.485+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:12.537 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:12.537 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:12.551 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:04:12.597 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:12.599+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:12.601 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T00:04:12.602 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T00:04:12.632 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:04:12.676 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:12.676 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:12.687 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:12.687+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:12.690 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:04:12.788 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:12.785+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:12.864 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:12.864 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:12.878 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:04:12.925 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:12.927+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:12.990 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:12.989+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:13.002 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:13.003 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:13.017 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:04:13.090 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:13.089+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:13.182 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:13.182 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:13.191 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:13.189+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:13.196 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:04:13.292 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:13.291+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:13.320 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:13.320 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:13.335 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:04:13.336 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:04:13.421 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:13.423+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:13.494 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:13.495+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:13.502 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:13.502 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:13.517 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:04:13.535 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:13.535 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:13.566 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:13.566 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:13.597 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:13.597 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:13.605 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:13.607+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:13.613 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T00:04:13.614 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T00:04:13.628 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:13.628 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:13.644 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T00:04:13.661 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:13.662 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:13.689 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:13.690 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:13.695 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:13.696 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:13.696 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:13.693+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:13.704 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:04:13.727 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:13.728 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:13.759 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:13.759 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:13.797 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:13.799+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:13.868 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:13.869 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:04:13.869 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:04:13.870 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:04:13.870 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:13.883 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:04:13.897 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:13.897+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:13.998 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:13.999+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:14.057 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:14.058 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:04:14.058 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:04:14.058 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:04:14.058 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.058 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:14.058 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:04:14.058 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 42.567106973000001, 2024-09-12T00:04:14.058 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0032495720000000001, 2024-09-12T00:04:14.058 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:14.058 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:14.058 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.058 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:14.059 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:14.059 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.059 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 193 2024-09-12T00:04:14.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.059 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:14.059 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.059 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:14.059 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:04:14.059 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.059 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.059 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:14.059 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:04:14.059 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:14.060 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486926+0000", 2024-09-12T00:04:14.060 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.463e-06 2024-09-12T00:04:14.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:14.060 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486937+0000", 2024-09-12T00:04:14.060 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1147e-05 2024-09-12T00:04:14.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:14.060 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486968+0000", 2024-09-12T00:04:14.061 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1077000000000001e-05 2024-09-12T00:04:14.061 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.061 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.061 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.061 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486985+0000", 2024-09-12T00:04:14.061 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6399e-05 2024-09-12T00:04:14.061 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.061 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.061 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:14.061 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487139+0000", 2024-09-12T00:04:14.061 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015403199999999999 2024-09-12T00:04:14.061 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.061 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.061 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:14.062 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487375+0000", 2024-09-12T00:04:14.062 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023621499999999999 2024-09-12T00:04:14.062 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.062 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.062 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:14.062 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487634+0000", 2024-09-12T00:04:14.062 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000259351 2024-09-12T00:04:14.062 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.062 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.062 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:14.062 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.489156+0000", 2024-09-12T00:04:14.062 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015213869999999999 2024-09-12T00:04:14.062 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.062 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.063 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.063 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.489974+0000", 2024-09-12T00:04:14.063 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00081855600000000001 2024-09-12T00:04:14.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.063 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.063 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:14.063 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.490064+0000", 2024-09-12T00:04:14.063 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9205999999999999e-05 2024-09-12T00:04:14.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.063 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.063 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:14.063 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.490173+0000", 2024-09-12T00:04:14.063 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109739 2024-09-12T00:04:14.063 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.064 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:14.064 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.064 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.064 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.064 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:04:14.064 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:04:14.064 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 39.690667429999998, 2024-09-12T00:04:14.064 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039523630000000004, 2024-09-12T00:04:14.064 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:14.064 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:14.064 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.064 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:14.064 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:14.064 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.065 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 208 2024-09-12T00:04:14.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.065 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:14.065 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.065 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:14.065 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:04:14.065 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.065 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.065 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:14.065 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:04:14.065 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.065 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.066 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:14.066 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363366+0000", 2024-09-12T00:04:14.066 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.004e-06 2024-09-12T00:04:14.066 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.066 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.066 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:14.066 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363379+0000", 2024-09-12T00:04:14.066 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2943e-05 2024-09-12T00:04:14.066 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.066 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.066 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:14.066 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363412+0000", 2024-09-12T00:04:14.066 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2808999999999997e-05 2024-09-12T00:04:14.066 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.066 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.067 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.067 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363430+0000", 2024-09-12T00:04:14.067 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8003e-05 2024-09-12T00:04:14.067 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.067 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.067 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:14.067 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363654+0000", 2024-09-12T00:04:14.067 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022394900000000001 2024-09-12T00:04:14.067 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.067 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.067 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:14.067 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363897+0000", 2024-09-12T00:04:14.067 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024272399999999999 2024-09-12T00:04:14.067 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.068 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.068 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:14.068 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.364326+0000", 2024-09-12T00:04:14.068 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042963399999999997 2024-09-12T00:04:14.068 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.068 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.068 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:14.068 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.365757+0000", 2024-09-12T00:04:14.068 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014303969999999999 2024-09-12T00:04:14.068 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.068 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.068 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.068 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367031+0000", 2024-09-12T00:04:14.069 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001274269 2024-09-12T00:04:14.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.069 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.069 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:14.069 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367197+0000", 2024-09-12T00:04:14.069 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016645900000000001 2024-09-12T00:04:14.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.069 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.069 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:14.069 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367316+0000", 2024-09-12T00:04:14.070 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011817200000000001 2024-09-12T00:04:14.070 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.070 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:14.070 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.070 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.070 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.070 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.070 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:04:14.070 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 39.633409125999997, 2024-09-12T00:04:14.070 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033190419999999999, 2024-09-12T00:04:14.070 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:14.070 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:14.070 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.071 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:14.071 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:14.071 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.071 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 219 2024-09-12T00:04:14.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.071 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:14.071 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.071 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:14.071 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:04:14.071 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.071 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.072 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:14.072 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:04:14.072 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.072 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.072 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.072 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:14.072 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420624+0000", 2024-09-12T00:04:14.072 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0829999999999998e-06 2024-09-12T00:04:14.072 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.072 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.072 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:14.073 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420633+0000", 2024-09-12T00:04:14.073 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8500000000000006e-06 2024-09-12T00:04:14.073 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.073 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.073 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:14.073 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420663+0000", 2024-09-12T00:04:14.073 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9597000000000001e-05 2024-09-12T00:04:14.073 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.073 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.073 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.073 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420681+0000", 2024-09-12T00:04:14.073 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7646e-05 2024-09-12T00:04:14.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.074 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.074 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:14.074 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420791+0000", 2024-09-12T00:04:14.074 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109979 2024-09-12T00:04:14.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.074 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.074 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:14.074 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.421042+0000", 2024-09-12T00:04:14.074 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025117199999999997 2024-09-12T00:04:14.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.074 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.075 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:14.075 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.421487+0000", 2024-09-12T00:04:14.075 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00044476599999999998 2024-09-12T00:04:14.075 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.075 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.075 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:14.075 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.422884+0000", 2024-09-12T00:04:14.075 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0013975109999999999 2024-09-12T00:04:14.075 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.075 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.075 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.075 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423797+0000", 2024-09-12T00:04:14.076 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00091310899999999995 2024-09-12T00:04:14.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.076 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.076 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:14.076 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423879+0000", 2024-09-12T00:04:14.076 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1829000000000005e-05 2024-09-12T00:04:14.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.076 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.076 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:14.076 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423941+0000", 2024-09-12T00:04:14.076 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1500000000000004e-05 2024-09-12T00:04:14.077 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.077 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:14.077 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.077 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.077 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.077 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:04:14.077 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 39.615768527, 2024-09-12T00:04:14.077 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003232782, 2024-09-12T00:04:14.077 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:14.077 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:14.078 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.078 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:14.078 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:14.078 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.078 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 224 2024-09-12T00:04:14.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.078 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:14.078 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.078 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:14.078 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:04:14.078 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.079 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.079 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.079 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:14.079 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:04:14.079 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.079 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.079 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.079 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:14.079 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438265+0000", 2024-09-12T00:04:14.079 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.666e-06 2024-09-12T00:04:14.079 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.079 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.080 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:14.080 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438276+0000", 2024-09-12T00:04:14.080 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1387e-05 2024-09-12T00:04:14.080 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.080 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.080 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:14.080 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438306+0000", 2024-09-12T00:04:14.080 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0069999999999998e-05 2024-09-12T00:04:14.080 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.080 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.080 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.081 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438321+0000", 2024-09-12T00:04:14.081 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.517e-05 2024-09-12T00:04:14.081 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.081 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.081 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:14.081 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438459+0000", 2024-09-12T00:04:14.081 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013781899999999999 2024-09-12T00:04:14.081 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.081 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.081 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:14.081 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438671+0000", 2024-09-12T00:04:14.081 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021214500000000001 2024-09-12T00:04:14.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.082 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.082 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:14.082 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.439093+0000", 2024-09-12T00:04:14.082 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042117899999999999 2024-09-12T00:04:14.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.082 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.082 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:14.082 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.440400+0000", 2024-09-12T00:04:14.082 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0013072719999999999 2024-09-12T00:04:14.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.082 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.083 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.083 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441339+0000", 2024-09-12T00:04:14.083 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00093906600000000001 2024-09-12T00:04:14.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.083 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.083 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:14.083 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441429+0000", 2024-09-12T00:04:14.083 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0358999999999993e-05 2024-09-12T00:04:14.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.083 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.083 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:14.084 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441495+0000", 2024-09-12T00:04:14.084 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5648999999999994e-05 2024-09-12T00:04:14.084 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.084 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:14.084 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.084 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.084 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.084 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:04:14.084 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 39.576269555000003, 2024-09-12T00:04:14.084 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003225716, 2024-09-12T00:04:14.084 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:14.085 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:14.085 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.085 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:14.085 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:14.085 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.085 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 235 2024-09-12T00:04:14.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.085 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:14.085 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.085 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:14.085 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:04:14.085 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.086 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.086 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:14.086 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:04:14.086 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.086 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.086 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:14.086 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477764+0000", 2024-09-12T00:04:14.086 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.48e-06 2024-09-12T00:04:14.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.087 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.087 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:14.087 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477775+0000", 2024-09-12T00:04:14.087 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1163e-05 2024-09-12T00:04:14.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.087 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.087 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:14.087 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477807+0000", 2024-09-12T00:04:14.087 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1860000000000003e-05 2024-09-12T00:04:14.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.087 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.087 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.087 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477822+0000", 2024-09-12T00:04:14.087 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5302999999999999e-05 2024-09-12T00:04:14.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.088 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.088 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:14.088 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477959+0000", 2024-09-12T00:04:14.088 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013695600000000001 2024-09-12T00:04:14.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.088 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.088 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:14.088 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.478184+0000", 2024-09-12T00:04:14.088 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022484800000000001 2024-09-12T00:04:14.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.088 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.088 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:14.089 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.478657+0000", 2024-09-12T00:04:14.089 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000473413 2024-09-12T00:04:14.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.089 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.089 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:14.089 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480162+0000", 2024-09-12T00:04:14.089 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00150454 2024-09-12T00:04:14.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.089 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.089 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.089 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480792+0000", 2024-09-12T00:04:14.089 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00063012400000000003 2024-09-12T00:04:14.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.089 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.090 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:14.090 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480906+0000", 2024-09-12T00:04:14.090 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113909 2024-09-12T00:04:14.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.090 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.090 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:14.090 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480987+0000", 2024-09-12T00:04:14.090 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1119999999999996e-05 2024-09-12T00:04:14.090 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.090 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:14.090 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.090 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.091 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:237 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.091 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:04:14.091 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 39.568948184, 2024-09-12T00:04:14.091 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0074291790000000002, 2024-09-12T00:04:14.091 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:14.091 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:14.091 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.091 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:14.091 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:14.091 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.091 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 237 2024-09-12T00:04:14.091 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.091 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:14.091 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.091 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:14.092 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:04:14.092 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.092 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.092 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.092 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:14.092 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:04:14.092 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.092 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.092 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.092 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:14.092 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485086+0000", 2024-09-12T00:04:14.092 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.05e-06 2024-09-12T00:04:14.092 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.092 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.093 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:14.093 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485101+0000", 2024-09-12T00:04:14.093 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5186e-05 2024-09-12T00:04:14.093 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.093 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.093 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:14.093 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485140+0000", 2024-09-12T00:04:14.093 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8896000000000002e-05 2024-09-12T00:04:14.093 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.093 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.093 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.093 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485162+0000", 2024-09-12T00:04:14.093 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2654e-05 2024-09-12T00:04:14.093 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.094 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.094 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:14.094 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485314+0000", 2024-09-12T00:04:14.094 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015150799999999999 2024-09-12T00:04:14.094 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.094 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.094 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:14.094 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485549+0000", 2024-09-12T00:04:14.094 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000235665 2024-09-12T00:04:14.094 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.094 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.094 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:14.094 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486064+0000", 2024-09-12T00:04:14.094 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00051418899999999997 2024-09-12T00:04:14.094 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.095 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.095 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:14.095 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.488211+0000", 2024-09-12T00:04:14.095 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0021470819999999998 2024-09-12T00:04:14.095 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.095 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.095 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.095 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492273+0000", 2024-09-12T00:04:14.095 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040617980000000001 2024-09-12T00:04:14.095 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.095 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.095 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:14.095 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492391+0000", 2024-09-12T00:04:14.095 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118613 2024-09-12T00:04:14.096 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.096 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.096 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:14.096 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492512+0000", 2024-09-12T00:04:14.096 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120538 2024-09-12T00:04:14.096 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.096 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:14.096 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.096 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.096 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.096 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:244 6.17 e35/29 6:e9187ab8:reshard::reshard.0000000000:head v 35'1, mlcod=0'0)", 2024-09-12T00:04:14.096 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:04:14.096 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 39.566365949000001, 2024-09-12T00:04:14.096 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0034313239999999999, 2024-09-12T00:04:14.096 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:14.097 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:14.097 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.097 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:14.097 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.097 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:14.097 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:04:14.097 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.097 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.097 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.097 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:14.097 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:04:14.097 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.097 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.097 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.098 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:14.098 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487667+0000", 2024-09-12T00:04:14.098 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4899999999999999e-06 2024-09-12T00:04:14.098 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.098 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.098 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:14.098 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487682+0000", 2024-09-12T00:04:14.098 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4929999999999999e-05 2024-09-12T00:04:14.098 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.098 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.098 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:14.098 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487740+0000", 2024-09-12T00:04:14.098 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8075000000000002e-05 2024-09-12T00:04:14.098 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.099 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.099 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.099 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487761+0000", 2024-09-12T00:04:14.099 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0769999999999999e-05 2024-09-12T00:04:14.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.099 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.099 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:14.099 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487966+0000", 2024-09-12T00:04:14.099 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020516800000000001 2024-09-12T00:04:14.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.099 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.099 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:14.099 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.488012+0000", 2024-09-12T00:04:14.099 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5794000000000002e-05 2024-09-12T00:04:14.100 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.100 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.100 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:14.100 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.490965+0000", 2024-09-12T00:04:14.100 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0029530609999999999 2024-09-12T00:04:14.100 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.100 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.100 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:14.100 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491096+0000", 2024-09-12T00:04:14.100 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013103600000000001 2024-09-12T00:04:14.100 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.100 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:14.100 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.100 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.100 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.101 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:293 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.101 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:04:14.101 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 39.556414128, 2024-09-12T00:04:14.101 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0075915649999999998, 2024-09-12T00:04:14.101 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:14.101 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:14.101 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.101 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:14.101 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:14.101 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.101 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 293 2024-09-12T00:04:14.101 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.101 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:14.102 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.102 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:14.102 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:04:14.102 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.102 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.102 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:14.102 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:04:14.102 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.102 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.102 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:14.103 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497626+0000", 2024-09-12T00:04:14.103 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2499999999999995e-06 2024-09-12T00:04:14.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.103 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.103 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:14.103 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497636+0000", 2024-09-12T00:04:14.103 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0139999999999999e-05 2024-09-12T00:04:14.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.103 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.103 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:14.103 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497660+0000", 2024-09-12T00:04:14.103 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4015999999999998e-05 2024-09-12T00:04:14.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.104 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.104 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.104 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497675+0000", 2024-09-12T00:04:14.104 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5339999999999999e-05 2024-09-12T00:04:14.104 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.104 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.104 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:14.104 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497839+0000", 2024-09-12T00:04:14.104 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016347900000000001 2024-09-12T00:04:14.104 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.104 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.105 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:14.105 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498097+0000", 2024-09-12T00:04:14.105 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025825700000000002 2024-09-12T00:04:14.105 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.105 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.105 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:14.105 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498618+0000", 2024-09-12T00:04:14.105 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052051300000000001 2024-09-12T00:04:14.105 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.105 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.105 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:14.105 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.501282+0000", 2024-09-12T00:04:14.106 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026646840000000001 2024-09-12T00:04:14.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.106 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.106 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.106 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505057+0000", 2024-09-12T00:04:14.106 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037747710000000001 2024-09-12T00:04:14.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.106 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.106 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:14.106 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505144+0000", 2024-09-12T00:04:14.106 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7466000000000006e-05 2024-09-12T00:04:14.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.107 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.107 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:14.107 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505208+0000", 2024-09-12T00:04:14.107 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3649e-05 2024-09-12T00:04:14.107 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.107 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:14.107 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.107 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.107 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.107 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:413 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.107 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:04:14.108 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 39.525374515999999, 2024-09-12T00:04:14.108 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005252049, 2024-09-12T00:04:14.108 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:14.108 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:14.108 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.108 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:14.108 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:14.108 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.108 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 413 2024-09-12T00:04:14.108 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.108 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:14.108 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.109 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:14.109 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:04:14.109 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.109 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.109 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.109 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:14.109 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:04:14.109 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.109 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.109 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.109 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:14.109 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528659+0000", 2024-09-12T00:04:14.110 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4739999999999999e-06 2024-09-12T00:04:14.110 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.110 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.110 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:14.110 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528669+0000", 2024-09-12T00:04:14.110 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0694e-05 2024-09-12T00:04:14.110 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.110 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.110 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:14.110 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528696+0000", 2024-09-12T00:04:14.110 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6846e-05 2024-09-12T00:04:14.110 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.111 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.111 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.111 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528711+0000", 2024-09-12T00:04:14.111 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4397e-05 2024-09-12T00:04:14.111 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.111 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.111 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:14.111 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528884+0000", 2024-09-12T00:04:14.111 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017304700000000001 2024-09-12T00:04:14.111 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.111 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.111 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:14.112 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529162+0000", 2024-09-12T00:04:14.112 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027861999999999999 2024-09-12T00:04:14.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.112 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.112 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:14.112 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529688+0000", 2024-09-12T00:04:14.112 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052593900000000001 2024-09-12T00:04:14.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.112 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.112 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:14.112 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.531480+0000", 2024-09-12T00:04:14.113 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0017920740000000001 2024-09-12T00:04:14.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.113 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.113 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.113 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533734+0000", 2024-09-12T00:04:14.113 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002254191 2024-09-12T00:04:14.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.113 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.113 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:14.113 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533845+0000", 2024-09-12T00:04:14.113 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110559 2024-09-12T00:04:14.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.114 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.114 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:14.114 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533908+0000", 2024-09-12T00:04:14.114 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3207999999999995e-05 2024-09-12T00:04:14.114 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.114 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:14.114 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.114 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.114 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.114 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:437 6.0 6:05588ce8:lc::lc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.114 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:04:14.114 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 39.518199027000001, 2024-09-12T00:04:14.115 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039419659999999999, 2024-09-12T00:04:14.115 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:14.115 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:14.115 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.115 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:14.115 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:14.115 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.115 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 437 2024-09-12T00:04:14.115 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.115 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:14.115 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.115 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:14.116 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:04:14.116 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.116 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.116 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.116 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:14.116 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:04:14.116 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.116 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.116 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.116 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:14.116 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535834+0000", 2024-09-12T00:04:14.116 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2859999999999998e-06 2024-09-12T00:04:14.116 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.117 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.117 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:14.117 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535846+0000", 2024-09-12T00:04:14.117 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1643e-05 2024-09-12T00:04:14.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.117 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.117 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:14.117 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535877+0000", 2024-09-12T00:04:14.117 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1457000000000001e-05 2024-09-12T00:04:14.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.117 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.117 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.117 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535894+0000", 2024-09-12T00:04:14.118 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.668e-05 2024-09-12T00:04:14.118 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.118 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.118 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:14.118 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535981+0000", 2024-09-12T00:04:14.118 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6823000000000005e-05 2024-09-12T00:04:14.118 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.118 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.118 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:14.118 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536086+0000", 2024-09-12T00:04:14.118 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010566200000000001 2024-09-12T00:04:14.118 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.119 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.119 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:14.119 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536330+0000", 2024-09-12T00:04:14.119 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024399999999999999 2024-09-12T00:04:14.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.119 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.119 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:14.119 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538288+0000", 2024-09-12T00:04:14.119 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0019575740000000001 2024-09-12T00:04:14.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.119 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.119 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.119 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539574+0000", 2024-09-12T00:04:14.120 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012862259999999999 2024-09-12T00:04:14.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.120 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.120 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:14.120 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539696+0000", 2024-09-12T00:04:14.120 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012190599999999999 2024-09-12T00:04:14.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.120 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.120 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:14.120 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539774+0000", 2024-09-12T00:04:14.120 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7708999999999997e-05 2024-09-12T00:04:14.120 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.120 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:14.120 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.121 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.121 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:464 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.121 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:04:14.121 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 39.509638045000003, 2024-09-12T00:04:14.121 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048192310000000002, 2024-09-12T00:04:14.121 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:14.121 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:14.121 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.121 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:14.121 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:14.121 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.121 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 464 2024-09-12T00:04:14.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.122 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:14.122 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.122 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:14.122 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:04:14.122 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.122 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.122 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:14.122 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:04:14.122 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.122 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.122 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:14.122 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544395+0000", 2024-09-12T00:04:14.122 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.905e-06 2024-09-12T00:04:14.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.123 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:14.123 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544405+0000", 2024-09-12T00:04:14.123 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0583e-05 2024-09-12T00:04:14.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.123 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:14.123 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544435+0000", 2024-09-12T00:04:14.123 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9431e-05 2024-09-12T00:04:14.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.123 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.123 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544468+0000", 2024-09-12T00:04:14.124 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2978999999999997e-05 2024-09-12T00:04:14.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.124 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.124 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:14.124 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544573+0000", 2024-09-12T00:04:14.124 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105165 2024-09-12T00:04:14.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.124 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.124 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:14.124 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544714+0000", 2024-09-12T00:04:14.124 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000141061 2024-09-12T00:04:14.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.124 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.124 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:14.125 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.545414+0000", 2024-09-12T00:04:14.125 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00070066200000000001 2024-09-12T00:04:14.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.125 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.125 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:14.125 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.547475+0000", 2024-09-12T00:04:14.125 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020609119999999998 2024-09-12T00:04:14.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.125 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.125 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.125 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549067+0000", 2024-09-12T00:04:14.125 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015914989999999999 2024-09-12T00:04:14.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.125 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.126 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:14.126 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549143+0000", 2024-09-12T00:04:14.126 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5795000000000002e-05 2024-09-12T00:04:14.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.126 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.126 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:14.126 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549212+0000", 2024-09-12T00:04:14.126 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9239000000000006e-05 2024-09-12T00:04:14.126 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.126 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:14.126 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.126 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.126 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:495 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.127 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:04:14.127 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 39.498568546999998, 2024-09-12T00:04:14.127 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052520209999999999, 2024-09-12T00:04:14.127 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:14.127 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:14.127 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.127 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:14.127 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:14.127 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.127 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 495 2024-09-12T00:04:14.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.127 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:14.127 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.127 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:14.127 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:04:14.128 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.128 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.128 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:14.128 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:04:14.128 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.128 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.128 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:14.128 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555464+0000", 2024-09-12T00:04:14.128 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8870000000000001e-06 2024-09-12T00:04:14.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.128 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.128 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:14.129 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555473+0000", 2024-09-12T00:04:14.129 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2399999999999996e-06 2024-09-12T00:04:14.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.129 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.129 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:14.129 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555496+0000", 2024-09-12T00:04:14.129 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2952e-05 2024-09-12T00:04:14.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.129 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.129 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.129 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555508+0000", 2024-09-12T00:04:14.129 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1548e-05 2024-09-12T00:04:14.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.129 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.129 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:14.130 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555596+0000", 2024-09-12T00:04:14.130 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8295999999999996e-05 2024-09-12T00:04:14.130 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.130 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.130 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:14.130 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555683+0000", 2024-09-12T00:04:14.130 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7267000000000003e-05 2024-09-12T00:04:14.130 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.130 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.130 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:14.130 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555862+0000", 2024-09-12T00:04:14.130 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017910699999999999 2024-09-12T00:04:14.130 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.131 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.131 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:14.131 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.556696+0000", 2024-09-12T00:04:14.131 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000833353 2024-09-12T00:04:14.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.131 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.131 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.131 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560563+0000", 2024-09-12T00:04:14.131 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038672089999999999 2024-09-12T00:04:14.132 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.132 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.132 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:14.132 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560642+0000", 2024-09-12T00:04:14.132 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.8909e-05 2024-09-12T00:04:14.132 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.132 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.132 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:14.132 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560714+0000", 2024-09-12T00:04:14.132 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2253000000000001e-05 2024-09-12T00:04:14.132 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.133 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:14.133 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.133 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.133 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:631 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.133 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:04:14.133 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 39.462740992999997, 2024-09-12T00:04:14.133 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0072389480000000003, 2024-09-12T00:04:14.133 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:14.133 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:14.133 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.133 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:14.134 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:14.134 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.134 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 631 2024-09-12T00:04:14.134 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.134 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:14.134 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.134 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:14.134 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:04:14.134 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.134 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.134 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.134 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:14.134 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:04:14.135 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.135 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.135 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:14.135 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591292+0000", 2024-09-12T00:04:14.135 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0760000000000001e-06 2024-09-12T00:04:14.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.135 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.135 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:14.135 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591301+0000", 2024-09-12T00:04:14.135 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3880000000000006e-06 2024-09-12T00:04:14.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.136 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.136 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:14.136 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591323+0000", 2024-09-12T00:04:14.136 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2121999999999999e-05 2024-09-12T00:04:14.136 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.136 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.136 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.136 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591338+0000", 2024-09-12T00:04:14.136 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5126999999999999e-05 2024-09-12T00:04:14.136 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.136 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.137 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:14.137 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591449+0000", 2024-09-12T00:04:14.137 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011054500000000001 2024-09-12T00:04:14.137 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.137 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.137 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:14.137 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591682+0000", 2024-09-12T00:04:14.137 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023258 2024-09-12T00:04:14.137 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.137 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.137 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:14.137 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.592011+0000", 2024-09-12T00:04:14.138 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00032941699999999998 2024-09-12T00:04:14.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.138 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.138 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:14.138 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593493+0000", 2024-09-12T00:04:14.138 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014821599999999999 2024-09-12T00:04:14.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.138 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.138 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.138 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598356+0000", 2024-09-12T00:04:14.138 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048625329999999996 2024-09-12T00:04:14.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.139 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.139 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:14.139 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598456+0000", 2024-09-12T00:04:14.139 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9878999999999997e-05 2024-09-12T00:04:14.139 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.139 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.139 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:14.139 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598529+0000", 2024-09-12T00:04:14.139 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3120999999999993e-05 2024-09-12T00:04:14.139 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.139 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:14.139 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.140 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.140 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.140 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:650 6.4 6:26625e58:lc::lc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.140 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:04:14.140 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 39.454343449, 2024-09-12T00:04:14.140 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042727010000000003, 2024-09-12T00:04:14.140 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:14.140 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:14.140 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.140 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:14.140 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:14.141 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.141 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 650 2024-09-12T00:04:14.141 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.141 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:14.141 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.141 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:14.141 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:04:14.141 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.141 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.141 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.141 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:14.141 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:04:14.142 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.142 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.142 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.142 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:14.142 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599689+0000", 2024-09-12T00:04:14.142 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3179999999999999e-06 2024-09-12T00:04:14.142 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.142 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.142 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:14.142 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599696+0000", 2024-09-12T00:04:14.142 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9580000000000001e-06 2024-09-12T00:04:14.142 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.143 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.143 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:14.143 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599714+0000", 2024-09-12T00:04:14.143 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8099999999999999e-05 2024-09-12T00:04:14.143 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.143 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.143 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.143 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599724+0000", 2024-09-12T00:04:14.143 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0492999999999999e-05 2024-09-12T00:04:14.143 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.143 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.143 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:14.144 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599799+0000", 2024-09-12T00:04:14.144 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5228999999999994e-05 2024-09-12T00:04:14.144 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.144 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.144 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:14.144 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599897+0000", 2024-09-12T00:04:14.144 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7476e-05 2024-09-12T00:04:14.144 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.144 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.144 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:14.145 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.600047+0000", 2024-09-12T00:04:14.145 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015028 2024-09-12T00:04:14.145 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.145 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.145 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:14.145 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.602604+0000", 2024-09-12T00:04:14.145 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0025571729999999998 2024-09-12T00:04:14.145 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.145 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.145 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.145 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603880+0000", 2024-09-12T00:04:14.145 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012753700000000001 2024-09-12T00:04:14.146 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.146 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.146 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:14.146 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603923+0000", 2024-09-12T00:04:14.146 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3758999999999999e-05 2024-09-12T00:04:14.146 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.146 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.146 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:14.146 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603960+0000", 2024-09-12T00:04:14.146 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6545000000000003e-05 2024-09-12T00:04:14.146 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.146 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:14.147 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.147 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.147 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.147 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:744 6.0 6:0651570b:lc::lc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.147 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:04:14.147 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 39.420052020999997, 2024-09-12T00:04:14.147 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048046149999999999, 2024-09-12T00:04:14.147 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:14.147 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:14.147 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.147 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:14.147 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:14.147 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.148 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 744 2024-09-12T00:04:14.148 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.148 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:14.148 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.148 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:14.148 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:04:14.148 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.148 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.148 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.148 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:14.148 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:04:14.148 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.149 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.149 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.149 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:14.149 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633981+0000", 2024-09-12T00:04:14.149 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3740000000000001e-06 2024-09-12T00:04:14.149 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.149 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.149 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:14.149 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633991+0000", 2024-09-12T00:04:14.149 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7839999999999998e-06 2024-09-12T00:04:14.149 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.149 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.149 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:14.149 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634016+0000", 2024-09-12T00:04:14.149 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5075999999999998e-05 2024-09-12T00:04:14.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.150 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.150 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.150 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634031+0000", 2024-09-12T00:04:14.150 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5124e-05 2024-09-12T00:04:14.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.150 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.150 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:14.150 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634105+0000", 2024-09-12T00:04:14.150 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3595000000000003e-05 2024-09-12T00:04:14.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.150 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.150 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:14.150 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634183+0000", 2024-09-12T00:04:14.151 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7936999999999996e-05 2024-09-12T00:04:14.151 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.151 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.151 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:14.151 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634342+0000", 2024-09-12T00:04:14.151 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015910499999999999 2024-09-12T00:04:14.151 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.151 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.151 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:14.151 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.635262+0000", 2024-09-12T00:04:14.151 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00092051000000000003 2024-09-12T00:04:14.151 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.151 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.151 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.152 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638638+0000", 2024-09-12T00:04:14.152 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033756419999999999 2024-09-12T00:04:14.152 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.152 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.152 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:14.152 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638722+0000", 2024-09-12T00:04:14.152 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.4029000000000005e-05 2024-09-12T00:04:14.152 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.152 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.152 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:14.152 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638783+0000", 2024-09-12T00:04:14.152 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1439000000000006e-05 2024-09-12T00:04:14.152 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.152 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:14.153 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.153 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.153 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.153 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:875 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.153 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:04:14.153 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 39.370412590000001, 2024-09-12T00:04:14.153 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004522295, 2024-09-12T00:04:14.153 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:14.153 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:14.153 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.153 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:14.153 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:14.153 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.153 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 875 2024-09-12T00:04:14.154 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.154 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:14.154 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.154 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:14.154 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:04:14.154 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.154 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.154 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.154 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:14.154 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:04:14.154 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.154 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.154 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.154 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:14.154 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683623+0000", 2024-09-12T00:04:14.155 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7140000000000001e-06 2024-09-12T00:04:14.155 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.155 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.155 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:14.155 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683639+0000", 2024-09-12T00:04:14.155 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6203000000000001e-05 2024-09-12T00:04:14.155 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.155 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.155 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:14.155 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683677+0000", 2024-09-12T00:04:14.155 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8470999999999998e-05 2024-09-12T00:04:14.155 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.155 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.155 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.155 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683708+0000", 2024-09-12T00:04:14.156 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0793999999999997e-05 2024-09-12T00:04:14.156 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.156 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.156 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:14.156 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683827+0000", 2024-09-12T00:04:14.156 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011832699999999999 2024-09-12T00:04:14.156 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.156 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.156 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:14.156 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683945+0000", 2024-09-12T00:04:14.156 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118301 2024-09-12T00:04:14.156 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.156 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.156 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:14.157 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.684226+0000", 2024-09-12T00:04:14.157 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000280604 2024-09-12T00:04:14.157 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.157 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.157 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.157 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685790+0000", 2024-09-12T00:04:14.157 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001564651 2024-09-12T00:04:14.157 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.157 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.157 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:14.157 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688028+0000", 2024-09-12T00:04:14.157 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0022381129999999999 2024-09-12T00:04:14.157 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.157 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.157 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:14.158 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688093+0000", 2024-09-12T00:04:14.158 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4329e-05 2024-09-12T00:04:14.158 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.158 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.158 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:14.158 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688140+0000", 2024-09-12T00:04:14.158 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7787999999999997e-05 2024-09-12T00:04:14.158 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.158 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:14.158 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.158 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.158 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.158 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:878 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.158 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:04:14.158 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 39.368768461000002, 2024-09-12T00:04:14.159 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037933009999999998, 2024-09-12T00:04:14.159 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:14.159 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:14.159 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.159 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:14.159 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:14.159 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.159 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 878 2024-09-12T00:04:14.159 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.159 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:14.159 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.159 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:14.159 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:04:14.160 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.160 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.160 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.160 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:14.160 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:04:14.160 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.160 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.160 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.160 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:14.160 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685265+0000", 2024-09-12T00:04:14.160 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.525e-06 2024-09-12T00:04:14.160 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.160 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.161 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:14.161 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685276+0000", 2024-09-12T00:04:14.161 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.076e-05 2024-09-12T00:04:14.161 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.161 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.161 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:14.161 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685306+0000", 2024-09-12T00:04:14.161 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0803000000000003e-05 2024-09-12T00:04:14.161 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.161 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.161 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.161 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685327+0000", 2024-09-12T00:04:14.161 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1061e-05 2024-09-12T00:04:14.162 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.162 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.162 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:14.162 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685429+0000", 2024-09-12T00:04:14.162 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000102015 2024-09-12T00:04:14.162 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.162 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.162 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:14.162 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685580+0000", 2024-09-12T00:04:14.162 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000151096 2024-09-12T00:04:14.162 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.162 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.162 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:14.162 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685861+0000", 2024-09-12T00:04:14.162 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028068100000000002 2024-09-12T00:04:14.163 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.163 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.163 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.163 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688647+0000", 2024-09-12T00:04:14.163 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0027860979999999999 2024-09-12T00:04:14.163 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.163 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.163 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:14.163 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688909+0000", 2024-09-12T00:04:14.163 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026159600000000001 2024-09-12T00:04:14.163 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.163 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.163 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:14.163 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688991+0000", 2024-09-12T00:04:14.163 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2429999999999995e-05 2024-09-12T00:04:14.164 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.164 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.164 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:14.164 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689056+0000", 2024-09-12T00:04:14.164 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4236e-05 2024-09-12T00:04:14.164 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.164 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:14.164 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.164 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.164 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.164 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:881 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.164 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:04:14.164 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 39.368134277999999, 2024-09-12T00:04:14.164 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003307979, 2024-09-12T00:04:14.165 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:14.165 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:14.165 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.165 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:14.165 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:14.165 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.165 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 881 2024-09-12T00:04:14.165 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.165 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:14.165 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.165 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:14.165 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:04:14.165 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.166 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.166 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.166 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:14.166 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:04:14.166 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.166 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.166 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.166 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:14.166 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685898+0000", 2024-09-12T00:04:14.166 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4249999999999999e-06 2024-09-12T00:04:14.166 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.166 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.167 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:14.167 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685904+0000", 2024-09-12T00:04:14.167 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1290000000000001e-06 2024-09-12T00:04:14.167 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.167 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.167 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:14.167 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685917+0000", 2024-09-12T00:04:14.167 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2825e-05 2024-09-12T00:04:14.167 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.167 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.167 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.167 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685925+0000", 2024-09-12T00:04:14.167 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6589999999999996e-06 2024-09-12T00:04:14.168 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.168 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.168 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:14.168 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686156+0000", 2024-09-12T00:04:14.168 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023017299999999999 2024-09-12T00:04:14.168 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.168 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.168 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:14.168 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686365+0000", 2024-09-12T00:04:14.168 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000209442 2024-09-12T00:04:14.168 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.169 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.169 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:14.169 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686567+0000", 2024-09-12T00:04:14.169 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020237400000000001 2024-09-12T00:04:14.169 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.169 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.169 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:14.169 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689076+0000", 2024-09-12T00:04:14.169 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002508957 2024-09-12T00:04:14.169 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.169 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.170 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.170 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689121+0000", 2024-09-12T00:04:14.170 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4561999999999998e-05 2024-09-12T00:04:14.170 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.170 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.170 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:14.170 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689168+0000", 2024-09-12T00:04:14.170 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7000999999999999e-05 2024-09-12T00:04:14.170 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.170 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.170 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:14.170 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689204+0000", 2024-09-12T00:04:14.170 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6431999999999999e-05 2024-09-12T00:04:14.171 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.171 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:14.171 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.171 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.171 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.171 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:894 6.0 6:05588ce8:lc::lc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.171 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:04:14.171 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 39.363778312000001, 2024-09-12T00:04:14.171 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040691010000000003, 2024-09-12T00:04:14.171 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:14.171 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:14.172 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.172 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:14.172 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:14.172 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.172 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 894 2024-09-12T00:04:14.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.172 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:14.172 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.172 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:14.172 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:04:14.172 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.173 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.173 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:14.173 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:04:14.173 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.173 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.173 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.173 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:14.173 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690253+0000", 2024-09-12T00:04:14.173 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.026e-06 2024-09-12T00:04:14.173 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.173 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.173 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:14.174 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690259+0000", 2024-09-12T00:04:14.174 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7389999999999996e-06 2024-09-12T00:04:14.174 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.174 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.174 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:14.174 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690273+0000", 2024-09-12T00:04:14.174 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3749e-05 2024-09-12T00:04:14.174 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.174 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.174 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.174 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690282+0000", 2024-09-12T00:04:14.174 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2520000000000005e-06 2024-09-12T00:04:14.175 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.175 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.175 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:14.175 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690704+0000", 2024-09-12T00:04:14.175 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042222199999999998 2024-09-12T00:04:14.175 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.175 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.175 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:14.175 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690826+0000", 2024-09-12T00:04:14.175 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012141099999999999 2024-09-12T00:04:14.175 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.176 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.176 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:14.176 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.691094+0000", 2024-09-12T00:04:14.176 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000268344 2024-09-12T00:04:14.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.176 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.176 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:14.176 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.693007+0000", 2024-09-12T00:04:14.176 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001912495 2024-09-12T00:04:14.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.176 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.176 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.177 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694184+0000", 2024-09-12T00:04:14.177 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00117786 2024-09-12T00:04:14.177 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.177 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.177 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:14.177 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694259+0000", 2024-09-12T00:04:14.177 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4091000000000006e-05 2024-09-12T00:04:14.177 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.177 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.177 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:14.177 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694321+0000", 2024-09-12T00:04:14.177 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2911999999999997e-05 2024-09-12T00:04:14.177 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.178 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:14.178 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.178 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.178 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.178 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1283 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.178 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:04:14.178 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 38.864459775999997, 2024-09-12T00:04:14.178 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00320967, 2024-09-12T00:04:14.178 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:14.178 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:14.178 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.178 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:14.179 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:14.179 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.179 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1283 2024-09-12T00:04:14.179 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.179 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:14.179 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.179 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:14.179 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:04:14.179 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.179 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.179 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.179 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:14.179 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:04:14.180 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:14.180 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.180 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.180 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:14.180 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189573+0000", 2024-09-12T00:04:14.180 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3130000000000001e-06 2024-09-12T00:04:14.180 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.180 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.180 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:14.180 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189583+0000", 2024-09-12T00:04:14.180 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4129999999999995e-06 2024-09-12T00:04:14.180 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.181 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.181 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:14.181 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189608+0000", 2024-09-12T00:04:14.181 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5863e-05 2024-09-12T00:04:14.181 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.181 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.181 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.181 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189628+0000", 2024-09-12T00:04:14.181 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9644e-05 2024-09-12T00:04:14.181 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.181 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.181 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:14.181 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189747+0000", 2024-09-12T00:04:14.181 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118999 2024-09-12T00:04:14.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.182 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.182 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:14.182 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189874+0000", 2024-09-12T00:04:14.182 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012674499999999999 2024-09-12T00:04:14.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.182 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.182 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:14.182 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.190148+0000", 2024-09-12T00:04:14.182 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000274431 2024-09-12T00:04:14.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.182 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.182 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:14.182 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.191174+0000", 2024-09-12T00:04:14.182 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001025855 2024-09-12T00:04:14.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.183 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.183 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.183 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192627+0000", 2024-09-12T00:04:14.183 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014527979999999999 2024-09-12T00:04:14.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.183 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.183 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:14.183 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192710+0000", 2024-09-12T00:04:14.183 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3146000000000007e-05 2024-09-12T00:04:14.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:14.183 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:14.183 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:14.183 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192781+0000", 2024-09-12T00:04:14.183 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.0463000000000006e-05 2024-09-12T00:04:14.184 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.184 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:14.184 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.184 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:14.184 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:14.184 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:14.185 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:04:14.186 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:14.187+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:14.286 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:14.285+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:14.356 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:14.357 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:14.357 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:14.357 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:14.374 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:04:14.386 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:14.387+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:14.487 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:14.487+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:14.586 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:14.586 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:14.586 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:14.587 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:14.587 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:14.588 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:14.585+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:14.603 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:04:14.612 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T00:04:14.645 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T00:04:14.689 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:14.689+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:14.790 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:14.791+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:14.792 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:14.792 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:14.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:14.792 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:14.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.793 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:14.793 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:14.793 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 43.462929912, 2024-09-12T00:04:14.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.027441031000000001, 2024-09-12T00:04:14.793 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:14.793 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:14.793 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.793 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:14.793 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:14.793 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.793 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:04:14.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.793 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:14.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:14.794 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:14.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:14.794 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:14.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:14.794 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330357+0000", 2024-09-12T00:04:14.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2339999999999996e-06 2024-09-12T00:04:14.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:14.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330381+0000", 2024-09-12T00:04:14.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4626000000000001e-05 2024-09-12T00:04:14.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:14.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330417+0000", 2024-09-12T00:04:14.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5886000000000002e-05 2024-09-12T00:04:14.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330442+0000", 2024-09-12T00:04:14.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4522999999999999e-05 2024-09-12T00:04:14.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335485+0000", 2024-09-12T00:04:14.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050432589999999996 2024-09-12T00:04:14.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:14.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335507+0000", 2024-09-12T00:04:14.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2013000000000001e-05 2024-09-12T00:04:14.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.351747+0000", 2024-09-12T00:04:14.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016240451999999999 2024-09-12T00:04:14.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:14.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352062+0000", 2024-09-12T00:04:14.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031433399999999999 2024-09-12T00:04:14.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:14.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352378+0000", 2024-09-12T00:04:14.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031586400000000001 2024-09-12T00:04:14.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:14.798 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.355074+0000", 2024-09-12T00:04:14.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026962919999999999 2024-09-12T00:04:14.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.798 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357537+0000", 2024-09-12T00:04:14.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024634689999999998 2024-09-12T00:04:14.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:14.798 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357680+0000", 2024-09-12T00:04:14.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014314899999999999 2024-09-12T00:04:14.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.799 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:14.799 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357793+0000", 2024-09-12T00:04:14.799 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011293 2024-09-12T00:04:14.799 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.799 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:14.799 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.799 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94232250902656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:14.799 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:14.799 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 43.435014752000001, 2024-09-12T00:04:14.799 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052696050000000001, 2024-09-12T00:04:14.799 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:14.799 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:14.799 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.800 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:14.800 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:14.800 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.800 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:04:14.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.800 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:14.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:14.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:14.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:14.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:14.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:14.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358270+0000", 2024-09-12T00:04:14.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.17e-06 2024-09-12T00:04:14.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:14.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358278+0000", 2024-09-12T00:04:14.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3529999999999995e-06 2024-09-12T00:04:14.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:14.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358306+0000", 2024-09-12T00:04:14.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7763000000000002e-05 2024-09-12T00:04:14.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358324+0000", 2024-09-12T00:04:14.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7861000000000001e-05 2024-09-12T00:04:14.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358447+0000", 2024-09-12T00:04:14.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012334299999999999 2024-09-12T00:04:14.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.803 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:14.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358624+0000", 2024-09-12T00:04:14.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017684999999999999 2024-09-12T00:04:14.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.803 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:14.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358964+0000", 2024-09-12T00:04:14.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00033991199999999999 2024-09-12T00:04:14.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.803 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.362920+0000", 2024-09-12T00:04:14.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039564600000000002 2024-09-12T00:04:14.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:14.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363016+0000", 2024-09-12T00:04:14.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5612999999999994e-05 2024-09-12T00:04:14.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:14.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363244+0000", 2024-09-12T00:04:14.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000228385 2024-09-12T00:04:14.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:14.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363537+0000", 2024-09-12T00:04:14.805 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00029289499999999999 2024-09-12T00:04:14.805 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.805 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:14.805 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.805 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.805 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.805 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:14.805 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 40.427637234999999, 2024-09-12T00:04:14.805 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011415537, 2024-09-12T00:04:14.805 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:14.805 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:14.805 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.805 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:14.806 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:14.806 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.806 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 209 2024-09-12T00:04:14.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.806 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:14.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:14.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:14.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:14.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:14.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:14.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365648+0000", 2024-09-12T00:04:14.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7360000000000001e-06 2024-09-12T00:04:14.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:14.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365660+0000", 2024-09-12T00:04:14.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2089999999999999e-05 2024-09-12T00:04:14.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:14.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365690+0000", 2024-09-12T00:04:14.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0320000000000001e-05 2024-09-12T00:04:14.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365708+0000", 2024-09-12T00:04:14.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7520000000000002e-05 2024-09-12T00:04:14.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365870+0000", 2024-09-12T00:04:14.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016208600000000001 2024-09-12T00:04:14.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.809 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:14.809 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365885+0000", 2024-09-12T00:04:14.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5119999999999999e-05 2024-09-12T00:04:14.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.809 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.809 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.809 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373482+0000", 2024-09-12T00:04:14.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075970279999999996 2024-09-12T00:04:14.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.809 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.809 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:14.809 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373805+0000", 2024-09-12T00:04:14.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032262799999999999 2024-09-12T00:04:14.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.810 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:14.810 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.374297+0000", 2024-09-12T00:04:14.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00049250599999999998 2024-09-12T00:04:14.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.810 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:14.810 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.375670+0000", 2024-09-12T00:04:14.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001373333 2024-09-12T00:04:14.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.811 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.811 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.376923+0000", 2024-09-12T00:04:14.811 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012525640000000001 2024-09-12T00:04:14.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.811 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:14.811 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377000+0000", 2024-09-12T00:04:14.811 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6732999999999999e-05 2024-09-12T00:04:14.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:14.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377061+0000", 2024-09-12T00:04:14.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0872999999999998e-05 2024-09-12T00:04:14.812 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.812 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:14.812 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.812 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:240 6.19 6:9f626c48:lc::lc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.812 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:14.813 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 40.309051482000001, 2024-09-12T00:04:14.813 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058545680000000001, 2024-09-12T00:04:14.813 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:14.813 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:14.813 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.813 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:14.813 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:14.813 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.813 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 240 2024-09-12T00:04:14.813 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.813 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:14.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:14.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:14.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:14.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:14.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:14.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484233+0000", 2024-09-12T00:04:14.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.973e-06 2024-09-12T00:04:14.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:14.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484241+0000", 2024-09-12T00:04:14.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8210000000000002e-06 2024-09-12T00:04:14.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.816 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.816 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:14.816 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484260+0000", 2024-09-12T00:04:14.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9148999999999999e-05 2024-09-12T00:04:14.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.816 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.816 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.816 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484268+0000", 2024-09-12T00:04:14.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5120000000000008e-06 2024-09-12T00:04:14.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.816 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.817 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.817 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484371+0000", 2024-09-12T00:04:14.817 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102501 2024-09-12T00:04:14.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.817 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.817 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:14.817 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484450+0000", 2024-09-12T00:04:14.817 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9122999999999994e-05 2024-09-12T00:04:14.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.817 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.817 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:14.817 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484578+0000", 2024-09-12T00:04:14.817 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000128095 2024-09-12T00:04:14.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.818 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:14.818 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.485336+0000", 2024-09-12T00:04:14.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00075754000000000001 2024-09-12T00:04:14.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.818 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.818 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.489975+0000", 2024-09-12T00:04:14.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004639738 2024-09-12T00:04:14.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.818 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:14.818 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490043+0000", 2024-09-12T00:04:14.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7923999999999995e-05 2024-09-12T00:04:14.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.819 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:14.819 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490085+0000", 2024-09-12T00:04:14.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2191999999999999e-05 2024-09-12T00:04:14.819 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.819 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:14.819 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.819 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:412 6.3 6:c3a682d4:reshard::reshard.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.819 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:14.819 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 40.266656075999997, 2024-09-12T00:04:14.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049075530000000003, 2024-09-12T00:04:14.819 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:14.820 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:14.820 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.820 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:14.820 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:14.820 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.820 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 412 2024-09-12T00:04:14.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.820 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:14.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:14.820 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:14.820 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:14.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:14.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:14.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526628+0000", 2024-09-12T00:04:14.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.513e-06 2024-09-12T00:04:14.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:14.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526634+0000", 2024-09-12T00:04:14.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1279999999999996e-06 2024-09-12T00:04:14.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.822 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:14.822 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526649+0000", 2024-09-12T00:04:14.822 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4997999999999999e-05 2024-09-12T00:04:14.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.822 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.822 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526658+0000", 2024-09-12T00:04:14.822 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1589999999999999e-06 2024-09-12T00:04:14.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.822 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526728+0000", 2024-09-12T00:04:14.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0203999999999994e-05 2024-09-12T00:04:14.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:14.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526839+0000", 2024-09-12T00:04:14.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011055 2024-09-12T00:04:14.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:14.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526979+0000", 2024-09-12T00:04:14.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139863 2024-09-12T00:04:14.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:14.824 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.527616+0000", 2024-09-12T00:04:14.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00063707900000000003 2024-09-12T00:04:14.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.824 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.824 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531450+0000", 2024-09-12T00:04:14.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003833819 2024-09-12T00:04:14.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.824 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:14.824 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531490+0000", 2024-09-12T00:04:14.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0129000000000002e-05 2024-09-12T00:04:14.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.825 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:14.825 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531534+0000", 2024-09-12T00:04:14.825 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4110999999999998e-05 2024-09-12T00:04:14.825 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.825 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:14.825 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.825 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.826 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:490 6.19 6:9dc32cef:lc::lc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.826 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:14.826 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 40.242458702, 2024-09-12T00:04:14.826 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047438380000000002, 2024-09-12T00:04:14.826 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:14.826 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:14.826 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.826 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:14.826 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:14.826 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.826 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 490 2024-09-12T00:04:14.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.826 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:14.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:14.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:14.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:14.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:14.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:14.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550825+0000", 2024-09-12T00:04:14.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0589999999999999e-06 2024-09-12T00:04:14.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:14.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550830+0000", 2024-09-12T00:04:14.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2140000000000004e-06 2024-09-12T00:04:14.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:14.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550843+0000", 2024-09-12T00:04:14.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3404000000000001e-05 2024-09-12T00:04:14.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550852+0000", 2024-09-12T00:04:14.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1549999999999996e-06 2024-09-12T00:04:14.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550910+0000", 2024-09-12T00:04:14.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7636000000000002e-05 2024-09-12T00:04:14.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:14.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550977+0000", 2024-09-12T00:04:14.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6636000000000004e-05 2024-09-12T00:04:14.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:14.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.551135+0000", 2024-09-12T00:04:14.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015852999999999999 2024-09-12T00:04:14.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552939+0000", 2024-09-12T00:04:14.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001803643 2024-09-12T00:04:14.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:14.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555471+0000", 2024-09-12T00:04:14.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002532327 2024-09-12T00:04:14.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:14.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555526+0000", 2024-09-12T00:04:14.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4728000000000002e-05 2024-09-12T00:04:14.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:14.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555567+0000", 2024-09-12T00:04:14.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1505999999999999e-05 2024-09-12T00:04:14.831 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.831 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:14.831 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.832 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:492 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'6, mlcod=35'4)", 2024-09-12T00:04:14.832 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:14.832 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 40.240682638000003, 2024-09-12T00:04:14.832 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056118790000000002, 2024-09-12T00:04:14.832 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:14.832 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:14.832 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.832 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:14.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.832 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:14.832 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:14.832 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:14.833 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:14.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:14.833 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552601+0000", 2024-09-12T00:04:14.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6899999999999996e-07 2024-09-12T00:04:14.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:14.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552608+0000", 2024-09-12T00:04:14.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4529999999999996e-06 2024-09-12T00:04:14.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:14.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552624+0000", 2024-09-12T00:04:14.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5885000000000001e-05 2024-09-12T00:04:14.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552632+0000", 2024-09-12T00:04:14.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2220000000000002e-06 2024-09-12T00:04:14.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552716+0000", 2024-09-12T00:04:14.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4060999999999994e-05 2024-09-12T00:04:14.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:14.836 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552735+0000", 2024-09-12T00:04:14.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9170000000000001e-05 2024-09-12T00:04:14.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.836 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:14.836 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558164+0000", 2024-09-12T00:04:14.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054289899999999999 2024-09-12T00:04:14.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.836 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:14.837 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558212+0000", 2024-09-12T00:04:14.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7129000000000002e-05 2024-09-12T00:04:14.837 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.837 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:14.837 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.837 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.837 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:496 6.3 6:c134263f:lc::lc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.837 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:14.837 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 40.239575350000003, 2024-09-12T00:04:14.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045956260000000002, 2024-09-12T00:04:14.837 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:14.838 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:14.838 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.838 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:14.838 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:14.838 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.838 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 496 2024-09-12T00:04:14.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.838 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:14.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:14.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:14.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:14.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:14.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:14.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553708+0000", 2024-09-12T00:04:14.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2359999999999999e-06 2024-09-12T00:04:14.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:14.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553714+0000", 2024-09-12T00:04:14.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4960000000000004e-06 2024-09-12T00:04:14.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:14.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553726+0000", 2024-09-12T00:04:14.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2618e-05 2024-09-12T00:04:14.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553734+0000", 2024-09-12T00:04:14.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4159999999999998e-06 2024-09-12T00:04:14.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.841 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.841 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.841 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553771+0000", 2024-09-12T00:04:14.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7095999999999999e-05 2024-09-12T00:04:14.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.841 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.841 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:14.841 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553815+0000", 2024-09-12T00:04:14.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3986999999999997e-05 2024-09-12T00:04:14.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.841 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.841 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:14.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553922+0000", 2024-09-12T00:04:14.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000107534 2024-09-12T00:04:14.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555052+0000", 2024-09-12T00:04:14.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011298359999999999 2024-09-12T00:04:14.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:14.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558197+0000", 2024-09-12T00:04:14.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0031450269999999999 2024-09-12T00:04:14.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.843 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:14.843 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558256+0000", 2024-09-12T00:04:14.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8403999999999999e-05 2024-09-12T00:04:14.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.843 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:14.843 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558303+0000", 2024-09-12T00:04:14.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6975999999999999e-05 2024-09-12T00:04:14.843 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.843 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:14.843 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.843 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:641 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.844 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:14.844 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 40.199505023, 2024-09-12T00:04:14.844 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052824789999999996, 2024-09-12T00:04:14.844 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:14.844 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:14.844 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.844 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:14.844 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:14.844 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.844 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 641 2024-09-12T00:04:14.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.844 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:14.844 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.844 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:14.845 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:14.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.845 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.845 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:14.845 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:14.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.845 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.845 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:14.845 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593778+0000", 2024-09-12T00:04:14.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0920000000000001e-06 2024-09-12T00:04:14.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.846 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.846 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:14.846 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593783+0000", 2024-09-12T00:04:14.846 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9490000000000004e-06 2024-09-12T00:04:14.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.846 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.846 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:14.847 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593795+0000", 2024-09-12T00:04:14.847 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2048999999999999e-05 2024-09-12T00:04:14.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.847 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.847 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.847 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593801+0000", 2024-09-12T00:04:14.847 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8989999999999998e-06 2024-09-12T00:04:14.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.847 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.847 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.847 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593852+0000", 2024-09-12T00:04:14.847 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1057999999999998e-05 2024-09-12T00:04:14.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.847 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.848 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:14.848 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593905+0000", 2024-09-12T00:04:14.848 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2196e-05 2024-09-12T00:04:14.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.848 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.848 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:14.848 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594017+0000", 2024-09-12T00:04:14.848 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000112816 2024-09-12T00:04:14.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.848 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.848 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.848 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.595190+0000", 2024-09-12T00:04:14.848 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011727199999999999 2024-09-12T00:04:14.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.848 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.849 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:14.849 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.598998+0000", 2024-09-12T00:04:14.849 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038081320000000001 2024-09-12T00:04:14.849 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.849 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.849 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:14.849 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599032+0000", 2024-09-12T00:04:14.849 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4283999999999999e-05 2024-09-12T00:04:14.849 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.849 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.849 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:14.849 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599060+0000", 2024-09-12T00:04:14.849 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7284000000000002e-05 2024-09-12T00:04:14.850 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.850 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:14.850 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.850 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.850 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.850 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:643 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'8, mlcod=35'6)", 2024-09-12T00:04:14.850 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:14.850 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 40.199006916000002, 2024-09-12T00:04:14.850 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048211260000000002, 2024-09-12T00:04:14.850 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:14.850 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:14.850 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.850 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:14.851 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.851 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:14.851 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:14.851 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.851 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.851 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.851 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:14.851 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:14.851 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.851 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.851 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.851 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:14.851 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594276+0000", 2024-09-12T00:04:14.851 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5899999999999995e-07 2024-09-12T00:04:14.852 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.852 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.852 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:14.852 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594283+0000", 2024-09-12T00:04:14.852 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6019999999999996e-06 2024-09-12T00:04:14.852 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.852 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.852 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:14.852 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594295+0000", 2024-09-12T00:04:14.852 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1683e-05 2024-09-12T00:04:14.852 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.853 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.853 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.853 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594303+0000", 2024-09-12T00:04:14.853 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0439999999999996e-06 2024-09-12T00:04:14.853 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.853 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.853 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.853 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594353+0000", 2024-09-12T00:04:14.853 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0698000000000001e-05 2024-09-12T00:04:14.853 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.853 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.853 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:14.853 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594380+0000", 2024-09-12T00:04:14.854 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7089000000000001e-05 2024-09-12T00:04:14.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.854 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.854 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:14.854 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599063+0000", 2024-09-12T00:04:14.854 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046824739999999998 2024-09-12T00:04:14.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.854 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.854 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:14.854 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599096+0000", 2024-09-12T00:04:14.854 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3677000000000003e-05 2024-09-12T00:04:14.855 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.855 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:14.855 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.855 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.855 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.855 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:647 6.a 6:5395e6f3:lc::lc.4:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.855 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:14.855 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 40.196656283000003, 2024-09-12T00:04:14.855 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049071770000000004, 2024-09-12T00:04:14.855 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:14.855 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:14.855 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.855 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:14.855 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:14.856 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.856 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 647 2024-09-12T00:04:14.856 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.856 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:14.856 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.856 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:14.856 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:14.856 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.856 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.856 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.856 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:14.856 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:14.856 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.857 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.857 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.857 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:14.857 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596627+0000", 2024-09-12T00:04:14.857 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1149999999999999e-06 2024-09-12T00:04:14.857 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.857 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.857 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:14.857 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596632+0000", 2024-09-12T00:04:14.857 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7060000000000003e-06 2024-09-12T00:04:14.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.858 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:14.858 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596645+0000", 2024-09-12T00:04:14.858 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2791e-05 2024-09-12T00:04:14.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.858 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.858 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596653+0000", 2024-09-12T00:04:14.858 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9230000000000002e-06 2024-09-12T00:04:14.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.858 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.858 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596705+0000", 2024-09-12T00:04:14.859 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2250000000000003e-05 2024-09-12T00:04:14.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.859 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:14.859 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596758+0000", 2024-09-12T00:04:14.859 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2964000000000003e-05 2024-09-12T00:04:14.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.859 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:14.859 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596873+0000", 2024-09-12T00:04:14.859 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011501 2024-09-12T00:04:14.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.859 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.860 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599088+0000", 2024-09-12T00:04:14.860 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002215135 2024-09-12T00:04:14.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.860 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.860 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:14.860 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601456+0000", 2024-09-12T00:04:14.860 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023684719999999999 2024-09-12T00:04:14.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.860 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.860 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:14.860 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601507+0000", 2024-09-12T00:04:14.860 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0933999999999997e-05 2024-09-12T00:04:14.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.861 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.861 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:14.861 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601533+0000", 2024-09-12T00:04:14.861 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5877e-05 2024-09-12T00:04:14.861 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.861 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:14.861 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.861 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.861 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.861 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:657 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'10, mlcod=35'7)", 2024-09-12T00:04:14.861 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:14.861 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 40.192832742999997, 2024-09-12T00:04:14.861 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066410239999999997, 2024-09-12T00:04:14.862 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:14.862 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:14.862 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.862 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:14.862 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.862 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:14.862 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:14.862 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.862 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.862 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.862 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:14.862 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:14.862 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.863 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.863 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.863 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:14.863 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:14.863 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6099999999999999e-07 2024-09-12T00:04:14.863 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.863 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.863 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:14.863 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600457+0000", 2024-09-12T00:04:14.863 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8700000000000003e-06 2024-09-12T00:04:14.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.864 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.864 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:14.864 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600470+0000", 2024-09-12T00:04:14.864 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3186999999999999e-05 2024-09-12T00:04:14.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.864 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.864 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.864 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600478+0000", 2024-09-12T00:04:14.864 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5310000000000004e-06 2024-09-12T00:04:14.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600521+0000", 2024-09-12T00:04:14.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2574000000000003e-05 2024-09-12T00:04:14.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:14.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600535+0000", 2024-09-12T00:04:14.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4151000000000001e-05 2024-09-12T00:04:14.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:14.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.606997+0000", 2024-09-12T00:04:14.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064626099999999997 2024-09-12T00:04:14.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:14.866 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607091+0000", 2024-09-12T00:04:14.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3239999999999995e-05 2024-09-12T00:04:14.866 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.866 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:14.866 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.866 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:659 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.866 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:14.866 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 40.192660410999999, 2024-09-12T00:04:14.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0065340989999999998, 2024-09-12T00:04:14.866 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:14.867 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:14.867 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.867 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:14.867 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:14.867 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.867 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 659 2024-09-12T00:04:14.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.867 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:14.867 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.867 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:14.868 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:14.868 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.868 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.868 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.868 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:14.868 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:14.868 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.868 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.868 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.868 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:14.868 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600623+0000", 2024-09-12T00:04:14.869 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.085e-06 2024-09-12T00:04:14.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.869 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.869 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:14.869 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600630+0000", 2024-09-12T00:04:14.869 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0029999999999997e-06 2024-09-12T00:04:14.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.869 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.869 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:14.869 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600647+0000", 2024-09-12T00:04:14.869 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6566999999999999e-05 2024-09-12T00:04:14.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.869 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.869 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.870 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600658+0000", 2024-09-12T00:04:14.870 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0992000000000001e-05 2024-09-12T00:04:14.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.870 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.870 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.870 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600717+0000", 2024-09-12T00:04:14.870 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9925e-05 2024-09-12T00:04:14.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.870 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.870 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:14.870 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600773+0000", 2024-09-12T00:04:14.871 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5766000000000001e-05 2024-09-12T00:04:14.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.871 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.871 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:14.871 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600889+0000", 2024-09-12T00:04:14.871 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115906 2024-09-12T00:04:14.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.871 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.871 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.871 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603483+0000", 2024-09-12T00:04:14.871 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025940799999999999 2024-09-12T00:04:14.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.871 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.871 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:14.872 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607098+0000", 2024-09-12T00:04:14.872 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036150459999999998 2024-09-12T00:04:14.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.872 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:14.872 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607133+0000", 2024-09-12T00:04:14.872 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4615e-05 2024-09-12T00:04:14.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.872 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:14.873 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607156+0000", 2024-09-12T00:04:14.873 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3113999999999999e-05 2024-09-12T00:04:14.873 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.873 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:14.873 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.873 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.873 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:666 6.a 6:5395e6f3:lc::lc.4:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.873 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:14.873 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 40.190913281999997, 2024-09-12T00:04:14.873 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.005127174, 2024-09-12T00:04:14.873 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:14.873 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:14.874 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.874 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:14.874 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:14.874 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.874 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 666 2024-09-12T00:04:14.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.874 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:14.874 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.874 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:14.874 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:14.874 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.874 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.874 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:14.875 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:14.875 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.875 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.875 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.875 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:14.875 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602370+0000", 2024-09-12T00:04:14.875 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0720000000000001e-06 2024-09-12T00:04:14.875 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.875 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.875 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:14.875 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602376+0000", 2024-09-12T00:04:14.875 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5489999999999997e-06 2024-09-12T00:04:14.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.876 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:14.876 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602391+0000", 2024-09-12T00:04:14.876 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5301000000000001e-05 2024-09-12T00:04:14.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.876 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.876 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602399+0000", 2024-09-12T00:04:14.876 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9179999999999994e-06 2024-09-12T00:04:14.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.876 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.876 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602456+0000", 2024-09-12T00:04:14.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7099999999999999e-05 2024-09-12T00:04:14.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.877 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.877 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:14.877 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602508+0000", 2024-09-12T00:04:14.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2476999999999999e-05 2024-09-12T00:04:14.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.877 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.877 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:14.877 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602606+0000", 2024-09-12T00:04:14.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7823000000000002e-05 2024-09-12T00:04:14.881 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.881 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.881 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.881 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.604653+0000", 2024-09-12T00:04:14.881 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002047068 2024-09-12T00:04:14.881 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.881 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.881 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:14.881 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607401+0000", 2024-09-12T00:04:14.882 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027477700000000001 2024-09-12T00:04:14.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.882 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.882 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:14.882 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607453+0000", 2024-09-12T00:04:14.882 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2092999999999997e-05 2024-09-12T00:04:14.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.882 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.882 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:14.882 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607496+0000", 2024-09-12T00:04:14.882 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3003000000000001e-05 2024-09-12T00:04:14.882 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.882 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:14.882 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.883 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.883 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.883 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:665 6.1a e35/29 6:5c7e8a6d:reshard::reshard.0000000015:head v 35'11, mlcod=35'8)", 2024-09-12T00:04:14.883 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:14.883 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 40.190541596999999, 2024-09-12T00:04:14.883 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048593209999999998, 2024-09-12T00:04:14.883 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:14.883 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:14.883 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.883 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:14.883 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.883 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:14.883 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:14.883 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.884 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.884 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:14.884 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:14.884 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.884 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.884 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:14.884 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602742+0000", 2024-09-12T00:04:14.884 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1069999999999999e-06 2024-09-12T00:04:14.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.884 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.884 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:14.884 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602749+0000", 2024-09-12T00:04:14.885 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9609999999999999e-06 2024-09-12T00:04:14.885 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.885 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.885 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:14.885 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602763+0000", 2024-09-12T00:04:14.885 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4086e-05 2024-09-12T00:04:14.885 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.885 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.885 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.885 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602772+0000", 2024-09-12T00:04:14.885 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8470000000000002e-06 2024-09-12T00:04:14.885 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.885 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.885 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.886 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602826+0000", 2024-09-12T00:04:14.886 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3885000000000003e-05 2024-09-12T00:04:14.886 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.886 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.886 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:14.886 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602837+0000", 2024-09-12T00:04:14.886 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1601e-05 2024-09-12T00:04:14.886 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.886 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.886 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:14.886 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607500+0000", 2024-09-12T00:04:14.886 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046627509999999997 2024-09-12T00:04:14.886 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.886 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.887 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:14.887 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607600+0000", 2024-09-12T00:04:14.887 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100083 2024-09-12T00:04:14.887 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.887 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:14.887 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.887 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.887 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.887 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:831 6.19 6:9d23f22c:lc::lc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.887 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:14.887 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 40.127256916999997, 2024-09-12T00:04:14.887 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047044610000000001, 2024-09-12T00:04:14.887 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:14.887 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:14.888 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.888 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:14.888 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:14.888 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.888 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 831 2024-09-12T00:04:14.888 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.888 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:14.888 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.888 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:14.888 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:14.888 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.888 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.888 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.888 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:14.889 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:14.889 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.889 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.889 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.889 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:14.889 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666026+0000", 2024-09-12T00:04:14.889 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.02e-06 2024-09-12T00:04:14.889 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.889 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.889 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:14.889 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666032+0000", 2024-09-12T00:04:14.889 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8850000000000004e-06 2024-09-12T00:04:14.889 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.889 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.890 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:14.890 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666047+0000", 2024-09-12T00:04:14.890 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4647999999999999e-05 2024-09-12T00:04:14.890 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.890 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.890 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.890 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666058+0000", 2024-09-12T00:04:14.890 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0905e-05 2024-09-12T00:04:14.890 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.890 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.890 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.890 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666376+0000", 2024-09-12T00:04:14.890 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031824899999999999 2024-09-12T00:04:14.890 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.890 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.891 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:14.891 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666479+0000", 2024-09-12T00:04:14.891 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102814 2024-09-12T00:04:14.891 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.891 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.891 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:14.891 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666635+0000", 2024-09-12T00:04:14.891 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000156343 2024-09-12T00:04:14.891 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.891 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.891 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:14.891 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.667611+0000", 2024-09-12T00:04:14.891 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000975671 2024-09-12T00:04:14.891 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.892 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.892 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.892 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670662+0000", 2024-09-12T00:04:14.892 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003050863 2024-09-12T00:04:14.892 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.892 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.892 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:14.892 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670701+0000", 2024-09-12T00:04:14.892 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9338000000000002e-05 2024-09-12T00:04:14.892 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.892 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.892 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:14.892 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670730+0000", 2024-09-12T00:04:14.893 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8725e-05 2024-09-12T00:04:14.893 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.893 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:14.893 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.893 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.893 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.893 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:852 6.1d e35/29 6:bbf2d10c:::obj_delete_at_hint.0000000025:head v 35'9, mlcod=35'7)", 2024-09-12T00:04:14.893 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:14.893 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 40.118679864000001, 2024-09-12T00:04:14.893 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00569595, 2024-09-12T00:04:14.894 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:14.894 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:14.894 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.894 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:14.894 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.894 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:14.894 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:14.894 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.894 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.894 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.894 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:14.894 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:14.894 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.894 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.895 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.895 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:14.895 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674604+0000", 2024-09-12T00:04:14.895 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2079999999999999e-06 2024-09-12T00:04:14.895 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.895 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.895 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:14.895 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674611+0000", 2024-09-12T00:04:14.895 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.973e-06 2024-09-12T00:04:14.895 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.895 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.895 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:14.895 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674625+0000", 2024-09-12T00:04:14.895 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3916e-05 2024-09-12T00:04:14.895 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.896 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.896 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.896 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674633+0000", 2024-09-12T00:04:14.896 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8580000000000006e-06 2024-09-12T00:04:14.896 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.896 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.896 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.896 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674697+0000", 2024-09-12T00:04:14.896 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4004999999999995e-05 2024-09-12T00:04:14.896 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.896 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.896 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:14.896 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674713+0000", 2024-09-12T00:04:14.896 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5835e-05 2024-09-12T00:04:14.897 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.897 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.897 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:14.897 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680245+0000", 2024-09-12T00:04:14.897 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055320250000000003 2024-09-12T00:04:14.897 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.897 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.897 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:14.897 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680298+0000", 2024-09-12T00:04:14.897 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3130000000000001e-05 2024-09-12T00:04:14.897 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.897 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:14.897 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.897 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.897 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.898 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:925 6.1a e35/29 6:5f2e3d26:lc::lc.18:head v 35'15, mlcod=35'12)", 2024-09-12T00:04:14.898 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:14.898 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 40.095152034000002, 2024-09-12T00:04:14.898 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055640999999999998, 2024-09-12T00:04:14.898 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:14.898 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:14.898 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.898 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:14.898 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.898 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:14.898 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:14.898 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.898 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.898 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.898 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:14.899 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:14.899 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.899 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.899 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.899 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:14.899 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698131+0000", 2024-09-12T00:04:14.899 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:04:14.899 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.899 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.899 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:14.899 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698140+0000", 2024-09-12T00:04:14.899 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3139999999999993e-06 2024-09-12T00:04:14.899 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.899 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.900 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:14.900 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698155+0000", 2024-09-12T00:04:14.900 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:04:14.900 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.900 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.900 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.900 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698164+0000", 2024-09-12T00:04:14.900 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1419999999999999e-06 2024-09-12T00:04:14.900 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.900 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.900 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.900 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698228+0000", 2024-09-12T00:04:14.900 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3380000000000006e-05 2024-09-12T00:04:14.900 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.901 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.901 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:14.901 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698252+0000", 2024-09-12T00:04:14.901 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4111e-05 2024-09-12T00:04:14.901 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.901 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.901 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:14.901 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703646+0000", 2024-09-12T00:04:14.901 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0053937840000000004 2024-09-12T00:04:14.901 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.901 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.901 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:14.901 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703694+0000", 2024-09-12T00:04:14.901 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8776999999999997e-05 2024-09-12T00:04:14.902 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.902 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:14.902 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.902 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.902 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.902 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:927 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.902 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:14.902 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 40.094633010000003, 2024-09-12T00:04:14.902 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050914949999999997, 2024-09-12T00:04:14.902 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:14.902 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:14.902 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:14.902 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:14.902 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:14.902 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.903 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 927 2024-09-12T00:04:14.903 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.903 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:14.903 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.903 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:14.903 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:14.903 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.903 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.903 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.903 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:14.903 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:14.903 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.903 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.903 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.904 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:14.904 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698651+0000", 2024-09-12T00:04:14.904 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3740000000000001e-06 2024-09-12T00:04:14.904 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.904 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.904 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:14.904 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698657+0000", 2024-09-12T00:04:14.904 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5239999999999997e-06 2024-09-12T00:04:14.904 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.904 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.904 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:14.904 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698673+0000", 2024-09-12T00:04:14.904 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5345999999999998e-05 2024-09-12T00:04:14.904 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.905 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.905 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.905 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698680+0000", 2024-09-12T00:04:14.905 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4649999999999997e-06 2024-09-12T00:04:14.905 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.905 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.905 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.905 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699009+0000", 2024-09-12T00:04:14.905 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032934000000000001 2024-09-12T00:04:14.905 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.905 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.905 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:14.905 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699213+0000", 2024-09-12T00:04:14.905 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020361500000000001 2024-09-12T00:04:14.906 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.906 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.906 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:14.906 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699450+0000", 2024-09-12T00:04:14.906 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023670399999999999 2024-09-12T00:04:14.906 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.906 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.906 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:14.906 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.700678+0000", 2024-09-12T00:04:14.906 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012285519999999999 2024-09-12T00:04:14.906 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.906 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.906 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:14.906 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703666+0000", 2024-09-12T00:04:14.907 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029876130000000001 2024-09-12T00:04:14.907 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.907 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.907 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:14.907 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703708+0000", 2024-09-12T00:04:14.907 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2361999999999999e-05 2024-09-12T00:04:14.907 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.907 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.907 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:14.907 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703741+0000", 2024-09-12T00:04:14.907 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.26e-05 2024-09-12T00:04:14.907 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.907 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:14.907 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.908 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.908 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.908 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:941 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:14.908 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:14.908 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 40.089139557000003, 2024-09-12T00:04:14.908 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0051476960000000002, 2024-09-12T00:04:14.908 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:14.908 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:14.908 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "started", 2024-09-12T00:04:14.908 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:14.908 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:14.908 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:14.908 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 941 2024-09-12T00:04:14.908 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.909 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:14.909 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.909 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:14.909 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:14.909 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.909 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.909 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.909 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:14.909 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:14.909 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:14.909 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.909 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.909 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:14.909 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704144+0000", 2024-09-12T00:04:14.910 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.514e-06 2024-09-12T00:04:14.910 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.910 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.910 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:14.910 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704152+0000", 2024-09-12T00:04:14.910 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2830000000000004e-06 2024-09-12T00:04:14.910 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.910 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.910 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:14.910 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704168+0000", 2024-09-12T00:04:14.910 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6835999999999999e-05 2024-09-12T00:04:14.910 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.910 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.910 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:14.911 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704178+0000", 2024-09-12T00:04:14.911 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7569999999999999e-06 2024-09-12T00:04:14.911 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.911 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.911 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:14.911 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704240+0000", 2024-09-12T00:04:14.911 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2193000000000006e-05 2024-09-12T00:04:14.911 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.911 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.911 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:14.911 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704308+0000", 2024-09-12T00:04:14.911 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7840000000000001e-05 2024-09-12T00:04:14.911 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:14.911 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:14.911 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:14.912 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.709290+0000", 2024-09-12T00:04:14.912 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049822729999999997 2024-09-12T00:04:14.912 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.912 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:14.912 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.912 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:14.912 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:14.912 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:14.914 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:04:14.914 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:14.913+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:15.015 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:15.013+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:15.116 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:15.115+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:15.128 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:15.128 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:15.128 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:15.128 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:15.145 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:04:15.237 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:15.237+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:15.318 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:15.317+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:15.364 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:15.364 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:15.364 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:15.364 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:15.364 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:15.381 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:04:15.426 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:15.425+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:15.520 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:15.517+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:15.598 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:15.599 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:15.599 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:15.599 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:15.599 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.599 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:15.599 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:15.599 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 64.105721134000007, 2024-09-12T00:04:15.599 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.278479906, 2024-09-12T00:04:15.599 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:15.599 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:15.599 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:15.599 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:15.599 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:15.600 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:15.600 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:04:15.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.600 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:15.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.600 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:15.600 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:15.600 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.600 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:15.600 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:15.600 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.601 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:15.601 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493422+0000", 2024-09-12T00:04:15.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.807e-06 2024-09-12T00:04:15.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.601 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:15.601 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493435+0000", 2024-09-12T00:04:15.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.375e-05 2024-09-12T00:04:15.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.601 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:15.601 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493457+0000", 2024-09-12T00:04:15.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2166000000000001e-05 2024-09-12T00:04:15.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.602 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.602 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:15.602 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493475+0000", 2024-09-12T00:04:15.602 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7184e-05 2024-09-12T00:04:15.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.602 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.602 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:15.602 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493617+0000", 2024-09-12T00:04:15.602 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014274200000000001 2024-09-12T00:04:15.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.602 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.602 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:15.603 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493632+0000", 2024-09-12T00:04:15.603 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4293e-05 2024-09-12T00:04:15.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.603 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.603 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:15.603 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.768657+0000", 2024-09-12T00:04:15.603 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.27502575400000001 2024-09-12T00:04:15.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.603 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.603 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:15.603 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769042+0000", 2024-09-12T00:04:15.603 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00038463700000000001 2024-09-12T00:04:15.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.603 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.604 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:15.604 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769430+0000", 2024-09-12T00:04:15.604 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000388014 2024-09-12T00:04:15.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.604 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.604 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:15.604 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.770784+0000", 2024-09-12T00:04:15.604 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00135402 2024-09-12T00:04:15.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.604 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.604 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:15.604 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771735+0000", 2024-09-12T00:04:15.605 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00095068599999999996 2024-09-12T00:04:15.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.605 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.605 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:15.605 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771828+0000", 2024-09-12T00:04:15.605 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3468999999999996e-05 2024-09-12T00:04:15.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.605 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.605 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:15.605 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771899+0000", 2024-09-12T00:04:15.605 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0383999999999996e-05 2024-09-12T00:04:15.605 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.605 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:15.605 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.606 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.606 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:15.606 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:15.606 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.677497377999998, 2024-09-12T00:04:15.606 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013402304, 2024-09-12T00:04:15.606 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:15.606 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:15.606 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:15.606 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:15.606 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:15.606 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:15.606 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 44 2024-09-12T00:04:15.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.607 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:15.607 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.607 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:15.607 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:15.607 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.607 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.607 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:15.607 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:15.607 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.607 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.607 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:15.607 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:15.607 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7100000000000001e-07 2024-09-12T00:04:15.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.608 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:15.608 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921706+0000", 2024-09-12T00:04:15.608 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2374999999999998e-05 2024-09-12T00:04:15.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.608 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:15.608 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921726+0000", 2024-09-12T00:04:15.608 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0373999999999998e-05 2024-09-12T00:04:15.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.608 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:15.608 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921733+0000", 2024-09-12T00:04:15.609 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8929999999999999e-06 2024-09-12T00:04:15.609 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.609 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.609 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:15.609 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927137+0000", 2024-09-12T00:04:15.609 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054037410000000001 2024-09-12T00:04:15.609 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.609 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.609 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:15.609 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927274+0000", 2024-09-12T00:04:15.609 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013697899999999999 2024-09-12T00:04:15.609 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.609 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.609 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:15.610 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927504+0000", 2024-09-12T00:04:15.610 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023005399999999999 2024-09-12T00:04:15.610 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.610 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.610 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:15.610 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.931848+0000", 2024-09-12T00:04:15.610 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0043445269999999999 2024-09-12T00:04:15.610 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.610 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.610 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:15.610 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934770+0000", 2024-09-12T00:04:15.610 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002922319 2024-09-12T00:04:15.610 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.610 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.610 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:15.611 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934901+0000", 2024-09-12T00:04:15.611 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013034599999999999 2024-09-12T00:04:15.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.611 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.611 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:15.611 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935045+0000", 2024-09-12T00:04:15.611 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014402499999999999 2024-09-12T00:04:15.611 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.611 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:15.611 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.611 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.611 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:15.611 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:15.612 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.677394413000002, 2024-09-12T00:04:15.612 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013456684999999999, 2024-09-12T00:04:15.612 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:15.612 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:15.612 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:15.612 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:15.612 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:15.612 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:15.612 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 45 2024-09-12T00:04:15.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.612 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:15.612 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.612 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:15.613 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:15.613 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.613 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.613 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:15.613 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:15.613 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.613 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.613 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:15.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921746+0000", 2024-09-12T00:04:15.614 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9800000000000003e-07 2024-09-12T00:04:15.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.614 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:15.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921751+0000", 2024-09-12T00:04:15.614 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7099999999999998e-06 2024-09-12T00:04:15.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.614 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:15.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921766+0000", 2024-09-12T00:04:15.614 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5633000000000001e-05 2024-09-12T00:04:15.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:15.615 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921786+0000", 2024-09-12T00:04:15.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9658000000000001e-05 2024-09-12T00:04:15.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:15.615 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929539+0000", 2024-09-12T00:04:15.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0077533120000000001 2024-09-12T00:04:15.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:15.615 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929706+0000", 2024-09-12T00:04:15.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016664199999999999 2024-09-12T00:04:15.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.616 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:15.616 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929933+0000", 2024-09-12T00:04:15.616 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000226658 2024-09-12T00:04:15.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.616 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:15.616 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934721+0000", 2024-09-12T00:04:15.616 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047886439999999999 2024-09-12T00:04:15.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.616 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:15.616 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935062+0000", 2024-09-12T00:04:15.616 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00034072399999999999 2024-09-12T00:04:15.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.617 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:15.617 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935141+0000", 2024-09-12T00:04:15.617 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8570000000000002e-05 2024-09-12T00:04:15.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.617 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:15.617 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935202+0000", 2024-09-12T00:04:15.617 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1536000000000002e-05 2024-09-12T00:04:15.617 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.617 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:15.617 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.618 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:15.618 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:15.618 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.677344181000002, 2024-09-12T00:04:15.618 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014633617, 2024-09-12T00:04:15.618 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:15.618 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:15.618 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:15.618 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:15.618 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:15.618 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:15.618 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:04:15.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.618 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:15.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:15.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:15.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:15.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:15.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:15.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:15.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3599999999999999e-07 2024-09-12T00:04:15.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:15.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921800+0000", 2024-09-12T00:04:15.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3850000000000002e-06 2024-09-12T00:04:15.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:15.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921805+0000", 2024-09-12T00:04:15.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9460000000000003e-06 2024-09-12T00:04:15.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:15.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921819+0000", 2024-09-12T00:04:15.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.325e-05 2024-09-12T00:04:15.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.621 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:15.621 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930627+0000", 2024-09-12T00:04:15.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00880827 2024-09-12T00:04:15.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.621 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:15.621 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930805+0000", 2024-09-12T00:04:15.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000177992 2024-09-12T00:04:15.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.621 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:15.621 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.931028+0000", 2024-09-12T00:04:15.622 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000223122 2024-09-12T00:04:15.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.622 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.622 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:15.622 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935258+0000", 2024-09-12T00:04:15.622 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0042302709999999999 2024-09-12T00:04:15.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.622 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.622 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:15.622 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936282+0000", 2024-09-12T00:04:15.622 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00102345 2024-09-12T00:04:15.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.622 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.622 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:15.623 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936367+0000", 2024-09-12T00:04:15.623 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4869000000000003e-05 2024-09-12T00:04:15.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.623 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.623 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:15.623 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936429+0000", 2024-09-12T00:04:15.623 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2626000000000007e-05 2024-09-12T00:04:15.623 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.623 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:15.623 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.623 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.623 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:15.623 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:15.624 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.677307931000001, 2024-09-12T00:04:15.624 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016022492999999999, 2024-09-12T00:04:15.624 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:15.624 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:15.624 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:15.624 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:15.624 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:15.624 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:15.624 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:04:15.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.624 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:15.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.624 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:15.624 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:15.624 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:15.625 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:15.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:15.625 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:15.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4000000000000002e-07 2024-09-12T00:04:15.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:15.625 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921891+0000", 2024-09-12T00:04:15.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8298000000000003e-05 2024-09-12T00:04:15.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:15.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921899+0000", 2024-09-12T00:04:15.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7059999999999993e-06 2024-09-12T00:04:15.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:15.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921904+0000", 2024-09-12T00:04:15.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9799999999999998e-06 2024-09-12T00:04:15.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:15.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932144+0000", 2024-09-12T00:04:15.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010239817999999999 2024-09-12T00:04:15.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:15.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932284+0000", 2024-09-12T00:04:15.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139436 2024-09-12T00:04:15.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:15.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932498+0000", 2024-09-12T00:04:15.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000214408 2024-09-12T00:04:15.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.628 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.628 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:15.628 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936444+0000", 2024-09-12T00:04:15.628 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039464169999999998 2024-09-12T00:04:15.628 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.628 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.628 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:15.628 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937702+0000", 2024-09-12T00:04:15.628 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012571679999999999 2024-09-12T00:04:15.628 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.628 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.628 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:15.629 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937793+0000", 2024-09-12T00:04:15.629 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1489000000000004e-05 2024-09-12T00:04:15.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.629 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.629 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:15.629 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937854+0000", 2024-09-12T00:04:15.629 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1333000000000004e-05 2024-09-12T00:04:15.629 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.629 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:15.629 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.630 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.630 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:15.630 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:15.630 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.677226062999999, 2024-09-12T00:04:15.630 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017189138999999999, 2024-09-12T00:04:15.630 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:15.630 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:15.630 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:15.630 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:15.630 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:15.630 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:15.630 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 48 2024-09-12T00:04:15.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.630 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:15.630 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:15.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:15.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:15.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:15.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:15.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:15.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7399999999999998e-07 2024-09-12T00:04:15.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:15.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921918+0000", 2024-09-12T00:04:15.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6399999999999999e-06 2024-09-12T00:04:15.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:15.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921925+0000", 2024-09-12T00:04:15.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7190000000000004e-06 2024-09-12T00:04:15.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:15.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921931+0000", 2024-09-12T00:04:15.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2519999999999996e-06 2024-09-12T00:04:15.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:15.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933475+0000", 2024-09-12T00:04:15.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011543759000000001 2024-09-12T00:04:15.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:15.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933617+0000", 2024-09-12T00:04:15.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000142282 2024-09-12T00:04:15.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.634 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:15.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933860+0000", 2024-09-12T00:04:15.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024276199999999999 2024-09-12T00:04:15.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.634 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:15.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937933+0000", 2024-09-12T00:04:15.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040734680000000002 2024-09-12T00:04:15.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.634 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:15.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938955+0000", 2024-09-12T00:04:15.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001021987 2024-09-12T00:04:15.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.635 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:15.635 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939038+0000", 2024-09-12T00:04:15.635 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2449999999999998e-05 2024-09-12T00:04:15.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.635 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:15.635 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939103+0000", 2024-09-12T00:04:15.635 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5345999999999994e-05 2024-09-12T00:04:15.635 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.635 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:15.635 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.635 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:15.636 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:15.636 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.677200521000003, 2024-09-12T00:04:15.636 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018247975, 2024-09-12T00:04:15.636 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:15.636 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:15.636 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:15.636 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:15.636 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:15.636 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:15.636 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 49 2024-09-12T00:04:15.636 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.636 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:15.636 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.636 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:15.636 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:15.637 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.637 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.637 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:15.637 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:15.637 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.637 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.637 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:15.638 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921940+0000", 2024-09-12T00:04:15.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7e-07 2024-09-12T00:04:15.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.638 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:15.638 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921943+0000", 2024-09-12T00:04:15.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1889999999999999e-06 2024-09-12T00:04:15.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.638 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:15.638 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921952+0000", 2024-09-12T00:04:15.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0010000000000007e-06 2024-09-12T00:04:15.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:15.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921959+0000", 2024-09-12T00:04:15.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2570000000000001e-06 2024-09-12T00:04:15.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:15.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935333+0000", 2024-09-12T00:04:15.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013373368 2024-09-12T00:04:15.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:15.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935472+0000", 2024-09-12T00:04:15.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013987900000000001 2024-09-12T00:04:15.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:15.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935700+0000", 2024-09-12T00:04:15.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000227922 2024-09-12T00:04:15.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:15.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939858+0000", 2024-09-12T00:04:15.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041571300000000002 2024-09-12T00:04:15.641 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.641 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.641 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:15.641 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940018+0000", 2024-09-12T00:04:15.641 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016060400000000001 2024-09-12T00:04:15.641 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.641 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.641 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:15.641 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940114+0000", 2024-09-12T00:04:15.641 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5692999999999993e-05 2024-09-12T00:04:15.641 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.641 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.641 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:15.642 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940187+0000", 2024-09-12T00:04:15.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3561999999999998e-05 2024-09-12T00:04:15.642 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.642 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:15.642 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.642 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.642 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.642 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:15.642 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:15.642 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.677157733999998, 2024-09-12T00:04:15.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021018614000000001, 2024-09-12T00:04:15.642 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:15.642 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:15.642 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:15.642 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:15.643 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:15.643 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:15.643 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 50 2024-09-12T00:04:15.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.643 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:15.643 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.643 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:15.643 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:15.643 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.643 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.643 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:15.644 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:15.644 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.644 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:15.644 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921983+0000", 2024-09-12T00:04:15.644 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4499999999999996e-07 2024-09-12T00:04:15.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.644 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:15.644 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922071+0000", 2024-09-12T00:04:15.644 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8010000000000006e-05 2024-09-12T00:04:15.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.645 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:15.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922084+0000", 2024-09-12T00:04:15.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3275000000000001e-05 2024-09-12T00:04:15.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.645 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:15.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922093+0000", 2024-09-12T00:04:15.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0580000000000004e-06 2024-09-12T00:04:15.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.645 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:15.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936515+0000", 2024-09-12T00:04:15.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014421270999999999 2024-09-12T00:04:15.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.646 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:15.646 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936677+0000", 2024-09-12T00:04:15.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162003 2024-09-12T00:04:15.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.646 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:15.646 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936908+0000", 2024-09-12T00:04:15.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023115700000000001 2024-09-12T00:04:15.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.646 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:15.646 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939985+0000", 2024-09-12T00:04:15.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030773879999999999 2024-09-12T00:04:15.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:15.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942623+0000", 2024-09-12T00:04:15.647 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026377929999999998 2024-09-12T00:04:15.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:15.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942818+0000", 2024-09-12T00:04:15.647 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019556200000000001 2024-09-12T00:04:15.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:15.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943001+0000", 2024-09-12T00:04:15.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018235199999999999 2024-09-12T00:04:15.648 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.648 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:15.648 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.648 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.648 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:15.648 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:15.648 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.677023341999998, 2024-09-12T00:04:15.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021092493, 2024-09-12T00:04:15.648 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:15.648 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:15.648 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:15.648 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:15.649 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:15.649 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:15.649 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 51 2024-09-12T00:04:15.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.649 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:15.649 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.649 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:15.649 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:15.649 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.649 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.649 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:15.649 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:15.649 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.650 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:15.650 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922118+0000", 2024-09-12T00:04:15.650 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0389999999999999e-06 2024-09-12T00:04:15.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.650 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:15.650 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922124+0000", 2024-09-12T00:04:15.650 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5409999999999997e-06 2024-09-12T00:04:15.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:15.651 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922136+0000", 2024-09-12T00:04:15.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.205e-05 2024-09-12T00:04:15.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.651 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:15.651 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922147+0000", 2024-09-12T00:04:15.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0451e-05 2024-09-12T00:04:15.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.651 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:15.651 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938000+0000", 2024-09-12T00:04:15.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015853682000000001 2024-09-12T00:04:15.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.652 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:15.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938142+0000", 2024-09-12T00:04:15.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014148899999999999 2024-09-12T00:04:15.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.652 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:15.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938362+0000", 2024-09-12T00:04:15.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022034800000000001 2024-09-12T00:04:15.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.652 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:15.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940330+0000", 2024-09-12T00:04:15.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001967459 2024-09-12T00:04:15.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:15.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943064+0000", 2024-09-12T00:04:15.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027346219999999999 2024-09-12T00:04:15.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:15.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943152+0000", 2024-09-12T00:04:15.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7563000000000002e-05 2024-09-12T00:04:15.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:15.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943209+0000", 2024-09-12T00:04:15.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7249e-05 2024-09-12T00:04:15.654 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.654 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:15.654 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.654 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:15.654 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:15.654 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.676973848999999, 2024-09-12T00:04:15.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021175616000000001, 2024-09-12T00:04:15.654 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:15.654 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:15.654 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:15.654 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:15.655 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:15.655 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:15.655 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 52 2024-09-12T00:04:15.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.655 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:15.655 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.655 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:15.655 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:15.655 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.655 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.655 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:15.655 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:15.655 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.656 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.656 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:15.656 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922167+0000", 2024-09-12T00:04:15.656 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3300000000000001e-07 2024-09-12T00:04:15.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.656 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.656 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:15.656 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922174+0000", 2024-09-12T00:04:15.656 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7070000000000003e-06 2024-09-12T00:04:15.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.656 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.656 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:15.656 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922184+0000", 2024-09-12T00:04:15.656 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682e-05 2024-09-12T00:04:15.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.657 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:15.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922195+0000", 2024-09-12T00:04:15.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0489000000000001e-05 2024-09-12T00:04:15.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.657 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:15.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939166+0000", 2024-09-12T00:04:15.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016971245999999999 2024-09-12T00:04:15.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.657 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:15.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939243+0000", 2024-09-12T00:04:15.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7201999999999997e-05 2024-09-12T00:04:15.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:15.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939381+0000", 2024-09-12T00:04:15.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013770699999999999 2024-09-12T00:04:15.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:15.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940923+0000", 2024-09-12T00:04:15.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001542302 2024-09-12T00:04:15.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:15.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943221+0000", 2024-09-12T00:04:15.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022979720000000001 2024-09-12T00:04:15.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:15.659 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943295+0000", 2024-09-12T00:04:15.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3317000000000003e-05 2024-09-12T00:04:15.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:15.659 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943342+0000", 2024-09-12T00:04:15.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7159e-05 2024-09-12T00:04:15.659 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.659 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:15.659 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.660 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.660 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:15.660 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:15.660 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.428028883000003, 2024-09-12T00:04:15.660 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015229411999999999, 2024-09-12T00:04:15.660 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:15.660 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:15.660 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:15.660 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:15.660 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:15.660 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:15.660 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 67 2024-09-12T00:04:15.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.661 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:15.661 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.661 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:15.661 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:15.661 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.661 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.661 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:15.661 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:15.661 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.661 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.661 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:15.661 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171112+0000", 2024-09-12T00:04:15.661 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2899999999999999e-06 2024-09-12T00:04:15.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:15.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171119+0000", 2024-09-12T00:04:15.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8870000000000003e-06 2024-09-12T00:04:15.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:15.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171131+0000", 2024-09-12T00:04:15.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1902999999999999e-05 2024-09-12T00:04:15.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:15.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171147+0000", 2024-09-12T00:04:15.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6203000000000001e-05 2024-09-12T00:04:15.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:15.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175044+0000", 2024-09-12T00:04:15.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038967310000000001 2024-09-12T00:04:15.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:15.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175172+0000", 2024-09-12T00:04:15.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012784100000000001 2024-09-12T00:04:15.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:15.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175372+0000", 2024-09-12T00:04:15.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019978500000000001 2024-09-12T00:04:15.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:15.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179276+0000", 2024-09-12T00:04:15.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039042149999999999 2024-09-12T00:04:15.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:15.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186150+0000", 2024-09-12T00:04:15.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0068740019999999997 2024-09-12T00:04:15.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:15.665 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186266+0000", 2024-09-12T00:04:15.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115742 2024-09-12T00:04:15.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.665 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:15.665 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186340+0000", 2024-09-12T00:04:15.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4813000000000004e-05 2024-09-12T00:04:15.665 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.665 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:15.665 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.665 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:15.665 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:15.665 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.427967807000002, 2024-09-12T00:04:15.666 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015308448000000001, 2024-09-12T00:04:15.666 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:15.666 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:15.666 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:15.666 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:15.666 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:15.666 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:15.666 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 68 2024-09-12T00:04:15.666 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.666 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:15.667 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.667 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:15.667 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:15.667 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.667 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.667 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:15.667 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:15.667 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.667 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.667 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:15.667 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171173+0000", 2024-09-12T00:04:15.667 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:04:15.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.668 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:15.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171182+0000", 2024-09-12T00:04:15.668 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2359999999999993e-06 2024-09-12T00:04:15.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.668 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:15.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171193+0000", 2024-09-12T00:04:15.668 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.095e-05 2024-09-12T00:04:15.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.668 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:15.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171207+0000", 2024-09-12T00:04:15.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3339999999999999e-05 2024-09-12T00:04:15.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:15.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176753+0000", 2024-09-12T00:04:15.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055460240000000001 2024-09-12T00:04:15.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:15.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176921+0000", 2024-09-12T00:04:15.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000168503 2024-09-12T00:04:15.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:15.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177112+0000", 2024-09-12T00:04:15.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019113999999999999 2024-09-12T00:04:15.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:15.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179382+0000", 2024-09-12T00:04:15.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022697099999999999 2024-09-12T00:04:15.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:15.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186356+0000", 2024-09-12T00:04:15.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069741919999999997 2024-09-12T00:04:15.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:15.671 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186422+0000", 2024-09-12T00:04:15.671 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6387e-05 2024-09-12T00:04:15.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.671 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:15.671 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186481+0000", 2024-09-12T00:04:15.671 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8059000000000001e-05 2024-09-12T00:04:15.671 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.671 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:15.671 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.671 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:15.671 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:15.672 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.427916037000003, 2024-09-12T00:04:15.672 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020001835999999999, 2024-09-12T00:04:15.672 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:15.672 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:15.672 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:15.672 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:15.672 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:15.672 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:15.672 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 69 2024-09-12T00:04:15.672 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.672 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:15.672 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.672 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:15.672 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:15.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.673 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:15.673 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:15.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.673 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:15.673 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171225+0000", 2024-09-12T00:04:15.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0599999999999999e-07 2024-09-12T00:04:15.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.674 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:15.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171349+0000", 2024-09-12T00:04:15.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012407299999999999 2024-09-12T00:04:15.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.674 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:15.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171367+0000", 2024-09-12T00:04:15.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8413000000000001e-05 2024-09-12T00:04:15.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.674 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:15.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171376+0000", 2024-09-12T00:04:15.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8170000000000005e-06 2024-09-12T00:04:15.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:15.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177692+0000", 2024-09-12T00:04:15.675 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063156729999999999 2024-09-12T00:04:15.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:15.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177817+0000", 2024-09-12T00:04:15.675 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012581499999999999 2024-09-12T00:04:15.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:15.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.178015+0000", 2024-09-12T00:04:15.675 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019715100000000001 2024-09-12T00:04:15.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:15.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181798+0000", 2024-09-12T00:04:15.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003783308 2024-09-12T00:04:15.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:15.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190976+0000", 2024-09-12T00:04:15.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091776519999999997 2024-09-12T00:04:15.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:15.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191122+0000", 2024-09-12T00:04:15.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000145966 2024-09-12T00:04:15.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.677 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.677 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:15.677 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191226+0000", 2024-09-12T00:04:15.677 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104162 2024-09-12T00:04:15.677 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.677 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:15.677 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.677 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.677 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:15.677 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:15.677 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.427747302, 2024-09-12T00:04:15.677 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019997773, 2024-09-12T00:04:15.678 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:15.678 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:15.678 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:15.678 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:15.678 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:15.678 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:15.678 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 70 2024-09-12T00:04:15.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.678 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:15.678 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.678 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:15.678 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:15.678 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.678 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:15.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:15.679 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:15.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:15.679 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3699999999999999e-07 2024-09-12T00:04:15.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:15.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171403+0000", 2024-09-12T00:04:15.679 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6199999999999994e-06 2024-09-12T00:04:15.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:15.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171416+0000", 2024-09-12T00:04:15.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2636000000000001e-05 2024-09-12T00:04:15.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:15.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171423+0000", 2024-09-12T00:04:15.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5440000000000001e-06 2024-09-12T00:04:15.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:15.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179458+0000", 2024-09-12T00:04:15.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080351989999999998 2024-09-12T00:04:15.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.681 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:15.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179604+0000", 2024-09-12T00:04:15.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014519899999999999 2024-09-12T00:04:15.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.681 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:15.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179831+0000", 2024-09-12T00:04:15.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022704800000000001 2024-09-12T00:04:15.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.681 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:15.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181918+0000", 2024-09-12T00:04:15.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020873950000000001 2024-09-12T00:04:15.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:15.682 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191243+0000", 2024-09-12T00:04:15.682 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0093244729999999998 2024-09-12T00:04:15.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:15.682 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191309+0000", 2024-09-12T00:04:15.682 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6116000000000002e-05 2024-09-12T00:04:15.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:15.682 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191390+0000", 2024-09-12T00:04:15.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1705999999999993e-05 2024-09-12T00:04:15.683 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.683 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:15.683 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.683 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.683 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:15.683 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:15.683 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.427701229, 2024-09-12T00:04:15.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020263554, 2024-09-12T00:04:15.683 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:15.683 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:15.683 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:15.683 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:15.683 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:15.684 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:15.684 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 71 2024-09-12T00:04:15.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.684 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:15.684 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.684 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:15.684 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:15.684 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.684 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.684 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:15.684 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:15.684 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.685 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.685 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:15.685 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:15.685 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5000000000000002e-07 2024-09-12T00:04:15.685 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.685 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.685 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:15.685 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171454+0000", 2024-09-12T00:04:15.685 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5046e-05 2024-09-12T00:04:15.685 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.685 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.685 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:15.685 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171471+0000", 2024-09-12T00:04:15.685 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6923999999999999e-05 2024-09-12T00:04:15.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.686 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.686 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:15.686 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171487+0000", 2024-09-12T00:04:15.686 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5823000000000001e-05 2024-09-12T00:04:15.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.686 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.686 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:15.686 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180765+0000", 2024-09-12T00:04:15.686 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0092774399999999996 2024-09-12T00:04:15.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.686 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.686 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:15.686 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180900+0000", 2024-09-12T00:04:15.686 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013556700000000001 2024-09-12T00:04:15.687 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.687 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.687 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:15.687 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181108+0000", 2024-09-12T00:04:15.687 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020727899999999999 2024-09-12T00:04:15.687 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.687 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.687 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:15.687 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184725+0000", 2024-09-12T00:04:15.687 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036171340000000001 2024-09-12T00:04:15.687 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.687 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.687 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:15.687 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191413+0000", 2024-09-12T00:04:15.688 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066881830000000003 2024-09-12T00:04:15.688 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.688 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.688 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:15.688 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191540+0000", 2024-09-12T00:04:15.688 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000126823 2024-09-12T00:04:15.688 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.688 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.688 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:15.688 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191702+0000", 2024-09-12T00:04:15.688 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162585 2024-09-12T00:04:15.688 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.688 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:15.688 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.688 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.689 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.689 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:15.689 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:15.689 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.427622653, 2024-09-12T00:04:15.689 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020448573000000001, 2024-09-12T00:04:15.689 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:15.689 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:15.689 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:15.689 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:15.689 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:15.689 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:15.689 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 72 2024-09-12T00:04:15.689 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.689 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:15.690 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.690 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:15.690 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:15.690 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.690 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.690 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.690 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:15.690 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:15.690 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.690 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.690 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.690 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:15.690 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171518+0000", 2024-09-12T00:04:15.690 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0440000000000001e-06 2024-09-12T00:04:15.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.691 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.691 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:15.691 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171647+0000", 2024-09-12T00:04:15.691 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012912899999999999 2024-09-12T00:04:15.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.691 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.691 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:15.691 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171664+0000", 2024-09-12T00:04:15.691 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6079999999999999e-05 2024-09-12T00:04:15.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.691 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.691 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:15.691 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171675+0000", 2024-09-12T00:04:15.691 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1223000000000001e-05 2024-09-12T00:04:15.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.692 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.692 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:15.692 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182000+0000", 2024-09-12T00:04:15.692 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010324949 2024-09-12T00:04:15.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.692 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.692 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:15.692 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182178+0000", 2024-09-12T00:04:15.692 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017808799999999999 2024-09-12T00:04:15.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.692 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.692 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:15.692 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182402+0000", 2024-09-12T00:04:15.693 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022381199999999999 2024-09-12T00:04:15.693 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.693 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.693 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:15.693 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190935+0000", 2024-09-12T00:04:15.693 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085331560000000001 2024-09-12T00:04:15.693 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.693 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.693 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:15.693 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191728+0000", 2024-09-12T00:04:15.693 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079325700000000001 2024-09-12T00:04:15.693 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.693 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.694 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:15.694 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191864+0000", 2024-09-12T00:04:15.694 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013606299999999999 2024-09-12T00:04:15.694 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.694 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.694 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:15.694 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191966+0000", 2024-09-12T00:04:15.694 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101772 2024-09-12T00:04:15.694 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.694 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:15.694 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.694 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.694 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.694 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:15.694 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:15.695 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.427439458000002, 2024-09-12T00:04:15.695 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020675235, 2024-09-12T00:04:15.695 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:15.695 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:15.695 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:15.695 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:15.695 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:15.695 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:15.695 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 73 2024-09-12T00:04:15.695 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.695 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:15.695 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.695 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:15.695 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:15.696 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.696 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.696 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.696 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:15.696 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:15.696 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.696 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.696 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.696 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:15.696 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171701+0000", 2024-09-12T00:04:15.696 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0999999999999997e-07 2024-09-12T00:04:15.696 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.696 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.696 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:15.697 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171709+0000", 2024-09-12T00:04:15.697 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2540000000000003e-06 2024-09-12T00:04:15.697 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.697 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.697 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:15.697 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171724+0000", 2024-09-12T00:04:15.697 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5569e-05 2024-09-12T00:04:15.697 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.697 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.697 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:15.697 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171734+0000", 2024-09-12T00:04:15.697 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6139999999999998e-06 2024-09-12T00:04:15.697 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.697 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.698 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:15.698 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183774+0000", 2024-09-12T00:04:15.698 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012040444000000001 2024-09-12T00:04:15.698 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.698 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.698 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:15.698 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183896+0000", 2024-09-12T00:04:15.698 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012204199999999999 2024-09-12T00:04:15.698 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.698 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.698 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:15.698 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184084+0000", 2024-09-12T00:04:15.698 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018792599999999999 2024-09-12T00:04:15.698 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.699 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.699 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:15.699 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191984+0000", 2024-09-12T00:04:15.699 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079003790000000008 2024-09-12T00:04:15.699 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.699 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.699 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:15.699 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192093+0000", 2024-09-12T00:04:15.699 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000108942 2024-09-12T00:04:15.699 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.699 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.699 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:15.699 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192250+0000", 2024-09-12T00:04:15.699 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015637600000000001 2024-09-12T00:04:15.699 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.700 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.700 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:15.700 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192376+0000", 2024-09-12T00:04:15.700 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012587899999999999 2024-09-12T00:04:15.700 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.700 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:15.700 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.700 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.700 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.700 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:15.700 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:15.700 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.427391247999999, 2024-09-12T00:04:15.700 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021088828, 2024-09-12T00:04:15.701 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:15.701 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:15.701 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:15.701 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:15.701 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:15.701 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:15.701 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 74 2024-09-12T00:04:15.701 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.701 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:15.701 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.701 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:15.701 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:15.701 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.701 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.702 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.702 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:15.702 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:15.702 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.702 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.702 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.702 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:15.702 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:15.702 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1699999999999997e-07 2024-09-12T00:04:15.702 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.702 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.702 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:15.702 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171758+0000", 2024-09-12T00:04:15.702 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0860000000000008e-06 2024-09-12T00:04:15.702 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.703 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.703 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:15.703 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171774+0000", 2024-09-12T00:04:15.703 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:04:15.703 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.703 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.703 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:15.703 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171788+0000", 2024-09-12T00:04:15.703 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4793999999999999e-05 2024-09-12T00:04:15.703 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.703 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.703 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:15.703 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184842+0000", 2024-09-12T00:04:15.703 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013053607 2024-09-12T00:04:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185130+0000", 2024-09-12T00:04:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00028779199999999998 2024-09-12T00:04:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185378+0000", 2024-09-12T00:04:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024780100000000002 2024-09-12T00:04:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:15.704 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192513+0000", 2024-09-12T00:04:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071350770000000001 2024-09-12T00:04:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192690+0000", 2024-09-12T00:04:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000176892 2024-09-12T00:04:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192769+0000", 2024-09-12T00:04:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9466000000000001e-05 2024-09-12T00:04:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:15.705 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192837+0000", 2024-09-12T00:04:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8466000000000005e-05 2024-09-12T00:04:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.427338671000001, 2024-09-12T00:04:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.02121994, 2024-09-12T00:04:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:15.706 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 75 2024-09-12T00:04:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171802+0000", 2024-09-12T00:04:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5000000000000002e-07 2024-09-12T00:04:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171954+0000", 2024-09-12T00:04:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015215500000000001 2024-09-12T00:04:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171966+0000", 2024-09-12T00:04:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1548e-05 2024-09-12T00:04:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171970+0000", 2024-09-12T00:04:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8729999999999998e-06 2024-09-12T00:04:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186552+0000", 2024-09-12T00:04:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014581775 2024-09-12T00:04:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186702+0000", 2024-09-12T00:04:15.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014946 2024-09-12T00:04:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186897+0000", 2024-09-12T00:04:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000195071 2024-09-12T00:04:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192666+0000", 2024-09-12T00:04:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057693470000000002 2024-09-12T00:04:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:15.710 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192857+0000", 2024-09-12T00:04:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191149 2024-09-12T00:04:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192967+0000", 2024-09-12T00:04:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110202 2024-09-12T00:04:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193021+0000", 2024-09-12T00:04:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3709999999999999e-05 2024-09-12T00:04:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.427159375999999, 2024-09-12T00:04:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026297425999999999, 2024-09-12T00:04:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 76 2024-09-12T00:04:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.712 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:15.713 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.713 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:15.713 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:15.713 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.713 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.713 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.713 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:15.713 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:15.713 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:15.713 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.713 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.713 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:15.713 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:15.713 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9399999999999995e-07 2024-09-12T00:04:15.714 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.714 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.714 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:15.714 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171987+0000", 2024-09-12T00:04:15.714 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5230000000000003e-06 2024-09-12T00:04:15.714 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.714 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.714 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:15.714 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172005+0000", 2024-09-12T00:04:15.714 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8788e-05 2024-09-12T00:04:15.714 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.714 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.714 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:15.714 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172010+0000", 2024-09-12T00:04:15.715 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7570000000000004e-06 2024-09-12T00:04:15.715 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.715 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.715 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:15.715 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193104+0000", 2024-09-12T00:04:15.715 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021094112000000002 2024-09-12T00:04:15.715 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.715 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.715 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:15.715 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193334+0000", 2024-09-12T00:04:15.715 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000229855 2024-09-12T00:04:15.715 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.715 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.715 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:15.715 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193697+0000", 2024-09-12T00:04:15.716 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00036272399999999998 2024-09-12T00:04:15.716 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.716 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.716 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:15.716 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.195602+0000", 2024-09-12T00:04:15.716 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019049620000000001 2024-09-12T00:04:15.716 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.716 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.716 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:15.716 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198123+0000", 2024-09-12T00:04:15.716 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025216520000000001 2024-09-12T00:04:15.716 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.716 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.716 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:15.717 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198213+0000", 2024-09-12T00:04:15.717 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0008999999999998e-05 2024-09-12T00:04:15.717 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:15.717 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:15.717 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:15.717 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198278+0000", 2024-09-12T00:04:15.717 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4549999999999997e-05 2024-09-12T00:04:15.717 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.717 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:15.717 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.717 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:15.717 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:15.717 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:15.718 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:04:15.719 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:15.719+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:15.720 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:04:15.720 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T00:04:15.721 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-12T00:04:15.783 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:04:15.820 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:15.819+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:15.920 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:15.917+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:15.941 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:15.941 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:15.942 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:15.942 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:15.962 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:04:16.018 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:16.019 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:16.021 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:16.017+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:16.064 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:16.064 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:16.095 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:16.096 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:16.122 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:16.123+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:16.132 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:16.132 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:16.172 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:16.172 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:16.177 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:16.177 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:16.195 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:04:16.210 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:16.210 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:16.253 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:16.254 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:16.254 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:16.253+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:16.277 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:16.277 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:16.337 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:16.337+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:16.398 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:16.398 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:16.417 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:04:16.425 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:16.427+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:16.526 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:16.525+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:16.615 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:16.615 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:16.622 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:04:16.633 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T00:04:16.634 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:16.633+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:16.639 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.3 to 1 (10000) 2024-09-12T00:04:16.670 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-12T00:04:16.728 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:16.727+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:16.799 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:16.799 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:16.818 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:04:16.861 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:16.861+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:16.930 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:16.929+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:16.991 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:16.991 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:17.009 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:04:17.057 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:17.059+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:17.131 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:17.131+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:17.140 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:17.140 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:17.154 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:04:17.232 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:17.229+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:17.322 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:17.322 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:17.334 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:17.333+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:17.336 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:04:17.435 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:17.433+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:17.455 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:17.455 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:17.469 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:04:17.537 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:17.533+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:17.599 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:17.599 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:17.614 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:04:17.637 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:17.633+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:17.640 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.4 to 1 (10000) 2024-09-12T00:04:17.664 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-12T00:04:17.735 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:17.735 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:17.736 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:17.735+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:17.749 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:04:17.841 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:17.843+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:17.921 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:17.921 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:17.935 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:04:17.981 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:17.983+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:18.039 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:18.039+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:18.106 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:18.106 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:18.122 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:04:18.139 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:18.137+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:18.241 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:18.239+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:18.290 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:18.290 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:18.295 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:04:18.304 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:04:18.346 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:18.347+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:18.442 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:18.441+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:18.466 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:18.466 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:18.481 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:04:18.495 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:18.495 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:18.526 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:18.527 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:18.543 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:18.541+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:18.557 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:18.557 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:18.588 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:18.588 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:18.598 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:18.598 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:18.612 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:04:18.621 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:18.622 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:18.641 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.5 to 1 (10000) 2024-09-12T00:04:18.654 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:18.654 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:18.661 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:18.663+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:18.668 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-12T00:04:18.670 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T00:04:18.685 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:18.685 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:18.717 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:18.717 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:18.737 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:18.737 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:04:18.737 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:04:18.737 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:04:18.737 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:18.745 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:18.747+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:18.751 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:04:18.846 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:18.847+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:18.923 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:18.923 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:04:18.923 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:04:18.924 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:04:18.924 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.924 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:18.924 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:04:18.924 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 47.435066927999998, 2024-09-12T00:04:18.924 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0032495720000000001, 2024-09-12T00:04:18.925 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:18.925 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:18.925 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:18.925 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:18.925 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:18.925 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:18.925 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 193 2024-09-12T00:04:18.925 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.926 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:18.926 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.926 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:18.926 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:04:18.926 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.926 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.926 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.926 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:18.927 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:04:18.927 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.927 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.927 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:18.927 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486926+0000", 2024-09-12T00:04:18.927 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.463e-06 2024-09-12T00:04:18.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.928 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.928 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:18.928 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486937+0000", 2024-09-12T00:04:18.928 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1147e-05 2024-09-12T00:04:18.928 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.928 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.928 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:18.929 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486968+0000", 2024-09-12T00:04:18.929 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1077000000000001e-05 2024-09-12T00:04:18.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.929 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.929 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:18.929 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486985+0000", 2024-09-12T00:04:18.929 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6399e-05 2024-09-12T00:04:18.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.930 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.930 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:18.930 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487139+0000", 2024-09-12T00:04:18.930 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015403199999999999 2024-09-12T00:04:18.930 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.930 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.931 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:18.931 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487375+0000", 2024-09-12T00:04:18.931 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023621499999999999 2024-09-12T00:04:18.931 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.931 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.931 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:18.931 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487634+0000", 2024-09-12T00:04:18.931 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000259351 2024-09-12T00:04:18.932 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.932 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.932 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:18.932 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.489156+0000", 2024-09-12T00:04:18.933 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015213869999999999 2024-09-12T00:04:18.933 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.933 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.933 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:18.933 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.489974+0000", 2024-09-12T00:04:18.933 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00081855600000000001 2024-09-12T00:04:18.933 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.933 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.933 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:18.933 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.490064+0000", 2024-09-12T00:04:18.933 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9205999999999999e-05 2024-09-12T00:04:18.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.934 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.934 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:18.934 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.490173+0000", 2024-09-12T00:04:18.934 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109739 2024-09-12T00:04:18.934 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:18.934 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:18.934 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:18.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.935 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.935 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:04:18.935 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:04:18.935 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 44.558627385000001, 2024-09-12T00:04:18.935 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039523630000000004, 2024-09-12T00:04:18.935 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:18.935 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:18.936 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:18.936 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:18.936 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:18.936 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:18.936 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 208 2024-09-12T00:04:18.936 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.937 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:18.937 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.937 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:18.937 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:04:18.937 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.937 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.937 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.937 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:18.937 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:04:18.937 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.938 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.938 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:18.938 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363366+0000", 2024-09-12T00:04:18.938 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.004e-06 2024-09-12T00:04:18.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.938 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.938 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:18.938 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363379+0000", 2024-09-12T00:04:18.938 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2943e-05 2024-09-12T00:04:18.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.938 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.939 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:18.939 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363412+0000", 2024-09-12T00:04:18.939 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2808999999999997e-05 2024-09-12T00:04:18.939 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.939 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.939 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:18.939 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363430+0000", 2024-09-12T00:04:18.939 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8003e-05 2024-09-12T00:04:18.939 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.939 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.939 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:18.940 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363654+0000", 2024-09-12T00:04:18.940 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022394900000000001 2024-09-12T00:04:18.940 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.940 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.940 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:18.940 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363897+0000", 2024-09-12T00:04:18.940 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024272399999999999 2024-09-12T00:04:18.940 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.940 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.941 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:18.941 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.364326+0000", 2024-09-12T00:04:18.941 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042963399999999997 2024-09-12T00:04:18.941 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.942 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.942 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:18.942 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.365757+0000", 2024-09-12T00:04:18.942 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014303969999999999 2024-09-12T00:04:18.942 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.942 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.942 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:18.942 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367031+0000", 2024-09-12T00:04:18.942 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001274269 2024-09-12T00:04:18.942 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.942 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.942 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:18.943 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367197+0000", 2024-09-12T00:04:18.943 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016645900000000001 2024-09-12T00:04:18.943 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.943 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.943 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:18.943 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367316+0000", 2024-09-12T00:04:18.943 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011817200000000001 2024-09-12T00:04:18.943 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:18.943 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:18.943 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:18.943 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.943 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.943 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:18.944 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:04:18.944 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 44.501369081, 2024-09-12T00:04:18.944 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033190419999999999, 2024-09-12T00:04:18.944 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:18.944 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:18.944 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:18.944 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:18.944 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:18.944 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:18.944 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 219 2024-09-12T00:04:18.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.944 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:18.944 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.944 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:18.945 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:04:18.945 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.945 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:18.945 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:04:18.945 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.945 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:18.945 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420624+0000", 2024-09-12T00:04:18.945 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0829999999999998e-06 2024-09-12T00:04:18.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.946 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.946 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:18.946 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420633+0000", 2024-09-12T00:04:18.946 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8500000000000006e-06 2024-09-12T00:04:18.946 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.946 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.946 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:18.946 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420663+0000", 2024-09-12T00:04:18.946 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9597000000000001e-05 2024-09-12T00:04:18.946 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.947 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.947 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:18.947 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420681+0000", 2024-09-12T00:04:18.947 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7646e-05 2024-09-12T00:04:18.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.947 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.947 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:18.947 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420791+0000", 2024-09-12T00:04:18.947 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109979 2024-09-12T00:04:18.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.947 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.947 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:18.947 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.421042+0000", 2024-09-12T00:04:18.948 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025117199999999997 2024-09-12T00:04:18.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.948 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:18.948 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.421487+0000", 2024-09-12T00:04:18.948 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00044476599999999998 2024-09-12T00:04:18.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.948 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:18.948 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.422884+0000", 2024-09-12T00:04:18.948 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0013975109999999999 2024-09-12T00:04:18.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.949 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:18.949 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423797+0000", 2024-09-12T00:04:18.949 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00091310899999999995 2024-09-12T00:04:18.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.949 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:18.949 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423879+0000", 2024-09-12T00:04:18.949 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1829000000000005e-05 2024-09-12T00:04:18.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.950 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.950 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:18.950 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423941+0000", 2024-09-12T00:04:18.950 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1500000000000004e-05 2024-09-12T00:04:18.950 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:18.950 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:18.950 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:18.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.950 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.951 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:18.951 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:04:18.951 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 44.483728481999997, 2024-09-12T00:04:18.951 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003232782, 2024-09-12T00:04:18.951 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:18.951 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:18.951 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:18.951 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:18.952 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:18.952 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:18.952 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 224 2024-09-12T00:04:18.952 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.952 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:18.952 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.952 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:18.952 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:04:18.952 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.952 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.952 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.952 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:18.953 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:04:18.953 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.953 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.953 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.953 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:18.953 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438265+0000", 2024-09-12T00:04:18.953 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.666e-06 2024-09-12T00:04:18.953 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.953 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.953 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:18.953 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438276+0000", 2024-09-12T00:04:18.953 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1387e-05 2024-09-12T00:04:18.953 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.953 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.954 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:18.954 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438306+0000", 2024-09-12T00:04:18.954 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0069999999999998e-05 2024-09-12T00:04:18.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.954 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.954 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:18.954 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438321+0000", 2024-09-12T00:04:18.954 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.517e-05 2024-09-12T00:04:18.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.954 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.954 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:18.954 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438459+0000", 2024-09-12T00:04:18.954 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013781899999999999 2024-09-12T00:04:18.955 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.955 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.955 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:18.955 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438671+0000", 2024-09-12T00:04:18.955 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021214500000000001 2024-09-12T00:04:18.955 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.955 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.955 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:18.955 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.439093+0000", 2024-09-12T00:04:18.955 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042117899999999999 2024-09-12T00:04:18.955 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.955 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.955 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:18.956 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.440400+0000", 2024-09-12T00:04:18.956 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0013072719999999999 2024-09-12T00:04:18.956 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.956 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.956 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:18.956 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441339+0000", 2024-09-12T00:04:18.956 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00093906600000000001 2024-09-12T00:04:18.956 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.956 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.956 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:18.956 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441429+0000", 2024-09-12T00:04:18.956 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0358999999999993e-05 2024-09-12T00:04:18.956 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.957 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.957 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:18.957 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441495+0000", 2024-09-12T00:04:18.957 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5648999999999994e-05 2024-09-12T00:04:18.957 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:18.957 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:18.957 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:18.957 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.957 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.957 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:18.957 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:04:18.957 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 44.44422951, 2024-09-12T00:04:18.957 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003225716, 2024-09-12T00:04:18.957 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:18.958 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:18.958 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:18.958 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:18.958 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:18.958 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:18.958 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 235 2024-09-12T00:04:18.958 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.958 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:18.958 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.958 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:18.958 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:04:18.958 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.958 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.958 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.959 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:18.959 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:04:18.959 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.959 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.959 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.959 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:18.959 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477764+0000", 2024-09-12T00:04:18.959 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.48e-06 2024-09-12T00:04:18.959 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.959 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.959 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:18.959 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477775+0000", 2024-09-12T00:04:18.959 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1163e-05 2024-09-12T00:04:18.959 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.959 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.960 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:18.960 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477807+0000", 2024-09-12T00:04:18.960 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1860000000000003e-05 2024-09-12T00:04:18.960 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.960 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.960 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:18.960 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477822+0000", 2024-09-12T00:04:18.960 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5302999999999999e-05 2024-09-12T00:04:18.960 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.960 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.960 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:18.960 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477959+0000", 2024-09-12T00:04:18.960 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013695600000000001 2024-09-12T00:04:18.961 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.961 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.961 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:18.961 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.478184+0000", 2024-09-12T00:04:18.961 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022484800000000001 2024-09-12T00:04:18.961 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.961 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.962 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:18.962 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.478657+0000", 2024-09-12T00:04:18.962 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000473413 2024-09-12T00:04:18.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.962 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.962 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:18.962 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480162+0000", 2024-09-12T00:04:18.962 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00150454 2024-09-12T00:04:18.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.962 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.962 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:18.962 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480792+0000", 2024-09-12T00:04:18.963 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00063012400000000003 2024-09-12T00:04:18.963 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.963 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.963 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:18.963 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480906+0000", 2024-09-12T00:04:18.963 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113909 2024-09-12T00:04:18.963 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.963 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.963 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:18.963 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480987+0000", 2024-09-12T00:04:18.963 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1119999999999996e-05 2024-09-12T00:04:18.963 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:18.963 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:18.963 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:18.964 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.964 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.964 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:237 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:18.964 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:04:18.964 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 44.436908139000003, 2024-09-12T00:04:18.964 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0074291790000000002, 2024-09-12T00:04:18.964 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:18.964 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:18.964 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:18.965 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:18.965 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:18.965 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:18.965 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 237 2024-09-12T00:04:18.965 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.965 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:18.965 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.965 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:18.965 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:04:18.965 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.965 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.965 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.965 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:18.965 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:04:18.966 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.966 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.966 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:18.966 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485086+0000", 2024-09-12T00:04:18.966 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.05e-06 2024-09-12T00:04:18.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.966 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.966 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:18.966 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485101+0000", 2024-09-12T00:04:18.966 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5186e-05 2024-09-12T00:04:18.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.966 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.967 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:18.967 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485140+0000", 2024-09-12T00:04:18.967 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8896000000000002e-05 2024-09-12T00:04:18.967 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.967 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.967 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:18.967 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485162+0000", 2024-09-12T00:04:18.968 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2654e-05 2024-09-12T00:04:18.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.968 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.968 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:18.968 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485314+0000", 2024-09-12T00:04:18.968 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015150799999999999 2024-09-12T00:04:18.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.968 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.968 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:18.968 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485549+0000", 2024-09-12T00:04:18.968 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000235665 2024-09-12T00:04:18.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.968 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.969 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:18.969 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486064+0000", 2024-09-12T00:04:18.969 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00051418899999999997 2024-09-12T00:04:18.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.969 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.969 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:18.969 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.488211+0000", 2024-09-12T00:04:18.969 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0021470819999999998 2024-09-12T00:04:18.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.969 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.969 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:18.969 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492273+0000", 2024-09-12T00:04:18.969 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040617980000000001 2024-09-12T00:04:18.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.970 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.970 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:18.970 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492391+0000", 2024-09-12T00:04:18.970 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118613 2024-09-12T00:04:18.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.970 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.970 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:18.970 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492512+0000", 2024-09-12T00:04:18.970 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120538 2024-09-12T00:04:18.970 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:18.970 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:18.970 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:18.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.971 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.971 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:244 6.17 e35/29 6:e9187ab8:reshard::reshard.0000000000:head v 35'1, mlcod=0'0)", 2024-09-12T00:04:18.971 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:04:18.971 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 44.434325903999998, 2024-09-12T00:04:18.971 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0034313239999999999, 2024-09-12T00:04:18.971 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:18.971 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:18.971 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:18.971 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:18.971 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.971 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:18.971 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:04:18.971 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.972 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.972 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:18.972 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:04:18.972 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.972 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.972 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.972 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:18.972 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487667+0000", 2024-09-12T00:04:18.972 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4899999999999999e-06 2024-09-12T00:04:18.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.973 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:18.973 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487682+0000", 2024-09-12T00:04:18.973 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4929999999999999e-05 2024-09-12T00:04:18.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.973 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:18.973 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487740+0000", 2024-09-12T00:04:18.973 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8075000000000002e-05 2024-09-12T00:04:18.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.974 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:18.974 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487761+0000", 2024-09-12T00:04:18.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0769999999999999e-05 2024-09-12T00:04:18.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.974 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:18.974 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487966+0000", 2024-09-12T00:04:18.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020516800000000001 2024-09-12T00:04:18.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.974 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:18.974 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.488012+0000", 2024-09-12T00:04:18.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5794000000000002e-05 2024-09-12T00:04:18.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.975 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:18.975 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.490965+0000", 2024-09-12T00:04:18.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0029530609999999999 2024-09-12T00:04:18.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.975 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:18.975 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491096+0000", 2024-09-12T00:04:18.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013103600000000001 2024-09-12T00:04:18.975 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:18.975 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:18.975 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:18.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.976 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:293 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:18.976 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:04:18.976 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 44.424374083000004, 2024-09-12T00:04:18.976 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0075915649999999998, 2024-09-12T00:04:18.976 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:18.976 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:18.976 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:18.976 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:18.976 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:18.976 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:18.976 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 293 2024-09-12T00:04:18.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.976 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:18.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.977 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:18.977 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:04:18.977 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.977 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:18.977 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:04:18.977 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.977 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:18.977 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497626+0000", 2024-09-12T00:04:18.977 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2499999999999995e-06 2024-09-12T00:04:18.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.978 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:18.978 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497636+0000", 2024-09-12T00:04:18.978 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0139999999999999e-05 2024-09-12T00:04:18.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.978 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:18.978 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497660+0000", 2024-09-12T00:04:18.978 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4015999999999998e-05 2024-09-12T00:04:18.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.978 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:18.979 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497675+0000", 2024-09-12T00:04:18.979 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5339999999999999e-05 2024-09-12T00:04:18.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.979 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.979 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:18.979 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497839+0000", 2024-09-12T00:04:18.979 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016347900000000001 2024-09-12T00:04:18.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.979 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.980 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:18.980 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498097+0000", 2024-09-12T00:04:18.980 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025825700000000002 2024-09-12T00:04:18.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.980 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:18.980 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498618+0000", 2024-09-12T00:04:18.980 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052051300000000001 2024-09-12T00:04:18.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.980 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:18.980 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.501282+0000", 2024-09-12T00:04:18.981 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026646840000000001 2024-09-12T00:04:18.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.981 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:18.981 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505057+0000", 2024-09-12T00:04:18.981 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037747710000000001 2024-09-12T00:04:18.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.981 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:18.981 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505144+0000", 2024-09-12T00:04:18.981 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7466000000000006e-05 2024-09-12T00:04:18.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.982 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:18.982 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505208+0000", 2024-09-12T00:04:18.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3649e-05 2024-09-12T00:04:18.982 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:18.982 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:18.982 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:18.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.982 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:413 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:18.982 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:04:18.982 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 44.393334471000003, 2024-09-12T00:04:18.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005252049, 2024-09-12T00:04:18.982 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:18.982 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:18.983 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:18.983 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:18.983 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:18.983 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:18.983 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 413 2024-09-12T00:04:18.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.983 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:18.983 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.983 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:18.983 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:04:18.983 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.984 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.984 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:18.984 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:04:18.984 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.984 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.984 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:18.984 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528659+0000", 2024-09-12T00:04:18.984 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4739999999999999e-06 2024-09-12T00:04:18.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.984 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.984 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:18.985 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528669+0000", 2024-09-12T00:04:18.985 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0694e-05 2024-09-12T00:04:18.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.985 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:18.985 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528696+0000", 2024-09-12T00:04:18.985 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6846e-05 2024-09-12T00:04:18.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.986 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:18.986 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528711+0000", 2024-09-12T00:04:18.986 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4397e-05 2024-09-12T00:04:18.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.986 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:18.986 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528884+0000", 2024-09-12T00:04:18.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017304700000000001 2024-09-12T00:04:18.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.987 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:18.987 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529162+0000", 2024-09-12T00:04:18.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027861999999999999 2024-09-12T00:04:18.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.987 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:18.987 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529688+0000", 2024-09-12T00:04:18.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052593900000000001 2024-09-12T00:04:18.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.988 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:18.988 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.531480+0000", 2024-09-12T00:04:18.988 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0017920740000000001 2024-09-12T00:04:18.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.988 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:18.988 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533734+0000", 2024-09-12T00:04:18.988 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002254191 2024-09-12T00:04:18.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.988 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:18.988 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533845+0000", 2024-09-12T00:04:18.989 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110559 2024-09-12T00:04:18.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.989 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:18.989 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533908+0000", 2024-09-12T00:04:18.989 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3207999999999995e-05 2024-09-12T00:04:18.989 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:18.989 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:18.989 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:18.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.989 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:437 6.0 6:05588ce8:lc::lc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:18.989 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:04:18.990 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 44.386158981999998, 2024-09-12T00:04:18.990 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039419659999999999, 2024-09-12T00:04:18.990 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:18.990 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:18.990 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:18.990 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:18.990 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:18.990 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:18.990 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 437 2024-09-12T00:04:18.990 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.990 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:18.990 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.990 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:18.991 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:04:18.991 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.991 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.991 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:18.991 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:04:18.991 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.991 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.991 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:18.991 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535834+0000", 2024-09-12T00:04:18.991 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2859999999999998e-06 2024-09-12T00:04:18.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.992 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.992 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:18.992 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535846+0000", 2024-09-12T00:04:18.992 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1643e-05 2024-09-12T00:04:18.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.992 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.992 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:18.992 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535877+0000", 2024-09-12T00:04:18.992 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1457000000000001e-05 2024-09-12T00:04:18.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.992 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.992 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:18.992 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535894+0000", 2024-09-12T00:04:18.992 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.668e-05 2024-09-12T00:04:18.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.993 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:18.993 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535981+0000", 2024-09-12T00:04:18.993 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6823000000000005e-05 2024-09-12T00:04:18.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.993 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:18.993 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536086+0000", 2024-09-12T00:04:18.993 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010566200000000001 2024-09-12T00:04:18.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.993 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:18.994 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536330+0000", 2024-09-12T00:04:18.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024399999999999999 2024-09-12T00:04:18.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.994 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:18.994 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538288+0000", 2024-09-12T00:04:18.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0019575740000000001 2024-09-12T00:04:18.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.994 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:18.994 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539574+0000", 2024-09-12T00:04:18.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012862259999999999 2024-09-12T00:04:18.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.995 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:18.995 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539696+0000", 2024-09-12T00:04:18.995 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012190599999999999 2024-09-12T00:04:18.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.995 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.995 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:18.995 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539774+0000", 2024-09-12T00:04:18.995 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7708999999999997e-05 2024-09-12T00:04:18.995 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:18.995 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:18.995 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:18.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.995 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.996 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:464 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:18.996 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:04:18.996 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 44.377597999999999, 2024-09-12T00:04:18.996 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048192310000000002, 2024-09-12T00:04:18.996 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:18.996 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:18.996 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:18.996 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:18.996 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:18.996 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:18.996 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 464 2024-09-12T00:04:18.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.996 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:18.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.997 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:18.997 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:04:18.997 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.997 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.997 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:18.997 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:04:18.997 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:18.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.997 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.997 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:18.997 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544395+0000", 2024-09-12T00:04:18.997 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.905e-06 2024-09-12T00:04:18.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.998 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.998 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:18.998 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544405+0000", 2024-09-12T00:04:18.998 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0583e-05 2024-09-12T00:04:18.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.998 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.998 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:18.998 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544435+0000", 2024-09-12T00:04:18.998 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9431e-05 2024-09-12T00:04:18.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.998 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.998 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:18.998 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544468+0000", 2024-09-12T00:04:18.999 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2978999999999997e-05 2024-09-12T00:04:18.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.999 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:18.999 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544573+0000", 2024-09-12T00:04:18.999 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105165 2024-09-12T00:04:18.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:18.999 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:18.999 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544714+0000", 2024-09-12T00:04:18.999 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000141061 2024-09-12T00:04:18.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:18.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.000 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:19.000 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.545414+0000", 2024-09-12T00:04:19.000 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00070066200000000001 2024-09-12T00:04:19.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.000 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.000 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:19.000 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.547475+0000", 2024-09-12T00:04:19.000 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020609119999999998 2024-09-12T00:04:19.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.000 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.000 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.000 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549067+0000", 2024-09-12T00:04:19.000 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015914989999999999 2024-09-12T00:04:19.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.001 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.001 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:19.001 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549143+0000", 2024-09-12T00:04:19.001 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5795000000000002e-05 2024-09-12T00:04:19.001 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.001 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.001 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:19.001 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549212+0000", 2024-09-12T00:04:19.001 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9239000000000006e-05 2024-09-12T00:04:19.001 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:19.001 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:19.001 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:19.001 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.002 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.002 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:495 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:19.002 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:04:19.002 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 44.366528502000001, 2024-09-12T00:04:19.002 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052520209999999999, 2024-09-12T00:04:19.002 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:19.002 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:19.002 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.002 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:19.002 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:19.002 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.002 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 495 2024-09-12T00:04:19.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.002 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:19.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.003 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:19.003 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:04:19.003 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:19.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.003 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:19.003 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:04:19.003 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:19.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.003 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:19.003 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555464+0000", 2024-09-12T00:04:19.004 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8870000000000001e-06 2024-09-12T00:04:19.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.004 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:19.004 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555473+0000", 2024-09-12T00:04:19.004 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2399999999999996e-06 2024-09-12T00:04:19.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.004 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:19.004 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555496+0000", 2024-09-12T00:04:19.004 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2952e-05 2024-09-12T00:04:19.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.005 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.005 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555508+0000", 2024-09-12T00:04:19.005 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1548e-05 2024-09-12T00:04:19.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.005 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:19.005 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555596+0000", 2024-09-12T00:04:19.005 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8295999999999996e-05 2024-09-12T00:04:19.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.005 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:19.005 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555683+0000", 2024-09-12T00:04:19.005 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7267000000000003e-05 2024-09-12T00:04:19.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.006 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:19.006 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555862+0000", 2024-09-12T00:04:19.006 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017910699999999999 2024-09-12T00:04:19.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.006 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:19.006 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.556696+0000", 2024-09-12T00:04:19.006 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000833353 2024-09-12T00:04:19.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.006 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.006 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560563+0000", 2024-09-12T00:04:19.007 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038672089999999999 2024-09-12T00:04:19.007 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.007 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.007 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:19.007 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560642+0000", 2024-09-12T00:04:19.007 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.8909e-05 2024-09-12T00:04:19.007 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.007 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.007 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:19.007 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560714+0000", 2024-09-12T00:04:19.007 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2253000000000001e-05 2024-09-12T00:04:19.007 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:19.007 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:19.007 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:19.008 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.008 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.008 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:631 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:19.008 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:04:19.008 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 44.330700948, 2024-09-12T00:04:19.008 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0072389480000000003, 2024-09-12T00:04:19.008 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:19.008 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:19.008 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.008 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:19.008 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:19.008 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.008 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 631 2024-09-12T00:04:19.009 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.009 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:19.009 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.009 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:19.009 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:04:19.009 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:19.009 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.009 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.009 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:19.009 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:04:19.009 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:19.009 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.009 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.009 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:19.010 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591292+0000", 2024-09-12T00:04:19.010 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0760000000000001e-06 2024-09-12T00:04:19.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.010 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.010 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:19.010 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591301+0000", 2024-09-12T00:04:19.010 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3880000000000006e-06 2024-09-12T00:04:19.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.010 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.010 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:19.010 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591323+0000", 2024-09-12T00:04:19.010 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2121999999999999e-05 2024-09-12T00:04:19.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.010 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.011 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.011 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591338+0000", 2024-09-12T00:04:19.011 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5126999999999999e-05 2024-09-12T00:04:19.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.011 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.011 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:19.011 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591449+0000", 2024-09-12T00:04:19.011 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011054500000000001 2024-09-12T00:04:19.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.011 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.011 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:19.011 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591682+0000", 2024-09-12T00:04:19.011 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023258 2024-09-12T00:04:19.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.012 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:19.012 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.592011+0000", 2024-09-12T00:04:19.012 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00032941699999999998 2024-09-12T00:04:19.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.012 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:19.012 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593493+0000", 2024-09-12T00:04:19.012 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014821599999999999 2024-09-12T00:04:19.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.012 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.012 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598356+0000", 2024-09-12T00:04:19.013 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048625329999999996 2024-09-12T00:04:19.013 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.013 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.013 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:19.013 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598456+0000", 2024-09-12T00:04:19.013 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9878999999999997e-05 2024-09-12T00:04:19.013 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.013 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.013 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:19.013 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598529+0000", 2024-09-12T00:04:19.013 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3120999999999993e-05 2024-09-12T00:04:19.013 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:19.013 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:19.013 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:19.014 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.014 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.014 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:650 6.4 6:26625e58:lc::lc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:19.014 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:04:19.014 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 44.322303404000003, 2024-09-12T00:04:19.014 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042727010000000003, 2024-09-12T00:04:19.014 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:19.014 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:19.014 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.014 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:19.014 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:19.014 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.014 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 650 2024-09-12T00:04:19.014 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.014 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:19.015 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.015 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:19.015 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:04:19.015 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:19.015 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.015 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.015 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:19.015 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:04:19.015 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:19.015 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.015 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.015 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:19.016 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599689+0000", 2024-09-12T00:04:19.016 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3179999999999999e-06 2024-09-12T00:04:19.016 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.016 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.016 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:19.016 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599696+0000", 2024-09-12T00:04:19.016 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9580000000000001e-06 2024-09-12T00:04:19.016 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.016 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.016 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:19.016 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599714+0000", 2024-09-12T00:04:19.016 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8099999999999999e-05 2024-09-12T00:04:19.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.017 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.017 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.017 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599724+0000", 2024-09-12T00:04:19.017 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0492999999999999e-05 2024-09-12T00:04:19.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.017 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.017 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:19.017 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599799+0000", 2024-09-12T00:04:19.017 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5228999999999994e-05 2024-09-12T00:04:19.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.017 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.018 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:19.018 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599897+0000", 2024-09-12T00:04:19.018 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7476e-05 2024-09-12T00:04:19.018 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.018 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.018 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:19.018 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.600047+0000", 2024-09-12T00:04:19.018 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015028 2024-09-12T00:04:19.018 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.018 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.019 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:19.019 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.602604+0000", 2024-09-12T00:04:19.019 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0025571729999999998 2024-09-12T00:04:19.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.019 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.019 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.019 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603880+0000", 2024-09-12T00:04:19.019 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012753700000000001 2024-09-12T00:04:19.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.019 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.019 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:19.020 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603923+0000", 2024-09-12T00:04:19.020 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3758999999999999e-05 2024-09-12T00:04:19.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.020 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.020 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:19.020 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603960+0000", 2024-09-12T00:04:19.020 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6545000000000003e-05 2024-09-12T00:04:19.020 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:19.020 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:19.020 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:19.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.021 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.021 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:744 6.0 6:0651570b:lc::lc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:19.021 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:04:19.021 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 44.288011976, 2024-09-12T00:04:19.021 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048046149999999999, 2024-09-12T00:04:19.021 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:19.021 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:19.021 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.021 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:19.021 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:19.022 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.022 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 744 2024-09-12T00:04:19.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.022 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:19.022 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.022 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:19.022 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:04:19.022 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:19.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.022 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.022 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:19.022 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:04:19.023 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:19.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.023 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:19.023 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633981+0000", 2024-09-12T00:04:19.023 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3740000000000001e-06 2024-09-12T00:04:19.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.023 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:19.024 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633991+0000", 2024-09-12T00:04:19.024 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7839999999999998e-06 2024-09-12T00:04:19.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.024 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.024 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:19.024 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634016+0000", 2024-09-12T00:04:19.024 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5075999999999998e-05 2024-09-12T00:04:19.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.024 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.024 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.024 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634031+0000", 2024-09-12T00:04:19.025 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5124e-05 2024-09-12T00:04:19.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.025 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:19.025 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634105+0000", 2024-09-12T00:04:19.025 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3595000000000003e-05 2024-09-12T00:04:19.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.025 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:19.025 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634183+0000", 2024-09-12T00:04:19.026 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7936999999999996e-05 2024-09-12T00:04:19.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.026 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.026 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:19.026 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634342+0000", 2024-09-12T00:04:19.026 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015910499999999999 2024-09-12T00:04:19.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.026 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.026 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:19.027 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.635262+0000", 2024-09-12T00:04:19.027 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00092051000000000003 2024-09-12T00:04:19.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.027 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.027 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.027 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638638+0000", 2024-09-12T00:04:19.027 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033756419999999999 2024-09-12T00:04:19.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.027 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.027 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:19.027 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638722+0000", 2024-09-12T00:04:19.028 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.4029000000000005e-05 2024-09-12T00:04:19.028 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.028 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.028 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:19.028 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638783+0000", 2024-09-12T00:04:19.028 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1439000000000006e-05 2024-09-12T00:04:19.028 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:19.028 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:19.028 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:19.028 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.029 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.029 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:875 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:19.029 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:04:19.029 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 44.238372544999997, 2024-09-12T00:04:19.029 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004522295, 2024-09-12T00:04:19.029 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:19.029 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:19.029 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.029 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:19.029 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:19.030 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.030 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 875 2024-09-12T00:04:19.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.030 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:19.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.030 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:19.030 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:04:19.030 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:19.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.031 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:19.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:04:19.031 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:19.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.031 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.031 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:19.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683623+0000", 2024-09-12T00:04:19.031 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7140000000000001e-06 2024-09-12T00:04:19.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.032 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:19.032 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683639+0000", 2024-09-12T00:04:19.032 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6203000000000001e-05 2024-09-12T00:04:19.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.032 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:19.032 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683677+0000", 2024-09-12T00:04:19.032 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8470999999999998e-05 2024-09-12T00:04:19.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.032 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.033 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683708+0000", 2024-09-12T00:04:19.033 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0793999999999997e-05 2024-09-12T00:04:19.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.033 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.033 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:19.033 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683827+0000", 2024-09-12T00:04:19.033 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011832699999999999 2024-09-12T00:04:19.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.033 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.033 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:19.033 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683945+0000", 2024-09-12T00:04:19.033 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118301 2024-09-12T00:04:19.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.034 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.034 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:19.034 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.684226+0000", 2024-09-12T00:04:19.034 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000280604 2024-09-12T00:04:19.034 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.034 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.034 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.034 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685790+0000", 2024-09-12T00:04:19.034 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001564651 2024-09-12T00:04:19.034 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.034 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.034 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:19.034 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688028+0000", 2024-09-12T00:04:19.035 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0022381129999999999 2024-09-12T00:04:19.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.035 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.035 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:19.035 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688093+0000", 2024-09-12T00:04:19.035 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4329e-05 2024-09-12T00:04:19.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.035 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.035 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:19.035 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688140+0000", 2024-09-12T00:04:19.035 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7787999999999997e-05 2024-09-12T00:04:19.035 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:19.035 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:19.036 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:19.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.036 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.036 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:878 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:19.036 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:04:19.036 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 44.236728415999998, 2024-09-12T00:04:19.036 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037933009999999998, 2024-09-12T00:04:19.036 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:19.036 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:19.036 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.036 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:19.036 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:19.036 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.037 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 878 2024-09-12T00:04:19.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.037 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:19.037 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.037 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:19.037 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:04:19.037 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:19.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.037 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.037 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:19.037 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:04:19.037 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:19.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.038 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.038 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:19.038 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685265+0000", 2024-09-12T00:04:19.038 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.525e-06 2024-09-12T00:04:19.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.038 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.038 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:19.038 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685276+0000", 2024-09-12T00:04:19.038 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.076e-05 2024-09-12T00:04:19.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.038 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.038 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:19.038 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685306+0000", 2024-09-12T00:04:19.039 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0803000000000003e-05 2024-09-12T00:04:19.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.039 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.039 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685327+0000", 2024-09-12T00:04:19.039 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1061e-05 2024-09-12T00:04:19.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.039 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:19.039 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685429+0000", 2024-09-12T00:04:19.039 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000102015 2024-09-12T00:04:19.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.040 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:19.040 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685580+0000", 2024-09-12T00:04:19.040 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000151096 2024-09-12T00:04:19.040 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.040 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.040 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:19.040 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685861+0000", 2024-09-12T00:04:19.040 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028068100000000002 2024-09-12T00:04:19.040 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.040 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.040 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.040 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688647+0000", 2024-09-12T00:04:19.041 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0027860979999999999 2024-09-12T00:04:19.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.041 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.041 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:19.041 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688909+0000", 2024-09-12T00:04:19.041 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026159600000000001 2024-09-12T00:04:19.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.041 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.041 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:19.041 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688991+0000", 2024-09-12T00:04:19.041 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2429999999999995e-05 2024-09-12T00:04:19.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.041 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.042 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:19.042 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689056+0000", 2024-09-12T00:04:19.042 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4236e-05 2024-09-12T00:04:19.042 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:19.042 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:19.042 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:19.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.042 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.042 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:881 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:19.042 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:04:19.042 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 44.236094233000003, 2024-09-12T00:04:19.042 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003307979, 2024-09-12T00:04:19.042 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:19.043 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:19.043 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.043 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:19.043 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:19.043 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.043 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 881 2024-09-12T00:04:19.043 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.043 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:19.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.043 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:19.043 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:04:19.043 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:19.043 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.044 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.044 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:19.044 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:04:19.044 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:19.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.044 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.044 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:19.044 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685898+0000", 2024-09-12T00:04:19.044 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4249999999999999e-06 2024-09-12T00:04:19.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.044 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.044 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:19.045 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685904+0000", 2024-09-12T00:04:19.045 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1290000000000001e-06 2024-09-12T00:04:19.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.045 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.045 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:19.045 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685917+0000", 2024-09-12T00:04:19.045 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2825e-05 2024-09-12T00:04:19.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.045 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.045 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.045 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685925+0000", 2024-09-12T00:04:19.045 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6589999999999996e-06 2024-09-12T00:04:19.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.046 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:19.046 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686156+0000", 2024-09-12T00:04:19.046 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023017299999999999 2024-09-12T00:04:19.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.046 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:19.046 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686365+0000", 2024-09-12T00:04:19.046 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000209442 2024-09-12T00:04:19.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.046 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:19.046 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686567+0000", 2024-09-12T00:04:19.047 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020237400000000001 2024-09-12T00:04:19.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.047 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:19.047 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689076+0000", 2024-09-12T00:04:19.047 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002508957 2024-09-12T00:04:19.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.047 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.047 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689121+0000", 2024-09-12T00:04:19.047 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4561999999999998e-05 2024-09-12T00:04:19.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.048 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:19.048 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689168+0000", 2024-09-12T00:04:19.048 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7000999999999999e-05 2024-09-12T00:04:19.048 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.048 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.048 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:19.048 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689204+0000", 2024-09-12T00:04:19.048 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6431999999999999e-05 2024-09-12T00:04:19.048 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:19.048 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:19.048 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:19.048 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.048 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.049 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:894 6.0 6:05588ce8:lc::lc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:19.049 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:04:19.049 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 44.231738266999997, 2024-09-12T00:04:19.049 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040691010000000003, 2024-09-12T00:04:19.049 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:19.049 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:19.049 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.049 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:19.049 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:19.049 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.049 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 894 2024-09-12T00:04:19.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.049 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:19.050 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.050 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:19.050 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:04:19.050 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:19.050 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.050 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.050 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:19.050 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:04:19.050 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:19.050 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.050 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.050 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:19.050 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690253+0000", 2024-09-12T00:04:19.050 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.026e-06 2024-09-12T00:04:19.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.051 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:19.051 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690259+0000", 2024-09-12T00:04:19.051 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7389999999999996e-06 2024-09-12T00:04:19.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.051 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:19.051 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690273+0000", 2024-09-12T00:04:19.051 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3749e-05 2024-09-12T00:04:19.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.051 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.052 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690282+0000", 2024-09-12T00:04:19.052 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2520000000000005e-06 2024-09-12T00:04:19.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.052 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.052 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:19.052 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690704+0000", 2024-09-12T00:04:19.052 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042222199999999998 2024-09-12T00:04:19.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.052 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.052 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:19.052 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690826+0000", 2024-09-12T00:04:19.052 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012141099999999999 2024-09-12T00:04:19.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.053 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.053 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:19.053 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.691094+0000", 2024-09-12T00:04:19.053 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000268344 2024-09-12T00:04:19.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.053 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.053 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:19.053 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.693007+0000", 2024-09-12T00:04:19.053 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001912495 2024-09-12T00:04:19.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.053 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.053 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.053 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694184+0000", 2024-09-12T00:04:19.054 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00117786 2024-09-12T00:04:19.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.054 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.054 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:19.054 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694259+0000", 2024-09-12T00:04:19.054 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4091000000000006e-05 2024-09-12T00:04:19.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.054 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.054 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:19.054 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694321+0000", 2024-09-12T00:04:19.054 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2911999999999997e-05 2024-09-12T00:04:19.054 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:19.054 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:19.055 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:19.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.055 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1283 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:19.055 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:04:19.055 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 43.732419731, 2024-09-12T00:04:19.055 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00320967, 2024-09-12T00:04:19.055 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:19.055 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:19.055 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.055 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:19.055 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:19.055 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.056 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1283 2024-09-12T00:04:19.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.056 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:19.056 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.056 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:19.056 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:04:19.056 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:19.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.056 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.056 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:19.056 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:04:19.056 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:19.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.057 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:19.057 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189573+0000", 2024-09-12T00:04:19.057 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3130000000000001e-06 2024-09-12T00:04:19.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.057 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:19.057 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189583+0000", 2024-09-12T00:04:19.057 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4129999999999995e-06 2024-09-12T00:04:19.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.057 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:19.058 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189608+0000", 2024-09-12T00:04:19.058 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5863e-05 2024-09-12T00:04:19.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.058 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.058 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.058 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189628+0000", 2024-09-12T00:04:19.058 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9644e-05 2024-09-12T00:04:19.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.058 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.058 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:19.058 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189747+0000", 2024-09-12T00:04:19.058 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118999 2024-09-12T00:04:19.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.058 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.059 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:19.059 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189874+0000", 2024-09-12T00:04:19.059 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012674499999999999 2024-09-12T00:04:19.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.059 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.059 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:19.059 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.190148+0000", 2024-09-12T00:04:19.059 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000274431 2024-09-12T00:04:19.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.059 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.059 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:19.059 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.191174+0000", 2024-09-12T00:04:19.059 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001025855 2024-09-12T00:04:19.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.060 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192627+0000", 2024-09-12T00:04:19.060 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014527979999999999 2024-09-12T00:04:19.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:19.060 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192710+0000", 2024-09-12T00:04:19.060 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3146000000000007e-05 2024-09-12T00:04:19.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:19.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:19.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:19.061 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192781+0000", 2024-09-12T00:04:19.061 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.0463000000000006e-05 2024-09-12T00:04:19.061 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:19.061 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:19.061 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:19.061 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:19.061 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:19.061 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:19.063 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:19.063+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:19.063 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:04:19.163 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:19.161+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:19.238 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:19.238 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:19.238 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:19.238 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:19.251 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:04:19.293 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:19.293+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:19.365 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:19.361+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:19.427 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:19.428 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:19.428 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:19.428 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:19.428 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:19.440 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:04:19.465 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:19.467+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:19.566 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:19.565+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:19.595 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:19.595 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:19.595 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:19.596 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:19.596 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.596 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:19.596 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:19.596 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.266069504000001, 2024-09-12T00:04:19.596 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.027441031000000001, 2024-09-12T00:04:19.596 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:19.596 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:19.596 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.596 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:19.596 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:19.596 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.596 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:04:19.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.597 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:19.597 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.597 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:19.597 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:19.597 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.597 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.597 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:19.597 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:19.597 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.597 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.598 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:19.598 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330357+0000", 2024-09-12T00:04:19.598 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2339999999999996e-06 2024-09-12T00:04:19.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.598 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.598 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:19.598 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330381+0000", 2024-09-12T00:04:19.598 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4626000000000001e-05 2024-09-12T00:04:19.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.598 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.598 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:19.598 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330417+0000", 2024-09-12T00:04:19.598 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5886000000000002e-05 2024-09-12T00:04:19.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.599 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.599 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.599 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330442+0000", 2024-09-12T00:04:19.599 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4522999999999999e-05 2024-09-12T00:04:19.599 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.599 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.599 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.599 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335485+0000", 2024-09-12T00:04:19.599 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050432589999999996 2024-09-12T00:04:19.599 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.599 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.599 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:19.599 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335507+0000", 2024-09-12T00:04:19.599 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2013000000000001e-05 2024-09-12T00:04:19.599 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.351747+0000", 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016240451999999999 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352062+0000", 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031433399999999999 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352378+0000", 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031586400000000001 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.355074+0000", 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026962919999999999 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357537+0000", 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024634689999999998 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357680+0000", 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014314899999999999 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357793+0000", 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011293 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94232250902656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.238154344000002, 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052696050000000001, 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.605 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:19.605 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358270+0000", 2024-09-12T00:04:19.605 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.17e-06 2024-09-12T00:04:19.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.605 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.605 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:19.605 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358278+0000", 2024-09-12T00:04:19.605 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3529999999999995e-06 2024-09-12T00:04:19.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.605 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.605 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:19.605 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358306+0000", 2024-09-12T00:04:19.605 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7763000000000002e-05 2024-09-12T00:04:19.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.606 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.606 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.606 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358324+0000", 2024-09-12T00:04:19.606 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7861000000000001e-05 2024-09-12T00:04:19.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.606 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.606 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.606 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358447+0000", 2024-09-12T00:04:19.606 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012334299999999999 2024-09-12T00:04:19.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.606 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.606 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:19.606 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358624+0000", 2024-09-12T00:04:19.606 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017684999999999999 2024-09-12T00:04:19.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.607 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.607 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:19.607 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358964+0000", 2024-09-12T00:04:19.607 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00033991199999999999 2024-09-12T00:04:19.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.607 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.607 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.607 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.362920+0000", 2024-09-12T00:04:19.607 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039564600000000002 2024-09-12T00:04:19.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.607 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.607 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:19.607 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363016+0000", 2024-09-12T00:04:19.607 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5612999999999994e-05 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363244+0000", 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000228385 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363537+0000", 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00029289499999999999 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 45.230776827, 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011415537, 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 209 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365648+0000", 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7360000000000001e-06 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365660+0000", 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2089999999999999e-05 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365690+0000", 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0320000000000001e-05 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.612 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365708+0000", 2024-09-12T00:04:19.612 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7520000000000002e-05 2024-09-12T00:04:19.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.612 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.612 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.612 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365870+0000", 2024-09-12T00:04:19.612 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016208600000000001 2024-09-12T00:04:19.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.612 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.612 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:19.612 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365885+0000", 2024-09-12T00:04:19.612 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5119999999999999e-05 2024-09-12T00:04:19.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.612 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373482+0000", 2024-09-12T00:04:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075970279999999996 2024-09-12T00:04:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373805+0000", 2024-09-12T00:04:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032262799999999999 2024-09-12T00:04:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.374297+0000", 2024-09-12T00:04:19.613 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00049250599999999998 2024-09-12T00:04:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.375670+0000", 2024-09-12T00:04:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001373333 2024-09-12T00:04:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.376923+0000", 2024-09-12T00:04:19.614 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012525640000000001 2024-09-12T00:04:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377000+0000", 2024-09-12T00:04:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6732999999999999e-05 2024-09-12T00:04:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377061+0000", 2024-09-12T00:04:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0872999999999998e-05 2024-09-12T00:04:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.615 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:240 6.19 6:9f626c48:lc::lc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 45.112191074000002, 2024-09-12T00:04:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058545680000000001, 2024-09-12T00:04:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:19.616 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 240 2024-09-12T00:04:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484233+0000", 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.973e-06 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484241+0000", 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8210000000000002e-06 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484260+0000", 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9148999999999999e-05 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484268+0000", 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5120000000000008e-06 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484371+0000", 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102501 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484450+0000", 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9122999999999994e-05 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:19.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484578+0000", 2024-09-12T00:04:19.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000128095 2024-09-12T00:04:19.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:19.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.485336+0000", 2024-09-12T00:04:19.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00075754000000000001 2024-09-12T00:04:19.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.489975+0000", 2024-09-12T00:04:19.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004639738 2024-09-12T00:04:19.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.621 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:19.621 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490043+0000", 2024-09-12T00:04:19.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7923999999999995e-05 2024-09-12T00:04:19.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.621 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:19.621 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490085+0000", 2024-09-12T00:04:19.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2191999999999999e-05 2024-09-12T00:04:19.621 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.621 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:19.621 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.622 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:412 6.3 6:c3a682d4:reshard::reshard.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:19.622 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:19.622 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 45.069795667999998, 2024-09-12T00:04:19.622 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049075530000000003, 2024-09-12T00:04:19.622 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:19.622 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:19.622 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.622 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:19.622 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:19.622 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.622 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 412 2024-09-12T00:04:19.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.622 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:19.622 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526628+0000", 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.513e-06 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526634+0000", 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1279999999999996e-06 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526649+0000", 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4997999999999999e-05 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526658+0000", 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1589999999999999e-06 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526728+0000", 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0203999999999994e-05 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526839+0000", 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011055 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526979+0000", 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139863 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.527616+0000", 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00063707900000000003 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531450+0000", 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003833819 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531490+0000", 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0129000000000002e-05 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531534+0000", 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4110999999999998e-05 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.628 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.628 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.628 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:490 6.19 6:9dc32cef:lc::lc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:19.628 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:19.628 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 45.045598294000001, 2024-09-12T00:04:19.628 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047438380000000002, 2024-09-12T00:04:19.628 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:19.628 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:19.628 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.628 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:19.628 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:19.628 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.628 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 490 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:19.630 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550825+0000", 2024-09-12T00:04:19.630 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0589999999999999e-06 2024-09-12T00:04:19.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.630 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.630 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:19.630 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550830+0000", 2024-09-12T00:04:19.630 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2140000000000004e-06 2024-09-12T00:04:19.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.630 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.630 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:19.630 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550843+0000", 2024-09-12T00:04:19.630 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3404000000000001e-05 2024-09-12T00:04:19.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.630 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.630 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550852+0000", 2024-09-12T00:04:19.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1549999999999996e-06 2024-09-12T00:04:19.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550910+0000", 2024-09-12T00:04:19.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7636000000000002e-05 2024-09-12T00:04:19.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:19.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550977+0000", 2024-09-12T00:04:19.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6636000000000004e-05 2024-09-12T00:04:19.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:19.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.551135+0000", 2024-09-12T00:04:19.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015852999999999999 2024-09-12T00:04:19.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552939+0000", 2024-09-12T00:04:19.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001803643 2024-09-12T00:04:19.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:19.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555471+0000", 2024-09-12T00:04:19.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002532327 2024-09-12T00:04:19.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:19.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555526+0000", 2024-09-12T00:04:19.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4728000000000002e-05 2024-09-12T00:04:19.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:19.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555567+0000", 2024-09-12T00:04:19.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1505999999999999e-05 2024-09-12T00:04:19.633 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.633 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:19.633 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.634 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:492 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'6, mlcod=35'4)", 2024-09-12T00:04:19.634 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:19.634 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 45.043822230000004, 2024-09-12T00:04:19.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056118790000000002, 2024-09-12T00:04:19.634 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:19.634 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:19.634 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.634 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:19.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.634 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:19.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:19.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.635 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:19.635 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:19.635 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.635 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:19.635 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552601+0000", 2024-09-12T00:04:19.635 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6899999999999996e-07 2024-09-12T00:04:19.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.635 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:19.635 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552608+0000", 2024-09-12T00:04:19.636 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4529999999999996e-06 2024-09-12T00:04:19.636 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.636 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.636 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:19.636 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552624+0000", 2024-09-12T00:04:19.636 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5885000000000001e-05 2024-09-12T00:04:19.636 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.636 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.636 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.636 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552632+0000", 2024-09-12T00:04:19.636 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2220000000000002e-06 2024-09-12T00:04:19.636 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.636 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.636 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.637 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552716+0000", 2024-09-12T00:04:19.637 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4060999999999994e-05 2024-09-12T00:04:19.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.637 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.637 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:19.637 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552735+0000", 2024-09-12T00:04:19.637 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9170000000000001e-05 2024-09-12T00:04:19.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.637 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.637 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:19.637 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558164+0000", 2024-09-12T00:04:19.637 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054289899999999999 2024-09-12T00:04:19.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.637 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.638 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:19.638 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558212+0000", 2024-09-12T00:04:19.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7129000000000002e-05 2024-09-12T00:04:19.638 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.638 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:19.638 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.638 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:496 6.3 6:c134263f:lc::lc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:19.638 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:19.638 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 45.042714942000003, 2024-09-12T00:04:19.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045956260000000002, 2024-09-12T00:04:19.638 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:19.638 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:19.639 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.639 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:19.639 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:19.639 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.639 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 496 2024-09-12T00:04:19.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.639 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:19.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:19.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:19.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:19.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:19.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:19.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553708+0000", 2024-09-12T00:04:19.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2359999999999999e-06 2024-09-12T00:04:19.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:19.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553714+0000", 2024-09-12T00:04:19.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4960000000000004e-06 2024-09-12T00:04:19.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.641 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.641 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:19.641 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553726+0000", 2024-09-12T00:04:19.641 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2618e-05 2024-09-12T00:04:19.641 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.641 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.641 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.641 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553734+0000", 2024-09-12T00:04:19.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4159999999999998e-06 2024-09-12T00:04:19.642 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.642 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.642 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.642 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553771+0000", 2024-09-12T00:04:19.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7095999999999999e-05 2024-09-12T00:04:19.642 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.642 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.642 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:19.642 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553815+0000", 2024-09-12T00:04:19.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3986999999999997e-05 2024-09-12T00:04:19.642 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.642 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.642 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:19.643 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553922+0000", 2024-09-12T00:04:19.643 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000107534 2024-09-12T00:04:19.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.643 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.643 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.643 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555052+0000", 2024-09-12T00:04:19.643 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011298359999999999 2024-09-12T00:04:19.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.643 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.643 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:19.643 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558197+0000", 2024-09-12T00:04:19.643 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0031450269999999999 2024-09-12T00:04:19.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.643 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.644 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:19.644 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558256+0000", 2024-09-12T00:04:19.644 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8403999999999999e-05 2024-09-12T00:04:19.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.644 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:19.644 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558303+0000", 2024-09-12T00:04:19.644 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6975999999999999e-05 2024-09-12T00:04:19.644 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.644 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:19.644 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.644 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:641 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:19.645 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:19.645 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 45.002644615000001, 2024-09-12T00:04:19.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052824789999999996, 2024-09-12T00:04:19.645 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:19.645 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:19.645 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.645 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:19.645 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:19.645 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.645 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 641 2024-09-12T00:04:19.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.645 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:19.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.645 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:19.646 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:19.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.646 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:19.646 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:19.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.646 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:19.646 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593778+0000", 2024-09-12T00:04:19.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0920000000000001e-06 2024-09-12T00:04:19.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:19.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593783+0000", 2024-09-12T00:04:19.647 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9490000000000004e-06 2024-09-12T00:04:19.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:19.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593795+0000", 2024-09-12T00:04:19.647 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2048999999999999e-05 2024-09-12T00:04:19.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593801+0000", 2024-09-12T00:04:19.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8989999999999998e-06 2024-09-12T00:04:19.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.648 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.648 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.648 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593852+0000", 2024-09-12T00:04:19.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1057999999999998e-05 2024-09-12T00:04:19.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.648 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.648 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:19.648 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593905+0000", 2024-09-12T00:04:19.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2196e-05 2024-09-12T00:04:19.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.649 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.649 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:19.649 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594017+0000", 2024-09-12T00:04:19.649 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000112816 2024-09-12T00:04:19.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.649 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.649 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.649 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.595190+0000", 2024-09-12T00:04:19.649 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011727199999999999 2024-09-12T00:04:19.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.649 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.649 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:19.649 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.598998+0000", 2024-09-12T00:04:19.649 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038081320000000001 2024-09-12T00:04:19.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.650 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:19.650 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599032+0000", 2024-09-12T00:04:19.650 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4283999999999999e-05 2024-09-12T00:04:19.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.650 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:19.650 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599060+0000", 2024-09-12T00:04:19.650 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7284000000000002e-05 2024-09-12T00:04:19.650 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.650 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:19.650 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.651 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:643 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'8, mlcod=35'6)", 2024-09-12T00:04:19.651 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:19.651 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 45.002146508000003, 2024-09-12T00:04:19.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048211260000000002, 2024-09-12T00:04:19.651 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:19.651 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:19.651 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.651 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:19.651 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:19.651 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:19.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.651 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:19.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:19.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.652 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:19.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594276+0000", 2024-09-12T00:04:19.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5899999999999995e-07 2024-09-12T00:04:19.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.652 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:19.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594283+0000", 2024-09-12T00:04:19.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6019999999999996e-06 2024-09-12T00:04:19.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:19.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594295+0000", 2024-09-12T00:04:19.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1683e-05 2024-09-12T00:04:19.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594303+0000", 2024-09-12T00:04:19.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0439999999999996e-06 2024-09-12T00:04:19.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594353+0000", 2024-09-12T00:04:19.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0698000000000001e-05 2024-09-12T00:04:19.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:19.654 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594380+0000", 2024-09-12T00:04:19.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7089000000000001e-05 2024-09-12T00:04:19.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:19.654 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599063+0000", 2024-09-12T00:04:19.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046824739999999998 2024-09-12T00:04:19.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:19.655 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599096+0000", 2024-09-12T00:04:19.655 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3677000000000003e-05 2024-09-12T00:04:19.655 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.655 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:19.655 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.655 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.655 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:647 6.a 6:5395e6f3:lc::lc.4:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:19.655 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:19.655 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.999795874999997, 2024-09-12T00:04:19.655 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049071770000000004, 2024-09-12T00:04:19.655 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:19.655 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:19.655 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.656 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:19.656 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:19.656 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.656 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 647 2024-09-12T00:04:19.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.656 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:19.656 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.656 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:19.656 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:19.656 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.656 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.656 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:19.656 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:19.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.657 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:19.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596627+0000", 2024-09-12T00:04:19.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1149999999999999e-06 2024-09-12T00:04:19.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.657 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:19.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596632+0000", 2024-09-12T00:04:19.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7060000000000003e-06 2024-09-12T00:04:19.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:19.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596645+0000", 2024-09-12T00:04:19.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2791e-05 2024-09-12T00:04:19.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596653+0000", 2024-09-12T00:04:19.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9230000000000002e-06 2024-09-12T00:04:19.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596705+0000", 2024-09-12T00:04:19.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2250000000000003e-05 2024-09-12T00:04:19.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:19.659 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596758+0000", 2024-09-12T00:04:19.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2964000000000003e-05 2024-09-12T00:04:19.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:19.659 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596873+0000", 2024-09-12T00:04:19.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011501 2024-09-12T00:04:19.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.659 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599088+0000", 2024-09-12T00:04:19.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002215135 2024-09-12T00:04:19.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.660 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.660 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:19.660 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601456+0000", 2024-09-12T00:04:19.660 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023684719999999999 2024-09-12T00:04:19.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.660 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.660 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:19.660 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601507+0000", 2024-09-12T00:04:19.660 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0933999999999997e-05 2024-09-12T00:04:19.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.660 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.660 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:19.661 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601533+0000", 2024-09-12T00:04:19.661 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5877e-05 2024-09-12T00:04:19.661 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.661 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:19.661 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.661 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.661 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:657 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'10, mlcod=35'7)", 2024-09-12T00:04:19.661 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:19.661 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.995972334999998, 2024-09-12T00:04:19.661 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066410239999999997, 2024-09-12T00:04:19.661 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:19.661 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:19.661 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.662 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:19.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:19.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:19.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:19.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:19.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:19.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:19.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6099999999999999e-07 2024-09-12T00:04:19.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:19.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600457+0000", 2024-09-12T00:04:19.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8700000000000003e-06 2024-09-12T00:04:19.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:19.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600470+0000", 2024-09-12T00:04:19.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3186999999999999e-05 2024-09-12T00:04:19.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600478+0000", 2024-09-12T00:04:19.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5310000000000004e-06 2024-09-12T00:04:19.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600521+0000", 2024-09-12T00:04:19.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2574000000000003e-05 2024-09-12T00:04:19.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:19.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600535+0000", 2024-09-12T00:04:19.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4151000000000001e-05 2024-09-12T00:04:19.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:19.665 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.606997+0000", 2024-09-12T00:04:19.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064626099999999997 2024-09-12T00:04:19.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.665 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:19.665 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607091+0000", 2024-09-12T00:04:19.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3239999999999995e-05 2024-09-12T00:04:19.665 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.665 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:19.665 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.665 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:659 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:19.665 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:19.666 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.995800002999999, 2024-09-12T00:04:19.666 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0065340989999999998, 2024-09-12T00:04:19.666 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:19.666 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:19.666 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.666 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:19.666 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:19.666 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.666 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 659 2024-09-12T00:04:19.666 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.666 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:19.666 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.666 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:19.666 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:19.667 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.667 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.667 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:19.667 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:19.667 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.667 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.667 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:19.667 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600623+0000", 2024-09-12T00:04:19.667 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.085e-06 2024-09-12T00:04:19.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.667 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.667 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:19.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600630+0000", 2024-09-12T00:04:19.668 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0029999999999997e-06 2024-09-12T00:04:19.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.668 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:19.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600647+0000", 2024-09-12T00:04:19.668 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6566999999999999e-05 2024-09-12T00:04:19.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.668 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600658+0000", 2024-09-12T00:04:19.668 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0992000000000001e-05 2024-09-12T00:04:19.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600717+0000", 2024-09-12T00:04:19.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9925e-05 2024-09-12T00:04:19.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:19.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600773+0000", 2024-09-12T00:04:19.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5766000000000001e-05 2024-09-12T00:04:19.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:19.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600889+0000", 2024-09-12T00:04:19.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115906 2024-09-12T00:04:19.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603483+0000", 2024-09-12T00:04:19.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025940799999999999 2024-09-12T00:04:19.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:19.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607098+0000", 2024-09-12T00:04:19.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036150459999999998 2024-09-12T00:04:19.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:19.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607133+0000", 2024-09-12T00:04:19.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4615e-05 2024-09-12T00:04:19.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.671 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:19.671 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607156+0000", 2024-09-12T00:04:19.671 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3113999999999999e-05 2024-09-12T00:04:19.671 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.671 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:19.671 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.671 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:666 6.a 6:5395e6f3:lc::lc.4:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:19.671 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:19.671 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.994052873999998, 2024-09-12T00:04:19.671 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.005127174, 2024-09-12T00:04:19.671 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:19.672 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:19.672 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.672 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:19.672 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:19.672 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.672 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 666 2024-09-12T00:04:19.672 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.672 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:19.672 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.672 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:19.672 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:19.672 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.672 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.673 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:19.673 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:19.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.673 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:19.673 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602370+0000", 2024-09-12T00:04:19.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0720000000000001e-06 2024-09-12T00:04:19.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.673 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:19.673 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602376+0000", 2024-09-12T00:04:19.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5489999999999997e-06 2024-09-12T00:04:19.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.674 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:19.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602391+0000", 2024-09-12T00:04:19.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5301000000000001e-05 2024-09-12T00:04:19.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.674 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602399+0000", 2024-09-12T00:04:19.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9179999999999994e-06 2024-09-12T00:04:19.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.674 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602456+0000", 2024-09-12T00:04:19.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7099999999999999e-05 2024-09-12T00:04:19.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:19.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602508+0000", 2024-09-12T00:04:19.675 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2476999999999999e-05 2024-09-12T00:04:19.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:19.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602606+0000", 2024-09-12T00:04:19.675 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7823000000000002e-05 2024-09-12T00:04:19.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.604653+0000", 2024-09-12T00:04:19.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002047068 2024-09-12T00:04:19.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:19.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607401+0000", 2024-09-12T00:04:19.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027477700000000001 2024-09-12T00:04:19.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:19.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607453+0000", 2024-09-12T00:04:19.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2092999999999997e-05 2024-09-12T00:04:19.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:19.677 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607496+0000", 2024-09-12T00:04:19.677 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3003000000000001e-05 2024-09-12T00:04:19.677 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.677 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:19.677 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.677 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.677 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:665 6.1a e35/29 6:5c7e8a6d:reshard::reshard.0000000015:head v 35'11, mlcod=35'8)", 2024-09-12T00:04:19.677 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:19.677 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.993681189, 2024-09-12T00:04:19.677 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048593209999999998, 2024-09-12T00:04:19.677 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:19.677 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:19.677 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.678 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:19.678 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.678 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:19.678 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:19.678 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.678 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.678 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:19.678 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:19.678 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.678 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.678 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:19.678 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602742+0000", 2024-09-12T00:04:19.678 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1069999999999999e-06 2024-09-12T00:04:19.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:19.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602749+0000", 2024-09-12T00:04:19.679 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9609999999999999e-06 2024-09-12T00:04:19.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:19.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602763+0000", 2024-09-12T00:04:19.679 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4086e-05 2024-09-12T00:04:19.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602772+0000", 2024-09-12T00:04:19.679 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8470000000000002e-06 2024-09-12T00:04:19.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602826+0000", 2024-09-12T00:04:19.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3885000000000003e-05 2024-09-12T00:04:19.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:19.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602837+0000", 2024-09-12T00:04:19.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1601e-05 2024-09-12T00:04:19.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:19.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607500+0000", 2024-09-12T00:04:19.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046627509999999997 2024-09-12T00:04:19.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.681 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:19.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607600+0000", 2024-09-12T00:04:19.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100083 2024-09-12T00:04:19.681 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.681 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:19.681 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.681 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:831 6.19 6:9d23f22c:lc::lc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:19.681 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:19.682 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.930396508999998, 2024-09-12T00:04:19.682 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047044610000000001, 2024-09-12T00:04:19.682 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:19.682 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:19.682 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.682 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:19.682 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:19.682 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.682 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 831 2024-09-12T00:04:19.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.682 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:19.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:19.683 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:19.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.683 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.683 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:19.683 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:19.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.683 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.683 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:19.683 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666026+0000", 2024-09-12T00:04:19.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.02e-06 2024-09-12T00:04:19.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.683 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.683 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:19.684 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666032+0000", 2024-09-12T00:04:19.684 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8850000000000004e-06 2024-09-12T00:04:19.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.684 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.684 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:19.684 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666047+0000", 2024-09-12T00:04:19.684 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4647999999999999e-05 2024-09-12T00:04:19.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.684 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.684 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.684 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666058+0000", 2024-09-12T00:04:19.684 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0905e-05 2024-09-12T00:04:19.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.684 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.685 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.685 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666376+0000", 2024-09-12T00:04:19.685 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031824899999999999 2024-09-12T00:04:19.685 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.685 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.685 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:19.685 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666479+0000", 2024-09-12T00:04:19.685 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102814 2024-09-12T00:04:19.685 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.685 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.685 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:19.685 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666635+0000", 2024-09-12T00:04:19.685 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000156343 2024-09-12T00:04:19.685 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.686 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.686 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:19.686 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.667611+0000", 2024-09-12T00:04:19.686 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000975671 2024-09-12T00:04:19.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.686 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.686 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.686 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670662+0000", 2024-09-12T00:04:19.686 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003050863 2024-09-12T00:04:19.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.686 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.686 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:19.686 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670701+0000", 2024-09-12T00:04:19.686 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9338000000000002e-05 2024-09-12T00:04:19.687 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.687 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.687 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:19.687 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670730+0000", 2024-09-12T00:04:19.687 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8725e-05 2024-09-12T00:04:19.687 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.687 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:19.687 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.687 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.687 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.687 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:852 6.1d e35/29 6:bbf2d10c:::obj_delete_at_hint.0000000025:head v 35'9, mlcod=35'7)", 2024-09-12T00:04:19.687 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:19.687 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.921819456000001, 2024-09-12T00:04:19.687 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00569595, 2024-09-12T00:04:19.688 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:19.688 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:19.688 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.688 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:19.688 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.688 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:19.688 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:19.688 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.688 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.688 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.688 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:19.688 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:19.688 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.688 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.689 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.689 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:19.689 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674604+0000", 2024-09-12T00:04:19.689 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2079999999999999e-06 2024-09-12T00:04:19.689 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.689 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.689 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:19.689 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674611+0000", 2024-09-12T00:04:19.689 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.973e-06 2024-09-12T00:04:19.689 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.689 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.689 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:19.689 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674625+0000", 2024-09-12T00:04:19.689 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3916e-05 2024-09-12T00:04:19.689 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.690 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.690 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.690 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674633+0000", 2024-09-12T00:04:19.690 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8580000000000006e-06 2024-09-12T00:04:19.690 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.690 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.690 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.690 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674697+0000", 2024-09-12T00:04:19.690 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4004999999999995e-05 2024-09-12T00:04:19.690 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.690 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.690 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:19.690 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674713+0000", 2024-09-12T00:04:19.690 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5835e-05 2024-09-12T00:04:19.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.691 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.691 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:19.691 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680245+0000", 2024-09-12T00:04:19.691 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055320250000000003 2024-09-12T00:04:19.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.691 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.691 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:19.691 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680298+0000", 2024-09-12T00:04:19.691 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3130000000000001e-05 2024-09-12T00:04:19.691 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.691 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:19.691 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.692 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.692 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:925 6.1a e35/29 6:5f2e3d26:lc::lc.18:head v 35'15, mlcod=35'12)", 2024-09-12T00:04:19.692 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:19.692 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.898291626000002, 2024-09-12T00:04:19.692 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055640999999999998, 2024-09-12T00:04:19.692 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:19.692 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:19.692 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.692 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:19.692 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.692 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:19.692 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:19.692 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.693 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.693 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:19.693 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:19.693 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.693 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.693 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.693 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:19.693 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698131+0000", 2024-09-12T00:04:19.693 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:04:19.693 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.693 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.693 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:19.693 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698140+0000", 2024-09-12T00:04:19.693 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3139999999999993e-06 2024-09-12T00:04:19.693 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.694 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.694 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:19.694 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698155+0000", 2024-09-12T00:04:19.694 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:04:19.694 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.694 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.694 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.694 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698164+0000", 2024-09-12T00:04:19.694 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1419999999999999e-06 2024-09-12T00:04:19.694 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.694 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.694 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.694 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698228+0000", 2024-09-12T00:04:19.695 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3380000000000006e-05 2024-09-12T00:04:19.695 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.695 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.695 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:19.695 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698252+0000", 2024-09-12T00:04:19.695 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4111e-05 2024-09-12T00:04:19.695 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.695 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.695 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:19.695 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703646+0000", 2024-09-12T00:04:19.695 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0053937840000000004 2024-09-12T00:04:19.695 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.695 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.695 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:19.696 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703694+0000", 2024-09-12T00:04:19.696 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8776999999999997e-05 2024-09-12T00:04:19.696 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.696 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:19.696 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.696 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.696 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.696 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:927 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:19.696 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:19.696 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.897772602000003, 2024-09-12T00:04:19.696 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050914949999999997, 2024-09-12T00:04:19.696 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:19.696 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:19.696 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:19.697 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:19.697 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:19.697 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.697 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 927 2024-09-12T00:04:19.697 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.697 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:19.697 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.697 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:19.697 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:19.697 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.697 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.697 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.697 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:19.697 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:19.698 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.698 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.698 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.698 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:19.698 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698651+0000", 2024-09-12T00:04:19.698 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3740000000000001e-06 2024-09-12T00:04:19.698 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.698 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.698 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:19.698 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698657+0000", 2024-09-12T00:04:19.698 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5239999999999997e-06 2024-09-12T00:04:19.698 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.698 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.698 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:19.699 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698673+0000", 2024-09-12T00:04:19.699 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5345999999999998e-05 2024-09-12T00:04:19.699 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.699 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.699 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.699 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698680+0000", 2024-09-12T00:04:19.699 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4649999999999997e-06 2024-09-12T00:04:19.699 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.699 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.699 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.699 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699009+0000", 2024-09-12T00:04:19.699 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032934000000000001 2024-09-12T00:04:19.699 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.699 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.699 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:19.700 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699213+0000", 2024-09-12T00:04:19.700 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020361500000000001 2024-09-12T00:04:19.700 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.700 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.700 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:19.700 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699450+0000", 2024-09-12T00:04:19.700 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023670399999999999 2024-09-12T00:04:19.700 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.700 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.700 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:19.700 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.700678+0000", 2024-09-12T00:04:19.700 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012285519999999999 2024-09-12T00:04:19.700 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.700 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.701 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:19.701 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703666+0000", 2024-09-12T00:04:19.701 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029876130000000001 2024-09-12T00:04:19.701 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.701 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.701 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:19.701 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703708+0000", 2024-09-12T00:04:19.701 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2361999999999999e-05 2024-09-12T00:04:19.701 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.701 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.701 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:19.701 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703741+0000", 2024-09-12T00:04:19.701 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.26e-05 2024-09-12T00:04:19.701 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.702 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:19.702 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.702 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.702 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.702 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:941 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:19.702 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:19.702 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.892279148999997, 2024-09-12T00:04:19.702 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0051476960000000002, 2024-09-12T00:04:19.702 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:19.702 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:19.702 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "started", 2024-09-12T00:04:19.702 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:19.702 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:19.702 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:19.702 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 941 2024-09-12T00:04:19.703 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.703 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:19.703 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.703 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:19.703 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:19.703 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.703 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.703 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.703 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:19.703 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:19.703 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:19.703 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.703 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.703 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:19.704 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704144+0000", 2024-09-12T00:04:19.704 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.514e-06 2024-09-12T00:04:19.704 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.704 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.704 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:19.704 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704152+0000", 2024-09-12T00:04:19.704 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2830000000000004e-06 2024-09-12T00:04:19.704 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.704 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.704 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:19.704 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704168+0000", 2024-09-12T00:04:19.704 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6835999999999999e-05 2024-09-12T00:04:19.704 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.704 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.705 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:19.705 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704178+0000", 2024-09-12T00:04:19.705 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7569999999999999e-06 2024-09-12T00:04:19.705 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.705 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.705 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:19.705 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704240+0000", 2024-09-12T00:04:19.705 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2193000000000006e-05 2024-09-12T00:04:19.705 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.705 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.705 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:19.705 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704308+0000", 2024-09-12T00:04:19.705 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7840000000000001e-05 2024-09-12T00:04:19.705 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:19.706 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:19.706 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:19.706 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.709290+0000", 2024-09-12T00:04:19.706 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049822729999999997 2024-09-12T00:04:19.706 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.706 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:19.706 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.706 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:19.706 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:19.706 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:19.708 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:04:19.708 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T00:04:19.708 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.6 to 1 (10000) 2024-09-12T00:04:19.709 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-12T00:04:19.710 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:19.707+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:19.809 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:19.807+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:19.909 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:19.909+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:19.932 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:19.932 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:19.932 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:19.932 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:19.946 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:04:20.033 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:20.033+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:20.112 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:20.111+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:20.163 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:20.164 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:20.164 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:20.164 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:20.164 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:20.181 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:04:20.213 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:20.215+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:20.314 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:20.313+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:20.397 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:20.397 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:20.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:20.397 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:20.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.397 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:20.397 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:20.398 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.904047442999996, 2024-09-12T00:04:20.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.278479906, 2024-09-12T00:04:20.398 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:20.398 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:20.398 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:20.398 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:20.398 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:20.398 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:20.398 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:04:20.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.398 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:20.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.398 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:20.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:20.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:20.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:20.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:20.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493422+0000", 2024-09-12T00:04:20.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.807e-06 2024-09-12T00:04:20.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.400 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:20.400 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493435+0000", 2024-09-12T00:04:20.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.375e-05 2024-09-12T00:04:20.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.400 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:20.400 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493457+0000", 2024-09-12T00:04:20.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2166000000000001e-05 2024-09-12T00:04:20.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.400 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:20.401 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493475+0000", 2024-09-12T00:04:20.401 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7184e-05 2024-09-12T00:04:20.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.401 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:20.401 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493617+0000", 2024-09-12T00:04:20.401 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014274200000000001 2024-09-12T00:04:20.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.401 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:20.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493632+0000", 2024-09-12T00:04:20.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4293e-05 2024-09-12T00:04:20.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.402 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:20.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.768657+0000", 2024-09-12T00:04:20.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.27502575400000001 2024-09-12T00:04:20.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.402 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:20.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769042+0000", 2024-09-12T00:04:20.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00038463700000000001 2024-09-12T00:04:20.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.403 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:20.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769430+0000", 2024-09-12T00:04:20.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000388014 2024-09-12T00:04:20.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.403 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:20.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.770784+0000", 2024-09-12T00:04:20.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00135402 2024-09-12T00:04:20.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:20.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771735+0000", 2024-09-12T00:04:20.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00095068599999999996 2024-09-12T00:04:20.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:20.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771828+0000", 2024-09-12T00:04:20.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3468999999999996e-05 2024-09-12T00:04:20.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:20.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771899+0000", 2024-09-12T00:04:20.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0383999999999996e-05 2024-09-12T00:04:20.405 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.405 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:20.405 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.405 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:20.405 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:20.405 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.475823687000002, 2024-09-12T00:04:20.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013402304, 2024-09-12T00:04:20.405 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:20.406 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:20.406 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:20.406 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:20.406 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:20.406 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:20.406 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 44 2024-09-12T00:04:20.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.406 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:20.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:20.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:20.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:20.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:20.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:20.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:20.408 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7100000000000001e-07 2024-09-12T00:04:20.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.408 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:20.408 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921706+0000", 2024-09-12T00:04:20.408 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2374999999999998e-05 2024-09-12T00:04:20.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.408 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:20.408 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921726+0000", 2024-09-12T00:04:20.408 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0373999999999998e-05 2024-09-12T00:04:20.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:20.409 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921733+0000", 2024-09-12T00:04:20.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8929999999999999e-06 2024-09-12T00:04:20.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:20.409 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927137+0000", 2024-09-12T00:04:20.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054037410000000001 2024-09-12T00:04:20.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:20.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927274+0000", 2024-09-12T00:04:20.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013697899999999999 2024-09-12T00:04:20.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:20.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927504+0000", 2024-09-12T00:04:20.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023005399999999999 2024-09-12T00:04:20.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:20.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.931848+0000", 2024-09-12T00:04:20.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0043445269999999999 2024-09-12T00:04:20.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.411 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:20.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934770+0000", 2024-09-12T00:04:20.411 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002922319 2024-09-12T00:04:20.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.411 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:20.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934901+0000", 2024-09-12T00:04:20.412 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013034599999999999 2024-09-12T00:04:20.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.412 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.412 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:20.412 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935045+0000", 2024-09-12T00:04:20.412 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014402499999999999 2024-09-12T00:04:20.412 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.412 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:20.412 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.412 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.412 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:20.412 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:20.413 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.475720722000005, 2024-09-12T00:04:20.413 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013456684999999999, 2024-09-12T00:04:20.413 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:20.413 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:20.413 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:20.413 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:20.413 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:20.413 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:20.413 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 45 2024-09-12T00:04:20.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.413 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:20.413 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:20.414 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:20.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.414 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:20.414 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:20.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.414 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:20.414 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921746+0000", 2024-09-12T00:04:20.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9800000000000003e-07 2024-09-12T00:04:20.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:20.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921751+0000", 2024-09-12T00:04:20.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7099999999999998e-06 2024-09-12T00:04:20.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:20.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921766+0000", 2024-09-12T00:04:20.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5633000000000001e-05 2024-09-12T00:04:20.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:20.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921786+0000", 2024-09-12T00:04:20.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9658000000000001e-05 2024-09-12T00:04:20.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:20.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929539+0000", 2024-09-12T00:04:20.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0077533120000000001 2024-09-12T00:04:20.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.417 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:20.417 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929706+0000", 2024-09-12T00:04:20.417 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016664199999999999 2024-09-12T00:04:20.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.417 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:20.417 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929933+0000", 2024-09-12T00:04:20.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000226658 2024-09-12T00:04:20.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.418 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.418 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:20.418 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934721+0000", 2024-09-12T00:04:20.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047886439999999999 2024-09-12T00:04:20.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.418 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.418 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:20.418 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935062+0000", 2024-09-12T00:04:20.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00034072399999999999 2024-09-12T00:04:20.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.418 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.419 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:20.419 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935141+0000", 2024-09-12T00:04:20.419 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8570000000000002e-05 2024-09-12T00:04:20.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.419 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.419 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:20.419 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935202+0000", 2024-09-12T00:04:20.419 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1536000000000002e-05 2024-09-12T00:04:20.419 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.419 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:20.419 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.419 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.419 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:20.420 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:20.420 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.475670489999999, 2024-09-12T00:04:20.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014633617, 2024-09-12T00:04:20.420 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:20.420 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:20.420 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:20.420 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:20.420 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:20.420 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:20.420 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:04:20.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.420 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:20.420 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.420 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:20.421 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:20.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:20.421 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:20.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:20.421 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:20.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3599999999999999e-07 2024-09-12T00:04:20.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:20.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921800+0000", 2024-09-12T00:04:20.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3850000000000002e-06 2024-09-12T00:04:20.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:20.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921805+0000", 2024-09-12T00:04:20.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9460000000000003e-06 2024-09-12T00:04:20.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:20.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921819+0000", 2024-09-12T00:04:20.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.325e-05 2024-09-12T00:04:20.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:20.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930627+0000", 2024-09-12T00:04:20.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00880827 2024-09-12T00:04:20.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:20.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930805+0000", 2024-09-12T00:04:20.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000177992 2024-09-12T00:04:20.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:20.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.931028+0000", 2024-09-12T00:04:20.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000223122 2024-09-12T00:04:20.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:20.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935258+0000", 2024-09-12T00:04:20.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0042302709999999999 2024-09-12T00:04:20.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:20.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936282+0000", 2024-09-12T00:04:20.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00102345 2024-09-12T00:04:20.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.425 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:20.425 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936367+0000", 2024-09-12T00:04:20.425 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4869000000000003e-05 2024-09-12T00:04:20.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.425 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:20.425 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936429+0000", 2024-09-12T00:04:20.425 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2626000000000007e-05 2024-09-12T00:04:20.425 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.425 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:20.425 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.426 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.426 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:20.426 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:20.426 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.475634240000005, 2024-09-12T00:04:20.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016022492999999999, 2024-09-12T00:04:20.426 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:20.426 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:20.426 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:20.426 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:20.426 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:20.426 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:20.426 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:04:20.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.427 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:20.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:20.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:20.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:20.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:20.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:20.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:20.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4000000000000002e-07 2024-09-12T00:04:20.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.428 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:20.428 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921891+0000", 2024-09-12T00:04:20.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8298000000000003e-05 2024-09-12T00:04:20.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.428 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:20.428 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921899+0000", 2024-09-12T00:04:20.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7059999999999993e-06 2024-09-12T00:04:20.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.429 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:20.429 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921904+0000", 2024-09-12T00:04:20.429 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9799999999999998e-06 2024-09-12T00:04:20.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.429 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:20.429 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932144+0000", 2024-09-12T00:04:20.429 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010239817999999999 2024-09-12T00:04:20.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.429 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:20.429 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932284+0000", 2024-09-12T00:04:20.430 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139436 2024-09-12T00:04:20.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.430 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:20.430 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932498+0000", 2024-09-12T00:04:20.430 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000214408 2024-09-12T00:04:20.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.430 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:20.430 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936444+0000", 2024-09-12T00:04:20.430 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039464169999999998 2024-09-12T00:04:20.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.430 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:20.431 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937702+0000", 2024-09-12T00:04:20.431 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012571679999999999 2024-09-12T00:04:20.431 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.431 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.431 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:20.431 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937793+0000", 2024-09-12T00:04:20.431 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1489000000000004e-05 2024-09-12T00:04:20.431 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.431 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.431 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:20.431 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937854+0000", 2024-09-12T00:04:20.431 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1333000000000004e-05 2024-09-12T00:04:20.432 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.432 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:20.432 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.432 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.432 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.432 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:20.432 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:20.432 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.475552371999996, 2024-09-12T00:04:20.432 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017189138999999999, 2024-09-12T00:04:20.432 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:20.432 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:20.432 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:20.432 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:20.433 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:20.433 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:20.433 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 48 2024-09-12T00:04:20.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.433 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:20.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:20.433 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:20.433 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:20.434 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:20.434 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.434 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:20.434 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:20.434 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7399999999999998e-07 2024-09-12T00:04:20.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.434 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:20.434 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921918+0000", 2024-09-12T00:04:20.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6399999999999999e-06 2024-09-12T00:04:20.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.435 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:20.435 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921925+0000", 2024-09-12T00:04:20.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7190000000000004e-06 2024-09-12T00:04:20.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.435 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:20.435 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921931+0000", 2024-09-12T00:04:20.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2519999999999996e-06 2024-09-12T00:04:20.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.435 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:20.436 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933475+0000", 2024-09-12T00:04:20.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011543759000000001 2024-09-12T00:04:20.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.436 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.436 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:20.436 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933617+0000", 2024-09-12T00:04:20.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000142282 2024-09-12T00:04:20.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.436 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.436 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:20.436 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933860+0000", 2024-09-12T00:04:20.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024276199999999999 2024-09-12T00:04:20.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.437 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:20.437 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937933+0000", 2024-09-12T00:04:20.437 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040734680000000002 2024-09-12T00:04:20.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.437 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:20.437 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938955+0000", 2024-09-12T00:04:20.437 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001021987 2024-09-12T00:04:20.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.438 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:20.438 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939038+0000", 2024-09-12T00:04:20.438 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2449999999999998e-05 2024-09-12T00:04:20.438 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.438 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.438 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:20.438 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939103+0000", 2024-09-12T00:04:20.438 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5345999999999994e-05 2024-09-12T00:04:20.438 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.438 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:20.438 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.438 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.438 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.439 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:20.439 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:20.439 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.475526830000007, 2024-09-12T00:04:20.439 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018247975, 2024-09-12T00:04:20.439 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:20.439 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:20.439 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:20.439 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:20.439 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:20.439 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:20.439 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 49 2024-09-12T00:04:20.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.439 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:20.440 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.440 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:20.440 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:20.440 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.440 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.440 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:20.440 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:20.440 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.440 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.440 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:20.440 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921940+0000", 2024-09-12T00:04:20.441 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7e-07 2024-09-12T00:04:20.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.441 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.441 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:20.441 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921943+0000", 2024-09-12T00:04:20.441 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1889999999999999e-06 2024-09-12T00:04:20.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.441 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.441 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:20.441 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921952+0000", 2024-09-12T00:04:20.441 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0010000000000007e-06 2024-09-12T00:04:20.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.441 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.442 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:20.442 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921959+0000", 2024-09-12T00:04:20.442 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2570000000000001e-06 2024-09-12T00:04:20.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.442 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:20.442 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935333+0000", 2024-09-12T00:04:20.442 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013373368 2024-09-12T00:04:20.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.443 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:20.443 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935472+0000", 2024-09-12T00:04:20.443 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013987900000000001 2024-09-12T00:04:20.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.443 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.443 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:20.443 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935700+0000", 2024-09-12T00:04:20.443 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000227922 2024-09-12T00:04:20.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.444 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:20.444 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939858+0000", 2024-09-12T00:04:20.444 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041571300000000002 2024-09-12T00:04:20.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.444 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:20.444 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940018+0000", 2024-09-12T00:04:20.444 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016060400000000001 2024-09-12T00:04:20.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.444 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:20.445 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940114+0000", 2024-09-12T00:04:20.445 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5692999999999993e-05 2024-09-12T00:04:20.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.445 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.445 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:20.445 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940187+0000", 2024-09-12T00:04:20.445 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3561999999999998e-05 2024-09-12T00:04:20.445 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.445 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:20.445 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.445 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.446 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:20.446 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:20.446 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.475484042999994, 2024-09-12T00:04:20.446 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021018614000000001, 2024-09-12T00:04:20.446 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:20.446 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:20.446 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:20.446 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:20.446 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:20.446 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:20.446 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 50 2024-09-12T00:04:20.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.446 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:20.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.447 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:20.447 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:20.447 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.447 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:20.447 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:20.447 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.447 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:20.447 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921983+0000", 2024-09-12T00:04:20.447 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4499999999999996e-07 2024-09-12T00:04:20.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.448 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.448 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:20.448 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922071+0000", 2024-09-12T00:04:20.448 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8010000000000006e-05 2024-09-12T00:04:20.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.448 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.448 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:20.448 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922084+0000", 2024-09-12T00:04:20.448 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3275000000000001e-05 2024-09-12T00:04:20.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.448 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.448 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:20.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922093+0000", 2024-09-12T00:04:20.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0580000000000004e-06 2024-09-12T00:04:20.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.449 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:20.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936515+0000", 2024-09-12T00:04:20.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014421270999999999 2024-09-12T00:04:20.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.449 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:20.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936677+0000", 2024-09-12T00:04:20.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162003 2024-09-12T00:04:20.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:20.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936908+0000", 2024-09-12T00:04:20.450 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023115700000000001 2024-09-12T00:04:20.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:20.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939985+0000", 2024-09-12T00:04:20.450 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030773879999999999 2024-09-12T00:04:20.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:20.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942623+0000", 2024-09-12T00:04:20.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026377929999999998 2024-09-12T00:04:20.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.451 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:20.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942818+0000", 2024-09-12T00:04:20.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019556200000000001 2024-09-12T00:04:20.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.451 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:20.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943001+0000", 2024-09-12T00:04:20.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018235199999999999 2024-09-12T00:04:20.451 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.451 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:20.451 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.452 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:20.452 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:20.452 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.475349651000002, 2024-09-12T00:04:20.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021092493, 2024-09-12T00:04:20.452 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:20.452 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:20.452 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:20.453 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:20.453 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:20.453 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:20.453 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 51 2024-09-12T00:04:20.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.453 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:20.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.453 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:20.453 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:20.453 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.453 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:20.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:20.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.454 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:20.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922118+0000", 2024-09-12T00:04:20.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0389999999999999e-06 2024-09-12T00:04:20.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.454 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:20.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922124+0000", 2024-09-12T00:04:20.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5409999999999997e-06 2024-09-12T00:04:20.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.455 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:20.455 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922136+0000", 2024-09-12T00:04:20.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.205e-05 2024-09-12T00:04:20.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.455 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:20.455 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922147+0000", 2024-09-12T00:04:20.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0451e-05 2024-09-12T00:04:20.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:20.456 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938000+0000", 2024-09-12T00:04:20.456 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015853682000000001 2024-09-12T00:04:20.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:20.456 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938142+0000", 2024-09-12T00:04:20.456 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014148899999999999 2024-09-12T00:04:20.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:20.457 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938362+0000", 2024-09-12T00:04:20.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022034800000000001 2024-09-12T00:04:20.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.457 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.457 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:20.457 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940330+0000", 2024-09-12T00:04:20.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001967459 2024-09-12T00:04:20.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.457 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.457 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:20.457 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943064+0000", 2024-09-12T00:04:20.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027346219999999999 2024-09-12T00:04:20.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.458 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.458 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:20.458 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943152+0000", 2024-09-12T00:04:20.458 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7563000000000002e-05 2024-09-12T00:04:20.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.458 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.458 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:20.458 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943209+0000", 2024-09-12T00:04:20.458 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7249e-05 2024-09-12T00:04:20.458 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.458 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:20.458 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.459 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:20.459 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:20.459 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.475300157999996, 2024-09-12T00:04:20.459 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021175616000000001, 2024-09-12T00:04:20.459 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:20.459 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:20.459 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:20.459 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:20.459 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:20.459 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:20.459 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 52 2024-09-12T00:04:20.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.460 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:20.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.460 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:20.460 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:20.460 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.460 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:20.460 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:20.460 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.461 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:20.461 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922167+0000", 2024-09-12T00:04:20.461 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3300000000000001e-07 2024-09-12T00:04:20.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.461 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:20.461 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922174+0000", 2024-09-12T00:04:20.461 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7070000000000003e-06 2024-09-12T00:04:20.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.461 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:20.461 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922184+0000", 2024-09-12T00:04:20.461 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682e-05 2024-09-12T00:04:20.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.462 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:20.462 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922195+0000", 2024-09-12T00:04:20.462 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0489000000000001e-05 2024-09-12T00:04:20.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.462 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:20.462 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939166+0000", 2024-09-12T00:04:20.462 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016971245999999999 2024-09-12T00:04:20.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.462 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:20.462 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939243+0000", 2024-09-12T00:04:20.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7201999999999997e-05 2024-09-12T00:04:20.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.463 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:20.463 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939381+0000", 2024-09-12T00:04:20.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013770699999999999 2024-09-12T00:04:20.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.463 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:20.463 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940923+0000", 2024-09-12T00:04:20.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001542302 2024-09-12T00:04:20.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.464 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:20.464 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943221+0000", 2024-09-12T00:04:20.464 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022979720000000001 2024-09-12T00:04:20.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.464 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:20.464 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943295+0000", 2024-09-12T00:04:20.464 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3317000000000003e-05 2024-09-12T00:04:20.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.464 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:20.464 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943342+0000", 2024-09-12T00:04:20.464 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7159e-05 2024-09-12T00:04:20.465 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.465 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:20.465 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.465 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:20.465 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:20.465 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.226355192, 2024-09-12T00:04:20.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015229411999999999, 2024-09-12T00:04:20.465 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:20.465 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:20.465 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:20.465 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:20.466 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:20.466 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:20.466 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 67 2024-09-12T00:04:20.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.466 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:20.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.466 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:20.466 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:20.466 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.466 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:20.466 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:20.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.467 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:20.467 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171112+0000", 2024-09-12T00:04:20.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2899999999999999e-06 2024-09-12T00:04:20.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.467 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:20.467 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171119+0000", 2024-09-12T00:04:20.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8870000000000003e-06 2024-09-12T00:04:20.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.468 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:20.468 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171131+0000", 2024-09-12T00:04:20.468 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1902999999999999e-05 2024-09-12T00:04:20.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.468 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:20.468 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171147+0000", 2024-09-12T00:04:20.468 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6203000000000001e-05 2024-09-12T00:04:20.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.468 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:20.468 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175044+0000", 2024-09-12T00:04:20.468 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038967310000000001 2024-09-12T00:04:20.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:20.469 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175172+0000", 2024-09-12T00:04:20.469 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012784100000000001 2024-09-12T00:04:20.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:20.469 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175372+0000", 2024-09-12T00:04:20.469 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019978500000000001 2024-09-12T00:04:20.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:20.470 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179276+0000", 2024-09-12T00:04:20.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039042149999999999 2024-09-12T00:04:20.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.470 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:20.470 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186150+0000", 2024-09-12T00:04:20.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0068740019999999997 2024-09-12T00:04:20.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.470 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:20.470 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186266+0000", 2024-09-12T00:04:20.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115742 2024-09-12T00:04:20.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.471 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:20.471 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186340+0000", 2024-09-12T00:04:20.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4813000000000004e-05 2024-09-12T00:04:20.471 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.471 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:20.471 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.471 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:20.471 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:20.471 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.226294116000005, 2024-09-12T00:04:20.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015308448000000001, 2024-09-12T00:04:20.472 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:20.472 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:20.472 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:20.472 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:20.472 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:20.472 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:20.472 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 68 2024-09-12T00:04:20.472 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.472 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:20.472 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.472 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:20.472 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:20.472 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.473 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.473 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:20.473 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:20.473 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.473 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.473 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:20.473 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171173+0000", 2024-09-12T00:04:20.473 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:04:20.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.473 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.474 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:20.474 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171182+0000", 2024-09-12T00:04:20.474 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2359999999999993e-06 2024-09-12T00:04:20.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.474 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:20.474 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171193+0000", 2024-09-12T00:04:20.474 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.095e-05 2024-09-12T00:04:20.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:20.475 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171207+0000", 2024-09-12T00:04:20.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3339999999999999e-05 2024-09-12T00:04:20.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.475 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:20.475 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176753+0000", 2024-09-12T00:04:20.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055460240000000001 2024-09-12T00:04:20.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.475 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:20.475 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176921+0000", 2024-09-12T00:04:20.476 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000168503 2024-09-12T00:04:20.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.476 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.476 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:20.476 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177112+0000", 2024-09-12T00:04:20.476 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019113999999999999 2024-09-12T00:04:20.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.476 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.476 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:20.476 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179382+0000", 2024-09-12T00:04:20.476 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022697099999999999 2024-09-12T00:04:20.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.476 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.477 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:20.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186356+0000", 2024-09-12T00:04:20.477 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069741919999999997 2024-09-12T00:04:20.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.477 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:20.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186422+0000", 2024-09-12T00:04:20.477 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6387e-05 2024-09-12T00:04:20.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.477 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:20.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186481+0000", 2024-09-12T00:04:20.477 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8059000000000001e-05 2024-09-12T00:04:20.478 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.478 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:20.478 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.478 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:20.478 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:20.478 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.226242346000006, 2024-09-12T00:04:20.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020001835999999999, 2024-09-12T00:04:20.478 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:20.478 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:20.478 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:20.478 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:20.479 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:20.479 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:20.479 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 69 2024-09-12T00:04:20.479 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.479 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:20.479 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.479 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:20.479 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:20.479 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.479 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.479 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.479 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:20.479 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:20.480 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.480 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.480 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.480 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:20.480 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171225+0000", 2024-09-12T00:04:20.480 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0599999999999999e-07 2024-09-12T00:04:20.480 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.480 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.480 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:20.480 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171349+0000", 2024-09-12T00:04:20.480 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012407299999999999 2024-09-12T00:04:20.480 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.481 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.481 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:20.481 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171367+0000", 2024-09-12T00:04:20.481 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8413000000000001e-05 2024-09-12T00:04:20.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.481 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.481 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:20.481 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171376+0000", 2024-09-12T00:04:20.481 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8170000000000005e-06 2024-09-12T00:04:20.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.481 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.481 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:20.481 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177692+0000", 2024-09-12T00:04:20.482 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063156729999999999 2024-09-12T00:04:20.482 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.482 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.482 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:20.482 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177817+0000", 2024-09-12T00:04:20.482 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012581499999999999 2024-09-12T00:04:20.482 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.482 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.482 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:20.482 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.178015+0000", 2024-09-12T00:04:20.482 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019715100000000001 2024-09-12T00:04:20.482 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.482 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.483 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:20.483 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181798+0000", 2024-09-12T00:04:20.483 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003783308 2024-09-12T00:04:20.483 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.483 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.483 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:20.483 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190976+0000", 2024-09-12T00:04:20.483 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091776519999999997 2024-09-12T00:04:20.483 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.483 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.483 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:20.483 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191122+0000", 2024-09-12T00:04:20.483 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000145966 2024-09-12T00:04:20.483 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.484 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.484 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:20.484 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191226+0000", 2024-09-12T00:04:20.484 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104162 2024-09-12T00:04:20.484 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.484 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:20.484 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.484 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.484 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.484 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:20.484 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:20.484 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.226073611000004, 2024-09-12T00:04:20.484 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019997773, 2024-09-12T00:04:20.485 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:20.485 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:20.485 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:20.485 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:20.485 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:20.485 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:20.485 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 70 2024-09-12T00:04:20.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.485 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:20.485 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.485 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:20.485 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:20.485 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.486 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.486 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:20.486 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:20.486 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.486 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.486 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:20.486 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:20.486 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3699999999999999e-07 2024-09-12T00:04:20.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.486 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.486 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:20.487 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171403+0000", 2024-09-12T00:04:20.487 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6199999999999994e-06 2024-09-12T00:04:20.487 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.487 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.487 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:20.487 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171416+0000", 2024-09-12T00:04:20.487 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2636000000000001e-05 2024-09-12T00:04:20.487 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.487 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.487 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:20.487 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171423+0000", 2024-09-12T00:04:20.487 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5440000000000001e-06 2024-09-12T00:04:20.487 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.487 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.488 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:20.488 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179458+0000", 2024-09-12T00:04:20.488 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080351989999999998 2024-09-12T00:04:20.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.488 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.488 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:20.488 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179604+0000", 2024-09-12T00:04:20.488 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014519899999999999 2024-09-12T00:04:20.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.488 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.488 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:20.488 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179831+0000", 2024-09-12T00:04:20.488 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022704800000000001 2024-09-12T00:04:20.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.489 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.489 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:20.489 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181918+0000", 2024-09-12T00:04:20.489 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020873950000000001 2024-09-12T00:04:20.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.489 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.489 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:20.489 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191243+0000", 2024-09-12T00:04:20.489 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0093244729999999998 2024-09-12T00:04:20.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.489 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.490 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:20.490 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191309+0000", 2024-09-12T00:04:20.490 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6116000000000002e-05 2024-09-12T00:04:20.490 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.490 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.490 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:20.490 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191390+0000", 2024-09-12T00:04:20.490 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1705999999999993e-05 2024-09-12T00:04:20.490 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.490 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:20.490 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.490 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.490 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.491 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:20.491 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:20.491 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.226027537999997, 2024-09-12T00:04:20.491 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020263554, 2024-09-12T00:04:20.491 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:20.491 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:20.491 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:20.491 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:20.491 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:20.491 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:20.491 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 71 2024-09-12T00:04:20.491 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.491 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:20.492 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.492 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:20.492 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:20.492 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.492 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.492 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.492 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:20.492 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:20.492 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.492 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.492 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.492 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:20.492 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:20.493 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5000000000000002e-07 2024-09-12T00:04:20.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.493 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.493 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:20.493 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171454+0000", 2024-09-12T00:04:20.493 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5046e-05 2024-09-12T00:04:20.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.493 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.493 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:20.493 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171471+0000", 2024-09-12T00:04:20.493 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6923999999999999e-05 2024-09-12T00:04:20.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.493 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.494 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:20.494 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171487+0000", 2024-09-12T00:04:20.494 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5823000000000001e-05 2024-09-12T00:04:20.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.494 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:20.494 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180765+0000", 2024-09-12T00:04:20.494 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0092774399999999996 2024-09-12T00:04:20.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.494 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:20.494 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180900+0000", 2024-09-12T00:04:20.495 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013556700000000001 2024-09-12T00:04:20.495 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.495 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.495 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:20.495 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181108+0000", 2024-09-12T00:04:20.495 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020727899999999999 2024-09-12T00:04:20.495 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.495 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.495 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:20.495 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184725+0000", 2024-09-12T00:04:20.495 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036171340000000001 2024-09-12T00:04:20.495 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.495 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.495 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:20.496 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191413+0000", 2024-09-12T00:04:20.496 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066881830000000003 2024-09-12T00:04:20.496 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.496 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.496 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:20.496 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191540+0000", 2024-09-12T00:04:20.496 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000126823 2024-09-12T00:04:20.496 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.496 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.496 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:20.496 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191702+0000", 2024-09-12T00:04:20.496 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162585 2024-09-12T00:04:20.497 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.497 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:20.497 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.497 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.497 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.497 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:20.497 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:20.497 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.225948962000004, 2024-09-12T00:04:20.497 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020448573000000001, 2024-09-12T00:04:20.497 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:20.497 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:20.497 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:20.497 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:20.498 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:20.498 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:20.498 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 72 2024-09-12T00:04:20.498 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.498 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:20.498 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.498 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:20.498 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:20.498 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.498 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.498 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.498 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:20.498 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:20.499 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.499 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.499 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:20.499 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171518+0000", 2024-09-12T00:04:20.499 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0440000000000001e-06 2024-09-12T00:04:20.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.499 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.499 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:20.499 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171647+0000", 2024-09-12T00:04:20.499 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012912899999999999 2024-09-12T00:04:20.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.499 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.500 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:20.500 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171664+0000", 2024-09-12T00:04:20.500 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6079999999999999e-05 2024-09-12T00:04:20.500 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.500 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.500 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:20.500 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171675+0000", 2024-09-12T00:04:20.500 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1223000000000001e-05 2024-09-12T00:04:20.500 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.500 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.500 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:20.500 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182000+0000", 2024-09-12T00:04:20.500 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010324949 2024-09-12T00:04:20.501 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.501 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.501 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:20.501 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182178+0000", 2024-09-12T00:04:20.501 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017808799999999999 2024-09-12T00:04:20.501 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.501 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.501 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:20.501 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182402+0000", 2024-09-12T00:04:20.501 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022381199999999999 2024-09-12T00:04:20.501 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.501 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.502 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:20.502 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190935+0000", 2024-09-12T00:04:20.502 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085331560000000001 2024-09-12T00:04:20.502 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.502 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.502 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:20.502 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191728+0000", 2024-09-12T00:04:20.502 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079325700000000001 2024-09-12T00:04:20.502 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.502 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.502 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:20.502 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191864+0000", 2024-09-12T00:04:20.502 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013606299999999999 2024-09-12T00:04:20.503 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.503 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.503 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:20.503 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191966+0000", 2024-09-12T00:04:20.503 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101772 2024-09-12T00:04:20.503 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.503 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:20.503 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.503 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.503 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.503 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:20.503 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:20.503 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.225765766999999, 2024-09-12T00:04:20.504 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020675235, 2024-09-12T00:04:20.504 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:20.504 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:20.504 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:20.504 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:20.504 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:20.504 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:20.504 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 73 2024-09-12T00:04:20.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.504 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:20.504 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.504 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:20.504 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:20.505 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.505 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.505 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:20.505 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:20.505 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.505 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.505 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:20.505 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171701+0000", 2024-09-12T00:04:20.505 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0999999999999997e-07 2024-09-12T00:04:20.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.506 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.506 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:20.506 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171709+0000", 2024-09-12T00:04:20.506 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2540000000000003e-06 2024-09-12T00:04:20.506 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.506 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.506 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:20.506 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171724+0000", 2024-09-12T00:04:20.506 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5569e-05 2024-09-12T00:04:20.506 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.506 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.506 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:20.506 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171734+0000", 2024-09-12T00:04:20.507 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6139999999999998e-06 2024-09-12T00:04:20.507 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.507 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.507 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:20.507 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183774+0000", 2024-09-12T00:04:20.507 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012040444000000001 2024-09-12T00:04:20.507 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.507 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.507 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:20.507 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183896+0000", 2024-09-12T00:04:20.507 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012204199999999999 2024-09-12T00:04:20.507 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.507 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.508 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:20.508 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184084+0000", 2024-09-12T00:04:20.508 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018792599999999999 2024-09-12T00:04:20.508 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.508 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.508 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:20.508 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191984+0000", 2024-09-12T00:04:20.508 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079003790000000008 2024-09-12T00:04:20.508 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.508 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.508 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:20.508 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192093+0000", 2024-09-12T00:04:20.508 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000108942 2024-09-12T00:04:20.509 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.509 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.509 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:20.509 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192250+0000", 2024-09-12T00:04:20.509 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015637600000000001 2024-09-12T00:04:20.509 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.509 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.509 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:20.509 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192376+0000", 2024-09-12T00:04:20.509 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012587899999999999 2024-09-12T00:04:20.509 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.509 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:20.509 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.510 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.510 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:20.510 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:20.510 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.225717556999996, 2024-09-12T00:04:20.510 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021088828, 2024-09-12T00:04:20.510 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:20.510 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:20.510 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:20.510 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:20.510 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:20.510 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:20.510 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 74 2024-09-12T00:04:20.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.511 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:20.511 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.511 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:20.511 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:20.511 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.511 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.511 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:20.511 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:20.511 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.511 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.512 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:20.512 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:20.512 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1699999999999997e-07 2024-09-12T00:04:20.512 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.512 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.512 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:20.512 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171758+0000", 2024-09-12T00:04:20.512 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0860000000000008e-06 2024-09-12T00:04:20.512 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.512 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.512 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:20.512 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171774+0000", 2024-09-12T00:04:20.512 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:04:20.513 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.513 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.513 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:20.513 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171788+0000", 2024-09-12T00:04:20.513 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4793999999999999e-05 2024-09-12T00:04:20.513 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.513 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.513 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:20.513 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184842+0000", 2024-09-12T00:04:20.513 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013053607 2024-09-12T00:04:20.513 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.513 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.513 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:20.514 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185130+0000", 2024-09-12T00:04:20.514 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00028779199999999998 2024-09-12T00:04:20.514 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.514 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.514 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:20.514 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185378+0000", 2024-09-12T00:04:20.514 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024780100000000002 2024-09-12T00:04:20.514 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.514 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.514 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:20.514 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192513+0000", 2024-09-12T00:04:20.514 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071350770000000001 2024-09-12T00:04:20.514 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.515 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.515 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:20.515 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192690+0000", 2024-09-12T00:04:20.515 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000176892 2024-09-12T00:04:20.515 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.515 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.515 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:20.515 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192769+0000", 2024-09-12T00:04:20.515 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9466000000000001e-05 2024-09-12T00:04:20.515 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.515 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.515 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:20.515 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192837+0000", 2024-09-12T00:04:20.515 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8466000000000005e-05 2024-09-12T00:04:20.516 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.516 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:20.516 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.516 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.516 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.516 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:20.516 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:20.516 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.225664980000005, 2024-09-12T00:04:20.516 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.02121994, 2024-09-12T00:04:20.516 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:20.516 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:20.516 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:20.516 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:20.517 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:20.517 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:20.517 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 75 2024-09-12T00:04:20.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.517 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:20.517 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.517 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:20.517 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:20.518 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.518 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.518 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.518 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:20.518 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:20.518 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.518 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.518 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.518 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:20.518 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171802+0000", 2024-09-12T00:04:20.518 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5000000000000002e-07 2024-09-12T00:04:20.518 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.518 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.519 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:20.519 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171954+0000", 2024-09-12T00:04:20.519 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015215500000000001 2024-09-12T00:04:20.519 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.519 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.519 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:20.519 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171966+0000", 2024-09-12T00:04:20.519 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1548e-05 2024-09-12T00:04:20.519 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.519 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.519 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:20.519 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171970+0000", 2024-09-12T00:04:20.519 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8729999999999998e-06 2024-09-12T00:04:20.520 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.520 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.520 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:20.520 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186552+0000", 2024-09-12T00:04:20.520 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014581775 2024-09-12T00:04:20.520 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.520 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.520 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:20.520 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186702+0000", 2024-09-12T00:04:20.520 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014946 2024-09-12T00:04:20.520 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.520 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.520 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:20.521 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186897+0000", 2024-09-12T00:04:20.521 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000195071 2024-09-12T00:04:20.521 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.521 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.521 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:20.521 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192666+0000", 2024-09-12T00:04:20.521 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057693470000000002 2024-09-12T00:04:20.521 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.521 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.521 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:20.521 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192857+0000", 2024-09-12T00:04:20.521 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191149 2024-09-12T00:04:20.521 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.522 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.522 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:20.522 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192967+0000", 2024-09-12T00:04:20.522 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110202 2024-09-12T00:04:20.522 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.522 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.522 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:20.522 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193021+0000", 2024-09-12T00:04:20.522 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3709999999999999e-05 2024-09-12T00:04:20.522 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.522 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:20.522 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.522 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.523 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.523 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:20.523 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:20.523 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.225485684999995, 2024-09-12T00:04:20.523 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026297425999999999, 2024-09-12T00:04:20.523 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:20.523 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:20.523 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:20.523 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:20.523 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:20.523 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:20.523 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 76 2024-09-12T00:04:20.523 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.524 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:20.524 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.524 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:20.524 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:20.524 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.524 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.524 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.524 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:20.524 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:20.524 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:20.524 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.524 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.524 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:20.525 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:20.525 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9399999999999995e-07 2024-09-12T00:04:20.525 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.525 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.525 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:20.525 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171987+0000", 2024-09-12T00:04:20.525 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5230000000000003e-06 2024-09-12T00:04:20.525 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.525 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.525 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:20.525 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172005+0000", 2024-09-12T00:04:20.525 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8788e-05 2024-09-12T00:04:20.525 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.525 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.526 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:20.526 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172010+0000", 2024-09-12T00:04:20.526 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7570000000000004e-06 2024-09-12T00:04:20.526 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.526 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.526 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:20.526 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193104+0000", 2024-09-12T00:04:20.526 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021094112000000002 2024-09-12T00:04:20.526 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.526 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.526 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:20.526 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193334+0000", 2024-09-12T00:04:20.526 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000229855 2024-09-12T00:04:20.526 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.526 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.527 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:20.527 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193697+0000", 2024-09-12T00:04:20.527 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00036272399999999998 2024-09-12T00:04:20.527 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.527 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.527 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:20.527 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.195602+0000", 2024-09-12T00:04:20.527 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019049620000000001 2024-09-12T00:04:20.527 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.527 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.527 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:20.527 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198123+0000", 2024-09-12T00:04:20.527 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025216520000000001 2024-09-12T00:04:20.527 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.528 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.528 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:20.528 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198213+0000", 2024-09-12T00:04:20.528 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0008999999999998e-05 2024-09-12T00:04:20.528 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:20.528 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:20.528 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:20.528 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198278+0000", 2024-09-12T00:04:20.528 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4549999999999997e-05 2024-09-12T00:04:20.528 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.528 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:20.528 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.528 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:20.528 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:20.529 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:20.530 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:04:20.530 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:20.529+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:20.631 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:20.631+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:20.670 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.7 to 1 (10000) 2024-09-12T00:04:20.701 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T00:04:20.701 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:04:20.732 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:20.731+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:20.741 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:04:20.747 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:20.747 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:20.747 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:20.747 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:20.768 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:04:20.854 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:20.853+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:20.933 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:20.933+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:20.958 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:20.959 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:20.985 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:20.985 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:20.985 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:20.985 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:20.985 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:20.994 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:20.994 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:21.000 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:04:21.025 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:21.025 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:21.035 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:21.035+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:21.055 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:21.089 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:21.090 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:21.123 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:21.124 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:21.136 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:21.133+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:21.157 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:21.158 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:21.185 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:21.185 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:21.191 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:21.192 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:21.208 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:04:21.237 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:21.239+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:21.255 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:04:21.274 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T00:04:21.286 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-09-12T00:04:20.668321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":1047,"num_read_kb":763,"num_write":724,"num_write_kb":1672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":679,"ondisk_log_size":679,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230596,"kb_used_data":6020,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744124,"statfs":{"total":773094113280,"available":772857982976,"internally_reserved":0,"allocated":6164480,"data_stored":3536957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.029743"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953529+0000","last_change":"2024-09-12T00:03:23.604218+0000","last_active":"2024-09-12T00:04:17.953529+0000","last_peered":"2024-09-12T00:04:17.953529+0000","last_clean":"2024-09-12T00:04:17.953529+0000","last_became_active":"2024-09-12T00:03:23.603902+0000","last_became_peered":"2024-09-12T00:03:23.603902+0000","last_unstale":"2024-09-12T00:04:17.953529+0000","last_undegraded":"2024-09-12T00:04:17.953529+0000","last_fullsized":"2024-09-12T00:04:17.953529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:35.848041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950562+0000","last_change":"2024-09-12T00:03:25.337244+0000","last_active":"2024-09-12T00:04:17.950562+0000","last_peered":"2024-09-12T00:04:17.950562+0000","last_clean":"2024-09-12T00:04:17.950562+0000","last_became_active":"2024-09-12T00:03:25.335964+0000","last_became_peered":"2024-09-12T00:03:25.335964+0000","last_unstale":"2024-09-12T00:04:17.950562+0000","last_undegraded":"2024-09-12T00:04:17.950562+0000","last_fullsized":"2024-09-12T00:04:17.950562+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951374+0000","last_change":"2024-09-12T00:03:23.628328+0000","last_active":"2024-09-12T00:04:17.951374+0000","last_peered":"2024-09-12T00:04:17.951374+0000","last_clean":"2024-09-12T00:04:17.951374+0000","last_became_active":"2024-09-12T00:03:23.627630+0000","last_became_peered":"2024-09-12T00:03:23.627630+0000","last_unstale":"2024-09-12T00:04:17.951374+0000","last_undegraded":"2024-09-12T00:04:17.951374+0000","last_fullsized":"2024-09-12T00:04:17.951374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:00.573006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642617+0000","last_change":"2024-09-12T00:03:25.338343+0000","last_active":"2024-09-12T00:04:17.642617+0000","last_peered":"2024-09-12T00:04:17.642617+0000","last_clean":"2024-09-12T00:04:17.642617+0000","last_became_active":"2024-09-12T00:03:25.337994+0000","last_became_peered":"2024-09-12T00:03:25.337994+0000","last_unstale":"2024-09-12T00:04:17.642617+0000","last_undegraded":"2024-09-12T00:04:17.642617+0000","last_fullsized":"2024-09-12T00:04:17.642617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:39.689763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950995+0000","last_change":"2024-09-12T00:03:23.626533+0000","last_active":"2024-09-12T00:04:17.950995+0000","last_peered":"2024-09-12T00:04:17.950995+0000","last_clean":"2024-09-12T00:04:17.950995+0000","last_became_active":"2024-09-12T00:03:23.625728+0000","last_became_peered":"2024-09-12T00:03:23.625728+0000","last_unstale":"2024-09-12T00:04:17.950995+0000","last_undegraded":"2024-09-12T00:04:17.950995+0000","last_fullsized":"2024-09-12T00:04:17.950995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:31.772442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642099+0000","last_change":"2024-09-12T00:03:25.336667+0000","last_active":"2024-09-12T00:04:17.642099+0000","last_peered":"2024-09-12T00:04:17.642099+0000","last_clean":"2024-09-12T00:04:17.642099+0000","last_became_active":"2024-09-12T00:03:25.336327+0000","last_became_peered":"2024-09-12T00:03:25.336327+0000","last_unstale":"2024-09-12T00:04:17.642099+0000","last_undegraded":"2024-09-12T00:04:17.642099+0000","last_fullsized":"2024-09-12T00:04:17.642099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:45.222842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.648647+0000","last_change":"2024-09-12T00:03:23.609828+0000","last_active":"2024-09-12T00:04:18.648647+0000","last_peered":"2024-09-12T00:04:18.648647+0000","last_clean":"2024-09-12T00:04:18.648647+0000","last_became_active":"2024-09-12T00:03:23.609326+0000","last_became_peered":"2024-09-12T00:03:23.609326+0000","last_unstale":"2024-09-12T00:04:18.648647+0000","last_undegraded":"2024-09-12T00:04:18.648647+0000","last_fullsized":"2024-09-12T00:04:18.648647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:25.491620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646301+0000","last_change":"2024-09-12T00:03:25.339518+0000","last_active":"2024-09-12T00:04:18.646301+0000","last_peered":"2024-09-12T00:04:18.646301+0000","last_clean":"2024-09-12T00:04:18.646301+0000","last_became_active":"2024-09-12T00:03:25.338805+0000","last_became_peered":"2024-09-12T00:03:25.338805+0000","last_unstale":"2024-09-12T00:04:18.646301+0000","last_undegraded":"2024-09-12T00:04:18.646301+0000","last_fullsized":"2024-09-12T00:04:18.646301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951205+0000","last_change":"2024-09-12T00:03:23.633978+0000","last_active":"2024-09-12T00:04:17.951205+0000","last_peered":"2024-09-12T00:04:17.951205+0000","last_clean":"2024-09-12T00:04:17.951205+0000","last_became_active":"2024-09-12T00:03:23.633580+0000","last_became_peered":"2024-09-12T00:03:23.633580+0000","last_unstale":"2024-09-12T00:04:17.951205+0000","last_undegraded":"2024-09-12T00:04:17.951205+0000","last_fullsized":"2024-09-12T00:04:17.951205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:01.872688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.954537+0000","last_change":"2024-09-12T00:03:25.324424+0000","last_active":"2024-09-12T00:04:17.954537+0000","last_peered":"2024-09-12T00:04:17.954537+0000","last_clean":"2024-09-12T00:04:17.954537+0000","last_became_active":"2024-09-12T00:03:25.324138+0000","last_became_peered":"2024-09-12T00:03:25.324138+0000","last_unstale":"2024-09-12T00:04:17.954537+0000","last_undegraded":"2024-09-12T00:04:17.954537+0000","last_fullsized":"2024-09-12T00:04:17.954537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:09.954252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647258+0000","last_change":"2024-09-12T00:03:23.610136+0000","last_active":"2024-09-12T00:04:18.647258+0000","last_peered":"2024-09-12T00:04:18.647258+0000","last_clean":"2024-09-12T00:04:18.647258+0000","last_became_active":"2024-09-12T00:03:23.609509+0000","last_became_peered":"2024-09-12T00:03:23.609509+0000","last_unstale":"2024-09-12T00:04:18.647258+0000","last_undegraded":"2024-09-12T00:04:18.647258+0000","last_fullsized":"2024-09-12T00:04:18.647258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.954139+0000","last_change":"2024-09-12T00:03:25.355256+0000","last_active":"2024-09-12T00:04:17.954139+0000","last_peered":"2024-09-12T00:04:17.954139+0000","last_clean":"2024-09-12T00:04:17.954139+0000","last_became_active":"2024-09-12T00:03:25.355002+0000","last_became_peered":"2024-09-12T00:03:25.355002+0000","last_unstale":"2024-09-12T00:04:17.954139+0000","last_undegraded":"2024-09-12T00:04:17.954139+0000","last_fullsized":"2024-09-12T00:04:17.954139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:50.488869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950708+0000","last_change":"2024-09-12T00:03:23.606780+0000","last_active":"2024-09-12T00:04:17.950708+0000","last_peered":"2024-09-12T00:04:17.950708+0000","last_clean":"2024-09-12T00:04:17.950708+0000","last_became_active":"2024-09-12T00:03:23.606143+0000","last_became_peered":"2024-09-12T00:03:23.606143+0000","last_unstale":"2024-09-12T00:04:17.950708+0000","last_undegraded":"2024-09-12T00:04:17.950708+0000","last_fullsized":"2024-09-12T00:04:17.950708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:22.889982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.649408+0000","last_change":"2024-09-12T00:03:25.330195+0000","last_active":"2024-09-12T00:04:18.649408+0000","last_peered":"2024-09-12T00:04:18.649408+0000","last_clean":"2024-09-12T00:04:18.649408+0000","last_became_active":"2024-09-12T00:03:25.329625+0000","last_became_peered":"2024-09-12T00:03:25.329625+0000","last_unstale":"2024-09-12T00:04:18.649408+0000","last_undegraded":"2024-09-12T00:04:18.649408+0000","last_fullsized":"2024-09-12T00:04:18.649408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950232+0000","last_change":"2024-09-12T00:03:23.626723+0000","last_active":"2024-09-12T00:04:17.950232+0000","last_peered":"2024-09-12T00:04:17.950232+0000","last_clean":"2024-09-12T00:04:17.950232+0000","last_became_active":"2024-09-12T00:03:23.626018+0000","last_became_peered":"2024-09-12T00:03:23.626018+0000","last_unstale":"2024-09-12T00:04:17.950232+0000","last_undegraded":"2024-09-12T00:04:17.950232+0000","last_fullsized":"2024-09-12T00:04:17.950232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951710+0000","last_change":"2024-09-12T00:03:25.352418+0000","last_active":"2024-09-12T00:04:17.951710+0000","last_peered":"2024-09-12T00:04:17.951710+0000","last_clean":"2024-09-12T00:04:17.951710+0000","last_became_active":"2024-09-12T00:03:25.347902+0000","last_became_peered":"2024-09-12T00:03:25.347902+0000","last_unstale":"2024-09-12T00:04:17.951710+0000","last_undegraded":"2024-09-12T00:04:17.951710+0000","last_fullsized":"2024-09-12T00:04:17.951710+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:29.611790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.644605+0000","last_change":"2024-09-12T00:03:25.321057+0000","last_active":"2024-09-12T00:04:17.644605+0000","last_peered":"2024-09-12T00:04:17.644605+0000","last_clean":"2024-09-12T00:04:17.644605+0000","last_became_active":"2024-09-12T00:03:25.320611+0000","last_became_peered":"2024-09-12T00:03:25.320611+0000","last_unstale":"2024-09-12T00:04:17.644605+0000","last_undegraded":"2024-09-12T00:04:17.644605+0000","last_fullsized":"2024-09-12T00:04:17.644605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:46.041829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.952717+0000","last_change":"2024-09-12T00:03:23.594170+0000","last_active":"2024-09-12T00:04:17.952717+0000","last_peered":"2024-09-12T00:04:17.952717+0000","last_clean":"2024-09-12T00:04:17.952717+0000","last_became_active":"2024-09-12T00:03:23.593880+0000","last_became_peered":"2024-09-12T00:03:23.593880+0000","last_unstale":"2024-09-12T00:04:17.952717+0000","last_undegraded":"2024-09-12T00:04:17.952717+0000","last_fullsized":"2024-09-12T00:04:17.952717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:33.234598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950589+0000","last_change":"2024-09-12T00:03:25.334966+0000","last_active":"2024-09-12T00:04:17.950589+0000","last_peered":"2024-09-12T00:04:17.950589+0000","last_clean":"2024-09-12T00:04:17.950589+0000","last_became_active":"2024-09-12T00:03:25.334375+0000","last_became_peered":"2024-09-12T00:03:25.334375+0000","last_unstale":"2024-09-12T00:04:17.950589+0000","last_undegraded":"2024-09-12T00:04:17.950589+0000","last_fullsized":"2024-09-12T00:04:17.950589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:52.828056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953668+0000","last_change":"2024-09-12T00:03:23.614289+0000","last_active":"2024-09-12T00:04:17.953668+0000","last_peered":"2024-09-12T00:04:17.953668+0000","last_clean":"2024-09-12T00:04:17.953668+0000","last_became_active":"2024-09-12T00:03:23.614019+0000","last_became_peered":"2024-09-12T00:03:23.614019+0000","last_unstale":"2024-09-12T00:04:17.953668+0000","last_undegraded":"2024-09-12T00:04:17.953668+0000","last_fullsized":"2024-09-12T00:04:17.953668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:00.847027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951647+0000","last_change":"2024-09-12T00:03:25.357938+0000","last_active":"2024-09-12T00:04:17.951647+0000","last_peered":"2024-09-12T00:04:17.951647+0000","last_clean":"2024-09-12T00:04:17.951647+0000","last_became_active":"2024-09-12T00:03:25.357571+0000","last_became_peered":"2024-09-12T00:03:25.357571+0000","last_unstale":"2024-09-12T00:04:17.951647+0000","last_undegraded":"2024-09-12T00:04:17.951647+0000","last_fullsized":"2024-09-12T00:04:17.951647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:05.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.954219+0000","last_change":"2024-09-12T00:03:23.604162+0000","last_active":"2024-09-12T00:04:17.954219+0000","last_peered":"2024-09-12T00:04:17.954219+0000","last_clean":"2024-09-12T00:04:17.954219+0000","last_became_active":"2024-09-12T00:03:23.603466+0000","last_became_peered":"2024-09-12T00:03:23.603466+0000","last_unstale":"2024-09-12T00:04:17.954219+0000","last_undegraded":"2024-09-12T00:04:17.954219+0000","last_fullsized":"2024-09-12T00:04:17.954219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:50.482404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.644134+0000","last_change":"2024-09-12T00:03:25.345717+0000","last_active":"2024-09-12T00:04:18.644134+0000","last_peered":"2024-09-12T00:04:18.644134+0000","last_clean":"2024-09-12T00:04:18.644134+0000","last_became_active":"2024-09-12T00:03:25.344959+0000","last_became_peered":"2024-09-12T00:03:25.344959+0000","last_unstale":"2024-09-12T00:04:18.644134+0000","last_undegraded":"2024-09-12T00:04:18.644134+0000","last_fullsized":"2024-09-12T00:04:18.644134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.954693+0000","last_change":"2024-09-12T00:03:23.602960+0000","last_active":"2024-09-12T00:04:17.954693+0000","last_peered":"2024-09-12T00:04:17.954693+0000","last_clean":"2024-09-12T00:04:17.954693+0000","last_became_active":"2024-09-12T00:03:23.602640+0000","last_became_peered":"2024-09-12T00:03:23.602640+0000","last_unstale":"2024-09-12T00:04:17.954693+0000","last_undegraded":"2024-09-12T00:04:17.954693+0000","last_fullsized":"2024-09-12T00:04:17.954693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950567+0000","last_change":"2024-09-12T00:03:25.339888+0000","last_active":"2024-09-12T00:04:17.950567+0000","last_peered":"2024-09-12T00:04:17.950567+0000","last_clean":"2024-09-12T00:04:17.950567+0000","last_became_active":"2024-09-12T00:03:25.339092+0000","last_became_peered":"2024-09-12T00:03:25.339092+0000","last_unstale":"2024-09-12T00:04:17.950567+0000","last_undegraded":"2024-09-12T00:04:17.950567+0000","last_fullsized":"2024-09-12T00:04:17.950567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:06.165291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":67,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.644324+0000","last_change":"2024-09-12T00:03:23.604732+0000","last_active":"2024-09-12T00:04:18.644324+0000","last_peered":"2024-09-12T00:04:18.644324+0000","last_clean":"2024-09-12T00:04:18.644324+0000","last_became_active":"2024-09-12T00:03:23.603932+0000","last_became_peered":"2024-09-12T00:03:23.603932+0000","last_unstale":"2024-09-12T00:04:18.644324+0000","last_undegraded":"2024-09-12T00:04:18.644324+0000","last_fullsized":"2024-09-12T00:04:18.644324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:14.913580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951959+0000","last_change":"2024-09-12T00:03:25.341332+0000","last_active":"2024-09-12T00:04:17.951959+0000","last_peered":"2024-09-12T00:04:17.951959+0000","last_clean":"2024-09-12T00:04:17.951959+0000","last_became_active":"2024-09-12T00:03:25.340828+0000","last_became_peered":"2024-09-12T00:03:25.340828+0000","last_unstale":"2024-09-12T00:04:17.951959+0000","last_undegraded":"2024-09-12T00:04:17.951959+0000","last_fullsized":"2024-09-12T00:04:17.951959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":67,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643220+0000","last_change":"2024-09-12T00:03:23.602687+0000","last_active":"2024-09-12T00:04:18.643220+0000","last_peered":"2024-09-12T00:04:18.643220+0000","last_clean":"2024-09-12T00:04:18.643220+0000","last_became_active":"2024-09-12T00:03:23.601892+0000","last_became_peered":"2024-09-12T00:03:23.601892+0000","last_unstale":"2024-09-12T00:04:18.643220+0000","last_undegraded":"2024-09-12T00:04:18.643220+0000","last_fullsized":"2024-09-12T00:04:18.643220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950204+0000","last_change":"2024-09-12T00:03:33.354850+0000","last_active":"2024-09-12T00:04:17.950204+0000","last_peered":"2024-09-12T00:04:17.950204+0000","last_clean":"2024-09-12T00:04:17.950204+0000","last_became_active":"2024-09-12T00:03:33.351917+0000","last_became_peered":"2024-09-12T00:03:33.351917+0000","last_unstale":"2024-09-12T00:04:17.950204+0000","last_undegraded":"2024-09-12T00:04:17.950204+0000","last_fullsized":"2024-09-12T00:04:17.950204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:00.466863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643763+0000","last_change":"2024-09-12T00:03:25.323174+0000","last_active":"2024-09-12T00:04:18.643763+0000","last_peered":"2024-09-12T00:04:18.643763+0000","last_clean":"2024-09-12T00:04:18.643763+0000","last_became_active":"2024-09-12T00:03:25.322456+0000","last_became_peered":"2024-09-12T00:03:25.322456+0000","last_unstale":"2024-09-12T00:04:18.643763+0000","last_undegraded":"2024-09-12T00:04:18.643763+0000","last_fullsized":"2024-09-12T00:04:18.643763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":71,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.641842+0000","last_change":"2024-09-12T00:04:01.825243+0000","last_active":"2024-09-12T00:04:17.641842+0000","last_peered":"2024-09-12T00:04:17.641842+0000","last_clean":"2024-09-12T00:04:17.641842+0000","last_became_active":"2024-09-12T00:04:01.824774+0000","last_became_peered":"2024-09-12T00:04:01.824774+0000","last_unstale":"2024-09-12T00:04:17.641842+0000","last_undegraded":"2024-09-12T00:04:17.641842+0000","last_fullsized":"2024-09-12T00:04:17.641842+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:53.932507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643393+0000","last_change":"2024-09-12T00:03:27.341305+0000","last_active":"2024-09-12T00:04:17.643393+0000","last_peered":"2024-09-12T00:04:17.643393+0000","last_clean":"2024-09-12T00:04:17.643393+0000","last_became_active":"2024-09-12T00:03:27.338132+0000","last_became_peered":"2024-09-12T00:03:27.338132+0000","last_unstale":"2024-09-12T00:04:17.643393+0000","last_undegraded":"2024-09-12T00:04:17.643393+0000","last_fullsized":"2024-09-12T00:04:17.643393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:11.884824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'21","reported_seq":93,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647114+0000","last_change":"2024-09-12T00:03:29.347224+0000","last_active":"2024-09-12T00:04:18.647114+0000","last_peered":"2024-09-12T00:04:18.647114+0000","last_clean":"2024-09-12T00:04:18.647114+0000","last_became_active":"2024-09-12T00:03:29.346662+0000","last_became_peered":"2024-09-12T00:03:29.346662+0000","last_unstale":"2024-09-12T00:04:18.647114+0000","last_undegraded":"2024-09-12T00:04:18.647114+0000","last_fullsized":"2024-09-12T00:04:18.647114+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:28.258932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":49,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.952348+0000","last_change":"2024-09-12T00:03:31.337219+0000","last_active":"2024-09-12T00:04:17.952348+0000","last_peered":"2024-09-12T00:04:17.952348+0000","last_clean":"2024-09-12T00:04:17.952348+0000","last_became_active":"2024-09-12T00:03:31.336317+0000","last_became_peered":"2024-09-12T00:03:31.336317+0000","last_unstale":"2024-09-12T00:04:17.952348+0000","last_undegraded":"2024-09-12T00:04:17.952348+0000","last_fullsized":"2024-09-12T00:04:17.952348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:50.954053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950478+0000","last_change":"2024-09-12T00:03:33.376628+0000","last_active":"2024-09-12T00:04:17.950478+0000","last_peered":"2024-09-12T00:04:17.950478+0000","last_clean":"2024-09-12T00:04:17.950478+0000","last_became_active":"2024-09-12T00:03:33.375938+0000","last_became_peered":"2024-09-12T00:03:33.375938+0000","last_unstale":"2024-09-12T00:04:17.950478+0000","last_undegraded":"2024-09-12T00:04:17.950478+0000","last_fullsized":"2024-09-12T00:04:17.950478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:31.105042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642994+0000","last_change":"2024-09-12T00:03:25.326911+0000","last_active":"2024-09-12T00:04:17.642994+0000","last_peered":"2024-09-12T00:04:17.642994+0000","last_clean":"2024-09-12T00:04:17.642994+0000","last_became_active":"2024-09-12T00:03:25.326255+0000","last_became_peered":"2024-09-12T00:03:25.326255+0000","last_unstale":"2024-09-12T00:04:17.642994+0000","last_undegraded":"2024-09-12T00:04:17.642994+0000","last_fullsized":"2024-09-12T00:04:17.642994+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:15.491636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":67,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643268+0000","last_change":"2024-09-12T00:03:23.596266+0000","last_active":"2024-09-12T00:04:18.643268+0000","last_peered":"2024-09-12T00:04:18.643268+0000","last_clean":"2024-09-12T00:04:18.643268+0000","last_became_active":"2024-09-12T00:03:23.595480+0000","last_became_peered":"2024-09-12T00:03:23.595480+0000","last_unstale":"2024-09-12T00:04:18.643268+0000","last_undegraded":"2024-09-12T00:04:18.643268+0000","last_fullsized":"2024-09-12T00:04:18.643268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:25.491620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":57,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646460+0000","last_change":"2024-09-12T00:03:27.336108+0000","last_active":"2024-09-12T00:04:18.646460+0000","last_peered":"2024-09-12T00:04:18.646460+0000","last_clean":"2024-09-12T00:04:18.646460+0000","last_became_active":"2024-09-12T00:03:27.335308+0000","last_became_peered":"2024-09-12T00:03:27.335308+0000","last_unstale":"2024-09-12T00:04:18.646460+0000","last_undegraded":"2024-09-12T00:04:18.646460+0000","last_fullsized":"2024-09-12T00:04:18.646460+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:39.812803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'12","reported_seq":74,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.952411+0000","last_change":"2024-09-12T00:03:29.352496+0000","last_active":"2024-09-12T00:04:17.952411+0000","last_peered":"2024-09-12T00:04:17.952411+0000","last_clean":"2024-09-12T00:04:17.952411+0000","last_became_active":"2024-09-12T00:03:29.351783+0000","last_became_peered":"2024-09-12T00:03:29.351783+0000","last_unstale":"2024-09-12T00:04:17.952411+0000","last_undegraded":"2024-09-12T00:04:17.952411+0000","last_fullsized":"2024-09-12T00:04:17.952411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":49,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951930+0000","last_change":"2024-09-12T00:03:31.350279+0000","last_active":"2024-09-12T00:04:17.951930+0000","last_peered":"2024-09-12T00:04:17.951930+0000","last_clean":"2024-09-12T00:04:17.951930+0000","last_became_active":"2024-09-12T00:03:31.349244+0000","last_became_peered":"2024-09-12T00:03:31.349244+0000","last_unstale":"2024-09-12T00:04:17.951930+0000","last_undegraded":"2024-09-12T00:04:17.951930+0000","last_fullsized":"2024-09-12T00:04:17.951930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.420974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":47,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643030+0000","last_change":"2024-09-12T00:03:33.382726+0000","last_active":"2024-09-12T00:04:18.643030+0000","last_peered":"2024-09-12T00:04:18.643030+0000","last_clean":"2024-09-12T00:04:18.643030+0000","last_became_active":"2024-09-12T00:03:33.381875+0000","last_became_peered":"2024-09-12T00:03:33.381875+0000","last_unstale":"2024-09-12T00:04:18.643030+0000","last_undegraded":"2024-09-12T00:04:18.643030+0000","last_fullsized":"2024-09-12T00:04:18.643030+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951306+0000","last_change":"2024-09-12T00:03:25.357883+0000","last_active":"2024-09-12T00:04:17.951306+0000","last_peered":"2024-09-12T00:04:17.951306+0000","last_clean":"2024-09-12T00:04:17.951306+0000","last_became_active":"2024-09-12T00:03:25.355174+0000","last_became_peered":"2024-09-12T00:03:25.355174+0000","last_unstale":"2024-09-12T00:04:17.951306+0000","last_undegraded":"2024-09-12T00:04:17.951306+0000","last_fullsized":"2024-09-12T00:04:17.951306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:26.621650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642746+0000","last_change":"2024-09-12T00:03:23.617603+0000","last_active":"2024-09-12T00:04:17.642746+0000","last_peered":"2024-09-12T00:04:17.642746+0000","last_clean":"2024-09-12T00:04:17.642746+0000","last_became_active":"2024-09-12T00:03:23.617317+0000","last_became_peered":"2024-09-12T00:03:23.617317+0000","last_unstale":"2024-09-12T00:04:17.642746+0000","last_undegraded":"2024-09-12T00:04:17.642746+0000","last_fullsized":"2024-09-12T00:04:17.642746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:36.997566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":57,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647361+0000","last_change":"2024-09-12T00:03:27.347098+0000","last_active":"2024-09-12T00:04:18.647361+0000","last_peered":"2024-09-12T00:04:18.647361+0000","last_clean":"2024-09-12T00:04:18.647361+0000","last_became_active":"2024-09-12T00:03:27.346346+0000","last_became_peered":"2024-09-12T00:03:27.346346+0000","last_unstale":"2024-09-12T00:04:18.647361+0000","last_undegraded":"2024-09-12T00:04:18.647361+0000","last_fullsized":"2024-09-12T00:04:18.647361+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:56.250627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'22","reported_seq":92,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646362+0000","last_change":"2024-09-12T00:03:29.357080+0000","last_active":"2024-09-12T00:04:18.646362+0000","last_peered":"2024-09-12T00:04:18.646362+0000","last_clean":"2024-09-12T00:04:18.646362+0000","last_became_active":"2024-09-12T00:03:29.356262+0000","last_became_peered":"2024-09-12T00:03:29.356262+0000","last_unstale":"2024-09-12T00:04:18.646362+0000","last_undegraded":"2024-09-12T00:04:18.646362+0000","last_fullsized":"2024-09-12T00:04:18.646362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:27.790240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"32'2","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643475+0000","last_change":"2024-09-12T00:03:31.362060+0000","last_active":"2024-09-12T00:04:17.643475+0000","last_peered":"2024-09-12T00:04:17.643475+0000","last_clean":"2024-09-12T00:04:17.643475+0000","last_became_active":"2024-09-12T00:03:31.361330+0000","last_became_peered":"2024-09-12T00:03:31.361330+0000","last_unstale":"2024-09-12T00:04:17.643475+0000","last_undegraded":"2024-09-12T00:04:17.643475+0000","last_fullsized":"2024-09-12T00:04:17.643475+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:06.142584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":45,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647352+0000","last_change":"2024-09-12T00:03:33.378439+0000","last_active":"2024-09-12T00:04:18.647352+0000","last_peered":"2024-09-12T00:04:18.647352+0000","last_clean":"2024-09-12T00:04:18.647352+0000","last_became_active":"2024-09-12T00:03:33.374453+0000","last_became_peered":"2024-09-12T00:03:33.374453+0000","last_unstale":"2024-09-12T00:04:18.647352+0000","last_undegraded":"2024-09-12T00:04:18.647352+0000","last_fullsized":"2024-09-12T00:04:18.647352+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951613+0000","last_change":"2024-09-12T00:03:25.356433+0000","last_active":"2024-09-12T00:04:17.951613+0000","last_peered":"2024-09-12T00:04:17.951613+0000","last_clean":"2024-09-12T00:04:17.951613+0000","last_became_active":"2024-09-12T00:03:25.354803+0000","last_became_peered":"2024-09-12T00:03:25.354803+0000","last_unstale":"2024-09-12T00:04:17.951613+0000","last_undegraded":"2024-09-12T00:04:17.951613+0000","last_fullsized":"2024-09-12T00:04:17.951613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:00.419686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950800+0000","last_change":"2024-09-12T00:03:23.630527+0000","last_active":"2024-09-12T00:04:17.950800+0000","last_peered":"2024-09-12T00:04:17.950800+0000","last_clean":"2024-09-12T00:04:17.950800+0000","last_became_active":"2024-09-12T00:03:23.630183+0000","last_became_peered":"2024-09-12T00:03:23.630183+0000","last_unstale":"2024-09-12T00:04:17.950800+0000","last_undegraded":"2024-09-12T00:04:17.950800+0000","last_fullsized":"2024-09-12T00:04:17.950800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642907+0000","last_change":"2024-09-12T00:03:27.334188+0000","last_active":"2024-09-12T00:04:17.642907+0000","last_peered":"2024-09-12T00:04:17.642907+0000","last_clean":"2024-09-12T00:04:17.642907+0000","last_became_active":"2024-09-12T00:03:27.333395+0000","last_became_peered":"2024-09-12T00:03:27.333395+0000","last_unstale":"2024-09-12T00:04:17.642907+0000","last_undegraded":"2024-09-12T00:04:17.642907+0000","last_fullsized":"2024-09-12T00:04:17.642907+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:56.266608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'15","reported_seq":81,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.649161+0000","last_change":"2024-09-12T00:03:29.339735+0000","last_active":"2024-09-12T00:04:18.649161+0000","last_peered":"2024-09-12T00:04:18.649161+0000","last_clean":"2024-09-12T00:04:18.649161+0000","last_became_active":"2024-09-12T00:03:29.338810+0000","last_became_peered":"2024-09-12T00:03:29.338810+0000","last_unstale":"2024-09-12T00:04:18.649161+0000","last_undegraded":"2024-09-12T00:04:18.649161+0000","last_fullsized":"2024-09-12T00:04:18.649161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'2","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950691+0000","last_change":"2024-09-12T00:03:31.364647+0000","last_active":"2024-09-12T00:04:17.950691+0000","last_peered":"2024-09-12T00:04:17.950691+0000","last_clean":"2024-09-12T00:04:17.950691+0000","last_became_active":"2024-09-12T00:03:31.353547+0000","last_became_peered":"2024-09-12T00:03:31.353547+0000","last_unstale":"2024-09-12T00:04:17.950691+0000","last_undegraded":"2024-09-12T00:04:17.950691+0000","last_fullsized":"2024-09-12T00:04:17.950691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:20.795870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.644605+0000","last_change":"2024-09-12T00:03:25.329615+0000","last_active":"2024-09-12T00:04:17.644605+0000","last_peered":"2024-09-12T00:04:17.644605+0000","last_clean":"2024-09-12T00:04:17.644605+0000","last_became_active":"2024-09-12T00:03:25.329015+0000","last_became_peered":"2024-09-12T00:03:25.329015+0000","last_unstale":"2024-09-12T00:04:17.644605+0000","last_undegraded":"2024-09-12T00:04:17.644605+0000","last_fullsized":"2024-09-12T00:04:17.644605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:00.170397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953667+0000","last_change":"2024-09-12T00:03:23.602206+0000","last_active":"2024-09-12T00:04:17.953667+0000","last_peered":"2024-09-12T00:04:17.953667+0000","last_clean":"2024-09-12T00:04:17.953667+0000","last_became_active":"2024-09-12T00:03:23.601898+0000","last_became_peered":"2024-09-12T00:03:23.601898+0000","last_unstale":"2024-09-12T00:04:17.953667+0000","last_undegraded":"2024-09-12T00:04:17.953667+0000","last_fullsized":"2024-09-12T00:04:17.953667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:52.625795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950787+0000","last_change":"2024-09-12T00:03:27.331111+0000","last_active":"2024-09-12T00:04:17.950787+0000","last_peered":"2024-09-12T00:04:17.950787+0000","last_clean":"2024-09-12T00:04:17.950787+0000","last_became_active":"2024-09-12T00:03:27.329672+0000","last_became_peered":"2024-09-12T00:03:27.329672+0000","last_unstale":"2024-09-12T00:04:17.950787+0000","last_undegraded":"2024-09-12T00:04:17.950787+0000","last_fullsized":"2024-09-12T00:04:17.950787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'25","reported_seq":96,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951008+0000","last_change":"2024-09-12T00:03:29.335931+0000","last_active":"2024-09-12T00:04:17.951008+0000","last_peered":"2024-09-12T00:04:17.951008+0000","last_clean":"2024-09-12T00:04:17.951008+0000","last_became_active":"2024-09-12T00:03:29.335044+0000","last_became_peered":"2024-09-12T00:03:29.335044+0000","last_unstale":"2024-09-12T00:04:17.951008+0000","last_undegraded":"2024-09-12T00:04:17.951008+0000","last_fullsized":"2024-09-12T00:04:17.951008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:57.131209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":51,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643430+0000","last_change":"2024-09-12T00:03:31.355001+0000","last_active":"2024-09-12T00:04:18.643430+0000","last_peered":"2024-09-12T00:04:18.643430+0000","last_clean":"2024-09-12T00:04:18.643430+0000","last_became_active":"2024-09-12T00:03:31.354160+0000","last_became_peered":"2024-09-12T00:03:31.354160+0000","last_unstale":"2024-09-12T00:04:18.643430+0000","last_undegraded":"2024-09-12T00:04:18.643430+0000","last_fullsized":"2024-09-12T00:04:18.643430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:29.868141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":45,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.648320+0000","last_change":"2024-09-12T00:03:33.387603+0000","last_active":"2024-09-12T00:04:18.648320+0000","last_peered":"2024-09-12T00:04:18.648320+0000","last_clean":"2024-09-12T00:04:18.648320+0000","last_became_active":"2024-09-12T00:03:33.386614+0000","last_became_peered":"2024-09-12T00:03:33.386614+0000","last_unstale":"2024-09-12T00:04:18.648320+0000","last_undegraded":"2024-09-12T00:04:18.648320+0000","last_fullsized":"2024-09-12T00:04:18.648320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:37.428182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950913+0000","last_change":"2024-09-12T00:03:25.357300+0000","last_active":"2024-09-12T00:04:17.950913+0000","last_peered":"2024-09-12T00:04:17.950913+0000","last_clean":"2024-09-12T00:04:17.950913+0000","last_became_active":"2024-09-12T00:03:25.356970+0000","last_became_peered":"2024-09-12T00:03:25.356970+0000","last_unstale":"2024-09-12T00:04:17.950913+0000","last_undegraded":"2024-09-12T00:04:17.950913+0000","last_fullsized":"2024-09-12T00:04:17.950913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:04.193738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.649835+0000","last_change":"2024-09-12T00:03:23.609700+0000","last_active":"2024-09-12T00:04:18.649835+0000","last_peered":"2024-09-12T00:04:18.649835+0000","last_clean":"2024-09-12T00:04:18.649835+0000","last_became_active":"2024-09-12T00:03:23.609435+0000","last_became_peered":"2024-09-12T00:03:23.609435+0000","last_unstale":"2024-09-12T00:04:18.649835+0000","last_undegraded":"2024-09-12T00:04:18.649835+0000","last_fullsized":"2024-09-12T00:04:18.649835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":59,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.642662+0000","last_change":"2024-09-12T00:03:27.339670+0000","last_active":"2024-09-12T00:04:18.642662+0000","last_peered":"2024-09-12T00:04:18.642662+0000","last_clean":"2024-09-12T00:04:18.642662+0000","last_became_active":"2024-09-12T00:03:27.338880+0000","last_became_peered":"2024-09-12T00:03:27.338880+0000","last_unstale":"2024-09-12T00:04:18.642662+0000","last_undegraded":"2024-09-12T00:04:18.642662+0000","last_fullsized":"2024-09-12T00:04:18.642662+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:35.068652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"35'15","reported_seq":81,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645810+0000","last_change":"2024-09-12T00:03:29.337666+0000","last_active":"2024-09-12T00:04:18.645810+0000","last_peered":"2024-09-12T00:04:18.645810+0000","last_clean":"2024-09-12T00:04:18.645810+0000","last_became_active":"2024-09-12T00:03:29.336957+0000","last_became_peered":"2024-09-12T00:03:29.336957+0000","last_unstale":"2024-09-12T00:04:18.645810+0000","last_undegraded":"2024-09-12T00:04:18.645810+0000","last_fullsized":"2024-09-12T00:04:18.645810+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:58.417315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":49,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645841+0000","last_change":"2024-09-12T00:03:31.348590+0000","last_active":"2024-09-12T00:04:18.645841+0000","last_peered":"2024-09-12T00:04:18.645841+0000","last_clean":"2024-09-12T00:04:18.645841+0000","last_became_active":"2024-09-12T00:03:31.347736+0000","last_became_peered":"2024-09-12T00:03:31.347736+0000","last_unstale":"2024-09-12T00:04:18.645841+0000","last_undegraded":"2024-09-12T00:04:18.645841+0000","last_fullsized":"2024-09-12T00:04:18.645841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:04.962492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951675+0000","last_change":"2024-09-12T00:03:33.379699+0000","last_active":"2024-09-12T00:04:17.951675+0000","last_peered":"2024-09-12T00:04:17.951675+0000","last_clean":"2024-09-12T00:04:17.951675+0000","last_became_active":"2024-09-12T00:03:33.378945+0000","last_became_peered":"2024-09-12T00:03:33.378945+0000","last_unstale":"2024-09-12T00:04:17.951675+0000","last_undegraded":"2024-09-12T00:04:17.951675+0000","last_fullsized":"2024-09-12T00:04:17.951675+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:23.270488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647096+0000","last_change":"2024-09-12T00:03:25.333941+0000","last_active":"2024-09-12T00:04:18.647096+0000","last_peered":"2024-09-12T00:04:18.647096+0000","last_clean":"2024-09-12T00:04:18.647096+0000","last_became_active":"2024-09-12T00:03:25.333559+0000","last_became_peered":"2024-09-12T00:03:25.333559+0000","last_unstale":"2024-09-12T00:04:18.647096+0000","last_undegraded":"2024-09-12T00:04:18.647096+0000","last_fullsized":"2024-09-12T00:04:18.647096+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642507+0000","last_change":"2024-09-12T00:03:23.596202+0000","last_active":"2024-09-12T00:04:17.642507+0000","last_peered":"2024-09-12T00:04:17.642507+0000","last_clean":"2024-09-12T00:04:17.642507+0000","last_became_active":"2024-09-12T00:03:23.595859+0000","last_became_peered":"2024-09-12T00:03:23.595859+0000","last_unstale":"2024-09-12T00:04:17.642507+0000","last_undegraded":"2024-09-12T00:04:17.642507+0000","last_fullsized":"2024-09-12T00:04:17.642507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:12.001918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":56,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950472+0000","last_change":"2024-09-12T00:03:27.348080+0000","last_active":"2024-09-12T00:04:17.950472+0000","last_peered":"2024-09-12T00:04:17.950472+0000","last_clean":"2024-09-12T00:04:17.950472+0000","last_became_active":"2024-09-12T00:03:27.347288+0000","last_became_peered":"2024-09-12T00:03:27.347288+0000","last_unstale":"2024-09-12T00:04:17.950472+0000","last_undegraded":"2024-09-12T00:04:17.950472+0000","last_fullsized":"2024-09-12T00:04:17.950472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:37.033224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"35'27","reported_seq":102,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.641963+0000","last_change":"2024-09-12T00:03:29.349297+0000","last_active":"2024-09-12T00:04:17.641963+0000","last_peered":"2024-09-12T00:04:17.641963+0000","last_clean":"2024-09-12T00:04:17.641963+0000","last_became_active":"2024-09-12T00:03:29.348779+0000","last_became_peered":"2024-09-12T00:03:29.348779+0000","last_unstale":"2024-09-12T00:04:17.641963+0000","last_undegraded":"2024-09-12T00:04:17.641963+0000","last_fullsized":"2024-09-12T00:04:17.641963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:40.759557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'2","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950021+0000","last_change":"2024-09-12T00:03:31.354114+0000","last_active":"2024-09-12T00:04:17.950021+0000","last_peered":"2024-09-12T00:04:17.950021+0000","last_clean":"2024-09-12T00:04:17.950021+0000","last_became_active":"2024-09-12T00:03:31.353358+0000","last_became_peered":"2024-09-12T00:03:31.353358+0000","last_unstale":"2024-09-12T00:04:17.950021+0000","last_undegraded":"2024-09-12T00:04:17.950021+0000","last_fullsized":"2024-09-12T00:04:17.950021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:56.624718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":47,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643912+0000","last_change":"2024-09-12T00:03:33.383917+0000","last_active":"2024-09-12T00:04:18.643912+0000","last_peered":"2024-09-12T00:04:18.643912+0000","last_clean":"2024-09-12T00:04:18.643912+0000","last_became_active":"2024-09-12T00:03:33.383199+0000","last_became_peered":"2024-09-12T00:03:33.383199+0000","last_unstale":"2024-09-12T00:04:18.643912+0000","last_undegraded":"2024-09-12T00:04:18.643912+0000","last_fullsized":"2024-09-12T00:04:18.643912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:37.428182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951112+0000","last_change":"2024-09-12T00:03:25.356706+0000","last_active":"2024-09-12T00:04:17.951112+0000","last_peered":"2024-09-12T00:04:17.951112+0000","last_clean":"2024-09-12T00:04:17.951112+0000","last_became_active":"2024-09-12T00:03:25.354555+0000","last_became_peered":"2024-09-12T00:03:25.354555+0000","last_unstale":"2024-09-12T00:04:17.951112+0000","last_undegraded":"2024-09-12T00:04:17.951112+0000","last_fullsized":"2024-09-12T00:04:17.951112+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:55.543336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.954985+0000","last_change":"2024-09-12T00:03:23.612430+0000","last_active":"2024-09-12T00:04:17.954985+0000","last_peered":"2024-09-12T00:04:17.954985+0000","last_clean":"2024-09-12T00:04:17.954985+0000","last_became_active":"2024-09-12T00:03:23.612165+0000","last_became_peered":"2024-09-12T00:03:23.612165+0000","last_unstale":"2024-09-12T00:04:17.954985+0000","last_undegraded":"2024-09-12T00:04:17.954985+0000","last_fullsized":"2024-09-12T00:04:17.954985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:31.444343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":59,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643037+0000","last_change":"2024-09-12T00:03:27.329228+0000","last_active":"2024-09-12T00:04:18.643037+0000","last_peered":"2024-09-12T00:04:18.643037+0000","last_clean":"2024-09-12T00:04:18.643037+0000","last_became_active":"2024-09-12T00:03:27.328497+0000","last_became_peered":"2024-09-12T00:03:27.328497+0000","last_unstale":"2024-09-12T00:04:18.643037+0000","last_undegraded":"2024-09-12T00:04:18.643037+0000","last_fullsized":"2024-09-12T00:04:18.643037+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"35'24","reported_seq":100,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645493+0000","last_change":"2024-09-12T00:03:29.332778+0000","last_active":"2024-09-12T00:04:18.645493+0000","last_peered":"2024-09-12T00:04:18.645493+0000","last_clean":"2024-09-12T00:04:18.645493+0000","last_became_active":"2024-09-12T00:03:29.332010+0000","last_became_peered":"2024-09-12T00:03:29.332010+0000","last_unstale":"2024-09-12T00:04:18.645493+0000","last_undegraded":"2024-09-12T00:04:18.645493+0000","last_fullsized":"2024-09-12T00:04:18.645493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:13.563107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":48,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950535+0000","last_change":"2024-09-12T00:03:31.354374+0000","last_active":"2024-09-12T00:04:17.950535+0000","last_peered":"2024-09-12T00:04:17.950535+0000","last_clean":"2024-09-12T00:04:17.950535+0000","last_became_active":"2024-09-12T00:03:31.353407+0000","last_became_peered":"2024-09-12T00:03:31.353407+0000","last_unstale":"2024-09-12T00:04:17.950535+0000","last_undegraded":"2024-09-12T00:04:17.950535+0000","last_fullsized":"2024-09-12T00:04:17.950535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:30.520217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953590+0000","last_change":"2024-09-12T00:03:33.385373+0000","last_active":"2024-09-12T00:04:17.953590+0000","last_peered":"2024-09-12T00:04:17.953590+0000","last_clean":"2024-09-12T00:04:17.953590+0000","last_became_active":"2024-09-12T00:03:33.384559+0000","last_became_peered":"2024-09-12T00:03:33.384559+0000","last_unstale":"2024-09-12T00:04:17.953590+0000","last_undegraded":"2024-09-12T00:04:17.953590+0000","last_fullsized":"2024-09-12T00:04:17.953590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:55.924174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.954766+0000","last_change":"2024-09-12T00:03:25.326677+0000","last_active":"2024-09-12T00:04:17.954766+0000","last_peered":"2024-09-12T00:04:17.954766+0000","last_clean":"2024-09-12T00:04:17.954766+0000","last_became_active":"2024-09-12T00:03:25.325840+0000","last_became_peered":"2024-09-12T00:03:25.325840+0000","last_unstale":"2024-09-12T00:04:17.954766+0000","last_undegraded":"2024-09-12T00:04:17.954766+0000","last_fullsized":"2024-09-12T00:04:17.954766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:07.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953114+0000","last_change":"2024-09-12T00:03:23.616943+0000","last_active":"2024-09-12T00:04:17.953114+0000","last_peered":"2024-09-12T00:04:17.953114+0000","last_clean":"2024-09-12T00:04:17.953114+0000","last_became_active":"2024-09-12T00:03:23.616200+0000","last_became_peered":"2024-09-12T00:03:23.616200+0000","last_unstale":"2024-09-12T00:04:17.953114+0000","last_undegraded":"2024-09-12T00:04:17.953114+0000","last_fullsized":"2024-09-12T00:04:17.953114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":56,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953227+0000","last_change":"2024-09-12T00:03:27.330506+0000","last_active":"2024-09-12T00:04:17.953227+0000","last_peered":"2024-09-12T00:04:17.953227+0000","last_clean":"2024-09-12T00:04:17.953227+0000","last_became_active":"2024-09-12T00:03:27.329830+0000","last_became_peered":"2024-09-12T00:03:27.329830+0000","last_unstale":"2024-09-12T00:04:17.953227+0000","last_undegraded":"2024-09-12T00:04:17.953227+0000","last_fullsized":"2024-09-12T00:04:17.953227+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:03.446090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"35'17","reported_seq":84,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.952084+0000","last_change":"2024-09-12T00:03:29.343655+0000","last_active":"2024-09-12T00:04:17.952084+0000","last_peered":"2024-09-12T00:04:17.952084+0000","last_clean":"2024-09-12T00:04:17.952084+0000","last_became_active":"2024-09-12T00:03:29.343178+0000","last_became_peered":"2024-09-12T00:03:29.343178+0000","last_unstale":"2024-09-12T00:04:17.952084+0000","last_undegraded":"2024-09-12T00:04:17.952084+0000","last_fullsized":"2024-09-12T00:04:17.952084+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":48,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953519+0000","last_change":"2024-09-12T00:03:31.358077+0000","last_active":"2024-09-12T00:04:17.953519+0000","last_peered":"2024-09-12T00:04:17.953519+0000","last_clean":"2024-09-12T00:04:17.953519+0000","last_became_active":"2024-09-12T00:03:31.357272+0000","last_became_peered":"2024-09-12T00:03:31.357272+0000","last_unstale":"2024-09-12T00:04:17.953519+0000","last_undegraded":"2024-09-12T00:04:17.953519+0000","last_fullsized":"2024-09-12T00:04:17.953519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:37.991682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.949744+0000","last_change":"2024-09-12T00:03:33.386299+0000","last_active":"2024-09-12T00:04:17.949744+0000","last_peered":"2024-09-12T00:04:17.949744+0000","last_clean":"2024-09-12T00:04:17.949744+0000","last_became_active":"2024-09-12T00:03:33.385357+0000","last_became_peered":"2024-09-12T00:03:33.385357+0000","last_unstale":"2024-09-12T00:04:17.949744+0000","last_undegraded":"2024-09-12T00:04:17.949744+0000","last_fullsized":"2024-09-12T00:04:17.949744+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:17.028373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643318+0000","last_change":"2024-09-12T00:03:25.333772+0000","last_active":"2024-09-12T00:04:17.643318+0000","last_peered":"2024-09-12T00:04:17.643318+0000","last_clean":"2024-09-12T00:04:17.643318+0000","last_became_active":"2024-09-12T00:03:25.333338+0000","last_became_peered":"2024-09-12T00:03:25.333338+0000","last_unstale":"2024-09-12T00:04:17.643318+0000","last_undegraded":"2024-09-12T00:04:17.643318+0000","last_fullsized":"2024-09-12T00:04:17.643318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:13.572959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643370+0000","last_change":"2024-09-12T00:03:23.598015+0000","last_active":"2024-09-12T00:04:17.643370+0000","last_peered":"2024-09-12T00:04:17.643370+0000","last_clean":"2024-09-12T00:04:17.643370+0000","last_became_active":"2024-09-12T00:03:23.594135+0000","last_became_peered":"2024-09-12T00:03:23.594135+0000","last_unstale":"2024-09-12T00:04:17.643370+0000","last_undegraded":"2024-09-12T00:04:17.643370+0000","last_fullsized":"2024-09-12T00:04:17.643370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:31.336675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":56,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950544+0000","last_change":"2024-09-12T00:03:27.342295+0000","last_active":"2024-09-12T00:04:17.950544+0000","last_peered":"2024-09-12T00:04:17.950544+0000","last_clean":"2024-09-12T00:04:17.950544+0000","last_became_active":"2024-09-12T00:03:27.341619+0000","last_became_peered":"2024-09-12T00:03:27.341619+0000","last_unstale":"2024-09-12T00:04:17.950544+0000","last_undegraded":"2024-09-12T00:04:17.950544+0000","last_fullsized":"2024-09-12T00:04:17.950544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:00.908798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"35'15","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951417+0000","last_change":"2024-09-12T00:03:29.336391+0000","last_active":"2024-09-12T00:04:17.951417+0000","last_peered":"2024-09-12T00:04:17.951417+0000","last_clean":"2024-09-12T00:04:17.951417+0000","last_became_active":"2024-09-12T00:03:29.335679+0000","last_became_peered":"2024-09-12T00:03:29.335679+0000","last_unstale":"2024-09-12T00:04:17.951417+0000","last_undegraded":"2024-09-12T00:04:17.951417+0000","last_fullsized":"2024-09-12T00:04:17.951417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:58.540539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"32'2","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953336+0000","last_change":"2024-09-12T00:03:31.351170+0000","last_active":"2024-09-12T00:04:17.953336+0000","last_peered":"2024-09-12T00:04:17.953336+0000","last_clean":"2024-09-12T00:04:17.953336+0000","last_became_active":"2024-09-12T00:03:31.350264+0000","last_became_peered":"2024-09-12T00:03:31.350264+0000","last_unstale":"2024-09-12T00:04:17.953336+0000","last_undegraded":"2024-09-12T00:04:17.953336+0000","last_fullsized":"2024-09-12T00:04:17.953336+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:51.368815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":47,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.642715+0000","last_change":"2024-09-12T00:03:33.368236+0000","last_active":"2024-09-12T00:04:18.642715+0000","last_peered":"2024-09-12T00:04:18.642715+0000","last_clean":"2024-09-12T00:04:18.642715+0000","last_became_active":"2024-09-12T00:03:33.367424+0000","last_became_peered":"2024-09-12T00:03:33.367424+0000","last_unstale":"2024-09-12T00:04:18.642715+0000","last_undegraded":"2024-09-12T00:04:18.642715+0000","last_fullsized":"2024-09-12T00:04:18.642715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.649022+0000","last_change":"2024-09-12T00:03:25.330477+0000","last_active":"2024-09-12T00:04:18.649022+0000","last_peered":"2024-09-12T00:04:18.649022+0000","last_clean":"2024-09-12T00:04:18.649022+0000","last_became_active":"2024-09-12T00:03:25.330069+0000","last_became_peered":"2024-09-12T00:03:25.330069+0000","last_unstale":"2024-09-12T00:04:18.649022+0000","last_undegraded":"2024-09-12T00:04:18.649022+0000","last_fullsized":"2024-09-12T00:04:18.649022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642837+0000","last_change":"2024-09-12T00:03:23.604303+0000","last_active":"2024-09-12T00:04:17.642837+0000","last_peered":"2024-09-12T00:04:17.642837+0000","last_clean":"2024-09-12T00:04:17.642837+0000","last_became_active":"2024-09-12T00:03:23.603937+0000","last_became_peered":"2024-09-12T00:03:23.603937+0000","last_unstale":"2024-09-12T00:04:17.642837+0000","last_undegraded":"2024-09-12T00:04:17.642837+0000","last_fullsized":"2024-09-12T00:04:17.642837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:16.713949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.952505+0000","last_change":"2024-09-12T00:03:27.331569+0000","last_active":"2024-09-12T00:04:17.952505+0000","last_peered":"2024-09-12T00:04:17.952505+0000","last_clean":"2024-09-12T00:04:17.952505+0000","last_became_active":"2024-09-12T00:03:27.330909+0000","last_became_peered":"2024-09-12T00:03:27.330909+0000","last_unstale":"2024-09-12T00:04:17.952505+0000","last_undegraded":"2024-09-12T00:04:17.952505+0000","last_fullsized":"2024-09-12T00:04:17.952505+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643566+0000","last_change":"2024-09-12T00:03:29.338880+0000","last_active":"2024-09-12T00:04:18.643566+0000","last_peered":"2024-09-12T00:04:18.643566+0000","last_clean":"2024-09-12T00:04:18.643566+0000","last_became_active":"2024-09-12T00:03:29.338110+0000","last_became_peered":"2024-09-12T00:03:29.338110+0000","last_unstale":"2024-09-12T00:04:18.643566+0000","last_undegraded":"2024-09-12T00:04:18.643566+0000","last_fullsized":"2024-09-12T00:04:18.643566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.054460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"32'2","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951870+0000","last_change":"2024-09-12T00:03:31.339117+0000","last_active":"2024-09-12T00:04:17.951870+0000","last_peered":"2024-09-12T00:04:17.951870+0000","last_clean":"2024-09-12T00:04:17.951870+0000","last_became_active":"2024-09-12T00:03:31.338426+0000","last_became_peered":"2024-09-12T00:03:31.338426+0000","last_unstale":"2024-09-12T00:04:17.951870+0000","last_undegraded":"2024-09-12T00:04:17.951870+0000","last_fullsized":"2024-09-12T00:04:17.951870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:19.304169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":45,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646890+0000","last_change":"2024-09-12T00:03:33.385051+0000","last_active":"2024-09-12T00:04:18.646890+0000","last_peered":"2024-09-12T00:04:18.646890+0000","last_clean":"2024-09-12T00:04:18.646890+0000","last_became_active":"2024-09-12T00:03:33.380088+0000","last_became_peered":"2024-09-12T00:03:33.380088+0000","last_unstale":"2024-09-12T00:04:18.646890+0000","last_undegraded":"2024-09-12T00:04:18.646890+0000","last_fullsized":"2024-09-12T00:04:18.646890+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:02.972871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953799+0000","last_change":"2024-09-12T00:03:25.336113+0000","last_active":"2024-09-12T00:04:17.953799+0000","last_peered":"2024-09-12T00:04:17.953799+0000","last_clean":"2024-09-12T00:04:17.953799+0000","last_became_active":"2024-09-12T00:03:25.335449+0000","last_became_peered":"2024-09-12T00:03:25.335449+0000","last_unstale":"2024-09-12T00:04:17.953799+0000","last_undegraded":"2024-09-12T00:04:17.953799+0000","last_fullsized":"2024-09-12T00:04:17.953799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:34.277614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646130+0000","last_change":"2024-09-12T00:03:23.619285+0000","last_active":"2024-09-12T00:04:18.646130+0000","last_peered":"2024-09-12T00:04:18.646130+0000","last_clean":"2024-09-12T00:04:18.646130+0000","last_became_active":"2024-09-12T00:03:23.614187+0000","last_became_peered":"2024-09-12T00:03:23.614187+0000","last_unstale":"2024-09-12T00:04:18.646130+0000","last_undegraded":"2024-09-12T00:04:18.646130+0000","last_fullsized":"2024-09-12T00:04:18.646130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643141+0000","last_change":"2024-09-12T00:03:27.342832+0000","last_active":"2024-09-12T00:04:17.643141+0000","last_peered":"2024-09-12T00:04:17.643141+0000","last_clean":"2024-09-12T00:04:17.643141+0000","last_became_active":"2024-09-12T00:03:27.338764+0000","last_became_peered":"2024-09-12T00:03:27.338764+0000","last_unstale":"2024-09-12T00:04:17.643141+0000","last_undegraded":"2024-09-12T00:04:17.643141+0000","last_fullsized":"2024-09-12T00:04:17.643141+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:24.471349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'17","reported_seq":81,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951771+0000","last_change":"2024-09-12T00:03:29.345719+0000","last_active":"2024-09-12T00:04:17.951771+0000","last_peered":"2024-09-12T00:04:17.951771+0000","last_clean":"2024-09-12T00:04:17.951771+0000","last_became_active":"2024-09-12T00:03:29.345243+0000","last_became_peered":"2024-09-12T00:03:29.345243+0000","last_unstale":"2024-09-12T00:04:17.951771+0000","last_undegraded":"2024-09-12T00:04:17.951771+0000","last_fullsized":"2024-09-12T00:04:17.951771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:41.153263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":49,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.648571+0000","last_change":"2024-09-12T00:03:31.360630+0000","last_active":"2024-09-12T00:04:18.648571+0000","last_peered":"2024-09-12T00:04:18.648571+0000","last_clean":"2024-09-12T00:04:18.648571+0000","last_became_active":"2024-09-12T00:03:31.359763+0000","last_became_peered":"2024-09-12T00:03:31.359763+0000","last_unstale":"2024-09-12T00:04:18.648571+0000","last_undegraded":"2024-09-12T00:04:18.648571+0000","last_fullsized":"2024-09-12T00:04:18.648571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.952868+0000","last_change":"2024-09-12T00:03:33.372178+0000","last_active":"2024-09-12T00:04:17.952868+0000","last_peered":"2024-09-12T00:04:17.952868+0000","last_clean":"2024-09-12T00:04:17.952868+0000","last_became_active":"2024-09-12T00:03:33.370562+0000","last_became_peered":"2024-09-12T00:03:33.370562+0000","last_unstale":"2024-09-12T00:04:17.952868+0000","last_undegraded":"2024-09-12T00:04:17.952868+0000","last_fullsized":"2024-09-12T00:04:17.952868+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:31.888153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642597+0000","last_change":"2024-09-12T00:03:25.329229+0000","last_active":"2024-09-12T00:04:17.642597+0000","last_peered":"2024-09-12T00:04:17.642597+0000","last_clean":"2024-09-12T00:04:17.642597+0000","last_became_active":"2024-09-12T00:03:25.328934+0000","last_became_peered":"2024-09-12T00:03:25.328934+0000","last_unstale":"2024-09-12T00:04:17.642597+0000","last_undegraded":"2024-09-12T00:04:17.642597+0000","last_fullsized":"2024-09-12T00:04:17.642597+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:48.820585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":169,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950881+0000","last_change":"2024-09-12T00:03:11.770141+0000","last_active":"2024-09-12T00:04:17.950881+0000","last_peered":"2024-09-12T00:04:17.950881+0000","last_clean":"2024-09-12T00:04:17.950881+0000","last_became_active":"2024-09-12T00:03:11.767988+0000","last_became_peered":"2024-09-12T00:03:11.767988+0000","last_unstale":"2024-09-12T00:04:17.950881+0000","last_undegraded":"2024-09-12T00:04:17.950881+0000","last_fullsized":"2024-09-12T00:04:17.950881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_clean_scrub_stamp":"2024-09-12T00:03:10.462069+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:26.289955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":79,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642030+0000","last_change":"2024-09-12T00:03:18.567644+0000","last_active":"2024-09-12T00:04:17.642030+0000","last_peered":"2024-09-12T00:04:17.642030+0000","last_clean":"2024-09-12T00:04:17.642030+0000","last_became_active":"2024-09-12T00:03:16.592765+0000","last_became_peered":"2024-09-12T00:03:16.592765+0000","last_unstale":"2024-09-12T00:04:17.642030+0000","last_undegraded":"2024-09-12T00:04:17.642030+0000","last_fullsized":"2024-09-12T00:04:17.642030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:06.283894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001924708,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646128+0000","last_change":"2024-09-12T00:03:23.621849+0000","last_active":"2024-09-12T00:04:18.646128+0000","last_peered":"2024-09-12T00:04:18.646128+0000","last_clean":"2024-09-12T00:04:18.646128+0000","last_became_active":"2024-09-12T00:03:23.621146+0000","last_became_peered":"2024-09-12T00:03:23.621146+0000","last_unstale":"2024-09-12T00:04:18.646128+0000","last_undegraded":"2024-09-12T00:04:18.646128+0000","last_fullsized":"2024-09-12T00:04:18.646128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:38.426691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.954464+0000","last_change":"2024-09-12T00:03:27.316175+0000","last_active":"2024-09-12T00:04:17.954464+0000","last_peered":"2024-09-12T00:04:17.954464+0000","last_clean":"2024-09-12T00:04:17.954464+0000","last_became_active":"2024-09-12T00:03:27.315502+0000","last_became_peered":"2024-09-12T00:03:27.315502+0000","last_unstale":"2024-09-12T00:04:17.954464+0000","last_undegraded":"2024-09-12T00:04:17.954464+0000","last_fullsized":"2024-09-12T00:04:17.954464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:21.448686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"35'19","reported_seq":92,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642629+0000","last_change":"2024-09-12T00:03:29.348743+0000","last_active":"2024-09-12T00:04:17.642629+0000","last_peered":"2024-09-12T00:04:17.642629+0000","last_clean":"2024-09-12T00:04:17.642629+0000","last_became_active":"2024-09-12T00:03:29.348073+0000","last_became_peered":"2024-09-12T00:03:29.348073+0000","last_unstale":"2024-09-12T00:04:17.642629+0000","last_undegraded":"2024-09-12T00:04:17.642629+0000","last_fullsized":"2024-09-12T00:04:17.642629+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:27.315678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":48,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951126+0000","last_change":"2024-09-12T00:03:31.361408+0000","last_active":"2024-09-12T00:04:17.951126+0000","last_peered":"2024-09-12T00:04:17.951126+0000","last_clean":"2024-09-12T00:04:17.951126+0000","last_became_active":"2024-09-12T00:03:31.360462+0000","last_became_peered":"2024-09-12T00:03:31.360462+0000","last_unstale":"2024-09-12T00:04:17.951126+0000","last_undegraded":"2024-09-12T00:04:17.951126+0000","last_fullsized":"2024-09-12T00:04:17.951126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:58.407571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950507+0000","last_change":"2024-09-12T00:03:33.388253+0000","last_active":"2024-09-12T00:04:17.950507+0000","last_peered":"2024-09-12T00:04:17.950507+0000","last_clean":"2024-09-12T00:04:17.950507+0000","last_became_active":"2024-09-12T00:03:33.387457+0000","last_became_peered":"2024-09-12T00:03:33.387457+0000","last_unstale":"2024-09-12T00:04:17.950507+0000","last_undegraded":"2024-09-12T00:04:17.950507+0000","last_fullsized":"2024-09-12T00:04:17.950507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:46.021740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951328+0000","last_change":"2024-09-12T00:03:25.357970+0000","last_active":"2024-09-12T00:04:17.951328+0000","last_peered":"2024-09-12T00:04:17.951328+0000","last_clean":"2024-09-12T00:04:17.951328+0000","last_became_active":"2024-09-12T00:03:25.355306+0000","last_became_peered":"2024-09-12T00:03:25.355306+0000","last_unstale":"2024-09-12T00:04:17.951328+0000","last_undegraded":"2024-09-12T00:04:17.951328+0000","last_fullsized":"2024-09-12T00:04:17.951328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:17.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":78,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.644780+0000","last_change":"2024-09-12T00:03:18.567433+0000","last_active":"2024-09-12T00:04:17.644780+0000","last_peered":"2024-09-12T00:04:17.644780+0000","last_clean":"2024-09-12T00:04:17.644780+0000","last_became_active":"2024-09-12T00:03:16.557489+0000","last_became_peered":"2024-09-12T00:03:16.557489+0000","last_unstale":"2024-09-12T00:04:17.644780+0000","last_undegraded":"2024-09-12T00:04:17.644780+0000","last_fullsized":"2024-09-12T00:04:17.644780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:26.187640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001769713,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":67,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643074+0000","last_change":"2024-09-12T00:03:23.622111+0000","last_active":"2024-09-12T00:04:18.643074+0000","last_peered":"2024-09-12T00:04:18.643074+0000","last_clean":"2024-09-12T00:04:18.643074+0000","last_became_active":"2024-09-12T00:03:23.621358+0000","last_became_peered":"2024-09-12T00:03:23.621358+0000","last_unstale":"2024-09-12T00:04:18.643074+0000","last_undegraded":"2024-09-12T00:04:18.643074+0000","last_fullsized":"2024-09-12T00:04:18.643074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:02.202230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642303+0000","last_change":"2024-09-12T00:03:27.338241+0000","last_active":"2024-09-12T00:04:17.642303+0000","last_peered":"2024-09-12T00:04:17.642303+0000","last_clean":"2024-09-12T00:04:17.642303+0000","last_became_active":"2024-09-12T00:03:27.337391+0000","last_became_peered":"2024-09-12T00:03:27.337391+0000","last_unstale":"2024-09-12T00:04:17.642303+0000","last_undegraded":"2024-09-12T00:04:17.642303+0000","last_fullsized":"2024-09-12T00:04:17.642303+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:00.949475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'29","reported_seq":115,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953144+0000","last_change":"2024-09-12T00:03:29.346819+0000","last_active":"2024-09-12T00:04:17.953144+0000","last_peered":"2024-09-12T00:04:17.953144+0000","last_clean":"2024-09-12T00:04:17.953144+0000","last_became_active":"2024-09-12T00:03:29.346101+0000","last_became_peered":"2024-09-12T00:03:29.346101+0000","last_unstale":"2024-09-12T00:04:17.953144+0000","last_undegraded":"2024-09-12T00:04:17.953144+0000","last_fullsized":"2024-09-12T00:04:17.953144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:27.268327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":49,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643235+0000","last_change":"2024-09-12T00:03:31.361817+0000","last_active":"2024-09-12T00:04:17.643235+0000","last_peered":"2024-09-12T00:04:17.643235+0000","last_clean":"2024-09-12T00:04:17.643235+0000","last_became_active":"2024-09-12T00:03:31.361309+0000","last_became_peered":"2024-09-12T00:03:31.361309+0000","last_unstale":"2024-09-12T00:04:17.643235+0000","last_undegraded":"2024-09-12T00:04:17.643235+0000","last_fullsized":"2024-09-12T00:04:17.643235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:19.554189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950157+0000","last_change":"2024-09-12T00:03:33.386144+0000","last_active":"2024-09-12T00:04:17.950157+0000","last_peered":"2024-09-12T00:04:17.950157+0000","last_clean":"2024-09-12T00:04:17.950157+0000","last_became_active":"2024-09-12T00:03:33.384951+0000","last_became_peered":"2024-09-12T00:03:33.384951+0000","last_unstale":"2024-09-12T00:04:17.950157+0000","last_undegraded":"2024-09-12T00:04:17.950157+0000","last_fullsized":"2024-09-12T00:04:17.950157+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:49.807501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.644330+0000","last_change":"2024-09-12T00:03:25.332801+0000","last_active":"2024-09-12T00:04:18.644330+0000","last_peered":"2024-09-12T00:04:18.644330+0000","last_clean":"2024-09-12T00:04:18.644330+0000","last_became_active":"2024-09-12T00:03:25.331652+0000","last_became_peered":"2024-09-12T00:03:25.331652+0000","last_unstale":"2024-09-12T00:04:18.644330+0000","last_undegraded":"2024-09-12T00:04:18.644330+0000","last_fullsized":"2024-09-12T00:04:18.644330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950015+0000","last_change":"2024-09-12T00:03:18.892423+0000","last_active":"2024-09-12T00:04:17.950015+0000","last_peered":"2024-09-12T00:04:17.950015+0000","last_clean":"2024-09-12T00:04:17.950015+0000","last_became_active":"2024-09-12T00:03:16.559698+0000","last_became_peered":"2024-09-12T00:03:16.559698+0000","last_unstale":"2024-09-12T00:04:17.950015+0000","last_undegraded":"2024-09-12T00:04:17.950015+0000","last_fullsized":"2024-09-12T00:04:17.950015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:21.453461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082440599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950441+0000","last_change":"2024-09-12T00:03:23.633606+0000","last_active":"2024-09-12T00:04:17.950441+0000","last_peered":"2024-09-12T00:04:17.950441+0000","last_clean":"2024-09-12T00:04:17.950441+0000","last_became_active":"2024-09-12T00:03:23.632795+0000","last_became_peered":"2024-09-12T00:03:23.632795+0000","last_unstale":"2024-09-12T00:04:17.950441+0000","last_undegraded":"2024-09-12T00:04:17.950441+0000","last_fullsized":"2024-09-12T00:04:17.950441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:08.214455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953446+0000","last_change":"2024-09-12T00:03:27.326932+0000","last_active":"2024-09-12T00:04:17.953446+0000","last_peered":"2024-09-12T00:04:17.953446+0000","last_clean":"2024-09-12T00:04:17.953446+0000","last_became_active":"2024-09-12T00:03:27.326173+0000","last_became_peered":"2024-09-12T00:03:27.326173+0000","last_unstale":"2024-09-12T00:04:17.953446+0000","last_undegraded":"2024-09-12T00:04:17.953446+0000","last_fullsized":"2024-09-12T00:04:17.953446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:12.286539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":84,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953823+0000","last_change":"2024-09-12T00:03:29.338829+0000","last_active":"2024-09-12T00:04:17.953823+0000","last_peered":"2024-09-12T00:04:17.953823+0000","last_clean":"2024-09-12T00:04:17.953823+0000","last_became_active":"2024-09-12T00:03:29.337364+0000","last_became_peered":"2024-09-12T00:03:29.337364+0000","last_unstale":"2024-09-12T00:04:17.953823+0000","last_undegraded":"2024-09-12T00:04:17.953823+0000","last_fullsized":"2024-09-12T00:04:17.953823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:01.584359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":49,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646919+0000","last_change":"2024-09-12T00:03:31.346734+0000","last_active":"2024-09-12T00:04:18.646919+0000","last_peered":"2024-09-12T00:04:18.646919+0000","last_clean":"2024-09-12T00:04:18.646919+0000","last_became_active":"2024-09-12T00:03:31.346035+0000","last_became_peered":"2024-09-12T00:03:31.346035+0000","last_unstale":"2024-09-12T00:04:18.646919+0000","last_undegraded":"2024-09-12T00:04:18.646919+0000","last_fullsized":"2024-09-12T00:04:18.646919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:10.417936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":45,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645669+0000","last_change":"2024-09-12T00:03:33.354171+0000","last_active":"2024-09-12T00:04:18.645669+0000","last_peered":"2024-09-12T00:04:18.645669+0000","last_clean":"2024-09-12T00:04:18.645669+0000","last_became_active":"2024-09-12T00:03:33.353460+0000","last_became_peered":"2024-09-12T00:03:33.353460+0000","last_unstale":"2024-09-12T00:04:18.645669+0000","last_undegraded":"2024-09-12T00:04:18.645669+0000","last_fullsized":"2024-09-12T00:04:18.645669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:34.356970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643866+0000","last_change":"2024-09-12T00:03:25.336320+0000","last_active":"2024-09-12T00:04:18.643866+0000","last_peered":"2024-09-12T00:04:18.643866+0000","last_clean":"2024-09-12T00:04:18.643866+0000","last_became_active":"2024-09-12T00:03:25.333449+0000","last_became_peered":"2024-09-12T00:03:25.333449+0000","last_unstale":"2024-09-12T00:04:18.643866+0000","last_undegraded":"2024-09-12T00:04:18.643866+0000","last_fullsized":"2024-09-12T00:04:18.643866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":80,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643544+0000","last_change":"2024-09-12T00:03:18.568246+0000","last_active":"2024-09-12T00:04:17.643544+0000","last_peered":"2024-09-12T00:04:17.643544+0000","last_clean":"2024-09-12T00:04:17.643544+0000","last_became_active":"2024-09-12T00:03:16.554663+0000","last_became_peered":"2024-09-12T00:03:16.554663+0000","last_unstale":"2024-09-12T00:04:17.643544+0000","last_undegraded":"2024-09-12T00:04:17.643544+0000","last_fullsized":"2024-09-12T00:04:17.643544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:52.802404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025471840000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951285+0000","last_change":"2024-09-12T00:03:23.611064+0000","last_active":"2024-09-12T00:04:17.951285+0000","last_peered":"2024-09-12T00:04:17.951285+0000","last_clean":"2024-09-12T00:04:17.951285+0000","last_became_active":"2024-09-12T00:03:23.610612+0000","last_became_peered":"2024-09-12T00:03:23.610612+0000","last_unstale":"2024-09-12T00:04:17.951285+0000","last_undegraded":"2024-09-12T00:04:17.951285+0000","last_fullsized":"2024-09-12T00:04:17.951285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:04.201688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":56,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953306+0000","last_change":"2024-09-12T00:03:27.339197+0000","last_active":"2024-09-12T00:04:17.953306+0000","last_peered":"2024-09-12T00:04:17.953306+0000","last_clean":"2024-09-12T00:04:17.953306+0000","last_became_active":"2024-09-12T00:03:27.338508+0000","last_became_peered":"2024-09-12T00:03:27.338508+0000","last_unstale":"2024-09-12T00:04:17.953306+0000","last_undegraded":"2024-09-12T00:04:17.953306+0000","last_fullsized":"2024-09-12T00:04:17.953306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:08.306289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":70,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951129+0000","last_change":"2024-09-12T00:03:29.358418+0000","last_active":"2024-09-12T00:04:17.951129+0000","last_peered":"2024-09-12T00:04:17.951129+0000","last_clean":"2024-09-12T00:04:17.951129+0000","last_became_active":"2024-09-12T00:03:29.357949+0000","last_became_peered":"2024-09-12T00:03:29.357949+0000","last_unstale":"2024-09-12T00:04:17.951129+0000","last_undegraded":"2024-09-12T00:04:17.951129+0000","last_fullsized":"2024-09-12T00:04:17.951129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:53.457363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":49,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643414+0000","last_change":"2024-09-12T00:03:31.352559+0000","last_active":"2024-09-12T00:04:17.643414+0000","last_peered":"2024-09-12T00:04:17.643414+0000","last_clean":"2024-09-12T00:04:17.643414+0000","last_became_active":"2024-09-12T00:03:31.351663+0000","last_became_peered":"2024-09-12T00:03:31.351663+0000","last_unstale":"2024-09-12T00:04:17.643414+0000","last_undegraded":"2024-09-12T00:04:17.643414+0000","last_fullsized":"2024-09-12T00:04:17.643414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:03.662016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950111+0000","last_change":"2024-09-12T00:03:33.367035+0000","last_active":"2024-09-12T00:04:17.950111+0000","last_peered":"2024-09-12T00:04:17.950111+0000","last_clean":"2024-09-12T00:04:17.950111+0000","last_became_active":"2024-09-12T00:03:33.366311+0000","last_became_peered":"2024-09-12T00:03:33.366311+0000","last_unstale":"2024-09-12T00:04:17.950111+0000","last_undegraded":"2024-09-12T00:04:17.950111+0000","last_fullsized":"2024-09-12T00:04:17.950111+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643132+0000","last_change":"2024-09-12T00:03:25.322258+0000","last_active":"2024-09-12T00:04:18.643132+0000","last_peered":"2024-09-12T00:04:18.643132+0000","last_clean":"2024-09-12T00:04:18.643132+0000","last_became_active":"2024-09-12T00:03:25.320903+0000","last_became_peered":"2024-09-12T00:03:25.320903+0000","last_unstale":"2024-09-12T00:04:18.643132+0000","last_undegraded":"2024-09-12T00:04:18.643132+0000","last_fullsized":"2024-09-12T00:04:18.643132+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:05.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.649248+0000","last_change":"2024-09-12T00:03:23.619024+0000","last_active":"2024-09-12T00:04:18.649248+0000","last_peered":"2024-09-12T00:04:18.649248+0000","last_clean":"2024-09-12T00:04:18.649248+0000","last_became_active":"2024-09-12T00:03:23.618716+0000","last_became_peered":"2024-09-12T00:03:23.618716+0000","last_unstale":"2024-09-12T00:04:18.649248+0000","last_undegraded":"2024-09-12T00:04:18.649248+0000","last_fullsized":"2024-09-12T00:04:18.649248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950826+0000","last_change":"2024-09-12T00:03:18.562010+0000","last_active":"2024-09-12T00:04:17.950826+0000","last_peered":"2024-09-12T00:04:17.950826+0000","last_clean":"2024-09-12T00:04:17.950826+0000","last_became_active":"2024-09-12T00:03:16.561218+0000","last_became_peered":"2024-09-12T00:03:16.561218+0000","last_unstale":"2024-09-12T00:04:17.950826+0000","last_undegraded":"2024-09-12T00:04:17.950826+0000","last_fullsized":"2024-09-12T00:04:17.950826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:43.089686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084170299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":57,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645939+0000","last_change":"2024-09-12T00:03:27.341079+0000","last_active":"2024-09-12T00:04:18.645939+0000","last_peered":"2024-09-12T00:04:18.645939+0000","last_clean":"2024-09-12T00:04:18.645939+0000","last_became_active":"2024-09-12T00:03:27.340391+0000","last_became_peered":"2024-09-12T00:03:27.340391+0000","last_unstale":"2024-09-12T00:04:18.645939+0000","last_undegraded":"2024-09-12T00:04:18.645939+0000","last_fullsized":"2024-09-12T00:04:18.645939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:10.048469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"35'30","reported_seq":108,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.949702+0000","last_change":"2024-09-12T00:03:29.346823+0000","last_active":"2024-09-12T00:04:17.949702+0000","last_peered":"2024-09-12T00:04:17.949702+0000","last_clean":"2024-09-12T00:04:17.949702+0000","last_became_active":"2024-09-12T00:03:29.346066+0000","last_became_peered":"2024-09-12T00:03:29.346066+0000","last_unstale":"2024-09-12T00:04:17.949702+0000","last_undegraded":"2024-09-12T00:04:17.949702+0000","last_fullsized":"2024-09-12T00:04:17.949702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:12.080794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":49,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646549+0000","last_change":"2024-09-12T00:03:31.348574+0000","last_active":"2024-09-12T00:04:18.646549+0000","last_peered":"2024-09-12T00:04:18.646549+0000","last_clean":"2024-09-12T00:04:18.646549+0000","last_became_active":"2024-09-12T00:03:31.346511+0000","last_became_peered":"2024-09-12T00:03:31.346511+0000","last_unstale":"2024-09-12T00:04:18.646549+0000","last_undegraded":"2024-09-12T00:04:18.646549+0000","last_fullsized":"2024-09-12T00:04:18.646549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:14.061486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951060+0000","last_change":"2024-09-12T00:03:33.385232+0000","last_active":"2024-09-12T00:04:17.951060+0000","last_peered":"2024-09-12T00:04:17.951060+0000","last_clean":"2024-09-12T00:04:17.951060+0000","last_became_active":"2024-09-12T00:03:33.384457+0000","last_became_peered":"2024-09-12T00:03:33.384457+0000","last_unstale":"2024-09-12T00:04:17.951060+0000","last_undegraded":"2024-09-12T00:04:17.951060+0000","last_fullsized":"2024-09-12T00:04:17.951060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:34.615256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.644139+0000","last_change":"2024-09-12T00:03:25.334767+0000","last_active":"2024-09-12T00:04:18.644139+0000","last_peered":"2024-09-12T00:04:18.644139+0000","last_clean":"2024-09-12T00:04:18.644139+0000","last_became_active":"2024-09-12T00:03:25.332814+0000","last_became_peered":"2024-09-12T00:03:25.332814+0000","last_unstale":"2024-09-12T00:04:18.644139+0000","last_undegraded":"2024-09-12T00:04:18.644139+0000","last_fullsized":"2024-09-12T00:04:18.644139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":67,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.644001+0000","last_change":"2024-09-12T00:03:23.628752+0000","last_active":"2024-09-12T00:04:18.644001+0000","last_peered":"2024-09-12T00:04:18.644001+0000","last_clean":"2024-09-12T00:04:18.644001+0000","last_became_active":"2024-09-12T00:03:23.628128+0000","last_became_peered":"2024-09-12T00:03:23.628128+0000","last_unstale":"2024-09-12T00:04:18.644001+0000","last_undegraded":"2024-09-12T00:04:18.644001+0000","last_fullsized":"2024-09-12T00:04:18.644001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642215+0000","last_change":"2024-09-12T00:03:18.566691+0000","last_active":"2024-09-12T00:04:17.642215+0000","last_peered":"2024-09-12T00:04:17.642215+0000","last_clean":"2024-09-12T00:04:17.642215+0000","last_became_active":"2024-09-12T00:03:16.553662+0000","last_became_peered":"2024-09-12T00:03:16.553662+0000","last_unstale":"2024-09-12T00:04:17.642215+0000","last_undegraded":"2024-09-12T00:04:17.642215+0000","last_fullsized":"2024-09-12T00:04:17.642215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:14.502459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011030910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950929+0000","last_change":"2024-09-12T00:03:27.316317+0000","last_active":"2024-09-12T00:04:17.950929+0000","last_peered":"2024-09-12T00:04:17.950929+0000","last_clean":"2024-09-12T00:04:17.950929+0000","last_became_active":"2024-09-12T00:03:27.315704+0000","last_became_peered":"2024-09-12T00:03:27.315704+0000","last_unstale":"2024-09-12T00:04:17.950929+0000","last_undegraded":"2024-09-12T00:04:17.950929+0000","last_fullsized":"2024-09-12T00:04:17.950929+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:07.883485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'20","reported_seq":88,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.642904+0000","last_change":"2024-09-12T00:03:29.357640+0000","last_active":"2024-09-12T00:04:18.642904+0000","last_peered":"2024-09-12T00:04:18.642904+0000","last_clean":"2024-09-12T00:04:18.642904+0000","last_became_active":"2024-09-12T00:03:29.356183+0000","last_became_peered":"2024-09-12T00:03:29.356183+0000","last_unstale":"2024-09-12T00:04:18.642904+0000","last_undegraded":"2024-09-12T00:04:18.642904+0000","last_fullsized":"2024-09-12T00:04:18.642904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:41.818794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"32'2","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950267+0000","last_change":"2024-09-12T00:03:31.357011+0000","last_active":"2024-09-12T00:04:17.950267+0000","last_peered":"2024-09-12T00:04:17.950267+0000","last_clean":"2024-09-12T00:04:17.950267+0000","last_became_active":"2024-09-12T00:03:31.356108+0000","last_became_peered":"2024-09-12T00:03:31.356108+0000","last_unstale":"2024-09-12T00:04:17.950267+0000","last_undegraded":"2024-09-12T00:04:17.950267+0000","last_fullsized":"2024-09-12T00:04:17.950267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953467+0000","last_change":"2024-09-12T00:03:33.372465+0000","last_active":"2024-09-12T00:04:17.953467+0000","last_peered":"2024-09-12T00:04:17.953467+0000","last_clean":"2024-09-12T00:04:17.953467+0000","last_became_active":"2024-09-12T00:03:33.371214+0000","last_became_peered":"2024-09-12T00:03:33.371214+0000","last_unstale":"2024-09-12T00:04:17.953467+0000","last_undegraded":"2024-09-12T00:04:17.953467+0000","last_fullsized":"2024-09-12T00:04:17.953467+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:40.880933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645990+0000","last_change":"2024-09-12T00:03:25.332405+0000","last_active":"2024-09-12T00:04:18.645990+0000","last_peered":"2024-09-12T00:04:18.645990+0000","last_clean":"2024-09-12T00:04:18.645990+0000","last_became_active":"2024-09-12T00:03:25.331250+0000","last_became_peered":"2024-09-12T00:03:25.331250+0000","last_unstale":"2024-09-12T00:04:18.645990+0000","last_undegraded":"2024-09-12T00:04:18.645990+0000","last_fullsized":"2024-09-12T00:04:18.645990+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647558+0000","last_change":"2024-09-12T00:03:23.602222+0000","last_active":"2024-09-12T00:04:18.647558+0000","last_peered":"2024-09-12T00:04:18.647558+0000","last_clean":"2024-09-12T00:04:18.647558+0000","last_became_active":"2024-09-12T00:03:23.601481+0000","last_became_peered":"2024-09-12T00:03:23.601481+0000","last_unstale":"2024-09-12T00:04:18.647558+0000","last_undegraded":"2024-09-12T00:04:18.647558+0000","last_fullsized":"2024-09-12T00:04:18.647558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:56.636638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":78,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647426+0000","last_change":"2024-09-12T00:03:18.716648+0000","last_active":"2024-09-12T00:04:18.647426+0000","last_peered":"2024-09-12T00:04:18.647426+0000","last_clean":"2024-09-12T00:04:18.647426+0000","last_became_active":"2024-09-12T00:03:16.594609+0000","last_became_peered":"2024-09-12T00:03:16.594609+0000","last_unstale":"2024-09-12T00:04:18.647426+0000","last_undegraded":"2024-09-12T00:04:18.647426+0000","last_fullsized":"2024-09-12T00:04:18.647426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:34.635008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010254439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642531+0000","last_change":"2024-09-12T00:03:27.337871+0000","last_active":"2024-09-12T00:04:17.642531+0000","last_peered":"2024-09-12T00:04:17.642531+0000","last_clean":"2024-09-12T00:04:17.642531+0000","last_became_active":"2024-09-12T00:03:27.337299+0000","last_became_peered":"2024-09-12T00:03:27.337299+0000","last_unstale":"2024-09-12T00:04:17.642531+0000","last_undegraded":"2024-09-12T00:04:17.642531+0000","last_fullsized":"2024-09-12T00:04:17.642531+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:37.289387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'17","reported_seq":81,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642151+0000","last_change":"2024-09-12T00:03:29.354380+0000","last_active":"2024-09-12T00:04:17.642151+0000","last_peered":"2024-09-12T00:04:17.642151+0000","last_clean":"2024-09-12T00:04:17.642151+0000","last_became_active":"2024-09-12T00:03:29.353644+0000","last_became_peered":"2024-09-12T00:03:29.353644+0000","last_unstale":"2024-09-12T00:04:17.642151+0000","last_undegraded":"2024-09-12T00:04:17.642151+0000","last_fullsized":"2024-09-12T00:04:17.642151+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:15.452219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'2","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951233+0000","last_change":"2024-09-12T00:03:31.361616+0000","last_active":"2024-09-12T00:04:17.951233+0000","last_peered":"2024-09-12T00:04:17.951233+0000","last_clean":"2024-09-12T00:04:17.951233+0000","last_became_active":"2024-09-12T00:03:31.360518+0000","last_became_peered":"2024-09-12T00:03:31.360518+0000","last_unstale":"2024-09-12T00:04:17.951233+0000","last_undegraded":"2024-09-12T00:04:17.951233+0000","last_fullsized":"2024-09-12T00:04:17.951233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:40.640537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950468+0000","last_change":"2024-09-12T00:03:33.378417+0000","last_active":"2024-09-12T00:04:17.950468+0000","last_peered":"2024-09-12T00:04:17.950468+0000","last_clean":"2024-09-12T00:04:17.950468+0000","last_became_active":"2024-09-12T00:03:33.377669+0000","last_became_peered":"2024-09-12T00:03:33.377669+0000","last_unstale":"2024-09-12T00:04:17.950468+0000","last_undegraded":"2024-09-12T00:04:17.950468+0000","last_fullsized":"2024-09-12T00:04:17.950468+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:04.623906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646751+0000","last_change":"2024-09-12T00:03:25.318286+0000","last_active":"2024-09-12T00:04:18.646751+0000","last_peered":"2024-09-12T00:04:18.646751+0000","last_clean":"2024-09-12T00:04:18.646751+0000","last_became_active":"2024-09-12T00:03:25.317820+0000","last_became_peered":"2024-09-12T00:03:25.317820+0000","last_unstale":"2024-09-12T00:04:18.646751+0000","last_undegraded":"2024-09-12T00:04:18.646751+0000","last_fullsized":"2024-09-12T00:04:18.646751+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:05.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647310+0000","last_change":"2024-09-12T00:03:23.616319+0000","last_active":"2024-09-12T00:04:18.647310+0000","last_peered":"2024-09-12T00:04:18.647310+0000","last_clean":"2024-09-12T00:04:18.647310+0000","last_became_active":"2024-09-12T00:03:23.615158+0000","last_became_peered":"2024-09-12T00:03:23.615158+0000","last_unstale":"2024-09-12T00:04:18.647310+0000","last_undegraded":"2024-09-12T00:04:18.647310+0000","last_fullsized":"2024-09-12T00:04:18.647310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:15.677228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643628+0000","last_change":"2024-09-12T00:03:18.566832+0000","last_active":"2024-09-12T00:04:17.643628+0000","last_peered":"2024-09-12T00:04:17.643628+0000","last_clean":"2024-09-12T00:04:17.643628+0000","last_became_active":"2024-09-12T00:03:16.592377+0000","last_became_peered":"2024-09-12T00:03:16.592377+0000","last_unstale":"2024-09-12T00:04:17.643628+0000","last_undegraded":"2024-09-12T00:04:17.643628+0000","last_fullsized":"2024-09-12T00:04:17.643628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:31.379733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001199625,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":57,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645644+0000","last_change":"2024-09-12T00:03:27.337359+0000","last_active":"2024-09-12T00:04:18.645644+0000","last_peered":"2024-09-12T00:04:18.645644+0000","last_clean":"2024-09-12T00:04:18.645644+0000","last_became_active":"2024-09-12T00:03:27.336289+0000","last_became_peered":"2024-09-12T00:03:27.336289+0000","last_unstale":"2024-09-12T00:04:18.645644+0000","last_undegraded":"2024-09-12T00:04:18.645644+0000","last_fullsized":"2024-09-12T00:04:18.645644+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:39.147272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"35'25","reported_seq":101,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951012+0000","last_change":"2024-09-12T00:03:29.344621+0000","last_active":"2024-09-12T00:04:17.951012+0000","last_peered":"2024-09-12T00:04:17.951012+0000","last_clean":"2024-09-12T00:04:17.951012+0000","last_became_active":"2024-09-12T00:03:29.343779+0000","last_became_peered":"2024-09-12T00:03:29.343779+0000","last_unstale":"2024-09-12T00:04:17.951012+0000","last_undegraded":"2024-09-12T00:04:17.951012+0000","last_fullsized":"2024-09-12T00:04:17.951012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:49.518432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":49,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645947+0000","last_change":"2024-09-12T00:03:31.335460+0000","last_active":"2024-09-12T00:04:18.645947+0000","last_peered":"2024-09-12T00:04:18.645947+0000","last_clean":"2024-09-12T00:04:18.645947+0000","last_became_active":"2024-09-12T00:03:31.334701+0000","last_became_peered":"2024-09-12T00:03:31.334701+0000","last_unstale":"2024-09-12T00:04:18.645947+0000","last_undegraded":"2024-09-12T00:04:18.645947+0000","last_fullsized":"2024-09-12T00:04:18.645947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:28.484366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":45,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.649071+0000","last_change":"2024-09-12T00:03:33.386404+0000","last_active":"2024-09-12T00:04:18.649071+0000","last_peered":"2024-09-12T00:04:18.649071+0000","last_clean":"2024-09-12T00:04:18.649071+0000","last_became_active":"2024-09-12T00:03:33.385090+0000","last_became_peered":"2024-09-12T00:03:33.385090+0000","last_unstale":"2024-09-12T00:04:18.649071+0000","last_undegraded":"2024-09-12T00:04:18.649071+0000","last_fullsized":"2024-09-12T00:04:18.649071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":45,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647188+0000","last_change":"2024-09-12T00:03:33.361690+0000","last_active":"2024-09-12T00:04:18.647188+0000","last_peered":"2024-09-12T00:04:18.647188+0000","last_clean":"2024-09-12T00:04:18.647188+0000","last_became_active":"2024-09-12T00:03:33.360980+0000","last_became_peered":"2024-09-12T00:03:33.360980+0000","last_unstale":"2024-09-12T00:04:18.647188+0000","last_undegraded":"2024-09-12T00:04:18.647188+0000","last_fullsized":"2024-09-12T00:04:18.647188+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:24.954577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647818+0000","last_change":"2024-09-12T00:03:25.335027+0000","last_active":"2024-09-12T00:04:18.647818+0000","last_peered":"2024-09-12T00:04:18.647818+0000","last_clean":"2024-09-12T00:04:18.647818+0000","last_became_active":"2024-09-12T00:03:25.334530+0000","last_became_peered":"2024-09-12T00:03:25.334530+0000","last_unstale":"2024-09-12T00:04:18.647818+0000","last_undegraded":"2024-09-12T00:04:18.647818+0000","last_fullsized":"2024-09-12T00:04:18.647818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643073+0000","last_change":"2024-09-12T00:03:23.618114+0000","last_active":"2024-09-12T00:04:17.643073+0000","last_peered":"2024-09-12T00:04:17.643073+0000","last_clean":"2024-09-12T00:04:17.643073+0000","last_became_active":"2024-09-12T00:03:23.617781+0000","last_became_peered":"2024-09-12T00:03:23.617781+0000","last_unstale":"2024-09-12T00:04:17.643073+0000","last_undegraded":"2024-09-12T00:04:17.643073+0000","last_fullsized":"2024-09-12T00:04:17.643073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:30.629135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"28'2","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643135+0000","last_change":"2024-09-12T00:03:27.332281+0000","last_active":"2024-09-12T00:04:18.643135+0000","last_peered":"2024-09-12T00:04:18.643135+0000","last_clean":"2024-09-12T00:04:18.643135+0000","last_became_active":"2024-09-12T00:03:27.331527+0000","last_became_peered":"2024-09-12T00:03:27.331527+0000","last_unstale":"2024-09-12T00:04:18.643135+0000","last_undegraded":"2024-09-12T00:04:18.643135+0000","last_fullsized":"2024-09-12T00:04:18.643135+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"35'17","reported_seq":86,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.642869+0000","last_change":"2024-09-12T00:03:29.338655+0000","last_active":"2024-09-12T00:04:18.642869+0000","last_peered":"2024-09-12T00:04:18.642869+0000","last_clean":"2024-09-12T00:04:18.642869+0000","last_became_active":"2024-09-12T00:03:29.337905+0000","last_became_peered":"2024-09-12T00:03:29.337905+0000","last_unstale":"2024-09-12T00:04:18.642869+0000","last_undegraded":"2024-09-12T00:04:18.642869+0000","last_fullsized":"2024-09-12T00:04:18.642869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":48,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.949680+0000","last_change":"2024-09-12T00:03:31.351716+0000","last_active":"2024-09-12T00:04:17.949680+0000","last_peered":"2024-09-12T00:04:17.949680+0000","last_clean":"2024-09-12T00:04:17.949680+0000","last_became_active":"2024-09-12T00:03:31.350917+0000","last_became_peered":"2024-09-12T00:03:31.350917+0000","last_unstale":"2024-09-12T00:04:17.949680+0000","last_undegraded":"2024-09-12T00:04:17.949680+0000","last_fullsized":"2024-09-12T00:04:17.949680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:45.880820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953299+0000","last_change":"2024-09-12T00:03:33.374233+0000","last_active":"2024-09-12T00:04:17.953299+0000","last_peered":"2024-09-12T00:04:17.953299+0000","last_clean":"2024-09-12T00:04:17.953299+0000","last_became_active":"2024-09-12T00:03:33.373466+0000","last_became_peered":"2024-09-12T00:03:33.373466+0000","last_unstale":"2024-09-12T00:04:17.953299+0000","last_undegraded":"2024-09-12T00:04:17.953299+0000","last_fullsized":"2024-09-12T00:04:17.953299+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:55.598892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645818+0000","last_change":"2024-09-12T00:03:25.319144+0000","last_active":"2024-09-12T00:04:18.645818+0000","last_peered":"2024-09-12T00:04:18.645818+0000","last_clean":"2024-09-12T00:04:18.645818+0000","last_became_active":"2024-09-12T00:03:25.318362+0000","last_became_peered":"2024-09-12T00:03:25.318362+0000","last_unstale":"2024-09-12T00:04:18.645818+0000","last_undegraded":"2024-09-12T00:04:18.645818+0000","last_fullsized":"2024-09-12T00:04:18.645818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.954291+0000","last_change":"2024-09-12T00:03:23.613274+0000","last_active":"2024-09-12T00:04:17.954291+0000","last_peered":"2024-09-12T00:04:17.954291+0000","last_clean":"2024-09-12T00:04:17.954291+0000","last_became_active":"2024-09-12T00:03:23.612941+0000","last_became_peered":"2024-09-12T00:03:23.612941+0000","last_unstale":"2024-09-12T00:04:17.954291+0000","last_undegraded":"2024-09-12T00:04:17.954291+0000","last_fullsized":"2024-09-12T00:04:17.954291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:56.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":57,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645803+0000","last_change":"2024-09-12T00:03:27.336144+0000","last_active":"2024-09-12T00:04:18.645803+0000","last_peered":"2024-09-12T00:04:18.645803+0000","last_clean":"2024-09-12T00:04:18.645803+0000","last_became_active":"2024-09-12T00:03:27.335372+0000","last_became_peered":"2024-09-12T00:03:27.335372+0000","last_unstale":"2024-09-12T00:04:18.645803+0000","last_undegraded":"2024-09-12T00:04:18.645803+0000","last_fullsized":"2024-09-12T00:04:18.645803+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:33.978665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"43'5","reported_seq":60,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645496+0000","last_change":"2024-09-12T00:03:29.332051+0000","last_active":"2024-09-12T00:04:18.645496+0000","last_peered":"2024-09-12T00:04:18.645496+0000","last_clean":"2024-09-12T00:04:18.645496+0000","last_became_active":"2024-09-12T00:03:29.331243+0000","last_became_peered":"2024-09-12T00:03:29.331243+0000","last_unstale":"2024-09-12T00:04:18.645496+0000","last_undegraded":"2024-09-12T00:04:18.645496+0000","last_fullsized":"2024-09-12T00:04:18.645496+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:52.544770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":49,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646472+0000","last_change":"2024-09-12T00:03:31.347021+0000","last_active":"2024-09-12T00:04:18.646472+0000","last_peered":"2024-09-12T00:04:18.646472+0000","last_clean":"2024-09-12T00:04:18.646472+0000","last_became_active":"2024-09-12T00:03:31.344407+0000","last_became_peered":"2024-09-12T00:03:31.344407+0000","last_unstale":"2024-09-12T00:04:18.646472+0000","last_undegraded":"2024-09-12T00:04:18.646472+0000","last_fullsized":"2024-09-12T00:04:18.646472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:32.139742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":47,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643549+0000","last_change":"2024-09-12T00:03:33.370271+0000","last_active":"2024-09-12T00:04:18.643549+0000","last_peered":"2024-09-12T00:04:18.643549+0000","last_clean":"2024-09-12T00:04:18.643549+0000","last_became_active":"2024-09-12T00:03:33.369538+0000","last_became_peered":"2024-09-12T00:03:33.369538+0000","last_unstale":"2024-09-12T00:04:18.643549+0000","last_undegraded":"2024-09-12T00:04:18.643549+0000","last_fullsized":"2024-09-12T00:04:18.643549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645938+0000","last_change":"2024-09-12T00:03:25.341025+0000","last_active":"2024-09-12T00:04:18.645938+0000","last_peered":"2024-09-12T00:04:18.645938+0000","last_clean":"2024-09-12T00:04:18.645938+0000","last_became_active":"2024-09-12T00:03:25.340288+0000","last_became_peered":"2024-09-12T00:03:25.340288+0000","last_unstale":"2024-09-12T00:04:18.645938+0000","last_undegraded":"2024-09-12T00:04:18.645938+0000","last_fullsized":"2024-09-12T00:04:18.645938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.649762+0000","last_change":"2024-09-12T00:03:23.612814+0000","last_active":"2024-09-12T00:04:18.649762+0000","last_peered":"2024-09-12T00:04:18.649762+0000","last_clean":"2024-09-12T00:04:18.649762+0000","last_became_active":"2024-09-12T00:03:23.612332+0000","last_became_peered":"2024-09-12T00:03:23.612332+0000","last_unstale":"2024-09-12T00:04:18.649762+0000","last_undegraded":"2024-09-12T00:04:18.649762+0000","last_fullsized":"2024-09-12T00:04:18.649762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:02.202230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":57,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646058+0000","last_change":"2024-09-12T00:03:27.329869+0000","last_active":"2024-09-12T00:04:18.646058+0000","last_peered":"2024-09-12T00:04:18.646058+0000","last_clean":"2024-09-12T00:04:18.646058+0000","last_became_active":"2024-09-12T00:03:27.329077+0000","last_became_peered":"2024-09-12T00:03:27.329077+0000","last_unstale":"2024-09-12T00:04:18.646058+0000","last_undegraded":"2024-09-12T00:04:18.646058+0000","last_fullsized":"2024-09-12T00:04:18.646058+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'11","reported_seq":71,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953063+0000","last_change":"2024-09-12T00:03:29.346878+0000","last_active":"2024-09-12T00:04:17.953063+0000","last_peered":"2024-09-12T00:04:17.953063+0000","last_clean":"2024-09-12T00:04:17.953063+0000","last_became_active":"2024-09-12T00:03:29.345990+0000","last_became_peered":"2024-09-12T00:03:29.345990+0000","last_unstale":"2024-09-12T00:04:17.953063+0000","last_undegraded":"2024-09-12T00:04:17.953063+0000","last_fullsized":"2024-09-12T00:04:17.953063+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:06.398979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":49,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951094+0000","last_change":"2024-09-12T00:03:31.363658+0000","last_active":"2024-09-12T00:04:17.951094+0000","last_peered":"2024-09-12T00:04:17.951094+0000","last_clean":"2024-09-12T00:04:17.951094+0000","last_became_active":"2024-09-12T00:03:31.363080+0000","last_became_peered":"2024-09-12T00:03:31.363080+0000","last_unstale":"2024-09-12T00:04:17.951094+0000","last_undegraded":"2024-09-12T00:04:17.951094+0000","last_fullsized":"2024-09-12T00:04:17.951094+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:05.901608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642727+0000","last_change":"2024-09-12T00:03:33.380447+0000","last_active":"2024-09-12T00:04:17.642727+0000","last_peered":"2024-09-12T00:04:17.642727+0000","last_clean":"2024-09-12T00:04:17.642727+0000","last_became_active":"2024-09-12T00:03:33.379701+0000","last_became_peered":"2024-09-12T00:03:33.379701+0000","last_unstale":"2024-09-12T00:04:17.642727+0000","last_undegraded":"2024-09-12T00:04:17.642727+0000","last_fullsized":"2024-09-12T00:04:17.642727+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:55.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.949845+0000","last_change":"2024-09-12T00:03:25.330916+0000","last_active":"2024-09-12T00:04:17.949845+0000","last_peered":"2024-09-12T00:04:17.949845+0000","last_clean":"2024-09-12T00:04:17.949845+0000","last_became_active":"2024-09-12T00:03:25.330181+0000","last_became_peered":"2024-09-12T00:03:25.330181+0000","last_unstale":"2024-09-12T00:04:17.949845+0000","last_undegraded":"2024-09-12T00:04:17.949845+0000","last_fullsized":"2024-09-12T00:04:17.949845+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:03.153020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951743+0000","last_change":"2024-09-12T00:03:23.618613+0000","last_active":"2024-09-12T00:04:17.951743+0000","last_peered":"2024-09-12T00:04:17.951743+0000","last_clean":"2024-09-12T00:04:17.951743+0000","last_became_active":"2024-09-12T00:03:23.617587+0000","last_became_peered":"2024-09-12T00:03:23.617587+0000","last_unstale":"2024-09-12T00:04:17.951743+0000","last_undegraded":"2024-09-12T00:04:17.951743+0000","last_fullsized":"2024-09-12T00:04:17.951743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:54.211904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642274+0000","last_change":"2024-09-12T00:03:27.330320+0000","last_active":"2024-09-12T00:04:17.642274+0000","last_peered":"2024-09-12T00:04:17.642274+0000","last_clean":"2024-09-12T00:04:17.642274+0000","last_became_active":"2024-09-12T00:03:27.329236+0000","last_became_peered":"2024-09-12T00:03:27.329236+0000","last_unstale":"2024-09-12T00:04:17.642274+0000","last_undegraded":"2024-09-12T00:04:17.642274+0000","last_fullsized":"2024-09-12T00:04:17.642274+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:57.407947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'9","reported_seq":69,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950845+0000","last_change":"2024-09-12T00:03:29.346312+0000","last_active":"2024-09-12T00:04:17.950845+0000","last_peered":"2024-09-12T00:04:17.950845+0000","last_clean":"2024-09-12T00:04:17.950845+0000","last_became_active":"2024-09-12T00:03:29.345883+0000","last_became_peered":"2024-09-12T00:03:29.345883+0000","last_unstale":"2024-09-12T00:04:17.950845+0000","last_undegraded":"2024-09-12T00:04:17.950845+0000","last_fullsized":"2024-09-12T00:04:17.950845+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:46.723370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":48,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.952903+0000","last_change":"2024-09-12T00:03:31.358786+0000","last_active":"2024-09-12T00:04:17.952903+0000","last_peered":"2024-09-12T00:04:17.952903+0000","last_clean":"2024-09-12T00:04:17.952903+0000","last_became_active":"2024-09-12T00:03:31.358011+0000","last_became_peered":"2024-09-12T00:03:31.358011+0000","last_unstale":"2024-09-12T00:04:17.952903+0000","last_undegraded":"2024-09-12T00:04:17.952903+0000","last_fullsized":"2024-09-12T00:04:17.952903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:29.394163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643227+0000","last_change":"2024-09-12T00:03:25.351065+0000","last_active":"2024-09-12T00:04:17.643227+0000","last_peered":"2024-09-12T00:04:17.643227+0000","last_clean":"2024-09-12T00:04:17.643227+0000","last_became_active":"2024-09-12T00:03:25.350719+0000","last_became_peered":"2024-09-12T00:03:25.350719+0000","last_unstale":"2024-09-12T00:04:17.643227+0000","last_undegraded":"2024-09-12T00:04:17.643227+0000","last_fullsized":"2024-09-12T00:04:17.643227+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:54.693130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950691+0000","last_change":"2024-09-12T00:03:23.627584+0000","last_active":"2024-09-12T00:04:17.950691+0000","last_peered":"2024-09-12T00:04:17.950691+0000","last_clean":"2024-09-12T00:04:17.950691+0000","last_became_active":"2024-09-12T00:03:23.626026+0000","last_became_peered":"2024-09-12T00:03:23.626026+0000","last_unstale":"2024-09-12T00:04:17.950691+0000","last_undegraded":"2024-09-12T00:04:17.950691+0000","last_fullsized":"2024-09-12T00:04:17.950691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:38.192583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":59,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.644131+0000","last_change":"2024-09-12T00:03:27.335297+0000","last_active":"2024-09-12T00:04:18.644131+0000","last_peered":"2024-09-12T00:04:18.644131+0000","last_clean":"2024-09-12T00:04:18.644131+0000","last_became_active":"2024-09-12T00:03:27.334570+0000","last_became_peered":"2024-09-12T00:03:27.334570+0000","last_unstale":"2024-09-12T00:04:18.644131+0000","last_undegraded":"2024-09-12T00:04:18.644131+0000","last_fullsized":"2024-09-12T00:04:18.644131+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"35'18","reported_seq":90,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643653+0000","last_change":"2024-09-12T00:03:29.340387+0000","last_active":"2024-09-12T00:04:18.643653+0000","last_peered":"2024-09-12T00:04:18.643653+0000","last_clean":"2024-09-12T00:04:18.643653+0000","last_became_active":"2024-09-12T00:03:29.339781+0000","last_became_peered":"2024-09-12T00:03:29.339781+0000","last_unstale":"2024-09-12T00:04:18.643653+0000","last_undegraded":"2024-09-12T00:04:18.643653+0000","last_fullsized":"2024-09-12T00:04:18.643653+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:30.132716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":49,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.648146+0000","last_change":"2024-09-12T00:03:31.350303+0000","last_active":"2024-09-12T00:04:18.648146+0000","last_peered":"2024-09-12T00:04:18.648146+0000","last_clean":"2024-09-12T00:04:18.648146+0000","last_became_active":"2024-09-12T00:03:31.349591+0000","last_became_peered":"2024-09-12T00:03:31.349591+0000","last_unstale":"2024-09-12T00:04:18.648146+0000","last_undegraded":"2024-09-12T00:04:18.648146+0000","last_fullsized":"2024-09-12T00:04:18.648146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:00.263644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950360+0000","last_change":"2024-09-12T00:03:33.385028+0000","last_active":"2024-09-12T00:04:17.950360+0000","last_peered":"2024-09-12T00:04:17.950360+0000","last_clean":"2024-09-12T00:04:17.950360+0000","last_became_active":"2024-09-12T00:03:33.384274+0000","last_became_peered":"2024-09-12T00:03:33.384274+0000","last_unstale":"2024-09-12T00:04:17.950360+0000","last_undegraded":"2024-09-12T00:04:17.950360+0000","last_fullsized":"2024-09-12T00:04:17.950360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:11.634604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647307+0000","last_change":"2024-09-12T00:03:25.329888+0000","last_active":"2024-09-12T00:04:18.647307+0000","last_peered":"2024-09-12T00:04:18.647307+0000","last_clean":"2024-09-12T00:04:18.647307+0000","last_became_active":"2024-09-12T00:03:25.329151+0000","last_became_peered":"2024-09-12T00:03:25.329151+0000","last_unstale":"2024-09-12T00:04:18.647307+0000","last_undegraded":"2024-09-12T00:04:18.647307+0000","last_fullsized":"2024-09-12T00:04:18.647307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:47.272383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646273+0000","last_change":"2024-09-12T00:03:23.600146+0000","last_active":"2024-09-12T00:04:18.646273+0000","last_peered":"2024-09-12T00:04:18.646273+0000","last_clean":"2024-09-12T00:04:18.646273+0000","last_became_active":"2024-09-12T00:03:23.598862+0000","last_became_peered":"2024-09-12T00:03:23.598862+0000","last_unstale":"2024-09-12T00:04:18.646273+0000","last_undegraded":"2024-09-12T00:04:18.646273+0000","last_fullsized":"2024-09-12T00:04:18.646273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:13.330852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":57,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.649413+0000","last_change":"2024-09-12T00:03:27.341032+0000","last_active":"2024-09-12T00:04:18.649413+0000","last_peered":"2024-09-12T00:04:18.649413+0000","last_clean":"2024-09-12T00:04:18.649413+0000","last_became_active":"2024-09-12T00:03:27.340199+0000","last_became_peered":"2024-09-12T00:03:27.340199+0000","last_unstale":"2024-09-12T00:04:18.649413+0000","last_undegraded":"2024-09-12T00:04:18.649413+0000","last_fullsized":"2024-09-12T00:04:18.649413+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:23.673080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'15","reported_seq":78,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642925+0000","last_change":"2024-09-12T00:03:29.349125+0000","last_active":"2024-09-12T00:04:17.642925+0000","last_peered":"2024-09-12T00:04:17.642925+0000","last_clean":"2024-09-12T00:04:17.642925+0000","last_became_active":"2024-09-12T00:03:29.348145+0000","last_became_peered":"2024-09-12T00:03:29.348145+0000","last_unstale":"2024-09-12T00:04:17.642925+0000","last_undegraded":"2024-09-12T00:04:17.642925+0000","last_fullsized":"2024-09-12T00:04:17.642925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:55.699040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":48,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950563+0000","last_change":"2024-09-12T00:03:31.363427+0000","last_active":"2024-09-12T00:04:17.950563+0000","last_peered":"2024-09-12T00:04:17.950563+0000","last_clean":"2024-09-12T00:04:17.950563+0000","last_became_active":"2024-09-12T00:03:31.362578+0000","last_became_peered":"2024-09-12T00:03:31.362578+0000","last_unstale":"2024-09-12T00:04:17.950563+0000","last_undegraded":"2024-09-12T00:04:17.950563+0000","last_fullsized":"2024-09-12T00:04:17.950563+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:17.357647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643454+0000","last_change":"2024-09-12T00:03:33.375115+0000","last_active":"2024-09-12T00:04:17.643454+0000","last_peered":"2024-09-12T00:04:17.643454+0000","last_clean":"2024-09-12T00:04:17.643454+0000","last_became_active":"2024-09-12T00:03:33.374310+0000","last_became_peered":"2024-09-12T00:03:33.374310+0000","last_unstale":"2024-09-12T00:04:17.643454+0000","last_undegraded":"2024-09-12T00:04:17.643454+0000","last_fullsized":"2024-09-12T00:04:17.643454+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:46.466723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953379+0000","last_change":"2024-09-12T00:03:25.360355+0000","last_active":"2024-09-12T00:04:17.953379+0000","last_peered":"2024-09-12T00:04:17.953379+0000","last_clean":"2024-09-12T00:04:17.953379+0000","last_became_active":"2024-09-12T00:03:25.359682+0000","last_became_peered":"2024-09-12T00:03:25.359682+0000","last_unstale":"2024-09-12T00:04:17.953379+0000","last_undegraded":"2024-09-12T00:04:17.953379+0000","last_fullsized":"2024-09-12T00:04:17.953379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:11.808081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951482+0000","last_change":"2024-09-12T00:03:23.621199+0000","last_active":"2024-09-12T00:04:17.951482+0000","last_peered":"2024-09-12T00:04:17.951482+0000","last_clean":"2024-09-12T00:04:17.951482+0000","last_became_active":"2024-09-12T00:03:23.620961+0000","last_became_peered":"2024-09-12T00:03:23.620961+0000","last_unstale":"2024-09-12T00:04:17.951482+0000","last_undegraded":"2024-09-12T00:04:17.951482+0000","last_fullsized":"2024-09-12T00:04:17.951482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":57,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.648405+0000","last_change":"2024-09-12T00:03:27.336918+0000","last_active":"2024-09-12T00:04:18.648405+0000","last_peered":"2024-09-12T00:04:18.648405+0000","last_clean":"2024-09-12T00:04:18.648405+0000","last_became_active":"2024-09-12T00:03:27.336045+0000","last_became_peered":"2024-09-12T00:03:27.336045+0000","last_unstale":"2024-09-12T00:04:18.648405+0000","last_undegraded":"2024-09-12T00:04:18.648405+0000","last_fullsized":"2024-09-12T00:04:18.648405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'17","reported_seq":86,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643842+0000","last_change":"2024-09-12T00:03:29.338667+0000","last_active":"2024-09-12T00:04:18.643842+0000","last_peered":"2024-09-12T00:04:18.643842+0000","last_clean":"2024-09-12T00:04:18.643842+0000","last_became_active":"2024-09-12T00:03:29.338010+0000","last_became_peered":"2024-09-12T00:03:29.338010+0000","last_unstale":"2024-09-12T00:04:18.643842+0000","last_undegraded":"2024-09-12T00:04:18.643842+0000","last_fullsized":"2024-09-12T00:04:18.643842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:58.256619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":48,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953246+0000","last_change":"2024-09-12T00:03:31.352823+0000","last_active":"2024-09-12T00:04:17.953246+0000","last_peered":"2024-09-12T00:04:17.953246+0000","last_clean":"2024-09-12T00:04:17.953246+0000","last_became_active":"2024-09-12T00:03:31.352143+0000","last_became_peered":"2024-09-12T00:03:31.352143+0000","last_unstale":"2024-09-12T00:04:17.953246+0000","last_undegraded":"2024-09-12T00:04:17.953246+0000","last_fullsized":"2024-09-12T00:04:17.953246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:25.168692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642445+0000","last_change":"2024-09-12T00:03:33.379330+0000","last_active":"2024-09-12T00:04:17.642445+0000","last_peered":"2024-09-12T00:04:17.642445+0000","last_clean":"2024-09-12T00:04:17.642445+0000","last_became_active":"2024-09-12T00:03:33.376228+0000","last_became_peered":"2024-09-12T00:03:33.376228+0000","last_unstale":"2024-09-12T00:04:17.642445+0000","last_undegraded":"2024-09-12T00:04:17.642445+0000","last_fullsized":"2024-09-12T00:04:17.642445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:44.364562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647002+0000","last_change":"2024-09-12T00:03:25.325094+0000","last_active":"2024-09-12T00:04:18.647002+0000","last_peered":"2024-09-12T00:04:18.647002+0000","last_clean":"2024-09-12T00:04:18.647002+0000","last_became_active":"2024-09-12T00:03:25.324315+0000","last_became_peered":"2024-09-12T00:03:25.324315+0000","last_unstale":"2024-09-12T00:04:18.647002+0000","last_undegraded":"2024-09-12T00:04:18.647002+0000","last_fullsized":"2024-09-12T00:04:18.647002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:18.727732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646393+0000","last_change":"2024-09-12T00:03:23.606163+0000","last_active":"2024-09-12T00:04:18.646393+0000","last_peered":"2024-09-12T00:04:18.646393+0000","last_clean":"2024-09-12T00:04:18.646393+0000","last_became_active":"2024-09-12T00:03:23.605402+0000","last_became_peered":"2024-09-12T00:03:23.605402+0000","last_unstale":"2024-09-12T00:04:18.646393+0000","last_undegraded":"2024-09-12T00:04:18.646393+0000","last_fullsized":"2024-09-12T00:04:18.646393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:02.432313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":57,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646901+0000","last_change":"2024-09-12T00:03:27.336716+0000","last_active":"2024-09-12T00:04:18.646901+0000","last_peered":"2024-09-12T00:04:18.646901+0000","last_clean":"2024-09-12T00:04:18.646901+0000","last_became_active":"2024-09-12T00:03:27.335658+0000","last_became_peered":"2024-09-12T00:03:27.335658+0000","last_unstale":"2024-09-12T00:04:18.646901+0000","last_undegraded":"2024-09-12T00:04:18.646901+0000","last_fullsized":"2024-09-12T00:04:18.646901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:47.355798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"35'16","reported_seq":80,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643052+0000","last_change":"2024-09-12T00:03:29.354481+0000","last_active":"2024-09-12T00:04:17.643052+0000","last_peered":"2024-09-12T00:04:17.643052+0000","last_clean":"2024-09-12T00:04:17.643052+0000","last_became_active":"2024-09-12T00:03:29.353656+0000","last_became_peered":"2024-09-12T00:03:29.353656+0000","last_unstale":"2024-09-12T00:04:17.643052+0000","last_undegraded":"2024-09-12T00:04:17.643052+0000","last_fullsized":"2024-09-12T00:04:17.643052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:42.984798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'2","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953692+0000","last_change":"2024-09-12T00:03:31.351362+0000","last_active":"2024-09-12T00:04:17.953692+0000","last_peered":"2024-09-12T00:04:17.953692+0000","last_clean":"2024-09-12T00:04:17.953692+0000","last_became_active":"2024-09-12T00:03:31.350925+0000","last_became_peered":"2024-09-12T00:03:31.350925+0000","last_unstale":"2024-09-12T00:04:17.953692+0000","last_undegraded":"2024-09-12T00:04:17.953692+0000","last_fullsized":"2024-09-12T00:04:17.953692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:03.147968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.641814+0000","last_change":"2024-09-12T00:03:33.374932+0000","last_active":"2024-09-12T00:04:17.641814+0000","last_peered":"2024-09-12T00:04:17.641814+0000","last_clean":"2024-09-12T00:04:17.641814+0000","last_became_active":"2024-09-12T00:03:33.374185+0000","last_became_peered":"2024-09-12T00:03:33.374185+0000","last_unstale":"2024-09-12T00:04:17.641814+0000","last_undegraded":"2024-09-12T00:04:17.641814+0000","last_fullsized":"2024-09-12T00:04:17.641814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:54.883339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647742+0000","last_change":"2024-09-12T00:03:25.357999+0000","last_active":"2024-09-12T00:04:18.647742+0000","last_peered":"2024-09-12T00:04:18.647742+0000","last_clean":"2024-09-12T00:04:18.647742+0000","last_became_active":"2024-09-12T00:03:25.357623+0000","last_became_peered":"2024-09-12T00:03:25.357623+0000","last_unstale":"2024-09-12T00:04:18.647742+0000","last_undegraded":"2024-09-12T00:04:18.647742+0000","last_fullsized":"2024-09-12T00:04:18.647742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951670+0000","last_change":"2024-09-12T00:03:23.605954+0000","last_active":"2024-09-12T00:04:17.951670+0000","last_peered":"2024-09-12T00:04:17.951670+0000","last_clean":"2024-09-12T00:04:17.951670+0000","last_became_active":"2024-09-12T00:03:23.604773+0000","last_became_peered":"2024-09-12T00:03:23.604773+0000","last_unstale":"2024-09-12T00:04:17.951670+0000","last_undegraded":"2024-09-12T00:04:17.951670+0000","last_fullsized":"2024-09-12T00:04:17.951670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951222+0000","last_change":"2024-09-12T00:03:27.346785+0000","last_active":"2024-09-12T00:04:17.951222+0000","last_peered":"2024-09-12T00:04:17.951222+0000","last_clean":"2024-09-12T00:04:17.951222+0000","last_became_active":"2024-09-12T00:03:27.346168+0000","last_became_peered":"2024-09-12T00:03:27.346168+0000","last_unstale":"2024-09-12T00:04:17.951222+0000","last_undegraded":"2024-09-12T00:04:17.951222+0000","last_fullsized":"2024-09-12T00:04:17.951222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'40","reported_seq":127,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950254+0000","last_change":"2024-09-12T00:03:29.343942+0000","last_active":"2024-09-12T00:04:17.950254+0000","last_peered":"2024-09-12T00:04:17.950254+0000","last_clean":"2024-09-12T00:04:17.950254+0000","last_became_active":"2024-09-12T00:03:29.343238+0000","last_became_peered":"2024-09-12T00:03:29.343238+0000","last_unstale":"2024-09-12T00:04:17.950254+0000","last_undegraded":"2024-09-12T00:04:17.950254+0000","last_fullsized":"2024-09-12T00:04:17.950254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:30.949892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":49,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645566+0000","last_change":"2024-09-12T00:03:31.348120+0000","last_active":"2024-09-12T00:04:18.645566+0000","last_peered":"2024-09-12T00:04:18.645566+0000","last_clean":"2024-09-12T00:04:18.645566+0000","last_became_active":"2024-09-12T00:03:31.344599+0000","last_became_peered":"2024-09-12T00:03:31.344599+0000","last_unstale":"2024-09-12T00:04:18.645566+0000","last_undegraded":"2024-09-12T00:04:18.645566+0000","last_fullsized":"2024-09-12T00:04:18.645566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:00.279625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.952319+0000","last_change":"2024-09-12T00:03:33.363188+0000","last_active":"2024-09-12T00:04:17.952319+0000","last_peered":"2024-09-12T00:04:17.952319+0000","last_clean":"2024-09-12T00:04:17.952319+0000","last_became_active":"2024-09-12T00:03:33.360672+0000","last_became_peered":"2024-09-12T00:03:33.360672+0000","last_unstale":"2024-09-12T00:04:17.952319+0000","last_undegraded":"2024-09-12T00:04:17.952319+0000","last_fullsized":"2024-09-12T00:04:17.952319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:33.646117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647014+0000","last_change":"2024-09-12T00:03:25.336626+0000","last_active":"2024-09-12T00:04:18.647014+0000","last_peered":"2024-09-12T00:04:18.647014+0000","last_clean":"2024-09-12T00:04:18.647014+0000","last_became_active":"2024-09-12T00:03:25.336095+0000","last_became_peered":"2024-09-12T00:03:25.336095+0000","last_unstale":"2024-09-12T00:04:18.647014+0000","last_undegraded":"2024-09-12T00:04:18.647014+0000","last_fullsized":"2024-09-12T00:04:18.647014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642680+0000","last_change":"2024-09-12T00:03:23.601889+0000","last_active":"2024-09-12T00:04:17.642680+0000","last_peered":"2024-09-12T00:04:17.642680+0000","last_clean":"2024-09-12T00:04:17.642680+0000","last_became_active":"2024-09-12T00:03:23.601553+0000","last_became_peered":"2024-09-12T00:03:23.601553+0000","last_unstale":"2024-09-12T00:04:17.642680+0000","last_undegraded":"2024-09-12T00:04:17.642680+0000","last_fullsized":"2024-09-12T00:04:17.642680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:08.758769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":57,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647624+0000","last_change":"2024-09-12T00:03:27.326174+0000","last_active":"2024-09-12T00:04:18.647624+0000","last_peered":"2024-09-12T00:04:18.647624+0000","last_clean":"2024-09-12T00:04:18.647624+0000","last_became_active":"2024-09-12T00:03:27.325336+0000","last_became_peered":"2024-09-12T00:03:27.325336+0000","last_unstale":"2024-09-12T00:04:18.647624+0000","last_undegraded":"2024-09-12T00:04:18.647624+0000","last_fullsized":"2024-09-12T00:04:18.647624+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:08.659813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'15","reported_seq":81,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645859+0000","last_change":"2024-09-12T00:03:29.335957+0000","last_active":"2024-09-12T00:04:18.645859+0000","last_peered":"2024-09-12T00:04:18.645859+0000","last_clean":"2024-09-12T00:04:18.645859+0000","last_became_active":"2024-09-12T00:03:29.335186+0000","last_became_peered":"2024-09-12T00:03:29.335186+0000","last_unstale":"2024-09-12T00:04:18.645859+0000","last_undegraded":"2024-09-12T00:04:18.645859+0000","last_fullsized":"2024-09-12T00:04:18.645859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:20.551758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":49,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642360+0000","last_change":"2024-09-12T00:03:31.350287+0000","last_active":"2024-09-12T00:04:17.642360+0000","last_peered":"2024-09-12T00:04:17.642360+0000","last_clean":"2024-09-12T00:04:17.642360+0000","last_became_active":"2024-09-12T00:03:31.349890+0000","last_became_peered":"2024-09-12T00:03:31.349890+0000","last_unstale":"2024-09-12T00:04:17.642360+0000","last_undegraded":"2024-09-12T00:04:17.642360+0000","last_fullsized":"2024-09-12T00:04:17.642360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:33.081032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951030+0000","last_change":"2024-09-12T00:03:33.385037+0000","last_active":"2024-09-12T00:04:17.951030+0000","last_peered":"2024-09-12T00:04:17.951030+0000","last_clean":"2024-09-12T00:04:17.951030+0000","last_became_active":"2024-09-12T00:03:33.384379+0000","last_became_peered":"2024-09-12T00:03:33.384379+0000","last_unstale":"2024-09-12T00:04:17.951030+0000","last_undegraded":"2024-09-12T00:04:17.951030+0000","last_fullsized":"2024-09-12T00:04:17.951030+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:00.153475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.949919+0000","last_change":"2024-09-12T00:03:25.339110+0000","last_active":"2024-09-12T00:04:17.949919+0000","last_peered":"2024-09-12T00:04:17.949919+0000","last_clean":"2024-09-12T00:04:17.949919+0000","last_became_active":"2024-09-12T00:03:25.338417+0000","last_became_peered":"2024-09-12T00:03:25.338417+0000","last_unstale":"2024-09-12T00:04:17.949919+0000","last_undegraded":"2024-09-12T00:04:17.949919+0000","last_fullsized":"2024-09-12T00:04:17.949919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:48.866021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951416+0000","last_change":"2024-09-12T00:03:23.625514+0000","last_active":"2024-09-12T00:04:17.951416+0000","last_peered":"2024-09-12T00:04:17.951416+0000","last_clean":"2024-09-12T00:04:17.951416+0000","last_became_active":"2024-09-12T00:03:23.621654+0000","last_became_peered":"2024-09-12T00:03:23.621654+0000","last_unstale":"2024-09-12T00:04:17.951416+0000","last_undegraded":"2024-09-12T00:04:17.951416+0000","last_fullsized":"2024-09-12T00:04:17.951416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:43.784497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950351+0000","last_change":"2024-09-12T00:03:27.330377+0000","last_active":"2024-09-12T00:04:17.950351+0000","last_peered":"2024-09-12T00:04:17.950351+0000","last_clean":"2024-09-12T00:04:17.950351+0000","last_became_active":"2024-09-12T00:03:27.329713+0000","last_became_peered":"2024-09-12T00:03:27.329713+0000","last_unstale":"2024-09-12T00:04:17.950351+0000","last_undegraded":"2024-09-12T00:04:17.950351+0000","last_fullsized":"2024-09-12T00:04:17.950351+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'11","reported_seq":77,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643566+0000","last_change":"2024-09-12T00:03:29.337028+0000","last_active":"2024-09-12T00:04:18.643566+0000","last_peered":"2024-09-12T00:04:18.643566+0000","last_clean":"2024-09-12T00:04:18.643566+0000","last_became_active":"2024-09-12T00:03:29.335440+0000","last_became_peered":"2024-09-12T00:03:29.335440+0000","last_unstale":"2024-09-12T00:04:18.643566+0000","last_undegraded":"2024-09-12T00:04:18.643566+0000","last_fullsized":"2024-09-12T00:04:18.643566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:19.288395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":49,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.641749+0000","last_change":"2024-09-12T00:03:31.351990+0000","last_active":"2024-09-12T00:04:17.641749+0000","last_peered":"2024-09-12T00:04:17.641749+0000","last_clean":"2024-09-12T00:04:17.641749+0000","last_became_active":"2024-09-12T00:03:31.351580+0000","last_became_peered":"2024-09-12T00:03:31.351580+0000","last_unstale":"2024-09-12T00:04:17.641749+0000","last_undegraded":"2024-09-12T00:04:17.641749+0000","last_fullsized":"2024-09-12T00:04:17.641749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:38.095033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642252+0000","last_change":"2024-09-12T00:03:33.383008+0000","last_active":"2024-09-12T00:04:17.642252+0000","last_peered":"2024-09-12T00:04:17.642252+0000","last_clean":"2024-09-12T00:04:17.642252+0000","last_became_active":"2024-09-12T00:03:33.381496+0000","last_became_peered":"2024-09-12T00:03:33.381496+0000","last_unstale":"2024-09-12T00:04:17.642252+0000","last_undegraded":"2024-09-12T00:04:17.642252+0000","last_fullsized":"2024-09-12T00:04:17.642252+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:44.996509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646147+0000","last_change":"2024-09-12T00:03:25.337999+0000","last_active":"2024-09-12T00:04:18.646147+0000","last_peered":"2024-09-12T00:04:18.646147+0000","last_clean":"2024-09-12T00:04:18.646147+0000","last_became_active":"2024-09-12T00:03:25.337237+0000","last_became_peered":"2024-09-12T00:03:25.337237+0000","last_unstale":"2024-09-12T00:04:18.646147+0000","last_undegraded":"2024-09-12T00:04:18.646147+0000","last_fullsized":"2024-09-12T00:04:18.646147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951682+0000","last_change":"2024-09-12T00:03:23.631744+0000","last_active":"2024-09-12T00:04:17.951682+0000","last_peered":"2024-09-12T00:04:17.951682+0000","last_clean":"2024-09-12T00:04:17.951682+0000","last_became_active":"2024-09-12T00:03:23.630928+0000","last_became_peered":"2024-09-12T00:03:23.630928+0000","last_unstale":"2024-09-12T00:04:17.951682+0000","last_undegraded":"2024-09-12T00:04:17.951682+0000","last_fullsized":"2024-09-12T00:04:17.951682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:35.772832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":58,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645668+0000","last_change":"2024-09-12T00:03:27.345980+0000","last_active":"2024-09-12T00:04:18.645668+0000","last_peered":"2024-09-12T00:04:18.645668+0000","last_clean":"2024-09-12T00:04:18.645668+0000","last_became_active":"2024-09-12T00:03:27.345225+0000","last_became_peered":"2024-09-12T00:03:27.345225+0000","last_unstale":"2024-09-12T00:04:18.645668+0000","last_undegraded":"2024-09-12T00:04:18.645668+0000","last_fullsized":"2024-09-12T00:04:18.645668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:47.990032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"35'21","reported_seq":93,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.641853+0000","last_change":"2024-09-12T00:03:29.359254+0000","last_active":"2024-09-12T00:04:17.641853+0000","last_peered":"2024-09-12T00:04:17.641853+0000","last_clean":"2024-09-12T00:04:17.641853+0000","last_became_active":"2024-09-12T00:03:29.355711+0000","last_became_peered":"2024-09-12T00:03:29.355711+0000","last_unstale":"2024-09-12T00:04:17.641853+0000","last_undegraded":"2024-09-12T00:04:17.641853+0000","last_fullsized":"2024-09-12T00:04:17.641853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:49.919008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":49,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645992+0000","last_change":"2024-09-12T00:03:31.355300+0000","last_active":"2024-09-12T00:04:18.645992+0000","last_peered":"2024-09-12T00:04:18.645992+0000","last_clean":"2024-09-12T00:04:18.645992+0000","last_became_active":"2024-09-12T00:03:31.354506+0000","last_became_peered":"2024-09-12T00:03:31.354506+0000","last_unstale":"2024-09-12T00:04:18.645992+0000","last_undegraded":"2024-09-12T00:04:18.645992+0000","last_fullsized":"2024-09-12T00:04:18.645992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:51.564710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.954906+0000","last_change":"2024-09-12T00:03:33.384262+0000","last_active":"2024-09-12T00:04:17.954906+0000","last_peered":"2024-09-12T00:04:17.954906+0000","last_clean":"2024-09-12T00:04:17.954906+0000","last_became_active":"2024-09-12T00:03:33.383358+0000","last_became_peered":"2024-09-12T00:03:33.383358+0000","last_unstale":"2024-09-12T00:04:17.954906+0000","last_undegraded":"2024-09-12T00:04:17.954906+0000","last_fullsized":"2024-09-12T00:04:17.954906+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:45.060131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647511+0000","last_change":"2024-09-12T00:03:25.321452+0000","last_active":"2024-09-12T00:04:18.647511+0000","last_peered":"2024-09-12T00:04:18.647511+0000","last_clean":"2024-09-12T00:04:18.647511+0000","last_became_active":"2024-09-12T00:03:25.320503+0000","last_became_peered":"2024-09-12T00:03:25.320503+0000","last_unstale":"2024-09-12T00:04:18.647511+0000","last_undegraded":"2024-09-12T00:04:18.647511+0000","last_fullsized":"2024-09-12T00:04:18.647511+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:22.789487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646321+0000","last_change":"2024-09-12T00:03:23.617643+0000","last_active":"2024-09-12T00:04:18.646321+0000","last_peered":"2024-09-12T00:04:18.646321+0000","last_clean":"2024-09-12T00:04:18.646321+0000","last_became_active":"2024-09-12T00:03:23.617138+0000","last_became_peered":"2024-09-12T00:03:23.617138+0000","last_unstale":"2024-09-12T00:04:18.646321+0000","last_undegraded":"2024-09-12T00:04:18.646321+0000","last_fullsized":"2024-09-12T00:04:18.646321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953510+0000","last_change":"2024-09-12T00:03:25.335650+0000","last_active":"2024-09-12T00:04:17.953510+0000","last_peered":"2024-09-12T00:04:17.953510+0000","last_clean":"2024-09-12T00:04:17.953510+0000","last_became_active":"2024-09-12T00:03:25.334965+0000","last_became_peered":"2024-09-12T00:03:25.334965+0000","last_unstale":"2024-09-12T00:04:17.953510+0000","last_undegraded":"2024-09-12T00:04:17.953510+0000","last_fullsized":"2024-09-12T00:04:17.953510+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:13.501672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.949827+0000","last_change":"2024-09-12T00:03:23.618651+0000","last_active":"2024-09-12T00:04:17.949827+0000","last_peered":"2024-09-12T00:04:17.949827+0000","last_clean":"2024-09-12T00:04:17.949827+0000","last_became_active":"2024-09-12T00:03:23.612542+0000","last_became_peered":"2024-09-12T00:03:23.612542+0000","last_unstale":"2024-09-12T00:04:17.949827+0000","last_undegraded":"2024-09-12T00:04:17.949827+0000","last_fullsized":"2024-09-12T00:04:17.949827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642426+0000","last_change":"2024-09-12T00:03:25.327224+0000","last_active":"2024-09-12T00:04:17.642426+0000","last_peered":"2024-09-12T00:04:17.642426+0000","last_clean":"2024-09-12T00:04:17.642426+0000","last_became_active":"2024-09-12T00:03:25.326635+0000","last_became_peered":"2024-09-12T00:03:25.326635+0000","last_unstale":"2024-09-12T00:04:17.642426+0000","last_undegraded":"2024-09-12T00:04:17.642426+0000","last_fullsized":"2024-09-12T00:04:17.642426+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:16.827573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642304+0000","last_change":"2024-09-12T00:03:23.626043+0000","last_active":"2024-09-12T00:04:17.642304+0000","last_peered":"2024-09-12T00:04:17.642304+0000","last_clean":"2024-09-12T00:04:17.642304+0000","last_became_active":"2024-09-12T00:03:23.625717+0000","last_became_peered":"2024-09-12T00:03:23.625717+0000","last_unstale":"2024-09-12T00:04:17.642304+0000","last_undegraded":"2024-09-12T00:04:17.642304+0000","last_fullsized":"2024-09-12T00:04:17.642304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:45.258601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950726+0000","last_change":"2024-09-12T00:03:25.354015+0000","last_active":"2024-09-12T00:04:17.950726+0000","last_peered":"2024-09-12T00:04:17.950726+0000","last_clean":"2024-09-12T00:04:17.950726+0000","last_became_active":"2024-09-12T00:03:25.352319+0000","last_became_peered":"2024-09-12T00:03:25.352319+0000","last_unstale":"2024-09-12T00:04:17.950726+0000","last_undegraded":"2024-09-12T00:04:17.950726+0000","last_fullsized":"2024-09-12T00:04:17.950726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:08.033834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951306+0000","last_change":"2024-09-12T00:03:23.633614+0000","last_active":"2024-09-12T00:04:17.951306+0000","last_peered":"2024-09-12T00:04:17.951306+0000","last_clean":"2024-09-12T00:04:17.951306+0000","last_became_active":"2024-09-12T00:03:23.632850+0000","last_became_peered":"2024-09-12T00:03:23.632850+0000","last_unstale":"2024-09-12T00:04:17.951306+0000","last_undegraded":"2024-09-12T00:04:17.951306+0000","last_fullsized":"2024-09-12T00:04:17.951306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950912+0000","last_change":"2024-09-12T00:03:25.357453+0000","last_active":"2024-09-12T00:04:17.950912+0000","last_peered":"2024-09-12T00:04:17.950912+0000","last_clean":"2024-09-12T00:04:17.950912+0000","last_became_active":"2024-09-12T00:03:25.353815+0000","last_became_peered":"2024-09-12T00:03:25.353815+0000","last_unstale":"2024-09-12T00:04:17.950912+0000","last_undegraded":"2024-09-12T00:04:17.950912+0000","last_fullsized":"2024-09-12T00:04:17.950912+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:27.562174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":67,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643906+0000","last_change":"2024-09-12T00:03:23.609055+0000","last_active":"2024-09-12T00:04:18.643906+0000","last_peered":"2024-09-12T00:04:18.643906+0000","last_clean":"2024-09-12T00:04:18.643906+0000","last_became_active":"2024-09-12T00:03:23.608101+0000","last_became_peered":"2024-09-12T00:03:23.608101+0000","last_unstale":"2024-09-12T00:04:18.643906+0000","last_undegraded":"2024-09-12T00:04:18.643906+0000","last_fullsized":"2024-09-12T00:04:18.643906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951093+0000","last_change":"2024-09-12T00:03:25.324744+0000","last_active":"2024-09-12T00:04:17.951093+0000","last_peered":"2024-09-12T00:04:17.951093+0000","last_clean":"2024-09-12T00:04:17.951093+0000","last_became_active":"2024-09-12T00:03:25.324199+0000","last_became_peered":"2024-09-12T00:03:25.324199+0000","last_unstale":"2024-09-12T00:04:17.951093+0000","last_undegraded":"2024-09-12T00:04:17.951093+0000","last_fullsized":"2024-09-12T00:04:17.951093+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:12.547802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":67,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643875+0000","last_change":"2024-09-12T00:03:23.616706+0000","last_active":"2024-09-12T00:04:18.643875+0000","last_peered":"2024-09-12T00:04:18.643875+0000","last_clean":"2024-09-12T00:04:18.643875+0000","last_became_active":"2024-09-12T00:03:23.615970+0000","last_became_peered":"2024-09-12T00:03:23.615970+0000","last_unstale":"2024-09-12T00:04:18.643875+0000","last_undegraded":"2024-09-12T00:04:18.643875+0000","last_fullsized":"2024-09-12T00:04:18.643875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643035+0000","last_change":"2024-09-12T00:03:25.343716+0000","last_active":"2024-09-12T00:04:18.643035+0000","last_peered":"2024-09-12T00:04:18.643035+0000","last_clean":"2024-09-12T00:04:18.643035+0000","last_became_active":"2024-09-12T00:03:25.342930+0000","last_became_peered":"2024-09-12T00:03:25.342930+0000","last_unstale":"2024-09-12T00:04:18.643035+0000","last_undegraded":"2024-09-12T00:04:18.643035+0000","last_fullsized":"2024-09-12T00:04:18.643035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.649677+0000","last_change":"2024-09-12T00:03:23.612903+0000","last_active":"2024-09-12T00:04:18.649677+0000","last_peered":"2024-09-12T00:04:18.649677+0000","last_clean":"2024-09-12T00:04:18.649677+0000","last_became_active":"2024-09-12T00:03:23.612448+0000","last_became_peered":"2024-09-12T00:03:23.612448+0000","last_unstale":"2024-09-12T00:04:18.649677+0000","last_undegraded":"2024-09-12T00:04:18.649677+0000","last_fullsized":"2024-09-12T00:04:18.649677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:14.913580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950722+0000","last_change":"2024-09-12T00:03:25.326620+0000","last_active":"2024-09-12T00:04:17.950722+0000","last_peered":"2024-09-12T00:04:17.950722+0000","last_clean":"2024-09-12T00:04:17.950722+0000","last_became_active":"2024-09-12T00:03:25.326262+0000","last_became_peered":"2024-09-12T00:03:25.326262+0000","last_unstale":"2024-09-12T00:04:17.950722+0000","last_undegraded":"2024-09-12T00:04:17.950722+0000","last_fullsized":"2024-09-12T00:04:17.950722+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951594+0000","last_change":"2024-09-12T00:03:23.632200+0000","last_active":"2024-09-12T00:04:17.951594+0000","last_peered":"2024-09-12T00:04:17.951594+0000","last_clean":"2024-09-12T00:04:17.951594+0000","last_became_active":"2024-09-12T00:03:23.631510+0000","last_became_peered":"2024-09-12T00:03:23.631510+0000","last_unstale":"2024-09-12T00:04:17.951594+0000","last_undegraded":"2024-09-12T00:04:17.951594+0000","last_fullsized":"2024-09-12T00:04:17.951594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:07.177242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953731+0000","last_change":"2024-09-12T00:03:25.342763+0000","last_active":"2024-09-12T00:04:17.953731+0000","last_peered":"2024-09-12T00:04:17.953731+0000","last_clean":"2024-09-12T00:04:17.953731+0000","last_became_active":"2024-09-12T00:03:25.337834+0000","last_became_peered":"2024-09-12T00:03:25.337834+0000","last_unstale":"2024-09-12T00:04:17.953731+0000","last_undegraded":"2024-09-12T00:04:17.953731+0000","last_fullsized":"2024-09-12T00:04:17.953731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:35.920599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.644711+0000","last_change":"2024-09-12T00:03:23.630533+0000","last_active":"2024-09-12T00:04:17.644711+0000","last_peered":"2024-09-12T00:04:17.644711+0000","last_clean":"2024-09-12T00:04:17.644711+0000","last_became_active":"2024-09-12T00:03:23.630187+0000","last_became_peered":"2024-09-12T00:03:23.630187+0000","last_unstale":"2024-09-12T00:04:17.644711+0000","last_undegraded":"2024-09-12T00:04:17.644711+0000","last_fullsized":"2024-09-12T00:04:17.644711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:18.692638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953494+0000","last_change":"2024-09-12T00:03:25.339910+0000","last_active":"2024-09-12T00:04:17.953494+0000","last_peered":"2024-09-12T00:04:17.953494+0000","last_clean":"2024-09-12T00:04:17.953494+0000","last_became_active":"2024-09-12T00:03:25.336511+0000","last_became_peered":"2024-09-12T00:03:25.336511+0000","last_unstale":"2024-09-12T00:04:17.953494+0000","last_undegraded":"2024-09-12T00:04:17.953494+0000","last_fullsized":"2024-09-12T00:04:17.953494+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:30.647474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950226+0000","last_change":"2024-09-12T00:03:23.626232+0000","last_active":"2024-09-12T00:04:17.950226+0000","last_peered":"2024-09-12T00:04:17.950226+0000","last_clean":"2024-09-12T00:04:17.950226+0000","last_became_active":"2024-09-12T00:03:23.621761+0000","last_became_peered":"2024-09-12T00:03:23.621761+0000","last_unstale":"2024-09-12T00:04:17.950226+0000","last_undegraded":"2024-09-12T00:04:17.950226+0000","last_fullsized":"2024-09-12T00:04:17.950226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:31.587668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950964+0000","last_change":"2024-09-12T00:03:25.341017+0000","last_active":"2024-09-12T00:04:17.950964+0000","last_peered":"2024-09-12T00:04:17.950964+0000","last_clean":"2024-09-12T00:04:17.950964+0000","last_became_active":"2024-09-12T00:03:25.340279+0000","last_became_peered":"2024-09-12T00:03:25.340279+0000","last_unstale":"2024-09-12T00:04:17.950964+0000","last_undegraded":"2024-09-12T00:04:17.950964+0000","last_fullsized":"2024-09-12T00:04:17.950964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:08.066950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951347+0000","last_change":"2024-09-12T00:03:23.600956+0000","last_active":"2024-09-12T00:04:17.951347+0000","last_peered":"2024-09-12T00:04:17.951347+0000","last_clean":"2024-09-12T00:04:17.951347+0000","last_became_active":"2024-09-12T00:03:23.600673+0000","last_became_peered":"2024-09-12T00:03:23.600673+0000","last_unstale":"2024-09-12T00:04:17.951347+0000","last_undegraded":"2024-09-12T00:04:17.951347+0000","last_fullsized":"2024-09-12T00:04:17.951347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951582+0000","last_change":"2024-09-12T00:03:25.325088+0000","last_active":"2024-09-12T00:04:17.951582+0000","last_peered":"2024-09-12T00:04:17.951582+0000","last_clean":"2024-09-12T00:04:17.951582+0000","last_became_active":"2024-09-12T00:03:25.324597+0000","last_became_peered":"2024-09-12T00:03:25.324597+0000","last_unstale":"2024-09-12T00:04:17.951582+0000","last_undegraded":"2024-09-12T00:04:17.951582+0000","last_fullsized":"2024-09-12T00:04:17.951582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646277+0000","last_change":"2024-09-12T00:03:23.621791+0000","last_active":"2024-09-12T00:04:18.646277+0000","last_peered":"2024-09-12T00:04:18.646277+0000","last_clean":"2024-09-12T00:04:18.646277+0000","last_became_active":"2024-09-12T00:03:23.621063+0000","last_became_peered":"2024-09-12T00:03:23.621063+0000","last_unstale":"2024-09-12T00:04:18.646277+0000","last_undegraded":"2024-09-12T00:04:18.646277+0000","last_fullsized":"2024-09-12T00:04:18.646277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:33.234598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951498+0000","last_change":"2024-09-12T00:03:25.357605+0000","last_active":"2024-09-12T00:04:17.951498+0000","last_peered":"2024-09-12T00:04:17.951498+0000","last_clean":"2024-09-12T00:04:17.951498+0000","last_became_active":"2024-09-12T00:03:25.357286+0000","last_became_peered":"2024-09-12T00:03:25.357286+0000","last_unstale":"2024-09-12T00:04:17.951498+0000","last_undegraded":"2024-09-12T00:04:17.951498+0000","last_fullsized":"2024-09-12T00:04:17.951498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.954836+0000","last_change":"2024-09-12T00:03:23.600931+0000","last_active":"2024-09-12T00:04:17.954836+0000","last_peered":"2024-09-12T00:04:17.954836+0000","last_clean":"2024-09-12T00:04:17.954836+0000","last_became_active":"2024-09-12T00:03:23.600591+0000","last_became_peered":"2024-09-12T00:03:23.600591+0000","last_unstale":"2024-09-12T00:04:17.954836+0000","last_undegraded":"2024-09-12T00:04:17.954836+0000","last_fullsized":"2024-09-12T00:04:17.954836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.952756+0000","last_change":"2024-09-12T00:03:25.330869+0000","last_active":"2024-09-12T00:04:17.952756+0000","last_peered":"2024-09-12T00:04:17.952756+0000","last_clean":"2024-09-12T00:04:17.952756+0000","last_became_active":"2024-09-12T00:03:25.329742+0000","last_became_peered":"2024-09-12T00:03:25.329742+0000","last_unstale":"2024-09-12T00:04:17.952756+0000","last_undegraded":"2024-09-12T00:04:17.952756+0000","last_fullsized":"2024-09-12T00:04:17.952756+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:01.365985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642903+0000","last_change":"2024-09-12T00:03:23.604388+0000","last_active":"2024-09-12T00:04:17.642903+0000","last_peered":"2024-09-12T00:04:17.642903+0000","last_clean":"2024-09-12T00:04:17.642903+0000","last_became_active":"2024-09-12T00:03:23.603608+0000","last_became_peered":"2024-09-12T00:03:23.603608+0000","last_unstale":"2024-09-12T00:04:17.642903+0000","last_undegraded":"2024-09-12T00:04:17.642903+0000","last_fullsized":"2024-09-12T00:04:17.642903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:19.941103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646144+0000","last_change":"2024-09-12T00:03:25.347570+0000","last_active":"2024-09-12T00:04:18.646144+0000","last_peered":"2024-09-12T00:04:18.646144+0000","last_clean":"2024-09-12T00:04:18.646144+0000","last_became_active":"2024-09-12T00:03:25.346874+0000","last_became_peered":"2024-09-12T00:03:25.346874+0000","last_unstale":"2024-09-12T00:04:18.646144+0000","last_undegraded":"2024-09-12T00:04:18.646144+0000","last_fullsized":"2024-09-12T00:04:18.646144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953612+0000","last_change":"2024-09-12T00:03:23.623417+0000","last_active":"2024-09-12T00:04:17.953612+0000","last_peered":"2024-09-12T00:04:17.953612+0000","last_clean":"2024-09-12T00:04:17.953612+0000","last_became_active":"2024-09-12T00:03:23.620261+0000","last_became_peered":"2024-09-12T00:03:23.620261+0000","last_unstale":"2024-09-12T00:04:17.953612+0000","last_undegraded":"2024-09-12T00:04:17.953612+0000","last_fullsized":"2024-09-12T00:04:17.953612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950642+0000","last_change":"2024-09-12T00:03:25.357492+0000","last_active":"2024-09-12T00:04:17.950642+0000","last_peered":"2024-09-12T00:04:17.950642+0000","last_clean":"2024-09-12T00:04:17.950642+0000","last_became_active":"2024-09-12T00:03:25.357186+0000","last_became_peered":"2024-09-12T00:03:25.357186+0000","last_unstale":"2024-09-12T00:04:17.950642+0000","last_undegraded":"2024-09-12T00:04:17.950642+0000","last_fullsized":"2024-09-12T00:04:17.950642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643547+0000","last_change":"2024-09-12T00:03:23.607247+0000","last_active":"2024-09-12T00:04:17.643547+0000","last_peered":"2024-09-12T00:04:17.643547+0000","last_clean":"2024-09-12T00:04:17.643547+0000","last_became_active":"2024-09-12T00:03:23.606625+0000","last_became_peered":"2024-09-12T00:03:23.606625+0000","last_unstale":"2024-09-12T00:04:17.643547+0000","last_undegraded":"2024-09-12T00:04:17.643547+0000","last_fullsized":"2024-09-12T00:04:17.643547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:04.927836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.644704+0000","last_change":"2024-09-12T00:03:23.611398+0000","last_active":"2024-09-12T00:04:17.644704+0000","last_peered":"2024-09-12T00:04:17.644704+0000","last_clean":"2024-09-12T00:04:17.644704+0000","last_became_active":"2024-09-12T00:03:23.610918+0000","last_became_peered":"2024-09-12T00:03:23.610918+0000","last_unstale":"2024-09-12T00:04:17.644704+0000","last_undegraded":"2024-09-12T00:04:17.644704+0000","last_fullsized":"2024-09-12T00:04:17.644704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:28.688159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647410+0000","last_change":"2024-09-12T00:03:25.350116+0000","last_active":"2024-09-12T00:04:18.647410+0000","last_peered":"2024-09-12T00:04:18.647410+0000","last_clean":"2024-09-12T00:04:18.647410+0000","last_became_active":"2024-09-12T00:03:25.349281+0000","last_became_peered":"2024-09-12T00:03:25.349281+0000","last_unstale":"2024-09-12T00:04:18.647410+0000","last_undegraded":"2024-09-12T00:04:18.647410+0000","last_fullsized":"2024-09-12T00:04:18.647410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:33.350458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950275+0000","last_change":"2024-09-12T00:03:23.619574+0000","last_active":"2024-09-12T00:04:17.950275+0000","last_peered":"2024-09-12T00:04:17.950275+0000","last_clean":"2024-09-12T00:04:17.950275+0000","last_became_active":"2024-09-12T00:03:23.616154+0000","last_became_peered":"2024-09-12T00:03:23.616154+0000","last_unstale":"2024-09-12T00:04:17.950275+0000","last_undegraded":"2024-09-12T00:04:17.950275+0000","last_fullsized":"2024-09-12T00:04:17.950275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:46.335775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.952558+0000","last_change":"2024-09-12T00:03:25.345327+0000","last_active":"2024-09-12T00:04:17.952558+0000","last_peered":"2024-09-12T00:04:17.952558+0000","last_clean":"2024-09-12T00:04:17.952558+0000","last_became_active":"2024-09-12T00:03:25.344917+0000","last_became_peered":"2024-09-12T00:03:25.344917+0000","last_unstale":"2024-09-12T00:04:17.952558+0000","last_undegraded":"2024-09-12T00:04:17.952558+0000","last_fullsized":"2024-09-12T00:04:17.952558+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":977,"num_read_kb":704,"num_write":611,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":582,"ondisk_log_size":582,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":606208,"data_stored":287326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27644,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":626688,"data_stored":296481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1212416,"data_stored":885511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":622592,"data_stored":295189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":614400,"data_stored":294878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":593920,"data_stored":294483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1245184,"data_stored":887434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31820,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340020,"statfs":{"total":96636764160,"available":96604180480,"internally_reserved":0,"allocated":643072,"data_stored":295655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:04:21.306 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:04:21.369 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:21.369+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:21.428 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:21.429 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:21.439 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:21.439+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:21.449 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:04:21.540 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:21.539+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:21.641 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:21.643+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:21.660 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:21.661 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:21.678 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:04:21.707 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:04:21.716 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T00:04:21.717 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T00:04:21.736 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-09-12T00:04:20.668321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":1047,"num_read_kb":763,"num_write":724,"num_write_kb":1672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":679,"ondisk_log_size":679,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230596,"kb_used_data":6020,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744124,"statfs":{"total":773094113280,"available":772857982976,"internally_reserved":0,"allocated":6164480,"data_stored":3536957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.029743"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953529+0000","last_change":"2024-09-12T00:03:23.604218+0000","last_active":"2024-09-12T00:04:17.953529+0000","last_peered":"2024-09-12T00:04:17.953529+0000","last_clean":"2024-09-12T00:04:17.953529+0000","last_became_active":"2024-09-12T00:03:23.603902+0000","last_became_peered":"2024-09-12T00:03:23.603902+0000","last_unstale":"2024-09-12T00:04:17.953529+0000","last_undegraded":"2024-09-12T00:04:17.953529+0000","last_fullsized":"2024-09-12T00:04:17.953529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:35.848041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950562+0000","last_change":"2024-09-12T00:03:25.337244+0000","last_active":"2024-09-12T00:04:17.950562+0000","last_peered":"2024-09-12T00:04:17.950562+0000","last_clean":"2024-09-12T00:04:17.950562+0000","last_became_active":"2024-09-12T00:03:25.335964+0000","last_became_peered":"2024-09-12T00:03:25.335964+0000","last_unstale":"2024-09-12T00:04:17.950562+0000","last_undegraded":"2024-09-12T00:04:17.950562+0000","last_fullsized":"2024-09-12T00:04:17.950562+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951374+0000","last_change":"2024-09-12T00:03:23.628328+0000","last_active":"2024-09-12T00:04:17.951374+0000","last_peered":"2024-09-12T00:04:17.951374+0000","last_clean":"2024-09-12T00:04:17.951374+0000","last_became_active":"2024-09-12T00:03:23.627630+0000","last_became_peered":"2024-09-12T00:03:23.627630+0000","last_unstale":"2024-09-12T00:04:17.951374+0000","last_undegraded":"2024-09-12T00:04:17.951374+0000","last_fullsized":"2024-09-12T00:04:17.951374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:00.573006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642617+0000","last_change":"2024-09-12T00:03:25.338343+0000","last_active":"2024-09-12T00:04:17.642617+0000","last_peered":"2024-09-12T00:04:17.642617+0000","last_clean":"2024-09-12T00:04:17.642617+0000","last_became_active":"2024-09-12T00:03:25.337994+0000","last_became_peered":"2024-09-12T00:03:25.337994+0000","last_unstale":"2024-09-12T00:04:17.642617+0000","last_undegraded":"2024-09-12T00:04:17.642617+0000","last_fullsized":"2024-09-12T00:04:17.642617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:39.689763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950995+0000","last_change":"2024-09-12T00:03:23.626533+0000","last_active":"2024-09-12T00:04:17.950995+0000","last_peered":"2024-09-12T00:04:17.950995+0000","last_clean":"2024-09-12T00:04:17.950995+0000","last_became_active":"2024-09-12T00:03:23.625728+0000","last_became_peered":"2024-09-12T00:03:23.625728+0000","last_unstale":"2024-09-12T00:04:17.950995+0000","last_undegraded":"2024-09-12T00:04:17.950995+0000","last_fullsized":"2024-09-12T00:04:17.950995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:31.772442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642099+0000","last_change":"2024-09-12T00:03:25.336667+0000","last_active":"2024-09-12T00:04:17.642099+0000","last_peered":"2024-09-12T00:04:17.642099+0000","last_clean":"2024-09-12T00:04:17.642099+0000","last_became_active":"2024-09-12T00:03:25.336327+0000","last_became_peered":"2024-09-12T00:03:25.336327+0000","last_unstale":"2024-09-12T00:04:17.642099+0000","last_undegraded":"2024-09-12T00:04:17.642099+0000","last_fullsized":"2024-09-12T00:04:17.642099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:45.222842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.648647+0000","last_change":"2024-09-12T00:03:23.609828+0000","last_active":"2024-09-12T00:04:18.648647+0000","last_peered":"2024-09-12T00:04:18.648647+0000","last_clean":"2024-09-12T00:04:18.648647+0000","last_became_active":"2024-09-12T00:03:23.609326+0000","last_became_peered":"2024-09-12T00:03:23.609326+0000","last_unstale":"2024-09-12T00:04:18.648647+0000","last_undegraded":"2024-09-12T00:04:18.648647+0000","last_fullsized":"2024-09-12T00:04:18.648647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:25.491620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646301+0000","last_change":"2024-09-12T00:03:25.339518+0000","last_active":"2024-09-12T00:04:18.646301+0000","last_peered":"2024-09-12T00:04:18.646301+0000","last_clean":"2024-09-12T00:04:18.646301+0000","last_became_active":"2024-09-12T00:03:25.338805+0000","last_became_peered":"2024-09-12T00:03:25.338805+0000","last_unstale":"2024-09-12T00:04:18.646301+0000","last_undegraded":"2024-09-12T00:04:18.646301+0000","last_fullsized":"2024-09-12T00:04:18.646301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951205+0000","last_change":"2024-09-12T00:03:23.633978+0000","last_active":"2024-09-12T00:04:17.951205+0000","last_peered":"2024-09-12T00:04:17.951205+0000","last_clean":"2024-09-12T00:04:17.951205+0000","last_became_active":"2024-09-12T00:03:23.633580+0000","last_became_peered":"2024-09-12T00:03:23.633580+0000","last_unstale":"2024-09-12T00:04:17.951205+0000","last_undegraded":"2024-09-12T00:04:17.951205+0000","last_fullsized":"2024-09-12T00:04:17.951205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:01.872688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.954537+0000","last_change":"2024-09-12T00:03:25.324424+0000","last_active":"2024-09-12T00:04:17.954537+0000","last_peered":"2024-09-12T00:04:17.954537+0000","last_clean":"2024-09-12T00:04:17.954537+0000","last_became_active":"2024-09-12T00:03:25.324138+0000","last_became_peered":"2024-09-12T00:03:25.324138+0000","last_unstale":"2024-09-12T00:04:17.954537+0000","last_undegraded":"2024-09-12T00:04:17.954537+0000","last_fullsized":"2024-09-12T00:04:17.954537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:09.954252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647258+0000","last_change":"2024-09-12T00:03:23.610136+0000","last_active":"2024-09-12T00:04:18.647258+0000","last_peered":"2024-09-12T00:04:18.647258+0000","last_clean":"2024-09-12T00:04:18.647258+0000","last_became_active":"2024-09-12T00:03:23.609509+0000","last_became_peered":"2024-09-12T00:03:23.609509+0000","last_unstale":"2024-09-12T00:04:18.647258+0000","last_undegraded":"2024-09-12T00:04:18.647258+0000","last_fullsized":"2024-09-12T00:04:18.647258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.954139+0000","last_change":"2024-09-12T00:03:25.355256+0000","last_active":"2024-09-12T00:04:17.954139+0000","last_peered":"2024-09-12T00:04:17.954139+0000","last_clean":"2024-09-12T00:04:17.954139+0000","last_became_active":"2024-09-12T00:03:25.355002+0000","last_became_peered":"2024-09-12T00:03:25.355002+0000","last_unstale":"2024-09-12T00:04:17.954139+0000","last_undegraded":"2024-09-12T00:04:17.954139+0000","last_fullsized":"2024-09-12T00:04:17.954139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:50.488869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950708+0000","last_change":"2024-09-12T00:03:23.606780+0000","last_active":"2024-09-12T00:04:17.950708+0000","last_peered":"2024-09-12T00:04:17.950708+0000","last_clean":"2024-09-12T00:04:17.950708+0000","last_became_active":"2024-09-12T00:03:23.606143+0000","last_became_peered":"2024-09-12T00:03:23.606143+0000","last_unstale":"2024-09-12T00:04:17.950708+0000","last_undegraded":"2024-09-12T00:04:17.950708+0000","last_fullsized":"2024-09-12T00:04:17.950708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:22.889982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.649408+0000","last_change":"2024-09-12T00:03:25.330195+0000","last_active":"2024-09-12T00:04:18.649408+0000","last_peered":"2024-09-12T00:04:18.649408+0000","last_clean":"2024-09-12T00:04:18.649408+0000","last_became_active":"2024-09-12T00:03:25.329625+0000","last_became_peered":"2024-09-12T00:03:25.329625+0000","last_unstale":"2024-09-12T00:04:18.649408+0000","last_undegraded":"2024-09-12T00:04:18.649408+0000","last_fullsized":"2024-09-12T00:04:18.649408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950232+0000","last_change":"2024-09-12T00:03:23.626723+0000","last_active":"2024-09-12T00:04:17.950232+0000","last_peered":"2024-09-12T00:04:17.950232+0000","last_clean":"2024-09-12T00:04:17.950232+0000","last_became_active":"2024-09-12T00:03:23.626018+0000","last_became_peered":"2024-09-12T00:03:23.626018+0000","last_unstale":"2024-09-12T00:04:17.950232+0000","last_undegraded":"2024-09-12T00:04:17.950232+0000","last_fullsized":"2024-09-12T00:04:17.950232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951710+0000","last_change":"2024-09-12T00:03:25.352418+0000","last_active":"2024-09-12T00:04:17.951710+0000","last_peered":"2024-09-12T00:04:17.951710+0000","last_clean":"2024-09-12T00:04:17.951710+0000","last_became_active":"2024-09-12T00:03:25.347902+0000","last_became_peered":"2024-09-12T00:03:25.347902+0000","last_unstale":"2024-09-12T00:04:17.951710+0000","last_undegraded":"2024-09-12T00:04:17.951710+0000","last_fullsized":"2024-09-12T00:04:17.951710+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:29.611790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.644605+0000","last_change":"2024-09-12T00:03:25.321057+0000","last_active":"2024-09-12T00:04:17.644605+0000","last_peered":"2024-09-12T00:04:17.644605+0000","last_clean":"2024-09-12T00:04:17.644605+0000","last_became_active":"2024-09-12T00:03:25.320611+0000","last_became_peered":"2024-09-12T00:03:25.320611+0000","last_unstale":"2024-09-12T00:04:17.644605+0000","last_undegraded":"2024-09-12T00:04:17.644605+0000","last_fullsized":"2024-09-12T00:04:17.644605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:46.041829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.952717+0000","last_change":"2024-09-12T00:03:23.594170+0000","last_active":"2024-09-12T00:04:17.952717+0000","last_peered":"2024-09-12T00:04:17.952717+0000","last_clean":"2024-09-12T00:04:17.952717+0000","last_became_active":"2024-09-12T00:03:23.593880+0000","last_became_peered":"2024-09-12T00:03:23.593880+0000","last_unstale":"2024-09-12T00:04:17.952717+0000","last_undegraded":"2024-09-12T00:04:17.952717+0000","last_fullsized":"2024-09-12T00:04:17.952717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:33.234598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950589+0000","last_change":"2024-09-12T00:03:25.334966+0000","last_active":"2024-09-12T00:04:17.950589+0000","last_peered":"2024-09-12T00:04:17.950589+0000","last_clean":"2024-09-12T00:04:17.950589+0000","last_became_active":"2024-09-12T00:03:25.334375+0000","last_became_peered":"2024-09-12T00:03:25.334375+0000","last_unstale":"2024-09-12T00:04:17.950589+0000","last_undegraded":"2024-09-12T00:04:17.950589+0000","last_fullsized":"2024-09-12T00:04:17.950589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:52.828056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953668+0000","last_change":"2024-09-12T00:03:23.614289+0000","last_active":"2024-09-12T00:04:17.953668+0000","last_peered":"2024-09-12T00:04:17.953668+0000","last_clean":"2024-09-12T00:04:17.953668+0000","last_became_active":"2024-09-12T00:03:23.614019+0000","last_became_peered":"2024-09-12T00:03:23.614019+0000","last_unstale":"2024-09-12T00:04:17.953668+0000","last_undegraded":"2024-09-12T00:04:17.953668+0000","last_fullsized":"2024-09-12T00:04:17.953668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:00.847027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951647+0000","last_change":"2024-09-12T00:03:25.357938+0000","last_active":"2024-09-12T00:04:17.951647+0000","last_peered":"2024-09-12T00:04:17.951647+0000","last_clean":"2024-09-12T00:04:17.951647+0000","last_became_active":"2024-09-12T00:03:25.357571+0000","last_became_peered":"2024-09-12T00:03:25.357571+0000","last_unstale":"2024-09-12T00:04:17.951647+0000","last_undegraded":"2024-09-12T00:04:17.951647+0000","last_fullsized":"2024-09-12T00:04:17.951647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:05.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.954219+0000","last_change":"2024-09-12T00:03:23.604162+0000","last_active":"2024-09-12T00:04:17.954219+0000","last_peered":"2024-09-12T00:04:17.954219+0000","last_clean":"2024-09-12T00:04:17.954219+0000","last_became_active":"2024-09-12T00:03:23.603466+0000","last_became_peered":"2024-09-12T00:03:23.603466+0000","last_unstale":"2024-09-12T00:04:17.954219+0000","last_undegraded":"2024-09-12T00:04:17.954219+0000","last_fullsized":"2024-09-12T00:04:17.954219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:50.482404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.644134+0000","last_change":"2024-09-12T00:03:25.345717+0000","last_active":"2024-09-12T00:04:18.644134+0000","last_peered":"2024-09-12T00:04:18.644134+0000","last_clean":"2024-09-12T00:04:18.644134+0000","last_became_active":"2024-09-12T00:03:25.344959+0000","last_became_peered":"2024-09-12T00:03:25.344959+0000","last_unstale":"2024-09-12T00:04:18.644134+0000","last_undegraded":"2024-09-12T00:04:18.644134+0000","last_fullsized":"2024-09-12T00:04:18.644134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.954693+0000","last_change":"2024-09-12T00:03:23.602960+0000","last_active":"2024-09-12T00:04:17.954693+0000","last_peered":"2024-09-12T00:04:17.954693+0000","last_clean":"2024-09-12T00:04:17.954693+0000","last_became_active":"2024-09-12T00:03:23.602640+0000","last_became_peered":"2024-09-12T00:03:23.602640+0000","last_unstale":"2024-09-12T00:04:17.954693+0000","last_undegraded":"2024-09-12T00:04:17.954693+0000","last_fullsized":"2024-09-12T00:04:17.954693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950567+0000","last_change":"2024-09-12T00:03:25.339888+0000","last_active":"2024-09-12T00:04:17.950567+0000","last_peered":"2024-09-12T00:04:17.950567+0000","last_clean":"2024-09-12T00:04:17.950567+0000","last_became_active":"2024-09-12T00:03:25.339092+0000","last_became_peered":"2024-09-12T00:03:25.339092+0000","last_unstale":"2024-09-12T00:04:17.950567+0000","last_undegraded":"2024-09-12T00:04:17.950567+0000","last_fullsized":"2024-09-12T00:04:17.950567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:06.165291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":67,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.644324+0000","last_change":"2024-09-12T00:03:23.604732+0000","last_active":"2024-09-12T00:04:18.644324+0000","last_peered":"2024-09-12T00:04:18.644324+0000","last_clean":"2024-09-12T00:04:18.644324+0000","last_became_active":"2024-09-12T00:03:23.603932+0000","last_became_peered":"2024-09-12T00:03:23.603932+0000","last_unstale":"2024-09-12T00:04:18.644324+0000","last_undegraded":"2024-09-12T00:04:18.644324+0000","last_fullsized":"2024-09-12T00:04:18.644324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:14.913580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951959+0000","last_change":"2024-09-12T00:03:25.341332+0000","last_active":"2024-09-12T00:04:17.951959+0000","last_peered":"2024-09-12T00:04:17.951959+0000","last_clean":"2024-09-12T00:04:17.951959+0000","last_became_active":"2024-09-12T00:03:25.340828+0000","last_became_peered":"2024-09-12T00:03:25.340828+0000","last_unstale":"2024-09-12T00:04:17.951959+0000","last_undegraded":"2024-09-12T00:04:17.951959+0000","last_fullsized":"2024-09-12T00:04:17.951959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":67,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643220+0000","last_change":"2024-09-12T00:03:23.602687+0000","last_active":"2024-09-12T00:04:18.643220+0000","last_peered":"2024-09-12T00:04:18.643220+0000","last_clean":"2024-09-12T00:04:18.643220+0000","last_became_active":"2024-09-12T00:03:23.601892+0000","last_became_peered":"2024-09-12T00:03:23.601892+0000","last_unstale":"2024-09-12T00:04:18.643220+0000","last_undegraded":"2024-09-12T00:04:18.643220+0000","last_fullsized":"2024-09-12T00:04:18.643220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950204+0000","last_change":"2024-09-12T00:03:33.354850+0000","last_active":"2024-09-12T00:04:17.950204+0000","last_peered":"2024-09-12T00:04:17.950204+0000","last_clean":"2024-09-12T00:04:17.950204+0000","last_became_active":"2024-09-12T00:03:33.351917+0000","last_became_peered":"2024-09-12T00:03:33.351917+0000","last_unstale":"2024-09-12T00:04:17.950204+0000","last_undegraded":"2024-09-12T00:04:17.950204+0000","last_fullsized":"2024-09-12T00:04:17.950204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:00.466863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643763+0000","last_change":"2024-09-12T00:03:25.323174+0000","last_active":"2024-09-12T00:04:18.643763+0000","last_peered":"2024-09-12T00:04:18.643763+0000","last_clean":"2024-09-12T00:04:18.643763+0000","last_became_active":"2024-09-12T00:03:25.322456+0000","last_became_peered":"2024-09-12T00:03:25.322456+0000","last_unstale":"2024-09-12T00:04:18.643763+0000","last_undegraded":"2024-09-12T00:04:18.643763+0000","last_fullsized":"2024-09-12T00:04:18.643763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":71,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.641842+0000","last_change":"2024-09-12T00:04:01.825243+0000","last_active":"2024-09-12T00:04:17.641842+0000","last_peered":"2024-09-12T00:04:17.641842+0000","last_clean":"2024-09-12T00:04:17.641842+0000","last_became_active":"2024-09-12T00:04:01.824774+0000","last_became_peered":"2024-09-12T00:04:01.824774+0000","last_unstale":"2024-09-12T00:04:17.641842+0000","last_undegraded":"2024-09-12T00:04:17.641842+0000","last_fullsized":"2024-09-12T00:04:17.641842+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:53.932507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643393+0000","last_change":"2024-09-12T00:03:27.341305+0000","last_active":"2024-09-12T00:04:17.643393+0000","last_peered":"2024-09-12T00:04:17.643393+0000","last_clean":"2024-09-12T00:04:17.643393+0000","last_became_active":"2024-09-12T00:03:27.338132+0000","last_became_peered":"2024-09-12T00:03:27.338132+0000","last_unstale":"2024-09-12T00:04:17.643393+0000","last_undegraded":"2024-09-12T00:04:17.643393+0000","last_fullsized":"2024-09-12T00:04:17.643393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:11.884824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'21","reported_seq":93,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647114+0000","last_change":"2024-09-12T00:03:29.347224+0000","last_active":"2024-09-12T00:04:18.647114+0000","last_peered":"2024-09-12T00:04:18.647114+0000","last_clean":"2024-09-12T00:04:18.647114+0000","last_became_active":"2024-09-12T00:03:29.346662+0000","last_became_peered":"2024-09-12T00:03:29.346662+0000","last_unstale":"2024-09-12T00:04:18.647114+0000","last_undegraded":"2024-09-12T00:04:18.647114+0000","last_fullsized":"2024-09-12T00:04:18.647114+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:28.258932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":49,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.952348+0000","last_change":"2024-09-12T00:03:31.337219+0000","last_active":"2024-09-12T00:04:17.952348+0000","last_peered":"2024-09-12T00:04:17.952348+0000","last_clean":"2024-09-12T00:04:17.952348+0000","last_became_active":"2024-09-12T00:03:31.336317+0000","last_became_peered":"2024-09-12T00:03:31.336317+0000","last_unstale":"2024-09-12T00:04:17.952348+0000","last_undegraded":"2024-09-12T00:04:17.952348+0000","last_fullsized":"2024-09-12T00:04:17.952348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:50.954053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950478+0000","last_change":"2024-09-12T00:03:33.376628+0000","last_active":"2024-09-12T00:04:17.950478+0000","last_peered":"2024-09-12T00:04:17.950478+0000","last_clean":"2024-09-12T00:04:17.950478+0000","last_became_active":"2024-09-12T00:03:33.375938+0000","last_became_peered":"2024-09-12T00:03:33.375938+0000","last_unstale":"2024-09-12T00:04:17.950478+0000","last_undegraded":"2024-09-12T00:04:17.950478+0000","last_fullsized":"2024-09-12T00:04:17.950478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:31.105042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642994+0000","last_change":"2024-09-12T00:03:25.326911+0000","last_active":"2024-09-12T00:04:17.642994+0000","last_peered":"2024-09-12T00:04:17.642994+0000","last_clean":"2024-09-12T00:04:17.642994+0000","last_became_active":"2024-09-12T00:03:25.326255+0000","last_became_peered":"2024-09-12T00:03:25.326255+0000","last_unstale":"2024-09-12T00:04:17.642994+0000","last_undegraded":"2024-09-12T00:04:17.642994+0000","last_fullsized":"2024-09-12T00:04:17.642994+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:15.491636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":67,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643268+0000","last_change":"2024-09-12T00:03:23.596266+0000","last_active":"2024-09-12T00:04:18.643268+0000","last_peered":"2024-09-12T00:04:18.643268+0000","last_clean":"2024-09-12T00:04:18.643268+0000","last_became_active":"2024-09-12T00:03:23.595480+0000","last_became_peered":"2024-09-12T00:03:23.595480+0000","last_unstale":"2024-09-12T00:04:18.643268+0000","last_undegraded":"2024-09-12T00:04:18.643268+0000","last_fullsized":"2024-09-12T00:04:18.643268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:25.491620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":57,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646460+0000","last_change":"2024-09-12T00:03:27.336108+0000","last_active":"2024-09-12T00:04:18.646460+0000","last_peered":"2024-09-12T00:04:18.646460+0000","last_clean":"2024-09-12T00:04:18.646460+0000","last_became_active":"2024-09-12T00:03:27.335308+0000","last_became_peered":"2024-09-12T00:03:27.335308+0000","last_unstale":"2024-09-12T00:04:18.646460+0000","last_undegraded":"2024-09-12T00:04:18.646460+0000","last_fullsized":"2024-09-12T00:04:18.646460+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:39.812803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'12","reported_seq":74,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.952411+0000","last_change":"2024-09-12T00:03:29.352496+0000","last_active":"2024-09-12T00:04:17.952411+0000","last_peered":"2024-09-12T00:04:17.952411+0000","last_clean":"2024-09-12T00:04:17.952411+0000","last_became_active":"2024-09-12T00:03:29.351783+0000","last_became_peered":"2024-09-12T00:03:29.351783+0000","last_unstale":"2024-09-12T00:04:17.952411+0000","last_undegraded":"2024-09-12T00:04:17.952411+0000","last_fullsized":"2024-09-12T00:04:17.952411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":49,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951930+0000","last_change":"2024-09-12T00:03:31.350279+0000","last_active":"2024-09-12T00:04:17.951930+0000","last_peered":"2024-09-12T00:04:17.951930+0000","last_clean":"2024-09-12T00:04:17.951930+0000","last_became_active":"2024-09-12T00:03:31.349244+0000","last_became_peered":"2024-09-12T00:03:31.349244+0000","last_unstale":"2024-09-12T00:04:17.951930+0000","last_undegraded":"2024-09-12T00:04:17.951930+0000","last_fullsized":"2024-09-12T00:04:17.951930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.420974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":47,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643030+0000","last_change":"2024-09-12T00:03:33.382726+0000","last_active":"2024-09-12T00:04:18.643030+0000","last_peered":"2024-09-12T00:04:18.643030+0000","last_clean":"2024-09-12T00:04:18.643030+0000","last_became_active":"2024-09-12T00:03:33.381875+0000","last_became_peered":"2024-09-12T00:03:33.381875+0000","last_unstale":"2024-09-12T00:04:18.643030+0000","last_undegraded":"2024-09-12T00:04:18.643030+0000","last_fullsized":"2024-09-12T00:04:18.643030+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951306+0000","last_change":"2024-09-12T00:03:25.357883+0000","last_active":"2024-09-12T00:04:17.951306+0000","last_peered":"2024-09-12T00:04:17.951306+0000","last_clean":"2024-09-12T00:04:17.951306+0000","last_became_active":"2024-09-12T00:03:25.355174+0000","last_became_peered":"2024-09-12T00:03:25.355174+0000","last_unstale":"2024-09-12T00:04:17.951306+0000","last_undegraded":"2024-09-12T00:04:17.951306+0000","last_fullsized":"2024-09-12T00:04:17.951306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:26.621650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642746+0000","last_change":"2024-09-12T00:03:23.617603+0000","last_active":"2024-09-12T00:04:17.642746+0000","last_peered":"2024-09-12T00:04:17.642746+0000","last_clean":"2024-09-12T00:04:17.642746+0000","last_became_active":"2024-09-12T00:03:23.617317+0000","last_became_peered":"2024-09-12T00:03:23.617317+0000","last_unstale":"2024-09-12T00:04:17.642746+0000","last_undegraded":"2024-09-12T00:04:17.642746+0000","last_fullsized":"2024-09-12T00:04:17.642746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:36.997566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":57,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647361+0000","last_change":"2024-09-12T00:03:27.347098+0000","last_active":"2024-09-12T00:04:18.647361+0000","last_peered":"2024-09-12T00:04:18.647361+0000","last_clean":"2024-09-12T00:04:18.647361+0000","last_became_active":"2024-09-12T00:03:27.346346+0000","last_became_peered":"2024-09-12T00:03:27.346346+0000","last_unstale":"2024-09-12T00:04:18.647361+0000","last_undegraded":"2024-09-12T00:04:18.647361+0000","last_fullsized":"2024-09-12T00:04:18.647361+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:56.250627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'22","reported_seq":92,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646362+0000","last_change":"2024-09-12T00:03:29.357080+0000","last_active":"2024-09-12T00:04:18.646362+0000","last_peered":"2024-09-12T00:04:18.646362+0000","last_clean":"2024-09-12T00:04:18.646362+0000","last_became_active":"2024-09-12T00:03:29.356262+0000","last_became_peered":"2024-09-12T00:03:29.356262+0000","last_unstale":"2024-09-12T00:04:18.646362+0000","last_undegraded":"2024-09-12T00:04:18.646362+0000","last_fullsized":"2024-09-12T00:04:18.646362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:27.790240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"32'2","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643475+0000","last_change":"2024-09-12T00:03:31.362060+0000","last_active":"2024-09-12T00:04:17.643475+0000","last_peered":"2024-09-12T00:04:17.643475+0000","last_clean":"2024-09-12T00:04:17.643475+0000","last_became_active":"2024-09-12T00:03:31.361330+0000","last_became_peered":"2024-09-12T00:03:31.361330+0000","last_unstale":"2024-09-12T00:04:17.643475+0000","last_undegraded":"2024-09-12T00:04:17.643475+0000","last_fullsized":"2024-09-12T00:04:17.643475+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:06.142584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":45,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647352+0000","last_change":"2024-09-12T00:03:33.378439+0000","last_active":"2024-09-12T00:04:18.647352+0000","last_peered":"2024-09-12T00:04:18.647352+0000","last_clean":"2024-09-12T00:04:18.647352+0000","last_became_active":"2024-09-12T00:03:33.374453+0000","last_became_peered":"2024-09-12T00:03:33.374453+0000","last_unstale":"2024-09-12T00:04:18.647352+0000","last_undegraded":"2024-09-12T00:04:18.647352+0000","last_fullsized":"2024-09-12T00:04:18.647352+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951613+0000","last_change":"2024-09-12T00:03:25.356433+0000","last_active":"2024-09-12T00:04:17.951613+0000","last_peered":"2024-09-12T00:04:17.951613+0000","last_clean":"2024-09-12T00:04:17.951613+0000","last_became_active":"2024-09-12T00:03:25.354803+0000","last_became_peered":"2024-09-12T00:03:25.354803+0000","last_unstale":"2024-09-12T00:04:17.951613+0000","last_undegraded":"2024-09-12T00:04:17.951613+0000","last_fullsized":"2024-09-12T00:04:17.951613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:00.419686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950800+0000","last_change":"2024-09-12T00:03:23.630527+0000","last_active":"2024-09-12T00:04:17.950800+0000","last_peered":"2024-09-12T00:04:17.950800+0000","last_clean":"2024-09-12T00:04:17.950800+0000","last_became_active":"2024-09-12T00:03:23.630183+0000","last_became_peered":"2024-09-12T00:03:23.630183+0000","last_unstale":"2024-09-12T00:04:17.950800+0000","last_undegraded":"2024-09-12T00:04:17.950800+0000","last_fullsized":"2024-09-12T00:04:17.950800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642907+0000","last_change":"2024-09-12T00:03:27.334188+0000","last_active":"2024-09-12T00:04:17.642907+0000","last_peered":"2024-09-12T00:04:17.642907+0000","last_clean":"2024-09-12T00:04:17.642907+0000","last_became_active":"2024-09-12T00:03:27.333395+0000","last_became_peered":"2024-09-12T00:03:27.333395+0000","last_unstale":"2024-09-12T00:04:17.642907+0000","last_undegraded":"2024-09-12T00:04:17.642907+0000","last_fullsized":"2024-09-12T00:04:17.642907+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:56.266608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'15","reported_seq":81,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.649161+0000","last_change":"2024-09-12T00:03:29.339735+0000","last_active":"2024-09-12T00:04:18.649161+0000","last_peered":"2024-09-12T00:04:18.649161+0000","last_clean":"2024-09-12T00:04:18.649161+0000","last_became_active":"2024-09-12T00:03:29.338810+0000","last_became_peered":"2024-09-12T00:03:29.338810+0000","last_unstale":"2024-09-12T00:04:18.649161+0000","last_undegraded":"2024-09-12T00:04:18.649161+0000","last_fullsized":"2024-09-12T00:04:18.649161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'2","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950691+0000","last_change":"2024-09-12T00:03:31.364647+0000","last_active":"2024-09-12T00:04:17.950691+0000","last_peered":"2024-09-12T00:04:17.950691+0000","last_clean":"2024-09-12T00:04:17.950691+0000","last_became_active":"2024-09-12T00:03:31.353547+0000","last_became_peered":"2024-09-12T00:03:31.353547+0000","last_unstale":"2024-09-12T00:04:17.950691+0000","last_undegraded":"2024-09-12T00:04:17.950691+0000","last_fullsized":"2024-09-12T00:04:17.950691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:20.795870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.644605+0000","last_change":"2024-09-12T00:03:25.329615+0000","last_active":"2024-09-12T00:04:17.644605+0000","last_peered":"2024-09-12T00:04:17.644605+0000","last_clean":"2024-09-12T00:04:17.644605+0000","last_became_active":"2024-09-12T00:03:25.329015+0000","last_became_peered":"2024-09-12T00:03:25.329015+0000","last_unstale":"2024-09-12T00:04:17.644605+0000","last_undegraded":"2024-09-12T00:04:17.644605+0000","last_fullsized":"2024-09-12T00:04:17.644605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:00.170397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953667+0000","last_change":"2024-09-12T00:03:23.602206+0000","last_active":"2024-09-12T00:04:17.953667+0000","last_peered":"2024-09-12T00:04:17.953667+0000","last_clean":"2024-09-12T00:04:17.953667+0000","last_became_active":"2024-09-12T00:03:23.601898+0000","last_became_peered":"2024-09-12T00:03:23.601898+0000","last_unstale":"2024-09-12T00:04:17.953667+0000","last_undegraded":"2024-09-12T00:04:17.953667+0000","last_fullsized":"2024-09-12T00:04:17.953667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:52.625795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950787+0000","last_change":"2024-09-12T00:03:27.331111+0000","last_active":"2024-09-12T00:04:17.950787+0000","last_peered":"2024-09-12T00:04:17.950787+0000","last_clean":"2024-09-12T00:04:17.950787+0000","last_became_active":"2024-09-12T00:03:27.329672+0000","last_became_peered":"2024-09-12T00:03:27.329672+0000","last_unstale":"2024-09-12T00:04:17.950787+0000","last_undegraded":"2024-09-12T00:04:17.950787+0000","last_fullsized":"2024-09-12T00:04:17.950787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'25","reported_seq":96,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951008+0000","last_change":"2024-09-12T00:03:29.335931+0000","last_active":"2024-09-12T00:04:17.951008+0000","last_peered":"2024-09-12T00:04:17.951008+0000","last_clean":"2024-09-12T00:04:17.951008+0000","last_became_active":"2024-09-12T00:03:29.335044+0000","last_became_peered":"2024-09-12T00:03:29.335044+0000","last_unstale":"2024-09-12T00:04:17.951008+0000","last_undegraded":"2024-09-12T00:04:17.951008+0000","last_fullsized":"2024-09-12T00:04:17.951008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:57.131209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":51,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643430+0000","last_change":"2024-09-12T00:03:31.355001+0000","last_active":"2024-09-12T00:04:18.643430+0000","last_peered":"2024-09-12T00:04:18.643430+0000","last_clean":"2024-09-12T00:04:18.643430+0000","last_became_active":"2024-09-12T00:03:31.354160+0000","last_became_peered":"2024-09-12T00:03:31.354160+0000","last_unstale":"2024-09-12T00:04:18.643430+0000","last_undegraded":"2024-09-12T00:04:18.643430+0000","last_fullsized":"2024-09-12T00:04:18.643430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:29.868141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":45,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.648320+0000","last_change":"2024-09-12T00:03:33.387603+0000","last_active":"2024-09-12T00:04:18.648320+0000","last_peered":"2024-09-12T00:04:18.648320+0000","last_clean":"2024-09-12T00:04:18.648320+0000","last_became_active":"2024-09-12T00:03:33.386614+0000","last_became_peered":"2024-09-12T00:03:33.386614+0000","last_unstale":"2024-09-12T00:04:18.648320+0000","last_undegraded":"2024-09-12T00:04:18.648320+0000","last_fullsized":"2024-09-12T00:04:18.648320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:37.428182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950913+0000","last_change":"2024-09-12T00:03:25.357300+0000","last_active":"2024-09-12T00:04:17.950913+0000","last_peered":"2024-09-12T00:04:17.950913+0000","last_clean":"2024-09-12T00:04:17.950913+0000","last_became_active":"2024-09-12T00:03:25.356970+0000","last_became_peered":"2024-09-12T00:03:25.356970+0000","last_unstale":"2024-09-12T00:04:17.950913+0000","last_undegraded":"2024-09-12T00:04:17.950913+0000","last_fullsized":"2024-09-12T00:04:17.950913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:04.193738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.649835+0000","last_change":"2024-09-12T00:03:23.609700+0000","last_active":"2024-09-12T00:04:18.649835+0000","last_peered":"2024-09-12T00:04:18.649835+0000","last_clean":"2024-09-12T00:04:18.649835+0000","last_became_active":"2024-09-12T00:03:23.609435+0000","last_became_peered":"2024-09-12T00:03:23.609435+0000","last_unstale":"2024-09-12T00:04:18.649835+0000","last_undegraded":"2024-09-12T00:04:18.649835+0000","last_fullsized":"2024-09-12T00:04:18.649835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":59,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.642662+0000","last_change":"2024-09-12T00:03:27.339670+0000","last_active":"2024-09-12T00:04:18.642662+0000","last_peered":"2024-09-12T00:04:18.642662+0000","last_clean":"2024-09-12T00:04:18.642662+0000","last_became_active":"2024-09-12T00:03:27.338880+0000","last_became_peered":"2024-09-12T00:03:27.338880+0000","last_unstale":"2024-09-12T00:04:18.642662+0000","last_undegraded":"2024-09-12T00:04:18.642662+0000","last_fullsized":"2024-09-12T00:04:18.642662+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:35.068652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"35'15","reported_seq":81,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645810+0000","last_change":"2024-09-12T00:03:29.337666+0000","last_active":"2024-09-12T00:04:18.645810+0000","last_peered":"2024-09-12T00:04:18.645810+0000","last_clean":"2024-09-12T00:04:18.645810+0000","last_became_active":"2024-09-12T00:03:29.336957+0000","last_became_peered":"2024-09-12T00:03:29.336957+0000","last_unstale":"2024-09-12T00:04:18.645810+0000","last_undegraded":"2024-09-12T00:04:18.645810+0000","last_fullsized":"2024-09-12T00:04:18.645810+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:58.417315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":49,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645841+0000","last_change":"2024-09-12T00:03:31.348590+0000","last_active":"2024-09-12T00:04:18.645841+0000","last_peered":"2024-09-12T00:04:18.645841+0000","last_clean":"2024-09-12T00:04:18.645841+0000","last_became_active":"2024-09-12T00:03:31.347736+0000","last_became_peered":"2024-09-12T00:03:31.347736+0000","last_unstale":"2024-09-12T00:04:18.645841+0000","last_undegraded":"2024-09-12T00:04:18.645841+0000","last_fullsized":"2024-09-12T00:04:18.645841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:04.962492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951675+0000","last_change":"2024-09-12T00:03:33.379699+0000","last_active":"2024-09-12T00:04:17.951675+0000","last_peered":"2024-09-12T00:04:17.951675+0000","last_clean":"2024-09-12T00:04:17.951675+0000","last_became_active":"2024-09-12T00:03:33.378945+0000","last_became_peered":"2024-09-12T00:03:33.378945+0000","last_unstale":"2024-09-12T00:04:17.951675+0000","last_undegraded":"2024-09-12T00:04:17.951675+0000","last_fullsized":"2024-09-12T00:04:17.951675+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:23.270488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647096+0000","last_change":"2024-09-12T00:03:25.333941+0000","last_active":"2024-09-12T00:04:18.647096+0000","last_peered":"2024-09-12T00:04:18.647096+0000","last_clean":"2024-09-12T00:04:18.647096+0000","last_became_active":"2024-09-12T00:03:25.333559+0000","last_became_peered":"2024-09-12T00:03:25.333559+0000","last_unstale":"2024-09-12T00:04:18.647096+0000","last_undegraded":"2024-09-12T00:04:18.647096+0000","last_fullsized":"2024-09-12T00:04:18.647096+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642507+0000","last_change":"2024-09-12T00:03:23.596202+0000","last_active":"2024-09-12T00:04:17.642507+0000","last_peered":"2024-09-12T00:04:17.642507+0000","last_clean":"2024-09-12T00:04:17.642507+0000","last_became_active":"2024-09-12T00:03:23.595859+0000","last_became_peered":"2024-09-12T00:03:23.595859+0000","last_unstale":"2024-09-12T00:04:17.642507+0000","last_undegraded":"2024-09-12T00:04:17.642507+0000","last_fullsized":"2024-09-12T00:04:17.642507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:12.001918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":56,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950472+0000","last_change":"2024-09-12T00:03:27.348080+0000","last_active":"2024-09-12T00:04:17.950472+0000","last_peered":"2024-09-12T00:04:17.950472+0000","last_clean":"2024-09-12T00:04:17.950472+0000","last_became_active":"2024-09-12T00:03:27.347288+0000","last_became_peered":"2024-09-12T00:03:27.347288+0000","last_unstale":"2024-09-12T00:04:17.950472+0000","last_undegraded":"2024-09-12T00:04:17.950472+0000","last_fullsized":"2024-09-12T00:04:17.950472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:37.033224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"35'27","reported_seq":102,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.641963+0000","last_change":"2024-09-12T00:03:29.349297+0000","last_active":"2024-09-12T00:04:17.641963+0000","last_peered":"2024-09-12T00:04:17.641963+0000","last_clean":"2024-09-12T00:04:17.641963+0000","last_became_active":"2024-09-12T00:03:29.348779+0000","last_became_peered":"2024-09-12T00:03:29.348779+0000","last_unstale":"2024-09-12T00:04:17.641963+0000","last_undegraded":"2024-09-12T00:04:17.641963+0000","last_fullsized":"2024-09-12T00:04:17.641963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:40.759557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'2","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950021+0000","last_change":"2024-09-12T00:03:31.354114+0000","last_active":"2024-09-12T00:04:17.950021+0000","last_peered":"2024-09-12T00:04:17.950021+0000","last_clean":"2024-09-12T00:04:17.950021+0000","last_became_active":"2024-09-12T00:03:31.353358+0000","last_became_peered":"2024-09-12T00:03:31.353358+0000","last_unstale":"2024-09-12T00:04:17.950021+0000","last_undegraded":"2024-09-12T00:04:17.950021+0000","last_fullsized":"2024-09-12T00:04:17.950021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:56.624718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":47,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643912+0000","last_change":"2024-09-12T00:03:33.383917+0000","last_active":"2024-09-12T00:04:18.643912+0000","last_peered":"2024-09-12T00:04:18.643912+0000","last_clean":"2024-09-12T00:04:18.643912+0000","last_became_active":"2024-09-12T00:03:33.383199+0000","last_became_peered":"2024-09-12T00:03:33.383199+0000","last_unstale":"2024-09-12T00:04:18.643912+0000","last_undegraded":"2024-09-12T00:04:18.643912+0000","last_fullsized":"2024-09-12T00:04:18.643912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:37.428182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951112+0000","last_change":"2024-09-12T00:03:25.356706+0000","last_active":"2024-09-12T00:04:17.951112+0000","last_peered":"2024-09-12T00:04:17.951112+0000","last_clean":"2024-09-12T00:04:17.951112+0000","last_became_active":"2024-09-12T00:03:25.354555+0000","last_became_peered":"2024-09-12T00:03:25.354555+0000","last_unstale":"2024-09-12T00:04:17.951112+0000","last_undegraded":"2024-09-12T00:04:17.951112+0000","last_fullsized":"2024-09-12T00:04:17.951112+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:55.543336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.954985+0000","last_change":"2024-09-12T00:03:23.612430+0000","last_active":"2024-09-12T00:04:17.954985+0000","last_peered":"2024-09-12T00:04:17.954985+0000","last_clean":"2024-09-12T00:04:17.954985+0000","last_became_active":"2024-09-12T00:03:23.612165+0000","last_became_peered":"2024-09-12T00:03:23.612165+0000","last_unstale":"2024-09-12T00:04:17.954985+0000","last_undegraded":"2024-09-12T00:04:17.954985+0000","last_fullsized":"2024-09-12T00:04:17.954985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:31.444343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":59,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643037+0000","last_change":"2024-09-12T00:03:27.329228+0000","last_active":"2024-09-12T00:04:18.643037+0000","last_peered":"2024-09-12T00:04:18.643037+0000","last_clean":"2024-09-12T00:04:18.643037+0000","last_became_active":"2024-09-12T00:03:27.328497+0000","last_became_peered":"2024-09-12T00:03:27.328497+0000","last_unstale":"2024-09-12T00:04:18.643037+0000","last_undegraded":"2024-09-12T00:04:18.643037+0000","last_fullsized":"2024-09-12T00:04:18.643037+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"35'24","reported_seq":100,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645493+0000","last_change":"2024-09-12T00:03:29.332778+0000","last_active":"2024-09-12T00:04:18.645493+0000","last_peered":"2024-09-12T00:04:18.645493+0000","last_clean":"2024-09-12T00:04:18.645493+0000","last_became_active":"2024-09-12T00:03:29.332010+0000","last_became_peered":"2024-09-12T00:03:29.332010+0000","last_unstale":"2024-09-12T00:04:18.645493+0000","last_undegraded":"2024-09-12T00:04:18.645493+0000","last_fullsized":"2024-09-12T00:04:18.645493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:13.563107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":48,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950535+0000","last_change":"2024-09-12T00:03:31.354374+0000","last_active":"2024-09-12T00:04:17.950535+0000","last_peered":"2024-09-12T00:04:17.950535+0000","last_clean":"2024-09-12T00:04:17.950535+0000","last_became_active":"2024-09-12T00:03:31.353407+0000","last_became_peered":"2024-09-12T00:03:31.353407+0000","last_unstale":"2024-09-12T00:04:17.950535+0000","last_undegraded":"2024-09-12T00:04:17.950535+0000","last_fullsized":"2024-09-12T00:04:17.950535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:30.520217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953590+0000","last_change":"2024-09-12T00:03:33.385373+0000","last_active":"2024-09-12T00:04:17.953590+0000","last_peered":"2024-09-12T00:04:17.953590+0000","last_clean":"2024-09-12T00:04:17.953590+0000","last_became_active":"2024-09-12T00:03:33.384559+0000","last_became_peered":"2024-09-12T00:03:33.384559+0000","last_unstale":"2024-09-12T00:04:17.953590+0000","last_undegraded":"2024-09-12T00:04:17.953590+0000","last_fullsized":"2024-09-12T00:04:17.953590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:55.924174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.954766+0000","last_change":"2024-09-12T00:03:25.326677+0000","last_active":"2024-09-12T00:04:17.954766+0000","last_peered":"2024-09-12T00:04:17.954766+0000","last_clean":"2024-09-12T00:04:17.954766+0000","last_became_active":"2024-09-12T00:03:25.325840+0000","last_became_peered":"2024-09-12T00:03:25.325840+0000","last_unstale":"2024-09-12T00:04:17.954766+0000","last_undegraded":"2024-09-12T00:04:17.954766+0000","last_fullsized":"2024-09-12T00:04:17.954766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:07.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953114+0000","last_change":"2024-09-12T00:03:23.616943+0000","last_active":"2024-09-12T00:04:17.953114+0000","last_peered":"2024-09-12T00:04:17.953114+0000","last_clean":"2024-09-12T00:04:17.953114+0000","last_became_active":"2024-09-12T00:03:23.616200+0000","last_became_peered":"2024-09-12T00:03:23.616200+0000","last_unstale":"2024-09-12T00:04:17.953114+0000","last_undegraded":"2024-09-12T00:04:17.953114+0000","last_fullsized":"2024-09-12T00:04:17.953114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":56,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953227+0000","last_change":"2024-09-12T00:03:27.330506+0000","last_active":"2024-09-12T00:04:17.953227+0000","last_peered":"2024-09-12T00:04:17.953227+0000","last_clean":"2024-09-12T00:04:17.953227+0000","last_became_active":"2024-09-12T00:03:27.329830+0000","last_became_peered":"2024-09-12T00:03:27.329830+0000","last_unstale":"2024-09-12T00:04:17.953227+0000","last_undegraded":"2024-09-12T00:04:17.953227+0000","last_fullsized":"2024-09-12T00:04:17.953227+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:03.446090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"35'17","reported_seq":84,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.952084+0000","last_change":"2024-09-12T00:03:29.343655+0000","last_active":"2024-09-12T00:04:17.952084+0000","last_peered":"2024-09-12T00:04:17.952084+0000","last_clean":"2024-09-12T00:04:17.952084+0000","last_became_active":"2024-09-12T00:03:29.343178+0000","last_became_peered":"2024-09-12T00:03:29.343178+0000","last_unstale":"2024-09-12T00:04:17.952084+0000","last_undegraded":"2024-09-12T00:04:17.952084+0000","last_fullsized":"2024-09-12T00:04:17.952084+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":48,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953519+0000","last_change":"2024-09-12T00:03:31.358077+0000","last_active":"2024-09-12T00:04:17.953519+0000","last_peered":"2024-09-12T00:04:17.953519+0000","last_clean":"2024-09-12T00:04:17.953519+0000","last_became_active":"2024-09-12T00:03:31.357272+0000","last_became_peered":"2024-09-12T00:03:31.357272+0000","last_unstale":"2024-09-12T00:04:17.953519+0000","last_undegraded":"2024-09-12T00:04:17.953519+0000","last_fullsized":"2024-09-12T00:04:17.953519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:37.991682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.949744+0000","last_change":"2024-09-12T00:03:33.386299+0000","last_active":"2024-09-12T00:04:17.949744+0000","last_peered":"2024-09-12T00:04:17.949744+0000","last_clean":"2024-09-12T00:04:17.949744+0000","last_became_active":"2024-09-12T00:03:33.385357+0000","last_became_peered":"2024-09-12T00:03:33.385357+0000","last_unstale":"2024-09-12T00:04:17.949744+0000","last_undegraded":"2024-09-12T00:04:17.949744+0000","last_fullsized":"2024-09-12T00:04:17.949744+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:17.028373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643318+0000","last_change":"2024-09-12T00:03:25.333772+0000","last_active":"2024-09-12T00:04:17.643318+0000","last_peered":"2024-09-12T00:04:17.643318+0000","last_clean":"2024-09-12T00:04:17.643318+0000","last_became_active":"2024-09-12T00:03:25.333338+0000","last_became_peered":"2024-09-12T00:03:25.333338+0000","last_unstale":"2024-09-12T00:04:17.643318+0000","last_undegraded":"2024-09-12T00:04:17.643318+0000","last_fullsized":"2024-09-12T00:04:17.643318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:13.572959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643370+0000","last_change":"2024-09-12T00:03:23.598015+0000","last_active":"2024-09-12T00:04:17.643370+0000","last_peered":"2024-09-12T00:04:17.643370+0000","last_clean":"2024-09-12T00:04:17.643370+0000","last_became_active":"2024-09-12T00:03:23.594135+0000","last_became_peered":"2024-09-12T00:03:23.594135+0000","last_unstale":"2024-09-12T00:04:17.643370+0000","last_undegraded":"2024-09-12T00:04:17.643370+0000","last_fullsized":"2024-09-12T00:04:17.643370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:31.336675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":56,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950544+0000","last_change":"2024-09-12T00:03:27.342295+0000","last_active":"2024-09-12T00:04:17.950544+0000","last_peered":"2024-09-12T00:04:17.950544+0000","last_clean":"2024-09-12T00:04:17.950544+0000","last_became_active":"2024-09-12T00:03:27.341619+0000","last_became_peered":"2024-09-12T00:03:27.341619+0000","last_unstale":"2024-09-12T00:04:17.950544+0000","last_undegraded":"2024-09-12T00:04:17.950544+0000","last_fullsized":"2024-09-12T00:04:17.950544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:00.908798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"35'15","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951417+0000","last_change":"2024-09-12T00:03:29.336391+0000","last_active":"2024-09-12T00:04:17.951417+0000","last_peered":"2024-09-12T00:04:17.951417+0000","last_clean":"2024-09-12T00:04:17.951417+0000","last_became_active":"2024-09-12T00:03:29.335679+0000","last_became_peered":"2024-09-12T00:03:29.335679+0000","last_unstale":"2024-09-12T00:04:17.951417+0000","last_undegraded":"2024-09-12T00:04:17.951417+0000","last_fullsized":"2024-09-12T00:04:17.951417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:58.540539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"32'2","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953336+0000","last_change":"2024-09-12T00:03:31.351170+0000","last_active":"2024-09-12T00:04:17.953336+0000","last_peered":"2024-09-12T00:04:17.953336+0000","last_clean":"2024-09-12T00:04:17.953336+0000","last_became_active":"2024-09-12T00:03:31.350264+0000","last_became_peered":"2024-09-12T00:03:31.350264+0000","last_unstale":"2024-09-12T00:04:17.953336+0000","last_undegraded":"2024-09-12T00:04:17.953336+0000","last_fullsized":"2024-09-12T00:04:17.953336+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:51.368815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":47,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.642715+0000","last_change":"2024-09-12T00:03:33.368236+0000","last_active":"2024-09-12T00:04:18.642715+0000","last_peered":"2024-09-12T00:04:18.642715+0000","last_clean":"2024-09-12T00:04:18.642715+0000","last_became_active":"2024-09-12T00:03:33.367424+0000","last_became_peered":"2024-09-12T00:03:33.367424+0000","last_unstale":"2024-09-12T00:04:18.642715+0000","last_undegraded":"2024-09-12T00:04:18.642715+0000","last_fullsized":"2024-09-12T00:04:18.642715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.649022+0000","last_change":"2024-09-12T00:03:25.330477+0000","last_active":"2024-09-12T00:04:18.649022+0000","last_peered":"2024-09-12T00:04:18.649022+0000","last_clean":"2024-09-12T00:04:18.649022+0000","last_became_active":"2024-09-12T00:03:25.330069+0000","last_became_peered":"2024-09-12T00:03:25.330069+0000","last_unstale":"2024-09-12T00:04:18.649022+0000","last_undegraded":"2024-09-12T00:04:18.649022+0000","last_fullsized":"2024-09-12T00:04:18.649022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642837+0000","last_change":"2024-09-12T00:03:23.604303+0000","last_active":"2024-09-12T00:04:17.642837+0000","last_peered":"2024-09-12T00:04:17.642837+0000","last_clean":"2024-09-12T00:04:17.642837+0000","last_became_active":"2024-09-12T00:03:23.603937+0000","last_became_peered":"2024-09-12T00:03:23.603937+0000","last_unstale":"2024-09-12T00:04:17.642837+0000","last_undegraded":"2024-09-12T00:04:17.642837+0000","last_fullsized":"2024-09-12T00:04:17.642837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:16.713949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.952505+0000","last_change":"2024-09-12T00:03:27.331569+0000","last_active":"2024-09-12T00:04:17.952505+0000","last_peered":"2024-09-12T00:04:17.952505+0000","last_clean":"2024-09-12T00:04:17.952505+0000","last_became_active":"2024-09-12T00:03:27.330909+0000","last_became_peered":"2024-09-12T00:03:27.330909+0000","last_unstale":"2024-09-12T00:04:17.952505+0000","last_undegraded":"2024-09-12T00:04:17.952505+0000","last_fullsized":"2024-09-12T00:04:17.952505+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643566+0000","last_change":"2024-09-12T00:03:29.338880+0000","last_active":"2024-09-12T00:04:18.643566+0000","last_peered":"2024-09-12T00:04:18.643566+0000","last_clean":"2024-09-12T00:04:18.643566+0000","last_became_active":"2024-09-12T00:03:29.338110+0000","last_became_peered":"2024-09-12T00:03:29.338110+0000","last_unstale":"2024-09-12T00:04:18.643566+0000","last_undegraded":"2024-09-12T00:04:18.643566+0000","last_fullsized":"2024-09-12T00:04:18.643566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.054460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"32'2","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951870+0000","last_change":"2024-09-12T00:03:31.339117+0000","last_active":"2024-09-12T00:04:17.951870+0000","last_peered":"2024-09-12T00:04:17.951870+0000","last_clean":"2024-09-12T00:04:17.951870+0000","last_became_active":"2024-09-12T00:03:31.338426+0000","last_became_peered":"2024-09-12T00:03:31.338426+0000","last_unstale":"2024-09-12T00:04:17.951870+0000","last_undegraded":"2024-09-12T00:04:17.951870+0000","last_fullsized":"2024-09-12T00:04:17.951870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:19.304169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":45,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646890+0000","last_change":"2024-09-12T00:03:33.385051+0000","last_active":"2024-09-12T00:04:18.646890+0000","last_peered":"2024-09-12T00:04:18.646890+0000","last_clean":"2024-09-12T00:04:18.646890+0000","last_became_active":"2024-09-12T00:03:33.380088+0000","last_became_peered":"2024-09-12T00:03:33.380088+0000","last_unstale":"2024-09-12T00:04:18.646890+0000","last_undegraded":"2024-09-12T00:04:18.646890+0000","last_fullsized":"2024-09-12T00:04:18.646890+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:02.972871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953799+0000","last_change":"2024-09-12T00:03:25.336113+0000","last_active":"2024-09-12T00:04:17.953799+0000","last_peered":"2024-09-12T00:04:17.953799+0000","last_clean":"2024-09-12T00:04:17.953799+0000","last_became_active":"2024-09-12T00:03:25.335449+0000","last_became_peered":"2024-09-12T00:03:25.335449+0000","last_unstale":"2024-09-12T00:04:17.953799+0000","last_undegraded":"2024-09-12T00:04:17.953799+0000","last_fullsized":"2024-09-12T00:04:17.953799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:34.277614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646130+0000","last_change":"2024-09-12T00:03:23.619285+0000","last_active":"2024-09-12T00:04:18.646130+0000","last_peered":"2024-09-12T00:04:18.646130+0000","last_clean":"2024-09-12T00:04:18.646130+0000","last_became_active":"2024-09-12T00:03:23.614187+0000","last_became_peered":"2024-09-12T00:03:23.614187+0000","last_unstale":"2024-09-12T00:04:18.646130+0000","last_undegraded":"2024-09-12T00:04:18.646130+0000","last_fullsized":"2024-09-12T00:04:18.646130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643141+0000","last_change":"2024-09-12T00:03:27.342832+0000","last_active":"2024-09-12T00:04:17.643141+0000","last_peered":"2024-09-12T00:04:17.643141+0000","last_clean":"2024-09-12T00:04:17.643141+0000","last_became_active":"2024-09-12T00:03:27.338764+0000","last_became_peered":"2024-09-12T00:03:27.338764+0000","last_unstale":"2024-09-12T00:04:17.643141+0000","last_undegraded":"2024-09-12T00:04:17.643141+0000","last_fullsized":"2024-09-12T00:04:17.643141+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:24.471349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'17","reported_seq":81,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951771+0000","last_change":"2024-09-12T00:03:29.345719+0000","last_active":"2024-09-12T00:04:17.951771+0000","last_peered":"2024-09-12T00:04:17.951771+0000","last_clean":"2024-09-12T00:04:17.951771+0000","last_became_active":"2024-09-12T00:03:29.345243+0000","last_became_peered":"2024-09-12T00:03:29.345243+0000","last_unstale":"2024-09-12T00:04:17.951771+0000","last_undegraded":"2024-09-12T00:04:17.951771+0000","last_fullsized":"2024-09-12T00:04:17.951771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:41.153263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":49,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.648571+0000","last_change":"2024-09-12T00:03:31.360630+0000","last_active":"2024-09-12T00:04:18.648571+0000","last_peered":"2024-09-12T00:04:18.648571+0000","last_clean":"2024-09-12T00:04:18.648571+0000","last_became_active":"2024-09-12T00:03:31.359763+0000","last_became_peered":"2024-09-12T00:03:31.359763+0000","last_unstale":"2024-09-12T00:04:18.648571+0000","last_undegraded":"2024-09-12T00:04:18.648571+0000","last_fullsized":"2024-09-12T00:04:18.648571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.952868+0000","last_change":"2024-09-12T00:03:33.372178+0000","last_active":"2024-09-12T00:04:17.952868+0000","last_peered":"2024-09-12T00:04:17.952868+0000","last_clean":"2024-09-12T00:04:17.952868+0000","last_became_active":"2024-09-12T00:03:33.370562+0000","last_became_peered":"2024-09-12T00:03:33.370562+0000","last_unstale":"2024-09-12T00:04:17.952868+0000","last_undegraded":"2024-09-12T00:04:17.952868+0000","last_fullsized":"2024-09-12T00:04:17.952868+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:31.888153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642597+0000","last_change":"2024-09-12T00:03:25.329229+0000","last_active":"2024-09-12T00:04:17.642597+0000","last_peered":"2024-09-12T00:04:17.642597+0000","last_clean":"2024-09-12T00:04:17.642597+0000","last_became_active":"2024-09-12T00:03:25.328934+0000","last_became_peered":"2024-09-12T00:03:25.328934+0000","last_unstale":"2024-09-12T00:04:17.642597+0000","last_undegraded":"2024-09-12T00:04:17.642597+0000","last_fullsized":"2024-09-12T00:04:17.642597+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:48.820585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":169,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950881+0000","last_change":"2024-09-12T00:03:11.770141+0000","last_active":"2024-09-12T00:04:17.950881+0000","last_peered":"2024-09-12T00:04:17.950881+0000","last_clean":"2024-09-12T00:04:17.950881+0000","last_became_active":"2024-09-12T00:03:11.767988+0000","last_became_peered":"2024-09-12T00:03:11.767988+0000","last_unstale":"2024-09-12T00:04:17.950881+0000","last_undegraded":"2024-09-12T00:04:17.950881+0000","last_fullsized":"2024-09-12T00:04:17.950881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_clean_scrub_stamp":"2024-09-12T00:03:10.462069+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:26.289955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":79,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642030+0000","last_change":"2024-09-12T00:03:18.567644+0000","last_active":"2024-09-12T00:04:17.642030+0000","last_peered":"2024-09-12T00:04:17.642030+0000","last_clean":"2024-09-12T00:04:17.642030+0000","last_became_active":"2024-09-12T00:03:16.592765+0000","last_became_peered":"2024-09-12T00:03:16.592765+0000","last_unstale":"2024-09-12T00:04:17.642030+0000","last_undegraded":"2024-09-12T00:04:17.642030+0000","last_fullsized":"2024-09-12T00:04:17.642030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:06.283894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001924708,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646128+0000","last_change":"2024-09-12T00:03:23.621849+0000","last_active":"2024-09-12T00:04:18.646128+0000","last_peered":"2024-09-12T00:04:18.646128+0000","last_clean":"2024-09-12T00:04:18.646128+0000","last_became_active":"2024-09-12T00:03:23.621146+0000","last_became_peered":"2024-09-12T00:03:23.621146+0000","last_unstale":"2024-09-12T00:04:18.646128+0000","last_undegraded":"2024-09-12T00:04:18.646128+0000","last_fullsized":"2024-09-12T00:04:18.646128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:38.426691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.954464+0000","last_change":"2024-09-12T00:03:27.316175+0000","last_active":"2024-09-12T00:04:17.954464+0000","last_peered":"2024-09-12T00:04:17.954464+0000","last_clean":"2024-09-12T00:04:17.954464+0000","last_became_active":"2024-09-12T00:03:27.315502+0000","last_became_peered":"2024-09-12T00:03:27.315502+0000","last_unstale":"2024-09-12T00:04:17.954464+0000","last_undegraded":"2024-09-12T00:04:17.954464+0000","last_fullsized":"2024-09-12T00:04:17.954464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:21.448686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"35'19","reported_seq":92,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642629+0000","last_change":"2024-09-12T00:03:29.348743+0000","last_active":"2024-09-12T00:04:17.642629+0000","last_peered":"2024-09-12T00:04:17.642629+0000","last_clean":"2024-09-12T00:04:17.642629+0000","last_became_active":"2024-09-12T00:03:29.348073+0000","last_became_peered":"2024-09-12T00:03:29.348073+0000","last_unstale":"2024-09-12T00:04:17.642629+0000","last_undegraded":"2024-09-12T00:04:17.642629+0000","last_fullsized":"2024-09-12T00:04:17.642629+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:27.315678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":48,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951126+0000","last_change":"2024-09-12T00:03:31.361408+0000","last_active":"2024-09-12T00:04:17.951126+0000","last_peered":"2024-09-12T00:04:17.951126+0000","last_clean":"2024-09-12T00:04:17.951126+0000","last_became_active":"2024-09-12T00:03:31.360462+0000","last_became_peered":"2024-09-12T00:03:31.360462+0000","last_unstale":"2024-09-12T00:04:17.951126+0000","last_undegraded":"2024-09-12T00:04:17.951126+0000","last_fullsized":"2024-09-12T00:04:17.951126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:58.407571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950507+0000","last_change":"2024-09-12T00:03:33.388253+0000","last_active":"2024-09-12T00:04:17.950507+0000","last_peered":"2024-09-12T00:04:17.950507+0000","last_clean":"2024-09-12T00:04:17.950507+0000","last_became_active":"2024-09-12T00:03:33.387457+0000","last_became_peered":"2024-09-12T00:03:33.387457+0000","last_unstale":"2024-09-12T00:04:17.950507+0000","last_undegraded":"2024-09-12T00:04:17.950507+0000","last_fullsized":"2024-09-12T00:04:17.950507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:46.021740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951328+0000","last_change":"2024-09-12T00:03:25.357970+0000","last_active":"2024-09-12T00:04:17.951328+0000","last_peered":"2024-09-12T00:04:17.951328+0000","last_clean":"2024-09-12T00:04:17.951328+0000","last_became_active":"2024-09-12T00:03:25.355306+0000","last_became_peered":"2024-09-12T00:03:25.355306+0000","last_unstale":"2024-09-12T00:04:17.951328+0000","last_undegraded":"2024-09-12T00:04:17.951328+0000","last_fullsized":"2024-09-12T00:04:17.951328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:17.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":78,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.644780+0000","last_change":"2024-09-12T00:03:18.567433+0000","last_active":"2024-09-12T00:04:17.644780+0000","last_peered":"2024-09-12T00:04:17.644780+0000","last_clean":"2024-09-12T00:04:17.644780+0000","last_became_active":"2024-09-12T00:03:16.557489+0000","last_became_peered":"2024-09-12T00:03:16.557489+0000","last_unstale":"2024-09-12T00:04:17.644780+0000","last_undegraded":"2024-09-12T00:04:17.644780+0000","last_fullsized":"2024-09-12T00:04:17.644780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:26.187640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001769713,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":67,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643074+0000","last_change":"2024-09-12T00:03:23.622111+0000","last_active":"2024-09-12T00:04:18.643074+0000","last_peered":"2024-09-12T00:04:18.643074+0000","last_clean":"2024-09-12T00:04:18.643074+0000","last_became_active":"2024-09-12T00:03:23.621358+0000","last_became_peered":"2024-09-12T00:03:23.621358+0000","last_unstale":"2024-09-12T00:04:18.643074+0000","last_undegraded":"2024-09-12T00:04:18.643074+0000","last_fullsized":"2024-09-12T00:04:18.643074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:02.202230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642303+0000","last_change":"2024-09-12T00:03:27.338241+0000","last_active":"2024-09-12T00:04:17.642303+0000","last_peered":"2024-09-12T00:04:17.642303+0000","last_clean":"2024-09-12T00:04:17.642303+0000","last_became_active":"2024-09-12T00:03:27.337391+0000","last_became_peered":"2024-09-12T00:03:27.337391+0000","last_unstale":"2024-09-12T00:04:17.642303+0000","last_undegraded":"2024-09-12T00:04:17.642303+0000","last_fullsized":"2024-09-12T00:04:17.642303+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:00.949475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'29","reported_seq":115,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953144+0000","last_change":"2024-09-12T00:03:29.346819+0000","last_active":"2024-09-12T00:04:17.953144+0000","last_peered":"2024-09-12T00:04:17.953144+0000","last_clean":"2024-09-12T00:04:17.953144+0000","last_became_active":"2024-09-12T00:03:29.346101+0000","last_became_peered":"2024-09-12T00:03:29.346101+0000","last_unstale":"2024-09-12T00:04:17.953144+0000","last_undegraded":"2024-09-12T00:04:17.953144+0000","last_fullsized":"2024-09-12T00:04:17.953144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:27.268327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":49,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643235+0000","last_change":"2024-09-12T00:03:31.361817+0000","last_active":"2024-09-12T00:04:17.643235+0000","last_peered":"2024-09-12T00:04:17.643235+0000","last_clean":"2024-09-12T00:04:17.643235+0000","last_became_active":"2024-09-12T00:03:31.361309+0000","last_became_peered":"2024-09-12T00:03:31.361309+0000","last_unstale":"2024-09-12T00:04:17.643235+0000","last_undegraded":"2024-09-12T00:04:17.643235+0000","last_fullsized":"2024-09-12T00:04:17.643235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:19.554189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950157+0000","last_change":"2024-09-12T00:03:33.386144+0000","last_active":"2024-09-12T00:04:17.950157+0000","last_peered":"2024-09-12T00:04:17.950157+0000","last_clean":"2024-09-12T00:04:17.950157+0000","last_became_active":"2024-09-12T00:03:33.384951+0000","last_became_peered":"2024-09-12T00:03:33.384951+0000","last_unstale":"2024-09-12T00:04:17.950157+0000","last_undegraded":"2024-09-12T00:04:17.950157+0000","last_fullsized":"2024-09-12T00:04:17.950157+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:49.807501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.644330+0000","last_change":"2024-09-12T00:03:25.332801+0000","last_active":"2024-09-12T00:04:18.644330+0000","last_peered":"2024-09-12T00:04:18.644330+0000","last_clean":"2024-09-12T00:04:18.644330+0000","last_became_active":"2024-09-12T00:03:25.331652+0000","last_became_peered":"2024-09-12T00:03:25.331652+0000","last_unstale":"2024-09-12T00:04:18.644330+0000","last_undegraded":"2024-09-12T00:04:18.644330+0000","last_fullsized":"2024-09-12T00:04:18.644330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950015+0000","last_change":"2024-09-12T00:03:18.892423+0000","last_active":"2024-09-12T00:04:17.950015+0000","last_peered":"2024-09-12T00:04:17.950015+0000","last_clean":"2024-09-12T00:04:17.950015+0000","last_became_active":"2024-09-12T00:03:16.559698+0000","last_became_peered":"2024-09-12T00:03:16.559698+0000","last_unstale":"2024-09-12T00:04:17.950015+0000","last_undegraded":"2024-09-12T00:04:17.950015+0000","last_fullsized":"2024-09-12T00:04:17.950015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:21.453461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082440599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950441+0000","last_change":"2024-09-12T00:03:23.633606+0000","last_active":"2024-09-12T00:04:17.950441+0000","last_peered":"2024-09-12T00:04:17.950441+0000","last_clean":"2024-09-12T00:04:17.950441+0000","last_became_active":"2024-09-12T00:03:23.632795+0000","last_became_peered":"2024-09-12T00:03:23.632795+0000","last_unstale":"2024-09-12T00:04:17.950441+0000","last_undegraded":"2024-09-12T00:04:17.950441+0000","last_fullsized":"2024-09-12T00:04:17.950441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:08.214455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953446+0000","last_change":"2024-09-12T00:03:27.326932+0000","last_active":"2024-09-12T00:04:17.953446+0000","last_peered":"2024-09-12T00:04:17.953446+0000","last_clean":"2024-09-12T00:04:17.953446+0000","last_became_active":"2024-09-12T00:03:27.326173+0000","last_became_peered":"2024-09-12T00:03:27.326173+0000","last_unstale":"2024-09-12T00:04:17.953446+0000","last_undegraded":"2024-09-12T00:04:17.953446+0000","last_fullsized":"2024-09-12T00:04:17.953446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:12.286539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":84,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953823+0000","last_change":"2024-09-12T00:03:29.338829+0000","last_active":"2024-09-12T00:04:17.953823+0000","last_peered":"2024-09-12T00:04:17.953823+0000","last_clean":"2024-09-12T00:04:17.953823+0000","last_became_active":"2024-09-12T00:03:29.337364+0000","last_became_peered":"2024-09-12T00:03:29.337364+0000","last_unstale":"2024-09-12T00:04:17.953823+0000","last_undegraded":"2024-09-12T00:04:17.953823+0000","last_fullsized":"2024-09-12T00:04:17.953823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:01.584359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":49,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646919+0000","last_change":"2024-09-12T00:03:31.346734+0000","last_active":"2024-09-12T00:04:18.646919+0000","last_peered":"2024-09-12T00:04:18.646919+0000","last_clean":"2024-09-12T00:04:18.646919+0000","last_became_active":"2024-09-12T00:03:31.346035+0000","last_became_peered":"2024-09-12T00:03:31.346035+0000","last_unstale":"2024-09-12T00:04:18.646919+0000","last_undegraded":"2024-09-12T00:04:18.646919+0000","last_fullsized":"2024-09-12T00:04:18.646919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:10.417936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":45,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645669+0000","last_change":"2024-09-12T00:03:33.354171+0000","last_active":"2024-09-12T00:04:18.645669+0000","last_peered":"2024-09-12T00:04:18.645669+0000","last_clean":"2024-09-12T00:04:18.645669+0000","last_became_active":"2024-09-12T00:03:33.353460+0000","last_became_peered":"2024-09-12T00:03:33.353460+0000","last_unstale":"2024-09-12T00:04:18.645669+0000","last_undegraded":"2024-09-12T00:04:18.645669+0000","last_fullsized":"2024-09-12T00:04:18.645669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:34.356970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643866+0000","last_change":"2024-09-12T00:03:25.336320+0000","last_active":"2024-09-12T00:04:18.643866+0000","last_peered":"2024-09-12T00:04:18.643866+0000","last_clean":"2024-09-12T00:04:18.643866+0000","last_became_active":"2024-09-12T00:03:25.333449+0000","last_became_peered":"2024-09-12T00:03:25.333449+0000","last_unstale":"2024-09-12T00:04:18.643866+0000","last_undegraded":"2024-09-12T00:04:18.643866+0000","last_fullsized":"2024-09-12T00:04:18.643866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":80,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643544+0000","last_change":"2024-09-12T00:03:18.568246+0000","last_active":"2024-09-12T00:04:17.643544+0000","last_peered":"2024-09-12T00:04:17.643544+0000","last_clean":"2024-09-12T00:04:17.643544+0000","last_became_active":"2024-09-12T00:03:16.554663+0000","last_became_peered":"2024-09-12T00:03:16.554663+0000","last_unstale":"2024-09-12T00:04:17.643544+0000","last_undegraded":"2024-09-12T00:04:17.643544+0000","last_fullsized":"2024-09-12T00:04:17.643544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:52.802404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025471840000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951285+0000","last_change":"2024-09-12T00:03:23.611064+0000","last_active":"2024-09-12T00:04:17.951285+0000","last_peered":"2024-09-12T00:04:17.951285+0000","last_clean":"2024-09-12T00:04:17.951285+0000","last_became_active":"2024-09-12T00:03:23.610612+0000","last_became_peered":"2024-09-12T00:03:23.610612+0000","last_unstale":"2024-09-12T00:04:17.951285+0000","last_undegraded":"2024-09-12T00:04:17.951285+0000","last_fullsized":"2024-09-12T00:04:17.951285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:04.201688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":56,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953306+0000","last_change":"2024-09-12T00:03:27.339197+0000","last_active":"2024-09-12T00:04:17.953306+0000","last_peered":"2024-09-12T00:04:17.953306+0000","last_clean":"2024-09-12T00:04:17.953306+0000","last_became_active":"2024-09-12T00:03:27.338508+0000","last_became_peered":"2024-09-12T00:03:27.338508+0000","last_unstale":"2024-09-12T00:04:17.953306+0000","last_undegraded":"2024-09-12T00:04:17.953306+0000","last_fullsized":"2024-09-12T00:04:17.953306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:08.306289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":70,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951129+0000","last_change":"2024-09-12T00:03:29.358418+0000","last_active":"2024-09-12T00:04:17.951129+0000","last_peered":"2024-09-12T00:04:17.951129+0000","last_clean":"2024-09-12T00:04:17.951129+0000","last_became_active":"2024-09-12T00:03:29.357949+0000","last_became_peered":"2024-09-12T00:03:29.357949+0000","last_unstale":"2024-09-12T00:04:17.951129+0000","last_undegraded":"2024-09-12T00:04:17.951129+0000","last_fullsized":"2024-09-12T00:04:17.951129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:53.457363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":49,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643414+0000","last_change":"2024-09-12T00:03:31.352559+0000","last_active":"2024-09-12T00:04:17.643414+0000","last_peered":"2024-09-12T00:04:17.643414+0000","last_clean":"2024-09-12T00:04:17.643414+0000","last_became_active":"2024-09-12T00:03:31.351663+0000","last_became_peered":"2024-09-12T00:03:31.351663+0000","last_unstale":"2024-09-12T00:04:17.643414+0000","last_undegraded":"2024-09-12T00:04:17.643414+0000","last_fullsized":"2024-09-12T00:04:17.643414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:03.662016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950111+0000","last_change":"2024-09-12T00:03:33.367035+0000","last_active":"2024-09-12T00:04:17.950111+0000","last_peered":"2024-09-12T00:04:17.950111+0000","last_clean":"2024-09-12T00:04:17.950111+0000","last_became_active":"2024-09-12T00:03:33.366311+0000","last_became_peered":"2024-09-12T00:03:33.366311+0000","last_unstale":"2024-09-12T00:04:17.950111+0000","last_undegraded":"2024-09-12T00:04:17.950111+0000","last_fullsized":"2024-09-12T00:04:17.950111+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643132+0000","last_change":"2024-09-12T00:03:25.322258+0000","last_active":"2024-09-12T00:04:18.643132+0000","last_peered":"2024-09-12T00:04:18.643132+0000","last_clean":"2024-09-12T00:04:18.643132+0000","last_became_active":"2024-09-12T00:03:25.320903+0000","last_became_peered":"2024-09-12T00:03:25.320903+0000","last_unstale":"2024-09-12T00:04:18.643132+0000","last_undegraded":"2024-09-12T00:04:18.643132+0000","last_fullsized":"2024-09-12T00:04:18.643132+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:05.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.649248+0000","last_change":"2024-09-12T00:03:23.619024+0000","last_active":"2024-09-12T00:04:18.649248+0000","last_peered":"2024-09-12T00:04:18.649248+0000","last_clean":"2024-09-12T00:04:18.649248+0000","last_became_active":"2024-09-12T00:03:23.618716+0000","last_became_peered":"2024-09-12T00:03:23.618716+0000","last_unstale":"2024-09-12T00:04:18.649248+0000","last_undegraded":"2024-09-12T00:04:18.649248+0000","last_fullsized":"2024-09-12T00:04:18.649248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950826+0000","last_change":"2024-09-12T00:03:18.562010+0000","last_active":"2024-09-12T00:04:17.950826+0000","last_peered":"2024-09-12T00:04:17.950826+0000","last_clean":"2024-09-12T00:04:17.950826+0000","last_became_active":"2024-09-12T00:03:16.561218+0000","last_became_peered":"2024-09-12T00:03:16.561218+0000","last_unstale":"2024-09-12T00:04:17.950826+0000","last_undegraded":"2024-09-12T00:04:17.950826+0000","last_fullsized":"2024-09-12T00:04:17.950826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:43.089686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084170299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":57,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645939+0000","last_change":"2024-09-12T00:03:27.341079+0000","last_active":"2024-09-12T00:04:18.645939+0000","last_peered":"2024-09-12T00:04:18.645939+0000","last_clean":"2024-09-12T00:04:18.645939+0000","last_became_active":"2024-09-12T00:03:27.340391+0000","last_became_peered":"2024-09-12T00:03:27.340391+0000","last_unstale":"2024-09-12T00:04:18.645939+0000","last_undegraded":"2024-09-12T00:04:18.645939+0000","last_fullsized":"2024-09-12T00:04:18.645939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:10.048469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"35'30","reported_seq":108,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.949702+0000","last_change":"2024-09-12T00:03:29.346823+0000","last_active":"2024-09-12T00:04:17.949702+0000","last_peered":"2024-09-12T00:04:17.949702+0000","last_clean":"2024-09-12T00:04:17.949702+0000","last_became_active":"2024-09-12T00:03:29.346066+0000","last_became_peered":"2024-09-12T00:03:29.346066+0000","last_unstale":"2024-09-12T00:04:17.949702+0000","last_undegraded":"2024-09-12T00:04:17.949702+0000","last_fullsized":"2024-09-12T00:04:17.949702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:12.080794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":49,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646549+0000","last_change":"2024-09-12T00:03:31.348574+0000","last_active":"2024-09-12T00:04:18.646549+0000","last_peered":"2024-09-12T00:04:18.646549+0000","last_clean":"2024-09-12T00:04:18.646549+0000","last_became_active":"2024-09-12T00:03:31.346511+0000","last_became_peered":"2024-09-12T00:03:31.346511+0000","last_unstale":"2024-09-12T00:04:18.646549+0000","last_undegraded":"2024-09-12T00:04:18.646549+0000","last_fullsized":"2024-09-12T00:04:18.646549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:14.061486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951060+0000","last_change":"2024-09-12T00:03:33.385232+0000","last_active":"2024-09-12T00:04:17.951060+0000","last_peered":"2024-09-12T00:04:17.951060+0000","last_clean":"2024-09-12T00:04:17.951060+0000","last_became_active":"2024-09-12T00:03:33.384457+0000","last_became_peered":"2024-09-12T00:03:33.384457+0000","last_unstale":"2024-09-12T00:04:17.951060+0000","last_undegraded":"2024-09-12T00:04:17.951060+0000","last_fullsized":"2024-09-12T00:04:17.951060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:34.615256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.644139+0000","last_change":"2024-09-12T00:03:25.334767+0000","last_active":"2024-09-12T00:04:18.644139+0000","last_peered":"2024-09-12T00:04:18.644139+0000","last_clean":"2024-09-12T00:04:18.644139+0000","last_became_active":"2024-09-12T00:03:25.332814+0000","last_became_peered":"2024-09-12T00:03:25.332814+0000","last_unstale":"2024-09-12T00:04:18.644139+0000","last_undegraded":"2024-09-12T00:04:18.644139+0000","last_fullsized":"2024-09-12T00:04:18.644139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":67,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.644001+0000","last_change":"2024-09-12T00:03:23.628752+0000","last_active":"2024-09-12T00:04:18.644001+0000","last_peered":"2024-09-12T00:04:18.644001+0000","last_clean":"2024-09-12T00:04:18.644001+0000","last_became_active":"2024-09-12T00:03:23.628128+0000","last_became_peered":"2024-09-12T00:03:23.628128+0000","last_unstale":"2024-09-12T00:04:18.644001+0000","last_undegraded":"2024-09-12T00:04:18.644001+0000","last_fullsized":"2024-09-12T00:04:18.644001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642215+0000","last_change":"2024-09-12T00:03:18.566691+0000","last_active":"2024-09-12T00:04:17.642215+0000","last_peered":"2024-09-12T00:04:17.642215+0000","last_clean":"2024-09-12T00:04:17.642215+0000","last_became_active":"2024-09-12T00:03:16.553662+0000","last_became_peered":"2024-09-12T00:03:16.553662+0000","last_unstale":"2024-09-12T00:04:17.642215+0000","last_undegraded":"2024-09-12T00:04:17.642215+0000","last_fullsized":"2024-09-12T00:04:17.642215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:14.502459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011030910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950929+0000","last_change":"2024-09-12T00:03:27.316317+0000","last_active":"2024-09-12T00:04:17.950929+0000","last_peered":"2024-09-12T00:04:17.950929+0000","last_clean":"2024-09-12T00:04:17.950929+0000","last_became_active":"2024-09-12T00:03:27.315704+0000","last_became_peered":"2024-09-12T00:03:27.315704+0000","last_unstale":"2024-09-12T00:04:17.950929+0000","last_undegraded":"2024-09-12T00:04:17.950929+0000","last_fullsized":"2024-09-12T00:04:17.950929+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:07.883485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'20","reported_seq":88,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.642904+0000","last_change":"2024-09-12T00:03:29.357640+0000","last_active":"2024-09-12T00:04:18.642904+0000","last_peered":"2024-09-12T00:04:18.642904+0000","last_clean":"2024-09-12T00:04:18.642904+0000","last_became_active":"2024-09-12T00:03:29.356183+0000","last_became_peered":"2024-09-12T00:03:29.356183+0000","last_unstale":"2024-09-12T00:04:18.642904+0000","last_undegraded":"2024-09-12T00:04:18.642904+0000","last_fullsized":"2024-09-12T00:04:18.642904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:41.818794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"32'2","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950267+0000","last_change":"2024-09-12T00:03:31.357011+0000","last_active":"2024-09-12T00:04:17.950267+0000","last_peered":"2024-09-12T00:04:17.950267+0000","last_clean":"2024-09-12T00:04:17.950267+0000","last_became_active":"2024-09-12T00:03:31.356108+0000","last_became_peered":"2024-09-12T00:03:31.356108+0000","last_unstale":"2024-09-12T00:04:17.950267+0000","last_undegraded":"2024-09-12T00:04:17.950267+0000","last_fullsized":"2024-09-12T00:04:17.950267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953467+0000","last_change":"2024-09-12T00:03:33.372465+0000","last_active":"2024-09-12T00:04:17.953467+0000","last_peered":"2024-09-12T00:04:17.953467+0000","last_clean":"2024-09-12T00:04:17.953467+0000","last_became_active":"2024-09-12T00:03:33.371214+0000","last_became_peered":"2024-09-12T00:03:33.371214+0000","last_unstale":"2024-09-12T00:04:17.953467+0000","last_undegraded":"2024-09-12T00:04:17.953467+0000","last_fullsized":"2024-09-12T00:04:17.953467+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:40.880933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645990+0000","last_change":"2024-09-12T00:03:25.332405+0000","last_active":"2024-09-12T00:04:18.645990+0000","last_peered":"2024-09-12T00:04:18.645990+0000","last_clean":"2024-09-12T00:04:18.645990+0000","last_became_active":"2024-09-12T00:03:25.331250+0000","last_became_peered":"2024-09-12T00:03:25.331250+0000","last_unstale":"2024-09-12T00:04:18.645990+0000","last_undegraded":"2024-09-12T00:04:18.645990+0000","last_fullsized":"2024-09-12T00:04:18.645990+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647558+0000","last_change":"2024-09-12T00:03:23.602222+0000","last_active":"2024-09-12T00:04:18.647558+0000","last_peered":"2024-09-12T00:04:18.647558+0000","last_clean":"2024-09-12T00:04:18.647558+0000","last_became_active":"2024-09-12T00:03:23.601481+0000","last_became_peered":"2024-09-12T00:03:23.601481+0000","last_unstale":"2024-09-12T00:04:18.647558+0000","last_undegraded":"2024-09-12T00:04:18.647558+0000","last_fullsized":"2024-09-12T00:04:18.647558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:56.636638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":78,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647426+0000","last_change":"2024-09-12T00:03:18.716648+0000","last_active":"2024-09-12T00:04:18.647426+0000","last_peered":"2024-09-12T00:04:18.647426+0000","last_clean":"2024-09-12T00:04:18.647426+0000","last_became_active":"2024-09-12T00:03:16.594609+0000","last_became_peered":"2024-09-12T00:03:16.594609+0000","last_unstale":"2024-09-12T00:04:18.647426+0000","last_undegraded":"2024-09-12T00:04:18.647426+0000","last_fullsized":"2024-09-12T00:04:18.647426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:34.635008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010254439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642531+0000","last_change":"2024-09-12T00:03:27.337871+0000","last_active":"2024-09-12T00:04:17.642531+0000","last_peered":"2024-09-12T00:04:17.642531+0000","last_clean":"2024-09-12T00:04:17.642531+0000","last_became_active":"2024-09-12T00:03:27.337299+0000","last_became_peered":"2024-09-12T00:03:27.337299+0000","last_unstale":"2024-09-12T00:04:17.642531+0000","last_undegraded":"2024-09-12T00:04:17.642531+0000","last_fullsized":"2024-09-12T00:04:17.642531+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:37.289387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'17","reported_seq":81,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642151+0000","last_change":"2024-09-12T00:03:29.354380+0000","last_active":"2024-09-12T00:04:17.642151+0000","last_peered":"2024-09-12T00:04:17.642151+0000","last_clean":"2024-09-12T00:04:17.642151+0000","last_became_active":"2024-09-12T00:03:29.353644+0000","last_became_peered":"2024-09-12T00:03:29.353644+0000","last_unstale":"2024-09-12T00:04:17.642151+0000","last_undegraded":"2024-09-12T00:04:17.642151+0000","last_fullsized":"2024-09-12T00:04:17.642151+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:15.452219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'2","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951233+0000","last_change":"2024-09-12T00:03:31.361616+0000","last_active":"2024-09-12T00:04:17.951233+0000","last_peered":"2024-09-12T00:04:17.951233+0000","last_clean":"2024-09-12T00:04:17.951233+0000","last_became_active":"2024-09-12T00:03:31.360518+0000","last_became_peered":"2024-09-12T00:03:31.360518+0000","last_unstale":"2024-09-12T00:04:17.951233+0000","last_undegraded":"2024-09-12T00:04:17.951233+0000","last_fullsized":"2024-09-12T00:04:17.951233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:40.640537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950468+0000","last_change":"2024-09-12T00:03:33.378417+0000","last_active":"2024-09-12T00:04:17.950468+0000","last_peered":"2024-09-12T00:04:17.950468+0000","last_clean":"2024-09-12T00:04:17.950468+0000","last_became_active":"2024-09-12T00:03:33.377669+0000","last_became_peered":"2024-09-12T00:03:33.377669+0000","last_unstale":"2024-09-12T00:04:17.950468+0000","last_undegraded":"2024-09-12T00:04:17.950468+0000","last_fullsized":"2024-09-12T00:04:17.950468+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:04.623906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646751+0000","last_change":"2024-09-12T00:03:25.318286+0000","last_active":"2024-09-12T00:04:18.646751+0000","last_peered":"2024-09-12T00:04:18.646751+0000","last_clean":"2024-09-12T00:04:18.646751+0000","last_became_active":"2024-09-12T00:03:25.317820+0000","last_became_peered":"2024-09-12T00:03:25.317820+0000","last_unstale":"2024-09-12T00:04:18.646751+0000","last_undegraded":"2024-09-12T00:04:18.646751+0000","last_fullsized":"2024-09-12T00:04:18.646751+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:05.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647310+0000","last_change":"2024-09-12T00:03:23.616319+0000","last_active":"2024-09-12T00:04:18.647310+0000","last_peered":"2024-09-12T00:04:18.647310+0000","last_clean":"2024-09-12T00:04:18.647310+0000","last_became_active":"2024-09-12T00:03:23.615158+0000","last_became_peered":"2024-09-12T00:03:23.615158+0000","last_unstale":"2024-09-12T00:04:18.647310+0000","last_undegraded":"2024-09-12T00:04:18.647310+0000","last_fullsized":"2024-09-12T00:04:18.647310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:15.677228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643628+0000","last_change":"2024-09-12T00:03:18.566832+0000","last_active":"2024-09-12T00:04:17.643628+0000","last_peered":"2024-09-12T00:04:17.643628+0000","last_clean":"2024-09-12T00:04:17.643628+0000","last_became_active":"2024-09-12T00:03:16.592377+0000","last_became_peered":"2024-09-12T00:03:16.592377+0000","last_unstale":"2024-09-12T00:04:17.643628+0000","last_undegraded":"2024-09-12T00:04:17.643628+0000","last_fullsized":"2024-09-12T00:04:17.643628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:31.379733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001199625,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":57,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645644+0000","last_change":"2024-09-12T00:03:27.337359+0000","last_active":"2024-09-12T00:04:18.645644+0000","last_peered":"2024-09-12T00:04:18.645644+0000","last_clean":"2024-09-12T00:04:18.645644+0000","last_became_active":"2024-09-12T00:03:27.336289+0000","last_became_peered":"2024-09-12T00:03:27.336289+0000","last_unstale":"2024-09-12T00:04:18.645644+0000","last_undegraded":"2024-09-12T00:04:18.645644+0000","last_fullsized":"2024-09-12T00:04:18.645644+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:39.147272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"35'25","reported_seq":101,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951012+0000","last_change":"2024-09-12T00:03:29.344621+0000","last_active":"2024-09-12T00:04:17.951012+0000","last_peered":"2024-09-12T00:04:17.951012+0000","last_clean":"2024-09-12T00:04:17.951012+0000","last_became_active":"2024-09-12T00:03:29.343779+0000","last_became_peered":"2024-09-12T00:03:29.343779+0000","last_unstale":"2024-09-12T00:04:17.951012+0000","last_undegraded":"2024-09-12T00:04:17.951012+0000","last_fullsized":"2024-09-12T00:04:17.951012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:49.518432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":49,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645947+0000","last_change":"2024-09-12T00:03:31.335460+0000","last_active":"2024-09-12T00:04:18.645947+0000","last_peered":"2024-09-12T00:04:18.645947+0000","last_clean":"2024-09-12T00:04:18.645947+0000","last_became_active":"2024-09-12T00:03:31.334701+0000","last_became_peered":"2024-09-12T00:03:31.334701+0000","last_unstale":"2024-09-12T00:04:18.645947+0000","last_undegraded":"2024-09-12T00:04:18.645947+0000","last_fullsized":"2024-09-12T00:04:18.645947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:28.484366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":45,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.649071+0000","last_change":"2024-09-12T00:03:33.386404+0000","last_active":"2024-09-12T00:04:18.649071+0000","last_peered":"2024-09-12T00:04:18.649071+0000","last_clean":"2024-09-12T00:04:18.649071+0000","last_became_active":"2024-09-12T00:03:33.385090+0000","last_became_peered":"2024-09-12T00:03:33.385090+0000","last_unstale":"2024-09-12T00:04:18.649071+0000","last_undegraded":"2024-09-12T00:04:18.649071+0000","last_fullsized":"2024-09-12T00:04:18.649071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":45,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647188+0000","last_change":"2024-09-12T00:03:33.361690+0000","last_active":"2024-09-12T00:04:18.647188+0000","last_peered":"2024-09-12T00:04:18.647188+0000","last_clean":"2024-09-12T00:04:18.647188+0000","last_became_active":"2024-09-12T00:03:33.360980+0000","last_became_peered":"2024-09-12T00:03:33.360980+0000","last_unstale":"2024-09-12T00:04:18.647188+0000","last_undegraded":"2024-09-12T00:04:18.647188+0000","last_fullsized":"2024-09-12T00:04:18.647188+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:24.954577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647818+0000","last_change":"2024-09-12T00:03:25.335027+0000","last_active":"2024-09-12T00:04:18.647818+0000","last_peered":"2024-09-12T00:04:18.647818+0000","last_clean":"2024-09-12T00:04:18.647818+0000","last_became_active":"2024-09-12T00:03:25.334530+0000","last_became_peered":"2024-09-12T00:03:25.334530+0000","last_unstale":"2024-09-12T00:04:18.647818+0000","last_undegraded":"2024-09-12T00:04:18.647818+0000","last_fullsized":"2024-09-12T00:04:18.647818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643073+0000","last_change":"2024-09-12T00:03:23.618114+0000","last_active":"2024-09-12T00:04:17.643073+0000","last_peered":"2024-09-12T00:04:17.643073+0000","last_clean":"2024-09-12T00:04:17.643073+0000","last_became_active":"2024-09-12T00:03:23.617781+0000","last_became_peered":"2024-09-12T00:03:23.617781+0000","last_unstale":"2024-09-12T00:04:17.643073+0000","last_undegraded":"2024-09-12T00:04:17.643073+0000","last_fullsized":"2024-09-12T00:04:17.643073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:30.629135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"28'2","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643135+0000","last_change":"2024-09-12T00:03:27.332281+0000","last_active":"2024-09-12T00:04:18.643135+0000","last_peered":"2024-09-12T00:04:18.643135+0000","last_clean":"2024-09-12T00:04:18.643135+0000","last_became_active":"2024-09-12T00:03:27.331527+0000","last_became_peered":"2024-09-12T00:03:27.331527+0000","last_unstale":"2024-09-12T00:04:18.643135+0000","last_undegraded":"2024-09-12T00:04:18.643135+0000","last_fullsized":"2024-09-12T00:04:18.643135+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"35'17","reported_seq":86,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.642869+0000","last_change":"2024-09-12T00:03:29.338655+0000","last_active":"2024-09-12T00:04:18.642869+0000","last_peered":"2024-09-12T00:04:18.642869+0000","last_clean":"2024-09-12T00:04:18.642869+0000","last_became_active":"2024-09-12T00:03:29.337905+0000","last_became_peered":"2024-09-12T00:03:29.337905+0000","last_unstale":"2024-09-12T00:04:18.642869+0000","last_undegraded":"2024-09-12T00:04:18.642869+0000","last_fullsized":"2024-09-12T00:04:18.642869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":48,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.949680+0000","last_change":"2024-09-12T00:03:31.351716+0000","last_active":"2024-09-12T00:04:17.949680+0000","last_peered":"2024-09-12T00:04:17.949680+0000","last_clean":"2024-09-12T00:04:17.949680+0000","last_became_active":"2024-09-12T00:03:31.350917+0000","last_became_peered":"2024-09-12T00:03:31.350917+0000","last_unstale":"2024-09-12T00:04:17.949680+0000","last_undegraded":"2024-09-12T00:04:17.949680+0000","last_fullsized":"2024-09-12T00:04:17.949680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:45.880820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953299+0000","last_change":"2024-09-12T00:03:33.374233+0000","last_active":"2024-09-12T00:04:17.953299+0000","last_peered":"2024-09-12T00:04:17.953299+0000","last_clean":"2024-09-12T00:04:17.953299+0000","last_became_active":"2024-09-12T00:03:33.373466+0000","last_became_peered":"2024-09-12T00:03:33.373466+0000","last_unstale":"2024-09-12T00:04:17.953299+0000","last_undegraded":"2024-09-12T00:04:17.953299+0000","last_fullsized":"2024-09-12T00:04:17.953299+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:55.598892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645818+0000","last_change":"2024-09-12T00:03:25.319144+0000","last_active":"2024-09-12T00:04:18.645818+0000","last_peered":"2024-09-12T00:04:18.645818+0000","last_clean":"2024-09-12T00:04:18.645818+0000","last_became_active":"2024-09-12T00:03:25.318362+0000","last_became_peered":"2024-09-12T00:03:25.318362+0000","last_unstale":"2024-09-12T00:04:18.645818+0000","last_undegraded":"2024-09-12T00:04:18.645818+0000","last_fullsized":"2024-09-12T00:04:18.645818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.954291+0000","last_change":"2024-09-12T00:03:23.613274+0000","last_active":"2024-09-12T00:04:17.954291+0000","last_peered":"2024-09-12T00:04:17.954291+0000","last_clean":"2024-09-12T00:04:17.954291+0000","last_became_active":"2024-09-12T00:03:23.612941+0000","last_became_peered":"2024-09-12T00:03:23.612941+0000","last_unstale":"2024-09-12T00:04:17.954291+0000","last_undegraded":"2024-09-12T00:04:17.954291+0000","last_fullsized":"2024-09-12T00:04:17.954291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:56.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":57,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645803+0000","last_change":"2024-09-12T00:03:27.336144+0000","last_active":"2024-09-12T00:04:18.645803+0000","last_peered":"2024-09-12T00:04:18.645803+0000","last_clean":"2024-09-12T00:04:18.645803+0000","last_became_active":"2024-09-12T00:03:27.335372+0000","last_became_peered":"2024-09-12T00:03:27.335372+0000","last_unstale":"2024-09-12T00:04:18.645803+0000","last_undegraded":"2024-09-12T00:04:18.645803+0000","last_fullsized":"2024-09-12T00:04:18.645803+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:33.978665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"43'5","reported_seq":60,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645496+0000","last_change":"2024-09-12T00:03:29.332051+0000","last_active":"2024-09-12T00:04:18.645496+0000","last_peered":"2024-09-12T00:04:18.645496+0000","last_clean":"2024-09-12T00:04:18.645496+0000","last_became_active":"2024-09-12T00:03:29.331243+0000","last_became_peered":"2024-09-12T00:03:29.331243+0000","last_unstale":"2024-09-12T00:04:18.645496+0000","last_undegraded":"2024-09-12T00:04:18.645496+0000","last_fullsized":"2024-09-12T00:04:18.645496+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:52.544770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":49,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646472+0000","last_change":"2024-09-12T00:03:31.347021+0000","last_active":"2024-09-12T00:04:18.646472+0000","last_peered":"2024-09-12T00:04:18.646472+0000","last_clean":"2024-09-12T00:04:18.646472+0000","last_became_active":"2024-09-12T00:03:31.344407+0000","last_became_peered":"2024-09-12T00:03:31.344407+0000","last_unstale":"2024-09-12T00:04:18.646472+0000","last_undegraded":"2024-09-12T00:04:18.646472+0000","last_fullsized":"2024-09-12T00:04:18.646472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:32.139742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":47,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643549+0000","last_change":"2024-09-12T00:03:33.370271+0000","last_active":"2024-09-12T00:04:18.643549+0000","last_peered":"2024-09-12T00:04:18.643549+0000","last_clean":"2024-09-12T00:04:18.643549+0000","last_became_active":"2024-09-12T00:03:33.369538+0000","last_became_peered":"2024-09-12T00:03:33.369538+0000","last_unstale":"2024-09-12T00:04:18.643549+0000","last_undegraded":"2024-09-12T00:04:18.643549+0000","last_fullsized":"2024-09-12T00:04:18.643549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645938+0000","last_change":"2024-09-12T00:03:25.341025+0000","last_active":"2024-09-12T00:04:18.645938+0000","last_peered":"2024-09-12T00:04:18.645938+0000","last_clean":"2024-09-12T00:04:18.645938+0000","last_became_active":"2024-09-12T00:03:25.340288+0000","last_became_peered":"2024-09-12T00:03:25.340288+0000","last_unstale":"2024-09-12T00:04:18.645938+0000","last_undegraded":"2024-09-12T00:04:18.645938+0000","last_fullsized":"2024-09-12T00:04:18.645938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.649762+0000","last_change":"2024-09-12T00:03:23.612814+0000","last_active":"2024-09-12T00:04:18.649762+0000","last_peered":"2024-09-12T00:04:18.649762+0000","last_clean":"2024-09-12T00:04:18.649762+0000","last_became_active":"2024-09-12T00:03:23.612332+0000","last_became_peered":"2024-09-12T00:03:23.612332+0000","last_unstale":"2024-09-12T00:04:18.649762+0000","last_undegraded":"2024-09-12T00:04:18.649762+0000","last_fullsized":"2024-09-12T00:04:18.649762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:02.202230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":57,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646058+0000","last_change":"2024-09-12T00:03:27.329869+0000","last_active":"2024-09-12T00:04:18.646058+0000","last_peered":"2024-09-12T00:04:18.646058+0000","last_clean":"2024-09-12T00:04:18.646058+0000","last_became_active":"2024-09-12T00:03:27.329077+0000","last_became_peered":"2024-09-12T00:03:27.329077+0000","last_unstale":"2024-09-12T00:04:18.646058+0000","last_undegraded":"2024-09-12T00:04:18.646058+0000","last_fullsized":"2024-09-12T00:04:18.646058+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'11","reported_seq":71,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953063+0000","last_change":"2024-09-12T00:03:29.346878+0000","last_active":"2024-09-12T00:04:17.953063+0000","last_peered":"2024-09-12T00:04:17.953063+0000","last_clean":"2024-09-12T00:04:17.953063+0000","last_became_active":"2024-09-12T00:03:29.345990+0000","last_became_peered":"2024-09-12T00:03:29.345990+0000","last_unstale":"2024-09-12T00:04:17.953063+0000","last_undegraded":"2024-09-12T00:04:17.953063+0000","last_fullsized":"2024-09-12T00:04:17.953063+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:06.398979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":49,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951094+0000","last_change":"2024-09-12T00:03:31.363658+0000","last_active":"2024-09-12T00:04:17.951094+0000","last_peered":"2024-09-12T00:04:17.951094+0000","last_clean":"2024-09-12T00:04:17.951094+0000","last_became_active":"2024-09-12T00:03:31.363080+0000","last_became_peered":"2024-09-12T00:03:31.363080+0000","last_unstale":"2024-09-12T00:04:17.951094+0000","last_undegraded":"2024-09-12T00:04:17.951094+0000","last_fullsized":"2024-09-12T00:04:17.951094+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:05.901608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642727+0000","last_change":"2024-09-12T00:03:33.380447+0000","last_active":"2024-09-12T00:04:17.642727+0000","last_peered":"2024-09-12T00:04:17.642727+0000","last_clean":"2024-09-12T00:04:17.642727+0000","last_became_active":"2024-09-12T00:03:33.379701+0000","last_became_peered":"2024-09-12T00:03:33.379701+0000","last_unstale":"2024-09-12T00:04:17.642727+0000","last_undegraded":"2024-09-12T00:04:17.642727+0000","last_fullsized":"2024-09-12T00:04:17.642727+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:55.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.949845+0000","last_change":"2024-09-12T00:03:25.330916+0000","last_active":"2024-09-12T00:04:17.949845+0000","last_peered":"2024-09-12T00:04:17.949845+0000","last_clean":"2024-09-12T00:04:17.949845+0000","last_became_active":"2024-09-12T00:03:25.330181+0000","last_became_peered":"2024-09-12T00:03:25.330181+0000","last_unstale":"2024-09-12T00:04:17.949845+0000","last_undegraded":"2024-09-12T00:04:17.949845+0000","last_fullsized":"2024-09-12T00:04:17.949845+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:03.153020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951743+0000","last_change":"2024-09-12T00:03:23.618613+0000","last_active":"2024-09-12T00:04:17.951743+0000","last_peered":"2024-09-12T00:04:17.951743+0000","last_clean":"2024-09-12T00:04:17.951743+0000","last_became_active":"2024-09-12T00:03:23.617587+0000","last_became_peered":"2024-09-12T00:03:23.617587+0000","last_unstale":"2024-09-12T00:04:17.951743+0000","last_undegraded":"2024-09-12T00:04:17.951743+0000","last_fullsized":"2024-09-12T00:04:17.951743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:54.211904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642274+0000","last_change":"2024-09-12T00:03:27.330320+0000","last_active":"2024-09-12T00:04:17.642274+0000","last_peered":"2024-09-12T00:04:17.642274+0000","last_clean":"2024-09-12T00:04:17.642274+0000","last_became_active":"2024-09-12T00:03:27.329236+0000","last_became_peered":"2024-09-12T00:03:27.329236+0000","last_unstale":"2024-09-12T00:04:17.642274+0000","last_undegraded":"2024-09-12T00:04:17.642274+0000","last_fullsized":"2024-09-12T00:04:17.642274+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:57.407947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'9","reported_seq":69,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950845+0000","last_change":"2024-09-12T00:03:29.346312+0000","last_active":"2024-09-12T00:04:17.950845+0000","last_peered":"2024-09-12T00:04:17.950845+0000","last_clean":"2024-09-12T00:04:17.950845+0000","last_became_active":"2024-09-12T00:03:29.345883+0000","last_became_peered":"2024-09-12T00:03:29.345883+0000","last_unstale":"2024-09-12T00:04:17.950845+0000","last_undegraded":"2024-09-12T00:04:17.950845+0000","last_fullsized":"2024-09-12T00:04:17.950845+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:46.723370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":48,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.952903+0000","last_change":"2024-09-12T00:03:31.358786+0000","last_active":"2024-09-12T00:04:17.952903+0000","last_peered":"2024-09-12T00:04:17.952903+0000","last_clean":"2024-09-12T00:04:17.952903+0000","last_became_active":"2024-09-12T00:03:31.358011+0000","last_became_peered":"2024-09-12T00:03:31.358011+0000","last_unstale":"2024-09-12T00:04:17.952903+0000","last_undegraded":"2024-09-12T00:04:17.952903+0000","last_fullsized":"2024-09-12T00:04:17.952903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:29.394163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643227+0000","last_change":"2024-09-12T00:03:25.351065+0000","last_active":"2024-09-12T00:04:17.643227+0000","last_peered":"2024-09-12T00:04:17.643227+0000","last_clean":"2024-09-12T00:04:17.643227+0000","last_became_active":"2024-09-12T00:03:25.350719+0000","last_became_peered":"2024-09-12T00:03:25.350719+0000","last_unstale":"2024-09-12T00:04:17.643227+0000","last_undegraded":"2024-09-12T00:04:17.643227+0000","last_fullsized":"2024-09-12T00:04:17.643227+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:54.693130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950691+0000","last_change":"2024-09-12T00:03:23.627584+0000","last_active":"2024-09-12T00:04:17.950691+0000","last_peered":"2024-09-12T00:04:17.950691+0000","last_clean":"2024-09-12T00:04:17.950691+0000","last_became_active":"2024-09-12T00:03:23.626026+0000","last_became_peered":"2024-09-12T00:03:23.626026+0000","last_unstale":"2024-09-12T00:04:17.950691+0000","last_undegraded":"2024-09-12T00:04:17.950691+0000","last_fullsized":"2024-09-12T00:04:17.950691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:38.192583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":59,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.644131+0000","last_change":"2024-09-12T00:03:27.335297+0000","last_active":"2024-09-12T00:04:18.644131+0000","last_peered":"2024-09-12T00:04:18.644131+0000","last_clean":"2024-09-12T00:04:18.644131+0000","last_became_active":"2024-09-12T00:03:27.334570+0000","last_became_peered":"2024-09-12T00:03:27.334570+0000","last_unstale":"2024-09-12T00:04:18.644131+0000","last_undegraded":"2024-09-12T00:04:18.644131+0000","last_fullsized":"2024-09-12T00:04:18.644131+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"35'18","reported_seq":90,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643653+0000","last_change":"2024-09-12T00:03:29.340387+0000","last_active":"2024-09-12T00:04:18.643653+0000","last_peered":"2024-09-12T00:04:18.643653+0000","last_clean":"2024-09-12T00:04:18.643653+0000","last_became_active":"2024-09-12T00:03:29.339781+0000","last_became_peered":"2024-09-12T00:03:29.339781+0000","last_unstale":"2024-09-12T00:04:18.643653+0000","last_undegraded":"2024-09-12T00:04:18.643653+0000","last_fullsized":"2024-09-12T00:04:18.643653+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:30.132716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":49,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.648146+0000","last_change":"2024-09-12T00:03:31.350303+0000","last_active":"2024-09-12T00:04:18.648146+0000","last_peered":"2024-09-12T00:04:18.648146+0000","last_clean":"2024-09-12T00:04:18.648146+0000","last_became_active":"2024-09-12T00:03:31.349591+0000","last_became_peered":"2024-09-12T00:03:31.349591+0000","last_unstale":"2024-09-12T00:04:18.648146+0000","last_undegraded":"2024-09-12T00:04:18.648146+0000","last_fullsized":"2024-09-12T00:04:18.648146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:00.263644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950360+0000","last_change":"2024-09-12T00:03:33.385028+0000","last_active":"2024-09-12T00:04:17.950360+0000","last_peered":"2024-09-12T00:04:17.950360+0000","last_clean":"2024-09-12T00:04:17.950360+0000","last_became_active":"2024-09-12T00:03:33.384274+0000","last_became_peered":"2024-09-12T00:03:33.384274+0000","last_unstale":"2024-09-12T00:04:17.950360+0000","last_undegraded":"2024-09-12T00:04:17.950360+0000","last_fullsized":"2024-09-12T00:04:17.950360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:11.634604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647307+0000","last_change":"2024-09-12T00:03:25.329888+0000","last_active":"2024-09-12T00:04:18.647307+0000","last_peered":"2024-09-12T00:04:18.647307+0000","last_clean":"2024-09-12T00:04:18.647307+0000","last_became_active":"2024-09-12T00:03:25.329151+0000","last_became_peered":"2024-09-12T00:03:25.329151+0000","last_unstale":"2024-09-12T00:04:18.647307+0000","last_undegraded":"2024-09-12T00:04:18.647307+0000","last_fullsized":"2024-09-12T00:04:18.647307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:47.272383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646273+0000","last_change":"2024-09-12T00:03:23.600146+0000","last_active":"2024-09-12T00:04:18.646273+0000","last_peered":"2024-09-12T00:04:18.646273+0000","last_clean":"2024-09-12T00:04:18.646273+0000","last_became_active":"2024-09-12T00:03:23.598862+0000","last_became_peered":"2024-09-12T00:03:23.598862+0000","last_unstale":"2024-09-12T00:04:18.646273+0000","last_undegraded":"2024-09-12T00:04:18.646273+0000","last_fullsized":"2024-09-12T00:04:18.646273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:13.330852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":57,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.649413+0000","last_change":"2024-09-12T00:03:27.341032+0000","last_active":"2024-09-12T00:04:18.649413+0000","last_peered":"2024-09-12T00:04:18.649413+0000","last_clean":"2024-09-12T00:04:18.649413+0000","last_became_active":"2024-09-12T00:03:27.340199+0000","last_became_peered":"2024-09-12T00:03:27.340199+0000","last_unstale":"2024-09-12T00:04:18.649413+0000","last_undegraded":"2024-09-12T00:04:18.649413+0000","last_fullsized":"2024-09-12T00:04:18.649413+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:23.673080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'15","reported_seq":78,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642925+0000","last_change":"2024-09-12T00:03:29.349125+0000","last_active":"2024-09-12T00:04:17.642925+0000","last_peered":"2024-09-12T00:04:17.642925+0000","last_clean":"2024-09-12T00:04:17.642925+0000","last_became_active":"2024-09-12T00:03:29.348145+0000","last_became_peered":"2024-09-12T00:03:29.348145+0000","last_unstale":"2024-09-12T00:04:17.642925+0000","last_undegraded":"2024-09-12T00:04:17.642925+0000","last_fullsized":"2024-09-12T00:04:17.642925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:55.699040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":48,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950563+0000","last_change":"2024-09-12T00:03:31.363427+0000","last_active":"2024-09-12T00:04:17.950563+0000","last_peered":"2024-09-12T00:04:17.950563+0000","last_clean":"2024-09-12T00:04:17.950563+0000","last_became_active":"2024-09-12T00:03:31.362578+0000","last_became_peered":"2024-09-12T00:03:31.362578+0000","last_unstale":"2024-09-12T00:04:17.950563+0000","last_undegraded":"2024-09-12T00:04:17.950563+0000","last_fullsized":"2024-09-12T00:04:17.950563+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:17.357647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643454+0000","last_change":"2024-09-12T00:03:33.375115+0000","last_active":"2024-09-12T00:04:17.643454+0000","last_peered":"2024-09-12T00:04:17.643454+0000","last_clean":"2024-09-12T00:04:17.643454+0000","last_became_active":"2024-09-12T00:03:33.374310+0000","last_became_peered":"2024-09-12T00:03:33.374310+0000","last_unstale":"2024-09-12T00:04:17.643454+0000","last_undegraded":"2024-09-12T00:04:17.643454+0000","last_fullsized":"2024-09-12T00:04:17.643454+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:46.466723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953379+0000","last_change":"2024-09-12T00:03:25.360355+0000","last_active":"2024-09-12T00:04:17.953379+0000","last_peered":"2024-09-12T00:04:17.953379+0000","last_clean":"2024-09-12T00:04:17.953379+0000","last_became_active":"2024-09-12T00:03:25.359682+0000","last_became_peered":"2024-09-12T00:03:25.359682+0000","last_unstale":"2024-09-12T00:04:17.953379+0000","last_undegraded":"2024-09-12T00:04:17.953379+0000","last_fullsized":"2024-09-12T00:04:17.953379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:11.808081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951482+0000","last_change":"2024-09-12T00:03:23.621199+0000","last_active":"2024-09-12T00:04:17.951482+0000","last_peered":"2024-09-12T00:04:17.951482+0000","last_clean":"2024-09-12T00:04:17.951482+0000","last_became_active":"2024-09-12T00:03:23.620961+0000","last_became_peered":"2024-09-12T00:03:23.620961+0000","last_unstale":"2024-09-12T00:04:17.951482+0000","last_undegraded":"2024-09-12T00:04:17.951482+0000","last_fullsized":"2024-09-12T00:04:17.951482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":57,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.648405+0000","last_change":"2024-09-12T00:03:27.336918+0000","last_active":"2024-09-12T00:04:18.648405+0000","last_peered":"2024-09-12T00:04:18.648405+0000","last_clean":"2024-09-12T00:04:18.648405+0000","last_became_active":"2024-09-12T00:03:27.336045+0000","last_became_peered":"2024-09-12T00:03:27.336045+0000","last_unstale":"2024-09-12T00:04:18.648405+0000","last_undegraded":"2024-09-12T00:04:18.648405+0000","last_fullsized":"2024-09-12T00:04:18.648405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'17","reported_seq":86,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643842+0000","last_change":"2024-09-12T00:03:29.338667+0000","last_active":"2024-09-12T00:04:18.643842+0000","last_peered":"2024-09-12T00:04:18.643842+0000","last_clean":"2024-09-12T00:04:18.643842+0000","last_became_active":"2024-09-12T00:03:29.338010+0000","last_became_peered":"2024-09-12T00:03:29.338010+0000","last_unstale":"2024-09-12T00:04:18.643842+0000","last_undegraded":"2024-09-12T00:04:18.643842+0000","last_fullsized":"2024-09-12T00:04:18.643842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:58.256619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":48,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953246+0000","last_change":"2024-09-12T00:03:31.352823+0000","last_active":"2024-09-12T00:04:17.953246+0000","last_peered":"2024-09-12T00:04:17.953246+0000","last_clean":"2024-09-12T00:04:17.953246+0000","last_became_active":"2024-09-12T00:03:31.352143+0000","last_became_peered":"2024-09-12T00:03:31.352143+0000","last_unstale":"2024-09-12T00:04:17.953246+0000","last_undegraded":"2024-09-12T00:04:17.953246+0000","last_fullsized":"2024-09-12T00:04:17.953246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:25.168692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642445+0000","last_change":"2024-09-12T00:03:33.379330+0000","last_active":"2024-09-12T00:04:17.642445+0000","last_peered":"2024-09-12T00:04:17.642445+0000","last_clean":"2024-09-12T00:04:17.642445+0000","last_became_active":"2024-09-12T00:03:33.376228+0000","last_became_peered":"2024-09-12T00:03:33.376228+0000","last_unstale":"2024-09-12T00:04:17.642445+0000","last_undegraded":"2024-09-12T00:04:17.642445+0000","last_fullsized":"2024-09-12T00:04:17.642445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:44.364562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647002+0000","last_change":"2024-09-12T00:03:25.325094+0000","last_active":"2024-09-12T00:04:18.647002+0000","last_peered":"2024-09-12T00:04:18.647002+0000","last_clean":"2024-09-12T00:04:18.647002+0000","last_became_active":"2024-09-12T00:03:25.324315+0000","last_became_peered":"2024-09-12T00:03:25.324315+0000","last_unstale":"2024-09-12T00:04:18.647002+0000","last_undegraded":"2024-09-12T00:04:18.647002+0000","last_fullsized":"2024-09-12T00:04:18.647002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:18.727732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646393+0000","last_change":"2024-09-12T00:03:23.606163+0000","last_active":"2024-09-12T00:04:18.646393+0000","last_peered":"2024-09-12T00:04:18.646393+0000","last_clean":"2024-09-12T00:04:18.646393+0000","last_became_active":"2024-09-12T00:03:23.605402+0000","last_became_peered":"2024-09-12T00:03:23.605402+0000","last_unstale":"2024-09-12T00:04:18.646393+0000","last_undegraded":"2024-09-12T00:04:18.646393+0000","last_fullsized":"2024-09-12T00:04:18.646393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:02.432313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":57,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646901+0000","last_change":"2024-09-12T00:03:27.336716+0000","last_active":"2024-09-12T00:04:18.646901+0000","last_peered":"2024-09-12T00:04:18.646901+0000","last_clean":"2024-09-12T00:04:18.646901+0000","last_became_active":"2024-09-12T00:03:27.335658+0000","last_became_peered":"2024-09-12T00:03:27.335658+0000","last_unstale":"2024-09-12T00:04:18.646901+0000","last_undegraded":"2024-09-12T00:04:18.646901+0000","last_fullsized":"2024-09-12T00:04:18.646901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:47.355798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"35'16","reported_seq":80,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643052+0000","last_change":"2024-09-12T00:03:29.354481+0000","last_active":"2024-09-12T00:04:17.643052+0000","last_peered":"2024-09-12T00:04:17.643052+0000","last_clean":"2024-09-12T00:04:17.643052+0000","last_became_active":"2024-09-12T00:03:29.353656+0000","last_became_peered":"2024-09-12T00:03:29.353656+0000","last_unstale":"2024-09-12T00:04:17.643052+0000","last_undegraded":"2024-09-12T00:04:17.643052+0000","last_fullsized":"2024-09-12T00:04:17.643052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:42.984798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'2","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953692+0000","last_change":"2024-09-12T00:03:31.351362+0000","last_active":"2024-09-12T00:04:17.953692+0000","last_peered":"2024-09-12T00:04:17.953692+0000","last_clean":"2024-09-12T00:04:17.953692+0000","last_became_active":"2024-09-12T00:03:31.350925+0000","last_became_peered":"2024-09-12T00:03:31.350925+0000","last_unstale":"2024-09-12T00:04:17.953692+0000","last_undegraded":"2024-09-12T00:04:17.953692+0000","last_fullsized":"2024-09-12T00:04:17.953692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:03.147968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.641814+0000","last_change":"2024-09-12T00:03:33.374932+0000","last_active":"2024-09-12T00:04:17.641814+0000","last_peered":"2024-09-12T00:04:17.641814+0000","last_clean":"2024-09-12T00:04:17.641814+0000","last_became_active":"2024-09-12T00:03:33.374185+0000","last_became_peered":"2024-09-12T00:03:33.374185+0000","last_unstale":"2024-09-12T00:04:17.641814+0000","last_undegraded":"2024-09-12T00:04:17.641814+0000","last_fullsized":"2024-09-12T00:04:17.641814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:54.883339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647742+0000","last_change":"2024-09-12T00:03:25.357999+0000","last_active":"2024-09-12T00:04:18.647742+0000","last_peered":"2024-09-12T00:04:18.647742+0000","last_clean":"2024-09-12T00:04:18.647742+0000","last_became_active":"2024-09-12T00:03:25.357623+0000","last_became_peered":"2024-09-12T00:03:25.357623+0000","last_unstale":"2024-09-12T00:04:18.647742+0000","last_undegraded":"2024-09-12T00:04:18.647742+0000","last_fullsized":"2024-09-12T00:04:18.647742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951670+0000","last_change":"2024-09-12T00:03:23.605954+0000","last_active":"2024-09-12T00:04:17.951670+0000","last_peered":"2024-09-12T00:04:17.951670+0000","last_clean":"2024-09-12T00:04:17.951670+0000","last_became_active":"2024-09-12T00:03:23.604773+0000","last_became_peered":"2024-09-12T00:03:23.604773+0000","last_unstale":"2024-09-12T00:04:17.951670+0000","last_undegraded":"2024-09-12T00:04:17.951670+0000","last_fullsized":"2024-09-12T00:04:17.951670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951222+0000","last_change":"2024-09-12T00:03:27.346785+0000","last_active":"2024-09-12T00:04:17.951222+0000","last_peered":"2024-09-12T00:04:17.951222+0000","last_clean":"2024-09-12T00:04:17.951222+0000","last_became_active":"2024-09-12T00:03:27.346168+0000","last_became_peered":"2024-09-12T00:03:27.346168+0000","last_unstale":"2024-09-12T00:04:17.951222+0000","last_undegraded":"2024-09-12T00:04:17.951222+0000","last_fullsized":"2024-09-12T00:04:17.951222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'40","reported_seq":127,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950254+0000","last_change":"2024-09-12T00:03:29.343942+0000","last_active":"2024-09-12T00:04:17.950254+0000","last_peered":"2024-09-12T00:04:17.950254+0000","last_clean":"2024-09-12T00:04:17.950254+0000","last_became_active":"2024-09-12T00:03:29.343238+0000","last_became_peered":"2024-09-12T00:03:29.343238+0000","last_unstale":"2024-09-12T00:04:17.950254+0000","last_undegraded":"2024-09-12T00:04:17.950254+0000","last_fullsized":"2024-09-12T00:04:17.950254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:30.949892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":49,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645566+0000","last_change":"2024-09-12T00:03:31.348120+0000","last_active":"2024-09-12T00:04:18.645566+0000","last_peered":"2024-09-12T00:04:18.645566+0000","last_clean":"2024-09-12T00:04:18.645566+0000","last_became_active":"2024-09-12T00:03:31.344599+0000","last_became_peered":"2024-09-12T00:03:31.344599+0000","last_unstale":"2024-09-12T00:04:18.645566+0000","last_undegraded":"2024-09-12T00:04:18.645566+0000","last_fullsized":"2024-09-12T00:04:18.645566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:00.279625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.952319+0000","last_change":"2024-09-12T00:03:33.363188+0000","last_active":"2024-09-12T00:04:17.952319+0000","last_peered":"2024-09-12T00:04:17.952319+0000","last_clean":"2024-09-12T00:04:17.952319+0000","last_became_active":"2024-09-12T00:03:33.360672+0000","last_became_peered":"2024-09-12T00:03:33.360672+0000","last_unstale":"2024-09-12T00:04:17.952319+0000","last_undegraded":"2024-09-12T00:04:17.952319+0000","last_fullsized":"2024-09-12T00:04:17.952319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:33.646117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647014+0000","last_change":"2024-09-12T00:03:25.336626+0000","last_active":"2024-09-12T00:04:18.647014+0000","last_peered":"2024-09-12T00:04:18.647014+0000","last_clean":"2024-09-12T00:04:18.647014+0000","last_became_active":"2024-09-12T00:03:25.336095+0000","last_became_peered":"2024-09-12T00:03:25.336095+0000","last_unstale":"2024-09-12T00:04:18.647014+0000","last_undegraded":"2024-09-12T00:04:18.647014+0000","last_fullsized":"2024-09-12T00:04:18.647014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642680+0000","last_change":"2024-09-12T00:03:23.601889+0000","last_active":"2024-09-12T00:04:17.642680+0000","last_peered":"2024-09-12T00:04:17.642680+0000","last_clean":"2024-09-12T00:04:17.642680+0000","last_became_active":"2024-09-12T00:03:23.601553+0000","last_became_peered":"2024-09-12T00:03:23.601553+0000","last_unstale":"2024-09-12T00:04:17.642680+0000","last_undegraded":"2024-09-12T00:04:17.642680+0000","last_fullsized":"2024-09-12T00:04:17.642680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:08.758769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":57,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647624+0000","last_change":"2024-09-12T00:03:27.326174+0000","last_active":"2024-09-12T00:04:18.647624+0000","last_peered":"2024-09-12T00:04:18.647624+0000","last_clean":"2024-09-12T00:04:18.647624+0000","last_became_active":"2024-09-12T00:03:27.325336+0000","last_became_peered":"2024-09-12T00:03:27.325336+0000","last_unstale":"2024-09-12T00:04:18.647624+0000","last_undegraded":"2024-09-12T00:04:18.647624+0000","last_fullsized":"2024-09-12T00:04:18.647624+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:08.659813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'15","reported_seq":81,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645859+0000","last_change":"2024-09-12T00:03:29.335957+0000","last_active":"2024-09-12T00:04:18.645859+0000","last_peered":"2024-09-12T00:04:18.645859+0000","last_clean":"2024-09-12T00:04:18.645859+0000","last_became_active":"2024-09-12T00:03:29.335186+0000","last_became_peered":"2024-09-12T00:03:29.335186+0000","last_unstale":"2024-09-12T00:04:18.645859+0000","last_undegraded":"2024-09-12T00:04:18.645859+0000","last_fullsized":"2024-09-12T00:04:18.645859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:20.551758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":49,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642360+0000","last_change":"2024-09-12T00:03:31.350287+0000","last_active":"2024-09-12T00:04:17.642360+0000","last_peered":"2024-09-12T00:04:17.642360+0000","last_clean":"2024-09-12T00:04:17.642360+0000","last_became_active":"2024-09-12T00:03:31.349890+0000","last_became_peered":"2024-09-12T00:03:31.349890+0000","last_unstale":"2024-09-12T00:04:17.642360+0000","last_undegraded":"2024-09-12T00:04:17.642360+0000","last_fullsized":"2024-09-12T00:04:17.642360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:33.081032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951030+0000","last_change":"2024-09-12T00:03:33.385037+0000","last_active":"2024-09-12T00:04:17.951030+0000","last_peered":"2024-09-12T00:04:17.951030+0000","last_clean":"2024-09-12T00:04:17.951030+0000","last_became_active":"2024-09-12T00:03:33.384379+0000","last_became_peered":"2024-09-12T00:03:33.384379+0000","last_unstale":"2024-09-12T00:04:17.951030+0000","last_undegraded":"2024-09-12T00:04:17.951030+0000","last_fullsized":"2024-09-12T00:04:17.951030+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:00.153475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.949919+0000","last_change":"2024-09-12T00:03:25.339110+0000","last_active":"2024-09-12T00:04:17.949919+0000","last_peered":"2024-09-12T00:04:17.949919+0000","last_clean":"2024-09-12T00:04:17.949919+0000","last_became_active":"2024-09-12T00:03:25.338417+0000","last_became_peered":"2024-09-12T00:03:25.338417+0000","last_unstale":"2024-09-12T00:04:17.949919+0000","last_undegraded":"2024-09-12T00:04:17.949919+0000","last_fullsized":"2024-09-12T00:04:17.949919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:48.866021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951416+0000","last_change":"2024-09-12T00:03:23.625514+0000","last_active":"2024-09-12T00:04:17.951416+0000","last_peered":"2024-09-12T00:04:17.951416+0000","last_clean":"2024-09-12T00:04:17.951416+0000","last_became_active":"2024-09-12T00:03:23.621654+0000","last_became_peered":"2024-09-12T00:03:23.621654+0000","last_unstale":"2024-09-12T00:04:17.951416+0000","last_undegraded":"2024-09-12T00:04:17.951416+0000","last_fullsized":"2024-09-12T00:04:17.951416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:43.784497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950351+0000","last_change":"2024-09-12T00:03:27.330377+0000","last_active":"2024-09-12T00:04:17.950351+0000","last_peered":"2024-09-12T00:04:17.950351+0000","last_clean":"2024-09-12T00:04:17.950351+0000","last_became_active":"2024-09-12T00:03:27.329713+0000","last_became_peered":"2024-09-12T00:03:27.329713+0000","last_unstale":"2024-09-12T00:04:17.950351+0000","last_undegraded":"2024-09-12T00:04:17.950351+0000","last_fullsized":"2024-09-12T00:04:17.950351+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'11","reported_seq":77,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643566+0000","last_change":"2024-09-12T00:03:29.337028+0000","last_active":"2024-09-12T00:04:18.643566+0000","last_peered":"2024-09-12T00:04:18.643566+0000","last_clean":"2024-09-12T00:04:18.643566+0000","last_became_active":"2024-09-12T00:03:29.335440+0000","last_became_peered":"2024-09-12T00:03:29.335440+0000","last_unstale":"2024-09-12T00:04:18.643566+0000","last_undegraded":"2024-09-12T00:04:18.643566+0000","last_fullsized":"2024-09-12T00:04:18.643566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:19.288395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":49,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.641749+0000","last_change":"2024-09-12T00:03:31.351990+0000","last_active":"2024-09-12T00:04:17.641749+0000","last_peered":"2024-09-12T00:04:17.641749+0000","last_clean":"2024-09-12T00:04:17.641749+0000","last_became_active":"2024-09-12T00:03:31.351580+0000","last_became_peered":"2024-09-12T00:03:31.351580+0000","last_unstale":"2024-09-12T00:04:17.641749+0000","last_undegraded":"2024-09-12T00:04:17.641749+0000","last_fullsized":"2024-09-12T00:04:17.641749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:38.095033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642252+0000","last_change":"2024-09-12T00:03:33.383008+0000","last_active":"2024-09-12T00:04:17.642252+0000","last_peered":"2024-09-12T00:04:17.642252+0000","last_clean":"2024-09-12T00:04:17.642252+0000","last_became_active":"2024-09-12T00:03:33.381496+0000","last_became_peered":"2024-09-12T00:03:33.381496+0000","last_unstale":"2024-09-12T00:04:17.642252+0000","last_undegraded":"2024-09-12T00:04:17.642252+0000","last_fullsized":"2024-09-12T00:04:17.642252+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:44.996509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646147+0000","last_change":"2024-09-12T00:03:25.337999+0000","last_active":"2024-09-12T00:04:18.646147+0000","last_peered":"2024-09-12T00:04:18.646147+0000","last_clean":"2024-09-12T00:04:18.646147+0000","last_became_active":"2024-09-12T00:03:25.337237+0000","last_became_peered":"2024-09-12T00:03:25.337237+0000","last_unstale":"2024-09-12T00:04:18.646147+0000","last_undegraded":"2024-09-12T00:04:18.646147+0000","last_fullsized":"2024-09-12T00:04:18.646147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951682+0000","last_change":"2024-09-12T00:03:23.631744+0000","last_active":"2024-09-12T00:04:17.951682+0000","last_peered":"2024-09-12T00:04:17.951682+0000","last_clean":"2024-09-12T00:04:17.951682+0000","last_became_active":"2024-09-12T00:03:23.630928+0000","last_became_peered":"2024-09-12T00:03:23.630928+0000","last_unstale":"2024-09-12T00:04:17.951682+0000","last_undegraded":"2024-09-12T00:04:17.951682+0000","last_fullsized":"2024-09-12T00:04:17.951682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:35.772832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":58,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645668+0000","last_change":"2024-09-12T00:03:27.345980+0000","last_active":"2024-09-12T00:04:18.645668+0000","last_peered":"2024-09-12T00:04:18.645668+0000","last_clean":"2024-09-12T00:04:18.645668+0000","last_became_active":"2024-09-12T00:03:27.345225+0000","last_became_peered":"2024-09-12T00:03:27.345225+0000","last_unstale":"2024-09-12T00:04:18.645668+0000","last_undegraded":"2024-09-12T00:04:18.645668+0000","last_fullsized":"2024-09-12T00:04:18.645668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:47.990032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"35'21","reported_seq":93,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.641853+0000","last_change":"2024-09-12T00:03:29.359254+0000","last_active":"2024-09-12T00:04:17.641853+0000","last_peered":"2024-09-12T00:04:17.641853+0000","last_clean":"2024-09-12T00:04:17.641853+0000","last_became_active":"2024-09-12T00:03:29.355711+0000","last_became_peered":"2024-09-12T00:03:29.355711+0000","last_unstale":"2024-09-12T00:04:17.641853+0000","last_undegraded":"2024-09-12T00:04:17.641853+0000","last_fullsized":"2024-09-12T00:04:17.641853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:49.919008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":49,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.645992+0000","last_change":"2024-09-12T00:03:31.355300+0000","last_active":"2024-09-12T00:04:18.645992+0000","last_peered":"2024-09-12T00:04:18.645992+0000","last_clean":"2024-09-12T00:04:18.645992+0000","last_became_active":"2024-09-12T00:03:31.354506+0000","last_became_peered":"2024-09-12T00:03:31.354506+0000","last_unstale":"2024-09-12T00:04:18.645992+0000","last_undegraded":"2024-09-12T00:04:18.645992+0000","last_fullsized":"2024-09-12T00:04:18.645992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:51.564710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.954906+0000","last_change":"2024-09-12T00:03:33.384262+0000","last_active":"2024-09-12T00:04:17.954906+0000","last_peered":"2024-09-12T00:04:17.954906+0000","last_clean":"2024-09-12T00:04:17.954906+0000","last_became_active":"2024-09-12T00:03:33.383358+0000","last_became_peered":"2024-09-12T00:03:33.383358+0000","last_unstale":"2024-09-12T00:04:17.954906+0000","last_undegraded":"2024-09-12T00:04:17.954906+0000","last_fullsized":"2024-09-12T00:04:17.954906+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:45.060131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647511+0000","last_change":"2024-09-12T00:03:25.321452+0000","last_active":"2024-09-12T00:04:18.647511+0000","last_peered":"2024-09-12T00:04:18.647511+0000","last_clean":"2024-09-12T00:04:18.647511+0000","last_became_active":"2024-09-12T00:03:25.320503+0000","last_became_peered":"2024-09-12T00:03:25.320503+0000","last_unstale":"2024-09-12T00:04:18.647511+0000","last_undegraded":"2024-09-12T00:04:18.647511+0000","last_fullsized":"2024-09-12T00:04:18.647511+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:22.789487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646321+0000","last_change":"2024-09-12T00:03:23.617643+0000","last_active":"2024-09-12T00:04:18.646321+0000","last_peered":"2024-09-12T00:04:18.646321+0000","last_clean":"2024-09-12T00:04:18.646321+0000","last_became_active":"2024-09-12T00:03:23.617138+0000","last_became_peered":"2024-09-12T00:03:23.617138+0000","last_unstale":"2024-09-12T00:04:18.646321+0000","last_undegraded":"2024-09-12T00:04:18.646321+0000","last_fullsized":"2024-09-12T00:04:18.646321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953510+0000","last_change":"2024-09-12T00:03:25.335650+0000","last_active":"2024-09-12T00:04:17.953510+0000","last_peered":"2024-09-12T00:04:17.953510+0000","last_clean":"2024-09-12T00:04:17.953510+0000","last_became_active":"2024-09-12T00:03:25.334965+0000","last_became_peered":"2024-09-12T00:03:25.334965+0000","last_unstale":"2024-09-12T00:04:17.953510+0000","last_undegraded":"2024-09-12T00:04:17.953510+0000","last_fullsized":"2024-09-12T00:04:17.953510+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:13.501672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.949827+0000","last_change":"2024-09-12T00:03:23.618651+0000","last_active":"2024-09-12T00:04:17.949827+0000","last_peered":"2024-09-12T00:04:17.949827+0000","last_clean":"2024-09-12T00:04:17.949827+0000","last_became_active":"2024-09-12T00:03:23.612542+0000","last_became_peered":"2024-09-12T00:03:23.612542+0000","last_unstale":"2024-09-12T00:04:17.949827+0000","last_undegraded":"2024-09-12T00:04:17.949827+0000","last_fullsized":"2024-09-12T00:04:17.949827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642426+0000","last_change":"2024-09-12T00:03:25.327224+0000","last_active":"2024-09-12T00:04:17.642426+0000","last_peered":"2024-09-12T00:04:17.642426+0000","last_clean":"2024-09-12T00:04:17.642426+0000","last_became_active":"2024-09-12T00:03:25.326635+0000","last_became_peered":"2024-09-12T00:03:25.326635+0000","last_unstale":"2024-09-12T00:04:17.642426+0000","last_undegraded":"2024-09-12T00:04:17.642426+0000","last_fullsized":"2024-09-12T00:04:17.642426+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:16.827573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642304+0000","last_change":"2024-09-12T00:03:23.626043+0000","last_active":"2024-09-12T00:04:17.642304+0000","last_peered":"2024-09-12T00:04:17.642304+0000","last_clean":"2024-09-12T00:04:17.642304+0000","last_became_active":"2024-09-12T00:03:23.625717+0000","last_became_peered":"2024-09-12T00:03:23.625717+0000","last_unstale":"2024-09-12T00:04:17.642304+0000","last_undegraded":"2024-09-12T00:04:17.642304+0000","last_fullsized":"2024-09-12T00:04:17.642304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:45.258601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950726+0000","last_change":"2024-09-12T00:03:25.354015+0000","last_active":"2024-09-12T00:04:17.950726+0000","last_peered":"2024-09-12T00:04:17.950726+0000","last_clean":"2024-09-12T00:04:17.950726+0000","last_became_active":"2024-09-12T00:03:25.352319+0000","last_became_peered":"2024-09-12T00:03:25.352319+0000","last_unstale":"2024-09-12T00:04:17.950726+0000","last_undegraded":"2024-09-12T00:04:17.950726+0000","last_fullsized":"2024-09-12T00:04:17.950726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:08.033834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951306+0000","last_change":"2024-09-12T00:03:23.633614+0000","last_active":"2024-09-12T00:04:17.951306+0000","last_peered":"2024-09-12T00:04:17.951306+0000","last_clean":"2024-09-12T00:04:17.951306+0000","last_became_active":"2024-09-12T00:03:23.632850+0000","last_became_peered":"2024-09-12T00:03:23.632850+0000","last_unstale":"2024-09-12T00:04:17.951306+0000","last_undegraded":"2024-09-12T00:04:17.951306+0000","last_fullsized":"2024-09-12T00:04:17.951306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950912+0000","last_change":"2024-09-12T00:03:25.357453+0000","last_active":"2024-09-12T00:04:17.950912+0000","last_peered":"2024-09-12T00:04:17.950912+0000","last_clean":"2024-09-12T00:04:17.950912+0000","last_became_active":"2024-09-12T00:03:25.353815+0000","last_became_peered":"2024-09-12T00:03:25.353815+0000","last_unstale":"2024-09-12T00:04:17.950912+0000","last_undegraded":"2024-09-12T00:04:17.950912+0000","last_fullsized":"2024-09-12T00:04:17.950912+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:27.562174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":67,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643906+0000","last_change":"2024-09-12T00:03:23.609055+0000","last_active":"2024-09-12T00:04:18.643906+0000","last_peered":"2024-09-12T00:04:18.643906+0000","last_clean":"2024-09-12T00:04:18.643906+0000","last_became_active":"2024-09-12T00:03:23.608101+0000","last_became_peered":"2024-09-12T00:03:23.608101+0000","last_unstale":"2024-09-12T00:04:18.643906+0000","last_undegraded":"2024-09-12T00:04:18.643906+0000","last_fullsized":"2024-09-12T00:04:18.643906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951093+0000","last_change":"2024-09-12T00:03:25.324744+0000","last_active":"2024-09-12T00:04:17.951093+0000","last_peered":"2024-09-12T00:04:17.951093+0000","last_clean":"2024-09-12T00:04:17.951093+0000","last_became_active":"2024-09-12T00:03:25.324199+0000","last_became_peered":"2024-09-12T00:03:25.324199+0000","last_unstale":"2024-09-12T00:04:17.951093+0000","last_undegraded":"2024-09-12T00:04:17.951093+0000","last_fullsized":"2024-09-12T00:04:17.951093+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:12.547802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":67,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643875+0000","last_change":"2024-09-12T00:03:23.616706+0000","last_active":"2024-09-12T00:04:18.643875+0000","last_peered":"2024-09-12T00:04:18.643875+0000","last_clean":"2024-09-12T00:04:18.643875+0000","last_became_active":"2024-09-12T00:03:23.615970+0000","last_became_peered":"2024-09-12T00:03:23.615970+0000","last_unstale":"2024-09-12T00:04:18.643875+0000","last_undegraded":"2024-09-12T00:04:18.643875+0000","last_fullsized":"2024-09-12T00:04:18.643875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.643035+0000","last_change":"2024-09-12T00:03:25.343716+0000","last_active":"2024-09-12T00:04:18.643035+0000","last_peered":"2024-09-12T00:04:18.643035+0000","last_clean":"2024-09-12T00:04:18.643035+0000","last_became_active":"2024-09-12T00:03:25.342930+0000","last_became_peered":"2024-09-12T00:03:25.342930+0000","last_unstale":"2024-09-12T00:04:18.643035+0000","last_undegraded":"2024-09-12T00:04:18.643035+0000","last_fullsized":"2024-09-12T00:04:18.643035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.649677+0000","last_change":"2024-09-12T00:03:23.612903+0000","last_active":"2024-09-12T00:04:18.649677+0000","last_peered":"2024-09-12T00:04:18.649677+0000","last_clean":"2024-09-12T00:04:18.649677+0000","last_became_active":"2024-09-12T00:03:23.612448+0000","last_became_peered":"2024-09-12T00:03:23.612448+0000","last_unstale":"2024-09-12T00:04:18.649677+0000","last_undegraded":"2024-09-12T00:04:18.649677+0000","last_fullsized":"2024-09-12T00:04:18.649677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:14.913580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950722+0000","last_change":"2024-09-12T00:03:25.326620+0000","last_active":"2024-09-12T00:04:17.950722+0000","last_peered":"2024-09-12T00:04:17.950722+0000","last_clean":"2024-09-12T00:04:17.950722+0000","last_became_active":"2024-09-12T00:03:25.326262+0000","last_became_peered":"2024-09-12T00:03:25.326262+0000","last_unstale":"2024-09-12T00:04:17.950722+0000","last_undegraded":"2024-09-12T00:04:17.950722+0000","last_fullsized":"2024-09-12T00:04:17.950722+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951594+0000","last_change":"2024-09-12T00:03:23.632200+0000","last_active":"2024-09-12T00:04:17.951594+0000","last_peered":"2024-09-12T00:04:17.951594+0000","last_clean":"2024-09-12T00:04:17.951594+0000","last_became_active":"2024-09-12T00:03:23.631510+0000","last_became_peered":"2024-09-12T00:03:23.631510+0000","last_unstale":"2024-09-12T00:04:17.951594+0000","last_undegraded":"2024-09-12T00:04:17.951594+0000","last_fullsized":"2024-09-12T00:04:17.951594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:07.177242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953731+0000","last_change":"2024-09-12T00:03:25.342763+0000","last_active":"2024-09-12T00:04:17.953731+0000","last_peered":"2024-09-12T00:04:17.953731+0000","last_clean":"2024-09-12T00:04:17.953731+0000","last_became_active":"2024-09-12T00:03:25.337834+0000","last_became_peered":"2024-09-12T00:03:25.337834+0000","last_unstale":"2024-09-12T00:04:17.953731+0000","last_undegraded":"2024-09-12T00:04:17.953731+0000","last_fullsized":"2024-09-12T00:04:17.953731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:35.920599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.644711+0000","last_change":"2024-09-12T00:03:23.630533+0000","last_active":"2024-09-12T00:04:17.644711+0000","last_peered":"2024-09-12T00:04:17.644711+0000","last_clean":"2024-09-12T00:04:17.644711+0000","last_became_active":"2024-09-12T00:03:23.630187+0000","last_became_peered":"2024-09-12T00:03:23.630187+0000","last_unstale":"2024-09-12T00:04:17.644711+0000","last_undegraded":"2024-09-12T00:04:17.644711+0000","last_fullsized":"2024-09-12T00:04:17.644711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:18.692638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953494+0000","last_change":"2024-09-12T00:03:25.339910+0000","last_active":"2024-09-12T00:04:17.953494+0000","last_peered":"2024-09-12T00:04:17.953494+0000","last_clean":"2024-09-12T00:04:17.953494+0000","last_became_active":"2024-09-12T00:03:25.336511+0000","last_became_peered":"2024-09-12T00:03:25.336511+0000","last_unstale":"2024-09-12T00:04:17.953494+0000","last_undegraded":"2024-09-12T00:04:17.953494+0000","last_fullsized":"2024-09-12T00:04:17.953494+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:30.647474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950226+0000","last_change":"2024-09-12T00:03:23.626232+0000","last_active":"2024-09-12T00:04:17.950226+0000","last_peered":"2024-09-12T00:04:17.950226+0000","last_clean":"2024-09-12T00:04:17.950226+0000","last_became_active":"2024-09-12T00:03:23.621761+0000","last_became_peered":"2024-09-12T00:03:23.621761+0000","last_unstale":"2024-09-12T00:04:17.950226+0000","last_undegraded":"2024-09-12T00:04:17.950226+0000","last_fullsized":"2024-09-12T00:04:17.950226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:31.587668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950964+0000","last_change":"2024-09-12T00:03:25.341017+0000","last_active":"2024-09-12T00:04:17.950964+0000","last_peered":"2024-09-12T00:04:17.950964+0000","last_clean":"2024-09-12T00:04:17.950964+0000","last_became_active":"2024-09-12T00:03:25.340279+0000","last_became_peered":"2024-09-12T00:03:25.340279+0000","last_unstale":"2024-09-12T00:04:17.950964+0000","last_undegraded":"2024-09-12T00:04:17.950964+0000","last_fullsized":"2024-09-12T00:04:17.950964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:08.066950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951347+0000","last_change":"2024-09-12T00:03:23.600956+0000","last_active":"2024-09-12T00:04:17.951347+0000","last_peered":"2024-09-12T00:04:17.951347+0000","last_clean":"2024-09-12T00:04:17.951347+0000","last_became_active":"2024-09-12T00:03:23.600673+0000","last_became_peered":"2024-09-12T00:03:23.600673+0000","last_unstale":"2024-09-12T00:04:17.951347+0000","last_undegraded":"2024-09-12T00:04:17.951347+0000","last_fullsized":"2024-09-12T00:04:17.951347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951582+0000","last_change":"2024-09-12T00:03:25.325088+0000","last_active":"2024-09-12T00:04:17.951582+0000","last_peered":"2024-09-12T00:04:17.951582+0000","last_clean":"2024-09-12T00:04:17.951582+0000","last_became_active":"2024-09-12T00:03:25.324597+0000","last_became_peered":"2024-09-12T00:03:25.324597+0000","last_unstale":"2024-09-12T00:04:17.951582+0000","last_undegraded":"2024-09-12T00:04:17.951582+0000","last_fullsized":"2024-09-12T00:04:17.951582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646277+0000","last_change":"2024-09-12T00:03:23.621791+0000","last_active":"2024-09-12T00:04:18.646277+0000","last_peered":"2024-09-12T00:04:18.646277+0000","last_clean":"2024-09-12T00:04:18.646277+0000","last_became_active":"2024-09-12T00:03:23.621063+0000","last_became_peered":"2024-09-12T00:03:23.621063+0000","last_unstale":"2024-09-12T00:04:18.646277+0000","last_undegraded":"2024-09-12T00:04:18.646277+0000","last_fullsized":"2024-09-12T00:04:18.646277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:33.234598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.951498+0000","last_change":"2024-09-12T00:03:25.357605+0000","last_active":"2024-09-12T00:04:17.951498+0000","last_peered":"2024-09-12T00:04:17.951498+0000","last_clean":"2024-09-12T00:04:17.951498+0000","last_became_active":"2024-09-12T00:03:25.357286+0000","last_became_peered":"2024-09-12T00:03:25.357286+0000","last_unstale":"2024-09-12T00:04:17.951498+0000","last_undegraded":"2024-09-12T00:04:17.951498+0000","last_fullsized":"2024-09-12T00:04:17.951498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.954836+0000","last_change":"2024-09-12T00:03:23.600931+0000","last_active":"2024-09-12T00:04:17.954836+0000","last_peered":"2024-09-12T00:04:17.954836+0000","last_clean":"2024-09-12T00:04:17.954836+0000","last_became_active":"2024-09-12T00:03:23.600591+0000","last_became_peered":"2024-09-12T00:03:23.600591+0000","last_unstale":"2024-09-12T00:04:17.954836+0000","last_undegraded":"2024-09-12T00:04:17.954836+0000","last_fullsized":"2024-09-12T00:04:17.954836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.952756+0000","last_change":"2024-09-12T00:03:25.330869+0000","last_active":"2024-09-12T00:04:17.952756+0000","last_peered":"2024-09-12T00:04:17.952756+0000","last_clean":"2024-09-12T00:04:17.952756+0000","last_became_active":"2024-09-12T00:03:25.329742+0000","last_became_peered":"2024-09-12T00:03:25.329742+0000","last_unstale":"2024-09-12T00:04:17.952756+0000","last_undegraded":"2024-09-12T00:04:17.952756+0000","last_fullsized":"2024-09-12T00:04:17.952756+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:01.365985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.642903+0000","last_change":"2024-09-12T00:03:23.604388+0000","last_active":"2024-09-12T00:04:17.642903+0000","last_peered":"2024-09-12T00:04:17.642903+0000","last_clean":"2024-09-12T00:04:17.642903+0000","last_became_active":"2024-09-12T00:03:23.603608+0000","last_became_peered":"2024-09-12T00:03:23.603608+0000","last_unstale":"2024-09-12T00:04:17.642903+0000","last_undegraded":"2024-09-12T00:04:17.642903+0000","last_fullsized":"2024-09-12T00:04:17.642903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:19.941103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.646144+0000","last_change":"2024-09-12T00:03:25.347570+0000","last_active":"2024-09-12T00:04:18.646144+0000","last_peered":"2024-09-12T00:04:18.646144+0000","last_clean":"2024-09-12T00:04:18.646144+0000","last_became_active":"2024-09-12T00:03:25.346874+0000","last_became_peered":"2024-09-12T00:03:25.346874+0000","last_unstale":"2024-09-12T00:04:18.646144+0000","last_undegraded":"2024-09-12T00:04:18.646144+0000","last_fullsized":"2024-09-12T00:04:18.646144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.953612+0000","last_change":"2024-09-12T00:03:23.623417+0000","last_active":"2024-09-12T00:04:17.953612+0000","last_peered":"2024-09-12T00:04:17.953612+0000","last_clean":"2024-09-12T00:04:17.953612+0000","last_became_active":"2024-09-12T00:03:23.620261+0000","last_became_peered":"2024-09-12T00:03:23.620261+0000","last_unstale":"2024-09-12T00:04:17.953612+0000","last_undegraded":"2024-09-12T00:04:17.953612+0000","last_fullsized":"2024-09-12T00:04:17.953612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950642+0000","last_change":"2024-09-12T00:03:25.357492+0000","last_active":"2024-09-12T00:04:17.950642+0000","last_peered":"2024-09-12T00:04:17.950642+0000","last_clean":"2024-09-12T00:04:17.950642+0000","last_became_active":"2024-09-12T00:03:25.357186+0000","last_became_peered":"2024-09-12T00:03:25.357186+0000","last_unstale":"2024-09-12T00:04:17.950642+0000","last_undegraded":"2024-09-12T00:04:17.950642+0000","last_fullsized":"2024-09-12T00:04:17.950642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.643547+0000","last_change":"2024-09-12T00:03:23.607247+0000","last_active":"2024-09-12T00:04:17.643547+0000","last_peered":"2024-09-12T00:04:17.643547+0000","last_clean":"2024-09-12T00:04:17.643547+0000","last_became_active":"2024-09-12T00:03:23.606625+0000","last_became_peered":"2024-09-12T00:03:23.606625+0000","last_unstale":"2024-09-12T00:04:17.643547+0000","last_undegraded":"2024-09-12T00:04:17.643547+0000","last_fullsized":"2024-09-12T00:04:17.643547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:04.927836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.644704+0000","last_change":"2024-09-12T00:03:23.611398+0000","last_active":"2024-09-12T00:04:17.644704+0000","last_peered":"2024-09-12T00:04:17.644704+0000","last_clean":"2024-09-12T00:04:17.644704+0000","last_became_active":"2024-09-12T00:03:23.610918+0000","last_became_peered":"2024-09-12T00:03:23.610918+0000","last_unstale":"2024-09-12T00:04:17.644704+0000","last_undegraded":"2024-09-12T00:04:17.644704+0000","last_fullsized":"2024-09-12T00:04:17.644704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:28.688159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":61,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T00:04:18.647410+0000","last_change":"2024-09-12T00:03:25.350116+0000","last_active":"2024-09-12T00:04:18.647410+0000","last_peered":"2024-09-12T00:04:18.647410+0000","last_clean":"2024-09-12T00:04:18.647410+0000","last_became_active":"2024-09-12T00:03:25.349281+0000","last_became_peered":"2024-09-12T00:03:25.349281+0000","last_unstale":"2024-09-12T00:04:18.647410+0000","last_undegraded":"2024-09-12T00:04:18.647410+0000","last_fullsized":"2024-09-12T00:04:18.647410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:33.350458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.950275+0000","last_change":"2024-09-12T00:03:23.619574+0000","last_active":"2024-09-12T00:04:17.950275+0000","last_peered":"2024-09-12T00:04:17.950275+0000","last_clean":"2024-09-12T00:04:17.950275+0000","last_became_active":"2024-09-12T00:03:23.616154+0000","last_became_peered":"2024-09-12T00:03:23.616154+0000","last_unstale":"2024-09-12T00:04:17.950275+0000","last_undegraded":"2024-09-12T00:04:17.950275+0000","last_fullsized":"2024-09-12T00:04:17.950275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:46.335775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T00:04:17.952558+0000","last_change":"2024-09-12T00:03:25.345327+0000","last_active":"2024-09-12T00:04:17.952558+0000","last_peered":"2024-09-12T00:04:17.952558+0000","last_clean":"2024-09-12T00:04:17.952558+0000","last_became_active":"2024-09-12T00:03:25.344917+0000","last_became_peered":"2024-09-12T00:03:25.344917+0000","last_unstale":"2024-09-12T00:04:17.952558+0000","last_undegraded":"2024-09-12T00:04:17.952558+0000","last_fullsized":"2024-09-12T00:04:17.952558+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":977,"num_read_kb":704,"num_write":611,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":582,"ondisk_log_size":582,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":606208,"data_stored":287326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27644,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":626688,"data_stored":296481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1212416,"data_stored":885511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":622592,"data_stored":295189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":614400,"data_stored":294878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":593920,"data_stored":294483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1245184,"data_stored":887434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31820,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340020,"statfs":{"total":96636764160,"available":96604180480,"internally_reserved":0,"allocated":643072,"data_stored":295655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:04:21.747 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T00:04:21.747 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T00:04:21.749 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:21.751+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:21.803 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:21.803 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:21.817 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:04:21.865 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:21.867+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:21.948 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:21.948 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:21.951 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:21.951+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:21.963 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:04:22.051 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:22.051+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:22.130 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:22.130 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:22.144 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:04:22.153 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:22.149+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:22.254 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:22.255+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:22.308 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:22.308 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:22.323 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:04:22.354 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:22.353+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:22.456 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:22.455+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:22.491 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:22.492 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:22.507 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:04:22.594 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:22.595+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:22.657 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:22.659+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:22.672 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:22.672 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:22.687 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:04:22.688 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T00:04:22.758 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:22.757+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:22.857 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:22.857 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:22.859 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:22.857+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:22.871 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:04:22.960 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:22.957+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:22.993 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:22.993 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:23.008 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:04:23.063 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:23.061+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:23.128 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:23.129 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:23.143 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:04:23.164 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:23.161+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:23.218 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:04:23.259 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:23.260 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:23.265 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:23.267+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:23.275 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:04:23.365 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:23.365 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:23.366 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:23.367+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:23.395 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:23.395 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:23.425 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:23.426 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:23.437 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:23.438 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:23.441 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:23.452 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:04:23.459 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:23.460 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:23.467 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:23.465+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:23.477 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:23.477 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:23.493 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:23.493 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:23.523 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:23.524 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:23.568 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:23.567+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:23.617 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:23.617 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:04:23.618 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:04:23.618 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:04:23.618 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:23.633 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:04:23.678 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:23.679+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:23.769 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:23.769+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:23.799 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:23.799 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:04:23.799 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:04:23.800 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:04:23.800 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.800 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:23.800 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:04:23.800 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 52.311975038, 2024-09-12T00:04:23.800 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0032495720000000001, 2024-09-12T00:04:23.800 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:23.800 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:23.800 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:23.800 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:23.800 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:23.800 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:23.800 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 193 2024-09-12T00:04:23.801 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.801 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:23.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.801 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:23.801 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:04:23.801 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.801 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.801 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:23.801 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486924+0000", 2024-09-12T00:04:23.801 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.801 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.802 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:23.802 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486926+0000", 2024-09-12T00:04:23.802 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.463e-06 2024-09-12T00:04:23.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.802 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.802 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:23.802 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486937+0000", 2024-09-12T00:04:23.802 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1147e-05 2024-09-12T00:04:23.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.802 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.802 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:23.802 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486968+0000", 2024-09-12T00:04:23.802 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1077000000000001e-05 2024-09-12T00:04:23.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.803 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:23.803 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.486985+0000", 2024-09-12T00:04:23.803 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6399e-05 2024-09-12T00:04:23.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.803 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:23.803 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487139+0000", 2024-09-12T00:04:23.803 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015403199999999999 2024-09-12T00:04:23.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.803 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:23.803 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487375+0000", 2024-09-12T00:04:23.803 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023621499999999999 2024-09-12T00:04:23.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.804 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.804 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:23.804 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.487634+0000", 2024-09-12T00:04:23.804 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000259351 2024-09-12T00:04:23.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.804 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.804 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:23.804 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.489156+0000", 2024-09-12T00:04:23.804 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015213869999999999 2024-09-12T00:04:23.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.804 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.804 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:23.804 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.489974+0000", 2024-09-12T00:04:23.805 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00081855600000000001 2024-09-12T00:04:23.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.805 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:23.805 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.490064+0000", 2024-09-12T00:04:23.805 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9205999999999999e-05 2024-09-12T00:04:23.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.805 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:23.805 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:31.490173+0000", 2024-09-12T00:04:23.805 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109739 2024-09-12T00:04:23.805 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.805 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:23.805 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.806 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.806 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:04:23.806 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:04:23.806 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 49.435535495000003, 2024-09-12T00:04:23.806 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039523630000000004, 2024-09-12T00:04:23.806 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:23.806 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:23.806 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:23.806 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:23.806 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:23.806 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:23.806 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 208 2024-09-12T00:04:23.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.806 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:23.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.807 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:23.807 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:04:23.807 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.807 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:23.807 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363363+0000", 2024-09-12T00:04:23.807 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.807 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:23.807 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363366+0000", 2024-09-12T00:04:23.807 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.004e-06 2024-09-12T00:04:23.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.808 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.808 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:23.808 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363379+0000", 2024-09-12T00:04:23.808 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2943e-05 2024-09-12T00:04:23.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.808 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.808 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:23.808 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363412+0000", 2024-09-12T00:04:23.808 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2808999999999997e-05 2024-09-12T00:04:23.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.808 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.808 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:23.808 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363430+0000", 2024-09-12T00:04:23.809 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8003e-05 2024-09-12T00:04:23.809 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.809 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.809 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:23.809 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363654+0000", 2024-09-12T00:04:23.809 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022394900000000001 2024-09-12T00:04:23.809 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.809 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.809 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:23.809 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.363897+0000", 2024-09-12T00:04:23.809 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024272399999999999 2024-09-12T00:04:23.809 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.809 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.809 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:23.810 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.364326+0000", 2024-09-12T00:04:23.810 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042963399999999997 2024-09-12T00:04:23.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.810 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.810 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:23.810 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.365757+0000", 2024-09-12T00:04:23.810 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014303969999999999 2024-09-12T00:04:23.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.810 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.810 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:23.810 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367031+0000", 2024-09-12T00:04:23.810 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001274269 2024-09-12T00:04:23.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.810 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.810 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:23.811 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367197+0000", 2024-09-12T00:04:23.811 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016645900000000001 2024-09-12T00:04:23.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.811 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.811 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:23.811 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.367316+0000", 2024-09-12T00:04:23.811 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011817200000000001 2024-09-12T00:04:23.811 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.811 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:23.811 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.811 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.811 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:23.811 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:04:23.812 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 49.378277191000002, 2024-09-12T00:04:23.812 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033190419999999999, 2024-09-12T00:04:23.812 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:23.812 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:23.812 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:23.812 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:23.812 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:23.812 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:23.812 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 219 2024-09-12T00:04:23.812 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.812 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:23.812 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.812 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:23.812 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:04:23.813 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.813 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.813 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.813 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:23.813 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420622+0000", 2024-09-12T00:04:23.813 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.813 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.813 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.813 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:23.813 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420624+0000", 2024-09-12T00:04:23.813 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0829999999999998e-06 2024-09-12T00:04:23.813 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.813 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.813 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:23.814 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420633+0000", 2024-09-12T00:04:23.814 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8500000000000006e-06 2024-09-12T00:04:23.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.814 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.814 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:23.814 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420663+0000", 2024-09-12T00:04:23.814 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9597000000000001e-05 2024-09-12T00:04:23.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.814 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.814 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:23.814 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420681+0000", 2024-09-12T00:04:23.814 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7646e-05 2024-09-12T00:04:23.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.814 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.815 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:23.815 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.420791+0000", 2024-09-12T00:04:23.815 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109979 2024-09-12T00:04:23.815 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.815 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.815 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:23.815 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.421042+0000", 2024-09-12T00:04:23.815 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025117199999999997 2024-09-12T00:04:23.815 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.815 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.815 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:23.815 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.421487+0000", 2024-09-12T00:04:23.815 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00044476599999999998 2024-09-12T00:04:23.815 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.816 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.816 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:23.816 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.422884+0000", 2024-09-12T00:04:23.816 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0013975109999999999 2024-09-12T00:04:23.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.816 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.816 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:23.816 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423797+0000", 2024-09-12T00:04:23.816 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00091310899999999995 2024-09-12T00:04:23.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.816 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.816 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:23.816 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423879+0000", 2024-09-12T00:04:23.816 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1829000000000005e-05 2024-09-12T00:04:23.817 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.817 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.817 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:23.817 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.423941+0000", 2024-09-12T00:04:23.817 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1500000000000004e-05 2024-09-12T00:04:23.817 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.817 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:23.817 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.817 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.817 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.817 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:23.817 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:04:23.817 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 49.360636591999999, 2024-09-12T00:04:23.817 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003232782, 2024-09-12T00:04:23.818 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:23.818 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:23.818 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:23.818 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:23.818 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:23.818 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:23.818 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 224 2024-09-12T00:04:23.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.818 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:23.818 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.818 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:23.818 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:04:23.818 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.819 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.819 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:23.819 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438262+0000", 2024-09-12T00:04:23.819 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.819 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.819 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:23.819 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438265+0000", 2024-09-12T00:04:23.819 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.666e-06 2024-09-12T00:04:23.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.819 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.819 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:23.819 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438276+0000", 2024-09-12T00:04:23.819 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1387e-05 2024-09-12T00:04:23.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.820 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.820 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:23.820 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438306+0000", 2024-09-12T00:04:23.820 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0069999999999998e-05 2024-09-12T00:04:23.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.820 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.820 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:23.820 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438321+0000", 2024-09-12T00:04:23.820 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.517e-05 2024-09-12T00:04:23.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.820 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.820 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:23.820 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438459+0000", 2024-09-12T00:04:23.820 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013781899999999999 2024-09-12T00:04:23.821 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.821 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.821 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:23.821 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.438671+0000", 2024-09-12T00:04:23.821 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021214500000000001 2024-09-12T00:04:23.821 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.821 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.821 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:23.821 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.439093+0000", 2024-09-12T00:04:23.821 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042117899999999999 2024-09-12T00:04:23.821 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.821 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.821 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:23.821 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.440400+0000", 2024-09-12T00:04:23.822 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0013072719999999999 2024-09-12T00:04:23.822 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.822 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.822 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:23.822 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441339+0000", 2024-09-12T00:04:23.822 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00093906600000000001 2024-09-12T00:04:23.822 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.822 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.822 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:23.822 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441429+0000", 2024-09-12T00:04:23.822 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0358999999999993e-05 2024-09-12T00:04:23.822 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.822 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.822 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:23.823 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.441495+0000", 2024-09-12T00:04:23.823 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5648999999999994e-05 2024-09-12T00:04:23.823 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.823 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:23.823 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.823 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.823 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.823 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:23.823 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:04:23.823 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 49.321137620000002, 2024-09-12T00:04:23.823 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003225716, 2024-09-12T00:04:23.823 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:23.823 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:23.823 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:23.823 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:23.824 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:23.824 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:23.824 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 235 2024-09-12T00:04:23.824 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.824 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:23.824 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.824 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:23.824 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:04:23.824 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.824 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.824 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.824 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:23.824 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477761+0000", 2024-09-12T00:04:23.824 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.825 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.825 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.825 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:23.825 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477764+0000", 2024-09-12T00:04:23.825 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.48e-06 2024-09-12T00:04:23.825 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.825 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.825 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:23.825 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477775+0000", 2024-09-12T00:04:23.825 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1163e-05 2024-09-12T00:04:23.825 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.825 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.825 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:23.825 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477807+0000", 2024-09-12T00:04:23.825 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1860000000000003e-05 2024-09-12T00:04:23.826 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.826 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.826 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:23.826 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477822+0000", 2024-09-12T00:04:23.826 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5302999999999999e-05 2024-09-12T00:04:23.826 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.826 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.826 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:23.826 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.477959+0000", 2024-09-12T00:04:23.826 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013695600000000001 2024-09-12T00:04:23.826 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.826 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.826 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:23.827 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.478184+0000", 2024-09-12T00:04:23.827 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022484800000000001 2024-09-12T00:04:23.827 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.827 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.827 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:23.827 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.478657+0000", 2024-09-12T00:04:23.827 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000473413 2024-09-12T00:04:23.827 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.827 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.827 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:23.827 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480162+0000", 2024-09-12T00:04:23.827 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00150454 2024-09-12T00:04:23.827 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.827 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.827 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:23.828 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480792+0000", 2024-09-12T00:04:23.828 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00063012400000000003 2024-09-12T00:04:23.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.828 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.828 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:23.828 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480906+0000", 2024-09-12T00:04:23.828 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113909 2024-09-12T00:04:23.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.828 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.828 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:23.828 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.480987+0000", 2024-09-12T00:04:23.828 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1119999999999996e-05 2024-09-12T00:04:23.828 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.829 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:23.829 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.829 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.829 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.829 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:237 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:23.829 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:04:23.829 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 49.313816248999998, 2024-09-12T00:04:23.829 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0074291790000000002, 2024-09-12T00:04:23.829 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:23.829 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:23.829 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:23.829 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:23.829 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:23.829 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:23.829 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 237 2024-09-12T00:04:23.830 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.830 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:23.830 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.830 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:23.830 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:04:23.830 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.830 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.830 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.830 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:23.830 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485082+0000", 2024-09-12T00:04:23.830 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.830 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.830 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.830 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:23.831 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485086+0000", 2024-09-12T00:04:23.831 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.05e-06 2024-09-12T00:04:23.831 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.831 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.831 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:23.831 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485101+0000", 2024-09-12T00:04:23.831 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5186e-05 2024-09-12T00:04:23.831 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.831 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.831 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:23.831 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485140+0000", 2024-09-12T00:04:23.831 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8896000000000002e-05 2024-09-12T00:04:23.831 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.831 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.832 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:23.832 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485162+0000", 2024-09-12T00:04:23.832 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2654e-05 2024-09-12T00:04:23.832 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.832 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.832 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:23.832 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485314+0000", 2024-09-12T00:04:23.832 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015150799999999999 2024-09-12T00:04:23.832 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.832 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.832 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:23.832 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485549+0000", 2024-09-12T00:04:23.832 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000235665 2024-09-12T00:04:23.832 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.833 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.833 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:23.833 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486064+0000", 2024-09-12T00:04:23.833 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00051418899999999997 2024-09-12T00:04:23.833 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.833 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.833 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:23.833 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.488211+0000", 2024-09-12T00:04:23.833 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0021470819999999998 2024-09-12T00:04:23.833 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.833 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.833 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:23.833 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492273+0000", 2024-09-12T00:04:23.833 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040617980000000001 2024-09-12T00:04:23.834 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.834 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.834 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:23.834 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492391+0000", 2024-09-12T00:04:23.834 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118613 2024-09-12T00:04:23.834 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.834 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.834 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:23.834 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492512+0000", 2024-09-12T00:04:23.834 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120538 2024-09-12T00:04:23.834 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.834 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:23.834 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.834 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.834 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.835 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:244 6.17 e35/29 6:e9187ab8:reshard::reshard.0000000000:head v 35'1, mlcod=0'0)", 2024-09-12T00:04:23.835 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:04:23.835 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 49.311234014, 2024-09-12T00:04:23.835 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0034313239999999999, 2024-09-12T00:04:23.835 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:23.835 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:23.835 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:23.835 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:23.835 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.835 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:23.835 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:04:23.835 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.835 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.836 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:23.836 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487665+0000", 2024-09-12T00:04:23.836 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.836 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.836 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.836 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:23.836 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487667+0000", 2024-09-12T00:04:23.836 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4899999999999999e-06 2024-09-12T00:04:23.836 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.836 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.836 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:23.836 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487682+0000", 2024-09-12T00:04:23.836 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4929999999999999e-05 2024-09-12T00:04:23.836 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.837 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.837 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:23.837 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487740+0000", 2024-09-12T00:04:23.837 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8075000000000002e-05 2024-09-12T00:04:23.837 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.837 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.837 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:23.837 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487761+0000", 2024-09-12T00:04:23.837 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0769999999999999e-05 2024-09-12T00:04:23.837 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.837 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.837 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:23.837 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.487966+0000", 2024-09-12T00:04:23.837 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020516800000000001 2024-09-12T00:04:23.837 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.838 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.838 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:23.838 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.488012+0000", 2024-09-12T00:04:23.838 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5794000000000002e-05 2024-09-12T00:04:23.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.838 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.838 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:23.838 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.490965+0000", 2024-09-12T00:04:23.838 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0029530609999999999 2024-09-12T00:04:23.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.838 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.838 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:23.838 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491096+0000", 2024-09-12T00:04:23.838 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013103600000000001 2024-09-12T00:04:23.839 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.839 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:23.839 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.839 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.839 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.839 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:293 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:23.839 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:04:23.839 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 49.301282192999999, 2024-09-12T00:04:23.839 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0075915649999999998, 2024-09-12T00:04:23.839 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:23.839 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:23.839 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:23.839 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:23.839 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:23.839 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:23.840 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 293 2024-09-12T00:04:23.840 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.840 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:23.840 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.840 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:23.840 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:04:23.840 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.840 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.840 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.840 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:23.840 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497617+0000", 2024-09-12T00:04:23.840 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.840 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497626+0000", 2024-09-12T00:04:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2499999999999995e-06 2024-09-12T00:04:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497636+0000", 2024-09-12T00:04:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0139999999999999e-05 2024-09-12T00:04:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497660+0000", 2024-09-12T00:04:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4015999999999998e-05 2024-09-12T00:04:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.842 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.842 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:23.842 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497675+0000", 2024-09-12T00:04:23.842 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5339999999999999e-05 2024-09-12T00:04:23.842 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.842 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.842 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:23.842 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.497839+0000", 2024-09-12T00:04:23.842 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016347900000000001 2024-09-12T00:04:23.842 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.842 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.842 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:23.842 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498097+0000", 2024-09-12T00:04:23.842 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025825700000000002 2024-09-12T00:04:23.843 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.843 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.843 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:23.843 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.498618+0000", 2024-09-12T00:04:23.843 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052051300000000001 2024-09-12T00:04:23.843 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.843 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.843 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:23.843 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.501282+0000", 2024-09-12T00:04:23.843 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026646840000000001 2024-09-12T00:04:23.843 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.843 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.843 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:23.843 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505057+0000", 2024-09-12T00:04:23.844 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037747710000000001 2024-09-12T00:04:23.844 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.844 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.844 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:23.844 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505144+0000", 2024-09-12T00:04:23.844 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7466000000000006e-05 2024-09-12T00:04:23.844 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.844 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.844 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:23.844 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.505208+0000", 2024-09-12T00:04:23.845 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3649e-05 2024-09-12T00:04:23.845 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.845 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:23.845 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.845 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.845 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.845 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:413 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:23.845 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:04:23.845 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 49.270242580999998, 2024-09-12T00:04:23.845 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005252049, 2024-09-12T00:04:23.845 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:23.845 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:23.845 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:23.845 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:23.846 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:23.846 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:23.846 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 413 2024-09-12T00:04:23.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.846 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:23.846 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.846 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:23.846 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:04:23.846 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.846 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.846 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:23.846 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528656+0000", 2024-09-12T00:04:23.846 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.847 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.847 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:23.847 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528659+0000", 2024-09-12T00:04:23.847 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4739999999999999e-06 2024-09-12T00:04:23.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.847 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.847 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:23.847 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528669+0000", 2024-09-12T00:04:23.847 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0694e-05 2024-09-12T00:04:23.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.847 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.847 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:23.847 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528696+0000", 2024-09-12T00:04:23.847 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6846e-05 2024-09-12T00:04:23.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.848 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.848 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:23.848 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528711+0000", 2024-09-12T00:04:23.848 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4397e-05 2024-09-12T00:04:23.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.848 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.848 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:23.848 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.528884+0000", 2024-09-12T00:04:23.848 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017304700000000001 2024-09-12T00:04:23.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.848 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.848 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:23.849 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529162+0000", 2024-09-12T00:04:23.849 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027861999999999999 2024-09-12T00:04:23.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.849 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.849 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:23.849 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.529688+0000", 2024-09-12T00:04:23.849 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052593900000000001 2024-09-12T00:04:23.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.849 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.849 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:23.849 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.531480+0000", 2024-09-12T00:04:23.849 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0017920740000000001 2024-09-12T00:04:23.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.849 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.849 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:23.850 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533734+0000", 2024-09-12T00:04:23.850 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002254191 2024-09-12T00:04:23.850 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.850 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.850 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:23.850 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533845+0000", 2024-09-12T00:04:23.850 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110559 2024-09-12T00:04:23.850 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.850 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.850 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:23.850 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533908+0000", 2024-09-12T00:04:23.850 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3207999999999995e-05 2024-09-12T00:04:23.850 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.850 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:23.851 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.851 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.851 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:437 6.0 6:05588ce8:lc::lc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:23.851 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:04:23.851 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 49.263067092, 2024-09-12T00:04:23.851 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039419659999999999, 2024-09-12T00:04:23.851 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:23.851 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:23.851 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:23.851 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:23.851 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:23.851 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:23.851 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 437 2024-09-12T00:04:23.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.852 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:23.852 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.852 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:23.852 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:04:23.852 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.852 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.852 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:23.852 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535832+0000", 2024-09-12T00:04:23.852 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.852 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.852 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:23.852 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535834+0000", 2024-09-12T00:04:23.853 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2859999999999998e-06 2024-09-12T00:04:23.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.853 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.853 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:23.853 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535846+0000", 2024-09-12T00:04:23.853 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1643e-05 2024-09-12T00:04:23.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.853 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.853 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:23.853 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535877+0000", 2024-09-12T00:04:23.853 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1457000000000001e-05 2024-09-12T00:04:23.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.853 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.853 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:23.854 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535894+0000", 2024-09-12T00:04:23.854 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.668e-05 2024-09-12T00:04:23.854 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.854 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.854 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:23.854 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.535981+0000", 2024-09-12T00:04:23.854 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6823000000000005e-05 2024-09-12T00:04:23.854 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.854 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.854 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:23.854 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536086+0000", 2024-09-12T00:04:23.854 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010566200000000001 2024-09-12T00:04:23.854 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.854 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.855 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:23.855 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536330+0000", 2024-09-12T00:04:23.855 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024399999999999999 2024-09-12T00:04:23.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.855 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.855 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:23.855 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538288+0000", 2024-09-12T00:04:23.855 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0019575740000000001 2024-09-12T00:04:23.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.855 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.855 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:23.855 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539574+0000", 2024-09-12T00:04:23.855 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012862259999999999 2024-09-12T00:04:23.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.856 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.856 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:23.856 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539696+0000", 2024-09-12T00:04:23.856 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012190599999999999 2024-09-12T00:04:23.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.856 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.856 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:23.856 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539774+0000", 2024-09-12T00:04:23.856 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7708999999999997e-05 2024-09-12T00:04:23.856 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.856 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:23.856 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.856 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.857 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:464 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:23.857 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:04:23.857 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 49.254506110000001, 2024-09-12T00:04:23.857 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048192310000000002, 2024-09-12T00:04:23.857 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:23.857 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:23.857 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:23.857 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:23.857 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:23.857 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:23.857 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 464 2024-09-12T00:04:23.857 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.857 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:23.857 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.857 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:23.858 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:04:23.858 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.858 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.858 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:23.858 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544393+0000", 2024-09-12T00:04:23.858 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.858 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.858 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:23.858 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544395+0000", 2024-09-12T00:04:23.858 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.905e-06 2024-09-12T00:04:23.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.858 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.859 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:23.859 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544405+0000", 2024-09-12T00:04:23.859 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0583e-05 2024-09-12T00:04:23.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.859 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.859 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:23.859 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544435+0000", 2024-09-12T00:04:23.859 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9431e-05 2024-09-12T00:04:23.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.859 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.859 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:23.859 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544468+0000", 2024-09-12T00:04:23.859 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2978999999999997e-05 2024-09-12T00:04:23.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.860 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.860 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:23.860 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544573+0000", 2024-09-12T00:04:23.860 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105165 2024-09-12T00:04:23.860 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.860 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.860 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:23.860 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544714+0000", 2024-09-12T00:04:23.860 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000141061 2024-09-12T00:04:23.860 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.860 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.860 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:23.860 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.545414+0000", 2024-09-12T00:04:23.860 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00070066200000000001 2024-09-12T00:04:23.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.861 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.861 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:23.861 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.547475+0000", 2024-09-12T00:04:23.861 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020609119999999998 2024-09-12T00:04:23.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.861 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.861 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:23.861 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549067+0000", 2024-09-12T00:04:23.861 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0015914989999999999 2024-09-12T00:04:23.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.861 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.861 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:23.861 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549143+0000", 2024-09-12T00:04:23.861 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5795000000000002e-05 2024-09-12T00:04:23.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.862 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.862 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:23.862 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.549212+0000", 2024-09-12T00:04:23.862 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9239000000000006e-05 2024-09-12T00:04:23.862 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.862 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:23.862 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.864 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.864 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.864 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:495 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:23.864 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:04:23.864 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 49.243436611999996, 2024-09-12T00:04:23.864 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052520209999999999, 2024-09-12T00:04:23.864 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:23.864 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:23.864 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:23.864 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:23.864 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:23.864 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:23.864 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 495 2024-09-12T00:04:23.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.865 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:23.865 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.865 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:23.865 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:04:23.865 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.865 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.865 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:23.865 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555462+0000", 2024-09-12T00:04:23.865 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.865 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.865 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:23.866 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555464+0000", 2024-09-12T00:04:23.866 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8870000000000001e-06 2024-09-12T00:04:23.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.866 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.866 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:23.866 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555473+0000", 2024-09-12T00:04:23.866 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2399999999999996e-06 2024-09-12T00:04:23.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.866 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.866 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:23.866 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555496+0000", 2024-09-12T00:04:23.866 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2952e-05 2024-09-12T00:04:23.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.866 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.866 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:23.867 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555508+0000", 2024-09-12T00:04:23.867 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1548e-05 2024-09-12T00:04:23.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.867 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.867 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:23.867 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555596+0000", 2024-09-12T00:04:23.867 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8295999999999996e-05 2024-09-12T00:04:23.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.867 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.867 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:23.867 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555683+0000", 2024-09-12T00:04:23.867 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7267000000000003e-05 2024-09-12T00:04:23.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.867 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.868 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:23.868 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.555862+0000", 2024-09-12T00:04:23.868 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017910699999999999 2024-09-12T00:04:23.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.868 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.868 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:23.868 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.556696+0000", 2024-09-12T00:04:23.868 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000833353 2024-09-12T00:04:23.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.868 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.868 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:23.868 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560563+0000", 2024-09-12T00:04:23.868 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038672089999999999 2024-09-12T00:04:23.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.869 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.869 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:23.869 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560642+0000", 2024-09-12T00:04:23.869 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.8909e-05 2024-09-12T00:04:23.869 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.869 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.869 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:23.869 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.560714+0000", 2024-09-12T00:04:23.869 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2253000000000001e-05 2024-09-12T00:04:23.869 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.869 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:23.869 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.869 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.869 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.870 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:631 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:23.870 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:04:23.870 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 49.207609058000003, 2024-09-12T00:04:23.870 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0072389480000000003, 2024-09-12T00:04:23.870 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:23.870 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:23.870 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:23.870 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:23.870 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:23.870 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:23.870 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 631 2024-09-12T00:04:23.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.870 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:23.870 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.870 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:23.871 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:04:23.871 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.871 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.871 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:23.871 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591290+0000", 2024-09-12T00:04:23.871 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.871 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.871 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:23.871 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591292+0000", 2024-09-12T00:04:23.871 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0760000000000001e-06 2024-09-12T00:04:23.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.871 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.872 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:23.872 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591301+0000", 2024-09-12T00:04:23.872 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3880000000000006e-06 2024-09-12T00:04:23.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.872 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.872 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:23.872 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591323+0000", 2024-09-12T00:04:23.872 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2121999999999999e-05 2024-09-12T00:04:23.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.872 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.872 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:23.872 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591338+0000", 2024-09-12T00:04:23.872 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5126999999999999e-05 2024-09-12T00:04:23.873 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.873 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.873 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:23.873 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591449+0000", 2024-09-12T00:04:23.873 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011054500000000001 2024-09-12T00:04:23.873 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.873 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.873 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:23.873 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.591682+0000", 2024-09-12T00:04:23.873 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023258 2024-09-12T00:04:23.873 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.873 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.873 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:23.873 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.592011+0000", 2024-09-12T00:04:23.874 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00032941699999999998 2024-09-12T00:04:23.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.874 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.874 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:23.874 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.593493+0000", 2024-09-12T00:04:23.874 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014821599999999999 2024-09-12T00:04:23.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.874 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.874 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:23.874 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598356+0000", 2024-09-12T00:04:23.874 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048625329999999996 2024-09-12T00:04:23.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.874 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.874 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:23.874 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598456+0000", 2024-09-12T00:04:23.875 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9878999999999997e-05 2024-09-12T00:04:23.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.875 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.875 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:23.875 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598529+0000", 2024-09-12T00:04:23.875 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3120999999999993e-05 2024-09-12T00:04:23.875 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.875 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:23.875 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.875 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.875 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:650 6.4 6:26625e58:lc::lc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:23.875 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:04:23.875 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 49.199211513999998, 2024-09-12T00:04:23.876 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042727010000000003, 2024-09-12T00:04:23.876 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:23.876 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:23.876 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:23.876 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:23.876 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:23.876 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:23.876 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 650 2024-09-12T00:04:23.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.876 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:23.876 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.876 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:23.876 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:04:23.876 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.877 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.877 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.877 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:23.877 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599687+0000", 2024-09-12T00:04:23.877 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.877 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.877 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.877 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:23.877 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599689+0000", 2024-09-12T00:04:23.877 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3179999999999999e-06 2024-09-12T00:04:23.877 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.877 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.877 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:23.877 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599696+0000", 2024-09-12T00:04:23.878 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9580000000000001e-06 2024-09-12T00:04:23.878 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.878 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.878 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:23.878 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599714+0000", 2024-09-12T00:04:23.878 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8099999999999999e-05 2024-09-12T00:04:23.878 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.878 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.878 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:23.878 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599724+0000", 2024-09-12T00:04:23.878 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0492999999999999e-05 2024-09-12T00:04:23.878 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.878 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.878 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:23.878 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599799+0000", 2024-09-12T00:04:23.879 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5228999999999994e-05 2024-09-12T00:04:23.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.879 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.879 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:23.879 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599897+0000", 2024-09-12T00:04:23.879 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7476e-05 2024-09-12T00:04:23.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.879 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.879 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:23.879 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.600047+0000", 2024-09-12T00:04:23.879 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015028 2024-09-12T00:04:23.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.879 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.879 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:23.880 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.602604+0000", 2024-09-12T00:04:23.880 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0025571729999999998 2024-09-12T00:04:23.880 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.880 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.880 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:23.880 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603880+0000", 2024-09-12T00:04:23.880 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012753700000000001 2024-09-12T00:04:23.880 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.880 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.880 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:23.880 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603923+0000", 2024-09-12T00:04:23.880 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3758999999999999e-05 2024-09-12T00:04:23.880 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.880 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.881 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:23.881 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603960+0000", 2024-09-12T00:04:23.881 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6545000000000003e-05 2024-09-12T00:04:23.881 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.881 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:23.881 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.881 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.881 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.881 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:744 6.0 6:0651570b:lc::lc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:23.881 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:04:23.881 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 49.164920086000002, 2024-09-12T00:04:23.881 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048046149999999999, 2024-09-12T00:04:23.881 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:23.881 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:23.881 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:23.882 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:23.882 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:23.882 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:23.882 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 744 2024-09-12T00:04:23.882 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.882 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:23.882 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.882 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:23.882 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:04:23.882 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.882 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.882 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.882 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:23.882 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633979+0000", 2024-09-12T00:04:23.883 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.883 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.883 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.883 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:23.883 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633981+0000", 2024-09-12T00:04:23.883 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3740000000000001e-06 2024-09-12T00:04:23.883 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.883 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.883 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:23.883 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633991+0000", 2024-09-12T00:04:23.883 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7839999999999998e-06 2024-09-12T00:04:23.883 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.883 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.883 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:23.884 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634016+0000", 2024-09-12T00:04:23.884 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5075999999999998e-05 2024-09-12T00:04:23.884 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.884 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.884 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:23.884 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634031+0000", 2024-09-12T00:04:23.884 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5124e-05 2024-09-12T00:04:23.884 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.884 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.884 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:23.884 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634105+0000", 2024-09-12T00:04:23.884 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3595000000000003e-05 2024-09-12T00:04:23.884 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.884 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.885 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:23.885 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634183+0000", 2024-09-12T00:04:23.885 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7936999999999996e-05 2024-09-12T00:04:23.885 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.885 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.885 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:23.885 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634342+0000", 2024-09-12T00:04:23.885 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015910499999999999 2024-09-12T00:04:23.885 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.885 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.885 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:23.885 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.635262+0000", 2024-09-12T00:04:23.885 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00092051000000000003 2024-09-12T00:04:23.885 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.886 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.886 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:23.886 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638638+0000", 2024-09-12T00:04:23.886 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033756419999999999 2024-09-12T00:04:23.886 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.886 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.886 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:23.886 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638722+0000", 2024-09-12T00:04:23.886 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.4029000000000005e-05 2024-09-12T00:04:23.886 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.886 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.886 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:23.886 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638783+0000", 2024-09-12T00:04:23.886 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1439000000000006e-05 2024-09-12T00:04:23.887 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.887 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:23.887 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.887 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.887 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:875 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:23.887 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:04:23.887 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 49.115280654999999, 2024-09-12T00:04:23.887 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004522295, 2024-09-12T00:04:23.887 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:23.887 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:23.887 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:23.887 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:23.887 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:23.887 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:23.888 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 875 2024-09-12T00:04:23.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.888 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:23.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.888 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:23.888 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:04:23.888 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.888 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:23.888 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683618+0000", 2024-09-12T00:04:23.888 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.889 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:23.889 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683623+0000", 2024-09-12T00:04:23.889 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7140000000000001e-06 2024-09-12T00:04:23.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.889 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.889 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:23.889 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683639+0000", 2024-09-12T00:04:23.889 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6203000000000001e-05 2024-09-12T00:04:23.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.889 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.889 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:23.889 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683677+0000", 2024-09-12T00:04:23.889 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8470999999999998e-05 2024-09-12T00:04:23.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.890 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.890 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:23.890 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683708+0000", 2024-09-12T00:04:23.890 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0793999999999997e-05 2024-09-12T00:04:23.890 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.890 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.890 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:23.890 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683827+0000", 2024-09-12T00:04:23.890 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011832699999999999 2024-09-12T00:04:23.890 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.890 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.890 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:23.890 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.683945+0000", 2024-09-12T00:04:23.890 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118301 2024-09-12T00:04:23.890 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.891 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.891 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:23.891 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.684226+0000", 2024-09-12T00:04:23.891 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000280604 2024-09-12T00:04:23.891 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.891 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.891 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:23.891 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685790+0000", 2024-09-12T00:04:23.891 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001564651 2024-09-12T00:04:23.891 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.891 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.891 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:23.891 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688028+0000", 2024-09-12T00:04:23.891 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0022381129999999999 2024-09-12T00:04:23.892 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.892 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.892 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:23.892 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688093+0000", 2024-09-12T00:04:23.892 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4329e-05 2024-09-12T00:04:23.892 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.892 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.892 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:23.892 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688140+0000", 2024-09-12T00:04:23.892 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7787999999999997e-05 2024-09-12T00:04:23.892 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.892 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:23.892 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.892 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.893 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.893 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:878 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:23.893 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:04:23.893 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 49.113636526000001, 2024-09-12T00:04:23.893 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037933009999999998, 2024-09-12T00:04:23.893 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:23.893 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:23.893 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:23.893 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:23.893 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:23.893 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:23.893 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 878 2024-09-12T00:04:23.893 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.893 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:23.893 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.894 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:23.894 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:04:23.894 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.894 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.894 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.894 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:23.894 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685262+0000", 2024-09-12T00:04:23.894 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.894 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.894 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.894 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:23.894 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685265+0000", 2024-09-12T00:04:23.894 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.525e-06 2024-09-12T00:04:23.894 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.895 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.895 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:23.895 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685276+0000", 2024-09-12T00:04:23.895 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.076e-05 2024-09-12T00:04:23.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.895 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.895 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:23.895 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685306+0000", 2024-09-12T00:04:23.895 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0803000000000003e-05 2024-09-12T00:04:23.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.895 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.895 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:23.895 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685327+0000", 2024-09-12T00:04:23.895 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1061e-05 2024-09-12T00:04:23.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.896 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.896 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:23.896 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685429+0000", 2024-09-12T00:04:23.896 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000102015 2024-09-12T00:04:23.896 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.896 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.896 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:23.896 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685580+0000", 2024-09-12T00:04:23.896 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000151096 2024-09-12T00:04:23.896 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.896 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.896 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:23.896 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685861+0000", 2024-09-12T00:04:23.896 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028068100000000002 2024-09-12T00:04:23.897 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.897 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.897 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:23.897 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688647+0000", 2024-09-12T00:04:23.897 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0027860979999999999 2024-09-12T00:04:23.897 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.897 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.897 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:23.897 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688909+0000", 2024-09-12T00:04:23.897 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026159600000000001 2024-09-12T00:04:23.897 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.897 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.897 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:23.897 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.688991+0000", 2024-09-12T00:04:23.898 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2429999999999995e-05 2024-09-12T00:04:23.898 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.898 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.898 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:23.898 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689056+0000", 2024-09-12T00:04:23.898 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4236e-05 2024-09-12T00:04:23.898 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.898 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:23.898 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.898 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.898 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.898 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:881 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:23.898 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:04:23.898 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 49.113002342999998, 2024-09-12T00:04:23.899 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003307979, 2024-09-12T00:04:23.899 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:23.899 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:23.899 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:23.899 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:23.899 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:23.899 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:23.899 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 881 2024-09-12T00:04:23.899 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.899 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:23.899 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.899 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:23.899 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:04:23.899 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.900 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.900 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:23.900 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685896+0000", 2024-09-12T00:04:23.900 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.900 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.900 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:23.900 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685898+0000", 2024-09-12T00:04:23.900 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4249999999999999e-06 2024-09-12T00:04:23.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.900 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.900 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:23.900 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685904+0000", 2024-09-12T00:04:23.901 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1290000000000001e-06 2024-09-12T00:04:23.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.901 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:23.901 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685917+0000", 2024-09-12T00:04:23.901 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2825e-05 2024-09-12T00:04:23.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.901 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:23.901 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.685925+0000", 2024-09-12T00:04:23.901 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6589999999999996e-06 2024-09-12T00:04:23.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.901 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:23.902 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686156+0000", 2024-09-12T00:04:23.902 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023017299999999999 2024-09-12T00:04:23.902 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.902 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.902 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:23.902 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686365+0000", 2024-09-12T00:04:23.902 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000209442 2024-09-12T00:04:23.902 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.902 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.902 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:23.902 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.686567+0000", 2024-09-12T00:04:23.902 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020237400000000001 2024-09-12T00:04:23.902 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.902 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.902 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:23.903 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689076+0000", 2024-09-12T00:04:23.903 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002508957 2024-09-12T00:04:23.903 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.903 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.903 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:23.903 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689121+0000", 2024-09-12T00:04:23.903 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4561999999999998e-05 2024-09-12T00:04:23.903 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.903 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.903 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:23.903 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689168+0000", 2024-09-12T00:04:23.903 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7000999999999999e-05 2024-09-12T00:04:23.903 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.903 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.904 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:23.904 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.689204+0000", 2024-09-12T00:04:23.904 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6431999999999999e-05 2024-09-12T00:04:23.904 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.904 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:23.904 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.904 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.904 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.904 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:894 6.0 6:05588ce8:lc::lc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:23.904 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:04:23.904 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 49.108646376999999, 2024-09-12T00:04:23.904 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040691010000000003, 2024-09-12T00:04:23.904 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:23.904 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:23.905 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:23.905 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:23.905 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:23.905 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:23.905 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 894 2024-09-12T00:04:23.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.905 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:23.905 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.905 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:23.905 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:04:23.905 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.905 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.905 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:23.905 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690252+0000", 2024-09-12T00:04:23.906 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.906 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.906 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:23.906 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690253+0000", 2024-09-12T00:04:23.906 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.026e-06 2024-09-12T00:04:23.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.906 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.906 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:23.906 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690259+0000", 2024-09-12T00:04:23.906 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7389999999999996e-06 2024-09-12T00:04:23.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.906 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.906 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:23.907 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690273+0000", 2024-09-12T00:04:23.907 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3749e-05 2024-09-12T00:04:23.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.907 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.907 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:23.907 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690282+0000", 2024-09-12T00:04:23.907 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2520000000000005e-06 2024-09-12T00:04:23.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.907 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.907 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:23.907 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690704+0000", 2024-09-12T00:04:23.907 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042222199999999998 2024-09-12T00:04:23.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.907 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.907 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:23.908 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.690826+0000", 2024-09-12T00:04:23.908 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012141099999999999 2024-09-12T00:04:23.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.908 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.908 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:23.908 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.691094+0000", 2024-09-12T00:04:23.908 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000268344 2024-09-12T00:04:23.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.908 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.908 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:23.908 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.693007+0000", 2024-09-12T00:04:23.908 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001912495 2024-09-12T00:04:23.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.908 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.909 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:23.909 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694184+0000", 2024-09-12T00:04:23.909 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00117786 2024-09-12T00:04:23.909 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.909 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.909 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:23.909 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694259+0000", 2024-09-12T00:04:23.909 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4091000000000006e-05 2024-09-12T00:04:23.909 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.909 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.909 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:23.909 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.694321+0000", 2024-09-12T00:04:23.909 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2911999999999997e-05 2024-09-12T00:04:23.909 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.910 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:23.910 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.910 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.910 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.910 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1283 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:23.910 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:04:23.910 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 48.609327841000002, 2024-09-12T00:04:23.910 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00320967, 2024-09-12T00:04:23.910 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:23.910 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:23.910 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:23.910 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:23.910 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:23.910 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:23.911 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1283 2024-09-12T00:04:23.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.911 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:23.911 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.911 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:23.911 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:04:23.911 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.911 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.911 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:23.911 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189571+0000", 2024-09-12T00:04:23.911 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:23.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.911 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.911 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:23.912 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189573+0000", 2024-09-12T00:04:23.912 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3130000000000001e-06 2024-09-12T00:04:23.912 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.912 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.912 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:23.912 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189583+0000", 2024-09-12T00:04:23.912 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4129999999999995e-06 2024-09-12T00:04:23.912 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.912 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.912 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:23.912 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189608+0000", 2024-09-12T00:04:23.912 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5863e-05 2024-09-12T00:04:23.912 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.913 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.913 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:23.913 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189628+0000", 2024-09-12T00:04:23.913 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9644e-05 2024-09-12T00:04:23.913 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.913 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.913 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:23.913 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189747+0000", 2024-09-12T00:04:23.913 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118999 2024-09-12T00:04:23.913 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.913 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.913 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:23.913 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.189874+0000", 2024-09-12T00:04:23.913 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012674499999999999 2024-09-12T00:04:23.913 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.914 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.914 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:23.914 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.190148+0000", 2024-09-12T00:04:23.914 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000274431 2024-09-12T00:04:23.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.914 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.914 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:23.914 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.191174+0000", 2024-09-12T00:04:23.914 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001025855 2024-09-12T00:04:23.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.914 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.914 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:23.914 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192627+0000", 2024-09-12T00:04:23.914 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0014527979999999999 2024-09-12T00:04:23.915 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.915 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.915 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:23.915 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192710+0000", 2024-09-12T00:04:23.915 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3146000000000007e-05 2024-09-12T00:04:23.915 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:23.915 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:23.915 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:23.915 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:35.192781+0000", 2024-09-12T00:04:23.915 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.0463000000000006e-05 2024-09-12T00:04:23.915 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.915 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:23.915 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.915 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:23.915 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:23.916 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:23.917 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:04:23.918 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:23.913+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:24.018 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:24.019+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:24.037 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:24.037 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:24.037 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:24.037 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:24.054 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:04:24.118 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:24.119+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:24.179 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:24.179 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:24.180 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:24.180 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:24.180 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:24.192 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:04:24.219 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:24.219+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:24.303 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:24.304 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:24.304 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:24.304 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:24.304 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.304 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:24.304 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:24.304 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 52.974123591999998, 2024-09-12T00:04:24.304 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.027441031000000001, 2024-09-12T00:04:24.304 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.304 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.304 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.305 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.305 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:24.305 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:24.305 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:04:24.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.305 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.305 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.305 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.305 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:24.305 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.305 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.305 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.305 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:24.306 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.306 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.306 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.306 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.306 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330357+0000", 2024-09-12T00:04:24.306 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2339999999999996e-06 2024-09-12T00:04:24.306 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.306 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.306 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.306 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330381+0000", 2024-09-12T00:04:24.306 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4626000000000001e-05 2024-09-12T00:04:24.306 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.306 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.306 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.307 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330417+0000", 2024-09-12T00:04:24.307 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5886000000000002e-05 2024-09-12T00:04:24.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.307 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.307 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.307 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330442+0000", 2024-09-12T00:04:24.307 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4522999999999999e-05 2024-09-12T00:04:24.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.307 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.307 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.307 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335485+0000", 2024-09-12T00:04:24.307 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050432589999999996 2024-09-12T00:04:24.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.307 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.308 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:24.308 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335507+0000", 2024-09-12T00:04:24.308 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2013000000000001e-05 2024-09-12T00:04:24.308 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.308 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.308 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.308 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.351747+0000", 2024-09-12T00:04:24.308 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016240451999999999 2024-09-12T00:04:24.308 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.308 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.308 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.308 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352062+0000", 2024-09-12T00:04:24.308 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031433399999999999 2024-09-12T00:04:24.308 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.309 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.309 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:24.309 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352378+0000", 2024-09-12T00:04:24.309 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031586400000000001 2024-09-12T00:04:24.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.309 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.309 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.309 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.355074+0000", 2024-09-12T00:04:24.309 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026962919999999999 2024-09-12T00:04:24.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.309 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.309 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.309 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357537+0000", 2024-09-12T00:04:24.309 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024634689999999998 2024-09-12T00:04:24.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.310 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.310 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.310 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357680+0000", 2024-09-12T00:04:24.310 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014314899999999999 2024-09-12T00:04:24.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.310 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.310 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.310 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357793+0000", 2024-09-12T00:04:24.310 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011293 2024-09-12T00:04:24.310 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.310 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.310 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.311 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.311 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.311 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94232250902656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:24.311 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:24.311 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 52.946208431999999, 2024-09-12T00:04:24.311 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052696050000000001, 2024-09-12T00:04:24.311 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.311 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.311 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.311 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.311 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:24.311 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:24.311 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:04:24.311 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.312 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.312 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.312 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.312 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:24.312 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.312 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.312 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.312 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.312 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:24.312 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.312 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.312 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.312 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.312 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358270+0000", 2024-09-12T00:04:24.313 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.17e-06 2024-09-12T00:04:24.313 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.313 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.313 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.313 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358278+0000", 2024-09-12T00:04:24.313 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3529999999999995e-06 2024-09-12T00:04:24.313 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.313 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.313 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.313 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358306+0000", 2024-09-12T00:04:24.313 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7763000000000002e-05 2024-09-12T00:04:24.313 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.313 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.313 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.314 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358324+0000", 2024-09-12T00:04:24.314 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7861000000000001e-05 2024-09-12T00:04:24.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.314 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.314 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.314 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358447+0000", 2024-09-12T00:04:24.314 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012334299999999999 2024-09-12T00:04:24.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.314 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.314 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.314 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358624+0000", 2024-09-12T00:04:24.314 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017684999999999999 2024-09-12T00:04:24.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.314 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.315 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:24.315 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358964+0000", 2024-09-12T00:04:24.315 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00033991199999999999 2024-09-12T00:04:24.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.315 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.315 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.315 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.362920+0000", 2024-09-12T00:04:24.315 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039564600000000002 2024-09-12T00:04:24.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.315 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.315 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.315 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363016+0000", 2024-09-12T00:04:24.315 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5612999999999994e-05 2024-09-12T00:04:24.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.315 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.316 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.316 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363244+0000", 2024-09-12T00:04:24.316 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000228385 2024-09-12T00:04:24.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.316 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.316 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.316 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363537+0000", 2024-09-12T00:04:24.316 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00029289499999999999 2024-09-12T00:04:24.316 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.316 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.316 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.316 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.316 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:24.316 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:24.317 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.938830914999997, 2024-09-12T00:04:24.317 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011415537, 2024-09-12T00:04:24.317 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.317 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.317 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.317 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.317 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:24.317 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:24.317 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 209 2024-09-12T00:04:24.317 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.317 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.317 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.317 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.318 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:24.318 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.318 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.318 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.318 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.318 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:24.318 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.318 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.318 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.318 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.318 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365648+0000", 2024-09-12T00:04:24.318 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7360000000000001e-06 2024-09-12T00:04:24.318 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.318 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.319 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.319 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365660+0000", 2024-09-12T00:04:24.319 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2089999999999999e-05 2024-09-12T00:04:24.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.319 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.319 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.319 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365690+0000", 2024-09-12T00:04:24.319 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0320000000000001e-05 2024-09-12T00:04:24.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.319 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.319 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.319 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365708+0000", 2024-09-12T00:04:24.319 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7520000000000002e-05 2024-09-12T00:04:24.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.320 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.320 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.320 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365870+0000", 2024-09-12T00:04:24.320 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016208600000000001 2024-09-12T00:04:24.320 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.320 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.320 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:24.320 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365885+0000", 2024-09-12T00:04:24.320 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5119999999999999e-05 2024-09-12T00:04:24.320 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.320 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.320 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.320 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373482+0000", 2024-09-12T00:04:24.321 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075970279999999996 2024-09-12T00:04:24.321 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.321 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.321 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.321 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373805+0000", 2024-09-12T00:04:24.321 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032262799999999999 2024-09-12T00:04:24.321 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.321 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.321 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:24.321 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.374297+0000", 2024-09-12T00:04:24.321 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00049250599999999998 2024-09-12T00:04:24.321 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.321 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.322 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.322 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.375670+0000", 2024-09-12T00:04:24.322 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001373333 2024-09-12T00:04:24.322 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.322 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.322 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.322 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.376923+0000", 2024-09-12T00:04:24.322 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012525640000000001 2024-09-12T00:04:24.322 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.322 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.322 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.322 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377000+0000", 2024-09-12T00:04:24.322 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6732999999999999e-05 2024-09-12T00:04:24.322 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.322 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.323 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.323 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377061+0000", 2024-09-12T00:04:24.323 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0872999999999998e-05 2024-09-12T00:04:24.323 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.323 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.323 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.323 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.323 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.323 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:240 6.19 6:9f626c48:lc::lc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:24.323 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:24.323 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.820245161999999, 2024-09-12T00:04:24.323 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058545680000000001, 2024-09-12T00:04:24.323 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.324 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.324 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.324 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.324 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:24.324 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:24.324 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 240 2024-09-12T00:04:24.324 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.324 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.324 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.324 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.324 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:24.324 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.324 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.324 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.325 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.325 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:24.325 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.325 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.325 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.325 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.325 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484233+0000", 2024-09-12T00:04:24.325 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.973e-06 2024-09-12T00:04:24.325 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.325 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.325 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.325 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484241+0000", 2024-09-12T00:04:24.325 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8210000000000002e-06 2024-09-12T00:04:24.325 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.326 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.326 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.326 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484260+0000", 2024-09-12T00:04:24.326 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9148999999999999e-05 2024-09-12T00:04:24.326 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.326 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.326 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.326 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484268+0000", 2024-09-12T00:04:24.326 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5120000000000008e-06 2024-09-12T00:04:24.326 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.327 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.327 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.327 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484371+0000", 2024-09-12T00:04:24.327 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102501 2024-09-12T00:04:24.327 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.327 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.327 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.327 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484450+0000", 2024-09-12T00:04:24.327 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9122999999999994e-05 2024-09-12T00:04:24.327 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.327 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.327 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:24.327 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484578+0000", 2024-09-12T00:04:24.327 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000128095 2024-09-12T00:04:24.328 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.328 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.328 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.328 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.485336+0000", 2024-09-12T00:04:24.328 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00075754000000000001 2024-09-12T00:04:24.328 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.328 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.328 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.328 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.489975+0000", 2024-09-12T00:04:24.328 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004639738 2024-09-12T00:04:24.328 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.328 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.329 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.329 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490043+0000", 2024-09-12T00:04:24.329 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7923999999999995e-05 2024-09-12T00:04:24.329 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.329 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.329 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.329 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490085+0000", 2024-09-12T00:04:24.329 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2191999999999999e-05 2024-09-12T00:04:24.329 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.329 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.329 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.329 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.329 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.329 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:412 6.3 6:c3a682d4:reshard::reshard.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:24.330 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:24.330 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.777849756000002, 2024-09-12T00:04:24.330 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049075530000000003, 2024-09-12T00:04:24.330 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.330 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.330 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.330 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.330 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:24.330 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:24.330 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 412 2024-09-12T00:04:24.330 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.330 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.330 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.330 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.331 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:24.331 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.331 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.331 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.331 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.331 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:24.331 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.331 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.331 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.331 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.331 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526628+0000", 2024-09-12T00:04:24.331 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.513e-06 2024-09-12T00:04:24.331 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.331 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.331 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.332 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526634+0000", 2024-09-12T00:04:24.332 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1279999999999996e-06 2024-09-12T00:04:24.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.332 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.332 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.332 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526649+0000", 2024-09-12T00:04:24.332 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4997999999999999e-05 2024-09-12T00:04:24.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.332 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.332 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.332 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526658+0000", 2024-09-12T00:04:24.332 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1589999999999999e-06 2024-09-12T00:04:24.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.333 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.333 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.333 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526728+0000", 2024-09-12T00:04:24.333 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0203999999999994e-05 2024-09-12T00:04:24.333 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.333 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.333 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.333 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526839+0000", 2024-09-12T00:04:24.333 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011055 2024-09-12T00:04:24.333 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.333 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.333 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:24.333 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526979+0000", 2024-09-12T00:04:24.334 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139863 2024-09-12T00:04:24.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.334 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.334 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.334 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.527616+0000", 2024-09-12T00:04:24.334 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00063707900000000003 2024-09-12T00:04:24.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.334 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.334 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.334 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531450+0000", 2024-09-12T00:04:24.334 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003833819 2024-09-12T00:04:24.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.334 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.334 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.335 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531490+0000", 2024-09-12T00:04:24.335 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0129000000000002e-05 2024-09-12T00:04:24.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.335 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.335 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.335 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531534+0000", 2024-09-12T00:04:24.335 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4110999999999998e-05 2024-09-12T00:04:24.335 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.335 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.335 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.335 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.335 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:490 6.19 6:9dc32cef:lc::lc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:24.335 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:24.336 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.753652381999999, 2024-09-12T00:04:24.336 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047438380000000002, 2024-09-12T00:04:24.336 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.336 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.336 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.336 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.336 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:24.336 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:24.336 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 490 2024-09-12T00:04:24.336 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.336 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.336 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.336 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.336 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:24.337 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.337 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.337 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.337 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.337 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:24.337 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.337 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.337 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.337 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.337 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550825+0000", 2024-09-12T00:04:24.337 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0589999999999999e-06 2024-09-12T00:04:24.337 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.337 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.337 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.338 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550830+0000", 2024-09-12T00:04:24.338 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2140000000000004e-06 2024-09-12T00:04:24.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.338 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.338 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.338 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550843+0000", 2024-09-12T00:04:24.338 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3404000000000001e-05 2024-09-12T00:04:24.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.338 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.338 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.338 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550852+0000", 2024-09-12T00:04:24.338 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1549999999999996e-06 2024-09-12T00:04:24.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.339 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.339 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.339 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550910+0000", 2024-09-12T00:04:24.339 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7636000000000002e-05 2024-09-12T00:04:24.339 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.339 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.339 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.339 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550977+0000", 2024-09-12T00:04:24.339 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6636000000000004e-05 2024-09-12T00:04:24.339 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.339 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.339 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:24.339 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.551135+0000", 2024-09-12T00:04:24.339 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015852999999999999 2024-09-12T00:04:24.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.340 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.340 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.340 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552939+0000", 2024-09-12T00:04:24.340 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001803643 2024-09-12T00:04:24.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.340 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.340 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.340 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555471+0000", 2024-09-12T00:04:24.340 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002532327 2024-09-12T00:04:24.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.340 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.340 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.340 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555526+0000", 2024-09-12T00:04:24.341 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4728000000000002e-05 2024-09-12T00:04:24.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.341 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.341 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.341 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555567+0000", 2024-09-12T00:04:24.341 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1505999999999999e-05 2024-09-12T00:04:24.341 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.341 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.341 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.341 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.341 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:492 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'6, mlcod=35'4)", 2024-09-12T00:04:24.341 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:24.341 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.751876318000001, 2024-09-12T00:04:24.342 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056118790000000002, 2024-09-12T00:04:24.342 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.342 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.342 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.342 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.342 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.342 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.342 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:24.342 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.342 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.342 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.342 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.342 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:24.342 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.343 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.343 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.343 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552601+0000", 2024-09-12T00:04:24.343 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6899999999999996e-07 2024-09-12T00:04:24.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.343 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.343 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.343 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552608+0000", 2024-09-12T00:04:24.343 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4529999999999996e-06 2024-09-12T00:04:24.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.343 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.343 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.343 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552624+0000", 2024-09-12T00:04:24.343 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5885000000000001e-05 2024-09-12T00:04:24.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.344 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.344 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.344 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552632+0000", 2024-09-12T00:04:24.344 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2220000000000002e-06 2024-09-12T00:04:24.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.344 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.344 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.344 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552716+0000", 2024-09-12T00:04:24.344 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4060999999999994e-05 2024-09-12T00:04:24.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.344 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.344 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.344 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552735+0000", 2024-09-12T00:04:24.345 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9170000000000001e-05 2024-09-12T00:04:24.345 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.345 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.345 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.345 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558164+0000", 2024-09-12T00:04:24.345 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054289899999999999 2024-09-12T00:04:24.345 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.345 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.345 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.345 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558212+0000", 2024-09-12T00:04:24.345 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7129000000000002e-05 2024-09-12T00:04:24.345 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.345 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.345 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.346 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.346 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:496 6.3 6:c134263f:lc::lc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:24.346 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:24.346 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.750769030000001, 2024-09-12T00:04:24.346 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045956260000000002, 2024-09-12T00:04:24.346 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.346 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.346 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.346 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.346 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:24.346 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:24.346 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 496 2024-09-12T00:04:24.347 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.347 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.347 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.347 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:24.347 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.347 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.347 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.347 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:24.347 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.347 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.347 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.348 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553708+0000", 2024-09-12T00:04:24.348 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2359999999999999e-06 2024-09-12T00:04:24.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.348 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.348 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.348 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553714+0000", 2024-09-12T00:04:24.348 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4960000000000004e-06 2024-09-12T00:04:24.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.348 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.348 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.348 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553726+0000", 2024-09-12T00:04:24.348 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2618e-05 2024-09-12T00:04:24.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.348 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.349 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.349 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553734+0000", 2024-09-12T00:04:24.349 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4159999999999998e-06 2024-09-12T00:04:24.349 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.349 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.349 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.349 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553771+0000", 2024-09-12T00:04:24.349 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7095999999999999e-05 2024-09-12T00:04:24.349 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.349 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.349 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.349 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553815+0000", 2024-09-12T00:04:24.349 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3986999999999997e-05 2024-09-12T00:04:24.349 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.349 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.350 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:24.350 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553922+0000", 2024-09-12T00:04:24.350 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000107534 2024-09-12T00:04:24.350 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.350 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.350 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.350 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555052+0000", 2024-09-12T00:04:24.350 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011298359999999999 2024-09-12T00:04:24.350 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.350 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.350 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.350 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558197+0000", 2024-09-12T00:04:24.350 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0031450269999999999 2024-09-12T00:04:24.350 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.351 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.351 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.351 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558256+0000", 2024-09-12T00:04:24.351 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8403999999999999e-05 2024-09-12T00:04:24.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.351 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.351 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.351 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558303+0000", 2024-09-12T00:04:24.351 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6975999999999999e-05 2024-09-12T00:04:24.351 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.351 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.351 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.351 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.352 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:641 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:24.352 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:24.352 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.710698702999998, 2024-09-12T00:04:24.352 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052824789999999996, 2024-09-12T00:04:24.352 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.352 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.352 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.352 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.352 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:24.352 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:24.352 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 641 2024-09-12T00:04:24.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.352 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.352 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.353 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.353 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:24.353 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.353 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.353 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.353 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:24.353 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.353 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.353 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.353 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593778+0000", 2024-09-12T00:04:24.353 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0920000000000001e-06 2024-09-12T00:04:24.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.354 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.354 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.354 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593783+0000", 2024-09-12T00:04:24.354 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9490000000000004e-06 2024-09-12T00:04:24.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.354 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.354 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.354 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593795+0000", 2024-09-12T00:04:24.354 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2048999999999999e-05 2024-09-12T00:04:24.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.354 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.354 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.354 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593801+0000", 2024-09-12T00:04:24.354 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8989999999999998e-06 2024-09-12T00:04:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593852+0000", 2024-09-12T00:04:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1057999999999998e-05 2024-09-12T00:04:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593905+0000", 2024-09-12T00:04:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2196e-05 2024-09-12T00:04:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:24.355 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594017+0000", 2024-09-12T00:04:24.356 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000112816 2024-09-12T00:04:24.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.356 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.356 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.356 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.595190+0000", 2024-09-12T00:04:24.356 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011727199999999999 2024-09-12T00:04:24.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.356 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.356 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.356 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.598998+0000", 2024-09-12T00:04:24.356 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038081320000000001 2024-09-12T00:04:24.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.356 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.356 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.357 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599032+0000", 2024-09-12T00:04:24.357 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4283999999999999e-05 2024-09-12T00:04:24.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.357 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.357 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.357 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599060+0000", 2024-09-12T00:04:24.357 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7284000000000002e-05 2024-09-12T00:04:24.357 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.357 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.357 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.357 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.357 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:643 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'8, mlcod=35'6)", 2024-09-12T00:04:24.357 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:24.358 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.710200596, 2024-09-12T00:04:24.358 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048211260000000002, 2024-09-12T00:04:24.358 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.358 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.358 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.358 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.358 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.358 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.358 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:24.358 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.358 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.358 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.358 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.358 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:24.359 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.359 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594276+0000", 2024-09-12T00:04:24.359 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5899999999999995e-07 2024-09-12T00:04:24.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.359 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594283+0000", 2024-09-12T00:04:24.359 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6019999999999996e-06 2024-09-12T00:04:24.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.360 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594295+0000", 2024-09-12T00:04:24.360 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1683e-05 2024-09-12T00:04:24.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.360 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.360 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.360 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594303+0000", 2024-09-12T00:04:24.360 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0439999999999996e-06 2024-09-12T00:04:24.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.360 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.360 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.360 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594353+0000", 2024-09-12T00:04:24.360 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0698000000000001e-05 2024-09-12T00:04:24.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.361 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.361 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.361 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594380+0000", 2024-09-12T00:04:24.361 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7089000000000001e-05 2024-09-12T00:04:24.361 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.361 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.361 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.361 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599063+0000", 2024-09-12T00:04:24.361 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046824739999999998 2024-09-12T00:04:24.361 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.361 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.361 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.361 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599096+0000", 2024-09-12T00:04:24.361 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3677000000000003e-05 2024-09-12T00:04:24.362 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.362 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.362 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.362 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.362 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:647 6.a 6:5395e6f3:lc::lc.4:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:24.362 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:24.362 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.707849963000001, 2024-09-12T00:04:24.362 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049071770000000004, 2024-09-12T00:04:24.362 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.362 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.362 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.362 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.362 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:24.362 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:24.363 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 647 2024-09-12T00:04:24.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.363 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.363 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:24.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.363 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:24.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596627+0000", 2024-09-12T00:04:24.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1149999999999999e-06 2024-09-12T00:04:24.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596632+0000", 2024-09-12T00:04:24.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7060000000000003e-06 2024-09-12T00:04:24.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596645+0000", 2024-09-12T00:04:24.365 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2791e-05 2024-09-12T00:04:24.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.365 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596653+0000", 2024-09-12T00:04:24.365 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9230000000000002e-06 2024-09-12T00:04:24.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.365 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596705+0000", 2024-09-12T00:04:24.365 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2250000000000003e-05 2024-09-12T00:04:24.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.365 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.366 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596758+0000", 2024-09-12T00:04:24.366 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2964000000000003e-05 2024-09-12T00:04:24.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.366 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.366 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:24.366 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596873+0000", 2024-09-12T00:04:24.366 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011501 2024-09-12T00:04:24.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.366 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.366 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.366 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599088+0000", 2024-09-12T00:04:24.366 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002215135 2024-09-12T00:04:24.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.367 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.367 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.367 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601456+0000", 2024-09-12T00:04:24.367 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023684719999999999 2024-09-12T00:04:24.367 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.367 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.367 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.367 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601507+0000", 2024-09-12T00:04:24.367 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0933999999999997e-05 2024-09-12T00:04:24.367 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.367 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.367 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.367 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601533+0000", 2024-09-12T00:04:24.367 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5877e-05 2024-09-12T00:04:24.368 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.368 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.368 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.368 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:657 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'10, mlcod=35'7)", 2024-09-12T00:04:24.368 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:24.368 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.704026423000002, 2024-09-12T00:04:24.368 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066410239999999997, 2024-09-12T00:04:24.368 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.368 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.368 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.368 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:24.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:24.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:24.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6099999999999999e-07 2024-09-12T00:04:24.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600457+0000", 2024-09-12T00:04:24.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8700000000000003e-06 2024-09-12T00:04:24.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600470+0000", 2024-09-12T00:04:24.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3186999999999999e-05 2024-09-12T00:04:24.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.371 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600478+0000", 2024-09-12T00:04:24.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5310000000000004e-06 2024-09-12T00:04:24.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.371 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600521+0000", 2024-09-12T00:04:24.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2574000000000003e-05 2024-09-12T00:04:24.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.371 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600535+0000", 2024-09-12T00:04:24.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4151000000000001e-05 2024-09-12T00:04:24.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.372 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.372 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.372 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.606997+0000", 2024-09-12T00:04:24.372 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064626099999999997 2024-09-12T00:04:24.372 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.372 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.372 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.372 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607091+0000", 2024-09-12T00:04:24.372 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3239999999999995e-05 2024-09-12T00:04:24.372 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.372 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.372 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.372 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.372 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.373 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:659 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:24.373 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:24.373 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.703854090999997, 2024-09-12T00:04:24.373 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0065340989999999998, 2024-09-12T00:04:24.373 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.373 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.373 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.373 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.373 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:24.373 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:24.373 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 659 2024-09-12T00:04:24.373 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.373 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.373 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.374 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.374 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:24.374 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.374 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.374 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.374 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:24.374 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.374 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.374 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.375 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600623+0000", 2024-09-12T00:04:24.375 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.085e-06 2024-09-12T00:04:24.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.375 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.375 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600630+0000", 2024-09-12T00:04:24.375 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0029999999999997e-06 2024-09-12T00:04:24.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.375 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.375 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600647+0000", 2024-09-12T00:04:24.375 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6566999999999999e-05 2024-09-12T00:04:24.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.376 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.376 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600658+0000", 2024-09-12T00:04:24.376 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0992000000000001e-05 2024-09-12T00:04:24.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.376 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.376 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.376 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600717+0000", 2024-09-12T00:04:24.376 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9925e-05 2024-09-12T00:04:24.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.376 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.376 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.376 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600773+0000", 2024-09-12T00:04:24.376 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5766000000000001e-05 2024-09-12T00:04:24.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.377 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:24.377 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600889+0000", 2024-09-12T00:04:24.377 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115906 2024-09-12T00:04:24.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.377 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.377 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603483+0000", 2024-09-12T00:04:24.377 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025940799999999999 2024-09-12T00:04:24.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.377 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.377 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607098+0000", 2024-09-12T00:04:24.378 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036150459999999998 2024-09-12T00:04:24.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.378 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.378 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.378 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607133+0000", 2024-09-12T00:04:24.378 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4615e-05 2024-09-12T00:04:24.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.378 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.378 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.378 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607156+0000", 2024-09-12T00:04:24.378 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3113999999999999e-05 2024-09-12T00:04:24.378 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.378 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.378 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.379 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.379 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.379 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:666 6.a 6:5395e6f3:lc::lc.4:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:24.379 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:24.379 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.702106962000002, 2024-09-12T00:04:24.379 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.005127174, 2024-09-12T00:04:24.379 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.379 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.379 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.379 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.379 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:24.379 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:24.379 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 666 2024-09-12T00:04:24.379 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.380 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.380 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.380 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.380 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:24.380 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.380 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.380 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.380 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:24.380 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.380 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.380 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.380 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602370+0000", 2024-09-12T00:04:24.381 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0720000000000001e-06 2024-09-12T00:04:24.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.381 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.381 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.381 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602376+0000", 2024-09-12T00:04:24.381 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5489999999999997e-06 2024-09-12T00:04:24.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.381 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.381 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.381 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602391+0000", 2024-09-12T00:04:24.381 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5301000000000001e-05 2024-09-12T00:04:24.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.381 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.381 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.382 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602399+0000", 2024-09-12T00:04:24.382 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9179999999999994e-06 2024-09-12T00:04:24.382 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.382 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.382 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.382 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602456+0000", 2024-09-12T00:04:24.382 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7099999999999999e-05 2024-09-12T00:04:24.382 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.382 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.382 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.382 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602508+0000", 2024-09-12T00:04:24.382 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2476999999999999e-05 2024-09-12T00:04:24.382 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.382 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.382 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:24.383 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602606+0000", 2024-09-12T00:04:24.383 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7823000000000002e-05 2024-09-12T00:04:24.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.383 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.383 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.383 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.604653+0000", 2024-09-12T00:04:24.383 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002047068 2024-09-12T00:04:24.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.383 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.383 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.383 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607401+0000", 2024-09-12T00:04:24.383 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027477700000000001 2024-09-12T00:04:24.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.383 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.384 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.384 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607453+0000", 2024-09-12T00:04:24.384 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2092999999999997e-05 2024-09-12T00:04:24.384 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.384 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.384 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.384 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607496+0000", 2024-09-12T00:04:24.384 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3003000000000001e-05 2024-09-12T00:04:24.384 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.384 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.384 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.384 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.384 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.384 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:665 6.1a e35/29 6:5c7e8a6d:reshard::reshard.0000000015:head v 35'11, mlcod=35'8)", 2024-09-12T00:04:24.385 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:24.385 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.701735276999997, 2024-09-12T00:04:24.385 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048593209999999998, 2024-09-12T00:04:24.385 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.385 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.385 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.385 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.385 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.385 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.385 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:24.385 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.385 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.385 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.385 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.386 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:24.386 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.386 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.386 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.386 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602742+0000", 2024-09-12T00:04:24.386 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1069999999999999e-06 2024-09-12T00:04:24.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.386 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.386 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.386 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602749+0000", 2024-09-12T00:04:24.386 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9609999999999999e-06 2024-09-12T00:04:24.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.386 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.387 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.387 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602763+0000", 2024-09-12T00:04:24.387 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4086e-05 2024-09-12T00:04:24.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.387 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.387 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602772+0000", 2024-09-12T00:04:24.387 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8470000000000002e-06 2024-09-12T00:04:24.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.387 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.387 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602826+0000", 2024-09-12T00:04:24.387 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3885000000000003e-05 2024-09-12T00:04:24.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.388 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.388 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602837+0000", 2024-09-12T00:04:24.388 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1601e-05 2024-09-12T00:04:24.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.388 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.388 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.388 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607500+0000", 2024-09-12T00:04:24.388 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046627509999999997 2024-09-12T00:04:24.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.388 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.388 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.388 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607600+0000", 2024-09-12T00:04:24.388 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100083 2024-09-12T00:04:24.388 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.389 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.389 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.389 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.389 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.389 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:831 6.19 6:9d23f22c:lc::lc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:24.389 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:24.389 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.638450597000002, 2024-09-12T00:04:24.389 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047044610000000001, 2024-09-12T00:04:24.389 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.389 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.389 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.389 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.389 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:24.389 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:24.390 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 831 2024-09-12T00:04:24.390 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.390 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.390 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.390 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.390 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:24.390 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.390 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.390 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.390 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.390 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:24.390 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.390 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.390 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.391 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.391 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666026+0000", 2024-09-12T00:04:24.391 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.02e-06 2024-09-12T00:04:24.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.391 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.391 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.391 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666032+0000", 2024-09-12T00:04:24.391 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8850000000000004e-06 2024-09-12T00:04:24.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.391 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.391 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.391 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666047+0000", 2024-09-12T00:04:24.391 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4647999999999999e-05 2024-09-12T00:04:24.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.392 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.392 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666058+0000", 2024-09-12T00:04:24.392 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0905e-05 2024-09-12T00:04:24.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.392 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.392 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666376+0000", 2024-09-12T00:04:24.392 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031824899999999999 2024-09-12T00:04:24.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.392 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.392 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666479+0000", 2024-09-12T00:04:24.392 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102814 2024-09-12T00:04:24.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.393 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:24.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666635+0000", 2024-09-12T00:04:24.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000156343 2024-09-12T00:04:24.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.393 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.667611+0000", 2024-09-12T00:04:24.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000975671 2024-09-12T00:04:24.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.393 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670662+0000", 2024-09-12T00:04:24.394 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003050863 2024-09-12T00:04:24.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.394 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.394 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.394 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670701+0000", 2024-09-12T00:04:24.394 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9338000000000002e-05 2024-09-12T00:04:24.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.394 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.394 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.394 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670730+0000", 2024-09-12T00:04:24.394 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8725e-05 2024-09-12T00:04:24.394 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.394 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.394 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.395 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.395 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:852 6.1d e35/29 6:bbf2d10c:::obj_delete_at_hint.0000000025:head v 35'9, mlcod=35'7)", 2024-09-12T00:04:24.395 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:24.395 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.629873543999999, 2024-09-12T00:04:24.395 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00569595, 2024-09-12T00:04:24.395 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.395 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.395 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.395 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.395 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.395 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.395 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:24.395 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.395 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.396 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.396 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.396 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:24.396 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.396 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.396 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.396 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674604+0000", 2024-09-12T00:04:24.396 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2079999999999999e-06 2024-09-12T00:04:24.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.396 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.396 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.396 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674611+0000", 2024-09-12T00:04:24.396 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.973e-06 2024-09-12T00:04:24.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.397 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674625+0000", 2024-09-12T00:04:24.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3916e-05 2024-09-12T00:04:24.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.397 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674633+0000", 2024-09-12T00:04:24.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8580000000000006e-06 2024-09-12T00:04:24.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.397 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674697+0000", 2024-09-12T00:04:24.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4004999999999995e-05 2024-09-12T00:04:24.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.398 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.398 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674713+0000", 2024-09-12T00:04:24.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5835e-05 2024-09-12T00:04:24.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.398 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.398 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680245+0000", 2024-09-12T00:04:24.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055320250000000003 2024-09-12T00:04:24.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.398 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.398 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680298+0000", 2024-09-12T00:04:24.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3130000000000001e-05 2024-09-12T00:04:24.399 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.399 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.399 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.399 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:925 6.1a e35/29 6:5f2e3d26:lc::lc.18:head v 35'15, mlcod=35'12)", 2024-09-12T00:04:24.399 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:24.399 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.606345714, 2024-09-12T00:04:24.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055640999999999998, 2024-09-12T00:04:24.399 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.399 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.399 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.399 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.400 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.400 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:24.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.400 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.400 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:24.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.400 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.400 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698131+0000", 2024-09-12T00:04:24.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:04:24.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.401 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.401 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698140+0000", 2024-09-12T00:04:24.401 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3139999999999993e-06 2024-09-12T00:04:24.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.401 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.401 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698155+0000", 2024-09-12T00:04:24.401 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:04:24.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.401 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.401 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698164+0000", 2024-09-12T00:04:24.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1419999999999999e-06 2024-09-12T00:04:24.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.402 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698228+0000", 2024-09-12T00:04:24.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3380000000000006e-05 2024-09-12T00:04:24.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.402 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698252+0000", 2024-09-12T00:04:24.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4111e-05 2024-09-12T00:04:24.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.402 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703646+0000", 2024-09-12T00:04:24.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0053937840000000004 2024-09-12T00:04:24.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.403 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703694+0000", 2024-09-12T00:04:24.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8776999999999997e-05 2024-09-12T00:04:24.403 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.403 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.403 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.403 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:927 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:24.403 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:24.404 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.605826690000001, 2024-09-12T00:04:24.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050914949999999997, 2024-09-12T00:04:24.404 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.404 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.404 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.404 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.404 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:24.404 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:24.404 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 927 2024-09-12T00:04:24.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.404 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:24.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:24.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698651+0000", 2024-09-12T00:04:24.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3740000000000001e-06 2024-09-12T00:04:24.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698657+0000", 2024-09-12T00:04:24.406 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5239999999999997e-06 2024-09-12T00:04:24.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.406 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.406 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698673+0000", 2024-09-12T00:04:24.406 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5345999999999998e-05 2024-09-12T00:04:24.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.406 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.406 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698680+0000", 2024-09-12T00:04:24.406 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4649999999999997e-06 2024-09-12T00:04:24.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.406 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699009+0000", 2024-09-12T00:04:24.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032934000000000001 2024-09-12T00:04:24.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699213+0000", 2024-09-12T00:04:24.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020361500000000001 2024-09-12T00:04:24.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:24.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699450+0000", 2024-09-12T00:04:24.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023670399999999999 2024-09-12T00:04:24.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.408 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.408 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.700678+0000", 2024-09-12T00:04:24.408 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012285519999999999 2024-09-12T00:04:24.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.408 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.408 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703666+0000", 2024-09-12T00:04:24.408 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029876130000000001 2024-09-12T00:04:24.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.408 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.408 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703708+0000", 2024-09-12T00:04:24.408 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2361999999999999e-05 2024-09-12T00:04:24.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.409 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703741+0000", 2024-09-12T00:04:24.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.26e-05 2024-09-12T00:04:24.409 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.409 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.409 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.409 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:941 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:24.409 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:24.409 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 49.600333237000001, 2024-09-12T00:04:24.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0051476960000000002, 2024-09-12T00:04:24.409 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.409 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.410 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "started", 2024-09-12T00:04:24.410 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.410 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:24.410 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:24.410 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 941 2024-09-12T00:04:24.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.410 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:24.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:24.411 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.411 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704144+0000", 2024-09-12T00:04:24.411 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.514e-06 2024-09-12T00:04:24.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.411 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704152+0000", 2024-09-12T00:04:24.411 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2830000000000004e-06 2024-09-12T00:04:24.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.411 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.412 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704168+0000", 2024-09-12T00:04:24.412 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6835999999999999e-05 2024-09-12T00:04:24.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.412 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.412 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.412 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704178+0000", 2024-09-12T00:04:24.412 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7569999999999999e-06 2024-09-12T00:04:24.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.412 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.412 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.412 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704240+0000", 2024-09-12T00:04:24.412 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2193000000000006e-05 2024-09-12T00:04:24.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.412 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704308+0000", 2024-09-12T00:04:24.413 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7840000000000001e-05 2024-09-12T00:04:24.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.413 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.709290+0000", 2024-09-12T00:04:24.413 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049822729999999997 2024-09-12T00:04:24.413 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.413 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.413 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.413 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.413 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.413 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:24.415 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:04:24.415 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:24.415+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:24.515 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:24.513+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:24.536 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:24.536 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:24.536 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:24.536 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:24.553 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:04:24.641 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:24.641+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:24.709 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:04:24.717 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:24.719+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:24.723 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:24.723 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:24.723 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:24.723 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:24.723 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:24.743 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:04:24.819 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:24.819+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:24.920 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:24.917+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:24.941 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:24.941 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:24.941 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:24.941 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:24.942 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.942 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:24.942 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:24.942 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 73.447339048000003, 2024-09-12T00:04:24.942 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.278479906, 2024-09-12T00:04:24.942 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.942 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.942 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.942 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.942 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:24.942 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:24.942 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:04:24.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.943 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.943 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.943 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.943 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:24.943 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.943 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.943 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.943 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:24.943 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.943 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.943 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.943 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493422+0000", 2024-09-12T00:04:24.944 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.807e-06 2024-09-12T00:04:24.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.944 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.944 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.944 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493435+0000", 2024-09-12T00:04:24.944 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.375e-05 2024-09-12T00:04:24.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.944 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.944 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.944 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493457+0000", 2024-09-12T00:04:24.944 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2166000000000001e-05 2024-09-12T00:04:24.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.944 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.945 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.945 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493475+0000", 2024-09-12T00:04:24.945 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7184e-05 2024-09-12T00:04:24.945 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.945 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.945 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.945 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493617+0000", 2024-09-12T00:04:24.945 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014274200000000001 2024-09-12T00:04:24.945 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.945 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.945 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:24.946 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493632+0000", 2024-09-12T00:04:24.946 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4293e-05 2024-09-12T00:04:24.946 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.946 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.946 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.946 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.768657+0000", 2024-09-12T00:04:24.946 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.27502575400000001 2024-09-12T00:04:24.946 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.946 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.946 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.946 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769042+0000", 2024-09-12T00:04:24.946 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00038463700000000001 2024-09-12T00:04:24.946 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.947 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.947 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:24.947 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769430+0000", 2024-09-12T00:04:24.947 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000388014 2024-09-12T00:04:24.947 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.947 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.947 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.947 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.770784+0000", 2024-09-12T00:04:24.947 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00135402 2024-09-12T00:04:24.947 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.947 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.947 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.947 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771735+0000", 2024-09-12T00:04:24.948 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00095068599999999996 2024-09-12T00:04:24.948 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.948 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.948 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.948 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771828+0000", 2024-09-12T00:04:24.948 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3468999999999996e-05 2024-09-12T00:04:24.948 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.949 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.949 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.949 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771899+0000", 2024-09-12T00:04:24.949 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0383999999999996e-05 2024-09-12T00:04:24.949 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.949 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.949 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.949 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.949 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.949 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:24.949 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:24.949 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 73.019115291999995, 2024-09-12T00:04:24.949 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013402304, 2024-09-12T00:04:24.949 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.950 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.950 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.950 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.950 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:24.950 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:24.950 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 44 2024-09-12T00:04:24.950 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.950 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.950 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.950 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.950 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:24.950 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.951 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.951 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.951 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.951 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:24.951 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.951 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.951 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.951 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.952 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:24.952 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7100000000000001e-07 2024-09-12T00:04:24.952 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.952 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.952 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.952 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921706+0000", 2024-09-12T00:04:24.952 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2374999999999998e-05 2024-09-12T00:04:24.952 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.952 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.952 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.952 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921726+0000", 2024-09-12T00:04:24.952 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0373999999999998e-05 2024-09-12T00:04:24.953 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.953 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.953 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.953 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921733+0000", 2024-09-12T00:04:24.953 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8929999999999999e-06 2024-09-12T00:04:24.953 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.953 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.953 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.953 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927137+0000", 2024-09-12T00:04:24.954 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054037410000000001 2024-09-12T00:04:24.954 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.954 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.954 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.954 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927274+0000", 2024-09-12T00:04:24.954 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013697899999999999 2024-09-12T00:04:24.954 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.954 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.954 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:24.954 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927504+0000", 2024-09-12T00:04:24.954 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023005399999999999 2024-09-12T00:04:24.954 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.954 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.955 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.955 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.931848+0000", 2024-09-12T00:04:24.955 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0043445269999999999 2024-09-12T00:04:24.955 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.955 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.955 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.955 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934770+0000", 2024-09-12T00:04:24.955 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002922319 2024-09-12T00:04:24.955 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.955 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.955 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.955 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934901+0000", 2024-09-12T00:04:24.955 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013034599999999999 2024-09-12T00:04:24.956 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.956 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.956 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.956 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935045+0000", 2024-09-12T00:04:24.956 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014402499999999999 2024-09-12T00:04:24.956 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.956 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.956 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.956 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.956 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.956 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:24.956 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:24.956 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 73.019012326999999, 2024-09-12T00:04:24.956 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013456684999999999, 2024-09-12T00:04:24.957 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.957 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.957 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.957 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.957 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:24.957 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:24.957 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 45 2024-09-12T00:04:24.957 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.957 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.957 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.957 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.957 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:24.957 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.958 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.958 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.958 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.958 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:24.958 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.958 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.958 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.958 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.958 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921746+0000", 2024-09-12T00:04:24.958 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9800000000000003e-07 2024-09-12T00:04:24.958 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.958 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.958 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.958 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921751+0000", 2024-09-12T00:04:24.959 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7099999999999998e-06 2024-09-12T00:04:24.959 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.959 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.959 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.959 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921766+0000", 2024-09-12T00:04:24.959 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5633000000000001e-05 2024-09-12T00:04:24.959 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.959 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.959 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.959 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921786+0000", 2024-09-12T00:04:24.959 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9658000000000001e-05 2024-09-12T00:04:24.959 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.959 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.959 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.960 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929539+0000", 2024-09-12T00:04:24.960 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0077533120000000001 2024-09-12T00:04:24.960 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.960 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.960 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.960 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929706+0000", 2024-09-12T00:04:24.960 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016664199999999999 2024-09-12T00:04:24.960 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.960 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.960 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:24.960 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929933+0000", 2024-09-12T00:04:24.960 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000226658 2024-09-12T00:04:24.960 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.961 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.961 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.961 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934721+0000", 2024-09-12T00:04:24.961 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047886439999999999 2024-09-12T00:04:24.961 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.961 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.961 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.961 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935062+0000", 2024-09-12T00:04:24.961 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00034072399999999999 2024-09-12T00:04:24.961 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.961 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.962 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.962 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935141+0000", 2024-09-12T00:04:24.962 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8570000000000002e-05 2024-09-12T00:04:24.962 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.962 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.962 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.962 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935202+0000", 2024-09-12T00:04:24.962 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1536000000000002e-05 2024-09-12T00:04:24.962 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.962 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.962 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.962 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.962 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.963 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:24.963 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:24.963 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 73.018962095000006, 2024-09-12T00:04:24.963 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014633617, 2024-09-12T00:04:24.963 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.963 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.963 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.963 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.963 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:24.963 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:24.963 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:04:24.963 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.963 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.964 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.964 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.964 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:24.964 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.964 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.964 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.964 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.964 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:24.964 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.964 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.964 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.964 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.964 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:24.964 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3599999999999999e-07 2024-09-12T00:04:24.965 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.965 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.965 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.965 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921800+0000", 2024-09-12T00:04:24.965 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3850000000000002e-06 2024-09-12T00:04:24.965 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.965 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.965 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.965 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921805+0000", 2024-09-12T00:04:24.965 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9460000000000003e-06 2024-09-12T00:04:24.965 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.965 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.965 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.966 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921819+0000", 2024-09-12T00:04:24.966 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.325e-05 2024-09-12T00:04:24.966 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.966 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.966 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.966 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930627+0000", 2024-09-12T00:04:24.966 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00880827 2024-09-12T00:04:24.966 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.966 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.966 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.966 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930805+0000", 2024-09-12T00:04:24.966 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000177992 2024-09-12T00:04:24.966 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.966 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.967 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:24.967 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.931028+0000", 2024-09-12T00:04:24.967 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000223122 2024-09-12T00:04:24.967 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.967 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.967 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.967 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935258+0000", 2024-09-12T00:04:24.967 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0042302709999999999 2024-09-12T00:04:24.967 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.967 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.967 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.967 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936282+0000", 2024-09-12T00:04:24.967 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00102345 2024-09-12T00:04:24.968 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.968 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.968 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.968 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936367+0000", 2024-09-12T00:04:24.968 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4869000000000003e-05 2024-09-12T00:04:24.968 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.968 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.968 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.968 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936429+0000", 2024-09-12T00:04:24.968 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2626000000000007e-05 2024-09-12T00:04:24.968 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.968 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.968 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.969 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.969 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.969 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:24.969 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:24.969 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 73.018925844999998, 2024-09-12T00:04:24.969 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016022492999999999, 2024-09-12T00:04:24.969 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.969 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.969 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.969 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.969 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:24.969 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:24.969 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:04:24.969 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.970 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.970 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.970 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.970 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:24.970 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.970 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.970 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.970 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.970 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:24.970 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.970 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.970 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.970 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.971 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:24.971 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4000000000000002e-07 2024-09-12T00:04:24.971 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.971 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.971 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.971 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921891+0000", 2024-09-12T00:04:24.971 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8298000000000003e-05 2024-09-12T00:04:24.971 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.971 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.971 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.971 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921899+0000", 2024-09-12T00:04:24.971 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7059999999999993e-06 2024-09-12T00:04:24.971 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.971 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.972 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.972 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921904+0000", 2024-09-12T00:04:24.972 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9799999999999998e-06 2024-09-12T00:04:24.972 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.972 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.972 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.972 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932144+0000", 2024-09-12T00:04:24.972 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010239817999999999 2024-09-12T00:04:24.972 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.972 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.972 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.972 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932284+0000", 2024-09-12T00:04:24.972 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139436 2024-09-12T00:04:24.973 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.973 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.973 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:24.973 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932498+0000", 2024-09-12T00:04:24.973 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000214408 2024-09-12T00:04:24.973 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.973 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.973 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.973 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936444+0000", 2024-09-12T00:04:24.973 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039464169999999998 2024-09-12T00:04:24.973 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.973 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.973 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.973 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937702+0000", 2024-09-12T00:04:24.974 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012571679999999999 2024-09-12T00:04:24.974 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.974 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.974 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.974 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937793+0000", 2024-09-12T00:04:24.974 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1489000000000004e-05 2024-09-12T00:04:24.974 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.974 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.974 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.974 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937854+0000", 2024-09-12T00:04:24.974 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1333000000000004e-05 2024-09-12T00:04:24.974 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.975 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.975 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.975 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.975 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.975 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:24.975 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:24.975 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 73.018843977000003, 2024-09-12T00:04:24.975 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017189138999999999, 2024-09-12T00:04:24.975 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.975 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.975 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.975 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.976 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:24.976 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:24.976 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 48 2024-09-12T00:04:24.976 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.976 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.976 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.976 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.976 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:24.976 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.976 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.976 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.976 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.976 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:24.977 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.977 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.977 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.977 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.977 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:24.977 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7399999999999998e-07 2024-09-12T00:04:24.977 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.977 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.977 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.977 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921918+0000", 2024-09-12T00:04:24.977 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6399999999999999e-06 2024-09-12T00:04:24.977 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.977 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.978 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.978 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921925+0000", 2024-09-12T00:04:24.978 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7190000000000004e-06 2024-09-12T00:04:24.978 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.978 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.978 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.978 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921931+0000", 2024-09-12T00:04:24.978 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2519999999999996e-06 2024-09-12T00:04:24.978 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.978 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.978 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.978 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933475+0000", 2024-09-12T00:04:24.978 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011543759000000001 2024-09-12T00:04:24.978 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.979 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.979 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.979 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933617+0000", 2024-09-12T00:04:24.979 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000142282 2024-09-12T00:04:24.979 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.979 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.979 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:24.979 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933860+0000", 2024-09-12T00:04:24.979 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024276199999999999 2024-09-12T00:04:24.979 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.979 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.979 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.979 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937933+0000", 2024-09-12T00:04:24.979 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040734680000000002 2024-09-12T00:04:24.980 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.980 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.980 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.980 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938955+0000", 2024-09-12T00:04:24.980 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001021987 2024-09-12T00:04:24.980 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.980 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.980 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.980 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939038+0000", 2024-09-12T00:04:24.980 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2449999999999998e-05 2024-09-12T00:04:24.980 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.980 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.980 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.980 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939103+0000", 2024-09-12T00:04:24.981 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5345999999999994e-05 2024-09-12T00:04:24.981 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.981 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.981 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.981 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.981 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.981 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:24.981 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:24.981 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 73.018818435, 2024-09-12T00:04:24.981 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018247975, 2024-09-12T00:04:24.981 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.981 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.981 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.982 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.982 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:24.982 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:24.982 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 49 2024-09-12T00:04:24.982 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.982 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.982 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.982 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.982 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:24.982 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.982 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.982 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.982 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.982 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:24.983 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.983 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.983 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.983 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.983 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921940+0000", 2024-09-12T00:04:24.983 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7e-07 2024-09-12T00:04:24.983 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.983 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.983 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.983 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921943+0000", 2024-09-12T00:04:24.983 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1889999999999999e-06 2024-09-12T00:04:24.983 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.983 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.983 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.984 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921952+0000", 2024-09-12T00:04:24.984 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0010000000000007e-06 2024-09-12T00:04:24.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.984 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.984 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.984 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921959+0000", 2024-09-12T00:04:24.984 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2570000000000001e-06 2024-09-12T00:04:24.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.984 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.984 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.984 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935333+0000", 2024-09-12T00:04:24.984 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013373368 2024-09-12T00:04:24.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.985 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.985 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.985 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935472+0000", 2024-09-12T00:04:24.985 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013987900000000001 2024-09-12T00:04:24.985 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.985 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.985 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:24.985 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935700+0000", 2024-09-12T00:04:24.985 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000227922 2024-09-12T00:04:24.985 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.985 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.985 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.985 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939858+0000", 2024-09-12T00:04:24.985 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041571300000000002 2024-09-12T00:04:24.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.986 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.986 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.986 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940018+0000", 2024-09-12T00:04:24.986 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016060400000000001 2024-09-12T00:04:24.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.986 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.986 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.986 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940114+0000", 2024-09-12T00:04:24.986 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5692999999999993e-05 2024-09-12T00:04:24.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.986 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.986 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.987 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940187+0000", 2024-09-12T00:04:24.987 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3561999999999998e-05 2024-09-12T00:04:24.987 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.987 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.987 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.987 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.987 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:24.987 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:24.987 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 73.018775648000002, 2024-09-12T00:04:24.987 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021018614000000001, 2024-09-12T00:04:24.987 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.987 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.987 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.988 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.988 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:24.988 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:24.988 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 50 2024-09-12T00:04:24.988 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.988 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.988 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.988 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.988 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:24.988 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.988 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.988 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.988 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.989 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:24.989 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.989 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.989 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.989 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921983+0000", 2024-09-12T00:04:24.989 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4499999999999996e-07 2024-09-12T00:04:24.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.989 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.989 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.989 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922071+0000", 2024-09-12T00:04:24.989 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8010000000000006e-05 2024-09-12T00:04:24.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.989 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.990 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.990 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922084+0000", 2024-09-12T00:04:24.990 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3275000000000001e-05 2024-09-12T00:04:24.990 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.990 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.990 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.990 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922093+0000", 2024-09-12T00:04:24.990 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0580000000000004e-06 2024-09-12T00:04:24.990 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.990 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.990 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.990 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936515+0000", 2024-09-12T00:04:24.990 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014421270999999999 2024-09-12T00:04:24.990 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.991 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.991 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.991 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936677+0000", 2024-09-12T00:04:24.991 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162003 2024-09-12T00:04:24.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.991 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.991 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:24.991 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936908+0000", 2024-09-12T00:04:24.991 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023115700000000001 2024-09-12T00:04:24.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.991 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.991 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.991 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939985+0000", 2024-09-12T00:04:24.991 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030773879999999999 2024-09-12T00:04:24.992 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.992 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.992 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.992 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942623+0000", 2024-09-12T00:04:24.992 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026377929999999998 2024-09-12T00:04:24.992 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.992 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.992 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.992 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942818+0000", 2024-09-12T00:04:24.992 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019556200000000001 2024-09-12T00:04:24.992 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.992 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.992 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.993 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943001+0000", 2024-09-12T00:04:24.993 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018235199999999999 2024-09-12T00:04:24.993 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.993 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.993 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.993 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.993 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.993 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:24.993 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:24.993 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 73.018641255999995, 2024-09-12T00:04:24.993 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021092493, 2024-09-12T00:04:24.993 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.993 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.993 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:24.994 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:24.994 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:24.994 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:24.994 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 51 2024-09-12T00:04:24.994 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.994 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:24.994 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.994 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:24.994 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:24.994 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.994 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.994 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.994 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:24.994 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:24.995 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:24.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.995 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.995 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:24.995 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922118+0000", 2024-09-12T00:04:24.995 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0389999999999999e-06 2024-09-12T00:04:24.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.995 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.995 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:24.995 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922124+0000", 2024-09-12T00:04:24.995 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5409999999999997e-06 2024-09-12T00:04:24.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.995 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.996 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:24.996 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922136+0000", 2024-09-12T00:04:24.996 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.205e-05 2024-09-12T00:04:24.996 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.996 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.996 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:24.996 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922147+0000", 2024-09-12T00:04:24.996 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0451e-05 2024-09-12T00:04:24.996 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.996 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.996 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:24.996 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938000+0000", 2024-09-12T00:04:24.996 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015853682000000001 2024-09-12T00:04:24.996 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.997 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.997 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:24.997 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938142+0000", 2024-09-12T00:04:24.997 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014148899999999999 2024-09-12T00:04:24.997 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.997 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.997 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:24.997 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938362+0000", 2024-09-12T00:04:24.997 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022034800000000001 2024-09-12T00:04:24.997 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.997 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.997 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:24.997 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940330+0000", 2024-09-12T00:04:24.997 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001967459 2024-09-12T00:04:24.998 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.998 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.998 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:24.998 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943064+0000", 2024-09-12T00:04:24.998 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027346219999999999 2024-09-12T00:04:24.998 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.998 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.998 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:24.998 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943152+0000", 2024-09-12T00:04:24.998 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7563000000000002e-05 2024-09-12T00:04:24.998 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.998 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.998 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:24.998 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943209+0000", 2024-09-12T00:04:24.999 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7249e-05 2024-09-12T00:04:24.999 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.999 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:24.999 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:24.999 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:24.999 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:24.999 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:24.999 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:24.999 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 73.018591763000003, 2024-09-12T00:04:24.999 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021175616000000001, 2024-09-12T00:04:24.999 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:24.999 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:24.999 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.000 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:25.000 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:25.000 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:25.000 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 52 2024-09-12T00:04:25.000 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.000 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.000 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.000 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.000 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:25.000 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.000 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.000 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.000 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.001 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:25.001 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.001 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.001 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.001 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.001 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922167+0000", 2024-09-12T00:04:25.001 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3300000000000001e-07 2024-09-12T00:04:25.001 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.001 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.001 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.001 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922174+0000", 2024-09-12T00:04:25.001 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7070000000000003e-06 2024-09-12T00:04:25.001 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.001 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.002 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.002 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922184+0000", 2024-09-12T00:04:25.002 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682e-05 2024-09-12T00:04:25.002 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.002 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.002 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.002 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922195+0000", 2024-09-12T00:04:25.002 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0489000000000001e-05 2024-09-12T00:04:25.002 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.002 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.002 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.002 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939166+0000", 2024-09-12T00:04:25.002 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016971245999999999 2024-09-12T00:04:25.002 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.003 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.003 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.003 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939243+0000", 2024-09-12T00:04:25.003 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7201999999999997e-05 2024-09-12T00:04:25.003 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.003 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.003 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:25.003 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939381+0000", 2024-09-12T00:04:25.003 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013770699999999999 2024-09-12T00:04:25.003 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.003 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.003 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:25.003 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940923+0000", 2024-09-12T00:04:25.004 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001542302 2024-09-12T00:04:25.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.004 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.004 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:25.004 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943221+0000", 2024-09-12T00:04:25.004 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022979720000000001 2024-09-12T00:04:25.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.004 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.005 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.005 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943295+0000", 2024-09-12T00:04:25.005 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3317000000000003e-05 2024-09-12T00:04:25.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.005 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.005 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.005 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943342+0000", 2024-09-12T00:04:25.005 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7159e-05 2024-09-12T00:04:25.005 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.005 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.005 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.006 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.006 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:25.006 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:25.006 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 72.769646797000007, 2024-09-12T00:04:25.006 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015229411999999999, 2024-09-12T00:04:25.006 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.006 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.006 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.006 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:25.006 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:25.006 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:25.006 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 67 2024-09-12T00:04:25.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.006 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.007 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.007 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.007 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:25.007 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.007 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.007 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.007 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:25.007 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.007 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.007 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.007 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171112+0000", 2024-09-12T00:04:25.007 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2899999999999999e-06 2024-09-12T00:04:25.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.008 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.008 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.008 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171119+0000", 2024-09-12T00:04:25.008 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8870000000000003e-06 2024-09-12T00:04:25.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.008 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.008 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.008 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171131+0000", 2024-09-12T00:04:25.008 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1902999999999999e-05 2024-09-12T00:04:25.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.008 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.008 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.009 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171147+0000", 2024-09-12T00:04:25.009 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6203000000000001e-05 2024-09-12T00:04:25.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.009 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.009 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.009 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175044+0000", 2024-09-12T00:04:25.009 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038967310000000001 2024-09-12T00:04:25.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.009 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.009 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.009 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175172+0000", 2024-09-12T00:04:25.009 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012784100000000001 2024-09-12T00:04:25.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.009 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.010 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:25.010 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175372+0000", 2024-09-12T00:04:25.010 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019978500000000001 2024-09-12T00:04:25.010 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.010 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.010 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:25.010 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179276+0000", 2024-09-12T00:04:25.010 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039042149999999999 2024-09-12T00:04:25.010 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.010 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.010 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:25.010 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186150+0000", 2024-09-12T00:04:25.010 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0068740019999999997 2024-09-12T00:04:25.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.011 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.011 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.011 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186266+0000", 2024-09-12T00:04:25.011 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115742 2024-09-12T00:04:25.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.011 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.011 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.011 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186340+0000", 2024-09-12T00:04:25.011 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4813000000000004e-05 2024-09-12T00:04:25.011 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.011 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.011 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.012 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.012 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:25.012 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:25.012 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 72.769585720999999, 2024-09-12T00:04:25.012 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015308448000000001, 2024-09-12T00:04:25.012 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.012 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.012 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.012 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:25.012 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:25.012 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:25.012 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 68 2024-09-12T00:04:25.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.012 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.013 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.013 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.013 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:25.013 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.013 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.013 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.013 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.013 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:25.013 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.013 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.013 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.013 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.013 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171173+0000", 2024-09-12T00:04:25.013 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:04:25.014 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.014 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.014 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.014 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171182+0000", 2024-09-12T00:04:25.014 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2359999999999993e-06 2024-09-12T00:04:25.014 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.014 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.014 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.014 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171193+0000", 2024-09-12T00:04:25.014 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.095e-05 2024-09-12T00:04:25.014 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.014 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.014 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.015 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171207+0000", 2024-09-12T00:04:25.015 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3339999999999999e-05 2024-09-12T00:04:25.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.015 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.015 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.015 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176753+0000", 2024-09-12T00:04:25.015 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055460240000000001 2024-09-12T00:04:25.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.015 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.015 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.015 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176921+0000", 2024-09-12T00:04:25.015 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000168503 2024-09-12T00:04:25.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.015 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.016 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:25.016 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177112+0000", 2024-09-12T00:04:25.016 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019113999999999999 2024-09-12T00:04:25.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.016 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.016 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:25.016 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179382+0000", 2024-09-12T00:04:25.016 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022697099999999999 2024-09-12T00:04:25.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.016 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.016 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:25.016 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186356+0000", 2024-09-12T00:04:25.016 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069741919999999997 2024-09-12T00:04:25.017 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.017 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.017 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.017 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186422+0000", 2024-09-12T00:04:25.017 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6387e-05 2024-09-12T00:04:25.017 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.017 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.017 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.017 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186481+0000", 2024-09-12T00:04:25.017 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8059000000000001e-05 2024-09-12T00:04:25.017 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.017 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.017 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.017 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.018 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.018 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:25.018 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:25.018 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 72.769533951, 2024-09-12T00:04:25.018 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020001835999999999, 2024-09-12T00:04:25.018 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.018 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.018 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.018 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:25.018 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:25.018 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:25.018 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 69 2024-09-12T00:04:25.018 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.018 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.019 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.019 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.019 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:25.019 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.019 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.019 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.019 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.019 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:25.019 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.019 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.019 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.019 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.019 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171225+0000", 2024-09-12T00:04:25.020 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0599999999999999e-07 2024-09-12T00:04:25.020 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.020 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.020 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.020 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171349+0000", 2024-09-12T00:04:25.020 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012407299999999999 2024-09-12T00:04:25.020 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.020 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.020 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.020 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171367+0000", 2024-09-12T00:04:25.020 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8413000000000001e-05 2024-09-12T00:04:25.020 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.020 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.020 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.021 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171376+0000", 2024-09-12T00:04:25.021 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8170000000000005e-06 2024-09-12T00:04:25.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.021 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.021 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.021 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177692+0000", 2024-09-12T00:04:25.021 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063156729999999999 2024-09-12T00:04:25.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.021 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.021 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.021 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177817+0000", 2024-09-12T00:04:25.021 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012581499999999999 2024-09-12T00:04:25.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.021 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.022 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:25.022 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.178015+0000", 2024-09-12T00:04:25.022 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019715100000000001 2024-09-12T00:04:25.022 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.022 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.022 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:25.022 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181798+0000", 2024-09-12T00:04:25.022 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003783308 2024-09-12T00:04:25.022 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.022 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.022 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:25.022 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190976+0000", 2024-09-12T00:04:25.022 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091776519999999997 2024-09-12T00:04:25.022 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.023 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.023 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.023 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191122+0000", 2024-09-12T00:04:25.023 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000145966 2024-09-12T00:04:25.023 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.023 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.023 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.023 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191226+0000", 2024-09-12T00:04:25.023 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104162 2024-09-12T00:04:25.023 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.023 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.023 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.023 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.023 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.024 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:25.024 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:25.024 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 72.769365215999997, 2024-09-12T00:04:25.024 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019997773, 2024-09-12T00:04:25.024 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.024 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.024 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.024 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:25.024 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:25.024 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:25.024 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 70 2024-09-12T00:04:25.024 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.024 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.025 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.025 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.025 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:25.025 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.025 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.025 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.025 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.025 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:25.025 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.025 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.025 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.025 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.025 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:25.025 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3699999999999999e-07 2024-09-12T00:04:25.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.026 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.026 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.026 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171403+0000", 2024-09-12T00:04:25.026 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6199999999999994e-06 2024-09-12T00:04:25.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.026 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.026 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.026 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171416+0000", 2024-09-12T00:04:25.026 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2636000000000001e-05 2024-09-12T00:04:25.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.026 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.026 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.026 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171423+0000", 2024-09-12T00:04:25.027 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5440000000000001e-06 2024-09-12T00:04:25.027 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.027 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.027 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.027 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179458+0000", 2024-09-12T00:04:25.027 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080351989999999998 2024-09-12T00:04:25.027 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.027 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.027 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.027 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179604+0000", 2024-09-12T00:04:25.027 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014519899999999999 2024-09-12T00:04:25.027 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.027 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.027 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:25.028 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179831+0000", 2024-09-12T00:04:25.028 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022704800000000001 2024-09-12T00:04:25.028 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.028 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.028 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:25.028 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181918+0000", 2024-09-12T00:04:25.028 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020873950000000001 2024-09-12T00:04:25.028 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.028 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.028 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:25.028 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191243+0000", 2024-09-12T00:04:25.028 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0093244729999999998 2024-09-12T00:04:25.028 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.029 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.029 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.029 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191309+0000", 2024-09-12T00:04:25.029 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6116000000000002e-05 2024-09-12T00:04:25.029 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.029 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.029 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.029 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191390+0000", 2024-09-12T00:04:25.029 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1705999999999993e-05 2024-09-12T00:04:25.029 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.029 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.029 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.029 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.030 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.030 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:25.030 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:25.030 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 72.769319143000004, 2024-09-12T00:04:25.030 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020263554, 2024-09-12T00:04:25.030 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.030 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.030 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.030 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:25.030 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:25.030 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:25.030 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 71 2024-09-12T00:04:25.030 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.030 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.031 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.031 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.031 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:25.031 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.031 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.031 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.031 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.031 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:25.031 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.031 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.031 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.031 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.031 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:25.032 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5000000000000002e-07 2024-09-12T00:04:25.032 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.032 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.032 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.032 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171454+0000", 2024-09-12T00:04:25.032 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5046e-05 2024-09-12T00:04:25.032 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.032 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.032 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.032 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171471+0000", 2024-09-12T00:04:25.032 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6923999999999999e-05 2024-09-12T00:04:25.032 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.032 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.032 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.033 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171487+0000", 2024-09-12T00:04:25.033 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5823000000000001e-05 2024-09-12T00:04:25.033 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.033 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.033 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.033 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180765+0000", 2024-09-12T00:04:25.033 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0092774399999999996 2024-09-12T00:04:25.033 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.033 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.033 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.033 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180900+0000", 2024-09-12T00:04:25.033 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013556700000000001 2024-09-12T00:04:25.033 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.034 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.034 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:25.034 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181108+0000", 2024-09-12T00:04:25.034 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020727899999999999 2024-09-12T00:04:25.034 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.034 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.034 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:25.034 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184725+0000", 2024-09-12T00:04:25.034 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036171340000000001 2024-09-12T00:04:25.034 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.034 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.034 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:25.034 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191413+0000", 2024-09-12T00:04:25.034 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066881830000000003 2024-09-12T00:04:25.035 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.035 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.035 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.035 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191540+0000", 2024-09-12T00:04:25.035 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000126823 2024-09-12T00:04:25.035 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.035 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.035 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.035 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191702+0000", 2024-09-12T00:04:25.035 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162585 2024-09-12T00:04:25.035 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.035 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.035 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.036 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.036 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.036 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:25.036 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:25.036 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 72.769240566999997, 2024-09-12T00:04:25.036 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020448573000000001, 2024-09-12T00:04:25.036 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.036 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.036 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.036 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:25.036 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:25.036 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:25.036 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 72 2024-09-12T00:04:25.036 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.037 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.037 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.037 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.037 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:25.037 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.037 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.037 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.037 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.037 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:25.037 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.037 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.037 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.037 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.038 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171518+0000", 2024-09-12T00:04:25.038 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0440000000000001e-06 2024-09-12T00:04:25.038 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.038 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.038 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.038 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171647+0000", 2024-09-12T00:04:25.038 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012912899999999999 2024-09-12T00:04:25.038 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.038 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.038 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.038 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171664+0000", 2024-09-12T00:04:25.038 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6079999999999999e-05 2024-09-12T00:04:25.038 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.038 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.039 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.039 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171675+0000", 2024-09-12T00:04:25.039 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1223000000000001e-05 2024-09-12T00:04:25.039 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.039 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.039 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.039 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182000+0000", 2024-09-12T00:04:25.039 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010324949 2024-09-12T00:04:25.039 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.039 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.039 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.039 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182178+0000", 2024-09-12T00:04:25.039 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017808799999999999 2024-09-12T00:04:25.039 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.040 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.040 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:25.040 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182402+0000", 2024-09-12T00:04:25.040 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022381199999999999 2024-09-12T00:04:25.040 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.040 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.040 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:25.040 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190935+0000", 2024-09-12T00:04:25.040 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085331560000000001 2024-09-12T00:04:25.040 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.040 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.040 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:25.040 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191728+0000", 2024-09-12T00:04:25.040 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079325700000000001 2024-09-12T00:04:25.041 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.041 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.041 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.041 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191864+0000", 2024-09-12T00:04:25.041 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013606299999999999 2024-09-12T00:04:25.041 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.041 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.041 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.041 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191966+0000", 2024-09-12T00:04:25.041 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101772 2024-09-12T00:04:25.041 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.041 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.041 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.041 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.042 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.042 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:25.042 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:25.042 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 72.769057372000006, 2024-09-12T00:04:25.042 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020675235, 2024-09-12T00:04:25.042 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.042 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.042 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.042 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:25.042 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:25.042 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:25.042 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 73 2024-09-12T00:04:25.042 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.043 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.043 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.043 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.043 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:25.043 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.043 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.043 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.043 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:25.043 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.043 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.043 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.044 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171701+0000", 2024-09-12T00:04:25.044 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0999999999999997e-07 2024-09-12T00:04:25.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.044 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.044 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.044 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171709+0000", 2024-09-12T00:04:25.044 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2540000000000003e-06 2024-09-12T00:04:25.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.044 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.044 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.044 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171724+0000", 2024-09-12T00:04:25.044 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5569e-05 2024-09-12T00:04:25.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.044 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.045 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.045 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171734+0000", 2024-09-12T00:04:25.045 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6139999999999998e-06 2024-09-12T00:04:25.045 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.045 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.045 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.045 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183774+0000", 2024-09-12T00:04:25.045 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012040444000000001 2024-09-12T00:04:25.045 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.045 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.045 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.045 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183896+0000", 2024-09-12T00:04:25.045 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012204199999999999 2024-09-12T00:04:25.045 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.046 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.046 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:25.046 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184084+0000", 2024-09-12T00:04:25.046 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018792599999999999 2024-09-12T00:04:25.046 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.046 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.046 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:25.046 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191984+0000", 2024-09-12T00:04:25.046 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079003790000000008 2024-09-12T00:04:25.046 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.046 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.046 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:25.046 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192093+0000", 2024-09-12T00:04:25.047 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000108942 2024-09-12T00:04:25.047 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.047 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.047 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.047 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192250+0000", 2024-09-12T00:04:25.047 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015637600000000001 2024-09-12T00:04:25.047 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.047 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.047 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.047 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192376+0000", 2024-09-12T00:04:25.047 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012587899999999999 2024-09-12T00:04:25.047 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.047 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.047 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.048 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.048 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:25.048 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:25.048 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 72.769009162000003, 2024-09-12T00:04:25.048 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021088828, 2024-09-12T00:04:25.048 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.048 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.048 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.048 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:25.048 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:25.048 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:25.048 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 74 2024-09-12T00:04:25.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.049 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.049 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.049 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.049 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:25.049 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.049 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.049 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.049 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:25.049 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.049 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.049 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.050 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:25.050 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1699999999999997e-07 2024-09-12T00:04:25.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.050 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.050 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.050 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171758+0000", 2024-09-12T00:04:25.050 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0860000000000008e-06 2024-09-12T00:04:25.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.050 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.050 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.050 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171774+0000", 2024-09-12T00:04:25.050 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:04:25.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.050 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.051 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.051 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171788+0000", 2024-09-12T00:04:25.051 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4793999999999999e-05 2024-09-12T00:04:25.051 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.051 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.051 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.051 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184842+0000", 2024-09-12T00:04:25.051 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013053607 2024-09-12T00:04:25.051 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.051 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.051 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.051 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185130+0000", 2024-09-12T00:04:25.051 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00028779199999999998 2024-09-12T00:04:25.051 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.052 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.052 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:25.052 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185378+0000", 2024-09-12T00:04:25.052 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024780100000000002 2024-09-12T00:04:25.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.052 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.052 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:25.052 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192513+0000", 2024-09-12T00:04:25.052 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071350770000000001 2024-09-12T00:04:25.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.052 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.053 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:25.053 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192690+0000", 2024-09-12T00:04:25.053 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000176892 2024-09-12T00:04:25.053 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.053 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.053 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.053 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192769+0000", 2024-09-12T00:04:25.053 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9466000000000001e-05 2024-09-12T00:04:25.053 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.053 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.053 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.053 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192837+0000", 2024-09-12T00:04:25.053 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8466000000000005e-05 2024-09-12T00:04:25.053 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.054 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.054 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.054 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.054 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.054 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:25.054 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:25.054 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 72.768956584999998, 2024-09-12T00:04:25.054 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.02121994, 2024-09-12T00:04:25.054 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.054 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.054 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.054 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:25.054 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:25.055 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:25.055 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 75 2024-09-12T00:04:25.055 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.055 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.055 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.055 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.055 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:25.055 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.055 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.055 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.055 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.055 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:25.055 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.055 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.056 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.056 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.056 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171802+0000", 2024-09-12T00:04:25.056 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5000000000000002e-07 2024-09-12T00:04:25.056 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.056 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.056 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.056 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171954+0000", 2024-09-12T00:04:25.056 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015215500000000001 2024-09-12T00:04:25.056 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.056 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.056 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.056 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171966+0000", 2024-09-12T00:04:25.057 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1548e-05 2024-09-12T00:04:25.057 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.057 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.057 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.057 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171970+0000", 2024-09-12T00:04:25.057 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8729999999999998e-06 2024-09-12T00:04:25.057 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.057 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.057 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.057 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186552+0000", 2024-09-12T00:04:25.057 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014581775 2024-09-12T00:04:25.057 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.057 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.057 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.058 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186702+0000", 2024-09-12T00:04:25.058 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014946 2024-09-12T00:04:25.058 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.058 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.058 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:25.058 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186897+0000", 2024-09-12T00:04:25.058 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000195071 2024-09-12T00:04:25.058 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.058 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.058 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:25.058 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192666+0000", 2024-09-12T00:04:25.058 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057693470000000002 2024-09-12T00:04:25.058 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.058 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.059 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:25.059 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192857+0000", 2024-09-12T00:04:25.059 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191149 2024-09-12T00:04:25.059 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.059 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.059 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.059 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192967+0000", 2024-09-12T00:04:25.059 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110202 2024-09-12T00:04:25.059 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.059 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.059 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.059 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193021+0000", 2024-09-12T00:04:25.059 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3709999999999999e-05 2024-09-12T00:04:25.059 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.060 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.060 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.060 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.060 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.060 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:25.060 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:25.060 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 72.768777290000003, 2024-09-12T00:04:25.060 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026297425999999999, 2024-09-12T00:04:25.060 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.060 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.060 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.060 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:25.060 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:25.061 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:25.061 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 76 2024-09-12T00:04:25.061 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.061 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.061 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.061 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.061 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:25.061 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.061 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.061 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.061 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.061 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:25.061 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.061 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.062 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.062 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.062 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:25.062 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9399999999999995e-07 2024-09-12T00:04:25.062 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.062 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.062 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.062 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171987+0000", 2024-09-12T00:04:25.062 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5230000000000003e-06 2024-09-12T00:04:25.062 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.062 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.062 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.062 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172005+0000", 2024-09-12T00:04:25.062 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8788e-05 2024-09-12T00:04:25.063 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.063 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.063 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.063 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172010+0000", 2024-09-12T00:04:25.063 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7570000000000004e-06 2024-09-12T00:04:25.063 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.063 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.063 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.063 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193104+0000", 2024-09-12T00:04:25.063 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021094112000000002 2024-09-12T00:04:25.063 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.063 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.063 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.063 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193334+0000", 2024-09-12T00:04:25.064 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000229855 2024-09-12T00:04:25.064 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.064 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.064 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:25.064 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193697+0000", 2024-09-12T00:04:25.064 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00036272399999999998 2024-09-12T00:04:25.064 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.064 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.064 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:25.064 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.195602+0000", 2024-09-12T00:04:25.064 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019049620000000001 2024-09-12T00:04:25.064 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.064 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.065 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:25.065 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198123+0000", 2024-09-12T00:04:25.065 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025216520000000001 2024-09-12T00:04:25.065 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.065 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.065 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.065 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198213+0000", 2024-09-12T00:04:25.065 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0008999999999998e-05 2024-09-12T00:04:25.065 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.065 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.065 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.065 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198278+0000", 2024-09-12T00:04:25.065 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4549999999999997e-05 2024-09-12T00:04:25.065 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.066 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.066 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.066 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.066 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.066 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:25.067 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:04:25.068 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:25.065+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:25.168 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:25.167+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:25.219 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:25.219 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:25.219 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:25.220 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:25.232 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:04:25.277 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:25.277+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:25.345 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:25.346 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:25.346 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:25.346 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:25.346 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:25.363 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:04:25.370 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:25.371+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:25.470 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:25.469+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:25.532 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:25.533 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:25.533 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:25.533 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:25.533 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.533 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4232.0:1 2.3 e20/19 2:c4c92e5a:::rbd_trash:head v 20'1, mlcod=0'0)", 2024-09-12T00:04:25.533 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:16.594343+0000", 2024-09-12T00:04:25.533 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.939293676000005, 2024-09-12T00:04:25.533 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030233460000000001, 2024-09-12T00:04:25.533 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.533 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.533 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.533 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.533 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.534 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.534 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594343+0000", 2024-09-12T00:04:25.534 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.534 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.534 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.534 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.534 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594343+0000", 2024-09-12T00:04:25.534 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.534 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.534 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.534 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.534 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594343+0000", 2024-09-12T00:04:25.534 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7e-07 2024-09-12T00:04:25.534 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.535 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.535 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.535 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594348+0000", 2024-09-12T00:04:25.535 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7899999999999999e-06 2024-09-12T00:04:25.535 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.535 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.535 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.535 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594366+0000", 2024-09-12T00:04:25.535 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8255000000000001e-05 2024-09-12T00:04:25.535 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.535 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.535 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.536 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594381+0000", 2024-09-12T00:04:25.536 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4905999999999999e-05 2024-09-12T00:04:25.536 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.536 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.536 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.536 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594710+0000", 2024-09-12T00:04:25.536 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000329208 2024-09-12T00:04:25.537 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.537 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.537 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.537 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594870+0000", 2024-09-12T00:04:25.537 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015991900000000001 2024-09-12T00:04:25.537 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.537 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.537 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.537 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597290+0000", 2024-09-12T00:04:25.537 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024196439999999999 2024-09-12T00:04:25.537 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.537 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.537 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.538 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597366+0000", 2024-09-12T00:04:25.538 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6254000000000005e-05 2024-09-12T00:04:25.538 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.538 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.538 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.538 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.538 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.538 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:56 7.3 e32/31 7:c609908c:::notify.5:head v 32'1, mlcod=0'0)", 2024-09-12T00:04:25.538 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.376429+0000", 2024-09-12T00:04:25.538 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 54.157207290999999, 2024-09-12T00:04:25.538 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029522699999999999, 2024-09-12T00:04:25.538 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.538 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.538 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.539 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.539 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.539 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.539 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376429+0000", 2024-09-12T00:04:25.539 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.539 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.539 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.539 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.539 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376429+0000", 2024-09-12T00:04:25.539 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.539 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.539 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.539 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.539 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376435+0000", 2024-09-12T00:04:25.540 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8619999999999999e-06 2024-09-12T00:04:25.540 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.540 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.540 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.540 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376445+0000", 2024-09-12T00:04:25.540 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7929999999999992e-06 2024-09-12T00:04:25.540 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.540 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.540 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.540 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376467+0000", 2024-09-12T00:04:25.540 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2840000000000002e-05 2024-09-12T00:04:25.540 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.540 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.541 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.541 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376481+0000", 2024-09-12T00:04:25.541 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3254e-05 2024-09-12T00:04:25.541 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.541 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.541 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.541 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376585+0000", 2024-09-12T00:04:25.541 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104066 2024-09-12T00:04:25.541 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.541 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.541 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.541 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376611+0000", 2024-09-12T00:04:25.541 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6641000000000001e-05 2024-09-12T00:04:25.542 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.542 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.542 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.542 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.379288+0000", 2024-09-12T00:04:25.542 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026761879999999999 2024-09-12T00:04:25.542 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.542 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.542 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.542 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.379381+0000", 2024-09-12T00:04:25.542 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3626000000000001e-05 2024-09-12T00:04:25.542 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.542 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.542 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.542 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.543 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.543 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:214 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'1, mlcod=0'0)", 2024-09-12T00:04:25.543 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.401315+0000", 2024-09-12T00:04:25.543 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 51.132321417999997, 2024-09-12T00:04:25.543 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0018968030000000001, 2024-09-12T00:04:25.543 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.543 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.543 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.543 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.543 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.543 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.543 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.401315+0000", 2024-09-12T00:04:25.543 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.543 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.544 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.544 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.544 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.401315+0000", 2024-09-12T00:04:25.544 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.544 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.544 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.544 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.544 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.401316+0000", 2024-09-12T00:04:25.544 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8299999999999996e-07 2024-09-12T00:04:25.544 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.544 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.544 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.545 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.401326+0000", 2024-09-12T00:04:25.545 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0360000000000001e-05 2024-09-12T00:04:25.545 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.545 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.545 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.545 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.401363+0000", 2024-09-12T00:04:25.545 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7020000000000001e-05 2024-09-12T00:04:25.545 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.545 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.545 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.545 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.401384+0000", 2024-09-12T00:04:25.545 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1189999999999999e-05 2024-09-12T00:04:25.545 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.545 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.546 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.546 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.401578+0000", 2024-09-12T00:04:25.546 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019421799999999999 2024-09-12T00:04:25.546 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.546 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.546 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.546 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.401631+0000", 2024-09-12T00:04:25.546 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2830000000000001e-05 2024-09-12T00:04:25.546 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.547 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.547 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.547 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.403135+0000", 2024-09-12T00:04:25.547 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015033379999999999 2024-09-12T00:04:25.547 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.547 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.547 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.547 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.403212+0000", 2024-09-12T00:04:25.547 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7064000000000006e-05 2024-09-12T00:04:25.547 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.547 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.547 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.547 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.547 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.548 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:25.548 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.411707+0000", 2024-09-12T00:04:25.548 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 51.121929283, 2024-09-12T00:04:25.548 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0031684230000000001, 2024-09-12T00:04:25.548 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.548 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.548 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.548 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:25.548 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:25.548 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:25.548 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 217 2024-09-12T00:04:25.548 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.548 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.549 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.549 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.549 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411707+0000", 2024-09-12T00:04:25.549 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.549 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.549 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.549 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.549 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411707+0000", 2024-09-12T00:04:25.549 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.549 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.549 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.549 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.549 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411710+0000", 2024-09-12T00:04:25.550 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4599999999999999e-06 2024-09-12T00:04:25.550 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.550 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.550 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.550 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411740+0000", 2024-09-12T00:04:25.550 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.953e-05 2024-09-12T00:04:25.550 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.550 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.550 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.550 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411772+0000", 2024-09-12T00:04:25.550 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.163e-05 2024-09-12T00:04:25.550 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.550 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.550 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.551 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411789+0000", 2024-09-12T00:04:25.551 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7614000000000001e-05 2024-09-12T00:04:25.551 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.551 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.551 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.551 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411905+0000", 2024-09-12T00:04:25.551 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115665 2024-09-12T00:04:25.551 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.551 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.551 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.551 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.412108+0000", 2024-09-12T00:04:25.551 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020293500000000001 2024-09-12T00:04:25.551 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.551 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.552 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:25.552 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.412565+0000", 2024-09-12T00:04:25.552 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00045749700000000001 2024-09-12T00:04:25.552 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.552 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.552 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:25.552 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.414449+0000", 2024-09-12T00:04:25.552 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0018841859999999999 2024-09-12T00:04:25.552 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.552 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.552 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:25.552 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.414709+0000", 2024-09-12T00:04:25.552 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00025939399999999998 2024-09-12T00:04:25.553 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.553 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.553 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.553 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.414813+0000", 2024-09-12T00:04:25.553 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104366 2024-09-12T00:04:25.553 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.553 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.553 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.553 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.414875+0000", 2024-09-12T00:04:25.553 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2145999999999998e-05 2024-09-12T00:04:25.553 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.553 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.553 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.553 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.554 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.554 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:646 6.10 e35/29 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 35'1, mlcod=0'0)", 2024-09-12T00:04:25.554 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.597000+0000", 2024-09-12T00:04:25.554 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 50.936636153999999, 2024-09-12T00:04:25.554 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0044366320000000002, 2024-09-12T00:04:25.554 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.554 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.554 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.554 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.554 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.554 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.554 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597000+0000", 2024-09-12T00:04:25.554 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.554 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.555 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.555 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.555 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597000+0000", 2024-09-12T00:04:25.555 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.555 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.555 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.555 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.555 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597000+0000", 2024-09-12T00:04:25.555 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7700000000000001e-07 2024-09-12T00:04:25.555 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.555 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.555 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.555 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597004+0000", 2024-09-12T00:04:25.555 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7560000000000001e-06 2024-09-12T00:04:25.556 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.556 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.556 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.556 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597017+0000", 2024-09-12T00:04:25.556 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.33e-05 2024-09-12T00:04:25.556 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.556 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.556 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.556 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597024+0000", 2024-09-12T00:04:25.556 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8800000000000002e-06 2024-09-12T00:04:25.556 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.556 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.556 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.557 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597080+0000", 2024-09-12T00:04:25.557 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5949999999999998e-05 2024-09-12T00:04:25.557 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.557 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.557 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.557 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597093+0000", 2024-09-12T00:04:25.557 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2695e-05 2024-09-12T00:04:25.557 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.557 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.557 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.557 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601386+0000", 2024-09-12T00:04:25.557 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0042935480000000003 2024-09-12T00:04:25.557 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.557 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.558 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.558 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601437+0000", 2024-09-12T00:04:25.558 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0325999999999999e-05 2024-09-12T00:04:25.558 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.558 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.558 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.558 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.558 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.558 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:667 6.10 e35/29 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 35'2, mlcod=0'0)", 2024-09-12T00:04:25.558 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602975+0000", 2024-09-12T00:04:25.558 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 50.930661692000001, 2024-09-12T00:04:25.558 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040817340000000001, 2024-09-12T00:04:25.558 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.559 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.559 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.559 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.559 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.559 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.559 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602975+0000", 2024-09-12T00:04:25.559 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.559 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.559 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.559 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.559 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602975+0000", 2024-09-12T00:04:25.559 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.559 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.560 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.560 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.560 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602981+0000", 2024-09-12T00:04:25.560 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7939999999999997e-06 2024-09-12T00:04:25.560 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.560 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.560 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.560 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602988+0000", 2024-09-12T00:04:25.560 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5270000000000004e-06 2024-09-12T00:04:25.560 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.560 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.560 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.560 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603003+0000", 2024-09-12T00:04:25.561 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4731e-05 2024-09-12T00:04:25.561 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.561 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.561 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.561 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603009+0000", 2024-09-12T00:04:25.561 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.297e-06 2024-09-12T00:04:25.561 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.561 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.561 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.561 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603074+0000", 2024-09-12T00:04:25.561 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4713000000000002e-05 2024-09-12T00:04:25.561 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.561 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.561 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.561 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603090+0000", 2024-09-12T00:04:25.562 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6344000000000001e-05 2024-09-12T00:04:25.562 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.562 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.562 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.562 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607014+0000", 2024-09-12T00:04:25.562 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039241800000000002 2024-09-12T00:04:25.562 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.562 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.562 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.562 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607056+0000", 2024-09-12T00:04:25.562 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2147999999999997e-05 2024-09-12T00:04:25.562 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.562 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.563 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.563 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.563 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.563 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:668 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'2, mlcod=0'0)", 2024-09-12T00:04:25.563 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.607803+0000", 2024-09-12T00:04:25.563 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 50.925832915999997, 2024-09-12T00:04:25.563 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022602659999999999, 2024-09-12T00:04:25.563 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.563 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.563 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.563 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.563 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.563 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.563 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607803+0000", 2024-09-12T00:04:25.564 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.564 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.564 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.564 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.564 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607803+0000", 2024-09-12T00:04:25.564 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.564 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.564 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.564 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.564 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607805+0000", 2024-09-12T00:04:25.564 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.378e-06 2024-09-12T00:04:25.564 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.564 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.565 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.565 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607813+0000", 2024-09-12T00:04:25.565 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9899999999999997e-06 2024-09-12T00:04:25.565 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.565 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.565 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.565 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607831+0000", 2024-09-12T00:04:25.565 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8082999999999999e-05 2024-09-12T00:04:25.565 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.565 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.565 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.565 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607839+0000", 2024-09-12T00:04:25.565 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6459999999999999e-06 2024-09-12T00:04:25.565 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.566 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.566 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.566 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607907+0000", 2024-09-12T00:04:25.566 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7961999999999997e-05 2024-09-12T00:04:25.566 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.566 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.566 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.566 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607927+0000", 2024-09-12T00:04:25.566 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9364999999999998e-05 2024-09-12T00:04:25.566 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.566 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.567 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.567 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.610011+0000", 2024-09-12T00:04:25.567 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020847629999999999 2024-09-12T00:04:25.567 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.567 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.567 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.567 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.610064+0000", 2024-09-12T00:04:25.567 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2079000000000001e-05 2024-09-12T00:04:25.567 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.567 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.567 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.567 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.568 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.568 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:669 6.1c e35/29 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 35'3, mlcod=0'0)", 2024-09-12T00:04:25.568 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.608370+0000", 2024-09-12T00:04:25.568 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 50.925266467999997, 2024-09-12T00:04:25.568 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046099820000000003, 2024-09-12T00:04:25.568 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.568 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.568 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.568 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.568 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.568 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.568 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608370+0000", 2024-09-12T00:04:25.568 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.569 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.569 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.569 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.569 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608370+0000", 2024-09-12T00:04:25.569 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.569 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.569 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.569 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.569 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608371+0000", 2024-09-12T00:04:25.569 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8100000000000001e-07 2024-09-12T00:04:25.569 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.569 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.569 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.570 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608377+0000", 2024-09-12T00:04:25.570 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7349999999999999e-06 2024-09-12T00:04:25.570 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.570 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.570 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.570 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608395+0000", 2024-09-12T00:04:25.570 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7285000000000001e-05 2024-09-12T00:04:25.570 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.570 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.570 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.570 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608401+0000", 2024-09-12T00:04:25.570 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.365e-06 2024-09-12T00:04:25.570 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.570 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.571 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.571 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608463+0000", 2024-09-12T00:04:25.571 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2246e-05 2024-09-12T00:04:25.571 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.571 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.571 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.571 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608489+0000", 2024-09-12T00:04:25.571 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5222999999999999e-05 2024-09-12T00:04:25.571 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.571 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.571 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.571 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612945+0000", 2024-09-12T00:04:25.571 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004456603 2024-09-12T00:04:25.571 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.572 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.572 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.572 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612980+0000", 2024-09-12T00:04:25.572 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4544e-05 2024-09-12T00:04:25.572 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.572 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.572 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.572 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.572 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.572 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:682 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'4, mlcod=35'1)", 2024-09-12T00:04:25.572 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.612014+0000", 2024-09-12T00:04:25.572 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 50.921622065000001, 2024-09-12T00:04:25.572 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036839749999999999, 2024-09-12T00:04:25.573 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.573 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.573 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.573 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.573 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.573 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.573 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612014+0000", 2024-09-12T00:04:25.573 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.573 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.573 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.573 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.573 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612014+0000", 2024-09-12T00:04:25.573 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.573 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.574 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.574 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.574 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612015+0000", 2024-09-12T00:04:25.574 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0419999999999999e-06 2024-09-12T00:04:25.574 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.574 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.574 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.574 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612021+0000", 2024-09-12T00:04:25.574 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0009999999999998e-06 2024-09-12T00:04:25.574 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.574 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.574 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.574 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612035+0000", 2024-09-12T00:04:25.574 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.412e-05 2024-09-12T00:04:25.575 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.575 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.575 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.575 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612043+0000", 2024-09-12T00:04:25.575 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9699999999999999e-06 2024-09-12T00:04:25.575 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.575 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.575 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.575 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612111+0000", 2024-09-12T00:04:25.575 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7985999999999996e-05 2024-09-12T00:04:25.575 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.575 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.575 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.575 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612126+0000", 2024-09-12T00:04:25.576 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5099000000000001e-05 2024-09-12T00:04:25.576 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.576 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.576 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.576 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.615633+0000", 2024-09-12T00:04:25.576 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003506416 2024-09-12T00:04:25.576 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.576 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.576 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.576 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.615698+0000", 2024-09-12T00:04:25.576 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5340999999999997e-05 2024-09-12T00:04:25.576 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.576 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.576 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.577 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.577 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.577 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:688 6.1c e35/29 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 35'5, mlcod=35'2)", 2024-09-12T00:04:25.577 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.614097+0000", 2024-09-12T00:04:25.577 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 50.919538969000001, 2024-09-12T00:04:25.577 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001994282, 2024-09-12T00:04:25.577 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.577 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.577 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.577 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.577 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.577 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.577 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.614097+0000", 2024-09-12T00:04:25.578 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.578 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.578 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.578 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.578 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.614097+0000", 2024-09-12T00:04:25.578 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.578 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.578 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.578 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.578 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.614098+0000", 2024-09-12T00:04:25.578 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0299999999999998e-07 2024-09-12T00:04:25.578 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.578 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.578 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.579 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.614114+0000", 2024-09-12T00:04:25.579 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6192e-05 2024-09-12T00:04:25.579 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.579 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.579 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.579 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.614126+0000", 2024-09-12T00:04:25.579 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2081e-05 2024-09-12T00:04:25.579 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.579 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.579 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.579 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.614134+0000", 2024-09-12T00:04:25.579 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7039999999999994e-06 2024-09-12T00:04:25.579 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.579 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.580 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.580 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.614201+0000", 2024-09-12T00:04:25.580 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6534999999999999e-05 2024-09-12T00:04:25.580 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.580 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.580 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.580 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.614227+0000", 2024-09-12T00:04:25.580 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6849e-05 2024-09-12T00:04:25.580 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.580 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.580 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.580 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.616046+0000", 2024-09-12T00:04:25.580 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0018186470000000001 2024-09-12T00:04:25.581 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.581 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.581 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.581 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.616092+0000", 2024-09-12T00:04:25.581 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5470999999999999e-05 2024-09-12T00:04:25.581 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.581 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.581 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.581 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.581 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.581 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:716 6.1c e35/29 6:3fb1de85:::obj_delete_at_hint.0000000018:head v 35'6, mlcod=35'4)", 2024-09-12T00:04:25.581 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.622786+0000", 2024-09-12T00:04:25.581 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 50.910849726999999, 2024-09-12T00:04:25.581 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024813460000000002, 2024-09-12T00:04:25.582 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.582 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.582 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.582 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.582 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.582 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.582 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.622786+0000", 2024-09-12T00:04:25.582 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.582 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.582 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.582 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.582 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.622786+0000", 2024-09-12T00:04:25.582 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.582 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.583 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.583 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.583 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.622787+0000", 2024-09-12T00:04:25.583 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6500000000000008e-07 2024-09-12T00:04:25.583 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.583 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.583 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.583 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.622794+0000", 2024-09-12T00:04:25.583 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1580000000000002e-06 2024-09-12T00:04:25.583 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.583 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.583 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.583 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.622807+0000", 2024-09-12T00:04:25.584 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3784000000000001e-05 2024-09-12T00:04:25.584 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.584 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.584 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.584 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.622813+0000", 2024-09-12T00:04:25.584 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7849999999999997e-06 2024-09-12T00:04:25.584 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.584 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.584 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.584 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.622873+0000", 2024-09-12T00:04:25.584 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9401999999999998e-05 2024-09-12T00:04:25.584 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.584 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.584 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.585 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.622894+0000", 2024-09-12T00:04:25.585 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1624000000000002e-05 2024-09-12T00:04:25.585 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.585 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.585 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.585 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.625203+0000", 2024-09-12T00:04:25.585 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023087170000000001 2024-09-12T00:04:25.585 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.585 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.585 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.585 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.625268+0000", 2024-09-12T00:04:25.585 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4911000000000002e-05 2024-09-12T00:04:25.585 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.585 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.586 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.586 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.586 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.586 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:729 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:25.586 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.628426+0000", 2024-09-12T00:04:25.586 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 50.905210390000001, 2024-09-12T00:04:25.586 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002441983, 2024-09-12T00:04:25.586 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.586 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.586 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.586 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:25.586 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:25.586 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:25.586 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 729 2024-09-12T00:04:25.587 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.587 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.587 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.587 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.587 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.628426+0000", 2024-09-12T00:04:25.587 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.587 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.587 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.587 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.587 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.628426+0000", 2024-09-12T00:04:25.587 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.587 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.587 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.587 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.588 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.628427+0000", 2024-09-12T00:04:25.588 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5120000000000001e-06 2024-09-12T00:04:25.588 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.588 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.588 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.588 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.628433+0000", 2024-09-12T00:04:25.588 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4759999999999997e-06 2024-09-12T00:04:25.588 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.588 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.588 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.588 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.628448+0000", 2024-09-12T00:04:25.588 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5044e-05 2024-09-12T00:04:25.588 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.588 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.589 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.589 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.628455+0000", 2024-09-12T00:04:25.589 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9059999999999996e-06 2024-09-12T00:04:25.589 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.589 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.589 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.589 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.628513+0000", 2024-09-12T00:04:25.589 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8628999999999997e-05 2024-09-12T00:04:25.589 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.589 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.589 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.589 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.628584+0000", 2024-09-12T00:04:25.589 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0600999999999997e-05 2024-09-12T00:04:25.590 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.590 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.590 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:25.590 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.628752+0000", 2024-09-12T00:04:25.590 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016826800000000001 2024-09-12T00:04:25.590 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.590 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.590 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:25.590 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.630756+0000", 2024-09-12T00:04:25.590 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020041709999999999 2024-09-12T00:04:25.590 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.590 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.590 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:25.590 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.630768+0000", 2024-09-12T00:04:25.591 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1185e-05 2024-09-12T00:04:25.591 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.591 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.591 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.591 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.630803+0000", 2024-09-12T00:04:25.591 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5583999999999997e-05 2024-09-12T00:04:25.591 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.591 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.591 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.591 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.630868+0000", 2024-09-12T00:04:25.591 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4607e-05 2024-09-12T00:04:25.591 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.591 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.592 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.592 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.592 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.592 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:758 6.15 6:ae95b544:::obj_delete_at_hint.0000000020:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:25.592 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.639653+0000", 2024-09-12T00:04:25.592 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 50.893983073999998, 2024-09-12T00:04:25.592 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023477839999999999, 2024-09-12T00:04:25.592 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.592 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.592 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.592 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:25.592 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:25.593 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:25.593 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 758 2024-09-12T00:04:25.593 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.593 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.593 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.593 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.593 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.639653+0000", 2024-09-12T00:04:25.593 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.593 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.593 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.593 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.593 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.639653+0000", 2024-09-12T00:04:25.594 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.594 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.594 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.594 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.594 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.639655+0000", 2024-09-12T00:04:25.594 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6700000000000001e-06 2024-09-12T00:04:25.594 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.594 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.594 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.594 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.639663+0000", 2024-09-12T00:04:25.594 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0530000000000007e-06 2024-09-12T00:04:25.594 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.594 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.595 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.595 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.639683+0000", 2024-09-12T00:04:25.595 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9771000000000001e-05 2024-09-12T00:04:25.595 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.595 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.595 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.595 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.639692+0000", 2024-09-12T00:04:25.595 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1370000000000008e-06 2024-09-12T00:04:25.595 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.595 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.595 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.595 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.639767+0000", 2024-09-12T00:04:25.595 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5190000000000003e-05 2024-09-12T00:04:25.596 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.596 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.596 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.596 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.639936+0000", 2024-09-12T00:04:25.596 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016948000000000001 2024-09-12T00:04:25.596 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.596 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.596 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:25.596 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.640143+0000", 2024-09-12T00:04:25.596 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020707500000000001 2024-09-12T00:04:25.596 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.596 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.596 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:25.596 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.640971+0000", 2024-09-12T00:04:25.597 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00082798799999999999 2024-09-12T00:04:25.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.597 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.597 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:25.597 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.641891+0000", 2024-09-12T00:04:25.597 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00091904499999999995 2024-09-12T00:04:25.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.597 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.597 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.597 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.641942+0000", 2024-09-12T00:04:25.597 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1785e-05 2024-09-12T00:04:25.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.597 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.598 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.598 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642001+0000", 2024-09-12T00:04:25.598 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.859e-05 2024-09-12T00:04:25.598 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.598 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.598 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.598 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.598 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:768 6.15 6:ae95b544:::obj_delete_at_hint.0000000020:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:25.598 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.642525+0000", 2024-09-12T00:04:25.598 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 50.891111062999997, 2024-09-12T00:04:25.598 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048019760000000003, 2024-09-12T00:04:25.598 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.599 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.599 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.599 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:25.599 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:25.599 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:25.599 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 768 2024-09-12T00:04:25.599 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.599 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.599 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.599 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.599 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642525+0000", 2024-09-12T00:04:25.599 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.599 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.600 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.600 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642525+0000", 2024-09-12T00:04:25.600 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.600 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.600 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642526+0000", 2024-09-12T00:04:25.600 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3629999999999999e-06 2024-09-12T00:04:25.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.600 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.601 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642533+0000", 2024-09-12T00:04:25.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.64e-06 2024-09-12T00:04:25.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.601 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.601 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642549+0000", 2024-09-12T00:04:25.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5911000000000001e-05 2024-09-12T00:04:25.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.601 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.601 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642558+0000", 2024-09-12T00:04:25.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7420000000000003e-06 2024-09-12T00:04:25.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.602 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.602 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.602 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642628+0000", 2024-09-12T00:04:25.602 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0408999999999996e-05 2024-09-12T00:04:25.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.602 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.602 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.602 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642721+0000", 2024-09-12T00:04:25.602 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2888999999999998e-05 2024-09-12T00:04:25.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.602 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.602 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:25.602 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642914+0000", 2024-09-12T00:04:25.602 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000192945 2024-09-12T00:04:25.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.603 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.603 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:25.603 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.644463+0000", 2024-09-12T00:04:25.603 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001548848 2024-09-12T00:04:25.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.603 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.603 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:25.603 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.647249+0000", 2024-09-12T00:04:25.603 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027862989999999999 2024-09-12T00:04:25.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.603 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.603 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.604 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.647285+0000", 2024-09-12T00:04:25.604 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6210000000000001e-05 2024-09-12T00:04:25.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.604 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.604 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.604 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.647327+0000", 2024-09-12T00:04:25.604 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.172e-05 2024-09-12T00:04:25.604 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.604 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.604 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.604 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.604 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:850 6.15 6:abd89f08:lc::lc.23:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:25.604 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.673328+0000", 2024-09-12T00:04:25.605 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 50.860308328999999, 2024-09-12T00:04:25.605 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047245300000000002, 2024-09-12T00:04:25.605 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.605 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.605 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.605 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:25.605 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:25.605 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:25.605 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 850 2024-09-12T00:04:25.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.605 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.605 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.605 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.605 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673328+0000", 2024-09-12T00:04:25.606 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.606 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.606 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.606 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673328+0000", 2024-09-12T00:04:25.606 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.606 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.606 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.606 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673329+0000", 2024-09-12T00:04:25.606 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5799999999999998e-07 2024-09-12T00:04:25.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.606 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.607 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.607 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673333+0000", 2024-09-12T00:04:25.607 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5990000000000004e-06 2024-09-12T00:04:25.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.607 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.607 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.607 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673345+0000", 2024-09-12T00:04:25.607 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1637999999999999e-05 2024-09-12T00:04:25.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.607 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.607 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.607 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673353+0000", 2024-09-12T00:04:25.607 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4610000000000002e-06 2024-09-12T00:04:25.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.608 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.608 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673417+0000", 2024-09-12T00:04:25.608 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4951999999999997e-05 2024-09-12T00:04:25.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.608 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.608 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673521+0000", 2024-09-12T00:04:25.608 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103881 2024-09-12T00:04:25.609 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.609 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.609 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:25.609 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673729+0000", 2024-09-12T00:04:25.609 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020730600000000001 2024-09-12T00:04:25.609 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.609 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.609 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:25.609 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674901+0000", 2024-09-12T00:04:25.609 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011728140000000001 2024-09-12T00:04:25.609 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.609 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.609 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:25.610 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.677953+0000", 2024-09-12T00:04:25.610 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030517959999999998 2024-09-12T00:04:25.610 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.610 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.610 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.610 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.677997+0000", 2024-09-12T00:04:25.610 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3346999999999997e-05 2024-09-12T00:04:25.610 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.610 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.610 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.610 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.678052+0000", 2024-09-12T00:04:25.610 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5778e-05 2024-09-12T00:04:25.610 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.611 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.611 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.611 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.611 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:904 6.15 6:abd89f08:lc::lc.23:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:25.611 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.692432+0000", 2024-09-12T00:04:25.611 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 50.841203827000001, 2024-09-12T00:04:25.611 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021347660000000002, 2024-09-12T00:04:25.611 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.611 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.611 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.611 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:25.611 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:25.611 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:25.612 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 904 2024-09-12T00:04:25.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.612 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.612 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.612 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.612 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.692432+0000", 2024-09-12T00:04:25.612 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.612 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.612 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.612 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.692432+0000", 2024-09-12T00:04:25.612 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.613 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.613 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.613 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.692434+0000", 2024-09-12T00:04:25.613 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9709999999999998e-06 2024-09-12T00:04:25.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.613 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.613 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.613 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.692441+0000", 2024-09-12T00:04:25.613 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.973e-06 2024-09-12T00:04:25.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.613 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.613 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.613 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.692464+0000", 2024-09-12T00:04:25.613 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2903000000000001e-05 2024-09-12T00:04:25.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.614 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.692475+0000", 2024-09-12T00:04:25.614 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0345e-05 2024-09-12T00:04:25.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.614 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.692549+0000", 2024-09-12T00:04:25.614 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4482999999999998e-05 2024-09-12T00:04:25.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.614 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.692659+0000", 2024-09-12T00:04:25.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000109591 2024-09-12T00:04:25.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:25.615 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.692895+0000", 2024-09-12T00:04:25.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000236331 2024-09-12T00:04:25.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:25.615 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.693883+0000", 2024-09-12T00:04:25.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00098760499999999991 2024-09-12T00:04:25.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:25.616 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.694449+0000", 2024-09-12T00:04:25.616 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00056647800000000003 2024-09-12T00:04:25.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.616 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.616 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.694524+0000", 2024-09-12T00:04:25.616 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5252000000000004e-05 2024-09-12T00:04:25.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.616 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.616 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.694567+0000", 2024-09-12T00:04:25.616 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2833999999999997e-05 2024-09-12T00:04:25.616 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.617 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.617 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.617 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.617 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:919 6.15 6:abd89f08:lc::lc.23:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:25.617 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.695743+0000", 2024-09-12T00:04:25.617 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 50.837892924999998, 2024-09-12T00:04:25.617 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027955689999999999, 2024-09-12T00:04:25.617 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.617 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.617 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.617 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:25.617 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:25.617 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:25.618 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 919 2024-09-12T00:04:25.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.618 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.618 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.618 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695743+0000", 2024-09-12T00:04:25.618 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.618 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.618 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695743+0000", 2024-09-12T00:04:25.618 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695745+0000", 2024-09-12T00:04:25.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.412e-06 2024-09-12T00:04:25.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695752+0000", 2024-09-12T00:04:25.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0249999999999997e-06 2024-09-12T00:04:25.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695767+0000", 2024-09-12T00:04:25.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5787999999999999e-05 2024-09-12T00:04:25.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695775+0000", 2024-09-12T00:04:25.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3590000000000002e-06 2024-09-12T00:04:25.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695844+0000", 2024-09-12T00:04:25.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9522000000000003e-05 2024-09-12T00:04:25.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695912+0000", 2024-09-12T00:04:25.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7689999999999997e-05 2024-09-12T00:04:25.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.621 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:25.621 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.696117+0000", 2024-09-12T00:04:25.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020478900000000001 2024-09-12T00:04:25.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.621 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:25.621 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.696681+0000", 2024-09-12T00:04:25.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00056375200000000005 2024-09-12T00:04:25.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.621 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:25.622 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698408+0000", 2024-09-12T00:04:25.622 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017273659999999999 2024-09-12T00:04:25.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.622 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.622 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.622 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698484+0000", 2024-09-12T00:04:25.622 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6329999999999996e-05 2024-09-12T00:04:25.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.622 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.622 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.622 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698539+0000", 2024-09-12T00:04:25.622 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4536000000000001e-05 2024-09-12T00:04:25.622 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.622 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.623 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.623 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.623 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1107 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:25.623 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.792627+0000", 2024-09-12T00:04:25.623 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 50.741008958999998, 2024-09-12T00:04:25.623 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020914150000000001, 2024-09-12T00:04:25.623 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.623 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.623 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.623 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:25.623 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:25.623 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:25.623 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1107 2024-09-12T00:04:25.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.624 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.624 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.624 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.792627+0000", 2024-09-12T00:04:25.624 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.624 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.624 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.792627+0000", 2024-09-12T00:04:25.624 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.624 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.625 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.792630+0000", 2024-09-12T00:04:25.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5490000000000001e-06 2024-09-12T00:04:25.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.625 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.792639+0000", 2024-09-12T00:04:25.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2890000000000003e-06 2024-09-12T00:04:25.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.625 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.792658+0000", 2024-09-12T00:04:25.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9351000000000002e-05 2024-09-12T00:04:25.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.792670+0000", 2024-09-12T00:04:25.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1499e-05 2024-09-12T00:04:25.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.792791+0000", 2024-09-12T00:04:25.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012112699999999999 2024-09-12T00:04:25.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.793042+0000", 2024-09-12T00:04:25.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000250988 2024-09-12T00:04:25.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:25.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.793315+0000", 2024-09-12T00:04:25.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00027323799999999997 2024-09-12T00:04:25.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:25.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.794394+0000", 2024-09-12T00:04:25.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0010785409999999999 2024-09-12T00:04:25.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:25.628 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.794621+0000", 2024-09-12T00:04:25.628 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000227371 2024-09-12T00:04:25.628 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.628 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.628 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.628 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.794678+0000", 2024-09-12T00:04:25.628 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6486000000000001e-05 2024-09-12T00:04:25.628 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.628 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.628 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.628 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.794719+0000", 2024-09-12T00:04:25.628 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0976000000000002e-05 2024-09-12T00:04:25.628 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.629 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.629 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.629 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.629 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1296 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:25.629 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:35.222414+0000", 2024-09-12T00:04:25.629 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 50.311222245000003, 2024-09-12T00:04:25.629 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027841290000000002, 2024-09-12T00:04:25.629 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.629 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.629 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.629 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:25.629 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:25.630 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:25.630 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1296 2024-09-12T00:04:25.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.630 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.630 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.630 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.630 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222414+0000", 2024-09-12T00:04:25.630 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.630 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.630 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.630 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222414+0000", 2024-09-12T00:04:25.630 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222418+0000", 2024-09-12T00:04:25.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.563e-06 2024-09-12T00:04:25.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222434+0000", 2024-09-12T00:04:25.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6220000000000001e-05 2024-09-12T00:04:25.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222469+0000", 2024-09-12T00:04:25.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4892999999999999e-05 2024-09-12T00:04:25.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222492+0000", 2024-09-12T00:04:25.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2963999999999999e-05 2024-09-12T00:04:25.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222629+0000", 2024-09-12T00:04:25.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013722499999999999 2024-09-12T00:04:25.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222863+0000", 2024-09-12T00:04:25.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023409799999999999 2024-09-12T00:04:25.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:25.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.223212+0000", 2024-09-12T00:04:25.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00034954700000000002 2024-09-12T00:04:25.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:25.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.224374+0000", 2024-09-12T00:04:25.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011611620000000001 2024-09-12T00:04:25.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.634 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:25.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.225040+0000", 2024-09-12T00:04:25.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00066678500000000003 2024-09-12T00:04:25.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.634 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.225130+0000", 2024-09-12T00:04:25.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9813000000000002e-05 2024-09-12T00:04:25.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.634 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.225198+0000", 2024-09-12T00:04:25.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7859000000000002e-05 2024-09-12T00:04:25.634 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.635 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.635 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.635 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1298 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:25.635 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:35.226143+0000", 2024-09-12T00:04:25.635 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 50.307493002999998, 2024-09-12T00:04:25.635 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025053409999999999, 2024-09-12T00:04:25.635 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:25.635 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:25.635 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:25.635 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:25.635 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:25.636 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:25.636 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1298 2024-09-12T00:04:25.636 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.636 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:25.636 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.636 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:25.636 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226143+0000", 2024-09-12T00:04:25.636 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.636 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.636 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.636 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:25.636 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226143+0000", 2024-09-12T00:04:25.636 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:25.636 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.637 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.637 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:25.637 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226145+0000", 2024-09-12T00:04:25.637 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7859999999999999e-06 2024-09-12T00:04:25.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.637 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.637 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:25.637 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226156+0000", 2024-09-12T00:04:25.637 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.059e-05 2024-09-12T00:04:25.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.637 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.637 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:25.637 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226181+0000", 2024-09-12T00:04:25.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4980000000000001e-05 2024-09-12T00:04:25.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.638 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:25.638 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226202+0000", 2024-09-12T00:04:25.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0993e-05 2024-09-12T00:04:25.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.638 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:25.638 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226309+0000", 2024-09-12T00:04:25.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000107793 2024-09-12T00:04:25.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.638 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:25.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226437+0000", 2024-09-12T00:04:25.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012733199999999999 2024-09-12T00:04:25.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:25.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226707+0000", 2024-09-12T00:04:25.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00027011199999999998 2024-09-12T00:04:25.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:25.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.227865+0000", 2024-09-12T00:04:25.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001157744 2024-09-12T00:04:25.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:25.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.228507+0000", 2024-09-12T00:04:25.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00064225800000000004 2024-09-12T00:04:25.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:25.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.228588+0000", 2024-09-12T00:04:25.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0927000000000006e-05 2024-09-12T00:04:25.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:25.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:25.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:25.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.228649+0000", 2024-09-12T00:04:25.641 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0825999999999997e-05 2024-09-12T00:04:25.641 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.641 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.641 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.641 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:25.641 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:25.641 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:25.641 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:04:25.643 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:04:25.643 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:25.641+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:25.704 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T00:04:25.777 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:25.777+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:25.842 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:25.843 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:25.843 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:25.843 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:25.844 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:25.847+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:25.860 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:04:25.877 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:25.877 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:25.895 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:25.895 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:25.925 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:25.925 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:25.945 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:25.947+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:25.956 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:25.956 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:25.988 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:25.988 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:26.022 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:26.022 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:26.046 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:26.047+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:26.050 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:26.050 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:26.055 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:26.055 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:26.068 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:04:26.089 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:26.089 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:26.148 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:26.147+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:26.249 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:26.247+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:26.260 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:26.260 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:26.278 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:04:26.350 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:26.349+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:26.408 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:26.408 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:26.423 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:04:26.450 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:26.448+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:26.547 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:26.547 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:26.551 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:26.548+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:26.561 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:04:26.652 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:26.651+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:26.679 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:26.679 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:26.694 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:04:26.782 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:26.783+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:26.853 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:26.855+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:26.855 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:26.856 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:26.870 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:04:26.954 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:26.952+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:27.037 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:27.037 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:27.051 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:04:27.054 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:27.052+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:27.155 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:27.155+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:27.174 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:27.174 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:27.188 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:04:27.256 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:27.252+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:27.353 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:27.353 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:27.357 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:27.356+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:27.368 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:04:27.459 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:27.459+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:27.492 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:27.492 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:27.507 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:04:27.560 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:27.556+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:27.661 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:27.660+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:27.675 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:27.675 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:27.689 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:04:27.737 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:04:27.762 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:27.763+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:27.812 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:27.812 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:27.826 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:04:27.870 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:27.871+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:27.964 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:27.960+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:27.993 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:27.993 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:28.007 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:04:28.065 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:28.060+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:28.113 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:04:28.117 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T00:04:28.133 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:28.133 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:28.147 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:04:28.166 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:28.167+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:28.250 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:28.250 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:28.266 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:28.267 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:28.267 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:28.264+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:28.282 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:28.298 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:28.299 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:28.304 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:28.304 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:28.304 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:28.304 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:28.317 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:04:28.319 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:28.319 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:28.340 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:28.341 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:28.360 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:28.361 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:28.367 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:28.367+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:28.385 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:28.385 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:28.433 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:28.433 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:28.434 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:28.434 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:28.434 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:28.446 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:04:28.469 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:28.467+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:28.570 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:28.568+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:28.606 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:28.607 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:28.607 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:28.607 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:28.607 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.607 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:28.608 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:28.608 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 57.275564868000004, 2024-09-12T00:04:28.608 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.027441031000000001, 2024-09-12T00:04:28.608 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:28.608 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:28.609 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:28.609 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:28.609 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:28.609 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:28.609 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:04:28.610 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.610 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:28.610 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.610 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:28.610 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:28.611 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.611 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.611 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:28.611 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:28.612 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.613 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.613 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:28.613 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330357+0000", 2024-09-12T00:04:28.614 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2339999999999996e-06 2024-09-12T00:04:28.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.614 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:28.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330381+0000", 2024-09-12T00:04:28.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4626000000000001e-05 2024-09-12T00:04:28.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:28.616 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330417+0000", 2024-09-12T00:04:28.616 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5886000000000002e-05 2024-09-12T00:04:28.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:28.617 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330442+0000", 2024-09-12T00:04:28.617 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4522999999999999e-05 2024-09-12T00:04:28.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.617 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.618 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335485+0000", 2024-09-12T00:04:28.618 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050432589999999996 2024-09-12T00:04:28.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:28.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335507+0000", 2024-09-12T00:04:28.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2013000000000001e-05 2024-09-12T00:04:28.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.351747+0000", 2024-09-12T00:04:28.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016240451999999999 2024-09-12T00:04:28.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.621 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:28.622 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352062+0000", 2024-09-12T00:04:28.622 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031433399999999999 2024-09-12T00:04:28.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.622 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.622 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:28.622 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352378+0000", 2024-09-12T00:04:28.623 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031586400000000001 2024-09-12T00:04:28.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.623 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.623 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:28.623 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.355074+0000", 2024-09-12T00:04:28.624 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026962919999999999 2024-09-12T00:04:28.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.624 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:28.624 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357537+0000", 2024-09-12T00:04:28.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024634689999999998 2024-09-12T00:04:28.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:28.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357680+0000", 2024-09-12T00:04:28.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014314899999999999 2024-09-12T00:04:28.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:28.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357793+0000", 2024-09-12T00:04:28.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011293 2024-09-12T00:04:28.627 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.627 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:28.627 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.628 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.628 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94232250902656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:28.628 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:28.628 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 57.247649707999997, 2024-09-12T00:04:28.629 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052696050000000001, 2024-09-12T00:04:28.629 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:28.629 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:28.629 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:28.629 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:28.629 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:28.630 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:28.630 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:04:28.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.630 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:28.630 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.630 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:28.630 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:28.630 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:28.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:28.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:28.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358270+0000", 2024-09-12T00:04:28.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.17e-06 2024-09-12T00:04:28.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:28.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358278+0000", 2024-09-12T00:04:28.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3529999999999995e-06 2024-09-12T00:04:28.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:28.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358306+0000", 2024-09-12T00:04:28.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7763000000000002e-05 2024-09-12T00:04:28.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.634 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:28.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358324+0000", 2024-09-12T00:04:28.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7861000000000001e-05 2024-09-12T00:04:28.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.635 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.635 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358447+0000", 2024-09-12T00:04:28.635 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012334299999999999 2024-09-12T00:04:28.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.635 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:28.635 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358624+0000", 2024-09-12T00:04:28.636 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017684999999999999 2024-09-12T00:04:28.636 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.636 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.636 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:28.636 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358964+0000", 2024-09-12T00:04:28.637 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00033991199999999999 2024-09-12T00:04:28.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.637 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.637 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:28.637 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.362920+0000", 2024-09-12T00:04:28.637 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039564600000000002 2024-09-12T00:04:28.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.638 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:28.638 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363016+0000", 2024-09-12T00:04:28.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5612999999999994e-05 2024-09-12T00:04:28.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:28.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363244+0000", 2024-09-12T00:04:28.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000228385 2024-09-12T00:04:28.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:28.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363537+0000", 2024-09-12T00:04:28.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00029289499999999999 2024-09-12T00:04:28.640 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.640 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:28.640 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.641 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:28.641 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:28.641 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 54.240272191000003, 2024-09-12T00:04:28.641 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011415537, 2024-09-12T00:04:28.641 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:28.641 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:28.641 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:28.642 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:28.642 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:28.642 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:28.642 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 209 2024-09-12T00:04:28.642 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.642 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:28.643 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.643 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:28.643 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:28.643 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.643 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.644 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:28.644 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:28.644 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.644 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:28.644 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365648+0000", 2024-09-12T00:04:28.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7360000000000001e-06 2024-09-12T00:04:28.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.645 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:28.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365660+0000", 2024-09-12T00:04:28.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2089999999999999e-05 2024-09-12T00:04:28.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.646 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:28.646 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365690+0000", 2024-09-12T00:04:28.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0320000000000001e-05 2024-09-12T00:04:28.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:28.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365708+0000", 2024-09-12T00:04:28.647 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7520000000000002e-05 2024-09-12T00:04:28.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.648 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365870+0000", 2024-09-12T00:04:28.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016208600000000001 2024-09-12T00:04:28.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.648 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.648 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:28.649 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365885+0000", 2024-09-12T00:04:28.649 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5119999999999999e-05 2024-09-12T00:04:28.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.649 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.649 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.649 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373482+0000", 2024-09-12T00:04:28.649 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075970279999999996 2024-09-12T00:04:28.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.650 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:28.650 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373805+0000", 2024-09-12T00:04:28.650 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032262799999999999 2024-09-12T00:04:28.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:28.651 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.374297+0000", 2024-09-12T00:04:28.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00049250599999999998 2024-09-12T00:04:28.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.651 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:28.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.375670+0000", 2024-09-12T00:04:28.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001373333 2024-09-12T00:04:28.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.652 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:28.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.376923+0000", 2024-09-12T00:04:28.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012525640000000001 2024-09-12T00:04:28.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:28.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377000+0000", 2024-09-12T00:04:28.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6732999999999999e-05 2024-09-12T00:04:28.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:28.654 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377061+0000", 2024-09-12T00:04:28.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0872999999999998e-05 2024-09-12T00:04:28.654 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.654 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:28.654 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.655 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.655 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:240 6.19 6:9f626c48:lc::lc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:28.655 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:28.656 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 54.121686437999998, 2024-09-12T00:04:28.656 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058545680000000001, 2024-09-12T00:04:28.656 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:28.656 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:28.656 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:28.656 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:28.656 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:28.657 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:28.657 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 240 2024-09-12T00:04:28.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.657 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:28.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.657 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:28.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:28.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:28.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:28.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:28.659 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484233+0000", 2024-09-12T00:04:28.660 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.973e-06 2024-09-12T00:04:28.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.660 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.661 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:28.661 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484241+0000", 2024-09-12T00:04:28.661 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8210000000000002e-06 2024-09-12T00:04:28.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:28.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484260+0000", 2024-09-12T00:04:28.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9148999999999999e-05 2024-09-12T00:04:28.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:28.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484268+0000", 2024-09-12T00:04:28.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5120000000000008e-06 2024-09-12T00:04:28.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484371+0000", 2024-09-12T00:04:28.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102501 2024-09-12T00:04:28.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.665 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:28.665 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484450+0000", 2024-09-12T00:04:28.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9122999999999994e-05 2024-09-12T00:04:28.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.665 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:28.666 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484578+0000", 2024-09-12T00:04:28.666 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000128095 2024-09-12T00:04:28.666 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.666 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.666 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:28.666 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.485336+0000", 2024-09-12T00:04:28.667 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00075754000000000001 2024-09-12T00:04:28.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.668 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:28.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.489975+0000", 2024-09-12T00:04:28.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004639738 2024-09-12T00:04:28.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:28.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490043+0000", 2024-09-12T00:04:28.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7923999999999995e-05 2024-09-12T00:04:28.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:28.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490085+0000", 2024-09-12T00:04:28.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2191999999999999e-05 2024-09-12T00:04:28.671 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.671 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:28.671 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.672 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:412 6.3 6:c3a682d4:reshard::reshard.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:28.672 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:28.672 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 54.079291032, 2024-09-12T00:04:28.672 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049075530000000003, 2024-09-12T00:04:28.673 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:28.673 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:28.673 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:28.674 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:28.674 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:28.674 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:28.674 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 412 2024-09-12T00:04:28.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.675 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:28.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:28.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:28.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.677 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:28.677 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:28.677 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.677 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.678 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:28.678 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526628+0000", 2024-09-12T00:04:28.678 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.513e-06 2024-09-12T00:04:28.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.678 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:28.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526634+0000", 2024-09-12T00:04:28.679 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1279999999999996e-06 2024-09-12T00:04:28.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:28.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526649+0000", 2024-09-12T00:04:28.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4997999999999999e-05 2024-09-12T00:04:28.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:28.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526658+0000", 2024-09-12T00:04:28.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1589999999999999e-06 2024-09-12T00:04:28.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.681 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.682 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526728+0000", 2024-09-12T00:04:28.682 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0203999999999994e-05 2024-09-12T00:04:28.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:28.683 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526839+0000", 2024-09-12T00:04:28.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011055 2024-09-12T00:04:28.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.683 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.683 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:28.683 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526979+0000", 2024-09-12T00:04:28.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139863 2024-09-12T00:04:28.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.684 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.684 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:28.684 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.527616+0000", 2024-09-12T00:04:28.685 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00063707900000000003 2024-09-12T00:04:28.685 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.685 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.685 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:28.685 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531450+0000", 2024-09-12T00:04:28.686 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003833819 2024-09-12T00:04:28.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.686 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.686 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:28.686 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531490+0000", 2024-09-12T00:04:28.687 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0129000000000002e-05 2024-09-12T00:04:28.687 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.687 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.687 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:28.687 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531534+0000", 2024-09-12T00:04:28.688 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4110999999999998e-05 2024-09-12T00:04:28.688 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.688 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:28.688 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.688 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.689 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.689 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:490 6.19 6:9dc32cef:lc::lc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:28.689 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:28.689 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 54.055093657999997, 2024-09-12T00:04:28.689 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047438380000000002, 2024-09-12T00:04:28.690 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:28.690 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:28.690 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:28.690 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:28.690 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:28.691 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:28.691 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 490 2024-09-12T00:04:28.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.691 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:28.691 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.692 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:28.692 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:28.692 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.693 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.693 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:28.693 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:28.693 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.693 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.693 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.694 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:28.694 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550825+0000", 2024-09-12T00:04:28.694 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0589999999999999e-06 2024-09-12T00:04:28.694 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.694 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.695 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:28.695 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550830+0000", 2024-09-12T00:04:28.695 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2140000000000004e-06 2024-09-12T00:04:28.695 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.695 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.696 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:28.696 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550843+0000", 2024-09-12T00:04:28.696 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3404000000000001e-05 2024-09-12T00:04:28.696 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.696 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.697 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:28.697 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550852+0000", 2024-09-12T00:04:28.697 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1549999999999996e-06 2024-09-12T00:04:28.697 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.697 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.697 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.698 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550910+0000", 2024-09-12T00:04:28.698 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7636000000000002e-05 2024-09-12T00:04:28.698 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.698 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.698 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:28.699 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550977+0000", 2024-09-12T00:04:28.699 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6636000000000004e-05 2024-09-12T00:04:28.699 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.699 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.699 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:28.700 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.551135+0000", 2024-09-12T00:04:28.700 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015852999999999999 2024-09-12T00:04:28.700 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.700 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.700 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:28.701 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552939+0000", 2024-09-12T00:04:28.701 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001803643 2024-09-12T00:04:28.701 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.701 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.702 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:28.704 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555471+0000", 2024-09-12T00:04:28.704 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002532327 2024-09-12T00:04:28.704 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.704 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.705 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:28.705 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555526+0000", 2024-09-12T00:04:28.705 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4728000000000002e-05 2024-09-12T00:04:28.705 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.705 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.705 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:28.705 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555567+0000", 2024-09-12T00:04:28.706 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1505999999999999e-05 2024-09-12T00:04:28.706 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.706 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:28.706 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.706 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.706 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.707 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:492 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'6, mlcod=35'4)", 2024-09-12T00:04:28.707 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:28.707 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 54.053317593999999, 2024-09-12T00:04:28.707 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056118790000000002, 2024-09-12T00:04:28.707 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:28.707 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:28.707 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:28.708 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:28.708 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.708 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:28.708 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:28.708 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.708 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:28.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:28.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:28.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552601+0000", 2024-09-12T00:04:28.710 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6899999999999996e-07 2024-09-12T00:04:28.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.710 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.710 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:28.710 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552608+0000", 2024-09-12T00:04:28.710 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4529999999999996e-06 2024-09-12T00:04:28.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.711 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.711 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:28.711 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552624+0000", 2024-09-12T00:04:28.711 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5885000000000001e-05 2024-09-12T00:04:28.712 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.712 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.712 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:28.712 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552632+0000", 2024-09-12T00:04:28.713 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2220000000000002e-06 2024-09-12T00:04:28.713 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.713 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.713 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.713 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552716+0000", 2024-09-12T00:04:28.713 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4060999999999994e-05 2024-09-12T00:04:28.713 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.714 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.714 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:28.714 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552735+0000", 2024-09-12T00:04:28.714 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9170000000000001e-05 2024-09-12T00:04:28.714 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.714 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.715 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:28.715 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558164+0000", 2024-09-12T00:04:28.715 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054289899999999999 2024-09-12T00:04:28.715 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.715 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.716 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:28.716 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558212+0000", 2024-09-12T00:04:28.716 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7129000000000002e-05 2024-09-12T00:04:28.716 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.716 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:28.716 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.717 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.717 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.717 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:496 6.3 6:c134263f:lc::lc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:28.717 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:28.718 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 54.052210305999999, 2024-09-12T00:04:28.718 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045956260000000002, 2024-09-12T00:04:28.718 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:28.718 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:28.718 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:28.718 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:28.719 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:28.719 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:28.719 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 496 2024-09-12T00:04:28.719 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.719 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:28.720 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.720 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:28.720 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:28.720 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.720 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.720 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.721 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:28.721 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:28.721 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.721 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.721 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.722 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:28.722 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553708+0000", 2024-09-12T00:04:28.722 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2359999999999999e-06 2024-09-12T00:04:28.722 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.722 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.723 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:28.723 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553714+0000", 2024-09-12T00:04:28.723 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4960000000000004e-06 2024-09-12T00:04:28.723 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.723 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.723 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:28.724 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553726+0000", 2024-09-12T00:04:28.724 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2618e-05 2024-09-12T00:04:28.724 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.724 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.724 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:28.725 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553734+0000", 2024-09-12T00:04:28.725 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4159999999999998e-06 2024-09-12T00:04:28.725 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.725 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.725 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.726 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553771+0000", 2024-09-12T00:04:28.726 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7095999999999999e-05 2024-09-12T00:04:28.726 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.726 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.726 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:28.726 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553815+0000", 2024-09-12T00:04:28.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3986999999999997e-05 2024-09-12T00:04:28.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:28.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553922+0000", 2024-09-12T00:04:28.728 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000107534 2024-09-12T00:04:28.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.728 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:28.729 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555052+0000", 2024-09-12T00:04:28.729 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011298359999999999 2024-09-12T00:04:28.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.729 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.730 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:28.730 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558197+0000", 2024-09-12T00:04:28.730 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0031450269999999999 2024-09-12T00:04:28.730 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.730 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.731 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:28.731 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558256+0000", 2024-09-12T00:04:28.731 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8403999999999999e-05 2024-09-12T00:04:28.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.731 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:28.732 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558303+0000", 2024-09-12T00:04:28.732 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6975999999999999e-05 2024-09-12T00:04:28.732 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.732 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:28.732 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.733 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:641 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:28.733 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:28.733 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 54.012139978999997, 2024-09-12T00:04:28.733 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052824789999999996, 2024-09-12T00:04:28.733 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:28.733 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:28.734 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:28.734 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:28.734 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:28.734 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:28.734 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 641 2024-09-12T00:04:28.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.734 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:28.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:28.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:28.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:28.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:28.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.736 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:28.736 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593778+0000", 2024-09-12T00:04:28.736 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0920000000000001e-06 2024-09-12T00:04:28.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.736 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:28.736 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593783+0000", 2024-09-12T00:04:28.736 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9490000000000004e-06 2024-09-12T00:04:28.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.736 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:28.736 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593795+0000", 2024-09-12T00:04:28.737 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2048999999999999e-05 2024-09-12T00:04:28.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.737 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:28.737 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593801+0000", 2024-09-12T00:04:28.737 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8989999999999998e-06 2024-09-12T00:04:28.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.737 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.737 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593852+0000", 2024-09-12T00:04:28.737 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1057999999999998e-05 2024-09-12T00:04:28.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.737 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:28.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593905+0000", 2024-09-12T00:04:28.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2196e-05 2024-09-12T00:04:28.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.738 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:28.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594017+0000", 2024-09-12T00:04:28.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000112816 2024-09-12T00:04:28.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.738 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:28.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.595190+0000", 2024-09-12T00:04:28.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011727199999999999 2024-09-12T00:04:28.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.739 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:28.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.598998+0000", 2024-09-12T00:04:28.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038081320000000001 2024-09-12T00:04:28.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.739 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:28.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599032+0000", 2024-09-12T00:04:28.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4283999999999999e-05 2024-09-12T00:04:28.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.739 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:28.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599060+0000", 2024-09-12T00:04:28.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7284000000000002e-05 2024-09-12T00:04:28.739 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.740 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:28.740 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.740 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.740 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.740 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:643 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'8, mlcod=35'6)", 2024-09-12T00:04:28.740 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:28.740 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 54.011641871999998, 2024-09-12T00:04:28.740 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048211260000000002, 2024-09-12T00:04:28.740 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:28.740 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:28.740 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:28.740 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:28.740 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.740 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:28.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:28.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:28.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:28.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:28.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594276+0000", 2024-09-12T00:04:28.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5899999999999995e-07 2024-09-12T00:04:28.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:28.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594283+0000", 2024-09-12T00:04:28.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6019999999999996e-06 2024-09-12T00:04:28.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:28.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594295+0000", 2024-09-12T00:04:28.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1683e-05 2024-09-12T00:04:28.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:28.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594303+0000", 2024-09-12T00:04:28.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0439999999999996e-06 2024-09-12T00:04:28.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.743 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.743 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594353+0000", 2024-09-12T00:04:28.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0698000000000001e-05 2024-09-12T00:04:28.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.743 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:28.743 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594380+0000", 2024-09-12T00:04:28.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7089000000000001e-05 2024-09-12T00:04:28.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.743 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:28.743 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599063+0000", 2024-09-12T00:04:28.744 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046824739999999998 2024-09-12T00:04:28.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.744 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:28.744 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599096+0000", 2024-09-12T00:04:28.744 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3677000000000003e-05 2024-09-12T00:04:28.744 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.744 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:28.744 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.744 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:647 6.a 6:5395e6f3:lc::lc.4:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:28.744 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:28.744 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 54.009291239, 2024-09-12T00:04:28.745 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049071770000000004, 2024-09-12T00:04:28.745 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:28.745 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:28.745 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:28.745 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:28.745 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:28.745 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:28.745 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 647 2024-09-12T00:04:28.745 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.745 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:28.745 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.745 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:28.745 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:28.746 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.746 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.746 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:28.746 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:28.746 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.746 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.746 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:28.746 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596627+0000", 2024-09-12T00:04:28.746 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1149999999999999e-06 2024-09-12T00:04:28.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.746 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.746 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:28.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596632+0000", 2024-09-12T00:04:28.747 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7060000000000003e-06 2024-09-12T00:04:28.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:28.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596645+0000", 2024-09-12T00:04:28.747 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2791e-05 2024-09-12T00:04:28.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:28.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596653+0000", 2024-09-12T00:04:28.747 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9230000000000002e-06 2024-09-12T00:04:28.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.748 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596705+0000", 2024-09-12T00:04:28.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2250000000000003e-05 2024-09-12T00:04:28.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:28.748 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596758+0000", 2024-09-12T00:04:28.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2964000000000003e-05 2024-09-12T00:04:28.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:28.748 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596873+0000", 2024-09-12T00:04:28.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011501 2024-09-12T00:04:28.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.749 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.749 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:28.749 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599088+0000", 2024-09-12T00:04:28.749 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002215135 2024-09-12T00:04:28.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.749 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.749 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:28.749 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601456+0000", 2024-09-12T00:04:28.749 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023684719999999999 2024-09-12T00:04:28.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.749 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.749 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:28.749 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601507+0000", 2024-09-12T00:04:28.749 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0933999999999997e-05 2024-09-12T00:04:28.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.750 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:28.750 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601533+0000", 2024-09-12T00:04:28.750 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5877e-05 2024-09-12T00:04:28.750 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.750 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:28.750 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.750 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:657 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'10, mlcod=35'7)", 2024-09-12T00:04:28.750 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:28.750 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 54.005467699, 2024-09-12T00:04:28.751 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066410239999999997, 2024-09-12T00:04:28.751 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:28.751 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:28.751 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:28.751 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:28.751 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.751 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:28.751 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:28.751 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.751 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.751 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.751 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:28.751 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:28.751 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.752 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.752 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:28.752 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:28.752 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6099999999999999e-07 2024-09-12T00:04:28.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.752 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.752 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:28.752 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600457+0000", 2024-09-12T00:04:28.752 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8700000000000003e-06 2024-09-12T00:04:28.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.752 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.752 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:28.752 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600470+0000", 2024-09-12T00:04:28.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3186999999999999e-05 2024-09-12T00:04:28.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:28.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600478+0000", 2024-09-12T00:04:28.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5310000000000004e-06 2024-09-12T00:04:28.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600521+0000", 2024-09-12T00:04:28.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2574000000000003e-05 2024-09-12T00:04:28.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:28.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600535+0000", 2024-09-12T00:04:28.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4151000000000001e-05 2024-09-12T00:04:28.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.754 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:28.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.606997+0000", 2024-09-12T00:04:28.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064626099999999997 2024-09-12T00:04:28.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.754 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:28.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607091+0000", 2024-09-12T00:04:28.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3239999999999995e-05 2024-09-12T00:04:28.754 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.754 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:28.754 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.755 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.755 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:659 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:28.755 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:28.755 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 54.005295367000002, 2024-09-12T00:04:28.755 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0065340989999999998, 2024-09-12T00:04:28.755 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:28.755 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:28.755 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:28.755 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:28.755 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:28.755 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:28.755 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 659 2024-09-12T00:04:28.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.756 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:28.756 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.756 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:28.756 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:28.756 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.756 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.756 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.756 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:28.756 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:28.756 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.756 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.756 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.756 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:28.757 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600623+0000", 2024-09-12T00:04:28.757 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.085e-06 2024-09-12T00:04:28.757 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.757 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.757 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:28.757 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600630+0000", 2024-09-12T00:04:28.757 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0029999999999997e-06 2024-09-12T00:04:28.757 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.757 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.757 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:28.757 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600647+0000", 2024-09-12T00:04:28.757 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6566999999999999e-05 2024-09-12T00:04:28.757 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.757 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.758 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:28.758 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600658+0000", 2024-09-12T00:04:28.758 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0992000000000001e-05 2024-09-12T00:04:28.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.758 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.758 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.758 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600717+0000", 2024-09-12T00:04:28.758 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9925e-05 2024-09-12T00:04:28.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.758 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.758 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:28.758 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600773+0000", 2024-09-12T00:04:28.758 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5766000000000001e-05 2024-09-12T00:04:28.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.759 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.759 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:28.759 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600889+0000", 2024-09-12T00:04:28.759 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115906 2024-09-12T00:04:28.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.759 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.759 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:28.759 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603483+0000", 2024-09-12T00:04:28.759 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025940799999999999 2024-09-12T00:04:28.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.759 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.759 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:28.759 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607098+0000", 2024-09-12T00:04:28.759 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036150459999999998 2024-09-12T00:04:28.760 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.760 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.760 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:28.760 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607133+0000", 2024-09-12T00:04:28.760 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4615e-05 2024-09-12T00:04:28.760 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.760 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.760 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:28.760 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607156+0000", 2024-09-12T00:04:28.760 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3113999999999999e-05 2024-09-12T00:04:28.760 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.760 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:28.760 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.760 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.761 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.761 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:666 6.a 6:5395e6f3:lc::lc.4:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:28.761 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:28.761 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 54.003548238, 2024-09-12T00:04:28.761 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.005127174, 2024-09-12T00:04:28.761 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:28.761 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:28.761 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:28.761 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:28.761 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:28.761 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:28.761 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 666 2024-09-12T00:04:28.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.761 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:28.762 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.762 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:28.762 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:28.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.762 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.762 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:28.762 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:28.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.762 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.762 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:28.762 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602370+0000", 2024-09-12T00:04:28.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0720000000000001e-06 2024-09-12T00:04:28.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.763 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:28.763 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602376+0000", 2024-09-12T00:04:28.763 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5489999999999997e-06 2024-09-12T00:04:28.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.763 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:28.763 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602391+0000", 2024-09-12T00:04:28.763 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5301000000000001e-05 2024-09-12T00:04:28.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:28.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602399+0000", 2024-09-12T00:04:28.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9179999999999994e-06 2024-09-12T00:04:28.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.764 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602456+0000", 2024-09-12T00:04:28.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7099999999999999e-05 2024-09-12T00:04:28.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.764 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:28.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602508+0000", 2024-09-12T00:04:28.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2476999999999999e-05 2024-09-12T00:04:28.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.765 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:28.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602606+0000", 2024-09-12T00:04:28.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7823000000000002e-05 2024-09-12T00:04:28.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.765 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:28.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.604653+0000", 2024-09-12T00:04:28.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002047068 2024-09-12T00:04:28.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.765 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:28.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607401+0000", 2024-09-12T00:04:28.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027477700000000001 2024-09-12T00:04:28.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.766 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:28.766 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607453+0000", 2024-09-12T00:04:28.766 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2092999999999997e-05 2024-09-12T00:04:28.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.766 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:28.766 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607496+0000", 2024-09-12T00:04:28.766 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3003000000000001e-05 2024-09-12T00:04:28.766 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.766 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:28.766 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.767 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:665 6.1a e35/29 6:5c7e8a6d:reshard::reshard.0000000015:head v 35'11, mlcod=35'8)", 2024-09-12T00:04:28.767 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:28.767 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 54.003176553000003, 2024-09-12T00:04:28.767 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048593209999999998, 2024-09-12T00:04:28.767 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:28.767 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:28.767 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:28.767 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:28.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.767 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:28.767 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:28.767 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:28.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:28.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:28.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602742+0000", 2024-09-12T00:04:28.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1069999999999999e-06 2024-09-12T00:04:28.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:28.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602749+0000", 2024-09-12T00:04:28.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9609999999999999e-06 2024-09-12T00:04:28.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.769 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.769 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:28.769 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602763+0000", 2024-09-12T00:04:28.769 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4086e-05 2024-09-12T00:04:28.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.769 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.769 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:28.769 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602772+0000", 2024-09-12T00:04:28.769 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8470000000000002e-06 2024-09-12T00:04:28.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.769 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.769 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.769 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602826+0000", 2024-09-12T00:04:28.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3885000000000003e-05 2024-09-12T00:04:28.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:28.770 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602837+0000", 2024-09-12T00:04:28.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1601e-05 2024-09-12T00:04:28.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:28.770 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607500+0000", 2024-09-12T00:04:28.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046627509999999997 2024-09-12T00:04:28.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:28.771 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607600+0000", 2024-09-12T00:04:28.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100083 2024-09-12T00:04:28.771 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.771 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:28.771 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.771 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:831 6.19 6:9d23f22c:lc::lc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:28.771 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:28.771 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.939891873000001, 2024-09-12T00:04:28.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047044610000000001, 2024-09-12T00:04:28.771 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:28.771 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:28.772 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:28.772 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:28.772 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:28.772 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:28.772 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 831 2024-09-12T00:04:28.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.772 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:28.772 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.772 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:28.772 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:28.772 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.772 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.772 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:28.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:28.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.773 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:28.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666026+0000", 2024-09-12T00:04:28.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.02e-06 2024-09-12T00:04:28.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.773 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:28.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666032+0000", 2024-09-12T00:04:28.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8850000000000004e-06 2024-09-12T00:04:28.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.774 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:28.774 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666047+0000", 2024-09-12T00:04:28.774 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4647999999999999e-05 2024-09-12T00:04:28.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.774 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:28.774 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666058+0000", 2024-09-12T00:04:28.774 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0905e-05 2024-09-12T00:04:28.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.774 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.774 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666376+0000", 2024-09-12T00:04:28.774 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031824899999999999 2024-09-12T00:04:28.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.775 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:28.775 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666479+0000", 2024-09-12T00:04:28.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102814 2024-09-12T00:04:28.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.775 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.775 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:28.775 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666635+0000", 2024-09-12T00:04:28.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000156343 2024-09-12T00:04:28.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.775 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.775 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:28.775 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.667611+0000", 2024-09-12T00:04:28.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000975671 2024-09-12T00:04:28.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:28.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670662+0000", 2024-09-12T00:04:28.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003050863 2024-09-12T00:04:28.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:28.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670701+0000", 2024-09-12T00:04:28.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9338000000000002e-05 2024-09-12T00:04:28.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:28.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670730+0000", 2024-09-12T00:04:28.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8725e-05 2024-09-12T00:04:28.777 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.777 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:28.777 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.777 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:852 6.1d e35/29 6:bbf2d10c:::obj_delete_at_hint.0000000025:head v 35'9, mlcod=35'7)", 2024-09-12T00:04:28.777 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:28.777 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.931314819999997, 2024-09-12T00:04:28.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00569595, 2024-09-12T00:04:28.777 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:28.777 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:28.778 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:28.778 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:28.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.778 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:28.778 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:28.778 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.778 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:28.778 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:28.778 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.778 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:28.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674604+0000", 2024-09-12T00:04:28.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2079999999999999e-06 2024-09-12T00:04:28.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:28.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674611+0000", 2024-09-12T00:04:28.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.973e-06 2024-09-12T00:04:28.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:28.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674625+0000", 2024-09-12T00:04:28.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3916e-05 2024-09-12T00:04:28.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:28.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674633+0000", 2024-09-12T00:04:28.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8580000000000006e-06 2024-09-12T00:04:28.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674697+0000", 2024-09-12T00:04:28.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4004999999999995e-05 2024-09-12T00:04:28.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:28.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674713+0000", 2024-09-12T00:04:28.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5835e-05 2024-09-12T00:04:28.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.781 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:28.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680245+0000", 2024-09-12T00:04:28.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055320250000000003 2024-09-12T00:04:28.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.781 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:28.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680298+0000", 2024-09-12T00:04:28.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3130000000000001e-05 2024-09-12T00:04:28.781 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.781 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:28.781 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.782 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:925 6.1a e35/29 6:5f2e3d26:lc::lc.18:head v 35'15, mlcod=35'12)", 2024-09-12T00:04:28.782 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:28.782 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.907786989999998, 2024-09-12T00:04:28.782 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055640999999999998, 2024-09-12T00:04:28.782 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:28.782 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:28.782 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:28.782 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:28.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.782 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:28.782 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:28.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:28.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:28.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:28.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698131+0000", 2024-09-12T00:04:28.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:04:28.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:28.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698140+0000", 2024-09-12T00:04:28.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3139999999999993e-06 2024-09-12T00:04:28.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:28.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698155+0000", 2024-09-12T00:04:28.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:04:28.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:28.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698164+0000", 2024-09-12T00:04:28.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1419999999999999e-06 2024-09-12T00:04:28.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698228+0000", 2024-09-12T00:04:28.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3380000000000006e-05 2024-09-12T00:04:28.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:28.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698252+0000", 2024-09-12T00:04:28.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4111e-05 2024-09-12T00:04:28.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:28.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703646+0000", 2024-09-12T00:04:28.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0053937840000000004 2024-09-12T00:04:28.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.786 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:28.786 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703694+0000", 2024-09-12T00:04:28.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8776999999999997e-05 2024-09-12T00:04:28.786 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.786 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:28.786 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.786 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:927 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:28.786 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:28.786 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.907267965999999, 2024-09-12T00:04:28.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050914949999999997, 2024-09-12T00:04:28.787 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:28.787 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:28.787 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:28.787 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:28.787 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:28.787 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:28.787 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 927 2024-09-12T00:04:28.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.787 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:28.787 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.787 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:28.787 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:28.787 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.788 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:28.788 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:28.788 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.788 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:28.788 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698651+0000", 2024-09-12T00:04:28.788 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3740000000000001e-06 2024-09-12T00:04:28.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.788 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:28.788 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698657+0000", 2024-09-12T00:04:28.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5239999999999997e-06 2024-09-12T00:04:28.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:28.789 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698673+0000", 2024-09-12T00:04:28.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5345999999999998e-05 2024-09-12T00:04:28.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:28.789 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698680+0000", 2024-09-12T00:04:28.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4649999999999997e-06 2024-09-12T00:04:28.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699009+0000", 2024-09-12T00:04:28.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032934000000000001 2024-09-12T00:04:28.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:28.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699213+0000", 2024-09-12T00:04:28.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020361500000000001 2024-09-12T00:04:28.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:28.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699450+0000", 2024-09-12T00:04:28.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023670399999999999 2024-09-12T00:04:28.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:28.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.700678+0000", 2024-09-12T00:04:28.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012285519999999999 2024-09-12T00:04:28.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:28.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703666+0000", 2024-09-12T00:04:28.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029876130000000001 2024-09-12T00:04:28.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:28.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703708+0000", 2024-09-12T00:04:28.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2361999999999999e-05 2024-09-12T00:04:28.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:28.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703741+0000", 2024-09-12T00:04:28.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.26e-05 2024-09-12T00:04:28.792 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.792 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:28.792 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.792 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:941 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:28.792 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:28.792 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 53.901774512999999, 2024-09-12T00:04:28.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0051476960000000002, 2024-09-12T00:04:28.793 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:28.793 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:28.793 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "started", 2024-09-12T00:04:28.793 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:28.793 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:28.793 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:28.793 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 941 2024-09-12T00:04:28.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.793 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:28.793 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.793 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:28.793 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:28.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:28.794 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:28.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:28.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:28.794 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704144+0000", 2024-09-12T00:04:28.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.514e-06 2024-09-12T00:04:28.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:28.794 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704152+0000", 2024-09-12T00:04:28.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2830000000000004e-06 2024-09-12T00:04:28.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:28.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704168+0000", 2024-09-12T00:04:28.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6835999999999999e-05 2024-09-12T00:04:28.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:28.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704178+0000", 2024-09-12T00:04:28.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7569999999999999e-06 2024-09-12T00:04:28.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:28.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704240+0000", 2024-09-12T00:04:28.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2193000000000006e-05 2024-09-12T00:04:28.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:28.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704308+0000", 2024-09-12T00:04:28.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7840000000000001e-05 2024-09-12T00:04:28.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:28.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:28.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:28.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.709290+0000", 2024-09-12T00:04:28.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049822729999999997 2024-09-12T00:04:28.796 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.796 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:28.796 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.797 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:28.797 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:28.797 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:28.798 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:04:28.799 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:28.796+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:28.899 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:28.899+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:28.974 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:28.974 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:28.975 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:28.975 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:28.988 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:04:29.000 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:29.003+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:29.102 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:29.103+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:29.118 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:29.118 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:29.118 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:29.118 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:29.118 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:29.133 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:04:29.203 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:29.203+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:29.266 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:29.266 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:29.266 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:29.266 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:29.266 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.267 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:29.267 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:29.267 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.773885875000005, 2024-09-12T00:04:29.267 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.278479906, 2024-09-12T00:04:29.267 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.267 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.267 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.267 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.267 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:29.267 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:29.267 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:04:29.267 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.268 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.268 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.268 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.268 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:29.268 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.268 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.268 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.268 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.268 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:29.268 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.268 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.268 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.268 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.268 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493422+0000", 2024-09-12T00:04:29.269 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.807e-06 2024-09-12T00:04:29.269 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.269 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.269 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.269 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493435+0000", 2024-09-12T00:04:29.269 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.375e-05 2024-09-12T00:04:29.269 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.269 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.269 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.269 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493457+0000", 2024-09-12T00:04:29.269 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2166000000000001e-05 2024-09-12T00:04:29.269 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.269 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.270 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.270 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493475+0000", 2024-09-12T00:04:29.270 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7184e-05 2024-09-12T00:04:29.270 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.270 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.270 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.270 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493617+0000", 2024-09-12T00:04:29.270 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014274200000000001 2024-09-12T00:04:29.270 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.270 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.270 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:29.270 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493632+0000", 2024-09-12T00:04:29.270 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4293e-05 2024-09-12T00:04:29.270 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.271 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.271 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.271 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.768657+0000", 2024-09-12T00:04:29.271 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.27502575400000001 2024-09-12T00:04:29.271 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.271 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.271 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.271 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769042+0000", 2024-09-12T00:04:29.271 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00038463700000000001 2024-09-12T00:04:29.271 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.271 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.271 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:29.271 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769430+0000", 2024-09-12T00:04:29.271 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000388014 2024-09-12T00:04:29.272 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.272 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.272 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.272 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.770784+0000", 2024-09-12T00:04:29.272 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00135402 2024-09-12T00:04:29.272 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.272 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.272 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.272 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771735+0000", 2024-09-12T00:04:29.272 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00095068599999999996 2024-09-12T00:04:29.273 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.274 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.274 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.274 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771828+0000", 2024-09-12T00:04:29.274 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3468999999999996e-05 2024-09-12T00:04:29.274 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.274 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.274 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.274 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771899+0000", 2024-09-12T00:04:29.274 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0383999999999996e-05 2024-09-12T00:04:29.274 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.274 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.274 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.274 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.274 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.275 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:29.275 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:29.275 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.345662118999996, 2024-09-12T00:04:29.275 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013402304, 2024-09-12T00:04:29.275 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.275 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.275 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.275 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.275 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:29.275 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:29.275 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 44 2024-09-12T00:04:29.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.275 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.276 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.276 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.276 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:29.276 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.276 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.276 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.276 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:29.276 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.276 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.276 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.276 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:29.276 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7100000000000001e-07 2024-09-12T00:04:29.277 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.277 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.277 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.277 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921706+0000", 2024-09-12T00:04:29.277 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2374999999999998e-05 2024-09-12T00:04:29.277 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.277 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.277 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.277 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921726+0000", 2024-09-12T00:04:29.277 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0373999999999998e-05 2024-09-12T00:04:29.277 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.277 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.277 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.277 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921733+0000", 2024-09-12T00:04:29.278 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8929999999999999e-06 2024-09-12T00:04:29.278 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.278 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.278 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.278 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927137+0000", 2024-09-12T00:04:29.278 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054037410000000001 2024-09-12T00:04:29.278 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.278 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.278 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.278 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927274+0000", 2024-09-12T00:04:29.278 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013697899999999999 2024-09-12T00:04:29.278 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.278 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.278 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:29.279 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927504+0000", 2024-09-12T00:04:29.279 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023005399999999999 2024-09-12T00:04:29.279 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.279 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.279 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.279 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.931848+0000", 2024-09-12T00:04:29.279 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0043445269999999999 2024-09-12T00:04:29.279 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.279 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.279 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.279 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934770+0000", 2024-09-12T00:04:29.279 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002922319 2024-09-12T00:04:29.279 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.279 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.280 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.280 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934901+0000", 2024-09-12T00:04:29.280 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013034599999999999 2024-09-12T00:04:29.280 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.280 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.280 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.280 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935045+0000", 2024-09-12T00:04:29.280 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014402499999999999 2024-09-12T00:04:29.280 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.280 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.280 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.280 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.280 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.281 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:29.281 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:29.281 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.345559154, 2024-09-12T00:04:29.281 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013456684999999999, 2024-09-12T00:04:29.281 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.281 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.281 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.281 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.281 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:29.281 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:29.281 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 45 2024-09-12T00:04:29.281 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.281 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.282 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.282 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.282 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:29.282 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.282 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.282 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.282 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.282 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:29.282 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.282 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.282 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.282 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.282 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921746+0000", 2024-09-12T00:04:29.282 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9800000000000003e-07 2024-09-12T00:04:29.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.283 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.283 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.283 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921751+0000", 2024-09-12T00:04:29.283 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7099999999999998e-06 2024-09-12T00:04:29.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.283 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.283 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.283 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921766+0000", 2024-09-12T00:04:29.283 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5633000000000001e-05 2024-09-12T00:04:29.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.283 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.283 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.284 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921786+0000", 2024-09-12T00:04:29.284 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9658000000000001e-05 2024-09-12T00:04:29.284 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.284 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.284 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.284 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929539+0000", 2024-09-12T00:04:29.284 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0077533120000000001 2024-09-12T00:04:29.284 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.284 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.284 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.284 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929706+0000", 2024-09-12T00:04:29.284 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016664199999999999 2024-09-12T00:04:29.284 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.285 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.285 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:29.285 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929933+0000", 2024-09-12T00:04:29.285 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000226658 2024-09-12T00:04:29.285 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.285 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.285 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.285 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934721+0000", 2024-09-12T00:04:29.285 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047886439999999999 2024-09-12T00:04:29.285 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.285 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.285 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.285 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935062+0000", 2024-09-12T00:04:29.285 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00034072399999999999 2024-09-12T00:04:29.286 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.286 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.286 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.286 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935141+0000", 2024-09-12T00:04:29.286 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8570000000000002e-05 2024-09-12T00:04:29.286 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.286 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.286 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.286 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935202+0000", 2024-09-12T00:04:29.286 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1536000000000002e-05 2024-09-12T00:04:29.286 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.286 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.286 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.287 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.287 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.287 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:29.287 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:29.287 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.345508921999993, 2024-09-12T00:04:29.287 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014633617, 2024-09-12T00:04:29.287 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.287 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.287 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.287 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.287 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:29.287 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:29.287 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:04:29.288 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.288 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.288 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.288 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.288 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:29.288 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.288 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.288 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.288 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.288 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:29.288 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.288 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.288 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.288 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.289 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:29.289 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3599999999999999e-07 2024-09-12T00:04:29.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.289 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.289 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.289 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921800+0000", 2024-09-12T00:04:29.289 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3850000000000002e-06 2024-09-12T00:04:29.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.289 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.289 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.289 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921805+0000", 2024-09-12T00:04:29.289 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9460000000000003e-06 2024-09-12T00:04:29.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.289 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.290 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.290 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921819+0000", 2024-09-12T00:04:29.290 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.325e-05 2024-09-12T00:04:29.290 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.290 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.290 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.290 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930627+0000", 2024-09-12T00:04:29.290 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00880827 2024-09-12T00:04:29.290 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.290 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.290 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.290 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930805+0000", 2024-09-12T00:04:29.290 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000177992 2024-09-12T00:04:29.290 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.291 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.291 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:29.291 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.931028+0000", 2024-09-12T00:04:29.291 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000223122 2024-09-12T00:04:29.291 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.291 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.291 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.291 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935258+0000", 2024-09-12T00:04:29.291 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0042302709999999999 2024-09-12T00:04:29.291 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.291 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.291 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.291 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936282+0000", 2024-09-12T00:04:29.291 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00102345 2024-09-12T00:04:29.292 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.292 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.292 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.292 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936367+0000", 2024-09-12T00:04:29.292 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4869000000000003e-05 2024-09-12T00:04:29.292 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.292 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.292 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.292 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936429+0000", 2024-09-12T00:04:29.292 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2626000000000007e-05 2024-09-12T00:04:29.292 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.292 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.292 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.293 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.293 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.293 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:29.293 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:29.293 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.345472672, 2024-09-12T00:04:29.293 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016022492999999999, 2024-09-12T00:04:29.293 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.293 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.293 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.293 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.293 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:29.293 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:29.293 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:04:29.293 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.294 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.294 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.294 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.294 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:29.294 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.294 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.294 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.294 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.294 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:29.294 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.294 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.294 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.294 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.294 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:29.295 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4000000000000002e-07 2024-09-12T00:04:29.295 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.295 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.295 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.295 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921891+0000", 2024-09-12T00:04:29.295 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8298000000000003e-05 2024-09-12T00:04:29.295 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.295 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.295 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.295 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921899+0000", 2024-09-12T00:04:29.295 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7059999999999993e-06 2024-09-12T00:04:29.295 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.295 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.295 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.296 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921904+0000", 2024-09-12T00:04:29.296 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9799999999999998e-06 2024-09-12T00:04:29.296 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.296 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.296 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.296 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932144+0000", 2024-09-12T00:04:29.296 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010239817999999999 2024-09-12T00:04:29.296 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.296 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.296 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.296 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932284+0000", 2024-09-12T00:04:29.296 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139436 2024-09-12T00:04:29.296 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.297 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.297 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:29.297 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932498+0000", 2024-09-12T00:04:29.297 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000214408 2024-09-12T00:04:29.297 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.297 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.297 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.297 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936444+0000", 2024-09-12T00:04:29.297 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039464169999999998 2024-09-12T00:04:29.297 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.297 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.297 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.297 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937702+0000", 2024-09-12T00:04:29.297 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012571679999999999 2024-09-12T00:04:29.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.298 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.298 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.298 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937793+0000", 2024-09-12T00:04:29.298 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1489000000000004e-05 2024-09-12T00:04:29.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.298 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.298 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.298 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937854+0000", 2024-09-12T00:04:29.298 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1333000000000004e-05 2024-09-12T00:04:29.298 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.298 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.298 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.299 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.299 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:29.299 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:29.299 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.345390804000004, 2024-09-12T00:04:29.299 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017189138999999999, 2024-09-12T00:04:29.299 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.299 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.299 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.299 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.299 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:29.299 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:29.299 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 48 2024-09-12T00:04:29.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.299 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.300 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.300 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.300 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:29.300 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.300 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.300 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.300 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:29.300 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.301 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.301 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.301 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:29.301 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7399999999999998e-07 2024-09-12T00:04:29.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.301 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.301 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.301 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921918+0000", 2024-09-12T00:04:29.301 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6399999999999999e-06 2024-09-12T00:04:29.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.301 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.301 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.301 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921925+0000", 2024-09-12T00:04:29.301 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7190000000000004e-06 2024-09-12T00:04:29.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.302 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.302 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.302 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921931+0000", 2024-09-12T00:04:29.302 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2519999999999996e-06 2024-09-12T00:04:29.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.302 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.302 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.302 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933475+0000", 2024-09-12T00:04:29.302 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011543759000000001 2024-09-12T00:04:29.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.302 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.302 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.303 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933617+0000", 2024-09-12T00:04:29.303 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000142282 2024-09-12T00:04:29.303 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.303 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.303 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:29.303 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933860+0000", 2024-09-12T00:04:29.303 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024276199999999999 2024-09-12T00:04:29.303 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.303 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.303 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.303 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937933+0000", 2024-09-12T00:04:29.303 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040734680000000002 2024-09-12T00:04:29.303 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.303 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.304 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.304 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938955+0000", 2024-09-12T00:04:29.304 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001021987 2024-09-12T00:04:29.304 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.304 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.304 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.304 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939038+0000", 2024-09-12T00:04:29.304 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2449999999999998e-05 2024-09-12T00:04:29.304 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.304 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.304 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.304 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939103+0000", 2024-09-12T00:04:29.304 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5345999999999994e-05 2024-09-12T00:04:29.304 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.305 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.305 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.305 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.305 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:29.305 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:29.305 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.345365262000001, 2024-09-12T00:04:29.305 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018247975, 2024-09-12T00:04:29.305 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.305 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.305 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.305 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.306 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:29.306 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:29.306 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 49 2024-09-12T00:04:29.306 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.306 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.306 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.306 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.307 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:29.307 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.307 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.307 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.307 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:29.307 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.307 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.307 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.307 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921940+0000", 2024-09-12T00:04:29.307 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7e-07 2024-09-12T00:04:29.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.308 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.308 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.308 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921943+0000", 2024-09-12T00:04:29.308 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1889999999999999e-06 2024-09-12T00:04:29.308 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.308 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.308 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.308 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921952+0000", 2024-09-12T00:04:29.308 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0010000000000007e-06 2024-09-12T00:04:29.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.309 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.309 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.309 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921959+0000", 2024-09-12T00:04:29.309 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2570000000000001e-06 2024-09-12T00:04:29.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.309 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.309 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.309 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935333+0000", 2024-09-12T00:04:29.309 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013373368 2024-09-12T00:04:29.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.309 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.309 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.310 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935472+0000", 2024-09-12T00:04:29.310 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013987900000000001 2024-09-12T00:04:29.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.310 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.310 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:29.310 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935700+0000", 2024-09-12T00:04:29.310 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000227922 2024-09-12T00:04:29.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.310 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.310 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.310 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939858+0000", 2024-09-12T00:04:29.310 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041571300000000002 2024-09-12T00:04:29.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.310 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.311 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.311 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940018+0000", 2024-09-12T00:04:29.311 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016060400000000001 2024-09-12T00:04:29.311 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.311 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.311 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.311 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940114+0000", 2024-09-12T00:04:29.311 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5692999999999993e-05 2024-09-12T00:04:29.311 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.311 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.311 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.311 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940187+0000", 2024-09-12T00:04:29.311 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3561999999999998e-05 2024-09-12T00:04:29.312 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.312 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.312 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.312 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.312 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.312 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:29.312 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:29.312 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.345322475000003, 2024-09-12T00:04:29.312 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021018614000000001, 2024-09-12T00:04:29.312 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.312 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.312 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.312 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.312 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:29.313 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:29.313 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 50 2024-09-12T00:04:29.313 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.313 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.313 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.313 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.313 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:29.313 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.313 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.313 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.313 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.313 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:29.313 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.314 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.314 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.314 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921983+0000", 2024-09-12T00:04:29.314 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4499999999999996e-07 2024-09-12T00:04:29.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.314 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.314 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.314 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922071+0000", 2024-09-12T00:04:29.314 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8010000000000006e-05 2024-09-12T00:04:29.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.314 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.314 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.314 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922084+0000", 2024-09-12T00:04:29.315 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3275000000000001e-05 2024-09-12T00:04:29.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.315 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.315 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.315 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922093+0000", 2024-09-12T00:04:29.315 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0580000000000004e-06 2024-09-12T00:04:29.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.315 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.315 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.315 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936515+0000", 2024-09-12T00:04:29.315 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014421270999999999 2024-09-12T00:04:29.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.315 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.315 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.316 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936677+0000", 2024-09-12T00:04:29.316 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162003 2024-09-12T00:04:29.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.316 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.316 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:29.316 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936908+0000", 2024-09-12T00:04:29.316 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023115700000000001 2024-09-12T00:04:29.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.316 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.316 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.316 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939985+0000", 2024-09-12T00:04:29.316 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030773879999999999 2024-09-12T00:04:29.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.317 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.317 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.317 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942623+0000", 2024-09-12T00:04:29.317 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026377929999999998 2024-09-12T00:04:29.317 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.317 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.317 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.317 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942818+0000", 2024-09-12T00:04:29.317 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019556200000000001 2024-09-12T00:04:29.317 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.317 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.317 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.317 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943001+0000", 2024-09-12T00:04:29.317 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018235199999999999 2024-09-12T00:04:29.318 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.318 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.318 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.318 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.318 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.318 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:29.318 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:29.318 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.345188082999996, 2024-09-12T00:04:29.318 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021092493, 2024-09-12T00:04:29.318 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.318 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.318 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.318 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.318 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:29.319 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:29.319 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 51 2024-09-12T00:04:29.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.319 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.319 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.319 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.319 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:29.319 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.319 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.319 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.319 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:29.319 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.320 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.320 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.320 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922118+0000", 2024-09-12T00:04:29.320 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0389999999999999e-06 2024-09-12T00:04:29.320 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.320 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.320 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.320 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922124+0000", 2024-09-12T00:04:29.320 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5409999999999997e-06 2024-09-12T00:04:29.320 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.320 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.320 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.320 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922136+0000", 2024-09-12T00:04:29.320 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.205e-05 2024-09-12T00:04:29.321 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.321 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.321 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.321 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922147+0000", 2024-09-12T00:04:29.321 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0451e-05 2024-09-12T00:04:29.321 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.321 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.321 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.321 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938000+0000", 2024-09-12T00:04:29.321 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015853682000000001 2024-09-12T00:04:29.321 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.321 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.321 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.321 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938142+0000", 2024-09-12T00:04:29.322 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014148899999999999 2024-09-12T00:04:29.322 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.322 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.322 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:29.322 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938362+0000", 2024-09-12T00:04:29.322 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022034800000000001 2024-09-12T00:04:29.322 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.323 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.323 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.323 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940330+0000", 2024-09-12T00:04:29.323 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001967459 2024-09-12T00:04:29.323 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.323 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.323 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.323 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943064+0000", 2024-09-12T00:04:29.323 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027346219999999999 2024-09-12T00:04:29.323 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.323 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.324 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.324 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943152+0000", 2024-09-12T00:04:29.324 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7563000000000002e-05 2024-09-12T00:04:29.324 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.324 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.324 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.324 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943209+0000", 2024-09-12T00:04:29.324 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7249e-05 2024-09-12T00:04:29.324 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.324 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.324 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.324 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.324 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.325 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:29.325 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:29.325 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.345138590000005, 2024-09-12T00:04:29.325 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021175616000000001, 2024-09-12T00:04:29.325 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.325 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.325 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.325 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.325 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:29.325 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:29.325 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 52 2024-09-12T00:04:29.325 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.325 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.325 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.326 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.326 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:29.326 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.326 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.326 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.326 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.326 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:29.326 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.326 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.326 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.326 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.326 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922167+0000", 2024-09-12T00:04:29.326 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3300000000000001e-07 2024-09-12T00:04:29.327 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.327 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.327 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.327 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922174+0000", 2024-09-12T00:04:29.327 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7070000000000003e-06 2024-09-12T00:04:29.327 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.327 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.327 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.327 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922184+0000", 2024-09-12T00:04:29.327 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682e-05 2024-09-12T00:04:29.327 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.327 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.327 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.327 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922195+0000", 2024-09-12T00:04:29.328 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0489000000000001e-05 2024-09-12T00:04:29.328 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.328 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.328 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.328 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939166+0000", 2024-09-12T00:04:29.328 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016971245999999999 2024-09-12T00:04:29.328 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.328 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.328 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.328 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939243+0000", 2024-09-12T00:04:29.328 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7201999999999997e-05 2024-09-12T00:04:29.328 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.328 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.328 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:29.329 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939381+0000", 2024-09-12T00:04:29.329 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013770699999999999 2024-09-12T00:04:29.329 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.329 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.329 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.329 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940923+0000", 2024-09-12T00:04:29.329 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001542302 2024-09-12T00:04:29.329 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.329 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.329 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.329 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943221+0000", 2024-09-12T00:04:29.329 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022979720000000001 2024-09-12T00:04:29.329 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.330 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.330 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.330 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943295+0000", 2024-09-12T00:04:29.330 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3317000000000003e-05 2024-09-12T00:04:29.330 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.330 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.330 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.330 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943342+0000", 2024-09-12T00:04:29.330 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7159e-05 2024-09-12T00:04:29.330 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.330 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.330 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.330 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.330 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.331 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:29.331 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:29.331 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.096193623999994, 2024-09-12T00:04:29.331 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015229411999999999, 2024-09-12T00:04:29.331 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.331 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.331 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.331 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.331 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:29.331 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:29.331 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 67 2024-09-12T00:04:29.331 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.331 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.331 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.332 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.332 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:29.332 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.332 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.332 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.332 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:29.332 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.332 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.332 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.332 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171112+0000", 2024-09-12T00:04:29.332 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2899999999999999e-06 2024-09-12T00:04:29.333 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.333 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.333 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.333 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171119+0000", 2024-09-12T00:04:29.333 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8870000000000003e-06 2024-09-12T00:04:29.333 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.333 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.333 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.333 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171131+0000", 2024-09-12T00:04:29.333 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1902999999999999e-05 2024-09-12T00:04:29.333 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.333 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.333 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.333 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171147+0000", 2024-09-12T00:04:29.334 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6203000000000001e-05 2024-09-12T00:04:29.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.334 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.334 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.334 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175044+0000", 2024-09-12T00:04:29.334 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038967310000000001 2024-09-12T00:04:29.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.334 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.334 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.334 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175172+0000", 2024-09-12T00:04:29.334 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012784100000000001 2024-09-12T00:04:29.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.334 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.334 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:29.335 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175372+0000", 2024-09-12T00:04:29.335 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019978500000000001 2024-09-12T00:04:29.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.335 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.335 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.335 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179276+0000", 2024-09-12T00:04:29.335 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039042149999999999 2024-09-12T00:04:29.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.335 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.335 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.335 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186150+0000", 2024-09-12T00:04:29.335 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0068740019999999997 2024-09-12T00:04:29.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.335 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.336 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.336 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186266+0000", 2024-09-12T00:04:29.336 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115742 2024-09-12T00:04:29.336 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.336 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.336 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.336 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186340+0000", 2024-09-12T00:04:29.336 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4813000000000004e-05 2024-09-12T00:04:29.336 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.336 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.336 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.336 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.336 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.337 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:29.337 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:29.337 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.096132548, 2024-09-12T00:04:29.337 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015308448000000001, 2024-09-12T00:04:29.337 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.337 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.337 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.337 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.337 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:29.337 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:29.337 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 68 2024-09-12T00:04:29.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.338 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.338 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.338 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.338 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:29.338 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.338 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.338 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.338 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:29.338 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.338 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.338 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.339 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171173+0000", 2024-09-12T00:04:29.339 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:04:29.339 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.339 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.339 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.339 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171182+0000", 2024-09-12T00:04:29.339 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2359999999999993e-06 2024-09-12T00:04:29.339 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.339 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.339 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.339 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171193+0000", 2024-09-12T00:04:29.339 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.095e-05 2024-09-12T00:04:29.339 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.340 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.340 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.340 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171207+0000", 2024-09-12T00:04:29.340 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3339999999999999e-05 2024-09-12T00:04:29.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.340 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.340 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.340 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176753+0000", 2024-09-12T00:04:29.340 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055460240000000001 2024-09-12T00:04:29.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.340 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.340 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.340 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176921+0000", 2024-09-12T00:04:29.340 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000168503 2024-09-12T00:04:29.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.341 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.341 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:29.341 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177112+0000", 2024-09-12T00:04:29.341 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019113999999999999 2024-09-12T00:04:29.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.341 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.341 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.341 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179382+0000", 2024-09-12T00:04:29.341 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022697099999999999 2024-09-12T00:04:29.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.341 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.341 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.341 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186356+0000", 2024-09-12T00:04:29.342 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069741919999999997 2024-09-12T00:04:29.342 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.342 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.342 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.342 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186422+0000", 2024-09-12T00:04:29.342 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6387e-05 2024-09-12T00:04:29.342 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.342 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.342 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.342 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186481+0000", 2024-09-12T00:04:29.342 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8059000000000001e-05 2024-09-12T00:04:29.342 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.342 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.343 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.343 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.343 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:29.343 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:29.343 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.096080778000001, 2024-09-12T00:04:29.343 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020001835999999999, 2024-09-12T00:04:29.343 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.343 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.343 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.343 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.343 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:29.343 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:29.343 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 69 2024-09-12T00:04:29.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.344 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.344 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.344 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.344 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:29.344 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.344 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.344 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.344 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:29.344 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.344 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.344 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.345 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171225+0000", 2024-09-12T00:04:29.345 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0599999999999999e-07 2024-09-12T00:04:29.345 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.345 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.345 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.345 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171349+0000", 2024-09-12T00:04:29.345 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012407299999999999 2024-09-12T00:04:29.345 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.345 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.345 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.345 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171367+0000", 2024-09-12T00:04:29.345 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8413000000000001e-05 2024-09-12T00:04:29.345 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.345 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.346 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.346 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171376+0000", 2024-09-12T00:04:29.346 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8170000000000005e-06 2024-09-12T00:04:29.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.346 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.346 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.346 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177692+0000", 2024-09-12T00:04:29.346 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063156729999999999 2024-09-12T00:04:29.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.346 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.346 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.346 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177817+0000", 2024-09-12T00:04:29.346 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012581499999999999 2024-09-12T00:04:29.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.347 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:29.347 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.178015+0000", 2024-09-12T00:04:29.347 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019715100000000001 2024-09-12T00:04:29.347 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.347 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.347 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181798+0000", 2024-09-12T00:04:29.347 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003783308 2024-09-12T00:04:29.347 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.347 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.347 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190976+0000", 2024-09-12T00:04:29.348 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091776519999999997 2024-09-12T00:04:29.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.348 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.348 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.348 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191122+0000", 2024-09-12T00:04:29.348 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000145966 2024-09-12T00:04:29.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.348 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.348 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.348 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191226+0000", 2024-09-12T00:04:29.348 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104162 2024-09-12T00:04:29.348 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.348 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.348 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.349 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.349 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.349 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:29.349 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:29.349 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.095912042999998, 2024-09-12T00:04:29.349 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019997773, 2024-09-12T00:04:29.349 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.349 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.349 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.349 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.349 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:29.349 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:29.349 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 70 2024-09-12T00:04:29.349 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.350 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.350 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.350 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.350 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:29.350 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.350 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.350 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.350 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.350 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:29.350 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.350 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.350 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.350 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.350 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:29.351 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3699999999999999e-07 2024-09-12T00:04:29.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.351 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.351 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.351 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171403+0000", 2024-09-12T00:04:29.351 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6199999999999994e-06 2024-09-12T00:04:29.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.351 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.351 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.351 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171416+0000", 2024-09-12T00:04:29.351 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2636000000000001e-05 2024-09-12T00:04:29.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.351 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.351 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.352 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171423+0000", 2024-09-12T00:04:29.352 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5440000000000001e-06 2024-09-12T00:04:29.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.352 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.352 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.352 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179458+0000", 2024-09-12T00:04:29.352 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080351989999999998 2024-09-12T00:04:29.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.352 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.352 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.352 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179604+0000", 2024-09-12T00:04:29.352 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014519899999999999 2024-09-12T00:04:29.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.353 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.353 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:29.353 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179831+0000", 2024-09-12T00:04:29.353 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022704800000000001 2024-09-12T00:04:29.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.353 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.353 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.353 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181918+0000", 2024-09-12T00:04:29.353 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020873950000000001 2024-09-12T00:04:29.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.353 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.353 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.353 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191243+0000", 2024-09-12T00:04:29.353 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0093244729999999998 2024-09-12T00:04:29.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.354 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.354 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.354 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191309+0000", 2024-09-12T00:04:29.354 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6116000000000002e-05 2024-09-12T00:04:29.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.354 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.354 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.354 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191390+0000", 2024-09-12T00:04:29.354 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1705999999999993e-05 2024-09-12T00:04:29.354 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.354 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.354 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.355 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.355 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:29.355 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:29.355 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.095865970000006, 2024-09-12T00:04:29.355 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020263554, 2024-09-12T00:04:29.355 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.355 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.355 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.355 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.355 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:29.355 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:29.355 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 71 2024-09-12T00:04:29.355 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.356 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.356 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.356 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.356 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:29.356 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.356 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.356 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.356 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:29.356 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.356 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.356 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.356 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:29.357 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5000000000000002e-07 2024-09-12T00:04:29.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.357 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.357 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.357 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171454+0000", 2024-09-12T00:04:29.357 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5046e-05 2024-09-12T00:04:29.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.357 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.357 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.357 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171471+0000", 2024-09-12T00:04:29.357 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6923999999999999e-05 2024-09-12T00:04:29.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.357 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.357 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.358 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171487+0000", 2024-09-12T00:04:29.358 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5823000000000001e-05 2024-09-12T00:04:29.358 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.358 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.358 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.358 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180765+0000", 2024-09-12T00:04:29.358 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0092774399999999996 2024-09-12T00:04:29.358 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.358 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.358 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.358 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180900+0000", 2024-09-12T00:04:29.358 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013556700000000001 2024-09-12T00:04:29.358 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.358 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:29.359 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181108+0000", 2024-09-12T00:04:29.359 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020727899999999999 2024-09-12T00:04:29.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.359 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184725+0000", 2024-09-12T00:04:29.359 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036171340000000001 2024-09-12T00:04:29.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.359 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191413+0000", 2024-09-12T00:04:29.359 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066881830000000003 2024-09-12T00:04:29.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.360 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.360 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.360 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191540+0000", 2024-09-12T00:04:29.360 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000126823 2024-09-12T00:04:29.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.360 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.360 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.360 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191702+0000", 2024-09-12T00:04:29.360 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162585 2024-09-12T00:04:29.360 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.360 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.360 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.361 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.361 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:29.361 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:29.361 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.095787393999998, 2024-09-12T00:04:29.361 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020448573000000001, 2024-09-12T00:04:29.361 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.361 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.361 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.361 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.361 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:29.361 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:29.361 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 72 2024-09-12T00:04:29.361 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.361 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.362 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.362 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.362 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:29.362 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.362 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.362 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.362 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:29.362 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.362 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.362 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.362 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171518+0000", 2024-09-12T00:04:29.362 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0440000000000001e-06 2024-09-12T00:04:29.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.363 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171647+0000", 2024-09-12T00:04:29.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012912899999999999 2024-09-12T00:04:29.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.363 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171664+0000", 2024-09-12T00:04:29.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6079999999999999e-05 2024-09-12T00:04:29.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171675+0000", 2024-09-12T00:04:29.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1223000000000001e-05 2024-09-12T00:04:29.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182000+0000", 2024-09-12T00:04:29.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010324949 2024-09-12T00:04:29.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182178+0000", 2024-09-12T00:04:29.365 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017808799999999999 2024-09-12T00:04:29.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.365 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:29.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182402+0000", 2024-09-12T00:04:29.365 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022381199999999999 2024-09-12T00:04:29.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.365 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190935+0000", 2024-09-12T00:04:29.365 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085331560000000001 2024-09-12T00:04:29.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.366 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.366 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191728+0000", 2024-09-12T00:04:29.366 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079325700000000001 2024-09-12T00:04:29.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.366 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.366 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.366 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191864+0000", 2024-09-12T00:04:29.366 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013606299999999999 2024-09-12T00:04:29.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.366 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.366 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.366 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191966+0000", 2024-09-12T00:04:29.366 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101772 2024-09-12T00:04:29.366 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.367 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.367 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.367 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.367 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.367 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:29.367 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:29.367 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.095604198999993, 2024-09-12T00:04:29.367 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020675235, 2024-09-12T00:04:29.367 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.367 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.367 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.367 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.367 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:29.368 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:29.368 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 73 2024-09-12T00:04:29.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.368 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.368 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.368 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:29.368 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.368 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.368 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:29.368 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171701+0000", 2024-09-12T00:04:29.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0999999999999997e-07 2024-09-12T00:04:29.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171709+0000", 2024-09-12T00:04:29.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2540000000000003e-06 2024-09-12T00:04:29.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171724+0000", 2024-09-12T00:04:29.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5569e-05 2024-09-12T00:04:29.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171734+0000", 2024-09-12T00:04:29.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6139999999999998e-06 2024-09-12T00:04:29.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183774+0000", 2024-09-12T00:04:29.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012040444000000001 2024-09-12T00:04:29.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183896+0000", 2024-09-12T00:04:29.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012204199999999999 2024-09-12T00:04:29.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.371 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:29.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184084+0000", 2024-09-12T00:04:29.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018792599999999999 2024-09-12T00:04:29.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.371 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191984+0000", 2024-09-12T00:04:29.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079003790000000008 2024-09-12T00:04:29.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.372 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.372 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.372 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192093+0000", 2024-09-12T00:04:29.372 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000108942 2024-09-12T00:04:29.372 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.372 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.372 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.372 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192250+0000", 2024-09-12T00:04:29.372 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015637600000000001 2024-09-12T00:04:29.372 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.372 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.372 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.372 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192376+0000", 2024-09-12T00:04:29.372 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012587899999999999 2024-09-12T00:04:29.373 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.373 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.373 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.373 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.373 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.373 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:29.373 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:29.373 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.095555989000005, 2024-09-12T00:04:29.373 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021088828, 2024-09-12T00:04:29.373 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.373 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.373 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.373 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.374 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:29.374 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:29.374 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 74 2024-09-12T00:04:29.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.374 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.374 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.374 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.374 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:29.374 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.374 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.374 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.374 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:29.374 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.375 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.375 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:29.375 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1699999999999997e-07 2024-09-12T00:04:29.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.375 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.375 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171758+0000", 2024-09-12T00:04:29.375 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0860000000000008e-06 2024-09-12T00:04:29.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.375 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.375 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171774+0000", 2024-09-12T00:04:29.376 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:04:29.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.376 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.376 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.376 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171788+0000", 2024-09-12T00:04:29.376 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4793999999999999e-05 2024-09-12T00:04:29.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.376 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.376 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.376 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184842+0000", 2024-09-12T00:04:29.376 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013053607 2024-09-12T00:04:29.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.376 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.376 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.377 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185130+0000", 2024-09-12T00:04:29.377 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00028779199999999998 2024-09-12T00:04:29.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.377 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:29.377 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185378+0000", 2024-09-12T00:04:29.377 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024780100000000002 2024-09-12T00:04:29.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.377 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.377 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192513+0000", 2024-09-12T00:04:29.377 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071350770000000001 2024-09-12T00:04:29.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.378 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.378 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192690+0000", 2024-09-12T00:04:29.378 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000176892 2024-09-12T00:04:29.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.378 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.378 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.378 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192769+0000", 2024-09-12T00:04:29.378 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9466000000000001e-05 2024-09-12T00:04:29.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.378 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.378 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.378 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192837+0000", 2024-09-12T00:04:29.378 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8466000000000005e-05 2024-09-12T00:04:29.378 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.379 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.379 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.379 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.379 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.379 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:29.379 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:29.379 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.095503411999999, 2024-09-12T00:04:29.379 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.02121994, 2024-09-12T00:04:29.379 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.379 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.379 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.379 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.379 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:29.379 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:29.380 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 75 2024-09-12T00:04:29.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.380 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.380 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.380 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.380 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:29.380 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.380 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.380 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.380 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:29.380 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.381 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.381 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.381 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171802+0000", 2024-09-12T00:04:29.381 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5000000000000002e-07 2024-09-12T00:04:29.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.381 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.381 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.381 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171954+0000", 2024-09-12T00:04:29.381 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015215500000000001 2024-09-12T00:04:29.384 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.384 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.384 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.384 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171966+0000", 2024-09-12T00:04:29.384 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1548e-05 2024-09-12T00:04:29.384 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.384 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.384 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.384 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171970+0000", 2024-09-12T00:04:29.384 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8729999999999998e-06 2024-09-12T00:04:29.384 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.385 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.385 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.385 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186552+0000", 2024-09-12T00:04:29.385 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014581775 2024-09-12T00:04:29.385 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.385 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.385 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.385 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186702+0000", 2024-09-12T00:04:29.385 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014946 2024-09-12T00:04:29.385 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.385 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.385 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:29.385 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186897+0000", 2024-09-12T00:04:29.386 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000195071 2024-09-12T00:04:29.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.386 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.386 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.386 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192666+0000", 2024-09-12T00:04:29.386 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057693470000000002 2024-09-12T00:04:29.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.386 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.386 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.386 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192857+0000", 2024-09-12T00:04:29.386 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191149 2024-09-12T00:04:29.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.386 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.386 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.387 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192967+0000", 2024-09-12T00:04:29.387 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110202 2024-09-12T00:04:29.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.387 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.387 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193021+0000", 2024-09-12T00:04:29.387 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3709999999999999e-05 2024-09-12T00:04:29.387 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.387 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.387 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.387 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:29.387 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:29.388 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.095324117000004, 2024-09-12T00:04:29.388 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026297425999999999, 2024-09-12T00:04:29.388 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.388 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.388 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.388 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.388 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:29.388 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:29.388 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 76 2024-09-12T00:04:29.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.388 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.388 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.388 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.388 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:29.389 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.389 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.389 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.389 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.389 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:29.389 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.389 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.389 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.389 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.389 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:29.389 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9399999999999995e-07 2024-09-12T00:04:29.389 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.389 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.390 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.390 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171987+0000", 2024-09-12T00:04:29.390 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5230000000000003e-06 2024-09-12T00:04:29.390 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.390 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.390 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.390 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172005+0000", 2024-09-12T00:04:29.390 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8788e-05 2024-09-12T00:04:29.390 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.390 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.390 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.390 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172010+0000", 2024-09-12T00:04:29.390 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7570000000000004e-06 2024-09-12T00:04:29.390 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.391 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.391 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.391 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193104+0000", 2024-09-12T00:04:29.391 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021094112000000002 2024-09-12T00:04:29.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.391 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.391 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.391 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193334+0000", 2024-09-12T00:04:29.391 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000229855 2024-09-12T00:04:29.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.391 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.391 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:29.391 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193697+0000", 2024-09-12T00:04:29.391 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00036272399999999998 2024-09-12T00:04:29.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.392 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.392 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.195602+0000", 2024-09-12T00:04:29.392 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019049620000000001 2024-09-12T00:04:29.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.392 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.392 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198123+0000", 2024-09-12T00:04:29.392 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025216520000000001 2024-09-12T00:04:29.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.392 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.392 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198213+0000", 2024-09-12T00:04:29.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0008999999999998e-05 2024-09-12T00:04:29.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.393 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198278+0000", 2024-09-12T00:04:29.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4549999999999997e-05 2024-09-12T00:04:29.393 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.393 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.393 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.393 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.393 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.393 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:29.395 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:04:29.395 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:29.392+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:29.495 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:29.492+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:29.555 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:29.556 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:29.556 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:29.556 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:29.569 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:04:29.596 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:29.595+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:29.697 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:29.692+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:29.737 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:29.737 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:29.737 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:29.738 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:29.738 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:29.750 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:04:29.837 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:29.836+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:29.899 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:29.896+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:29.917 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:29.917 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:29.917 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:29.917 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:29.917 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.917 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4232.0:1 2.3 e20/19 2:c4c92e5a:::rbd_trash:head v 20'1, mlcod=0'0)", 2024-09-12T00:04:29.918 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:16.594343+0000", 2024-09-12T00:04:29.918 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 73.323891919000005, 2024-09-12T00:04:29.918 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030233460000000001, 2024-09-12T00:04:29.918 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.918 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.918 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.918 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.918 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.918 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.918 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594343+0000", 2024-09-12T00:04:29.918 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.918 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.918 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.918 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.919 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594343+0000", 2024-09-12T00:04:29.919 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.919 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.919 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.919 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.919 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594343+0000", 2024-09-12T00:04:29.919 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7e-07 2024-09-12T00:04:29.919 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.919 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.919 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.919 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594348+0000", 2024-09-12T00:04:29.919 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7899999999999999e-06 2024-09-12T00:04:29.919 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.919 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.920 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.920 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594366+0000", 2024-09-12T00:04:29.920 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8255000000000001e-05 2024-09-12T00:04:29.920 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.920 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.920 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.920 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594381+0000", 2024-09-12T00:04:29.920 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4905999999999999e-05 2024-09-12T00:04:29.920 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.920 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.920 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.920 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594710+0000", 2024-09-12T00:04:29.920 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000329208 2024-09-12T00:04:29.921 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.921 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.921 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.921 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594870+0000", 2024-09-12T00:04:29.921 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015991900000000001 2024-09-12T00:04:29.921 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.921 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.921 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.921 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597290+0000", 2024-09-12T00:04:29.921 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024196439999999999 2024-09-12T00:04:29.921 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.921 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.921 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.921 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597366+0000", 2024-09-12T00:04:29.922 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6254000000000005e-05 2024-09-12T00:04:29.922 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.922 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.922 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.922 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.922 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.922 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:56 7.3 e32/31 7:c609908c:::notify.5:head v 32'1, mlcod=0'0)", 2024-09-12T00:04:29.922 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.376429+0000", 2024-09-12T00:04:29.922 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.541805533999998, 2024-09-12T00:04:29.922 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029522699999999999, 2024-09-12T00:04:29.922 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.922 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.922 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.922 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.923 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.923 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.923 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376429+0000", 2024-09-12T00:04:29.923 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.923 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.923 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.923 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.923 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376429+0000", 2024-09-12T00:04:29.923 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.923 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.923 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.923 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.923 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376435+0000", 2024-09-12T00:04:29.923 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8619999999999999e-06 2024-09-12T00:04:29.923 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.924 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.924 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.924 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376445+0000", 2024-09-12T00:04:29.924 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7929999999999992e-06 2024-09-12T00:04:29.924 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.924 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.924 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.924 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376467+0000", 2024-09-12T00:04:29.924 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2840000000000002e-05 2024-09-12T00:04:29.924 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.924 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.924 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.924 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376481+0000", 2024-09-12T00:04:29.924 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3254e-05 2024-09-12T00:04:29.925 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.925 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.925 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.925 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376585+0000", 2024-09-12T00:04:29.925 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104066 2024-09-12T00:04:29.925 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.925 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.925 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.925 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376611+0000", 2024-09-12T00:04:29.925 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6641000000000001e-05 2024-09-12T00:04:29.925 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.925 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.925 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.925 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.379288+0000", 2024-09-12T00:04:29.926 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026761879999999999 2024-09-12T00:04:29.926 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.926 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.926 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.926 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.379381+0000", 2024-09-12T00:04:29.926 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3626000000000001e-05 2024-09-12T00:04:29.926 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.926 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.926 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.926 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.926 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.926 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:214 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'1, mlcod=0'0)", 2024-09-12T00:04:29.926 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.401315+0000", 2024-09-12T00:04:29.926 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.516919661000003, 2024-09-12T00:04:29.927 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0018968030000000001, 2024-09-12T00:04:29.927 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.927 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.927 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.927 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.927 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.927 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.927 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.401315+0000", 2024-09-12T00:04:29.927 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.927 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.927 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.927 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.927 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.401315+0000", 2024-09-12T00:04:29.927 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.927 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.928 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.928 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.928 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.401316+0000", 2024-09-12T00:04:29.928 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8299999999999996e-07 2024-09-12T00:04:29.928 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.928 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.928 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.928 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.401326+0000", 2024-09-12T00:04:29.928 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0360000000000001e-05 2024-09-12T00:04:29.928 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.928 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.928 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.928 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.401363+0000", 2024-09-12T00:04:29.928 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7020000000000001e-05 2024-09-12T00:04:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.401384+0000", 2024-09-12T00:04:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1189999999999999e-05 2024-09-12T00:04:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.401578+0000", 2024-09-12T00:04:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019421799999999999 2024-09-12T00:04:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.401631+0000", 2024-09-12T00:04:29.929 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2830000000000001e-05 2024-09-12T00:04:29.930 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.930 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.930 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.930 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.403135+0000", 2024-09-12T00:04:29.930 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015033379999999999 2024-09-12T00:04:29.930 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.930 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.930 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.930 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.403212+0000", 2024-09-12T00:04:29.930 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7064000000000006e-05 2024-09-12T00:04:29.930 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.930 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.930 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.930 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.931 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.931 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:29.931 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.411707+0000", 2024-09-12T00:04:29.931 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.506527525999999, 2024-09-12T00:04:29.931 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0031684230000000001, 2024-09-12T00:04:29.931 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.931 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.931 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.931 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.931 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:29.931 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:29.931 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 217 2024-09-12T00:04:29.932 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.932 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.932 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.932 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.932 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411707+0000", 2024-09-12T00:04:29.932 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.932 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.932 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.932 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.932 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411707+0000", 2024-09-12T00:04:29.932 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.932 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.932 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.932 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.933 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411710+0000", 2024-09-12T00:04:29.933 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4599999999999999e-06 2024-09-12T00:04:29.933 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.933 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.933 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.933 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411740+0000", 2024-09-12T00:04:29.933 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.953e-05 2024-09-12T00:04:29.933 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.933 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.933 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.933 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411772+0000", 2024-09-12T00:04:29.933 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.163e-05 2024-09-12T00:04:29.933 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.933 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.933 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.934 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411789+0000", 2024-09-12T00:04:29.934 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7614000000000001e-05 2024-09-12T00:04:29.934 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.934 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.934 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.934 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411905+0000", 2024-09-12T00:04:29.934 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115665 2024-09-12T00:04:29.934 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.934 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.934 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.934 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.412108+0000", 2024-09-12T00:04:29.934 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020293500000000001 2024-09-12T00:04:29.934 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.934 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.935 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:29.935 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.412565+0000", 2024-09-12T00:04:29.935 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00045749700000000001 2024-09-12T00:04:29.935 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.935 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.935 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.935 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.414449+0000", 2024-09-12T00:04:29.935 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0018841859999999999 2024-09-12T00:04:29.935 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.935 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.935 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.935 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.414709+0000", 2024-09-12T00:04:29.935 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00025939399999999998 2024-09-12T00:04:29.935 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.936 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.936 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.936 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.414813+0000", 2024-09-12T00:04:29.936 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104366 2024-09-12T00:04:29.936 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.936 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.936 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.936 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.414875+0000", 2024-09-12T00:04:29.936 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2145999999999998e-05 2024-09-12T00:04:29.936 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.936 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.936 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.936 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.936 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.936 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:646 6.10 e35/29 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 35'1, mlcod=0'0)", 2024-09-12T00:04:29.937 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.597000+0000", 2024-09-12T00:04:29.937 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.321234396999998, 2024-09-12T00:04:29.937 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0044366320000000002, 2024-09-12T00:04:29.937 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.937 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.937 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.937 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.937 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.937 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.937 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597000+0000", 2024-09-12T00:04:29.937 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.937 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.937 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.937 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.938 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597000+0000", 2024-09-12T00:04:29.938 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.938 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.938 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.938 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.938 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597000+0000", 2024-09-12T00:04:29.938 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7700000000000001e-07 2024-09-12T00:04:29.938 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.938 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.938 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.938 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597004+0000", 2024-09-12T00:04:29.938 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7560000000000001e-06 2024-09-12T00:04:29.938 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.938 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.938 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.939 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597017+0000", 2024-09-12T00:04:29.939 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.33e-05 2024-09-12T00:04:29.939 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.939 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.939 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.939 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597024+0000", 2024-09-12T00:04:29.939 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8800000000000002e-06 2024-09-12T00:04:29.939 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.939 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.939 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.939 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597080+0000", 2024-09-12T00:04:29.939 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5949999999999998e-05 2024-09-12T00:04:29.939 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.939 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.939 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.940 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597093+0000", 2024-09-12T00:04:29.940 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2695e-05 2024-09-12T00:04:29.940 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.940 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.940 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.940 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601386+0000", 2024-09-12T00:04:29.940 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0042935480000000003 2024-09-12T00:04:29.940 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.940 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.940 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.940 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601437+0000", 2024-09-12T00:04:29.940 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0325999999999999e-05 2024-09-12T00:04:29.940 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.940 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.941 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.941 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.941 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.941 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:667 6.10 e35/29 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 35'2, mlcod=0'0)", 2024-09-12T00:04:29.941 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602975+0000", 2024-09-12T00:04:29.941 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.315259935, 2024-09-12T00:04:29.941 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040817340000000001, 2024-09-12T00:04:29.941 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.941 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.941 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.941 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.941 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.941 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.941 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602975+0000", 2024-09-12T00:04:29.941 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.942 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.942 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.942 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602975+0000", 2024-09-12T00:04:29.942 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.942 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.942 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.942 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602981+0000", 2024-09-12T00:04:29.942 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7939999999999997e-06 2024-09-12T00:04:29.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.942 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.942 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.942 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602988+0000", 2024-09-12T00:04:29.943 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5270000000000004e-06 2024-09-12T00:04:29.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.943 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.943 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.943 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603003+0000", 2024-09-12T00:04:29.943 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4731e-05 2024-09-12T00:04:29.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.943 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.943 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.943 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603009+0000", 2024-09-12T00:04:29.943 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.297e-06 2024-09-12T00:04:29.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.943 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.943 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.943 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603074+0000", 2024-09-12T00:04:29.944 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4713000000000002e-05 2024-09-12T00:04:29.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.944 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.944 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.944 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603090+0000", 2024-09-12T00:04:29.944 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6344000000000001e-05 2024-09-12T00:04:29.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.944 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.944 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.944 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607014+0000", 2024-09-12T00:04:29.944 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039241800000000002 2024-09-12T00:04:29.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.944 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.944 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.945 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607056+0000", 2024-09-12T00:04:29.945 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2147999999999997e-05 2024-09-12T00:04:29.945 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.945 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.945 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.945 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.945 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.945 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:668 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'2, mlcod=0'0)", 2024-09-12T00:04:29.945 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.607803+0000", 2024-09-12T00:04:29.945 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.310431158999997, 2024-09-12T00:04:29.945 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022602659999999999, 2024-09-12T00:04:29.945 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.945 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.946 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.946 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.946 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.946 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.946 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607803+0000", 2024-09-12T00:04:29.946 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.946 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.946 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.946 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.946 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607803+0000", 2024-09-12T00:04:29.946 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.946 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.946 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.946 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.946 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607805+0000", 2024-09-12T00:04:29.947 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.378e-06 2024-09-12T00:04:29.947 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.947 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.947 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.947 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607813+0000", 2024-09-12T00:04:29.947 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9899999999999997e-06 2024-09-12T00:04:29.947 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.947 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.947 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.947 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607831+0000", 2024-09-12T00:04:29.947 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8082999999999999e-05 2024-09-12T00:04:29.947 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.947 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.947 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.947 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607839+0000", 2024-09-12T00:04:29.948 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6459999999999999e-06 2024-09-12T00:04:29.948 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.948 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.948 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.948 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607907+0000", 2024-09-12T00:04:29.948 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7961999999999997e-05 2024-09-12T00:04:29.948 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.948 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.948 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.948 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607927+0000", 2024-09-12T00:04:29.948 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9364999999999998e-05 2024-09-12T00:04:29.948 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.948 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.948 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.949 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.610011+0000", 2024-09-12T00:04:29.949 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020847629999999999 2024-09-12T00:04:29.949 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.949 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.949 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.949 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.610064+0000", 2024-09-12T00:04:29.949 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2079000000000001e-05 2024-09-12T00:04:29.949 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.949 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.949 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.949 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.949 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.949 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:669 6.1c e35/29 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 35'3, mlcod=0'0)", 2024-09-12T00:04:29.949 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.608370+0000", 2024-09-12T00:04:29.949 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.309864711000003, 2024-09-12T00:04:29.950 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046099820000000003, 2024-09-12T00:04:29.950 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.950 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.950 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.950 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.950 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.950 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.950 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608370+0000", 2024-09-12T00:04:29.950 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.950 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.950 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.950 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.950 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608370+0000", 2024-09-12T00:04:29.951 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.951 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.951 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.951 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.951 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608371+0000", 2024-09-12T00:04:29.951 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8100000000000001e-07 2024-09-12T00:04:29.951 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.951 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.951 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.951 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608377+0000", 2024-09-12T00:04:29.951 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7349999999999999e-06 2024-09-12T00:04:29.951 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.951 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.951 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.951 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608395+0000", 2024-09-12T00:04:29.952 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7285000000000001e-05 2024-09-12T00:04:29.952 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.952 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.952 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.952 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608401+0000", 2024-09-12T00:04:29.952 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.365e-06 2024-09-12T00:04:29.952 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.952 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.952 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.952 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608463+0000", 2024-09-12T00:04:29.952 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2246e-05 2024-09-12T00:04:29.952 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.952 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.953 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.953 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608489+0000", 2024-09-12T00:04:29.953 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5222999999999999e-05 2024-09-12T00:04:29.953 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.953 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.953 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.953 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612945+0000", 2024-09-12T00:04:29.953 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004456603 2024-09-12T00:04:29.953 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.953 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.953 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.953 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612980+0000", 2024-09-12T00:04:29.953 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4544e-05 2024-09-12T00:04:29.953 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.954 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.954 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.954 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.954 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.954 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:682 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'4, mlcod=35'1)", 2024-09-12T00:04:29.954 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.612014+0000", 2024-09-12T00:04:29.954 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.306220308, 2024-09-12T00:04:29.954 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036839749999999999, 2024-09-12T00:04:29.954 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.954 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.954 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.954 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.954 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.954 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.954 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612014+0000", 2024-09-12T00:04:29.955 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.955 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.955 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.955 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.955 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612014+0000", 2024-09-12T00:04:29.955 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.955 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.955 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.955 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.955 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612015+0000", 2024-09-12T00:04:29.955 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0419999999999999e-06 2024-09-12T00:04:29.955 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.955 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.955 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.956 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612021+0000", 2024-09-12T00:04:29.956 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0009999999999998e-06 2024-09-12T00:04:29.956 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.956 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.956 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.956 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612035+0000", 2024-09-12T00:04:29.956 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.412e-05 2024-09-12T00:04:29.956 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.956 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.956 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.956 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612043+0000", 2024-09-12T00:04:29.956 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9699999999999999e-06 2024-09-12T00:04:29.956 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.956 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.956 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.957 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612111+0000", 2024-09-12T00:04:29.957 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7985999999999996e-05 2024-09-12T00:04:29.957 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.957 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.957 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.957 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612126+0000", 2024-09-12T00:04:29.957 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5099000000000001e-05 2024-09-12T00:04:29.957 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.957 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.957 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.957 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.615633+0000", 2024-09-12T00:04:29.957 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003506416 2024-09-12T00:04:29.957 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.957 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.958 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.958 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.615698+0000", 2024-09-12T00:04:29.958 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5340999999999997e-05 2024-09-12T00:04:29.958 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.958 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.958 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.958 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.958 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.958 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:688 6.1c e35/29 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 35'5, mlcod=35'2)", 2024-09-12T00:04:29.958 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.614097+0000", 2024-09-12T00:04:29.958 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.304137212000001, 2024-09-12T00:04:29.958 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001994282, 2024-09-12T00:04:29.958 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.958 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.959 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.959 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.959 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.959 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.959 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.614097+0000", 2024-09-12T00:04:29.959 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.959 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.959 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.959 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.959 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.614097+0000", 2024-09-12T00:04:29.959 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.959 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.959 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.959 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.960 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.614098+0000", 2024-09-12T00:04:29.960 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0299999999999998e-07 2024-09-12T00:04:29.960 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.960 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.960 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.960 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.614114+0000", 2024-09-12T00:04:29.960 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6192e-05 2024-09-12T00:04:29.960 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.960 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.960 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.960 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.614126+0000", 2024-09-12T00:04:29.960 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2081e-05 2024-09-12T00:04:29.960 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.960 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.961 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.961 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.614134+0000", 2024-09-12T00:04:29.961 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7039999999999994e-06 2024-09-12T00:04:29.961 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.961 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.961 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.961 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.614201+0000", 2024-09-12T00:04:29.961 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6534999999999999e-05 2024-09-12T00:04:29.961 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.961 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.961 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.961 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.614227+0000", 2024-09-12T00:04:29.961 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6849e-05 2024-09-12T00:04:29.961 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.961 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.962 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.962 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.616046+0000", 2024-09-12T00:04:29.962 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0018186470000000001 2024-09-12T00:04:29.962 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.962 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.962 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.962 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.616092+0000", 2024-09-12T00:04:29.962 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5470999999999999e-05 2024-09-12T00:04:29.962 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.962 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.962 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.962 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.962 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.963 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:716 6.1c e35/29 6:3fb1de85:::obj_delete_at_hint.0000000018:head v 35'6, mlcod=35'4)", 2024-09-12T00:04:29.963 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.622786+0000", 2024-09-12T00:04:29.963 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.295447969999998, 2024-09-12T00:04:29.963 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024813460000000002, 2024-09-12T00:04:29.963 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.963 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.963 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.963 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.963 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.963 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.963 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.622786+0000", 2024-09-12T00:04:29.963 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.963 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.963 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.963 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.964 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.622786+0000", 2024-09-12T00:04:29.964 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.964 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.964 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.964 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.964 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.622787+0000", 2024-09-12T00:04:29.964 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6500000000000008e-07 2024-09-12T00:04:29.964 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.964 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.964 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.964 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.622794+0000", 2024-09-12T00:04:29.964 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1580000000000002e-06 2024-09-12T00:04:29.964 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.964 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.965 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.965 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.622807+0000", 2024-09-12T00:04:29.965 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3784000000000001e-05 2024-09-12T00:04:29.965 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.965 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.965 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.965 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.622813+0000", 2024-09-12T00:04:29.965 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7849999999999997e-06 2024-09-12T00:04:29.965 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.965 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.965 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.965 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.622873+0000", 2024-09-12T00:04:29.965 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9401999999999998e-05 2024-09-12T00:04:29.965 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.966 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.966 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.966 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.622894+0000", 2024-09-12T00:04:29.966 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1624000000000002e-05 2024-09-12T00:04:29.966 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.966 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.966 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.966 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.625203+0000", 2024-09-12T00:04:29.966 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023087170000000001 2024-09-12T00:04:29.966 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.966 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.966 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.966 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.625268+0000", 2024-09-12T00:04:29.966 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4911000000000002e-05 2024-09-12T00:04:29.966 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.967 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.967 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.967 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.967 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.967 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:729 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:29.967 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.628426+0000", 2024-09-12T00:04:29.967 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.289808633, 2024-09-12T00:04:29.967 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002441983, 2024-09-12T00:04:29.967 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.967 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.967 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.967 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.967 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:29.967 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:29.967 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 729 2024-09-12T00:04:29.968 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.968 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.968 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.968 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.968 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.628426+0000", 2024-09-12T00:04:29.968 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.968 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.968 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.968 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.968 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.628426+0000", 2024-09-12T00:04:29.968 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.968 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.968 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.968 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.969 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.628427+0000", 2024-09-12T00:04:29.969 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5120000000000001e-06 2024-09-12T00:04:29.969 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.969 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.969 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.969 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.628433+0000", 2024-09-12T00:04:29.969 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4759999999999997e-06 2024-09-12T00:04:29.969 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.969 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.969 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.969 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.628448+0000", 2024-09-12T00:04:29.969 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5044e-05 2024-09-12T00:04:29.969 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.969 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.970 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.970 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.628455+0000", 2024-09-12T00:04:29.970 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9059999999999996e-06 2024-09-12T00:04:29.970 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.970 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.970 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.970 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.628513+0000", 2024-09-12T00:04:29.970 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8628999999999997e-05 2024-09-12T00:04:29.970 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.970 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.970 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.970 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.628584+0000", 2024-09-12T00:04:29.970 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0600999999999997e-05 2024-09-12T00:04:29.970 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.970 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.971 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:29.971 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.628752+0000", 2024-09-12T00:04:29.971 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016826800000000001 2024-09-12T00:04:29.971 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.971 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.971 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.971 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.630756+0000", 2024-09-12T00:04:29.971 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020041709999999999 2024-09-12T00:04:29.971 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.971 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.971 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.971 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.630768+0000", 2024-09-12T00:04:29.971 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1185e-05 2024-09-12T00:04:29.971 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.972 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.972 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.972 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.630803+0000", 2024-09-12T00:04:29.972 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5583999999999997e-05 2024-09-12T00:04:29.972 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.972 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.972 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.972 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.630868+0000", 2024-09-12T00:04:29.972 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4607e-05 2024-09-12T00:04:29.972 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.972 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.972 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.972 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.972 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.973 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:758 6.15 6:ae95b544:::obj_delete_at_hint.0000000020:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:29.973 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.639653+0000", 2024-09-12T00:04:29.973 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.278581316999997, 2024-09-12T00:04:29.973 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023477839999999999, 2024-09-12T00:04:29.973 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.973 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.973 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.973 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.973 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:29.973 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:29.973 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 758 2024-09-12T00:04:29.973 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.973 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.973 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.974 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.974 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.639653+0000", 2024-09-12T00:04:29.974 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.974 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.974 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.974 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.974 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.639653+0000", 2024-09-12T00:04:29.974 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.974 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.974 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.974 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.974 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.639655+0000", 2024-09-12T00:04:29.974 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6700000000000001e-06 2024-09-12T00:04:29.974 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.974 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.975 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.975 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.639663+0000", 2024-09-12T00:04:29.975 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0530000000000007e-06 2024-09-12T00:04:29.975 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.975 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.975 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.975 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.639683+0000", 2024-09-12T00:04:29.975 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9771000000000001e-05 2024-09-12T00:04:29.975 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.975 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.975 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.975 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.639692+0000", 2024-09-12T00:04:29.975 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1370000000000008e-06 2024-09-12T00:04:29.975 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.976 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.976 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.976 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.639767+0000", 2024-09-12T00:04:29.976 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5190000000000003e-05 2024-09-12T00:04:29.976 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.976 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.976 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.976 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.639936+0000", 2024-09-12T00:04:29.976 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016948000000000001 2024-09-12T00:04:29.976 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.976 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.976 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:29.976 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.640143+0000", 2024-09-12T00:04:29.976 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020707500000000001 2024-09-12T00:04:29.976 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.977 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.977 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.977 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.640971+0000", 2024-09-12T00:04:29.977 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00082798799999999999 2024-09-12T00:04:29.977 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.977 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.977 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.977 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.641891+0000", 2024-09-12T00:04:29.977 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00091904499999999995 2024-09-12T00:04:29.977 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.977 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.977 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.977 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.641942+0000", 2024-09-12T00:04:29.977 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1785e-05 2024-09-12T00:04:29.978 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.978 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.978 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.978 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642001+0000", 2024-09-12T00:04:29.978 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.859e-05 2024-09-12T00:04:29.978 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.978 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.978 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.978 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.978 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.978 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:768 6.15 6:ae95b544:::obj_delete_at_hint.0000000020:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:29.978 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.642525+0000", 2024-09-12T00:04:29.978 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.275709306000003, 2024-09-12T00:04:29.979 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048019760000000003, 2024-09-12T00:04:29.979 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.979 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.979 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.979 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.979 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:29.979 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:29.979 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 768 2024-09-12T00:04:29.979 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.979 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.979 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.979 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.979 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642525+0000", 2024-09-12T00:04:29.979 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.980 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.980 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.980 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.980 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642525+0000", 2024-09-12T00:04:29.980 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.980 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.980 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.980 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.980 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642526+0000", 2024-09-12T00:04:29.980 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3629999999999999e-06 2024-09-12T00:04:29.980 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.980 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.980 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.980 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642533+0000", 2024-09-12T00:04:29.980 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.64e-06 2024-09-12T00:04:29.981 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.981 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.981 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.981 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642549+0000", 2024-09-12T00:04:29.981 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5911000000000001e-05 2024-09-12T00:04:29.981 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.981 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.981 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.981 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642558+0000", 2024-09-12T00:04:29.981 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7420000000000003e-06 2024-09-12T00:04:29.981 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.981 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.981 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.981 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642628+0000", 2024-09-12T00:04:29.982 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0408999999999996e-05 2024-09-12T00:04:29.982 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.982 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.982 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.982 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642721+0000", 2024-09-12T00:04:29.982 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2888999999999998e-05 2024-09-12T00:04:29.982 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.982 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.982 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:29.982 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642914+0000", 2024-09-12T00:04:29.982 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000192945 2024-09-12T00:04:29.982 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.982 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.982 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.982 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.644463+0000", 2024-09-12T00:04:29.983 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001548848 2024-09-12T00:04:29.983 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.983 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.983 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.983 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.647249+0000", 2024-09-12T00:04:29.983 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027862989999999999 2024-09-12T00:04:29.983 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.983 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.983 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.983 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.647285+0000", 2024-09-12T00:04:29.983 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6210000000000001e-05 2024-09-12T00:04:29.983 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.983 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.983 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.983 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.647327+0000", 2024-09-12T00:04:29.984 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.172e-05 2024-09-12T00:04:29.984 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.984 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.984 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.984 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.984 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:850 6.15 6:abd89f08:lc::lc.23:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:29.984 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.673328+0000", 2024-09-12T00:04:29.984 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.244906571999998, 2024-09-12T00:04:29.984 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047245300000000002, 2024-09-12T00:04:29.984 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.984 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.984 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.984 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.985 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:29.985 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:29.985 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 850 2024-09-12T00:04:29.985 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.985 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.985 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.985 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.985 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673328+0000", 2024-09-12T00:04:29.985 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.985 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.985 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.985 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.985 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673328+0000", 2024-09-12T00:04:29.985 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.986 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.986 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.986 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673329+0000", 2024-09-12T00:04:29.986 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5799999999999998e-07 2024-09-12T00:04:29.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.986 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.986 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.986 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673333+0000", 2024-09-12T00:04:29.986 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5990000000000004e-06 2024-09-12T00:04:29.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.987 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.987 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.987 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673345+0000", 2024-09-12T00:04:29.987 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1637999999999999e-05 2024-09-12T00:04:29.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.987 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.987 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.987 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673353+0000", 2024-09-12T00:04:29.987 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4610000000000002e-06 2024-09-12T00:04:29.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.987 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.987 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.987 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673417+0000", 2024-09-12T00:04:29.988 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4951999999999997e-05 2024-09-12T00:04:29.988 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.988 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.988 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.988 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673521+0000", 2024-09-12T00:04:29.988 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103881 2024-09-12T00:04:29.988 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.988 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.988 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:29.988 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673729+0000", 2024-09-12T00:04:29.988 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020730600000000001 2024-09-12T00:04:29.988 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.988 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.988 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.989 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674901+0000", 2024-09-12T00:04:29.989 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011728140000000001 2024-09-12T00:04:29.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.989 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.989 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.989 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.677953+0000", 2024-09-12T00:04:29.989 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030517959999999998 2024-09-12T00:04:29.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.989 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.989 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.989 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.677997+0000", 2024-09-12T00:04:29.989 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3346999999999997e-05 2024-09-12T00:04:29.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.989 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.990 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.990 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.678052+0000", 2024-09-12T00:04:29.990 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5778e-05 2024-09-12T00:04:29.990 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.990 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.990 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.990 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.990 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.990 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:904 6.15 6:abd89f08:lc::lc.23:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:29.990 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.692432+0000", 2024-09-12T00:04:29.990 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.22580207, 2024-09-12T00:04:29.990 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021347660000000002, 2024-09-12T00:04:29.990 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.990 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.990 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.991 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.991 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:29.991 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:29.991 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 904 2024-09-12T00:04:29.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.991 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.991 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.991 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.991 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.692432+0000", 2024-09-12T00:04:29.991 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.991 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.991 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.991 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.692432+0000", 2024-09-12T00:04:29.992 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.992 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.992 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.992 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.992 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.692434+0000", 2024-09-12T00:04:29.992 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9709999999999998e-06 2024-09-12T00:04:29.992 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.992 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.992 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.992 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.692441+0000", 2024-09-12T00:04:29.992 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.973e-06 2024-09-12T00:04:29.993 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.993 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.993 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.993 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.692464+0000", 2024-09-12T00:04:29.993 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2903000000000001e-05 2024-09-12T00:04:29.993 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.993 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.993 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.993 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.692475+0000", 2024-09-12T00:04:29.993 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0345e-05 2024-09-12T00:04:29.993 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.993 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.993 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.993 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.692549+0000", 2024-09-12T00:04:29.994 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4482999999999998e-05 2024-09-12T00:04:29.994 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.994 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.994 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:29.994 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.692659+0000", 2024-09-12T00:04:29.994 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000109591 2024-09-12T00:04:29.994 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.994 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.994 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:29.994 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.692895+0000", 2024-09-12T00:04:29.994 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000236331 2024-09-12T00:04:29.994 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.994 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.994 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:29.995 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.693883+0000", 2024-09-12T00:04:29.995 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00098760499999999991 2024-09-12T00:04:29.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.995 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.995 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:29.995 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.694449+0000", 2024-09-12T00:04:29.995 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00056647800000000003 2024-09-12T00:04:29.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.995 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.995 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:29.995 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.694524+0000", 2024-09-12T00:04:29.995 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5252000000000004e-05 2024-09-12T00:04:29.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.995 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.995 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:29.996 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.694567+0000", 2024-09-12T00:04:29.996 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2833999999999997e-05 2024-09-12T00:04:29.996 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.996 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:29.996 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:29.996 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.996 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.996 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:919 6.15 6:abd89f08:lc::lc.23:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:29.996 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.695743+0000", 2024-09-12T00:04:29.996 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.222491167999998, 2024-09-12T00:04:29.996 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027955689999999999, 2024-09-12T00:04:29.996 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:29.996 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:29.997 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:29.997 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:29.997 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:29.997 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:29.997 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 919 2024-09-12T00:04:29.997 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.997 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:29.997 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.997 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:29.997 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695743+0000", 2024-09-12T00:04:29.997 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.997 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.997 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.997 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:29.998 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695743+0000", 2024-09-12T00:04:29.998 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:29.998 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.998 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.998 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:29.998 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695745+0000", 2024-09-12T00:04:29.998 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.412e-06 2024-09-12T00:04:29.998 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.998 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.998 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:29.998 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695752+0000", 2024-09-12T00:04:29.998 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0249999999999997e-06 2024-09-12T00:04:29.998 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.998 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.998 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:29.999 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695767+0000", 2024-09-12T00:04:29.999 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5787999999999999e-05 2024-09-12T00:04:29.999 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.999 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.999 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:29.999 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695775+0000", 2024-09-12T00:04:29.999 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3590000000000002e-06 2024-09-12T00:04:29.999 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.999 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.999 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:29.999 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695844+0000", 2024-09-12T00:04:29.999 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9522000000000003e-05 2024-09-12T00:04:29.999 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:29.999 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:29.999 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.000 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695912+0000", 2024-09-12T00:04:30.000 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7689999999999997e-05 2024-09-12T00:04:30.000 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.000 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.000 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:30.000 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.696117+0000", 2024-09-12T00:04:30.000 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020478900000000001 2024-09-12T00:04:30.000 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.000 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.000 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.000 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.696681+0000", 2024-09-12T00:04:30.000 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00056375200000000005 2024-09-12T00:04:30.001 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.001 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.001 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.001 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698408+0000", 2024-09-12T00:04:30.001 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017273659999999999 2024-09-12T00:04:30.001 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.001 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.001 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.001 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698484+0000", 2024-09-12T00:04:30.001 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6329999999999996e-05 2024-09-12T00:04:30.001 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.001 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.001 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.002 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698539+0000", 2024-09-12T00:04:30.002 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4536000000000001e-05 2024-09-12T00:04:30.002 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.002 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.002 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.002 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.002 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.002 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1107 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:30.002 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.792627+0000", 2024-09-12T00:04:30.002 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.125607201999998, 2024-09-12T00:04:30.002 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020914150000000001, 2024-09-12T00:04:30.002 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.002 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.002 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.002 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.003 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:30.003 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:30.003 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1107 2024-09-12T00:04:30.003 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.003 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.003 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.003 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.004 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.792627+0000", 2024-09-12T00:04:30.004 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.004 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.004 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.004 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.792627+0000", 2024-09-12T00:04:30.004 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.004 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.004 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.004 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.792630+0000", 2024-09-12T00:04:30.004 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5490000000000001e-06 2024-09-12T00:04:30.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.004 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.005 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.005 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.792639+0000", 2024-09-12T00:04:30.005 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2890000000000003e-06 2024-09-12T00:04:30.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.005 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.005 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.005 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.792658+0000", 2024-09-12T00:04:30.005 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9351000000000002e-05 2024-09-12T00:04:30.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.005 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.005 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.005 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.792670+0000", 2024-09-12T00:04:30.005 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1499e-05 2024-09-12T00:04:30.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.005 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.006 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.006 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.792791+0000", 2024-09-12T00:04:30.006 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012112699999999999 2024-09-12T00:04:30.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.006 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.006 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.006 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.793042+0000", 2024-09-12T00:04:30.006 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000250988 2024-09-12T00:04:30.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.006 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.006 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:30.006 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.793315+0000", 2024-09-12T00:04:30.006 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00027323799999999997 2024-09-12T00:04:30.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.007 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.007 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.007 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.794394+0000", 2024-09-12T00:04:30.007 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0010785409999999999 2024-09-12T00:04:30.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.007 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.007 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.007 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.794621+0000", 2024-09-12T00:04:30.007 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000227371 2024-09-12T00:04:30.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.007 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.007 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.007 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.794678+0000", 2024-09-12T00:04:30.007 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6486000000000001e-05 2024-09-12T00:04:30.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.008 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.008 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.008 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.794719+0000", 2024-09-12T00:04:30.008 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0976000000000002e-05 2024-09-12T00:04:30.008 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.008 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.008 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.008 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.008 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1296 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:30.008 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:35.222414+0000", 2024-09-12T00:04:30.008 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 54.695820488000003, 2024-09-12T00:04:30.008 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027841290000000002, 2024-09-12T00:04:30.008 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.008 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.009 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.009 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.009 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:30.009 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:30.009 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1296 2024-09-12T00:04:30.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.009 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.009 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.009 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.009 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222414+0000", 2024-09-12T00:04:30.009 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.009 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.009 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.010 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222414+0000", 2024-09-12T00:04:30.010 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.010 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.010 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.010 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.010 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222418+0000", 2024-09-12T00:04:30.010 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.563e-06 2024-09-12T00:04:30.010 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.010 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.010 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.010 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222434+0000", 2024-09-12T00:04:30.010 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6220000000000001e-05 2024-09-12T00:04:30.010 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.010 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.010 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.011 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222469+0000", 2024-09-12T00:04:30.011 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4892999999999999e-05 2024-09-12T00:04:30.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.011 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.011 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.011 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222492+0000", 2024-09-12T00:04:30.011 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2963999999999999e-05 2024-09-12T00:04:30.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.011 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.011 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.011 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222629+0000", 2024-09-12T00:04:30.011 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013722499999999999 2024-09-12T00:04:30.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.011 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.012 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.012 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222863+0000", 2024-09-12T00:04:30.012 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023409799999999999 2024-09-12T00:04:30.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.012 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.012 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:30.012 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.223212+0000", 2024-09-12T00:04:30.012 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00034954700000000002 2024-09-12T00:04:30.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.012 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.012 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.012 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.224374+0000", 2024-09-12T00:04:30.012 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011611620000000001 2024-09-12T00:04:30.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.013 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.013 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.013 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.225040+0000", 2024-09-12T00:04:30.013 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00066678500000000003 2024-09-12T00:04:30.013 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.013 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.013 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.013 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.225130+0000", 2024-09-12T00:04:30.013 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9813000000000002e-05 2024-09-12T00:04:30.013 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.013 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.013 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.013 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.225198+0000", 2024-09-12T00:04:30.013 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7859000000000002e-05 2024-09-12T00:04:30.013 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.014 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.014 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.014 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.014 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.014 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1298 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:30.014 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:35.226143+0000", 2024-09-12T00:04:30.014 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 54.692091245999997, 2024-09-12T00:04:30.014 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025053409999999999, 2024-09-12T00:04:30.014 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.014 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.014 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.014 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.014 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:30.014 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:30.015 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1298 2024-09-12T00:04:30.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.015 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.015 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.015 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.015 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226143+0000", 2024-09-12T00:04:30.015 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.015 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.015 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.015 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226143+0000", 2024-09-12T00:04:30.015 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.015 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.015 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.016 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226145+0000", 2024-09-12T00:04:30.016 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7859999999999999e-06 2024-09-12T00:04:30.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.016 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.016 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.016 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226156+0000", 2024-09-12T00:04:30.016 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.059e-05 2024-09-12T00:04:30.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.016 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.016 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.016 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226181+0000", 2024-09-12T00:04:30.016 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4980000000000001e-05 2024-09-12T00:04:30.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.016 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.017 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.017 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226202+0000", 2024-09-12T00:04:30.017 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0993e-05 2024-09-12T00:04:30.017 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.017 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.017 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.017 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226309+0000", 2024-09-12T00:04:30.017 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000107793 2024-09-12T00:04:30.017 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.017 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.017 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.017 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226437+0000", 2024-09-12T00:04:30.017 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012733199999999999 2024-09-12T00:04:30.017 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.018 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.018 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:30.018 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226707+0000", 2024-09-12T00:04:30.018 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00027011199999999998 2024-09-12T00:04:30.018 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.018 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.018 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.018 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.227865+0000", 2024-09-12T00:04:30.018 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001157744 2024-09-12T00:04:30.018 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.018 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.018 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.018 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.228507+0000", 2024-09-12T00:04:30.018 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00064225800000000004 2024-09-12T00:04:30.018 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.019 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.019 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.019 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.228588+0000", 2024-09-12T00:04:30.019 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0927000000000006e-05 2024-09-12T00:04:30.019 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.019 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.019 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.019 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.228649+0000", 2024-09-12T00:04:30.019 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0825999999999997e-05 2024-09-12T00:04:30.019 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.019 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.019 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.019 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.019 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.020 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:30.021 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:04:30.022 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:30.023+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:30.028 INFO:tasks.workunit.client.0.smithi019.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:04:30.029 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:04:30.029 INFO:tasks.workunit.client.0.smithi019.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:04:30.029 INFO:tasks.workunit.client.0.smithi019.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:04:30.029 INFO:tasks.workunit.client.0.smithi019.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:04:30.029 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:04:30.029 INFO:tasks.workunit.client.0.smithi019.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:04:30.029 INFO:tasks.workunit.client.0.smithi019.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:04:30.029 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:04:30.029 INFO:tasks.workunit.client.0.smithi019.stderr: git switch -c 2024-09-12T00:04:30.029 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:04:30.029 INFO:tasks.workunit.client.0.smithi019.stderr:Or undo this operation with: 2024-09-12T00:04:30.029 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:04:30.029 INFO:tasks.workunit.client.0.smithi019.stderr: git switch - 2024-09-12T00:04:30.030 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:04:30.030 INFO:tasks.workunit.client.0.smithi019.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:04:30.030 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:04:30.030 INFO:tasks.workunit.client.0.smithi019.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:04:30.036 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:04:30.081 INFO:tasks.workunit.client.0.smithi019.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:04:30.084 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:04:30.084 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:04:30.122 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:30.123+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:30.139 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T00:04:30.155 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:30.155 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:30.155 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:30.155 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:30.170 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:04:30.261 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:30.260+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:30.324 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:30.320+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:30.343 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:30.343 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:30.344 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:30.344 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:30.344 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:30.359 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:04:30.402 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:04:30.449 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:30.448+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:30.523 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:30.524 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:30.524 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:30.524 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:30.524 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.524 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4232.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-12T00:04:30.525 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:04:30.525 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 73.975716782000006, 2024-09-12T00:04:30.525 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.049385680000000001, 2024-09-12T00:04:30.525 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.525 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.526 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.526 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.526 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4232", 2024-09-12T00:04:30.526 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/3037249369", 2024-09-12T00:04:30.526 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:04:30.526 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.527 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.527 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.527 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.527 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:04:30.527 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.527 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.527 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.528 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.528 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:04:30.528 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.528 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.528 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.528 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.529 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548454+0000", 2024-09-12T00:04:30.529 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2259999999999999e-06 2024-09-12T00:04:30.529 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.529 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.529 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.529 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548466+0000", 2024-09-12T00:04:30.529 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1361e-05 2024-09-12T00:04:30.529 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.530 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.530 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.530 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548492+0000", 2024-09-12T00:04:30.530 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6225999999999999e-05 2024-09-12T00:04:30.530 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.530 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.530 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.530 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548509+0000", 2024-09-12T00:04:30.531 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7452000000000002e-05 2024-09-12T00:04:30.531 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.531 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.531 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.531 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549371+0000", 2024-09-12T00:04:30.531 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00086204300000000005 2024-09-12T00:04:30.531 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.531 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.532 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:30.532 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549396+0000", 2024-09-12T00:04:30.532 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.51e-05 2024-09-12T00:04:30.532 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.532 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.532 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.532 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593253+0000", 2024-09-12T00:04:30.532 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.043856248 2024-09-12T00:04:30.532 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.532 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.532 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.532 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593517+0000", 2024-09-12T00:04:30.532 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026439299999999997 2024-09-12T00:04:30.533 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.533 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.533 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:30.533 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594046+0000", 2024-09-12T00:04:30.533 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00052854200000000001 2024-09-12T00:04:30.533 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.533 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.533 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.533 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597642+0000", 2024-09-12T00:04:30.533 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0035959070000000002 2024-09-12T00:04:30.533 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.533 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.533 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.534 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597670+0000", 2024-09-12T00:04:30.534 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8235999999999999e-05 2024-09-12T00:04:30.534 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.534 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.534 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.534 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597754+0000", 2024-09-12T00:04:30.534 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4009000000000002e-05 2024-09-12T00:04:30.534 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.534 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.534 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.534 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597833+0000", 2024-09-12T00:04:30.534 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8937000000000007e-05 2024-09-12T00:04:30.534 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.535 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.535 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.535 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.535 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.535 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4232.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-12T00:04:30.535 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:17.547042+0000", 2024-09-12T00:04:30.535 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 72.977121628000006, 2024-09-12T00:04:30.535 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011713866, 2024-09-12T00:04:30.535 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.535 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.535 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.535 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.535 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4232", 2024-09-12T00:04:30.535 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/3037249369", 2024-09-12T00:04:30.536 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 5 2024-09-12T00:04:30.536 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.536 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.536 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.536 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.536 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547042+0000", 2024-09-12T00:04:30.536 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.536 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.536 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.536 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.536 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547042+0000", 2024-09-12T00:04:30.536 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.536 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.537 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.537 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.537 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547048+0000", 2024-09-12T00:04:30.537 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3639999999999998e-06 2024-09-12T00:04:30.537 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.537 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.537 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.537 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547078+0000", 2024-09-12T00:04:30.537 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.029e-05 2024-09-12T00:04:30.537 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.537 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.537 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.537 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547135+0000", 2024-09-12T00:04:30.537 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7299000000000001e-05 2024-09-12T00:04:30.538 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.538 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.538 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.538 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547159+0000", 2024-09-12T00:04:30.538 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3470000000000001e-05 2024-09-12T00:04:30.538 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.538 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.538 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.538 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547408+0000", 2024-09-12T00:04:30.538 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024930800000000001 2024-09-12T00:04:30.538 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.538 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.538 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:30.538 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547419+0000", 2024-09-12T00:04:30.539 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1316e-05 2024-09-12T00:04:30.539 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.539 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.539 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.539 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.555594+0000", 2024-09-12T00:04:30.539 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0081748129999999995 2024-09-12T00:04:30.539 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.539 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.539 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.539 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.555811+0000", 2024-09-12T00:04:30.539 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021711199999999999 2024-09-12T00:04:30.539 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.539 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.540 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:30.540 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.556013+0000", 2024-09-12T00:04:30.540 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020175099999999999 2024-09-12T00:04:30.540 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.540 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.540 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.540 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.557402+0000", 2024-09-12T00:04:30.540 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0013890269999999999 2024-09-12T00:04:30.540 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.540 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.540 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.540 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.558483+0000", 2024-09-12T00:04:30.540 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001081128 2024-09-12T00:04:30.540 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.541 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.541 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.541 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.558636+0000", 2024-09-12T00:04:30.541 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015267500000000001 2024-09-12T00:04:30.541 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.541 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.541 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.541 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.558756+0000", 2024-09-12T00:04:30.541 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000120313 2024-09-12T00:04:30.541 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.541 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.541 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.541 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.541 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.542 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4232.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-09-12T00:04:30.542 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:18.562030+0000", 2024-09-12T00:04:30.542 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 71.962133437999995, 2024-09-12T00:04:30.542 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0073448150000000002, 2024-09-12T00:04:30.542 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.542 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.542 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.542 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.542 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4232", 2024-09-12T00:04:30.542 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/3037249369", 2024-09-12T00:04:30.542 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 7 2024-09-12T00:04:30.542 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.543 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.543 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.543 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.543 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562030+0000", 2024-09-12T00:04:30.543 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.543 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.543 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.543 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.543 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562030+0000", 2024-09-12T00:04:30.543 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.543 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.543 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.543 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.543 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562034+0000", 2024-09-12T00:04:30.544 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6069999999999999e-06 2024-09-12T00:04:30.544 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.544 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.544 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.544 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562051+0000", 2024-09-12T00:04:30.544 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7450000000000001e-05 2024-09-12T00:04:30.544 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.544 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.544 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.544 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562091+0000", 2024-09-12T00:04:30.544 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9703000000000003e-05 2024-09-12T00:04:30.544 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.544 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.545 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.545 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562112+0000", 2024-09-12T00:04:30.545 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1189999999999999e-05 2024-09-12T00:04:30.545 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.545 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.545 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.545 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562253+0000", 2024-09-12T00:04:30.545 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000140302 2024-09-12T00:04:30.545 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.545 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.545 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:30.545 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562264+0000", 2024-09-12T00:04:30.545 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1737e-05 2024-09-12T00:04:30.546 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.546 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.546 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.546 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.566247+0000", 2024-09-12T00:04:30.546 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039824259999999998 2024-09-12T00:04:30.546 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.546 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.546 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.546 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.566384+0000", 2024-09-12T00:04:30.546 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000136916 2024-09-12T00:04:30.546 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.546 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.546 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:30.547 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.566645+0000", 2024-09-12T00:04:30.547 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000261241 2024-09-12T00:04:30.547 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.547 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.547 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.547 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.568507+0000", 2024-09-12T00:04:30.547 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001862219 2024-09-12T00:04:30.547 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.547 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.547 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.547 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.569221+0000", 2024-09-12T00:04:30.547 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00071416199999999996 2024-09-12T00:04:30.547 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.548 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.548 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.548 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.569306+0000", 2024-09-12T00:04:30.548 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5016000000000001e-05 2024-09-12T00:04:30.548 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.548 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.548 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.548 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.569375+0000", 2024-09-12T00:04:30.548 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8845999999999998e-05 2024-09-12T00:04:30.548 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.548 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.548 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.548 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.548 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.549 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T00:04:30.549 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:04:30.549 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 61.194507014000003, 2024-09-12T00:04:30.549 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025928692999999999, 2024-09-12T00:04:30.549 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.549 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.549 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "reached pg", 2024-09-12T00:04:30.549 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.549 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:30.549 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:30.549 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 43 2024-09-12T00:04:30.549 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.549 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.550 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.550 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.550 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:04:30.550 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.550 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.550 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.550 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.550 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:04:30.550 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.550 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.550 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.550 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.550 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329660+0000", 2024-09-12T00:04:30.550 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.965e-06 2024-09-12T00:04:30.551 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.551 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.551 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.551 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329673+0000", 2024-09-12T00:04:30.551 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3402e-05 2024-09-12T00:04:30.551 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.551 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.551 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.551 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329706+0000", 2024-09-12T00:04:30.551 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2441000000000003e-05 2024-09-12T00:04:30.551 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.551 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.551 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.551 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329723+0000", 2024-09-12T00:04:30.552 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7609e-05 2024-09-12T00:04:30.552 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.552 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.552 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.552 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330437+0000", 2024-09-12T00:04:30.552 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00071403500000000002 2024-09-12T00:04:30.552 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.552 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.552 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:30.552 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330454+0000", 2024-09-12T00:04:30.552 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6820000000000002e-05 2024-09-12T00:04:30.552 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.552 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.552 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.553 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347344+0000", 2024-09-12T00:04:30.553 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016890275 2024-09-12T00:04:30.553 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.553 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.553 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:30.553 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347365+0000", 2024-09-12T00:04:30.553 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0350999999999999e-05 2024-09-12T00:04:30.553 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.553 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.553 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.553 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355323+0000", 2024-09-12T00:04:30.553 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079579400000000002 2024-09-12T00:04:30.553 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.554 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.554 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.554 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355585+0000", 2024-09-12T00:04:30.554 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026285499999999999 2024-09-12T00:04:30.554 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.554 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.554 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.554 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.554 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.554 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:241 6.7 6:e31d3d5f:lc::lc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:30.554 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.484582+0000", 2024-09-12T00:04:30.554 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 56.039582129999999, 2024-09-12T00:04:30.554 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056165570000000003, 2024-09-12T00:04:30.554 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.555 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.555 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.555 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.555 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:30.555 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:30.555 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 241 2024-09-12T00:04:30.555 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.555 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.555 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.555 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.555 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484582+0000", 2024-09-12T00:04:30.555 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.555 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.555 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.556 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.556 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484582+0000", 2024-09-12T00:04:30.556 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.556 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.556 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.556 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.556 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484583+0000", 2024-09-12T00:04:30.556 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.536e-06 2024-09-12T00:04:30.556 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.556 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.556 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.556 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484590+0000", 2024-09-12T00:04:30.556 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6100000000000002e-06 2024-09-12T00:04:30.556 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.557 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.557 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.557 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484613+0000", 2024-09-12T00:04:30.557 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3309999999999999e-05 2024-09-12T00:04:30.557 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.557 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.557 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.557 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484624+0000", 2024-09-12T00:04:30.557 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0669999999999999e-05 2024-09-12T00:04:30.557 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.557 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.557 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.557 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484716+0000", 2024-09-12T00:04:30.558 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2257999999999997e-05 2024-09-12T00:04:30.558 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.558 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.558 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.558 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484900+0000", 2024-09-12T00:04:30.558 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000183807 2024-09-12T00:04:30.558 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.558 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.558 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:30.558 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.485057+0000", 2024-09-12T00:04:30.558 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015707300000000001 2024-09-12T00:04:30.558 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.558 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.558 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.559 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.485975+0000", 2024-09-12T00:04:30.559 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00091781399999999998 2024-09-12T00:04:30.559 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.559 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.559 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.559 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490054+0000", 2024-09-12T00:04:30.559 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040794569999999999 2024-09-12T00:04:30.559 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.559 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.559 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.559 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490128+0000", 2024-09-12T00:04:30.559 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3336000000000004e-05 2024-09-12T00:04:30.559 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.559 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.560 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.560 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490198+0000", 2024-09-12T00:04:30.560 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0685999999999994e-05 2024-09-12T00:04:30.560 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.560 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.560 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.560 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.560 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.560 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:276 6.7 6:e31d3d5f:lc::lc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:30.560 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.491340+0000", 2024-09-12T00:04:30.560 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 56.032824009999999, 2024-09-12T00:04:30.560 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056286460000000002, 2024-09-12T00:04:30.560 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.561 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.561 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.561 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.561 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:30.561 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:30.561 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 276 2024-09-12T00:04:30.561 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.561 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.561 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.561 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.561 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491340+0000", 2024-09-12T00:04:30.561 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.561 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.561 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.562 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.562 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491340+0000", 2024-09-12T00:04:30.562 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.562 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.562 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.562 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.562 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491342+0000", 2024-09-12T00:04:30.562 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8509999999999999e-06 2024-09-12T00:04:30.562 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.562 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.562 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.562 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491348+0000", 2024-09-12T00:04:30.562 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1929999999999998e-06 2024-09-12T00:04:30.563 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.563 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.563 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.563 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491366+0000", 2024-09-12T00:04:30.563 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7669999999999999e-05 2024-09-12T00:04:30.563 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.563 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.563 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.563 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491382+0000", 2024-09-12T00:04:30.563 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6554000000000001e-05 2024-09-12T00:04:30.563 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.563 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.563 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.563 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491452+0000", 2024-09-12T00:04:30.564 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9917000000000002e-05 2024-09-12T00:04:30.564 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.564 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.564 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.564 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491536+0000", 2024-09-12T00:04:30.564 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4229999999999998e-05 2024-09-12T00:04:30.564 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.564 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.564 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:30.564 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491704+0000", 2024-09-12T00:04:30.564 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000167994 2024-09-12T00:04:30.564 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.564 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.564 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.565 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.492347+0000", 2024-09-12T00:04:30.565 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00064263799999999995 2024-09-12T00:04:30.565 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.565 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.565 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.565 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.496901+0000", 2024-09-12T00:04:30.565 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045546329999999998 2024-09-12T00:04:30.565 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.565 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.565 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.565 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.496939+0000", 2024-09-12T00:04:30.565 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7135999999999998e-05 2024-09-12T00:04:30.565 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.565 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.566 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.566 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.496968+0000", 2024-09-12T00:04:30.566 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9830000000000001e-05 2024-09-12T00:04:30.566 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.566 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.566 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.566 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.566 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.566 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:290 6.7 6:e31d3d5f:lc::lc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:30.567 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.494565+0000", 2024-09-12T00:04:30.567 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 56.029599058999999, 2024-09-12T00:04:30.567 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052924829999999997, 2024-09-12T00:04:30.567 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.567 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.567 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.567 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.567 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:30.567 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:30.567 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 290 2024-09-12T00:04:30.567 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.567 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.567 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.567 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.568 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.494565+0000", 2024-09-12T00:04:30.568 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.568 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.568 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.568 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.568 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.494565+0000", 2024-09-12T00:04:30.568 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.568 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.568 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.568 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.568 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.494566+0000", 2024-09-12T00:04:30.568 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2720000000000001e-06 2024-09-12T00:04:30.568 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.568 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.569 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.569 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.494571+0000", 2024-09-12T00:04:30.569 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.305e-06 2024-09-12T00:04:30.569 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.569 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.569 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.569 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.494586+0000", 2024-09-12T00:04:30.569 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4666e-05 2024-09-12T00:04:30.569 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.569 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.569 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.569 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.494595+0000", 2024-09-12T00:04:30.569 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7329999999999992e-06 2024-09-12T00:04:30.569 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.570 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.570 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.570 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.494663+0000", 2024-09-12T00:04:30.570 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8518999999999999e-05 2024-09-12T00:04:30.570 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.570 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.570 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.570 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.494719+0000", 2024-09-12T00:04:30.570 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5962999999999999e-05 2024-09-12T00:04:30.570 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.571 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.571 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:30.571 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.494842+0000", 2024-09-12T00:04:30.571 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012300399999999999 2024-09-12T00:04:30.571 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.571 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.571 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.571 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.495730+0000", 2024-09-12T00:04:30.571 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00088798299999999996 2024-09-12T00:04:30.571 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.571 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.571 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.571 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.499795+0000", 2024-09-12T00:04:30.572 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040645259999999997 2024-09-12T00:04:30.572 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.572 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.572 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.572 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.499831+0000", 2024-09-12T00:04:30.572 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6257999999999997e-05 2024-09-12T00:04:30.572 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.572 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.572 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.572 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.499857+0000", 2024-09-12T00:04:30.572 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6254e-05 2024-09-12T00:04:30.572 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.572 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.573 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.573 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.573 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.573 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:297 6.8 6:162a24ce:lc::lc.8:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:30.573 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.497051+0000", 2024-09-12T00:04:30.573 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 56.027113198000002, 2024-09-12T00:04:30.573 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056532370000000002, 2024-09-12T00:04:30.573 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.573 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.573 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.573 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.573 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:30.573 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:30.574 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 297 2024-09-12T00:04:30.574 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.574 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.574 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.574 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.574 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497051+0000", 2024-09-12T00:04:30.574 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.574 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.574 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.574 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.574 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497051+0000", 2024-09-12T00:04:30.574 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.574 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.574 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.575 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.575 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497052+0000", 2024-09-12T00:04:30.575 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3659999999999999e-06 2024-09-12T00:04:30.575 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.575 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.575 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.575 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497058+0000", 2024-09-12T00:04:30.575 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0909999999999998e-06 2024-09-12T00:04:30.575 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.575 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.575 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.575 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497075+0000", 2024-09-12T00:04:30.575 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7312e-05 2024-09-12T00:04:30.575 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.576 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.576 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.576 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497084+0000", 2024-09-12T00:04:30.576 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3149999999999992e-06 2024-09-12T00:04:30.576 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.576 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.576 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.576 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497189+0000", 2024-09-12T00:04:30.576 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105257 2024-09-12T00:04:30.576 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.576 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.576 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.576 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497278+0000", 2024-09-12T00:04:30.577 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9512000000000006e-05 2024-09-12T00:04:30.577 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.577 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.577 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:30.577 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497460+0000", 2024-09-12T00:04:30.577 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018169 2024-09-12T00:04:30.577 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.577 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.577 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.577 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.498149+0000", 2024-09-12T00:04:30.577 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000688632 2024-09-12T00:04:30.577 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.577 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.578 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.578 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.502640+0000", 2024-09-12T00:04:30.578 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0044907690000000004 2024-09-12T00:04:30.578 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.578 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.578 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.578 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.502676+0000", 2024-09-12T00:04:30.578 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6452000000000003e-05 2024-09-12T00:04:30.578 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.578 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.578 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.578 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.502704+0000", 2024-09-12T00:04:30.578 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7841e-05 2024-09-12T00:04:30.578 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.579 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.579 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.579 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.579 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.579 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:322 6.7 6:e31d3d5f:lc::lc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:30.579 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.500700+0000", 2024-09-12T00:04:30.579 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 56.023463802999999, 2024-09-12T00:04:30.579 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0067834599999999998, 2024-09-12T00:04:30.579 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.579 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.579 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.579 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.579 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:30.579 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:30.580 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 322 2024-09-12T00:04:30.580 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.580 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.580 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.580 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.580 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500700+0000", 2024-09-12T00:04:30.580 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.580 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.580 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.580 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.580 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500700+0000", 2024-09-12T00:04:30.580 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.580 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.581 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.581 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.581 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500701+0000", 2024-09-12T00:04:30.581 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.19e-06 2024-09-12T00:04:30.581 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.581 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.581 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.581 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500708+0000", 2024-09-12T00:04:30.581 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1130000000000003e-06 2024-09-12T00:04:30.581 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.581 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.581 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.581 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500721+0000", 2024-09-12T00:04:30.581 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3073e-05 2024-09-12T00:04:30.582 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.582 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.582 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.582 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500730+0000", 2024-09-12T00:04:30.582 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5969999999999992e-06 2024-09-12T00:04:30.582 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.582 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.582 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.582 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500798+0000", 2024-09-12T00:04:30.582 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7659999999999999e-05 2024-09-12T00:04:30.582 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.582 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.582 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.582 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500860+0000", 2024-09-12T00:04:30.583 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2089999999999997e-05 2024-09-12T00:04:30.583 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.583 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.583 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:30.583 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.501007+0000", 2024-09-12T00:04:30.583 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000147618 2024-09-12T00:04:30.583 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.583 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.583 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.583 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.501726+0000", 2024-09-12T00:04:30.583 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00071825600000000002 2024-09-12T00:04:30.583 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.583 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.584 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.584 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.507420+0000", 2024-09-12T00:04:30.584 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056941240000000001 2024-09-12T00:04:30.584 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.584 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.584 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.584 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.507453+0000", 2024-09-12T00:04:30.584 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3547999999999998e-05 2024-09-12T00:04:30.584 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.584 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.584 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.584 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.507483+0000", 2024-09-12T00:04:30.584 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0190999999999999e-05 2024-09-12T00:04:30.584 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.585 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.585 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.585 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.585 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.585 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:346 6.8 6:10010070:lc::lc.29:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:30.585 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.507975+0000", 2024-09-12T00:04:30.585 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 56.016188747000001, 2024-09-12T00:04:30.585 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049882800000000003, 2024-09-12T00:04:30.585 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.585 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.585 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.585 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.585 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:30.586 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:30.586 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 346 2024-09-12T00:04:30.586 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.586 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.586 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.586 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.586 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.507975+0000", 2024-09-12T00:04:30.586 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.586 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.586 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.586 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.586 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.507975+0000", 2024-09-12T00:04:30.586 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.586 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.587 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.587 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.587 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.507976+0000", 2024-09-12T00:04:30.587 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.238e-06 2024-09-12T00:04:30.587 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.587 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.587 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.587 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.507981+0000", 2024-09-12T00:04:30.587 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1499999999999998e-06 2024-09-12T00:04:30.587 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.587 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.587 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.587 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.507995+0000", 2024-09-12T00:04:30.587 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.396e-05 2024-09-12T00:04:30.588 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.588 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.588 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.588 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.508004+0000", 2024-09-12T00:04:30.588 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.952e-06 2024-09-12T00:04:30.588 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.588 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.588 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.588 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.508068+0000", 2024-09-12T00:04:30.588 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3751000000000007e-05 2024-09-12T00:04:30.588 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.588 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.588 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.589 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.508154+0000", 2024-09-12T00:04:30.589 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6336999999999997e-05 2024-09-12T00:04:30.589 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.589 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.589 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:30.589 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.508289+0000", 2024-09-12T00:04:30.589 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013407299999999999 2024-09-12T00:04:30.589 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.589 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.589 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.589 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.508923+0000", 2024-09-12T00:04:30.589 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00063415300000000004 2024-09-12T00:04:30.589 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.589 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.590 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.590 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.512848+0000", 2024-09-12T00:04:30.590 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039254040000000004 2024-09-12T00:04:30.590 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.590 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.590 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.590 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.512918+0000", 2024-09-12T00:04:30.590 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0406000000000003e-05 2024-09-12T00:04:30.590 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.590 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.590 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.590 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.512963+0000", 2024-09-12T00:04:30.590 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4855999999999999e-05 2024-09-12T00:04:30.590 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.591 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.591 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.591 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.591 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.591 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:362 6.8 6:10010070:lc::lc.29:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:30.591 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.514037+0000", 2024-09-12T00:04:30.591 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 56.010127300999997, 2024-09-12T00:04:30.591 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050974030000000004, 2024-09-12T00:04:30.591 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.591 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.591 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.591 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.591 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:30.592 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:30.592 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 362 2024-09-12T00:04:30.592 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.592 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.592 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.592 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.592 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.514037+0000", 2024-09-12T00:04:30.592 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.592 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.592 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.592 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.592 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.514037+0000", 2024-09-12T00:04:30.592 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.592 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.593 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.593 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.593 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.514038+0000", 2024-09-12T00:04:30.593 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4020000000000001e-06 2024-09-12T00:04:30.593 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.593 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.593 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.593 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.514045+0000", 2024-09-12T00:04:30.593 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7850000000000003e-06 2024-09-12T00:04:30.593 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.593 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.593 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.593 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.514065+0000", 2024-09-12T00:04:30.594 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0068000000000002e-05 2024-09-12T00:04:30.594 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.594 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.594 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.594 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.514074+0000", 2024-09-12T00:04:30.594 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1349999999999998e-06 2024-09-12T00:04:30.594 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.594 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.594 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.594 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.514144+0000", 2024-09-12T00:04:30.594 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0395000000000006e-05 2024-09-12T00:04:30.594 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.594 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.594 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.595 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.514209+0000", 2024-09-12T00:04:30.595 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4832999999999994e-05 2024-09-12T00:04:30.595 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.595 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.595 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:30.595 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.514348+0000", 2024-09-12T00:04:30.595 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013913200000000001 2024-09-12T00:04:30.595 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.595 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.595 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.595 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.514955+0000", 2024-09-12T00:04:30.595 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00060652799999999995 2024-09-12T00:04:30.595 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.595 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.596 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.596 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.519053+0000", 2024-09-12T00:04:30.596 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040983260000000002 2024-09-12T00:04:30.596 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.596 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.596 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.596 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.519089+0000", 2024-09-12T00:04:30.596 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6055e-05 2024-09-12T00:04:30.596 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.596 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.596 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.596 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.519134+0000", 2024-09-12T00:04:30.596 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4743999999999997e-05 2024-09-12T00:04:30.597 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.597 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.597 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.597 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.597 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:408 6.7 6:e31d3d5f:lc::lc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:30.597 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.525223+0000", 2024-09-12T00:04:30.597 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.998941014000003, 2024-09-12T00:04:30.597 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064357069999999997, 2024-09-12T00:04:30.597 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.597 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.597 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.597 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.597 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:30.598 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:30.598 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 408 2024-09-12T00:04:30.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.598 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.598 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.598 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.598 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525223+0000", 2024-09-12T00:04:30.598 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.598 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.598 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.598 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525223+0000", 2024-09-12T00:04:30.598 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.599 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.599 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.599 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525224+0000", 2024-09-12T00:04:30.599 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.325e-06 2024-09-12T00:04:30.599 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.599 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.599 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.599 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525230+0000", 2024-09-12T00:04:30.599 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.677e-06 2024-09-12T00:04:30.599 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.599 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.599 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.599 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525243+0000", 2024-09-12T00:04:30.599 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3592e-05 2024-09-12T00:04:30.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.600 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.600 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525255+0000", 2024-09-12T00:04:30.600 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1257000000000001e-05 2024-09-12T00:04:30.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.600 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.600 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525339+0000", 2024-09-12T00:04:30.600 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4565000000000001e-05 2024-09-12T00:04:30.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.600 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.601 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525433+0000", 2024-09-12T00:04:30.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.4248999999999998e-05 2024-09-12T00:04:30.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.601 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:30.601 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525649+0000", 2024-09-12T00:04:30.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021594999999999999 2024-09-12T00:04:30.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.601 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.601 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526275+0000", 2024-09-12T00:04:30.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00062531200000000005 2024-09-12T00:04:30.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.602 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.602 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531540+0000", 2024-09-12T00:04:30.602 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052655009999999997 2024-09-12T00:04:30.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.602 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.602 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.602 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531606+0000", 2024-09-12T00:04:30.602 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5733000000000002e-05 2024-09-12T00:04:30.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.602 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.602 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.602 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531659+0000", 2024-09-12T00:04:30.602 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2546000000000001e-05 2024-09-12T00:04:30.602 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.603 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.603 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.603 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.603 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:492 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:30.603 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.552214+0000", 2024-09-12T00:04:30.603 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.971949457999997, 2024-09-12T00:04:30.603 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.006213199, 2024-09-12T00:04:30.603 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.603 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.603 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.603 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.603 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:30.604 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:30.604 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 492 2024-09-12T00:04:30.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.604 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.604 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.604 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.604 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552214+0000", 2024-09-12T00:04:30.604 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.604 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.604 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.604 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552214+0000", 2024-09-12T00:04:30.604 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.605 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.605 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.605 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552215+0000", 2024-09-12T00:04:30.605 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1170000000000001e-06 2024-09-12T00:04:30.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.605 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.605 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.605 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552220+0000", 2024-09-12T00:04:30.605 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8149999999999996e-06 2024-09-12T00:04:30.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.605 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.605 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.605 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552233+0000", 2024-09-12T00:04:30.605 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2784e-05 2024-09-12T00:04:30.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.606 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.606 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.606 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552240+0000", 2024-09-12T00:04:30.606 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8379999999999996e-06 2024-09-12T00:04:30.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.606 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.606 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.606 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552297+0000", 2024-09-12T00:04:30.606 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7123000000000002e-05 2024-09-12T00:04:30.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.608 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.608 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552382+0000", 2024-09-12T00:04:30.608 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5334000000000007e-05 2024-09-12T00:04:30.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.608 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:30.608 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552504+0000", 2024-09-12T00:04:30.608 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000121309 2024-09-12T00:04:30.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.609 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.609 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558157+0000", 2024-09-12T00:04:30.609 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056535439999999999 2024-09-12T00:04:30.609 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.609 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.609 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.609 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558356+0000", 2024-09-12T00:04:30.609 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000198436 2024-09-12T00:04:30.609 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.609 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.609 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.609 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558401+0000", 2024-09-12T00:04:30.610 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5048e-05 2024-09-12T00:04:30.610 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.610 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.610 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.610 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558428+0000", 2024-09-12T00:04:30.610 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6851000000000001e-05 2024-09-12T00:04:30.610 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.610 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.610 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.610 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.610 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.610 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:643 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:30.610 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.593859+0000", 2024-09-12T00:04:30.611 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.930304468000003, 2024-09-12T00:04:30.611 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054148069999999998, 2024-09-12T00:04:30.611 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.611 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.611 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.611 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.611 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:30.611 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:30.611 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 643 2024-09-12T00:04:30.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.611 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.611 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.611 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.611 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593859+0000", 2024-09-12T00:04:30.612 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.612 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.612 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.612 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593859+0000", 2024-09-12T00:04:30.612 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.612 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.612 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.612 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593860+0000", 2024-09-12T00:04:30.612 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0500000000000002e-07 2024-09-12T00:04:30.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.612 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.613 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.613 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593864+0000", 2024-09-12T00:04:30.613 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3100000000000002e-06 2024-09-12T00:04:30.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.613 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.613 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.613 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593875+0000", 2024-09-12T00:04:30.613 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0706999999999999e-05 2024-09-12T00:04:30.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.613 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.613 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.613 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593882+0000", 2024-09-12T00:04:30.613 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2919999999999998e-06 2024-09-12T00:04:30.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.614 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593939+0000", 2024-09-12T00:04:30.614 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6138999999999999e-05 2024-09-12T00:04:30.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.614 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594023+0000", 2024-09-12T00:04:30.614 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4128000000000005e-05 2024-09-12T00:04:30.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.614 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:30.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594194+0000", 2024-09-12T00:04:30.614 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017098800000000001 2024-09-12T00:04:30.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.615 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.598923+0000", 2024-09-12T00:04:30.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047291369999999996 2024-09-12T00:04:30.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.615 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599219+0000", 2024-09-12T00:04:30.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00029588500000000002 2024-09-12T00:04:30.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.615 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599250+0000", 2024-09-12T00:04:30.616 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0771000000000001e-05 2024-09-12T00:04:30.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.616 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.616 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599274+0000", 2024-09-12T00:04:30.616 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4644999999999999e-05 2024-09-12T00:04:30.616 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.616 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.616 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.616 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:657 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:30.616 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600087+0000", 2024-09-12T00:04:30.616 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.924077269999998, 2024-09-12T00:04:30.617 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0072536739999999999, 2024-09-12T00:04:30.617 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.617 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.617 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.617 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.617 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:30.617 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:30.617 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 657 2024-09-12T00:04:30.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.617 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.617 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.617 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600087+0000", 2024-09-12T00:04:30.618 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.618 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.618 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600087+0000", 2024-09-12T00:04:30.618 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.618 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.618 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600088+0000", 2024-09-12T00:04:30.618 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4759999999999999e-06 2024-09-12T00:04:30.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.618 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600093+0000", 2024-09-12T00:04:30.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4330000000000003e-06 2024-09-12T00:04:30.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600107+0000", 2024-09-12T00:04:30.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.348e-05 2024-09-12T00:04:30.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600116+0000", 2024-09-12T00:04:30.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7339999999999997e-06 2024-09-12T00:04:30.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600178+0000", 2024-09-12T00:04:30.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2382e-05 2024-09-12T00:04:30.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600233+0000", 2024-09-12T00:04:30.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4960999999999998e-05 2024-09-12T00:04:30.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.621 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:30.621 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600373+0000", 2024-09-12T00:04:30.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013955599999999999 2024-09-12T00:04:30.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.621 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.621 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.604463+0000", 2024-09-12T00:04:30.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040905539999999997 2024-09-12T00:04:30.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.621 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.621 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607243+0000", 2024-09-12T00:04:30.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027799140000000001 2024-09-12T00:04:30.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.622 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.622 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.622 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607306+0000", 2024-09-12T00:04:30.622 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2575000000000003e-05 2024-09-12T00:04:30.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.622 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.622 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.622 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607340+0000", 2024-09-12T00:04:30.622 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4609e-05 2024-09-12T00:04:30.622 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.622 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.622 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.623 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.623 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:665 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:30.623 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602284+0000", 2024-09-12T00:04:30.623 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.921880096999999, 2024-09-12T00:04:30.623 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055001709999999999, 2024-09-12T00:04:30.623 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.623 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.623 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.623 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.623 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:30.623 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:30.623 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 665 2024-09-12T00:04:30.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.624 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.624 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.624 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602284+0000", 2024-09-12T00:04:30.624 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.624 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.624 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602284+0000", 2024-09-12T00:04:30.624 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.624 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.624 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602285+0000", 2024-09-12T00:04:30.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6700000000000002e-07 2024-09-12T00:04:30.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.625 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602289+0000", 2024-09-12T00:04:30.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5519999999999998e-06 2024-09-12T00:04:30.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.625 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602304+0000", 2024-09-12T00:04:30.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5299e-05 2024-09-12T00:04:30.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602313+0000", 2024-09-12T00:04:30.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6379999999999993e-06 2024-09-12T00:04:30.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602370+0000", 2024-09-12T00:04:30.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6839000000000002e-05 2024-09-12T00:04:30.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602460+0000", 2024-09-12T00:04:30.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0323999999999998e-05 2024-09-12T00:04:30.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:30.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602650+0000", 2024-09-12T00:04:30.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018955900000000001 2024-09-12T00:04:30.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607365+0000", 2024-09-12T00:04:30.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004715632 2024-09-12T00:04:30.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607698+0000", 2024-09-12T00:04:30.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00033217400000000002 2024-09-12T00:04:30.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.628 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.628 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.628 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607738+0000", 2024-09-12T00:04:30.628 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0516000000000003e-05 2024-09-12T00:04:30.628 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.628 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.628 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.628 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607784+0000", 2024-09-12T00:04:30.628 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5770999999999999e-05 2024-09-12T00:04:30.628 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.628 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.628 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.628 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.628 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.629 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:669 6.1c 6:3b93e7b4:::obj_delete_at_hint.0000000016:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:30.629 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.607439+0000", 2024-09-12T00:04:30.629 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.916725106999998, 2024-09-12T00:04:30.629 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057881649999999996, 2024-09-12T00:04:30.629 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.629 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.629 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.629 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.629 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:30.629 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:30.629 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 669 2024-09-12T00:04:30.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.629 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.630 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.630 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.630 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607439+0000", 2024-09-12T00:04:30.630 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.630 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.630 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.630 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607439+0000", 2024-09-12T00:04:30.630 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.630 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.630 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.630 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607439+0000", 2024-09-12T00:04:30.630 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9599999999999998e-07 2024-09-12T00:04:30.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607443+0000", 2024-09-12T00:04:30.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0340000000000001e-06 2024-09-12T00:04:30.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607453+0000", 2024-09-12T00:04:30.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682999999999999e-05 2024-09-12T00:04:30.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607461+0000", 2024-09-12T00:04:30.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6860000000000006e-06 2024-09-12T00:04:30.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607927+0000", 2024-09-12T00:04:30.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00046655600000000002 2024-09-12T00:04:30.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608017+0000", 2024-09-12T00:04:30.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9788000000000002e-05 2024-09-12T00:04:30.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:30.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608262+0000", 2024-09-12T00:04:30.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024518499999999998 2024-09-12T00:04:30.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612908+0000", 2024-09-12T00:04:30.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046458009999999998 2024-09-12T00:04:30.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.613137+0000", 2024-09-12T00:04:30.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022881999999999999 2024-09-12T00:04:30.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.634 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.613178+0000", 2024-09-12T00:04:30.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0496e-05 2024-09-12T00:04:30.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.634 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.613227+0000", 2024-09-12T00:04:30.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9320000000000002e-05 2024-09-12T00:04:30.634 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.634 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.634 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.635 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:670 6.8 6:10010070:lc::lc.29:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:30.635 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.607563+0000", 2024-09-12T00:04:30.635 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.916600856000002, 2024-09-12T00:04:30.635 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054159179999999996, 2024-09-12T00:04:30.635 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.635 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.635 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.635 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.635 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:30.635 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:30.635 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 670 2024-09-12T00:04:30.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.635 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.636 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.636 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607563+0000", 2024-09-12T00:04:30.636 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.636 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.636 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.636 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.636 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607563+0000", 2024-09-12T00:04:30.636 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.636 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.636 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.636 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.636 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607564+0000", 2024-09-12T00:04:30.636 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.181e-06 2024-09-12T00:04:30.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.637 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.637 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.637 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607570+0000", 2024-09-12T00:04:30.637 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0809999999999999e-06 2024-09-12T00:04:30.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.637 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.637 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.637 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607582+0000", 2024-09-12T00:04:30.637 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1924e-05 2024-09-12T00:04:30.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.637 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.637 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.637 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607590+0000", 2024-09-12T00:04:30.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1370000000000002e-06 2024-09-12T00:04:30.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.638 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.638 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607669+0000", 2024-09-12T00:04:30.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8792e-05 2024-09-12T00:04:30.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.638 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.638 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607751+0000", 2024-09-12T00:04:30.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1641e-05 2024-09-12T00:04:30.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.638 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:30.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607915+0000", 2024-09-12T00:04:30.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000163979 2024-09-12T00:04:30.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.609266+0000", 2024-09-12T00:04:30.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0013514810000000001 2024-09-12T00:04:30.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612885+0000", 2024-09-12T00:04:30.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003618834 2024-09-12T00:04:30.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612941+0000", 2024-09-12T00:04:30.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5815e-05 2024-09-12T00:04:30.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612979+0000", 2024-09-12T00:04:30.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8053000000000003e-05 2024-09-12T00:04:30.640 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.640 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.640 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.641 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:920 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:30.641 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.696100+0000", 2024-09-12T00:04:30.641 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.828064177999998, 2024-09-12T00:04:30.641 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0051855019999999998, 2024-09-12T00:04:30.641 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.641 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.641 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.641 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.641 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:30.641 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:30.641 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 920 2024-09-12T00:04:30.641 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.641 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.641 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.642 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.642 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.696100+0000", 2024-09-12T00:04:30.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.642 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.642 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.642 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.642 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.696100+0000", 2024-09-12T00:04:30.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.642 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.642 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.642 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.642 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.696101+0000", 2024-09-12T00:04:30.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2410000000000001e-06 2024-09-12T00:04:30.642 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.643 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.643 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.643 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.696106+0000", 2024-09-12T00:04:30.643 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9899999999999997e-06 2024-09-12T00:04:30.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.643 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.643 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.643 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.696134+0000", 2024-09-12T00:04:30.643 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8008e-05 2024-09-12T00:04:30.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.643 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.643 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.643 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.696142+0000", 2024-09-12T00:04:30.643 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0870000000000007e-06 2024-09-12T00:04:30.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.644 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.644 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.696207+0000", 2024-09-12T00:04:30.644 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5147000000000005e-05 2024-09-12T00:04:30.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.644 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.644 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.696309+0000", 2024-09-12T00:04:30.644 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102311 2024-09-12T00:04:30.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.644 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:30.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.696478+0000", 2024-09-12T00:04:30.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000168431 2024-09-12T00:04:30.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.645 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698072+0000", 2024-09-12T00:04:30.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001593836 2024-09-12T00:04:30.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.645 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.701213+0000", 2024-09-12T00:04:30.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0031411880000000001 2024-09-12T00:04:30.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.646 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.646 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.701254+0000", 2024-09-12T00:04:30.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1504000000000001e-05 2024-09-12T00:04:30.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.646 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.646 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.701285+0000", 2024-09-12T00:04:30.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0759000000000001e-05 2024-09-12T00:04:30.646 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.646 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.646 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.646 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:925 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:30.647 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.697503+0000", 2024-09-12T00:04:30.647 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 55.826660394000001, 2024-09-12T00:04:30.647 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.006503755, 2024-09-12T00:04:30.647 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:30.647 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:30.647 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:30.647 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:30.647 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:30.647 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:30.647 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 925 2024-09-12T00:04:30.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.647 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:30.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:30.648 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697503+0000", 2024-09-12T00:04:30.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.648 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.648 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:30.648 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697503+0000", 2024-09-12T00:04:30.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:30.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.648 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.648 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:30.648 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697505+0000", 2024-09-12T00:04:30.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5030000000000001e-06 2024-09-12T00:04:30.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.649 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.649 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:30.649 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697512+0000", 2024-09-12T00:04:30.649 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7630000000000003e-06 2024-09-12T00:04:30.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.649 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.649 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:30.649 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697529+0000", 2024-09-12T00:04:30.649 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7345000000000001e-05 2024-09-12T00:04:30.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.649 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.649 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:30.649 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697539+0000", 2024-09-12T00:04:30.649 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0412e-05 2024-09-12T00:04:30.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.650 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:30.650 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697606+0000", 2024-09-12T00:04:30.650 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6531000000000004e-05 2024-09-12T00:04:30.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.650 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:30.650 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697673+0000", 2024-09-12T00:04:30.650 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6661000000000004e-05 2024-09-12T00:04:30.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.650 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:30.650 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697839+0000", 2024-09-12T00:04:30.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016669699999999999 2024-09-12T00:04:30.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.651 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:30.651 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.700786+0000", 2024-09-12T00:04:30.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029466819999999999 2024-09-12T00:04:30.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.651 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:30.651 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703889+0000", 2024-09-12T00:04:30.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0031034830000000002 2024-09-12T00:04:30.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.651 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:30.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703961+0000", 2024-09-12T00:04:30.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1178000000000002e-05 2024-09-12T00:04:30.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:30.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:30.652 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:30.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704007+0000", 2024-09-12T00:04:30.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6499999999999999e-05 2024-09-12T00:04:30.652 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.652 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.652 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.652 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:30.652 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:30.652 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:30.654 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:04:30.654 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:30.655 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:30.655 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:30.655 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:30.656 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:30.656 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:30.656 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:30.656 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:30.657 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:30.657 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:30.657 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:30.657 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:30.658 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:30.652+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:30.658 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:30.658 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:30.676 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:30.677 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:30.755 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:30.755+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:30.790 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:30.790 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:30.804 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:04:30.820 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:04:30.855 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:30.852+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:30.901 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:04:30.956 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:30.955+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:30.963 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:04:30.964 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:04:30.965 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:04:30.969 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:30.970 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:30.984 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:04:31.011 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:04:31.017 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:04:31.017 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:04:31.066 INFO:tasks.workunit:Running workunits matching rgw/s3_bucket_quota.pl on client.0... 2024-09-12T00:04:31.067 INFO:tasks.workunit:Running workunit rgw/s3_bucket_quota.pl... 2024-09-12T00:04:31.067 DEBUG:teuthology.orchestra.run.smithi019:workunit test rgw/s3_bucket_quota.pl> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_bucket_quota.pl 2024-09-12T00:04:31.074 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:31.075+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:31.150 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:31.150 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:31.157 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:31.159+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:31.166 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:04:31.258 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:31.259+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:31.335 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:31.336 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:31.351 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:04:31.394 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:31.395+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:31.444 INFO:tasks.workunit.client.0.smithi019.stderr:1+0 records in 2024-09-12T00:04:31.444 INFO:tasks.workunit.client.0.smithi019.stderr:1+0 records out 2024-09-12T00:04:31.444 INFO:tasks.workunit.client.0.smithi019.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0120134 s, 873 MB/s 2024-09-12T00:04:31.461 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:31.456+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:31.465 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T00:04:31.524 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:31.524 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:31.540 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:04:31.561 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:31.560+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:31.658 INFO:tasks.workunit.client.0.smithi019.stdout:Bucket Created: buck_2024_08_12_00_04_31 2024-09-12T00:04:31.662 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:31.663+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:31.665 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:31.665 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:31.679 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:04:31.763 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:31.760+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:31.821 INFO:tasks.workunit.client.0.smithi019.stdout:quota set for the bucket: buck_2024_08_12_00_04_31 2024-09-12T00:04:31.848 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:31.848 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:31.863 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:04:31.865 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:31.860+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:31.966 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:31.967+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:31.992 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:31.992 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:32.007 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:04:32.065 INFO:tasks.workunit.client.0.smithi019.stdout:quota enabled for the bucket: buck_2024_08_12_00_04_31 2024-09-12T00:04:32.065 INFO:tasks.workunit.client.0.smithi019.stdout:adding file to bucket: 10Mb. 2024-09-12T00:04:32.065 INFO:tasks.workunit.client.0.smithi019.stdout:upload file successful 2024-09-12T00:04:32.065 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:04:32.065 INFO:tasks.workunit.client.0.smithi019.stdout:Test case: PASSED - Test max objects passed 2024-09-12T00:04:32.065 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:04:32.066 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:32.064+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:32.168 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:32.164+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:32.183 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:32.184 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:32.199 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:04:32.268 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:32.264+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:32.313 INFO:tasks.workunit.client.0.smithi019.stdout:user qa_user deleted 2024-09-12T00:04:32.314 INFO:tasks.workunit.client.0.smithi019.stdout:bucket delete succeeded 2024-09-12T00:04:32.326 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:32.326 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:32.340 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:04:32.341 INFO:tasks.workunit.client.0.smithi019.stderr:1+0 records in 2024-09-12T00:04:32.341 INFO:tasks.workunit.client.0.smithi019.stderr:1+0 records out 2024-09-12T00:04:32.341 INFO:tasks.workunit.client.0.smithi019.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0232254 s, 451 MB/s 2024-09-12T00:04:32.389 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:32.391+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:32.463 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:32.464 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:32.470 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:32.471+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:32.480 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:04:32.485 INFO:tasks.workunit.client.0.smithi019.stdout:Bucket Created: buck_2024_08_12_00_04_32 2024-09-12T00:04:32.571 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:32.568+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:32.647 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:32.647 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:32.662 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:04:32.694 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:04:32.705 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:32.704+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:32.773 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:32.774+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:32.800 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:32.800 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:32.815 INFO:tasks.workunit.client.0.smithi019.stdout:bucket quota max_objs set for the given user: buck_2024_08_12_00_04_32 2024-09-12T00:04:32.818 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:04:32.869 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:32.869 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:32.875 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:32.874+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:32.889 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:32.889 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:32.910 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:32.910 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:32.928 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:32.929 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:32.939 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:32.939 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:32.939 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:32.940 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:32.940 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:32.952 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:32.952 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:32.953 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:04:32.975 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:32.975 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:32.976 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:32.974+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:32.999 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:32.999 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:33.018 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:33.019 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:33.086 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:33.086 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:33.086 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:33.086 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:33.087 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.087 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:33.087 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:33.087 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 61.757117698000002, 2024-09-12T00:04:33.087 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.027441031000000001, 2024-09-12T00:04:33.087 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.087 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.087 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.087 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.087 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:33.087 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:33.087 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:04:33.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.088 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.088 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.088 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.088 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:33.088 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.088 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.088 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.088 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:33.088 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.089 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.089 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.089 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330357+0000", 2024-09-12T00:04:33.089 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2339999999999996e-06 2024-09-12T00:04:33.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.089 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.089 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.089 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330381+0000", 2024-09-12T00:04:33.089 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4626000000000001e-05 2024-09-12T00:04:33.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.090 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330417+0000", 2024-09-12T00:04:33.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5886000000000002e-05 2024-09-12T00:04:33.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.090 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330442+0000", 2024-09-12T00:04:33.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4522999999999999e-05 2024-09-12T00:04:33.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.090 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335485+0000", 2024-09-12T00:04:33.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050432589999999996 2024-09-12T00:04:33.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.091 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:33.091 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335507+0000", 2024-09-12T00:04:33.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2013000000000001e-05 2024-09-12T00:04:33.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.091 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.091 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.351747+0000", 2024-09-12T00:04:33.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016240451999999999 2024-09-12T00:04:33.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.092 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.092 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352062+0000", 2024-09-12T00:04:33.092 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031433399999999999 2024-09-12T00:04:33.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.092 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.092 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:33.092 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352378+0000", 2024-09-12T00:04:33.092 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031586400000000001 2024-09-12T00:04:33.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.092 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.092 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.093 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.355074+0000", 2024-09-12T00:04:33.093 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026962919999999999 2024-09-12T00:04:33.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.093 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.093 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.093 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357537+0000", 2024-09-12T00:04:33.093 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024634689999999998 2024-09-12T00:04:33.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.093 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.093 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.093 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357680+0000", 2024-09-12T00:04:33.093 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014314899999999999 2024-09-12T00:04:33.094 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.094 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.094 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.094 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357793+0000", 2024-09-12T00:04:33.094 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011293 2024-09-12T00:04:33.094 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.094 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.094 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.095 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.095 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.095 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94232250902656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:33.095 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:33.095 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 61.729202538000003, 2024-09-12T00:04:33.095 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052696050000000001, 2024-09-12T00:04:33.095 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.095 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.096 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.096 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.096 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:33.096 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:33.096 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:04:33.097 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.097 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.097 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.097 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.097 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:33.097 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.097 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.098 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.098 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.098 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:33.098 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.098 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.098 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.098 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358270+0000", 2024-09-12T00:04:33.099 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.17e-06 2024-09-12T00:04:33.099 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.099 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.099 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.099 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358278+0000", 2024-09-12T00:04:33.099 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3529999999999995e-06 2024-09-12T00:04:33.099 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.099 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.099 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.100 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358306+0000", 2024-09-12T00:04:33.100 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7763000000000002e-05 2024-09-12T00:04:33.100 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.100 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.100 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.100 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358324+0000", 2024-09-12T00:04:33.100 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7861000000000001e-05 2024-09-12T00:04:33.101 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.101 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.101 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.101 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358447+0000", 2024-09-12T00:04:33.101 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012334299999999999 2024-09-12T00:04:33.101 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.101 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.101 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.102 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358624+0000", 2024-09-12T00:04:33.102 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017684999999999999 2024-09-12T00:04:33.102 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.102 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.102 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:33.102 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358964+0000", 2024-09-12T00:04:33.102 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00033991199999999999 2024-09-12T00:04:33.103 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.103 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.103 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.103 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.362920+0000", 2024-09-12T00:04:33.103 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039564600000000002 2024-09-12T00:04:33.103 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.103 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.103 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.103 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363016+0000", 2024-09-12T00:04:33.104 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5612999999999994e-05 2024-09-12T00:04:33.104 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.104 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.104 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.104 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363244+0000", 2024-09-12T00:04:33.104 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000228385 2024-09-12T00:04:33.104 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.104 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.104 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.104 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363537+0000", 2024-09-12T00:04:33.104 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00029289499999999999 2024-09-12T00:04:33.104 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.104 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.105 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.105 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.105 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.105 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:33.105 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:33.105 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.721825021000001, 2024-09-12T00:04:33.105 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011415537, 2024-09-12T00:04:33.105 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.105 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.106 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.106 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.106 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:33.106 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:33.106 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 209 2024-09-12T00:04:33.106 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.106 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.106 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.106 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.106 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:33.106 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.106 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.106 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.107 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.107 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:33.107 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.107 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.107 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.107 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.107 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365648+0000", 2024-09-12T00:04:33.107 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7360000000000001e-06 2024-09-12T00:04:33.107 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.107 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.107 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.107 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365660+0000", 2024-09-12T00:04:33.107 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2089999999999999e-05 2024-09-12T00:04:33.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.108 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.108 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.108 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365690+0000", 2024-09-12T00:04:33.108 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0320000000000001e-05 2024-09-12T00:04:33.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.108 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.108 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.108 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365708+0000", 2024-09-12T00:04:33.108 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7520000000000002e-05 2024-09-12T00:04:33.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.108 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.109 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.109 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365870+0000", 2024-09-12T00:04:33.109 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016208600000000001 2024-09-12T00:04:33.109 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.109 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.109 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:33.109 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365885+0000", 2024-09-12T00:04:33.109 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5119999999999999e-05 2024-09-12T00:04:33.109 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.109 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.109 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.109 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373482+0000", 2024-09-12T00:04:33.109 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075970279999999996 2024-09-12T00:04:33.110 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.110 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.110 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.110 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373805+0000", 2024-09-12T00:04:33.110 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032262799999999999 2024-09-12T00:04:33.110 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.110 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.110 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.110 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.374297+0000", 2024-09-12T00:04:33.110 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00049250599999999998 2024-09-12T00:04:33.110 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.111 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.111 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.111 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.375670+0000", 2024-09-12T00:04:33.111 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001373333 2024-09-12T00:04:33.111 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.111 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.111 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.111 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.376923+0000", 2024-09-12T00:04:33.111 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012525640000000001 2024-09-12T00:04:33.111 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.111 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.111 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.111 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377000+0000", 2024-09-12T00:04:33.112 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6732999999999999e-05 2024-09-12T00:04:33.112 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.112 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.112 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.112 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377061+0000", 2024-09-12T00:04:33.112 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0872999999999998e-05 2024-09-12T00:04:33.112 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.112 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.112 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.112 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.112 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.112 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:240 6.19 6:9f626c48:lc::lc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:33.112 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:33.113 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.603239268000003, 2024-09-12T00:04:33.113 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058545680000000001, 2024-09-12T00:04:33.113 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.113 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.113 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.113 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.113 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:33.113 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:33.113 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 240 2024-09-12T00:04:33.113 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.113 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.113 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.114 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.114 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:33.114 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.114 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.114 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.114 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.114 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:33.114 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.114 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.114 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.114 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.114 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484233+0000", 2024-09-12T00:04:33.114 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.973e-06 2024-09-12T00:04:33.114 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.115 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.115 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.115 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484241+0000", 2024-09-12T00:04:33.115 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8210000000000002e-06 2024-09-12T00:04:33.115 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.115 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.115 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.115 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484260+0000", 2024-09-12T00:04:33.115 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9148999999999999e-05 2024-09-12T00:04:33.115 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.115 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.115 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.115 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484268+0000", 2024-09-12T00:04:33.116 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5120000000000008e-06 2024-09-12T00:04:33.116 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.116 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.116 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.116 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484371+0000", 2024-09-12T00:04:33.116 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102501 2024-09-12T00:04:33.116 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.116 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.116 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.116 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484450+0000", 2024-09-12T00:04:33.116 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9122999999999994e-05 2024-09-12T00:04:33.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.117 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.117 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.117 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484578+0000", 2024-09-12T00:04:33.117 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000128095 2024-09-12T00:04:33.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.117 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.117 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.117 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.485336+0000", 2024-09-12T00:04:33.117 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00075754000000000001 2024-09-12T00:04:33.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.118 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.118 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.118 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.489975+0000", 2024-09-12T00:04:33.118 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004639738 2024-09-12T00:04:33.118 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.118 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.118 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.118 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490043+0000", 2024-09-12T00:04:33.118 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7923999999999995e-05 2024-09-12T00:04:33.118 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.118 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.118 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.119 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490085+0000", 2024-09-12T00:04:33.119 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2191999999999999e-05 2024-09-12T00:04:33.119 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.119 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.119 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.119 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.119 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.119 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:412 6.3 6:c3a682d4:reshard::reshard.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:33.119 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:33.119 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.560843861999999, 2024-09-12T00:04:33.119 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049075530000000003, 2024-09-12T00:04:33.119 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.120 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.120 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.120 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.120 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:33.120 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:33.120 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 412 2024-09-12T00:04:33.120 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.120 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.120 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.120 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.120 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:33.121 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.121 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.121 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.121 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.121 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:33.121 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.121 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.121 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.121 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.121 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526628+0000", 2024-09-12T00:04:33.121 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.513e-06 2024-09-12T00:04:33.121 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.121 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.122 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.122 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526634+0000", 2024-09-12T00:04:33.122 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1279999999999996e-06 2024-09-12T00:04:33.122 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.122 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.122 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.122 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526649+0000", 2024-09-12T00:04:33.122 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4997999999999999e-05 2024-09-12T00:04:33.122 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.122 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.122 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.122 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526658+0000", 2024-09-12T00:04:33.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1589999999999999e-06 2024-09-12T00:04:33.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.123 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.123 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.123 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526728+0000", 2024-09-12T00:04:33.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0203999999999994e-05 2024-09-12T00:04:33.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.123 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.123 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.123 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526839+0000", 2024-09-12T00:04:33.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011055 2024-09-12T00:04:33.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.123 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.123 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.123 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526979+0000", 2024-09-12T00:04:33.124 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139863 2024-09-12T00:04:33.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.124 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.124 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.527616+0000", 2024-09-12T00:04:33.124 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00063707900000000003 2024-09-12T00:04:33.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.124 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.124 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531450+0000", 2024-09-12T00:04:33.124 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003833819 2024-09-12T00:04:33.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.125 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.125 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531490+0000", 2024-09-12T00:04:33.125 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0129000000000002e-05 2024-09-12T00:04:33.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.125 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.125 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.125 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531534+0000", 2024-09-12T00:04:33.125 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4110999999999998e-05 2024-09-12T00:04:33.125 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.125 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.125 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.126 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.126 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.126 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:490 6.19 6:9dc32cef:lc::lc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:33.126 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:33.126 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.536646488000002, 2024-09-12T00:04:33.126 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047438380000000002, 2024-09-12T00:04:33.126 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.126 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.126 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.126 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.126 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:33.126 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:33.126 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 490 2024-09-12T00:04:33.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.127 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.127 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.127 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.127 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:33.127 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.127 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.127 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.127 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:33.127 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.127 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.127 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.128 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550825+0000", 2024-09-12T00:04:33.128 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0589999999999999e-06 2024-09-12T00:04:33.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.128 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.128 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.128 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550830+0000", 2024-09-12T00:04:33.128 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2140000000000004e-06 2024-09-12T00:04:33.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.128 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.128 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.129 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550843+0000", 2024-09-12T00:04:33.129 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3404000000000001e-05 2024-09-12T00:04:33.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.129 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.129 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550852+0000", 2024-09-12T00:04:33.129 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1549999999999996e-06 2024-09-12T00:04:33.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.129 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.129 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550910+0000", 2024-09-12T00:04:33.129 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7636000000000002e-05 2024-09-12T00:04:33.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550977+0000", 2024-09-12T00:04:33.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6636000000000004e-05 2024-09-12T00:04:33.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.551135+0000", 2024-09-12T00:04:33.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015852999999999999 2024-09-12T00:04:33.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552939+0000", 2024-09-12T00:04:33.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001803643 2024-09-12T00:04:33.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.131 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.131 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.131 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555471+0000", 2024-09-12T00:04:33.131 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002532327 2024-09-12T00:04:33.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.131 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.131 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.131 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555526+0000", 2024-09-12T00:04:33.131 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4728000000000002e-05 2024-09-12T00:04:33.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.131 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.131 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.131 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555567+0000", 2024-09-12T00:04:33.131 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1505999999999999e-05 2024-09-12T00:04:33.132 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.132 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.132 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.132 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.132 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:492 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'6, mlcod=35'4)", 2024-09-12T00:04:33.132 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:33.132 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.534870423999998, 2024-09-12T00:04:33.132 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056118790000000002, 2024-09-12T00:04:33.132 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.133 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.133 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.133 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.133 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.133 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.133 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:33.133 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.133 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.133 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.134 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:33.134 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.134 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.134 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.134 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552601+0000", 2024-09-12T00:04:33.134 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6899999999999996e-07 2024-09-12T00:04:33.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.135 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.135 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.135 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552608+0000", 2024-09-12T00:04:33.135 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4529999999999996e-06 2024-09-12T00:04:33.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.135 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.135 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.135 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552624+0000", 2024-09-12T00:04:33.135 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5885000000000001e-05 2024-09-12T00:04:33.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.135 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.136 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.136 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552632+0000", 2024-09-12T00:04:33.136 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2220000000000002e-06 2024-09-12T00:04:33.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.136 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.136 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.136 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552716+0000", 2024-09-12T00:04:33.136 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4060999999999994e-05 2024-09-12T00:04:33.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.136 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.136 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.136 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552735+0000", 2024-09-12T00:04:33.136 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9170000000000001e-05 2024-09-12T00:04:33.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.137 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.137 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.137 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558164+0000", 2024-09-12T00:04:33.137 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054289899999999999 2024-09-12T00:04:33.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.137 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.137 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.137 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558212+0000", 2024-09-12T00:04:33.137 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7129000000000002e-05 2024-09-12T00:04:33.137 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.137 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.138 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.138 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.138 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:496 6.3 6:c134263f:lc::lc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:33.138 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:33.138 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.533763135999997, 2024-09-12T00:04:33.138 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045956260000000002, 2024-09-12T00:04:33.138 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.138 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.138 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.138 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.138 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:33.138 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:33.139 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 496 2024-09-12T00:04:33.139 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.139 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.139 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.139 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.139 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:33.139 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.139 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.139 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.139 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.139 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553707+0000", 2024-09-12T00:04:33.139 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.139 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.139 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.139 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.140 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553708+0000", 2024-09-12T00:04:33.140 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2359999999999999e-06 2024-09-12T00:04:33.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.140 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.140 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.140 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553714+0000", 2024-09-12T00:04:33.140 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4960000000000004e-06 2024-09-12T00:04:33.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.140 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.140 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.140 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553726+0000", 2024-09-12T00:04:33.140 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2618e-05 2024-09-12T00:04:33.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.141 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.141 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.141 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553734+0000", 2024-09-12T00:04:33.141 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4159999999999998e-06 2024-09-12T00:04:33.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.141 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.141 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.141 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553771+0000", 2024-09-12T00:04:33.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7095999999999999e-05 2024-09-12T00:04:33.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553815+0000", 2024-09-12T00:04:33.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3986999999999997e-05 2024-09-12T00:04:33.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.553922+0000", 2024-09-12T00:04:33.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000107534 2024-09-12T00:04:33.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.143 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.143 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.143 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555052+0000", 2024-09-12T00:04:33.143 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011298359999999999 2024-09-12T00:04:33.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.143 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.143 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.143 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558197+0000", 2024-09-12T00:04:33.143 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0031450269999999999 2024-09-12T00:04:33.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.144 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.144 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.144 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558256+0000", 2024-09-12T00:04:33.144 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8403999999999999e-05 2024-09-12T00:04:33.144 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.144 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.144 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.144 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558303+0000", 2024-09-12T00:04:33.144 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6975999999999999e-05 2024-09-12T00:04:33.145 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.145 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.145 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.145 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.145 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:641 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:33.145 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:33.145 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.493692809000002, 2024-09-12T00:04:33.145 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052824789999999996, 2024-09-12T00:04:33.145 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.146 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.146 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.146 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.146 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:33.146 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:33.146 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 641 2024-09-12T00:04:33.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.146 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.146 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.146 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.146 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:33.147 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.147 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.147 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:33.147 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.147 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.147 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593778+0000", 2024-09-12T00:04:33.147 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0920000000000001e-06 2024-09-12T00:04:33.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.148 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.148 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.148 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593783+0000", 2024-09-12T00:04:33.148 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9490000000000004e-06 2024-09-12T00:04:33.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.148 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.148 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.148 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593795+0000", 2024-09-12T00:04:33.148 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2048999999999999e-05 2024-09-12T00:04:33.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.148 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.148 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.149 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593801+0000", 2024-09-12T00:04:33.149 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8989999999999998e-06 2024-09-12T00:04:33.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.149 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.149 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.149 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593852+0000", 2024-09-12T00:04:33.149 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1057999999999998e-05 2024-09-12T00:04:33.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.149 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.149 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.149 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593905+0000", 2024-09-12T00:04:33.149 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2196e-05 2024-09-12T00:04:33.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.150 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.150 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:33.150 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594017+0000", 2024-09-12T00:04:33.150 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000112816 2024-09-12T00:04:33.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.150 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.150 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.150 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.595190+0000", 2024-09-12T00:04:33.150 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011727199999999999 2024-09-12T00:04:33.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.150 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.150 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.151 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.598998+0000", 2024-09-12T00:04:33.151 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038081320000000001 2024-09-12T00:04:33.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.151 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.151 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599032+0000", 2024-09-12T00:04:33.151 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4283999999999999e-05 2024-09-12T00:04:33.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.151 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.151 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599060+0000", 2024-09-12T00:04:33.151 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7284000000000002e-05 2024-09-12T00:04:33.151 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.151 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.151 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.152 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.152 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.152 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:643 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'8, mlcod=35'6)", 2024-09-12T00:04:33.152 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:33.152 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.493194701999997, 2024-09-12T00:04:33.152 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048211260000000002, 2024-09-12T00:04:33.152 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.152 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.152 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.152 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.152 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.152 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.152 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:33.153 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.153 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.153 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.153 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:33.153 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.153 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.153 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.153 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594276+0000", 2024-09-12T00:04:33.153 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5899999999999995e-07 2024-09-12T00:04:33.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.153 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.153 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.153 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594283+0000", 2024-09-12T00:04:33.154 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6019999999999996e-06 2024-09-12T00:04:33.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.154 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.154 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594295+0000", 2024-09-12T00:04:33.154 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1683e-05 2024-09-12T00:04:33.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.154 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.154 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594303+0000", 2024-09-12T00:04:33.154 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0439999999999996e-06 2024-09-12T00:04:33.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.154 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.155 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594353+0000", 2024-09-12T00:04:33.155 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0698000000000001e-05 2024-09-12T00:04:33.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.155 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.155 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.155 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594380+0000", 2024-09-12T00:04:33.155 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7089000000000001e-05 2024-09-12T00:04:33.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.155 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.155 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.155 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599063+0000", 2024-09-12T00:04:33.155 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046824739999999998 2024-09-12T00:04:33.156 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.156 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.156 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.156 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599096+0000", 2024-09-12T00:04:33.156 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3677000000000003e-05 2024-09-12T00:04:33.156 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.156 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.156 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.156 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.156 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.156 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:647 6.a 6:5395e6f3:lc::lc.4:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:33.156 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:33.156 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.490844068999998, 2024-09-12T00:04:33.157 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049071770000000004, 2024-09-12T00:04:33.157 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.157 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.157 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.157 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.157 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:33.157 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:33.157 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 647 2024-09-12T00:04:33.157 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.157 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.157 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.157 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.157 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:33.158 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.158 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.158 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.158 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:33.158 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.158 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.158 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.158 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596627+0000", 2024-09-12T00:04:33.158 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1149999999999999e-06 2024-09-12T00:04:33.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.159 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.159 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596632+0000", 2024-09-12T00:04:33.159 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7060000000000003e-06 2024-09-12T00:04:33.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.159 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.159 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596645+0000", 2024-09-12T00:04:33.159 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2791e-05 2024-09-12T00:04:33.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.159 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.159 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596653+0000", 2024-09-12T00:04:33.159 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9230000000000002e-06 2024-09-12T00:04:33.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.160 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.160 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.160 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596705+0000", 2024-09-12T00:04:33.160 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2250000000000003e-05 2024-09-12T00:04:33.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.160 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.160 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.160 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596758+0000", 2024-09-12T00:04:33.160 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2964000000000003e-05 2024-09-12T00:04:33.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.161 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.161 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:33.161 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596873+0000", 2024-09-12T00:04:33.161 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011501 2024-09-12T00:04:33.161 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.161 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.161 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.161 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599088+0000", 2024-09-12T00:04:33.161 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002215135 2024-09-12T00:04:33.161 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.161 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.161 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.161 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601456+0000", 2024-09-12T00:04:33.162 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023684719999999999 2024-09-12T00:04:33.162 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.162 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.162 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.162 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601507+0000", 2024-09-12T00:04:33.162 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0933999999999997e-05 2024-09-12T00:04:33.162 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.162 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.162 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.162 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601533+0000", 2024-09-12T00:04:33.162 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5877e-05 2024-09-12T00:04:33.162 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.162 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.163 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.163 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.163 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:657 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'10, mlcod=35'7)", 2024-09-12T00:04:33.163 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:33.163 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.487020528999999, 2024-09-12T00:04:33.163 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066410239999999997, 2024-09-12T00:04:33.163 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.163 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.163 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.163 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.163 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.163 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.163 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:33.164 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.164 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.164 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:33.164 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.164 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.164 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:33.165 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6099999999999999e-07 2024-09-12T00:04:33.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.165 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.165 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.165 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600457+0000", 2024-09-12T00:04:33.165 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8700000000000003e-06 2024-09-12T00:04:33.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.165 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.165 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.165 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600470+0000", 2024-09-12T00:04:33.165 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3186999999999999e-05 2024-09-12T00:04:33.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.165 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.165 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.166 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600478+0000", 2024-09-12T00:04:33.166 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5310000000000004e-06 2024-09-12T00:04:33.166 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.166 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.166 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.166 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600521+0000", 2024-09-12T00:04:33.166 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2574000000000003e-05 2024-09-12T00:04:33.166 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.166 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.166 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.166 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600535+0000", 2024-09-12T00:04:33.166 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4151000000000001e-05 2024-09-12T00:04:33.166 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.166 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.167 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.167 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.606997+0000", 2024-09-12T00:04:33.167 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064626099999999997 2024-09-12T00:04:33.167 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.167 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.167 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.167 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607091+0000", 2024-09-12T00:04:33.167 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3239999999999995e-05 2024-09-12T00:04:33.167 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.167 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.167 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.167 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.167 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.168 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:659 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:33.168 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:33.168 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.486848197, 2024-09-12T00:04:33.168 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0065340989999999998, 2024-09-12T00:04:33.168 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.168 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.168 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.168 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.168 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:33.169 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:33.169 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 659 2024-09-12T00:04:33.169 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.169 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.169 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.170 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.170 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:33.170 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.170 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.170 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.170 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.171 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:33.171 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.171 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.171 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.171 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.171 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600623+0000", 2024-09-12T00:04:33.171 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.085e-06 2024-09-12T00:04:33.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.172 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.172 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.172 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600630+0000", 2024-09-12T00:04:33.172 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0029999999999997e-06 2024-09-12T00:04:33.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.173 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.173 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.173 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600647+0000", 2024-09-12T00:04:33.173 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6566999999999999e-05 2024-09-12T00:04:33.173 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.173 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.174 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.174 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600658+0000", 2024-09-12T00:04:33.174 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0992000000000001e-05 2024-09-12T00:04:33.174 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.174 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.174 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.175 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600717+0000", 2024-09-12T00:04:33.175 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9925e-05 2024-09-12T00:04:33.175 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.175 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.175 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.175 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600773+0000", 2024-09-12T00:04:33.176 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5766000000000001e-05 2024-09-12T00:04:33.176 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.176 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.176 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:33.176 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600889+0000", 2024-09-12T00:04:33.177 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115906 2024-09-12T00:04:33.177 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.177 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.177 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.177 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603483+0000", 2024-09-12T00:04:33.177 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025940799999999999 2024-09-12T00:04:33.178 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.178 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.178 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.178 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607098+0000", 2024-09-12T00:04:33.178 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036150459999999998 2024-09-12T00:04:33.178 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.179 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.179 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.179 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607133+0000", 2024-09-12T00:04:33.179 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4615e-05 2024-09-12T00:04:33.179 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.179 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.180 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.180 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607156+0000", 2024-09-12T00:04:33.180 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3113999999999999e-05 2024-09-12T00:04:33.180 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.180 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.180 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.181 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.181 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.181 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:666 6.a 6:5395e6f3:lc::lc.4:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:33.181 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:33.181 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.485101067999999, 2024-09-12T00:04:33.181 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.005127174, 2024-09-12T00:04:33.182 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.182 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.182 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.182 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.182 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:33.183 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:33.183 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 666 2024-09-12T00:04:33.183 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.183 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.183 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.183 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.184 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:33.184 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.184 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.184 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.184 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.184 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:33.184 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.185 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.185 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.185 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.185 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602370+0000", 2024-09-12T00:04:33.185 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0720000000000001e-06 2024-09-12T00:04:33.185 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.186 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.186 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.186 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602376+0000", 2024-09-12T00:04:33.186 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5489999999999997e-06 2024-09-12T00:04:33.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.186 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.186 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.186 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602391+0000", 2024-09-12T00:04:33.187 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5301000000000001e-05 2024-09-12T00:04:33.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.187 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.187 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.187 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602399+0000", 2024-09-12T00:04:33.187 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9179999999999994e-06 2024-09-12T00:04:33.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.187 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.187 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.187 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602456+0000", 2024-09-12T00:04:33.187 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7099999999999999e-05 2024-09-12T00:04:33.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.187 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.188 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.188 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602508+0000", 2024-09-12T00:04:33.188 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2476999999999999e-05 2024-09-12T00:04:33.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.188 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:33.188 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602606+0000", 2024-09-12T00:04:33.188 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7823000000000002e-05 2024-09-12T00:04:33.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.188 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.188 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.604653+0000", 2024-09-12T00:04:33.188 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002047068 2024-09-12T00:04:33.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.189 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.189 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.189 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607401+0000", 2024-09-12T00:04:33.189 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027477700000000001 2024-09-12T00:04:33.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.189 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.189 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.189 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607453+0000", 2024-09-12T00:04:33.189 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2092999999999997e-05 2024-09-12T00:04:33.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.190 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.190 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.190 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607496+0000", 2024-09-12T00:04:33.190 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3003000000000001e-05 2024-09-12T00:04:33.190 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.190 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.190 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.190 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.190 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.190 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:665 6.1a e35/29 6:5c7e8a6d:reshard::reshard.0000000015:head v 35'11, mlcod=35'8)", 2024-09-12T00:04:33.190 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:33.190 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.484729383000001, 2024-09-12T00:04:33.190 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048593209999999998, 2024-09-12T00:04:33.190 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.190 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.191 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.191 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.191 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.191 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.191 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:33.191 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.191 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.191 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.191 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:33.191 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.191 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.191 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.192 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602742+0000", 2024-09-12T00:04:33.192 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1069999999999999e-06 2024-09-12T00:04:33.192 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.192 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.192 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.192 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602749+0000", 2024-09-12T00:04:33.192 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9609999999999999e-06 2024-09-12T00:04:33.192 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.192 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.192 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.192 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602763+0000", 2024-09-12T00:04:33.192 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4086e-05 2024-09-12T00:04:33.192 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.193 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.193 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.193 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602772+0000", 2024-09-12T00:04:33.193 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8470000000000002e-06 2024-09-12T00:04:33.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.193 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.193 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.193 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602826+0000", 2024-09-12T00:04:33.193 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3885000000000003e-05 2024-09-12T00:04:33.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.193 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.193 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.193 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602837+0000", 2024-09-12T00:04:33.194 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1601e-05 2024-09-12T00:04:33.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.194 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.194 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.194 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607500+0000", 2024-09-12T00:04:33.194 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046627509999999997 2024-09-12T00:04:33.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.194 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.194 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.194 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607600+0000", 2024-09-12T00:04:33.194 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100083 2024-09-12T00:04:33.194 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.194 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.194 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.195 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.195 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:831 6.19 6:9d23f22c:lc::lc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:33.195 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:33.195 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.421444702999999, 2024-09-12T00:04:33.195 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047044610000000001, 2024-09-12T00:04:33.195 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.195 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.195 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.195 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.195 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:33.195 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:33.195 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 831 2024-09-12T00:04:33.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.196 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.196 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.196 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.196 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:33.196 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.196 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.196 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.196 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.196 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666025+0000", 2024-09-12T00:04:33.197 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.197 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.197 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.197 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.197 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666026+0000", 2024-09-12T00:04:33.197 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.02e-06 2024-09-12T00:04:33.197 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.197 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.197 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.197 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666032+0000", 2024-09-12T00:04:33.197 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8850000000000004e-06 2024-09-12T00:04:33.197 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.197 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.197 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.198 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666047+0000", 2024-09-12T00:04:33.198 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4647999999999999e-05 2024-09-12T00:04:33.198 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.198 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.198 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.198 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666058+0000", 2024-09-12T00:04:33.198 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0905e-05 2024-09-12T00:04:33.198 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.198 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.198 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.198 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666376+0000", 2024-09-12T00:04:33.198 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031824899999999999 2024-09-12T00:04:33.198 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.199 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.199 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.199 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666479+0000", 2024-09-12T00:04:33.199 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102814 2024-09-12T00:04:33.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.199 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.199 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.199 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.666635+0000", 2024-09-12T00:04:33.199 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000156343 2024-09-12T00:04:33.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.199 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.199 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.199 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.667611+0000", 2024-09-12T00:04:33.199 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000975671 2024-09-12T00:04:33.200 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.200 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.200 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.200 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670662+0000", 2024-09-12T00:04:33.200 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003050863 2024-09-12T00:04:33.200 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.200 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.200 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.200 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670701+0000", 2024-09-12T00:04:33.200 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9338000000000002e-05 2024-09-12T00:04:33.200 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.200 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.200 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.201 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.670730+0000", 2024-09-12T00:04:33.201 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8725e-05 2024-09-12T00:04:33.201 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.201 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.201 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.201 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.201 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.201 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:852 6.1d e35/29 6:bbf2d10c:::obj_delete_at_hint.0000000025:head v 35'9, mlcod=35'7)", 2024-09-12T00:04:33.201 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:33.201 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.412867650000003, 2024-09-12T00:04:33.201 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00569595, 2024-09-12T00:04:33.201 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.202 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.202 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.202 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.202 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.202 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.202 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:33.202 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.202 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.202 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.202 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.202 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:33.202 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.202 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.203 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.203 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.203 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674604+0000", 2024-09-12T00:04:33.203 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2079999999999999e-06 2024-09-12T00:04:33.203 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.203 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.203 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.203 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674611+0000", 2024-09-12T00:04:33.203 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.973e-06 2024-09-12T00:04:33.203 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.203 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.203 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.204 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674625+0000", 2024-09-12T00:04:33.204 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3916e-05 2024-09-12T00:04:33.204 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.204 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.204 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.204 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674633+0000", 2024-09-12T00:04:33.204 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8580000000000006e-06 2024-09-12T00:04:33.204 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.204 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.204 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.204 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674697+0000", 2024-09-12T00:04:33.204 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4004999999999995e-05 2024-09-12T00:04:33.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.205 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.205 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.205 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674713+0000", 2024-09-12T00:04:33.205 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5835e-05 2024-09-12T00:04:33.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.205 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.205 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.205 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680245+0000", 2024-09-12T00:04:33.205 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055320250000000003 2024-09-12T00:04:33.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.205 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.206 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.206 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680298+0000", 2024-09-12T00:04:33.206 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3130000000000001e-05 2024-09-12T00:04:33.206 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.206 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.206 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.206 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.206 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.206 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:925 6.1a e35/29 6:5f2e3d26:lc::lc.18:head v 35'15, mlcod=35'12)", 2024-09-12T00:04:33.206 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:33.206 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.389339820000004, 2024-09-12T00:04:33.206 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055640999999999998, 2024-09-12T00:04:33.206 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.207 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.207 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.207 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.207 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.207 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.207 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:33.207 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.207 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.207 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.207 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.207 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:33.207 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.207 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.208 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.208 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.208 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698131+0000", 2024-09-12T00:04:33.208 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:04:33.208 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.208 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.208 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.208 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698140+0000", 2024-09-12T00:04:33.208 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3139999999999993e-06 2024-09-12T00:04:33.208 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.208 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.208 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.209 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698155+0000", 2024-09-12T00:04:33.209 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:04:33.209 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.209 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.209 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.209 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698164+0000", 2024-09-12T00:04:33.209 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1419999999999999e-06 2024-09-12T00:04:33.209 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.209 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.209 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.209 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698228+0000", 2024-09-12T00:04:33.209 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3380000000000006e-05 2024-09-12T00:04:33.209 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.210 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.210 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.210 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698252+0000", 2024-09-12T00:04:33.210 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4111e-05 2024-09-12T00:04:33.210 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.210 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.210 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.210 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703646+0000", 2024-09-12T00:04:33.210 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0053937840000000004 2024-09-12T00:04:33.210 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.210 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.210 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.210 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703694+0000", 2024-09-12T00:04:33.211 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8776999999999997e-05 2024-09-12T00:04:33.211 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.211 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.211 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.211 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.211 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.211 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:927 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:33.211 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:33.211 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.388820795999997, 2024-09-12T00:04:33.211 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050914949999999997, 2024-09-12T00:04:33.211 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.211 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.211 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.212 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.212 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:33.212 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:33.212 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 927 2024-09-12T00:04:33.212 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.212 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.212 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.212 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.212 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:33.212 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.212 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.212 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.212 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.213 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:33.213 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.213 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.213 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.213 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.213 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698651+0000", 2024-09-12T00:04:33.213 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3740000000000001e-06 2024-09-12T00:04:33.213 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.213 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.213 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.213 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698657+0000", 2024-09-12T00:04:33.213 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5239999999999997e-06 2024-09-12T00:04:33.213 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.214 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.214 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.214 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698673+0000", 2024-09-12T00:04:33.214 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5345999999999998e-05 2024-09-12T00:04:33.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.214 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.214 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.214 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698680+0000", 2024-09-12T00:04:33.214 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4649999999999997e-06 2024-09-12T00:04:33.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.214 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.214 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.214 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699009+0000", 2024-09-12T00:04:33.214 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032934000000000001 2024-09-12T00:04:33.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.215 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.215 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.215 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699213+0000", 2024-09-12T00:04:33.215 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020361500000000001 2024-09-12T00:04:33.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.215 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.215 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.215 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699450+0000", 2024-09-12T00:04:33.215 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023670399999999999 2024-09-12T00:04:33.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.215 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.215 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.215 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.700678+0000", 2024-09-12T00:04:33.216 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012285519999999999 2024-09-12T00:04:33.216 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.216 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.216 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.216 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703666+0000", 2024-09-12T00:04:33.216 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029876130000000001 2024-09-12T00:04:33.216 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.216 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.216 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.216 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703708+0000", 2024-09-12T00:04:33.216 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2361999999999999e-05 2024-09-12T00:04:33.216 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.216 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.216 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.217 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703741+0000", 2024-09-12T00:04:33.217 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.26e-05 2024-09-12T00:04:33.217 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.217 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.217 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.217 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.217 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.217 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:941 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:33.217 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:33.217 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 58.383327342999998, 2024-09-12T00:04:33.217 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0051476960000000002, 2024-09-12T00:04:33.217 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.217 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.217 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "started", 2024-09-12T00:04:33.218 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.218 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:33.218 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:33.218 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 941 2024-09-12T00:04:33.218 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.218 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.218 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.218 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.218 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:33.218 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.218 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.218 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.218 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.218 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:33.218 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.219 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.219 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.219 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.219 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704144+0000", 2024-09-12T00:04:33.219 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.514e-06 2024-09-12T00:04:33.219 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.219 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.219 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.219 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704152+0000", 2024-09-12T00:04:33.219 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2830000000000004e-06 2024-09-12T00:04:33.219 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.219 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.219 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.219 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704168+0000", 2024-09-12T00:04:33.220 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6835999999999999e-05 2024-09-12T00:04:33.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.220 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.220 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.220 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704178+0000", 2024-09-12T00:04:33.220 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7569999999999999e-06 2024-09-12T00:04:33.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.220 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.220 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.220 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704240+0000", 2024-09-12T00:04:33.220 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2193000000000006e-05 2024-09-12T00:04:33.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.220 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.220 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.221 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704308+0000", 2024-09-12T00:04:33.221 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7840000000000001e-05 2024-09-12T00:04:33.221 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.221 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.221 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.221 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.709290+0000", 2024-09-12T00:04:33.221 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049822729999999997 2024-09-12T00:04:33.221 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.221 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.221 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.221 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.221 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.221 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:33.222 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:33.084+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:33.223 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:04:33.223 INFO:tasks.workunit.client.0.smithi019.stdout:quota enabled for the bucket: buck_2024_08_12_00_04_32 2024-09-12T00:04:33.223 INFO:tasks.workunit.client.0.smithi019.stdout:adding file to bucket: 10Mb. 2024-09-12T00:04:33.223 INFO:tasks.workunit.client.0.smithi019.stdout:upload file successful 2024-09-12T00:04:33.223 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:04:33.223 INFO:tasks.workunit.client.0.smithi019.stdout:Test case: PASSED - Test max objects for the given user passed 2024-09-12T00:04:33.224 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:04:33.225 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:33.222+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:33.326 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:33.326+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:33.385 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:33.385 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:33.385 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:33.385 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:33.399 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:04:33.409 INFO:tasks.workunit.client.0.smithi019.stdout:user qa_user deleted 2024-09-12T00:04:33.410 INFO:tasks.workunit.client.0.smithi019.stdout:bucket delete succeeded 2024-09-12T00:04:33.427 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:33.424+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:33.437 INFO:tasks.workunit.client.0.smithi019.stderr:1+0 records in 2024-09-12T00:04:33.437 INFO:tasks.workunit.client.0.smithi019.stderr:1+0 records out 2024-09-12T00:04:33.438 INFO:tasks.workunit.client.0.smithi019.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0251206 s, 417 MB/s 2024-09-12T00:04:33.490 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T00:04:33.520 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:33.520 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:33.520 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:33.520 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:33.520 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:33.528 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:33.526+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:33.535 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:04:33.628 INFO:tasks.workunit.client.0.smithi019.stdout:Bucket Created: buck_2024_08_12_00_04_33 2024-09-12T00:04:33.628 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:33.626+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:33.705 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:33.705 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:33.705 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:33.705 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:33.705 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.705 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:33.706 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:33.706 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 82.211984443999995, 2024-09-12T00:04:33.706 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.278479906, 2024-09-12T00:04:33.706 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.706 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.706 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.706 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.706 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:33.706 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:33.706 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:04:33.706 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.707 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.707 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.707 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.707 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:33.707 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.707 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.707 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.707 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:33.707 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.708 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.708 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.708 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493422+0000", 2024-09-12T00:04:33.708 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.807e-06 2024-09-12T00:04:33.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.708 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.708 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.708 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493435+0000", 2024-09-12T00:04:33.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.375e-05 2024-09-12T00:04:33.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493457+0000", 2024-09-12T00:04:33.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2166000000000001e-05 2024-09-12T00:04:33.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493475+0000", 2024-09-12T00:04:33.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7184e-05 2024-09-12T00:04:33.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493617+0000", 2024-09-12T00:04:33.710 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014274200000000001 2024-09-12T00:04:33.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.710 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.710 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:33.710 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493632+0000", 2024-09-12T00:04:33.710 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4293e-05 2024-09-12T00:04:33.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.710 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.710 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.710 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.768657+0000", 2024-09-12T00:04:33.710 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.27502575400000001 2024-09-12T00:04:33.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.710 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.710 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.710 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769042+0000", 2024-09-12T00:04:33.711 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00038463700000000001 2024-09-12T00:04:33.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.711 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.711 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.711 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769430+0000", 2024-09-12T00:04:33.711 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000388014 2024-09-12T00:04:33.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.711 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.711 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.711 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.770784+0000", 2024-09-12T00:04:33.711 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00135402 2024-09-12T00:04:33.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.711 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.711 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.711 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771735+0000", 2024-09-12T00:04:33.712 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00095068599999999996 2024-09-12T00:04:33.712 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.712 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.712 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.712 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771828+0000", 2024-09-12T00:04:33.712 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3468999999999996e-05 2024-09-12T00:04:33.712 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.712 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.712 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.712 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771899+0000", 2024-09-12T00:04:33.712 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0383999999999996e-05 2024-09-12T00:04:33.712 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.713 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.713 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.713 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.713 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.713 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:33.713 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:33.713 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 81.783760688000001, 2024-09-12T00:04:33.713 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013402304, 2024-09-12T00:04:33.713 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.713 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.713 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.713 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.714 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:33.714 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:33.714 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 44 2024-09-12T00:04:33.714 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.714 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.714 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.714 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.714 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:33.714 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.714 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.715 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.715 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.715 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:33.715 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.715 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.715 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.715 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.715 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921643+0000", 2024-09-12T00:04:33.716 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7100000000000001e-07 2024-09-12T00:04:33.716 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.716 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.716 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.716 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921706+0000", 2024-09-12T00:04:33.716 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2374999999999998e-05 2024-09-12T00:04:33.716 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.716 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.717 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.717 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921726+0000", 2024-09-12T00:04:33.717 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0373999999999998e-05 2024-09-12T00:04:33.717 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.717 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.717 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.717 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921733+0000", 2024-09-12T00:04:33.717 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8929999999999999e-06 2024-09-12T00:04:33.717 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.717 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.717 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.718 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927137+0000", 2024-09-12T00:04:33.718 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054037410000000001 2024-09-12T00:04:33.718 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.718 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.718 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.718 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927274+0000", 2024-09-12T00:04:33.718 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013697899999999999 2024-09-12T00:04:33.718 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.718 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.718 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.718 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.927504+0000", 2024-09-12T00:04:33.719 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023005399999999999 2024-09-12T00:04:33.719 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.719 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.719 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.719 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.931848+0000", 2024-09-12T00:04:33.719 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0043445269999999999 2024-09-12T00:04:33.719 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.719 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.719 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.720 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934770+0000", 2024-09-12T00:04:33.720 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002922319 2024-09-12T00:04:33.720 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.720 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.720 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.720 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934901+0000", 2024-09-12T00:04:33.720 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013034599999999999 2024-09-12T00:04:33.720 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.720 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.720 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.720 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935045+0000", 2024-09-12T00:04:33.720 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014402499999999999 2024-09-12T00:04:33.721 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.721 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.721 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.721 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.721 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.721 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:33.721 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:33.721 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 81.783657723000005, 2024-09-12T00:04:33.721 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013456684999999999, 2024-09-12T00:04:33.721 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.721 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.722 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.722 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.722 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:33.722 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:33.722 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 45 2024-09-12T00:04:33.722 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.722 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.722 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.722 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.722 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:33.723 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.723 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.723 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.723 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.723 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:33.723 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.723 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.723 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.723 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.723 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921746+0000", 2024-09-12T00:04:33.724 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9800000000000003e-07 2024-09-12T00:04:33.724 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.724 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.724 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.724 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921751+0000", 2024-09-12T00:04:33.724 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7099999999999998e-06 2024-09-12T00:04:33.724 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.724 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.724 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.724 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921766+0000", 2024-09-12T00:04:33.725 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5633000000000001e-05 2024-09-12T00:04:33.725 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.725 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.725 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.725 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921786+0000", 2024-09-12T00:04:33.725 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9658000000000001e-05 2024-09-12T00:04:33.725 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.725 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.725 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.726 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929539+0000", 2024-09-12T00:04:33.726 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0077533120000000001 2024-09-12T00:04:33.726 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.726 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.726 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.726 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929706+0000", 2024-09-12T00:04:33.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016664199999999999 2024-09-12T00:04:33.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929933+0000", 2024-09-12T00:04:33.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000226658 2024-09-12T00:04:33.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934721+0000", 2024-09-12T00:04:33.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047886439999999999 2024-09-12T00:04:33.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.728 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.728 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935062+0000", 2024-09-12T00:04:33.728 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00034072399999999999 2024-09-12T00:04:33.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.728 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.728 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935141+0000", 2024-09-12T00:04:33.728 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8570000000000002e-05 2024-09-12T00:04:33.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.729 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.729 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.729 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935202+0000", 2024-09-12T00:04:33.729 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1536000000000002e-05 2024-09-12T00:04:33.729 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.729 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.729 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.729 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.730 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:33.730 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:33.730 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 81.783607490999998, 2024-09-12T00:04:33.730 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014633617, 2024-09-12T00:04:33.730 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.730 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.730 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.730 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.730 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:33.730 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:33.730 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:04:33.730 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.730 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.731 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.731 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.731 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:33.731 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.731 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.731 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.731 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:33.731 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.731 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.731 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.731 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:33.731 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3599999999999999e-07 2024-09-12T00:04:33.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.732 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921800+0000", 2024-09-12T00:04:33.732 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3850000000000002e-06 2024-09-12T00:04:33.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.732 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921805+0000", 2024-09-12T00:04:33.732 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9460000000000003e-06 2024-09-12T00:04:33.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.732 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921819+0000", 2024-09-12T00:04:33.733 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.325e-05 2024-09-12T00:04:33.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.733 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.733 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930627+0000", 2024-09-12T00:04:33.733 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00880827 2024-09-12T00:04:33.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.733 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.733 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930805+0000", 2024-09-12T00:04:33.733 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000177992 2024-09-12T00:04:33.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.734 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.734 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.931028+0000", 2024-09-12T00:04:33.734 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000223122 2024-09-12T00:04:33.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.734 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.734 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.734 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935258+0000", 2024-09-12T00:04:33.734 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0042302709999999999 2024-09-12T00:04:33.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.734 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.734 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936282+0000", 2024-09-12T00:04:33.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00102345 2024-09-12T00:04:33.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936367+0000", 2024-09-12T00:04:33.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4869000000000003e-05 2024-09-12T00:04:33.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.736 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936429+0000", 2024-09-12T00:04:33.736 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2626000000000007e-05 2024-09-12T00:04:33.736 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.736 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.736 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.736 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:33.736 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:33.737 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 81.783571241000004, 2024-09-12T00:04:33.737 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016022492999999999, 2024-09-12T00:04:33.737 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.737 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.737 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.737 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.737 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:33.737 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:33.737 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:04:33.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.737 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.737 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.737 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:33.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.738 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:33.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.738 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:33.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4000000000000002e-07 2024-09-12T00:04:33.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.738 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921891+0000", 2024-09-12T00:04:33.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8298000000000003e-05 2024-09-12T00:04:33.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.739 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921899+0000", 2024-09-12T00:04:33.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7059999999999993e-06 2024-09-12T00:04:33.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.740 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.740 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.740 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921904+0000", 2024-09-12T00:04:33.740 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9799999999999998e-06 2024-09-12T00:04:33.740 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.740 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.740 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.740 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932144+0000", 2024-09-12T00:04:33.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010239817999999999 2024-09-12T00:04:33.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932284+0000", 2024-09-12T00:04:33.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139436 2024-09-12T00:04:33.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932498+0000", 2024-09-12T00:04:33.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000214408 2024-09-12T00:04:33.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936444+0000", 2024-09-12T00:04:33.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039464169999999998 2024-09-12T00:04:33.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937702+0000", 2024-09-12T00:04:33.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012571679999999999 2024-09-12T00:04:33.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.743 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.743 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937793+0000", 2024-09-12T00:04:33.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1489000000000004e-05 2024-09-12T00:04:33.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.743 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.743 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937854+0000", 2024-09-12T00:04:33.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1333000000000004e-05 2024-09-12T00:04:33.744 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.744 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.744 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.744 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:33.744 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:33.744 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 81.783489372999995, 2024-09-12T00:04:33.744 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017189138999999999, 2024-09-12T00:04:33.744 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.745 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.745 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.745 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.745 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:33.745 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:33.745 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 48 2024-09-12T00:04:33.745 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.745 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.745 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.745 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.745 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:33.746 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.746 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.746 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.746 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:33.746 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.746 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.746 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.746 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:33.747 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7399999999999998e-07 2024-09-12T00:04:33.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921918+0000", 2024-09-12T00:04:33.747 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6399999999999999e-06 2024-09-12T00:04:33.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921925+0000", 2024-09-12T00:04:33.747 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7190000000000004e-06 2024-09-12T00:04:33.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.748 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921931+0000", 2024-09-12T00:04:33.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2519999999999996e-06 2024-09-12T00:04:33.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.749 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.749 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933475+0000", 2024-09-12T00:04:33.749 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011543759000000001 2024-09-12T00:04:33.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.749 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.749 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.749 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933617+0000", 2024-09-12T00:04:33.749 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000142282 2024-09-12T00:04:33.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.749 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.749 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.749 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933860+0000", 2024-09-12T00:04:33.750 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024276199999999999 2024-09-12T00:04:33.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.750 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.750 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937933+0000", 2024-09-12T00:04:33.750 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040734680000000002 2024-09-12T00:04:33.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.750 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.750 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938955+0000", 2024-09-12T00:04:33.750 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001021987 2024-09-12T00:04:33.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.751 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.751 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939038+0000", 2024-09-12T00:04:33.751 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2449999999999998e-05 2024-09-12T00:04:33.751 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.751 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.751 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.751 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939103+0000", 2024-09-12T00:04:33.751 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5345999999999994e-05 2024-09-12T00:04:33.751 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.751 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.751 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.751 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.751 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.751 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:33.752 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:33.752 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 81.783463831000006, 2024-09-12T00:04:33.752 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018247975, 2024-09-12T00:04:33.752 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.752 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.752 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.752 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.752 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:33.752 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:33.752 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 49 2024-09-12T00:04:33.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.753 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:33.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:33.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.754 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921940+0000", 2024-09-12T00:04:33.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7e-07 2024-09-12T00:04:33.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.754 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921943+0000", 2024-09-12T00:04:33.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1889999999999999e-06 2024-09-12T00:04:33.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.755 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.755 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921952+0000", 2024-09-12T00:04:33.755 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0010000000000007e-06 2024-09-12T00:04:33.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.755 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.755 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.755 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921959+0000", 2024-09-12T00:04:33.755 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2570000000000001e-06 2024-09-12T00:04:33.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.756 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.756 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.756 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935333+0000", 2024-09-12T00:04:33.756 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013373368 2024-09-12T00:04:33.756 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.756 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.756 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.756 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935472+0000", 2024-09-12T00:04:33.756 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013987900000000001 2024-09-12T00:04:33.756 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.756 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.757 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.757 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935700+0000", 2024-09-12T00:04:33.757 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000227922 2024-09-12T00:04:33.757 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.757 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.757 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.757 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939858+0000", 2024-09-12T00:04:33.757 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041571300000000002 2024-09-12T00:04:33.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.758 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.758 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.758 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940018+0000", 2024-09-12T00:04:33.758 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016060400000000001 2024-09-12T00:04:33.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.758 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.758 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.758 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940114+0000", 2024-09-12T00:04:33.758 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5692999999999993e-05 2024-09-12T00:04:33.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.759 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.759 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.759 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940187+0000", 2024-09-12T00:04:33.759 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3561999999999998e-05 2024-09-12T00:04:33.759 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.759 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.759 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.759 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.760 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:33.760 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:33.760 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 81.783421043999994, 2024-09-12T00:04:33.760 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021018614000000001, 2024-09-12T00:04:33.760 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.760 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.760 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.760 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.760 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:33.760 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:33.760 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 50 2024-09-12T00:04:33.760 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.761 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.761 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.761 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.761 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:33.761 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.761 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.761 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.761 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:33.761 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.761 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.761 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.762 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921983+0000", 2024-09-12T00:04:33.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4499999999999996e-07 2024-09-12T00:04:33.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.762 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.762 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.762 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922071+0000", 2024-09-12T00:04:33.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8010000000000006e-05 2024-09-12T00:04:33.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.762 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.762 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.762 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922084+0000", 2024-09-12T00:04:33.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3275000000000001e-05 2024-09-12T00:04:33.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.763 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.763 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922093+0000", 2024-09-12T00:04:33.763 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0580000000000004e-06 2024-09-12T00:04:33.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.763 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.763 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936515+0000", 2024-09-12T00:04:33.763 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014421270999999999 2024-09-12T00:04:33.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.763 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.763 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936677+0000", 2024-09-12T00:04:33.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162003 2024-09-12T00:04:33.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.764 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936908+0000", 2024-09-12T00:04:33.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023115700000000001 2024-09-12T00:04:33.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.764 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939985+0000", 2024-09-12T00:04:33.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030773879999999999 2024-09-12T00:04:33.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.765 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942623+0000", 2024-09-12T00:04:33.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026377929999999998 2024-09-12T00:04:33.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.765 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942818+0000", 2024-09-12T00:04:33.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019556200000000001 2024-09-12T00:04:33.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.766 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.766 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943001+0000", 2024-09-12T00:04:33.766 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018235199999999999 2024-09-12T00:04:33.766 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.766 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.766 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.766 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:33.766 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:33.766 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 81.783286652000001, 2024-09-12T00:04:33.767 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021092493, 2024-09-12T00:04:33.767 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.767 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.767 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.767 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.767 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:33.767 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:33.767 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 51 2024-09-12T00:04:33.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.767 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:33.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:33.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922118+0000", 2024-09-12T00:04:33.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0389999999999999e-06 2024-09-12T00:04:33.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.769 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.769 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.769 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922124+0000", 2024-09-12T00:04:33.769 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5409999999999997e-06 2024-09-12T00:04:33.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.769 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.769 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.769 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922136+0000", 2024-09-12T00:04:33.769 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.205e-05 2024-09-12T00:04:33.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.769 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.769 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.769 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922147+0000", 2024-09-12T00:04:33.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0451e-05 2024-09-12T00:04:33.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.770 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938000+0000", 2024-09-12T00:04:33.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015853682000000001 2024-09-12T00:04:33.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.770 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938142+0000", 2024-09-12T00:04:33.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014148899999999999 2024-09-12T00:04:33.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.771 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.771 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938362+0000", 2024-09-12T00:04:33.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022034800000000001 2024-09-12T00:04:33.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.771 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.771 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940330+0000", 2024-09-12T00:04:33.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001967459 2024-09-12T00:04:33.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.772 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.772 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.772 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943064+0000", 2024-09-12T00:04:33.772 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027346219999999999 2024-09-12T00:04:33.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.772 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.772 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.772 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943152+0000", 2024-09-12T00:04:33.772 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7563000000000002e-05 2024-09-12T00:04:33.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.773 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943209+0000", 2024-09-12T00:04:33.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7249e-05 2024-09-12T00:04:33.773 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.773 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.773 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.773 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:33.773 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:33.774 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 81.783237158999995, 2024-09-12T00:04:33.774 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021175616000000001, 2024-09-12T00:04:33.774 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.774 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.774 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.774 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.774 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:33.774 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:33.774 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 52 2024-09-12T00:04:33.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.775 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.775 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.775 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.775 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:33.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.775 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.775 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.775 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:33.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.775 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922167+0000", 2024-09-12T00:04:33.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3300000000000001e-07 2024-09-12T00:04:33.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922174+0000", 2024-09-12T00:04:33.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7070000000000003e-06 2024-09-12T00:04:33.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922184+0000", 2024-09-12T00:04:33.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682e-05 2024-09-12T00:04:33.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922195+0000", 2024-09-12T00:04:33.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0489000000000001e-05 2024-09-12T00:04:33.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.778 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.778 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939166+0000", 2024-09-12T00:04:33.778 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016971245999999999 2024-09-12T00:04:33.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.778 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939243+0000", 2024-09-12T00:04:33.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7201999999999997e-05 2024-09-12T00:04:33.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939381+0000", 2024-09-12T00:04:33.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013770699999999999 2024-09-12T00:04:33.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940923+0000", 2024-09-12T00:04:33.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001542302 2024-09-12T00:04:33.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943221+0000", 2024-09-12T00:04:33.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022979720000000001 2024-09-12T00:04:33.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943295+0000", 2024-09-12T00:04:33.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3317000000000003e-05 2024-09-12T00:04:33.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.781 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943342+0000", 2024-09-12T00:04:33.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7159e-05 2024-09-12T00:04:33.781 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.781 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.782 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.782 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:33.782 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:33.782 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 81.534292192999999, 2024-09-12T00:04:33.782 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015229411999999999, 2024-09-12T00:04:33.782 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.782 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.782 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.782 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.783 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:33.783 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:33.783 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 67 2024-09-12T00:04:33.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.783 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:33.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:33.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171112+0000", 2024-09-12T00:04:33.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2899999999999999e-06 2024-09-12T00:04:33.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171119+0000", 2024-09-12T00:04:33.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8870000000000003e-06 2024-09-12T00:04:33.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171131+0000", 2024-09-12T00:04:33.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1902999999999999e-05 2024-09-12T00:04:33.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171147+0000", 2024-09-12T00:04:33.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6203000000000001e-05 2024-09-12T00:04:33.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.786 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.786 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175044+0000", 2024-09-12T00:04:33.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038967310000000001 2024-09-12T00:04:33.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.786 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.786 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175172+0000", 2024-09-12T00:04:33.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012784100000000001 2024-09-12T00:04:33.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.786 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.787 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175372+0000", 2024-09-12T00:04:33.787 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019978500000000001 2024-09-12T00:04:33.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.787 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.787 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.787 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179276+0000", 2024-09-12T00:04:33.787 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039042149999999999 2024-09-12T00:04:33.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.787 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.787 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.787 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186150+0000", 2024-09-12T00:04:33.787 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0068740019999999997 2024-09-12T00:04:33.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.788 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.788 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186266+0000", 2024-09-12T00:04:33.788 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115742 2024-09-12T00:04:33.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.788 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.788 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186340+0000", 2024-09-12T00:04:33.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4813000000000004e-05 2024-09-12T00:04:33.789 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.789 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.789 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.789 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:33.789 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:33.789 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 81.534231117000004, 2024-09-12T00:04:33.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015308448000000001, 2024-09-12T00:04:33.789 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.789 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.789 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.790 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.790 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:33.790 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:33.790 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 68 2024-09-12T00:04:33.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.790 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:33.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:33.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171173+0000", 2024-09-12T00:04:33.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:04:33.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171182+0000", 2024-09-12T00:04:33.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2359999999999993e-06 2024-09-12T00:04:33.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171193+0000", 2024-09-12T00:04:33.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.095e-05 2024-09-12T00:04:33.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171207+0000", 2024-09-12T00:04:33.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3339999999999999e-05 2024-09-12T00:04:33.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176753+0000", 2024-09-12T00:04:33.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055460240000000001 2024-09-12T00:04:33.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.793 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.793 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.793 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176921+0000", 2024-09-12T00:04:33.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000168503 2024-09-12T00:04:33.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.793 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.793 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.793 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177112+0000", 2024-09-12T00:04:33.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019113999999999999 2024-09-12T00:04:33.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.793 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.794 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179382+0000", 2024-09-12T00:04:33.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022697099999999999 2024-09-12T00:04:33.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.794 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186356+0000", 2024-09-12T00:04:33.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069741919999999997 2024-09-12T00:04:33.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.794 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186422+0000", 2024-09-12T00:04:33.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6387e-05 2024-09-12T00:04:33.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186481+0000", 2024-09-12T00:04:33.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8059000000000001e-05 2024-09-12T00:04:33.795 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.795 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.795 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.795 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:33.795 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:33.795 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 81.534179347000006, 2024-09-12T00:04:33.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020001835999999999, 2024-09-12T00:04:33.796 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.796 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.796 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.796 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.796 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:33.796 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:33.796 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 69 2024-09-12T00:04:33.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.796 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:33.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:33.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171225+0000", 2024-09-12T00:04:33.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0599999999999999e-07 2024-09-12T00:04:33.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171349+0000", 2024-09-12T00:04:33.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012407299999999999 2024-09-12T00:04:33.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.798 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171367+0000", 2024-09-12T00:04:33.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8413000000000001e-05 2024-09-12T00:04:33.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.798 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171376+0000", 2024-09-12T00:04:33.799 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8170000000000005e-06 2024-09-12T00:04:33.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.799 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.799 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177692+0000", 2024-09-12T00:04:33.799 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063156729999999999 2024-09-12T00:04:33.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.799 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.799 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177817+0000", 2024-09-12T00:04:33.799 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012581499999999999 2024-09-12T00:04:33.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.178015+0000", 2024-09-12T00:04:33.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019715100000000001 2024-09-12T00:04:33.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181798+0000", 2024-09-12T00:04:33.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003783308 2024-09-12T00:04:33.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190976+0000", 2024-09-12T00:04:33.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091776519999999997 2024-09-12T00:04:33.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191122+0000", 2024-09-12T00:04:33.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000145966 2024-09-12T00:04:33.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191226+0000", 2024-09-12T00:04:33.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104162 2024-09-12T00:04:33.802 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.802 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.802 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.802 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:33.802 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:33.802 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 81.534010612000003, 2024-09-12T00:04:33.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019997773, 2024-09-12T00:04:33.803 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.803 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.803 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.803 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.803 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:33.803 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:33.803 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 70 2024-09-12T00:04:33.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.803 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.803 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:33.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:33.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.805 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:33.805 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3699999999999999e-07 2024-09-12T00:04:33.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.805 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.805 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.805 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171403+0000", 2024-09-12T00:04:33.805 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6199999999999994e-06 2024-09-12T00:04:33.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.805 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.805 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171416+0000", 2024-09-12T00:04:33.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2636000000000001e-05 2024-09-12T00:04:33.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171423+0000", 2024-09-12T00:04:33.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5440000000000001e-06 2024-09-12T00:04:33.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179458+0000", 2024-09-12T00:04:33.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080351989999999998 2024-09-12T00:04:33.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179604+0000", 2024-09-12T00:04:33.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014519899999999999 2024-09-12T00:04:33.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179831+0000", 2024-09-12T00:04:33.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022704800000000001 2024-09-12T00:04:33.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.809 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.809 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181918+0000", 2024-09-12T00:04:33.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020873950000000001 2024-09-12T00:04:33.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.809 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.809 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.809 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191243+0000", 2024-09-12T00:04:33.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0093244729999999998 2024-09-12T00:04:33.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.810 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.810 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191309+0000", 2024-09-12T00:04:33.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6116000000000002e-05 2024-09-12T00:04:33.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.810 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.810 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191390+0000", 2024-09-12T00:04:33.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1705999999999993e-05 2024-09-12T00:04:33.810 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.811 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.811 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.811 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:33.811 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:33.811 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 81.533964538999996, 2024-09-12T00:04:33.811 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020263554, 2024-09-12T00:04:33.811 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.811 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.811 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.811 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.811 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:33.811 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:33.812 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 71 2024-09-12T00:04:33.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.812 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:33.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:33.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.813 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.813 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:33.813 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5000000000000002e-07 2024-09-12T00:04:33.813 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.813 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.813 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.813 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171454+0000", 2024-09-12T00:04:33.813 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5046e-05 2024-09-12T00:04:33.813 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.813 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.813 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.813 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171471+0000", 2024-09-12T00:04:33.813 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6923999999999999e-05 2024-09-12T00:04:33.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171487+0000", 2024-09-12T00:04:33.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5823000000000001e-05 2024-09-12T00:04:33.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180765+0000", 2024-09-12T00:04:33.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0092774399999999996 2024-09-12T00:04:33.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180900+0000", 2024-09-12T00:04:33.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013556700000000001 2024-09-12T00:04:33.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.816 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181108+0000", 2024-09-12T00:04:33.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020727899999999999 2024-09-12T00:04:33.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.816 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.816 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.816 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184725+0000", 2024-09-12T00:04:33.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036171340000000001 2024-09-12T00:04:33.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.816 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.816 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.817 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191413+0000", 2024-09-12T00:04:33.817 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066881830000000003 2024-09-12T00:04:33.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.817 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.817 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.817 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191540+0000", 2024-09-12T00:04:33.817 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000126823 2024-09-12T00:04:33.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.817 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.817 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.817 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191702+0000", 2024-09-12T00:04:33.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162585 2024-09-12T00:04:33.818 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.818 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.818 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.818 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:33.818 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:33.818 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 81.533885963000003, 2024-09-12T00:04:33.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020448573000000001, 2024-09-12T00:04:33.818 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.818 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.819 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.819 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.819 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:33.819 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:33.819 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 72 2024-09-12T00:04:33.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.819 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.819 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.819 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:33.820 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.820 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:33.820 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.820 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171518+0000", 2024-09-12T00:04:33.820 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0440000000000001e-06 2024-09-12T00:04:33.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171647+0000", 2024-09-12T00:04:33.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012912899999999999 2024-09-12T00:04:33.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171664+0000", 2024-09-12T00:04:33.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6079999999999999e-05 2024-09-12T00:04:33.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171675+0000", 2024-09-12T00:04:33.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1223000000000001e-05 2024-09-12T00:04:33.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.822 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.822 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182000+0000", 2024-09-12T00:04:33.822 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010324949 2024-09-12T00:04:33.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.822 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.822 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182178+0000", 2024-09-12T00:04:33.822 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017808799999999999 2024-09-12T00:04:33.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.822 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.822 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182402+0000", 2024-09-12T00:04:33.822 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022381199999999999 2024-09-12T00:04:33.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190935+0000", 2024-09-12T00:04:33.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085331560000000001 2024-09-12T00:04:33.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191728+0000", 2024-09-12T00:04:33.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079325700000000001 2024-09-12T00:04:33.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191864+0000", 2024-09-12T00:04:33.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013606299999999999 2024-09-12T00:04:33.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.824 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.824 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191966+0000", 2024-09-12T00:04:33.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101772 2024-09-12T00:04:33.824 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.824 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.824 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.824 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:33.824 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:33.825 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 81.533702767999998, 2024-09-12T00:04:33.825 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020675235, 2024-09-12T00:04:33.825 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.825 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.825 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.825 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.825 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:33.825 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:33.825 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 73 2024-09-12T00:04:33.825 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.825 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.825 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.825 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.825 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:33.826 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.826 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:33.826 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.826 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171701+0000", 2024-09-12T00:04:33.826 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0999999999999997e-07 2024-09-12T00:04:33.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171709+0000", 2024-09-12T00:04:33.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2540000000000003e-06 2024-09-12T00:04:33.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171724+0000", 2024-09-12T00:04:33.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5569e-05 2024-09-12T00:04:33.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171734+0000", 2024-09-12T00:04:33.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6139999999999998e-06 2024-09-12T00:04:33.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183774+0000", 2024-09-12T00:04:33.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012040444000000001 2024-09-12T00:04:33.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183896+0000", 2024-09-12T00:04:33.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012204199999999999 2024-09-12T00:04:33.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184084+0000", 2024-09-12T00:04:33.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018792599999999999 2024-09-12T00:04:33.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191984+0000", 2024-09-12T00:04:33.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079003790000000008 2024-09-12T00:04:33.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192093+0000", 2024-09-12T00:04:33.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000108942 2024-09-12T00:04:33.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192250+0000", 2024-09-12T00:04:33.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015637600000000001 2024-09-12T00:04:33.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192376+0000", 2024-09-12T00:04:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012587899999999999 2024-09-12T00:04:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 81.533654557999995, 2024-09-12T00:04:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021088828, 2024-09-12T00:04:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 74 2024-09-12T00:04:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1699999999999997e-07 2024-09-12T00:04:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171758+0000", 2024-09-12T00:04:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0860000000000008e-06 2024-09-12T00:04:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.836 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171774+0000", 2024-09-12T00:04:33.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:04:33.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.836 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.836 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171788+0000", 2024-09-12T00:04:33.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4793999999999999e-05 2024-09-12T00:04:33.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184842+0000", 2024-09-12T00:04:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013053607 2024-09-12T00:04:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185130+0000", 2024-09-12T00:04:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00028779199999999998 2024-09-12T00:04:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185378+0000", 2024-09-12T00:04:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024780100000000002 2024-09-12T00:04:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192513+0000", 2024-09-12T00:04:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071350770000000001 2024-09-12T00:04:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192690+0000", 2024-09-12T00:04:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000176892 2024-09-12T00:04:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192769+0000", 2024-09-12T00:04:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9466000000000001e-05 2024-09-12T00:04:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192837+0000", 2024-09-12T00:04:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8466000000000005e-05 2024-09-12T00:04:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.840 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.840 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.840 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:33.840 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:33.840 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 81.533601981000004, 2024-09-12T00:04:33.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.02121994, 2024-09-12T00:04:33.841 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.841 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.841 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.841 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.841 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:33.841 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:33.842 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 75 2024-09-12T00:04:33.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.842 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.843 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.843 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:33.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.844 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.844 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:33.844 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.844 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.845 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.845 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171802+0000", 2024-09-12T00:04:33.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5000000000000002e-07 2024-09-12T00:04:33.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.846 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.846 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.846 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171954+0000", 2024-09-12T00:04:33.846 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015215500000000001 2024-09-12T00:04:33.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.847 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.847 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.847 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171966+0000", 2024-09-12T00:04:33.847 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1548e-05 2024-09-12T00:04:33.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.847 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.848 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.848 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171970+0000", 2024-09-12T00:04:33.848 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8729999999999998e-06 2024-09-12T00:04:33.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.848 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.849 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.849 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186552+0000", 2024-09-12T00:04:33.849 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014581775 2024-09-12T00:04:33.849 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.849 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.849 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.850 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186702+0000", 2024-09-12T00:04:33.850 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014946 2024-09-12T00:04:33.850 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.850 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.850 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.850 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186897+0000", 2024-09-12T00:04:33.850 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000195071 2024-09-12T00:04:33.851 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.851 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.851 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.851 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192666+0000", 2024-09-12T00:04:33.851 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057693470000000002 2024-09-12T00:04:33.851 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.851 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.851 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.852 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192857+0000", 2024-09-12T00:04:33.852 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191149 2024-09-12T00:04:33.852 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.852 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.852 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.852 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192967+0000", 2024-09-12T00:04:33.852 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110202 2024-09-12T00:04:33.853 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.853 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.853 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.853 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193021+0000", 2024-09-12T00:04:33.853 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3709999999999999e-05 2024-09-12T00:04:33.853 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.853 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.854 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.854 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.854 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:33.854 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:33.854 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 81.533422685999994, 2024-09-12T00:04:33.854 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026297425999999999, 2024-09-12T00:04:33.855 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:33.855 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:33.855 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:33.855 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:33.855 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:33.855 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:33.856 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 76 2024-09-12T00:04:33.856 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.856 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:33.856 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.856 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:33.857 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:33.857 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.857 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.857 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.857 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:33.857 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:33.858 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:33.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.858 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:33.858 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:33.859 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9399999999999995e-07 2024-09-12T00:04:33.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.859 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:33.859 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171987+0000", 2024-09-12T00:04:33.859 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5230000000000003e-06 2024-09-12T00:04:33.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.860 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.860 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:33.860 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172005+0000", 2024-09-12T00:04:33.860 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8788e-05 2024-09-12T00:04:33.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.860 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.860 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:33.861 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172010+0000", 2024-09-12T00:04:33.861 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7570000000000004e-06 2024-09-12T00:04:33.861 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.861 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.861 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:33.862 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193104+0000", 2024-09-12T00:04:33.862 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021094112000000002 2024-09-12T00:04:33.862 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.862 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.862 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:33.863 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193334+0000", 2024-09-12T00:04:33.863 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000229855 2024-09-12T00:04:33.863 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.863 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.864 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:33.864 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193697+0000", 2024-09-12T00:04:33.864 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00036272399999999998 2024-09-12T00:04:33.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.864 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.864 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:33.864 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.195602+0000", 2024-09-12T00:04:33.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019049620000000001 2024-09-12T00:04:33.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:33.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198123+0000", 2024-09-12T00:04:33.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025216520000000001 2024-09-12T00:04:33.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:33.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198213+0000", 2024-09-12T00:04:33.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0008999999999998e-05 2024-09-12T00:04:33.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:33.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:33.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:33.866 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198278+0000", 2024-09-12T00:04:33.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4549999999999997e-05 2024-09-12T00:04:33.866 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.866 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.866 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.866 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:33.866 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:33.866 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:33.869 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:04:33.869 INFO:tasks.workunit.client.0.smithi019.stdout:quota set for the bucket: buck_2024_08_12_00_04_33 2024-09-12T00:04:33.869 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:33.864+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:33.969 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:33.964+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:34.037 INFO:tasks.workunit.client.0.smithi019.stdout:quota enabled for the bucket: buck_2024_08_12_00_04_33 2024-09-12T00:04:34.037 INFO:tasks.workunit.client.0.smithi019.stdout:adding file to bucket: 10Mb. 2024-09-12T00:04:34.037 INFO:tasks.workunit.client.0.smithi019.stdout:upload file successful 2024-09-12T00:04:34.041 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:34.041 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:34.042 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:34.042 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:34.046 INFO:tasks.workunit.client.0.smithi019.stderr:1+0 records in 2024-09-12T00:04:34.047 INFO:tasks.workunit.client.0.smithi019.stderr:1+0 records out 2024-09-12T00:04:34.047 INFO:tasks.workunit.client.0.smithi019.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00817487 s, 1.3 GB/s 2024-09-12T00:04:34.057 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:04:34.100 INFO:tasks.workunit.client.0.smithi019.stdout:readding file to bucket: 10MBfile1 2024-09-12T00:04:34.100 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:04:34.100 INFO:tasks.workunit.client.0.smithi019.stdout:Test case: PASSED - set max objects and test beyond max objects passed 2024-09-12T00:04:34.100 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:04:34.101 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:34.096+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:34.171 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:34.168+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:34.221 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:34.221 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:34.221 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:34.221 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:34.221 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:34.234 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:04:34.272 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:34.270+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:34.373 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:34.370+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:34.386 INFO:tasks.workunit.client.0.smithi019.stdout:user qa_user deleted 2024-09-12T00:04:34.386 INFO:tasks.workunit.client.0.smithi019.stdout:bucket delete succeeded 2024-09-12T00:04:34.408 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:34.409 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:34.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:34.409 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:34.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.409 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4232.0:1 2.3 e20/19 2:c4c92e5a:::rbd_trash:head v 20'1, mlcod=0'0)", 2024-09-12T00:04:34.409 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:16.594343+0000", 2024-09-12T00:04:34.409 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.815639755999996, 2024-09-12T00:04:34.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030233460000000001, 2024-09-12T00:04:34.409 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:34.410 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:34.410 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:34.410 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:34.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:34.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594343+0000", 2024-09-12T00:04:34.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:34.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594343+0000", 2024-09-12T00:04:34.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.411 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:34.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594343+0000", 2024-09-12T00:04:34.411 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7e-07 2024-09-12T00:04:34.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.411 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:34.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594348+0000", 2024-09-12T00:04:34.411 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7899999999999999e-06 2024-09-12T00:04:34.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.411 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:34.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594366+0000", 2024-09-12T00:04:34.412 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8255000000000001e-05 2024-09-12T00:04:34.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.412 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.412 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:34.412 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594381+0000", 2024-09-12T00:04:34.412 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4905999999999999e-05 2024-09-12T00:04:34.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.412 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.412 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:34.412 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594710+0000", 2024-09-12T00:04:34.412 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000329208 2024-09-12T00:04:34.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.412 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:34.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594870+0000", 2024-09-12T00:04:34.413 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015991900000000001 2024-09-12T00:04:34.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.413 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:34.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597290+0000", 2024-09-12T00:04:34.413 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024196439999999999 2024-09-12T00:04:34.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.413 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:34.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597366+0000", 2024-09-12T00:04:34.413 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6254000000000005e-05 2024-09-12T00:04:34.414 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.414 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:34.414 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.414 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:56 7.3 e32/31 7:c609908c:::notify.5:head v 32'1, mlcod=0'0)", 2024-09-12T00:04:34.414 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.376429+0000", 2024-09-12T00:04:34.414 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.033553370999996, 2024-09-12T00:04:34.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029522699999999999, 2024-09-12T00:04:34.414 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:34.414 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:34.414 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:34.414 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:34.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:34.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376429+0000", 2024-09-12T00:04:34.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:34.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376429+0000", 2024-09-12T00:04:34.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:34.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376435+0000", 2024-09-12T00:04:34.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8619999999999999e-06 2024-09-12T00:04:34.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:34.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376445+0000", 2024-09-12T00:04:34.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7929999999999992e-06 2024-09-12T00:04:34.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:34.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376467+0000", 2024-09-12T00:04:34.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2840000000000002e-05 2024-09-12T00:04:34.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:34.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376481+0000", 2024-09-12T00:04:34.417 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3254e-05 2024-09-12T00:04:34.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.417 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:34.417 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376585+0000", 2024-09-12T00:04:34.417 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104066 2024-09-12T00:04:34.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.417 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:34.417 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376611+0000", 2024-09-12T00:04:34.417 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6641000000000001e-05 2024-09-12T00:04:34.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.417 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:34.418 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.379288+0000", 2024-09-12T00:04:34.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026761879999999999 2024-09-12T00:04:34.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.418 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.418 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:34.418 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.379381+0000", 2024-09-12T00:04:34.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3626000000000001e-05 2024-09-12T00:04:34.418 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.418 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:34.418 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.418 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.418 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:34.419 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.411707+0000", 2024-09-12T00:04:34.419 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 59.998275362999998, 2024-09-12T00:04:34.419 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0031684230000000001, 2024-09-12T00:04:34.419 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:34.419 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:34.419 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:34.419 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:34.419 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:34.419 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:34.419 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 217 2024-09-12T00:04:34.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.420 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:34.420 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.420 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:34.420 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411707+0000", 2024-09-12T00:04:34.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.420 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.420 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:34.420 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411707+0000", 2024-09-12T00:04:34.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.420 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.420 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:34.421 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411710+0000", 2024-09-12T00:04:34.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4599999999999999e-06 2024-09-12T00:04:34.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:34.421 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411740+0000", 2024-09-12T00:04:34.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.953e-05 2024-09-12T00:04:34.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:34.421 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411772+0000", 2024-09-12T00:04:34.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.163e-05 2024-09-12T00:04:34.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:34.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411789+0000", 2024-09-12T00:04:34.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7614000000000001e-05 2024-09-12T00:04:34.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:34.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411905+0000", 2024-09-12T00:04:34.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115665 2024-09-12T00:04:34.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:34.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.412108+0000", 2024-09-12T00:04:34.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020293500000000001 2024-09-12T00:04:34.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:34.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.412565+0000", 2024-09-12T00:04:34.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00045749700000000001 2024-09-12T00:04:34.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:34.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.414449+0000", 2024-09-12T00:04:34.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0018841859999999999 2024-09-12T00:04:34.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:34.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.414709+0000", 2024-09-12T00:04:34.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00025939399999999998 2024-09-12T00:04:34.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:34.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.414813+0000", 2024-09-12T00:04:34.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104366 2024-09-12T00:04:34.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:34.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.414875+0000", 2024-09-12T00:04:34.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2145999999999998e-05 2024-09-12T00:04:34.424 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.425 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:34.425 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.425 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:646 6.10 e35/29 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 35'1, mlcod=0'0)", 2024-09-12T00:04:34.425 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.597000+0000", 2024-09-12T00:04:34.425 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 59.812982234000003, 2024-09-12T00:04:34.425 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0044366320000000002, 2024-09-12T00:04:34.425 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:34.425 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:34.425 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:34.425 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:34.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.425 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:34.426 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597000+0000", 2024-09-12T00:04:34.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.426 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.426 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:34.426 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597000+0000", 2024-09-12T00:04:34.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.426 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.426 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:34.426 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597000+0000", 2024-09-12T00:04:34.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7700000000000001e-07 2024-09-12T00:04:34.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.426 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:34.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597004+0000", 2024-09-12T00:04:34.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7560000000000001e-06 2024-09-12T00:04:34.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:34.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597017+0000", 2024-09-12T00:04:34.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.33e-05 2024-09-12T00:04:34.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:34.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597024+0000", 2024-09-12T00:04:34.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8800000000000002e-06 2024-09-12T00:04:34.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.428 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:34.428 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597080+0000", 2024-09-12T00:04:34.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5949999999999998e-05 2024-09-12T00:04:34.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.428 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:34.428 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597093+0000", 2024-09-12T00:04:34.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2695e-05 2024-09-12T00:04:34.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.429 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:34.429 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601386+0000", 2024-09-12T00:04:34.429 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0042935480000000003 2024-09-12T00:04:34.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.429 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:34.429 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601437+0000", 2024-09-12T00:04:34.429 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0325999999999999e-05 2024-09-12T00:04:34.429 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.429 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:34.429 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.429 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:667 6.10 e35/29 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 35'2, mlcod=0'0)", 2024-09-12T00:04:34.430 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602975+0000", 2024-09-12T00:04:34.430 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 59.807007771999999, 2024-09-12T00:04:34.430 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040817340000000001, 2024-09-12T00:04:34.430 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:34.430 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:34.430 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:34.430 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:34.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.430 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:34.430 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602975+0000", 2024-09-12T00:04:34.430 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.430 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:34.431 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602975+0000", 2024-09-12T00:04:34.431 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.431 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.431 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.431 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:34.431 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602981+0000", 2024-09-12T00:04:34.431 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7939999999999997e-06 2024-09-12T00:04:34.431 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.431 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.431 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:34.431 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602988+0000", 2024-09-12T00:04:34.431 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5270000000000004e-06 2024-09-12T00:04:34.431 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.431 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.432 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:34.432 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603003+0000", 2024-09-12T00:04:34.432 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4731e-05 2024-09-12T00:04:34.432 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.432 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.432 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:34.432 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603009+0000", 2024-09-12T00:04:34.432 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.297e-06 2024-09-12T00:04:34.432 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.432 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.432 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:34.432 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603074+0000", 2024-09-12T00:04:34.432 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4713000000000002e-05 2024-09-12T00:04:34.432 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:34.433 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603090+0000", 2024-09-12T00:04:34.433 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6344000000000001e-05 2024-09-12T00:04:34.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:34.433 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607014+0000", 2024-09-12T00:04:34.433 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039241800000000002 2024-09-12T00:04:34.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:34.433 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607056+0000", 2024-09-12T00:04:34.433 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2147999999999997e-05 2024-09-12T00:04:34.434 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.434 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:34.434 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.434 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:669 6.1c e35/29 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 35'3, mlcod=0'0)", 2024-09-12T00:04:34.434 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.608370+0000", 2024-09-12T00:04:34.434 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 59.801612548000001, 2024-09-12T00:04:34.434 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046099820000000003, 2024-09-12T00:04:34.434 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:34.434 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:34.434 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:34.434 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:34.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.435 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:34.435 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608370+0000", 2024-09-12T00:04:34.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.435 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:34.435 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608370+0000", 2024-09-12T00:04:34.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.435 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:34.435 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608371+0000", 2024-09-12T00:04:34.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8100000000000001e-07 2024-09-12T00:04:34.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.436 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.436 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:34.436 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608377+0000", 2024-09-12T00:04:34.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7349999999999999e-06 2024-09-12T00:04:34.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.436 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.436 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:34.436 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608395+0000", 2024-09-12T00:04:34.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7285000000000001e-05 2024-09-12T00:04:34.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.436 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.436 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:34.436 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608401+0000", 2024-09-12T00:04:34.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.365e-06 2024-09-12T00:04:34.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.437 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:34.437 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608463+0000", 2024-09-12T00:04:34.437 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2246e-05 2024-09-12T00:04:34.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.437 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:34.437 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608489+0000", 2024-09-12T00:04:34.437 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5222999999999999e-05 2024-09-12T00:04:34.438 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.438 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.438 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:34.438 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612945+0000", 2024-09-12T00:04:34.438 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004456603 2024-09-12T00:04:34.438 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.438 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.438 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:34.438 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612980+0000", 2024-09-12T00:04:34.438 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4544e-05 2024-09-12T00:04:34.438 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.438 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:34.439 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.439 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.439 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:682 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'4, mlcod=35'1)", 2024-09-12T00:04:34.439 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.612014+0000", 2024-09-12T00:04:34.439 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 59.797968144999999, 2024-09-12T00:04:34.439 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036839749999999999, 2024-09-12T00:04:34.439 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:34.439 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:34.439 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:34.439 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:34.439 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.439 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:34.440 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612014+0000", 2024-09-12T00:04:34.440 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.440 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.440 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:34.440 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612014+0000", 2024-09-12T00:04:34.440 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.440 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.440 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:34.440 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612015+0000", 2024-09-12T00:04:34.440 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0419999999999999e-06 2024-09-12T00:04:34.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.441 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.441 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:34.441 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612021+0000", 2024-09-12T00:04:34.441 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0009999999999998e-06 2024-09-12T00:04:34.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.441 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.441 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:34.441 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612035+0000", 2024-09-12T00:04:34.441 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.412e-05 2024-09-12T00:04:34.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.441 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.441 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:34.441 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612043+0000", 2024-09-12T00:04:34.442 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9699999999999999e-06 2024-09-12T00:04:34.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.442 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:34.442 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612111+0000", 2024-09-12T00:04:34.442 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7985999999999996e-05 2024-09-12T00:04:34.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.442 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:34.442 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612126+0000", 2024-09-12T00:04:34.442 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5099000000000001e-05 2024-09-12T00:04:34.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.443 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:34.443 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.615633+0000", 2024-09-12T00:04:34.443 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003506416 2024-09-12T00:04:34.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.443 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.443 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:34.443 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.615698+0000", 2024-09-12T00:04:34.443 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5340999999999997e-05 2024-09-12T00:04:34.443 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.443 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:34.443 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.443 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.443 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:768 6.15 6:ae95b544:::obj_delete_at_hint.0000000020:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:34.444 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.642525+0000", 2024-09-12T00:04:34.444 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 59.767457143000001, 2024-09-12T00:04:34.444 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048019760000000003, 2024-09-12T00:04:34.444 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:34.444 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:34.444 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:34.444 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:34.444 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:34.444 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:34.444 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 768 2024-09-12T00:04:34.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.444 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:34.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.444 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:34.445 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642525+0000", 2024-09-12T00:04:34.445 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.445 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.445 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:34.445 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642525+0000", 2024-09-12T00:04:34.445 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.445 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.445 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:34.445 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642526+0000", 2024-09-12T00:04:34.445 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3629999999999999e-06 2024-09-12T00:04:34.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.446 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.446 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:34.446 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642533+0000", 2024-09-12T00:04:34.446 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.64e-06 2024-09-12T00:04:34.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.446 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.446 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:34.446 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642549+0000", 2024-09-12T00:04:34.446 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5911000000000001e-05 2024-09-12T00:04:34.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.446 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.446 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:34.446 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642558+0000", 2024-09-12T00:04:34.446 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7420000000000003e-06 2024-09-12T00:04:34.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.447 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:34.447 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642628+0000", 2024-09-12T00:04:34.447 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0408999999999996e-05 2024-09-12T00:04:34.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.447 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:34.447 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642721+0000", 2024-09-12T00:04:34.447 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2888999999999998e-05 2024-09-12T00:04:34.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.447 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:34.447 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642914+0000", 2024-09-12T00:04:34.448 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000192945 2024-09-12T00:04:34.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.448 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.448 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:34.448 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.644463+0000", 2024-09-12T00:04:34.448 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001548848 2024-09-12T00:04:34.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.448 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.448 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:34.448 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.647249+0000", 2024-09-12T00:04:34.448 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027862989999999999 2024-09-12T00:04:34.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.448 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.448 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:34.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.647285+0000", 2024-09-12T00:04:34.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6210000000000001e-05 2024-09-12T00:04:34.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.449 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:34.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.647327+0000", 2024-09-12T00:04:34.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.172e-05 2024-09-12T00:04:34.449 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.449 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:34.449 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.449 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:850 6.15 6:abd89f08:lc::lc.23:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:34.450 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.673328+0000", 2024-09-12T00:04:34.450 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 59.736654409000003, 2024-09-12T00:04:34.450 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047245300000000002, 2024-09-12T00:04:34.450 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:34.450 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:34.450 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:34.450 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:34.450 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:34.450 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:34.450 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 850 2024-09-12T00:04:34.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.450 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:34.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:34.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673328+0000", 2024-09-12T00:04:34.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.451 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:34.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673328+0000", 2024-09-12T00:04:34.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.451 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:34.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673329+0000", 2024-09-12T00:04:34.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5799999999999998e-07 2024-09-12T00:04:34.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.452 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:34.452 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673333+0000", 2024-09-12T00:04:34.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5990000000000004e-06 2024-09-12T00:04:34.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.452 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:34.452 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673345+0000", 2024-09-12T00:04:34.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1637999999999999e-05 2024-09-12T00:04:34.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.452 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:34.452 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673353+0000", 2024-09-12T00:04:34.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4610000000000002e-06 2024-09-12T00:04:34.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.453 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:34.453 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673417+0000", 2024-09-12T00:04:34.453 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4951999999999997e-05 2024-09-12T00:04:34.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.453 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:34.453 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673521+0000", 2024-09-12T00:04:34.453 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103881 2024-09-12T00:04:34.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.453 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:34.453 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673729+0000", 2024-09-12T00:04:34.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020730600000000001 2024-09-12T00:04:34.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.454 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:34.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674901+0000", 2024-09-12T00:04:34.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011728140000000001 2024-09-12T00:04:34.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.454 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:34.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.677953+0000", 2024-09-12T00:04:34.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030517959999999998 2024-09-12T00:04:34.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.455 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:34.455 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.677997+0000", 2024-09-12T00:04:34.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3346999999999997e-05 2024-09-12T00:04:34.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.455 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:34.455 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.678052+0000", 2024-09-12T00:04:34.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5778e-05 2024-09-12T00:04:34.455 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.455 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:34.455 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.455 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:919 6.15 6:abd89f08:lc::lc.23:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:34.456 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.695743+0000", 2024-09-12T00:04:34.456 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 59.714239005000003, 2024-09-12T00:04:34.456 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027955689999999999, 2024-09-12T00:04:34.456 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:34.456 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:34.456 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:34.456 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:34.456 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:34.456 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:34.456 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 919 2024-09-12T00:04:34.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.456 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:34.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:34.457 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695743+0000", 2024-09-12T00:04:34.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.457 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.457 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:34.457 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695743+0000", 2024-09-12T00:04:34.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.457 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.457 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:34.457 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695745+0000", 2024-09-12T00:04:34.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.412e-06 2024-09-12T00:04:34.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.457 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.458 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:34.458 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695752+0000", 2024-09-12T00:04:34.458 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0249999999999997e-06 2024-09-12T00:04:34.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.458 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.458 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:34.458 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695767+0000", 2024-09-12T00:04:34.458 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5787999999999999e-05 2024-09-12T00:04:34.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.458 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.458 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:34.458 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695775+0000", 2024-09-12T00:04:34.458 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3590000000000002e-06 2024-09-12T00:04:34.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.459 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:34.459 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695844+0000", 2024-09-12T00:04:34.459 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9522000000000003e-05 2024-09-12T00:04:34.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.459 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:34.459 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.695912+0000", 2024-09-12T00:04:34.459 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7689999999999997e-05 2024-09-12T00:04:34.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.459 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:34.459 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.696117+0000", 2024-09-12T00:04:34.460 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020478900000000001 2024-09-12T00:04:34.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.460 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:34.460 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.696681+0000", 2024-09-12T00:04:34.460 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00056375200000000005 2024-09-12T00:04:34.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.460 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:34.460 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698408+0000", 2024-09-12T00:04:34.460 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017273659999999999 2024-09-12T00:04:34.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.460 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:34.461 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698484+0000", 2024-09-12T00:04:34.461 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6329999999999996e-05 2024-09-12T00:04:34.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.461 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:34.461 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698539+0000", 2024-09-12T00:04:34.461 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4536000000000001e-05 2024-09-12T00:04:34.461 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.461 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:34.461 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.461 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1296 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:34.462 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:35.222414+0000", 2024-09-12T00:04:34.462 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 59.187568325000001, 2024-09-12T00:04:34.462 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027841290000000002, 2024-09-12T00:04:34.462 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:34.462 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:34.462 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:34.462 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:34.462 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:34.462 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:34.462 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1296 2024-09-12T00:04:34.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.462 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:34.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.462 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:34.462 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222414+0000", 2024-09-12T00:04:34.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.463 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:34.463 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222414+0000", 2024-09-12T00:04:34.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.463 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:34.463 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222418+0000", 2024-09-12T00:04:34.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.563e-06 2024-09-12T00:04:34.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.463 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:34.464 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222434+0000", 2024-09-12T00:04:34.464 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6220000000000001e-05 2024-09-12T00:04:34.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.464 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:34.464 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222469+0000", 2024-09-12T00:04:34.464 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4892999999999999e-05 2024-09-12T00:04:34.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.464 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:34.464 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222492+0000", 2024-09-12T00:04:34.464 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2963999999999999e-05 2024-09-12T00:04:34.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.465 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:34.465 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222629+0000", 2024-09-12T00:04:34.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013722499999999999 2024-09-12T00:04:34.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.465 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:34.465 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.222863+0000", 2024-09-12T00:04:34.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023409799999999999 2024-09-12T00:04:34.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.465 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:34.465 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.223212+0000", 2024-09-12T00:04:34.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00034954700000000002 2024-09-12T00:04:34.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.466 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:34.466 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.224374+0000", 2024-09-12T00:04:34.466 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011611620000000001 2024-09-12T00:04:34.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.466 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:34.466 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.225040+0000", 2024-09-12T00:04:34.466 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00066678500000000003 2024-09-12T00:04:34.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.467 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:34.467 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.225130+0000", 2024-09-12T00:04:34.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9813000000000002e-05 2024-09-12T00:04:34.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.467 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:34.467 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.225198+0000", 2024-09-12T00:04:34.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7859000000000002e-05 2024-09-12T00:04:34.467 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.467 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:34.467 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.468 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1298 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:34.468 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:35.226143+0000", 2024-09-12T00:04:34.468 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 59.183839083000002, 2024-09-12T00:04:34.468 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025053409999999999, 2024-09-12T00:04:34.468 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:34.468 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:34.468 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:34.468 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:34.468 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:34.468 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:34.468 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1298 2024-09-12T00:04:34.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.468 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:34.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:34.469 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226143+0000", 2024-09-12T00:04:34.469 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:34.469 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226143+0000", 2024-09-12T00:04:34.469 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:34.469 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226145+0000", 2024-09-12T00:04:34.469 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7859999999999999e-06 2024-09-12T00:04:34.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.470 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:34.470 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226156+0000", 2024-09-12T00:04:34.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.059e-05 2024-09-12T00:04:34.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.470 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:34.470 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226181+0000", 2024-09-12T00:04:34.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4980000000000001e-05 2024-09-12T00:04:34.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.470 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:34.470 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226202+0000", 2024-09-12T00:04:34.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0993e-05 2024-09-12T00:04:34.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.471 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:34.471 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226309+0000", 2024-09-12T00:04:34.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000107793 2024-09-12T00:04:34.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.471 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:34.471 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226437+0000", 2024-09-12T00:04:34.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012733199999999999 2024-09-12T00:04:34.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.471 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:34.471 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.226707+0000", 2024-09-12T00:04:34.472 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00027011199999999998 2024-09-12T00:04:34.472 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.472 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.472 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:34.472 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.227865+0000", 2024-09-12T00:04:34.472 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001157744 2024-09-12T00:04:34.472 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.472 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.472 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:34.472 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.228507+0000", 2024-09-12T00:04:34.472 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00064225800000000004 2024-09-12T00:04:34.472 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.472 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.473 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:34.473 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.228588+0000", 2024-09-12T00:04:34.473 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0927000000000006e-05 2024-09-12T00:04:34.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.473 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.473 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:34.473 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:35.228649+0000", 2024-09-12T00:04:34.473 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0825999999999997e-05 2024-09-12T00:04:34.473 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.473 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:34.473 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.473 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.473 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1641 3.26 3:658fe58e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2__shadow_.hDHTDpIswwqRA2bHiHVxkhWqZde6XEj_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:34.474 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:04:34.474 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.3536961080000001, 2024-09-12T00:04:34.474 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017888905, 2024-09-12T00:04:34.474 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:34.474 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:34.474 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:34.474 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:34.474 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:34.474 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:34.474 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1641 2024-09-12T00:04:34.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.474 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:34.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.474 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:34.474 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:04:34.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.475 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:34.475 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:04:34.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.475 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:34.475 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056289+0000", 2024-09-12T00:04:34.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5349999999999999e-06 2024-09-12T00:04:34.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.475 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:34.476 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058595+0000", 2024-09-12T00:04:34.476 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002306083 2024-09-12T00:04:34.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.476 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.476 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:34.476 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058621+0000", 2024-09-12T00:04:34.476 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6431000000000002e-05 2024-09-12T00:04:34.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.476 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.476 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:34.476 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058631+0000", 2024-09-12T00:04:34.476 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0166000000000001e-05 2024-09-12T00:04:34.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.477 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:34.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058712+0000", 2024-09-12T00:04:34.477 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0122000000000003e-05 2024-09-12T00:04:34.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.477 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:34.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058821+0000", 2024-09-12T00:04:34.477 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010907400000000001 2024-09-12T00:04:34.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.477 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:34.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058910+0000", 2024-09-12T00:04:34.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9523000000000003e-05 2024-09-12T00:04:34.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.478 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:34.478 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073881+0000", 2024-09-12T00:04:34.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014971224 2024-09-12T00:04:34.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.478 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:34.478 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074101+0000", 2024-09-12T00:04:34.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0002195 2024-09-12T00:04:34.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.479 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:34.479 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074133+0000", 2024-09-12T00:04:34.479 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2138000000000003e-05 2024-09-12T00:04:34.479 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.479 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.479 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:34.479 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074175+0000", 2024-09-12T00:04:34.479 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2109e-05 2024-09-12T00:04:34.479 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.479 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:34.479 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.479 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.479 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.479 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1642 3.20 3:07bca365:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2__shadow_.hDHTDpIswwqRA2bHiHVxkhWqZde6XEj_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:34.480 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.060666+0000", 2024-09-12T00:04:34.480 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.349316682, 2024-09-12T00:04:34.480 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013097882, 2024-09-12T00:04:34.480 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:34.480 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:34.480 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:34.480 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:34.480 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:34.480 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:34.480 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1642 2024-09-12T00:04:34.480 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.480 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:34.481 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.481 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:34.481 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.060666+0000", 2024-09-12T00:04:34.481 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.481 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.481 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:34.481 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.060666+0000", 2024-09-12T00:04:34.481 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.481 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.481 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:34.481 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.060668+0000", 2024-09-12T00:04:34.482 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.728e-06 2024-09-12T00:04:34.482 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.482 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.482 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:34.482 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061720+0000", 2024-09-12T00:04:34.482 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0010517160000000001 2024-09-12T00:04:34.482 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.482 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.482 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:34.482 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061736+0000", 2024-09-12T00:04:34.482 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6181999999999999e-05 2024-09-12T00:04:34.482 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.482 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.483 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:34.483 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061744+0000", 2024-09-12T00:04:34.483 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5959999999999998e-06 2024-09-12T00:04:34.483 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.483 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.483 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:34.483 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061838+0000", 2024-09-12T00:04:34.483 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.4658000000000001e-05 2024-09-12T00:04:34.483 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.483 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.483 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:34.483 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.062005+0000", 2024-09-12T00:04:34.483 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000166529 2024-09-12T00:04:34.484 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.484 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.484 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:34.484 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.062175+0000", 2024-09-12T00:04:34.484 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000170182 2024-09-12T00:04:34.484 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.484 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.484 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:34.484 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.071854+0000", 2024-09-12T00:04:34.484 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0096790339999999996 2024-09-12T00:04:34.484 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.484 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.484 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:34.484 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073661+0000", 2024-09-12T00:04:34.485 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001806738 2024-09-12T00:04:34.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.485 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.485 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:34.485 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073708+0000", 2024-09-12T00:04:34.485 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7351000000000001e-05 2024-09-12T00:04:34.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.485 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.485 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:34.485 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073763+0000", 2024-09-12T00:04:34.485 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5167999999999998e-05 2024-09-12T00:04:34.485 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.485 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:34.485 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.486 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.486 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1752 4.1b 4:d867e322:::.dir.b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:34.486 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.614859+0000", 2024-09-12T00:04:34.486 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.79512345299999998, 2024-09-12T00:04:34.486 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057820520000000002, 2024-09-12T00:04:34.486 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:34.486 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:34.486 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:34.486 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:34.486 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:34.486 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:34.486 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1752 2024-09-12T00:04:34.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.487 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:34.487 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.487 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:34.487 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.614859+0000", 2024-09-12T00:04:34.487 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.487 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.487 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.487 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:34.487 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.614859+0000", 2024-09-12T00:04:34.487 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.487 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.487 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.487 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:34.487 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.614859+0000", 2024-09-12T00:04:34.488 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8100000000000003e-07 2024-09-12T00:04:34.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.488 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.488 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:34.488 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.614864+0000", 2024-09-12T00:04:34.488 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1080000000000003e-06 2024-09-12T00:04:34.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.488 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.488 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:34.488 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.614872+0000", 2024-09-12T00:04:34.488 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8419999999999994e-06 2024-09-12T00:04:34.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.488 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.489 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:34.489 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.614884+0000", 2024-09-12T00:04:34.489 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1592e-05 2024-09-12T00:04:34.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.489 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.489 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:34.489 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.614995+0000", 2024-09-12T00:04:34.489 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110599 2024-09-12T00:04:34.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.489 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.489 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:34.489 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.615114+0000", 2024-09-12T00:04:34.489 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011910500000000001 2024-09-12T00:04:34.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.490 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.490 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:34.490 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.615257+0000", 2024-09-12T00:04:34.490 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014299899999999999 2024-09-12T00:04:34.490 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.490 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.490 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:34.490 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.616621+0000", 2024-09-12T00:04:34.490 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001364107 2024-09-12T00:04:34.490 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.490 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.490 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:34.490 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.620537+0000", 2024-09-12T00:04:34.490 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039166169999999998 2024-09-12T00:04:34.491 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.491 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.491 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:34.491 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.620598+0000", 2024-09-12T00:04:34.491 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0424000000000003e-05 2024-09-12T00:04:34.491 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.491 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.491 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:34.491 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.620641+0000", 2024-09-12T00:04:34.491 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3078000000000003e-05 2024-09-12T00:04:34.491 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.491 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:34.491 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.491 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.492 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.492 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1754 8.5 e58/33 8:a4bd5286:root::.bucket.meta.buck_2024_08_12_00_04_33%3ab5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3:head v 58'1, mlcod=0'0)", 2024-09-12T00:04:34.492 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.621874+0000", 2024-09-12T00:04:34.492 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.78810820599999998, 2024-09-12T00:04:34.492 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003110055, 2024-09-12T00:04:34.492 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:34.492 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:34.492 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:34.492 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:34.492 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.492 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:34.492 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621874+0000", 2024-09-12T00:04:34.492 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.492 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.493 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.493 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:34.493 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621874+0000", 2024-09-12T00:04:34.493 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.493 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.493 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:34.493 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621875+0000", 2024-09-12T00:04:34.493 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8100000000000002e-07 2024-09-12T00:04:34.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.493 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.493 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:34.493 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621881+0000", 2024-09-12T00:04:34.493 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0519999999999998e-06 2024-09-12T00:04:34.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.494 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:34.494 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621892+0000", 2024-09-12T00:04:34.494 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1593000000000001e-05 2024-09-12T00:04:34.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.494 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:34.494 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621898+0000", 2024-09-12T00:04:34.494 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0150000000000003e-06 2024-09-12T00:04:34.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.494 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:34.494 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621960+0000", 2024-09-12T00:04:34.495 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2528999999999997e-05 2024-09-12T00:04:34.495 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.495 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.495 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:34.495 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621979+0000", 2024-09-12T00:04:34.495 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8580000000000002e-05 2024-09-12T00:04:34.495 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.495 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.495 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:34.495 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.624931+0000", 2024-09-12T00:04:34.495 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029521360000000002 2024-09-12T00:04:34.495 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.495 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.495 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:34.496 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.624984+0000", 2024-09-12T00:04:34.496 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3368999999999997e-05 2024-09-12T00:04:34.496 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.496 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:34.496 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.496 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.496 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.496 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1775 3.30 e58/23 3:0c2ae78d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_1:head v 58'1, mlcod=0'0)", 2024-09-12T00:04:34.496 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:04:34.496 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.40822114799999998, 2024-09-12T00:04:34.496 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017585038000000001, 2024-09-12T00:04:34.496 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:34.496 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:34.497 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:34.497 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:34.497 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.497 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:34.497 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:04:34.497 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.497 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.497 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.497 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:34.497 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:04:34.497 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.497 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.497 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.498 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:34.498 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001763+0000", 2024-09-12T00:04:34.498 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2730000000000001e-06 2024-09-12T00:04:34.498 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.498 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.498 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:34.498 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005217+0000", 2024-09-12T00:04:34.498 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0034533810000000002 2024-09-12T00:04:34.498 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.498 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.498 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:34.498 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005241+0000", 2024-09-12T00:04:34.498 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4403e-05 2024-09-12T00:04:34.498 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.499 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.499 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:34.499 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005253+0000", 2024-09-12T00:04:34.499 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2007e-05 2024-09-12T00:04:34.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.499 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.499 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:34.499 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005324+0000", 2024-09-12T00:04:34.499 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0765000000000004e-05 2024-09-12T00:04:34.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.499 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.499 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:34.499 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005348+0000", 2024-09-12T00:04:34.500 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3762000000000001e-05 2024-09-12T00:04:34.500 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.500 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.500 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:34.500 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019291+0000", 2024-09-12T00:04:34.500 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013943707 2024-09-12T00:04:34.500 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.500 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.500 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:34.500 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019346+0000", 2024-09-12T00:04:34.500 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4740000000000001e-05 2024-09-12T00:04:34.500 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.500 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:34.500 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.501 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.501 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.501 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1780 3.16 3:69d8ee52:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:34.501 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:04:34.501 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.386612236, 2024-09-12T00:04:34.501 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016232362, 2024-09-12T00:04:34.501 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:34.501 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:34.501 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:34.501 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:34.501 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:34.501 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:34.501 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1780 2024-09-12T00:04:34.501 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.502 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:34.502 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.502 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:34.502 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:04:34.502 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.502 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.502 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.502 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:34.502 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:04:34.502 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.502 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.502 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.502 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:34.502 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023372+0000", 2024-09-12T00:04:34.503 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0209999999999998e-06 2024-09-12T00:04:34.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.504 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.504 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:34.505 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024447+0000", 2024-09-12T00:04:34.505 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0010749550000000001 2024-09-12T00:04:34.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.505 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.505 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:34.505 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024473+0000", 2024-09-12T00:04:34.505 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5689000000000001e-05 2024-09-12T00:04:34.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.505 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.505 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:34.505 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024484+0000", 2024-09-12T00:04:34.505 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1153e-05 2024-09-12T00:04:34.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.505 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.506 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:34.506 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024547+0000", 2024-09-12T00:04:34.506 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3400999999999998e-05 2024-09-12T00:04:34.506 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.506 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.506 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:34.506 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024669+0000", 2024-09-12T00:04:34.506 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012184999999999999 2024-09-12T00:04:34.506 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.506 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.506 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:34.506 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025014+0000", 2024-09-12T00:04:34.506 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000344505 2024-09-12T00:04:34.506 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.507 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.507 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:34.507 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039161+0000", 2024-09-12T00:04:34.507 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014147799000000001 2024-09-12T00:04:34.507 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.507 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.507 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:34.507 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039434+0000", 2024-09-12T00:04:34.507 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00027254699999999999 2024-09-12T00:04:34.507 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.507 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.507 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:34.507 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039521+0000", 2024-09-12T00:04:34.507 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6663999999999996e-05 2024-09-12T00:04:34.508 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.508 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.508 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:34.508 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039602+0000", 2024-09-12T00:04:34.508 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1778000000000002e-05 2024-09-12T00:04:34.508 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.508 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:34.508 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.508 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.508 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.508 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1866 4.1 4:81d6abbb:::.dir.b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:34.508 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.377502+0000", 2024-09-12T00:04:34.508 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.032480533999999998, 2024-09-12T00:04:34.508 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027496119999999998, 2024-09-12T00:04:34.509 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:34.509 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:34.509 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:34.509 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:34.509 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:34.509 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:34.509 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1866 2024-09-12T00:04:34.509 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.509 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:34.509 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.509 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:34.509 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377502+0000", 2024-09-12T00:04:34.509 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.510 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.510 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:34.510 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377502+0000", 2024-09-12T00:04:34.510 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.510 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.510 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:34.510 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377503+0000", 2024-09-12T00:04:34.510 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3090000000000001e-06 2024-09-12T00:04:34.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.510 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.510 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:34.510 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377509+0000", 2024-09-12T00:04:34.511 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9660000000000001e-06 2024-09-12T00:04:34.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.511 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.511 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:34.511 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377524+0000", 2024-09-12T00:04:34.511 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.451e-05 2024-09-12T00:04:34.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.511 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.511 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:34.511 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377531+0000", 2024-09-12T00:04:34.511 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8769999999999993e-06 2024-09-12T00:04:34.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.511 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.512 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:34.512 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377624+0000", 2024-09-12T00:04:34.512 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2249000000000004e-05 2024-09-12T00:04:34.512 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.512 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.512 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:34.512 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377698+0000", 2024-09-12T00:04:34.512 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4204999999999999e-05 2024-09-12T00:04:34.512 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.512 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.512 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:34.512 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377792+0000", 2024-09-12T00:04:34.512 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.4618999999999997e-05 2024-09-12T00:04:34.512 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.513 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.513 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:34.513 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.378462+0000", 2024-09-12T00:04:34.513 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00066923600000000003 2024-09-12T00:04:34.513 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.513 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.513 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:34.513 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.380136+0000", 2024-09-12T00:04:34.513 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0016747050000000001 2024-09-12T00:04:34.513 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.513 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.513 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:34.513 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.380187+0000", 2024-09-12T00:04:34.513 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0426000000000001e-05 2024-09-12T00:04:34.514 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.514 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.514 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:34.514 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.380251+0000", 2024-09-12T00:04:34.514 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4510000000000004e-05 2024-09-12T00:04:34.514 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.514 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:34.514 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.514 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.514 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.514 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1871 4.1b 4:d867e322:::.dir.b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:34.514 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.377553+0000", 2024-09-12T00:04:34.514 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.032429156000000001, 2024-09-12T00:04:34.514 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0081380240000000006, 2024-09-12T00:04:34.515 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:34.515 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:34.515 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:34.515 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:34.515 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:34.515 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:34.515 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1871 2024-09-12T00:04:34.515 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.515 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:34.515 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.515 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:34.515 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377553+0000", 2024-09-12T00:04:34.515 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.515 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.516 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.516 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:34.516 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377553+0000", 2024-09-12T00:04:34.516 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:34.516 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.516 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.516 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:34.516 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377554+0000", 2024-09-12T00:04:34.516 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2900000000000004e-07 2024-09-12T00:04:34.516 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.516 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.516 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:34.516 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377556+0000", 2024-09-12T00:04:34.516 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7420000000000002e-06 2024-09-12T00:04:34.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.517 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.517 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:34.517 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377566+0000", 2024-09-12T00:04:34.517 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2110000000000004e-06 2024-09-12T00:04:34.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.517 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.517 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:34.517 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377572+0000", 2024-09-12T00:04:34.517 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9209999999999997e-06 2024-09-12T00:04:34.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.517 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.517 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:34.517 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377628+0000", 2024-09-12T00:04:34.518 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6433e-05 2024-09-12T00:04:34.518 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.518 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.518 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:34.518 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377709+0000", 2024-09-12T00:04:34.518 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1371000000000004e-05 2024-09-12T00:04:34.518 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.518 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.518 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:34.518 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377813+0000", 2024-09-12T00:04:34.518 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104162 2024-09-12T00:04:34.518 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.518 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.518 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:34.519 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.379948+0000", 2024-09-12T00:04:34.519 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002134815 2024-09-12T00:04:34.519 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.519 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.519 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:34.519 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.385636+0000", 2024-09-12T00:04:34.519 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056879330000000001 2024-09-12T00:04:34.519 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.519 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.519 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:34.519 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.385666+0000", 2024-09-12T00:04:34.519 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.953e-05 2024-09-12T00:04:34.519 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:34.519 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:34.520 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:34.520 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.385691+0000", 2024-09-12T00:04:34.520 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5377000000000001e-05 2024-09-12T00:04:34.520 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.520 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:34.520 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.520 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:34.520 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:34.520 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:34.521 INFO:tasks.workunit.client.0.smithi019.stderr:1+0 records in 2024-09-12T00:04:34.521 INFO:tasks.workunit.client.0.smithi019.stderr:1+0 records out 2024-09-12T00:04:34.521 INFO:tasks.workunit.client.0.smithi019.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0191377 s, 548 MB/s 2024-09-12T00:04:34.522 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:04:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T00:04:34.524 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:34.522+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:34.609 INFO:tasks.workunit.client.0.smithi019.stdout:Bucket Created: buck_2024_08_12_00_04_34 2024-09-12T00:04:34.625 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:34.622+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:34.685 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:34.685 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:34.686 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:34.686 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:34.699 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:04:34.745 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:34.744+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:34.817 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:34.817 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:34.817 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:34.817 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:34.817 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:34.827 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:34.824+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:34.832 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:04:34.920 INFO:tasks.workunit.client.0.smithi019.stdout:bucket quota max_objs set for the given user: buck_2024_08_12_00_04_34 2024-09-12T00:04:34.928 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:34.926+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:35.004 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:35.004 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:35.004 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:35.004 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:35.004 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.004 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4232.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-12T00:04:35.004 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:04:35.004 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 78.456945105000003, 2024-09-12T00:04:35.005 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.049385680000000001, 2024-09-12T00:04:35.005 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:35.005 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:35.005 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:35.005 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:35.005 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4232", 2024-09-12T00:04:35.005 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/3037249369", 2024-09-12T00:04:35.005 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:04:35.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.005 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:35.005 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.005 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:35.006 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:04:35.006 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.006 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.006 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:35.006 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:04:35.006 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.006 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.006 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:35.006 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548454+0000", 2024-09-12T00:04:35.006 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2259999999999999e-06 2024-09-12T00:04:35.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.007 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.007 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:35.007 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548466+0000", 2024-09-12T00:04:35.007 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1361e-05 2024-09-12T00:04:35.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.007 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.007 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:35.007 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548492+0000", 2024-09-12T00:04:35.008 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6225999999999999e-05 2024-09-12T00:04:35.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.008 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.008 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:35.008 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548509+0000", 2024-09-12T00:04:35.008 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7452000000000002e-05 2024-09-12T00:04:35.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.008 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.008 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.008 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549371+0000", 2024-09-12T00:04:35.008 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00086204300000000005 2024-09-12T00:04:35.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.008 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.009 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:35.009 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549396+0000", 2024-09-12T00:04:35.009 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.51e-05 2024-09-12T00:04:35.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.010 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.010 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.010 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593253+0000", 2024-09-12T00:04:35.010 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.043856248 2024-09-12T00:04:35.010 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.010 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.010 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:35.010 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593517+0000", 2024-09-12T00:04:35.010 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026439299999999997 2024-09-12T00:04:35.010 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.010 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.010 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:35.010 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594046+0000", 2024-09-12T00:04:35.011 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00052854200000000001 2024-09-12T00:04:35.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.011 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.011 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:35.011 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597642+0000", 2024-09-12T00:04:35.011 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0035959070000000002 2024-09-12T00:04:35.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.011 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.011 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:35.011 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597670+0000", 2024-09-12T00:04:35.011 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8235999999999999e-05 2024-09-12T00:04:35.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.011 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.012 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:35.012 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597754+0000", 2024-09-12T00:04:35.012 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4009000000000002e-05 2024-09-12T00:04:35.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.012 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.012 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:35.012 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597833+0000", 2024-09-12T00:04:35.012 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8937000000000007e-05 2024-09-12T00:04:35.012 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.012 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:35.012 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.013 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.013 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4232.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-12T00:04:35.013 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:17.547042+0000", 2024-09-12T00:04:35.013 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 77.458349951000002, 2024-09-12T00:04:35.013 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011713866, 2024-09-12T00:04:35.013 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:35.013 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:35.013 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:35.013 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:35.013 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4232", 2024-09-12T00:04:35.013 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/3037249369", 2024-09-12T00:04:35.013 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 5 2024-09-12T00:04:35.013 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.014 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:35.014 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.014 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:35.014 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547042+0000", 2024-09-12T00:04:35.014 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.014 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.014 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.014 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:35.014 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547042+0000", 2024-09-12T00:04:35.014 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.014 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.014 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.014 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:35.014 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547048+0000", 2024-09-12T00:04:35.015 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3639999999999998e-06 2024-09-12T00:04:35.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.015 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.015 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:35.015 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547078+0000", 2024-09-12T00:04:35.015 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.029e-05 2024-09-12T00:04:35.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.015 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.015 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:35.015 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547135+0000", 2024-09-12T00:04:35.015 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7299000000000001e-05 2024-09-12T00:04:35.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.015 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.015 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:35.016 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547159+0000", 2024-09-12T00:04:35.016 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3470000000000001e-05 2024-09-12T00:04:35.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.016 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.016 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.016 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547408+0000", 2024-09-12T00:04:35.016 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024930800000000001 2024-09-12T00:04:35.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.016 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.016 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:35.016 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547419+0000", 2024-09-12T00:04:35.016 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1316e-05 2024-09-12T00:04:35.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.017 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.017 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.017 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.555594+0000", 2024-09-12T00:04:35.017 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0081748129999999995 2024-09-12T00:04:35.017 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.017 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.017 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:35.017 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.555811+0000", 2024-09-12T00:04:35.017 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021711199999999999 2024-09-12T00:04:35.017 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.017 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.017 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:35.017 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.556013+0000", 2024-09-12T00:04:35.018 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020175099999999999 2024-09-12T00:04:35.018 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.018 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.018 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:35.018 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.557402+0000", 2024-09-12T00:04:35.018 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0013890269999999999 2024-09-12T00:04:35.018 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.018 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.018 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:35.018 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.558483+0000", 2024-09-12T00:04:35.018 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001081128 2024-09-12T00:04:35.018 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.018 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.018 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:35.019 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.558636+0000", 2024-09-12T00:04:35.019 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015267500000000001 2024-09-12T00:04:35.019 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.019 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.019 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:35.019 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.558756+0000", 2024-09-12T00:04:35.019 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000120313 2024-09-12T00:04:35.019 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.019 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:35.019 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.019 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.019 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.019 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4232.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-09-12T00:04:35.020 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:18.562030+0000", 2024-09-12T00:04:35.020 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 76.443361761000006, 2024-09-12T00:04:35.020 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0073448150000000002, 2024-09-12T00:04:35.020 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:35.020 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:35.020 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:35.020 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:35.020 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4232", 2024-09-12T00:04:35.020 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/3037249369", 2024-09-12T00:04:35.020 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 7 2024-09-12T00:04:35.020 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.020 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:35.020 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.021 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:35.021 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562030+0000", 2024-09-12T00:04:35.021 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.021 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.021 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:35.021 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562030+0000", 2024-09-12T00:04:35.021 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.021 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.021 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:35.021 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562034+0000", 2024-09-12T00:04:35.021 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6069999999999999e-06 2024-09-12T00:04:35.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.022 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.022 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:35.022 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562051+0000", 2024-09-12T00:04:35.022 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7450000000000001e-05 2024-09-12T00:04:35.022 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.022 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.022 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:35.022 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562091+0000", 2024-09-12T00:04:35.022 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9703000000000003e-05 2024-09-12T00:04:35.022 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.022 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.022 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:35.022 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562112+0000", 2024-09-12T00:04:35.023 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1189999999999999e-05 2024-09-12T00:04:35.023 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.023 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.023 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.023 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562253+0000", 2024-09-12T00:04:35.023 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000140302 2024-09-12T00:04:35.023 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.023 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.023 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:35.024 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562264+0000", 2024-09-12T00:04:35.024 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1737e-05 2024-09-12T00:04:35.024 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.024 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.024 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.025 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.566247+0000", 2024-09-12T00:04:35.025 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039824259999999998 2024-09-12T00:04:35.025 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.025 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.025 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:35.025 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.566384+0000", 2024-09-12T00:04:35.025 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000136916 2024-09-12T00:04:35.025 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.025 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.025 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:35.025 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.566645+0000", 2024-09-12T00:04:35.025 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000261241 2024-09-12T00:04:35.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.026 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.026 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:35.026 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.568507+0000", 2024-09-12T00:04:35.026 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001862219 2024-09-12T00:04:35.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.026 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.026 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:35.026 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.569221+0000", 2024-09-12T00:04:35.026 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00071416199999999996 2024-09-12T00:04:35.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.026 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.026 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:35.026 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.569306+0000", 2024-09-12T00:04:35.027 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5016000000000001e-05 2024-09-12T00:04:35.027 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.027 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.027 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:35.027 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.569375+0000", 2024-09-12T00:04:35.027 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8845999999999998e-05 2024-09-12T00:04:35.027 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.027 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:35.027 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.027 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.027 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.027 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T00:04:35.027 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:04:35.027 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 65.675735337000006, 2024-09-12T00:04:35.028 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025928692999999999, 2024-09-12T00:04:35.028 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:35.028 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:35.028 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "reached pg", 2024-09-12T00:04:35.028 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:35.028 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:35.028 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:35.028 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 43 2024-09-12T00:04:35.028 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.028 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:35.028 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.028 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:35.028 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:04:35.028 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.029 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.029 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.029 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:35.029 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:04:35.029 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.029 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.029 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.029 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:35.029 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329660+0000", 2024-09-12T00:04:35.029 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.965e-06 2024-09-12T00:04:35.029 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.029 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.029 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:35.029 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329673+0000", 2024-09-12T00:04:35.030 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3402e-05 2024-09-12T00:04:35.030 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.030 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.030 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:35.030 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329706+0000", 2024-09-12T00:04:35.030 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2441000000000003e-05 2024-09-12T00:04:35.030 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.030 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.030 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:35.030 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329723+0000", 2024-09-12T00:04:35.030 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7609e-05 2024-09-12T00:04:35.030 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.030 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.030 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.030 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330437+0000", 2024-09-12T00:04:35.031 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00071403500000000002 2024-09-12T00:04:35.031 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.031 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.031 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:35.031 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330454+0000", 2024-09-12T00:04:35.031 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6820000000000002e-05 2024-09-12T00:04:35.031 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.031 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.031 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.031 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347344+0000", 2024-09-12T00:04:35.031 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016890275 2024-09-12T00:04:35.031 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.031 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.031 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:35.032 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347365+0000", 2024-09-12T00:04:35.032 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0350999999999999e-05 2024-09-12T00:04:35.032 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.032 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.032 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.032 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355323+0000", 2024-09-12T00:04:35.032 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079579400000000002 2024-09-12T00:04:35.032 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.032 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.032 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:35.032 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355585+0000", 2024-09-12T00:04:35.032 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026285499999999999 2024-09-12T00:04:35.032 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.032 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:35.033 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.034 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.034 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.034 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:241 6.7 6:e31d3d5f:lc::lc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:35.034 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.484582+0000", 2024-09-12T00:04:35.034 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 60.520810453000003, 2024-09-12T00:04:35.034 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056165570000000003, 2024-09-12T00:04:35.034 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:35.034 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:35.034 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:35.034 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:35.034 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:35.034 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:35.034 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 241 2024-09-12T00:04:35.035 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.035 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:35.035 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.035 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:35.035 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484582+0000", 2024-09-12T00:04:35.035 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.035 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.035 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.035 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:35.035 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484582+0000", 2024-09-12T00:04:35.035 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.035 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.035 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.035 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:35.035 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484583+0000", 2024-09-12T00:04:35.036 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.536e-06 2024-09-12T00:04:35.036 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.036 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.036 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:35.036 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484590+0000", 2024-09-12T00:04:35.036 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6100000000000002e-06 2024-09-12T00:04:35.036 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.036 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.036 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:35.036 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484613+0000", 2024-09-12T00:04:35.036 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3309999999999999e-05 2024-09-12T00:04:35.036 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.036 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.037 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:35.037 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484624+0000", 2024-09-12T00:04:35.037 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0669999999999999e-05 2024-09-12T00:04:35.037 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.037 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.037 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.037 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484716+0000", 2024-09-12T00:04:35.037 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2257999999999997e-05 2024-09-12T00:04:35.037 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.037 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.037 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:35.037 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484900+0000", 2024-09-12T00:04:35.037 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000183807 2024-09-12T00:04:35.037 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.038 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.038 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:35.038 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.485057+0000", 2024-09-12T00:04:35.038 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015707300000000001 2024-09-12T00:04:35.038 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.038 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.038 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:35.038 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.485975+0000", 2024-09-12T00:04:35.038 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00091781399999999998 2024-09-12T00:04:35.038 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.038 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.038 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:35.038 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490054+0000", 2024-09-12T00:04:35.038 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040794569999999999 2024-09-12T00:04:35.039 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.039 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.039 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:35.039 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490128+0000", 2024-09-12T00:04:35.039 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3336000000000004e-05 2024-09-12T00:04:35.039 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.039 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.039 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:35.039 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490198+0000", 2024-09-12T00:04:35.039 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0685999999999994e-05 2024-09-12T00:04:35.039 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.039 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:35.039 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.039 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.039 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.040 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:276 6.7 6:e31d3d5f:lc::lc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:35.040 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.491340+0000", 2024-09-12T00:04:35.040 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 60.514052333000002, 2024-09-12T00:04:35.040 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056286460000000002, 2024-09-12T00:04:35.040 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:35.040 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:35.040 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:35.040 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:35.040 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:35.040 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:35.040 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 276 2024-09-12T00:04:35.040 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.040 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:35.040 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.041 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:35.041 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491340+0000", 2024-09-12T00:04:35.041 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.041 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.041 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.041 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:35.041 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491340+0000", 2024-09-12T00:04:35.041 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.041 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.041 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.041 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:35.041 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491342+0000", 2024-09-12T00:04:35.041 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8509999999999999e-06 2024-09-12T00:04:35.042 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.042 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.042 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:35.042 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491348+0000", 2024-09-12T00:04:35.042 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1929999999999998e-06 2024-09-12T00:04:35.042 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.042 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.042 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:35.042 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491366+0000", 2024-09-12T00:04:35.042 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7669999999999999e-05 2024-09-12T00:04:35.042 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.042 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.042 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:35.043 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491382+0000", 2024-09-12T00:04:35.043 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6554000000000001e-05 2024-09-12T00:04:35.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.043 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.043 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.043 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491452+0000", 2024-09-12T00:04:35.043 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9917000000000002e-05 2024-09-12T00:04:35.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.043 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.043 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:35.043 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491536+0000", 2024-09-12T00:04:35.043 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4229999999999998e-05 2024-09-12T00:04:35.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.044 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.044 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:35.044 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491704+0000", 2024-09-12T00:04:35.044 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000167994 2024-09-12T00:04:35.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.044 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.044 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:35.044 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.492347+0000", 2024-09-12T00:04:35.044 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00064263799999999995 2024-09-12T00:04:35.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.044 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.044 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:35.045 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.496901+0000", 2024-09-12T00:04:35.045 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045546329999999998 2024-09-12T00:04:35.045 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.045 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.045 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:35.045 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.496939+0000", 2024-09-12T00:04:35.045 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7135999999999998e-05 2024-09-12T00:04:35.045 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.045 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.045 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:35.045 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.496968+0000", 2024-09-12T00:04:35.046 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9830000000000001e-05 2024-09-12T00:04:35.046 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.046 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:35.046 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.046 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.046 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.046 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:290 6.7 6:e31d3d5f:lc::lc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:35.046 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.494565+0000", 2024-09-12T00:04:35.046 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 60.510827382000002, 2024-09-12T00:04:35.046 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052924829999999997, 2024-09-12T00:04:35.046 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:35.047 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:35.047 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:35.047 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:35.047 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:35.047 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:35.047 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 290 2024-09-12T00:04:35.047 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.047 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:35.047 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.047 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:35.047 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.494565+0000", 2024-09-12T00:04:35.047 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.048 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.048 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:35.048 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.494565+0000", 2024-09-12T00:04:35.048 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.048 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.048 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:35.048 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.494566+0000", 2024-09-12T00:04:35.048 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2720000000000001e-06 2024-09-12T00:04:35.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.049 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.049 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:35.049 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.494571+0000", 2024-09-12T00:04:35.049 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.305e-06 2024-09-12T00:04:35.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.049 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.049 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:35.049 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.494586+0000", 2024-09-12T00:04:35.049 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4666e-05 2024-09-12T00:04:35.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.049 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.050 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:35.050 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.494595+0000", 2024-09-12T00:04:35.050 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7329999999999992e-06 2024-09-12T00:04:35.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.050 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.050 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.050 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.494663+0000", 2024-09-12T00:04:35.050 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8518999999999999e-05 2024-09-12T00:04:35.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.050 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.050 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:35.050 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.494719+0000", 2024-09-12T00:04:35.051 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5962999999999999e-05 2024-09-12T00:04:35.051 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.051 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.051 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:35.051 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.494842+0000", 2024-09-12T00:04:35.051 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012300399999999999 2024-09-12T00:04:35.051 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.051 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.051 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:35.051 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.495730+0000", 2024-09-12T00:04:35.051 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00088798299999999996 2024-09-12T00:04:35.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.052 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.052 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:35.052 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.499795+0000", 2024-09-12T00:04:35.052 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040645259999999997 2024-09-12T00:04:35.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.052 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.052 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:35.052 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.499831+0000", 2024-09-12T00:04:35.052 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6257999999999997e-05 2024-09-12T00:04:35.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.052 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.053 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:35.053 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.499857+0000", 2024-09-12T00:04:35.053 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6254e-05 2024-09-12T00:04:35.053 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.053 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:35.053 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.053 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.053 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.053 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:297 6.8 6:162a24ce:lc::lc.8:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:35.053 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.497051+0000", 2024-09-12T00:04:35.053 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 60.508341520999998, 2024-09-12T00:04:35.054 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056532370000000002, 2024-09-12T00:04:35.054 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:35.054 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:35.054 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:35.054 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:35.054 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:35.054 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:35.054 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 297 2024-09-12T00:04:35.054 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.054 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:35.054 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.054 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:35.055 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497051+0000", 2024-09-12T00:04:35.055 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.055 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.055 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.055 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:35.055 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497051+0000", 2024-09-12T00:04:35.055 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.055 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.055 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.055 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:35.055 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497052+0000", 2024-09-12T00:04:35.055 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3659999999999999e-06 2024-09-12T00:04:35.056 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.056 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.056 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:35.056 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497058+0000", 2024-09-12T00:04:35.056 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0909999999999998e-06 2024-09-12T00:04:35.056 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.056 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.056 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:35.056 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497075+0000", 2024-09-12T00:04:35.056 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7312e-05 2024-09-12T00:04:35.056 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.057 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.057 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:35.057 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497084+0000", 2024-09-12T00:04:35.057 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3149999999999992e-06 2024-09-12T00:04:35.057 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.057 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.057 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.057 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497189+0000", 2024-09-12T00:04:35.057 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105257 2024-09-12T00:04:35.057 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.057 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.058 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:35.058 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497278+0000", 2024-09-12T00:04:35.058 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9512000000000006e-05 2024-09-12T00:04:35.058 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.058 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.058 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:35.058 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497460+0000", 2024-09-12T00:04:35.058 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018169 2024-09-12T00:04:35.058 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.058 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.058 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:35.059 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.498149+0000", 2024-09-12T00:04:35.059 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000688632 2024-09-12T00:04:35.059 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.059 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.059 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:35.059 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.502640+0000", 2024-09-12T00:04:35.059 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0044907690000000004 2024-09-12T00:04:35.059 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.059 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.059 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:35.059 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.502676+0000", 2024-09-12T00:04:35.060 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6452000000000003e-05 2024-09-12T00:04:35.060 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.060 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.060 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:35.060 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.502704+0000", 2024-09-12T00:04:35.060 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7841e-05 2024-09-12T00:04:35.060 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.060 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:35.060 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.060 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.060 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.060 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:322 6.7 6:e31d3d5f:lc::lc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:35.061 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.500700+0000", 2024-09-12T00:04:35.061 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 60.504692126000002, 2024-09-12T00:04:35.061 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0067834599999999998, 2024-09-12T00:04:35.061 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:35.061 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:35.061 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:35.061 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:35.061 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:35.061 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:35.061 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 322 2024-09-12T00:04:35.061 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.061 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:35.061 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.061 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:35.062 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500700+0000", 2024-09-12T00:04:35.062 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.062 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.062 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.062 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:35.062 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500700+0000", 2024-09-12T00:04:35.062 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.062 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.062 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.062 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:35.062 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500701+0000", 2024-09-12T00:04:35.062 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.19e-06 2024-09-12T00:04:35.062 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.062 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.063 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:35.063 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500708+0000", 2024-09-12T00:04:35.063 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1130000000000003e-06 2024-09-12T00:04:35.063 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.063 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.063 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:35.063 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500721+0000", 2024-09-12T00:04:35.063 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3073e-05 2024-09-12T00:04:35.063 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.063 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.063 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:35.063 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500730+0000", 2024-09-12T00:04:35.063 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5969999999999992e-06 2024-09-12T00:04:35.063 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.063 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.064 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.064 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500798+0000", 2024-09-12T00:04:35.064 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7659999999999999e-05 2024-09-12T00:04:35.064 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.064 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.064 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:35.064 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500860+0000", 2024-09-12T00:04:35.064 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2089999999999997e-05 2024-09-12T00:04:35.064 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.064 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.064 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:35.064 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.501007+0000", 2024-09-12T00:04:35.064 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000147618 2024-09-12T00:04:35.064 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.065 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.065 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:35.065 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.501726+0000", 2024-09-12T00:04:35.065 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00071825600000000002 2024-09-12T00:04:35.065 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.065 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.065 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:35.065 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.507420+0000", 2024-09-12T00:04:35.065 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056941240000000001 2024-09-12T00:04:35.065 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.065 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.065 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:35.065 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.507453+0000", 2024-09-12T00:04:35.065 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3547999999999998e-05 2024-09-12T00:04:35.066 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.066 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.066 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:35.066 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.507483+0000", 2024-09-12T00:04:35.066 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0190999999999999e-05 2024-09-12T00:04:35.066 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.066 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:35.066 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.066 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.066 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.066 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:408 6.7 6:e31d3d5f:lc::lc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:35.066 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.525223+0000", 2024-09-12T00:04:35.066 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 60.480169337, 2024-09-12T00:04:35.066 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064357069999999997, 2024-09-12T00:04:35.067 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:35.067 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:35.067 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:35.067 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:35.067 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:35.067 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:35.067 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 408 2024-09-12T00:04:35.067 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.067 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:35.067 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.067 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:35.067 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525223+0000", 2024-09-12T00:04:35.067 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.067 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.068 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.068 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:35.068 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525223+0000", 2024-09-12T00:04:35.068 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.068 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.068 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.068 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:35.068 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525224+0000", 2024-09-12T00:04:35.068 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.325e-06 2024-09-12T00:04:35.068 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.068 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.068 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:35.068 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525230+0000", 2024-09-12T00:04:35.069 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.677e-06 2024-09-12T00:04:35.069 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.069 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.069 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:35.069 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525243+0000", 2024-09-12T00:04:35.069 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3592e-05 2024-09-12T00:04:35.069 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.069 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.069 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:35.069 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525255+0000", 2024-09-12T00:04:35.069 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1257000000000001e-05 2024-09-12T00:04:35.069 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.069 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.069 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.070 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525339+0000", 2024-09-12T00:04:35.070 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4565000000000001e-05 2024-09-12T00:04:35.070 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.070 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.070 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:35.070 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525433+0000", 2024-09-12T00:04:35.070 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.4248999999999998e-05 2024-09-12T00:04:35.070 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.070 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.070 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:35.070 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525649+0000", 2024-09-12T00:04:35.070 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021594999999999999 2024-09-12T00:04:35.070 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.070 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.071 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:35.071 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526275+0000", 2024-09-12T00:04:35.071 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00062531200000000005 2024-09-12T00:04:35.071 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.071 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.071 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:35.071 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531540+0000", 2024-09-12T00:04:35.071 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052655009999999997 2024-09-12T00:04:35.071 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.071 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.071 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:35.071 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531606+0000", 2024-09-12T00:04:35.071 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5733000000000002e-05 2024-09-12T00:04:35.071 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.072 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.072 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:35.072 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531659+0000", 2024-09-12T00:04:35.072 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2546000000000001e-05 2024-09-12T00:04:35.072 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.072 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:35.072 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.072 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.072 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.072 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:492 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:35.072 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.552214+0000", 2024-09-12T00:04:35.072 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 60.453177781000001, 2024-09-12T00:04:35.072 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.006213199, 2024-09-12T00:04:35.072 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:35.073 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:35.073 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:35.073 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:35.073 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:35.073 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:35.073 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 492 2024-09-12T00:04:35.073 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.073 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:35.073 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.073 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:35.073 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552214+0000", 2024-09-12T00:04:35.073 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.073 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.073 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.074 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:35.074 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552214+0000", 2024-09-12T00:04:35.074 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.074 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.074 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.074 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:35.074 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552215+0000", 2024-09-12T00:04:35.074 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1170000000000001e-06 2024-09-12T00:04:35.074 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.074 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.074 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:35.074 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552220+0000", 2024-09-12T00:04:35.074 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8149999999999996e-06 2024-09-12T00:04:35.074 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.075 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.075 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:35.075 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552233+0000", 2024-09-12T00:04:35.075 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2784e-05 2024-09-12T00:04:35.075 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.075 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.075 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:35.075 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552240+0000", 2024-09-12T00:04:35.075 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8379999999999996e-06 2024-09-12T00:04:35.075 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.075 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.076 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.076 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552297+0000", 2024-09-12T00:04:35.076 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7123000000000002e-05 2024-09-12T00:04:35.076 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.076 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.076 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:35.076 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552382+0000", 2024-09-12T00:04:35.076 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5334000000000007e-05 2024-09-12T00:04:35.076 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.076 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.076 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:35.076 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552504+0000", 2024-09-12T00:04:35.077 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000121309 2024-09-12T00:04:35.077 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.077 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.077 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:35.077 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558157+0000", 2024-09-12T00:04:35.077 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056535439999999999 2024-09-12T00:04:35.077 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.077 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.077 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:35.077 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558356+0000", 2024-09-12T00:04:35.077 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000198436 2024-09-12T00:04:35.078 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.078 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.078 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:35.078 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558401+0000", 2024-09-12T00:04:35.078 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5048e-05 2024-09-12T00:04:35.078 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.078 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.078 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:35.078 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558428+0000", 2024-09-12T00:04:35.078 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6851000000000001e-05 2024-09-12T00:04:35.078 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.078 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:35.079 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.079 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.079 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.079 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:643 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:35.079 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.593859+0000", 2024-09-12T00:04:35.079 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 60.411532790999999, 2024-09-12T00:04:35.079 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054148069999999998, 2024-09-12T00:04:35.079 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:35.079 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:35.079 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:35.079 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:35.079 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:35.080 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:35.080 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 643 2024-09-12T00:04:35.080 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.080 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:35.080 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.080 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:35.080 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593859+0000", 2024-09-12T00:04:35.080 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.080 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.080 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.080 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:35.081 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593859+0000", 2024-09-12T00:04:35.081 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.081 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.081 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.081 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:35.081 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593860+0000", 2024-09-12T00:04:35.081 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0500000000000002e-07 2024-09-12T00:04:35.081 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.081 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.081 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:35.081 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593864+0000", 2024-09-12T00:04:35.082 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3100000000000002e-06 2024-09-12T00:04:35.082 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.082 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.082 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:35.082 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593875+0000", 2024-09-12T00:04:35.082 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0706999999999999e-05 2024-09-12T00:04:35.082 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.082 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.083 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:35.083 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593882+0000", 2024-09-12T00:04:35.083 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2919999999999998e-06 2024-09-12T00:04:35.083 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.083 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.083 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.084 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593939+0000", 2024-09-12T00:04:35.084 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6138999999999999e-05 2024-09-12T00:04:35.084 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.084 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.084 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:35.084 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594023+0000", 2024-09-12T00:04:35.084 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4128000000000005e-05 2024-09-12T00:04:35.084 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.085 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.085 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:35.085 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594194+0000", 2024-09-12T00:04:35.085 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017098800000000001 2024-09-12T00:04:35.085 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.085 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.085 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:35.085 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.598923+0000", 2024-09-12T00:04:35.085 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047291369999999996 2024-09-12T00:04:35.085 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.086 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.086 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:35.086 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599219+0000", 2024-09-12T00:04:35.086 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00029588500000000002 2024-09-12T00:04:35.086 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.086 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.086 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:35.086 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599250+0000", 2024-09-12T00:04:35.086 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0771000000000001e-05 2024-09-12T00:04:35.086 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.086 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.087 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:35.087 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599274+0000", 2024-09-12T00:04:35.087 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4644999999999999e-05 2024-09-12T00:04:35.087 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.087 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:35.087 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.087 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.087 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.087 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:657 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:35.087 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600087+0000", 2024-09-12T00:04:35.087 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 60.405305593000001, 2024-09-12T00:04:35.088 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0072536739999999999, 2024-09-12T00:04:35.088 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:35.088 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:35.088 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:35.088 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:35.088 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:35.088 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:35.088 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 657 2024-09-12T00:04:35.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.088 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:35.088 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.089 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:35.089 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600087+0000", 2024-09-12T00:04:35.089 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.089 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.089 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:35.089 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600087+0000", 2024-09-12T00:04:35.089 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.089 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.089 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:35.089 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600088+0000", 2024-09-12T00:04:35.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4759999999999999e-06 2024-09-12T00:04:35.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:35.090 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600093+0000", 2024-09-12T00:04:35.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4330000000000003e-06 2024-09-12T00:04:35.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:35.090 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600107+0000", 2024-09-12T00:04:35.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.348e-05 2024-09-12T00:04:35.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.091 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:35.091 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600116+0000", 2024-09-12T00:04:35.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7339999999999997e-06 2024-09-12T00:04:35.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.091 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.091 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600178+0000", 2024-09-12T00:04:35.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2382e-05 2024-09-12T00:04:35.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.092 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:35.092 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600233+0000", 2024-09-12T00:04:35.092 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4960999999999998e-05 2024-09-12T00:04:35.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.092 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.092 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:35.092 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600373+0000", 2024-09-12T00:04:35.092 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013955599999999999 2024-09-12T00:04:35.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.092 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.092 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:35.093 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.604463+0000", 2024-09-12T00:04:35.093 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040905539999999997 2024-09-12T00:04:35.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.093 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.093 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:35.093 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607243+0000", 2024-09-12T00:04:35.093 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027799140000000001 2024-09-12T00:04:35.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.093 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.093 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:35.093 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607306+0000", 2024-09-12T00:04:35.093 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2575000000000003e-05 2024-09-12T00:04:35.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.093 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.093 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:35.094 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607340+0000", 2024-09-12T00:04:35.094 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4609e-05 2024-09-12T00:04:35.094 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.094 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:35.094 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.094 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.094 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.094 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:665 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:35.094 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602284+0000", 2024-09-12T00:04:35.094 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 60.403108420000002, 2024-09-12T00:04:35.094 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055001709999999999, 2024-09-12T00:04:35.094 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:35.094 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:35.094 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:35.095 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:35.095 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:35.095 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:35.095 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 665 2024-09-12T00:04:35.095 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.095 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:35.095 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.095 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:35.095 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602284+0000", 2024-09-12T00:04:35.095 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.095 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.095 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.095 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:35.095 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602284+0000", 2024-09-12T00:04:35.096 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.096 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.096 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.096 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:35.096 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602285+0000", 2024-09-12T00:04:35.096 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6700000000000002e-07 2024-09-12T00:04:35.096 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.096 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.096 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:35.096 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602289+0000", 2024-09-12T00:04:35.096 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5519999999999998e-06 2024-09-12T00:04:35.096 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.096 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.097 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:35.097 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602304+0000", 2024-09-12T00:04:35.097 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5299e-05 2024-09-12T00:04:35.097 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.097 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.097 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:35.097 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602313+0000", 2024-09-12T00:04:35.097 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6379999999999993e-06 2024-09-12T00:04:35.097 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.097 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.097 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.097 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602370+0000", 2024-09-12T00:04:35.097 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6839000000000002e-05 2024-09-12T00:04:35.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.098 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.098 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:35.098 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602460+0000", 2024-09-12T00:04:35.098 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0323999999999998e-05 2024-09-12T00:04:35.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.098 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.098 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:35.098 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602650+0000", 2024-09-12T00:04:35.098 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018955900000000001 2024-09-12T00:04:35.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.098 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.098 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:35.098 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607365+0000", 2024-09-12T00:04:35.099 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004715632 2024-09-12T00:04:35.099 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.099 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.099 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:35.099 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607698+0000", 2024-09-12T00:04:35.099 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00033217400000000002 2024-09-12T00:04:35.099 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.099 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.099 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:35.099 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607738+0000", 2024-09-12T00:04:35.099 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0516000000000003e-05 2024-09-12T00:04:35.099 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.099 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.100 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:35.100 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607784+0000", 2024-09-12T00:04:35.100 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5770999999999999e-05 2024-09-12T00:04:35.100 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.100 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:35.100 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.100 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.100 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.100 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:669 6.1c 6:3b93e7b4:::obj_delete_at_hint.0000000016:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:35.100 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.607439+0000", 2024-09-12T00:04:35.100 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 60.397953430000001, 2024-09-12T00:04:35.100 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057881649999999996, 2024-09-12T00:04:35.100 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:35.100 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:35.101 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:35.101 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:35.101 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:35.101 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:35.101 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 669 2024-09-12T00:04:35.101 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.101 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:35.101 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.101 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:35.101 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607439+0000", 2024-09-12T00:04:35.101 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.101 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.101 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.101 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:35.102 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607439+0000", 2024-09-12T00:04:35.102 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.102 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.102 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.102 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:35.102 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607439+0000", 2024-09-12T00:04:35.102 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9599999999999998e-07 2024-09-12T00:04:35.102 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.102 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.102 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:35.102 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607443+0000", 2024-09-12T00:04:35.102 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0340000000000001e-06 2024-09-12T00:04:35.102 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.102 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.103 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:35.103 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607453+0000", 2024-09-12T00:04:35.103 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682999999999999e-05 2024-09-12T00:04:35.103 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.103 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.103 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:35.103 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607461+0000", 2024-09-12T00:04:35.103 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6860000000000006e-06 2024-09-12T00:04:35.103 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.103 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.103 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.103 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607927+0000", 2024-09-12T00:04:35.103 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00046655600000000002 2024-09-12T00:04:35.103 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.104 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.104 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:35.104 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608017+0000", 2024-09-12T00:04:35.104 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9788000000000002e-05 2024-09-12T00:04:35.104 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.104 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.104 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:35.104 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608262+0000", 2024-09-12T00:04:35.104 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024518499999999998 2024-09-12T00:04:35.104 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.104 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.104 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:35.104 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612908+0000", 2024-09-12T00:04:35.105 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046458009999999998 2024-09-12T00:04:35.105 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.105 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.105 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:35.105 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.613137+0000", 2024-09-12T00:04:35.105 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022881999999999999 2024-09-12T00:04:35.105 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.105 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.105 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:35.105 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.613178+0000", 2024-09-12T00:04:35.105 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0496e-05 2024-09-12T00:04:35.106 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.106 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.106 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:35.106 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.613227+0000", 2024-09-12T00:04:35.106 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9320000000000002e-05 2024-09-12T00:04:35.106 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.106 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:35.106 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.106 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.106 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.106 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:670 6.8 6:10010070:lc::lc.29:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:35.107 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.607563+0000", 2024-09-12T00:04:35.107 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 60.397829178999999, 2024-09-12T00:04:35.107 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054159179999999996, 2024-09-12T00:04:35.107 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:35.107 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:35.107 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:35.107 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:35.107 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:35.107 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:35.107 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 670 2024-09-12T00:04:35.107 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.107 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:35.108 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.108 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:35.108 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607563+0000", 2024-09-12T00:04:35.108 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.108 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.108 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:35.108 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607563+0000", 2024-09-12T00:04:35.108 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.108 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.109 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:35.109 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607564+0000", 2024-09-12T00:04:35.109 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.181e-06 2024-09-12T00:04:35.109 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.109 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.109 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:35.109 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607570+0000", 2024-09-12T00:04:35.109 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0809999999999999e-06 2024-09-12T00:04:35.109 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.109 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.109 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:35.109 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607582+0000", 2024-09-12T00:04:35.110 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1924e-05 2024-09-12T00:04:35.110 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.110 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.110 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:35.110 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607590+0000", 2024-09-12T00:04:35.110 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1370000000000002e-06 2024-09-12T00:04:35.110 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.110 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.110 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.110 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607669+0000", 2024-09-12T00:04:35.110 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8792e-05 2024-09-12T00:04:35.110 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.111 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.111 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:35.111 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607751+0000", 2024-09-12T00:04:35.111 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1641e-05 2024-09-12T00:04:35.111 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.111 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.111 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:35.111 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607915+0000", 2024-09-12T00:04:35.111 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000163979 2024-09-12T00:04:35.111 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.111 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.112 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:35.112 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.609266+0000", 2024-09-12T00:04:35.112 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0013514810000000001 2024-09-12T00:04:35.112 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.112 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.112 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:35.112 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612885+0000", 2024-09-12T00:04:35.112 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003618834 2024-09-12T00:04:35.112 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.112 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.112 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:35.112 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612941+0000", 2024-09-12T00:04:35.113 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5815e-05 2024-09-12T00:04:35.113 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.113 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.113 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:35.113 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612979+0000", 2024-09-12T00:04:35.113 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8053000000000003e-05 2024-09-12T00:04:35.113 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.113 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:35.114 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.114 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.114 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.114 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:925 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:35.114 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.697503+0000", 2024-09-12T00:04:35.114 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 60.307888716999997, 2024-09-12T00:04:35.114 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.006503755, 2024-09-12T00:04:35.114 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:35.114 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:35.114 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:35.114 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:35.115 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:35.115 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:35.115 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 925 2024-09-12T00:04:35.115 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.115 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:35.115 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.115 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:35.115 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697503+0000", 2024-09-12T00:04:35.115 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.115 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.115 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.116 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:35.116 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697503+0000", 2024-09-12T00:04:35.116 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.116 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.116 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.116 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:35.116 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697505+0000", 2024-09-12T00:04:35.116 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5030000000000001e-06 2024-09-12T00:04:35.116 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.116 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.116 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:35.117 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697512+0000", 2024-09-12T00:04:35.117 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7630000000000003e-06 2024-09-12T00:04:35.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.117 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.117 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:35.117 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697529+0000", 2024-09-12T00:04:35.117 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7345000000000001e-05 2024-09-12T00:04:35.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.117 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.117 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:35.117 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697539+0000", 2024-09-12T00:04:35.118 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0412e-05 2024-09-12T00:04:35.118 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.118 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.118 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.118 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697606+0000", 2024-09-12T00:04:35.118 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6531000000000004e-05 2024-09-12T00:04:35.118 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.118 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.118 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:35.118 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697673+0000", 2024-09-12T00:04:35.118 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6661000000000004e-05 2024-09-12T00:04:35.119 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.119 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.119 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:35.119 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697839+0000", 2024-09-12T00:04:35.119 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016669699999999999 2024-09-12T00:04:35.119 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.119 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.119 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:35.119 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.700786+0000", 2024-09-12T00:04:35.119 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029466819999999999 2024-09-12T00:04:35.119 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.120 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.120 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:35.120 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703889+0000", 2024-09-12T00:04:35.120 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0031034830000000002 2024-09-12T00:04:35.120 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.120 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.120 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:35.120 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703961+0000", 2024-09-12T00:04:35.120 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1178000000000002e-05 2024-09-12T00:04:35.120 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.120 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.120 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:35.121 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704007+0000", 2024-09-12T00:04:35.121 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6499999999999999e-05 2024-09-12T00:04:35.121 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.121 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:35.121 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.121 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.121 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.121 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1641 3.26 e58/23 3:658fe58e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2__shadow_.hDHTDpIswwqRA2bHiHVxkhWqZde6XEj_1:head v 58'1, mlcod=0'0)", 2024-09-12T00:04:35.121 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:04:35.121 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.9463768340000001, 2024-09-12T00:04:35.121 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014950144, 2024-09-12T00:04:35.122 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:35.122 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:35.122 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:35.122 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:35.122 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.122 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:35.122 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:04:35.122 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.122 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.122 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.122 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:35.122 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:04:35.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.123 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.123 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:35.123 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059017+0000", 2024-09-12T00:04:35.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.508e-06 2024-09-12T00:04:35.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.123 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.123 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:35.123 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061582+0000", 2024-09-12T00:04:35.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025654010000000001 2024-09-12T00:04:35.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.123 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.123 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:35.124 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061607+0000", 2024-09-12T00:04:35.124 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5028000000000002e-05 2024-09-12T00:04:35.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.124 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:35.124 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061619+0000", 2024-09-12T00:04:35.124 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1905999999999999e-05 2024-09-12T00:04:35.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.124 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.124 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061696+0000", 2024-09-12T00:04:35.124 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7305999999999995e-05 2024-09-12T00:04:35.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.125 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:35.125 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061717+0000", 2024-09-12T00:04:35.125 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0380000000000001e-05 2024-09-12T00:04:35.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.125 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.125 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:35.125 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073925+0000", 2024-09-12T00:04:35.125 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012208088000000001 2024-09-12T00:04:35.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.125 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.125 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:35.125 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073965+0000", 2024-09-12T00:04:35.125 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0527e-05 2024-09-12T00:04:35.125 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.126 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:35.126 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.126 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.126 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.126 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1775 3.30 3:0c2ae78d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:35.126 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:04:35.126 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.0065395159999999, 2024-09-12T00:04:35.126 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020783729000000001, 2024-09-12T00:04:35.126 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:35.126 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:35.126 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:35.126 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:35.126 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:35.127 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:35.127 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1775 2024-09-12T00:04:35.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.127 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:35.127 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.127 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:35.127 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:04:35.127 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.127 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.127 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:35.127 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:04:35.127 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.128 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.128 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:35.128 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998856+0000", 2024-09-12T00:04:35.128 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6849999999999999e-06 2024-09-12T00:04:35.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.128 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.128 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:35.128 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001327+0000", 2024-09-12T00:04:35.128 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024706279999999999 2024-09-12T00:04:35.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.128 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.128 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:35.128 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001355+0000", 2024-09-12T00:04:35.129 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8419999999999999e-05 2024-09-12T00:04:35.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.129 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:35.129 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001366+0000", 2024-09-12T00:04:35.129 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1073999999999999e-05 2024-09-12T00:04:35.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.129 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.129 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001438+0000", 2024-09-12T00:04:35.129 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1389000000000004e-05 2024-09-12T00:04:35.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:35.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001548+0000", 2024-09-12T00:04:35.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110612 2024-09-12T00:04:35.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:35.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001639+0000", 2024-09-12T00:04:35.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0192999999999995e-05 2024-09-12T00:04:35.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:35.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019057+0000", 2024-09-12T00:04:35.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017418411000000002 2024-09-12T00:04:35.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.131 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.131 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:35.131 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019528+0000", 2024-09-12T00:04:35.131 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00047075699999999998 2024-09-12T00:04:35.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.131 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.131 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:35.131 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019577+0000", 2024-09-12T00:04:35.131 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8714999999999997e-05 2024-09-12T00:04:35.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.132 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.132 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:35.132 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019636+0000", 2024-09-12T00:04:35.132 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9845e-05 2024-09-12T00:04:35.132 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.132 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:35.132 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.132 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.132 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1780 3.16 e58/23 3:69d8ee52:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3_10Mb.:head v 58'1, mlcod=0'0)", 2024-09-12T00:04:35.132 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:04:35.132 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.98024622400000005, 2024-09-12T00:04:35.132 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01408911, 2024-09-12T00:04:35.133 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:35.133 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:35.133 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:35.133 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:35.133 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.133 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:35.133 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:04:35.133 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.133 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.133 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:35.133 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:04:35.133 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:35.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.134 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.134 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:35.134 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025148+0000", 2024-09-12T00:04:35.134 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4229999999999999e-06 2024-09-12T00:04:35.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.134 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.134 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:35.134 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026337+0000", 2024-09-12T00:04:35.134 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011890589999999999 2024-09-12T00:04:35.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.134 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.134 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:35.135 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026362+0000", 2024-09-12T00:04:35.135 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4566000000000002e-05 2024-09-12T00:04:35.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.135 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.135 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:35.135 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026372+0000", 2024-09-12T00:04:35.135 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8509999999999994e-06 2024-09-12T00:04:35.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.135 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.135 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:35.135 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026448+0000", 2024-09-12T00:04:35.135 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6626999999999997e-05 2024-09-12T00:04:35.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.136 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.136 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:35.136 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026473+0000", 2024-09-12T00:04:35.136 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4647e-05 2024-09-12T00:04:35.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.136 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.136 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:35.136 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039120+0000", 2024-09-12T00:04:35.136 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012647122 2024-09-12T00:04:35.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:35.136 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:35.136 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:35.136 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039235+0000", 2024-09-12T00:04:35.136 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000114815 2024-09-12T00:04:35.137 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.137 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:35.137 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.137 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:35.137 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:35.137 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:35.137 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:04:35.139 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:04:35.139 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:35.136+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:35.184 INFO:tasks.workunit.client.0.smithi019.stdout:quota enabled for the bucket: buck_2024_08_12_00_04_34 2024-09-12T00:04:35.185 INFO:tasks.workunit.client.0.smithi019.stdout:adding file to bucket: 10Mb. 2024-09-12T00:04:35.185 INFO:tasks.workunit.client.0.smithi019.stdout:upload file successful 2024-09-12T00:04:35.215 INFO:tasks.workunit.client.0.smithi019.stderr:1+0 records in 2024-09-12T00:04:35.215 INFO:tasks.workunit.client.0.smithi019.stderr:1+0 records out 2024-09-12T00:04:35.216 INFO:tasks.workunit.client.0.smithi019.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0285254 s, 368 MB/s 2024-09-12T00:04:35.239 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:35.238+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:35.243 INFO:tasks.workunit.client.0.smithi019.stdout:readding file to bucket: 10MBfile1 2024-09-12T00:04:35.243 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:04:35.243 INFO:tasks.workunit.client.0.smithi019.stdout:Test case: PASSED - set max objects for a given user and test beyond max objects passed 2024-09-12T00:04:35.243 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:04:35.269 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:35.269 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:04:35.269 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:04:35.269 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:35.283 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:04:35.335 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:35.336 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:35.354 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:35.354 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:35.369 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:35.370+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:35.372 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:35.372 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:35.390 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:35.390 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:35.410 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:35.410 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:35.432 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:35.432 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:35.441 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:35.442+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:35.454 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:35.455 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:35.461 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:35.461 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:35.476 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:04:35.477 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:35.477 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:35.487 INFO:tasks.workunit.client.0.smithi019.stdout:user qa_user deleted 2024-09-12T00:04:35.487 INFO:tasks.workunit.client.0.smithi019.stdout:bucket delete succeeded 2024-09-12T00:04:35.561 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:35.562+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:35.633 INFO:tasks.workunit.client.0.smithi019.stdout:Bucket Created: buck_2024_08_12_00_04_35 2024-09-12T00:04:35.643 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:35.640+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:35.646 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:35.646 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:35.660 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:04:35.744 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:35.740+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:35.806 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:04:35.807 INFO:tasks.workunit.client.0.smithi019.stdout:Test case: PASSED - quota set for the bucket: buck_2024_08_12_00_04_35 with max size as zero 2024-09-12T00:04:35.807 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:04:35.807 INFO:tasks.workunit.client.0.smithi019.stdout:bucket delete succeeded 2024-09-12T00:04:35.834 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:35.834 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:35.845 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:35.842+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:35.849 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:04:35.946 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:35.946+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:35.958 INFO:tasks.workunit.client.0.smithi019.stdout:Bucket Created: buck_2024_08_12_00_04_35 2024-09-12T00:04:36.018 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:36.019 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:36.033 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:04:36.047 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:36.044+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:36.139 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:04:36.139 INFO:tasks.workunit.client.0.smithi019.stdout:Test case: PASSED - quota set for the bucket: buck_2024_08_12_00_04_35 with max objects as zero 2024-09-12T00:04:36.139 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:04:36.139 INFO:tasks.workunit.client.0.smithi019.stdout:bucket delete succeeded 2024-09-12T00:04:36.148 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:36.146+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:36.205 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:36.205 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:36.219 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:04:36.261 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:36.262+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:36.297 INFO:tasks.workunit.client.0.smithi019.stdout:Bucket Created: buck_2024_08_12_00_04_36 2024-09-12T00:04:36.349 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:36.350+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:36.391 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:36.391 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:36.408 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:04:36.450 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:36.452+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:36.470 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:04:36.470 INFO:tasks.workunit.client.0.smithi019.stdout:Test case: PASSED - quota set for the bucket: buck_2024_08_12_00_04_36 max objects -1 2024-09-12T00:04:36.471 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:04:36.471 INFO:tasks.workunit.client.0.smithi019.stdout:bucket delete succeeded 2024-09-12T00:04:36.524 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:04:36.551 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:36.550+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:36.582 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:36.582 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:36.598 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:04:36.615 INFO:tasks.workunit.client.0.smithi019.stdout:Bucket Created: buck_2024_08_12_00_04_36 2024-09-12T00:04:36.685 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:36.686+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:36.753 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:36.754+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:36.771 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:36.771 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:36.789 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:04:36.790 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:04:36.790 INFO:tasks.workunit.client.0.smithi019.stdout:Test case: PASSED - quota set for the bucket: buck_2024_08_12_00_04_36 with max size -1 2024-09-12T00:04:36.790 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:04:36.790 INFO:tasks.workunit.client.0.smithi019.stdout:bucket delete succeeded 2024-09-12T00:04:36.854 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:36.856+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:36.951 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:36.951 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:36.955 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:36.956+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:36.966 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:04:37.056 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:37.056+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:37.085 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:37.085 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:37.100 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:04:37.159 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:37.158+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:37.223 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:37.223 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:37.237 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:04:37.281 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:37.284+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:37.362 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:37.362+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:37.379 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:37.379 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:37.397 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:04:37.485 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:37.488+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:37.492 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T00:04:37.496 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:04:37.565 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:37.568+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:37.578 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:37.578 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:37.600 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:04:37.639 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:37.640 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:37.656 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:37.657 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:37.664 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:37.664+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:37.673 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:37.673 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:37.690 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:37.690 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:37.712 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:37.712 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:37.733 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:37.734 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:37.755 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:37.755 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:37.761 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:37.761 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:37.761 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:37.761 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:37.761 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.761 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:37.762 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:37.762 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 66.43197807, 2024-09-12T00:04:37.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.027441031000000001, 2024-09-12T00:04:37.762 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:37.762 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:37.762 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:37.762 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:37.762 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:37.762 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:37.762 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:04:37.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.762 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:37.762 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.762 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:37.763 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:37.763 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.763 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:37.763 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:04:37.763 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.763 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:37.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330357+0000", 2024-09-12T00:04:37.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2339999999999996e-06 2024-09-12T00:04:37.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.764 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:37.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330381+0000", 2024-09-12T00:04:37.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4626000000000001e-05 2024-09-12T00:04:37.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.765 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:37.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330417+0000", 2024-09-12T00:04:37.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5886000000000002e-05 2024-09-12T00:04:37.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.765 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:37.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330442+0000", 2024-09-12T00:04:37.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4522999999999999e-05 2024-09-12T00:04:37.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.766 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.766 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335485+0000", 2024-09-12T00:04:37.766 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050432589999999996 2024-09-12T00:04:37.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.766 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:37.766 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335507+0000", 2024-09-12T00:04:37.766 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2013000000000001e-05 2024-09-12T00:04:37.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.766 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.766 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.351747+0000", 2024-09-12T00:04:37.767 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016240451999999999 2024-09-12T00:04:37.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.767 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:37.767 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352062+0000", 2024-09-12T00:04:37.767 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031433399999999999 2024-09-12T00:04:37.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.767 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:37.767 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352378+0000", 2024-09-12T00:04:37.767 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031586400000000001 2024-09-12T00:04:37.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.767 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:37.767 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.355074+0000", 2024-09-12T00:04:37.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026962919999999999 2024-09-12T00:04:37.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:37.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357537+0000", 2024-09-12T00:04:37.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024634689999999998 2024-09-12T00:04:37.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:37.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357680+0000", 2024-09-12T00:04:37.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014314899999999999 2024-09-12T00:04:37.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.769 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:37.769 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357793+0000", 2024-09-12T00:04:37.769 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011293 2024-09-12T00:04:37.769 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.769 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:37.769 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.769 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.769 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94232250902656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:04:37.769 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:37.769 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 66.404062909999993, 2024-09-12T00:04:37.769 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052696050000000001, 2024-09-12T00:04:37.769 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:37.769 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:37.770 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:37.770 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:37.770 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:37.770 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:37.770 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:04:37.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.770 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:37.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:37.770 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:37.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:37.771 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358268+0000", 2024-09-12T00:04:37.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.771 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:37.771 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358270+0000", 2024-09-12T00:04:37.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.17e-06 2024-09-12T00:04:37.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.771 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:37.771 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358278+0000", 2024-09-12T00:04:37.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3529999999999995e-06 2024-09-12T00:04:37.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.772 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:37.772 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358306+0000", 2024-09-12T00:04:37.772 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7763000000000002e-05 2024-09-12T00:04:37.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.772 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.772 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:37.772 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358324+0000", 2024-09-12T00:04:37.772 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7861000000000001e-05 2024-09-12T00:04:37.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.772 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.772 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.772 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358447+0000", 2024-09-12T00:04:37.772 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012334299999999999 2024-09-12T00:04:37.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.773 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:37.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358624+0000", 2024-09-12T00:04:37.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017684999999999999 2024-09-12T00:04:37.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.773 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:37.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.358964+0000", 2024-09-12T00:04:37.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00033991199999999999 2024-09-12T00:04:37.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.773 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:37.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.362920+0000", 2024-09-12T00:04:37.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039564600000000002 2024-09-12T00:04:37.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.774 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:37.774 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363016+0000", 2024-09-12T00:04:37.774 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5612999999999994e-05 2024-09-12T00:04:37.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.774 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:37.774 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363244+0000", 2024-09-12T00:04:37.774 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000228385 2024-09-12T00:04:37.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.774 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:37.774 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.363537+0000", 2024-09-12T00:04:37.774 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00029289499999999999 2024-09-12T00:04:37.775 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.775 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:37.775 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.775 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.775 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:37.775 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:37.775 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.396685392999998, 2024-09-12T00:04:37.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011415537, 2024-09-12T00:04:37.775 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:37.775 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:37.775 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:37.775 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:37.775 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:37.776 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:37.776 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 209 2024-09-12T00:04:37.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.776 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:37.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:37.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:37.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:37.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365645+0000", 2024-09-12T00:04:37.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:37.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365648+0000", 2024-09-12T00:04:37.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7360000000000001e-06 2024-09-12T00:04:37.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:37.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365660+0000", 2024-09-12T00:04:37.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2089999999999999e-05 2024-09-12T00:04:37.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:37.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365690+0000", 2024-09-12T00:04:37.778 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0320000000000001e-05 2024-09-12T00:04:37.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.778 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:37.778 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365708+0000", 2024-09-12T00:04:37.778 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7520000000000002e-05 2024-09-12T00:04:37.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.778 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.778 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365870+0000", 2024-09-12T00:04:37.778 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016208600000000001 2024-09-12T00:04:37.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.778 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:37.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.365885+0000", 2024-09-12T00:04:37.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5119999999999999e-05 2024-09-12T00:04:37.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373482+0000", 2024-09-12T00:04:37.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075970279999999996 2024-09-12T00:04:37.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:37.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.373805+0000", 2024-09-12T00:04:37.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032262799999999999 2024-09-12T00:04:37.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:37.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.374297+0000", 2024-09-12T00:04:37.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00049250599999999998 2024-09-12T00:04:37.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:37.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.375670+0000", 2024-09-12T00:04:37.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001373333 2024-09-12T00:04:37.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:37.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.376923+0000", 2024-09-12T00:04:37.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012525640000000001 2024-09-12T00:04:37.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.781 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:37.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377000+0000", 2024-09-12T00:04:37.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6732999999999999e-05 2024-09-12T00:04:37.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.781 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:37.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.377061+0000", 2024-09-12T00:04:37.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0872999999999998e-05 2024-09-12T00:04:37.781 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.781 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:37.781 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.781 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:240 6.19 6:9f626c48:lc::lc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:37.782 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:37.782 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.278099640000001, 2024-09-12T00:04:37.782 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058545680000000001, 2024-09-12T00:04:37.782 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:37.782 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:37.782 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:37.782 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:37.782 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:37.782 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:37.782 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 240 2024-09-12T00:04:37.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.782 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:37.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.782 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:37.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:37.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:37.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484231+0000", 2024-09-12T00:04:37.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:37.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484233+0000", 2024-09-12T00:04:37.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.973e-06 2024-09-12T00:04:37.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:37.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484241+0000", 2024-09-12T00:04:37.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8210000000000002e-06 2024-09-12T00:04:37.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:37.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484260+0000", 2024-09-12T00:04:37.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9148999999999999e-05 2024-09-12T00:04:37.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:37.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484268+0000", 2024-09-12T00:04:37.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5120000000000008e-06 2024-09-12T00:04:37.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484371+0000", 2024-09-12T00:04:37.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102501 2024-09-12T00:04:37.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:37.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484450+0000", 2024-09-12T00:04:37.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9122999999999994e-05 2024-09-12T00:04:37.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:37.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484578+0000", 2024-09-12T00:04:37.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000128095 2024-09-12T00:04:37.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.786 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:37.786 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.485336+0000", 2024-09-12T00:04:37.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00075754000000000001 2024-09-12T00:04:37.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.786 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:37.786 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.489975+0000", 2024-09-12T00:04:37.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004639738 2024-09-12T00:04:37.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.786 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:37.786 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490043+0000", 2024-09-12T00:04:37.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7923999999999995e-05 2024-09-12T00:04:37.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.787 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.787 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:37.787 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490085+0000", 2024-09-12T00:04:37.787 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2191999999999999e-05 2024-09-12T00:04:37.787 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.787 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:37.787 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.787 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.787 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:412 6.3 6:c3a682d4:reshard::reshard.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:37.787 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:37.787 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.235704234000004, 2024-09-12T00:04:37.787 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049075530000000003, 2024-09-12T00:04:37.787 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:37.788 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:37.788 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:37.788 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:37.788 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:37.788 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:37.788 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 412 2024-09-12T00:04:37.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.788 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:37.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.788 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:37.788 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:37.788 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:37.789 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526626+0000", 2024-09-12T00:04:37.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:37.789 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526628+0000", 2024-09-12T00:04:37.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.513e-06 2024-09-12T00:04:37.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:37.789 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526634+0000", 2024-09-12T00:04:37.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1279999999999996e-06 2024-09-12T00:04:37.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:37.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526649+0000", 2024-09-12T00:04:37.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4997999999999999e-05 2024-09-12T00:04:37.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:37.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526658+0000", 2024-09-12T00:04:37.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1589999999999999e-06 2024-09-12T00:04:37.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526728+0000", 2024-09-12T00:04:37.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0203999999999994e-05 2024-09-12T00:04:37.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:37.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526839+0000", 2024-09-12T00:04:37.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011055 2024-09-12T00:04:37.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:37.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526979+0000", 2024-09-12T00:04:37.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139863 2024-09-12T00:04:37.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:37.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.527616+0000", 2024-09-12T00:04:37.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00063707900000000003 2024-09-12T00:04:37.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:37.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531450+0000", 2024-09-12T00:04:37.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003833819 2024-09-12T00:04:37.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:37.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531490+0000", 2024-09-12T00:04:37.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0129000000000002e-05 2024-09-12T00:04:37.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:37.793 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531534+0000", 2024-09-12T00:04:37.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4110999999999998e-05 2024-09-12T00:04:37.793 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.793 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:37.793 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.793 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.793 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:490 6.19 6:9dc32cef:lc::lc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:37.793 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:37.793 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.21150686, 2024-09-12T00:04:37.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047438380000000002, 2024-09-12T00:04:37.793 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:37.793 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:37.793 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:37.794 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:37.794 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:37.794 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:37.794 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 490 2024-09-12T00:04:37.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.794 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:37.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:37.794 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:37.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:37.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550824+0000", 2024-09-12T00:04:37.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:37.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550825+0000", 2024-09-12T00:04:37.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0589999999999999e-06 2024-09-12T00:04:37.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:37.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550830+0000", 2024-09-12T00:04:37.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2140000000000004e-06 2024-09-12T00:04:37.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:37.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550843+0000", 2024-09-12T00:04:37.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3404000000000001e-05 2024-09-12T00:04:37.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:37.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550852+0000", 2024-09-12T00:04:37.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1549999999999996e-06 2024-09-12T00:04:37.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550910+0000", 2024-09-12T00:04:37.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7636000000000002e-05 2024-09-12T00:04:37.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:37.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.550977+0000", 2024-09-12T00:04:37.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6636000000000004e-05 2024-09-12T00:04:37.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:37.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.551135+0000", 2024-09-12T00:04:37.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015852999999999999 2024-09-12T00:04:37.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:37.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552939+0000", 2024-09-12T00:04:37.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001803643 2024-09-12T00:04:37.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:37.798 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555471+0000", 2024-09-12T00:04:37.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002532327 2024-09-12T00:04:37.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:37.798 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555526+0000", 2024-09-12T00:04:37.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4728000000000002e-05 2024-09-12T00:04:37.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:37.798 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.555567+0000", 2024-09-12T00:04:37.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1505999999999999e-05 2024-09-12T00:04:37.799 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.799 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:37.799 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.799 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:492 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'6, mlcod=35'4)", 2024-09-12T00:04:37.799 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:37.799 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.209730796000002, 2024-09-12T00:04:37.799 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056118790000000002, 2024-09-12T00:04:37.799 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:37.799 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:37.799 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:37.799 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:37.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.799 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:37.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:37.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:37.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552600+0000", 2024-09-12T00:04:37.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:37.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552601+0000", 2024-09-12T00:04:37.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6899999999999996e-07 2024-09-12T00:04:37.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:37.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552608+0000", 2024-09-12T00:04:37.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4529999999999996e-06 2024-09-12T00:04:37.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:37.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552624+0000", 2024-09-12T00:04:37.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5885000000000001e-05 2024-09-12T00:04:37.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:37.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552632+0000", 2024-09-12T00:04:37.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2220000000000002e-06 2024-09-12T00:04:37.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552716+0000", 2024-09-12T00:04:37.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4060999999999994e-05 2024-09-12T00:04:37.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:37.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552735+0000", 2024-09-12T00:04:37.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9170000000000001e-05 2024-09-12T00:04:37.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:37.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558164+0000", 2024-09-12T00:04:37.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054289899999999999 2024-09-12T00:04:37.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.803 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:37.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558212+0000", 2024-09-12T00:04:37.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7129000000000002e-05 2024-09-12T00:04:37.803 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.803 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:37.803 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.803 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:641 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:37.803 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:37.803 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.168553181, 2024-09-12T00:04:37.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052824789999999996, 2024-09-12T00:04:37.804 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:37.804 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:37.804 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:37.804 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:37.804 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:37.804 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:37.804 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 641 2024-09-12T00:04:37.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.804 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:37.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:37.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:37.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:37.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593777+0000", 2024-09-12T00:04:37.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:37.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593778+0000", 2024-09-12T00:04:37.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0920000000000001e-06 2024-09-12T00:04:37.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:37.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593783+0000", 2024-09-12T00:04:37.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9490000000000004e-06 2024-09-12T00:04:37.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:37.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593795+0000", 2024-09-12T00:04:37.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2048999999999999e-05 2024-09-12T00:04:37.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:37.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593801+0000", 2024-09-12T00:04:37.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8989999999999998e-06 2024-09-12T00:04:37.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593852+0000", 2024-09-12T00:04:37.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1057999999999998e-05 2024-09-12T00:04:37.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:37.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593905+0000", 2024-09-12T00:04:37.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2196e-05 2024-09-12T00:04:37.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:37.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594017+0000", 2024-09-12T00:04:37.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000112816 2024-09-12T00:04:37.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:37.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.595190+0000", 2024-09-12T00:04:37.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011727199999999999 2024-09-12T00:04:37.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.816 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:37.816 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.598998+0000", 2024-09-12T00:04:37.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038081320000000001 2024-09-12T00:04:37.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.816 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.816 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:37.816 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599032+0000", 2024-09-12T00:04:37.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4283999999999999e-05 2024-09-12T00:04:37.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.816 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.816 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:37.816 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599060+0000", 2024-09-12T00:04:37.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7284000000000002e-05 2024-09-12T00:04:37.816 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.817 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:37.817 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.817 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.817 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:643 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'8, mlcod=35'6)", 2024-09-12T00:04:37.817 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:37.817 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.168055074000002, 2024-09-12T00:04:37.817 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048211260000000002, 2024-09-12T00:04:37.817 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:37.817 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:37.817 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:37.817 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:37.817 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.817 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:37.818 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:37.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.818 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:37.818 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594275+0000", 2024-09-12T00:04:37.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.818 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:37.818 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594276+0000", 2024-09-12T00:04:37.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5899999999999995e-07 2024-09-12T00:04:37.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.819 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:37.819 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594283+0000", 2024-09-12T00:04:37.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6019999999999996e-06 2024-09-12T00:04:37.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.819 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:37.819 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594295+0000", 2024-09-12T00:04:37.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1683e-05 2024-09-12T00:04:37.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.819 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:37.819 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594303+0000", 2024-09-12T00:04:37.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0439999999999996e-06 2024-09-12T00:04:37.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.820 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594353+0000", 2024-09-12T00:04:37.820 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0698000000000001e-05 2024-09-12T00:04:37.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:37.820 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594380+0000", 2024-09-12T00:04:37.820 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7089000000000001e-05 2024-09-12T00:04:37.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:37.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599063+0000", 2024-09-12T00:04:37.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046824739999999998 2024-09-12T00:04:37.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:37.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599096+0000", 2024-09-12T00:04:37.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3677000000000003e-05 2024-09-12T00:04:37.821 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.821 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:37.821 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.821 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:647 6.a 6:5395e6f3:lc::lc.4:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:37.821 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:37.822 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.165704441000003, 2024-09-12T00:04:37.822 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049071770000000004, 2024-09-12T00:04:37.822 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:37.822 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:37.822 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:37.822 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:37.822 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:37.822 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:37.822 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 647 2024-09-12T00:04:37.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.822 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:37.822 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:37.822 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:37.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:37.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596626+0000", 2024-09-12T00:04:37.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:37.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596627+0000", 2024-09-12T00:04:37.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1149999999999999e-06 2024-09-12T00:04:37.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:37.824 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596632+0000", 2024-09-12T00:04:37.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7060000000000003e-06 2024-09-12T00:04:37.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.824 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:37.824 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596645+0000", 2024-09-12T00:04:37.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2791e-05 2024-09-12T00:04:37.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.824 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:37.824 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596653+0000", 2024-09-12T00:04:37.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9230000000000002e-06 2024-09-12T00:04:37.825 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.825 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.825 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.825 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596705+0000", 2024-09-12T00:04:37.825 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2250000000000003e-05 2024-09-12T00:04:37.825 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.825 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.825 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:37.825 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596758+0000", 2024-09-12T00:04:37.825 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2964000000000003e-05 2024-09-12T00:04:37.825 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.825 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.825 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:37.825 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.596873+0000", 2024-09-12T00:04:37.826 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011501 2024-09-12T00:04:37.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:37.826 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599088+0000", 2024-09-12T00:04:37.826 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002215135 2024-09-12T00:04:37.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:37.826 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601456+0000", 2024-09-12T00:04:37.826 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023684719999999999 2024-09-12T00:04:37.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:37.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601507+0000", 2024-09-12T00:04:37.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0933999999999997e-05 2024-09-12T00:04:37.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:37.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601533+0000", 2024-09-12T00:04:37.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5877e-05 2024-09-12T00:04:37.827 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.827 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:37.827 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.827 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:657 6.1a e35/29 6:5be42343:lc::lc.11:head v 35'10, mlcod=35'7)", 2024-09-12T00:04:37.828 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:37.828 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.161880901000004, 2024-09-12T00:04:37.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066410239999999997, 2024-09-12T00:04:37.828 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:37.828 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:37.828 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:37.828 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:37.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:37.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:37.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:37.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:37.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:37.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600450+0000", 2024-09-12T00:04:37.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6099999999999999e-07 2024-09-12T00:04:37.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:37.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600457+0000", 2024-09-12T00:04:37.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8700000000000003e-06 2024-09-12T00:04:37.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:37.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600470+0000", 2024-09-12T00:04:37.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3186999999999999e-05 2024-09-12T00:04:37.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:37.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600478+0000", 2024-09-12T00:04:37.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5310000000000004e-06 2024-09-12T00:04:37.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600521+0000", 2024-09-12T00:04:37.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2574000000000003e-05 2024-09-12T00:04:37.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:37.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600535+0000", 2024-09-12T00:04:37.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4151000000000001e-05 2024-09-12T00:04:37.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:37.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.606997+0000", 2024-09-12T00:04:37.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064626099999999997 2024-09-12T00:04:37.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:37.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607091+0000", 2024-09-12T00:04:37.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3239999999999995e-05 2024-09-12T00:04:37.832 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.832 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:37.832 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.832 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:659 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:37.832 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:37.832 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.161708568999998, 2024-09-12T00:04:37.832 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0065340989999999998, 2024-09-12T00:04:37.832 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:37.832 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:37.832 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:37.832 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:37.832 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:37.833 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:37.833 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 659 2024-09-12T00:04:37.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.833 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:37.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:37.833 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:37.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:37.833 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600622+0000", 2024-09-12T00:04:37.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:37.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600623+0000", 2024-09-12T00:04:37.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.085e-06 2024-09-12T00:04:37.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:37.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600630+0000", 2024-09-12T00:04:37.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0029999999999997e-06 2024-09-12T00:04:37.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:37.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600647+0000", 2024-09-12T00:04:37.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6566999999999999e-05 2024-09-12T00:04:37.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:37.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600658+0000", 2024-09-12T00:04:37.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0992000000000001e-05 2024-09-12T00:04:37.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600717+0000", 2024-09-12T00:04:37.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9925e-05 2024-09-12T00:04:37.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:37.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600773+0000", 2024-09-12T00:04:37.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5766000000000001e-05 2024-09-12T00:04:37.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.836 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:37.836 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600889+0000", 2024-09-12T00:04:37.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115906 2024-09-12T00:04:37.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.836 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:37.836 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603483+0000", 2024-09-12T00:04:37.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025940799999999999 2024-09-12T00:04:37.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.836 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:37.837 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607098+0000", 2024-09-12T00:04:37.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036150459999999998 2024-09-12T00:04:37.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.837 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.837 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:37.837 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607133+0000", 2024-09-12T00:04:37.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4615e-05 2024-09-12T00:04:37.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.837 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.837 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:37.837 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607156+0000", 2024-09-12T00:04:37.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3113999999999999e-05 2024-09-12T00:04:37.838 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.838 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:37.838 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.838 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:666 6.a 6:5395e6f3:lc::lc.4:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:37.838 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:37.838 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.159961440000004, 2024-09-12T00:04:37.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.005127174, 2024-09-12T00:04:37.838 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:37.838 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:37.838 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:37.838 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:37.838 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:37.839 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:37.839 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 666 2024-09-12T00:04:37.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.839 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:37.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:37.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:37.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:37.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602369+0000", 2024-09-12T00:04:37.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:37.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602370+0000", 2024-09-12T00:04:37.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0720000000000001e-06 2024-09-12T00:04:37.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:37.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602376+0000", 2024-09-12T00:04:37.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5489999999999997e-06 2024-09-12T00:04:37.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:37.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602391+0000", 2024-09-12T00:04:37.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5301000000000001e-05 2024-09-12T00:04:37.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.841 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.841 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:37.841 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602399+0000", 2024-09-12T00:04:37.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9179999999999994e-06 2024-09-12T00:04:37.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.841 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.841 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.841 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602456+0000", 2024-09-12T00:04:37.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7099999999999999e-05 2024-09-12T00:04:37.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.841 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:37.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602508+0000", 2024-09-12T00:04:37.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2476999999999999e-05 2024-09-12T00:04:37.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:37.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602606+0000", 2024-09-12T00:04:37.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7823000000000002e-05 2024-09-12T00:04:37.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:37.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.604653+0000", 2024-09-12T00:04:37.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002047068 2024-09-12T00:04:37.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.843 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:37.843 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607401+0000", 2024-09-12T00:04:37.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027477700000000001 2024-09-12T00:04:37.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.843 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:37.843 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607453+0000", 2024-09-12T00:04:37.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2092999999999997e-05 2024-09-12T00:04:37.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.843 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:37.843 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607496+0000", 2024-09-12T00:04:37.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3003000000000001e-05 2024-09-12T00:04:37.844 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.844 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:37.844 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.844 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.844 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:665 6.1a e35/29 6:5c7e8a6d:reshard::reshard.0000000015:head v 35'11, mlcod=35'8)", 2024-09-12T00:04:37.844 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:37.844 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.159589754999999, 2024-09-12T00:04:37.844 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048593209999999998, 2024-09-12T00:04:37.844 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:37.844 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:37.844 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:37.844 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:37.845 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.845 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:37.845 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:37.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.845 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.845 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:37.845 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602741+0000", 2024-09-12T00:04:37.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.845 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.845 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:37.845 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602742+0000", 2024-09-12T00:04:37.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1069999999999999e-06 2024-09-12T00:04:37.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.846 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.846 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:37.846 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602749+0000", 2024-09-12T00:04:37.846 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9609999999999999e-06 2024-09-12T00:04:37.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.846 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.846 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:37.846 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602763+0000", 2024-09-12T00:04:37.846 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4086e-05 2024-09-12T00:04:37.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.846 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.846 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:37.846 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602772+0000", 2024-09-12T00:04:37.847 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8470000000000002e-06 2024-09-12T00:04:37.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.847 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.847 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.847 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602826+0000", 2024-09-12T00:04:37.847 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3885000000000003e-05 2024-09-12T00:04:37.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.847 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.847 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:37.847 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602837+0000", 2024-09-12T00:04:37.847 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1601e-05 2024-09-12T00:04:37.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.847 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.848 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:37.848 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607500+0000", 2024-09-12T00:04:37.848 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046627509999999997 2024-09-12T00:04:37.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.848 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.848 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:37.848 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607600+0000", 2024-09-12T00:04:37.848 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100083 2024-09-12T00:04:37.848 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.848 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:37.848 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.848 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.848 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:852 6.1d e35/29 6:bbf2d10c:::obj_delete_at_hint.0000000025:head v 35'9, mlcod=35'7)", 2024-09-12T00:04:37.849 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:37.849 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.087728022, 2024-09-12T00:04:37.849 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00569595, 2024-09-12T00:04:37.849 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:37.849 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:37.849 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:37.849 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:37.849 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.849 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:37.849 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:37.849 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.849 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.849 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.849 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:37.850 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674602+0000", 2024-09-12T00:04:37.850 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.850 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.850 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.850 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:37.850 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674604+0000", 2024-09-12T00:04:37.850 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2079999999999999e-06 2024-09-12T00:04:37.850 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.850 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.850 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:37.850 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674611+0000", 2024-09-12T00:04:37.850 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.973e-06 2024-09-12T00:04:37.850 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.850 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.851 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:37.851 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674625+0000", 2024-09-12T00:04:37.851 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3916e-05 2024-09-12T00:04:37.851 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.851 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.851 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:37.851 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674633+0000", 2024-09-12T00:04:37.851 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8580000000000006e-06 2024-09-12T00:04:37.851 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.851 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.851 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.851 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674697+0000", 2024-09-12T00:04:37.851 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4004999999999995e-05 2024-09-12T00:04:37.851 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.851 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.852 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:37.852 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674713+0000", 2024-09-12T00:04:37.852 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5835e-05 2024-09-12T00:04:37.852 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.852 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.852 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:37.852 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680245+0000", 2024-09-12T00:04:37.852 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055320250000000003 2024-09-12T00:04:37.852 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.852 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.852 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:37.852 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.680298+0000", 2024-09-12T00:04:37.852 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3130000000000001e-05 2024-09-12T00:04:37.853 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.853 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:37.853 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.853 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.853 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.853 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:925 6.1a e35/29 6:5f2e3d26:lc::lc.18:head v 35'15, mlcod=35'12)", 2024-09-12T00:04:37.853 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:37.853 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.064200192000001, 2024-09-12T00:04:37.853 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055640999999999998, 2024-09-12T00:04:37.853 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:37.853 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:37.853 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:37.853 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:37.853 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.854 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:37.854 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:37.854 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.854 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.854 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:37.854 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698130+0000", 2024-09-12T00:04:37.854 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.854 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.854 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:37.854 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698131+0000", 2024-09-12T00:04:37.854 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:04:37.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.855 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.855 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:37.855 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698140+0000", 2024-09-12T00:04:37.855 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3139999999999993e-06 2024-09-12T00:04:37.855 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.855 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.855 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:37.855 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698155+0000", 2024-09-12T00:04:37.855 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:04:37.855 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.855 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.855 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:37.855 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698164+0000", 2024-09-12T00:04:37.855 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1419999999999999e-06 2024-09-12T00:04:37.856 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.856 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.856 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.856 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698228+0000", 2024-09-12T00:04:37.856 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3380000000000006e-05 2024-09-12T00:04:37.856 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.856 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.856 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:37.856 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698252+0000", 2024-09-12T00:04:37.856 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4111e-05 2024-09-12T00:04:37.856 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.856 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.856 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:37.857 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703646+0000", 2024-09-12T00:04:37.857 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0053937840000000004 2024-09-12T00:04:37.857 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.857 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.857 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:37.857 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703694+0000", 2024-09-12T00:04:37.857 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8776999999999997e-05 2024-09-12T00:04:37.857 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.857 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:37.857 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.857 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.857 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.857 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:927 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:37.857 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:37.858 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.063681168000002, 2024-09-12T00:04:37.858 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050914949999999997, 2024-09-12T00:04:37.858 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:37.858 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:37.858 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:37.858 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:37.858 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:37.858 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:37.858 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 927 2024-09-12T00:04:37.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.858 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:37.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.858 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:37.858 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:37.859 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.859 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:37.859 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698649+0000", 2024-09-12T00:04:37.859 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.859 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:37.859 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698651+0000", 2024-09-12T00:04:37.859 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3740000000000001e-06 2024-09-12T00:04:37.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.859 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:37.859 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698657+0000", 2024-09-12T00:04:37.860 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5239999999999997e-06 2024-09-12T00:04:37.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.860 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.860 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:37.860 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698673+0000", 2024-09-12T00:04:37.860 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5345999999999998e-05 2024-09-12T00:04:37.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.860 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.860 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:37.860 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.698680+0000", 2024-09-12T00:04:37.860 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4649999999999997e-06 2024-09-12T00:04:37.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.860 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.861 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.861 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699009+0000", 2024-09-12T00:04:37.861 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00032934000000000001 2024-09-12T00:04:37.861 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.861 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.861 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:37.861 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699213+0000", 2024-09-12T00:04:37.861 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020361500000000001 2024-09-12T00:04:37.861 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.861 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.861 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:37.861 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.699450+0000", 2024-09-12T00:04:37.861 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023670399999999999 2024-09-12T00:04:37.861 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.862 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.862 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:37.862 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.700678+0000", 2024-09-12T00:04:37.862 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012285519999999999 2024-09-12T00:04:37.862 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.862 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.862 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:37.862 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703666+0000", 2024-09-12T00:04:37.862 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029876130000000001 2024-09-12T00:04:37.862 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.862 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.862 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:37.862 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703708+0000", 2024-09-12T00:04:37.862 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2361999999999999e-05 2024-09-12T00:04:37.862 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.863 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.863 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:37.863 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703741+0000", 2024-09-12T00:04:37.863 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.26e-05 2024-09-12T00:04:37.863 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.863 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:37.863 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.863 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.863 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.863 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:941 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:37.863 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:37.863 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 63.058187715000003, 2024-09-12T00:04:37.863 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0051476960000000002, 2024-09-12T00:04:37.863 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:37.864 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:37.864 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "started", 2024-09-12T00:04:37.864 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:37.864 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:37.864 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:37.864 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 941 2024-09-12T00:04:37.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.864 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:37.864 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:37.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:37.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:37.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704143+0000", 2024-09-12T00:04:37.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:37.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704144+0000", 2024-09-12T00:04:37.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.514e-06 2024-09-12T00:04:37.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:37.866 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704152+0000", 2024-09-12T00:04:37.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2830000000000004e-06 2024-09-12T00:04:37.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:37.866 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704168+0000", 2024-09-12T00:04:37.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6835999999999999e-05 2024-09-12T00:04:37.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:37.866 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704178+0000", 2024-09-12T00:04:37.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7569999999999999e-06 2024-09-12T00:04:37.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.867 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.867 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.867 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704240+0000", 2024-09-12T00:04:37.867 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2193000000000006e-05 2024-09-12T00:04:37.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.867 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.867 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:37.867 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704308+0000", 2024-09-12T00:04:37.867 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7840000000000001e-05 2024-09-12T00:04:37.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.867 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.867 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:37.867 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.709290+0000", 2024-09-12T00:04:37.868 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049822729999999997 2024-09-12T00:04:37.868 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.868 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:37.868 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.868 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.868 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.868 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1787 6.12 6:4f78e9a2:gc::gc.8:head [call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_enqueue in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:37.868 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.334334+0000", 2024-09-12T00:04:37.868 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 3.4279961800000001, 2024-09-12T00:04:37.868 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052676989999999998, 2024-09-12T00:04:37.868 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:37.868 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:37.868 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:37.868 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:37.869 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:37.869 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:37.869 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1787 2024-09-12T00:04:37.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.869 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:37.869 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.869 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:37.869 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.334334+0000", 2024-09-12T00:04:37.869 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.869 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.869 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:37.869 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.334334+0000", 2024-09-12T00:04:37.869 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.870 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.870 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:37.870 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.334336+0000", 2024-09-12T00:04:37.870 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0640000000000001e-06 2024-09-12T00:04:37.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.870 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.870 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:37.870 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.334344+0000", 2024-09-12T00:04:37.870 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3039999999999999e-06 2024-09-12T00:04:37.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.870 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.870 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:37.870 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.334361+0000", 2024-09-12T00:04:37.871 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7643999999999999e-05 2024-09-12T00:04:37.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.871 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.871 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:37.871 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.334369+0000", 2024-09-12T00:04:37.871 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5410000000000003e-06 2024-09-12T00:04:37.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.871 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.871 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.871 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.334431+0000", 2024-09-12T00:04:37.871 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1854999999999996e-05 2024-09-12T00:04:37.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.871 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.871 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:37.872 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.334491+0000", 2024-09-12T00:04:37.872 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0708000000000002e-05 2024-09-12T00:04:37.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.872 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:37.872 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.334664+0000", 2024-09-12T00:04:37.872 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017301400000000001 2024-09-12T00:04:37.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.872 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:37.872 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.335357+0000", 2024-09-12T00:04:37.872 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00069306200000000004 2024-09-12T00:04:37.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.873 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:37.873 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.339547+0000", 2024-09-12T00:04:37.873 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041895480000000004 2024-09-12T00:04:37.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.873 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.873 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:37.873 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.339576+0000", 2024-09-12T00:04:37.873 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9204e-05 2024-09-12T00:04:37.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.873 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.873 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:37.873 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.339602+0000", 2024-09-12T00:04:37.873 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5755e-05 2024-09-12T00:04:37.873 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.874 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:37.874 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.874 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.874 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1864 4.3d 4:bcffd798:::.dir.b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:37.874 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.377468+0000", 2024-09-12T00:04:37.874 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 3.3848628019999998, 2024-09-12T00:04:37.874 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080797030000000006, 2024-09-12T00:04:37.874 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:37.874 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:37.874 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:37.874 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:37.874 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:37.874 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:37.875 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1864 2024-09-12T00:04:37.875 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.875 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:37.875 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.875 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:37.875 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377468+0000", 2024-09-12T00:04:37.875 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.875 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.875 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.875 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:37.875 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377468+0000", 2024-09-12T00:04:37.875 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:37.875 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.875 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:37.876 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377469+0000", 2024-09-12T00:04:37.876 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8500000000000001e-06 2024-09-12T00:04:37.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.876 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:37.876 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377478+0000", 2024-09-12T00:04:37.876 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.541e-06 2024-09-12T00:04:37.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.876 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:37.876 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377492+0000", 2024-09-12T00:04:37.876 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3978999999999999e-05 2024-09-12T00:04:37.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.877 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.877 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:37.877 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377498+0000", 2024-09-12T00:04:37.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0630000000000002e-06 2024-09-12T00:04:37.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.877 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.877 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:37.877 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377561+0000", 2024-09-12T00:04:37.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2477000000000005e-05 2024-09-12T00:04:37.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.877 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.877 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:37.877 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377649+0000", 2024-09-12T00:04:37.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8914999999999998e-05 2024-09-12T00:04:37.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.878 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.878 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:37.878 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377756+0000", 2024-09-12T00:04:37.878 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000106816 2024-09-12T00:04:37.878 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.878 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.878 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:37.878 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.378610+0000", 2024-09-12T00:04:37.878 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00085353200000000005 2024-09-12T00:04:37.878 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.878 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.878 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:37.878 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.385488+0000", 2024-09-12T00:04:37.878 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0068780200000000003 2024-09-12T00:04:37.879 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.879 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.879 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:37.879 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.385519+0000", 2024-09-12T00:04:37.879 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0935000000000001e-05 2024-09-12T00:04:37.879 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:37.879 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:37.879 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:37.879 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.385547+0000", 2024-09-12T00:04:37.879 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8575e-05 2024-09-12T00:04:37.879 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.879 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:37.879 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.879 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:37.880 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:37.880 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:37.880 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:37.881 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:37.882 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:04:37.883 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:37.880+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:37.982 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:37.984+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:38.044 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:38.044 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:38.044 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:38.044 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:38.052 INFO:tasks.workunit.client.0.smithi019.stderr:200+0 records in 2024-09-12T00:04:38.052 INFO:tasks.workunit.client.0.smithi019.stderr:200+0 records out 2024-09-12T00:04:38.052 INFO:tasks.workunit.client.0.smithi019.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 1.25945 s, 1.7 GB/s 2024-09-12T00:04:38.059 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:04:38.105 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:38.108+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:38.185 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:38.188+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:38.220 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:38.220 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:38.220 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:38.220 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:38.221 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:38.231 INFO:tasks.workunit.client.0.smithi019.stdout:Bucket Created: buck_2024_08_12_00_04_38 2024-09-12T00:04:38.233 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:04:38.321 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:38.324+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:38.389 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:38.388+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:38.391 INFO:tasks.workunit.client.0.smithi019.stdout:quota set for the bucket: buck_2024_08_12_00_04_38 2024-09-12T00:04:38.400 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:38.400 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:38.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:38.400 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:38.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.400 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:38.400 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:38.400 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 86.908217355000005, 2024-09-12T00:04:38.401 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.278479906, 2024-09-12T00:04:38.401 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.401 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.401 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.401 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:38.401 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:38.401 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:38.401 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:04:38.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.401 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.401 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.401 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:38.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.402 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:38.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.402 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493422+0000", 2024-09-12T00:04:38.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.807e-06 2024-09-12T00:04:38.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.403 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493435+0000", 2024-09-12T00:04:38.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.375e-05 2024-09-12T00:04:38.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.403 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493457+0000", 2024-09-12T00:04:38.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2166000000000001e-05 2024-09-12T00:04:38.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493475+0000", 2024-09-12T00:04:38.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7184e-05 2024-09-12T00:04:38.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493617+0000", 2024-09-12T00:04:38.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014274200000000001 2024-09-12T00:04:38.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:38.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493632+0000", 2024-09-12T00:04:38.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4293e-05 2024-09-12T00:04:38.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.768657+0000", 2024-09-12T00:04:38.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.27502575400000001 2024-09-12T00:04:38.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769042+0000", 2024-09-12T00:04:38.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00038463700000000001 2024-09-12T00:04:38.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:38.406 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769430+0000", 2024-09-12T00:04:38.406 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000388014 2024-09-12T00:04:38.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.406 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:38.406 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.770784+0000", 2024-09-12T00:04:38.406 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00135402 2024-09-12T00:04:38.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.406 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:38.406 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771735+0000", 2024-09-12T00:04:38.406 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00095068599999999996 2024-09-12T00:04:38.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771828+0000", 2024-09-12T00:04:38.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3468999999999996e-05 2024-09-12T00:04:38.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771899+0000", 2024-09-12T00:04:38.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0383999999999996e-05 2024-09-12T00:04:38.407 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.407 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.407 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.407 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:38.408 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:38.408 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 86.479890634, 2024-09-12T00:04:38.408 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013456684999999999, 2024-09-12T00:04:38.408 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.408 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.408 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.408 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:38.408 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:38.408 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:38.408 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 45 2024-09-12T00:04:38.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.408 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.409 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:38.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.409 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:38.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.409 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921746+0000", 2024-09-12T00:04:38.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9800000000000003e-07 2024-09-12T00:04:38.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921751+0000", 2024-09-12T00:04:38.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7099999999999998e-06 2024-09-12T00:04:38.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921766+0000", 2024-09-12T00:04:38.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5633000000000001e-05 2024-09-12T00:04:38.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921786+0000", 2024-09-12T00:04:38.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9658000000000001e-05 2024-09-12T00:04:38.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.411 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929539+0000", 2024-09-12T00:04:38.411 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0077533120000000001 2024-09-12T00:04:38.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.411 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929706+0000", 2024-09-12T00:04:38.411 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016664199999999999 2024-09-12T00:04:38.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.411 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:38.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929933+0000", 2024-09-12T00:04:38.411 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000226658 2024-09-12T00:04:38.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.412 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.412 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:38.412 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934721+0000", 2024-09-12T00:04:38.412 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047886439999999999 2024-09-12T00:04:38.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.412 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.412 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:38.412 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935062+0000", 2024-09-12T00:04:38.412 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00034072399999999999 2024-09-12T00:04:38.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.412 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.412 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935141+0000", 2024-09-12T00:04:38.413 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8570000000000002e-05 2024-09-12T00:04:38.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.413 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935202+0000", 2024-09-12T00:04:38.413 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1536000000000002e-05 2024-09-12T00:04:38.413 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.413 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.413 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.413 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.413 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:38.413 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:38.414 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 86.479840401999994, 2024-09-12T00:04:38.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014633617, 2024-09-12T00:04:38.414 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.414 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.414 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.414 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:38.414 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:38.414 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:38.414 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:04:38.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.414 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.414 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:38.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:38.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:38.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3599999999999999e-07 2024-09-12T00:04:38.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921800+0000", 2024-09-12T00:04:38.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3850000000000002e-06 2024-09-12T00:04:38.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921805+0000", 2024-09-12T00:04:38.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9460000000000003e-06 2024-09-12T00:04:38.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921819+0000", 2024-09-12T00:04:38.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.325e-05 2024-09-12T00:04:38.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.417 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.417 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930627+0000", 2024-09-12T00:04:38.417 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00880827 2024-09-12T00:04:38.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.417 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.417 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930805+0000", 2024-09-12T00:04:38.417 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000177992 2024-09-12T00:04:38.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.417 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:38.417 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.931028+0000", 2024-09-12T00:04:38.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000223122 2024-09-12T00:04:38.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.418 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.418 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:38.418 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935258+0000", 2024-09-12T00:04:38.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0042302709999999999 2024-09-12T00:04:38.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.418 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.418 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:38.418 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936282+0000", 2024-09-12T00:04:38.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00102345 2024-09-12T00:04:38.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.419 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.419 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.419 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936367+0000", 2024-09-12T00:04:38.419 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4869000000000003e-05 2024-09-12T00:04:38.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.419 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.419 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.419 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936429+0000", 2024-09-12T00:04:38.419 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2626000000000007e-05 2024-09-12T00:04:38.419 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.419 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.419 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.419 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.420 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:38.420 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:38.420 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 86.479804152, 2024-09-12T00:04:38.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016022492999999999, 2024-09-12T00:04:38.420 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.420 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.420 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.420 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:38.420 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:38.420 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:38.420 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:04:38.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.421 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.421 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:38.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.421 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:38.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:38.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4000000000000002e-07 2024-09-12T00:04:38.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921891+0000", 2024-09-12T00:04:38.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8298000000000003e-05 2024-09-12T00:04:38.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921899+0000", 2024-09-12T00:04:38.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7059999999999993e-06 2024-09-12T00:04:38.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921904+0000", 2024-09-12T00:04:38.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9799999999999998e-06 2024-09-12T00:04:38.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932144+0000", 2024-09-12T00:04:38.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010239817999999999 2024-09-12T00:04:38.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932284+0000", 2024-09-12T00:04:38.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139436 2024-09-12T00:04:38.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:38.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932498+0000", 2024-09-12T00:04:38.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000214408 2024-09-12T00:04:38.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:38.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936444+0000", 2024-09-12T00:04:38.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039464169999999998 2024-09-12T00:04:38.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:38.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937702+0000", 2024-09-12T00:04:38.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012571679999999999 2024-09-12T00:04:38.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.425 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.425 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937793+0000", 2024-09-12T00:04:38.425 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1489000000000004e-05 2024-09-12T00:04:38.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.425 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.425 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937854+0000", 2024-09-12T00:04:38.425 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1333000000000004e-05 2024-09-12T00:04:38.425 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.425 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.425 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.426 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:38.426 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:38.426 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 86.479722284000005, 2024-09-12T00:04:38.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017189138999999999, 2024-09-12T00:04:38.426 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.426 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.426 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.426 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:38.426 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:38.426 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:38.426 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 48 2024-09-12T00:04:38.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.426 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.426 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:38.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:38.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:38.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7399999999999998e-07 2024-09-12T00:04:38.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.428 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.428 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921918+0000", 2024-09-12T00:04:38.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6399999999999999e-06 2024-09-12T00:04:38.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.428 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.428 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921925+0000", 2024-09-12T00:04:38.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7190000000000004e-06 2024-09-12T00:04:38.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.428 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.428 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921931+0000", 2024-09-12T00:04:38.429 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2519999999999996e-06 2024-09-12T00:04:38.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.429 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.429 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933475+0000", 2024-09-12T00:04:38.429 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011543759000000001 2024-09-12T00:04:38.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.429 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.429 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933617+0000", 2024-09-12T00:04:38.429 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000142282 2024-09-12T00:04:38.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.430 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:38.430 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933860+0000", 2024-09-12T00:04:38.430 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024276199999999999 2024-09-12T00:04:38.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.430 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:38.430 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937933+0000", 2024-09-12T00:04:38.430 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040734680000000002 2024-09-12T00:04:38.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.430 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:38.430 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938955+0000", 2024-09-12T00:04:38.430 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001021987 2024-09-12T00:04:38.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.431 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.431 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.431 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939038+0000", 2024-09-12T00:04:38.431 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2449999999999998e-05 2024-09-12T00:04:38.431 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.431 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.431 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.431 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939103+0000", 2024-09-12T00:04:38.431 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5345999999999994e-05 2024-09-12T00:04:38.431 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.431 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.431 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.431 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.431 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.432 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:38.432 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:38.432 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 86.479696742000002, 2024-09-12T00:04:38.432 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018247975, 2024-09-12T00:04:38.432 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.432 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.432 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.432 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:38.432 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:38.432 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:38.432 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 49 2024-09-12T00:04:38.432 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.432 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.433 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:38.433 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.433 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:38.433 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.433 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921940+0000", 2024-09-12T00:04:38.433 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7e-07 2024-09-12T00:04:38.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.434 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.434 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921943+0000", 2024-09-12T00:04:38.434 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1889999999999999e-06 2024-09-12T00:04:38.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.434 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.434 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921952+0000", 2024-09-12T00:04:38.434 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0010000000000007e-06 2024-09-12T00:04:38.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.434 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.435 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921959+0000", 2024-09-12T00:04:38.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2570000000000001e-06 2024-09-12T00:04:38.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.435 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.435 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935333+0000", 2024-09-12T00:04:38.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013373368 2024-09-12T00:04:38.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.435 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.435 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935472+0000", 2024-09-12T00:04:38.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013987900000000001 2024-09-12T00:04:38.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.436 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:38.436 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935700+0000", 2024-09-12T00:04:38.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000227922 2024-09-12T00:04:38.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.436 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.436 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:38.436 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939858+0000", 2024-09-12T00:04:38.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041571300000000002 2024-09-12T00:04:38.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.436 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.436 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:38.436 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940018+0000", 2024-09-12T00:04:38.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016060400000000001 2024-09-12T00:04:38.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.437 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.437 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940114+0000", 2024-09-12T00:04:38.437 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5692999999999993e-05 2024-09-12T00:04:38.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.437 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.437 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940187+0000", 2024-09-12T00:04:38.437 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3561999999999998e-05 2024-09-12T00:04:38.437 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.437 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.437 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.438 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:38.438 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:38.438 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 86.479653955000003, 2024-09-12T00:04:38.438 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021018614000000001, 2024-09-12T00:04:38.438 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.438 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.438 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.438 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:38.438 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:38.438 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:38.438 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 50 2024-09-12T00:04:38.438 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.438 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.438 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.439 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.439 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:38.439 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.439 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.439 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.439 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:38.439 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.439 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.439 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.439 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921983+0000", 2024-09-12T00:04:38.439 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4499999999999996e-07 2024-09-12T00:04:38.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.440 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.440 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.440 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922071+0000", 2024-09-12T00:04:38.440 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8010000000000006e-05 2024-09-12T00:04:38.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.440 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.440 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.441 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922084+0000", 2024-09-12T00:04:38.441 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3275000000000001e-05 2024-09-12T00:04:38.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.441 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.441 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.441 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922093+0000", 2024-09-12T00:04:38.441 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0580000000000004e-06 2024-09-12T00:04:38.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.441 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.441 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.441 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936515+0000", 2024-09-12T00:04:38.442 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014421270999999999 2024-09-12T00:04:38.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.442 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.442 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936677+0000", 2024-09-12T00:04:38.442 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162003 2024-09-12T00:04:38.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.442 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:38.442 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936908+0000", 2024-09-12T00:04:38.442 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023115700000000001 2024-09-12T00:04:38.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.442 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:38.443 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939985+0000", 2024-09-12T00:04:38.443 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030773879999999999 2024-09-12T00:04:38.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.443 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.443 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:38.443 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942623+0000", 2024-09-12T00:04:38.443 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026377929999999998 2024-09-12T00:04:38.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.443 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.443 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.443 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942818+0000", 2024-09-12T00:04:38.443 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019556200000000001 2024-09-12T00:04:38.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.444 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.444 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943001+0000", 2024-09-12T00:04:38.444 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018235199999999999 2024-09-12T00:04:38.444 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.444 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.444 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.444 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:38.444 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:38.444 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 86.479519562999997, 2024-09-12T00:04:38.444 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021092493, 2024-09-12T00:04:38.445 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.445 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.445 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.445 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:38.445 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:38.445 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:38.445 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 51 2024-09-12T00:04:38.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.445 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.445 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.445 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.445 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:38.445 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.446 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.446 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.446 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:38.446 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.446 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.446 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.446 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922118+0000", 2024-09-12T00:04:38.446 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0389999999999999e-06 2024-09-12T00:04:38.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.446 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.446 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.446 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922124+0000", 2024-09-12T00:04:38.447 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5409999999999997e-06 2024-09-12T00:04:38.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.447 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.447 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922136+0000", 2024-09-12T00:04:38.447 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.205e-05 2024-09-12T00:04:38.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.447 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.447 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922147+0000", 2024-09-12T00:04:38.447 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0451e-05 2024-09-12T00:04:38.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.448 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.448 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938000+0000", 2024-09-12T00:04:38.448 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015853682000000001 2024-09-12T00:04:38.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.448 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.448 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.448 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938142+0000", 2024-09-12T00:04:38.448 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014148899999999999 2024-09-12T00:04:38.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.448 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.448 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:38.448 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938362+0000", 2024-09-12T00:04:38.448 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022034800000000001 2024-09-12T00:04:38.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.449 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:38.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940330+0000", 2024-09-12T00:04:38.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001967459 2024-09-12T00:04:38.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.449 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:38.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943064+0000", 2024-09-12T00:04:38.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027346219999999999 2024-09-12T00:04:38.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.449 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943152+0000", 2024-09-12T00:04:38.450 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7563000000000002e-05 2024-09-12T00:04:38.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943209+0000", 2024-09-12T00:04:38.450 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7249e-05 2024-09-12T00:04:38.450 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.450 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.450 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.450 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:38.451 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:38.451 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 86.479470070000005, 2024-09-12T00:04:38.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021175616000000001, 2024-09-12T00:04:38.451 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.451 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.451 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.451 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:38.451 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:38.451 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:38.451 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 52 2024-09-12T00:04:38.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.451 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.451 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.452 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:38.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.452 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.452 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:38.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.452 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.452 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922167+0000", 2024-09-12T00:04:38.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3300000000000001e-07 2024-09-12T00:04:38.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.453 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.453 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922174+0000", 2024-09-12T00:04:38.453 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7070000000000003e-06 2024-09-12T00:04:38.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.453 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.453 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922184+0000", 2024-09-12T00:04:38.453 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682e-05 2024-09-12T00:04:38.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.453 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922195+0000", 2024-09-12T00:04:38.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0489000000000001e-05 2024-09-12T00:04:38.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.454 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939166+0000", 2024-09-12T00:04:38.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016971245999999999 2024-09-12T00:04:38.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.454 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939243+0000", 2024-09-12T00:04:38.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7201999999999997e-05 2024-09-12T00:04:38.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.455 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:38.455 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939381+0000", 2024-09-12T00:04:38.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013770699999999999 2024-09-12T00:04:38.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.455 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:38.455 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940923+0000", 2024-09-12T00:04:38.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001542302 2024-09-12T00:04:38.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:38.456 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943221+0000", 2024-09-12T00:04:38.456 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022979720000000001 2024-09-12T00:04:38.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.456 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943295+0000", 2024-09-12T00:04:38.456 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3317000000000003e-05 2024-09-12T00:04:38.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.457 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.457 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943342+0000", 2024-09-12T00:04:38.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7159e-05 2024-09-12T00:04:38.457 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.457 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.457 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.457 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.457 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:38.457 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:38.457 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 86.230525103999994, 2024-09-12T00:04:38.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015229411999999999, 2024-09-12T00:04:38.457 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.458 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.458 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.458 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:38.458 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:38.458 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:38.458 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 67 2024-09-12T00:04:38.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.458 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.458 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.458 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.458 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:38.458 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.459 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.459 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:38.459 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.459 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.459 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171112+0000", 2024-09-12T00:04:38.459 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2899999999999999e-06 2024-09-12T00:04:38.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.459 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.460 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171119+0000", 2024-09-12T00:04:38.460 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8870000000000003e-06 2024-09-12T00:04:38.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.460 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.460 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171131+0000", 2024-09-12T00:04:38.460 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1902999999999999e-05 2024-09-12T00:04:38.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.460 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.460 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171147+0000", 2024-09-12T00:04:38.460 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6203000000000001e-05 2024-09-12T00:04:38.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.461 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.461 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175044+0000", 2024-09-12T00:04:38.461 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038967310000000001 2024-09-12T00:04:38.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.461 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.461 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175172+0000", 2024-09-12T00:04:38.461 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012784100000000001 2024-09-12T00:04:38.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.461 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:38.461 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175372+0000", 2024-09-12T00:04:38.462 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019978500000000001 2024-09-12T00:04:38.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.462 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:38.462 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179276+0000", 2024-09-12T00:04:38.462 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039042149999999999 2024-09-12T00:04:38.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.462 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:38.462 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186150+0000", 2024-09-12T00:04:38.462 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0068740019999999997 2024-09-12T00:04:38.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.463 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.463 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186266+0000", 2024-09-12T00:04:38.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115742 2024-09-12T00:04:38.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.463 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.463 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186340+0000", 2024-09-12T00:04:38.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4813000000000004e-05 2024-09-12T00:04:38.463 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.463 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.463 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.464 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:38.464 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:38.464 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 86.230464028, 2024-09-12T00:04:38.464 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015308448000000001, 2024-09-12T00:04:38.464 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.464 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.464 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.464 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:38.464 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:38.464 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:38.464 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 68 2024-09-12T00:04:38.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.464 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.465 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.465 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:38.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.465 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.465 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:38.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.465 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.465 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171173+0000", 2024-09-12T00:04:38.466 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:04:38.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.466 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.466 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171182+0000", 2024-09-12T00:04:38.466 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2359999999999993e-06 2024-09-12T00:04:38.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.466 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.466 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171193+0000", 2024-09-12T00:04:38.466 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.095e-05 2024-09-12T00:04:38.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.466 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.467 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171207+0000", 2024-09-12T00:04:38.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3339999999999999e-05 2024-09-12T00:04:38.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.467 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.467 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176753+0000", 2024-09-12T00:04:38.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055460240000000001 2024-09-12T00:04:38.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.467 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.467 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176921+0000", 2024-09-12T00:04:38.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000168503 2024-09-12T00:04:38.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.468 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:38.468 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177112+0000", 2024-09-12T00:04:38.468 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019113999999999999 2024-09-12T00:04:38.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.468 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:38.468 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179382+0000", 2024-09-12T00:04:38.468 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022697099999999999 2024-09-12T00:04:38.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.468 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:38.468 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186356+0000", 2024-09-12T00:04:38.469 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069741919999999997 2024-09-12T00:04:38.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.469 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186422+0000", 2024-09-12T00:04:38.469 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6387e-05 2024-09-12T00:04:38.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.469 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186481+0000", 2024-09-12T00:04:38.469 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8059000000000001e-05 2024-09-12T00:04:38.469 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.469 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.469 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.470 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:38.470 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:38.470 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 86.230412258000001, 2024-09-12T00:04:38.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020001835999999999, 2024-09-12T00:04:38.470 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.470 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.470 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.470 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:38.470 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:38.470 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:38.470 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 69 2024-09-12T00:04:38.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.471 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.471 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.471 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:38.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.471 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.471 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:38.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.472 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.472 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171225+0000", 2024-09-12T00:04:38.472 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0599999999999999e-07 2024-09-12T00:04:38.472 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.472 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.472 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.472 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171349+0000", 2024-09-12T00:04:38.472 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012407299999999999 2024-09-12T00:04:38.472 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.472 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.472 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.472 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171367+0000", 2024-09-12T00:04:38.472 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8413000000000001e-05 2024-09-12T00:04:38.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.473 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.473 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.473 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171376+0000", 2024-09-12T00:04:38.473 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8170000000000005e-06 2024-09-12T00:04:38.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.473 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.473 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.473 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177692+0000", 2024-09-12T00:04:38.473 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063156729999999999 2024-09-12T00:04:38.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.473 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.473 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.474 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177817+0000", 2024-09-12T00:04:38.474 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012581499999999999 2024-09-12T00:04:38.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.474 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:38.474 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.178015+0000", 2024-09-12T00:04:38.474 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019715100000000001 2024-09-12T00:04:38.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.474 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:38.474 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181798+0000", 2024-09-12T00:04:38.474 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003783308 2024-09-12T00:04:38.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:38.475 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190976+0000", 2024-09-12T00:04:38.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091776519999999997 2024-09-12T00:04:38.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.475 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.475 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191122+0000", 2024-09-12T00:04:38.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000145966 2024-09-12T00:04:38.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.475 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.475 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191226+0000", 2024-09-12T00:04:38.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104162 2024-09-12T00:04:38.476 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.476 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.476 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.476 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.476 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:38.476 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:38.476 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 86.230243522999999, 2024-09-12T00:04:38.476 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019997773, 2024-09-12T00:04:38.476 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.476 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.476 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.476 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:38.477 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:38.477 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:38.477 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 70 2024-09-12T00:04:38.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.477 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.477 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:38.477 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.477 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:38.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.478 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.478 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:38.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3699999999999999e-07 2024-09-12T00:04:38.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.478 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.478 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171403+0000", 2024-09-12T00:04:38.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6199999999999994e-06 2024-09-12T00:04:38.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.479 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.479 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171416+0000", 2024-09-12T00:04:38.479 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2636000000000001e-05 2024-09-12T00:04:38.479 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.479 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.479 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.479 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171423+0000", 2024-09-12T00:04:38.479 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5440000000000001e-06 2024-09-12T00:04:38.479 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.479 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.479 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.479 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179458+0000", 2024-09-12T00:04:38.479 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080351989999999998 2024-09-12T00:04:38.480 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.480 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.480 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.480 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179604+0000", 2024-09-12T00:04:38.480 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014519899999999999 2024-09-12T00:04:38.480 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.480 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.480 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:38.480 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179831+0000", 2024-09-12T00:04:38.480 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022704800000000001 2024-09-12T00:04:38.480 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.480 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.481 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:38.481 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181918+0000", 2024-09-12T00:04:38.481 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020873950000000001 2024-09-12T00:04:38.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.481 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.481 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:38.481 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191243+0000", 2024-09-12T00:04:38.481 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0093244729999999998 2024-09-12T00:04:38.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.481 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.481 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.481 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191309+0000", 2024-09-12T00:04:38.481 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6116000000000002e-05 2024-09-12T00:04:38.482 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.482 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.482 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.482 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191390+0000", 2024-09-12T00:04:38.482 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1705999999999993e-05 2024-09-12T00:04:38.482 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.482 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.482 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.482 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.482 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.482 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:38.482 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:38.483 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 86.230197450000006, 2024-09-12T00:04:38.483 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020263554, 2024-09-12T00:04:38.483 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.483 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.483 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.483 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:38.483 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:38.483 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:38.483 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 71 2024-09-12T00:04:38.483 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.483 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.483 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.483 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.484 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:38.484 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.484 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.484 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.484 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.484 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:38.484 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.484 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.484 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.484 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.484 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:38.484 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5000000000000002e-07 2024-09-12T00:04:38.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.485 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.485 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.485 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171454+0000", 2024-09-12T00:04:38.485 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5046e-05 2024-09-12T00:04:38.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.485 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.485 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.485 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171471+0000", 2024-09-12T00:04:38.485 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6923999999999999e-05 2024-09-12T00:04:38.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.485 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.485 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.486 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171487+0000", 2024-09-12T00:04:38.486 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5823000000000001e-05 2024-09-12T00:04:38.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.486 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.486 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.486 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180765+0000", 2024-09-12T00:04:38.486 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0092774399999999996 2024-09-12T00:04:38.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.486 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.486 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.486 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180900+0000", 2024-09-12T00:04:38.486 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013556700000000001 2024-09-12T00:04:38.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.487 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.487 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:38.487 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181108+0000", 2024-09-12T00:04:38.487 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020727899999999999 2024-09-12T00:04:38.487 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.487 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.487 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:38.487 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184725+0000", 2024-09-12T00:04:38.487 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036171340000000001 2024-09-12T00:04:38.487 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.487 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.487 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:38.487 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191413+0000", 2024-09-12T00:04:38.488 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066881830000000003 2024-09-12T00:04:38.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.488 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.488 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.488 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191540+0000", 2024-09-12T00:04:38.488 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000126823 2024-09-12T00:04:38.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.488 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.488 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.488 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191702+0000", 2024-09-12T00:04:38.488 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162585 2024-09-12T00:04:38.488 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.488 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.489 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.489 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.489 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:38.489 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:38.489 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 86.230118873999999, 2024-09-12T00:04:38.489 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020448573000000001, 2024-09-12T00:04:38.489 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.489 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.489 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.489 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:38.489 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:38.489 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:38.490 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 72 2024-09-12T00:04:38.490 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.490 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.490 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.490 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.490 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:38.490 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.490 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.490 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.490 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.490 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:38.490 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.490 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.491 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.491 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.491 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171518+0000", 2024-09-12T00:04:38.491 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0440000000000001e-06 2024-09-12T00:04:38.491 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.491 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.491 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.491 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171647+0000", 2024-09-12T00:04:38.491 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012912899999999999 2024-09-12T00:04:38.491 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.491 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.491 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.491 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171664+0000", 2024-09-12T00:04:38.492 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6079999999999999e-05 2024-09-12T00:04:38.492 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.492 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.492 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.492 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171675+0000", 2024-09-12T00:04:38.492 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1223000000000001e-05 2024-09-12T00:04:38.492 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.492 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.492 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.492 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182000+0000", 2024-09-12T00:04:38.492 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010324949 2024-09-12T00:04:38.492 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.492 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.493 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.493 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182178+0000", 2024-09-12T00:04:38.493 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017808799999999999 2024-09-12T00:04:38.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.493 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.493 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:38.493 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182402+0000", 2024-09-12T00:04:38.493 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022381199999999999 2024-09-12T00:04:38.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.493 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.493 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:38.493 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190935+0000", 2024-09-12T00:04:38.493 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085331560000000001 2024-09-12T00:04:38.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.494 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:38.494 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191728+0000", 2024-09-12T00:04:38.494 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079325700000000001 2024-09-12T00:04:38.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.494 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.494 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191864+0000", 2024-09-12T00:04:38.494 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013606299999999999 2024-09-12T00:04:38.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.494 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.494 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191966+0000", 2024-09-12T00:04:38.495 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101772 2024-09-12T00:04:38.495 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.495 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.495 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.495 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.495 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.495 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:38.495 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:38.495 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 86.229935678999993, 2024-09-12T00:04:38.495 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020675235, 2024-09-12T00:04:38.495 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.495 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.495 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.496 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:38.496 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:38.496 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:38.496 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 73 2024-09-12T00:04:38.496 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.496 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.496 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.496 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.496 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:38.496 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.496 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.496 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.496 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.496 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:38.497 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.497 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.497 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.497 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.497 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171701+0000", 2024-09-12T00:04:38.497 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0999999999999997e-07 2024-09-12T00:04:38.497 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.497 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.497 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.497 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171709+0000", 2024-09-12T00:04:38.497 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2540000000000003e-06 2024-09-12T00:04:38.497 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.497 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.498 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.498 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171724+0000", 2024-09-12T00:04:38.498 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5569e-05 2024-09-12T00:04:38.498 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.498 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.498 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.498 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171734+0000", 2024-09-12T00:04:38.498 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6139999999999998e-06 2024-09-12T00:04:38.498 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.498 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.498 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.498 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183774+0000", 2024-09-12T00:04:38.498 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012040444000000001 2024-09-12T00:04:38.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.499 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.499 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.499 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183896+0000", 2024-09-12T00:04:38.499 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012204199999999999 2024-09-12T00:04:38.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.499 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.499 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:38.499 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184084+0000", 2024-09-12T00:04:38.499 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018792599999999999 2024-09-12T00:04:38.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.499 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.499 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:38.499 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191984+0000", 2024-09-12T00:04:38.500 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079003790000000008 2024-09-12T00:04:38.500 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.500 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.500 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:38.500 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192093+0000", 2024-09-12T00:04:38.500 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000108942 2024-09-12T00:04:38.500 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.500 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.500 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.500 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192250+0000", 2024-09-12T00:04:38.500 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015637600000000001 2024-09-12T00:04:38.500 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.500 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.501 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.501 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192376+0000", 2024-09-12T00:04:38.501 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012587899999999999 2024-09-12T00:04:38.501 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.501 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.501 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.501 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.501 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.501 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:38.501 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:38.501 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 86.229887469000005, 2024-09-12T00:04:38.501 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021088828, 2024-09-12T00:04:38.501 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.501 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.502 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.502 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:38.502 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:38.502 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:38.502 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 74 2024-09-12T00:04:38.502 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.502 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.502 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.502 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.502 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:38.502 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.502 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.502 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.503 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.503 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:38.503 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.503 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.503 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.503 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.503 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:38.503 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1699999999999997e-07 2024-09-12T00:04:38.503 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.503 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.503 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.503 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171758+0000", 2024-09-12T00:04:38.504 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0860000000000008e-06 2024-09-12T00:04:38.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.504 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.504 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.504 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171774+0000", 2024-09-12T00:04:38.504 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:04:38.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.504 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.504 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.504 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171788+0000", 2024-09-12T00:04:38.504 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4793999999999999e-05 2024-09-12T00:04:38.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.504 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.505 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.505 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184842+0000", 2024-09-12T00:04:38.505 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013053607 2024-09-12T00:04:38.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.505 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.505 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.505 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185130+0000", 2024-09-12T00:04:38.505 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00028779199999999998 2024-09-12T00:04:38.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.505 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.505 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:38.505 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185378+0000", 2024-09-12T00:04:38.506 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024780100000000002 2024-09-12T00:04:38.506 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.506 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.506 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:38.506 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192513+0000", 2024-09-12T00:04:38.506 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071350770000000001 2024-09-12T00:04:38.506 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.506 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.506 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:38.506 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192690+0000", 2024-09-12T00:04:38.506 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000176892 2024-09-12T00:04:38.506 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.507 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.507 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.507 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192769+0000", 2024-09-12T00:04:38.507 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9466000000000001e-05 2024-09-12T00:04:38.507 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.507 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.507 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.507 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192837+0000", 2024-09-12T00:04:38.507 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8466000000000005e-05 2024-09-12T00:04:38.507 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.507 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.507 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.507 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.507 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.508 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:38.508 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:38.508 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 86.229834892, 2024-09-12T00:04:38.508 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.02121994, 2024-09-12T00:04:38.508 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.508 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.508 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.508 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:38.508 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:38.508 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:38.508 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 75 2024-09-12T00:04:38.508 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.508 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.509 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.509 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.509 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:38.509 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.509 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.509 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.509 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.509 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:38.509 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.509 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.509 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.509 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.509 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171802+0000", 2024-09-12T00:04:38.509 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5000000000000002e-07 2024-09-12T00:04:38.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.510 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.510 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.510 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171954+0000", 2024-09-12T00:04:38.510 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015215500000000001 2024-09-12T00:04:38.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.510 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.510 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.510 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171966+0000", 2024-09-12T00:04:38.510 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1548e-05 2024-09-12T00:04:38.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.510 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.510 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.510 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171970+0000", 2024-09-12T00:04:38.511 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8729999999999998e-06 2024-09-12T00:04:38.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.511 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.511 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.511 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186552+0000", 2024-09-12T00:04:38.511 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014581775 2024-09-12T00:04:38.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.511 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.511 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.511 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186702+0000", 2024-09-12T00:04:38.511 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014946 2024-09-12T00:04:38.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.511 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.511 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:38.512 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186897+0000", 2024-09-12T00:04:38.512 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000195071 2024-09-12T00:04:38.512 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.512 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.512 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:38.512 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192666+0000", 2024-09-12T00:04:38.512 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057693470000000002 2024-09-12T00:04:38.512 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.512 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.512 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:38.512 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192857+0000", 2024-09-12T00:04:38.512 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191149 2024-09-12T00:04:38.512 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.513 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.513 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.513 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192967+0000", 2024-09-12T00:04:38.513 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110202 2024-09-12T00:04:38.513 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.513 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.513 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.513 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193021+0000", 2024-09-12T00:04:38.513 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3709999999999999e-05 2024-09-12T00:04:38.513 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.513 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.513 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.513 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.514 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.514 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:38.514 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:38.514 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 86.229655597000004, 2024-09-12T00:04:38.514 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026297425999999999, 2024-09-12T00:04:38.514 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.514 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.514 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.514 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:38.514 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:38.514 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:38.514 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 76 2024-09-12T00:04:38.514 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.515 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.515 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.515 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.515 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:38.515 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.515 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.515 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.515 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.515 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:38.515 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.515 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.515 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.515 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.515 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:38.516 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9399999999999995e-07 2024-09-12T00:04:38.516 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.516 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.516 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.516 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171987+0000", 2024-09-12T00:04:38.516 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5230000000000003e-06 2024-09-12T00:04:38.516 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.516 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.516 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.516 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172005+0000", 2024-09-12T00:04:38.516 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8788e-05 2024-09-12T00:04:38.516 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.516 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.517 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.517 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172010+0000", 2024-09-12T00:04:38.517 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7570000000000004e-06 2024-09-12T00:04:38.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.517 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.517 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.517 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193104+0000", 2024-09-12T00:04:38.517 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021094112000000002 2024-09-12T00:04:38.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.517 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.517 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.517 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193334+0000", 2024-09-12T00:04:38.517 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000229855 2024-09-12T00:04:38.518 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.518 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.518 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:38.518 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193697+0000", 2024-09-12T00:04:38.518 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00036272399999999998 2024-09-12T00:04:38.518 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.518 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.518 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:38.518 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.195602+0000", 2024-09-12T00:04:38.518 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019049620000000001 2024-09-12T00:04:38.518 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.518 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.518 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:38.518 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198123+0000", 2024-09-12T00:04:38.519 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025216520000000001 2024-09-12T00:04:38.519 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.519 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.519 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.519 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198213+0000", 2024-09-12T00:04:38.519 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0008999999999998e-05 2024-09-12T00:04:38.519 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.519 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.519 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.519 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198278+0000", 2024-09-12T00:04:38.519 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4549999999999997e-05 2024-09-12T00:04:38.519 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.519 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.519 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.520 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.520 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.520 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1776 3.10 3:0ad809ca:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:38.520 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.002444+0000", 2024-09-12T00:04:38.520 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.3991925350000001, 2024-09-12T00:04:38.520 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016768360999999999, 2024-09-12T00:04:38.520 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.520 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.520 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.520 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:38.520 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:38.520 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:38.520 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1776 2024-09-12T00:04:38.520 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.521 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.521 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.521 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.521 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.002444+0000", 2024-09-12T00:04:38.521 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.521 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.521 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.521 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.521 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.002444+0000", 2024-09-12T00:04:38.521 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.521 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.521 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.521 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.521 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.002446+0000", 2024-09-12T00:04:38.522 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5830000000000001e-06 2024-09-12T00:04:38.522 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.522 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.522 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.522 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003441+0000", 2024-09-12T00:04:38.522 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00099495500000000006 2024-09-12T00:04:38.522 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.522 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.522 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.522 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003468+0000", 2024-09-12T00:04:38.522 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6514000000000001e-05 2024-09-12T00:04:38.522 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.522 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.522 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.523 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003481+0000", 2024-09-12T00:04:38.523 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3016999999999999e-05 2024-09-12T00:04:38.523 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.523 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.523 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.523 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003556+0000", 2024-09-12T00:04:38.523 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5556999999999995e-05 2024-09-12T00:04:38.523 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.523 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.523 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.523 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003705+0000", 2024-09-12T00:04:38.523 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014846799999999999 2024-09-12T00:04:38.523 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.523 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.524 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:38.524 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003828+0000", 2024-09-12T00:04:38.524 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000123621 2024-09-12T00:04:38.524 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.524 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.524 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:38.524 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.013795+0000", 2024-09-12T00:04:38.524 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0099663170000000006 2024-09-12T00:04:38.524 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.524 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.524 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:38.524 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019048+0000", 2024-09-12T00:04:38.524 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052537729999999998 2024-09-12T00:04:38.524 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.525 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.525 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.525 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019126+0000", 2024-09-12T00:04:38.525 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7224999999999993e-05 2024-09-12T00:04:38.525 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.525 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.525 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.525 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019212+0000", 2024-09-12T00:04:38.525 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6330999999999997e-05 2024-09-12T00:04:38.525 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.525 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.525 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.525 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.525 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.526 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:38.527 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:04:38.527 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:38.526+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:38.628 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:38.626+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:38.679 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:38.679 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:38.679 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:38.679 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:38.693 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:04:38.737 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:38.740+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:38.805 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:38.805 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:38.805 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:38.805 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:38.805 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:38.819 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:04:38.829 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:38.830+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:38.930 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:38.932+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:38.982 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:38.982 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:38.982 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:38.982 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:38.982 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.982 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4232.0:1 2.3 e20/19 2:c4c92e5a:::rbd_trash:head v 20'1, mlcod=0'0)", 2024-09-12T00:04:38.983 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:16.594343+0000", 2024-09-12T00:04:38.983 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 82.388691933000004, 2024-09-12T00:04:38.983 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030233460000000001, 2024-09-12T00:04:38.983 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.983 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.983 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.983 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.983 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.983 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.983 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594343+0000", 2024-09-12T00:04:38.983 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.983 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.983 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.983 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.984 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594343+0000", 2024-09-12T00:04:38.984 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.984 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.984 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.984 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594343+0000", 2024-09-12T00:04:38.984 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7e-07 2024-09-12T00:04:38.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.984 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.984 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.984 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594348+0000", 2024-09-12T00:04:38.984 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7899999999999999e-06 2024-09-12T00:04:38.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.985 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.985 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.985 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594366+0000", 2024-09-12T00:04:38.985 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8255000000000001e-05 2024-09-12T00:04:38.985 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.985 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.985 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.985 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594381+0000", 2024-09-12T00:04:38.985 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4905999999999999e-05 2024-09-12T00:04:38.985 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.985 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.985 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.985 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594710+0000", 2024-09-12T00:04:38.986 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000329208 2024-09-12T00:04:38.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.986 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.986 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.986 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594870+0000", 2024-09-12T00:04:38.986 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015991900000000001 2024-09-12T00:04:38.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.986 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.986 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.986 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597290+0000", 2024-09-12T00:04:38.986 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024196439999999999 2024-09-12T00:04:38.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.986 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.986 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.987 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597366+0000", 2024-09-12T00:04:38.987 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6254000000000005e-05 2024-09-12T00:04:38.987 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.987 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.987 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.987 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.987 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:56 7.3 e32/31 7:c609908c:::notify.5:head v 32'1, mlcod=0'0)", 2024-09-12T00:04:38.987 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.376429+0000", 2024-09-12T00:04:38.987 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 67.606605548000005, 2024-09-12T00:04:38.987 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029522699999999999, 2024-09-12T00:04:38.987 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.987 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.988 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.988 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.988 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.988 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.988 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376429+0000", 2024-09-12T00:04:38.988 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.988 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.988 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.988 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.988 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376429+0000", 2024-09-12T00:04:38.988 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.988 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.988 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.988 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.989 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376435+0000", 2024-09-12T00:04:38.989 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8619999999999999e-06 2024-09-12T00:04:38.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.989 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.989 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.989 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376445+0000", 2024-09-12T00:04:38.989 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7929999999999992e-06 2024-09-12T00:04:38.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.989 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.989 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.989 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376467+0000", 2024-09-12T00:04:38.989 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2840000000000002e-05 2024-09-12T00:04:38.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.990 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.990 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.990 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376481+0000", 2024-09-12T00:04:38.990 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3254e-05 2024-09-12T00:04:38.990 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.990 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.990 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.990 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376585+0000", 2024-09-12T00:04:38.990 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104066 2024-09-12T00:04:38.990 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.990 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.990 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.990 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376611+0000", 2024-09-12T00:04:38.990 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6641000000000001e-05 2024-09-12T00:04:38.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.991 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.991 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:38.991 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.379288+0000", 2024-09-12T00:04:38.991 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026761879999999999 2024-09-12T00:04:38.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.991 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.991 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:38.991 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.379381+0000", 2024-09-12T00:04:38.991 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3626000000000001e-05 2024-09-12T00:04:38.991 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.991 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:38.991 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:38.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.992 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.992 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:38.992 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.411707+0000", 2024-09-12T00:04:38.992 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 64.571327539999999, 2024-09-12T00:04:38.992 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0031684230000000001, 2024-09-12T00:04:38.992 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:38.992 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:38.992 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:38.992 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:38.992 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:38.992 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:38.992 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 217 2024-09-12T00:04:38.992 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.993 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:38.993 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.993 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:38.993 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411707+0000", 2024-09-12T00:04:38.993 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.993 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.993 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.993 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:38.993 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411707+0000", 2024-09-12T00:04:38.993 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:38.993 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.993 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.993 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:38.993 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411710+0000", 2024-09-12T00:04:38.994 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4599999999999999e-06 2024-09-12T00:04:38.994 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.994 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.994 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:38.994 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411740+0000", 2024-09-12T00:04:38.994 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.953e-05 2024-09-12T00:04:38.994 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.994 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.994 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:38.994 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411772+0000", 2024-09-12T00:04:38.994 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.163e-05 2024-09-12T00:04:38.994 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.994 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.994 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:38.995 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411789+0000", 2024-09-12T00:04:38.995 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7614000000000001e-05 2024-09-12T00:04:38.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.995 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.995 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:38.995 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411905+0000", 2024-09-12T00:04:38.995 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115665 2024-09-12T00:04:38.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.995 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.995 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:38.995 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.412108+0000", 2024-09-12T00:04:38.995 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020293500000000001 2024-09-12T00:04:38.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.995 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.996 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:38.996 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.412565+0000", 2024-09-12T00:04:38.996 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00045749700000000001 2024-09-12T00:04:38.996 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.996 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.996 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:38.996 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.414449+0000", 2024-09-12T00:04:38.996 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0018841859999999999 2024-09-12T00:04:38.996 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.996 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.997 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:38.997 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.414709+0000", 2024-09-12T00:04:38.997 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00025939399999999998 2024-09-12T00:04:38.997 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:38.997 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:38.997 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.002 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.414813+0000", 2024-09-12T00:04:39.002 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104366 2024-09-12T00:04:39.002 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.002 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.002 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.002 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.414875+0000", 2024-09-12T00:04:39.002 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2145999999999998e-05 2024-09-12T00:04:39.002 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.002 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.003 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.003 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.003 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.003 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:646 6.10 e35/29 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 35'1, mlcod=0'0)", 2024-09-12T00:04:39.003 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.597000+0000", 2024-09-12T00:04:39.003 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 64.386034410999997, 2024-09-12T00:04:39.003 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0044366320000000002, 2024-09-12T00:04:39.003 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.003 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.003 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.003 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.003 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.003 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.003 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597000+0000", 2024-09-12T00:04:39.004 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.004 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.004 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.004 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597000+0000", 2024-09-12T00:04:39.004 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.004 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.004 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.004 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597000+0000", 2024-09-12T00:04:39.004 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7700000000000001e-07 2024-09-12T00:04:39.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.004 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.005 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.005 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597004+0000", 2024-09-12T00:04:39.005 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7560000000000001e-06 2024-09-12T00:04:39.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.005 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.005 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.005 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597017+0000", 2024-09-12T00:04:39.005 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.33e-05 2024-09-12T00:04:39.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.005 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.005 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.005 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597024+0000", 2024-09-12T00:04:39.005 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8800000000000002e-06 2024-09-12T00:04:39.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.006 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.006 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.006 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597080+0000", 2024-09-12T00:04:39.006 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5949999999999998e-05 2024-09-12T00:04:39.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.006 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.006 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.006 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597093+0000", 2024-09-12T00:04:39.006 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2695e-05 2024-09-12T00:04:39.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.006 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.006 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.006 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601386+0000", 2024-09-12T00:04:39.007 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0042935480000000003 2024-09-12T00:04:39.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.007 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.007 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.007 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601437+0000", 2024-09-12T00:04:39.007 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0325999999999999e-05 2024-09-12T00:04:39.007 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.007 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.007 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.007 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.008 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:667 6.10 e35/29 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 35'2, mlcod=0'0)", 2024-09-12T00:04:39.008 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602975+0000", 2024-09-12T00:04:39.008 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 64.380059949, 2024-09-12T00:04:39.008 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040817340000000001, 2024-09-12T00:04:39.008 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.008 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.008 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.008 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.008 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.008 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.008 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602975+0000", 2024-09-12T00:04:39.008 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.009 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.009 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.009 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602975+0000", 2024-09-12T00:04:39.009 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.009 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.009 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.009 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602981+0000", 2024-09-12T00:04:39.009 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7939999999999997e-06 2024-09-12T00:04:39.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.009 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.009 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.009 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602988+0000", 2024-09-12T00:04:39.010 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5270000000000004e-06 2024-09-12T00:04:39.010 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.010 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.010 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.010 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603003+0000", 2024-09-12T00:04:39.010 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4731e-05 2024-09-12T00:04:39.010 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.010 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.010 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.010 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603009+0000", 2024-09-12T00:04:39.010 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.297e-06 2024-09-12T00:04:39.010 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.010 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.010 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.011 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603074+0000", 2024-09-12T00:04:39.011 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4713000000000002e-05 2024-09-12T00:04:39.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.011 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.011 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.011 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603090+0000", 2024-09-12T00:04:39.011 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6344000000000001e-05 2024-09-12T00:04:39.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.011 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.011 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.011 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607014+0000", 2024-09-12T00:04:39.011 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039241800000000002 2024-09-12T00:04:39.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.011 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.012 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.012 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607056+0000", 2024-09-12T00:04:39.012 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2147999999999997e-05 2024-09-12T00:04:39.012 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.012 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.012 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.012 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.012 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:669 6.1c e35/29 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 35'3, mlcod=0'0)", 2024-09-12T00:04:39.012 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.608370+0000", 2024-09-12T00:04:39.012 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 64.374664725000002, 2024-09-12T00:04:39.012 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046099820000000003, 2024-09-12T00:04:39.012 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.012 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.013 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.013 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.013 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.013 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.013 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608370+0000", 2024-09-12T00:04:39.013 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.013 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.013 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.013 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.013 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608370+0000", 2024-09-12T00:04:39.013 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.013 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.013 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.013 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.014 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608371+0000", 2024-09-12T00:04:39.014 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8100000000000001e-07 2024-09-12T00:04:39.014 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.014 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.014 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.014 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608377+0000", 2024-09-12T00:04:39.014 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7349999999999999e-06 2024-09-12T00:04:39.014 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.014 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.014 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.014 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608395+0000", 2024-09-12T00:04:39.014 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7285000000000001e-05 2024-09-12T00:04:39.014 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.014 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.015 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.015 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608401+0000", 2024-09-12T00:04:39.015 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.365e-06 2024-09-12T00:04:39.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.015 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.015 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.015 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608463+0000", 2024-09-12T00:04:39.015 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2246e-05 2024-09-12T00:04:39.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.015 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.015 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.015 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608489+0000", 2024-09-12T00:04:39.015 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5222999999999999e-05 2024-09-12T00:04:39.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.016 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.016 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.016 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612945+0000", 2024-09-12T00:04:39.016 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004456603 2024-09-12T00:04:39.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.016 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.016 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.016 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612980+0000", 2024-09-12T00:04:39.016 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4544e-05 2024-09-12T00:04:39.016 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.016 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.016 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.017 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.017 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:682 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'4, mlcod=35'1)", 2024-09-12T00:04:39.017 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.612014+0000", 2024-09-12T00:04:39.017 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 64.371020322000007, 2024-09-12T00:04:39.017 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036839749999999999, 2024-09-12T00:04:39.017 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.017 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.017 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.017 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.017 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.017 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.017 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612014+0000", 2024-09-12T00:04:39.017 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.017 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.018 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.018 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.018 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612014+0000", 2024-09-12T00:04:39.018 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.018 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.018 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.018 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.018 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612015+0000", 2024-09-12T00:04:39.018 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0419999999999999e-06 2024-09-12T00:04:39.018 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.018 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.019 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.019 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612021+0000", 2024-09-12T00:04:39.019 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0009999999999998e-06 2024-09-12T00:04:39.019 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.019 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.019 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.019 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612035+0000", 2024-09-12T00:04:39.019 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.412e-05 2024-09-12T00:04:39.019 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.019 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.019 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.019 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612043+0000", 2024-09-12T00:04:39.019 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9699999999999999e-06 2024-09-12T00:04:39.019 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.020 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.020 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.020 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612111+0000", 2024-09-12T00:04:39.020 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7985999999999996e-05 2024-09-12T00:04:39.020 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.020 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.020 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.020 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612126+0000", 2024-09-12T00:04:39.020 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5099000000000001e-05 2024-09-12T00:04:39.020 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.020 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.020 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.020 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.615633+0000", 2024-09-12T00:04:39.021 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003506416 2024-09-12T00:04:39.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.021 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.021 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.021 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.615698+0000", 2024-09-12T00:04:39.021 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5340999999999997e-05 2024-09-12T00:04:39.021 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.021 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.021 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.021 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.021 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:768 6.15 6:ae95b544:::obj_delete_at_hint.0000000020:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:39.021 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.642525+0000", 2024-09-12T00:04:39.021 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 64.340509319999995, 2024-09-12T00:04:39.022 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048019760000000003, 2024-09-12T00:04:39.022 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.022 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.022 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.022 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.022 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.022 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.022 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 768 2024-09-12T00:04:39.022 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.022 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.022 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.022 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.022 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642525+0000", 2024-09-12T00:04:39.023 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.023 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.023 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.023 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.023 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642525+0000", 2024-09-12T00:04:39.023 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.023 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.023 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.023 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.023 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642526+0000", 2024-09-12T00:04:39.023 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3629999999999999e-06 2024-09-12T00:04:39.023 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.023 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.023 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.024 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642533+0000", 2024-09-12T00:04:39.024 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.64e-06 2024-09-12T00:04:39.024 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.024 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.024 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.024 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642549+0000", 2024-09-12T00:04:39.024 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5911000000000001e-05 2024-09-12T00:04:39.024 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.024 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.024 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.024 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642558+0000", 2024-09-12T00:04:39.024 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7420000000000003e-06 2024-09-12T00:04:39.024 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.025 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.025 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.025 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642628+0000", 2024-09-12T00:04:39.025 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0408999999999996e-05 2024-09-12T00:04:39.025 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.025 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.025 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.025 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642721+0000", 2024-09-12T00:04:39.025 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2888999999999998e-05 2024-09-12T00:04:39.025 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.025 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.025 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:39.025 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642914+0000", 2024-09-12T00:04:39.025 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000192945 2024-09-12T00:04:39.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.026 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.026 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.026 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.644463+0000", 2024-09-12T00:04:39.026 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001548848 2024-09-12T00:04:39.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.026 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.026 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.026 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.647249+0000", 2024-09-12T00:04:39.026 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027862989999999999 2024-09-12T00:04:39.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.026 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.026 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.026 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.647285+0000", 2024-09-12T00:04:39.027 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6210000000000001e-05 2024-09-12T00:04:39.027 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.027 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.027 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.027 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.647327+0000", 2024-09-12T00:04:39.027 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.172e-05 2024-09-12T00:04:39.027 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.027 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.027 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.027 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.027 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.027 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:850 6.15 6:abd89f08:lc::lc.23:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:39.027 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.673328+0000", 2024-09-12T00:04:39.027 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 64.309706586000004, 2024-09-12T00:04:39.028 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047245300000000002, 2024-09-12T00:04:39.028 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.028 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.028 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.028 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.028 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.028 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.028 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 850 2024-09-12T00:04:39.028 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.028 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.028 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.028 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.028 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673328+0000", 2024-09-12T00:04:39.028 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.029 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.029 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.029 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.029 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673328+0000", 2024-09-12T00:04:39.029 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.029 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.029 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.029 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.029 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673329+0000", 2024-09-12T00:04:39.029 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5799999999999998e-07 2024-09-12T00:04:39.029 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.029 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.029 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.030 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673333+0000", 2024-09-12T00:04:39.030 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5990000000000004e-06 2024-09-12T00:04:39.030 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.030 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.030 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.030 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673345+0000", 2024-09-12T00:04:39.030 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1637999999999999e-05 2024-09-12T00:04:39.030 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.030 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.030 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.030 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673353+0000", 2024-09-12T00:04:39.030 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4610000000000002e-06 2024-09-12T00:04:39.030 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.030 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.031 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.031 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673417+0000", 2024-09-12T00:04:39.031 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4951999999999997e-05 2024-09-12T00:04:39.031 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.031 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.031 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.031 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673521+0000", 2024-09-12T00:04:39.031 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103881 2024-09-12T00:04:39.031 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.031 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.031 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:39.031 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673729+0000", 2024-09-12T00:04:39.031 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020730600000000001 2024-09-12T00:04:39.031 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.032 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.032 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.032 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674901+0000", 2024-09-12T00:04:39.032 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011728140000000001 2024-09-12T00:04:39.032 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.032 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.032 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.032 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.677953+0000", 2024-09-12T00:04:39.032 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030517959999999998 2024-09-12T00:04:39.032 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.032 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.032 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.032 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.677997+0000", 2024-09-12T00:04:39.033 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3346999999999997e-05 2024-09-12T00:04:39.033 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.033 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.033 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.033 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.678052+0000", 2024-09-12T00:04:39.033 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5778e-05 2024-09-12T00:04:39.033 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.033 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.033 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.033 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.033 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.033 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1641 3.26 3:658fe58e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2__shadow_.hDHTDpIswwqRA2bHiHVxkhWqZde6XEj_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:39.033 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:04:39.033 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.9267482850000004, 2024-09-12T00:04:39.034 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017888905, 2024-09-12T00:04:39.034 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.034 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.034 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.034 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.034 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.034 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.034 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1641 2024-09-12T00:04:39.034 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.034 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.034 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.034 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.034 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:04:39.034 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.035 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.035 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.035 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.035 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:04:39.035 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.035 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.035 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.035 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.035 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056289+0000", 2024-09-12T00:04:39.035 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5349999999999999e-06 2024-09-12T00:04:39.035 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.035 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.035 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.035 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058595+0000", 2024-09-12T00:04:39.036 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002306083 2024-09-12T00:04:39.036 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.036 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.036 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.036 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058621+0000", 2024-09-12T00:04:39.036 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6431000000000002e-05 2024-09-12T00:04:39.036 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.036 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.036 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.036 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058631+0000", 2024-09-12T00:04:39.036 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0166000000000001e-05 2024-09-12T00:04:39.036 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.036 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.037 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.037 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058712+0000", 2024-09-12T00:04:39.037 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0122000000000003e-05 2024-09-12T00:04:39.037 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.037 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.037 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.037 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058821+0000", 2024-09-12T00:04:39.037 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010907400000000001 2024-09-12T00:04:39.037 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.037 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.037 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:39.037 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058910+0000", 2024-09-12T00:04:39.037 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9523000000000003e-05 2024-09-12T00:04:39.037 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.038 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.038 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.038 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073881+0000", 2024-09-12T00:04:39.038 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014971224 2024-09-12T00:04:39.038 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.038 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.038 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.038 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074101+0000", 2024-09-12T00:04:39.038 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0002195 2024-09-12T00:04:39.038 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.038 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.038 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.038 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074133+0000", 2024-09-12T00:04:39.038 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2138000000000003e-05 2024-09-12T00:04:39.039 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.039 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.039 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.039 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074175+0000", 2024-09-12T00:04:39.039 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2109e-05 2024-09-12T00:04:39.039 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.039 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.039 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.039 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.039 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.039 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1642 3.20 3:07bca365:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2__shadow_.hDHTDpIswwqRA2bHiHVxkhWqZde6XEj_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:39.039 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.060666+0000", 2024-09-12T00:04:39.039 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.9223688589999997, 2024-09-12T00:04:39.039 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013097882, 2024-09-12T00:04:39.039 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.040 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.040 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.040 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.040 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.040 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.040 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1642 2024-09-12T00:04:39.040 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.040 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.040 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.040 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.040 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.060666+0000", 2024-09-12T00:04:39.040 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.040 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.041 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.041 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.041 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.060666+0000", 2024-09-12T00:04:39.041 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.041 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.041 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.041 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.041 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.060668+0000", 2024-09-12T00:04:39.041 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.728e-06 2024-09-12T00:04:39.041 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.041 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.041 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.041 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061720+0000", 2024-09-12T00:04:39.041 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0010517160000000001 2024-09-12T00:04:39.041 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.042 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.042 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.042 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061736+0000", 2024-09-12T00:04:39.042 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6181999999999999e-05 2024-09-12T00:04:39.042 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.042 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.042 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.042 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061744+0000", 2024-09-12T00:04:39.042 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5959999999999998e-06 2024-09-12T00:04:39.042 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.042 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.042 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.042 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061838+0000", 2024-09-12T00:04:39.042 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.4658000000000001e-05 2024-09-12T00:04:39.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.043 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.043 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.043 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.062005+0000", 2024-09-12T00:04:39.043 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000166529 2024-09-12T00:04:39.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.043 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.043 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:39.043 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.062175+0000", 2024-09-12T00:04:39.043 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000170182 2024-09-12T00:04:39.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.043 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.043 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.043 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.071854+0000", 2024-09-12T00:04:39.044 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0096790339999999996 2024-09-12T00:04:39.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.044 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.044 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.044 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073661+0000", 2024-09-12T00:04:39.044 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001806738 2024-09-12T00:04:39.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.044 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.044 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.044 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073708+0000", 2024-09-12T00:04:39.044 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7351000000000001e-05 2024-09-12T00:04:39.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.044 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.045 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.045 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073763+0000", 2024-09-12T00:04:39.045 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5167999999999998e-05 2024-09-12T00:04:39.045 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.045 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.045 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.045 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.045 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.045 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1752 4.1b 4:d867e322:::.dir.b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:39.045 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.614859+0000", 2024-09-12T00:04:39.045 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.3681756299999996, 2024-09-12T00:04:39.045 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057820520000000002, 2024-09-12T00:04:39.045 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.045 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.046 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.046 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.046 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.046 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.046 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1752 2024-09-12T00:04:39.046 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.046 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.046 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.046 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.046 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.614859+0000", 2024-09-12T00:04:39.046 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.046 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.046 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.046 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.047 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.614859+0000", 2024-09-12T00:04:39.047 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.047 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.047 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.047 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.047 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.614859+0000", 2024-09-12T00:04:39.047 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8100000000000003e-07 2024-09-12T00:04:39.047 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.047 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.047 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.047 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.614864+0000", 2024-09-12T00:04:39.047 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1080000000000003e-06 2024-09-12T00:04:39.047 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.047 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.048 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.048 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.614872+0000", 2024-09-12T00:04:39.048 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8419999999999994e-06 2024-09-12T00:04:39.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.048 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.048 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.048 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.614884+0000", 2024-09-12T00:04:39.048 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1592e-05 2024-09-12T00:04:39.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.048 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.048 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.048 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.614995+0000", 2024-09-12T00:04:39.048 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110599 2024-09-12T00:04:39.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.049 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.049 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.049 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.615114+0000", 2024-09-12T00:04:39.049 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011910500000000001 2024-09-12T00:04:39.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.049 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.049 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:39.049 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.615257+0000", 2024-09-12T00:04:39.049 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014299899999999999 2024-09-12T00:04:39.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.049 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.049 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.049 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.616621+0000", 2024-09-12T00:04:39.050 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001364107 2024-09-12T00:04:39.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.050 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.050 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.050 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.620537+0000", 2024-09-12T00:04:39.050 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039166169999999998 2024-09-12T00:04:39.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.050 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.050 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.050 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.620598+0000", 2024-09-12T00:04:39.050 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0424000000000003e-05 2024-09-12T00:04:39.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.050 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.050 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.051 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.620641+0000", 2024-09-12T00:04:39.051 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3078000000000003e-05 2024-09-12T00:04:39.051 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.051 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.051 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.051 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.051 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.051 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1754 8.5 e58/33 8:a4bd5286:root::.bucket.meta.buck_2024_08_12_00_04_33%3ab5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3:head v 58'1, mlcod=0'0)", 2024-09-12T00:04:39.051 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.621874+0000", 2024-09-12T00:04:39.051 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.3611603829999996, 2024-09-12T00:04:39.051 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003110055, 2024-09-12T00:04:39.051 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.051 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.051 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.052 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.052 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.052 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.052 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621874+0000", 2024-09-12T00:04:39.052 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.052 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.052 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.052 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621874+0000", 2024-09-12T00:04:39.052 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.052 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.052 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.052 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621875+0000", 2024-09-12T00:04:39.053 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8100000000000002e-07 2024-09-12T00:04:39.053 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.053 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.053 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.053 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621881+0000", 2024-09-12T00:04:39.053 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0519999999999998e-06 2024-09-12T00:04:39.053 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.053 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.053 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.053 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621892+0000", 2024-09-12T00:04:39.053 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1593000000000001e-05 2024-09-12T00:04:39.053 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.053 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.053 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.054 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621898+0000", 2024-09-12T00:04:39.054 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0150000000000003e-06 2024-09-12T00:04:39.054 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.054 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.054 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.054 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621960+0000", 2024-09-12T00:04:39.054 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2528999999999997e-05 2024-09-12T00:04:39.054 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.054 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.054 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.054 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621979+0000", 2024-09-12T00:04:39.054 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8580000000000002e-05 2024-09-12T00:04:39.054 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.054 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.054 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.055 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.624931+0000", 2024-09-12T00:04:39.055 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029521360000000002 2024-09-12T00:04:39.055 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.055 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.055 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.055 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.624984+0000", 2024-09-12T00:04:39.055 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3368999999999997e-05 2024-09-12T00:04:39.055 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.055 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.055 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.055 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.055 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.055 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1775 3.30 e58/23 3:0c2ae78d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_1:head v 58'1, mlcod=0'0)", 2024-09-12T00:04:39.055 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:04:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.9812733250000001, 2024-09-12T00:04:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017585038000000001, 2024-09-12T00:04:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:04:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.056 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:04:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001763+0000", 2024-09-12T00:04:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2730000000000001e-06 2024-09-12T00:04:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005217+0000", 2024-09-12T00:04:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0034533810000000002 2024-09-12T00:04:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.057 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005241+0000", 2024-09-12T00:04:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4403e-05 2024-09-12T00:04:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005253+0000", 2024-09-12T00:04:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2007e-05 2024-09-12T00:04:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005324+0000", 2024-09-12T00:04:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0765000000000004e-05 2024-09-12T00:04:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.058 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005348+0000", 2024-09-12T00:04:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3762000000000001e-05 2024-09-12T00:04:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019291+0000", 2024-09-12T00:04:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013943707 2024-09-12T00:04:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019346+0000", 2024-09-12T00:04:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4740000000000001e-05 2024-09-12T00:04:39.059 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1780 3.16 3:69d8ee52:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:04:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.9596644130000005, 2024-09-12T00:04:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016232362, 2024-09-12T00:04:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.060 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1780 2024-09-12T00:04:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:04:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:04:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.061 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023372+0000", 2024-09-12T00:04:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0209999999999998e-06 2024-09-12T00:04:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024447+0000", 2024-09-12T00:04:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0010749550000000001 2024-09-12T00:04:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024473+0000", 2024-09-12T00:04:39.062 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5689000000000001e-05 2024-09-12T00:04:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024484+0000", 2024-09-12T00:04:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1153e-05 2024-09-12T00:04:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024547+0000", 2024-09-12T00:04:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3400999999999998e-05 2024-09-12T00:04:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.063 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024669+0000", 2024-09-12T00:04:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012184999999999999 2024-09-12T00:04:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025014+0000", 2024-09-12T00:04:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000344505 2024-09-12T00:04:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039161+0000", 2024-09-12T00:04:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014147799000000001 2024-09-12T00:04:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.064 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039434+0000", 2024-09-12T00:04:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00027254699999999999 2024-09-12T00:04:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039521+0000", 2024-09-12T00:04:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6663999999999996e-05 2024-09-12T00:04:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039602+0000", 2024-09-12T00:04:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1778000000000002e-05 2024-09-12T00:04:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.065 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1871 4.1b 4:d867e322:::.dir.b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.377553+0000", 2024-09-12T00:04:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.6054813330000002, 2024-09-12T00:04:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0081380240000000006, 2024-09-12T00:04:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.066 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1871 2024-09-12T00:04:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377553+0000", 2024-09-12T00:04:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377553+0000", 2024-09-12T00:04:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.067 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377554+0000", 2024-09-12T00:04:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2900000000000004e-07 2024-09-12T00:04:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377556+0000", 2024-09-12T00:04:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7420000000000002e-06 2024-09-12T00:04:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377566+0000", 2024-09-12T00:04:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2110000000000004e-06 2024-09-12T00:04:39.068 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.069 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.069 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.069 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377572+0000", 2024-09-12T00:04:39.069 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9209999999999997e-06 2024-09-12T00:04:39.069 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.069 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.069 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.069 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377628+0000", 2024-09-12T00:04:39.069 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6433e-05 2024-09-12T00:04:39.069 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.069 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.069 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.069 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377709+0000", 2024-09-12T00:04:39.069 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1371000000000004e-05 2024-09-12T00:04:39.070 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.070 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.070 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:39.070 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377813+0000", 2024-09-12T00:04:39.070 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104162 2024-09-12T00:04:39.070 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.070 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.070 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.070 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.379948+0000", 2024-09-12T00:04:39.070 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002134815 2024-09-12T00:04:39.070 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.070 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.070 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.070 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.385636+0000", 2024-09-12T00:04:39.071 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056879330000000001 2024-09-12T00:04:39.071 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.071 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.071 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.071 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.385666+0000", 2024-09-12T00:04:39.071 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.953e-05 2024-09-12T00:04:39.071 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.071 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.071 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.071 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.385691+0000", 2024-09-12T00:04:39.071 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5377000000000001e-05 2024-09-12T00:04:39.071 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.071 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.071 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.072 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.072 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.072 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1912 3.16 3:6a08f78f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.4__shadow_.EKM6BwfpK8ZqXIKQk7k4yJFkOWS2UlN_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:04:39.072 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:35.139256+0000", 2024-09-12T00:04:39.072 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 3.8437784920000002, 2024-09-12T00:04:39.072 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01537029, 2024-09-12T00:04:39.072 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.072 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.072 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.072 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.072 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.072 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.072 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1912 2024-09-12T00:04:39.073 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.073 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.073 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.073 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.073 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.139256+0000", 2024-09-12T00:04:39.073 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.073 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.073 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.073 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.073 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.139256+0000", 2024-09-12T00:04:39.073 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.073 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.073 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.074 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.074 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.139258+0000", 2024-09-12T00:04:39.074 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3439999999999999e-06 2024-09-12T00:04:39.074 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.074 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.074 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.074 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141028+0000", 2024-09-12T00:04:39.074 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001770183 2024-09-12T00:04:39.074 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.074 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.075 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.075 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141054+0000", 2024-09-12T00:04:39.075 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5928e-05 2024-09-12T00:04:39.075 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.075 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.075 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.075 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141065+0000", 2024-09-12T00:04:39.075 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0589e-05 2024-09-12T00:04:39.075 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.075 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.075 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.075 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141145+0000", 2024-09-12T00:04:39.075 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0121000000000001e-05 2024-09-12T00:04:39.075 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.076 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.076 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.076 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141257+0000", 2024-09-12T00:04:39.076 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000111672 2024-09-12T00:04:39.076 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.076 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.076 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:39.076 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141361+0000", 2024-09-12T00:04:39.076 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103705 2024-09-12T00:04:39.076 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.076 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.076 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.076 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.152422+0000", 2024-09-12T00:04:39.077 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011061586999999999 2024-09-12T00:04:39.077 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.077 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.077 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.077 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154552+0000", 2024-09-12T00:04:39.077 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021297120000000002 2024-09-12T00:04:39.077 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.077 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.077 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.077 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154590+0000", 2024-09-12T00:04:39.077 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7942999999999999e-05 2024-09-12T00:04:39.078 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.078 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.078 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.078 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154626+0000", 2024-09-12T00:04:39.078 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6505999999999999e-05 2024-09-12T00:04:39.078 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.078 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.078 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.078 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.078 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.078 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1917 3.1 e59/23 3:829295ac:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.4_10Mb.:head v 59'1, mlcod=0'0)", 2024-09-12T00:04:39.078 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:35.170889+0000", 2024-09-12T00:04:39.078 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 3.8121458499999998, 2024-09-12T00:04:39.079 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011229917000000001, 2024-09-12T00:04:39.079 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.079 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.079 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.079 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.079 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.079 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.079 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.170889+0000", 2024-09-12T00:04:39.079 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.079 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.079 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.079 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.079 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.170889+0000", 2024-09-12T00:04:39.079 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.080 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.080 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.080 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.080 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.170889+0000", 2024-09-12T00:04:39.080 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5200000000000002e-07 2024-09-12T00:04:39.080 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.080 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.080 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.080 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.175127+0000", 2024-09-12T00:04:39.080 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0042381220000000004 2024-09-12T00:04:39.080 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.080 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.080 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.080 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.175149+0000", 2024-09-12T00:04:39.081 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1926e-05 2024-09-12T00:04:39.081 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.081 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.081 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.081 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.175164+0000", 2024-09-12T00:04:39.081 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5167999999999999e-05 2024-09-12T00:04:39.081 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.081 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.081 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.081 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.175234+0000", 2024-09-12T00:04:39.081 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0129999999999994e-05 2024-09-12T00:04:39.081 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.081 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.081 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.082 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.175252+0000", 2024-09-12T00:04:39.082 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7388999999999999e-05 2024-09-12T00:04:39.082 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.082 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.082 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.082 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.182013+0000", 2024-09-12T00:04:39.082 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0067615740000000002 2024-09-12T00:04:39.082 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.082 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.082 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.082 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.182119+0000", 2024-09-12T00:04:39.082 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010515599999999999 2024-09-12T00:04:39.082 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.082 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.083 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.083 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.083 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.083 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2463 4.a 4:53c017a3:::.dir.b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:04:39.083 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:38.218126+0000", 2024-09-12T00:04:39.083 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.76490845500000004, 2024-09-12T00:04:39.083 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0044908689999999998, 2024-09-12T00:04:39.083 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.083 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.083 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.083 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.083 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.083 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.083 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2463 2024-09-12T00:04:39.084 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.084 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.084 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.084 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.084 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.218126+0000", 2024-09-12T00:04:39.084 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.084 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.084 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.084 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.084 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.218126+0000", 2024-09-12T00:04:39.084 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.084 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.084 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.085 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.085 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.218128+0000", 2024-09-12T00:04:39.085 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.646e-06 2024-09-12T00:04:39.085 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.085 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.085 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.085 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.218134+0000", 2024-09-12T00:04:39.085 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7270000000000001e-06 2024-09-12T00:04:39.085 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.085 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.085 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.085 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.218150+0000", 2024-09-12T00:04:39.085 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6113999999999999e-05 2024-09-12T00:04:39.085 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.086 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.086 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.086 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.218162+0000", 2024-09-12T00:04:39.086 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1473e-05 2024-09-12T00:04:39.086 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.086 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.086 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.086 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.218227+0000", 2024-09-12T00:04:39.086 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5153000000000005e-05 2024-09-12T00:04:39.086 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.086 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.086 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.086 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.218380+0000", 2024-09-12T00:04:39.086 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015293500000000001 2024-09-12T00:04:39.087 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.087 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.087 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:39.087 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.218565+0000", 2024-09-12T00:04:39.087 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018521 2024-09-12T00:04:39.087 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.087 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.087 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.087 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.220206+0000", 2024-09-12T00:04:39.087 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0016404900000000001 2024-09-12T00:04:39.087 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.087 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.087 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.087 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.222520+0000", 2024-09-12T00:04:39.088 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023145309999999999 2024-09-12T00:04:39.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.088 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.088 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.088 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.222574+0000", 2024-09-12T00:04:39.088 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3522e-05 2024-09-12T00:04:39.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.088 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.088 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.088 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.222617+0000", 2024-09-12T00:04:39.088 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3068000000000002e-05 2024-09-12T00:04:39.088 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.088 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.088 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2462 4.24 e60/25 4:25c5078c:::.dir.b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9.0:head v 60'1, mlcod=0'0)", 2024-09-12T00:04:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:38.219442+0000", 2024-09-12T00:04:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.763592724, 2024-09-12T00:04:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0028928500000000002, 2024-09-12T00:04:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.219442+0000", 2024-09-12T00:04:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.090 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.219442+0000", 2024-09-12T00:04:39.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.090 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.219443+0000", 2024-09-12T00:04:39.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.232e-06 2024-09-12T00:04:39.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.090 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.219452+0000", 2024-09-12T00:04:39.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.935e-06 2024-09-12T00:04:39.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.091 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.091 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.219466+0000", 2024-09-12T00:04:39.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4107000000000001e-05 2024-09-12T00:04:39.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.091 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.091 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.219474+0000", 2024-09-12T00:04:39.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6820000000000003e-06 2024-09-12T00:04:39.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.091 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.091 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.219535+0000", 2024-09-12T00:04:39.092 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1549000000000003e-05 2024-09-12T00:04:39.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.092 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.092 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.092 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.219557+0000", 2024-09-12T00:04:39.092 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1268999999999999e-05 2024-09-12T00:04:39.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.092 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.092 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.092 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.222288+0000", 2024-09-12T00:04:39.092 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027312740000000001 2024-09-12T00:04:39.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.092 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.093 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.093 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.222335+0000", 2024-09-12T00:04:39.093 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6801999999999997e-05 2024-09-12T00:04:39.093 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.093 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.093 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.093 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.093 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.093 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:39.094 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:04:39.095 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:39.094+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:39.195 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:39.196+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:39.261 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:39.261 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:39.261 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:39.261 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:39.275 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:04:39.318 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:39.320+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:39.398 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:39.400+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:39.440 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:39.440 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:39.440 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:39.440 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:39.440 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:39.453 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:04:39.500 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:39.500+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:39.518 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:04:39.599 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:39.600+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:39.613 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:39.613 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:39.613 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:39.614 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:39.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.614 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4232.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-12T00:04:39.614 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:04:39.614 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 83.065659041000004, 2024-09-12T00:04:39.614 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.049385680000000001, 2024-09-12T00:04:39.614 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.614 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.614 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.614 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.614 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4232", 2024-09-12T00:04:39.614 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/3037249369", 2024-09-12T00:04:39.614 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:04:39.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.615 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.615 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:04:39.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.615 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:04:39.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.616 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548454+0000", 2024-09-12T00:04:39.616 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2259999999999999e-06 2024-09-12T00:04:39.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.616 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.616 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548466+0000", 2024-09-12T00:04:39.616 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1361e-05 2024-09-12T00:04:39.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.616 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.616 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548492+0000", 2024-09-12T00:04:39.616 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6225999999999999e-05 2024-09-12T00:04:39.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.617 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548509+0000", 2024-09-12T00:04:39.617 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7452000000000002e-05 2024-09-12T00:04:39.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.617 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.617 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549371+0000", 2024-09-12T00:04:39.617 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00086204300000000005 2024-09-12T00:04:39.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.617 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:39.617 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549396+0000", 2024-09-12T00:04:39.617 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.51e-05 2024-09-12T00:04:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593253+0000", 2024-09-12T00:04:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.043856248 2024-09-12T00:04:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593517+0000", 2024-09-12T00:04:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026439299999999997 2024-09-12T00:04:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594046+0000", 2024-09-12T00:04:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00052854200000000001 2024-09-12T00:04:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597642+0000", 2024-09-12T00:04:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0035959070000000002 2024-09-12T00:04:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597670+0000", 2024-09-12T00:04:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8235999999999999e-05 2024-09-12T00:04:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597754+0000", 2024-09-12T00:04:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4009000000000002e-05 2024-09-12T00:04:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597833+0000", 2024-09-12T00:04:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8937000000000007e-05 2024-09-12T00:04:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4232.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-12T00:04:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:17.547042+0000", 2024-09-12T00:04:39.621 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 82.067063887000003, 2024-09-12T00:04:39.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011713866, 2024-09-12T00:04:39.621 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.621 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.621 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.621 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4232", 2024-09-12T00:04:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/3037249369", 2024-09-12T00:04:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 5 2024-09-12T00:04:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547042+0000", 2024-09-12T00:04:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547042+0000", 2024-09-12T00:04:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547048+0000", 2024-09-12T00:04:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3639999999999998e-06 2024-09-12T00:04:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547078+0000", 2024-09-12T00:04:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.029e-05 2024-09-12T00:04:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547135+0000", 2024-09-12T00:04:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7299000000000001e-05 2024-09-12T00:04:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547159+0000", 2024-09-12T00:04:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3470000000000001e-05 2024-09-12T00:04:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547408+0000", 2024-09-12T00:04:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024930800000000001 2024-09-12T00:04:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547419+0000", 2024-09-12T00:04:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1316e-05 2024-09-12T00:04:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.555594+0000", 2024-09-12T00:04:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0081748129999999995 2024-09-12T00:04:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.555811+0000", 2024-09-12T00:04:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021711199999999999 2024-09-12T00:04:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.556013+0000", 2024-09-12T00:04:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020175099999999999 2024-09-12T00:04:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.557402+0000", 2024-09-12T00:04:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0013890269999999999 2024-09-12T00:04:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.558483+0000", 2024-09-12T00:04:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001081128 2024-09-12T00:04:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.558636+0000", 2024-09-12T00:04:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015267500000000001 2024-09-12T00:04:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.558756+0000", 2024-09-12T00:04:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000120313 2024-09-12T00:04:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4232.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-09-12T00:04:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:18.562030+0000", 2024-09-12T00:04:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 81.052075697000006, 2024-09-12T00:04:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0073448150000000002, 2024-09-12T00:04:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.629 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4232", 2024-09-12T00:04:39.629 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/3037249369", 2024-09-12T00:04:39.629 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 7 2024-09-12T00:04:39.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.629 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.629 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.629 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.629 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562030+0000", 2024-09-12T00:04:39.629 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.629 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.630 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.630 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562030+0000", 2024-09-12T00:04:39.630 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.630 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.630 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.630 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562034+0000", 2024-09-12T00:04:39.630 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6069999999999999e-06 2024-09-12T00:04:39.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.630 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.630 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.630 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562051+0000", 2024-09-12T00:04:39.630 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7450000000000001e-05 2024-09-12T00:04:39.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562091+0000", 2024-09-12T00:04:39.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9703000000000003e-05 2024-09-12T00:04:39.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562112+0000", 2024-09-12T00:04:39.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1189999999999999e-05 2024-09-12T00:04:39.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562253+0000", 2024-09-12T00:04:39.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000140302 2024-09-12T00:04:39.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:39.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562264+0000", 2024-09-12T00:04:39.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1737e-05 2024-09-12T00:04:39.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.566247+0000", 2024-09-12T00:04:39.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039824259999999998 2024-09-12T00:04:39.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.566384+0000", 2024-09-12T00:04:39.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000136916 2024-09-12T00:04:39.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:39.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.566645+0000", 2024-09-12T00:04:39.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000261241 2024-09-12T00:04:39.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.634 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.568507+0000", 2024-09-12T00:04:39.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001862219 2024-09-12T00:04:39.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.634 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.569221+0000", 2024-09-12T00:04:39.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00071416199999999996 2024-09-12T00:04:39.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.635 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.635 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.569306+0000", 2024-09-12T00:04:39.635 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5016000000000001e-05 2024-09-12T00:04:39.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.635 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.635 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.569375+0000", 2024-09-12T00:04:39.635 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8845999999999998e-05 2024-09-12T00:04:39.635 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.636 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.636 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.636 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.636 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.636 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T00:04:39.636 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:04:39.636 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 70.284449273000007, 2024-09-12T00:04:39.636 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025928692999999999, 2024-09-12T00:04:39.636 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.636 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.636 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "reached pg", 2024-09-12T00:04:39.637 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.637 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.637 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.637 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 43 2024-09-12T00:04:39.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.637 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.637 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.637 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.637 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:04:39.637 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.638 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.638 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:04:39.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.638 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.638 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329660+0000", 2024-09-12T00:04:39.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.965e-06 2024-09-12T00:04:39.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329673+0000", 2024-09-12T00:04:39.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3402e-05 2024-09-12T00:04:39.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329706+0000", 2024-09-12T00:04:39.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2441000000000003e-05 2024-09-12T00:04:39.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329723+0000", 2024-09-12T00:04:39.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7609e-05 2024-09-12T00:04:39.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330437+0000", 2024-09-12T00:04:39.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00071403500000000002 2024-09-12T00:04:39.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:39.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330454+0000", 2024-09-12T00:04:39.641 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6820000000000002e-05 2024-09-12T00:04:39.641 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.641 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.641 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.641 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347344+0000", 2024-09-12T00:04:39.641 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016890275 2024-09-12T00:04:39.641 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.641 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.641 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:39.641 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347365+0000", 2024-09-12T00:04:39.641 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0350999999999999e-05 2024-09-12T00:04:39.641 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.642 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.642 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.642 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355323+0000", 2024-09-12T00:04:39.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079579400000000002 2024-09-12T00:04:39.642 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.642 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.642 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.642 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355585+0000", 2024-09-12T00:04:39.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026285499999999999 2024-09-12T00:04:39.642 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.642 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.642 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.643 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.643 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:241 6.7 6:e31d3d5f:lc::lc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:39.643 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.484582+0000", 2024-09-12T00:04:39.643 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 65.129524388999997, 2024-09-12T00:04:39.643 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056165570000000003, 2024-09-12T00:04:39.643 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.643 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.643 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.643 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.643 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.643 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.643 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 241 2024-09-12T00:04:39.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.644 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.644 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.644 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484582+0000", 2024-09-12T00:04:39.644 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.644 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.644 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484582+0000", 2024-09-12T00:04:39.644 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.645 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484583+0000", 2024-09-12T00:04:39.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.536e-06 2024-09-12T00:04:39.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.645 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484590+0000", 2024-09-12T00:04:39.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6100000000000002e-06 2024-09-12T00:04:39.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.646 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.646 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484613+0000", 2024-09-12T00:04:39.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3309999999999999e-05 2024-09-12T00:04:39.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484624+0000", 2024-09-12T00:04:39.647 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0669999999999999e-05 2024-09-12T00:04:39.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484716+0000", 2024-09-12T00:04:39.647 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2257999999999997e-05 2024-09-12T00:04:39.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484900+0000", 2024-09-12T00:04:39.647 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000183807 2024-09-12T00:04:39.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.648 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.648 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:39.648 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.485057+0000", 2024-09-12T00:04:39.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015707300000000001 2024-09-12T00:04:39.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.648 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.648 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.648 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.485975+0000", 2024-09-12T00:04:39.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00091781399999999998 2024-09-12T00:04:39.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.648 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.648 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.649 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490054+0000", 2024-09-12T00:04:39.649 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040794569999999999 2024-09-12T00:04:39.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.649 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.649 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.649 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490128+0000", 2024-09-12T00:04:39.649 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3336000000000004e-05 2024-09-12T00:04:39.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.649 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.649 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.649 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490198+0000", 2024-09-12T00:04:39.650 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0685999999999994e-05 2024-09-12T00:04:39.650 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.650 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.650 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.650 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:276 6.7 6:e31d3d5f:lc::lc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:39.650 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.491340+0000", 2024-09-12T00:04:39.650 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 65.122766268999996, 2024-09-12T00:04:39.650 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056286460000000002, 2024-09-12T00:04:39.650 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.650 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.650 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.650 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.651 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.651 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.651 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 276 2024-09-12T00:04:39.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.652 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.652 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491340+0000", 2024-09-12T00:04:39.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.652 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491340+0000", 2024-09-12T00:04:39.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491342+0000", 2024-09-12T00:04:39.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8509999999999999e-06 2024-09-12T00:04:39.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491348+0000", 2024-09-12T00:04:39.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1929999999999998e-06 2024-09-12T00:04:39.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491366+0000", 2024-09-12T00:04:39.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7669999999999999e-05 2024-09-12T00:04:39.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.654 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491382+0000", 2024-09-12T00:04:39.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6554000000000001e-05 2024-09-12T00:04:39.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.654 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491452+0000", 2024-09-12T00:04:39.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9917000000000002e-05 2024-09-12T00:04:39.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.654 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491536+0000", 2024-09-12T00:04:39.655 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4229999999999998e-05 2024-09-12T00:04:39.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.655 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.655 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:39.655 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491704+0000", 2024-09-12T00:04:39.655 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000167994 2024-09-12T00:04:39.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.655 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.655 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.655 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.492347+0000", 2024-09-12T00:04:39.655 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00064263799999999995 2024-09-12T00:04:39.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.655 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.655 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.656 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.496901+0000", 2024-09-12T00:04:39.656 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045546329999999998 2024-09-12T00:04:39.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.656 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.656 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.656 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.496939+0000", 2024-09-12T00:04:39.656 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7135999999999998e-05 2024-09-12T00:04:39.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.656 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.656 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.496968+0000", 2024-09-12T00:04:39.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9830000000000001e-05 2024-09-12T00:04:39.657 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.657 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.657 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.657 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:297 6.8 6:162a24ce:lc::lc.8:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:39.657 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.497051+0000", 2024-09-12T00:04:39.657 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 65.117055457000006, 2024-09-12T00:04:39.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056532370000000002, 2024-09-12T00:04:39.657 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.657 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.657 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.658 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.658 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.658 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.658 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 297 2024-09-12T00:04:39.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.658 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497051+0000", 2024-09-12T00:04:39.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497051+0000", 2024-09-12T00:04:39.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.659 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497052+0000", 2024-09-12T00:04:39.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3659999999999999e-06 2024-09-12T00:04:39.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.659 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497058+0000", 2024-09-12T00:04:39.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0909999999999998e-06 2024-09-12T00:04:39.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.660 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497075+0000", 2024-09-12T00:04:39.660 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7312e-05 2024-09-12T00:04:39.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.660 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.660 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.660 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497084+0000", 2024-09-12T00:04:39.660 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3149999999999992e-06 2024-09-12T00:04:39.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.660 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.660 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.661 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497189+0000", 2024-09-12T00:04:39.661 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105257 2024-09-12T00:04:39.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.661 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.661 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.661 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497278+0000", 2024-09-12T00:04:39.661 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9512000000000006e-05 2024-09-12T00:04:39.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.661 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.661 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:39.661 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497460+0000", 2024-09-12T00:04:39.661 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018169 2024-09-12T00:04:39.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.498149+0000", 2024-09-12T00:04:39.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000688632 2024-09-12T00:04:39.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.502640+0000", 2024-09-12T00:04:39.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0044907690000000004 2024-09-12T00:04:39.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.502676+0000", 2024-09-12T00:04:39.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6452000000000003e-05 2024-09-12T00:04:39.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.502704+0000", 2024-09-12T00:04:39.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7841e-05 2024-09-12T00:04:39.663 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.663 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.663 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.663 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:322 6.7 6:e31d3d5f:lc::lc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:39.663 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.500700+0000", 2024-09-12T00:04:39.663 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 65.113406061999996, 2024-09-12T00:04:39.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0067834599999999998, 2024-09-12T00:04:39.663 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.664 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.664 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.664 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.664 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.664 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.664 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 322 2024-09-12T00:04:39.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.664 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500700+0000", 2024-09-12T00:04:39.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.665 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.665 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500700+0000", 2024-09-12T00:04:39.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.665 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.665 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500701+0000", 2024-09-12T00:04:39.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.19e-06 2024-09-12T00:04:39.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.665 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.665 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500708+0000", 2024-09-12T00:04:39.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1130000000000003e-06 2024-09-12T00:04:39.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.666 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.666 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.666 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500721+0000", 2024-09-12T00:04:39.666 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3073e-05 2024-09-12T00:04:39.666 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.666 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.666 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.666 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500730+0000", 2024-09-12T00:04:39.666 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5969999999999992e-06 2024-09-12T00:04:39.666 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.666 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.666 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.666 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500798+0000", 2024-09-12T00:04:39.666 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7659999999999999e-05 2024-09-12T00:04:39.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.667 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.667 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.667 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500860+0000", 2024-09-12T00:04:39.667 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2089999999999997e-05 2024-09-12T00:04:39.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.667 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.667 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:39.667 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.501007+0000", 2024-09-12T00:04:39.667 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000147618 2024-09-12T00:04:39.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.668 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.501726+0000", 2024-09-12T00:04:39.668 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00071825600000000002 2024-09-12T00:04:39.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.668 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.507420+0000", 2024-09-12T00:04:39.668 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056941240000000001 2024-09-12T00:04:39.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.507453+0000", 2024-09-12T00:04:39.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3547999999999998e-05 2024-09-12T00:04:39.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.507483+0000", 2024-09-12T00:04:39.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0190999999999999e-05 2024-09-12T00:04:39.669 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.669 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.670 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.670 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:408 6.7 6:e31d3d5f:lc::lc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:39.670 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.525223+0000", 2024-09-12T00:04:39.670 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 65.088883272999993, 2024-09-12T00:04:39.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064357069999999997, 2024-09-12T00:04:39.670 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.670 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.670 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.670 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.670 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.670 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.670 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 408 2024-09-12T00:04:39.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.671 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.671 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.671 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525223+0000", 2024-09-12T00:04:39.671 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.671 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.671 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525223+0000", 2024-09-12T00:04:39.671 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.671 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.671 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525224+0000", 2024-09-12T00:04:39.672 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.325e-06 2024-09-12T00:04:39.672 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.672 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.672 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.672 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525230+0000", 2024-09-12T00:04:39.672 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.677e-06 2024-09-12T00:04:39.672 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.672 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.672 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.672 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525243+0000", 2024-09-12T00:04:39.672 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3592e-05 2024-09-12T00:04:39.672 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.672 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.672 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.673 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525255+0000", 2024-09-12T00:04:39.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1257000000000001e-05 2024-09-12T00:04:39.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.673 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.673 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525339+0000", 2024-09-12T00:04:39.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4565000000000001e-05 2024-09-12T00:04:39.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.673 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.673 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525433+0000", 2024-09-12T00:04:39.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.4248999999999998e-05 2024-09-12T00:04:39.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.674 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:39.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525649+0000", 2024-09-12T00:04:39.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021594999999999999 2024-09-12T00:04:39.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526275+0000", 2024-09-12T00:04:39.675 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00062531200000000005 2024-09-12T00:04:39.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531540+0000", 2024-09-12T00:04:39.675 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052655009999999997 2024-09-12T00:04:39.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531606+0000", 2024-09-12T00:04:39.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5733000000000002e-05 2024-09-12T00:04:39.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531659+0000", 2024-09-12T00:04:39.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2546000000000001e-05 2024-09-12T00:04:39.676 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.676 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.676 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.677 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.677 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:492 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:39.677 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.552214+0000", 2024-09-12T00:04:39.677 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 65.061891716999995, 2024-09-12T00:04:39.677 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.006213199, 2024-09-12T00:04:39.677 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.677 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.677 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.677 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.677 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.677 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.677 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 492 2024-09-12T00:04:39.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.678 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.678 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.678 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.678 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552214+0000", 2024-09-12T00:04:39.678 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.678 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.678 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.678 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552214+0000", 2024-09-12T00:04:39.678 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.678 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.678 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.678 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552215+0000", 2024-09-12T00:04:39.678 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1170000000000001e-06 2024-09-12T00:04:39.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552220+0000", 2024-09-12T00:04:39.679 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8149999999999996e-06 2024-09-12T00:04:39.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552233+0000", 2024-09-12T00:04:39.679 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2784e-05 2024-09-12T00:04:39.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552240+0000", 2024-09-12T00:04:39.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8379999999999996e-06 2024-09-12T00:04:39.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552297+0000", 2024-09-12T00:04:39.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7123000000000002e-05 2024-09-12T00:04:39.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552382+0000", 2024-09-12T00:04:39.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5334000000000007e-05 2024-09-12T00:04:39.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:39.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552504+0000", 2024-09-12T00:04:39.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000121309 2024-09-12T00:04:39.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.681 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558157+0000", 2024-09-12T00:04:39.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056535439999999999 2024-09-12T00:04:39.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.681 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558356+0000", 2024-09-12T00:04:39.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000198436 2024-09-12T00:04:39.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.682 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558401+0000", 2024-09-12T00:04:39.682 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5048e-05 2024-09-12T00:04:39.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.682 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558428+0000", 2024-09-12T00:04:39.682 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6851000000000001e-05 2024-09-12T00:04:39.682 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.682 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.682 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.682 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:643 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.593859+0000", 2024-09-12T00:04:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 65.020246727, 2024-09-12T00:04:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054148069999999998, 2024-09-12T00:04:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 643 2024-09-12T00:04:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.684 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.684 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593859+0000", 2024-09-12T00:04:39.684 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.684 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.684 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.684 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593859+0000", 2024-09-12T00:04:39.684 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.684 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.685 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.685 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593860+0000", 2024-09-12T00:04:39.685 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0500000000000002e-07 2024-09-12T00:04:39.685 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.685 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.685 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.685 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593864+0000", 2024-09-12T00:04:39.685 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3100000000000002e-06 2024-09-12T00:04:39.685 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.685 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.685 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.685 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593875+0000", 2024-09-12T00:04:39.686 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0706999999999999e-05 2024-09-12T00:04:39.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.686 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.686 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.686 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593882+0000", 2024-09-12T00:04:39.686 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2919999999999998e-06 2024-09-12T00:04:39.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.686 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.686 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.686 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593939+0000", 2024-09-12T00:04:39.686 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6138999999999999e-05 2024-09-12T00:04:39.687 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.687 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.687 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.687 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594023+0000", 2024-09-12T00:04:39.687 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4128000000000005e-05 2024-09-12T00:04:39.687 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.687 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.687 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:39.687 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594194+0000", 2024-09-12T00:04:39.687 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017098800000000001 2024-09-12T00:04:39.687 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.687 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.687 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.687 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.598923+0000", 2024-09-12T00:04:39.688 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047291369999999996 2024-09-12T00:04:39.688 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.688 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.688 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.688 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599219+0000", 2024-09-12T00:04:39.688 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00029588500000000002 2024-09-12T00:04:39.688 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.688 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.688 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.688 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599250+0000", 2024-09-12T00:04:39.688 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0771000000000001e-05 2024-09-12T00:04:39.688 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.688 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.688 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.689 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599274+0000", 2024-09-12T00:04:39.689 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4644999999999999e-05 2024-09-12T00:04:39.689 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.689 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.689 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.689 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.689 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.689 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:657 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:39.689 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600087+0000", 2024-09-12T00:04:39.689 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 65.014019528999995, 2024-09-12T00:04:39.689 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0072536739999999999, 2024-09-12T00:04:39.690 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.690 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.690 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.690 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.690 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.690 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.690 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 657 2024-09-12T00:04:39.690 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.690 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.690 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.690 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.690 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600087+0000", 2024-09-12T00:04:39.691 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.691 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.691 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.691 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600087+0000", 2024-09-12T00:04:39.691 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.691 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.691 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.691 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600088+0000", 2024-09-12T00:04:39.692 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4759999999999999e-06 2024-09-12T00:04:39.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.692 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.692 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.692 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600093+0000", 2024-09-12T00:04:39.692 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4330000000000003e-06 2024-09-12T00:04:39.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.692 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.692 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.692 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600107+0000", 2024-09-12T00:04:39.692 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.348e-05 2024-09-12T00:04:39.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.693 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.693 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.693 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600116+0000", 2024-09-12T00:04:39.693 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7339999999999997e-06 2024-09-12T00:04:39.693 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.693 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.693 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.693 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600178+0000", 2024-09-12T00:04:39.693 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2382e-05 2024-09-12T00:04:39.693 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.693 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.694 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.694 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600233+0000", 2024-09-12T00:04:39.694 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4960999999999998e-05 2024-09-12T00:04:39.694 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.694 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.694 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:39.694 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600373+0000", 2024-09-12T00:04:39.694 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013955599999999999 2024-09-12T00:04:39.694 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.694 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.694 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.694 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.604463+0000", 2024-09-12T00:04:39.695 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040905539999999997 2024-09-12T00:04:39.695 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.695 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.695 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.695 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607243+0000", 2024-09-12T00:04:39.695 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027799140000000001 2024-09-12T00:04:39.695 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.695 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.695 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.696 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607306+0000", 2024-09-12T00:04:39.696 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2575000000000003e-05 2024-09-12T00:04:39.696 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.696 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.696 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.696 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607340+0000", 2024-09-12T00:04:39.696 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4609e-05 2024-09-12T00:04:39.696 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.696 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.697 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.697 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.697 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.697 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:665 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:39.697 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602284+0000", 2024-09-12T00:04:39.697 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 65.011822355999996, 2024-09-12T00:04:39.697 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055001709999999999, 2024-09-12T00:04:39.697 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.697 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.697 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.697 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.697 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.697 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.697 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 665 2024-09-12T00:04:39.698 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.698 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.698 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.698 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.698 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602284+0000", 2024-09-12T00:04:39.698 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.698 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.698 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.698 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.698 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602284+0000", 2024-09-12T00:04:39.698 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.698 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.698 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.698 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.699 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602285+0000", 2024-09-12T00:04:39.699 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6700000000000002e-07 2024-09-12T00:04:39.699 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.699 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.699 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.699 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602289+0000", 2024-09-12T00:04:39.699 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5519999999999998e-06 2024-09-12T00:04:39.699 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.699 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.699 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.699 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602304+0000", 2024-09-12T00:04:39.699 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5299e-05 2024-09-12T00:04:39.699 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.700 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.700 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.700 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602313+0000", 2024-09-12T00:04:39.700 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6379999999999993e-06 2024-09-12T00:04:39.700 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.700 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.700 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.700 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602370+0000", 2024-09-12T00:04:39.700 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6839000000000002e-05 2024-09-12T00:04:39.700 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.701 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.701 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.701 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602460+0000", 2024-09-12T00:04:39.701 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0323999999999998e-05 2024-09-12T00:04:39.701 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.701 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.701 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:39.701 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602650+0000", 2024-09-12T00:04:39.701 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018955900000000001 2024-09-12T00:04:39.701 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.701 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.701 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.701 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607365+0000", 2024-09-12T00:04:39.701 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004715632 2024-09-12T00:04:39.702 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.702 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.702 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.702 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607698+0000", 2024-09-12T00:04:39.702 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00033217400000000002 2024-09-12T00:04:39.702 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.702 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.702 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.702 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607738+0000", 2024-09-12T00:04:39.702 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0516000000000003e-05 2024-09-12T00:04:39.702 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.702 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.702 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.703 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607784+0000", 2024-09-12T00:04:39.703 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5770999999999999e-05 2024-09-12T00:04:39.703 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.703 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.703 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.703 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.704 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.704 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:669 6.1c 6:3b93e7b4:::obj_delete_at_hint.0000000016:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:39.704 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.607439+0000", 2024-09-12T00:04:39.704 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 65.006667366000002, 2024-09-12T00:04:39.704 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057881649999999996, 2024-09-12T00:04:39.704 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.705 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.705 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.705 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.705 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.705 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.706 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 669 2024-09-12T00:04:39.706 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.706 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.706 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.706 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.707 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607439+0000", 2024-09-12T00:04:39.707 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.707 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.707 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.707 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607439+0000", 2024-09-12T00:04:39.708 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.708 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.708 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.708 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607439+0000", 2024-09-12T00:04:39.708 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9599999999999998e-07 2024-09-12T00:04:39.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607443+0000", 2024-09-12T00:04:39.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0340000000000001e-06 2024-09-12T00:04:39.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607453+0000", 2024-09-12T00:04:39.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682999999999999e-05 2024-09-12T00:04:39.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.710 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.710 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.710 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607461+0000", 2024-09-12T00:04:39.710 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6860000000000006e-06 2024-09-12T00:04:39.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.710 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.710 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.710 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607927+0000", 2024-09-12T00:04:39.710 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00046655600000000002 2024-09-12T00:04:39.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.710 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.710 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.710 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608017+0000", 2024-09-12T00:04:39.710 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9788000000000002e-05 2024-09-12T00:04:39.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.711 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.711 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:39.711 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608262+0000", 2024-09-12T00:04:39.711 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024518499999999998 2024-09-12T00:04:39.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.711 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.711 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.711 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612908+0000", 2024-09-12T00:04:39.711 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046458009999999998 2024-09-12T00:04:39.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.711 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.711 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.711 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.613137+0000", 2024-09-12T00:04:39.711 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022881999999999999 2024-09-12T00:04:39.712 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.712 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.712 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.712 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.613178+0000", 2024-09-12T00:04:39.712 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0496e-05 2024-09-12T00:04:39.712 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.712 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.712 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.712 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.613227+0000", 2024-09-12T00:04:39.712 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9320000000000002e-05 2024-09-12T00:04:39.712 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.712 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.712 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.713 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.713 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.713 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:670 6.8 6:10010070:lc::lc.29:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:39.713 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.607563+0000", 2024-09-12T00:04:39.713 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 65.006543114999999, 2024-09-12T00:04:39.713 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054159179999999996, 2024-09-12T00:04:39.713 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.713 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.713 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.713 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.713 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.713 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.713 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 670 2024-09-12T00:04:39.713 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.714 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.714 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.714 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.714 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607563+0000", 2024-09-12T00:04:39.714 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.714 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.714 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.714 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.714 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607563+0000", 2024-09-12T00:04:39.714 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.714 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.714 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.714 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.714 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607564+0000", 2024-09-12T00:04:39.715 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.181e-06 2024-09-12T00:04:39.715 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.715 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.715 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.715 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607570+0000", 2024-09-12T00:04:39.715 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0809999999999999e-06 2024-09-12T00:04:39.715 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.715 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.715 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.715 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607582+0000", 2024-09-12T00:04:39.715 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1924e-05 2024-09-12T00:04:39.715 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.715 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.715 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.716 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607590+0000", 2024-09-12T00:04:39.716 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1370000000000002e-06 2024-09-12T00:04:39.716 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.716 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.716 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.716 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607669+0000", 2024-09-12T00:04:39.716 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8792e-05 2024-09-12T00:04:39.716 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.716 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.716 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.716 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607751+0000", 2024-09-12T00:04:39.716 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1641e-05 2024-09-12T00:04:39.716 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.717 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.717 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:39.717 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607915+0000", 2024-09-12T00:04:39.717 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000163979 2024-09-12T00:04:39.717 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.717 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.717 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.717 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.609266+0000", 2024-09-12T00:04:39.717 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0013514810000000001 2024-09-12T00:04:39.718 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.718 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.718 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.718 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612885+0000", 2024-09-12T00:04:39.718 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003618834 2024-09-12T00:04:39.718 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.718 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.718 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.718 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612941+0000", 2024-09-12T00:04:39.718 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5815e-05 2024-09-12T00:04:39.718 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.718 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.719 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.719 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612979+0000", 2024-09-12T00:04:39.719 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8053000000000003e-05 2024-09-12T00:04:39.719 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.719 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.719 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.719 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.719 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.719 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:925 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:39.719 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.697503+0000", 2024-09-12T00:04:39.719 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 64.916602652999998, 2024-09-12T00:04:39.719 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.006503755, 2024-09-12T00:04:39.720 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.720 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.720 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.720 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.720 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.720 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.720 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 925 2024-09-12T00:04:39.720 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.720 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.720 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.720 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.720 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697503+0000", 2024-09-12T00:04:39.720 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.720 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.721 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.721 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.721 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697503+0000", 2024-09-12T00:04:39.721 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.721 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.721 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.721 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.721 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697505+0000", 2024-09-12T00:04:39.721 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5030000000000001e-06 2024-09-12T00:04:39.721 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.721 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.721 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.721 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697512+0000", 2024-09-12T00:04:39.721 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7630000000000003e-06 2024-09-12T00:04:39.722 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.722 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.722 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.722 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697529+0000", 2024-09-12T00:04:39.722 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7345000000000001e-05 2024-09-12T00:04:39.722 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.722 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.722 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.722 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697539+0000", 2024-09-12T00:04:39.722 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0412e-05 2024-09-12T00:04:39.722 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.723 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.723 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.723 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697606+0000", 2024-09-12T00:04:39.723 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6531000000000004e-05 2024-09-12T00:04:39.723 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.723 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.723 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.723 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697673+0000", 2024-09-12T00:04:39.723 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6661000000000004e-05 2024-09-12T00:04:39.723 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.723 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.723 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:39.723 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697839+0000", 2024-09-12T00:04:39.723 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016669699999999999 2024-09-12T00:04:39.724 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.724 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.724 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.724 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.700786+0000", 2024-09-12T00:04:39.724 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029466819999999999 2024-09-12T00:04:39.724 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.724 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.724 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.724 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703889+0000", 2024-09-12T00:04:39.724 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0031034830000000002 2024-09-12T00:04:39.724 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.724 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.724 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.725 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703961+0000", 2024-09-12T00:04:39.725 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1178000000000002e-05 2024-09-12T00:04:39.725 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.725 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.725 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.725 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704007+0000", 2024-09-12T00:04:39.725 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6499999999999999e-05 2024-09-12T00:04:39.725 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.725 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.725 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.725 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.726 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.726 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1641 3.26 e58/23 3:658fe58e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2__shadow_.hDHTDpIswwqRA2bHiHVxkhWqZde6XEj_1:head v 58'1, mlcod=0'0)", 2024-09-12T00:04:39.726 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:04:39.726 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 6.5550907699999996, 2024-09-12T00:04:39.726 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014950144, 2024-09-12T00:04:39.726 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.726 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.726 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.726 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.726 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.726 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:04:39.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:04:39.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059017+0000", 2024-09-12T00:04:39.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.508e-06 2024-09-12T00:04:39.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.728 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.728 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061582+0000", 2024-09-12T00:04:39.728 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025654010000000001 2024-09-12T00:04:39.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.728 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.728 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061607+0000", 2024-09-12T00:04:39.728 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5028000000000002e-05 2024-09-12T00:04:39.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.728 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.728 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061619+0000", 2024-09-12T00:04:39.728 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1905999999999999e-05 2024-09-12T00:04:39.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.729 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.729 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.729 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061696+0000", 2024-09-12T00:04:39.729 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7305999999999995e-05 2024-09-12T00:04:39.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.729 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.729 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.729 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061717+0000", 2024-09-12T00:04:39.729 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0380000000000001e-05 2024-09-12T00:04:39.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.729 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.729 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.729 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073925+0000", 2024-09-12T00:04:39.730 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012208088000000001 2024-09-12T00:04:39.730 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.730 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.730 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.730 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073965+0000", 2024-09-12T00:04:39.730 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0527e-05 2024-09-12T00:04:39.730 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.730 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.730 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.730 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.730 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.730 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1775 3.30 3:0c2ae78d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:39.730 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:04:39.730 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.6152534520000001, 2024-09-12T00:04:39.731 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020783729000000001, 2024-09-12T00:04:39.731 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.731 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.731 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.731 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:39.731 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:39.731 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:39.731 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1775 2024-09-12T00:04:39.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.731 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.731 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.731 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.731 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:04:39.732 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.732 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:04:39.732 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.732 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998856+0000", 2024-09-12T00:04:39.732 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6849999999999999e-06 2024-09-12T00:04:39.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.733 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001327+0000", 2024-09-12T00:04:39.733 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024706279999999999 2024-09-12T00:04:39.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.733 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.733 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001355+0000", 2024-09-12T00:04:39.733 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8419999999999999e-05 2024-09-12T00:04:39.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.733 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.733 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001366+0000", 2024-09-12T00:04:39.733 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1073999999999999e-05 2024-09-12T00:04:39.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.734 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.734 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001438+0000", 2024-09-12T00:04:39.734 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1389000000000004e-05 2024-09-12T00:04:39.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.734 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.734 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.734 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001548+0000", 2024-09-12T00:04:39.734 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110612 2024-09-12T00:04:39.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.734 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.734 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:39.734 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001639+0000", 2024-09-12T00:04:39.734 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0192999999999995e-05 2024-09-12T00:04:39.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:39.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019057+0000", 2024-09-12T00:04:39.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017418411000000002 2024-09-12T00:04:39.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:39.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019528+0000", 2024-09-12T00:04:39.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00047075699999999998 2024-09-12T00:04:39.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019577+0000", 2024-09-12T00:04:39.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8714999999999997e-05 2024-09-12T00:04:39.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.736 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.736 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019636+0000", 2024-09-12T00:04:39.736 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9845e-05 2024-09-12T00:04:39.736 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.736 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.736 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.736 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1780 3.16 e58/23 3:69d8ee52:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3_10Mb.:head v 58'1, mlcod=0'0)", 2024-09-12T00:04:39.736 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:04:39.736 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.5889601600000001, 2024-09-12T00:04:39.737 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01408911, 2024-09-12T00:04:39.737 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.737 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.737 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.737 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.737 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.737 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:04:39.737 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.737 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.737 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:04:39.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.738 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025148+0000", 2024-09-12T00:04:39.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4229999999999999e-06 2024-09-12T00:04:39.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.738 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026337+0000", 2024-09-12T00:04:39.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011890589999999999 2024-09-12T00:04:39.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.738 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026362+0000", 2024-09-12T00:04:39.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4566000000000002e-05 2024-09-12T00:04:39.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.739 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026372+0000", 2024-09-12T00:04:39.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8509999999999994e-06 2024-09-12T00:04:39.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.739 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026448+0000", 2024-09-12T00:04:39.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6626999999999997e-05 2024-09-12T00:04:39.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.740 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.740 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026473+0000", 2024-09-12T00:04:39.740 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4647e-05 2024-09-12T00:04:39.740 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.740 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.740 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.740 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039120+0000", 2024-09-12T00:04:39.740 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012647122 2024-09-12T00:04:39.740 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.740 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.740 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.740 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039235+0000", 2024-09-12T00:04:39.740 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000114815 2024-09-12T00:04:39.740 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.741 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.741 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.741 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1912 3.16 e59/23 3:6a08f78f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.4__shadow_.EKM6BwfpK8ZqXIKQk7k4yJFkOWS2UlN_1:head v 59'3, mlcod=58'1)", 2024-09-12T00:04:39.741 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:35.141491+0000", 2024-09-12T00:04:39.741 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.4726150359999997, 2024-09-12T00:04:39.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012877679, 2024-09-12T00:04:39.741 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:39.741 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:39.741 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:39.741 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:39.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:39.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141491+0000", 2024-09-12T00:04:39.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:39.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141491+0000", 2024-09-12T00:04:39.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:39.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:39.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141493+0000", 2024-09-12T00:04:39.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2539999999999999e-06 2024-09-12T00:04:39.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.743 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:39.743 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.143346+0000", 2024-09-12T00:04:39.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0018525 2024-09-12T00:04:39.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.743 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:39.743 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.143365+0000", 2024-09-12T00:04:39.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9173000000000001e-05 2024-09-12T00:04:39.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.743 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:39.743 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.143377+0000", 2024-09-12T00:04:39.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1824999999999999e-05 2024-09-12T00:04:39.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.744 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:39.744 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.143454+0000", 2024-09-12T00:04:39.744 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7100000000000004e-05 2024-09-12T00:04:39.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.744 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:39.744 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.143481+0000", 2024-09-12T00:04:39.744 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6849e-05 2024-09-12T00:04:39.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.744 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:39.744 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154309+0000", 2024-09-12T00:04:39.745 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010827922 2024-09-12T00:04:39.745 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:39.745 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:39.745 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:39.745 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154369+0000", 2024-09-12T00:04:39.745 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0056000000000002e-05 2024-09-12T00:04:39.746 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.746 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.746 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.746 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:39.746 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:39.746 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:39.748 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:04:39.749 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:39.746+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:39.849 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:39.846+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:39.881 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:39.881 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:04:39.881 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:04:39.882 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:39.883 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:04:39.895 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:04:39.982 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:39.982+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:40.029 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:40.030 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:40.047 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:40.047 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:40.050 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:40.052+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:40.061 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:40.061 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:04:40.061 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:04:40.061 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:04:40.061 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:40.065 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:40.065 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:40.075 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:04:40.082 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:40.082 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:40.099 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:40.100 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:40.120 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:40.121 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:40.138 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:40.138 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:40.151 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:40.152+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:40.158 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:40.158 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:40.242 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:40.242 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:40.253 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:40.252+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:40.257 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:04:40.353 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:40.354+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:40.382 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:40.382 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:40.396 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:04:40.482 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:40.482+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:40.510 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T00:04:40.555 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:40.554+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:40.563 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:40.563 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:40.577 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:04:40.656 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:40.656+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:40.745 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:40.746 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:40.758 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:40.758+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:40.759 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:04:40.858 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:40.858+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:40.922 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:40.923 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:40.940 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:04:40.959 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:40.960+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:41.060 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:41.060+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:41.100 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:41.100 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:41.114 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:04:41.162 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:41.162+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:41.235 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:41.235 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:41.249 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:04:41.294 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:41.294+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:41.363 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:41.364+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:41.413 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:41.413 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:41.427 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:04:41.473 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:41.474+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:41.548 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:41.548 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:41.562 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:04:41.606 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:41.606+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:41.666 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:41.666+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:41.727 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:41.727 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:41.742 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:04:41.785 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:41.788+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:41.865 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:41.866 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:41.868 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:41.866+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:41.879 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:04:41.969 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:41.972+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:42.044 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:42.045 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:42.058 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:04:42.101 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:42.104+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:42.172 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:42.174+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:42.175 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:04:42.216 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:42.216 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:42.229 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:04:42.273 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:42.274+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:42.314 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:42.314 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:42.331 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:42.331 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:42.347 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:42.347 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:42.364 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:42.364 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:42.374 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:42.376+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:42.385 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:42.385 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:42.387 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:42.387 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:42.387 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:42.387 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:42.401 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:04:42.406 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:42.407 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:42.428 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:42.428 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:42.449 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:42.449 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:42.479 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:42.478+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:42.480 INFO:tasks.workunit.client.0.smithi019.stdout:quota enabled for the bucket: buck_2024_08_12_00_04_38 2024-09-12T00:04:42.480 INFO:tasks.workunit.client.0.smithi019.stdout:adding file to bucket: 2Gb. 2024-09-12T00:04:42.480 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:04:42.480 INFO:tasks.workunit.client.0.smithi019.stdout:Test case: PASSED - set max size and ensure that objects upload beyond max size is not entertained 2024-09-12T00:04:42.480 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:04:42.481 INFO:tasks.workunit.client.0.smithi019.stdout:delete objects successful 2024-09-12T00:04:42.524 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:42.524 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:42.525 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:42.525 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:42.525 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:42.529 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T00:04:42.543 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:04:42.586 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:42.588+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:42.681 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:42.684+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:42.706 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:42.706 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:42.706 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:42.706 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:42.706 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.706 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:42.706 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 91.213696657, 2024-09-12T00:04:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.278479906, 2024-09-12T00:04:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:04:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.708 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:42.708 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:42.708 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493422+0000", 2024-09-12T00:04:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.807e-06 2024-09-12T00:04:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493435+0000", 2024-09-12T00:04:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.375e-05 2024-09-12T00:04:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493457+0000", 2024-09-12T00:04:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2166000000000001e-05 2024-09-12T00:04:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493475+0000", 2024-09-12T00:04:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7184e-05 2024-09-12T00:04:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493617+0000", 2024-09-12T00:04:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014274200000000001 2024-09-12T00:04:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493632+0000", 2024-09-12T00:04:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4293e-05 2024-09-12T00:04:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.768657+0000", 2024-09-12T00:04:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.27502575400000001 2024-09-12T00:04:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769042+0000", 2024-09-12T00:04:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00038463700000000001 2024-09-12T00:04:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769430+0000", 2024-09-12T00:04:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000388014 2024-09-12T00:04:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.770784+0000", 2024-09-12T00:04:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00135402 2024-09-12T00:04:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771735+0000", 2024-09-12T00:04:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00095068599999999996 2024-09-12T00:04:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771828+0000", 2024-09-12T00:04:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3468999999999996e-05 2024-09-12T00:04:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771899+0000", 2024-09-12T00:04:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0383999999999996e-05 2024-09-12T00:04:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 90.785369935999995, 2024-09-12T00:04:42.716 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013456684999999999, 2024-09-12T00:04:42.716 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:42.716 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:42.716 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:42.716 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:42.716 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:42.716 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:42.716 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 45 2024-09-12T00:04:42.717 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.717 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:42.717 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.717 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:42.717 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:42.717 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.717 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.718 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.718 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:42.718 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921745+0000", 2024-09-12T00:04:42.718 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.718 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.718 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.719 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:42.719 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921746+0000", 2024-09-12T00:04:42.719 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9800000000000003e-07 2024-09-12T00:04:42.719 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.719 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.721 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:42.721 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921751+0000", 2024-09-12T00:04:42.721 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7099999999999998e-06 2024-09-12T00:04:42.721 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.721 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.721 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:42.721 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921766+0000", 2024-09-12T00:04:42.721 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5633000000000001e-05 2024-09-12T00:04:42.721 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.721 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.721 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:42.721 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921786+0000", 2024-09-12T00:04:42.721 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9658000000000001e-05 2024-09-12T00:04:42.722 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.722 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.722 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:42.722 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929539+0000", 2024-09-12T00:04:42.722 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0077533120000000001 2024-09-12T00:04:42.722 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.722 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.722 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:42.722 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929706+0000", 2024-09-12T00:04:42.722 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016664199999999999 2024-09-12T00:04:42.722 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.722 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.722 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:42.723 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.929933+0000", 2024-09-12T00:04:42.723 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000226658 2024-09-12T00:04:42.723 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.723 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.723 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:42.723 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.934721+0000", 2024-09-12T00:04:42.723 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047886439999999999 2024-09-12T00:04:42.723 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.723 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.723 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:42.723 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935062+0000", 2024-09-12T00:04:42.723 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00034072399999999999 2024-09-12T00:04:42.723 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.723 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.724 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:42.724 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935141+0000", 2024-09-12T00:04:42.724 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8570000000000002e-05 2024-09-12T00:04:42.724 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.724 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.724 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:42.724 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935202+0000", 2024-09-12T00:04:42.724 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1536000000000002e-05 2024-09-12T00:04:42.724 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.724 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:42.724 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.724 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.724 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.725 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:42.725 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:42.725 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 90.785319704000003, 2024-09-12T00:04:42.725 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014633617, 2024-09-12T00:04:42.725 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:42.725 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:42.725 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:42.725 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:42.726 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:42.726 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:42.726 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:04:42.726 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.726 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:42.726 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.726 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:42.726 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:42.726 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.726 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.726 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.726 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:42.726 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:42.726 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:42.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921796+0000", 2024-09-12T00:04:42.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3599999999999999e-07 2024-09-12T00:04:42.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:42.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921800+0000", 2024-09-12T00:04:42.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3850000000000002e-06 2024-09-12T00:04:42.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:42.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921805+0000", 2024-09-12T00:04:42.728 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9460000000000003e-06 2024-09-12T00:04:42.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.728 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:42.728 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921819+0000", 2024-09-12T00:04:42.728 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.325e-05 2024-09-12T00:04:42.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.728 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:42.728 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930627+0000", 2024-09-12T00:04:42.728 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00880827 2024-09-12T00:04:42.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.729 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:42.729 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.930805+0000", 2024-09-12T00:04:42.729 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000177992 2024-09-12T00:04:42.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.729 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.729 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:42.729 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.931028+0000", 2024-09-12T00:04:42.729 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000223122 2024-09-12T00:04:42.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.729 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.729 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:42.729 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935258+0000", 2024-09-12T00:04:42.729 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0042302709999999999 2024-09-12T00:04:42.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.730 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.730 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:42.730 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936282+0000", 2024-09-12T00:04:42.730 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00102345 2024-09-12T00:04:42.730 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.730 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.730 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:42.730 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936367+0000", 2024-09-12T00:04:42.730 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4869000000000003e-05 2024-09-12T00:04:42.730 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.730 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.730 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:42.730 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936429+0000", 2024-09-12T00:04:42.731 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2626000000000007e-05 2024-09-12T00:04:42.731 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.731 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:42.731 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.731 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.731 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:42.731 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:42.731 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 90.785283453999995, 2024-09-12T00:04:42.731 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016022492999999999, 2024-09-12T00:04:42.731 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:42.731 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:42.731 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:42.731 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:42.732 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:42.732 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:42.732 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:04:42.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.732 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:42.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:42.732 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:42.732 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:42.732 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:42.732 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.733 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:42.733 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:42.733 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4000000000000002e-07 2024-09-12T00:04:42.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.733 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:42.733 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921891+0000", 2024-09-12T00:04:42.734 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8298000000000003e-05 2024-09-12T00:04:42.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.734 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.734 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:42.734 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921899+0000", 2024-09-12T00:04:42.734 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7059999999999993e-06 2024-09-12T00:04:42.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.734 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.734 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:42.734 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921904+0000", 2024-09-12T00:04:42.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9799999999999998e-06 2024-09-12T00:04:42.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:42.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932144+0000", 2024-09-12T00:04:42.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010239817999999999 2024-09-12T00:04:42.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:42.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932284+0000", 2024-09-12T00:04:42.736 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139436 2024-09-12T00:04:42.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.736 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:42.736 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932498+0000", 2024-09-12T00:04:42.736 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000214408 2024-09-12T00:04:42.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.736 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:42.736 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936444+0000", 2024-09-12T00:04:42.736 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039464169999999998 2024-09-12T00:04:42.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:42.737 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937702+0000", 2024-09-12T00:04:42.737 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012571679999999999 2024-09-12T00:04:42.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.737 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:42.737 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937793+0000", 2024-09-12T00:04:42.737 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1489000000000004e-05 2024-09-12T00:04:42.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.737 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:42.737 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937854+0000", 2024-09-12T00:04:42.737 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1333000000000004e-05 2024-09-12T00:04:42.737 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.738 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:42.738 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.738 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:42.738 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:42.738 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 90.785201585999999, 2024-09-12T00:04:42.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017189138999999999, 2024-09-12T00:04:42.738 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:42.738 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:42.738 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:42.738 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:42.738 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:42.738 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:42.739 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 48 2024-09-12T00:04:42.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.739 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:42.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.739 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:42.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:42.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.739 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:42.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:42.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.740 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.740 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:42.740 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:42.740 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7399999999999998e-07 2024-09-12T00:04:42.740 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.740 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.740 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:42.740 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921918+0000", 2024-09-12T00:04:42.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6399999999999999e-06 2024-09-12T00:04:42.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:42.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921925+0000", 2024-09-12T00:04:42.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7190000000000004e-06 2024-09-12T00:04:42.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:42.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921931+0000", 2024-09-12T00:04:42.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2519999999999996e-06 2024-09-12T00:04:42.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:42.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933475+0000", 2024-09-12T00:04:42.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011543759000000001 2024-09-12T00:04:42.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:42.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933617+0000", 2024-09-12T00:04:42.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000142282 2024-09-12T00:04:42.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:42.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933860+0000", 2024-09-12T00:04:42.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024276199999999999 2024-09-12T00:04:42.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.743 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:42.743 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937933+0000", 2024-09-12T00:04:42.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040734680000000002 2024-09-12T00:04:42.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.743 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:42.743 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938955+0000", 2024-09-12T00:04:42.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001021987 2024-09-12T00:04:42.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.744 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:42.744 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939038+0000", 2024-09-12T00:04:42.744 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2449999999999998e-05 2024-09-12T00:04:42.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.744 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:42.744 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939103+0000", 2024-09-12T00:04:42.744 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5345999999999994e-05 2024-09-12T00:04:42.744 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.744 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:42.744 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.745 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:42.745 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:42.745 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 90.785176043999996, 2024-09-12T00:04:42.745 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018247975, 2024-09-12T00:04:42.745 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:42.745 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:42.745 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:42.745 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:42.745 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:42.745 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:42.745 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 49 2024-09-12T00:04:42.745 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.745 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:42.746 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.746 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:42.746 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:42.746 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.746 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.746 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:42.746 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:42.746 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:42.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921940+0000", 2024-09-12T00:04:42.747 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7e-07 2024-09-12T00:04:42.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:42.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921943+0000", 2024-09-12T00:04:42.747 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1889999999999999e-06 2024-09-12T00:04:42.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:42.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921952+0000", 2024-09-12T00:04:42.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0010000000000007e-06 2024-09-12T00:04:42.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:42.748 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921959+0000", 2024-09-12T00:04:42.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2570000000000001e-06 2024-09-12T00:04:42.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:42.748 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935333+0000", 2024-09-12T00:04:42.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013373368 2024-09-12T00:04:42.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:42.749 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935472+0000", 2024-09-12T00:04:42.749 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013987900000000001 2024-09-12T00:04:42.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.749 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.749 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:42.749 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935700+0000", 2024-09-12T00:04:42.749 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000227922 2024-09-12T00:04:42.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.749 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.749 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:42.749 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939858+0000", 2024-09-12T00:04:42.749 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041571300000000002 2024-09-12T00:04:42.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.749 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.750 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:42.750 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940018+0000", 2024-09-12T00:04:42.750 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016060400000000001 2024-09-12T00:04:42.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.750 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:42.750 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940114+0000", 2024-09-12T00:04:42.750 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5692999999999993e-05 2024-09-12T00:04:42.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.750 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:42.750 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940187+0000", 2024-09-12T00:04:42.750 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3561999999999998e-05 2024-09-12T00:04:42.750 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.751 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:42.751 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.751 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.751 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.751 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:42.751 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:42.751 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 90.785133256999998, 2024-09-12T00:04:42.751 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021018614000000001, 2024-09-12T00:04:42.751 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:42.751 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:42.751 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:42.751 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:42.751 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:42.751 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:42.752 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 50 2024-09-12T00:04:42.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.752 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:42.752 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.752 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:42.752 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:42.752 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.752 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.752 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:42.752 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:42.752 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.752 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:42.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921983+0000", 2024-09-12T00:04:42.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4499999999999996e-07 2024-09-12T00:04:42.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:42.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922071+0000", 2024-09-12T00:04:42.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8010000000000006e-05 2024-09-12T00:04:42.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:42.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922084+0000", 2024-09-12T00:04:42.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3275000000000001e-05 2024-09-12T00:04:42.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.754 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:42.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922093+0000", 2024-09-12T00:04:42.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0580000000000004e-06 2024-09-12T00:04:42.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.754 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:42.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936515+0000", 2024-09-12T00:04:42.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014421270999999999 2024-09-12T00:04:42.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.754 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:42.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936677+0000", 2024-09-12T00:04:42.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162003 2024-09-12T00:04:42.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.755 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.755 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:42.755 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936908+0000", 2024-09-12T00:04:42.755 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023115700000000001 2024-09-12T00:04:42.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.755 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.755 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:42.755 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939985+0000", 2024-09-12T00:04:42.755 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030773879999999999 2024-09-12T00:04:42.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.755 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.755 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:42.755 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942623+0000", 2024-09-12T00:04:42.756 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026377929999999998 2024-09-12T00:04:42.756 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.756 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.756 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:42.756 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942818+0000", 2024-09-12T00:04:42.756 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019556200000000001 2024-09-12T00:04:42.756 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.756 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.757 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:42.757 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943001+0000", 2024-09-12T00:04:42.757 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018235199999999999 2024-09-12T00:04:42.757 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.757 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:42.757 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.757 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.757 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.757 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:42.757 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:42.757 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 90.784998865000006, 2024-09-12T00:04:42.757 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021092493, 2024-09-12T00:04:42.757 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:42.757 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 51 2024-09-12T00:04:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.759 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:42.759 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:42.759 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.759 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.759 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:42.759 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922118+0000", 2024-09-12T00:04:42.759 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0389999999999999e-06 2024-09-12T00:04:42.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.760 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.761 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:42.761 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922124+0000", 2024-09-12T00:04:42.761 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5409999999999997e-06 2024-09-12T00:04:42.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.761 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.761 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:42.761 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922136+0000", 2024-09-12T00:04:42.761 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.205e-05 2024-09-12T00:04:42.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.761 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.761 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:42.761 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922147+0000", 2024-09-12T00:04:42.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0451e-05 2024-09-12T00:04:42.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.762 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.762 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:42.762 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938000+0000", 2024-09-12T00:04:42.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015853682000000001 2024-09-12T00:04:42.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.762 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.762 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:42.763 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938142+0000", 2024-09-12T00:04:42.763 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014148899999999999 2024-09-12T00:04:42.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.763 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:42.763 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938362+0000", 2024-09-12T00:04:42.763 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022034800000000001 2024-09-12T00:04:42.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.763 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:42.763 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940330+0000", 2024-09-12T00:04:42.763 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001967459 2024-09-12T00:04:42.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.764 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:42.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943064+0000", 2024-09-12T00:04:42.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027346219999999999 2024-09-12T00:04:42.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.764 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:42.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943152+0000", 2024-09-12T00:04:42.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7563000000000002e-05 2024-09-12T00:04:42.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.764 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:42.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943209+0000", 2024-09-12T00:04:42.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7249e-05 2024-09-12T00:04:42.765 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.765 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:42.765 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.765 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:42.765 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:42.765 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 90.784949372, 2024-09-12T00:04:42.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021175616000000001, 2024-09-12T00:04:42.765 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:42.765 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:42.765 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:42.766 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:42.766 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:42.766 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:42.766 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 52 2024-09-12T00:04:42.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.766 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:42.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.766 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:42.766 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:42.766 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.766 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:42.766 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:42.767 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.767 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:42.767 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922167+0000", 2024-09-12T00:04:42.767 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3300000000000001e-07 2024-09-12T00:04:42.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.767 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:42.767 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922174+0000", 2024-09-12T00:04:42.767 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7070000000000003e-06 2024-09-12T00:04:42.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:42.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922184+0000", 2024-09-12T00:04:42.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682e-05 2024-09-12T00:04:42.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:42.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922195+0000", 2024-09-12T00:04:42.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0489000000000001e-05 2024-09-12T00:04:42.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:42.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939166+0000", 2024-09-12T00:04:42.769 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016971245999999999 2024-09-12T00:04:42.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.769 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.769 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:42.769 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939243+0000", 2024-09-12T00:04:42.769 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7201999999999997e-05 2024-09-12T00:04:42.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.769 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.769 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:42.769 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939381+0000", 2024-09-12T00:04:42.769 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013770699999999999 2024-09-12T00:04:42.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:42.770 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940923+0000", 2024-09-12T00:04:42.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001542302 2024-09-12T00:04:42.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:42.770 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943221+0000", 2024-09-12T00:04:42.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022979720000000001 2024-09-12T00:04:42.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:42.770 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943295+0000", 2024-09-12T00:04:42.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3317000000000003e-05 2024-09-12T00:04:42.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.771 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:42.771 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943342+0000", 2024-09-12T00:04:42.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7159e-05 2024-09-12T00:04:42.771 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.771 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:42.771 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.771 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:42.771 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:42.771 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 90.536004406000004, 2024-09-12T00:04:42.772 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015229411999999999, 2024-09-12T00:04:42.772 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:42.772 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:42.772 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:42.772 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:42.772 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:42.772 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:42.772 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 67 2024-09-12T00:04:42.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.772 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:42.772 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.772 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:42.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:42.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.773 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:42.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:42.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.773 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:42.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171112+0000", 2024-09-12T00:04:42.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2899999999999999e-06 2024-09-12T00:04:42.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.774 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:42.774 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171119+0000", 2024-09-12T00:04:42.774 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8870000000000003e-06 2024-09-12T00:04:42.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.774 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:42.774 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171131+0000", 2024-09-12T00:04:42.774 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1902999999999999e-05 2024-09-12T00:04:42.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.774 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:42.775 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171147+0000", 2024-09-12T00:04:42.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6203000000000001e-05 2024-09-12T00:04:42.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.775 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.775 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:42.775 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175044+0000", 2024-09-12T00:04:42.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038967310000000001 2024-09-12T00:04:42.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.775 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.775 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:42.775 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175172+0000", 2024-09-12T00:04:42.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012784100000000001 2024-09-12T00:04:42.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:42.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175372+0000", 2024-09-12T00:04:42.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019978500000000001 2024-09-12T00:04:42.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:42.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179276+0000", 2024-09-12T00:04:42.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039042149999999999 2024-09-12T00:04:42.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:42.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186150+0000", 2024-09-12T00:04:42.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0068740019999999997 2024-09-12T00:04:42.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:42.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186266+0000", 2024-09-12T00:04:42.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115742 2024-09-12T00:04:42.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:42.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186340+0000", 2024-09-12T00:04:42.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4813000000000004e-05 2024-09-12T00:04:42.777 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.777 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:42.778 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.778 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:42.778 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:42.778 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 90.535943329999995, 2024-09-12T00:04:42.778 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015308448000000001, 2024-09-12T00:04:42.778 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:42.778 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:42.778 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:42.778 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:42.778 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:42.778 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:42.778 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 68 2024-09-12T00:04:42.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.779 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:42.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:42.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:42.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:42.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:42.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:42.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171173+0000", 2024-09-12T00:04:42.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:04:42.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:42.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171182+0000", 2024-09-12T00:04:42.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2359999999999993e-06 2024-09-12T00:04:42.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:42.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171193+0000", 2024-09-12T00:04:42.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.095e-05 2024-09-12T00:04:42.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.781 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:42.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171207+0000", 2024-09-12T00:04:42.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3339999999999999e-05 2024-09-12T00:04:42.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.781 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:42.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176753+0000", 2024-09-12T00:04:42.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055460240000000001 2024-09-12T00:04:42.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.781 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:42.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176921+0000", 2024-09-12T00:04:42.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000168503 2024-09-12T00:04:42.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.782 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:42.782 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177112+0000", 2024-09-12T00:04:42.782 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019113999999999999 2024-09-12T00:04:42.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.782 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:42.782 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179382+0000", 2024-09-12T00:04:42.782 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022697099999999999 2024-09-12T00:04:42.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.782 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:42.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186356+0000", 2024-09-12T00:04:42.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069741919999999997 2024-09-12T00:04:42.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:42.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186422+0000", 2024-09-12T00:04:42.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6387e-05 2024-09-12T00:04:42.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:42.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186481+0000", 2024-09-12T00:04:42.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8059000000000001e-05 2024-09-12T00:04:42.783 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.783 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:42.784 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.784 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:42.784 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:42.784 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 90.535891559999996, 2024-09-12T00:04:42.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020001835999999999, 2024-09-12T00:04:42.784 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:42.784 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:42.784 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:42.784 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:42.784 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:42.784 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:42.785 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 69 2024-09-12T00:04:42.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.785 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:42.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:42.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:42.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:42.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:42.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.786 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:42.786 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171225+0000", 2024-09-12T00:04:42.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0599999999999999e-07 2024-09-12T00:04:42.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.786 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:42.786 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171349+0000", 2024-09-12T00:04:42.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012407299999999999 2024-09-12T00:04:42.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.786 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:42.786 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171367+0000", 2024-09-12T00:04:42.787 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8413000000000001e-05 2024-09-12T00:04:42.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.787 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.787 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:42.787 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171376+0000", 2024-09-12T00:04:42.787 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8170000000000005e-06 2024-09-12T00:04:42.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.787 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.787 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:42.787 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177692+0000", 2024-09-12T00:04:42.787 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063156729999999999 2024-09-12T00:04:42.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.787 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.788 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:42.788 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177817+0000", 2024-09-12T00:04:42.788 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012581499999999999 2024-09-12T00:04:42.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.788 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:42.788 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.178015+0000", 2024-09-12T00:04:42.788 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019715100000000001 2024-09-12T00:04:42.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.788 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:42.788 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181798+0000", 2024-09-12T00:04:42.788 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003783308 2024-09-12T00:04:42.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:42.789 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190976+0000", 2024-09-12T00:04:42.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091776519999999997 2024-09-12T00:04:42.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:42.789 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191122+0000", 2024-09-12T00:04:42.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000145966 2024-09-12T00:04:42.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:42.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191226+0000", 2024-09-12T00:04:42.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104162 2024-09-12T00:04:42.790 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.790 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:42.790 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.790 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:42.790 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:42.790 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 90.535722824999993, 2024-09-12T00:04:42.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019997773, 2024-09-12T00:04:42.790 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:42.790 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:42.791 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:42.791 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:42.791 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:42.791 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:42.791 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 70 2024-09-12T00:04:42.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.791 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:42.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:42.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:42.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:42.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:42.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:42.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:42.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3699999999999999e-07 2024-09-12T00:04:42.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:42.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171403+0000", 2024-09-12T00:04:42.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6199999999999994e-06 2024-09-12T00:04:42.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.793 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.793 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:42.793 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171416+0000", 2024-09-12T00:04:42.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2636000000000001e-05 2024-09-12T00:04:42.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.793 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.793 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:42.793 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171423+0000", 2024-09-12T00:04:42.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5440000000000001e-06 2024-09-12T00:04:42.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.793 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:42.794 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179458+0000", 2024-09-12T00:04:42.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080351989999999998 2024-09-12T00:04:42.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:42.794 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179604+0000", 2024-09-12T00:04:42.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014519899999999999 2024-09-12T00:04:42.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:42.794 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179831+0000", 2024-09-12T00:04:42.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022704800000000001 2024-09-12T00:04:42.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:42.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181918+0000", 2024-09-12T00:04:42.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020873950000000001 2024-09-12T00:04:42.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:42.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191243+0000", 2024-09-12T00:04:42.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0093244729999999998 2024-09-12T00:04:42.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:42.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191309+0000", 2024-09-12T00:04:42.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6116000000000002e-05 2024-09-12T00:04:42.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:42.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191390+0000", 2024-09-12T00:04:42.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1705999999999993e-05 2024-09-12T00:04:42.796 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.796 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:42.796 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.796 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:42.796 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:42.796 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 90.535676752000001, 2024-09-12T00:04:42.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020263554, 2024-09-12T00:04:42.797 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:42.797 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:42.797 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:42.797 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:42.797 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:42.797 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:42.797 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 71 2024-09-12T00:04:42.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.797 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:42.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:42.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:42.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:42.798 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:42.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:42.798 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:42.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5000000000000002e-07 2024-09-12T00:04:42.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:42.799 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171454+0000", 2024-09-12T00:04:42.799 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5046e-05 2024-09-12T00:04:42.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.799 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:42.799 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171471+0000", 2024-09-12T00:04:42.799 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6923999999999999e-05 2024-09-12T00:04:42.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.799 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:42.799 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171487+0000", 2024-09-12T00:04:42.799 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5823000000000001e-05 2024-09-12T00:04:42.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:42.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180765+0000", 2024-09-12T00:04:42.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0092774399999999996 2024-09-12T00:04:42.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:42.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180900+0000", 2024-09-12T00:04:42.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013556700000000001 2024-09-12T00:04:42.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:42.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181108+0000", 2024-09-12T00:04:42.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020727899999999999 2024-09-12T00:04:42.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:42.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184725+0000", 2024-09-12T00:04:42.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036171340000000001 2024-09-12T00:04:42.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:42.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191413+0000", 2024-09-12T00:04:42.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066881830000000003 2024-09-12T00:04:42.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:42.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191540+0000", 2024-09-12T00:04:42.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000126823 2024-09-12T00:04:42.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:42.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191702+0000", 2024-09-12T00:04:42.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162585 2024-09-12T00:04:42.802 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.802 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:42.802 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.803 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:42.803 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:42.803 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 90.535598175999993, 2024-09-12T00:04:42.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020448573000000001, 2024-09-12T00:04:42.803 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:42.803 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:42.803 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:42.803 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:42.803 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:42.803 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:42.803 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 72 2024-09-12T00:04:42.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.804 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:42.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:42.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:42.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:42.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:42.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:42.805 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171518+0000", 2024-09-12T00:04:42.805 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0440000000000001e-06 2024-09-12T00:04:42.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.805 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.805 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:42.805 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171647+0000", 2024-09-12T00:04:42.805 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012912899999999999 2024-09-12T00:04:42.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.805 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.805 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:42.805 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171664+0000", 2024-09-12T00:04:42.805 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6079999999999999e-05 2024-09-12T00:04:42.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:42.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171675+0000", 2024-09-12T00:04:42.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1223000000000001e-05 2024-09-12T00:04:42.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:42.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182000+0000", 2024-09-12T00:04:42.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010324949 2024-09-12T00:04:42.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:42.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182178+0000", 2024-09-12T00:04:42.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017808799999999999 2024-09-12T00:04:42.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:42.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182402+0000", 2024-09-12T00:04:42.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022381199999999999 2024-09-12T00:04:42.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:42.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190935+0000", 2024-09-12T00:04:42.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085331560000000001 2024-09-12T00:04:42.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:42.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191728+0000", 2024-09-12T00:04:42.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079325700000000001 2024-09-12T00:04:42.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:42.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191864+0000", 2024-09-12T00:04:42.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013606299999999999 2024-09-12T00:04:42.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:42.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191966+0000", 2024-09-12T00:04:42.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101772 2024-09-12T00:04:42.809 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.809 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:42.809 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.809 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.809 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:42.809 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:42.809 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 90.535414981000002, 2024-09-12T00:04:42.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020675235, 2024-09-12T00:04:42.809 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:42.809 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:42.809 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:42.809 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:42.810 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:42.810 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:42.810 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 73 2024-09-12T00:04:42.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.810 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:42.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.810 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:42.810 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:42.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.810 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:42.810 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:42.811 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.811 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:42.811 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171701+0000", 2024-09-12T00:04:42.811 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0999999999999997e-07 2024-09-12T00:04:42.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.811 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:42.811 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171709+0000", 2024-09-12T00:04:42.811 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2540000000000003e-06 2024-09-12T00:04:42.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:42.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171724+0000", 2024-09-12T00:04:42.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5569e-05 2024-09-12T00:04:42.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:42.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171734+0000", 2024-09-12T00:04:42.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6139999999999998e-06 2024-09-12T00:04:42.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:42.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183774+0000", 2024-09-12T00:04:42.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012040444000000001 2024-09-12T00:04:42.813 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.813 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.813 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:42.813 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183896+0000", 2024-09-12T00:04:42.813 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012204199999999999 2024-09-12T00:04:42.813 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.813 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.813 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:42.813 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184084+0000", 2024-09-12T00:04:42.813 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018792599999999999 2024-09-12T00:04:42.813 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.813 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.813 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:42.813 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191984+0000", 2024-09-12T00:04:42.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079003790000000008 2024-09-12T00:04:42.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:42.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192093+0000", 2024-09-12T00:04:42.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000108942 2024-09-12T00:04:42.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:42.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192250+0000", 2024-09-12T00:04:42.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015637600000000001 2024-09-12T00:04:42.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:42.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192376+0000", 2024-09-12T00:04:42.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012587899999999999 2024-09-12T00:04:42.817 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.817 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:42.817 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.817 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.817 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:42.817 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:42.817 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 90.535366771, 2024-09-12T00:04:42.817 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021088828, 2024-09-12T00:04:42.817 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:42.817 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:42.818 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:42.818 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:42.818 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:42.818 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:42.818 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 74 2024-09-12T00:04:42.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.818 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:42.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.818 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:42.818 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:42.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.819 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:42.819 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:42.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.819 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:42.819 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:42.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1699999999999997e-07 2024-09-12T00:04:42.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.819 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:42.819 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171758+0000", 2024-09-12T00:04:42.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0860000000000008e-06 2024-09-12T00:04:42.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:42.820 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171774+0000", 2024-09-12T00:04:42.820 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:04:42.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:42.820 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171788+0000", 2024-09-12T00:04:42.820 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4793999999999999e-05 2024-09-12T00:04:42.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:42.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184842+0000", 2024-09-12T00:04:42.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013053607 2024-09-12T00:04:42.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:42.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185130+0000", 2024-09-12T00:04:42.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00028779199999999998 2024-09-12T00:04:42.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:42.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185378+0000", 2024-09-12T00:04:42.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024780100000000002 2024-09-12T00:04:42.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.822 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:42.822 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192513+0000", 2024-09-12T00:04:42.822 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071350770000000001 2024-09-12T00:04:42.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.822 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:42.822 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192690+0000", 2024-09-12T00:04:42.822 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000176892 2024-09-12T00:04:42.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.822 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:42.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192769+0000", 2024-09-12T00:04:42.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9466000000000001e-05 2024-09-12T00:04:42.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:42.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192837+0000", 2024-09-12T00:04:42.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8466000000000005e-05 2024-09-12T00:04:42.823 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.823 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:42.823 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.823 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:42.824 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:42.824 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 90.535314193999994, 2024-09-12T00:04:42.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.02121994, 2024-09-12T00:04:42.824 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:42.824 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:42.824 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:42.824 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:42.824 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:42.824 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:42.824 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 75 2024-09-12T00:04:42.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.824 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:42.825 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.825 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:42.825 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:42.825 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.825 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.825 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.825 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:42.825 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:42.825 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.825 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.825 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.825 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:42.825 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171802+0000", 2024-09-12T00:04:42.825 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5000000000000002e-07 2024-09-12T00:04:42.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:42.826 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171954+0000", 2024-09-12T00:04:42.826 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015215500000000001 2024-09-12T00:04:42.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:42.826 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171966+0000", 2024-09-12T00:04:42.826 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1548e-05 2024-09-12T00:04:42.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:42.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171970+0000", 2024-09-12T00:04:42.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8729999999999998e-06 2024-09-12T00:04:42.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:42.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186552+0000", 2024-09-12T00:04:42.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014581775 2024-09-12T00:04:42.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:42.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186702+0000", 2024-09-12T00:04:42.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014946 2024-09-12T00:04:42.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:42.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186897+0000", 2024-09-12T00:04:42.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000195071 2024-09-12T00:04:42.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:42.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192666+0000", 2024-09-12T00:04:42.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057693470000000002 2024-09-12T00:04:42.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:42.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192857+0000", 2024-09-12T00:04:42.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191149 2024-09-12T00:04:42.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:42.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192967+0000", 2024-09-12T00:04:42.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110202 2024-09-12T00:04:42.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:42.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193021+0000", 2024-09-12T00:04:42.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3709999999999999e-05 2024-09-12T00:04:42.829 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.829 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:42.829 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.830 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:42.830 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:42.830 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 90.535134898999999, 2024-09-12T00:04:42.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026297425999999999, 2024-09-12T00:04:42.830 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:42.830 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:42.830 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:42.830 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:42.830 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:42.830 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:42.830 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 76 2024-09-12T00:04:42.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.831 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:42.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:42.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:42.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:42.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:42.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.832 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:42.832 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:42.832 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9399999999999995e-07 2024-09-12T00:04:42.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.832 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:42.832 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171987+0000", 2024-09-12T00:04:42.832 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5230000000000003e-06 2024-09-12T00:04:42.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.832 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:42.832 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172005+0000", 2024-09-12T00:04:42.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8788e-05 2024-09-12T00:04:42.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:42.833 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172010+0000", 2024-09-12T00:04:42.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7570000000000004e-06 2024-09-12T00:04:42.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:42.833 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193104+0000", 2024-09-12T00:04:42.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021094112000000002 2024-09-12T00:04:42.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:42.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193334+0000", 2024-09-12T00:04:42.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000229855 2024-09-12T00:04:42.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:42.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193697+0000", 2024-09-12T00:04:42.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00036272399999999998 2024-09-12T00:04:42.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:42.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.195602+0000", 2024-09-12T00:04:42.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019049620000000001 2024-09-12T00:04:42.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:42.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198123+0000", 2024-09-12T00:04:42.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025216520000000001 2024-09-12T00:04:42.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:42.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198213+0000", 2024-09-12T00:04:42.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0008999999999998e-05 2024-09-12T00:04:42.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:42.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198278+0000", 2024-09-12T00:04:42.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4549999999999997e-05 2024-09-12T00:04:42.836 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.836 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:42.836 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.836 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1776 3.10 3:0ad809ca:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:42.836 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.002444+0000", 2024-09-12T00:04:42.836 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 8.7046718369999994, 2024-09-12T00:04:42.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016768360999999999, 2024-09-12T00:04:42.836 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:42.836 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:42.836 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:42.837 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:42.837 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:42.837 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:42.837 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1776 2024-09-12T00:04:42.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.837 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:42.837 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.837 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:42.837 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.002444+0000", 2024-09-12T00:04:42.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.837 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.837 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:42.837 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.002444+0000", 2024-09-12T00:04:42.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:42.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:42.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.002446+0000", 2024-09-12T00:04:42.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5830000000000001e-06 2024-09-12T00:04:42.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:42.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003441+0000", 2024-09-12T00:04:42.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00099495500000000006 2024-09-12T00:04:42.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:42.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003468+0000", 2024-09-12T00:04:42.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6514000000000001e-05 2024-09-12T00:04:42.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:42.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003481+0000", 2024-09-12T00:04:42.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3016999999999999e-05 2024-09-12T00:04:42.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:42.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003556+0000", 2024-09-12T00:04:42.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5556999999999995e-05 2024-09-12T00:04:42.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:42.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003705+0000", 2024-09-12T00:04:42.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014846799999999999 2024-09-12T00:04:42.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:42.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003828+0000", 2024-09-12T00:04:42.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000123621 2024-09-12T00:04:42.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:42.841 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.013795+0000", 2024-09-12T00:04:42.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0099663170000000006 2024-09-12T00:04:42.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.841 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.841 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:42.841 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019048+0000", 2024-09-12T00:04:42.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052537729999999998 2024-09-12T00:04:42.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.841 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.841 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:42.841 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019126+0000", 2024-09-12T00:04:42.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7224999999999993e-05 2024-09-12T00:04:42.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:42.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:42.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:42.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019212+0000", 2024-09-12T00:04:42.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6330999999999997e-05 2024-09-12T00:04:42.842 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.842 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:42.842 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.842 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:42.842 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:42.842 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:42.844 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:04:42.844 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:42.844+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:42.945 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:42.944+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:43.001 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:43.001 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:43.002 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:43.002 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:43.017 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:04:43.061 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:43.064+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:43.114 INFO:tasks.workunit.client.0.smithi019.stderr:100+0 records in 2024-09-12T00:04:43.114 INFO:tasks.workunit.client.0.smithi019.stderr:100+0 records out 2024-09-12T00:04:43.114 INFO:tasks.workunit.client.0.smithi019.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 0.631558 s, 1.7 GB/s 2024-09-12T00:04:43.147 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:43.148+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:43.216 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:43.216 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:43.217 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:43.217 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:43.217 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:43.231 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:04:43.278 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:43.280+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:43.349 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:43.352+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:43.402 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:43.403 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:43.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:43.403 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:43.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.403 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4232.0:1 2.3 e20/19 2:c4c92e5a:::rbd_trash:head v 20'1, mlcod=0'0)", 2024-09-12T00:04:43.403 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:16.594343+0000", 2024-09-12T00:04:43.403 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 86.808431424000005, 2024-09-12T00:04:43.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030233460000000001, 2024-09-12T00:04:43.403 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:43.404 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:43.404 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:43.404 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:43.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:43.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594343+0000", 2024-09-12T00:04:43.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:43.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594343+0000", 2024-09-12T00:04:43.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:43.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594343+0000", 2024-09-12T00:04:43.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7e-07 2024-09-12T00:04:43.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:43.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594348+0000", 2024-09-12T00:04:43.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7899999999999999e-06 2024-09-12T00:04:43.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.406 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:43.406 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594366+0000", 2024-09-12T00:04:43.406 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8255000000000001e-05 2024-09-12T00:04:43.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.406 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:43.406 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594381+0000", 2024-09-12T00:04:43.406 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4905999999999999e-05 2024-09-12T00:04:43.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.406 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:43.406 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594710+0000", 2024-09-12T00:04:43.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000329208 2024-09-12T00:04:43.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:43.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594870+0000", 2024-09-12T00:04:43.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015991900000000001 2024-09-12T00:04:43.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:43.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597290+0000", 2024-09-12T00:04:43.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024196439999999999 2024-09-12T00:04:43.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:43.408 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597366+0000", 2024-09-12T00:04:43.408 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6254000000000005e-05 2024-09-12T00:04:43.408 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.408 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:43.408 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.408 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:56 7.3 e32/31 7:c609908c:::notify.5:head v 32'1, mlcod=0'0)", 2024-09-12T00:04:43.408 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.376429+0000", 2024-09-12T00:04:43.408 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 72.026345039000006, 2024-09-12T00:04:43.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029522699999999999, 2024-09-12T00:04:43.409 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:43.409 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:43.409 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:43.409 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:43.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:43.409 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376429+0000", 2024-09-12T00:04:43.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:43.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376429+0000", 2024-09-12T00:04:43.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:43.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376435+0000", 2024-09-12T00:04:43.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8619999999999999e-06 2024-09-12T00:04:43.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:43.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376445+0000", 2024-09-12T00:04:43.411 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7929999999999992e-06 2024-09-12T00:04:43.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.411 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:43.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376467+0000", 2024-09-12T00:04:43.411 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2840000000000002e-05 2024-09-12T00:04:43.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.411 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:43.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376481+0000", 2024-09-12T00:04:43.412 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3254e-05 2024-09-12T00:04:43.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.412 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.412 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:43.412 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376585+0000", 2024-09-12T00:04:43.412 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104066 2024-09-12T00:04:43.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.412 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.412 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:43.412 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.376611+0000", 2024-09-12T00:04:43.412 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6641000000000001e-05 2024-09-12T00:04:43.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.413 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:43.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.379288+0000", 2024-09-12T00:04:43.413 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026761879999999999 2024-09-12T00:04:43.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.413 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:43.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.379381+0000", 2024-09-12T00:04:43.413 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3626000000000001e-05 2024-09-12T00:04:43.413 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.414 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:43.414 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.414 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:43.414 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.411707+0000", 2024-09-12T00:04:43.414 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.991067031, 2024-09-12T00:04:43.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0031684230000000001, 2024-09-12T00:04:43.414 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:43.414 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:43.414 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:43.415 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:43.415 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:43.415 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:43.415 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 217 2024-09-12T00:04:43.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.415 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:43.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:43.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411707+0000", 2024-09-12T00:04:43.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:43.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411707+0000", 2024-09-12T00:04:43.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:43.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411710+0000", 2024-09-12T00:04:43.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4599999999999999e-06 2024-09-12T00:04:43.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:43.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411740+0000", 2024-09-12T00:04:43.417 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.953e-05 2024-09-12T00:04:43.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.417 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:43.417 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411772+0000", 2024-09-12T00:04:43.417 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.163e-05 2024-09-12T00:04:43.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.417 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:43.417 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411789+0000", 2024-09-12T00:04:43.417 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7614000000000001e-05 2024-09-12T00:04:43.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.417 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:43.418 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.411905+0000", 2024-09-12T00:04:43.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115665 2024-09-12T00:04:43.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.418 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.418 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:43.418 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.412108+0000", 2024-09-12T00:04:43.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020293500000000001 2024-09-12T00:04:43.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.418 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.418 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:43.418 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.412565+0000", 2024-09-12T00:04:43.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00045749700000000001 2024-09-12T00:04:43.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.419 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.419 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:43.419 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.414449+0000", 2024-09-12T00:04:43.419 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0018841859999999999 2024-09-12T00:04:43.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.419 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.419 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:43.419 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.414709+0000", 2024-09-12T00:04:43.419 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00025939399999999998 2024-09-12T00:04:43.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.420 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.420 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:43.420 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.414813+0000", 2024-09-12T00:04:43.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104366 2024-09-12T00:04:43.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.420 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.420 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:43.420 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.414875+0000", 2024-09-12T00:04:43.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2145999999999998e-05 2024-09-12T00:04:43.420 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.420 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:43.420 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.421 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:646 6.10 e35/29 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 35'1, mlcod=0'0)", 2024-09-12T00:04:43.421 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.597000+0000", 2024-09-12T00:04:43.421 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.805773901999999, 2024-09-12T00:04:43.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0044366320000000002, 2024-09-12T00:04:43.421 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:43.421 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:43.421 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:43.421 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:43.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:43.421 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597000+0000", 2024-09-12T00:04:43.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:43.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597000+0000", 2024-09-12T00:04:43.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:43.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597000+0000", 2024-09-12T00:04:43.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7700000000000001e-07 2024-09-12T00:04:43.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:43.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597004+0000", 2024-09-12T00:04:43.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7560000000000001e-06 2024-09-12T00:04:43.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:43.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597017+0000", 2024-09-12T00:04:43.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.33e-05 2024-09-12T00:04:43.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:43.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597024+0000", 2024-09-12T00:04:43.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8800000000000002e-06 2024-09-12T00:04:43.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:43.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597080+0000", 2024-09-12T00:04:43.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5949999999999998e-05 2024-09-12T00:04:43.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:43.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.597093+0000", 2024-09-12T00:04:43.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2695e-05 2024-09-12T00:04:43.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:43.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601386+0000", 2024-09-12T00:04:43.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0042935480000000003 2024-09-12T00:04:43.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.425 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:43.425 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.601437+0000", 2024-09-12T00:04:43.425 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0325999999999999e-05 2024-09-12T00:04:43.425 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.425 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:43.425 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.426 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:667 6.10 e35/29 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 35'2, mlcod=0'0)", 2024-09-12T00:04:43.426 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602975+0000", 2024-09-12T00:04:43.426 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.799799440000001, 2024-09-12T00:04:43.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040817340000000001, 2024-09-12T00:04:43.426 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:43.426 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:43.426 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:43.426 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:43.426 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.426 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:43.426 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602975+0000", 2024-09-12T00:04:43.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.426 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:43.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602975+0000", 2024-09-12T00:04:43.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:43.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602981+0000", 2024-09-12T00:04:43.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7939999999999997e-06 2024-09-12T00:04:43.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:43.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602988+0000", 2024-09-12T00:04:43.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5270000000000004e-06 2024-09-12T00:04:43.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.428 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:43.428 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603003+0000", 2024-09-12T00:04:43.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4731e-05 2024-09-12T00:04:43.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.428 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:43.428 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603009+0000", 2024-09-12T00:04:43.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.297e-06 2024-09-12T00:04:43.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.429 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:43.429 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603074+0000", 2024-09-12T00:04:43.429 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4713000000000002e-05 2024-09-12T00:04:43.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.429 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:43.429 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.603090+0000", 2024-09-12T00:04:43.429 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6344000000000001e-05 2024-09-12T00:04:43.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.430 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:43.430 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607014+0000", 2024-09-12T00:04:43.430 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039241800000000002 2024-09-12T00:04:43.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.430 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:43.430 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607056+0000", 2024-09-12T00:04:43.430 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2147999999999997e-05 2024-09-12T00:04:43.430 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.430 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:43.430 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.430 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:669 6.1c e35/29 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 35'3, mlcod=0'0)", 2024-09-12T00:04:43.431 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.608370+0000", 2024-09-12T00:04:43.431 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.794404216000004, 2024-09-12T00:04:43.431 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046099820000000003, 2024-09-12T00:04:43.431 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:43.431 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:43.431 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:43.431 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:43.431 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.431 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:43.431 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608370+0000", 2024-09-12T00:04:43.431 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.431 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.431 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.432 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:43.432 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608370+0000", 2024-09-12T00:04:43.432 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.432 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.432 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.432 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:43.432 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608371+0000", 2024-09-12T00:04:43.432 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8100000000000001e-07 2024-09-12T00:04:43.432 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.432 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.432 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:43.432 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608377+0000", 2024-09-12T00:04:43.432 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7349999999999999e-06 2024-09-12T00:04:43.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:43.433 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608395+0000", 2024-09-12T00:04:43.433 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7285000000000001e-05 2024-09-12T00:04:43.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:43.433 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608401+0000", 2024-09-12T00:04:43.433 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.365e-06 2024-09-12T00:04:43.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:43.434 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608463+0000", 2024-09-12T00:04:43.434 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2246e-05 2024-09-12T00:04:43.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.434 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:43.434 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608489+0000", 2024-09-12T00:04:43.434 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5222999999999999e-05 2024-09-12T00:04:43.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.434 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:43.434 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612945+0000", 2024-09-12T00:04:43.434 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004456603 2024-09-12T00:04:43.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.435 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:43.435 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612980+0000", 2024-09-12T00:04:43.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4544e-05 2024-09-12T00:04:43.435 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.435 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:43.435 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.435 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:682 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'4, mlcod=35'1)", 2024-09-12T00:04:43.435 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.612014+0000", 2024-09-12T00:04:43.435 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.790759812999994, 2024-09-12T00:04:43.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036839749999999999, 2024-09-12T00:04:43.436 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:43.436 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:43.436 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:43.436 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:43.436 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.436 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:43.436 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612014+0000", 2024-09-12T00:04:43.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.436 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.436 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:43.436 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612014+0000", 2024-09-12T00:04:43.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.437 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:43.437 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612015+0000", 2024-09-12T00:04:43.437 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0419999999999999e-06 2024-09-12T00:04:43.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.437 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:43.437 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612021+0000", 2024-09-12T00:04:43.437 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0009999999999998e-06 2024-09-12T00:04:43.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.437 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:43.438 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612035+0000", 2024-09-12T00:04:43.438 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.412e-05 2024-09-12T00:04:43.438 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.438 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.438 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:43.438 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612043+0000", 2024-09-12T00:04:43.438 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9699999999999999e-06 2024-09-12T00:04:43.438 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.438 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.438 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:43.439 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612111+0000", 2024-09-12T00:04:43.439 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7985999999999996e-05 2024-09-12T00:04:43.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.439 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.439 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:43.439 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612126+0000", 2024-09-12T00:04:43.439 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5099000000000001e-05 2024-09-12T00:04:43.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.439 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.439 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:43.439 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.615633+0000", 2024-09-12T00:04:43.440 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003506416 2024-09-12T00:04:43.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.440 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.440 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:43.440 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.615698+0000", 2024-09-12T00:04:43.440 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5340999999999997e-05 2024-09-12T00:04:43.440 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.440 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:43.440 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.441 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.441 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:768 6.15 6:ae95b544:::obj_delete_at_hint.0000000020:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:43.441 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.642525+0000", 2024-09-12T00:04:43.441 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.760248810999997, 2024-09-12T00:04:43.441 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048019760000000003, 2024-09-12T00:04:43.441 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:43.441 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:43.441 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:43.441 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:43.441 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:43.442 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:43.442 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 768 2024-09-12T00:04:43.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.442 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:43.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.442 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:43.442 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642525+0000", 2024-09-12T00:04:43.442 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.442 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:43.443 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642525+0000", 2024-09-12T00:04:43.443 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.443 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.443 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:43.443 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642526+0000", 2024-09-12T00:04:43.443 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3629999999999999e-06 2024-09-12T00:04:43.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.443 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.443 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:43.443 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642533+0000", 2024-09-12T00:04:43.443 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.64e-06 2024-09-12T00:04:43.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.443 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.444 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:43.444 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642549+0000", 2024-09-12T00:04:43.444 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5911000000000001e-05 2024-09-12T00:04:43.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.444 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:43.444 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642558+0000", 2024-09-12T00:04:43.444 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7420000000000003e-06 2024-09-12T00:04:43.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.444 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:43.444 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642628+0000", 2024-09-12T00:04:43.444 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0408999999999996e-05 2024-09-12T00:04:43.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.445 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.445 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:43.445 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642721+0000", 2024-09-12T00:04:43.445 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2888999999999998e-05 2024-09-12T00:04:43.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.445 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.445 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:43.445 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.642914+0000", 2024-09-12T00:04:43.445 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000192945 2024-09-12T00:04:43.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.446 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.446 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:43.446 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.644463+0000", 2024-09-12T00:04:43.446 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001548848 2024-09-12T00:04:43.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.446 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.446 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:43.446 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.647249+0000", 2024-09-12T00:04:43.446 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027862989999999999 2024-09-12T00:04:43.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.447 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:43.447 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.647285+0000", 2024-09-12T00:04:43.447 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6210000000000001e-05 2024-09-12T00:04:43.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.447 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:43.447 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.647327+0000", 2024-09-12T00:04:43.447 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.172e-05 2024-09-12T00:04:43.447 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.447 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:43.447 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.448 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:850 6.15 6:abd89f08:lc::lc.23:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:43.448 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.673328+0000", 2024-09-12T00:04:43.448 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 68.729446077000006, 2024-09-12T00:04:43.448 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047245300000000002, 2024-09-12T00:04:43.448 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:43.448 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:43.448 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:43.448 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:43.448 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:43.448 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:43.448 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 850 2024-09-12T00:04:43.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.448 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:43.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.449 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:43.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673328+0000", 2024-09-12T00:04:43.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.449 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:43.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673328+0000", 2024-09-12T00:04:43.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:43.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673329+0000", 2024-09-12T00:04:43.450 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5799999999999998e-07 2024-09-12T00:04:43.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:43.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673333+0000", 2024-09-12T00:04:43.450 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5990000000000004e-06 2024-09-12T00:04:43.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:43.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673345+0000", 2024-09-12T00:04:43.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1637999999999999e-05 2024-09-12T00:04:43.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.451 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:43.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673353+0000", 2024-09-12T00:04:43.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4610000000000002e-06 2024-09-12T00:04:43.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.451 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:43.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673417+0000", 2024-09-12T00:04:43.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4951999999999997e-05 2024-09-12T00:04:43.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.452 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:43.452 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673521+0000", 2024-09-12T00:04:43.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103881 2024-09-12T00:04:43.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.452 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:43.452 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.673729+0000", 2024-09-12T00:04:43.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020730600000000001 2024-09-12T00:04:43.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.452 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:43.453 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.674901+0000", 2024-09-12T00:04:43.453 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011728140000000001 2024-09-12T00:04:43.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.453 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:43.453 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.677953+0000", 2024-09-12T00:04:43.453 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030517959999999998 2024-09-12T00:04:43.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.453 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:43.453 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.677997+0000", 2024-09-12T00:04:43.453 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3346999999999997e-05 2024-09-12T00:04:43.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.454 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:43.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.678052+0000", 2024-09-12T00:04:43.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5778e-05 2024-09-12T00:04:43.454 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.454 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:43.454 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.454 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1641 3.26 3:658fe58e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2__shadow_.hDHTDpIswwqRA2bHiHVxkhWqZde6XEj_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:43.454 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:04:43.454 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.346487776, 2024-09-12T00:04:43.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017888905, 2024-09-12T00:04:43.455 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:43.455 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:43.455 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:43.455 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:43.455 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:43.455 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:43.455 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1641 2024-09-12T00:04:43.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.455 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:43.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.455 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:43.455 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:04:43.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:43.456 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:04:43.456 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:43.456 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056289+0000", 2024-09-12T00:04:43.456 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5349999999999999e-06 2024-09-12T00:04:43.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:43.456 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058595+0000", 2024-09-12T00:04:43.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002306083 2024-09-12T00:04:43.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.457 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.457 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:43.457 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058621+0000", 2024-09-12T00:04:43.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6431000000000002e-05 2024-09-12T00:04:43.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.457 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.457 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:43.457 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058631+0000", 2024-09-12T00:04:43.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0166000000000001e-05 2024-09-12T00:04:43.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.457 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.458 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:43.458 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058712+0000", 2024-09-12T00:04:43.458 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0122000000000003e-05 2024-09-12T00:04:43.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.458 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.458 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:43.458 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058821+0000", 2024-09-12T00:04:43.458 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010907400000000001 2024-09-12T00:04:43.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.458 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.458 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:43.458 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058910+0000", 2024-09-12T00:04:43.458 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9523000000000003e-05 2024-09-12T00:04:43.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.459 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:43.459 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073881+0000", 2024-09-12T00:04:43.459 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014971224 2024-09-12T00:04:43.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.459 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:43.459 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074101+0000", 2024-09-12T00:04:43.459 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0002195 2024-09-12T00:04:43.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.459 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:43.459 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074133+0000", 2024-09-12T00:04:43.459 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2138000000000003e-05 2024-09-12T00:04:43.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.460 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:43.460 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074175+0000", 2024-09-12T00:04:43.460 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2109e-05 2024-09-12T00:04:43.460 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.460 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:43.460 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.460 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1642 3.20 3:07bca365:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2__shadow_.hDHTDpIswwqRA2bHiHVxkhWqZde6XEj_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:43.460 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.060666+0000", 2024-09-12T00:04:43.460 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.34210835, 2024-09-12T00:04:43.461 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013097882, 2024-09-12T00:04:43.461 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:43.461 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:43.461 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:43.461 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:43.461 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:43.461 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:43.461 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1642 2024-09-12T00:04:43.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.461 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:43.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.461 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:43.462 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.060666+0000", 2024-09-12T00:04:43.462 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.462 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:43.462 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.060666+0000", 2024-09-12T00:04:43.462 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.462 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:43.462 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.060668+0000", 2024-09-12T00:04:43.462 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.728e-06 2024-09-12T00:04:43.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.463 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:43.463 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061720+0000", 2024-09-12T00:04:43.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0010517160000000001 2024-09-12T00:04:43.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.463 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:43.463 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061736+0000", 2024-09-12T00:04:43.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6181999999999999e-05 2024-09-12T00:04:43.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.463 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:43.463 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061744+0000", 2024-09-12T00:04:43.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5959999999999998e-06 2024-09-12T00:04:43.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.464 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:43.464 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061838+0000", 2024-09-12T00:04:43.464 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.4658000000000001e-05 2024-09-12T00:04:43.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.464 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:43.464 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.062005+0000", 2024-09-12T00:04:43.464 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000166529 2024-09-12T00:04:43.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.464 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:43.464 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.062175+0000", 2024-09-12T00:04:43.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000170182 2024-09-12T00:04:43.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.465 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:43.465 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.071854+0000", 2024-09-12T00:04:43.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0096790339999999996 2024-09-12T00:04:43.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.465 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:43.465 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073661+0000", 2024-09-12T00:04:43.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001806738 2024-09-12T00:04:43.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.466 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:43.466 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073708+0000", 2024-09-12T00:04:43.466 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7351000000000001e-05 2024-09-12T00:04:43.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.466 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:43.466 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073763+0000", 2024-09-12T00:04:43.466 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5167999999999998e-05 2024-09-12T00:04:43.466 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.466 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:43.466 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.467 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1752 4.1b 4:d867e322:::.dir.b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:43.467 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.614859+0000", 2024-09-12T00:04:43.467 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.7879151209999993, 2024-09-12T00:04:43.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057820520000000002, 2024-09-12T00:04:43.467 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:43.467 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:43.467 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:43.467 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:43.467 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:43.467 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:43.467 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1752 2024-09-12T00:04:43.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.468 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:43.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.468 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:43.468 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.614859+0000", 2024-09-12T00:04:43.468 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.468 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:43.468 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.614859+0000", 2024-09-12T00:04:43.468 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:43.469 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.614859+0000", 2024-09-12T00:04:43.469 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8100000000000003e-07 2024-09-12T00:04:43.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:43.469 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.614864+0000", 2024-09-12T00:04:43.469 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1080000000000003e-06 2024-09-12T00:04:43.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:43.469 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.614872+0000", 2024-09-12T00:04:43.469 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8419999999999994e-06 2024-09-12T00:04:43.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.470 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:43.470 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.614884+0000", 2024-09-12T00:04:43.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1592e-05 2024-09-12T00:04:43.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.470 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:43.470 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.614995+0000", 2024-09-12T00:04:43.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110599 2024-09-12T00:04:43.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.470 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:43.470 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.615114+0000", 2024-09-12T00:04:43.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011910500000000001 2024-09-12T00:04:43.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.471 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:43.471 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.615257+0000", 2024-09-12T00:04:43.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014299899999999999 2024-09-12T00:04:43.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.471 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:43.471 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.616621+0000", 2024-09-12T00:04:43.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001364107 2024-09-12T00:04:43.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.471 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:43.472 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.620537+0000", 2024-09-12T00:04:43.472 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039166169999999998 2024-09-12T00:04:43.472 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.472 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.472 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:43.472 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.620598+0000", 2024-09-12T00:04:43.472 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0424000000000003e-05 2024-09-12T00:04:43.472 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.472 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.472 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:43.472 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.620641+0000", 2024-09-12T00:04:43.472 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3078000000000003e-05 2024-09-12T00:04:43.472 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.473 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:43.473 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.473 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.473 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1754 8.5 e58/33 8:a4bd5286:root::.bucket.meta.buck_2024_08_12_00_04_33%3ab5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3:head v 58'1, mlcod=0'0)", 2024-09-12T00:04:43.473 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.621874+0000", 2024-09-12T00:04:43.473 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.7808998739999993, 2024-09-12T00:04:43.473 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003110055, 2024-09-12T00:04:43.473 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:43.473 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:43.474 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:43.474 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:43.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.474 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:43.474 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621874+0000", 2024-09-12T00:04:43.474 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.474 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:43.474 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621874+0000", 2024-09-12T00:04:43.474 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.475 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:43.475 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621875+0000", 2024-09-12T00:04:43.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8100000000000002e-07 2024-09-12T00:04:43.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.475 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:43.475 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621881+0000", 2024-09-12T00:04:43.476 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0519999999999998e-06 2024-09-12T00:04:43.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.476 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.476 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:43.476 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621892+0000", 2024-09-12T00:04:43.476 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1593000000000001e-05 2024-09-12T00:04:43.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.476 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.476 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:43.476 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621898+0000", 2024-09-12T00:04:43.476 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0150000000000003e-06 2024-09-12T00:04:43.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.476 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.476 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:43.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621960+0000", 2024-09-12T00:04:43.477 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2528999999999997e-05 2024-09-12T00:04:43.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.477 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:43.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.621979+0000", 2024-09-12T00:04:43.477 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8580000000000002e-05 2024-09-12T00:04:43.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.477 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:43.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.624931+0000", 2024-09-12T00:04:43.477 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029521360000000002 2024-09-12T00:04:43.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.478 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:43.478 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.624984+0000", 2024-09-12T00:04:43.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3368999999999997e-05 2024-09-12T00:04:43.478 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.478 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:43.478 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.478 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1775 3.30 e58/23 3:0c2ae78d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_1:head v 58'1, mlcod=0'0)", 2024-09-12T00:04:43.478 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:04:43.478 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.4010128159999997, 2024-09-12T00:04:43.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017585038000000001, 2024-09-12T00:04:43.479 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:43.479 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:43.479 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:43.479 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:43.479 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.479 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:43.479 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:04:43.479 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.479 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.479 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.479 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:43.479 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:04:43.479 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.480 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.480 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.480 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:43.480 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001763+0000", 2024-09-12T00:04:43.480 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2730000000000001e-06 2024-09-12T00:04:43.480 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.480 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.480 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:43.480 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005217+0000", 2024-09-12T00:04:43.480 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0034533810000000002 2024-09-12T00:04:43.480 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.481 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.481 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:43.481 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005241+0000", 2024-09-12T00:04:43.481 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4403e-05 2024-09-12T00:04:43.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.481 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.481 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:43.481 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005253+0000", 2024-09-12T00:04:43.481 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2007e-05 2024-09-12T00:04:43.482 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.482 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.482 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:43.482 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005324+0000", 2024-09-12T00:04:43.482 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0765000000000004e-05 2024-09-12T00:04:43.482 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.482 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.482 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:43.482 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005348+0000", 2024-09-12T00:04:43.482 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3762000000000001e-05 2024-09-12T00:04:43.482 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.482 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.482 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:43.482 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019291+0000", 2024-09-12T00:04:43.483 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013943707 2024-09-12T00:04:43.483 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.483 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.483 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:43.483 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019346+0000", 2024-09-12T00:04:43.483 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4740000000000001e-05 2024-09-12T00:04:43.483 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.483 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:43.483 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.483 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.483 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.483 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1780 3.16 3:69d8ee52:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:43.484 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:04:43.484 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.3794039040000001, 2024-09-12T00:04:43.484 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016232362, 2024-09-12T00:04:43.484 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:43.484 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:43.484 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:43.484 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:43.484 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:43.484 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:43.484 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1780 2024-09-12T00:04:43.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.485 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:43.485 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.485 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:43.485 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:04:43.485 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.485 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.485 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:43.485 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:04:43.485 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.485 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.485 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:43.486 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023372+0000", 2024-09-12T00:04:43.486 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0209999999999998e-06 2024-09-12T00:04:43.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.486 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.486 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:43.486 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024447+0000", 2024-09-12T00:04:43.486 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0010749550000000001 2024-09-12T00:04:43.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.486 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.486 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:43.486 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024473+0000", 2024-09-12T00:04:43.486 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5689000000000001e-05 2024-09-12T00:04:43.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.486 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.487 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:43.487 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024484+0000", 2024-09-12T00:04:43.487 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1153e-05 2024-09-12T00:04:43.487 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.487 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.487 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:43.487 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024547+0000", 2024-09-12T00:04:43.487 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3400999999999998e-05 2024-09-12T00:04:43.487 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.487 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.487 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:43.487 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024669+0000", 2024-09-12T00:04:43.487 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012184999999999999 2024-09-12T00:04:43.487 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.488 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.488 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:43.488 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025014+0000", 2024-09-12T00:04:43.488 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000344505 2024-09-12T00:04:43.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.488 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.488 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:43.488 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039161+0000", 2024-09-12T00:04:43.488 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014147799000000001 2024-09-12T00:04:43.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.488 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.488 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:43.489 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039434+0000", 2024-09-12T00:04:43.489 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00027254699999999999 2024-09-12T00:04:43.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.489 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.489 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:43.489 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039521+0000", 2024-09-12T00:04:43.489 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6663999999999996e-05 2024-09-12T00:04:43.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.489 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.489 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:43.489 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039602+0000", 2024-09-12T00:04:43.489 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1778000000000002e-05 2024-09-12T00:04:43.489 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.490 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:43.490 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.490 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.490 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.490 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1871 4.1b 4:d867e322:::.dir.b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:43.490 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.377553+0000", 2024-09-12T00:04:43.490 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.0252208239999998, 2024-09-12T00:04:43.490 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0081380240000000006, 2024-09-12T00:04:43.490 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:43.490 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:43.490 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:43.490 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:43.490 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:43.490 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:43.491 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1871 2024-09-12T00:04:43.491 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.491 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:43.491 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.491 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:43.491 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377553+0000", 2024-09-12T00:04:43.491 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.491 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.491 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.491 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:43.491 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377553+0000", 2024-09-12T00:04:43.492 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.492 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.492 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.492 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:43.492 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377554+0000", 2024-09-12T00:04:43.492 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2900000000000004e-07 2024-09-12T00:04:43.492 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.492 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.492 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:43.492 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377556+0000", 2024-09-12T00:04:43.492 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7420000000000002e-06 2024-09-12T00:04:43.492 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.492 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.493 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:43.493 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377566+0000", 2024-09-12T00:04:43.493 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2110000000000004e-06 2024-09-12T00:04:43.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.493 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.493 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:43.493 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377572+0000", 2024-09-12T00:04:43.493 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9209999999999997e-06 2024-09-12T00:04:43.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.493 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.493 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:43.493 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377628+0000", 2024-09-12T00:04:43.493 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6433e-05 2024-09-12T00:04:43.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.494 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:43.494 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377709+0000", 2024-09-12T00:04:43.494 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1371000000000004e-05 2024-09-12T00:04:43.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.494 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:43.494 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.377813+0000", 2024-09-12T00:04:43.494 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104162 2024-09-12T00:04:43.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.494 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:43.494 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.379948+0000", 2024-09-12T00:04:43.495 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002134815 2024-09-12T00:04:43.495 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.495 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.495 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:43.495 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.385636+0000", 2024-09-12T00:04:43.495 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056879330000000001 2024-09-12T00:04:43.495 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.495 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.495 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:43.495 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.385666+0000", 2024-09-12T00:04:43.495 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.953e-05 2024-09-12T00:04:43.495 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.496 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.496 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:43.496 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.385691+0000", 2024-09-12T00:04:43.496 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5377000000000001e-05 2024-09-12T00:04:43.496 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.496 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:43.496 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.496 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.496 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.496 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1912 3.16 3:6a08f78f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.4__shadow_.EKM6BwfpK8ZqXIKQk7k4yJFkOWS2UlN_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:04:43.496 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:35.139256+0000", 2024-09-12T00:04:43.496 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 8.2635179829999998, 2024-09-12T00:04:43.497 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01537029, 2024-09-12T00:04:43.497 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:43.497 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:43.497 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:43.497 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:43.497 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:43.497 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:43.497 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1912 2024-09-12T00:04:43.497 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.497 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:43.497 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.497 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:43.497 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.139256+0000", 2024-09-12T00:04:43.497 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.498 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.498 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.498 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:43.498 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.139256+0000", 2024-09-12T00:04:43.498 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.500 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.500 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.501 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:43.501 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.139258+0000", 2024-09-12T00:04:43.501 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3439999999999999e-06 2024-09-12T00:04:43.501 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.501 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.501 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:43.501 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141028+0000", 2024-09-12T00:04:43.501 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001770183 2024-09-12T00:04:43.501 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.501 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.501 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:43.501 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141054+0000", 2024-09-12T00:04:43.501 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5928e-05 2024-09-12T00:04:43.501 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.502 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.502 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:43.502 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141065+0000", 2024-09-12T00:04:43.502 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0589e-05 2024-09-12T00:04:43.502 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.502 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.502 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:43.503 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141145+0000", 2024-09-12T00:04:43.503 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0121000000000001e-05 2024-09-12T00:04:43.503 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.503 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.503 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:43.503 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141257+0000", 2024-09-12T00:04:43.503 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000111672 2024-09-12T00:04:43.503 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.503 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.503 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:43.503 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141361+0000", 2024-09-12T00:04:43.504 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103705 2024-09-12T00:04:43.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.504 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.504 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:43.504 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.152422+0000", 2024-09-12T00:04:43.504 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011061586999999999 2024-09-12T00:04:43.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.505 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.505 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:43.505 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154552+0000", 2024-09-12T00:04:43.505 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021297120000000002 2024-09-12T00:04:43.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.506 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.506 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:43.506 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154590+0000", 2024-09-12T00:04:43.506 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7942999999999999e-05 2024-09-12T00:04:43.506 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.506 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.506 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:43.507 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154626+0000", 2024-09-12T00:04:43.507 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6505999999999999e-05 2024-09-12T00:04:43.507 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.507 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:43.507 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.507 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.507 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.507 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1917 3.1 e59/23 3:829295ac:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.4_10Mb.:head v 59'1, mlcod=0'0)", 2024-09-12T00:04:43.508 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:35.170889+0000", 2024-09-12T00:04:43.508 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 8.2318853409999999, 2024-09-12T00:04:43.508 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011229917000000001, 2024-09-12T00:04:43.508 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:43.508 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:43.508 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:43.508 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:43.509 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.509 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:43.509 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.170889+0000", 2024-09-12T00:04:43.509 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.509 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.509 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.510 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:43.510 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.170889+0000", 2024-09-12T00:04:43.510 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.510 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.510 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:43.511 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.170889+0000", 2024-09-12T00:04:43.511 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5200000000000002e-07 2024-09-12T00:04:43.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.511 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.511 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:43.511 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.175127+0000", 2024-09-12T00:04:43.511 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0042381220000000004 2024-09-12T00:04:43.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.512 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.512 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:43.512 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.175149+0000", 2024-09-12T00:04:43.512 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1926e-05 2024-09-12T00:04:43.512 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.512 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.512 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:43.512 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.175164+0000", 2024-09-12T00:04:43.513 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5167999999999999e-05 2024-09-12T00:04:43.513 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.513 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.513 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:43.513 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.175234+0000", 2024-09-12T00:04:43.513 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0129999999999994e-05 2024-09-12T00:04:43.513 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.513 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.513 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:43.513 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.175252+0000", 2024-09-12T00:04:43.513 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7388999999999999e-05 2024-09-12T00:04:43.513 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.513 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.514 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:43.514 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.182013+0000", 2024-09-12T00:04:43.514 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0067615740000000002 2024-09-12T00:04:43.514 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.514 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.514 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:43.515 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.182119+0000", 2024-09-12T00:04:43.515 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010515599999999999 2024-09-12T00:04:43.515 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.515 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:43.515 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.515 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.515 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.515 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2463 4.a 4:53c017a3:::.dir.b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:04:43.515 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:38.218126+0000", 2024-09-12T00:04:43.515 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.1846479460000001, 2024-09-12T00:04:43.515 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0044908689999999998, 2024-09-12T00:04:43.515 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:43.515 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:43.516 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:43.516 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:43.516 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:43.516 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:43.516 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2463 2024-09-12T00:04:43.516 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.516 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:43.516 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.516 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:43.516 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.218126+0000", 2024-09-12T00:04:43.516 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.516 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.516 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.516 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:43.517 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.218126+0000", 2024-09-12T00:04:43.517 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.517 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.517 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:43.517 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.218128+0000", 2024-09-12T00:04:43.517 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.646e-06 2024-09-12T00:04:43.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.517 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.517 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:43.517 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.218134+0000", 2024-09-12T00:04:43.517 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7270000000000001e-06 2024-09-12T00:04:43.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.517 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.518 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:43.518 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.218150+0000", 2024-09-12T00:04:43.518 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6113999999999999e-05 2024-09-12T00:04:43.518 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.518 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.518 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:43.518 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.218162+0000", 2024-09-12T00:04:43.518 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1473e-05 2024-09-12T00:04:43.518 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.518 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.518 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:43.518 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.218227+0000", 2024-09-12T00:04:43.518 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5153000000000005e-05 2024-09-12T00:04:43.519 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.519 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.519 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:43.519 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.218380+0000", 2024-09-12T00:04:43.519 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015293500000000001 2024-09-12T00:04:43.519 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.519 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.519 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:43.519 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.218565+0000", 2024-09-12T00:04:43.519 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018521 2024-09-12T00:04:43.519 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.519 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.520 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:43.520 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.220206+0000", 2024-09-12T00:04:43.520 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0016404900000000001 2024-09-12T00:04:43.520 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.520 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.520 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:43.520 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.222520+0000", 2024-09-12T00:04:43.520 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023145309999999999 2024-09-12T00:04:43.520 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.521 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.521 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:43.521 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.222574+0000", 2024-09-12T00:04:43.521 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3522e-05 2024-09-12T00:04:43.521 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.521 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.521 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:43.521 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.222617+0000", 2024-09-12T00:04:43.521 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3068000000000002e-05 2024-09-12T00:04:43.521 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.521 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:43.521 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.521 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.521 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.522 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2462 4.24 e60/25 4:25c5078c:::.dir.b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9.0:head v 60'1, mlcod=0'0)", 2024-09-12T00:04:43.522 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:38.219442+0000", 2024-09-12T00:04:43.522 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.1833322150000001, 2024-09-12T00:04:43.522 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0028928500000000002, 2024-09-12T00:04:43.522 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:43.522 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:43.522 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:43.522 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:43.522 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.522 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:43.522 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.219442+0000", 2024-09-12T00:04:43.522 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.523 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.523 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.523 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:43.523 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.219442+0000", 2024-09-12T00:04:43.523 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:43.523 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.523 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.523 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:43.523 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.219443+0000", 2024-09-12T00:04:43.523 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.232e-06 2024-09-12T00:04:43.523 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.523 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.524 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:43.524 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.219452+0000", 2024-09-12T00:04:43.524 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.935e-06 2024-09-12T00:04:43.524 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.524 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.524 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:43.524 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.219466+0000", 2024-09-12T00:04:43.524 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4107000000000001e-05 2024-09-12T00:04:43.524 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.524 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.524 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:43.524 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.219474+0000", 2024-09-12T00:04:43.524 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6820000000000003e-06 2024-09-12T00:04:43.524 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.525 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.525 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:43.525 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.219535+0000", 2024-09-12T00:04:43.525 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1549000000000003e-05 2024-09-12T00:04:43.525 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.525 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.525 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:43.525 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.219557+0000", 2024-09-12T00:04:43.525 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1268999999999999e-05 2024-09-12T00:04:43.525 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.525 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.525 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:43.525 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.222288+0000", 2024-09-12T00:04:43.526 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027312740000000001 2024-09-12T00:04:43.526 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:43.526 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:43.526 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:43.526 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:38.222335+0000", 2024-09-12T00:04:43.526 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6801999999999997e-05 2024-09-12T00:04:43.526 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.526 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:43.526 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.526 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:43.526 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:43.526 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:43.528 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:04:43.529 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T00:04:43.529 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:43.528+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:43.628 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:43.626+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:43.703 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:43.704 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:43.704 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:43.704 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:43.717 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:04:43.761 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:43.764+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:43.831 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:43.830+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:43.855 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:43.855 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:43.855 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:43.855 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:43.855 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:43.869 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:04:43.957 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:43.960+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:44.033 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:44.030+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:44.037 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:44.038 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:44.038 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:44.038 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:44.038 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.038 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4232.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-12T00:04:44.038 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:04:44.038 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 87.489240233999993, 2024-09-12T00:04:44.038 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.049385680000000001, 2024-09-12T00:04:44.038 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:44.038 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:44.038 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.038 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:44.039 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4232", 2024-09-12T00:04:44.039 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/3037249369", 2024-09-12T00:04:44.039 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:04:44.039 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.039 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:44.039 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.039 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:44.039 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:04:44.039 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.039 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.039 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.039 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:44.040 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:04:44.040 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.040 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.040 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.040 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:44.040 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548454+0000", 2024-09-12T00:04:44.040 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2259999999999999e-06 2024-09-12T00:04:44.040 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.040 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.040 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:44.040 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548466+0000", 2024-09-12T00:04:44.041 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1361e-05 2024-09-12T00:04:44.041 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.041 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.041 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:44.041 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548492+0000", 2024-09-12T00:04:44.041 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6225999999999999e-05 2024-09-12T00:04:44.041 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.041 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.041 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.041 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548509+0000", 2024-09-12T00:04:44.041 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7452000000000002e-05 2024-09-12T00:04:44.042 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.042 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.042 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.042 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549371+0000", 2024-09-12T00:04:44.042 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00086204300000000005 2024-09-12T00:04:44.042 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.042 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.042 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:44.042 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549396+0000", 2024-09-12T00:04:44.042 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.51e-05 2024-09-12T00:04:44.042 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.042 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.042 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.042 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593253+0000", 2024-09-12T00:04:44.043 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.043856248 2024-09-12T00:04:44.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.043 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.043 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:44.043 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593517+0000", 2024-09-12T00:04:44.043 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026439299999999997 2024-09-12T00:04:44.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.043 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.043 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:44.043 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594046+0000", 2024-09-12T00:04:44.043 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00052854200000000001 2024-09-12T00:04:44.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.043 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.043 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.044 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597642+0000", 2024-09-12T00:04:44.044 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0035959070000000002 2024-09-12T00:04:44.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.044 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.044 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:44.044 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597670+0000", 2024-09-12T00:04:44.044 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8235999999999999e-05 2024-09-12T00:04:44.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.044 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.044 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:44.044 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597754+0000", 2024-09-12T00:04:44.044 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4009000000000002e-05 2024-09-12T00:04:44.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.045 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.045 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:44.045 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597833+0000", 2024-09-12T00:04:44.045 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8937000000000007e-05 2024-09-12T00:04:44.045 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.045 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:44.045 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.045 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.045 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.045 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4232.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-12T00:04:44.045 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:17.547042+0000", 2024-09-12T00:04:44.045 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 86.490645079999993, 2024-09-12T00:04:44.045 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011713866, 2024-09-12T00:04:44.045 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:44.045 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:44.046 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.046 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:44.046 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4232", 2024-09-12T00:04:44.046 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/3037249369", 2024-09-12T00:04:44.046 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 5 2024-09-12T00:04:44.046 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.046 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:44.046 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.046 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:44.046 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547042+0000", 2024-09-12T00:04:44.046 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.046 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.046 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.046 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:44.047 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547042+0000", 2024-09-12T00:04:44.047 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.047 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.047 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.047 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:44.047 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547048+0000", 2024-09-12T00:04:44.047 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3639999999999998e-06 2024-09-12T00:04:44.047 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.047 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.047 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:44.047 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547078+0000", 2024-09-12T00:04:44.047 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.029e-05 2024-09-12T00:04:44.047 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.047 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.048 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:44.048 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547135+0000", 2024-09-12T00:04:44.048 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7299000000000001e-05 2024-09-12T00:04:44.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.048 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.048 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.048 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547159+0000", 2024-09-12T00:04:44.048 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3470000000000001e-05 2024-09-12T00:04:44.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.048 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.048 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.048 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547408+0000", 2024-09-12T00:04:44.048 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024930800000000001 2024-09-12T00:04:44.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.048 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.049 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:44.049 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.547419+0000", 2024-09-12T00:04:44.049 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1316e-05 2024-09-12T00:04:44.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.049 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.049 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.049 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.555594+0000", 2024-09-12T00:04:44.049 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0081748129999999995 2024-09-12T00:04:44.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.049 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.049 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:44.049 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.555811+0000", 2024-09-12T00:04:44.049 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021711199999999999 2024-09-12T00:04:44.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.050 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.050 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:44.050 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.556013+0000", 2024-09-12T00:04:44.050 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020175099999999999 2024-09-12T00:04:44.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.050 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.050 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:44.050 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.557402+0000", 2024-09-12T00:04:44.050 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0013890269999999999 2024-09-12T00:04:44.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.050 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.050 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.050 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.558483+0000", 2024-09-12T00:04:44.050 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001081128 2024-09-12T00:04:44.051 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.051 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.051 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:44.051 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.558636+0000", 2024-09-12T00:04:44.051 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015267500000000001 2024-09-12T00:04:44.051 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.051 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.051 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:44.051 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:17.558756+0000", 2024-09-12T00:04:44.051 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000120313 2024-09-12T00:04:44.051 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.051 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:44.051 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.052 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.052 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4232.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-09-12T00:04:44.052 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:18.562030+0000", 2024-09-12T00:04:44.052 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 85.475656889999996, 2024-09-12T00:04:44.052 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0073448150000000002, 2024-09-12T00:04:44.052 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:44.052 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:44.052 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.052 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:44.052 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4232", 2024-09-12T00:04:44.052 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/3037249369", 2024-09-12T00:04:44.052 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 7 2024-09-12T00:04:44.053 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.053 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:44.053 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.053 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:44.053 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562030+0000", 2024-09-12T00:04:44.053 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.053 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.053 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.053 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:44.053 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562030+0000", 2024-09-12T00:04:44.053 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.053 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.053 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.053 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:44.054 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562034+0000", 2024-09-12T00:04:44.054 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6069999999999999e-06 2024-09-12T00:04:44.054 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.054 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.054 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:44.054 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562051+0000", 2024-09-12T00:04:44.054 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7450000000000001e-05 2024-09-12T00:04:44.054 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.054 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.054 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:44.054 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562091+0000", 2024-09-12T00:04:44.054 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9703000000000003e-05 2024-09-12T00:04:44.054 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.055 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.055 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.055 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562112+0000", 2024-09-12T00:04:44.055 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1189999999999999e-05 2024-09-12T00:04:44.055 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.055 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.055 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.055 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562253+0000", 2024-09-12T00:04:44.055 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000140302 2024-09-12T00:04:44.055 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.055 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.055 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:44.055 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.562264+0000", 2024-09-12T00:04:44.056 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1737e-05 2024-09-12T00:04:44.056 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.056 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.056 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.056 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.566247+0000", 2024-09-12T00:04:44.056 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039824259999999998 2024-09-12T00:04:44.056 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.056 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.056 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:44.056 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.566384+0000", 2024-09-12T00:04:44.056 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000136916 2024-09-12T00:04:44.056 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.056 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.057 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:44.057 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.566645+0000", 2024-09-12T00:04:44.057 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000261241 2024-09-12T00:04:44.057 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.057 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.057 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:44.057 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.568507+0000", 2024-09-12T00:04:44.057 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001862219 2024-09-12T00:04:44.057 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.057 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.057 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.057 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.569221+0000", 2024-09-12T00:04:44.058 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00071416199999999996 2024-09-12T00:04:44.058 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.058 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.058 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:44.058 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.569306+0000", 2024-09-12T00:04:44.058 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5016000000000001e-05 2024-09-12T00:04:44.058 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.058 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.058 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:44.058 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:18.569375+0000", 2024-09-12T00:04:44.058 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8845999999999998e-05 2024-09-12T00:04:44.058 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.058 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:44.058 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.059 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.059 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.059 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T00:04:44.059 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:04:44.059 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 74.708030465999997, 2024-09-12T00:04:44.059 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025928692999999999, 2024-09-12T00:04:44.059 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:44.059 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:44.059 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "reached pg", 2024-09-12T00:04:44.059 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:44.059 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:44.059 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.059 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 43 2024-09-12T00:04:44.060 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.060 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:44.060 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.060 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:44.060 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:04:44.060 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.060 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.060 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.060 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:44.060 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:04:44.060 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.060 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.060 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.060 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:44.061 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329660+0000", 2024-09-12T00:04:44.061 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.965e-06 2024-09-12T00:04:44.061 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.061 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.061 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:44.061 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329673+0000", 2024-09-12T00:04:44.061 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3402e-05 2024-09-12T00:04:44.061 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.061 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.061 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:44.062 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329706+0000", 2024-09-12T00:04:44.062 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2441000000000003e-05 2024-09-12T00:04:44.062 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.062 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.062 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.062 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329723+0000", 2024-09-12T00:04:44.062 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7609e-05 2024-09-12T00:04:44.062 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.062 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.062 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.062 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330437+0000", 2024-09-12T00:04:44.062 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00071403500000000002 2024-09-12T00:04:44.063 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.063 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.063 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:44.063 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330454+0000", 2024-09-12T00:04:44.063 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6820000000000002e-05 2024-09-12T00:04:44.063 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.063 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.063 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.063 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347344+0000", 2024-09-12T00:04:44.064 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016890275 2024-09-12T00:04:44.064 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.064 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.064 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:44.064 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347365+0000", 2024-09-12T00:04:44.064 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0350999999999999e-05 2024-09-12T00:04:44.064 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.064 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.065 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.065 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355323+0000", 2024-09-12T00:04:44.065 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079579400000000002 2024-09-12T00:04:44.065 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.065 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.065 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:44.065 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355585+0000", 2024-09-12T00:04:44.065 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026285499999999999 2024-09-12T00:04:44.065 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.065 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:44.065 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.065 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.065 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.065 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:241 6.7 6:e31d3d5f:lc::lc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.066 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.484582+0000", 2024-09-12T00:04:44.066 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 69.553105582000001, 2024-09-12T00:04:44.066 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056165570000000003, 2024-09-12T00:04:44.066 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:44.066 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:44.066 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.066 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:44.066 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:44.066 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.066 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 241 2024-09-12T00:04:44.066 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.066 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:44.066 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.067 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:44.067 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484582+0000", 2024-09-12T00:04:44.067 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.067 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.067 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.067 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:44.067 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484582+0000", 2024-09-12T00:04:44.067 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.067 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.067 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.067 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:44.067 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484583+0000", 2024-09-12T00:04:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.536e-06 2024-09-12T00:04:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484590+0000", 2024-09-12T00:04:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6100000000000002e-06 2024-09-12T00:04:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484613+0000", 2024-09-12T00:04:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3309999999999999e-05 2024-09-12T00:04:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484624+0000", 2024-09-12T00:04:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0669999999999999e-05 2024-09-12T00:04:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484716+0000", 2024-09-12T00:04:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2257999999999997e-05 2024-09-12T00:04:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.484900+0000", 2024-09-12T00:04:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000183807 2024-09-12T00:04:44.070 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.070 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.070 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:44.070 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.485057+0000", 2024-09-12T00:04:44.070 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015707300000000001 2024-09-12T00:04:44.070 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.070 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.070 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:44.070 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.485975+0000", 2024-09-12T00:04:44.070 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00091781399999999998 2024-09-12T00:04:44.070 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.070 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.070 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.071 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490054+0000", 2024-09-12T00:04:44.071 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040794569999999999 2024-09-12T00:04:44.071 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.071 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.071 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:44.071 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490128+0000", 2024-09-12T00:04:44.071 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3336000000000004e-05 2024-09-12T00:04:44.071 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.071 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.071 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:44.071 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.490198+0000", 2024-09-12T00:04:44.071 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0685999999999994e-05 2024-09-12T00:04:44.071 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.071 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:44.072 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.072 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.072 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.072 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:276 6.7 6:e31d3d5f:lc::lc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.072 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.491340+0000", 2024-09-12T00:04:44.072 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 69.546347462, 2024-09-12T00:04:44.072 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056286460000000002, 2024-09-12T00:04:44.072 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:44.072 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:44.072 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.072 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:44.072 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:44.072 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.073 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 276 2024-09-12T00:04:44.073 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.073 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:44.073 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.073 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:44.073 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491340+0000", 2024-09-12T00:04:44.073 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.073 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.073 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.073 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:44.073 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491340+0000", 2024-09-12T00:04:44.073 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.073 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.074 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.074 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:44.074 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491342+0000", 2024-09-12T00:04:44.074 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8509999999999999e-06 2024-09-12T00:04:44.074 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.074 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.074 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:44.074 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491348+0000", 2024-09-12T00:04:44.074 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1929999999999998e-06 2024-09-12T00:04:44.074 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.074 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.074 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:44.074 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491366+0000", 2024-09-12T00:04:44.074 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7669999999999999e-05 2024-09-12T00:04:44.075 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.075 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.075 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.075 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491382+0000", 2024-09-12T00:04:44.075 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6554000000000001e-05 2024-09-12T00:04:44.075 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.076 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.076 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.076 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491452+0000", 2024-09-12T00:04:44.076 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9917000000000002e-05 2024-09-12T00:04:44.076 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.076 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.076 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:44.076 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491536+0000", 2024-09-12T00:04:44.076 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4229999999999998e-05 2024-09-12T00:04:44.076 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.076 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.076 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:44.077 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.491704+0000", 2024-09-12T00:04:44.077 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000167994 2024-09-12T00:04:44.077 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.077 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.077 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:44.077 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.492347+0000", 2024-09-12T00:04:44.077 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00064263799999999995 2024-09-12T00:04:44.077 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.077 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.077 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.077 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.496901+0000", 2024-09-12T00:04:44.078 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045546329999999998 2024-09-12T00:04:44.078 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.078 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.078 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:44.078 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.496939+0000", 2024-09-12T00:04:44.078 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7135999999999998e-05 2024-09-12T00:04:44.078 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.078 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.078 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:44.078 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.496968+0000", 2024-09-12T00:04:44.078 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9830000000000001e-05 2024-09-12T00:04:44.078 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.078 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:44.078 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.079 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.079 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.079 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:297 6.8 6:162a24ce:lc::lc.8:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.079 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.497051+0000", 2024-09-12T00:04:44.079 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 69.540636649999996, 2024-09-12T00:04:44.079 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056532370000000002, 2024-09-12T00:04:44.079 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:44.079 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:44.079 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.080 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:44.080 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:44.080 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.080 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 297 2024-09-12T00:04:44.080 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.080 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:44.080 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.080 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:44.080 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497051+0000", 2024-09-12T00:04:44.080 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.080 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.081 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.081 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:44.081 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497051+0000", 2024-09-12T00:04:44.081 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.081 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.081 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.081 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:44.081 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497052+0000", 2024-09-12T00:04:44.081 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3659999999999999e-06 2024-09-12T00:04:44.081 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.081 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.081 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:44.081 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497058+0000", 2024-09-12T00:04:44.082 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0909999999999998e-06 2024-09-12T00:04:44.082 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.082 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.082 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:44.082 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497075+0000", 2024-09-12T00:04:44.082 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7312e-05 2024-09-12T00:04:44.082 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.082 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.082 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.082 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497084+0000", 2024-09-12T00:04:44.082 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3149999999999992e-06 2024-09-12T00:04:44.082 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.082 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.083 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.083 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497189+0000", 2024-09-12T00:04:44.083 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105257 2024-09-12T00:04:44.083 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.083 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.083 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:44.083 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497278+0000", 2024-09-12T00:04:44.083 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9512000000000006e-05 2024-09-12T00:04:44.083 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.083 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.084 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:44.084 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.497460+0000", 2024-09-12T00:04:44.084 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018169 2024-09-12T00:04:44.084 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.084 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.084 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:44.084 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.498149+0000", 2024-09-12T00:04:44.084 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000688632 2024-09-12T00:04:44.084 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.084 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.084 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.084 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.502640+0000", 2024-09-12T00:04:44.084 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0044907690000000004 2024-09-12T00:04:44.085 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.085 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.085 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:44.085 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.502676+0000", 2024-09-12T00:04:44.085 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6452000000000003e-05 2024-09-12T00:04:44.085 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.085 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.085 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:44.085 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.502704+0000", 2024-09-12T00:04:44.085 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7841e-05 2024-09-12T00:04:44.085 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.085 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:44.085 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.086 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.086 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.086 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:322 6.7 6:e31d3d5f:lc::lc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.086 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.500700+0000", 2024-09-12T00:04:44.086 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 69.536987255, 2024-09-12T00:04:44.086 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0067834599999999998, 2024-09-12T00:04:44.086 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:44.086 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:44.086 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.086 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:44.086 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:44.086 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.086 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 322 2024-09-12T00:04:44.086 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.087 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:44.087 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.087 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:44.087 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500700+0000", 2024-09-12T00:04:44.087 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.087 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.087 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.087 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:44.087 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500700+0000", 2024-09-12T00:04:44.087 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.087 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.087 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.088 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:44.088 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500701+0000", 2024-09-12T00:04:44.088 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.19e-06 2024-09-12T00:04:44.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.088 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.088 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:44.088 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500708+0000", 2024-09-12T00:04:44.088 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1130000000000003e-06 2024-09-12T00:04:44.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.088 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.089 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:44.089 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500721+0000", 2024-09-12T00:04:44.089 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3073e-05 2024-09-12T00:04:44.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.089 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.089 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.089 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500730+0000", 2024-09-12T00:04:44.089 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5969999999999992e-06 2024-09-12T00:04:44.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.089 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.089 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.089 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500798+0000", 2024-09-12T00:04:44.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7659999999999999e-05 2024-09-12T00:04:44.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:44.090 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.500860+0000", 2024-09-12T00:04:44.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2089999999999997e-05 2024-09-12T00:04:44.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:44.090 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.501007+0000", 2024-09-12T00:04:44.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000147618 2024-09-12T00:04:44.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:44.091 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.501726+0000", 2024-09-12T00:04:44.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00071825600000000002 2024-09-12T00:04:44.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.091 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.091 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.507420+0000", 2024-09-12T00:04:44.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056941240000000001 2024-09-12T00:04:44.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.091 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:44.091 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.507453+0000", 2024-09-12T00:04:44.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3547999999999998e-05 2024-09-12T00:04:44.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.092 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.092 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:44.092 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.507483+0000", 2024-09-12T00:04:44.092 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0190999999999999e-05 2024-09-12T00:04:44.092 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.092 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:44.092 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.092 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.092 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:408 6.7 6:e31d3d5f:lc::lc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.092 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.525223+0000", 2024-09-12T00:04:44.092 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 69.512464465999997, 2024-09-12T00:04:44.092 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064357069999999997, 2024-09-12T00:04:44.092 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:44.093 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:44.093 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.093 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:44.093 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:44.093 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.093 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 408 2024-09-12T00:04:44.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.093 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:44.093 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.093 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:44.093 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525223+0000", 2024-09-12T00:04:44.093 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.093 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.094 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:44.094 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525223+0000", 2024-09-12T00:04:44.094 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.094 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.094 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.094 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:44.094 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525224+0000", 2024-09-12T00:04:44.094 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.325e-06 2024-09-12T00:04:44.094 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.094 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.094 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:44.094 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525230+0000", 2024-09-12T00:04:44.094 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.677e-06 2024-09-12T00:04:44.094 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.095 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.095 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:44.095 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525243+0000", 2024-09-12T00:04:44.095 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3592e-05 2024-09-12T00:04:44.095 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.095 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.095 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.095 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525255+0000", 2024-09-12T00:04:44.095 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1257000000000001e-05 2024-09-12T00:04:44.095 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.095 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.095 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.095 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525339+0000", 2024-09-12T00:04:44.095 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4565000000000001e-05 2024-09-12T00:04:44.096 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.096 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.096 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:44.096 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525433+0000", 2024-09-12T00:04:44.096 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.4248999999999998e-05 2024-09-12T00:04:44.096 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.096 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.096 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:44.096 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.525649+0000", 2024-09-12T00:04:44.096 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021594999999999999 2024-09-12T00:04:44.096 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.096 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.096 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:44.096 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.526275+0000", 2024-09-12T00:04:44.097 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00062531200000000005 2024-09-12T00:04:44.097 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.097 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.097 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.097 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531540+0000", 2024-09-12T00:04:44.097 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052655009999999997 2024-09-12T00:04:44.097 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.097 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.097 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:44.098 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531606+0000", 2024-09-12T00:04:44.098 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5733000000000002e-05 2024-09-12T00:04:44.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.098 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.098 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:44.098 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.531659+0000", 2024-09-12T00:04:44.098 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2546000000000001e-05 2024-09-12T00:04:44.098 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.098 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:44.098 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.098 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.099 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:492 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.099 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.552214+0000", 2024-09-12T00:04:44.099 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 69.485472909999999, 2024-09-12T00:04:44.099 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.006213199, 2024-09-12T00:04:44.099 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:44.099 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:44.099 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.099 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:44.099 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:44.099 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.099 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 492 2024-09-12T00:04:44.099 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.099 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:44.100 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.100 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:44.100 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552214+0000", 2024-09-12T00:04:44.100 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.100 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.100 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.100 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:44.100 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552214+0000", 2024-09-12T00:04:44.100 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.100 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.100 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.100 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:44.100 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552215+0000", 2024-09-12T00:04:44.101 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1170000000000001e-06 2024-09-12T00:04:44.101 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.101 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.101 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:44.101 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552220+0000", 2024-09-12T00:04:44.101 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8149999999999996e-06 2024-09-12T00:04:44.101 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.101 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.101 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:44.101 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552233+0000", 2024-09-12T00:04:44.101 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2784e-05 2024-09-12T00:04:44.102 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.102 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.102 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.102 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552240+0000", 2024-09-12T00:04:44.102 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8379999999999996e-06 2024-09-12T00:04:44.102 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.102 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.102 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.102 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552297+0000", 2024-09-12T00:04:44.102 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7123000000000002e-05 2024-09-12T00:04:44.102 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.103 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.103 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:44.103 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552382+0000", 2024-09-12T00:04:44.103 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5334000000000007e-05 2024-09-12T00:04:44.103 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.103 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.103 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:44.103 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.552504+0000", 2024-09-12T00:04:44.103 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000121309 2024-09-12T00:04:44.103 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.103 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.103 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:44.103 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558157+0000", 2024-09-12T00:04:44.103 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0056535439999999999 2024-09-12T00:04:44.104 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.104 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.104 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.104 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558356+0000", 2024-09-12T00:04:44.104 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000198436 2024-09-12T00:04:44.104 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.104 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.104 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:44.104 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558401+0000", 2024-09-12T00:04:44.104 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5048e-05 2024-09-12T00:04:44.104 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.104 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.104 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:44.104 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.558428+0000", 2024-09-12T00:04:44.105 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6851000000000001e-05 2024-09-12T00:04:44.105 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.105 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:44.105 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.105 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.105 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.105 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:643 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.105 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.593859+0000", 2024-09-12T00:04:44.105 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 69.443827920000004, 2024-09-12T00:04:44.105 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054148069999999998, 2024-09-12T00:04:44.106 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:44.106 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:44.106 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.106 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:44.106 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:44.106 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.106 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 643 2024-09-12T00:04:44.106 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.106 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:44.106 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.106 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:44.106 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593859+0000", 2024-09-12T00:04:44.106 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.106 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.107 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.107 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:44.107 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593859+0000", 2024-09-12T00:04:44.107 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.107 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.107 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.107 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:44.107 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593860+0000", 2024-09-12T00:04:44.107 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0500000000000002e-07 2024-09-12T00:04:44.107 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.107 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.107 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:44.107 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593864+0000", 2024-09-12T00:04:44.107 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3100000000000002e-06 2024-09-12T00:04:44.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.108 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.108 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:44.108 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593875+0000", 2024-09-12T00:04:44.108 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0706999999999999e-05 2024-09-12T00:04:44.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.108 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.108 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.108 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593882+0000", 2024-09-12T00:04:44.108 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2919999999999998e-06 2024-09-12T00:04:44.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.108 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.108 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.108 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.593939+0000", 2024-09-12T00:04:44.109 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6138999999999999e-05 2024-09-12T00:04:44.109 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.109 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.109 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:44.109 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594023+0000", 2024-09-12T00:04:44.109 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4128000000000005e-05 2024-09-12T00:04:44.109 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.109 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.109 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:44.109 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.594194+0000", 2024-09-12T00:04:44.109 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017098800000000001 2024-09-12T00:04:44.109 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.109 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.109 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:44.110 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.598923+0000", 2024-09-12T00:04:44.110 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047291369999999996 2024-09-12T00:04:44.110 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.110 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.110 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.110 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599219+0000", 2024-09-12T00:04:44.110 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00029588500000000002 2024-09-12T00:04:44.110 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.110 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.110 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:44.110 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599250+0000", 2024-09-12T00:04:44.110 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0771000000000001e-05 2024-09-12T00:04:44.110 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.111 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.111 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:44.111 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.599274+0000", 2024-09-12T00:04:44.111 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4644999999999999e-05 2024-09-12T00:04:44.111 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.111 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:44.111 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.111 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.111 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.111 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:657 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.111 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.600087+0000", 2024-09-12T00:04:44.111 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 69.437600721999999, 2024-09-12T00:04:44.111 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0072536739999999999, 2024-09-12T00:04:44.111 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:44.112 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:44.112 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.112 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:44.112 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:44.112 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.112 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 657 2024-09-12T00:04:44.112 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.112 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:44.112 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.112 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:44.112 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600087+0000", 2024-09-12T00:04:44.112 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.112 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.113 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.113 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:44.113 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600087+0000", 2024-09-12T00:04:44.113 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.113 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.113 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.113 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:44.113 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600088+0000", 2024-09-12T00:04:44.113 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4759999999999999e-06 2024-09-12T00:04:44.113 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.113 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.113 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:44.113 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600093+0000", 2024-09-12T00:04:44.113 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4330000000000003e-06 2024-09-12T00:04:44.113 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.116 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.117 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:44.117 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600107+0000", 2024-09-12T00:04:44.117 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.348e-05 2024-09-12T00:04:44.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.117 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.117 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.117 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600116+0000", 2024-09-12T00:04:44.117 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7339999999999997e-06 2024-09-12T00:04:44.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.117 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.117 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.117 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600178+0000", 2024-09-12T00:04:44.118 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2382e-05 2024-09-12T00:04:44.118 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.118 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.118 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:44.118 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600233+0000", 2024-09-12T00:04:44.118 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4960999999999998e-05 2024-09-12T00:04:44.118 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.118 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.118 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:44.118 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.600373+0000", 2024-09-12T00:04:44.118 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013955599999999999 2024-09-12T00:04:44.118 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.118 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.118 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:44.119 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.604463+0000", 2024-09-12T00:04:44.119 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040905539999999997 2024-09-12T00:04:44.119 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.119 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.119 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.119 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607243+0000", 2024-09-12T00:04:44.119 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027799140000000001 2024-09-12T00:04:44.119 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.119 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.119 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:44.119 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607306+0000", 2024-09-12T00:04:44.119 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2575000000000003e-05 2024-09-12T00:04:44.119 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.119 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.120 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:44.120 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607340+0000", 2024-09-12T00:04:44.120 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4609e-05 2024-09-12T00:04:44.120 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.120 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:44.120 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.120 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.120 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.120 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:665 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.120 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.602284+0000", 2024-09-12T00:04:44.120 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 69.435403549, 2024-09-12T00:04:44.120 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055001709999999999, 2024-09-12T00:04:44.120 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:44.121 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:44.121 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.121 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:44.121 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:44.121 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.121 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 665 2024-09-12T00:04:44.121 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.121 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:44.121 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.121 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:44.121 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602284+0000", 2024-09-12T00:04:44.121 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.122 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.122 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.122 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:44.122 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602284+0000", 2024-09-12T00:04:44.122 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.122 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.122 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.122 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:44.122 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602285+0000", 2024-09-12T00:04:44.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6700000000000002e-07 2024-09-12T00:04:44.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.123 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.123 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:44.123 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602289+0000", 2024-09-12T00:04:44.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5519999999999998e-06 2024-09-12T00:04:44.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.123 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.123 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:44.123 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602304+0000", 2024-09-12T00:04:44.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5299e-05 2024-09-12T00:04:44.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.123 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.124 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.124 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602313+0000", 2024-09-12T00:04:44.124 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6379999999999993e-06 2024-09-12T00:04:44.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.124 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.124 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602370+0000", 2024-09-12T00:04:44.124 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6839000000000002e-05 2024-09-12T00:04:44.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.124 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:44.125 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602460+0000", 2024-09-12T00:04:44.125 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0323999999999998e-05 2024-09-12T00:04:44.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.125 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.125 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:44.125 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.602650+0000", 2024-09-12T00:04:44.125 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018955900000000001 2024-09-12T00:04:44.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.125 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.125 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:44.125 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607365+0000", 2024-09-12T00:04:44.125 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004715632 2024-09-12T00:04:44.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.125 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.126 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.126 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607698+0000", 2024-09-12T00:04:44.126 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00033217400000000002 2024-09-12T00:04:44.126 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.126 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.126 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:44.126 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607738+0000", 2024-09-12T00:04:44.126 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0516000000000003e-05 2024-09-12T00:04:44.126 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.126 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.126 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:44.126 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607784+0000", 2024-09-12T00:04:44.126 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5770999999999999e-05 2024-09-12T00:04:44.126 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.127 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:44.127 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.127 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.127 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:669 6.1c 6:3b93e7b4:::obj_delete_at_hint.0000000016:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.127 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.607439+0000", 2024-09-12T00:04:44.127 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 69.430248559000006, 2024-09-12T00:04:44.127 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057881649999999996, 2024-09-12T00:04:44.127 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:44.127 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:44.127 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.127 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:44.127 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:44.127 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.128 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 669 2024-09-12T00:04:44.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.128 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:44.128 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.128 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:44.128 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607439+0000", 2024-09-12T00:04:44.128 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.128 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.128 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:44.128 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607439+0000", 2024-09-12T00:04:44.128 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.128 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.128 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:44.129 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607439+0000", 2024-09-12T00:04:44.129 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9599999999999998e-07 2024-09-12T00:04:44.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.129 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:44.129 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607443+0000", 2024-09-12T00:04:44.129 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0340000000000001e-06 2024-09-12T00:04:44.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.129 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:44.129 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607453+0000", 2024-09-12T00:04:44.129 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682999999999999e-05 2024-09-12T00:04:44.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607461+0000", 2024-09-12T00:04:44.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6860000000000006e-06 2024-09-12T00:04:44.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607927+0000", 2024-09-12T00:04:44.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00046655600000000002 2024-09-12T00:04:44.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:44.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608017+0000", 2024-09-12T00:04:44.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9788000000000002e-05 2024-09-12T00:04:44.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.131 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:44.131 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.608262+0000", 2024-09-12T00:04:44.131 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024518499999999998 2024-09-12T00:04:44.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.131 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.131 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:44.131 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612908+0000", 2024-09-12T00:04:44.131 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046458009999999998 2024-09-12T00:04:44.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.131 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.131 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.131 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.613137+0000", 2024-09-12T00:04:44.131 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022881999999999999 2024-09-12T00:04:44.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.132 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.132 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:44.132 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.613178+0000", 2024-09-12T00:04:44.132 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0496e-05 2024-09-12T00:04:44.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.132 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.132 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:44.132 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.613227+0000", 2024-09-12T00:04:44.132 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9320000000000002e-05 2024-09-12T00:04:44.132 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.132 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:44.133 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.133 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.133 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:670 6.8 6:10010070:lc::lc.29:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.133 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.607563+0000", 2024-09-12T00:04:44.133 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 69.430124308000003, 2024-09-12T00:04:44.133 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054159179999999996, 2024-09-12T00:04:44.133 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:44.133 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:44.133 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.133 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:44.133 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:44.133 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.134 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 670 2024-09-12T00:04:44.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.134 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:44.134 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.134 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:44.134 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607563+0000", 2024-09-12T00:04:44.134 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.134 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.134 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:44.134 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607563+0000", 2024-09-12T00:04:44.134 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.134 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.135 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:44.135 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607564+0000", 2024-09-12T00:04:44.135 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.181e-06 2024-09-12T00:04:44.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.135 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.135 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:44.135 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607570+0000", 2024-09-12T00:04:44.135 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0809999999999999e-06 2024-09-12T00:04:44.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.135 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.135 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:44.135 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607582+0000", 2024-09-12T00:04:44.135 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1924e-05 2024-09-12T00:04:44.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.135 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.136 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.136 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607590+0000", 2024-09-12T00:04:44.136 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1370000000000002e-06 2024-09-12T00:04:44.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.136 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.136 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.136 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607669+0000", 2024-09-12T00:04:44.136 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8792e-05 2024-09-12T00:04:44.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.136 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.136 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:44.136 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607751+0000", 2024-09-12T00:04:44.136 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1641e-05 2024-09-12T00:04:44.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.137 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.137 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:44.137 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.607915+0000", 2024-09-12T00:04:44.137 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000163979 2024-09-12T00:04:44.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.137 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.137 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.137 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.609266+0000", 2024-09-12T00:04:44.137 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0013514810000000001 2024-09-12T00:04:44.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.137 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.137 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:44.138 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612885+0000", 2024-09-12T00:04:44.138 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003618834 2024-09-12T00:04:44.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.138 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.138 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:44.138 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612941+0000", 2024-09-12T00:04:44.138 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5815e-05 2024-09-12T00:04:44.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.138 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.138 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:44.138 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.612979+0000", 2024-09-12T00:04:44.138 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8053000000000003e-05 2024-09-12T00:04:44.138 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.138 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:44.138 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.139 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.139 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.139 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:925 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.139 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:34.697503+0000", 2024-09-12T00:04:44.139 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 69.340183846000002, 2024-09-12T00:04:44.139 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.006503755, 2024-09-12T00:04:44.139 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:44.139 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:44.139 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.139 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:44.139 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:44.139 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.139 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 925 2024-09-12T00:04:44.139 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.140 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:44.140 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.140 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:44.140 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697503+0000", 2024-09-12T00:04:44.140 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.140 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.140 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:44.140 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697503+0000", 2024-09-12T00:04:44.140 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.140 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.140 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:44.140 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697505+0000", 2024-09-12T00:04:44.141 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5030000000000001e-06 2024-09-12T00:04:44.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.141 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.141 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:44.141 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697512+0000", 2024-09-12T00:04:44.141 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7630000000000003e-06 2024-09-12T00:04:44.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.141 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.141 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:44.141 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697529+0000", 2024-09-12T00:04:44.141 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7345000000000001e-05 2024-09-12T00:04:44.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.141 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.141 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.141 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697539+0000", 2024-09-12T00:04:44.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0412e-05 2024-09-12T00:04:44.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697606+0000", 2024-09-12T00:04:44.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6531000000000004e-05 2024-09-12T00:04:44.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:44.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697673+0000", 2024-09-12T00:04:44.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6661000000000004e-05 2024-09-12T00:04:44.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:44.143 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.697839+0000", 2024-09-12T00:04:44.143 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016669699999999999 2024-09-12T00:04:44.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.143 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.143 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:44.143 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.700786+0000", 2024-09-12T00:04:44.143 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029466819999999999 2024-09-12T00:04:44.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.143 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.143 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.143 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703889+0000", 2024-09-12T00:04:44.143 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0031034830000000002 2024-09-12T00:04:44.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.143 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.143 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:44.144 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.703961+0000", 2024-09-12T00:04:44.144 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1178000000000002e-05 2024-09-12T00:04:44.144 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.144 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.144 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:44.144 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:34.704007+0000", 2024-09-12T00:04:44.144 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6499999999999999e-05 2024-09-12T00:04:44.144 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.144 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:44.144 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.144 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.144 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.144 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1641 3.26 e58/23 3:658fe58e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2__shadow_.hDHTDpIswwqRA2bHiHVxkhWqZde6XEj_1:head v 58'1, mlcod=0'0)", 2024-09-12T00:04:44.145 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:04:44.145 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.978671963, 2024-09-12T00:04:44.145 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014950144, 2024-09-12T00:04:44.145 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:44.145 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:44.145 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.145 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:44.145 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.145 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:44.145 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:04:44.145 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.145 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.145 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:44.146 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:04:44.146 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.146 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.146 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:44.146 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059017+0000", 2024-09-12T00:04:44.146 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.508e-06 2024-09-12T00:04:44.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.146 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.146 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:44.146 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061582+0000", 2024-09-12T00:04:44.146 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025654010000000001 2024-09-12T00:04:44.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.147 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:44.147 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061607+0000", 2024-09-12T00:04:44.147 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5028000000000002e-05 2024-09-12T00:04:44.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.147 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.147 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061619+0000", 2024-09-12T00:04:44.147 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1905999999999999e-05 2024-09-12T00:04:44.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.147 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.147 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061696+0000", 2024-09-12T00:04:44.147 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7305999999999995e-05 2024-09-12T00:04:44.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.148 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.148 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:44.148 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061717+0000", 2024-09-12T00:04:44.148 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0380000000000001e-05 2024-09-12T00:04:44.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.148 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.148 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:44.148 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073925+0000", 2024-09-12T00:04:44.148 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012208088000000001 2024-09-12T00:04:44.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.149 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.149 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:44.149 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073965+0000", 2024-09-12T00:04:44.149 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0527e-05 2024-09-12T00:04:44.149 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.149 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:44.149 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.149 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.150 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1775 3.30 3:0c2ae78d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:44.150 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:04:44.150 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.038834645, 2024-09-12T00:04:44.150 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020783729000000001, 2024-09-12T00:04:44.150 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:44.150 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:44.150 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.150 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:44.150 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:44.150 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.150 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1775 2024-09-12T00:04:44.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.151 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:44.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.151 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:44.151 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:04:44.151 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.151 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:44.151 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:04:44.151 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.152 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:44.152 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998856+0000", 2024-09-12T00:04:44.152 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6849999999999999e-06 2024-09-12T00:04:44.152 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.152 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.152 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:44.152 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001327+0000", 2024-09-12T00:04:44.152 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024706279999999999 2024-09-12T00:04:44.152 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.152 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.152 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:44.152 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001355+0000", 2024-09-12T00:04:44.152 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8419999999999999e-05 2024-09-12T00:04:44.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.153 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.153 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.153 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001366+0000", 2024-09-12T00:04:44.153 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1073999999999999e-05 2024-09-12T00:04:44.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.153 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.153 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.153 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001438+0000", 2024-09-12T00:04:44.153 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1389000000000004e-05 2024-09-12T00:04:44.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.153 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.153 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:44.153 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001548+0000", 2024-09-12T00:04:44.154 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110612 2024-09-12T00:04:44.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.154 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:44.154 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001639+0000", 2024-09-12T00:04:44.154 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0192999999999995e-05 2024-09-12T00:04:44.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.154 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:44.154 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019057+0000", 2024-09-12T00:04:44.154 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017418411000000002 2024-09-12T00:04:44.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.154 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.155 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019528+0000", 2024-09-12T00:04:44.155 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00047075699999999998 2024-09-12T00:04:44.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.155 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.155 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:44.155 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019577+0000", 2024-09-12T00:04:44.155 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8714999999999997e-05 2024-09-12T00:04:44.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.155 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.155 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:44.155 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019636+0000", 2024-09-12T00:04:44.155 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9845e-05 2024-09-12T00:04:44.155 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.156 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:44.156 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.156 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.156 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.156 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1780 3.16 e58/23 3:69d8ee52:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3_10Mb.:head v 58'1, mlcod=0'0)", 2024-09-12T00:04:44.156 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:04:44.156 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.012541353, 2024-09-12T00:04:44.156 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01408911, 2024-09-12T00:04:44.156 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:44.156 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:44.156 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.156 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:44.156 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.156 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:44.157 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:04:44.157 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.157 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.157 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.157 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:44.157 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:04:44.157 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.157 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.157 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.157 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:44.157 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025148+0000", 2024-09-12T00:04:44.157 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4229999999999999e-06 2024-09-12T00:04:44.157 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.157 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.158 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:44.158 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026337+0000", 2024-09-12T00:04:44.158 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011890589999999999 2024-09-12T00:04:44.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.158 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.158 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:44.158 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026362+0000", 2024-09-12T00:04:44.158 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4566000000000002e-05 2024-09-12T00:04:44.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.158 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.158 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.158 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026372+0000", 2024-09-12T00:04:44.158 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8509999999999994e-06 2024-09-12T00:04:44.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.159 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.159 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026448+0000", 2024-09-12T00:04:44.159 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6626999999999997e-05 2024-09-12T00:04:44.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.159 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:44.159 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026473+0000", 2024-09-12T00:04:44.159 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4647e-05 2024-09-12T00:04:44.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.159 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:44.159 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039120+0000", 2024-09-12T00:04:44.159 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012647122 2024-09-12T00:04:44.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.160 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.160 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:44.160 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039235+0000", 2024-09-12T00:04:44.160 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000114815 2024-09-12T00:04:44.160 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.160 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:44.160 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.160 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.160 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1912 3.16 e59/23 3:6a08f78f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.4__shadow_.EKM6BwfpK8ZqXIKQk7k4yJFkOWS2UlN_1:head v 59'3, mlcod=58'1)", 2024-09-12T00:04:44.160 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:35.141491+0000", 2024-09-12T00:04:44.160 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 8.8961962289999992, 2024-09-12T00:04:44.161 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012877679, 2024-09-12T00:04:44.161 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:44.161 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:44.161 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.161 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:44.161 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.161 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:44.161 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141491+0000", 2024-09-12T00:04:44.161 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.161 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.161 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.161 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:44.161 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141491+0000", 2024-09-12T00:04:44.161 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:44.162 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.162 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.162 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:44.162 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141493+0000", 2024-09-12T00:04:44.162 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2539999999999999e-06 2024-09-12T00:04:44.162 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.162 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.162 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:44.162 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.143346+0000", 2024-09-12T00:04:44.162 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0018525 2024-09-12T00:04:44.162 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.162 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.162 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:44.162 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.143365+0000", 2024-09-12T00:04:44.163 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9173000000000001e-05 2024-09-12T00:04:44.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.163 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.163 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.163 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.143377+0000", 2024-09-12T00:04:44.163 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1824999999999999e-05 2024-09-12T00:04:44.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.163 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.163 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:44.163 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.143454+0000", 2024-09-12T00:04:44.163 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7100000000000004e-05 2024-09-12T00:04:44.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.163 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.163 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:44.164 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.143481+0000", 2024-09-12T00:04:44.164 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6849e-05 2024-09-12T00:04:44.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.164 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:44.164 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154309+0000", 2024-09-12T00:04:44.164 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010827922 2024-09-12T00:04:44.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:44.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:44.164 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:44.164 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154369+0000", 2024-09-12T00:04:44.165 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0056000000000002e-05 2024-09-12T00:04:44.165 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.165 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:44.165 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.165 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:44.165 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:44.165 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:44.167 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:04:44.167 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:44.166+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:44.268 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:44.266+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:44.299 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:44.300 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:04:44.300 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:04:44.300 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:44.314 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:04:44.402 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:44.402+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:44.466 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:04:44.469 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:44.472+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:44.475 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:44.475 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:04:44.475 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:04:44.475 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:04:44.475 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:44.490 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:04:44.577 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:44.578+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:44.615 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:44.615 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:44.631 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:44.631 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:44.650 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:44.650 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:44.658 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:04:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:04:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:04:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.379355+0000", 2024-09-12T00:04:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 70.279381748999995, 2024-09-12T00:04:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.01135805, 2024-09-12T00:04:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 210 2024-09-12T00:04:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.379355+0000", 2024-09-12T00:04:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.379355+0000", 2024-09-12T00:04:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.379358+0000", 2024-09-12T00:04:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3939999999999999e-06 2024-09-12T00:04:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.379369+0000", 2024-09-12T00:04:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0835999999999999e-05 2024-09-12T00:04:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.379400+0000", 2024-09-12T00:04:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1313999999999999e-05 2024-09-12T00:04:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.379421+0000", 2024-09-12T00:04:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0622999999999999e-05 2024-09-12T00:04:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.379576+0000", 2024-09-12T00:04:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015531799999999999 2024-09-12T00:04:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op must wait for map", 2024-09-12T00:04:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.379591+0000", 2024-09-12T00:04:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5537e-05 2024-09-12T00:04:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.386416+0000", 2024-09-12T00:04:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0068249180000000001 2024-09-12T00:04:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.386748+0000", 2024-09-12T00:04:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00033200999999999999 2024-09-12T00:04:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.387362+0000", 2024-09-12T00:04:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00061383499999999997 2024-09-12T00:04:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.388623+0000", 2024-09-12T00:04:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012604319999999999 2024-09-12T00:04:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.390566+0000", 2024-09-12T00:04:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001943097 2024-09-12T00:04:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.390652+0000", 2024-09-12T00:04:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6428999999999995e-05 2024-09-12T00:04:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.390713+0000", 2024-09-12T00:04:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1307000000000001e-05 2024-09-12T00:04:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:238 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.485103+0000", 2024-09-12T00:04:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 70.173634422999996, 2024-09-12T00:04:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0065205209999999996, 2024-09-12T00:04:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 238 2024-09-12T00:04:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485103+0000", 2024-09-12T00:04:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485103+0000", 2024-09-12T00:04:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485105+0000", 2024-09-12T00:04:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6060000000000001e-06 2024-09-12T00:04:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485117+0000", 2024-09-12T00:04:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.172e-05 2024-09-12T00:04:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485151+0000", 2024-09-12T00:04:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3726999999999997e-05 2024-09-12T00:04:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485171+0000", 2024-09-12T00:04:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9766e-05 2024-09-12T00:04:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485314+0000", 2024-09-12T00:04:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014306200000000001 2024-09-12T00:04:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485647+0000", 2024-09-12T00:04:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000333708 2024-09-12T00:04:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486167+0000", 2024-09-12T00:04:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00052006800000000005 2024-09-12T00:04:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.490890+0000", 2024-09-12T00:04:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047229630000000002 2024-09-12T00:04:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491471+0000", 2024-09-12T00:04:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00058063500000000003 2024-09-12T00:04:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491555+0000", 2024-09-12T00:04:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3863000000000007e-05 2024-09-12T00:04:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491623+0000", 2024-09-12T00:04:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8403000000000002e-05 2024-09-12T00:04:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:239 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.485976+0000", 2024-09-12T00:04:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 70.172760717000003, 2024-09-12T00:04:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061240579999999999, 2024-09-12T00:04:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 239 2024-09-12T00:04:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485976+0000", 2024-09-12T00:04:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485976+0000", 2024-09-12T00:04:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485978+0000", 2024-09-12T00:04:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6160000000000001e-06 2024-09-12T00:04:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.485988+0000", 2024-09-12T00:04:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7270000000000002e-06 2024-09-12T00:04:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486012+0000", 2024-09-12T00:04:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4620000000000001e-05 2024-09-12T00:04:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486023+0000", 2024-09-12T00:04:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1003e-05 2024-09-12T00:04:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486139+0000", 2024-09-12T00:04:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000115709 2024-09-12T00:04:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486410+0000", 2024-09-12T00:04:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027089399999999999 2024-09-12T00:04:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486899+0000", 2024-09-12T00:04:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00048920300000000001 2024-09-12T00:04:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.488841+0000", 2024-09-12T00:04:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001941707 2024-09-12T00:04:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491881+0000", 2024-09-12T00:04:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0030405010000000001 2024-09-12T00:04:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491992+0000", 2024-09-12T00:04:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011072499999999999 2024-09-12T00:04:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492101+0000", 2024-09-12T00:04:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000108353 2024-09-12T00:04:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.681 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:237 6.0 e35/29 6:013d6c33:gc::gc.30:head v 35'3, mlcod=35'1)", 2024-09-12T00:04:44.681 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.486272+0000", 2024-09-12T00:04:44.681 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 70.172464989999995, 2024-09-12T00:04:44.681 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0056896949999999998, 2024-09-12T00:04:44.681 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:44.681 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:44.681 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.682 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:44.682 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.682 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:44.682 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486272+0000", 2024-09-12T00:04:44.682 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.682 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.682 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.682 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:44.682 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486272+0000", 2024-09-12T00:04:44.682 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.682 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.683 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.683 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:44.683 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486274+0000", 2024-09-12T00:04:44.683 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9300000000000002e-06 2024-09-12T00:04:44.683 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.683 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.683 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:44.683 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486288+0000", 2024-09-12T00:04:44.683 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3910000000000001e-05 2024-09-12T00:04:44.683 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.683 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.683 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:44.683 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486325+0000", 2024-09-12T00:04:44.684 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7243000000000002e-05 2024-09-12T00:04:44.684 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.684 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.684 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.684 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486345+0000", 2024-09-12T00:04:44.684 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.965e-05 2024-09-12T00:04:44.684 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.684 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.684 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.684 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486468+0000", 2024-09-12T00:04:44.684 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012352899999999999 2024-09-12T00:04:44.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.685 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.685 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:44.685 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.486518+0000", 2024-09-12T00:04:44.685 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9406000000000001e-05 2024-09-12T00:04:44.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.685 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.685 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:44.685 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491839+0000", 2024-09-12T00:04:44.685 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053210150000000001 2024-09-12T00:04:44.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.686 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.686 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:44.686 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.491962+0000", 2024-09-12T00:04:44.686 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012301200000000001 2024-09-12T00:04:44.686 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.686 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:44.686 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.686 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.686 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:272 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.686 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.492825+0000", 2024-09-12T00:04:44.686 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 70.165912148999993, 2024-09-12T00:04:44.687 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0065149680000000003, 2024-09-12T00:04:44.687 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:44.687 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:44.687 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.687 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:44.687 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:44.687 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.687 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 272 2024-09-12T00:04:44.687 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.687 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:44.687 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.688 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:44.688 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492825+0000", 2024-09-12T00:04:44.688 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.688 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.688 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:44.688 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492825+0000", 2024-09-12T00:04:44.688 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.688 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.688 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:44.688 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492827+0000", 2024-09-12T00:04:44.689 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4600000000000002e-06 2024-09-12T00:04:44.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.689 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:44.689 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.492841+0000", 2024-09-12T00:04:44.689 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3806e-05 2024-09-12T00:04:44.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.689 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:44.689 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.493399+0000", 2024-09-12T00:04:44.689 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00055804599999999998 2024-09-12T00:04:44.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.690 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.690 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.690 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.493425+0000", 2024-09-12T00:04:44.690 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5795999999999998e-05 2024-09-12T00:04:44.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.690 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.690 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.690 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.493602+0000", 2024-09-12T00:04:44.690 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000176439 2024-09-12T00:04:44.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.690 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.690 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:44.691 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.493825+0000", 2024-09-12T00:04:44.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000223334 2024-09-12T00:04:44.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.691 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.691 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:44.691 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.494238+0000", 2024-09-12T00:04:44.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0004127 2024-09-12T00:04:44.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.691 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.691 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:44.691 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.496411+0000", 2024-09-12T00:04:44.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0021736049999999999 2024-09-12T00:04:44.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.692 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.692 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.692 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499154+0000", 2024-09-12T00:04:44.692 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0027423399999999998 2024-09-12T00:04:44.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.692 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.692 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:44.692 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499244+0000", 2024-09-12T00:04:44.692 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0789000000000001e-05 2024-09-12T00:04:44.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.692 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.693 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:44.693 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.499340+0000", 2024-09-12T00:04:44.693 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5653000000000001e-05 2024-09-12T00:04:44.693 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.693 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:44.693 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.693 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.693 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:300 6.f e35/29 6:f1983ba0:::obj_delete_at_hint.0000000001:head v 35'2, mlcod=0'0)", 2024-09-12T00:04:44.693 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.500751+0000", 2024-09-12T00:04:44.693 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 70.157985827000005, 2024-09-12T00:04:44.694 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0084073080000000005, 2024-09-12T00:04:44.694 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:44.694 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:44.694 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.694 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:44.694 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.694 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:44.694 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.500751+0000", 2024-09-12T00:04:44.694 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.694 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.695 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:44.695 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.500751+0000", 2024-09-12T00:04:44.695 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.695 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:44.695 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.500753+0000", 2024-09-12T00:04:44.695 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.747e-06 2024-09-12T00:04:44.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.695 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:44.696 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.500767+0000", 2024-09-12T00:04:44.696 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3492999999999999e-05 2024-09-12T00:04:44.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.696 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.696 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:44.696 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.500801+0000", 2024-09-12T00:04:44.696 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4919999999999998e-05 2024-09-12T00:04:44.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.696 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.696 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.697 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.500820+0000", 2024-09-12T00:04:44.697 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8830000000000001e-05 2024-09-12T00:04:44.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.697 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.697 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.697 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.501058+0000", 2024-09-12T00:04:44.697 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000237755 2024-09-12T00:04:44.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.697 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.697 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:44.697 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.501112+0000", 2024-09-12T00:04:44.698 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3585999999999998e-05 2024-09-12T00:04:44.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.698 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.698 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:44.698 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509031+0000", 2024-09-12T00:04:44.698 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0079190449999999996 2024-09-12T00:04:44.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.698 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.698 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:44.698 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509159+0000", 2024-09-12T00:04:44.698 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012793200000000001 2024-09-12T00:04:44.698 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.699 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:44.699 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.699 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.699 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:320 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.699 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.502392+0000", 2024-09-12T00:04:44.699 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 70.156345607000006, 2024-09-12T00:04:44.699 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0069714160000000002, 2024-09-12T00:04:44.699 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:44.699 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:44.699 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.700 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:44.700 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:44.700 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.700 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 320 2024-09-12T00:04:44.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.700 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:44.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.700 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:44.700 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.502392+0000", 2024-09-12T00:04:44.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:44.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.502392+0000", 2024-09-12T00:04:44.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:44.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.502394+0000", 2024-09-12T00:04:44.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2259999999999999e-06 2024-09-12T00:04:44.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:44.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.502406+0000", 2024-09-12T00:04:44.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.22e-05 2024-09-12T00:04:44.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:44.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.502437+0000", 2024-09-12T00:04:44.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1074000000000001e-05 2024-09-12T00:04:44.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.502457+0000", 2024-09-12T00:04:44.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0143e-05 2024-09-12T00:04:44.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.502603+0000", 2024-09-12T00:04:44.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000145978 2024-09-12T00:04:44.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:44.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.502747+0000", 2024-09-12T00:04:44.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014341199999999999 2024-09-12T00:04:44.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:44.704 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.502998+0000", 2024-09-12T00:04:44.704 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025188199999999998 2024-09-12T00:04:44.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.704 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.704 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.704 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.504854+0000", 2024-09-12T00:04:44.704 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0018553969999999999 2024-09-12T00:04:44.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.704 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.704 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:44.704 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509098+0000", 2024-09-12T00:04:44.704 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004244383 2024-09-12T00:04:44.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.705 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:44.705 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509230+0000", 2024-09-12T00:04:44.705 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013213600000000001 2024-09-12T00:04:44.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.705 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:44.705 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.509363+0000", 2024-09-12T00:04:44.705 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013258500000000001 2024-09-12T00:04:44.705 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.705 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:44.706 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.706 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:353 6.18 6:1fdc4f8e:lc::lc.10:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.706 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.513823+0000", 2024-09-12T00:04:44.706 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 70.144913908999996, 2024-09-12T00:04:44.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053204819999999996, 2024-09-12T00:04:44.706 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:44.706 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:44.706 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.706 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:44.706 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:44.706 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.707 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 353 2024-09-12T00:04:44.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.707 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:44.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:44.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513823+0000", 2024-09-12T00:04:44.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:44.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513823+0000", 2024-09-12T00:04:44.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.708 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.708 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:44.708 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513826+0000", 2024-09-12T00:04:44.708 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3470000000000001e-06 2024-09-12T00:04:44.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.708 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.708 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:44.708 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513837+0000", 2024-09-12T00:04:44.708 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1687e-05 2024-09-12T00:04:44.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.709 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.709 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:44.709 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513866+0000", 2024-09-12T00:04:44.709 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9045999999999999e-05 2024-09-12T00:04:44.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.709 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.709 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.709 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.513894+0000", 2024-09-12T00:04:44.709 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7373e-05 2024-09-12T00:04:44.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.709 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.710 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.710 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514066+0000", 2024-09-12T00:04:44.710 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017232900000000001 2024-09-12T00:04:44.710 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.710 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.710 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:44.710 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514210+0000", 2024-09-12T00:04:44.710 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000144115 2024-09-12T00:04:44.710 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.710 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.710 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:44.710 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.514504+0000", 2024-09-12T00:04:44.711 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00029396400000000002 2024-09-12T00:04:44.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.711 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.711 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.711 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.517622+0000", 2024-09-12T00:04:44.711 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0031183669999999999 2024-09-12T00:04:44.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.711 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.711 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:44.711 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.518940+0000", 2024-09-12T00:04:44.711 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001317585 2024-09-12T00:04:44.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:44.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519063+0000", 2024-09-12T00:04:44.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000123289 2024-09-12T00:04:44.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:44.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.519144+0000", 2024-09-12T00:04:44.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.038e-05 2024-09-12T00:04:44.712 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.712 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:44.713 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.713 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.713 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:418 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.713 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.530697+0000", 2024-09-12T00:04:44.713 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 70.128040399, 2024-09-12T00:04:44.713 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0058430890000000001, 2024-09-12T00:04:44.713 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:44.713 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:44.713 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.713 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:44.714 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:44.714 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.714 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 418 2024-09-12T00:04:44.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.714 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:44.714 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.714 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:44.714 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.530697+0000", 2024-09-12T00:04:44.714 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.714 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.715 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:44.715 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.530697+0000", 2024-09-12T00:04:44.715 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.715 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.715 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:44.715 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.530699+0000", 2024-09-12T00:04:44.715 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3829999999999999e-06 2024-09-12T00:04:44.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.715 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.715 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:44.716 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.530712+0000", 2024-09-12T00:04:44.716 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.279e-05 2024-09-12T00:04:44.716 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.716 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.716 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:44.716 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.530739+0000", 2024-09-12T00:04:44.716 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.741e-05 2024-09-12T00:04:44.716 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.716 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.716 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.716 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.530758+0000", 2024-09-12T00:04:44.716 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8595999999999999e-05 2024-09-12T00:04:44.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.717 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.717 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.717 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.530893+0000", 2024-09-12T00:04:44.717 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000135091 2024-09-12T00:04:44.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.717 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.717 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:44.717 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.531017+0000", 2024-09-12T00:04:44.717 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012423299999999999 2024-09-12T00:04:44.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.717 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:44.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.531387+0000", 2024-09-12T00:04:44.718 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00036971399999999999 2024-09-12T00:04:44.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.534048+0000", 2024-09-12T00:04:44.718 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002661095 2024-09-12T00:04:44.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:44.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536254+0000", 2024-09-12T00:04:44.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0022059229999999998 2024-09-12T00:04:44.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.719 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:44.719 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536396+0000", 2024-09-12T00:04:44.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014159599999999999 2024-09-12T00:04:44.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.719 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:44.719 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536540+0000", 2024-09-12T00:04:44.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000144258 2024-09-12T00:04:44.719 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.720 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:44.720 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.720 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.720 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:419 6.b 6:d5e0c857:lc::lc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.720 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.531125+0000", 2024-09-12T00:04:44.720 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 70.127611907000002, 2024-09-12T00:04:44.720 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053831210000000003, 2024-09-12T00:04:44.720 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:44.720 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:44.720 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.721 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:44.721 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:44.721 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.721 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 419 2024-09-12T00:04:44.721 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.721 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:44.721 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.721 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:44.721 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.531125+0000", 2024-09-12T00:04:44.721 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.722 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.722 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:44.722 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.531125+0000", 2024-09-12T00:04:44.722 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.722 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.722 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:44.722 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.531127+0000", 2024-09-12T00:04:44.722 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.238e-06 2024-09-12T00:04:44.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.722 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.723 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:44.723 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.531137+0000", 2024-09-12T00:04:44.723 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4020000000000008e-06 2024-09-12T00:04:44.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.723 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:44.723 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.531157+0000", 2024-09-12T00:04:44.723 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0285999999999999e-05 2024-09-12T00:04:44.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.724 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.724 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.531170+0000", 2024-09-12T00:04:44.724 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2489e-05 2024-09-12T00:04:44.724 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.724 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.724 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.724 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.531282+0000", 2024-09-12T00:04:44.724 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000112185 2024-09-12T00:04:44.724 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.724 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.724 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:44.725 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.531583+0000", 2024-09-12T00:04:44.725 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00030135200000000001 2024-09-12T00:04:44.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.725 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.725 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:44.725 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.531990+0000", 2024-09-12T00:04:44.725 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040675100000000001 2024-09-12T00:04:44.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.725 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.725 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.728 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.533226+0000", 2024-09-12T00:04:44.729 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012362289999999999 2024-09-12T00:04:44.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.729 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.729 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:44.729 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536301+0000", 2024-09-12T00:04:44.729 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0030750909999999998 2024-09-12T00:04:44.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.730 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.730 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:44.730 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536416+0000", 2024-09-12T00:04:44.730 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000115208 2024-09-12T00:04:44.730 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.730 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.730 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:44.731 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.536508+0000", 2024-09-12T00:04:44.731 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1890000000000003e-05 2024-09-12T00:04:44.731 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.731 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:44.731 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.731 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.731 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.731 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:448 6.b 6:d5e0c857:lc::lc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.732 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.538511+0000", 2024-09-12T00:04:44.732 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 70.120225880000007, 2024-09-12T00:04:44.732 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0055566979999999997, 2024-09-12T00:04:44.732 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:44.732 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:44.732 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.732 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:44.732 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:44.733 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.733 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 448 2024-09-12T00:04:44.733 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.733 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:44.733 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.733 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:44.733 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538511+0000", 2024-09-12T00:04:44.733 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.734 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.734 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:44.734 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538511+0000", 2024-09-12T00:04:44.734 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.734 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.734 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:44.735 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538513+0000", 2024-09-12T00:04:44.735 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.576e-06 2024-09-12T00:04:44.735 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.735 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.735 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:44.735 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538521+0000", 2024-09-12T00:04:44.735 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7249999999999997e-06 2024-09-12T00:04:44.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.736 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.736 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:44.736 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538540+0000", 2024-09-12T00:04:44.736 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9656999999999998e-05 2024-09-12T00:04:44.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.736 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.736 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.737 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538550+0000", 2024-09-12T00:04:44.737 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0227000000000001e-05 2024-09-12T00:04:44.737 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.737 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.737 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.737 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538704+0000", 2024-09-12T00:04:44.737 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000153282 2024-09-12T00:04:44.738 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.738 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.738 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:44.738 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538845+0000", 2024-09-12T00:04:44.738 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014140100000000001 2024-09-12T00:04:44.738 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.738 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.738 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:44.739 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539271+0000", 2024-09-12T00:04:44.739 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000425728 2024-09-12T00:04:44.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.739 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.739 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.739 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.540501+0000", 2024-09-12T00:04:44.739 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012298739999999999 2024-09-12T00:04:44.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.740 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.740 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:44.740 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543888+0000", 2024-09-12T00:04:44.740 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033877180000000001 2024-09-12T00:04:44.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.740 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.740 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:44.741 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543975+0000", 2024-09-12T00:04:44.741 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6293999999999997e-05 2024-09-12T00:04:44.741 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.741 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.741 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:44.741 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544068+0000", 2024-09-12T00:04:44.741 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3215999999999997e-05 2024-09-12T00:04:44.742 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.742 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:44.742 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.742 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.742 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.742 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:450 6.16 6:6d4431ed:lc::lc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.742 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.538866+0000", 2024-09-12T00:04:44.742 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 70.119871003, 2024-09-12T00:04:44.743 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059883590000000004, 2024-09-12T00:04:44.743 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:44.743 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:44.743 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.743 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:44.743 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:44.743 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.744 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 450 2024-09-12T00:04:44.744 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.744 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:44.744 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.744 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:44.744 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538866+0000", 2024-09-12T00:04:44.745 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.745 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.745 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.745 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:44.745 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538866+0000", 2024-09-12T00:04:44.745 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.745 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.746 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.746 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:44.746 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538869+0000", 2024-09-12T00:04:44.746 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9739999999999998e-06 2024-09-12T00:04:44.746 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.746 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.746 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:44.747 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538882+0000", 2024-09-12T00:04:44.747 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2594e-05 2024-09-12T00:04:44.747 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.747 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.747 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:44.747 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538911+0000", 2024-09-12T00:04:44.748 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9074e-05 2024-09-12T00:04:44.748 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.748 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.748 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.748 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.538930+0000", 2024-09-12T00:04:44.748 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8729e-05 2024-09-12T00:04:44.748 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.748 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.749 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.749 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539125+0000", 2024-09-12T00:04:44.749 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000195372 2024-09-12T00:04:44.749 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.749 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.749 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:44.749 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539259+0000", 2024-09-12T00:04:44.750 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133943 2024-09-12T00:04:44.750 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.750 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.750 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:44.750 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.539554+0000", 2024-09-12T00:04:44.750 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00029477600000000001 2024-09-12T00:04:44.750 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.751 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.751 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.751 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.540900+0000", 2024-09-12T00:04:44.751 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001346786 2024-09-12T00:04:44.751 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.751 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.751 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:44.751 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544690+0000", 2024-09-12T00:04:44.752 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037900640000000001 2024-09-12T00:04:44.752 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.752 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.752 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:44.752 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544788+0000", 2024-09-12T00:04:44.752 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7120000000000005e-05 2024-09-12T00:04:44.752 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.753 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.753 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:44.753 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.544855+0000", 2024-09-12T00:04:44.753 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6927000000000005e-05 2024-09-12T00:04:44.753 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.753 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:44.753 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.754 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.754 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:453 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.754 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.540315+0000", 2024-09-12T00:04:44.754 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 70.118421796999996, 2024-09-12T00:04:44.754 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054614520000000003, 2024-09-12T00:04:44.754 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:44.754 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:44.755 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.755 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:44.755 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:44.755 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.755 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 453 2024-09-12T00:04:44.755 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.755 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:44.756 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.756 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:44.756 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.540315+0000", 2024-09-12T00:04:44.756 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.756 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.756 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.756 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:44.756 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.540315+0000", 2024-09-12T00:04:44.757 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.757 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.757 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.757 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:44.757 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.540317+0000", 2024-09-12T00:04:44.757 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9999999999999999e-06 2024-09-12T00:04:44.757 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.757 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.758 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:44.758 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.540327+0000", 2024-09-12T00:04:44.758 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1949999999999992e-06 2024-09-12T00:04:44.758 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.758 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.758 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:44.758 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.540355+0000", 2024-09-12T00:04:44.758 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8524e-05 2024-09-12T00:04:44.759 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.759 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.759 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.759 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.540373+0000", 2024-09-12T00:04:44.759 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7952999999999999e-05 2024-09-12T00:04:44.759 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.759 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.759 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.760 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.540514+0000", 2024-09-12T00:04:44.760 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014090399999999999 2024-09-12T00:04:44.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.760 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.760 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:44.760 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.540702+0000", 2024-09-12T00:04:44.760 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000188042 2024-09-12T00:04:44.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.761 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.761 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:44.761 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.541038+0000", 2024-09-12T00:04:44.761 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00033560099999999999 2024-09-12T00:04:44.761 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.761 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.761 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.761 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.543304+0000", 2024-09-12T00:04:44.762 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0022663140000000002 2024-09-12T00:04:44.762 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.762 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.762 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:44.762 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.545619+0000", 2024-09-12T00:04:44.762 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0023154899999999999 2024-09-12T00:04:44.762 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.762 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.763 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:44.763 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.545701+0000", 2024-09-12T00:04:44.763 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1169999999999997e-05 2024-09-12T00:04:44.763 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.763 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.763 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:44.763 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.545777+0000", 2024-09-12T00:04:44.763 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6259000000000003e-05 2024-09-12T00:04:44.763 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.764 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:44.764 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.764 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.764 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.764 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:646 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.764 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.598362+0000", 2024-09-12T00:04:44.764 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 70.060374789999997, 2024-09-12T00:04:44.765 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053640759999999997, 2024-09-12T00:04:44.765 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:44.765 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:44.765 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.765 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:44.765 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:44.765 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.765 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 646 2024-09-12T00:04:44.766 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.766 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:44.766 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.766 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:44.766 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598362+0000", 2024-09-12T00:04:44.766 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.766 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.766 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.766 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:44.767 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598362+0000", 2024-09-12T00:04:44.767 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.767 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.767 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.767 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:44.767 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598365+0000", 2024-09-12T00:04:44.767 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6740000000000001e-06 2024-09-12T00:04:44.767 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.768 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.768 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:44.768 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598377+0000", 2024-09-12T00:04:44.768 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2405999999999999e-05 2024-09-12T00:04:44.768 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.768 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.768 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:44.769 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598405+0000", 2024-09-12T00:04:44.769 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.711e-05 2024-09-12T00:04:44.769 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.769 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.769 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.769 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598419+0000", 2024-09-12T00:04:44.769 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4496e-05 2024-09-12T00:04:44.769 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.769 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.770 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.770 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598537+0000", 2024-09-12T00:04:44.770 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117806 2024-09-12T00:04:44.770 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.770 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.770 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:44.770 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598640+0000", 2024-09-12T00:04:44.770 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000103089 2024-09-12T00:04:44.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.771 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.771 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:44.771 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.598818+0000", 2024-09-12T00:04:44.771 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017786500000000001 2024-09-12T00:04:44.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.771 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.771 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:44.772 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.599860+0000", 2024-09-12T00:04:44.772 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0010425499999999999 2024-09-12T00:04:44.772 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.772 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.772 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.772 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603631+0000", 2024-09-12T00:04:44.772 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003770991 2024-09-12T00:04:44.772 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.773 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.773 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:44.773 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603685+0000", 2024-09-12T00:04:44.773 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3526000000000002e-05 2024-09-12T00:04:44.773 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.773 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.773 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:44.773 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.603726+0000", 2024-09-12T00:04:44.774 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1563000000000002e-05 2024-09-12T00:04:44.774 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.774 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:44.774 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.774 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.774 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.774 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:664 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.774 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.604102+0000", 2024-09-12T00:04:44.775 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 70.054635473999994, 2024-09-12T00:04:44.775 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053581949999999996, 2024-09-12T00:04:44.775 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:44.775 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:44.775 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.775 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:44.775 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:44.775 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.776 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 664 2024-09-12T00:04:44.776 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.776 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:44.776 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.776 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:44.776 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.604102+0000", 2024-09-12T00:04:44.776 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.776 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.777 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.777 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:44.777 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.604102+0000", 2024-09-12T00:04:44.777 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.777 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.777 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.777 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:44.778 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.604103+0000", 2024-09-12T00:04:44.778 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.071e-06 2024-09-12T00:04:44.778 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.778 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.778 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:44.778 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.604107+0000", 2024-09-12T00:04:44.778 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6330000000000004e-06 2024-09-12T00:04:44.779 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.779 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.779 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:44.779 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.604118+0000", 2024-09-12T00:04:44.779 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0716999999999999e-05 2024-09-12T00:04:44.779 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.779 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.780 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.780 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.604125+0000", 2024-09-12T00:04:44.780 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.0849999999999999e-06 2024-09-12T00:04:44.780 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.780 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.780 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.780 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.604200+0000", 2024-09-12T00:04:44.780 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4357999999999995e-05 2024-09-12T00:04:44.781 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.781 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.781 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:44.781 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.604315+0000", 2024-09-12T00:04:44.781 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000115505 2024-09-12T00:04:44.781 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.781 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.781 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:44.782 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.604499+0000", 2024-09-12T00:04:44.782 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018364499999999999 2024-09-12T00:04:44.782 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.782 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.782 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:44.782 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.605291+0000", 2024-09-12T00:04:44.782 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00079249300000000002 2024-09-12T00:04:44.783 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.783 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.783 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.783 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.609384+0000", 2024-09-12T00:04:44.783 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040931159999999999 2024-09-12T00:04:44.783 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.783 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.783 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:44.783 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.609425+0000", 2024-09-12T00:04:44.784 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0861000000000001e-05 2024-09-12T00:04:44.784 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.784 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.784 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:44.784 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.609460+0000", 2024-09-12T00:04:44.784 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4711e-05 2024-09-12T00:04:44.784 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.785 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:44.785 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.785 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.785 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.785 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:741 6.b 6:d5e0c857:lc::lc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.785 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.633835+0000", 2024-09-12T00:04:44.785 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 70.024901732000004, 2024-09-12T00:04:44.785 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0073974219999999999, 2024-09-12T00:04:44.786 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:44.786 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:44.786 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.786 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:44.786 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:44.786 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.786 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 741 2024-09-12T00:04:44.786 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.787 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:44.787 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.787 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:44.787 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633835+0000", 2024-09-12T00:04:44.787 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.787 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.787 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.788 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:44.788 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633835+0000", 2024-09-12T00:04:44.788 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.788 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.788 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.788 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:44.788 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633838+0000", 2024-09-12T00:04:44.788 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5069999999999999e-06 2024-09-12T00:04:44.789 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.789 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.789 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:44.789 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633849+0000", 2024-09-12T00:04:44.789 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1357e-05 2024-09-12T00:04:44.789 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.789 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.790 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:44.790 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633878+0000", 2024-09-12T00:04:44.790 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8455000000000001e-05 2024-09-12T00:04:44.790 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.790 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.790 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.790 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.633900+0000", 2024-09-12T00:04:44.790 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2645000000000001e-05 2024-09-12T00:04:44.791 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.791 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.791 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.791 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634026+0000", 2024-09-12T00:04:44.791 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012531900000000001 2024-09-12T00:04:44.791 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.791 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.791 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:44.792 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634176+0000", 2024-09-12T00:04:44.792 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015004499999999999 2024-09-12T00:04:44.792 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.792 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.792 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:44.792 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.634372+0000", 2024-09-12T00:04:44.792 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000195754 2024-09-12T00:04:44.793 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.793 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.793 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:44.793 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.638369+0000", 2024-09-12T00:04:44.793 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039971219999999997 2024-09-12T00:04:44.793 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.793 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.793 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.794 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.641041+0000", 2024-09-12T00:04:44.794 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026719880000000001 2024-09-12T00:04:44.794 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.794 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.794 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:44.794 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.641129+0000", 2024-09-12T00:04:44.794 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7905000000000006e-05 2024-09-12T00:04:44.794 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.795 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.795 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:44.795 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.641233+0000", 2024-09-12T00:04:44.795 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000104325 2024-09-12T00:04:44.795 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.795 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:44.795 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.795 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.796 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.796 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:804 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.796 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.657079+0000", 2024-09-12T00:04:44.796 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 70.001658477000007, 2024-09-12T00:04:44.796 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006449537, 2024-09-12T00:04:44.796 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:44.796 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:44.797 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.797 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:44.797 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:44.797 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.797 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 804 2024-09-12T00:04:44.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.797 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:44.797 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.798 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:44.798 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.657079+0000", 2024-09-12T00:04:44.798 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.798 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.798 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.798 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:44.798 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.657079+0000", 2024-09-12T00:04:44.798 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.799 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.799 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.799 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:44.799 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.657080+0000", 2024-09-12T00:04:44.799 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0780000000000001e-06 2024-09-12T00:04:44.799 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.799 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.799 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:44.800 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.657085+0000", 2024-09-12T00:04:44.800 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1159999999999998e-06 2024-09-12T00:04:44.800 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.800 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.800 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:44.800 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.657098+0000", 2024-09-12T00:04:44.800 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3573e-05 2024-09-12T00:04:44.801 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.801 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.801 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.657105+0000", 2024-09-12T00:04:44.801 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8109999999999997e-06 2024-09-12T00:04:44.801 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.801 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.802 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.657167+0000", 2024-09-12T00:04:44.802 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1978999999999997e-05 2024-09-12T00:04:44.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.802 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.802 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:44.802 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.657235+0000", 2024-09-12T00:04:44.802 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.7339e-05 2024-09-12T00:04:44.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.803 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:44.803 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.657374+0000", 2024-09-12T00:04:44.803 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013934400000000001 2024-09-12T00:04:44.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.803 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.803 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.658631+0000", 2024-09-12T00:04:44.804 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012567780000000001 2024-09-12T00:04:44.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.804 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.804 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:44.804 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.663352+0000", 2024-09-12T00:04:44.804 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004721444 2024-09-12T00:04:44.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.804 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.805 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:44.805 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.663456+0000", 2024-09-12T00:04:44.805 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010382600000000001 2024-09-12T00:04:44.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.805 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:44.805 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.663528+0000", 2024-09-12T00:04:44.806 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2249000000000006e-05 2024-09-12T00:04:44.806 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.806 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:44.806 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.806 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.806 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:826 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T00:04:44.806 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:03:34.667092+0000", 2024-09-12T00:04:44.807 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 69.991645242000004, 2024-09-12T00:04:44.807 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0057279729999999999, 2024-09-12T00:04:44.807 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:44.807 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:44.807 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.807 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:44.807 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:44.808 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.808 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 826 2024-09-12T00:04:44.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.808 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:44.808 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.808 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:44.808 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667092+0000", 2024-09-12T00:04:44.808 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.808 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.808 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:44.808 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667092+0000", 2024-09-12T00:04:44.808 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.809 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.809 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.809 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:44.809 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667094+0000", 2024-09-12T00:04:44.809 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.804e-06 2024-09-12T00:04:44.809 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.809 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.809 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:44.809 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667101+0000", 2024-09-12T00:04:44.809 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1130000000000003e-06 2024-09-12T00:04:44.809 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.809 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.809 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:44.810 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667122+0000", 2024-09-12T00:04:44.810 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1480000000000001e-05 2024-09-12T00:04:44.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.810 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.810 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.810 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667135+0000", 2024-09-12T00:04:44.810 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2862e-05 2024-09-12T00:04:44.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.810 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.810 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.810 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667211+0000", 2024-09-12T00:04:44.810 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5442e-05 2024-09-12T00:04:44.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.810 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.811 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:44.811 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667411+0000", 2024-09-12T00:04:44.811 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000200003 2024-09-12T00:04:44.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.811 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.811 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:44.811 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.667625+0000", 2024-09-12T00:04:44.811 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021448999999999999 2024-09-12T00:04:44.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.811 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.811 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:44.811 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.669634+0000", 2024-09-12T00:04:44.811 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020084550000000001 2024-09-12T00:04:44.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.812 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.812 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.812 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.672670+0000", 2024-09-12T00:04:44.812 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0030365539999999999 2024-09-12T00:04:44.812 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.812 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.812 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:44.812 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.672748+0000", 2024-09-12T00:04:44.812 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7836999999999994e-05 2024-09-12T00:04:44.812 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.812 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.812 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:44.812 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:03:34.672820+0000", 2024-09-12T00:04:44.813 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1933000000000004e-05 2024-09-12T00:04:44.813 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.813 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:44.813 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.813 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.813 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.813 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.5049.0:6 5.0 5:00000000::::head [pgnls start_epoch 59] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:04:44.813 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:34.496340+0000", 2024-09-12T00:04:44.813 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.162396835999999, 2024-09-12T00:04:44.813 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0057624779999999997, 2024-09-12T00:04:44.813 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:44.813 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:44.813 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "started", 2024-09-12T00:04:44.814 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:44.814 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.5049", 2024-09-12T00:04:44.814 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/1082954997", 2024-09-12T00:04:44.814 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 6 2024-09-12T00:04:44.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.814 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:44.814 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.814 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:44.814 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:34.496340+0000", 2024-09-12T00:04:44.814 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.814 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.814 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:44.814 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:34.496340+0000", 2024-09-12T00:04:44.815 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.815 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.815 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.815 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:44.815 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:34.496343+0000", 2024-09-12T00:04:44.815 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5770000000000001e-06 2024-09-12T00:04:44.815 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.815 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.815 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:44.815 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:34.496352+0000", 2024-09-12T00:04:44.815 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3530000000000001e-06 2024-09-12T00:04:44.815 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.815 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.815 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:44.816 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:34.496375+0000", 2024-09-12T00:04:44.816 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2376000000000001e-05 2024-09-12T00:04:44.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.816 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.816 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.816 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:34.496390+0000", 2024-09-12T00:04:44.816 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4936000000000001e-05 2024-09-12T00:04:44.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.816 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.816 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.816 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:34.496528+0000", 2024-09-12T00:04:44.816 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000138443 2024-09-12T00:04:44.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.816 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.817 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op must wait for map", 2024-09-12T00:04:44.817 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:34.496538+0000", 2024-09-12T00:04:44.817 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9729999999999992e-06 2024-09-12T00:04:44.817 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.817 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.817 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.817 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:34.501682+0000", 2024-09-12T00:04:44.817 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0051437180000000002 2024-09-12T00:04:44.817 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.817 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.817 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:44.817 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:34.501762+0000", 2024-09-12T00:04:44.817 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0321000000000006e-05 2024-09-12T00:04:44.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.818 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.818 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:44.818 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:34.502103+0000", 2024-09-12T00:04:44.818 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00034078100000000002 2024-09-12T00:04:44.818 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.818 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:44.818 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.818 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.818 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2465 4.37 4:ee90fc49:::.dir.b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:04:44.818 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:38.218160+0000", 2024-09-12T00:04:44.818 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.4405772499999996, 2024-09-12T00:04:44.818 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053513689999999999, 2024-09-12T00:04:44.819 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:44.819 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:44.819 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:44.819 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:44.819 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:44.819 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:44.819 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2465 2024-09-12T00:04:44.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.819 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:44.819 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.819 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:44.819 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:38.218160+0000", 2024-09-12T00:04:44.819 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.820 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.820 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:44.820 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:38.218160+0000", 2024-09-12T00:04:44.820 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:44.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.820 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.820 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:44.820 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:38.218163+0000", 2024-09-12T00:04:44.820 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7369999999999998e-06 2024-09-12T00:04:44.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.820 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.820 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:44.821 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:38.218175+0000", 2024-09-12T00:04:44.821 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1963e-05 2024-09-12T00:04:44.821 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.821 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.821 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:44.821 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:38.218207+0000", 2024-09-12T00:04:44.821 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1936000000000001e-05 2024-09-12T00:04:44.821 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.821 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.821 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:44.821 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:38.218223+0000", 2024-09-12T00:04:44.821 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6840000000000001e-05 2024-09-12T00:04:44.821 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.821 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.822 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:44.822 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:38.218408+0000", 2024-09-12T00:04:44.822 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018412499999999999 2024-09-12T00:04:44.822 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.822 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.822 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:44.822 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:38.218801+0000", 2024-09-12T00:04:44.822 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039306699999999998 2024-09-12T00:04:44.822 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.822 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.822 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:44.822 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:38.219349+0000", 2024-09-12T00:04:44.822 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000548173 2024-09-12T00:04:44.822 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.823 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.823 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:44.823 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:38.221664+0000", 2024-09-12T00:04:44.823 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0023155530000000001 2024-09-12T00:04:44.823 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.823 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.823 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:44.823 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:38.223316+0000", 2024-09-12T00:04:44.823 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0016520899999999999 2024-09-12T00:04:44.823 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.823 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.823 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:44.823 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:38.223406+0000", 2024-09-12T00:04:44.823 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9114000000000001e-05 2024-09-12T00:04:44.824 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:44.824 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:44.824 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:44.824 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:38.223511+0000", 2024-09-12T00:04:44.824 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105771 2024-09-12T00:04:44.824 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.824 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:44.824 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.824 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:44.824 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:44.824 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:44.825 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:44.826 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:44.826 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:44.826 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:44.827 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:04:44.827 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:44.828 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:44.828 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:44.828 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:44.828 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:44.829 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:44.829 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:44.828+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:44.927 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:44.928+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:45.002 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:45.002 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:45.017 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:04:45.066 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:45.066+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:45.128 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:45.126+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:45.138 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:45.138 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:45.153 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:04:45.237 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:45.238+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:45.330 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:45.330+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:45.335 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:45.335 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:45.350 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:04:45.431 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:45.432+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:45.532 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:45.532 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:45.532 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:45.530+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:45.538 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T00:04:45.549 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:04:45.632 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:45.632+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:45.733 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:45.730+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:45.744 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:45.744 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:45.762 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:04:45.849 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:45.850+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:45.935 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:45.936+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:45.944 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:45.944 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:45.970 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:04:46.036 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:46.036+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:46.137 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:46.136+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:46.148 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:46.148 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:46.165 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:04:46.238 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:46.240+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:46.301 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:46.301 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:46.317 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:04:46.340 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:46.340+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:46.441 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:46.440+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:46.441 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:46.441 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:46.456 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:04:46.542 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:46.542+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:46.546 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T00:04:46.629 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:46.629 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:46.642 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:46.642+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:46.655 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:04:46.744 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:46.744+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:46.806 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:46.807 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:46.827 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:04:46.830 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:04:46.845 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:46.842+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:46.946 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:46.946+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:47.032 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:47.032 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:47.047 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:47.046+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:47.062 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:04:47.073 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:47.073 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:47.097 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:47.097 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:47.116 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:47.117 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:47.145 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:47.146 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:47.148 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:47.148+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:47.172 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:47.172 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:47.200 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:47.200 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:47.225 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:47.225 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:47.225 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.225 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2653 3.2c e63/23 3:36c33326:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_148:head v 63'3, mlcod=62'1)", 2024-09-12T00:04:47.225 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.223078+0000", 2024-09-12T00:04:47.225 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0043654510000000002, 2024-09-12T00:04:47.225 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0044078659999999999, 2024-09-12T00:04:47.227 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:47.227 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:47.227 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "started", 2024-09-12T00:04:47.228 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:47.228 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.228 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:47.228 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.223078+0000", 2024-09-12T00:04:47.228 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.228 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.228 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:47.228 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.223078+0000", 2024-09-12T00:04:47.228 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.228 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.229 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:47.229 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.223080+0000", 2024-09-12T00:04:47.229 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.722e-06 2024-09-12T00:04:47.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.229 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.229 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:47.229 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.224293+0000", 2024-09-12T00:04:47.229 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012127150000000001 2024-09-12T00:04:47.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.229 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.229 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:47.229 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.224322+0000", 2024-09-12T00:04:47.229 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9011999999999999e-05 2024-09-12T00:04:47.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.230 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.230 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:47.230 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.224337+0000", 2024-09-12T00:04:47.230 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5282999999999999e-05 2024-09-12T00:04:47.230 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.230 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.230 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.230 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.225051+0000", 2024-09-12T00:04:47.230 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00071437200000000001 2024-09-12T00:04:47.230 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.230 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.230 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:47.230 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.225081+0000", 2024-09-12T00:04:47.230 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9802999999999999e-05 2024-09-12T00:04:47.230 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.231 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.231 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.231 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.231 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T00:04:47.231 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 1 2024-09-12T00:04:47.231 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:47.241 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:47.242 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:47.249 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:47.246+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:47.251 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:04:47.275 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:47.276 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:47.350 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:47.350+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:47.439 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:47.439 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:47.439 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:47.439 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:47.439 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:47.451 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:47.452+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:47.461 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:04:47.552 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:47.552+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:47.651 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:47.652 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:47.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:47.652 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:47.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.652 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:47.652 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:47.652 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 96.159481416000006, 2024-09-12T00:04:47.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.278479906, 2024-09-12T00:04:47.652 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:47.652 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:47.653 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:47.653 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:47.653 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:47.653 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:47.653 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:04:47.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.653 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:47.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:47.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:47.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:47.654 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:47.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:47.654 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493422+0000", 2024-09-12T00:04:47.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.807e-06 2024-09-12T00:04:47.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:47.654 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493435+0000", 2024-09-12T00:04:47.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.375e-05 2024-09-12T00:04:47.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.655 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.655 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:47.655 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493457+0000", 2024-09-12T00:04:47.655 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2166000000000001e-05 2024-09-12T00:04:47.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.655 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.655 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:47.655 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493475+0000", 2024-09-12T00:04:47.655 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7184e-05 2024-09-12T00:04:47.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.655 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.655 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.655 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493617+0000", 2024-09-12T00:04:47.655 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014274200000000001 2024-09-12T00:04:47.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.656 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.656 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:47.656 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493632+0000", 2024-09-12T00:04:47.656 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4293e-05 2024-09-12T00:04:47.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.657 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.768657+0000", 2024-09-12T00:04:47.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.27502575400000001 2024-09-12T00:04:47.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.657 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:47.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769042+0000", 2024-09-12T00:04:47.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00038463700000000001 2024-09-12T00:04:47.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.657 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:47.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769430+0000", 2024-09-12T00:04:47.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000388014 2024-09-12T00:04:47.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:47.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.770784+0000", 2024-09-12T00:04:47.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00135402 2024-09-12T00:04:47.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:47.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771735+0000", 2024-09-12T00:04:47.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00095068599999999996 2024-09-12T00:04:47.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:47.659 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771828+0000", 2024-09-12T00:04:47.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3468999999999996e-05 2024-09-12T00:04:47.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.660 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.660 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:47.660 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771899+0000", 2024-09-12T00:04:47.660 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0383999999999996e-05 2024-09-12T00:04:47.660 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.660 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.660 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.661 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.661 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:47.661 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:47.661 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 95.731068213, 2024-09-12T00:04:47.661 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016022492999999999, 2024-09-12T00:04:47.661 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:47.661 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:47.661 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:47.661 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:47.661 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:47.661 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:47.661 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 47 2024-09-12T00:04:47.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.661 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:47.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:47.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:47.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:47.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:47.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:47.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921832+0000", 2024-09-12T00:04:47.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4000000000000002e-07 2024-09-12T00:04:47.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:47.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921891+0000", 2024-09-12T00:04:47.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8298000000000003e-05 2024-09-12T00:04:47.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:47.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921899+0000", 2024-09-12T00:04:47.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7059999999999993e-06 2024-09-12T00:04:47.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:47.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921904+0000", 2024-09-12T00:04:47.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9799999999999998e-06 2024-09-12T00:04:47.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932144+0000", 2024-09-12T00:04:47.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010239817999999999 2024-09-12T00:04:47.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:47.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932284+0000", 2024-09-12T00:04:47.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000139436 2024-09-12T00:04:47.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:47.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.932498+0000", 2024-09-12T00:04:47.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000214408 2024-09-12T00:04:47.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.665 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:47.665 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936444+0000", 2024-09-12T00:04:47.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039464169999999998 2024-09-12T00:04:47.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.665 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:47.665 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937702+0000", 2024-09-12T00:04:47.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012571679999999999 2024-09-12T00:04:47.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.665 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:47.666 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937793+0000", 2024-09-12T00:04:47.666 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1489000000000004e-05 2024-09-12T00:04:47.666 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.666 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.666 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:47.666 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937854+0000", 2024-09-12T00:04:47.666 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1333000000000004e-05 2024-09-12T00:04:47.666 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.666 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.666 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.666 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.667 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.667 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:47.667 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:47.667 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 95.730986345000005, 2024-09-12T00:04:47.667 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017189138999999999, 2024-09-12T00:04:47.667 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:47.667 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:47.667 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:47.667 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:47.667 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:47.667 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:47.667 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 48 2024-09-12T00:04:47.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.668 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:47.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.668 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:47.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:47.668 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.668 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:47.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:47.668 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.668 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:47.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:47.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7399999999999998e-07 2024-09-12T00:04:47.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:47.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921918+0000", 2024-09-12T00:04:47.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6399999999999999e-06 2024-09-12T00:04:47.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:47.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921925+0000", 2024-09-12T00:04:47.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7190000000000004e-06 2024-09-12T00:04:47.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:47.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921931+0000", 2024-09-12T00:04:47.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2519999999999996e-06 2024-09-12T00:04:47.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933475+0000", 2024-09-12T00:04:47.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011543759000000001 2024-09-12T00:04:47.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:47.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933617+0000", 2024-09-12T00:04:47.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000142282 2024-09-12T00:04:47.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.671 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:47.671 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933860+0000", 2024-09-12T00:04:47.671 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024276199999999999 2024-09-12T00:04:47.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.671 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:47.671 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937933+0000", 2024-09-12T00:04:47.671 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040734680000000002 2024-09-12T00:04:47.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.671 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:47.671 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938955+0000", 2024-09-12T00:04:47.671 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001021987 2024-09-12T00:04:47.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.672 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.672 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:47.672 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939038+0000", 2024-09-12T00:04:47.672 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2449999999999998e-05 2024-09-12T00:04:47.672 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.672 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.672 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:47.672 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939103+0000", 2024-09-12T00:04:47.672 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5345999999999994e-05 2024-09-12T00:04:47.672 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.672 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.672 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.672 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.673 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:47.673 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:47.673 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 95.730960803000002, 2024-09-12T00:04:47.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018247975, 2024-09-12T00:04:47.673 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:47.673 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:47.673 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:47.673 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:47.673 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:47.673 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:47.673 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 49 2024-09-12T00:04:47.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.673 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:47.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.674 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:47.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:47.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.674 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:47.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:47.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.674 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:47.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921940+0000", 2024-09-12T00:04:47.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7e-07 2024-09-12T00:04:47.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:47.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921943+0000", 2024-09-12T00:04:47.675 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1889999999999999e-06 2024-09-12T00:04:47.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:47.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921952+0000", 2024-09-12T00:04:47.675 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0010000000000007e-06 2024-09-12T00:04:47.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:47.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921959+0000", 2024-09-12T00:04:47.675 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2570000000000001e-06 2024-09-12T00:04:47.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935333+0000", 2024-09-12T00:04:47.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013373368 2024-09-12T00:04:47.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:47.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935472+0000", 2024-09-12T00:04:47.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013987900000000001 2024-09-12T00:04:47.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:47.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935700+0000", 2024-09-12T00:04:47.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000227922 2024-09-12T00:04:47.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.677 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.677 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:47.677 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939858+0000", 2024-09-12T00:04:47.677 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041571300000000002 2024-09-12T00:04:47.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.677 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.677 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:47.677 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940018+0000", 2024-09-12T00:04:47.677 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016060400000000001 2024-09-12T00:04:47.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.677 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.677 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:47.677 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940114+0000", 2024-09-12T00:04:47.677 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5692999999999993e-05 2024-09-12T00:04:47.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.678 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.678 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:47.678 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940187+0000", 2024-09-12T00:04:47.678 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3561999999999998e-05 2024-09-12T00:04:47.678 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.678 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.678 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.678 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.678 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:47.678 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:47.678 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 95.730918016000004, 2024-09-12T00:04:47.678 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021018614000000001, 2024-09-12T00:04:47.679 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:47.679 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:47.679 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:47.679 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:47.679 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:47.679 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:47.679 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 50 2024-09-12T00:04:47.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.679 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:47.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:47.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:47.679 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:47.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:47.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.681 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:47.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921983+0000", 2024-09-12T00:04:47.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4499999999999996e-07 2024-09-12T00:04:47.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.681 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:47.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922071+0000", 2024-09-12T00:04:47.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8010000000000006e-05 2024-09-12T00:04:47.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:47.682 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922084+0000", 2024-09-12T00:04:47.682 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3275000000000001e-05 2024-09-12T00:04:47.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:47.682 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922093+0000", 2024-09-12T00:04:47.682 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0580000000000004e-06 2024-09-12T00:04:47.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.682 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936515+0000", 2024-09-12T00:04:47.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014421270999999999 2024-09-12T00:04:47.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.683 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.683 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:47.683 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936677+0000", 2024-09-12T00:04:47.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162003 2024-09-12T00:04:47.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.683 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.683 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:47.683 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936908+0000", 2024-09-12T00:04:47.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023115700000000001 2024-09-12T00:04:47.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.683 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.683 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:47.684 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939985+0000", 2024-09-12T00:04:47.684 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030773879999999999 2024-09-12T00:04:47.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.684 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.684 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:47.684 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942623+0000", 2024-09-12T00:04:47.684 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026377929999999998 2024-09-12T00:04:47.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.684 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.684 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:47.684 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942818+0000", 2024-09-12T00:04:47.684 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019556200000000001 2024-09-12T00:04:47.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.685 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.685 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:47.685 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943001+0000", 2024-09-12T00:04:47.685 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018235199999999999 2024-09-12T00:04:47.685 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.685 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.685 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.685 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.686 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.686 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:47.686 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:47.686 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 95.730783623999997, 2024-09-12T00:04:47.686 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021092493, 2024-09-12T00:04:47.686 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:47.686 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:47.686 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:47.686 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:47.686 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:47.686 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:47.686 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 51 2024-09-12T00:04:47.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.686 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:47.687 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.687 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:47.687 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:47.687 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.687 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.687 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.687 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:47.687 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:47.687 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.687 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.687 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.687 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:47.688 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922118+0000", 2024-09-12T00:04:47.688 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0389999999999999e-06 2024-09-12T00:04:47.688 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.688 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.688 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:47.688 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922124+0000", 2024-09-12T00:04:47.688 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5409999999999997e-06 2024-09-12T00:04:47.688 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.688 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.688 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:47.688 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922136+0000", 2024-09-12T00:04:47.689 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.205e-05 2024-09-12T00:04:47.689 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.689 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.689 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:47.690 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922147+0000", 2024-09-12T00:04:47.690 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0451e-05 2024-09-12T00:04:47.690 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.690 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.690 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.690 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938000+0000", 2024-09-12T00:04:47.690 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015853682000000001 2024-09-12T00:04:47.690 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.691 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.691 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:47.691 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938142+0000", 2024-09-12T00:04:47.691 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014148899999999999 2024-09-12T00:04:47.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.691 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.691 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:47.691 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938362+0000", 2024-09-12T00:04:47.691 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022034800000000001 2024-09-12T00:04:47.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.692 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.692 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:47.692 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940330+0000", 2024-09-12T00:04:47.692 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001967459 2024-09-12T00:04:47.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.692 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.692 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:47.692 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943064+0000", 2024-09-12T00:04:47.692 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027346219999999999 2024-09-12T00:04:47.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.692 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.692 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:47.693 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943152+0000", 2024-09-12T00:04:47.693 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7563000000000002e-05 2024-09-12T00:04:47.693 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.693 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.693 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:47.693 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943209+0000", 2024-09-12T00:04:47.693 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7249e-05 2024-09-12T00:04:47.693 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.693 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.693 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.693 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.693 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.693 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:47.694 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:47.694 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 95.730734131000006, 2024-09-12T00:04:47.694 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021175616000000001, 2024-09-12T00:04:47.694 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:47.694 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:47.694 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:47.694 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:47.694 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:47.694 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:47.694 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 52 2024-09-12T00:04:47.694 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.694 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:47.694 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.695 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:47.695 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:47.695 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.695 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.695 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.695 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:47.695 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:47.695 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.695 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.695 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.695 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:47.695 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922167+0000", 2024-09-12T00:04:47.695 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3300000000000001e-07 2024-09-12T00:04:47.696 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.696 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.696 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:47.696 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922174+0000", 2024-09-12T00:04:47.696 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7070000000000003e-06 2024-09-12T00:04:47.696 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.696 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.696 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:47.696 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922184+0000", 2024-09-12T00:04:47.696 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682e-05 2024-09-12T00:04:47.696 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.696 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.696 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:47.697 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922195+0000", 2024-09-12T00:04:47.697 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0489000000000001e-05 2024-09-12T00:04:47.697 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.697 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.697 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.697 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939166+0000", 2024-09-12T00:04:47.697 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016971245999999999 2024-09-12T00:04:47.697 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.697 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.697 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:47.697 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939243+0000", 2024-09-12T00:04:47.697 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7201999999999997e-05 2024-09-12T00:04:47.697 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.698 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.698 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:47.698 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939381+0000", 2024-09-12T00:04:47.698 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013770699999999999 2024-09-12T00:04:47.698 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.698 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.698 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:47.698 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940923+0000", 2024-09-12T00:04:47.698 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001542302 2024-09-12T00:04:47.698 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.698 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.698 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:47.698 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943221+0000", 2024-09-12T00:04:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022979720000000001 2024-09-12T00:04:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943295+0000", 2024-09-12T00:04:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3317000000000003e-05 2024-09-12T00:04:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943342+0000", 2024-09-12T00:04:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7159e-05 2024-09-12T00:04:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 95.481789164999995, 2024-09-12T00:04:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015229411999999999, 2024-09-12T00:04:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 67 2024-09-12T00:04:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171111+0000", 2024-09-12T00:04:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171112+0000", 2024-09-12T00:04:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2899999999999999e-06 2024-09-12T00:04:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171119+0000", 2024-09-12T00:04:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8870000000000003e-06 2024-09-12T00:04:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171131+0000", 2024-09-12T00:04:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1902999999999999e-05 2024-09-12T00:04:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.703 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.703 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:47.703 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171147+0000", 2024-09-12T00:04:47.703 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6203000000000001e-05 2024-09-12T00:04:47.703 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.703 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.703 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.703 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175044+0000", 2024-09-12T00:04:47.703 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0038967310000000001 2024-09-12T00:04:47.703 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.703 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.703 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:47.703 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175172+0000", 2024-09-12T00:04:47.703 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012784100000000001 2024-09-12T00:04:47.704 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.704 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.704 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:47.704 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.175372+0000", 2024-09-12T00:04:47.704 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019978500000000001 2024-09-12T00:04:47.704 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.704 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.704 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:47.704 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179276+0000", 2024-09-12T00:04:47.704 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039042149999999999 2024-09-12T00:04:47.704 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.704 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.704 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:47.705 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186150+0000", 2024-09-12T00:04:47.705 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0068740019999999997 2024-09-12T00:04:47.705 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.705 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.705 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:47.705 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186266+0000", 2024-09-12T00:04:47.705 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000115742 2024-09-12T00:04:47.705 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.705 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.705 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:47.705 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186340+0000", 2024-09-12T00:04:47.705 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4813000000000004e-05 2024-09-12T00:04:47.705 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.705 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.706 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.706 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.706 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.706 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:47.706 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:47.706 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 95.481728089000001, 2024-09-12T00:04:47.706 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015308448000000001, 2024-09-12T00:04:47.706 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:47.706 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:47.706 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:47.706 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:47.706 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:47.706 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:47.706 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 68 2024-09-12T00:04:47.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.707 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:47.707 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.707 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:47.707 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:47.707 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.707 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.707 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:47.707 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171172+0000", 2024-09-12T00:04:47.707 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.707 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.707 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:47.708 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171173+0000", 2024-09-12T00:04:47.708 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0699999999999996e-07 2024-09-12T00:04:47.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.708 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.708 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:47.708 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171182+0000", 2024-09-12T00:04:47.708 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2359999999999993e-06 2024-09-12T00:04:47.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.708 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.708 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:47.708 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171193+0000", 2024-09-12T00:04:47.708 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.095e-05 2024-09-12T00:04:47.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:47.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171207+0000", 2024-09-12T00:04:47.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3339999999999999e-05 2024-09-12T00:04:47.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176753+0000", 2024-09-12T00:04:47.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055460240000000001 2024-09-12T00:04:47.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:47.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.176921+0000", 2024-09-12T00:04:47.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000168503 2024-09-12T00:04:47.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.710 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.710 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:47.710 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177112+0000", 2024-09-12T00:04:47.710 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019113999999999999 2024-09-12T00:04:47.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.710 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.710 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:47.710 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179382+0000", 2024-09-12T00:04:47.710 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022697099999999999 2024-09-12T00:04:47.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.710 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.710 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:47.710 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186356+0000", 2024-09-12T00:04:47.711 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069741919999999997 2024-09-12T00:04:47.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.711 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.711 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:47.711 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186422+0000", 2024-09-12T00:04:47.711 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6387e-05 2024-09-12T00:04:47.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.711 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.711 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:47.711 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186481+0000", 2024-09-12T00:04:47.711 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8059000000000001e-05 2024-09-12T00:04:47.711 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.711 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.711 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.712 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.712 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.712 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:47.712 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:47.712 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 95.481676319000002, 2024-09-12T00:04:47.712 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020001835999999999, 2024-09-12T00:04:47.712 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:47.712 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:47.712 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:47.712 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:47.712 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:47.712 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:47.712 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 69 2024-09-12T00:04:47.713 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.713 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:47.713 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.713 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:47.713 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:47.713 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.713 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.713 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.713 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:47.713 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:47.713 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.713 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.713 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.714 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:47.714 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171225+0000", 2024-09-12T00:04:47.714 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0599999999999999e-07 2024-09-12T00:04:47.714 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.714 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.714 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:47.714 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171349+0000", 2024-09-12T00:04:47.714 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012407299999999999 2024-09-12T00:04:47.714 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.714 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.714 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:47.714 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171367+0000", 2024-09-12T00:04:47.714 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8413000000000001e-05 2024-09-12T00:04:47.714 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.715 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.715 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:47.715 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171376+0000", 2024-09-12T00:04:47.715 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8170000000000005e-06 2024-09-12T00:04:47.715 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.715 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.715 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.715 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177692+0000", 2024-09-12T00:04:47.715 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063156729999999999 2024-09-12T00:04:47.715 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.715 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.715 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:47.715 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177817+0000", 2024-09-12T00:04:47.715 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012581499999999999 2024-09-12T00:04:47.716 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.716 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.716 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:47.716 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.178015+0000", 2024-09-12T00:04:47.716 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019715100000000001 2024-09-12T00:04:47.716 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.716 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.716 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:47.716 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181798+0000", 2024-09-12T00:04:47.716 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003783308 2024-09-12T00:04:47.716 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.716 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.716 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:47.717 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190976+0000", 2024-09-12T00:04:47.717 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091776519999999997 2024-09-12T00:04:47.717 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.717 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.717 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:47.717 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191122+0000", 2024-09-12T00:04:47.717 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000145966 2024-09-12T00:04:47.717 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.717 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.717 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:47.717 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191226+0000", 2024-09-12T00:04:47.717 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104162 2024-09-12T00:04:47.717 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.717 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.718 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.718 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.718 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.718 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:47.718 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:47.718 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 95.481507583999999, 2024-09-12T00:04:47.718 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019997773, 2024-09-12T00:04:47.718 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:47.718 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:47.718 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:47.718 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:47.718 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:47.718 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:47.719 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 70 2024-09-12T00:04:47.719 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.719 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:47.719 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.719 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:47.719 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:47.719 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.719 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.719 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.719 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:47.719 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:47.719 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.719 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.719 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.720 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:47.720 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:47.720 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3699999999999999e-07 2024-09-12T00:04:47.720 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.720 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.720 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:47.720 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171403+0000", 2024-09-12T00:04:47.720 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6199999999999994e-06 2024-09-12T00:04:47.720 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.720 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.720 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:47.720 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171416+0000", 2024-09-12T00:04:47.720 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2636000000000001e-05 2024-09-12T00:04:47.720 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.721 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.721 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:47.721 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171423+0000", 2024-09-12T00:04:47.721 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5440000000000001e-06 2024-09-12T00:04:47.721 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.721 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.721 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.721 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179458+0000", 2024-09-12T00:04:47.721 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080351989999999998 2024-09-12T00:04:47.721 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.721 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.721 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:47.721 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179604+0000", 2024-09-12T00:04:47.722 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014519899999999999 2024-09-12T00:04:47.722 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.722 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.722 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:47.722 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179831+0000", 2024-09-12T00:04:47.722 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022704800000000001 2024-09-12T00:04:47.722 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.722 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.722 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:47.722 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181918+0000", 2024-09-12T00:04:47.722 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020873950000000001 2024-09-12T00:04:47.722 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.722 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.722 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:47.723 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191243+0000", 2024-09-12T00:04:47.723 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0093244729999999998 2024-09-12T00:04:47.723 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.723 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.723 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:47.723 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191309+0000", 2024-09-12T00:04:47.723 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6116000000000002e-05 2024-09-12T00:04:47.723 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.723 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.723 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:47.723 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191390+0000", 2024-09-12T00:04:47.723 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1705999999999993e-05 2024-09-12T00:04:47.723 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.723 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.724 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.724 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.724 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.724 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:47.724 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:47.724 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 95.481461511000006, 2024-09-12T00:04:47.724 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020263554, 2024-09-12T00:04:47.724 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:47.724 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:47.724 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:47.724 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:47.724 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:47.724 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:47.725 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 71 2024-09-12T00:04:47.725 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.725 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:47.725 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.725 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:47.725 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:47.725 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.725 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.725 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.725 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:47.725 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:47.725 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.725 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.726 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.726 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:47.726 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:47.726 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5000000000000002e-07 2024-09-12T00:04:47.726 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.726 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.726 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:47.726 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171454+0000", 2024-09-12T00:04:47.726 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5046e-05 2024-09-12T00:04:47.726 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.726 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.726 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:47.726 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171471+0000", 2024-09-12T00:04:47.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6923999999999999e-05 2024-09-12T00:04:47.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:47.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171487+0000", 2024-09-12T00:04:47.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5823000000000001e-05 2024-09-12T00:04:47.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180765+0000", 2024-09-12T00:04:47.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0092774399999999996 2024-09-12T00:04:47.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.728 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:47.728 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180900+0000", 2024-09-12T00:04:47.728 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013556700000000001 2024-09-12T00:04:47.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.728 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:47.728 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181108+0000", 2024-09-12T00:04:47.728 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020727899999999999 2024-09-12T00:04:47.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.728 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:47.728 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184725+0000", 2024-09-12T00:04:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036171340000000001 2024-09-12T00:04:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191413+0000", 2024-09-12T00:04:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066881830000000003 2024-09-12T00:04:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191540+0000", 2024-09-12T00:04:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000126823 2024-09-12T00:04:47.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.730 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.730 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:47.730 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191702+0000", 2024-09-12T00:04:47.730 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162585 2024-09-12T00:04:47.730 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.730 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.730 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.730 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.730 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.730 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:47.730 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:47.730 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 95.481382934999999, 2024-09-12T00:04:47.730 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020448573000000001, 2024-09-12T00:04:47.731 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:47.731 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:47.731 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:47.731 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:47.731 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:47.731 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:47.731 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 72 2024-09-12T00:04:47.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.731 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:47.731 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.731 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:47.731 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:47.731 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:47.732 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:47.732 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:47.732 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171518+0000", 2024-09-12T00:04:47.732 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0440000000000001e-06 2024-09-12T00:04:47.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:47.733 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171647+0000", 2024-09-12T00:04:47.733 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012912899999999999 2024-09-12T00:04:47.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.733 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:47.733 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171664+0000", 2024-09-12T00:04:47.733 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6079999999999999e-05 2024-09-12T00:04:47.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.733 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:47.733 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171675+0000", 2024-09-12T00:04:47.733 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1223000000000001e-05 2024-09-12T00:04:47.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.734 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.734 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.734 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182000+0000", 2024-09-12T00:04:47.734 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010324949 2024-09-12T00:04:47.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.734 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.734 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:47.734 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182178+0000", 2024-09-12T00:04:47.734 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017808799999999999 2024-09-12T00:04:47.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.734 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.734 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:47.734 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182402+0000", 2024-09-12T00:04:47.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022381199999999999 2024-09-12T00:04:47.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:47.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190935+0000", 2024-09-12T00:04:47.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085331560000000001 2024-09-12T00:04:47.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:47.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191728+0000", 2024-09-12T00:04:47.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079325700000000001 2024-09-12T00:04:47.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:47.736 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191864+0000", 2024-09-12T00:04:47.736 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013606299999999999 2024-09-12T00:04:47.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.736 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:47.736 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191966+0000", 2024-09-12T00:04:47.736 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101772 2024-09-12T00:04:47.736 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.736 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.736 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.736 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:47.736 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:47.737 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 95.481199739999994, 2024-09-12T00:04:47.737 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020675235, 2024-09-12T00:04:47.737 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:47.737 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:47.737 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:47.737 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:47.737 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:47.737 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:47.737 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 73 2024-09-12T00:04:47.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.737 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:47.737 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:47.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:47.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.738 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:47.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:47.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.738 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:47.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171701+0000", 2024-09-12T00:04:47.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0999999999999997e-07 2024-09-12T00:04:47.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.739 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:47.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171709+0000", 2024-09-12T00:04:47.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2540000000000003e-06 2024-09-12T00:04:47.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.739 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:47.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171724+0000", 2024-09-12T00:04:47.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5569e-05 2024-09-12T00:04:47.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.739 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:47.739 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171734+0000", 2024-09-12T00:04:47.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6139999999999998e-06 2024-09-12T00:04:47.740 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.740 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.740 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.740 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183774+0000", 2024-09-12T00:04:47.740 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012040444000000001 2024-09-12T00:04:47.740 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.740 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.740 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:47.740 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183896+0000", 2024-09-12T00:04:47.740 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012204199999999999 2024-09-12T00:04:47.740 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.740 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.740 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:47.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184084+0000", 2024-09-12T00:04:47.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018792599999999999 2024-09-12T00:04:47.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:47.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191984+0000", 2024-09-12T00:04:47.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079003790000000008 2024-09-12T00:04:47.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:47.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192093+0000", 2024-09-12T00:04:47.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000108942 2024-09-12T00:04:47.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:47.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192250+0000", 2024-09-12T00:04:47.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015637600000000001 2024-09-12T00:04:47.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:47.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192376+0000", 2024-09-12T00:04:47.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012587899999999999 2024-09-12T00:04:47.742 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.742 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.742 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.743 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:47.743 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:47.743 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 95.481151530000005, 2024-09-12T00:04:47.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021088828, 2024-09-12T00:04:47.743 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:47.743 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:47.743 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:47.743 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:47.743 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:47.743 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:47.744 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 74 2024-09-12T00:04:47.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.744 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:47.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.744 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:47.744 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:47.744 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.744 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:47.744 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:47.744 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.745 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.745 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:47.745 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:47.745 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1699999999999997e-07 2024-09-12T00:04:47.745 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.745 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.745 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:47.745 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171758+0000", 2024-09-12T00:04:47.745 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0860000000000008e-06 2024-09-12T00:04:47.745 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.745 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.745 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:47.745 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171774+0000", 2024-09-12T00:04:47.746 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:04:47.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.746 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.746 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:47.746 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171788+0000", 2024-09-12T00:04:47.746 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4793999999999999e-05 2024-09-12T00:04:47.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.746 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.746 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.746 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184842+0000", 2024-09-12T00:04:47.746 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013053607 2024-09-12T00:04:47.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:47.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185130+0000", 2024-09-12T00:04:47.747 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00028779199999999998 2024-09-12T00:04:47.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:47.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185378+0000", 2024-09-12T00:04:47.747 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024780100000000002 2024-09-12T00:04:47.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:47.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192513+0000", 2024-09-12T00:04:47.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071350770000000001 2024-09-12T00:04:47.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:47.748 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192690+0000", 2024-09-12T00:04:47.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000176892 2024-09-12T00:04:47.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:47.748 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192769+0000", 2024-09-12T00:04:47.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9466000000000001e-05 2024-09-12T00:04:47.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.749 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:47.749 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192837+0000", 2024-09-12T00:04:47.749 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8466000000000005e-05 2024-09-12T00:04:47.749 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.749 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.749 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.749 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.749 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:47.749 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:47.749 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 95.481098953, 2024-09-12T00:04:47.749 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.02121994, 2024-09-12T00:04:47.749 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:47.749 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:47.750 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:47.750 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:47.750 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:47.750 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:47.750 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 75 2024-09-12T00:04:47.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.750 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:47.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.750 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:47.750 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:47.750 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.751 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:47.751 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:47.751 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.751 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.751 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.751 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:47.751 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171802+0000", 2024-09-12T00:04:47.751 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5000000000000002e-07 2024-09-12T00:04:47.751 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.751 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.751 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:47.751 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171954+0000", 2024-09-12T00:04:47.751 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015215500000000001 2024-09-12T00:04:47.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.752 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.752 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:47.752 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171966+0000", 2024-09-12T00:04:47.752 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1548e-05 2024-09-12T00:04:47.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.752 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.752 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:47.752 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171970+0000", 2024-09-12T00:04:47.752 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8729999999999998e-06 2024-09-12T00:04:47.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.752 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.752 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186552+0000", 2024-09-12T00:04:47.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014581775 2024-09-12T00:04:47.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:47.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186702+0000", 2024-09-12T00:04:47.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014946 2024-09-12T00:04:47.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:47.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186897+0000", 2024-09-12T00:04:47.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000195071 2024-09-12T00:04:47.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.754 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:47.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192666+0000", 2024-09-12T00:04:47.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057693470000000002 2024-09-12T00:04:47.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.754 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:47.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192857+0000", 2024-09-12T00:04:47.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191149 2024-09-12T00:04:47.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.754 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:47.755 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192967+0000", 2024-09-12T00:04:47.755 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110202 2024-09-12T00:04:47.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.755 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.755 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:47.755 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193021+0000", 2024-09-12T00:04:47.755 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3709999999999999e-05 2024-09-12T00:04:47.755 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.755 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.755 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.755 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.755 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:47.755 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:47.756 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 95.480919658000005, 2024-09-12T00:04:47.756 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026297425999999999, 2024-09-12T00:04:47.756 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:47.756 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:47.756 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:47.756 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:47.756 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:47.756 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:47.756 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 76 2024-09-12T00:04:47.756 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.756 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:47.756 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.757 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:47.757 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:47.757 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.757 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.757 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.757 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:47.757 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:47.757 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.757 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.757 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.757 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:47.757 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:47.757 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9399999999999995e-07 2024-09-12T00:04:47.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.758 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.758 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:47.758 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171987+0000", 2024-09-12T00:04:47.758 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5230000000000003e-06 2024-09-12T00:04:47.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.758 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.758 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:47.758 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172005+0000", 2024-09-12T00:04:47.758 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8788e-05 2024-09-12T00:04:47.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.758 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.758 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:47.758 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172010+0000", 2024-09-12T00:04:47.759 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7570000000000004e-06 2024-09-12T00:04:47.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.759 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.759 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.759 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193104+0000", 2024-09-12T00:04:47.759 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021094112000000002 2024-09-12T00:04:47.760 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.760 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.760 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:47.760 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193334+0000", 2024-09-12T00:04:47.760 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000229855 2024-09-12T00:04:47.760 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.760 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.760 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:47.760 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193697+0000", 2024-09-12T00:04:47.760 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00036272399999999998 2024-09-12T00:04:47.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.761 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.761 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:47.761 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.195602+0000", 2024-09-12T00:04:47.761 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019049620000000001 2024-09-12T00:04:47.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.761 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.761 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:47.761 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198123+0000", 2024-09-12T00:04:47.761 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025216520000000001 2024-09-12T00:04:47.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.762 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.762 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:47.762 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198213+0000", 2024-09-12T00:04:47.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0008999999999998e-05 2024-09-12T00:04:47.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.762 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.762 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:47.762 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198278+0000", 2024-09-12T00:04:47.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4549999999999997e-05 2024-09-12T00:04:47.763 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.763 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.763 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.763 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1776 3.10 3:0ad809ca:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:47.763 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.002444+0000", 2024-09-12T00:04:47.763 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.650456596, 2024-09-12T00:04:47.763 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016768360999999999, 2024-09-12T00:04:47.763 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:47.763 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:47.763 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:47.764 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:47.764 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:47.764 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:47.764 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1776 2024-09-12T00:04:47.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.764 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:47.764 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:47.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.002444+0000", 2024-09-12T00:04:47.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.764 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:47.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.002444+0000", 2024-09-12T00:04:47.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.765 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:47.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.002446+0000", 2024-09-12T00:04:47.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5830000000000001e-06 2024-09-12T00:04:47.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.765 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:47.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003441+0000", 2024-09-12T00:04:47.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00099495500000000006 2024-09-12T00:04:47.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.766 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:47.766 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003468+0000", 2024-09-12T00:04:47.766 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6514000000000001e-05 2024-09-12T00:04:47.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.766 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:47.766 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003481+0000", 2024-09-12T00:04:47.766 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3016999999999999e-05 2024-09-12T00:04:47.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.767 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.767 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003556+0000", 2024-09-12T00:04:47.767 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5556999999999995e-05 2024-09-12T00:04:47.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.767 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:47.767 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003705+0000", 2024-09-12T00:04:47.767 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014846799999999999 2024-09-12T00:04:47.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.767 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:47.767 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003828+0000", 2024-09-12T00:04:47.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000123621 2024-09-12T00:04:47.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:47.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.013795+0000", 2024-09-12T00:04:47.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0099663170000000006 2024-09-12T00:04:47.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:47.769 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019048+0000", 2024-09-12T00:04:47.769 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052537729999999998 2024-09-12T00:04:47.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.769 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.769 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:47.770 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019126+0000", 2024-09-12T00:04:47.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7224999999999993e-05 2024-09-12T00:04:47.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:47.770 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019212+0000", 2024-09-12T00:04:47.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6330999999999997e-05 2024-09-12T00:04:47.770 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.770 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.771 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.771 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2646 3.37 3:ee59c452:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:47.771 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.142558+0000", 2024-09-12T00:04:47.771 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.51034223499999998, 2024-09-12T00:04:47.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018660066999999999, 2024-09-12T00:04:47.771 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:47.771 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:47.771 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:47.771 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:47.772 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:47.772 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:47.772 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2646 2024-09-12T00:04:47.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.772 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:47.772 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.772 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:47.772 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.142558+0000", 2024-09-12T00:04:47.772 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.772 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.772 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:47.772 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.142558+0000", 2024-09-12T00:04:47.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.773 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:47.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.142562+0000", 2024-09-12T00:04:47.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7950000000000001e-06 2024-09-12T00:04:47.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.773 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:47.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.144592+0000", 2024-09-12T00:04:47.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020297890000000002 2024-09-12T00:04:47.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.774 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:47.774 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.144609+0000", 2024-09-12T00:04:47.774 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7634000000000001e-05 2024-09-12T00:04:47.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.774 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:47.774 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.144619+0000", 2024-09-12T00:04:47.774 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3989999999999993e-06 2024-09-12T00:04:47.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.774 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.775 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.144703+0000", 2024-09-12T00:04:47.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4648000000000007e-05 2024-09-12T00:04:47.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.775 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.775 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:47.775 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.144837+0000", 2024-09-12T00:04:47.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000133709 2024-09-12T00:04:47.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.775 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.775 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:47.775 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.145006+0000", 2024-09-12T00:04:47.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000169073 2024-09-12T00:04:47.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:47.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.152562+0000", 2024-09-12T00:04:47.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075562399999999997 2024-09-12T00:04:47.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:47.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.161086+0000", 2024-09-12T00:04:47.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085240349999999993 2024-09-12T00:04:47.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:47.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.161158+0000", 2024-09-12T00:04:47.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1929999999999997e-05 2024-09-12T00:04:47.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:47.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.161218+0000", 2024-09-12T00:04:47.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9815000000000002e-05 2024-09-12T00:04:47.778 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.778 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.778 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.778 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2695 3.10 3:08f22abb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:47.778 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.555842+0000", 2024-09-12T00:04:47.778 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.097058670999999999, 2024-09-12T00:04:47.778 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017506441000000001, 2024-09-12T00:04:47.778 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:47.779 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:47.779 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:47.779 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:47.779 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:47.779 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:47.779 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2695 2024-09-12T00:04:47.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.779 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:47.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:47.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.555842+0000", 2024-09-12T00:04:47.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:47.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.555842+0000", 2024-09-12T00:04:47.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:47.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:47.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.555844+0000", 2024-09-12T00:04:47.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8430000000000001e-06 2024-09-12T00:04:47.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:47.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.558169+0000", 2024-09-12T00:04:47.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023244939999999999 2024-09-12T00:04:47.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.781 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:47.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.558191+0000", 2024-09-12T00:04:47.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2062e-05 2024-09-12T00:04:47.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.781 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:47.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.558201+0000", 2024-09-12T00:04:47.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.91e-06 2024-09-12T00:04:47.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.782 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:47.782 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.558276+0000", 2024-09-12T00:04:47.782 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5408999999999996e-05 2024-09-12T00:04:47.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.782 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:47.782 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.558445+0000", 2024-09-12T00:04:47.782 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000168326 2024-09-12T00:04:47.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.782 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:47.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.558554+0000", 2024-09-12T00:04:47.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000109274 2024-09-12T00:04:47.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:47.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.564596+0000", 2024-09-12T00:04:47.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0060426350000000002 2024-09-12T00:04:47.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:47.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.573228+0000", 2024-09-12T00:04:47.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0086312960000000001 2024-09-12T00:04:47.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:47.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.573296+0000", 2024-09-12T00:04:47.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8402e-05 2024-09-12T00:04:47.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:47.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:47.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:47.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.573348+0000", 2024-09-12T00:04:47.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1789999999999997e-05 2024-09-12T00:04:47.785 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.785 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.785 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.785 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:47.785 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:47.785 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:47.787 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:04:47.787 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:47.786+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:47.888 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:47.888+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:47.964 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:47.965 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:47.965 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:47.965 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:47.982 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:04:47.989 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:47.986+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:48.090 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:48.090+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:48.175 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:48.175 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:48.175 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:48.175 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:48.175 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:48.191 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:04:48.192 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:48.190+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:48.293 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:48.290+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:48.331 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:48.331 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:48.331 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:48.331 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:48.331 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.331 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1641 3.26 3:658fe58e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2__shadow_.hDHTDpIswwqRA2bHiHVxkhWqZde6XEj_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:48.331 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:04:48.331 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 15.275300873999999, 2024-09-12T00:04:48.331 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017888905, 2024-09-12T00:04:48.331 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.332 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.332 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.332 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.332 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.332 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.332 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1641 2024-09-12T00:04:48.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.332 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.332 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.332 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.332 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:04:48.332 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.333 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.333 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.333 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:04:48.333 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.333 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.333 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.333 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.333 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056289+0000", 2024-09-12T00:04:48.333 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5349999999999999e-06 2024-09-12T00:04:48.333 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.333 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.333 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.333 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058595+0000", 2024-09-12T00:04:48.334 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002306083 2024-09-12T00:04:48.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.334 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.334 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.334 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058621+0000", 2024-09-12T00:04:48.334 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6431000000000002e-05 2024-09-12T00:04:48.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.334 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.334 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.334 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058631+0000", 2024-09-12T00:04:48.334 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0166000000000001e-05 2024-09-12T00:04:48.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.334 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.334 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.335 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058712+0000", 2024-09-12T00:04:48.335 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0122000000000003e-05 2024-09-12T00:04:48.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.335 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.335 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.335 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058821+0000", 2024-09-12T00:04:48.335 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010907400000000001 2024-09-12T00:04:48.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.335 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.335 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:48.335 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058910+0000", 2024-09-12T00:04:48.335 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9523000000000003e-05 2024-09-12T00:04:48.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.335 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.336 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.336 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073881+0000", 2024-09-12T00:04:48.336 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014971224 2024-09-12T00:04:48.336 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.336 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.336 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.336 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074101+0000", 2024-09-12T00:04:48.336 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0002195 2024-09-12T00:04:48.336 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.336 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.336 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.336 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074133+0000", 2024-09-12T00:04:48.336 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2138000000000003e-05 2024-09-12T00:04:48.337 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.337 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.337 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.337 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074175+0000", 2024-09-12T00:04:48.337 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2109e-05 2024-09-12T00:04:48.337 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.337 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.337 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.337 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.337 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.337 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1775 3.30 e58/23 3:0c2ae78d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_1:head v 58'1, mlcod=0'0)", 2024-09-12T00:04:48.337 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:04:48.337 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.329825914000001, 2024-09-12T00:04:48.337 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017585038000000001, 2024-09-12T00:04:48.338 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.338 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.338 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.338 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.338 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.338 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.338 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:04:48.338 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.338 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.338 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.338 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:04:48.338 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.339 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.339 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.339 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001763+0000", 2024-09-12T00:04:48.339 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2730000000000001e-06 2024-09-12T00:04:48.339 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.339 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.339 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.339 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005217+0000", 2024-09-12T00:04:48.339 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0034533810000000002 2024-09-12T00:04:48.339 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.339 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.339 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.339 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005241+0000", 2024-09-12T00:04:48.339 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4403e-05 2024-09-12T00:04:48.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.340 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.340 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.340 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005253+0000", 2024-09-12T00:04:48.340 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2007e-05 2024-09-12T00:04:48.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.340 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.340 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.340 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005324+0000", 2024-09-12T00:04:48.340 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0765000000000004e-05 2024-09-12T00:04:48.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.340 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.340 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.341 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005348+0000", 2024-09-12T00:04:48.341 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3762000000000001e-05 2024-09-12T00:04:48.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.341 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.341 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.341 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019291+0000", 2024-09-12T00:04:48.341 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013943707 2024-09-12T00:04:48.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.341 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.341 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.341 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019346+0000", 2024-09-12T00:04:48.341 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4740000000000001e-05 2024-09-12T00:04:48.341 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.342 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.342 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.342 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.342 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.342 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1780 3.16 3:69d8ee52:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:48.342 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:04:48.342 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.308217001999999, 2024-09-12T00:04:48.342 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016232362, 2024-09-12T00:04:48.342 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.342 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.342 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.342 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.342 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.342 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.343 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1780 2024-09-12T00:04:48.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.343 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.343 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.343 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.343 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:04:48.343 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.343 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.343 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.343 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:04:48.343 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.344 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.344 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.344 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023372+0000", 2024-09-12T00:04:48.344 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0209999999999998e-06 2024-09-12T00:04:48.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.344 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.344 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.344 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024447+0000", 2024-09-12T00:04:48.344 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0010749550000000001 2024-09-12T00:04:48.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.344 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.344 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.344 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024473+0000", 2024-09-12T00:04:48.345 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5689000000000001e-05 2024-09-12T00:04:48.345 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.345 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.345 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.345 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024484+0000", 2024-09-12T00:04:48.345 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1153e-05 2024-09-12T00:04:48.345 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.345 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.345 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.345 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024547+0000", 2024-09-12T00:04:48.345 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3400999999999998e-05 2024-09-12T00:04:48.345 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.345 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.346 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.346 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024669+0000", 2024-09-12T00:04:48.346 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012184999999999999 2024-09-12T00:04:48.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.346 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.346 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:48.346 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025014+0000", 2024-09-12T00:04:48.346 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000344505 2024-09-12T00:04:48.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.346 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.346 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.346 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039161+0000", 2024-09-12T00:04:48.346 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014147799000000001 2024-09-12T00:04:48.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.347 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.347 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039434+0000", 2024-09-12T00:04:48.347 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00027254699999999999 2024-09-12T00:04:48.347 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.347 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.347 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039521+0000", 2024-09-12T00:04:48.347 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6663999999999996e-05 2024-09-12T00:04:48.347 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.348 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.348 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039602+0000", 2024-09-12T00:04:48.348 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1778000000000002e-05 2024-09-12T00:04:48.348 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.348 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.348 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.348 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.348 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1912 3.16 3:6a08f78f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.4__shadow_.EKM6BwfpK8ZqXIKQk7k4yJFkOWS2UlN_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:04:48.348 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:35.139256+0000", 2024-09-12T00:04:48.348 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.192331081000001, 2024-09-12T00:04:48.348 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01537029, 2024-09-12T00:04:48.348 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.349 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.349 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.349 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.349 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.349 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.349 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1912 2024-09-12T00:04:48.349 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.349 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.349 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.349 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.349 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.139256+0000", 2024-09-12T00:04:48.349 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.349 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.349 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.350 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.350 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.139256+0000", 2024-09-12T00:04:48.350 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.350 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.350 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.350 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.350 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.139258+0000", 2024-09-12T00:04:48.350 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3439999999999999e-06 2024-09-12T00:04:48.350 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.350 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.350 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.350 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141028+0000", 2024-09-12T00:04:48.350 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001770183 2024-09-12T00:04:48.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.351 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.351 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.351 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141054+0000", 2024-09-12T00:04:48.351 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5928e-05 2024-09-12T00:04:48.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.351 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.351 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.351 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141065+0000", 2024-09-12T00:04:48.351 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0589e-05 2024-09-12T00:04:48.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.351 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.351 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.352 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141145+0000", 2024-09-12T00:04:48.352 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0121000000000001e-05 2024-09-12T00:04:48.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.352 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.352 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.352 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141257+0000", 2024-09-12T00:04:48.352 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000111672 2024-09-12T00:04:48.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.352 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.353 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:48.353 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141361+0000", 2024-09-12T00:04:48.353 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103705 2024-09-12T00:04:48.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.353 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.353 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.353 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.152422+0000", 2024-09-12T00:04:48.353 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011061586999999999 2024-09-12T00:04:48.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.353 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.353 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.353 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154552+0000", 2024-09-12T00:04:48.353 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021297120000000002 2024-09-12T00:04:48.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.354 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.354 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.354 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154590+0000", 2024-09-12T00:04:48.354 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7942999999999999e-05 2024-09-12T00:04:48.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.354 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.354 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.354 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154626+0000", 2024-09-12T00:04:48.354 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6505999999999999e-05 2024-09-12T00:04:48.354 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.354 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.354 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.354 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.355 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2650 3.5 3:a19f3a83:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.355 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.189998+0000", 2024-09-12T00:04:48.355 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.1415891060000001, 2024-09-12T00:04:48.355 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016025257000000001, 2024-09-12T00:04:48.355 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.355 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.355 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.355 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.356 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.356 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.356 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2650 2024-09-12T00:04:48.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.356 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.356 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.356 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.356 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.189998+0000", 2024-09-12T00:04:48.356 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.356 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.357 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.357 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.189998+0000", 2024-09-12T00:04:48.357 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.357 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.357 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.357 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.190001+0000", 2024-09-12T00:04:48.357 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5830000000000001e-06 2024-09-12T00:04:48.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.357 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.357 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.357 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191320+0000", 2024-09-12T00:04:48.357 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0013192449999999999 2024-09-12T00:04:48.358 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.358 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.358 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.358 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191341+0000", 2024-09-12T00:04:48.358 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1690000000000001e-05 2024-09-12T00:04:48.358 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.358 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.358 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.358 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191355+0000", 2024-09-12T00:04:48.358 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3147e-05 2024-09-12T00:04:48.358 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.359 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191444+0000", 2024-09-12T00:04:48.359 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9809999999999996e-05 2024-09-12T00:04:48.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.359 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191623+0000", 2024-09-12T00:04:48.359 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017869399999999999 2024-09-12T00:04:48.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:48.360 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191786+0000", 2024-09-12T00:04:48.360 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000163203 2024-09-12T00:04:48.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.360 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.360 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.360 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.198758+0000", 2024-09-12T00:04:48.360 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069714440000000003 2024-09-12T00:04:48.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.360 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.360 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.360 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.205895+0000", 2024-09-12T00:04:48.361 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.007137404 2024-09-12T00:04:48.361 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.361 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.361 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.361 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.205966+0000", 2024-09-12T00:04:48.361 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0797999999999995e-05 2024-09-12T00:04:48.361 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.361 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.361 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.361 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.206023+0000", 2024-09-12T00:04:48.361 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7238999999999999e-05 2024-09-12T00:04:48.361 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.361 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.361 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.362 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.362 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2655 3.5 3:a26caaa1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.362 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.241675+0000", 2024-09-12T00:04:48.362 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.089911844, 2024-09-12T00:04:48.362 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018338047999999999, 2024-09-12T00:04:48.362 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.362 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.362 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.362 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.362 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.362 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.362 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2655 2024-09-12T00:04:48.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.363 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.363 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.241675+0000", 2024-09-12T00:04:48.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.363 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.241675+0000", 2024-09-12T00:04:48.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.241678+0000", 2024-09-12T00:04:48.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4430000000000002e-06 2024-09-12T00:04:48.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243471+0000", 2024-09-12T00:04:48.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017937369999999999 2024-09-12T00:04:48.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243493+0000", 2024-09-12T00:04:48.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2001000000000002e-05 2024-09-12T00:04:48.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.365 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243505+0000", 2024-09-12T00:04:48.365 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1632e-05 2024-09-12T00:04:48.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.365 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243579+0000", 2024-09-12T00:04:48.365 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4165999999999994e-05 2024-09-12T00:04:48.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.365 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243766+0000", 2024-09-12T00:04:48.366 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018714599999999999 2024-09-12T00:04:48.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.366 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.366 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:48.366 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243937+0000", 2024-09-12T00:04:48.366 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017038700000000001 2024-09-12T00:04:48.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.366 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.366 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.366 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.250274+0000", 2024-09-12T00:04:48.366 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063369070000000001 2024-09-12T00:04:48.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.366 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.367 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.367 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.259911+0000", 2024-09-12T00:04:48.367 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0096378669999999996 2024-09-12T00:04:48.367 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.367 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.367 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.367 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.259960+0000", 2024-09-12T00:04:48.367 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8763000000000001e-05 2024-09-12T00:04:48.367 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.367 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.367 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.367 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.260013+0000", 2024-09-12T00:04:48.367 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2998999999999999e-05 2024-09-12T00:04:48.367 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.368 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.368 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.368 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2656 3.29 e63/23 3:951a8707:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_151:head v 63'1, mlcod=0'0)", 2024-09-12T00:04:48.368 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.258538+0000", 2024-09-12T00:04:48.368 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.0730492300000001, 2024-09-12T00:04:48.368 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013245392999999999, 2024-09-12T00:04:48.368 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.368 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.368 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.368 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.258538+0000", 2024-09-12T00:04:48.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.258538+0000", 2024-09-12T00:04:48.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.258540+0000", 2024-09-12T00:04:48.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6510000000000001e-06 2024-09-12T00:04:48.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.264924+0000", 2024-09-12T00:04:48.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063834649999999996 2024-09-12T00:04:48.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.264956+0000", 2024-09-12T00:04:48.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2020999999999997e-05 2024-09-12T00:04:48.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.264967+0000", 2024-09-12T00:04:48.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1199000000000001e-05 2024-09-12T00:04:48.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.371 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.265049+0000", 2024-09-12T00:04:48.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2311999999999994e-05 2024-09-12T00:04:48.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.371 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.265069+0000", 2024-09-12T00:04:48.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9488e-05 2024-09-12T00:04:48.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.372 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.372 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.372 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.271710+0000", 2024-09-12T00:04:48.372 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066412600000000004 2024-09-12T00:04:48.372 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.372 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.372 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.372 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.271783+0000", 2024-09-12T00:04:48.372 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2997000000000006e-05 2024-09-12T00:04:48.372 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.372 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.372 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.373 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.373 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.373 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2657 3.3c 3:3e583291:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.373 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.263916+0000", 2024-09-12T00:04:48.373 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.067671153, 2024-09-12T00:04:48.373 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020609368999999999, 2024-09-12T00:04:48.373 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.373 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.373 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.373 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.373 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.373 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.373 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2657 2024-09-12T00:04:48.373 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.374 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.374 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.374 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.374 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.263916+0000", 2024-09-12T00:04:48.374 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.374 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.374 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.374 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.263916+0000", 2024-09-12T00:04:48.374 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.374 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.375 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.375 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.263919+0000", 2024-09-12T00:04:48.375 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.92e-06 2024-09-12T00:04:48.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.375 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.375 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266277+0000", 2024-09-12T00:04:48.375 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023579310000000002 2024-09-12T00:04:48.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.375 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.375 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266302+0000", 2024-09-12T00:04:48.375 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4807000000000002e-05 2024-09-12T00:04:48.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.376 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.376 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.376 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266317+0000", 2024-09-12T00:04:48.376 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5209e-05 2024-09-12T00:04:48.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.376 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.376 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.376 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266414+0000", 2024-09-12T00:04:48.376 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7658000000000006e-05 2024-09-12T00:04:48.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.376 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.376 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.376 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266556+0000", 2024-09-12T00:04:48.377 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014166100000000001 2024-09-12T00:04:48.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.377 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:48.377 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266680+0000", 2024-09-12T00:04:48.377 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012421099999999999 2024-09-12T00:04:48.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.377 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.377 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275396+0000", 2024-09-12T00:04:48.377 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0087156609999999995 2024-09-12T00:04:48.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.378 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.378 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.284426+0000", 2024-09-12T00:04:48.378 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0090300039999999995 2024-09-12T00:04:48.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.378 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.378 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.378 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.284472+0000", 2024-09-12T00:04:48.378 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6273000000000002e-05 2024-09-12T00:04:48.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.378 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.378 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.378 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.284525+0000", 2024-09-12T00:04:48.378 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3034000000000001e-05 2024-09-12T00:04:48.379 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.379 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.379 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.379 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.379 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.379 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2658 3.3a 3:5ec14981:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.379 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.274153+0000", 2024-09-12T00:04:48.379 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.0574337110000001, 2024-09-12T00:04:48.379 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017963626, 2024-09-12T00:04:48.379 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.379 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.379 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.379 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.380 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.380 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.380 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2658 2024-09-12T00:04:48.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.380 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.380 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.380 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.380 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.274153+0000", 2024-09-12T00:04:48.380 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.381 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.381 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.381 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.274153+0000", 2024-09-12T00:04:48.381 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.381 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.381 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.381 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.274156+0000", 2024-09-12T00:04:48.381 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5299999999999999e-06 2024-09-12T00:04:48.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.381 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.381 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.381 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275746+0000", 2024-09-12T00:04:48.381 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001589741 2024-09-12T00:04:48.382 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.382 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.382 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.382 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275770+0000", 2024-09-12T00:04:48.382 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4539999999999999e-05 2024-09-12T00:04:48.382 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.382 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.382 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.382 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275785+0000", 2024-09-12T00:04:48.382 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4783000000000001e-05 2024-09-12T00:04:48.382 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.382 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.382 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.383 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275867+0000", 2024-09-12T00:04:48.383 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2362999999999997e-05 2024-09-12T00:04:48.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.383 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.383 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.383 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275990+0000", 2024-09-12T00:04:48.383 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012287100000000001 2024-09-12T00:04:48.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.383 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.383 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:48.383 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.276085+0000", 2024-09-12T00:04:48.383 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5172000000000003e-05 2024-09-12T00:04:48.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.383 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.384 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.384 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.282993+0000", 2024-09-12T00:04:48.384 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069076210000000001 2024-09-12T00:04:48.384 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.384 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.384 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.384 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.291976+0000", 2024-09-12T00:04:48.384 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0089835269999999998 2024-09-12T00:04:48.384 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.384 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.384 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.384 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.292054+0000", 2024-09-12T00:04:48.384 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7804000000000002e-05 2024-09-12T00:04:48.384 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.385 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.385 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.385 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.292117+0000", 2024-09-12T00:04:48.385 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2674000000000003e-05 2024-09-12T00:04:48.385 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.385 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.385 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.385 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.385 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.385 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2661 3.1e e63/23 3:7a671bd1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_156:head v 63'3, mlcod=62'1)", 2024-09-12T00:04:48.385 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.312780+0000", 2024-09-12T00:04:48.385 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.0188070819999999, 2024-09-12T00:04:48.385 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015038723, 2024-09-12T00:04:48.386 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.386 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.386 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.386 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.386 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.386 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.386 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.312780+0000", 2024-09-12T00:04:48.386 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.386 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.386 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.386 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.312780+0000", 2024-09-12T00:04:48.386 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.387 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.387 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.312783+0000", 2024-09-12T00:04:48.387 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.756e-06 2024-09-12T00:04:48.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.387 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.387 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317423+0000", 2024-09-12T00:04:48.387 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004640323 2024-09-12T00:04:48.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.387 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.387 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317453+0000", 2024-09-12T00:04:48.388 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0301e-05 2024-09-12T00:04:48.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.388 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.388 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.388 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317468+0000", 2024-09-12T00:04:48.388 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4989e-05 2024-09-12T00:04:48.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.388 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.388 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.388 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317551+0000", 2024-09-12T00:04:48.388 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2712000000000004e-05 2024-09-12T00:04:48.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.388 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.389 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.389 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317578+0000", 2024-09-12T00:04:48.389 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7161999999999998e-05 2024-09-12T00:04:48.389 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.389 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.389 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.389 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.327765+0000", 2024-09-12T00:04:48.389 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010187229000000001 2024-09-12T00:04:48.389 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.389 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.389 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.389 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.327819+0000", 2024-09-12T00:04:48.389 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3251000000000002e-05 2024-09-12T00:04:48.389 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.390 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.390 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.390 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.390 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.390 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2675 3.20 3:0529bfef:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.390 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.454008+0000", 2024-09-12T00:04:48.390 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.87757882600000003, 2024-09-12T00:04:48.390 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017972776999999999, 2024-09-12T00:04:48.390 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.390 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.390 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.390 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.390 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.391 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.391 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2675 2024-09-12T00:04:48.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.391 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.391 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.391 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.391 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.454008+0000", 2024-09-12T00:04:48.391 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.391 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.391 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.391 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.454008+0000", 2024-09-12T00:04:48.391 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.392 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.392 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.454011+0000", 2024-09-12T00:04:48.392 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1379999999999999e-06 2024-09-12T00:04:48.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.392 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.392 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455547+0000", 2024-09-12T00:04:48.392 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001535919 2024-09-12T00:04:48.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.392 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455580+0000", 2024-09-12T00:04:48.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2789000000000001e-05 2024-09-12T00:04:48.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.393 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455591+0000", 2024-09-12T00:04:48.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0531e-05 2024-09-12T00:04:48.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.393 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455670+0000", 2024-09-12T00:04:48.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9822999999999998e-05 2024-09-12T00:04:48.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.394 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.394 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455863+0000", 2024-09-12T00:04:48.394 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019248799999999999 2024-09-12T00:04:48.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.394 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.394 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:48.394 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.456021+0000", 2024-09-12T00:04:48.394 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000157627 2024-09-12T00:04:48.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.394 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.394 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.394 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.462847+0000", 2024-09-12T00:04:48.394 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0068268230000000001 2024-09-12T00:04:48.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.394 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.395 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.395 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.471901+0000", 2024-09-12T00:04:48.395 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0090533820000000004 2024-09-12T00:04:48.395 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.395 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.395 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.395 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.471939+0000", 2024-09-12T00:04:48.395 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8334999999999998e-05 2024-09-12T00:04:48.395 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.395 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.395 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.395 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.471981+0000", 2024-09-12T00:04:48.395 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1922000000000003e-05 2024-09-12T00:04:48.396 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.396 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.396 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.396 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.396 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2693 3.1e e63/23 3:7a8f9e2c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_178:head v 63'4, mlcod=63'2)", 2024-09-12T00:04:48.396 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.541097+0000", 2024-09-12T00:04:48.396 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.79049011400000002, 2024-09-12T00:04:48.396 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013470268000000001, 2024-09-12T00:04:48.396 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.396 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.397 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.397 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.397 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.541097+0000", 2024-09-12T00:04:48.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.397 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.541097+0000", 2024-09-12T00:04:48.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.397 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.541098+0000", 2024-09-12T00:04:48.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.454e-06 2024-09-12T00:04:48.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.398 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.398 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545193+0000", 2024-09-12T00:04:48.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040943899999999998 2024-09-12T00:04:48.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.398 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.398 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545221+0000", 2024-09-12T00:04:48.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8595e-05 2024-09-12T00:04:48.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545235+0000", 2024-09-12T00:04:48.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3329999999999999e-05 2024-09-12T00:04:48.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545320+0000", 2024-09-12T00:04:48.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5371000000000006e-05 2024-09-12T00:04:48.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545348+0000", 2024-09-12T00:04:48.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7532e-05 2024-09-12T00:04:48.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.400 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.400 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.554493+0000", 2024-09-12T00:04:48.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091452400000000007 2024-09-12T00:04:48.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.400 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.400 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.554567+0000", 2024-09-12T00:04:48.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4356000000000004e-05 2024-09-12T00:04:48.400 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.400 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.401 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.401 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2696 3.2b e63/23 3:d7c776f8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_181:head v 63'8, mlcod=63'6)", 2024-09-12T00:04:48.401 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.572942+0000", 2024-09-12T00:04:48.401 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.75864457600000001, 2024-09-12T00:04:48.401 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016050795999999999, 2024-09-12T00:04:48.401 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.401 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.402 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.402 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.402 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.572942+0000", 2024-09-12T00:04:48.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.402 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.572942+0000", 2024-09-12T00:04:48.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.403 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.572945+0000", 2024-09-12T00:04:48.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1730000000000002e-06 2024-09-12T00:04:48.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.403 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577465+0000", 2024-09-12T00:04:48.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045199649999999999 2024-09-12T00:04:48.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.403 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577495+0000", 2024-09-12T00:04:48.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0473000000000001e-05 2024-09-12T00:04:48.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577512+0000", 2024-09-12T00:04:48.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7215999999999999e-05 2024-09-12T00:04:48.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577616+0000", 2024-09-12T00:04:48.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103304 2024-09-12T00:04:48.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577649+0000", 2024-09-12T00:04:48.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3695999999999997e-05 2024-09-12T00:04:48.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.588945+0000", 2024-09-12T00:04:48.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011295556 2024-09-12T00:04:48.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.588993+0000", 2024-09-12T00:04:48.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8412999999999999e-05 2024-09-12T00:04:48.405 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.405 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.406 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.406 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2702 3.3c 3:3d6a0b3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.406 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.626588+0000", 2024-09-12T00:04:48.406 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.70499888200000005, 2024-09-12T00:04:48.406 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018349791000000001, 2024-09-12T00:04:48.406 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.406 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.406 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.406 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.406 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.406 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.406 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2702 2024-09-12T00:04:48.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.407 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.626588+0000", 2024-09-12T00:04:48.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.626588+0000", 2024-09-12T00:04:48.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.408 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.408 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.626591+0000", 2024-09-12T00:04:48.408 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0469999999999998e-06 2024-09-12T00:04:48.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.408 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.408 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.627983+0000", 2024-09-12T00:04:48.408 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001391541 2024-09-12T00:04:48.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.408 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.408 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628016+0000", 2024-09-12T00:04:48.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3556999999999997e-05 2024-09-12T00:04:48.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.409 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628035+0000", 2024-09-12T00:04:48.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9162999999999999e-05 2024-09-12T00:04:48.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.409 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628108+0000", 2024-09-12T00:04:48.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2336999999999995e-05 2024-09-12T00:04:48.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628237+0000", 2024-09-12T00:04:48.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000128706 2024-09-12T00:04:48.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:48.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628329+0000", 2024-09-12T00:04:48.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2761000000000002e-05 2024-09-12T00:04:48.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.632309+0000", 2024-09-12T00:04:48.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003979692 2024-09-12T00:04:48.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.411 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.644845+0000", 2024-09-12T00:04:48.411 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012536112 2024-09-12T00:04:48.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.411 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.644898+0000", 2024-09-12T00:04:48.411 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.329e-05 2024-09-12T00:04:48.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.411 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.644938+0000", 2024-09-12T00:04:48.412 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9585000000000001e-05 2024-09-12T00:04:48.412 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.412 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.412 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.412 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.412 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2716 3.20 3:042f7231:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.412 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.766936+0000", 2024-09-12T00:04:48.412 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.56465074900000001, 2024-09-12T00:04:48.412 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025751422999999999, 2024-09-12T00:04:48.412 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.412 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.412 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.413 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.413 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.413 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.413 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2716 2024-09-12T00:04:48.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.413 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.413 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766936+0000", 2024-09-12T00:04:48.413 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.413 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766936+0000", 2024-09-12T00:04:48.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.414 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.414 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766939+0000", 2024-09-12T00:04:48.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8499999999999998e-06 2024-09-12T00:04:48.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.414 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.414 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769471+0000", 2024-09-12T00:04:48.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025320780000000001 2024-09-12T00:04:48.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.414 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769506+0000", 2024-09-12T00:04:48.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4842999999999998e-05 2024-09-12T00:04:48.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769522+0000", 2024-09-12T00:04:48.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5548000000000001e-05 2024-09-12T00:04:48.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769602+0000", 2024-09-12T00:04:48.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0291999999999996e-05 2024-09-12T00:04:48.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769726+0000", 2024-09-12T00:04:48.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012447900000000001 2024-09-12T00:04:48.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:48.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769833+0000", 2024-09-12T00:04:48.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010621899999999999 2024-09-12T00:04:48.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.775790+0000", 2024-09-12T00:04:48.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0059571529999999998 2024-09-12T00:04:48.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.417 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.417 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.792589+0000", 2024-09-12T00:04:48.417 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016799445 2024-09-12T00:04:48.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.417 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.417 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.792634+0000", 2024-09-12T00:04:48.417 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4543999999999999e-05 2024-09-12T00:04:48.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.418 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.418 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.792688+0000", 2024-09-12T00:04:48.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3971999999999998e-05 2024-09-12T00:04:48.418 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.418 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.418 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.418 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.418 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2719 3.1 e63/23 3:83b62cc7:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_204:head v 63'9, mlcod=63'7)", 2024-09-12T00:04:48.418 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.801392+0000", 2024-09-12T00:04:48.418 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.53019505199999994, 2024-09-12T00:04:48.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014562542, 2024-09-12T00:04:48.418 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.418 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.419 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.419 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.419 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.419 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.419 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.801392+0000", 2024-09-12T00:04:48.419 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.419 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.419 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.419 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.801392+0000", 2024-09-12T00:04:48.419 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.419 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.419 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.420 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.801394+0000", 2024-09-12T00:04:48.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0090000000000002e-06 2024-09-12T00:04:48.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.420 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.420 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.420 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807832+0000", 2024-09-12T00:04:48.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064375989999999996 2024-09-12T00:04:48.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.420 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.420 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.420 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807863+0000", 2024-09-12T00:04:48.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1114000000000001e-05 2024-09-12T00:04:48.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.421 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807877+0000", 2024-09-12T00:04:48.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4386000000000001e-05 2024-09-12T00:04:48.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.421 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807948+0000", 2024-09-12T00:04:48.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1055000000000003e-05 2024-09-12T00:04:48.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.421 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807965+0000", 2024-09-12T00:04:48.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7025999999999999e-05 2024-09-12T00:04:48.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.815469+0000", 2024-09-12T00:04:48.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075039979999999996 2024-09-12T00:04:48.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.815955+0000", 2024-09-12T00:04:48.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00048535499999999998 2024-09-12T00:04:48.422 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.422 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.422 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.423 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2739 3.3a 3:5e74d49c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_224:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.423 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.006819+0000", 2024-09-12T00:04:48.423 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.32476819299999998, 2024-09-12T00:04:48.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018768888000000001, 2024-09-12T00:04:48.423 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.423 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.423 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.423 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.423 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.423 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.423 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2739 2024-09-12T00:04:48.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.424 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.006819+0000", 2024-09-12T00:04:48.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.006819+0000", 2024-09-12T00:04:48.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.006821+0000", 2024-09-12T00:04:48.425 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5959999999999998e-06 2024-09-12T00:04:48.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.425 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.425 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008558+0000", 2024-09-12T00:04:48.425 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017366840000000001 2024-09-12T00:04:48.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.425 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.425 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008585+0000", 2024-09-12T00:04:48.425 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7129000000000001e-05 2024-09-12T00:04:48.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.425 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.426 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008599+0000", 2024-09-12T00:04:48.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.326e-05 2024-09-12T00:04:48.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.426 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.426 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.426 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008679+0000", 2024-09-12T00:04:48.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0174999999999997e-05 2024-09-12T00:04:48.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.426 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.426 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.426 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008800+0000", 2024-09-12T00:04:48.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012106499999999999 2024-09-12T00:04:48.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:48.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008921+0000", 2024-09-12T00:04:48.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012163900000000001 2024-09-12T00:04:48.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.015366+0000", 2024-09-12T00:04:48.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064442309999999999 2024-09-12T00:04:48.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.025511+0000", 2024-09-12T00:04:48.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010145636 2024-09-12T00:04:48.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.428 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.428 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.025555+0000", 2024-09-12T00:04:48.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3426000000000001e-05 2024-09-12T00:04:48.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.428 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.428 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.025588+0000", 2024-09-12T00:04:48.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3046999999999997e-05 2024-09-12T00:04:48.428 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.428 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.428 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.429 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2743 3.16 3:696a1d44:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.429 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.046229+0000", 2024-09-12T00:04:48.429 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.28535811900000002, 2024-09-12T00:04:48.429 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015475686000000001, 2024-09-12T00:04:48.429 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.429 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.429 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.429 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.429 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.429 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.429 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2743 2024-09-12T00:04:48.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.430 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.430 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.430 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.046229+0000", 2024-09-12T00:04:48.430 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.430 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.430 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.046229+0000", 2024-09-12T00:04:48.430 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.431 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.431 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.046232+0000", 2024-09-12T00:04:48.431 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.802e-06 2024-09-12T00:04:48.431 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.431 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.431 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.431 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047565+0000", 2024-09-12T00:04:48.431 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0013334670000000001 2024-09-12T00:04:48.431 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.431 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.431 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.431 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047600+0000", 2024-09-12T00:04:48.431 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4431000000000003e-05 2024-09-12T00:04:48.432 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.432 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.432 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.432 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047616+0000", 2024-09-12T00:04:48.432 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5928999999999999e-05 2024-09-12T00:04:48.432 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.432 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.432 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.432 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047703+0000", 2024-09-12T00:04:48.432 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7557000000000002e-05 2024-09-12T00:04:48.432 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.432 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.433 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047863+0000", 2024-09-12T00:04:48.433 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015991700000000001 2024-09-12T00:04:48.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:48.433 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047993+0000", 2024-09-12T00:04:48.433 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000129591 2024-09-12T00:04:48.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.433 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.058764+0000", 2024-09-12T00:04:48.433 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010770956 2024-09-12T00:04:48.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.434 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.434 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.061632+0000", 2024-09-12T00:04:48.434 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0028681639999999999 2024-09-12T00:04:48.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.434 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.434 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.061675+0000", 2024-09-12T00:04:48.434 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3288999999999998e-05 2024-09-12T00:04:48.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.435 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.435 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.061705+0000", 2024-09-12T00:04:48.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9583000000000001e-05 2024-09-12T00:04:48.435 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.435 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.435 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.435 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2744 3.20 3:0785dd58:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.435 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.057454+0000", 2024-09-12T00:04:48.435 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.27413306599999998, 2024-09-12T00:04:48.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018728709, 2024-09-12T00:04:48.435 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.435 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.436 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.436 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.436 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.436 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.436 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2744 2024-09-12T00:04:48.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.436 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.436 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.436 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.436 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.057454+0000", 2024-09-12T00:04:48.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.437 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.437 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.057454+0000", 2024-09-12T00:04:48.437 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.437 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.437 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.057457+0000", 2024-09-12T00:04:48.437 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6680000000000001e-06 2024-09-12T00:04:48.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.437 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.437 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059191+0000", 2024-09-12T00:04:48.438 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001734766 2024-09-12T00:04:48.438 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.438 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.438 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.438 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059216+0000", 2024-09-12T00:04:48.438 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4933e-05 2024-09-12T00:04:48.438 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.438 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.438 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.438 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059230+0000", 2024-09-12T00:04:48.438 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3737000000000001e-05 2024-09-12T00:04:48.438 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.438 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.438 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.439 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059310+0000", 2024-09-12T00:04:48.439 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0086999999999994e-05 2024-09-12T00:04:48.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.439 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.439 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.439 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059415+0000", 2024-09-12T00:04:48.439 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010509 2024-09-12T00:04:48.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.439 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.439 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:48.439 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059521+0000", 2024-09-12T00:04:48.439 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105454 2024-09-12T00:04:48.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.440 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.440 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.440 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.066050+0000", 2024-09-12T00:04:48.440 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0065290620000000004 2024-09-12T00:04:48.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.440 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.440 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.440 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.076044+0000", 2024-09-12T00:04:48.440 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0099942539999999993 2024-09-12T00:04:48.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.440 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.440 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.440 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.076123+0000", 2024-09-12T00:04:48.440 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8980000000000006e-05 2024-09-12T00:04:48.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.441 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.441 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.441 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.076183+0000", 2024-09-12T00:04:48.441 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9678e-05 2024-09-12T00:04:48.441 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.441 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.441 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.441 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.441 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2752 3.5 3:a07c0cce:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.441 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.145032+0000", 2024-09-12T00:04:48.441 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.186555422, 2024-09-12T00:04:48.442 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017073703999999999, 2024-09-12T00:04:48.442 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.442 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.442 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.442 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.442 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.442 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.442 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2752 2024-09-12T00:04:48.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.442 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.442 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.442 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.145032+0000", 2024-09-12T00:04:48.442 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.443 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.443 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.443 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.145032+0000", 2024-09-12T00:04:48.443 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.443 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.443 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.443 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.145035+0000", 2024-09-12T00:04:48.443 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1810000000000001e-06 2024-09-12T00:04:48.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.443 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.443 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.443 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.146817+0000", 2024-09-12T00:04:48.444 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017823439999999999 2024-09-12T00:04:48.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.444 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.444 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.146860+0000", 2024-09-12T00:04:48.444 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2549999999999997e-05 2024-09-12T00:04:48.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.444 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.444 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.146880+0000", 2024-09-12T00:04:48.444 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9947000000000001e-05 2024-09-12T00:04:48.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.445 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.445 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.146984+0000", 2024-09-12T00:04:48.445 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104503 2024-09-12T00:04:48.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.445 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.445 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.445 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.147170+0000", 2024-09-12T00:04:48.445 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018568100000000001 2024-09-12T00:04:48.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.445 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.445 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:48.445 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.147326+0000", 2024-09-12T00:04:48.446 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000155993 2024-09-12T00:04:48.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.446 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.446 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.446 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.154513+0000", 2024-09-12T00:04:48.446 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071872910000000002 2024-09-12T00:04:48.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.446 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.446 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.446 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.162030+0000", 2024-09-12T00:04:48.446 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075170030000000004 2024-09-12T00:04:48.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.446 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.447 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.447 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.162071+0000", 2024-09-12T00:04:48.447 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0834999999999998e-05 2024-09-12T00:04:48.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.447 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.447 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.162105+0000", 2024-09-12T00:04:48.447 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4375999999999997e-05 2024-09-12T00:04:48.447 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.447 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.447 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.447 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.447 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.448 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:48.449 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:04:48.450 INFO:tasks.workunit.client.0.smithi019.stdout:adding file to bucket: 1Gb. 2024-09-12T00:04:48.450 INFO:tasks.workunit.client.0.smithi019.stdout:upload file successful 2024-09-12T00:04:48.450 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:04:48.450 INFO:tasks.workunit.client.0.smithi019.stdout:Test case: PASSED - set max size and ensure that the max size is in effect 2024-09-12T00:04:48.450 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:04:48.450 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:48.446+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:48.550 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:48.550+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:48.567 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:48.567 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:48.567 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.567 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.5433.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94830441411344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.567 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.568337+0000", 2024-09-12T00:04:48.567 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.001971694, 2024-09-12T00:04:48.567 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019901229999999999, 2024-09-12T00:04:48.567 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.568 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.568 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.568 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.568 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.5433", 2024-09-12T00:04:48.568 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/523908109", 2024-09-12T00:04:48.568 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 99 2024-09-12T00:04:48.568 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.568 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.568 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.568 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.568 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.568337+0000", 2024-09-12T00:04:48.568 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.568 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.568 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.569 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.569 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.568337+0000", 2024-09-12T00:04:48.569 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.569 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.569 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.569 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.569 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.568339+0000", 2024-09-12T00:04:48.569 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9e-06 2024-09-12T00:04:48.569 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.569 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.569 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.569 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.568345+0000", 2024-09-12T00:04:48.569 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1700000000000002e-06 2024-09-12T00:04:48.569 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.570 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.570 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.570 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.568363+0000", 2024-09-12T00:04:48.570 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7601e-05 2024-09-12T00:04:48.570 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.570 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.570 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.570 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.568370+0000", 2024-09-12T00:04:48.570 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9149999999999999e-06 2024-09-12T00:04:48.570 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.570 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.570 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.570 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.568420+0000", 2024-09-12T00:04:48.570 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0603000000000003e-05 2024-09-12T00:04:48.571 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.571 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.571 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.571 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.568475+0000", 2024-09-12T00:04:48.571 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5040000000000002e-05 2024-09-12T00:04:48.571 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.571 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.571 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:48.571 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.568559+0000", 2024-09-12T00:04:48.571 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3819999999999994e-05 2024-09-12T00:04:48.571 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.571 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.571 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.571 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.569070+0000", 2024-09-12T00:04:48.572 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00051090900000000004 2024-09-12T00:04:48.572 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.572 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.572 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.572 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.570294+0000", 2024-09-12T00:04:48.572 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0012239620000000001 2024-09-12T00:04:48.572 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.572 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.572 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.572 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.570325+0000", 2024-09-12T00:04:48.572 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0883999999999998e-05 2024-09-12T00:04:48.572 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.572 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.573 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.573 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.573 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.573 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop_reply(client.5433.0:99 7.15 e63/31 ondisk, result = 0)", 2024-09-12T00:04:48.573 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.570188+0000", 2024-09-12T00:04:48.573 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.000120529, 2024-09-12T00:04:48.573 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021489299999999999, 2024-09-12T00:04:48.573 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.573 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.573 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "started", 2024-09-12T00:04:48.573 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.573 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.573 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.574 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.570188+0000", 2024-09-12T00:04:48.574 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.574 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.574 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.574 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.574 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.570188+0000", 2024-09-12T00:04:48.574 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.574 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.574 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.574 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.574 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.570189+0000", 2024-09-12T00:04:48.574 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5999999999999991e-07 2024-09-12T00:04:48.574 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.574 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.575 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.575 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.570197+0000", 2024-09-12T00:04:48.575 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.357e-06 2024-09-12T00:04:48.575 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.575 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.575 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.575 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.570207+0000", 2024-09-12T00:04:48.575 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0773e-05 2024-09-12T00:04:48.575 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.575 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.575 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.575 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.570214+0000", 2024-09-12T00:04:48.575 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8850000000000001e-06 2024-09-12T00:04:48.575 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.576 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.576 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.576 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.570285+0000", 2024-09-12T00:04:48.576 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1063999999999996e-05 2024-09-12T00:04:48.576 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.576 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.576 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.576 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.570291+0000", 2024-09-12T00:04:48.576 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8089999999999998e-06 2024-09-12T00:04:48.576 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.576 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.576 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.576 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.576 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T00:04:48.577 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 2 2024-09-12T00:04:48.577 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:48.581 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:04:48.586 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:04:48.655 INFO:tasks.workunit.client.0.smithi019.stdout:user qa_user deleted 2024-09-12T00:04:48.655 INFO:tasks.workunit.client.0.smithi019.stdout:bucket delete succeeded 2024-09-12T00:04:48.656 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:48.656+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:48.696 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:48.696 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:48.697 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:48.697 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:48.697 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:48.710 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:04:48.752 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:48.750+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:48.853 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:48.850+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:48.863 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:48.863 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:48.863 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:48.863 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:48.863 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.863 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4232.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-12T00:04:48.864 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:04:48.864 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 92.316428837000004, 2024-09-12T00:04:48.864 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.049385680000000001, 2024-09-12T00:04:48.864 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.864 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.864 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.864 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.864 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4232", 2024-09-12T00:04:48.864 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/3037249369", 2024-09-12T00:04:48.864 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:04:48.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.865 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:04:48.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:04:48.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548454+0000", 2024-09-12T00:04:48.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2259999999999999e-06 2024-09-12T00:04:48.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.866 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548466+0000", 2024-09-12T00:04:48.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1361e-05 2024-09-12T00:04:48.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.866 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548492+0000", 2024-09-12T00:04:48.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6225999999999999e-05 2024-09-12T00:04:48.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.867 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548509+0000", 2024-09-12T00:04:48.867 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7452000000000002e-05 2024-09-12T00:04:48.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.867 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.867 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.867 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549371+0000", 2024-09-12T00:04:48.867 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00086204300000000005 2024-09-12T00:04:48.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.867 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.867 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:48.867 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549396+0000", 2024-09-12T00:04:48.867 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.51e-05 2024-09-12T00:04:48.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.867 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.868 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.868 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593253+0000", 2024-09-12T00:04:48.868 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.043856248 2024-09-12T00:04:48.868 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.868 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.868 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.868 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593517+0000", 2024-09-12T00:04:48.868 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026439299999999997 2024-09-12T00:04:48.868 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.868 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.868 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:48.868 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594046+0000", 2024-09-12T00:04:48.868 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00052854200000000001 2024-09-12T00:04:48.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.869 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.869 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.869 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597642+0000", 2024-09-12T00:04:48.869 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0035959070000000002 2024-09-12T00:04:48.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.869 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.869 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.869 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597670+0000", 2024-09-12T00:04:48.869 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8235999999999999e-05 2024-09-12T00:04:48.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.869 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.869 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.869 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597754+0000", 2024-09-12T00:04:48.870 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4009000000000002e-05 2024-09-12T00:04:48.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.870 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.870 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.870 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597833+0000", 2024-09-12T00:04:48.870 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8937000000000007e-05 2024-09-12T00:04:48.870 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.870 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.870 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.870 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.870 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T00:04:48.870 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:04:48.870 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 79.535219068999993, 2024-09-12T00:04:48.871 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025928692999999999, 2024-09-12T00:04:48.871 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.871 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.871 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "reached pg", 2024-09-12T00:04:48.871 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.871 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.871 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.871 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 43 2024-09-12T00:04:48.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.871 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.871 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.871 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.871 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:04:48.871 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.872 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.872 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:04:48.872 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.872 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.872 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329660+0000", 2024-09-12T00:04:48.872 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.965e-06 2024-09-12T00:04:48.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.872 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.872 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329673+0000", 2024-09-12T00:04:48.873 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3402e-05 2024-09-12T00:04:48.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.873 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.873 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.873 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329706+0000", 2024-09-12T00:04:48.873 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2441000000000003e-05 2024-09-12T00:04:48.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.873 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.873 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.873 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329723+0000", 2024-09-12T00:04:48.873 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7609e-05 2024-09-12T00:04:48.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.873 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.873 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.874 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330437+0000", 2024-09-12T00:04:48.874 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00071403500000000002 2024-09-12T00:04:48.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.874 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.874 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:48.874 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330454+0000", 2024-09-12T00:04:48.874 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6820000000000002e-05 2024-09-12T00:04:48.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.874 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.874 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.874 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347344+0000", 2024-09-12T00:04:48.874 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016890275 2024-09-12T00:04:48.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.874 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.874 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:48.875 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347365+0000", 2024-09-12T00:04:48.875 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0350999999999999e-05 2024-09-12T00:04:48.875 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.875 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.875 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.875 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355323+0000", 2024-09-12T00:04:48.875 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079579400000000002 2024-09-12T00:04:48.875 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.875 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.875 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.875 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355585+0000", 2024-09-12T00:04:48.875 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026285499999999999 2024-09-12T00:04:48.875 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.876 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.876 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.876 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.876 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1641 3.26 e58/23 3:658fe58e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2__shadow_.hDHTDpIswwqRA2bHiHVxkhWqZde6XEj_1:head v 58'1, mlcod=0'0)", 2024-09-12T00:04:48.876 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:04:48.876 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 15.805860566, 2024-09-12T00:04:48.876 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014950144, 2024-09-12T00:04:48.876 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.876 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.876 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.876 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.876 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.877 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:04:48.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.877 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.877 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.877 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:04:48.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.877 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.877 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.877 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059017+0000", 2024-09-12T00:04:48.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.508e-06 2024-09-12T00:04:48.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.878 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.878 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.878 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061582+0000", 2024-09-12T00:04:48.878 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025654010000000001 2024-09-12T00:04:48.878 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.878 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.878 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.878 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061607+0000", 2024-09-12T00:04:48.878 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5028000000000002e-05 2024-09-12T00:04:48.878 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.878 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.878 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.878 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061619+0000", 2024-09-12T00:04:48.879 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1905999999999999e-05 2024-09-12T00:04:48.879 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.879 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.879 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.879 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061696+0000", 2024-09-12T00:04:48.879 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7305999999999995e-05 2024-09-12T00:04:48.879 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.879 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.879 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.879 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061717+0000", 2024-09-12T00:04:48.879 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0380000000000001e-05 2024-09-12T00:04:48.879 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.879 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.879 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.880 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073925+0000", 2024-09-12T00:04:48.880 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012208088000000001 2024-09-12T00:04:48.880 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.880 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.880 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.880 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073965+0000", 2024-09-12T00:04:48.880 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0527e-05 2024-09-12T00:04:48.880 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.880 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.880 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.880 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.880 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.880 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1775 3.30 3:0c2ae78d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:48.881 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:04:48.881 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.866023247999999, 2024-09-12T00:04:48.881 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020783729000000001, 2024-09-12T00:04:48.881 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.881 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.881 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.881 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.881 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.881 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.881 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1775 2024-09-12T00:04:48.881 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.881 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.881 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.881 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.882 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:04:48.882 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.882 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.882 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.882 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:04:48.882 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.882 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.882 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.882 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998856+0000", 2024-09-12T00:04:48.882 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6849999999999999e-06 2024-09-12T00:04:48.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.883 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.883 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.883 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001327+0000", 2024-09-12T00:04:48.883 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024706279999999999 2024-09-12T00:04:48.883 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.883 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.883 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.883 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001355+0000", 2024-09-12T00:04:48.883 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8419999999999999e-05 2024-09-12T00:04:48.883 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.883 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.883 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.883 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001366+0000", 2024-09-12T00:04:48.883 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1073999999999999e-05 2024-09-12T00:04:48.883 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.884 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.884 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.884 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001438+0000", 2024-09-12T00:04:48.884 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1389000000000004e-05 2024-09-12T00:04:48.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.884 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.884 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.884 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001548+0000", 2024-09-12T00:04:48.884 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110612 2024-09-12T00:04:48.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.884 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.884 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:48.884 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001639+0000", 2024-09-12T00:04:48.884 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0192999999999995e-05 2024-09-12T00:04:48.885 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.885 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.885 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.885 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019057+0000", 2024-09-12T00:04:48.885 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017418411000000002 2024-09-12T00:04:48.885 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.885 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.885 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.885 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019528+0000", 2024-09-12T00:04:48.885 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00047075699999999998 2024-09-12T00:04:48.885 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.885 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.885 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.885 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019577+0000", 2024-09-12T00:04:48.886 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8714999999999997e-05 2024-09-12T00:04:48.886 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.886 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.886 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.886 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019636+0000", 2024-09-12T00:04:48.886 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9845e-05 2024-09-12T00:04:48.886 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.886 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.886 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.886 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.886 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.886 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1780 3.16 e58/23 3:69d8ee52:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3_10Mb.:head v 58'1, mlcod=0'0)", 2024-09-12T00:04:48.886 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:04:48.887 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.839729955999999, 2024-09-12T00:04:48.887 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01408911, 2024-09-12T00:04:48.887 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.887 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.887 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.887 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.887 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.887 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.887 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:04:48.887 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.887 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.887 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.887 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.887 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:04:48.888 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.888 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.888 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.888 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.888 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025148+0000", 2024-09-12T00:04:48.888 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4229999999999999e-06 2024-09-12T00:04:48.888 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.888 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.888 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.888 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026337+0000", 2024-09-12T00:04:48.888 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011890589999999999 2024-09-12T00:04:48.888 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.888 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.889 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.889 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026362+0000", 2024-09-12T00:04:48.889 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4566000000000002e-05 2024-09-12T00:04:48.889 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.889 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.889 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.889 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026372+0000", 2024-09-12T00:04:48.889 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8509999999999994e-06 2024-09-12T00:04:48.889 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.889 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.889 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.889 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026448+0000", 2024-09-12T00:04:48.889 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6626999999999997e-05 2024-09-12T00:04:48.889 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.890 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.890 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.890 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026473+0000", 2024-09-12T00:04:48.890 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4647e-05 2024-09-12T00:04:48.890 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.890 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.890 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.890 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039120+0000", 2024-09-12T00:04:48.890 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012647122 2024-09-12T00:04:48.890 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.890 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.890 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.890 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039235+0000", 2024-09-12T00:04:48.890 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000114815 2024-09-12T00:04:48.891 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.891 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.891 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.891 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.891 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.891 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2648 3.13 3:c936a360:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.891 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.164782+0000", 2024-09-12T00:04:48.891 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.7000936690000001, 2024-09-12T00:04:48.891 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019628063000000001, 2024-09-12T00:04:48.891 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.891 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.891 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.891 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.891 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.892 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.892 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2648 2024-09-12T00:04:48.892 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.892 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.892 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.892 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.892 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.164782+0000", 2024-09-12T00:04:48.892 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.892 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.892 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.892 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.892 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.164782+0000", 2024-09-12T00:04:48.892 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.893 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.893 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.893 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.893 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.164786+0000", 2024-09-12T00:04:48.893 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3450000000000002e-06 2024-09-12T00:04:48.893 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.893 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.893 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.893 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166758+0000", 2024-09-12T00:04:48.893 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019721629999999999 2024-09-12T00:04:48.893 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.893 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.893 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.894 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166785+0000", 2024-09-12T00:04:48.894 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7676000000000001e-05 2024-09-12T00:04:48.894 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.894 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.894 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.894 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166799+0000", 2024-09-12T00:04:48.894 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3716e-05 2024-09-12T00:04:48.894 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.894 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.894 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.894 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166895+0000", 2024-09-12T00:04:48.894 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6243999999999995e-05 2024-09-12T00:04:48.894 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.894 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.895 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.895 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.167092+0000", 2024-09-12T00:04:48.895 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019639200000000001 2024-09-12T00:04:48.895 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.895 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.895 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:48.895 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.167273+0000", 2024-09-12T00:04:48.895 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000181533 2024-09-12T00:04:48.895 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.895 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.895 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.895 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.174331+0000", 2024-09-12T00:04:48.895 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0070577879999999997 2024-09-12T00:04:48.895 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.896 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.896 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.896 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.184172+0000", 2024-09-12T00:04:48.896 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0098409469999999992 2024-09-12T00:04:48.896 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.896 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.896 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.896 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.184238+0000", 2024-09-12T00:04:48.896 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6036000000000003e-05 2024-09-12T00:04:48.896 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.896 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.896 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.896 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.184410+0000", 2024-09-12T00:04:48.897 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017222299999999999 2024-09-12T00:04:48.897 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.897 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.897 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.897 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.897 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.897 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2659 3.2d 3:b4a71344:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.897 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.285246+0000", 2024-09-12T00:04:48.897 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.579629766, 2024-09-12T00:04:48.897 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020000217000000001, 2024-09-12T00:04:48.897 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.897 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.897 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.897 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.898 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.898 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.898 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2659 2024-09-12T00:04:48.898 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.898 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.898 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.898 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.898 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.285246+0000", 2024-09-12T00:04:48.898 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.898 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.898 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.898 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.898 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.285246+0000", 2024-09-12T00:04:48.899 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.899 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.899 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.899 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.899 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.285249+0000", 2024-09-12T00:04:48.899 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3890000000000001e-06 2024-09-12T00:04:48.899 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.899 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.899 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.899 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287047+0000", 2024-09-12T00:04:48.899 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017978099999999999 2024-09-12T00:04:48.899 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.899 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.899 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.900 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287084+0000", 2024-09-12T00:04:48.900 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6358e-05 2024-09-12T00:04:48.900 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.900 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.900 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.900 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287101+0000", 2024-09-12T00:04:48.900 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7815000000000001e-05 2024-09-12T00:04:48.900 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.900 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.900 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.900 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287198+0000", 2024-09-12T00:04:48.900 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6482000000000002e-05 2024-09-12T00:04:48.900 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.900 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.901 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.901 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287337+0000", 2024-09-12T00:04:48.901 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013917500000000001 2024-09-12T00:04:48.901 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.901 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.901 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:48.901 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287451+0000", 2024-09-12T00:04:48.901 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000113962 2024-09-12T00:04:48.901 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.901 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.901 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.901 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.293889+0000", 2024-09-12T00:04:48.901 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064380110000000004 2024-09-12T00:04:48.901 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.902 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.902 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.902 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.305119+0000", 2024-09-12T00:04:48.902 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011229872 2024-09-12T00:04:48.902 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.902 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.902 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.902 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.305191+0000", 2024-09-12T00:04:48.902 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2002000000000006e-05 2024-09-12T00:04:48.902 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.902 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.902 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.902 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.305246+0000", 2024-09-12T00:04:48.902 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5340999999999998e-05 2024-09-12T00:04:48.903 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.903 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.903 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.903 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.903 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.903 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2662 3.28 3:1791a19e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.903 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.317519+0000", 2024-09-12T00:04:48.903 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.5473568179999999, 2024-09-12T00:04:48.903 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016495961999999999, 2024-09-12T00:04:48.903 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.903 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.903 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.903 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.904 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.904 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.904 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2662 2024-09-12T00:04:48.904 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.904 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.904 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.904 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.904 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317519+0000", 2024-09-12T00:04:48.904 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.904 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.904 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.904 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.904 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317519+0000", 2024-09-12T00:04:48.904 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.905 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.905 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.905 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.905 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317522+0000", 2024-09-12T00:04:48.905 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7389999999999999e-06 2024-09-12T00:04:48.905 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.905 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.905 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.905 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319683+0000", 2024-09-12T00:04:48.905 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021614970000000001 2024-09-12T00:04:48.905 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.905 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.905 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.906 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319715+0000", 2024-09-12T00:04:48.906 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1574e-05 2024-09-12T00:04:48.906 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.906 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.906 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.906 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319730+0000", 2024-09-12T00:04:48.906 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5543e-05 2024-09-12T00:04:48.906 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.906 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.906 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.906 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319820+0000", 2024-09-12T00:04:48.906 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9402999999999998e-05 2024-09-12T00:04:48.906 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.906 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.907 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.907 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319976+0000", 2024-09-12T00:04:48.907 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015662900000000001 2024-09-12T00:04:48.907 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.907 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.907 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:48.907 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.320143+0000", 2024-09-12T00:04:48.907 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000166207 2024-09-12T00:04:48.907 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.907 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.907 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.907 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.327504+0000", 2024-09-12T00:04:48.907 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0073616189999999998 2024-09-12T00:04:48.907 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.908 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.908 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.908 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.333886+0000", 2024-09-12T00:04:48.908 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063817650000000002 2024-09-12T00:04:48.908 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.908 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.908 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.908 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.333952+0000", 2024-09-12T00:04:48.908 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5889999999999994e-05 2024-09-12T00:04:48.908 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.908 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.908 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.908 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.334015+0000", 2024-09-12T00:04:48.908 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3095999999999994e-05 2024-09-12T00:04:48.909 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.909 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.909 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.909 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.909 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.909 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2664 3.1d 3:b8bd1b2d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.909 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.341755+0000", 2024-09-12T00:04:48.909 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.5231209620000001, 2024-09-12T00:04:48.909 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017365477000000001, 2024-09-12T00:04:48.909 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.909 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.909 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.909 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.910 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.910 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.910 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2664 2024-09-12T00:04:48.910 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.910 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.910 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.910 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.910 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.341755+0000", 2024-09-12T00:04:48.910 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.910 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.910 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.910 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.910 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.341755+0000", 2024-09-12T00:04:48.910 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.911 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.911 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.911 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.911 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.341758+0000", 2024-09-12T00:04:48.911 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6560000000000001e-06 2024-09-12T00:04:48.911 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.911 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.911 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.911 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343741+0000", 2024-09-12T00:04:48.911 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019832389999999999 2024-09-12T00:04:48.911 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.911 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.911 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.911 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343766+0000", 2024-09-12T00:04:48.912 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4967e-05 2024-09-12T00:04:48.912 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.912 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.912 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.912 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343776+0000", 2024-09-12T00:04:48.912 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0686000000000001e-05 2024-09-12T00:04:48.912 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.912 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.912 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.912 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343854+0000", 2024-09-12T00:04:48.912 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7210000000000001e-05 2024-09-12T00:04:48.912 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.912 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.912 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.913 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.344027+0000", 2024-09-12T00:04:48.913 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000173065 2024-09-12T00:04:48.913 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.913 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.913 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:48.913 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.344194+0000", 2024-09-12T00:04:48.913 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016688900000000001 2024-09-12T00:04:48.913 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.913 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.913 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.913 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.358530+0000", 2024-09-12T00:04:48.913 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014336877 2024-09-12T00:04:48.913 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.913 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.914 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.914 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.359009+0000", 2024-09-12T00:04:48.914 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00047882099999999999 2024-09-12T00:04:48.914 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.914 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.914 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.914 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.359069+0000", 2024-09-12T00:04:48.914 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9892999999999997e-05 2024-09-12T00:04:48.914 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.914 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.914 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.914 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.359120+0000", 2024-09-12T00:04:48.914 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1174000000000002e-05 2024-09-12T00:04:48.914 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.915 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.915 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.915 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.915 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.915 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2666 3.13 3:cbd43ea3:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.915 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.362905+0000", 2024-09-12T00:04:48.915 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.5019705800000001, 2024-09-12T00:04:48.915 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017815950000000001, 2024-09-12T00:04:48.915 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.915 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.915 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.915 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.915 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.915 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.915 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2666 2024-09-12T00:04:48.916 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.916 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.916 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.916 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.916 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.362905+0000", 2024-09-12T00:04:48.916 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.916 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.916 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.916 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.916 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.362905+0000", 2024-09-12T00:04:48.916 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.916 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.916 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.917 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.917 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.362909+0000", 2024-09-12T00:04:48.917 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4529999999999998e-06 2024-09-12T00:04:48.917 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.917 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.917 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.917 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364466+0000", 2024-09-12T00:04:48.917 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015570060000000001 2024-09-12T00:04:48.917 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.917 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.917 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.917 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364500+0000", 2024-09-12T00:04:48.917 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4289999999999999e-05 2024-09-12T00:04:48.917 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.918 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.918 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.918 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364515+0000", 2024-09-12T00:04:48.918 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4537e-05 2024-09-12T00:04:48.918 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.918 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.918 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.918 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364615+0000", 2024-09-12T00:04:48.918 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100782 2024-09-12T00:04:48.918 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.918 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.918 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.918 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364805+0000", 2024-09-12T00:04:48.918 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018921399999999999 2024-09-12T00:04:48.919 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.919 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.919 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:48.919 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364984+0000", 2024-09-12T00:04:48.919 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017972299999999999 2024-09-12T00:04:48.919 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.919 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.919 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.919 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.372042+0000", 2024-09-12T00:04:48.919 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0070581120000000001 2024-09-12T00:04:48.919 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.919 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.919 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.919 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.380620+0000", 2024-09-12T00:04:48.920 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085774309999999999 2024-09-12T00:04:48.920 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.920 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.920 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.920 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.380666+0000", 2024-09-12T00:04:48.920 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5881000000000003e-05 2024-09-12T00:04:48.920 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.920 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.920 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.920 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.380721+0000", 2024-09-12T00:04:48.920 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5520999999999999e-05 2024-09-12T00:04:48.920 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.920 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.920 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.921 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.921 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.921 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2677 3.13 3:c9d59693:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.921 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.474053+0000", 2024-09-12T00:04:48.921 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.3908232329999999, 2024-09-12T00:04:48.921 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017985961000000002, 2024-09-12T00:04:48.921 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.921 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.921 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.921 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.921 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.921 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.921 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2677 2024-09-12T00:04:48.922 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.922 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.922 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.922 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.922 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.474053+0000", 2024-09-12T00:04:48.922 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.922 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.922 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.922 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.922 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.474053+0000", 2024-09-12T00:04:48.922 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.922 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.922 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.922 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.922 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.474055+0000", 2024-09-12T00:04:48.923 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.711e-06 2024-09-12T00:04:48.923 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.923 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.923 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.923 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475342+0000", 2024-09-12T00:04:48.923 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001286508 2024-09-12T00:04:48.923 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.923 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.923 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.923 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475373+0000", 2024-09-12T00:04:48.923 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1130000000000002e-05 2024-09-12T00:04:48.923 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.923 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.924 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.924 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475387+0000", 2024-09-12T00:04:48.924 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4280999999999999e-05 2024-09-12T00:04:48.924 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.924 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.924 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.924 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475476+0000", 2024-09-12T00:04:48.924 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8621000000000004e-05 2024-09-12T00:04:48.924 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.924 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.924 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.924 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475644+0000", 2024-09-12T00:04:48.924 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016785699999999999 2024-09-12T00:04:48.924 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.925 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.925 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:48.925 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475742+0000", 2024-09-12T00:04:48.925 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8016000000000005e-05 2024-09-12T00:04:48.925 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.925 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.925 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.925 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.480305+0000", 2024-09-12T00:04:48.925 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045629049999999999 2024-09-12T00:04:48.925 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.925 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.925 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.925 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.491948+0000", 2024-09-12T00:04:48.925 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011643280000000001 2024-09-12T00:04:48.926 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.926 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.926 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.926 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.492000+0000", 2024-09-12T00:04:48.926 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2482000000000003e-05 2024-09-12T00:04:48.926 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.926 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.926 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.926 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.492039+0000", 2024-09-12T00:04:48.926 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8170000000000002e-05 2024-09-12T00:04:48.926 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.926 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.926 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.926 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.927 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.927 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2691 3.2d 3:b4a2284d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.927 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.515274+0000", 2024-09-12T00:04:48.927 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.349602177, 2024-09-12T00:04:48.927 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018577757, 2024-09-12T00:04:48.927 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.927 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.927 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.927 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.927 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.927 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.927 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2691 2024-09-12T00:04:48.927 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.927 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.927 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.928 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.928 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.515274+0000", 2024-09-12T00:04:48.928 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.928 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.928 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.928 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.928 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.515274+0000", 2024-09-12T00:04:48.928 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.928 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.929 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.929 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.929 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.515276+0000", 2024-09-12T00:04:48.929 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3499999999999999e-06 2024-09-12T00:04:48.929 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.929 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.929 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.929 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.516900+0000", 2024-09-12T00:04:48.929 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001623633 2024-09-12T00:04:48.929 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.929 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.929 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.929 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.516929+0000", 2024-09-12T00:04:48.929 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9009999999999998e-05 2024-09-12T00:04:48.930 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.930 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.930 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.930 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.516942+0000", 2024-09-12T00:04:48.930 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3551e-05 2024-09-12T00:04:48.930 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.930 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.930 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.930 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.517022+0000", 2024-09-12T00:04:48.930 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0167999999999995e-05 2024-09-12T00:04:48.930 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.930 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.930 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.930 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.517216+0000", 2024-09-12T00:04:48.931 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000193919 2024-09-12T00:04:48.931 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.931 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.931 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:48.931 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.517380+0000", 2024-09-12T00:04:48.931 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016336000000000001 2024-09-12T00:04:48.931 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.931 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.931 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.931 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.522907+0000", 2024-09-12T00:04:48.931 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055276420000000001 2024-09-12T00:04:48.931 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.931 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.931 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.932 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.533735+0000", 2024-09-12T00:04:48.932 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010827997000000001 2024-09-12T00:04:48.932 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.932 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.932 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.932 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.533800+0000", 2024-09-12T00:04:48.932 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4738000000000003e-05 2024-09-12T00:04:48.932 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.932 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.932 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.932 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.533851+0000", 2024-09-12T00:04:48.932 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1388999999999999e-05 2024-09-12T00:04:48.932 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.933 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.933 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.933 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.933 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.933 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2697 3.13 3:c87ccb22:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.933 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.577849+0000", 2024-09-12T00:04:48.933 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.2870268570000001, 2024-09-12T00:04:48.933 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019139156000000001, 2024-09-12T00:04:48.933 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.933 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.933 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.934 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.934 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.934 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.934 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2697 2024-09-12T00:04:48.934 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.934 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.934 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.934 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.934 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577849+0000", 2024-09-12T00:04:48.934 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.934 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.934 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.934 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.935 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577849+0000", 2024-09-12T00:04:48.935 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.935 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.935 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.935 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.935 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577853+0000", 2024-09-12T00:04:48.935 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7510000000000002e-06 2024-09-12T00:04:48.935 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.935 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.935 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.935 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579595+0000", 2024-09-12T00:04:48.935 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001741954 2024-09-12T00:04:48.935 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.935 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.936 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.936 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579625+0000", 2024-09-12T00:04:48.936 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9907999999999999e-05 2024-09-12T00:04:48.936 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.936 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.936 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.936 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579640+0000", 2024-09-12T00:04:48.936 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4894e-05 2024-09-12T00:04:48.936 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.936 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.936 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.936 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579728+0000", 2024-09-12T00:04:48.936 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8704999999999999e-05 2024-09-12T00:04:48.936 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.937 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.937 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.937 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579922+0000", 2024-09-12T00:04:48.937 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000194019 2024-09-12T00:04:48.937 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.937 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.937 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:48.937 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.580092+0000", 2024-09-12T00:04:48.937 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016984300000000001 2024-09-12T00:04:48.937 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.937 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.937 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.937 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.591944+0000", 2024-09-12T00:04:48.938 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011852252000000001 2024-09-12T00:04:48.938 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.938 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.938 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.938 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.596913+0000", 2024-09-12T00:04:48.938 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049688279999999998 2024-09-12T00:04:48.938 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.938 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.938 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.938 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.596955+0000", 2024-09-12T00:04:48.938 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2290999999999999e-05 2024-09-12T00:04:48.938 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.938 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.938 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.939 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.596988+0000", 2024-09-12T00:04:48.939 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2710999999999999e-05 2024-09-12T00:04:48.939 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.939 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.939 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.939 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.939 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.939 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2701 3.11 3:8babcc8d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.939 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.617191+0000", 2024-09-12T00:04:48.939 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.2476852439999999, 2024-09-12T00:04:48.939 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013760204999999999, 2024-09-12T00:04:48.939 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.939 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.939 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.940 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.940 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.940 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.940 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2701 2024-09-12T00:04:48.940 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.940 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.940 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.940 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.940 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.617191+0000", 2024-09-12T00:04:48.940 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.940 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.940 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.940 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.940 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.617191+0000", 2024-09-12T00:04:48.941 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.941 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.941 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.941 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.941 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.617194+0000", 2024-09-12T00:04:48.941 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.788e-06 2024-09-12T00:04:48.941 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.941 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.941 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.941 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618652+0000", 2024-09-12T00:04:48.941 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001457716 2024-09-12T00:04:48.941 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.941 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.941 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.942 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618682+0000", 2024-09-12T00:04:48.942 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9668000000000001e-05 2024-09-12T00:04:48.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.942 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.942 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.942 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618692+0000", 2024-09-12T00:04:48.942 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0429e-05 2024-09-12T00:04:48.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.942 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.942 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.942 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618766+0000", 2024-09-12T00:04:48.942 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4190999999999995e-05 2024-09-12T00:04:48.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.942 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.943 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.943 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618932+0000", 2024-09-12T00:04:48.943 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000165923 2024-09-12T00:04:48.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.943 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.943 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:48.943 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.619026+0000", 2024-09-12T00:04:48.943 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3906999999999994e-05 2024-09-12T00:04:48.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.943 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.943 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.943 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.623168+0000", 2024-09-12T00:04:48.943 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041419309999999997 2024-09-12T00:04:48.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.944 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.944 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.944 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.630815+0000", 2024-09-12T00:04:48.944 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0076470100000000001 2024-09-12T00:04:48.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.944 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.944 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.944 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.630887+0000", 2024-09-12T00:04:48.944 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2218999999999994e-05 2024-09-12T00:04:48.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.944 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.944 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.944 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.630951+0000", 2024-09-12T00:04:48.944 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3423000000000006e-05 2024-09-12T00:04:48.945 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.945 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.945 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.945 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.945 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.945 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2704 3.13 3:c90afc39:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.945 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.647542+0000", 2024-09-12T00:04:48.945 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.217333381, 2024-09-12T00:04:48.945 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017595339000000002, 2024-09-12T00:04:48.945 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.945 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.945 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.945 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.946 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.946 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.946 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2704 2024-09-12T00:04:48.946 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.946 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.946 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.946 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.946 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.647542+0000", 2024-09-12T00:04:48.946 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.946 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.946 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.946 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.946 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.647542+0000", 2024-09-12T00:04:48.946 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.947 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.947 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.947 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.947 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.647544+0000", 2024-09-12T00:04:48.947 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6339999999999999e-06 2024-09-12T00:04:48.947 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.947 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.947 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.947 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649032+0000", 2024-09-12T00:04:48.947 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001488063 2024-09-12T00:04:48.947 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.947 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.947 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.947 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649053+0000", 2024-09-12T00:04:48.947 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0761e-05 2024-09-12T00:04:48.948 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.948 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.948 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.948 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649066+0000", 2024-09-12T00:04:48.948 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2597e-05 2024-09-12T00:04:48.948 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.948 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.948 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.948 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649142+0000", 2024-09-12T00:04:48.948 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6254999999999994e-05 2024-09-12T00:04:48.948 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.948 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.948 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.949 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649250+0000", 2024-09-12T00:04:48.949 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010774500000000001 2024-09-12T00:04:48.949 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.949 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.949 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:48.949 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649364+0000", 2024-09-12T00:04:48.949 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000114401 2024-09-12T00:04:48.949 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.949 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.949 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.949 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.658970+0000", 2024-09-12T00:04:48.949 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0096065260000000006 2024-09-12T00:04:48.949 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.949 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.950 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.950 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.665022+0000", 2024-09-12T00:04:48.950 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0060516459999999999 2024-09-12T00:04:48.950 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.950 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.950 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.950 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.665086+0000", 2024-09-12T00:04:48.950 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3940000000000001e-05 2024-09-12T00:04:48.950 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.950 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.950 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.950 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.665138+0000", 2024-09-12T00:04:48.950 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1771000000000003e-05 2024-09-12T00:04:48.950 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.951 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.951 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.951 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.951 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.951 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2706 3.d 3:b1b5d8c6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.951 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.667263+0000", 2024-09-12T00:04:48.951 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.1976124269999999, 2024-09-12T00:04:48.951 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017030099999999999, 2024-09-12T00:04:48.951 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.951 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.951 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.951 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.951 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.951 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.952 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2706 2024-09-12T00:04:48.952 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.952 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.952 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.952 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.952 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.667263+0000", 2024-09-12T00:04:48.952 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.952 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.952 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.952 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.952 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.667263+0000", 2024-09-12T00:04:48.952 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.952 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.952 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.953 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.953 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.667267+0000", 2024-09-12T00:04:48.953 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1540000000000002e-06 2024-09-12T00:04:48.953 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.953 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.953 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.953 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672789+0000", 2024-09-12T00:04:48.953 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055222819999999999 2024-09-12T00:04:48.953 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.953 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.953 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.953 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672817+0000", 2024-09-12T00:04:48.953 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8510999999999999e-05 2024-09-12T00:04:48.954 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.954 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.954 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.954 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672831+0000", 2024-09-12T00:04:48.954 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3919e-05 2024-09-12T00:04:48.954 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.954 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.954 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.954 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672988+0000", 2024-09-12T00:04:48.954 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015688 2024-09-12T00:04:48.954 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.954 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.954 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.954 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.673174+0000", 2024-09-12T00:04:48.954 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018615400000000001 2024-09-12T00:04:48.955 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.955 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.955 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:48.955 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.673352+0000", 2024-09-12T00:04:48.955 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017803599999999999 2024-09-12T00:04:48.955 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.955 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.955 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.955 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.683897+0000", 2024-09-12T00:04:48.955 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010544239 2024-09-12T00:04:48.955 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.955 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.955 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.955 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.684176+0000", 2024-09-12T00:04:48.956 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000279506 2024-09-12T00:04:48.956 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.956 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.956 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.956 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.684235+0000", 2024-09-12T00:04:48.956 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9101000000000002e-05 2024-09-12T00:04:48.956 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.956 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.956 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.956 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.684294+0000", 2024-09-12T00:04:48.956 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8318e-05 2024-09-12T00:04:48.956 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.956 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.956 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.957 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.957 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.957 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2714 3.17 e63/23 3:eac65a57:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_199:head v 63'3, mlcod=62'1)", 2024-09-12T00:04:48.957 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.752259+0000", 2024-09-12T00:04:48.957 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.112616893, 2024-09-12T00:04:48.957 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013747212, 2024-09-12T00:04:48.957 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.957 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.957 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.957 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.958 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.958 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.958 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.752259+0000", 2024-09-12T00:04:48.958 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.958 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.958 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.958 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.958 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.752259+0000", 2024-09-12T00:04:48.958 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.958 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.958 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.958 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.958 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.752261+0000", 2024-09-12T00:04:48.958 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2390000000000001e-06 2024-09-12T00:04:48.959 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.959 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.959 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.959 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757723+0000", 2024-09-12T00:04:48.959 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054619569999999999 2024-09-12T00:04:48.959 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.959 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.959 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.959 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757749+0000", 2024-09-12T00:04:48.959 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5732999999999999e-05 2024-09-12T00:04:48.959 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.959 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.959 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.959 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757762+0000", 2024-09-12T00:04:48.960 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3556e-05 2024-09-12T00:04:48.960 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.960 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.960 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.960 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757841+0000", 2024-09-12T00:04:48.960 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8644000000000001e-05 2024-09-12T00:04:48.960 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.960 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.960 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.960 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757864+0000", 2024-09-12T00:04:48.960 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3112000000000002e-05 2024-09-12T00:04:48.960 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.960 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.961 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.961 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.765956+0000", 2024-09-12T00:04:48.961 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080919679999999997 2024-09-12T00:04:48.961 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.961 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.961 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.961 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766006+0000", 2024-09-12T00:04:48.961 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0003000000000002e-05 2024-09-12T00:04:48.961 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.961 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.961 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.961 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.961 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.961 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2742 3.1d 3:b8ae26ad:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.035857+0000", 2024-09-12T00:04:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.82901921099999998, 2024-09-12T00:04:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025139262999999998, 2024-09-12T00:04:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2742 2024-09-12T00:04:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.962 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.035857+0000", 2024-09-12T00:04:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.035857+0000", 2024-09-12T00:04:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.035859+0000", 2024-09-12T00:04:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0899999999999999e-06 2024-09-12T00:04:48.963 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038486+0000", 2024-09-12T00:04:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026273749999999999 2024-09-12T00:04:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038511+0000", 2024-09-12T00:04:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5327e-05 2024-09-12T00:04:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038527+0000", 2024-09-12T00:04:48.964 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5196e-05 2024-09-12T00:04:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038604+0000", 2024-09-12T00:04:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6921000000000004e-05 2024-09-12T00:04:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038789+0000", 2024-09-12T00:04:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018526400000000001 2024-09-12T00:04:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:48.965 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.039001+0000", 2024-09-12T00:04:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021200400000000001 2024-09-12T00:04:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.056879+0000", 2024-09-12T00:04:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017877783000000001 2024-09-12T00:04:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.060872+0000", 2024-09-12T00:04:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039929529999999996 2024-09-12T00:04:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.966 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.060942+0000", 2024-09-12T00:04:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0060000000000003e-05 2024-09-12T00:04:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.060996+0000", 2024-09-12T00:04:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4289999999999997e-05 2024-09-12T00:04:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.967 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2747 3.17 e63/23 3:eaa4528d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_232:head v 63'5, mlcod=63'3)", 2024-09-12T00:04:48.968 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.094555+0000", 2024-09-12T00:04:48.968 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.77032038400000002, 2024-09-12T00:04:48.968 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017679139, 2024-09-12T00:04:48.968 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.968 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.968 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.968 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.968 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.968 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.968 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.094555+0000", 2024-09-12T00:04:48.968 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.968 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.968 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.968 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.969 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.094555+0000", 2024-09-12T00:04:48.969 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.969 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.969 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.969 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.969 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.094558+0000", 2024-09-12T00:04:48.969 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.232e-06 2024-09-12T00:04:48.969 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.969 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.969 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.969 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098897+0000", 2024-09-12T00:04:48.969 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0043397840000000002 2024-09-12T00:04:48.969 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.969 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.970 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.970 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098930+0000", 2024-09-12T00:04:48.970 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2592000000000002e-05 2024-09-12T00:04:48.970 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.970 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.970 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.970 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098945+0000", 2024-09-12T00:04:48.970 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4759e-05 2024-09-12T00:04:48.970 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.970 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.970 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.970 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.099033+0000", 2024-09-12T00:04:48.970 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8535000000000005e-05 2024-09-12T00:04:48.970 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.971 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.971 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.971 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.099065+0000", 2024-09-12T00:04:48.971 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1825000000000001e-05 2024-09-12T00:04:48.971 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.971 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.971 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.971 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112134+0000", 2024-09-12T00:04:48.971 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013068329 2024-09-12T00:04:48.971 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.971 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.971 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.971 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112235+0000", 2024-09-12T00:04:48.971 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010108299999999999 2024-09-12T00:04:48.972 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.972 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.972 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.972 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.972 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.972 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2764 3.2d 3:b7a0f55d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_249:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:48.972 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.325396+0000", 2024-09-12T00:04:48.972 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.53947943600000003, 2024-09-12T00:04:48.972 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022487040999999999, 2024-09-12T00:04:48.972 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:48.972 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:48.972 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:48.973 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:48.973 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:48.973 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:48.973 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2764 2024-09-12T00:04:48.973 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.973 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:48.973 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.973 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:48.973 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.325396+0000", 2024-09-12T00:04:48.973 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.973 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.973 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.973 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:48.974 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.325396+0000", 2024-09-12T00:04:48.974 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:48.974 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.974 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.974 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:48.974 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.325400+0000", 2024-09-12T00:04:48.974 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2370000000000001e-06 2024-09-12T00:04:48.974 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.974 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.974 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:48.974 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328424+0000", 2024-09-12T00:04:48.974 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003024657 2024-09-12T00:04:48.974 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.974 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.975 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:48.975 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328456+0000", 2024-09-12T00:04:48.975 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1819999999999997e-05 2024-09-12T00:04:48.975 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.975 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.975 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:48.975 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328476+0000", 2024-09-12T00:04:48.975 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9673999999999998e-05 2024-09-12T00:04:48.975 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.975 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.975 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:48.975 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328567+0000", 2024-09-12T00:04:48.975 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1640999999999999e-05 2024-09-12T00:04:48.976 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.976 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.976 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:48.976 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328734+0000", 2024-09-12T00:04:48.976 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016619200000000001 2024-09-12T00:04:48.976 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.976 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.976 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:48.976 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328910+0000", 2024-09-12T00:04:48.976 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017652299999999999 2024-09-12T00:04:48.976 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.976 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.976 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:48.976 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.333757+0000", 2024-09-12T00:04:48.977 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048465060000000004 2024-09-12T00:04:48.977 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.977 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.977 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:48.977 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.347806+0000", 2024-09-12T00:04:48.977 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01404908 2024-09-12T00:04:48.977 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.977 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.977 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:48.977 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.347847+0000", 2024-09-12T00:04:48.977 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1396999999999997e-05 2024-09-12T00:04:48.977 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:48.977 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:48.977 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:48.978 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.347883+0000", 2024-09-12T00:04:48.978 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6313999999999998e-05 2024-09-12T00:04:48.978 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.978 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.978 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.978 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:48.978 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:48.978 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:48.979 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:04:48.980 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:48.978+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:49.081 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:49.078+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:49.111 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:49.112 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:04:49.112 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:04:49.112 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:49.126 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:04:49.214 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:49.214+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:49.283 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:49.282+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:49.288 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:49.288 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:04:49.288 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:04:49.288 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:04:49.288 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:49.303 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:04:49.307 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:04:49.384 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:49.384+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:49.465 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:49.465 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:49.473 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:49.473 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:04:49.473 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:04:49.473 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:04:49.473 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.473 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2657 3.3c e63/23 3:3e583291:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_152:head v 63'4, mlcod=62'2)", 2024-09-12T00:04:49.473 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:04:49.473 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 2.2053325419999998, 2024-09-12T00:04:49.474 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017073642999999999, 2024-09-12T00:04:49.474 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:49.474 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:49.474 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:49.474 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:49.474 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.474 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:49.474 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:04:49.474 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.474 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.474 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.474 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:49.474 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:04:49.475 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.475 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.475 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.475 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:49.475 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266877+0000", 2024-09-12T00:04:49.475 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3630000000000001e-06 2024-09-12T00:04:49.475 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.475 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.475 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:49.475 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271243+0000", 2024-09-12T00:04:49.475 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043659730000000004 2024-09-12T00:04:49.475 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.475 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.476 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:49.476 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271279+0000", 2024-09-12T00:04:49.476 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6334999999999997e-05 2024-09-12T00:04:49.476 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.476 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.476 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:49.476 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271296+0000", 2024-09-12T00:04:49.476 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6619000000000001e-05 2024-09-12T00:04:49.476 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.476 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.476 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:49.476 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271429+0000", 2024-09-12T00:04:49.477 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133132 2024-09-12T00:04:49.477 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.477 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.477 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:49.477 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271468+0000", 2024-09-12T00:04:49.477 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8483999999999999e-05 2024-09-12T00:04:49.477 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.477 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.477 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:49.477 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.283854+0000", 2024-09-12T00:04:49.477 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012386645999999999 2024-09-12T00:04:49.477 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.477 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.477 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:49.478 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.283948+0000", 2024-09-12T00:04:49.478 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4091000000000004e-05 2024-09-12T00:04:49.478 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.478 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:49.478 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.478 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.478 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.478 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2658 3.3a e63/23 3:5ec14981:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_153:head v 63'1, mlcod=0'0)", 2024-09-12T00:04:49.478 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.276052+0000", 2024-09-12T00:04:49.478 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 2.1961556519999998, 2024-09-12T00:04:49.478 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015387336999999999, 2024-09-12T00:04:49.478 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:49.478 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:49.478 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:49.479 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:49.479 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.479 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:49.479 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.276052+0000", 2024-09-12T00:04:49.479 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.479 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.479 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.479 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:49.479 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.276052+0000", 2024-09-12T00:04:49.479 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.479 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.479 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.479 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:49.480 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.276054+0000", 2024-09-12T00:04:49.480 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3199999999999998e-06 2024-09-12T00:04:49.480 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.480 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.480 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:49.480 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282165+0000", 2024-09-12T00:04:49.480 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061108359999999997 2024-09-12T00:04:49.480 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.480 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.480 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:49.480 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282192+0000", 2024-09-12T00:04:49.480 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7008999999999998e-05 2024-09-12T00:04:49.480 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.480 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.481 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:49.481 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282206+0000", 2024-09-12T00:04:49.481 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4705999999999999e-05 2024-09-12T00:04:49.481 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.481 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.481 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:49.481 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282387+0000", 2024-09-12T00:04:49.481 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018015199999999999 2024-09-12T00:04:49.481 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.481 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.481 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:49.481 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282426+0000", 2024-09-12T00:04:49.481 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9323999999999998e-05 2024-09-12T00:04:49.481 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.482 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.482 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:49.482 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291241+0000", 2024-09-12T00:04:49.482 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0088146950000000009 2024-09-12T00:04:49.482 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.482 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.482 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:49.482 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291439+0000", 2024-09-12T00:04:49.482 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000198295 2024-09-12T00:04:49.482 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.482 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:49.482 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.482 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.483 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.483 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2659 3.2d e63/23 3:b4a71344:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_154:head v 63'5, mlcod=63'3)", 2024-09-12T00:04:49.483 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:04:49.483 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 2.1845282479999999, 2024-09-12T00:04:49.483 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016913793, 2024-09-12T00:04:49.483 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:49.483 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:49.483 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:49.483 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:49.483 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.483 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:49.483 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:04:49.483 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.483 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.484 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.484 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:49.484 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:04:49.484 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.484 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.484 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.484 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:49.484 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287682+0000", 2024-09-12T00:04:49.484 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9799999999999998e-06 2024-09-12T00:04:49.484 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.484 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.484 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:49.484 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291872+0000", 2024-09-12T00:04:49.485 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041904070000000002 2024-09-12T00:04:49.485 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.485 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.485 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:49.485 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291901+0000", 2024-09-12T00:04:49.485 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9017999999999999e-05 2024-09-12T00:04:49.485 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.485 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.485 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:49.485 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291917+0000", 2024-09-12T00:04:49.485 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5775999999999999e-05 2024-09-12T00:04:49.485 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.485 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.485 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:49.486 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.292061+0000", 2024-09-12T00:04:49.486 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014356800000000001 2024-09-12T00:04:49.486 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.486 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.486 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:49.486 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.292123+0000", 2024-09-12T00:04:49.486 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2799999999999995e-05 2024-09-12T00:04:49.486 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.486 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.486 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:49.486 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.304456+0000", 2024-09-12T00:04:49.486 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012332865 2024-09-12T00:04:49.486 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.486 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.487 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:49.487 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.304593+0000", 2024-09-12T00:04:49.487 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000136379 2024-09-12T00:04:49.487 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.487 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:49.487 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.487 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.487 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.487 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2667 3.8 3:1177e826:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:49.487 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:04:49.487 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 2.09908633, 2024-09-12T00:04:49.487 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024306991999999999, 2024-09-12T00:04:49.487 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:49.488 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:49.488 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:49.488 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:49.488 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:49.488 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:49.488 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2667 2024-09-12T00:04:49.488 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.488 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:49.488 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.488 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:49.488 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:04:49.488 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.488 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.489 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.489 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:49.489 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:04:49.489 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.489 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.489 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.489 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:49.489 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373124+0000", 2024-09-12T00:04:49.489 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.19e-06 2024-09-12T00:04:49.489 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.489 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.489 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:49.489 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377167+0000", 2024-09-12T00:04:49.489 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040430329999999997 2024-09-12T00:04:49.490 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.490 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.490 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:49.490 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377201+0000", 2024-09-12T00:04:49.490 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3868000000000002e-05 2024-09-12T00:04:49.490 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.490 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.490 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:49.490 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377219+0000", 2024-09-12T00:04:49.490 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8019000000000001e-05 2024-09-12T00:04:49.490 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.490 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.490 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:49.490 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377362+0000", 2024-09-12T00:04:49.491 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000143001 2024-09-12T00:04:49.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.491 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.491 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:49.491 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377603+0000", 2024-09-12T00:04:49.491 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024115200000000001 2024-09-12T00:04:49.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.491 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.491 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:49.491 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377833+0000", 2024-09-12T00:04:49.491 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022952000000000001 2024-09-12T00:04:49.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.491 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.491 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:49.492 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.386771+0000", 2024-09-12T00:04:49.492 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0089385739999999995 2024-09-12T00:04:49.492 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.492 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.492 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:49.492 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397160+0000", 2024-09-12T00:04:49.492 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010388391 2024-09-12T00:04:49.492 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.492 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.492 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:49.492 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397307+0000", 2024-09-12T00:04:49.492 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014745099999999999 2024-09-12T00:04:49.492 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.492 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.493 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:49.493 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397428+0000", 2024-09-12T00:04:49.493 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012079299999999999 2024-09-12T00:04:49.493 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.493 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:49.493 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.493 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.493 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.493 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2669 3.1b 3:d9b9bd82:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:49.493 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:04:49.493 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 2.079409681, 2024-09-12T00:04:49.493 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016867298999999999, 2024-09-12T00:04:49.493 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:49.494 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:49.494 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:49.494 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:49.494 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:49.494 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:49.494 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2669 2024-09-12T00:04:49.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.494 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:49.494 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.494 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:49.494 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:04:49.494 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.495 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.495 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:49.495 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:04:49.495 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.495 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.495 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:49.495 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392800+0000", 2024-09-12T00:04:49.495 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8629999999999999e-06 2024-09-12T00:04:49.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.495 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.495 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:49.495 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396812+0000", 2024-09-12T00:04:49.496 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040120140000000004 2024-09-12T00:04:49.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.496 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.496 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:49.496 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396849+0000", 2024-09-12T00:04:49.496 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6291000000000002e-05 2024-09-12T00:04:49.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.496 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.496 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:49.496 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396906+0000", 2024-09-12T00:04:49.496 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7692999999999998e-05 2024-09-12T00:04:49.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.496 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.496 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:49.497 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397059+0000", 2024-09-12T00:04:49.497 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015268399999999999 2024-09-12T00:04:49.497 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.497 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.497 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:49.497 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397472+0000", 2024-09-12T00:04:49.497 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041270899999999998 2024-09-12T00:04:49.497 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.497 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.497 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:49.497 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397697+0000", 2024-09-12T00:04:49.497 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022526299999999999 2024-09-12T00:04:49.497 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.497 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.498 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:49.498 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.406380+0000", 2024-09-12T00:04:49.498 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086830429999999997 2024-09-12T00:04:49.498 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.498 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.498 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:49.498 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409367+0000", 2024-09-12T00:04:49.498 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002987403 2024-09-12T00:04:49.498 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.498 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.498 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:49.498 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409532+0000", 2024-09-12T00:04:49.498 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016417 2024-09-12T00:04:49.499 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.499 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.499 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:49.499 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409665+0000", 2024-09-12T00:04:49.499 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013316599999999999 2024-09-12T00:04:49.499 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.499 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:49.499 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.499 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.499 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.499 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2678 3.2b 3:d57f7217:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:49.499 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:04:49.499 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.9879922329999999, 2024-09-12T00:04:49.499 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018772965999999999, 2024-09-12T00:04:49.500 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:49.500 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:49.500 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:49.500 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:49.500 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:49.500 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:49.500 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2678 2024-09-12T00:04:49.500 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.500 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:49.500 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.500 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:49.500 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:04:49.500 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.501 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.501 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:49.501 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:04:49.501 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.501 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.501 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:49.501 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484219+0000", 2024-09-12T00:04:49.501 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7299999999999999e-06 2024-09-12T00:04:49.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.501 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.502 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:49.502 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488148+0000", 2024-09-12T00:04:49.502 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039289859999999998 2024-09-12T00:04:49.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.502 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.502 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:49.502 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488214+0000", 2024-09-12T00:04:49.502 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6202000000000001e-05 2024-09-12T00:04:49.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.502 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.502 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:49.502 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488239+0000", 2024-09-12T00:04:49.502 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4839000000000001e-05 2024-09-12T00:04:49.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.503 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.503 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:49.503 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488374+0000", 2024-09-12T00:04:49.503 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000135189 2024-09-12T00:04:49.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.503 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.503 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:49.503 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488626+0000", 2024-09-12T00:04:49.503 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025242800000000002 2024-09-12T00:04:49.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.503 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.503 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:49.503 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488849+0000", 2024-09-12T00:04:49.504 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022295 2024-09-12T00:04:49.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.504 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.504 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:49.504 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498947+0000", 2024-09-12T00:04:49.504 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010098072 2024-09-12T00:04:49.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.504 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.504 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:49.504 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502674+0000", 2024-09-12T00:04:49.504 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037269149999999999 2024-09-12T00:04:49.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.504 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.504 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:49.505 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502856+0000", 2024-09-12T00:04:49.505 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018163599999999999 2024-09-12T00:04:49.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.505 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.505 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:49.505 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502988+0000", 2024-09-12T00:04:49.505 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013201900000000001 2024-09-12T00:04:49.505 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.505 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:49.505 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.505 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.505 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2691 3.2d e63/23 3:b4a2284d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_176:head v 63'6, mlcod=63'4)", 2024-09-12T00:04:49.506 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:04:49.506 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.954867532, 2024-09-12T00:04:49.506 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015889306999999998, 2024-09-12T00:04:49.506 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:49.506 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:49.506 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:49.506 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:49.506 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.506 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:49.506 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:04:49.506 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.506 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.506 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.507 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:49.507 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:04:49.507 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.507 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.507 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:49.507 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517342+0000", 2024-09-12T00:04:49.507 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3700000000000002e-06 2024-09-12T00:04:49.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.507 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.507 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:49.507 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521776+0000", 2024-09-12T00:04:49.507 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044339790000000002 2024-09-12T00:04:49.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.508 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.508 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:49.508 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521806+0000", 2024-09-12T00:04:49.508 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9855000000000001e-05 2024-09-12T00:04:49.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.508 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.508 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:49.508 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521820+0000", 2024-09-12T00:04:49.508 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4496e-05 2024-09-12T00:04:49.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.508 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.508 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:49.509 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521963+0000", 2024-09-12T00:04:49.509 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014277199999999999 2024-09-12T00:04:49.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.509 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.509 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:49.509 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.522029+0000", 2024-09-12T00:04:49.509 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6186000000000006e-05 2024-09-12T00:04:49.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.509 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.509 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:49.509 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.533123+0000", 2024-09-12T00:04:49.509 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011093252 2024-09-12T00:04:49.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.509 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.510 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:49.510 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.533229+0000", 2024-09-12T00:04:49.510 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000106397 2024-09-12T00:04:49.510 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.510 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:49.510 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.510 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.510 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2694 3.3d e63/23 3:bd0bdafc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_179:head v 63'7, mlcod=63'5)", 2024-09-12T00:04:49.510 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:04:49.510 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.91965276, 2024-09-12T00:04:49.510 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016398093999999998, 2024-09-12T00:04:49.510 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:49.510 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:49.511 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:49.511 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:49.511 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.511 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:49.511 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:04:49.511 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.511 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.511 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:49.511 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:04:49.511 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.511 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.511 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:49.512 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552558+0000", 2024-09-12T00:04:49.512 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6030000000000001e-06 2024-09-12T00:04:49.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.512 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:49.512 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556085+0000", 2024-09-12T00:04:49.512 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0035274339999999999 2024-09-12T00:04:49.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.512 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:49.512 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556126+0000", 2024-09-12T00:04:49.512 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0290999999999998e-05 2024-09-12T00:04:49.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.513 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.513 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:49.513 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556154+0000", 2024-09-12T00:04:49.513 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7965000000000001e-05 2024-09-12T00:04:49.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.513 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.513 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:49.513 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556298+0000", 2024-09-12T00:04:49.513 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014459799999999999 2024-09-12T00:04:49.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.513 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.513 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:49.513 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556339+0000", 2024-09-12T00:04:49.513 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0577000000000001e-05 2024-09-12T00:04:49.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.514 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.514 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:49.514 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.568778+0000", 2024-09-12T00:04:49.514 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012438886999999999 2024-09-12T00:04:49.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.514 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.514 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:49.514 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.568953+0000", 2024-09-12T00:04:49.514 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017473900000000001 2024-09-12T00:04:49.514 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.514 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:49.514 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.514 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.515 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2696 3.2b 3:d7c776f8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:49.515 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:04:49.515 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.904805863, 2024-09-12T00:04:49.515 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022026211, 2024-09-12T00:04:49.515 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:49.515 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:49.515 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:49.515 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:49.515 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:49.515 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:49.515 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2696 2024-09-12T00:04:49.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.515 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:49.516 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.516 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:49.516 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:04:49.516 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.516 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.516 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:49.516 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:04:49.516 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.516 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.516 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:49.516 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567406+0000", 2024-09-12T00:04:49.516 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9389999999999996e-06 2024-09-12T00:04:49.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.517 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:49.517 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571490+0000", 2024-09-12T00:04:49.517 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040837870000000002 2024-09-12T00:04:49.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.517 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:49.517 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571530+0000", 2024-09-12T00:04:49.517 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9894999999999997e-05 2024-09-12T00:04:49.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.517 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:49.518 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571554+0000", 2024-09-12T00:04:49.518 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4011000000000001e-05 2024-09-12T00:04:49.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.518 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.518 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:49.518 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571726+0000", 2024-09-12T00:04:49.518 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0001717 2024-09-12T00:04:49.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.518 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.518 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:49.518 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.572130+0000", 2024-09-12T00:04:49.518 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040465299999999999 2024-09-12T00:04:49.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.518 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.519 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:49.519 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.572470+0000", 2024-09-12T00:04:49.519 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00033946999999999997 2024-09-12T00:04:49.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.519 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.519 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:49.519 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.579159+0000", 2024-09-12T00:04:49.519 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0066893009999999999 2024-09-12T00:04:49.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.519 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.519 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:49.519 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589136+0000", 2024-09-12T00:04:49.519 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099772060000000006 2024-09-12T00:04:49.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.519 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.520 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:49.520 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589309+0000", 2024-09-12T00:04:49.520 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017264299999999999 2024-09-12T00:04:49.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.520 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:49.520 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589428+0000", 2024-09-12T00:04:49.520 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118606 2024-09-12T00:04:49.520 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.520 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:49.520 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.521 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2698 3.3d e63/23 3:bcafb0f9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_183:head v 63'8, mlcod=63'6)", 2024-09-12T00:04:49.521 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:04:49.521 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.8771028140000001, 2024-09-12T00:04:49.521 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016019080000000002, 2024-09-12T00:04:49.521 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:49.521 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:49.521 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:49.521 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:49.521 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.521 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:49.521 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:04:49.521 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.521 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.522 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:49.522 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:04:49.522 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.522 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.522 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:49.522 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595107+0000", 2024-09-12T00:04:49.522 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.497e-06 2024-09-12T00:04:49.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.522 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.522 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:49.522 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598465+0000", 2024-09-12T00:04:49.522 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033583129999999999 2024-09-12T00:04:49.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.523 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:49.523 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598502+0000", 2024-09-12T00:04:49.523 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6814999999999999e-05 2024-09-12T00:04:49.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.523 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:49.523 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598520+0000", 2024-09-12T00:04:49.523 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8264999999999999e-05 2024-09-12T00:04:49.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.523 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:49.523 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598666+0000", 2024-09-12T00:04:49.524 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014574499999999999 2024-09-12T00:04:49.524 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.524 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.524 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:49.524 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598706+0000", 2024-09-12T00:04:49.524 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9993999999999997e-05 2024-09-12T00:04:49.524 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.524 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.524 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:49.524 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.611012+0000", 2024-09-12T00:04:49.524 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012306381 2024-09-12T00:04:49.524 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.524 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.524 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:49.525 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.611123+0000", 2024-09-12T00:04:49.525 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011107000000000001 2024-09-12T00:04:49.525 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.525 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:49.525 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.525 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.525 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.525 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2702 3.3c e63/23 3:3d6a0b3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_187:head v 63'5, mlcod=63'3)", 2024-09-12T00:04:49.525 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:04:49.525 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.8436279770000001, 2024-09-12T00:04:49.525 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015754475, 2024-09-12T00:04:49.525 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:49.526 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:49.526 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:49.526 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:49.526 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.526 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:49.526 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:04:49.526 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.526 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.526 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:49.526 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:04:49.526 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.526 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.526 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:49.527 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628581+0000", 2024-09-12T00:04:49.527 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2129999999999998e-06 2024-09-12T00:04:49.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.527 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.527 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:49.527 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633160+0000", 2024-09-12T00:04:49.527 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045784470000000002 2024-09-12T00:04:49.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.527 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.527 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:49.527 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633193+0000", 2024-09-12T00:04:49.527 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3015000000000002e-05 2024-09-12T00:04:49.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.528 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.528 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:49.528 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633213+0000", 2024-09-12T00:04:49.528 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0271999999999998e-05 2024-09-12T00:04:49.528 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.528 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.528 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:49.528 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633397+0000", 2024-09-12T00:04:49.528 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018359299999999999 2024-09-12T00:04:49.528 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.528 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.528 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:49.528 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633440+0000", 2024-09-12T00:04:49.529 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2984e-05 2024-09-12T00:04:49.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.529 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.529 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:49.529 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.644242+0000", 2024-09-12T00:04:49.529 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010802673 2024-09-12T00:04:49.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.529 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.529 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:49.529 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.644334+0000", 2024-09-12T00:04:49.529 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1278000000000003e-05 2024-09-12T00:04:49.529 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.529 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:49.529 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.530 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.530 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.530 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2707 3.8 3:10a400a4:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:49.530 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:04:49.530 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.7953504090000001, 2024-09-12T00:04:49.530 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019444162000000001, 2024-09-12T00:04:49.530 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:49.530 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:49.530 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:49.530 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:49.530 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:49.530 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:49.530 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2707 2024-09-12T00:04:49.531 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.531 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:49.531 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.531 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:49.531 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:04:49.531 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.531 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.531 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.531 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:49.531 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:04:49.531 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.531 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.531 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.532 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:49.532 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676879+0000", 2024-09-12T00:04:49.532 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1886e-05 2024-09-12T00:04:49.532 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.532 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.532 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:49.532 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680743+0000", 2024-09-12T00:04:49.532 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038648060000000001 2024-09-12T00:04:49.532 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.532 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.532 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:49.532 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680783+0000", 2024-09-12T00:04:49.532 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9511000000000002e-05 2024-09-12T00:04:49.532 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.533 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.533 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:49.533 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680801+0000", 2024-09-12T00:04:49.533 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8056000000000001e-05 2024-09-12T00:04:49.533 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.533 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.533 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:49.533 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680948+0000", 2024-09-12T00:04:49.533 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014682399999999999 2024-09-12T00:04:49.533 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.533 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.533 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:49.533 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.681206+0000", 2024-09-12T00:04:49.534 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025860500000000002 2024-09-12T00:04:49.534 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.534 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.534 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:49.534 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.681439+0000", 2024-09-12T00:04:49.534 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023246599999999999 2024-09-12T00:04:49.534 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.534 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.534 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:49.534 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.689277+0000", 2024-09-12T00:04:49.534 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0078379000000000001 2024-09-12T00:04:49.534 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.534 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.534 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:49.535 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696136+0000", 2024-09-12T00:04:49.535 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0068593439999999999 2024-09-12T00:04:49.535 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.535 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.535 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:49.535 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696228+0000", 2024-09-12T00:04:49.535 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2038000000000002e-05 2024-09-12T00:04:49.535 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.535 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.535 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:49.535 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696301+0000", 2024-09-12T00:04:49.535 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2725999999999995e-05 2024-09-12T00:04:49.535 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.536 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:49.536 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.536 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.536 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.536 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2720 3.6 3:61c9c6cd:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:49.536 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:04:49.536 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.6686310930000001, 2024-09-12T00:04:49.536 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021831761000000002, 2024-09-12T00:04:49.536 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:49.536 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:49.536 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:49.536 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:49.537 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:49.537 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:49.537 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2720 2024-09-12T00:04:49.537 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.537 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:49.537 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.537 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:49.537 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:04:49.537 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.537 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.537 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.537 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:49.537 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:04:49.537 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.538 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.538 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.538 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:49.538 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803580+0000", 2024-09-12T00:04:49.538 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9870000000000001e-06 2024-09-12T00:04:49.538 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.538 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.538 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:49.538 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808102+0000", 2024-09-12T00:04:49.538 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004521677 2024-09-12T00:04:49.538 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.538 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.538 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:49.539 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808152+0000", 2024-09-12T00:04:49.539 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9923999999999998e-05 2024-09-12T00:04:49.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.539 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.539 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:49.539 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808178+0000", 2024-09-12T00:04:49.539 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5911999999999999e-05 2024-09-12T00:04:49.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.539 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.539 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:49.539 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808365+0000", 2024-09-12T00:04:49.539 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000187839 2024-09-12T00:04:49.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.539 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.540 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:49.540 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808757+0000", 2024-09-12T00:04:49.540 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039202900000000001 2024-09-12T00:04:49.540 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.540 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.540 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:49.540 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.809162+0000", 2024-09-12T00:04:49.540 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040460300000000002 2024-09-12T00:04:49.540 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.540 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.540 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:49.540 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.816553+0000", 2024-09-12T00:04:49.540 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.007390537 2024-09-12T00:04:49.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.541 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.541 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:49.541 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.824836+0000", 2024-09-12T00:04:49.541 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082834369999999994 2024-09-12T00:04:49.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.541 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.541 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:49.541 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.825223+0000", 2024-09-12T00:04:49.541 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00038724700000000001 2024-09-12T00:04:49.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.541 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.541 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:49.541 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.825408+0000", 2024-09-12T00:04:49.542 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018456899999999999 2024-09-12T00:04:49.542 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.542 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:49.542 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.542 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.542 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.542 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2722 3.1b 3:d95d04cc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_207:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:49.542 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.822403+0000", 2024-09-12T00:04:49.542 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.6498043999999998, 2024-09-12T00:04:49.542 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015693082000000001, 2024-09-12T00:04:49.542 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:49.542 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:49.542 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:49.543 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:49.543 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:49.543 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:49.543 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2722 2024-09-12T00:04:49.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.543 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:49.543 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.543 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:49.543 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.822403+0000", 2024-09-12T00:04:49.543 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.543 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.543 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:49.543 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.822403+0000", 2024-09-12T00:04:49.544 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.544 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.544 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.544 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:49.544 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.822405+0000", 2024-09-12T00:04:49.544 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4169999999999999e-06 2024-09-12T00:04:49.544 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.544 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.544 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:49.544 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826387+0000", 2024-09-12T00:04:49.544 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039818379999999997 2024-09-12T00:04:49.544 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.544 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.545 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:49.545 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826412+0000", 2024-09-12T00:04:49.545 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5159000000000001e-05 2024-09-12T00:04:49.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.545 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.545 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:49.545 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826425+0000", 2024-09-12T00:04:49.545 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3283e-05 2024-09-12T00:04:49.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.545 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.545 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:49.545 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826536+0000", 2024-09-12T00:04:49.546 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110109 2024-09-12T00:04:49.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.546 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.546 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:49.546 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826725+0000", 2024-09-12T00:04:49.546 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018966600000000001 2024-09-12T00:04:49.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.546 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.546 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:49.546 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826904+0000", 2024-09-12T00:04:49.546 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017913200000000001 2024-09-12T00:04:49.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.546 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.546 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:49.547 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.835018+0000", 2024-09-12T00:04:49.547 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0081138300000000007 2024-09-12T00:04:49.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.547 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.547 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:49.547 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837918+0000", 2024-09-12T00:04:49.547 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002899535 2024-09-12T00:04:49.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.547 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.547 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:49.547 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838010+0000", 2024-09-12T00:04:49.547 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1901e-05 2024-09-12T00:04:49.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.547 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.548 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:49.548 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838096+0000", 2024-09-12T00:04:49.548 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6211999999999994e-05 2024-09-12T00:04:49.548 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.548 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:49.548 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.548 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.548 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.548 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2724 3.1b 3:da32d84b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:49.548 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:04:49.548 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.6284206569999999, 2024-09-12T00:04:49.548 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019410604000000001, 2024-09-12T00:04:49.548 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:49.548 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:49.549 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:49.549 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:49.549 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:49.549 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:49.549 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2724 2024-09-12T00:04:49.549 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.549 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:49.549 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.549 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:49.549 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:04:49.549 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.549 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.549 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.550 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:49.550 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:04:49.550 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.550 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.550 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.550 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:49.550 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843790+0000", 2024-09-12T00:04:49.550 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.393e-06 2024-09-12T00:04:49.550 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.550 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.550 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:49.550 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847786+0000", 2024-09-12T00:04:49.550 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039965579999999999 2024-09-12T00:04:49.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.551 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:49.551 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847836+0000", 2024-09-12T00:04:49.551 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9731000000000002e-05 2024-09-12T00:04:49.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.551 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:49.551 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847856+0000", 2024-09-12T00:04:49.551 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0245e-05 2024-09-12T00:04:49.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.551 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:49.551 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848053+0000", 2024-09-12T00:04:49.552 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000196882 2024-09-12T00:04:49.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.552 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:49.552 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848291+0000", 2024-09-12T00:04:49.552 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000237762 2024-09-12T00:04:49.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.552 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:49.552 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848544+0000", 2024-09-12T00:04:49.552 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025307500000000001 2024-09-12T00:04:49.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.552 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:49.553 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.860024+0000", 2024-09-12T00:04:49.553 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011479390000000001 2024-09-12T00:04:49.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.553 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:49.553 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.862880+0000", 2024-09-12T00:04:49.553 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002856833 2024-09-12T00:04:49.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.553 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:49.553 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.863048+0000", 2024-09-12T00:04:49.553 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016796700000000001 2024-09-12T00:04:49.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.554 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:49.554 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.863197+0000", 2024-09-12T00:04:49.554 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148768 2024-09-12T00:04:49.554 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.554 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:49.554 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.554 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.554 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2727 3.39 e63/23 3:9c63b475:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_212:head v 63'3, mlcod=62'1)", 2024-09-12T00:04:49.554 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:04:49.554 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.594392061, 2024-09-12T00:04:49.554 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016224526999999999, 2024-09-12T00:04:49.554 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:49.555 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:49.555 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:49.555 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:49.555 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.555 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:49.555 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:04:49.555 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.555 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.555 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.555 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:49.555 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:04:49.555 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.555 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.555 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.556 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:49.556 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877818+0000", 2024-09-12T00:04:49.556 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.813e-06 2024-09-12T00:04:49.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.556 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.556 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:49.556 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883917+0000", 2024-09-12T00:04:49.556 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0060993009999999997 2024-09-12T00:04:49.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.556 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.556 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:49.556 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883961+0000", 2024-09-12T00:04:49.556 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3951e-05 2024-09-12T00:04:49.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.557 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:49.557 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883992+0000", 2024-09-12T00:04:49.557 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0565000000000003e-05 2024-09-12T00:04:49.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.557 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:49.557 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884176+0000", 2024-09-12T00:04:49.557 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018378200000000001 2024-09-12T00:04:49.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.557 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:49.557 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884252+0000", 2024-09-12T00:04:49.558 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6209000000000002e-05 2024-09-12T00:04:49.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.558 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.558 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:49.558 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.893904+0000", 2024-09-12T00:04:49.558 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0096519339999999992 2024-09-12T00:04:49.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.558 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.558 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:49.558 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.894040+0000", 2024-09-12T00:04:49.558 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013597199999999999 2024-09-12T00:04:49.558 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.558 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:49.558 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.559 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.559 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2730 3.7 3:e3fca83c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:49.559 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:04:49.559 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.5638639350000001, 2024-09-12T00:04:49.559 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022178479000000001, 2024-09-12T00:04:49.559 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:49.559 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:49.559 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:49.559 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:49.559 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:49.559 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:49.559 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2730 2024-09-12T00:04:49.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.560 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:49.560 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.560 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:49.560 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:04:49.560 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.560 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.560 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:49.560 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:04:49.561 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.561 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.561 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:49.561 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908346+0000", 2024-09-12T00:04:49.561 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1999999999999999e-06 2024-09-12T00:04:49.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.561 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.561 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:49.561 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912423+0000", 2024-09-12T00:04:49.561 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004076423 2024-09-12T00:04:49.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.561 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.561 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:49.562 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912472+0000", 2024-09-12T00:04:49.562 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9023999999999997e-05 2024-09-12T00:04:49.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.562 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:49.562 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912498+0000", 2024-09-12T00:04:49.562 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6591999999999999e-05 2024-09-12T00:04:49.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.562 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:49.562 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912677+0000", 2024-09-12T00:04:49.562 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017824599999999999 2024-09-12T00:04:49.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.563 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:49.563 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913094+0000", 2024-09-12T00:04:49.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041757799999999999 2024-09-12T00:04:49.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.563 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.563 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:49.563 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913512+0000", 2024-09-12T00:04:49.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000417475 2024-09-12T00:04:49.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.563 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.563 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:49.563 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.929229+0000", 2024-09-12T00:04:49.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015717294999999999 2024-09-12T00:04:49.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.564 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:49.564 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930204+0000", 2024-09-12T00:04:49.564 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00097506199999999996 2024-09-12T00:04:49.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.564 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:49.564 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930392+0000", 2024-09-12T00:04:49.564 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000187775 2024-09-12T00:04:49.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.564 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:49.564 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930522+0000", 2024-09-12T00:04:49.565 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012980899999999999 2024-09-12T00:04:49.565 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.565 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:49.565 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.565 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.565 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2753 3.7 3:e119c99e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_238:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:49.565 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:04:49.565 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.3181758649999999, 2024-09-12T00:04:49.565 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.023674186999999999, 2024-09-12T00:04:49.565 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:49.565 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:49.565 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:49.565 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:49.566 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:49.566 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:49.566 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2753 2024-09-12T00:04:49.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.566 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:49.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.566 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:49.566 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:04:49.566 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.566 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:49.566 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:04:49.566 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.567 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.567 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:49.567 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154035+0000", 2024-09-12T00:04:49.567 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2799999999999999e-06 2024-09-12T00:04:49.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.567 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.567 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:49.567 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159459+0000", 2024-09-12T00:04:49.567 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054242190000000001 2024-09-12T00:04:49.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.567 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.567 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:49.567 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159509+0000", 2024-09-12T00:04:49.568 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9830999999999998e-05 2024-09-12T00:04:49.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.568 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:49.568 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159536+0000", 2024-09-12T00:04:49.568 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7438000000000001e-05 2024-09-12T00:04:49.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.568 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:49.568 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159710+0000", 2024-09-12T00:04:49.568 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017342 2024-09-12T00:04:49.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.568 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:49.569 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159961+0000", 2024-09-12T00:04:49.569 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025164499999999999 2024-09-12T00:04:49.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.569 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.569 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:49.569 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.160206+0000", 2024-09-12T00:04:49.569 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024534200000000001 2024-09-12T00:04:49.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.569 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.569 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:49.569 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177421+0000", 2024-09-12T00:04:49.569 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017214956 2024-09-12T00:04:49.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.569 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:49.570 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177534+0000", 2024-09-12T00:04:49.570 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000112223 2024-09-12T00:04:49.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:49.570 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177625+0000", 2024-09-12T00:04:49.570 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0947999999999997e-05 2024-09-12T00:04:49.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:49.570 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177706+0000", 2024-09-12T00:04:49.570 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0884999999999996e-05 2024-09-12T00:04:49.570 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.571 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:49.571 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.571 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2757 3.2b 3:d6dac417:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:49.571 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:04:49.571 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.2521070430000001, 2024-09-12T00:04:49.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017779708000000002, 2024-09-12T00:04:49.571 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:49.571 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:49.571 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:49.571 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:49.571 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:49.572 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:49.572 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2757 2024-09-12T00:04:49.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.572 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:49.572 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.572 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:49.572 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:04:49.572 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.572 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.572 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:49.572 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:04:49.572 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.573 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:49.573 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220103+0000", 2024-09-12T00:04:49.573 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.32e-06 2024-09-12T00:04:49.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.573 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:49.573 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225042+0000", 2024-09-12T00:04:49.573 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049386200000000003 2024-09-12T00:04:49.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.573 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:49.573 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225083+0000", 2024-09-12T00:04:49.573 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1304000000000003e-05 2024-09-12T00:04:49.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.574 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:49.574 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225102+0000", 2024-09-12T00:04:49.574 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8502e-05 2024-09-12T00:04:49.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.574 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:49.574 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225256+0000", 2024-09-12T00:04:49.574 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015436099999999999 2024-09-12T00:04:49.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.574 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:49.574 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225513+0000", 2024-09-12T00:04:49.575 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000256562 2024-09-12T00:04:49.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.575 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.575 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:49.575 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225737+0000", 2024-09-12T00:04:49.575 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022379 2024-09-12T00:04:49.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.575 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.575 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:49.575 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.234281+0000", 2024-09-12T00:04:49.575 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0085440540000000006 2024-09-12T00:04:49.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.575 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.575 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:49.576 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237710+0000", 2024-09-12T00:04:49.576 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0034298380000000002 2024-09-12T00:04:49.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.576 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:49.576 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237805+0000", 2024-09-12T00:04:49.576 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4804999999999998e-05 2024-09-12T00:04:49.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.576 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:49.576 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237880+0000", 2024-09-12T00:04:49.576 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4552e-05 2024-09-12T00:04:49.576 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.576 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:49.577 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.577 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.577 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2764 3.2d e63/23 3:b7a0f55d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_249:head v 63'7, mlcod=63'5)", 2024-09-12T00:04:49.577 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:04:49.577 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.1433295729999999, 2024-09-12T00:04:49.577 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018235872, 2024-09-12T00:04:49.577 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:49.577 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:49.577 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:49.577 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:49.577 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.577 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:49.577 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:04:49.578 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.578 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:49.578 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:04:49.578 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:49.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.578 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:49.578 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328882+0000", 2024-09-12T00:04:49.578 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5000000000000001e-06 2024-09-12T00:04:49.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.578 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:49.579 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335092+0000", 2024-09-12T00:04:49.579 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0062094730000000001 2024-09-12T00:04:49.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.579 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.579 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:49.579 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335127+0000", 2024-09-12T00:04:49.579 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5717999999999999e-05 2024-09-12T00:04:49.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.579 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.579 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:49.579 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335144+0000", 2024-09-12T00:04:49.579 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7119e-05 2024-09-12T00:04:49.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.579 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.580 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:49.580 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335308+0000", 2024-09-12T00:04:49.580 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000163757 2024-09-12T00:04:49.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.580 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.580 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:49.580 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335354+0000", 2024-09-12T00:04:49.580 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6164e-05 2024-09-12T00:04:49.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.580 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.580 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:49.580 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.346991+0000", 2024-09-12T00:04:49.580 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011636851 2024-09-12T00:04:49.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:49.581 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:49.581 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:49.581 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.347113+0000", 2024-09-12T00:04:49.581 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012229 2024-09-12T00:04:49.581 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.581 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:49.581 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.581 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:49.581 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:49.581 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:49.582 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:49.583 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:49.583 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:49.584 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:49.584 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:04:49.584 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:49.582+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:49.585 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:49.585 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:49.585 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:49.585 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:49.586 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:49.586 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:49.586 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T00:04:49.588 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:49.588 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:49.609 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:49.610 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:49.683 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:49.682+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:49.761 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:49.761 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:49.775 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:04:49.818 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:49.818+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:49.886 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:49.886+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:49.943 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:49.943 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:49.957 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:04:49.987 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:49.988+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:50.088 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:50.086+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:50.128 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:50.128 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:50.143 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:04:50.230 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:50.230+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:50.289 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:50.292+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:50.306 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:50.306 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:50.321 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:04:50.410 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:50.410+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:50.485 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:50.485 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:50.491 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:50.490+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:50.500 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:04:50.593 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:50.592+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:50.662 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:50.662 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:50.676 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:04:50.694 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:50.696+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:50.795 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:50.796+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:50.797 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:50.797 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:50.811 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:04:50.895 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:50.894+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:50.933 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:50.933 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:50.948 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:04:50.997 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:50.996+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:51.098 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:51.098+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:51.115 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:51.115 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:51.131 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:04:51.199 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:51.200+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:51.268 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:51.268 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:51.282 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:04:51.300 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:51.298+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:51.401 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:51.404+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:51.456 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:51.456 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:51.471 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:04:51.513 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:51.516+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:51.589 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:04:51.631 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:04:51.633 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:51.636+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:51.648 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:51.648 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:51.665 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:04:51.709 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:51.712+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:51.749 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T00:04:51.749 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T00:04:51.749 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T00:04:51.749 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T00:04:51.795 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:51.796 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:51.804 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:51.802+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:51.815 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:51.815 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:51.833 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:51.834 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:51.837 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:51.837 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:51.837 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:51.837 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:51.851 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:51.851 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:51.852 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:04:51.873 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:51.874 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:51.893 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:51.893 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:51.904 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:51.904+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:51.914 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:51.914 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:51.935 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:51.936 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:51.989 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:51.989 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:51.990 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:51.990 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:51.990 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:52.002 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:04:52.006 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:52.006+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:52.055 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:04:52.055 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:52.055 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 64, 2024-09-12T00:04:52.055 INFO:teuthology.orchestra.run.smithi019.stdout: "fsid": "e8cc2cf2-4ebe-41fb-ac6a-f09b6fd34589", 2024-09-12T00:04:52.055 INFO:teuthology.orchestra.run.smithi019.stdout: "created": "2024-09-12T00:02:55.594166+0000", 2024-09-12T00:04:52.056 INFO:teuthology.orchestra.run.smithi019.stdout: "modified": "2024-09-12T00:04:49.555133+0000", 2024-09-12T00:04:52.056 INFO:teuthology.orchestra.run.smithi019.stdout: "last_up_change": "2024-09-12T00:03:08.456127+0000", 2024-09-12T00:04:52.056 INFO:teuthology.orchestra.run.smithi019.stdout: "last_in_change": "2024-09-12T00:02:58.648554+0000", 2024-09-12T00:04:52.056 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T00:04:52.056 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_num": 5804032, 2024-09-12T00:04:52.056 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_set": [ 2024-09-12T00:04:52.056 INFO:teuthology.orchestra.run.smithi019.stdout: "nodeep-scrub", 2024-09-12T00:04:52.056 INFO:teuthology.orchestra.run.smithi019.stdout: "pglog_hardlimit", 2024-09-12T00:04:52.056 INFO:teuthology.orchestra.run.smithi019.stdout: "purged_snapdirs", 2024-09-12T00:04:52.056 INFO:teuthology.orchestra.run.smithi019.stdout: "recovery_deletes", 2024-09-12T00:04:52.056 INFO:teuthology.orchestra.run.smithi019.stdout: "sortbitwise" 2024-09-12T00:04:52.056 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T00:04:52.057 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_version": 5, 2024-09-12T00:04:52.057 INFO:teuthology.orchestra.run.smithi019.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T00:04:52.057 INFO:teuthology.orchestra.run.smithi019.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T00:04:52.057 INFO:teuthology.orchestra.run.smithi019.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T00:04:52.057 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_snapshot": "", 2024-09-12T00:04:52.057 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_max": 8, 2024-09-12T00:04:52.057 INFO:teuthology.orchestra.run.smithi019.stdout: "max_osd": 8, 2024-09-12T00:04:52.057 INFO:teuthology.orchestra.run.smithi019.stdout: "require_min_compat_client": "luminous", 2024-09-12T00:04:52.057 INFO:teuthology.orchestra.run.smithi019.stdout: "min_compat_client": "luminous", 2024-09-12T00:04:52.057 INFO:teuthology.orchestra.run.smithi019.stdout: "require_osd_release": "squid", 2024-09-12T00:04:52.057 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_crimson": false, 2024-09-12T00:04:52.058 INFO:teuthology.orchestra.run.smithi019.stdout: "pools": [ 2024-09-12T00:04:52.058 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.058 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 1, 2024-09-12T00:04:52.058 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": ".mgr", 2024-09-12T00:04:52.058 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T00:03:10.418576+0000", 2024-09-12T00:04:52.058 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-12T00:04:52.058 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2024-09-12T00:04:52.058 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T00:04:52.058 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T00:04:52.058 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T00:04:52.058 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T00:04:52.058 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T00:04:52.058 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T00:04:52.058 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T00:04:52.059 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T00:04:52.059 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T00:04:52.059 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T00:04:52.059 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T00:04:52.059 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 1, 2024-09-12T00:04:52.059 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 1, 2024-09-12T00:04:52.059 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 1, 2024-09-12T00:04:52.059 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 1, 2024-09-12T00:04:52.059 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 1, 2024-09-12T00:04:52.059 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T00:04:52.059 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T00:04:52.059 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T00:04:52.059 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T00:04:52.060 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T00:04:52.060 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T00:04:52.060 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T00:04:52.060 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.060 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "18", 2024-09-12T00:04:52.060 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T00:04:52.060 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T00:04:52.060 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T00:04:52.060 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T00:04:52.060 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T00:04:52.060 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2024-09-12T00:04:52.060 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2024-09-12T00:04:52.060 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T00:04:52.061 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T00:04:52.061 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T00:04:52.061 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T00:04:52.061 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T00:04:52.061 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T00:04:52.061 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T00:04:52.061 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T00:04:52.061 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T00:04:52.061 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T00:04:52.061 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T00:04:52.061 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T00:04:52.061 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T00:04:52.061 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T00:04:52.062 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T00:04:52.062 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T00:04:52.062 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T00:04:52.062 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T00:04:52.062 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T00:04:52.062 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.062 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T00:04:52.062 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T00:04:52.062 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T00:04:52.062 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T00:04:52.062 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T00:04:52.062 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T00:04:52.062 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T00:04:52.062 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T00:04:52.063 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T00:04:52.063 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T00:04:52.063 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T00:04:52.063 INFO:teuthology.orchestra.run.smithi019.stdout: "options": { 2024-09-12T00:04:52.063 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_max": 32, 2024-09-12T00:04:52.063 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_min": 1 2024-09-12T00:04:52.063 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.063 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T00:04:52.063 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": {} 2024-09-12T00:04:52.064 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.064 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T00:04:52.064 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T00:04:52.064 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 8, 2024-09-12T00:04:52.064 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 8, 2024-09-12T00:04:52.064 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 0.25, 2024-09-12T00:04:52.064 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 2, 2024-09-12T00:04:52.064 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 2, 2024-09-12T00:04:52.064 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 1, 2024-09-12T00:04:52.064 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 1, 2024-09-12T00:04:52.064 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 1 2024-09-12T00:04:52.064 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.064 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.065 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.065 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 2, 2024-09-12T00:04:52.065 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": "rbd", 2024-09-12T00:04:52.065 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T00:03:14.745863+0000", 2024-09-12T00:04:52.065 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 8193, 2024-09-12T00:04:52.065 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T00:04:52.065 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T00:04:52.065 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T00:04:52.065 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T00:04:52.065 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T00:04:52.065 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T00:04:52.065 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T00:04:52.065 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T00:04:52.065 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T00:04:52.066 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T00:04:52.066 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T00:04:52.066 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T00:04:52.066 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 8, 2024-09-12T00:04:52.066 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 8, 2024-09-12T00:04:52.066 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 8, 2024-09-12T00:04:52.066 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 8, 2024-09-12T00:04:52.066 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 8, 2024-09-12T00:04:52.066 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T00:04:52.066 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T00:04:52.066 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T00:04:52.066 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T00:04:52.067 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T00:04:52.067 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T00:04:52.067 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T00:04:52.067 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.067 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "22", 2024-09-12T00:04:52.067 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T00:04:52.067 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T00:04:52.067 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T00:04:52.067 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T00:04:52.068 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T00:04:52.068 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 2, 2024-09-12T00:04:52.068 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 22, 2024-09-12T00:04:52.068 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T00:04:52.068 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T00:04:52.068 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T00:04:52.068 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T00:04:52.068 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T00:04:52.068 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T00:04:52.068 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T00:04:52.068 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T00:04:52.068 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T00:04:52.069 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T00:04:52.069 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T00:04:52.069 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T00:04:52.069 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T00:04:52.069 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T00:04:52.069 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T00:04:52.069 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T00:04:52.069 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T00:04:52.069 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T00:04:52.069 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T00:04:52.069 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.069 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T00:04:52.069 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T00:04:52.069 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T00:04:52.070 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T00:04:52.070 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T00:04:52.070 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T00:04:52.070 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T00:04:52.070 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T00:04:52.070 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T00:04:52.070 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T00:04:52.070 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T00:04:52.070 INFO:teuthology.orchestra.run.smithi019.stdout: "options": {}, 2024-09-12T00:04:52.070 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T00:04:52.070 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd": {} 2024-09-12T00:04:52.070 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.070 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T00:04:52.070 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T00:04:52.070 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 4.9800000190734863, 2024-09-12T00:04:52.071 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 4.9800000190734863, 2024-09-12T00:04:52.071 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 0.87999999523162842, 2024-09-12T00:04:52.071 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 4.380000114440918, 2024-09-12T00:04:52.071 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 4.380000114440918, 2024-09-12T00:04:52.071 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 1, 2024-09-12T00:04:52.071 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 1, 2024-09-12T00:04:52.071 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 1 2024-09-12T00:04:52.071 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.071 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.071 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.071 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 3, 2024-09-12T00:04:52.071 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": "default.rgw.buckets.data", 2024-09-12T00:04:52.072 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T00:03:22.360758+0000", 2024-09-12T00:04:52.072 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-12T00:04:52.072 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2024-09-12T00:04:52.072 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T00:04:52.072 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T00:04:52.072 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T00:04:52.072 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T00:04:52.072 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T00:04:52.072 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T00:04:52.072 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T00:04:52.072 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T00:04:52.072 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T00:04:52.072 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T00:04:52.073 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T00:04:52.073 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 64, 2024-09-12T00:04:52.073 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 64, 2024-09-12T00:04:52.073 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 64, 2024-09-12T00:04:52.073 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 64, 2024-09-12T00:04:52.073 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 64, 2024-09-12T00:04:52.073 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T00:04:52.073 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T00:04:52.073 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T00:04:52.073 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T00:04:52.073 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T00:04:52.074 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T00:04:52.074 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T00:04:52.074 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.074 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "25", 2024-09-12T00:04:52.074 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T00:04:52.074 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T00:04:52.074 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T00:04:52.074 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T00:04:52.074 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T00:04:52.074 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2024-09-12T00:04:52.077 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2024-09-12T00:04:52.077 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T00:04:52.077 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T00:04:52.077 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T00:04:52.077 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T00:04:52.077 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T00:04:52.077 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T00:04:52.078 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T00:04:52.078 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T00:04:52.078 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T00:04:52.078 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T00:04:52.078 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T00:04:52.078 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T00:04:52.078 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T00:04:52.078 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T00:04:52.078 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T00:04:52.078 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T00:04:52.078 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T00:04:52.078 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T00:04:52.078 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T00:04:52.079 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.079 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T00:04:52.079 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T00:04:52.079 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T00:04:52.079 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T00:04:52.079 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T00:04:52.079 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T00:04:52.079 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T00:04:52.079 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T00:04:52.079 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T00:04:52.080 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T00:04:52.080 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T00:04:52.080 INFO:teuthology.orchestra.run.smithi019.stdout: "options": {}, 2024-09-12T00:04:52.080 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T00:04:52.080 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw": {} 2024-09-12T00:04:52.080 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.080 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T00:04:52.080 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T00:04:52.081 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 1.5, 2024-09-12T00:04:52.081 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 1.5, 2024-09-12T00:04:52.081 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 1, 2024-09-12T00:04:52.081 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 1.5, 2024-09-12T00:04:52.081 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 1.5, 2024-09-12T00:04:52.081 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 1, 2024-09-12T00:04:52.081 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 1, 2024-09-12T00:04:52.081 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 1 2024-09-12T00:04:52.082 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.082 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.082 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.082 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 4, 2024-09-12T00:04:52.082 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": "default.rgw.buckets.index", 2024-09-12T00:04:52.082 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T00:03:23.944957+0000", 2024-09-12T00:04:52.082 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-12T00:04:52.082 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2024-09-12T00:04:52.082 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T00:04:52.083 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T00:04:52.083 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T00:04:52.083 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T00:04:52.083 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T00:04:52.083 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T00:04:52.083 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T00:04:52.083 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T00:04:52.083 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T00:04:52.083 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T00:04:52.084 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T00:04:52.084 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 64, 2024-09-12T00:04:52.084 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 64, 2024-09-12T00:04:52.084 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 64, 2024-09-12T00:04:52.084 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 64, 2024-09-12T00:04:52.084 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 64, 2024-09-12T00:04:52.084 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T00:04:52.084 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T00:04:52.084 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T00:04:52.085 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T00:04:52.085 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T00:04:52.085 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T00:04:52.085 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T00:04:52.085 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.085 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "27", 2024-09-12T00:04:52.085 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T00:04:52.085 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T00:04:52.085 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T00:04:52.086 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T00:04:52.086 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T00:04:52.086 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2024-09-12T00:04:52.086 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2024-09-12T00:04:52.086 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T00:04:52.086 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T00:04:52.086 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T00:04:52.086 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T00:04:52.086 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T00:04:52.087 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T00:04:52.087 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T00:04:52.087 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T00:04:52.087 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T00:04:52.087 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T00:04:52.087 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T00:04:52.087 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T00:04:52.087 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T00:04:52.087 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T00:04:52.088 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T00:04:52.088 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T00:04:52.088 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T00:04:52.088 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T00:04:52.088 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T00:04:52.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.088 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T00:04:52.088 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T00:04:52.089 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T00:04:52.089 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T00:04:52.089 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T00:04:52.089 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T00:04:52.089 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T00:04:52.089 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T00:04:52.089 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T00:04:52.089 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T00:04:52.090 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T00:04:52.090 INFO:teuthology.orchestra.run.smithi019.stdout: "options": {}, 2024-09-12T00:04:52.090 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T00:04:52.090 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw": {} 2024-09-12T00:04:52.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.090 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T00:04:52.091 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T00:04:52.091 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 1.1299999952316284, 2024-09-12T00:04:52.091 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 1.1299999952316284, 2024-09-12T00:04:52.091 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 1, 2024-09-12T00:04:52.091 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T00:04:52.091 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T00:04:52.091 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 1, 2024-09-12T00:04:52.091 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 1, 2024-09-12T00:04:52.091 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 1 2024-09-12T00:04:52.092 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.092 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.092 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 5, 2024-09-12T00:04:52.092 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": ".rgw.root", 2024-09-12T00:04:52.092 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T00:03:25.559276+0000", 2024-09-12T00:04:52.092 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-12T00:04:52.092 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2024-09-12T00:04:52.092 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T00:04:52.092 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T00:04:52.093 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T00:04:52.093 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T00:04:52.093 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T00:04:52.093 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T00:04:52.093 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T00:04:52.093 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T00:04:52.093 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T00:04:52.093 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T00:04:52.093 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T00:04:52.094 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 32, 2024-09-12T00:04:52.094 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 32, 2024-09-12T00:04:52.094 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 32, 2024-09-12T00:04:52.094 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 32, 2024-09-12T00:04:52.094 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 32, 2024-09-12T00:04:52.094 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T00:04:52.094 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T00:04:52.094 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T00:04:52.094 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T00:04:52.094 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T00:04:52.095 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T00:04:52.095 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T00:04:52.095 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.095 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "29", 2024-09-12T00:04:52.095 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T00:04:52.095 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T00:04:52.095 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T00:04:52.095 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T00:04:52.095 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T00:04:52.095 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2024-09-12T00:04:52.096 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2024-09-12T00:04:52.096 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T00:04:52.096 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T00:04:52.096 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T00:04:52.096 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T00:04:52.096 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T00:04:52.096 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T00:04:52.096 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T00:04:52.096 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T00:04:52.096 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T00:04:52.097 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T00:04:52.097 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T00:04:52.097 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T00:04:52.097 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T00:04:52.097 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T00:04:52.097 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T00:04:52.097 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T00:04:52.097 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T00:04:52.098 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T00:04:52.098 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T00:04:52.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.098 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T00:04:52.098 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T00:04:52.098 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T00:04:52.098 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T00:04:52.098 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T00:04:52.098 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T00:04:52.098 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T00:04:52.098 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T00:04:52.099 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T00:04:52.099 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T00:04:52.099 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T00:04:52.099 INFO:teuthology.orchestra.run.smithi019.stdout: "options": {}, 2024-09-12T00:04:52.099 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T00:04:52.099 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw": {} 2024-09-12T00:04:52.099 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.099 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T00:04:52.099 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T00:04:52.099 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 1.75, 2024-09-12T00:04:52.100 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 1.75, 2024-09-12T00:04:52.100 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 1, 2024-09-12T00:04:52.100 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 1.75, 2024-09-12T00:04:52.100 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 1.75, 2024-09-12T00:04:52.100 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 1, 2024-09-12T00:04:52.100 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 1, 2024-09-12T00:04:52.100 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 1 2024-09-12T00:04:52.100 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.100 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.100 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.101 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 6, 2024-09-12T00:04:52.101 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": "default.rgw.log", 2024-09-12T00:04:52.101 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T00:03:27.471761+0000", 2024-09-12T00:04:52.101 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-12T00:04:52.101 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2024-09-12T00:04:52.101 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T00:04:52.101 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T00:04:52.101 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T00:04:52.101 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T00:04:52.102 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T00:04:52.102 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T00:04:52.102 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T00:04:52.102 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T00:04:52.102 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T00:04:52.102 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T00:04:52.102 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T00:04:52.102 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 32, 2024-09-12T00:04:52.102 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 32, 2024-09-12T00:04:52.103 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 32, 2024-09-12T00:04:52.103 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 32, 2024-09-12T00:04:52.103 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 32, 2024-09-12T00:04:52.103 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T00:04:52.103 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T00:04:52.103 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T00:04:52.103 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T00:04:52.103 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T00:04:52.103 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T00:04:52.103 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T00:04:52.104 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.104 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "31", 2024-09-12T00:04:52.104 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T00:04:52.104 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T00:04:52.104 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T00:04:52.104 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T00:04:52.104 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T00:04:52.104 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2024-09-12T00:04:52.104 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2024-09-12T00:04:52.105 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T00:04:52.105 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T00:04:52.105 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T00:04:52.105 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T00:04:52.105 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T00:04:52.105 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T00:04:52.105 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T00:04:52.105 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T00:04:52.105 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T00:04:52.105 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T00:04:52.106 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T00:04:52.106 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T00:04:52.106 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T00:04:52.106 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T00:04:52.106 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T00:04:52.106 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T00:04:52.106 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T00:04:52.106 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T00:04:52.106 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T00:04:52.106 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.107 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T00:04:52.107 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T00:04:52.107 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T00:04:52.107 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T00:04:52.107 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T00:04:52.107 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T00:04:52.107 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T00:04:52.107 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T00:04:52.107 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T00:04:52.108 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T00:04:52.108 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T00:04:52.108 INFO:teuthology.orchestra.run.smithi019.stdout: "options": {}, 2024-09-12T00:04:52.108 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T00:04:52.108 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw": {} 2024-09-12T00:04:52.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.108 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T00:04:52.108 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T00:04:52.108 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 1.5, 2024-09-12T00:04:52.108 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 1.5, 2024-09-12T00:04:52.109 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 1, 2024-09-12T00:04:52.109 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 1.5, 2024-09-12T00:04:52.109 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 1.5, 2024-09-12T00:04:52.109 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 1, 2024-09-12T00:04:52.109 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 1, 2024-09-12T00:04:52.109 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 1 2024-09-12T00:04:52.109 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.109 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.109 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.110 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 7, 2024-09-12T00:04:52.110 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": "default.rgw.control", 2024-09-12T00:04:52.110 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T00:03:29.369053+0000", 2024-09-12T00:04:52.110 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-12T00:04:52.110 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2024-09-12T00:04:52.110 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T00:04:52.110 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T00:04:52.110 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T00:04:52.110 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T00:04:52.111 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T00:04:52.111 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T00:04:52.111 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T00:04:52.111 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T00:04:52.111 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T00:04:52.111 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T00:04:52.111 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T00:04:52.111 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 32, 2024-09-12T00:04:52.111 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 32, 2024-09-12T00:04:52.112 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 32, 2024-09-12T00:04:52.112 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 32, 2024-09-12T00:04:52.112 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 32, 2024-09-12T00:04:52.112 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T00:04:52.112 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T00:04:52.112 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T00:04:52.112 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T00:04:52.112 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T00:04:52.112 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T00:04:52.113 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T00:04:52.113 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.113 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "33", 2024-09-12T00:04:52.113 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T00:04:52.113 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T00:04:52.113 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T00:04:52.113 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T00:04:52.113 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T00:04:52.113 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2024-09-12T00:04:52.114 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2024-09-12T00:04:52.114 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T00:04:52.114 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T00:04:52.114 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T00:04:52.114 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T00:04:52.114 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T00:04:52.114 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T00:04:52.114 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T00:04:52.114 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T00:04:52.115 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T00:04:52.115 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T00:04:52.115 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T00:04:52.115 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T00:04:52.115 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T00:04:52.115 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T00:04:52.115 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T00:04:52.115 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T00:04:52.115 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T00:04:52.116 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T00:04:52.116 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T00:04:52.116 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.116 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T00:04:52.116 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T00:04:52.116 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T00:04:52.116 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T00:04:52.116 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T00:04:52.116 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T00:04:52.117 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T00:04:52.117 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T00:04:52.117 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T00:04:52.117 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T00:04:52.117 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T00:04:52.117 INFO:teuthology.orchestra.run.smithi019.stdout: "options": {}, 2024-09-12T00:04:52.117 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T00:04:52.118 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw": {} 2024-09-12T00:04:52.118 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.118 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T00:04:52.118 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T00:04:52.118 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 1.5, 2024-09-12T00:04:52.118 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 1.5, 2024-09-12T00:04:52.118 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 1, 2024-09-12T00:04:52.118 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 1.5, 2024-09-12T00:04:52.118 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 1.5, 2024-09-12T00:04:52.119 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 1, 2024-09-12T00:04:52.119 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 1, 2024-09-12T00:04:52.119 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 1 2024-09-12T00:04:52.119 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.119 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.119 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.119 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 8, 2024-09-12T00:04:52.119 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": "default.rgw.meta", 2024-09-12T00:04:52.119 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T00:03:31.499978+0000", 2024-09-12T00:04:52.120 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-12T00:04:52.120 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2024-09-12T00:04:52.120 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T00:04:52.120 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T00:04:52.120 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T00:04:52.120 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T00:04:52.120 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T00:04:52.120 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T00:04:52.120 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T00:04:52.121 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T00:04:52.121 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T00:04:52.121 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T00:04:52.121 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T00:04:52.121 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 32, 2024-09-12T00:04:52.121 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 32, 2024-09-12T00:04:52.121 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 32, 2024-09-12T00:04:52.121 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 32, 2024-09-12T00:04:52.121 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 32, 2024-09-12T00:04:52.122 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T00:04:52.122 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T00:04:52.122 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T00:04:52.122 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T00:04:52.122 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T00:04:52.122 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T00:04:52.122 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T00:04:52.122 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.122 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "35", 2024-09-12T00:04:52.123 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T00:04:52.123 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T00:04:52.123 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T00:04:52.123 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T00:04:52.123 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T00:04:52.123 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2024-09-12T00:04:52.123 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2024-09-12T00:04:52.123 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T00:04:52.123 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T00:04:52.124 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T00:04:52.124 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T00:04:52.124 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T00:04:52.124 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T00:04:52.124 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T00:04:52.124 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T00:04:52.124 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T00:04:52.124 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T00:04:52.124 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T00:04:52.125 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T00:04:52.125 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T00:04:52.125 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T00:04:52.125 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T00:04:52.125 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T00:04:52.125 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T00:04:52.125 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T00:04:52.125 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T00:04:52.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.126 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T00:04:52.126 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T00:04:52.126 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T00:04:52.126 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T00:04:52.126 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T00:04:52.126 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T00:04:52.126 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T00:04:52.126 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T00:04:52.127 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T00:04:52.127 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T00:04:52.127 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T00:04:52.127 INFO:teuthology.orchestra.run.smithi019.stdout: "options": { 2024-09-12T00:04:52.127 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_bias": 4 2024-09-12T00:04:52.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.127 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T00:04:52.127 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw": {} 2024-09-12T00:04:52.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.128 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T00:04:52.128 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T00:04:52.128 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 1.5, 2024-09-12T00:04:52.128 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 1.5, 2024-09-12T00:04:52.128 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 1, 2024-09-12T00:04:52.128 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 1.5, 2024-09-12T00:04:52.128 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 1.5, 2024-09-12T00:04:52.128 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 1, 2024-09-12T00:04:52.129 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 1, 2024-09-12T00:04:52.129 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 1 2024-09-12T00:04:52.129 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.129 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.129 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T00:04:52.129 INFO:teuthology.orchestra.run.smithi019.stdout: "osds": [ 2024-09-12T00:04:52.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.129 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 0, 2024-09-12T00:04:52.129 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "af1b1898-c45f-43f5-b9c5-26e491625211", 2024-09-12T00:04:52.130 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2024-09-12T00:04:52.130 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2024-09-12T00:04:52.130 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2024-09-12T00:04:52.130 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2024-09-12T00:04:52.130 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 0, 2024-09-12T00:04:52.130 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 0, 2024-09-12T00:04:52.130 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 14, 2024-09-12T00:04:52.130 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 33, 2024-09-12T00:04:52.130 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 0, 2024-09-12T00:04:52.131 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2024-09-12T00:04:52.131 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2024-09-12T00:04:52.131 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.131 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.131 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.131 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6808", 2024-09-12T00:04:52.131 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 846638970 2024-09-12T00:04:52.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.132 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.132 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.132 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6809", 2024-09-12T00:04:52.132 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 846638970 2024-09-12T00:04:52.132 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.133 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.133 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2024-09-12T00:04:52.133 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.133 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.134 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.134 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6810", 2024-09-12T00:04:52.134 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 846638970 2024-09-12T00:04:52.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.134 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.134 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.135 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6811", 2024-09-12T00:04:52.135 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 846638970 2024-09-12T00:04:52.135 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.135 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.135 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2024-09-12T00:04:52.135 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.135 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.136 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.136 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6814", 2024-09-12T00:04:52.136 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 846638970 2024-09-12T00:04:52.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.136 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.136 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.136 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6815", 2024-09-12T00:04:52.136 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 846638970 2024-09-12T00:04:52.136 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.136 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.136 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2024-09-12T00:04:52.136 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.137 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.137 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.137 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6812", 2024-09-12T00:04:52.137 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 846638970 2024-09-12T00:04:52.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.137 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.137 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.137 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6813", 2024-09-12T00:04:52.137 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 846638970 2024-09-12T00:04:52.137 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.137 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.137 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.19:6809/846638970", 2024-09-12T00:04:52.137 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.19:6811/846638970", 2024-09-12T00:04:52.138 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.19:6815/846638970", 2024-09-12T00:04:52.138 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.19:6813/846638970", 2024-09-12T00:04:52.138 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2024-09-12T00:04:52.138 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2024-09-12T00:04:52.138 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2024-09-12T00:04:52.138 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.138 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.138 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 1, 2024-09-12T00:04:52.138 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "fe1aa63d-8e57-4163-98a5-0131e1a60680", 2024-09-12T00:04:52.138 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2024-09-12T00:04:52.138 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2024-09-12T00:04:52.138 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2024-09-12T00:04:52.138 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2024-09-12T00:04:52.139 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 0, 2024-09-12T00:04:52.139 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 0, 2024-09-12T00:04:52.139 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 14, 2024-09-12T00:04:52.139 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 33, 2024-09-12T00:04:52.139 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 0, 2024-09-12T00:04:52.139 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2024-09-12T00:04:52.139 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2024-09-12T00:04:52.139 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.139 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.139 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.140 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6800", 2024-09-12T00:04:52.140 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 889703096 2024-09-12T00:04:52.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.140 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.140 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.140 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6801", 2024-09-12T00:04:52.140 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 889703096 2024-09-12T00:04:52.140 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.140 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.140 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2024-09-12T00:04:52.140 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.140 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.141 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.141 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6802", 2024-09-12T00:04:52.141 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 889703096 2024-09-12T00:04:52.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.141 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.141 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.141 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6803", 2024-09-12T00:04:52.141 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 889703096 2024-09-12T00:04:52.141 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.141 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.141 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2024-09-12T00:04:52.141 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.141 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.142 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.142 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6806", 2024-09-12T00:04:52.142 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 889703096 2024-09-12T00:04:52.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.142 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.142 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6807", 2024-09-12T00:04:52.142 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 889703096 2024-09-12T00:04:52.142 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.142 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.142 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2024-09-12T00:04:52.142 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.143 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.143 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6804", 2024-09-12T00:04:52.143 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 889703096 2024-09-12T00:04:52.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.143 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.143 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.143 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6805", 2024-09-12T00:04:52.143 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 889703096 2024-09-12T00:04:52.143 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.143 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.143 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.19:6801/889703096", 2024-09-12T00:04:52.143 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.19:6803/889703096", 2024-09-12T00:04:52.144 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.19:6807/889703096", 2024-09-12T00:04:52.144 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.19:6805/889703096", 2024-09-12T00:04:52.144 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2024-09-12T00:04:52.144 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2024-09-12T00:04:52.144 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2024-09-12T00:04:52.144 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.144 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.144 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.144 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 2, 2024-09-12T00:04:52.144 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "1c97c435-1516-46e1-8fb9-fab9d7419774", 2024-09-12T00:04:52.144 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2024-09-12T00:04:52.144 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2024-09-12T00:04:52.144 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2024-09-12T00:04:52.145 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2024-09-12T00:04:52.145 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 0, 2024-09-12T00:04:52.145 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 0, 2024-09-12T00:04:52.145 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 14, 2024-09-12T00:04:52.145 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 33, 2024-09-12T00:04:52.145 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 0, 2024-09-12T00:04:52.145 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2024-09-12T00:04:52.145 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2024-09-12T00:04:52.145 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.145 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.145 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.145 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6816", 2024-09-12T00:04:52.145 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1847757189 2024-09-12T00:04:52.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.146 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.146 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.146 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6817", 2024-09-12T00:04:52.146 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1847757189 2024-09-12T00:04:52.146 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.146 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.146 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2024-09-12T00:04:52.146 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.146 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.146 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.146 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6818", 2024-09-12T00:04:52.147 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1847757189 2024-09-12T00:04:52.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.147 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.147 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6819", 2024-09-12T00:04:52.147 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1847757189 2024-09-12T00:04:52.147 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.147 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.147 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2024-09-12T00:04:52.147 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.147 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.148 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6822", 2024-09-12T00:04:52.148 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1847757189 2024-09-12T00:04:52.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.148 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.148 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.148 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6823", 2024-09-12T00:04:52.148 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1847757189 2024-09-12T00:04:52.148 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.148 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.148 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2024-09-12T00:04:52.148 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.148 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.149 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.149 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6820", 2024-09-12T00:04:52.149 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1847757189 2024-09-12T00:04:52.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.149 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.149 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.149 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6821", 2024-09-12T00:04:52.149 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1847757189 2024-09-12T00:04:52.149 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.149 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.149 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.19:6817/1847757189", 2024-09-12T00:04:52.150 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.19:6819/1847757189", 2024-09-12T00:04:52.150 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.19:6823/1847757189", 2024-09-12T00:04:52.150 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.19:6821/1847757189", 2024-09-12T00:04:52.150 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2024-09-12T00:04:52.150 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2024-09-12T00:04:52.150 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2024-09-12T00:04:52.150 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.150 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.150 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 3, 2024-09-12T00:04:52.150 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "30dc8f77-54f0-4e5a-8adc-3ef4b1c08f71", 2024-09-12T00:04:52.150 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2024-09-12T00:04:52.150 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2024-09-12T00:04:52.151 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2024-09-12T00:04:52.151 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2024-09-12T00:04:52.151 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 0, 2024-09-12T00:04:52.151 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 0, 2024-09-12T00:04:52.151 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 14, 2024-09-12T00:04:52.151 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 42, 2024-09-12T00:04:52.151 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 0, 2024-09-12T00:04:52.151 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2024-09-12T00:04:52.151 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2024-09-12T00:04:52.151 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.151 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.151 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6824", 2024-09-12T00:04:52.151 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2630062148 2024-09-12T00:04:52.152 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.152 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.152 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.152 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6825", 2024-09-12T00:04:52.152 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2630062148 2024-09-12T00:04:52.152 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.152 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.152 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.152 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2024-09-12T00:04:52.152 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.152 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.152 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.152 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6826", 2024-09-12T00:04:52.153 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2630062148 2024-09-12T00:04:52.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.153 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.153 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.153 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6827", 2024-09-12T00:04:52.153 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2630062148 2024-09-12T00:04:52.153 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.153 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.153 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2024-09-12T00:04:52.153 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.153 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.153 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.154 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6830", 2024-09-12T00:04:52.154 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2630062148 2024-09-12T00:04:52.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.154 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.154 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6831", 2024-09-12T00:04:52.154 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2630062148 2024-09-12T00:04:52.154 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.154 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.154 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2024-09-12T00:04:52.154 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.155 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.155 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6828", 2024-09-12T00:04:52.155 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2630062148 2024-09-12T00:04:52.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.155 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.155 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.155 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6829", 2024-09-12T00:04:52.155 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2630062148 2024-09-12T00:04:52.155 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.155 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.155 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.19:6825/2630062148", 2024-09-12T00:04:52.155 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.19:6827/2630062148", 2024-09-12T00:04:52.155 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.19:6831/2630062148", 2024-09-12T00:04:52.156 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.19:6829/2630062148", 2024-09-12T00:04:52.156 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2024-09-12T00:04:52.156 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2024-09-12T00:04:52.156 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2024-09-12T00:04:52.156 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.156 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.156 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.156 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 4, 2024-09-12T00:04:52.156 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "0b4e8ec4-cb09-4c05-9ddb-fe1e664e8f03", 2024-09-12T00:04:52.156 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2024-09-12T00:04:52.156 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2024-09-12T00:04:52.156 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2024-09-12T00:04:52.156 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2024-09-12T00:04:52.157 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 0, 2024-09-12T00:04:52.157 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 0, 2024-09-12T00:04:52.157 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 14, 2024-09-12T00:04:52.157 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 33, 2024-09-12T00:04:52.157 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 0, 2024-09-12T00:04:52.157 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2024-09-12T00:04:52.157 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2024-09-12T00:04:52.157 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.157 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.157 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.157 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6800", 2024-09-12T00:04:52.157 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2966848021 2024-09-12T00:04:52.157 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.158 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.158 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.158 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6801", 2024-09-12T00:04:52.158 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2966848021 2024-09-12T00:04:52.158 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.158 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.158 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2024-09-12T00:04:52.158 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.158 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.158 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.158 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6802", 2024-09-12T00:04:52.158 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2966848021 2024-09-12T00:04:52.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.159 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.159 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6803", 2024-09-12T00:04:52.159 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2966848021 2024-09-12T00:04:52.159 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.159 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.159 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2024-09-12T00:04:52.159 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.159 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.159 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6806", 2024-09-12T00:04:52.159 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2966848021 2024-09-12T00:04:52.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.160 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.160 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.160 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6807", 2024-09-12T00:04:52.160 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2966848021 2024-09-12T00:04:52.160 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.160 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.160 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2024-09-12T00:04:52.160 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.160 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.160 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.160 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6804", 2024-09-12T00:04:52.161 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2966848021 2024-09-12T00:04:52.161 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.161 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.161 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.161 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6805", 2024-09-12T00:04:52.161 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2966848021 2024-09-12T00:04:52.161 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.161 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.161 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.161 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.135:6801/2966848021", 2024-09-12T00:04:52.161 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.135:6803/2966848021", 2024-09-12T00:04:52.161 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.135:6807/2966848021", 2024-09-12T00:04:52.161 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.135:6805/2966848021", 2024-09-12T00:04:52.162 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2024-09-12T00:04:52.162 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2024-09-12T00:04:52.162 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2024-09-12T00:04:52.162 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.162 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.162 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.162 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 5, 2024-09-12T00:04:52.162 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "44796deb-5225-490a-a526-e0be07036b8d", 2024-09-12T00:04:52.162 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2024-09-12T00:04:52.162 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2024-09-12T00:04:52.162 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2024-09-12T00:04:52.162 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2024-09-12T00:04:52.162 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 0, 2024-09-12T00:04:52.162 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 0, 2024-09-12T00:04:52.162 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 14, 2024-09-12T00:04:52.163 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 33, 2024-09-12T00:04:52.163 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 0, 2024-09-12T00:04:52.163 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2024-09-12T00:04:52.163 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2024-09-12T00:04:52.163 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.163 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.163 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.163 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6826", 2024-09-12T00:04:52.163 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3933885245 2024-09-12T00:04:52.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.163 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.163 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.163 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6827", 2024-09-12T00:04:52.164 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3933885245 2024-09-12T00:04:52.164 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.164 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.164 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2024-09-12T00:04:52.164 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.164 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.164 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6828", 2024-09-12T00:04:52.164 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3933885245 2024-09-12T00:04:52.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.164 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.165 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6829", 2024-09-12T00:04:52.165 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3933885245 2024-09-12T00:04:52.165 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.165 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.165 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2024-09-12T00:04:52.165 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.165 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.165 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.165 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6832", 2024-09-12T00:04:52.165 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3933885245 2024-09-12T00:04:52.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.165 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.166 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.166 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6833", 2024-09-12T00:04:52.166 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3933885245 2024-09-12T00:04:52.166 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.166 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.166 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.166 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2024-09-12T00:04:52.166 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.166 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.166 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.166 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6830", 2024-09-12T00:04:52.166 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3933885245 2024-09-12T00:04:52.166 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.166 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.167 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.167 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6831", 2024-09-12T00:04:52.167 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3933885245 2024-09-12T00:04:52.167 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.167 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.167 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.167 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.135:6827/3933885245", 2024-09-12T00:04:52.167 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.135:6829/3933885245", 2024-09-12T00:04:52.167 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.135:6833/3933885245", 2024-09-12T00:04:52.167 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.135:6831/3933885245", 2024-09-12T00:04:52.167 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2024-09-12T00:04:52.167 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2024-09-12T00:04:52.167 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2024-09-12T00:04:52.167 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.168 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.168 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.168 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 6, 2024-09-12T00:04:52.168 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "cecfecf3-d6c7-44f3-9c08-259ae76571c7", 2024-09-12T00:04:52.168 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2024-09-12T00:04:52.168 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2024-09-12T00:04:52.168 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2024-09-12T00:04:52.168 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2024-09-12T00:04:52.168 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 0, 2024-09-12T00:04:52.168 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 0, 2024-09-12T00:04:52.168 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 14, 2024-09-12T00:04:52.168 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 33, 2024-09-12T00:04:52.168 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 0, 2024-09-12T00:04:52.169 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2024-09-12T00:04:52.169 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2024-09-12T00:04:52.169 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.169 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.169 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.169 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6816", 2024-09-12T00:04:52.169 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 951791611 2024-09-12T00:04:52.169 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.169 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.169 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.169 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6817", 2024-09-12T00:04:52.169 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 951791611 2024-09-12T00:04:52.169 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.170 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.170 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.170 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2024-09-12T00:04:52.170 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.170 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.170 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.170 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6818", 2024-09-12T00:04:52.170 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 951791611 2024-09-12T00:04:52.170 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.170 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.170 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.170 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6819", 2024-09-12T00:04:52.170 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 951791611 2024-09-12T00:04:52.171 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.171 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.171 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.171 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2024-09-12T00:04:52.171 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.171 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.171 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.171 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6822", 2024-09-12T00:04:52.171 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 951791611 2024-09-12T00:04:52.171 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.171 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.171 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.171 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6823", 2024-09-12T00:04:52.172 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 951791611 2024-09-12T00:04:52.172 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.172 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.172 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2024-09-12T00:04:52.172 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.172 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.172 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.172 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6820", 2024-09-12T00:04:52.172 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 951791611 2024-09-12T00:04:52.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.172 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.173 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.173 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6821", 2024-09-12T00:04:52.173 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 951791611 2024-09-12T00:04:52.173 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.173 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.173 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.173 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.135:6817/951791611", 2024-09-12T00:04:52.173 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.135:6819/951791611", 2024-09-12T00:04:52.173 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.135:6823/951791611", 2024-09-12T00:04:52.173 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.135:6821/951791611", 2024-09-12T00:04:52.173 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2024-09-12T00:04:52.173 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2024-09-12T00:04:52.173 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2024-09-12T00:04:52.173 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.174 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.174 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.174 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 7, 2024-09-12T00:04:52.174 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "df0b245a-9a80-4038-8e00-4931eaee68c6", 2024-09-12T00:04:52.174 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2024-09-12T00:04:52.174 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2024-09-12T00:04:52.174 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2024-09-12T00:04:52.174 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2024-09-12T00:04:52.174 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 0, 2024-09-12T00:04:52.174 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 0, 2024-09-12T00:04:52.175 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 14, 2024-09-12T00:04:52.175 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 33, 2024-09-12T00:04:52.175 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 0, 2024-09-12T00:04:52.175 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2024-09-12T00:04:52.175 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2024-09-12T00:04:52.175 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.175 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.175 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.175 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6808", 2024-09-12T00:04:52.175 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3316717279 2024-09-12T00:04:52.175 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.175 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.175 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.176 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6809", 2024-09-12T00:04:52.176 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3316717279 2024-09-12T00:04:52.176 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.176 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.176 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.176 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2024-09-12T00:04:52.176 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.176 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.176 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.176 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6810", 2024-09-12T00:04:52.176 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3316717279 2024-09-12T00:04:52.176 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.176 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.177 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.177 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6811", 2024-09-12T00:04:52.177 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3316717279 2024-09-12T00:04:52.177 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.177 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.177 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.177 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2024-09-12T00:04:52.177 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.177 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.178 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.178 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6814", 2024-09-12T00:04:52.178 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3316717279 2024-09-12T00:04:52.178 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.178 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.178 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.178 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6815", 2024-09-12T00:04:52.178 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3316717279 2024-09-12T00:04:52.178 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.178 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.178 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.178 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2024-09-12T00:04:52.178 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T00:04:52.178 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.179 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T00:04:52.179 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6812", 2024-09-12T00:04:52.179 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3316717279 2024-09-12T00:04:52.179 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.179 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.179 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T00:04:52.179 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.135:6813", 2024-09-12T00:04:52.179 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3316717279 2024-09-12T00:04:52.179 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.179 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.179 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.179 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.135:6809/3316717279", 2024-09-12T00:04:52.179 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.135:6811/3316717279", 2024-09-12T00:04:52.180 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.135:6815/3316717279", 2024-09-12T00:04:52.180 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.135:6813/3316717279", 2024-09-12T00:04:52.180 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2024-09-12T00:04:52.180 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2024-09-12T00:04:52.180 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2024-09-12T00:04:52.180 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.180 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.180 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T00:04:52.180 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_xinfo": [ 2024-09-12T00:04:52.180 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.180 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 0, 2024-09-12T00:04:52.180 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2024-09-12T00:04:52.180 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2024-09-12T00:04:52.180 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2024-09-12T00:04:52.181 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540719139924082687, 2024-09-12T00:04:52.181 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2024-09-12T00:04:52.181 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2024-09-12T00:03:06.137315+0000", 2024-09-12T00:04:52.181 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 0 2024-09-12T00:04:52.181 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.181 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.181 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 1, 2024-09-12T00:04:52.181 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2024-09-12T00:04:52.181 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2024-09-12T00:04:52.181 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2024-09-12T00:04:52.181 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540719139924082687, 2024-09-12T00:04:52.181 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2024-09-12T00:04:52.181 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2024-09-12T00:03:05.222776+0000", 2024-09-12T00:04:52.182 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 0 2024-09-12T00:04:52.182 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.182 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.182 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 2, 2024-09-12T00:04:52.182 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2024-09-12T00:04:52.182 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2024-09-12T00:04:52.182 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2024-09-12T00:04:52.182 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540719139924082687, 2024-09-12T00:04:52.182 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2024-09-12T00:04:52.182 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2024-09-12T00:03:05.477878+0000", 2024-09-12T00:04:52.182 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 0 2024-09-12T00:04:52.182 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.182 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.182 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 3, 2024-09-12T00:04:52.183 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2024-09-12T00:04:52.183 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2024-09-12T00:04:52.183 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2024-09-12T00:04:52.183 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540719139924082687, 2024-09-12T00:04:52.183 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2024-09-12T00:04:52.183 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2024-09-12T00:03:05.530174+0000", 2024-09-12T00:04:52.183 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 0 2024-09-12T00:04:52.183 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.183 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.183 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 4, 2024-09-12T00:04:52.183 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2024-09-12T00:04:52.183 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2024-09-12T00:04:52.183 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2024-09-12T00:04:52.183 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540719139924082687, 2024-09-12T00:04:52.184 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2024-09-12T00:04:52.184 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2024-09-12T00:03:04.779952+0000", 2024-09-12T00:04:52.184 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 0 2024-09-12T00:04:52.184 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.184 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.184 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 5, 2024-09-12T00:04:52.184 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2024-09-12T00:04:52.184 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2024-09-12T00:04:52.184 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2024-09-12T00:04:52.184 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540719139924082687, 2024-09-12T00:04:52.184 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2024-09-12T00:04:52.184 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2024-09-12T00:03:05.847174+0000", 2024-09-12T00:04:52.184 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 0 2024-09-12T00:04:52.185 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.185 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.185 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 6, 2024-09-12T00:04:52.185 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2024-09-12T00:04:52.185 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2024-09-12T00:04:52.185 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2024-09-12T00:04:52.185 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540719139924082687, 2024-09-12T00:04:52.185 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2024-09-12T00:04:52.185 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2024-09-12T00:03:05.445765+0000", 2024-09-12T00:04:52.185 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 0 2024-09-12T00:04:52.185 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.185 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.185 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 7, 2024-09-12T00:04:52.185 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2024-09-12T00:04:52.186 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2024-09-12T00:04:52.186 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2024-09-12T00:04:52.186 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540719139924082687, 2024-09-12T00:04:52.186 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2024-09-12T00:04:52.186 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2024-09-12T00:03:05.572805+0000", 2024-09-12T00:04:52.186 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 0 2024-09-12T00:04:52.186 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.186 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T00:04:52.186 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_upmap": [], 2024-09-12T00:04:52.186 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_upmap_items": [ 2024-09-12T00:04:52.186 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.186 INFO:teuthology.orchestra.run.smithi019.stdout: "pgid": "3.13", 2024-09-12T00:04:52.186 INFO:teuthology.orchestra.run.smithi019.stdout: "mappings": [ 2024-09-12T00:04:52.186 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.187 INFO:teuthology.orchestra.run.smithi019.stdout: "from": 0, 2024-09-12T00:04:52.187 INFO:teuthology.orchestra.run.smithi019.stdout: "to": 7 2024-09-12T00:04:52.187 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.187 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.187 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.187 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T00:04:52.187 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_upmap_primaries": [], 2024-09-12T00:04:52.187 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_temp": [], 2024-09-12T00:04:52.187 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_temp": [], 2024-09-12T00:04:52.187 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklist": {}, 2024-09-12T00:04:52.187 INFO:teuthology.orchestra.run.smithi019.stdout: "range_blocklist": {}, 2024-09-12T00:04:52.187 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profiles": { 2024-09-12T00:04:52.187 INFO:teuthology.orchestra.run.smithi019.stdout: "default": { 2024-09-12T00:04:52.188 INFO:teuthology.orchestra.run.smithi019.stdout: "crush-failure-domain": "osd", 2024-09-12T00:04:52.188 INFO:teuthology.orchestra.run.smithi019.stdout: "k": "2", 2024-09-12T00:04:52.188 INFO:teuthology.orchestra.run.smithi019.stdout: "m": "1", 2024-09-12T00:04:52.188 INFO:teuthology.orchestra.run.smithi019.stdout: "plugin": "jerasure", 2024-09-12T00:04:52.188 INFO:teuthology.orchestra.run.smithi019.stdout: "technique": "reed_sol_van" 2024-09-12T00:04:52.188 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.188 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps_queue": [], 2024-09-12T00:04:52.188 INFO:teuthology.orchestra.run.smithi019.stdout: "new_removed_snaps": [], 2024-09-12T00:04:52.188 INFO:teuthology.orchestra.run.smithi019.stdout: "new_purged_snaps": [], 2024-09-12T00:04:52.188 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_node_flags": {}, 2024-09-12T00:04:52.188 INFO:teuthology.orchestra.run.smithi019.stdout: "device_class_flags": {}, 2024-09-12T00:04:52.188 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_mode": { 2024-09-12T00:04:52.189 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_mode_enabled": false, 2024-09-12T00:04:52.189 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_bucket_count": 0, 2024-09-12T00:04:52.189 INFO:teuthology.orchestra.run.smithi019.stdout: "degraded_stretch_mode": 0, 2024-09-12T00:04:52.189 INFO:teuthology.orchestra.run.smithi019.stdout: "recovering_stretch_mode": 0, 2024-09-12T00:04:52.189 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_mode_bucket": 0 2024-09-12T00:04:52.189 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.189 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:52.192 INFO:tasks.thrashosds.thrasher:j is {'epoch': 64, 'fsid': 'e8cc2cf2-4ebe-41fb-ac6a-f09b6fd34589', 'created': '2024-09-12T00:02:55.594166+0000', 'modified': '2024-09-12T00:04:49.555133+0000', 'last_up_change': '2024-09-12T00:03:08.456127+0000', 'last_in_change': '2024-09-12T00:02:58.648554+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T00:03:10.418576+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T00:03:14.745863+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'default.rgw.buckets.data', 'create_time': '2024-09-12T00:03:22.360758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'default.rgw.buckets.index', 'create_time': '2024-09-12T00:03:23.944957+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': '.rgw.root', 'create_time': '2024-09-12T00:03:25.559276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'default.rgw.log', 'create_time': '2024-09-12T00:03:27.471761+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'default.rgw.control', 'create_time': '2024-09-12T00:03:29.369053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'default.rgw.meta', 'create_time': '2024-09-12T00:03:31.499978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'af1b1898-c45f-43f5-b9c5-26e491625211', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6808', 'nonce': 846638970}, {'type': 'v1', 'addr': '172.21.15.19:6809', 'nonce': 846638970}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6810', 'nonce': 846638970}, {'type': 'v1', 'addr': '172.21.15.19:6811', 'nonce': 846638970}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6814', 'nonce': 846638970}, {'type': 'v1', 'addr': '172.21.15.19:6815', 'nonce': 846638970}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6812', 'nonce': 846638970}, {'type': 'v1', 'addr': '172.21.15.19:6813', 'nonce': 846638970}]}, 'public_addr': '172.21.15.19:6809/846638970', 'cluster_addr': '172.21.15.19:6811/846638970', 'heartbeat_back_addr': '172.21.15.19:6815/846638970', 'heartbeat_front_addr': '172.21.15.19:6813/846638970', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'fe1aa63d-8e57-4163-98a5-0131e1a60680', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6800', 'nonce': 889703096}, {'type': 'v1', 'addr': '172.21.15.19:6801', 'nonce': 889703096}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6802', 'nonce': 889703096}, {'type': 'v1', 'addr': '172.21.15.19:6803', 'nonce': 889703096}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6806', 'nonce': 889703096}, {'type': 'v1', 'addr': '172.21.15.19:6807', 'nonce': 889703096}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6804', 'nonce': 889703096}, {'type': 'v1', 'addr': '172.21.15.19:6805', 'nonce': 889703096}]}, 'public_addr': '172.21.15.19:6801/889703096', 'cluster_addr': '172.21.15.19:6803/889703096', 'heartbeat_back_addr': '172.21.15.19:6807/889703096', 'heartbeat_front_addr': '172.21.15.19:6805/889703096', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '1c97c435-1516-46e1-8fb9-fab9d7419774', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6816', 'nonce': 1847757189}, {'type': 'v1', 'addr': '172.21.15.19:6817', 'nonce': 1847757189}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6818', 'nonce': 1847757189}, {'type': 'v1', 'addr': '172.21.15.19:6819', 'nonce': 1847757189}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6822', 'nonce': 1847757189}, {'type': 'v1', 'addr': '172.21.15.19:6823', 'nonce': 1847757189}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6820', 'nonce': 1847757189}, {'type': 'v1', 'addr': '172.21.15.19:6821', 'nonce': 1847757189}]}, 'public_addr': '172.21.15.19:6817/1847757189', 'cluster_addr': '172.21.15.19:6819/1847757189', 'heartbeat_back_addr': '172.21.15.19:6823/1847757189', 'heartbeat_front_addr': '172.21.15.19:6821/1847757189', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '30dc8f77-54f0-4e5a-8adc-3ef4b1c08f71', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 42, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6824', 'nonce': 2630062148}, {'type': 'v1', 'addr': '172.21.15.19:6825', 'nonce': 2630062148}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6826', 'nonce': 2630062148}, {'type': 'v1', 'addr': '172.21.15.19:6827', 'nonce': 2630062148}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6830', 'nonce': 2630062148}, {'type': 'v1', 'addr': '172.21.15.19:6831', 'nonce': 2630062148}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6828', 'nonce': 2630062148}, {'type': 'v1', 'addr': '172.21.15.19:6829', 'nonce': 2630062148}]}, 'public_addr': '172.21.15.19:6825/2630062148', 'cluster_addr': '172.21.15.19:6827/2630062148', 'heartbeat_back_addr': '172.21.15.19:6831/2630062148', 'heartbeat_front_addr': '172.21.15.19:6829/2630062148', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '0b4e8ec4-cb09-4c05-9ddb-fe1e664e8f03', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6800', 'nonce': 2966848021}, {'type': 'v1', 'addr': '172.21.15.135:6801', 'nonce': 2966848021}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6802', 'nonce': 2966848021}, {'type': 'v1', 'addr': '172.21.15.135:6803', 'nonce': 2966848021}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6806', 'nonce': 2966848021}, {'type': 'v1', 'addr': '172.21.15.135:6807', 'nonce': 2966848021}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6804', 'nonce': 2966848021}, {'type': 'v1', 'addr': '172.21.15.135:6805', 'nonce': 2966848021}]}, 'public_addr': '172.21.15.135:6801/2966848021', 'cluster_addr': '172.21.15.135:6803/2966848021', 'heartbeat_back_addr': '172.21.15.135:6807/2966848021', 'heartbeat_front_addr': '172.21.15.135:6805/2966848021', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '44796deb-5225-490a-a526-e0be07036b8d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6826', 'nonce': 3933885245}, {'type': 'v1', 'addr': '172.21.15.135:6827', 'nonce': 3933885245}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6828', 'nonce': 3933885245}, {'type': 'v1', 'addr': '172.21.15.135:6829', 'nonce': 3933885245}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6832', 'nonce': 3933885245}, {'type': 'v1', 'addr': '172.21.15.135:6833', 'nonce': 3933885245}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6830', 'nonce': 3933885245}, {'type': 'v1', 'addr': '172.21.15.135:6831', 'nonce': 3933885245}]}, 'public_addr': '172.21.15.135:6827/3933885245', 'cluster_addr': '172.21.15.135:6829/3933885245', 'heartbeat_back_addr': '172.21.15.135:6833/3933885245', 'heartbeat_front_addr': '172.21.15.135:6831/3933885245', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'cecfecf3-d6c7-44f3-9c08-259ae76571c7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6816', 'nonce': 951791611}, {'type': 'v1', 'addr': '172.21.15.135:6817', 'nonce': 951791611}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6818', 'nonce': 951791611}, {'type': 'v1', 'addr': '172.21.15.135:6819', 'nonce': 951791611}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6822', 'nonce': 951791611}, {'type': 'v1', 'addr': '172.21.15.135:6823', 'nonce': 951791611}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6820', 'nonce': 951791611}, {'type': 'v1', 'addr': '172.21.15.135:6821', 'nonce': 951791611}]}, 'public_addr': '172.21.15.135:6817/951791611', 'cluster_addr': '172.21.15.135:6819/951791611', 'heartbeat_back_addr': '172.21.15.135:6823/951791611', 'heartbeat_front_addr': '172.21.15.135:6821/951791611', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'df0b245a-9a80-4038-8e00-4931eaee68c6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6808', 'nonce': 3316717279}, {'type': 'v1', 'addr': '172.21.15.135:6809', 'nonce': 3316717279}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6810', 'nonce': 3316717279}, {'type': 'v1', 'addr': '172.21.15.135:6811', 'nonce': 3316717279}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6814', 'nonce': 3316717279}, {'type': 'v1', 'addr': '172.21.15.135:6815', 'nonce': 3316717279}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6812', 'nonce': 3316717279}, {'type': 'v1', 'addr': '172.21.15.135:6813', 'nonce': 3316717279}]}, 'public_addr': '172.21.15.135:6809/3316717279', 'cluster_addr': '172.21.15.135:6811/3316717279', 'heartbeat_back_addr': '172.21.15.135:6815/3316717279', 'heartbeat_front_addr': '172.21.15.135:6813/3316717279', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T00:03:06.137315+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T00:03:05.222776+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T00:03:05.477878+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T00:03:05.530174+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T00:03:04.779952+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T00:03:05.847174+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T00:03:05.445765+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T00:03:05.572805+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '3.13', 'mappings': [{'from': 0, 'to': 7}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T00:04:52.192 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:04:52.193 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:52.193 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:52.193 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:52.193 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:52.193 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.193 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:52.194 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:52.194 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 100.67177974000001, 2024-09-12T00:04:52.194 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.278479906, 2024-09-12T00:04:52.194 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.194 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.194 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.194 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.194 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:52.194 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:52.194 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:04:52.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.194 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.194 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.194 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.195 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:52.195 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.195 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.195 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.195 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:52.195 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.195 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.195 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.195 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493422+0000", 2024-09-12T00:04:52.195 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.807e-06 2024-09-12T00:04:52.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.196 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.196 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.196 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493435+0000", 2024-09-12T00:04:52.196 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.375e-05 2024-09-12T00:04:52.196 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.196 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.196 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.196 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493457+0000", 2024-09-12T00:04:52.196 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2166000000000001e-05 2024-09-12T00:04:52.196 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.196 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.196 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.196 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493475+0000", 2024-09-12T00:04:52.197 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7184e-05 2024-09-12T00:04:52.197 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.197 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.197 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.197 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493617+0000", 2024-09-12T00:04:52.197 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014274200000000001 2024-09-12T00:04:52.197 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.197 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.197 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:52.197 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493632+0000", 2024-09-12T00:04:52.197 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4293e-05 2024-09-12T00:04:52.197 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.197 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.198 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.198 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.768657+0000", 2024-09-12T00:04:52.198 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.27502575400000001 2024-09-12T00:04:52.198 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.198 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.198 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.198 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769042+0000", 2024-09-12T00:04:52.198 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00038463700000000001 2024-09-12T00:04:52.198 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.198 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.198 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:52.198 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769430+0000", 2024-09-12T00:04:52.198 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000388014 2024-09-12T00:04:52.198 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.199 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.199 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.199 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.770784+0000", 2024-09-12T00:04:52.199 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00135402 2024-09-12T00:04:52.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.199 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.199 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.199 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771735+0000", 2024-09-12T00:04:52.199 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00095068599999999996 2024-09-12T00:04:52.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.199 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.199 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.199 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771828+0000", 2024-09-12T00:04:52.200 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3468999999999996e-05 2024-09-12T00:04:52.200 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.200 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.200 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.200 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771899+0000", 2024-09-12T00:04:52.200 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0383999999999996e-05 2024-09-12T00:04:52.200 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.200 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.200 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.200 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.200 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.200 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:52.200 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:52.200 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 100.243284669, 2024-09-12T00:04:52.201 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017189138999999999, 2024-09-12T00:04:52.201 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.201 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.201 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.201 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.201 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:52.201 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:52.201 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 48 2024-09-12T00:04:52.201 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.201 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.201 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.201 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.201 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:52.202 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.202 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.202 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.202 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.202 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:52.202 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.202 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.202 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.202 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.202 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:52.202 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7399999999999998e-07 2024-09-12T00:04:52.202 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.202 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.202 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.203 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921918+0000", 2024-09-12T00:04:52.203 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6399999999999999e-06 2024-09-12T00:04:52.203 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.203 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.203 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.203 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921925+0000", 2024-09-12T00:04:52.203 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7190000000000004e-06 2024-09-12T00:04:52.203 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.203 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.203 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.203 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921931+0000", 2024-09-12T00:04:52.203 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2519999999999996e-06 2024-09-12T00:04:52.203 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.203 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.204 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.204 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933475+0000", 2024-09-12T00:04:52.204 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011543759000000001 2024-09-12T00:04:52.204 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.204 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.204 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.204 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933617+0000", 2024-09-12T00:04:52.204 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000142282 2024-09-12T00:04:52.204 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.204 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.204 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:52.204 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933860+0000", 2024-09-12T00:04:52.204 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024276199999999999 2024-09-12T00:04:52.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.205 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.205 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.205 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937933+0000", 2024-09-12T00:04:52.205 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040734680000000002 2024-09-12T00:04:52.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.205 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.205 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.205 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938955+0000", 2024-09-12T00:04:52.205 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001021987 2024-09-12T00:04:52.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.205 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.205 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.205 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939038+0000", 2024-09-12T00:04:52.205 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2449999999999998e-05 2024-09-12T00:04:52.206 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.206 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.206 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.206 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939103+0000", 2024-09-12T00:04:52.206 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5345999999999994e-05 2024-09-12T00:04:52.206 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.206 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.206 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.206 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.206 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.206 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:52.206 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:52.206 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 100.243259127, 2024-09-12T00:04:52.206 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018247975, 2024-09-12T00:04:52.207 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.207 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.207 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.207 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.207 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:52.207 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:52.207 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 49 2024-09-12T00:04:52.207 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.207 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.207 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.207 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.207 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:52.207 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.208 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.208 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.208 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.208 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:52.208 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.208 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.208 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.208 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.208 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921940+0000", 2024-09-12T00:04:52.208 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7e-07 2024-09-12T00:04:52.208 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.208 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.208 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.208 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921943+0000", 2024-09-12T00:04:52.209 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1889999999999999e-06 2024-09-12T00:04:52.209 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.209 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.209 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.209 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921952+0000", 2024-09-12T00:04:52.209 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0010000000000007e-06 2024-09-12T00:04:52.209 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.209 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.209 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.209 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921959+0000", 2024-09-12T00:04:52.209 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2570000000000001e-06 2024-09-12T00:04:52.209 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.209 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.209 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.210 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935333+0000", 2024-09-12T00:04:52.210 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013373368 2024-09-12T00:04:52.210 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.210 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.210 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.210 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935472+0000", 2024-09-12T00:04:52.210 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013987900000000001 2024-09-12T00:04:52.210 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.210 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.210 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:52.210 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935700+0000", 2024-09-12T00:04:52.210 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000227922 2024-09-12T00:04:52.210 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.210 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.211 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.211 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939858+0000", 2024-09-12T00:04:52.211 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041571300000000002 2024-09-12T00:04:52.211 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.211 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.211 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.211 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940018+0000", 2024-09-12T00:04:52.211 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016060400000000001 2024-09-12T00:04:52.211 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.211 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.211 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.211 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940114+0000", 2024-09-12T00:04:52.211 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5692999999999993e-05 2024-09-12T00:04:52.211 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.212 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.212 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.212 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940187+0000", 2024-09-12T00:04:52.212 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3561999999999998e-05 2024-09-12T00:04:52.212 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.212 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.212 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.212 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.212 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.212 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:52.212 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:52.212 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 100.24321634, 2024-09-12T00:04:52.213 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021018614000000001, 2024-09-12T00:04:52.213 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.213 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.213 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.213 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.213 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:52.213 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:52.213 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 50 2024-09-12T00:04:52.213 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.213 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.213 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.213 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.213 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:52.213 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.214 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.214 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.214 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:52.214 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.214 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.214 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.214 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921983+0000", 2024-09-12T00:04:52.214 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4499999999999996e-07 2024-09-12T00:04:52.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.214 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.214 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.214 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922071+0000", 2024-09-12T00:04:52.215 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8010000000000006e-05 2024-09-12T00:04:52.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.215 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.215 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.215 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922084+0000", 2024-09-12T00:04:52.215 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3275000000000001e-05 2024-09-12T00:04:52.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.215 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.215 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.215 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922093+0000", 2024-09-12T00:04:52.215 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0580000000000004e-06 2024-09-12T00:04:52.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.215 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.216 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.216 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936515+0000", 2024-09-12T00:04:52.216 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014421270999999999 2024-09-12T00:04:52.216 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.216 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.216 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.216 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936677+0000", 2024-09-12T00:04:52.216 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162003 2024-09-12T00:04:52.216 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.216 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.216 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:52.216 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936908+0000", 2024-09-12T00:04:52.216 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023115700000000001 2024-09-12T00:04:52.216 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.217 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.217 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.217 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939985+0000", 2024-09-12T00:04:52.217 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030773879999999999 2024-09-12T00:04:52.217 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.217 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.217 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.217 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942623+0000", 2024-09-12T00:04:52.217 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026377929999999998 2024-09-12T00:04:52.217 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.217 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.217 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.218 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942818+0000", 2024-09-12T00:04:52.218 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019556200000000001 2024-09-12T00:04:52.218 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.218 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.218 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.218 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943001+0000", 2024-09-12T00:04:52.218 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018235199999999999 2024-09-12T00:04:52.218 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.218 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.218 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.218 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.218 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.218 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:52.218 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:52.219 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 100.243081948, 2024-09-12T00:04:52.219 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021092493, 2024-09-12T00:04:52.219 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.219 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.219 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.219 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.219 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:52.219 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:52.219 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 51 2024-09-12T00:04:52.219 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.219 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.219 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.219 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.220 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:52.220 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.220 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.220 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.220 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:52.220 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.220 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.220 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.220 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922118+0000", 2024-09-12T00:04:52.220 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0389999999999999e-06 2024-09-12T00:04:52.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.221 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.221 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.221 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922124+0000", 2024-09-12T00:04:52.221 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5409999999999997e-06 2024-09-12T00:04:52.221 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.221 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.221 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.221 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922136+0000", 2024-09-12T00:04:52.221 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.205e-05 2024-09-12T00:04:52.221 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.221 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.221 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.221 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922147+0000", 2024-09-12T00:04:52.222 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0451e-05 2024-09-12T00:04:52.222 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.222 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.222 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.222 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938000+0000", 2024-09-12T00:04:52.222 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015853682000000001 2024-09-12T00:04:52.222 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.222 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.222 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.222 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938142+0000", 2024-09-12T00:04:52.222 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014148899999999999 2024-09-12T00:04:52.222 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.222 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.223 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:52.223 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938362+0000", 2024-09-12T00:04:52.223 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022034800000000001 2024-09-12T00:04:52.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.223 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.223 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.223 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940330+0000", 2024-09-12T00:04:52.223 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001967459 2024-09-12T00:04:52.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.223 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.223 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.223 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943064+0000", 2024-09-12T00:04:52.223 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027346219999999999 2024-09-12T00:04:52.224 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.224 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.224 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.224 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943152+0000", 2024-09-12T00:04:52.224 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7563000000000002e-05 2024-09-12T00:04:52.224 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.224 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.224 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.224 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943209+0000", 2024-09-12T00:04:52.224 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7249e-05 2024-09-12T00:04:52.224 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.224 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.224 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.224 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.225 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.225 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:52.225 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:52.225 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 100.24303245500001, 2024-09-12T00:04:52.225 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021175616000000001, 2024-09-12T00:04:52.225 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.225 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.225 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.225 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.225 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:52.225 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:52.225 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 52 2024-09-12T00:04:52.225 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.226 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.226 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.226 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.226 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:52.226 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.226 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.226 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.226 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.226 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:52.226 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.226 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.226 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.226 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.226 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922167+0000", 2024-09-12T00:04:52.227 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3300000000000001e-07 2024-09-12T00:04:52.227 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.227 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.227 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.227 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922174+0000", 2024-09-12T00:04:52.227 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7070000000000003e-06 2024-09-12T00:04:52.227 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.227 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.227 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.227 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922184+0000", 2024-09-12T00:04:52.227 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682e-05 2024-09-12T00:04:52.227 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.228 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.228 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.228 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922195+0000", 2024-09-12T00:04:52.228 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0489000000000001e-05 2024-09-12T00:04:52.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.228 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.228 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.228 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939166+0000", 2024-09-12T00:04:52.228 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016971245999999999 2024-09-12T00:04:52.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.228 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.228 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.228 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939243+0000", 2024-09-12T00:04:52.229 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7201999999999997e-05 2024-09-12T00:04:52.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.229 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.229 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:52.229 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939381+0000", 2024-09-12T00:04:52.229 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013770699999999999 2024-09-12T00:04:52.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.229 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.229 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.229 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940923+0000", 2024-09-12T00:04:52.229 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001542302 2024-09-12T00:04:52.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.229 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.229 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.230 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943221+0000", 2024-09-12T00:04:52.230 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022979720000000001 2024-09-12T00:04:52.230 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.230 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.230 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.230 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943295+0000", 2024-09-12T00:04:52.230 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3317000000000003e-05 2024-09-12T00:04:52.230 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.230 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.230 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.230 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943342+0000", 2024-09-12T00:04:52.230 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7159e-05 2024-09-12T00:04:52.231 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.231 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.231 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.231 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.231 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.231 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:52.231 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:52.231 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 99.993974643000001, 2024-09-12T00:04:52.231 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020001835999999999, 2024-09-12T00:04:52.231 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.231 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.231 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.231 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.231 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:52.232 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:52.232 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 69 2024-09-12T00:04:52.232 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.232 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.232 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.232 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.232 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:52.232 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.232 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.232 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.232 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.232 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:52.232 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.232 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.233 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.233 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.233 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171225+0000", 2024-09-12T00:04:52.233 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0599999999999999e-07 2024-09-12T00:04:52.233 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.233 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.233 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.233 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171349+0000", 2024-09-12T00:04:52.233 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012407299999999999 2024-09-12T00:04:52.233 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.233 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.233 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.233 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171367+0000", 2024-09-12T00:04:52.233 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8413000000000001e-05 2024-09-12T00:04:52.234 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.234 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.234 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.234 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171376+0000", 2024-09-12T00:04:52.234 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8170000000000005e-06 2024-09-12T00:04:52.234 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.234 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.234 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.234 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177692+0000", 2024-09-12T00:04:52.234 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063156729999999999 2024-09-12T00:04:52.234 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.234 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.234 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.234 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177817+0000", 2024-09-12T00:04:52.235 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012581499999999999 2024-09-12T00:04:52.235 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.235 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.235 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:52.235 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.178015+0000", 2024-09-12T00:04:52.235 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019715100000000001 2024-09-12T00:04:52.235 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.235 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.235 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.235 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181798+0000", 2024-09-12T00:04:52.235 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003783308 2024-09-12T00:04:52.235 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.235 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.236 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.236 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190976+0000", 2024-09-12T00:04:52.236 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091776519999999997 2024-09-12T00:04:52.236 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.236 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.236 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.236 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191122+0000", 2024-09-12T00:04:52.236 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000145966 2024-09-12T00:04:52.236 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.236 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.236 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.236 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191226+0000", 2024-09-12T00:04:52.236 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104162 2024-09-12T00:04:52.237 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.237 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.237 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.237 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.237 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.237 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:52.237 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:52.237 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 99.993805907999999, 2024-09-12T00:04:52.237 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019997773, 2024-09-12T00:04:52.237 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.237 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.237 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.237 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.237 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:52.238 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:52.238 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 70 2024-09-12T00:04:52.238 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.238 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.238 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.238 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.238 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:52.238 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.238 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.238 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.238 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.238 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:52.238 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.239 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.239 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.239 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.239 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:52.239 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3699999999999999e-07 2024-09-12T00:04:52.239 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.239 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.239 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.239 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171403+0000", 2024-09-12T00:04:52.239 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6199999999999994e-06 2024-09-12T00:04:52.239 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.239 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.239 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.239 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171416+0000", 2024-09-12T00:04:52.240 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2636000000000001e-05 2024-09-12T00:04:52.240 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.240 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.240 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.240 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171423+0000", 2024-09-12T00:04:52.240 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5440000000000001e-06 2024-09-12T00:04:52.240 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.240 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.240 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.240 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179458+0000", 2024-09-12T00:04:52.240 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080351989999999998 2024-09-12T00:04:52.240 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.240 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.241 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.241 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179604+0000", 2024-09-12T00:04:52.241 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014519899999999999 2024-09-12T00:04:52.241 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.241 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.241 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:52.241 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179831+0000", 2024-09-12T00:04:52.241 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022704800000000001 2024-09-12T00:04:52.241 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.241 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.241 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.241 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181918+0000", 2024-09-12T00:04:52.241 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020873950000000001 2024-09-12T00:04:52.242 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.242 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.242 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.242 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191243+0000", 2024-09-12T00:04:52.242 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0093244729999999998 2024-09-12T00:04:52.242 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.242 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.242 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.242 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191309+0000", 2024-09-12T00:04:52.242 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6116000000000002e-05 2024-09-12T00:04:52.242 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.242 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.242 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.242 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191390+0000", 2024-09-12T00:04:52.243 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1705999999999993e-05 2024-09-12T00:04:52.243 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.243 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.243 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.243 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.243 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.243 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:52.243 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:52.243 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 99.993759835000006, 2024-09-12T00:04:52.243 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020263554, 2024-09-12T00:04:52.243 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.243 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.243 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.244 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.244 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:52.244 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:52.244 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 71 2024-09-12T00:04:52.244 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.244 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.244 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.244 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.244 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:52.244 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.244 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.244 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.244 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.244 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:52.245 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.245 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.245 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.245 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.245 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:52.245 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5000000000000002e-07 2024-09-12T00:04:52.245 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.245 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.245 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.245 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171454+0000", 2024-09-12T00:04:52.245 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5046e-05 2024-09-12T00:04:52.245 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.245 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.245 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.246 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171471+0000", 2024-09-12T00:04:52.246 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6923999999999999e-05 2024-09-12T00:04:52.246 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.246 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.246 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.246 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171487+0000", 2024-09-12T00:04:52.246 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5823000000000001e-05 2024-09-12T00:04:52.246 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.246 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.246 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.246 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180765+0000", 2024-09-12T00:04:52.246 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0092774399999999996 2024-09-12T00:04:52.246 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.247 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.247 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.247 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180900+0000", 2024-09-12T00:04:52.247 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013556700000000001 2024-09-12T00:04:52.247 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.247 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.247 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:52.247 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181108+0000", 2024-09-12T00:04:52.247 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020727899999999999 2024-09-12T00:04:52.247 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.247 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.247 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.247 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184725+0000", 2024-09-12T00:04:52.247 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036171340000000001 2024-09-12T00:04:52.248 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.248 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.248 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.248 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191413+0000", 2024-09-12T00:04:52.248 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066881830000000003 2024-09-12T00:04:52.248 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.248 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.248 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.248 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191540+0000", 2024-09-12T00:04:52.248 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000126823 2024-09-12T00:04:52.248 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.248 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.248 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.248 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191702+0000", 2024-09-12T00:04:52.249 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162585 2024-09-12T00:04:52.249 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.249 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.249 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.249 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.249 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.249 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:52.249 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:52.249 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 99.993681258999999, 2024-09-12T00:04:52.249 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020448573000000001, 2024-09-12T00:04:52.249 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.249 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.249 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.250 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.250 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:52.250 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:52.250 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 72 2024-09-12T00:04:52.250 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.250 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.250 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.250 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.250 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:52.250 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.250 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.250 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.250 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.250 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:52.251 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.251 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.251 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.251 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.251 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171518+0000", 2024-09-12T00:04:52.251 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0440000000000001e-06 2024-09-12T00:04:52.251 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.251 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.251 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.251 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171647+0000", 2024-09-12T00:04:52.251 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012912899999999999 2024-09-12T00:04:52.251 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.251 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.251 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.252 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171664+0000", 2024-09-12T00:04:52.252 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6079999999999999e-05 2024-09-12T00:04:52.252 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.252 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.252 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.252 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171675+0000", 2024-09-12T00:04:52.252 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1223000000000001e-05 2024-09-12T00:04:52.252 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.252 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.252 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.252 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182000+0000", 2024-09-12T00:04:52.252 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010324949 2024-09-12T00:04:52.252 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.253 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.253 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.253 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182178+0000", 2024-09-12T00:04:52.253 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017808799999999999 2024-09-12T00:04:52.253 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.253 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.253 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:52.253 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182402+0000", 2024-09-12T00:04:52.253 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022381199999999999 2024-09-12T00:04:52.253 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.253 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.253 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.253 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190935+0000", 2024-09-12T00:04:52.253 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085331560000000001 2024-09-12T00:04:52.254 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.254 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.254 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.254 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191728+0000", 2024-09-12T00:04:52.254 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079325700000000001 2024-09-12T00:04:52.254 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.254 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.254 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.254 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191864+0000", 2024-09-12T00:04:52.254 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013606299999999999 2024-09-12T00:04:52.254 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.254 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.254 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.255 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191966+0000", 2024-09-12T00:04:52.255 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101772 2024-09-12T00:04:52.255 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.255 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.255 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.255 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.255 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.255 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:52.255 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:52.255 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 99.993498063999994, 2024-09-12T00:04:52.255 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020675235, 2024-09-12T00:04:52.255 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.255 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.255 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.256 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.256 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:52.256 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:52.256 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 73 2024-09-12T00:04:52.256 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.256 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.256 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.256 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.256 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:52.256 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.256 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.256 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.256 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.257 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:52.257 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.257 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.257 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.257 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.257 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171701+0000", 2024-09-12T00:04:52.257 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0999999999999997e-07 2024-09-12T00:04:52.257 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.257 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.257 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.257 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171709+0000", 2024-09-12T00:04:52.257 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2540000000000003e-06 2024-09-12T00:04:52.257 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.258 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.258 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.258 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171724+0000", 2024-09-12T00:04:52.258 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5569e-05 2024-09-12T00:04:52.258 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.258 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.258 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.258 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171734+0000", 2024-09-12T00:04:52.258 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6139999999999998e-06 2024-09-12T00:04:52.258 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.258 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.258 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.258 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183774+0000", 2024-09-12T00:04:52.258 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012040444000000001 2024-09-12T00:04:52.259 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.259 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.259 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.259 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183896+0000", 2024-09-12T00:04:52.259 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012204199999999999 2024-09-12T00:04:52.259 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.259 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.259 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:52.259 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184084+0000", 2024-09-12T00:04:52.259 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018792599999999999 2024-09-12T00:04:52.259 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.259 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.259 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.259 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191984+0000", 2024-09-12T00:04:52.260 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079003790000000008 2024-09-12T00:04:52.260 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.260 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.260 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.260 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192093+0000", 2024-09-12T00:04:52.260 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000108942 2024-09-12T00:04:52.260 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.260 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.260 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.260 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192250+0000", 2024-09-12T00:04:52.260 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015637600000000001 2024-09-12T00:04:52.260 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.260 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.261 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.261 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192376+0000", 2024-09-12T00:04:52.261 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012587899999999999 2024-09-12T00:04:52.261 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.261 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.261 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.261 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.261 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.261 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:52.261 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:52.261 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 99.993449854000005, 2024-09-12T00:04:52.261 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021088828, 2024-09-12T00:04:52.261 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.261 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.262 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.262 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.262 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:52.262 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:52.262 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 74 2024-09-12T00:04:52.262 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.262 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.262 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.262 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.262 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:52.262 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.262 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.262 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.263 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.263 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:52.263 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.263 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.263 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.263 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.263 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:52.263 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1699999999999997e-07 2024-09-12T00:04:52.263 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.263 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.263 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.263 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171758+0000", 2024-09-12T00:04:52.263 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0860000000000008e-06 2024-09-12T00:04:52.263 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.264 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.264 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.264 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171774+0000", 2024-09-12T00:04:52.264 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:04:52.264 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.264 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.264 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.264 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171788+0000", 2024-09-12T00:04:52.264 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4793999999999999e-05 2024-09-12T00:04:52.264 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.264 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.264 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.264 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184842+0000", 2024-09-12T00:04:52.265 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013053607 2024-09-12T00:04:52.265 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.265 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.265 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.265 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185130+0000", 2024-09-12T00:04:52.265 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00028779199999999998 2024-09-12T00:04:52.265 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.265 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.265 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:52.265 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185378+0000", 2024-09-12T00:04:52.265 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024780100000000002 2024-09-12T00:04:52.265 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.265 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.266 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.266 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192513+0000", 2024-09-12T00:04:52.266 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071350770000000001 2024-09-12T00:04:52.266 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.266 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.266 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.266 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192690+0000", 2024-09-12T00:04:52.266 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000176892 2024-09-12T00:04:52.266 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.266 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.266 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.266 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192769+0000", 2024-09-12T00:04:52.266 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9466000000000001e-05 2024-09-12T00:04:52.266 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.267 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.267 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.267 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192837+0000", 2024-09-12T00:04:52.267 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8466000000000005e-05 2024-09-12T00:04:52.267 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.267 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.267 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.267 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.267 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.267 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:52.267 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:52.267 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 99.993397277, 2024-09-12T00:04:52.267 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.02121994, 2024-09-12T00:04:52.267 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.268 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.268 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.268 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.268 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:52.268 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:52.268 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 75 2024-09-12T00:04:52.268 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.268 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.268 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.268 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.268 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:52.268 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.268 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.269 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.269 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.269 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:52.269 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.269 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.269 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.269 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.269 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171802+0000", 2024-09-12T00:04:52.269 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5000000000000002e-07 2024-09-12T00:04:52.269 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.269 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.269 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.269 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171954+0000", 2024-09-12T00:04:52.269 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015215500000000001 2024-09-12T00:04:52.270 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.270 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.270 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.270 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171966+0000", 2024-09-12T00:04:52.270 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1548e-05 2024-09-12T00:04:52.270 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.270 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.270 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.270 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171970+0000", 2024-09-12T00:04:52.270 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8729999999999998e-06 2024-09-12T00:04:52.270 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.270 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.270 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.270 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186552+0000", 2024-09-12T00:04:52.271 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014581775 2024-09-12T00:04:52.271 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.271 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.271 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.271 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186702+0000", 2024-09-12T00:04:52.271 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014946 2024-09-12T00:04:52.271 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.271 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.271 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:52.271 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186897+0000", 2024-09-12T00:04:52.271 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000195071 2024-09-12T00:04:52.271 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.271 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.271 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.272 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192666+0000", 2024-09-12T00:04:52.272 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057693470000000002 2024-09-12T00:04:52.272 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.272 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.272 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.272 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192857+0000", 2024-09-12T00:04:52.272 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191149 2024-09-12T00:04:52.272 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.272 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.272 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.272 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192967+0000", 2024-09-12T00:04:52.272 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110202 2024-09-12T00:04:52.272 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.272 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.273 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.273 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193021+0000", 2024-09-12T00:04:52.273 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3709999999999999e-05 2024-09-12T00:04:52.273 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.273 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.273 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.273 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.273 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.273 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:52.273 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:52.273 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 99.993217982000004, 2024-09-12T00:04:52.273 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026297425999999999, 2024-09-12T00:04:52.273 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.273 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.274 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.274 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.274 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:52.274 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:52.274 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 76 2024-09-12T00:04:52.274 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.274 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.274 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.274 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.274 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:52.275 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.275 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.275 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.275 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:52.275 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.275 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.275 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.275 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:52.275 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9399999999999995e-07 2024-09-12T00:04:52.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.275 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.275 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.276 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171987+0000", 2024-09-12T00:04:52.276 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5230000000000003e-06 2024-09-12T00:04:52.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.276 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.276 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.276 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172005+0000", 2024-09-12T00:04:52.276 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8788e-05 2024-09-12T00:04:52.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.276 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.276 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.276 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172010+0000", 2024-09-12T00:04:52.276 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7570000000000004e-06 2024-09-12T00:04:52.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.276 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.277 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.277 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193104+0000", 2024-09-12T00:04:52.277 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021094112000000002 2024-09-12T00:04:52.277 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.277 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.277 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.277 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193334+0000", 2024-09-12T00:04:52.277 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000229855 2024-09-12T00:04:52.277 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.277 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.278 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:52.278 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193697+0000", 2024-09-12T00:04:52.278 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00036272399999999998 2024-09-12T00:04:52.278 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.278 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.278 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.278 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.195602+0000", 2024-09-12T00:04:52.278 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019049620000000001 2024-09-12T00:04:52.278 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.278 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.278 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.280 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198123+0000", 2024-09-12T00:04:52.280 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025216520000000001 2024-09-12T00:04:52.280 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.280 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.280 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.280 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198213+0000", 2024-09-12T00:04:52.281 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0008999999999998e-05 2024-09-12T00:04:52.281 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.281 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.281 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.281 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198278+0000", 2024-09-12T00:04:52.281 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4549999999999997e-05 2024-09-12T00:04:52.281 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.281 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.281 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.281 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.281 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.281 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1776 3.10 3:0ad809ca:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:52.281 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.002444+0000", 2024-09-12T00:04:52.281 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.162754920000001, 2024-09-12T00:04:52.282 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016768360999999999, 2024-09-12T00:04:52.282 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.282 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.282 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.282 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.282 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:52.282 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:52.282 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1776 2024-09-12T00:04:52.282 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.282 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.282 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.282 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.282 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.002444+0000", 2024-09-12T00:04:52.282 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.283 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.283 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.283 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.002444+0000", 2024-09-12T00:04:52.283 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.283 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.283 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.283 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.002446+0000", 2024-09-12T00:04:52.283 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5830000000000001e-06 2024-09-12T00:04:52.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.283 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.283 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.284 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003441+0000", 2024-09-12T00:04:52.284 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00099495500000000006 2024-09-12T00:04:52.284 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.284 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.284 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.284 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003468+0000", 2024-09-12T00:04:52.284 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6514000000000001e-05 2024-09-12T00:04:52.284 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.284 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.284 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.284 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003481+0000", 2024-09-12T00:04:52.284 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3016999999999999e-05 2024-09-12T00:04:52.284 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.284 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.285 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.285 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003556+0000", 2024-09-12T00:04:52.285 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5556999999999995e-05 2024-09-12T00:04:52.285 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.285 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.285 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.285 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003705+0000", 2024-09-12T00:04:52.285 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014846799999999999 2024-09-12T00:04:52.285 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.285 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.285 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:52.285 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003828+0000", 2024-09-12T00:04:52.285 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000123621 2024-09-12T00:04:52.285 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.286 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.286 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.286 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.013795+0000", 2024-09-12T00:04:52.286 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0099663170000000006 2024-09-12T00:04:52.286 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.286 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.286 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.286 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019048+0000", 2024-09-12T00:04:52.286 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052537729999999998 2024-09-12T00:04:52.286 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.286 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.286 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.286 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019126+0000", 2024-09-12T00:04:52.286 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7224999999999993e-05 2024-09-12T00:04:52.287 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.287 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.287 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.287 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019212+0000", 2024-09-12T00:04:52.287 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6330999999999997e-05 2024-09-12T00:04:52.287 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.287 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.287 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.287 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.287 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.287 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2646 3.37 3:ee59c452:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:52.287 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.142558+0000", 2024-09-12T00:04:52.287 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.0226405590000001, 2024-09-12T00:04:52.287 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018660066999999999, 2024-09-12T00:04:52.288 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.288 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.288 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.288 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.288 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:52.288 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:52.288 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2646 2024-09-12T00:04:52.288 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.288 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.288 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.288 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.288 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.142558+0000", 2024-09-12T00:04:52.288 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.289 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.289 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.289 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.142558+0000", 2024-09-12T00:04:52.289 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.289 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.289 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.289 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.142562+0000", 2024-09-12T00:04:52.289 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7950000000000001e-06 2024-09-12T00:04:52.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.289 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.289 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.289 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.144592+0000", 2024-09-12T00:04:52.290 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020297890000000002 2024-09-12T00:04:52.290 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.290 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.290 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.290 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.144609+0000", 2024-09-12T00:04:52.290 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7634000000000001e-05 2024-09-12T00:04:52.290 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.290 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.290 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.290 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.144619+0000", 2024-09-12T00:04:52.290 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3989999999999993e-06 2024-09-12T00:04:52.290 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.290 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.290 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.291 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.144703+0000", 2024-09-12T00:04:52.291 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4648000000000007e-05 2024-09-12T00:04:52.291 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.291 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.291 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.291 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.144837+0000", 2024-09-12T00:04:52.291 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000133709 2024-09-12T00:04:52.291 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.291 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.291 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:52.291 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.145006+0000", 2024-09-12T00:04:52.291 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000169073 2024-09-12T00:04:52.291 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.292 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.292 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.292 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.152562+0000", 2024-09-12T00:04:52.292 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075562399999999997 2024-09-12T00:04:52.292 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.292 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.292 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.292 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.161086+0000", 2024-09-12T00:04:52.292 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085240349999999993 2024-09-12T00:04:52.292 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.292 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.292 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.292 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.161158+0000", 2024-09-12T00:04:52.292 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1929999999999997e-05 2024-09-12T00:04:52.293 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.293 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.293 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.293 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.161218+0000", 2024-09-12T00:04:52.293 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9815000000000002e-05 2024-09-12T00:04:52.293 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.293 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.293 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.293 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.293 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.293 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2695 3.10 3:08f22abb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:52.293 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.555842+0000", 2024-09-12T00:04:52.293 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.6093569949999997, 2024-09-12T00:04:52.293 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017506441000000001, 2024-09-12T00:04:52.294 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.294 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.294 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.294 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.294 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:52.294 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:52.294 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2695 2024-09-12T00:04:52.294 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.294 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.294 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.294 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.294 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.555842+0000", 2024-09-12T00:04:52.294 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.294 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.295 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.295 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.295 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.555842+0000", 2024-09-12T00:04:52.295 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.295 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.295 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.295 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.295 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.555844+0000", 2024-09-12T00:04:52.295 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8430000000000001e-06 2024-09-12T00:04:52.295 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.295 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.295 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.295 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.558169+0000", 2024-09-12T00:04:52.295 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023244939999999999 2024-09-12T00:04:52.296 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.296 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.296 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.296 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.558191+0000", 2024-09-12T00:04:52.296 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2062e-05 2024-09-12T00:04:52.296 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.296 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.296 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.296 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.558201+0000", 2024-09-12T00:04:52.296 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.91e-06 2024-09-12T00:04:52.296 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.296 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.296 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.297 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.558276+0000", 2024-09-12T00:04:52.297 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5408999999999996e-05 2024-09-12T00:04:52.297 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.297 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.297 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.297 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.558445+0000", 2024-09-12T00:04:52.297 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000168326 2024-09-12T00:04:52.297 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.297 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.297 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:52.297 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.558554+0000", 2024-09-12T00:04:52.297 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000109274 2024-09-12T00:04:52.297 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.297 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.298 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.298 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.564596+0000", 2024-09-12T00:04:52.298 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0060426350000000002 2024-09-12T00:04:52.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.298 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.298 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.298 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.573228+0000", 2024-09-12T00:04:52.298 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0086312960000000001 2024-09-12T00:04:52.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.298 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.298 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.298 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.573296+0000", 2024-09-12T00:04:52.298 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8402e-05 2024-09-12T00:04:52.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.299 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.299 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.299 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.573348+0000", 2024-09-12T00:04:52.299 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1789999999999997e-05 2024-09-12T00:04:52.299 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.299 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.299 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.299 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.299 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2717 3.1a 3:5be58560:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:52.299 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.775712+0000", 2024-09-12T00:04:52.299 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.3894865450000005, 2024-09-12T00:04:52.299 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018214033000000001, 2024-09-12T00:04:52.300 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.300 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.300 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.300 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.300 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:52.300 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:52.300 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2717 2024-09-12T00:04:52.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.300 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.300 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.300 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.300 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.775712+0000", 2024-09-12T00:04:52.300 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.301 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.301 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.301 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.775712+0000", 2024-09-12T00:04:52.301 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.301 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.301 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.301 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.775715+0000", 2024-09-12T00:04:52.301 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.678e-06 2024-09-12T00:04:52.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.301 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.301 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.301 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.777487+0000", 2024-09-12T00:04:52.302 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001772657 2024-09-12T00:04:52.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.302 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.302 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.302 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.777511+0000", 2024-09-12T00:04:52.302 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3359000000000001e-05 2024-09-12T00:04:52.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.302 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.302 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.302 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.777521+0000", 2024-09-12T00:04:52.302 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0078000000000001e-05 2024-09-12T00:04:52.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.302 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.302 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.303 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.777608+0000", 2024-09-12T00:04:52.303 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7084999999999997e-05 2024-09-12T00:04:52.303 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.303 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.303 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.303 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.777800+0000", 2024-09-12T00:04:52.303 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000192299 2024-09-12T00:04:52.303 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.303 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.303 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:52.303 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.777984+0000", 2024-09-12T00:04:52.303 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018348099999999999 2024-09-12T00:04:52.303 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.303 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.304 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.304 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.791888+0000", 2024-09-12T00:04:52.304 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013904626999999999 2024-09-12T00:04:52.304 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.304 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.304 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.304 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.793860+0000", 2024-09-12T00:04:52.304 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019722339999999998 2024-09-12T00:04:52.304 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.304 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.304 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.304 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.793897+0000", 2024-09-12T00:04:52.304 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6384000000000003e-05 2024-09-12T00:04:52.304 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.305 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.305 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.305 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.793926+0000", 2024-09-12T00:04:52.305 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9150999999999999e-05 2024-09-12T00:04:52.305 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.305 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.305 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.305 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.305 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2761 3.1a 3:5b171b72:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:52.305 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.284447+0000", 2024-09-12T00:04:52.305 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 3.8807519049999999, 2024-09-12T00:04:52.305 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016409588999999999, 2024-09-12T00:04:52.305 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.306 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.306 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.306 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.306 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:52.306 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:52.306 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2761 2024-09-12T00:04:52.306 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.306 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.306 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.306 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.306 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.284447+0000", 2024-09-12T00:04:52.306 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.306 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.306 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.306 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.307 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.284447+0000", 2024-09-12T00:04:52.307 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.307 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.307 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.307 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.284450+0000", 2024-09-12T00:04:52.307 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5899999999999999e-06 2024-09-12T00:04:52.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.307 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.307 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.307 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.286501+0000", 2024-09-12T00:04:52.307 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020512199999999999 2024-09-12T00:04:52.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.308 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.308 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.308 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.286557+0000", 2024-09-12T00:04:52.308 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5721999999999999e-05 2024-09-12T00:04:52.308 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.308 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.308 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.308 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.286585+0000", 2024-09-12T00:04:52.308 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8274000000000001e-05 2024-09-12T00:04:52.308 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.308 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.308 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.308 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.286684+0000", 2024-09-12T00:04:52.308 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8894000000000006e-05 2024-09-12T00:04:52.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.309 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.309 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.309 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.286823+0000", 2024-09-12T00:04:52.309 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000138617 2024-09-12T00:04:52.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.309 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.309 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:52.309 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.286922+0000", 2024-09-12T00:04:52.309 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.9507999999999997e-05 2024-09-12T00:04:52.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.309 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.309 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.309 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.291710+0000", 2024-09-12T00:04:52.310 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047878850000000004 2024-09-12T00:04:52.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.310 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.310 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.310 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.300784+0000", 2024-09-12T00:04:52.310 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0090731879999999994 2024-09-12T00:04:52.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.310 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.310 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.310 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.300825+0000", 2024-09-12T00:04:52.310 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1418000000000002e-05 2024-09-12T00:04:52.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.310 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.310 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.311 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.300856+0000", 2024-09-12T00:04:52.311 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1272999999999997e-05 2024-09-12T00:04:52.311 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.311 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.311 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.311 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.311 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.311 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2763 3.1a 3:59bb7aeb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_248:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:52.311 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.315032+0000", 2024-09-12T00:04:52.311 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 3.8501660879999999, 2024-09-12T00:04:52.311 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018477223000000001, 2024-09-12T00:04:52.311 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.311 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.311 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.312 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.312 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:52.312 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:52.312 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2763 2024-09-12T00:04:52.312 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.312 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.312 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.312 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.312 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.315032+0000", 2024-09-12T00:04:52.312 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.312 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.312 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.312 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.312 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.315032+0000", 2024-09-12T00:04:52.313 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.313 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.313 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.313 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.313 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.315036+0000", 2024-09-12T00:04:52.313 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1669999999999999e-06 2024-09-12T00:04:52.313 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.313 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.313 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.313 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.317265+0000", 2024-09-12T00:04:52.313 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022292129999999999 2024-09-12T00:04:52.313 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.313 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.313 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.314 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.317308+0000", 2024-09-12T00:04:52.314 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3597000000000003e-05 2024-09-12T00:04:52.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.314 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.314 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.314 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.317331+0000", 2024-09-12T00:04:52.314 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2101999999999999e-05 2024-09-12T00:04:52.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.314 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.314 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.314 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.317552+0000", 2024-09-12T00:04:52.314 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000221189 2024-09-12T00:04:52.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.314 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.315 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.315 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.317751+0000", 2024-09-12T00:04:52.315 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019959599999999999 2024-09-12T00:04:52.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.315 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.315 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:52.315 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.317931+0000", 2024-09-12T00:04:52.315 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017935600000000001 2024-09-12T00:04:52.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.315 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.315 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.315 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.323667+0000", 2024-09-12T00:04:52.315 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057359739999999996 2024-09-12T00:04:52.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.316 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.316 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.316 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.333314+0000", 2024-09-12T00:04:52.316 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0096473759999999992 2024-09-12T00:04:52.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.316 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.316 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.316 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.333406+0000", 2024-09-12T00:04:52.316 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2164999999999996e-05 2024-09-12T00:04:52.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.316 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.316 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.316 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.333510+0000", 2024-09-12T00:04:52.316 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103488 2024-09-12T00:04:52.317 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.317 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.317 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.317 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.317 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.317 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:52.317 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:04:52.319 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:52.190+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:52.319 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:52.320+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:52.420 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:52.420+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:52.437 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:52.437 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:52.437 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:52.437 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:52.451 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:04:52.537 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:52.540+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:52.572 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T00:04:52.610 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:52.610 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:52.611 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:52.611 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:52.611 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:52.621 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:52.620+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:52.623 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:04:52.667 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:04:52.675 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T00:04:52.689 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-09-12T00:04:52.576260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1070219449,"num_objects":489,"num_object_clones":0,"num_object_copies":978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":489,"num_whiteouts":0,"num_read":2852,"num_read_kb":2532,"num_write":1495,"num_write_kb":1066784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2209,"ondisk_log_size":2209,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2108016,"kb_used_data":1866832,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":752866704,"statfs":{"total":773094113280,"available":770935504896,"internally_reserved":0,"allocated":1911635968,"data_stored":1908500958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":246795826},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1044438742,"num_objects":236,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":236,"num_whiteouts":0,"num_read":158,"num_read_kb":156,"num_write":288,"num_write_kb":1024063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.164695"},"pg_stats":[{"pgid":"3.3f","version":"63'3","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.346540+0000","last_change":"2024-09-12T00:03:23.604218+0000","last_active":"2024-09-12T00:04:47.346540+0000","last_peered":"2024-09-12T00:04:47.346540+0000","last_clean":"2024-09-12T00:04:47.346540+0000","last_became_active":"2024-09-12T00:03:23.603902+0000","last_became_peered":"2024-09-12T00:03:23.603902+0000","last_unstale":"2024-09-12T00:04:47.346540+0000","last_undegraded":"2024-09-12T00:04:47.346540+0000","last_fullsized":"2024-09-12T00:04:47.346540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:35.848041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":85,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.557729+0000","last_change":"2024-09-12T00:03:25.337244+0000","last_active":"2024-09-12T00:04:46.557729+0000","last_peered":"2024-09-12T00:04:46.557729+0000","last_clean":"2024-09-12T00:04:46.557729+0000","last_became_active":"2024-09-12T00:03:25.335964+0000","last_became_peered":"2024-09-12T00:03:25.335964+0000","last_unstale":"2024-09-12T00:04:46.557729+0000","last_undegraded":"2024-09-12T00:04:46.557729+0000","last_fullsized":"2024-09-12T00:04:46.557729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"63'5","reported_seq":93,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.749568+0000","last_change":"2024-09-12T00:03:23.628328+0000","last_active":"2024-09-12T00:04:47.749568+0000","last_peered":"2024-09-12T00:04:47.749568+0000","last_clean":"2024-09-12T00:04:47.749568+0000","last_became_active":"2024-09-12T00:03:23.627630+0000","last_became_peered":"2024-09-12T00:03:23.627630+0000","last_unstale":"2024-09-12T00:04:47.749568+0000","last_undegraded":"2024-09-12T00:04:47.749568+0000","last_fullsized":"2024-09-12T00:04:47.749568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:00.573006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":85,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.572903+0000","last_change":"2024-09-12T00:03:25.338343+0000","last_active":"2024-09-12T00:04:46.572903+0000","last_peered":"2024-09-12T00:04:46.572903+0000","last_clean":"2024-09-12T00:04:46.572903+0000","last_became_active":"2024-09-12T00:03:25.337994+0000","last_became_peered":"2024-09-12T00:03:25.337994+0000","last_unstale":"2024-09-12T00:04:46.572903+0000","last_undegraded":"2024-09-12T00:04:46.572903+0000","last_fullsized":"2024-09-12T00:04:46.572903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:39.689763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"63'8","reported_seq":96,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.571516+0000","last_change":"2024-09-12T00:03:23.626533+0000","last_active":"2024-09-12T00:04:47.571516+0000","last_peered":"2024-09-12T00:04:47.571516+0000","last_clean":"2024-09-12T00:04:47.571516+0000","last_became_active":"2024-09-12T00:03:23.625728+0000","last_became_peered":"2024-09-12T00:03:23.625728+0000","last_unstale":"2024-09-12T00:04:47.571516+0000","last_undegraded":"2024-09-12T00:04:47.571516+0000","last_fullsized":"2024-09-12T00:04:47.571516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:31.772442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"59'2","reported_seq":93,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.573327+0000","last_change":"2024-09-12T00:03:25.336667+0000","last_active":"2024-09-12T00:04:46.573327+0000","last_peered":"2024-09-12T00:04:46.573327+0000","last_clean":"2024-09-12T00:04:46.573327+0000","last_became_active":"2024-09-12T00:03:25.336327+0000","last_became_peered":"2024-09-12T00:03:25.336327+0000","last_unstale":"2024-09-12T00:04:46.573327+0000","last_undegraded":"2024-09-12T00:04:46.573327+0000","last_fullsized":"2024-09-12T00:04:46.573327+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:45.222842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"63'5","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.284475+0000","last_change":"2024-09-12T00:03:23.609828+0000","last_active":"2024-09-12T00:04:47.284475+0000","last_peered":"2024-09-12T00:04:47.284475+0000","last_clean":"2024-09-12T00:04:47.284475+0000","last_became_active":"2024-09-12T00:03:23.609326+0000","last_became_peered":"2024-09-12T00:03:23.609326+0000","last_unstale":"2024-09-12T00:04:47.284475+0000","last_undegraded":"2024-09-12T00:04:47.284475+0000","last_fullsized":"2024-09-12T00:04:47.284475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:25.491620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'8","reported_seq":105,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.588151+0000","last_change":"2024-09-12T00:03:25.339518+0000","last_active":"2024-09-12T00:04:46.588151+0000","last_peered":"2024-09-12T00:04:46.588151+0000","last_clean":"2024-09-12T00:04:46.588151+0000","last_became_active":"2024-09-12T00:03:25.338805+0000","last_became_peered":"2024-09-12T00:03:25.338805+0000","last_unstale":"2024-09-12T00:04:46.588151+0000","last_undegraded":"2024-09-12T00:04:46.588151+0000","last_fullsized":"2024-09-12T00:04:46.588151+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"63'5","reported_seq":94,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.014046+0000","last_change":"2024-09-12T00:03:23.633978+0000","last_active":"2024-09-12T00:04:48.014046+0000","last_peered":"2024-09-12T00:04:48.014046+0000","last_clean":"2024-09-12T00:04:48.014046+0000","last_became_active":"2024-09-12T00:03:23.633580+0000","last_became_peered":"2024-09-12T00:03:23.633580+0000","last_unstale":"2024-09-12T00:04:48.014046+0000","last_undegraded":"2024-09-12T00:04:48.014046+0000","last_fullsized":"2024-09-12T00:04:48.014046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:01.872688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"59'2","reported_seq":93,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574663+0000","last_change":"2024-09-12T00:03:25.324424+0000","last_active":"2024-09-12T00:04:46.574663+0000","last_peered":"2024-09-12T00:04:46.574663+0000","last_clean":"2024-09-12T00:04:46.574663+0000","last_became_active":"2024-09-12T00:03:25.324138+0000","last_became_peered":"2024-09-12T00:03:25.324138+0000","last_unstale":"2024-09-12T00:04:46.574663+0000","last_undegraded":"2024-09-12T00:04:46.574663+0000","last_fullsized":"2024-09-12T00:04:46.574663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:09.954252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"63'2","reported_seq":89,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.292057+0000","last_change":"2024-09-12T00:03:23.610136+0000","last_active":"2024-09-12T00:04:47.292057+0000","last_peered":"2024-09-12T00:04:47.292057+0000","last_clean":"2024-09-12T00:04:47.292057+0000","last_became_active":"2024-09-12T00:03:23.609509+0000","last_became_peered":"2024-09-12T00:03:23.609509+0000","last_unstale":"2024-09-12T00:04:47.292057+0000","last_undegraded":"2024-09-12T00:04:47.292057+0000","last_fullsized":"2024-09-12T00:04:47.292057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"59'8","reported_seq":118,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.575513+0000","last_change":"2024-09-12T00:03:25.355256+0000","last_active":"2024-09-12T00:04:46.575513+0000","last_peered":"2024-09-12T00:04:46.575513+0000","last_clean":"2024-09-12T00:04:46.575513+0000","last_became_active":"2024-09-12T00:03:25.355002+0000","last_became_peered":"2024-09-12T00:03:25.355002+0000","last_unstale":"2024-09-12T00:04:46.575513+0000","last_undegraded":"2024-09-12T00:04:46.575513+0000","last_fullsized":"2024-09-12T00:04:46.575513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:50.488869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"63'3","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.461107+0000","last_change":"2024-09-12T00:03:23.606780+0000","last_active":"2024-09-12T00:04:47.461107+0000","last_peered":"2024-09-12T00:04:47.461107+0000","last_clean":"2024-09-12T00:04:47.461107+0000","last_became_active":"2024-09-12T00:03:23.606143+0000","last_became_peered":"2024-09-12T00:03:23.606143+0000","last_unstale":"2024-09-12T00:04:47.461107+0000","last_undegraded":"2024-09-12T00:04:47.461107+0000","last_fullsized":"2024-09-12T00:04:47.461107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:22.889982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'2","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.604611+0000","last_change":"2024-09-12T00:03:25.330195+0000","last_active":"2024-09-12T00:04:46.604611+0000","last_peered":"2024-09-12T00:04:46.604611+0000","last_clean":"2024-09-12T00:04:46.604611+0000","last_became_active":"2024-09-12T00:03:25.329625+0000","last_became_peered":"2024-09-12T00:03:25.329625+0000","last_unstale":"2024-09-12T00:04:46.604611+0000","last_undegraded":"2024-09-12T00:04:46.604611+0000","last_fullsized":"2024-09-12T00:04:46.604611+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":88,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.559446+0000","last_change":"2024-09-12T00:03:23.626723+0000","last_active":"2024-09-12T00:04:46.559446+0000","last_peered":"2024-09-12T00:04:46.559446+0000","last_clean":"2024-09-12T00:04:46.559446+0000","last_became_active":"2024-09-12T00:03:23.626018+0000","last_became_peered":"2024-09-12T00:03:23.626018+0000","last_unstale":"2024-09-12T00:04:46.559446+0000","last_undegraded":"2024-09-12T00:04:46.559446+0000","last_fullsized":"2024-09-12T00:04:46.559446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"59'4","reported_seq":100,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.562139+0000","last_change":"2024-09-12T00:03:25.352418+0000","last_active":"2024-09-12T00:04:46.562139+0000","last_peered":"2024-09-12T00:04:46.562139+0000","last_clean":"2024-09-12T00:04:46.562139+0000","last_became_active":"2024-09-12T00:03:25.347902+0000","last_became_peered":"2024-09-12T00:03:25.347902+0000","last_unstale":"2024-09-12T00:04:46.562139+0000","last_undegraded":"2024-09-12T00:04:46.562139+0000","last_fullsized":"2024-09-12T00:04:46.562139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:29.611790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"59'2","reported_seq":93,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.572753+0000","last_change":"2024-09-12T00:03:25.321057+0000","last_active":"2024-09-12T00:04:46.572753+0000","last_peered":"2024-09-12T00:04:46.572753+0000","last_clean":"2024-09-12T00:04:46.572753+0000","last_became_active":"2024-09-12T00:03:25.320611+0000","last_became_peered":"2024-09-12T00:03:25.320611+0000","last_unstale":"2024-09-12T00:04:46.572753+0000","last_undegraded":"2024-09-12T00:04:46.572753+0000","last_fullsized":"2024-09-12T00:04:46.572753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:46.041829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"63'4","reported_seq":93,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.161162+0000","last_change":"2024-09-12T00:03:23.594170+0000","last_active":"2024-09-12T00:04:47.161162+0000","last_peered":"2024-09-12T00:04:47.161162+0000","last_clean":"2024-09-12T00:04:47.161162+0000","last_became_active":"2024-09-12T00:03:23.593880+0000","last_became_peered":"2024-09-12T00:03:23.593880+0000","last_unstale":"2024-09-12T00:04:47.161162+0000","last_undegraded":"2024-09-12T00:04:47.161162+0000","last_fullsized":"2024-09-12T00:04:47.161162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:33.234598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"59'2","reported_seq":93,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.575284+0000","last_change":"2024-09-12T00:03:25.334966+0000","last_active":"2024-09-12T00:04:46.575284+0000","last_peered":"2024-09-12T00:04:46.575284+0000","last_clean":"2024-09-12T00:04:46.575284+0000","last_became_active":"2024-09-12T00:03:25.334375+0000","last_became_peered":"2024-09-12T00:03:25.334375+0000","last_unstale":"2024-09-12T00:04:46.575284+0000","last_undegraded":"2024-09-12T00:04:46.575284+0000","last_fullsized":"2024-09-12T00:04:46.575284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:52.828056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"63'2","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.575702+0000","last_change":"2024-09-12T00:03:23.614289+0000","last_active":"2024-09-12T00:04:46.575702+0000","last_peered":"2024-09-12T00:04:46.575702+0000","last_clean":"2024-09-12T00:04:46.575702+0000","last_became_active":"2024-09-12T00:03:23.614019+0000","last_became_peered":"2024-09-12T00:03:23.614019+0000","last_unstale":"2024-09-12T00:04:46.575702+0000","last_undegraded":"2024-09-12T00:04:46.575702+0000","last_fullsized":"2024-09-12T00:04:46.575702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:00.847027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"59'10","reported_seq":116,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.559039+0000","last_change":"2024-09-12T00:03:25.357938+0000","last_active":"2024-09-12T00:04:46.559039+0000","last_peered":"2024-09-12T00:04:46.559039+0000","last_clean":"2024-09-12T00:04:46.559039+0000","last_became_active":"2024-09-12T00:03:25.357571+0000","last_became_peered":"2024-09-12T00:03:25.357571+0000","last_unstale":"2024-09-12T00:04:46.559039+0000","last_undegraded":"2024-09-12T00:04:46.559039+0000","last_fullsized":"2024-09-12T00:04:46.559039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:05.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"63'2","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.826049+0000","last_change":"2024-09-12T00:03:23.604162+0000","last_active":"2024-09-12T00:04:47.826049+0000","last_peered":"2024-09-12T00:04:47.826049+0000","last_clean":"2024-09-12T00:04:47.826049+0000","last_became_active":"2024-09-12T00:03:23.603466+0000","last_became_peered":"2024-09-12T00:03:23.603466+0000","last_unstale":"2024-09-12T00:04:47.826049+0000","last_undegraded":"2024-09-12T00:04:47.826049+0000","last_fullsized":"2024-09-12T00:04:47.826049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:50.482404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'8","reported_seq":121,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.635419+0000","last_change":"2024-09-12T00:03:25.345717+0000","last_active":"2024-09-12T00:04:48.635419+0000","last_peered":"2024-09-12T00:04:48.635419+0000","last_clean":"2024-09-12T00:04:48.635419+0000","last_became_active":"2024-09-12T00:03:25.344959+0000","last_became_peered":"2024-09-12T00:03:25.344959+0000","last_unstale":"2024-09-12T00:04:48.635419+0000","last_undegraded":"2024-09-12T00:04:48.635419+0000","last_fullsized":"2024-09-12T00:04:48.635419+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"63'2","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.575122+0000","last_change":"2024-09-12T00:03:23.602960+0000","last_active":"2024-09-12T00:04:46.575122+0000","last_peered":"2024-09-12T00:04:46.575122+0000","last_clean":"2024-09-12T00:04:46.575122+0000","last_became_active":"2024-09-12T00:03:23.602640+0000","last_became_peered":"2024-09-12T00:03:23.602640+0000","last_unstale":"2024-09-12T00:04:46.575122+0000","last_undegraded":"2024-09-12T00:04:46.575122+0000","last_fullsized":"2024-09-12T00:04:46.575122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"59'2","reported_seq":93,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.560215+0000","last_change":"2024-09-12T00:03:25.339888+0000","last_active":"2024-09-12T00:04:46.560215+0000","last_peered":"2024-09-12T00:04:46.560215+0000","last_clean":"2024-09-12T00:04:46.560215+0000","last_became_active":"2024-09-12T00:03:25.339092+0000","last_became_peered":"2024-09-12T00:03:25.339092+0000","last_unstale":"2024-09-12T00:04:46.560215+0000","last_undegraded":"2024-09-12T00:04:46.560215+0000","last_fullsized":"2024-09-12T00:04:46.560215+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:06.165291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"63'5","reported_seq":94,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.033514+0000","last_change":"2024-09-12T00:03:23.604732+0000","last_active":"2024-09-12T00:04:48.033514+0000","last_peered":"2024-09-12T00:04:48.033514+0000","last_clean":"2024-09-12T00:04:48.033514+0000","last_became_active":"2024-09-12T00:03:23.603932+0000","last_became_peered":"2024-09-12T00:03:23.603932+0000","last_unstale":"2024-09-12T00:04:48.033514+0000","last_undegraded":"2024-09-12T00:04:48.033514+0000","last_fullsized":"2024-09-12T00:04:48.033514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:14.913580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"63'2","reported_seq":94,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.637851+0000","last_change":"2024-09-12T00:03:25.341332+0000","last_active":"2024-09-12T00:04:48.637851+0000","last_peered":"2024-09-12T00:04:48.637851+0000","last_clean":"2024-09-12T00:04:48.637851+0000","last_became_active":"2024-09-12T00:03:25.340828+0000","last_became_peered":"2024-09-12T00:03:25.340828+0000","last_unstale":"2024-09-12T00:04:48.637851+0000","last_undegraded":"2024-09-12T00:04:48.637851+0000","last_fullsized":"2024-09-12T00:04:48.637851+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"62'2","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.562089+0000","last_change":"2024-09-12T00:03:23.602687+0000","last_active":"2024-09-12T00:04:46.562089+0000","last_peered":"2024-09-12T00:04:46.562089+0000","last_clean":"2024-09-12T00:04:46.562089+0000","last_became_active":"2024-09-12T00:03:23.601892+0000","last_became_peered":"2024-09-12T00:03:23.601892+0000","last_unstale":"2024-09-12T00:04:46.562089+0000","last_undegraded":"2024-09-12T00:04:46.562089+0000","last_fullsized":"2024-09-12T00:04:46.562089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":69,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574197+0000","last_change":"2024-09-12T00:03:33.354850+0000","last_active":"2024-09-12T00:04:46.574197+0000","last_peered":"2024-09-12T00:04:46.574197+0000","last_clean":"2024-09-12T00:04:46.574197+0000","last_became_active":"2024-09-12T00:03:33.351917+0000","last_became_peered":"2024-09-12T00:03:33.351917+0000","last_unstale":"2024-09-12T00:04:46.574197+0000","last_undegraded":"2024-09-12T00:04:46.574197+0000","last_fullsized":"2024-09-12T00:04:46.574197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:00.466863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"59'6","reported_seq":111,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.562901+0000","last_change":"2024-09-12T00:03:25.323174+0000","last_active":"2024-09-12T00:04:46.562901+0000","last_peered":"2024-09-12T00:04:46.562901+0000","last_clean":"2024-09-12T00:04:46.562901+0000","last_became_active":"2024-09-12T00:03:25.322456+0000","last_became_peered":"2024-09-12T00:03:25.322456+0000","last_unstale":"2024-09-12T00:04:46.562901+0000","last_undegraded":"2024-09-12T00:04:46.562901+0000","last_fullsized":"2024-09-12T00:04:46.562901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"63'6","reported_seq":101,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.596958+0000","last_change":"2024-09-12T00:04:01.825243+0000","last_active":"2024-09-12T00:04:47.596958+0000","last_peered":"2024-09-12T00:04:47.596958+0000","last_clean":"2024-09-12T00:04:47.596958+0000","last_became_active":"2024-09-12T00:04:01.824774+0000","last_became_peered":"2024-09-12T00:04:01.824774+0000","last_unstale":"2024-09-12T00:04:47.596958+0000","last_undegraded":"2024-09-12T00:04:47.596958+0000","last_fullsized":"2024-09-12T00:04:47.596958+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:53.932507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574946+0000","last_change":"2024-09-12T00:03:27.341305+0000","last_active":"2024-09-12T00:04:46.574946+0000","last_peered":"2024-09-12T00:04:46.574946+0000","last_clean":"2024-09-12T00:04:46.574946+0000","last_became_active":"2024-09-12T00:03:27.338132+0000","last_became_peered":"2024-09-12T00:03:27.338132+0000","last_unstale":"2024-09-12T00:04:46.574946+0000","last_undegraded":"2024-09-12T00:04:46.574946+0000","last_fullsized":"2024-09-12T00:04:46.574946+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:11.884824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"63'26","reported_seq":120,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.585669+0000","last_change":"2024-09-12T00:03:29.347224+0000","last_active":"2024-09-12T00:04:46.585669+0000","last_peered":"2024-09-12T00:04:46.585669+0000","last_clean":"2024-09-12T00:04:46.585669+0000","last_became_active":"2024-09-12T00:03:29.346662+0000","last_became_peered":"2024-09-12T00:03:29.346662+0000","last_unstale":"2024-09-12T00:04:46.585669+0000","last_undegraded":"2024-09-12T00:04:46.585669+0000","last_fullsized":"2024-09-12T00:04:46.585669+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:28.258932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":73,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.559587+0000","last_change":"2024-09-12T00:03:31.337219+0000","last_active":"2024-09-12T00:04:46.559587+0000","last_peered":"2024-09-12T00:04:46.559587+0000","last_clean":"2024-09-12T00:04:46.559587+0000","last_became_active":"2024-09-12T00:03:31.336317+0000","last_became_peered":"2024-09-12T00:03:31.336317+0000","last_unstale":"2024-09-12T00:04:46.559587+0000","last_undegraded":"2024-09-12T00:04:46.559587+0000","last_fullsized":"2024-09-12T00:04:46.559587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:50.954053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"63'36","reported_seq":118,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.633779+0000","last_change":"2024-09-12T00:03:33.376628+0000","last_active":"2024-09-12T00:04:48.633779+0000","last_peered":"2024-09-12T00:04:48.633779+0000","last_clean":"2024-09-12T00:04:48.633779+0000","last_became_active":"2024-09-12T00:03:33.375938+0000","last_became_peered":"2024-09-12T00:03:33.375938+0000","last_unstale":"2024-09-12T00:04:48.633779+0000","last_undegraded":"2024-09-12T00:04:48.633779+0000","last_fullsized":"2024-09-12T00:04:48.633779+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:31.105042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"63'4","reported_seq":102,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.638186+0000","last_change":"2024-09-12T00:03:25.326911+0000","last_active":"2024-09-12T00:04:48.638186+0000","last_peered":"2024-09-12T00:04:48.638186+0000","last_clean":"2024-09-12T00:04:48.638186+0000","last_became_active":"2024-09-12T00:03:25.326255+0000","last_became_peered":"2024-09-12T00:03:25.326255+0000","last_unstale":"2024-09-12T00:04:48.638186+0000","last_undegraded":"2024-09-12T00:04:48.638186+0000","last_fullsized":"2024-09-12T00:04:48.638186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:15.491636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"63'2","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.562541+0000","last_change":"2024-09-12T00:03:23.596266+0000","last_active":"2024-09-12T00:04:46.562541+0000","last_peered":"2024-09-12T00:04:46.562541+0000","last_clean":"2024-09-12T00:04:46.562541+0000","last_became_active":"2024-09-12T00:03:23.595480+0000","last_became_peered":"2024-09-12T00:03:23.595480+0000","last_unstale":"2024-09-12T00:04:46.562541+0000","last_undegraded":"2024-09-12T00:04:46.562541+0000","last_fullsized":"2024-09-12T00:04:46.562541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:25.491620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":79,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.585666+0000","last_change":"2024-09-12T00:03:27.336108+0000","last_active":"2024-09-12T00:04:46.585666+0000","last_peered":"2024-09-12T00:04:46.585666+0000","last_clean":"2024-09-12T00:04:46.585666+0000","last_became_active":"2024-09-12T00:03:27.335308+0000","last_became_peered":"2024-09-12T00:03:27.335308+0000","last_unstale":"2024-09-12T00:04:46.585666+0000","last_undegraded":"2024-09-12T00:04:46.585666+0000","last_fullsized":"2024-09-12T00:04:46.585666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:39.812803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'12","reported_seq":98,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.561765+0000","last_change":"2024-09-12T00:03:29.352496+0000","last_active":"2024-09-12T00:04:46.561765+0000","last_peered":"2024-09-12T00:04:46.561765+0000","last_clean":"2024-09-12T00:04:46.561765+0000","last_became_active":"2024-09-12T00:03:29.351783+0000","last_became_peered":"2024-09-12T00:03:29.351783+0000","last_unstale":"2024-09-12T00:04:46.561765+0000","last_undegraded":"2024-09-12T00:04:46.561765+0000","last_fullsized":"2024-09-12T00:04:46.561765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":73,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.559516+0000","last_change":"2024-09-12T00:03:31.350279+0000","last_active":"2024-09-12T00:04:46.559516+0000","last_peered":"2024-09-12T00:04:46.559516+0000","last_clean":"2024-09-12T00:04:46.559516+0000","last_became_active":"2024-09-12T00:03:31.349244+0000","last_became_peered":"2024-09-12T00:03:31.349244+0000","last_unstale":"2024-09-12T00:04:46.559516+0000","last_undegraded":"2024-09-12T00:04:46.559516+0000","last_fullsized":"2024-09-12T00:04:46.559516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.420974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":69,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.557413+0000","last_change":"2024-09-12T00:03:33.382726+0000","last_active":"2024-09-12T00:04:46.557413+0000","last_peered":"2024-09-12T00:04:46.557413+0000","last_clean":"2024-09-12T00:04:46.557413+0000","last_became_active":"2024-09-12T00:03:33.381875+0000","last_became_peered":"2024-09-12T00:03:33.381875+0000","last_unstale":"2024-09-12T00:04:46.557413+0000","last_undegraded":"2024-09-12T00:04:46.557413+0000","last_fullsized":"2024-09-12T00:04:46.557413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"63'12","reported_seq":123,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.638636+0000","last_change":"2024-09-12T00:03:25.357883+0000","last_active":"2024-09-12T00:04:48.638636+0000","last_peered":"2024-09-12T00:04:48.638636+0000","last_clean":"2024-09-12T00:04:48.638636+0000","last_became_active":"2024-09-12T00:03:25.355174+0000","last_became_peered":"2024-09-12T00:03:25.355174+0000","last_unstale":"2024-09-12T00:04:48.638636+0000","last_undegraded":"2024-09-12T00:04:48.638636+0000","last_fullsized":"2024-09-12T00:04:48.638636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:26.621650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"63'2","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.435046+0000","last_change":"2024-09-12T00:03:23.617603+0000","last_active":"2024-09-12T00:04:47.435046+0000","last_peered":"2024-09-12T00:04:47.435046+0000","last_clean":"2024-09-12T00:04:47.435046+0000","last_became_active":"2024-09-12T00:03:23.617317+0000","last_became_peered":"2024-09-12T00:03:23.617317+0000","last_unstale":"2024-09-12T00:04:47.435046+0000","last_undegraded":"2024-09-12T00:04:47.435046+0000","last_fullsized":"2024-09-12T00:04:47.435046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:36.997566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":79,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.586425+0000","last_change":"2024-09-12T00:03:27.347098+0000","last_active":"2024-09-12T00:04:46.586425+0000","last_peered":"2024-09-12T00:04:46.586425+0000","last_clean":"2024-09-12T00:04:46.586425+0000","last_became_active":"2024-09-12T00:03:27.346346+0000","last_became_peered":"2024-09-12T00:03:27.346346+0000","last_unstale":"2024-09-12T00:04:46.586425+0000","last_undegraded":"2024-09-12T00:04:46.586425+0000","last_fullsized":"2024-09-12T00:04:46.586425+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:56.250627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'22","reported_seq":114,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.585872+0000","last_change":"2024-09-12T00:03:29.357080+0000","last_active":"2024-09-12T00:04:46.585872+0000","last_peered":"2024-09-12T00:04:46.585872+0000","last_clean":"2024-09-12T00:04:46.585872+0000","last_became_active":"2024-09-12T00:03:29.356262+0000","last_became_peered":"2024-09-12T00:03:29.356262+0000","last_unstale":"2024-09-12T00:04:46.585872+0000","last_undegraded":"2024-09-12T00:04:46.585872+0000","last_fullsized":"2024-09-12T00:04:46.585872+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:27.790240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"63'92","reported_seq":181,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.472959+0000","last_change":"2024-09-12T00:03:31.362060+0000","last_active":"2024-09-12T00:04:48.472959+0000","last_peered":"2024-09-12T00:04:48.472959+0000","last_clean":"2024-09-12T00:04:48.472959+0000","last_became_active":"2024-09-12T00:03:31.361330+0000","last_became_peered":"2024-09-12T00:03:31.361330+0000","last_unstale":"2024-09-12T00:04:48.472959+0000","last_undegraded":"2024-09-12T00:04:48.472959+0000","last_fullsized":"2024-09-12T00:04:48.472959+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:06.142584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":67,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.603832+0000","last_change":"2024-09-12T00:03:33.378439+0000","last_active":"2024-09-12T00:04:46.603832+0000","last_peered":"2024-09-12T00:04:46.603832+0000","last_clean":"2024-09-12T00:04:46.603832+0000","last_became_active":"2024-09-12T00:03:33.374453+0000","last_became_peered":"2024-09-12T00:03:33.374453+0000","last_unstale":"2024-09-12T00:04:46.603832+0000","last_undegraded":"2024-09-12T00:04:46.603832+0000","last_fullsized":"2024-09-12T00:04:46.603832+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"58'2","reported_seq":93,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.561889+0000","last_change":"2024-09-12T00:03:25.356433+0000","last_active":"2024-09-12T00:04:46.561889+0000","last_peered":"2024-09-12T00:04:46.561889+0000","last_clean":"2024-09-12T00:04:46.561889+0000","last_became_active":"2024-09-12T00:03:25.354803+0000","last_became_peered":"2024-09-12T00:03:25.354803+0000","last_unstale":"2024-09-12T00:04:46.561889+0000","last_undegraded":"2024-09-12T00:04:46.561889+0000","last_fullsized":"2024-09-12T00:04:46.561889+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:00.419686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"63'7","reported_seq":96,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.573299+0000","last_change":"2024-09-12T00:03:23.630527+0000","last_active":"2024-09-12T00:04:47.573299+0000","last_peered":"2024-09-12T00:04:47.573299+0000","last_clean":"2024-09-12T00:04:47.573299+0000","last_became_active":"2024-09-12T00:03:23.630183+0000","last_became_peered":"2024-09-12T00:03:23.630183+0000","last_unstale":"2024-09-12T00:04:47.573299+0000","last_undegraded":"2024-09-12T00:04:47.573299+0000","last_fullsized":"2024-09-12T00:04:47.573299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.573851+0000","last_change":"2024-09-12T00:03:27.334188+0000","last_active":"2024-09-12T00:04:46.573851+0000","last_peered":"2024-09-12T00:04:46.573851+0000","last_clean":"2024-09-12T00:04:46.573851+0000","last_became_active":"2024-09-12T00:03:27.333395+0000","last_became_peered":"2024-09-12T00:03:27.333395+0000","last_unstale":"2024-09-12T00:04:46.573851+0000","last_undegraded":"2024-09-12T00:04:46.573851+0000","last_fullsized":"2024-09-12T00:04:46.573851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:56.266608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"63'20","reported_seq":108,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.604234+0000","last_change":"2024-09-12T00:03:29.339735+0000","last_active":"2024-09-12T00:04:46.604234+0000","last_peered":"2024-09-12T00:04:46.604234+0000","last_clean":"2024-09-12T00:04:46.604234+0000","last_became_active":"2024-09-12T00:03:29.338810+0000","last_became_peered":"2024-09-12T00:03:29.338810+0000","last_unstale":"2024-09-12T00:04:46.604234+0000","last_undegraded":"2024-09-12T00:04:46.604234+0000","last_fullsized":"2024-09-12T00:04:46.604234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"63'92","reported_seq":261,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.647550+0000","last_change":"2024-09-12T00:03:31.364647+0000","last_active":"2024-09-12T00:04:48.647550+0000","last_peered":"2024-09-12T00:04:48.647550+0000","last_clean":"2024-09-12T00:04:48.647550+0000","last_became_active":"2024-09-12T00:03:31.353547+0000","last_became_peered":"2024-09-12T00:03:31.353547+0000","last_unstale":"2024-09-12T00:04:48.647550+0000","last_undegraded":"2024-09-12T00:04:48.647550+0000","last_fullsized":"2024-09-12T00:04:48.647550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:20.795870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"63'4","reported_seq":102,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.637044+0000","last_change":"2024-09-12T00:03:25.329615+0000","last_active":"2024-09-12T00:04:48.637044+0000","last_peered":"2024-09-12T00:04:48.637044+0000","last_clean":"2024-09-12T00:04:48.637044+0000","last_became_active":"2024-09-12T00:03:25.329015+0000","last_became_peered":"2024-09-12T00:03:25.329015+0000","last_unstale":"2024-09-12T00:04:48.637044+0000","last_undegraded":"2024-09-12T00:04:48.637044+0000","last_fullsized":"2024-09-12T00:04:48.637044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:00.170397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"63'4","reported_seq":94,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.600624+0000","last_change":"2024-09-12T00:03:23.602206+0000","last_active":"2024-09-12T00:04:46.600624+0000","last_peered":"2024-09-12T00:04:46.600624+0000","last_clean":"2024-09-12T00:04:46.600624+0000","last_became_active":"2024-09-12T00:03:23.601898+0000","last_became_peered":"2024-09-12T00:03:23.601898+0000","last_unstale":"2024-09-12T00:04:46.600624+0000","last_undegraded":"2024-09-12T00:04:46.600624+0000","last_fullsized":"2024-09-12T00:04:46.600624+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:52.625795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.557899+0000","last_change":"2024-09-12T00:03:27.331111+0000","last_active":"2024-09-12T00:04:46.557899+0000","last_peered":"2024-09-12T00:04:46.557899+0000","last_clean":"2024-09-12T00:04:46.557899+0000","last_became_active":"2024-09-12T00:03:27.329672+0000","last_became_peered":"2024-09-12T00:03:27.329672+0000","last_unstale":"2024-09-12T00:04:46.557899+0000","last_undegraded":"2024-09-12T00:04:46.557899+0000","last_fullsized":"2024-09-12T00:04:46.557899+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"63'31","reported_seq":126,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574629+0000","last_change":"2024-09-12T00:03:29.335931+0000","last_active":"2024-09-12T00:04:46.574629+0000","last_peered":"2024-09-12T00:04:46.574629+0000","last_clean":"2024-09-12T00:04:46.574629+0000","last_became_active":"2024-09-12T00:03:29.335044+0000","last_became_peered":"2024-09-12T00:03:29.335044+0000","last_unstale":"2024-09-12T00:04:46.574629+0000","last_undegraded":"2024-09-12T00:04:46.574629+0000","last_fullsized":"2024-09-12T00:04:46.574629+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:57.131209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":73,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.562095+0000","last_change":"2024-09-12T00:03:31.355001+0000","last_active":"2024-09-12T00:04:46.562095+0000","last_peered":"2024-09-12T00:04:46.562095+0000","last_clean":"2024-09-12T00:04:46.562095+0000","last_became_active":"2024-09-12T00:03:31.354160+0000","last_became_peered":"2024-09-12T00:03:31.354160+0000","last_unstale":"2024-09-12T00:04:46.562095+0000","last_undegraded":"2024-09-12T00:04:46.562095+0000","last_fullsized":"2024-09-12T00:04:46.562095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:29.868141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":67,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.604478+0000","last_change":"2024-09-12T00:03:33.387603+0000","last_active":"2024-09-12T00:04:46.604478+0000","last_peered":"2024-09-12T00:04:46.604478+0000","last_clean":"2024-09-12T00:04:46.604478+0000","last_became_active":"2024-09-12T00:03:33.386614+0000","last_became_peered":"2024-09-12T00:03:33.386614+0000","last_unstale":"2024-09-12T00:04:46.604478+0000","last_undegraded":"2024-09-12T00:04:46.604478+0000","last_fullsized":"2024-09-12T00:04:46.604478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:37.428182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'2","reported_seq":94,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.558045+0000","last_change":"2024-09-12T00:03:25.357300+0000","last_active":"2024-09-12T00:04:46.558045+0000","last_peered":"2024-09-12T00:04:46.558045+0000","last_clean":"2024-09-12T00:04:46.558045+0000","last_became_active":"2024-09-12T00:03:25.356970+0000","last_became_peered":"2024-09-12T00:03:25.356970+0000","last_unstale":"2024-09-12T00:04:46.558045+0000","last_undegraded":"2024-09-12T00:04:46.558045+0000","last_fullsized":"2024-09-12T00:04:46.558045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:04.193738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"63'4","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.616150+0000","last_change":"2024-09-12T00:03:23.609700+0000","last_active":"2024-09-12T00:04:46.616150+0000","last_peered":"2024-09-12T00:04:46.616150+0000","last_clean":"2024-09-12T00:04:46.616150+0000","last_became_active":"2024-09-12T00:03:23.609435+0000","last_became_peered":"2024-09-12T00:03:23.609435+0000","last_unstale":"2024-09-12T00:04:46.616150+0000","last_undegraded":"2024-09-12T00:04:46.616150+0000","last_fullsized":"2024-09-12T00:04:46.616150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.557161+0000","last_change":"2024-09-12T00:03:27.339670+0000","last_active":"2024-09-12T00:04:46.557161+0000","last_peered":"2024-09-12T00:04:46.557161+0000","last_clean":"2024-09-12T00:04:46.557161+0000","last_became_active":"2024-09-12T00:03:27.338880+0000","last_became_peered":"2024-09-12T00:03:27.338880+0000","last_unstale":"2024-09-12T00:04:46.557161+0000","last_undegraded":"2024-09-12T00:04:46.557161+0000","last_fullsized":"2024-09-12T00:04:46.557161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:35.068652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"63'22","reported_seq":110,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.585556+0000","last_change":"2024-09-12T00:03:29.337666+0000","last_active":"2024-09-12T00:04:46.585556+0000","last_peered":"2024-09-12T00:04:46.585556+0000","last_clean":"2024-09-12T00:04:46.585556+0000","last_became_active":"2024-09-12T00:03:29.336957+0000","last_became_peered":"2024-09-12T00:03:29.336957+0000","last_unstale":"2024-09-12T00:04:46.585556+0000","last_undegraded":"2024-09-12T00:04:46.585556+0000","last_fullsized":"2024-09-12T00:04:46.585556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:58.417315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":21,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":71,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.584641+0000","last_change":"2024-09-12T00:03:31.348590+0000","last_active":"2024-09-12T00:04:46.584641+0000","last_peered":"2024-09-12T00:04:46.584641+0000","last_clean":"2024-09-12T00:04:46.584641+0000","last_became_active":"2024-09-12T00:03:31.347736+0000","last_became_peered":"2024-09-12T00:03:31.347736+0000","last_unstale":"2024-09-12T00:04:46.584641+0000","last_undegraded":"2024-09-12T00:04:46.584641+0000","last_fullsized":"2024-09-12T00:04:46.584641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:04.962492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"59'8","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.558112+0000","last_change":"2024-09-12T00:03:33.379699+0000","last_active":"2024-09-12T00:04:46.558112+0000","last_peered":"2024-09-12T00:04:46.558112+0000","last_clean":"2024-09-12T00:04:46.558112+0000","last_became_active":"2024-09-12T00:03:33.378945+0000","last_became_peered":"2024-09-12T00:03:33.378945+0000","last_unstale":"2024-09-12T00:04:46.558112+0000","last_undegraded":"2024-09-12T00:04:46.558112+0000","last_fullsized":"2024-09-12T00:04:46.558112+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:23.270488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'6","reported_seq":108,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.634979+0000","last_change":"2024-09-12T00:03:25.333941+0000","last_active":"2024-09-12T00:04:48.634979+0000","last_peered":"2024-09-12T00:04:48.634979+0000","last_clean":"2024-09-12T00:04:48.634979+0000","last_became_active":"2024-09-12T00:03:25.333559+0000","last_became_peered":"2024-09-12T00:03:25.333559+0000","last_unstale":"2024-09-12T00:04:48.634979+0000","last_undegraded":"2024-09-12T00:04:48.634979+0000","last_fullsized":"2024-09-12T00:04:48.634979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"63'2","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.148299+0000","last_change":"2024-09-12T00:03:23.596202+0000","last_active":"2024-09-12T00:04:47.148299+0000","last_peered":"2024-09-12T00:04:47.148299+0000","last_clean":"2024-09-12T00:04:47.148299+0000","last_became_active":"2024-09-12T00:03:23.595859+0000","last_became_peered":"2024-09-12T00:03:23.595859+0000","last_unstale":"2024-09-12T00:04:47.148299+0000","last_undegraded":"2024-09-12T00:04:47.148299+0000","last_fullsized":"2024-09-12T00:04:47.148299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:12.001918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":80,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.560013+0000","last_change":"2024-09-12T00:03:27.348080+0000","last_active":"2024-09-12T00:04:46.560013+0000","last_peered":"2024-09-12T00:04:46.560013+0000","last_clean":"2024-09-12T00:04:46.560013+0000","last_became_active":"2024-09-12T00:03:27.347288+0000","last_became_peered":"2024-09-12T00:03:27.347288+0000","last_unstale":"2024-09-12T00:04:46.560013+0000","last_undegraded":"2024-09-12T00:04:46.560013+0000","last_fullsized":"2024-09-12T00:04:46.560013+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:37.033224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"63'33","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.572637+0000","last_change":"2024-09-12T00:03:29.349297+0000","last_active":"2024-09-12T00:04:46.572637+0000","last_peered":"2024-09-12T00:04:46.572637+0000","last_clean":"2024-09-12T00:04:46.572637+0000","last_became_active":"2024-09-12T00:03:29.348779+0000","last_became_peered":"2024-09-12T00:03:29.348779+0000","last_unstale":"2024-09-12T00:04:46.572637+0000","last_undegraded":"2024-09-12T00:04:46.572637+0000","last_fullsized":"2024-09-12T00:04:46.572637+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:40.759557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"63'92","reported_seq":180,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.485547+0000","last_change":"2024-09-12T00:03:31.354114+0000","last_active":"2024-09-12T00:04:48.485547+0000","last_peered":"2024-09-12T00:04:48.485547+0000","last_clean":"2024-09-12T00:04:48.485547+0000","last_became_active":"2024-09-12T00:03:31.353358+0000","last_became_peered":"2024-09-12T00:03:31.353358+0000","last_unstale":"2024-09-12T00:04:48.485547+0000","last_undegraded":"2024-09-12T00:04:48.485547+0000","last_fullsized":"2024-09-12T00:04:48.485547+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:56.624718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":69,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.563436+0000","last_change":"2024-09-12T00:03:33.383917+0000","last_active":"2024-09-12T00:04:46.563436+0000","last_peered":"2024-09-12T00:04:46.563436+0000","last_clean":"2024-09-12T00:04:46.563436+0000","last_became_active":"2024-09-12T00:03:33.383199+0000","last_became_peered":"2024-09-12T00:03:33.383199+0000","last_unstale":"2024-09-12T00:04:46.563436+0000","last_undegraded":"2024-09-12T00:04:46.563436+0000","last_fullsized":"2024-09-12T00:04:46.563436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:37.428182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"59'8","reported_seq":106,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.560626+0000","last_change":"2024-09-12T00:03:25.356706+0000","last_active":"2024-09-12T00:04:46.560626+0000","last_peered":"2024-09-12T00:04:46.560626+0000","last_clean":"2024-09-12T00:04:46.560626+0000","last_became_active":"2024-09-12T00:03:25.354555+0000","last_became_peered":"2024-09-12T00:03:25.354555+0000","last_unstale":"2024-09-12T00:04:46.560626+0000","last_undegraded":"2024-09-12T00:04:46.560626+0000","last_fullsized":"2024-09-12T00:04:46.560626+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:55.543336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"63'6","reported_seq":95,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.938183+0000","last_change":"2024-09-12T00:03:23.612430+0000","last_active":"2024-09-12T00:04:47.938183+0000","last_peered":"2024-09-12T00:04:47.938183+0000","last_clean":"2024-09-12T00:04:47.938183+0000","last_became_active":"2024-09-12T00:03:23.612165+0000","last_became_peered":"2024-09-12T00:03:23.612165+0000","last_unstale":"2024-09-12T00:04:47.938183+0000","last_undegraded":"2024-09-12T00:04:47.938183+0000","last_fullsized":"2024-09-12T00:04:47.938183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:31.444343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.557648+0000","last_change":"2024-09-12T00:03:27.329228+0000","last_active":"2024-09-12T00:04:46.557648+0000","last_peered":"2024-09-12T00:04:46.557648+0000","last_clean":"2024-09-12T00:04:46.557648+0000","last_became_active":"2024-09-12T00:03:27.328497+0000","last_became_peered":"2024-09-12T00:03:27.328497+0000","last_unstale":"2024-09-12T00:04:46.557648+0000","last_undegraded":"2024-09-12T00:04:46.557648+0000","last_fullsized":"2024-09-12T00:04:46.557648+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"63'35","reported_seq":133,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.501338+0000","last_change":"2024-09-12T00:03:29.332778+0000","last_active":"2024-09-12T00:04:48.501338+0000","last_peered":"2024-09-12T00:04:48.501338+0000","last_clean":"2024-09-12T00:04:48.501338+0000","last_became_active":"2024-09-12T00:03:29.332010+0000","last_became_peered":"2024-09-12T00:03:29.332010+0000","last_unstale":"2024-09-12T00:04:48.501338+0000","last_undegraded":"2024-09-12T00:04:48.501338+0000","last_fullsized":"2024-09-12T00:04:48.501338+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:13.563107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4763,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":45,"num_read_kb":34,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":72,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.559554+0000","last_change":"2024-09-12T00:03:31.354374+0000","last_active":"2024-09-12T00:04:46.559554+0000","last_peered":"2024-09-12T00:04:46.559554+0000","last_clean":"2024-09-12T00:04:46.559554+0000","last_became_active":"2024-09-12T00:03:31.353407+0000","last_became_peered":"2024-09-12T00:03:31.353407+0000","last_unstale":"2024-09-12T00:04:46.559554+0000","last_undegraded":"2024-09-12T00:04:46.559554+0000","last_fullsized":"2024-09-12T00:04:46.559554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:30.520217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'5","reported_seq":89,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.616646+0000","last_change":"2024-09-12T00:03:33.385373+0000","last_active":"2024-09-12T00:04:46.616646+0000","last_peered":"2024-09-12T00:04:46.616646+0000","last_clean":"2024-09-12T00:04:46.616646+0000","last_became_active":"2024-09-12T00:03:33.384559+0000","last_became_peered":"2024-09-12T00:03:33.384559+0000","last_unstale":"2024-09-12T00:04:46.616646+0000","last_undegraded":"2024-09-12T00:04:46.616646+0000","last_fullsized":"2024-09-12T00:04:46.616646+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:55.924174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"59'2","reported_seq":93,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.575098+0000","last_change":"2024-09-12T00:03:25.326677+0000","last_active":"2024-09-12T00:04:46.575098+0000","last_peered":"2024-09-12T00:04:46.575098+0000","last_clean":"2024-09-12T00:04:46.575098+0000","last_became_active":"2024-09-12T00:03:25.325840+0000","last_became_peered":"2024-09-12T00:03:25.325840+0000","last_unstale":"2024-09-12T00:04:46.575098+0000","last_undegraded":"2024-09-12T00:04:46.575098+0000","last_fullsized":"2024-09-12T00:04:46.575098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:07.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"62'4","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.615615+0000","last_change":"2024-09-12T00:03:23.616943+0000","last_active":"2024-09-12T00:04:46.615615+0000","last_peered":"2024-09-12T00:04:46.615615+0000","last_clean":"2024-09-12T00:04:46.615615+0000","last_became_active":"2024-09-12T00:03:23.616200+0000","last_became_peered":"2024-09-12T00:03:23.616200+0000","last_unstale":"2024-09-12T00:04:46.615615+0000","last_undegraded":"2024-09-12T00:04:46.615615+0000","last_fullsized":"2024-09-12T00:04:46.615615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":79,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.615329+0000","last_change":"2024-09-12T00:03:27.330506+0000","last_active":"2024-09-12T00:04:46.615329+0000","last_peered":"2024-09-12T00:04:46.615329+0000","last_clean":"2024-09-12T00:04:46.615329+0000","last_became_active":"2024-09-12T00:03:27.329830+0000","last_became_peered":"2024-09-12T00:03:27.329830+0000","last_unstale":"2024-09-12T00:04:46.615329+0000","last_undegraded":"2024-09-12T00:04:46.615329+0000","last_fullsized":"2024-09-12T00:04:46.615329+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:03.446090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"63'22","reported_seq":113,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.559726+0000","last_change":"2024-09-12T00:03:29.343655+0000","last_active":"2024-09-12T00:04:46.559726+0000","last_peered":"2024-09-12T00:04:46.559726+0000","last_clean":"2024-09-12T00:04:46.559726+0000","last_became_active":"2024-09-12T00:03:29.343178+0000","last_became_peered":"2024-09-12T00:03:29.343178+0000","last_unstale":"2024-09-12T00:04:46.559726+0000","last_undegraded":"2024-09-12T00:04:46.559726+0000","last_fullsized":"2024-09-12T00:04:46.559726+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":71,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.616492+0000","last_change":"2024-09-12T00:03:31.358077+0000","last_active":"2024-09-12T00:04:46.616492+0000","last_peered":"2024-09-12T00:04:46.616492+0000","last_clean":"2024-09-12T00:04:46.616492+0000","last_became_active":"2024-09-12T00:03:31.357272+0000","last_became_peered":"2024-09-12T00:03:31.357272+0000","last_unstale":"2024-09-12T00:04:46.616492+0000","last_undegraded":"2024-09-12T00:04:46.616492+0000","last_fullsized":"2024-09-12T00:04:46.616492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:37.991682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":68,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.559207+0000","last_change":"2024-09-12T00:03:33.386299+0000","last_active":"2024-09-12T00:04:46.559207+0000","last_peered":"2024-09-12T00:04:46.559207+0000","last_clean":"2024-09-12T00:04:46.559207+0000","last_became_active":"2024-09-12T00:03:33.385357+0000","last_became_peered":"2024-09-12T00:03:33.385357+0000","last_unstale":"2024-09-12T00:04:46.559207+0000","last_undegraded":"2024-09-12T00:04:46.559207+0000","last_fullsized":"2024-09-12T00:04:46.559207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:17.028373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":85,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574854+0000","last_change":"2024-09-12T00:03:25.333772+0000","last_active":"2024-09-12T00:04:46.574854+0000","last_peered":"2024-09-12T00:04:46.574854+0000","last_clean":"2024-09-12T00:04:46.574854+0000","last_became_active":"2024-09-12T00:03:25.333338+0000","last_became_peered":"2024-09-12T00:03:25.333338+0000","last_unstale":"2024-09-12T00:04:46.574854+0000","last_undegraded":"2024-09-12T00:04:46.574854+0000","last_fullsized":"2024-09-12T00:04:46.574854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:13.572959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"63'3","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.573775+0000","last_change":"2024-09-12T00:03:23.598015+0000","last_active":"2024-09-12T00:04:46.573775+0000","last_peered":"2024-09-12T00:04:46.573775+0000","last_clean":"2024-09-12T00:04:46.573775+0000","last_became_active":"2024-09-12T00:03:23.594135+0000","last_became_peered":"2024-09-12T00:03:23.594135+0000","last_unstale":"2024-09-12T00:04:46.573775+0000","last_undegraded":"2024-09-12T00:04:46.573775+0000","last_fullsized":"2024-09-12T00:04:46.573775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:31.336675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":80,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.560072+0000","last_change":"2024-09-12T00:03:27.342295+0000","last_active":"2024-09-12T00:04:46.560072+0000","last_peered":"2024-09-12T00:04:46.560072+0000","last_clean":"2024-09-12T00:04:46.560072+0000","last_became_active":"2024-09-12T00:03:27.341619+0000","last_became_peered":"2024-09-12T00:03:27.341619+0000","last_unstale":"2024-09-12T00:04:46.560072+0000","last_undegraded":"2024-09-12T00:04:46.560072+0000","last_fullsized":"2024-09-12T00:04:46.560072+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:00.908798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"63'20","reported_seq":106,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.561545+0000","last_change":"2024-09-12T00:03:29.336391+0000","last_active":"2024-09-12T00:04:46.561545+0000","last_peered":"2024-09-12T00:04:46.561545+0000","last_clean":"2024-09-12T00:04:46.561545+0000","last_became_active":"2024-09-12T00:03:29.335679+0000","last_became_peered":"2024-09-12T00:03:29.335679+0000","last_unstale":"2024-09-12T00:04:46.561545+0000","last_undegraded":"2024-09-12T00:04:46.561545+0000","last_fullsized":"2024-09-12T00:04:46.561545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:58.540539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"63'92","reported_seq":188,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.474364+0000","last_change":"2024-09-12T00:03:31.351170+0000","last_active":"2024-09-12T00:04:48.474364+0000","last_peered":"2024-09-12T00:04:48.474364+0000","last_clean":"2024-09-12T00:04:48.474364+0000","last_became_active":"2024-09-12T00:03:31.350264+0000","last_became_peered":"2024-09-12T00:03:31.350264+0000","last_unstale":"2024-09-12T00:04:48.474364+0000","last_undegraded":"2024-09-12T00:04:48.474364+0000","last_fullsized":"2024-09-12T00:04:48.474364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:51.368815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"59'3","reported_seq":73,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.557260+0000","last_change":"2024-09-12T00:03:33.368236+0000","last_active":"2024-09-12T00:04:46.557260+0000","last_peered":"2024-09-12T00:04:46.557260+0000","last_clean":"2024-09-12T00:04:46.557260+0000","last_became_active":"2024-09-12T00:03:33.367424+0000","last_became_peered":"2024-09-12T00:03:33.367424+0000","last_unstale":"2024-09-12T00:04:46.557260+0000","last_undegraded":"2024-09-12T00:04:46.557260+0000","last_fullsized":"2024-09-12T00:04:46.557260+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"59'4","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.604456+0000","last_change":"2024-09-12T00:03:25.330477+0000","last_active":"2024-09-12T00:04:46.604456+0000","last_peered":"2024-09-12T00:04:46.604456+0000","last_clean":"2024-09-12T00:04:46.604456+0000","last_became_active":"2024-09-12T00:03:25.330069+0000","last_became_peered":"2024-09-12T00:03:25.330069+0000","last_unstale":"2024-09-12T00:04:46.604456+0000","last_undegraded":"2024-09-12T00:04:46.604456+0000","last_fullsized":"2024-09-12T00:04:46.604456+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"63'2","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.573111+0000","last_change":"2024-09-12T00:03:23.604303+0000","last_active":"2024-09-12T00:04:46.573111+0000","last_peered":"2024-09-12T00:04:46.573111+0000","last_clean":"2024-09-12T00:04:46.573111+0000","last_became_active":"2024-09-12T00:03:23.603937+0000","last_became_peered":"2024-09-12T00:03:23.603937+0000","last_unstale":"2024-09-12T00:04:46.573111+0000","last_undegraded":"2024-09-12T00:04:46.573111+0000","last_fullsized":"2024-09-12T00:04:46.573111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:16.713949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":205,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.441323+0000","last_change":"2024-09-12T00:03:27.331569+0000","last_active":"2024-09-12T00:04:48.441323+0000","last_peered":"2024-09-12T00:04:48.441323+0000","last_clean":"2024-09-12T00:04:48.441323+0000","last_became_active":"2024-09-12T00:03:27.330909+0000","last_became_peered":"2024-09-12T00:03:27.330909+0000","last_unstale":"2024-09-12T00:04:48.441323+0000","last_undegraded":"2024-09-12T00:04:48.441323+0000","last_fullsized":"2024-09-12T00:04:48.441323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"59'11","reported_seq":93,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.562552+0000","last_change":"2024-09-12T00:03:29.338880+0000","last_active":"2024-09-12T00:04:46.562552+0000","last_peered":"2024-09-12T00:04:46.562552+0000","last_clean":"2024-09-12T00:04:46.562552+0000","last_became_active":"2024-09-12T00:03:29.338110+0000","last_became_peered":"2024-09-12T00:03:29.338110+0000","last_unstale":"2024-09-12T00:04:46.562552+0000","last_undegraded":"2024-09-12T00:04:46.562552+0000","last_fullsized":"2024-09-12T00:04:46.562552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.054460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"63'92","reported_seq":217,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.644614+0000","last_change":"2024-09-12T00:03:31.339117+0000","last_active":"2024-09-12T00:04:48.644614+0000","last_peered":"2024-09-12T00:04:48.644614+0000","last_clean":"2024-09-12T00:04:48.644614+0000","last_became_active":"2024-09-12T00:03:31.338426+0000","last_became_peered":"2024-09-12T00:03:31.338426+0000","last_unstale":"2024-09-12T00:04:48.644614+0000","last_undegraded":"2024-09-12T00:04:48.644614+0000","last_fullsized":"2024-09-12T00:04:48.644614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:19.304169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":67,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.604545+0000","last_change":"2024-09-12T00:03:33.385051+0000","last_active":"2024-09-12T00:04:46.604545+0000","last_peered":"2024-09-12T00:04:46.604545+0000","last_clean":"2024-09-12T00:04:46.604545+0000","last_became_active":"2024-09-12T00:03:33.380088+0000","last_became_peered":"2024-09-12T00:03:33.380088+0000","last_unstale":"2024-09-12T00:04:46.604545+0000","last_undegraded":"2024-09-12T00:04:46.604545+0000","last_fullsized":"2024-09-12T00:04:46.604545+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:02.972871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"58'2","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.616732+0000","last_change":"2024-09-12T00:03:25.336113+0000","last_active":"2024-09-12T00:04:46.616732+0000","last_peered":"2024-09-12T00:04:46.616732+0000","last_clean":"2024-09-12T00:04:46.616732+0000","last_became_active":"2024-09-12T00:03:25.335449+0000","last_became_peered":"2024-09-12T00:03:25.335449+0000","last_unstale":"2024-09-12T00:04:46.616732+0000","last_undegraded":"2024-09-12T00:04:46.616732+0000","last_fullsized":"2024-09-12T00:04:46.616732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:34.277614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"63'6","reported_seq":93,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.397311+0000","last_change":"2024-09-12T00:03:23.619285+0000","last_active":"2024-09-12T00:04:47.397311+0000","last_peered":"2024-09-12T00:04:47.397311+0000","last_clean":"2024-09-12T00:04:47.397311+0000","last_became_active":"2024-09-12T00:03:23.614187+0000","last_became_peered":"2024-09-12T00:03:23.614187+0000","last_unstale":"2024-09-12T00:04:47.397311+0000","last_undegraded":"2024-09-12T00:04:47.397311+0000","last_fullsized":"2024-09-12T00:04:47.397311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574115+0000","last_change":"2024-09-12T00:03:27.342832+0000","last_active":"2024-09-12T00:04:46.574115+0000","last_peered":"2024-09-12T00:04:46.574115+0000","last_clean":"2024-09-12T00:04:46.574115+0000","last_became_active":"2024-09-12T00:03:27.338764+0000","last_became_peered":"2024-09-12T00:03:27.338764+0000","last_unstale":"2024-09-12T00:04:46.574115+0000","last_undegraded":"2024-09-12T00:04:46.574115+0000","last_fullsized":"2024-09-12T00:04:46.574115+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:24.471349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"63'22","reported_seq":110,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.558378+0000","last_change":"2024-09-12T00:03:29.345719+0000","last_active":"2024-09-12T00:04:46.558378+0000","last_peered":"2024-09-12T00:04:46.558378+0000","last_clean":"2024-09-12T00:04:46.558378+0000","last_became_active":"2024-09-12T00:03:29.345243+0000","last_became_peered":"2024-09-12T00:03:29.345243+0000","last_unstale":"2024-09-12T00:04:46.558378+0000","last_undegraded":"2024-09-12T00:04:46.558378+0000","last_fullsized":"2024-09-12T00:04:46.558378+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:41.153263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":71,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.604729+0000","last_change":"2024-09-12T00:03:31.360630+0000","last_active":"2024-09-12T00:04:46.604729+0000","last_peered":"2024-09-12T00:04:46.604729+0000","last_clean":"2024-09-12T00:04:46.604729+0000","last_became_active":"2024-09-12T00:03:31.359763+0000","last_became_peered":"2024-09-12T00:03:31.359763+0000","last_unstale":"2024-09-12T00:04:46.604729+0000","last_undegraded":"2024-09-12T00:04:46.604729+0000","last_fullsized":"2024-09-12T00:04:46.604729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"63'2","reported_seq":71,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.614871+0000","last_change":"2024-09-12T00:03:33.372178+0000","last_active":"2024-09-12T00:04:46.614871+0000","last_peered":"2024-09-12T00:04:46.614871+0000","last_clean":"2024-09-12T00:04:46.614871+0000","last_became_active":"2024-09-12T00:03:33.370562+0000","last_became_peered":"2024-09-12T00:03:33.370562+0000","last_unstale":"2024-09-12T00:04:46.614871+0000","last_undegraded":"2024-09-12T00:04:46.614871+0000","last_fullsized":"2024-09-12T00:04:46.614871+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:31.888153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"59'4","reported_seq":103,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574487+0000","last_change":"2024-09-12T00:03:25.329229+0000","last_active":"2024-09-12T00:04:46.574487+0000","last_peered":"2024-09-12T00:04:46.574487+0000","last_clean":"2024-09-12T00:04:46.574487+0000","last_became_active":"2024-09-12T00:03:25.328934+0000","last_became_peered":"2024-09-12T00:03:25.328934+0000","last_unstale":"2024-09-12T00:04:46.574487+0000","last_undegraded":"2024-09-12T00:04:46.574487+0000","last_fullsized":"2024-09-12T00:04:46.574487+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:48.820585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":193,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.557949+0000","last_change":"2024-09-12T00:03:11.770141+0000","last_active":"2024-09-12T00:04:46.557949+0000","last_peered":"2024-09-12T00:04:46.557949+0000","last_clean":"2024-09-12T00:04:46.557949+0000","last_became_active":"2024-09-12T00:03:11.767988+0000","last_became_peered":"2024-09-12T00:03:11.767988+0000","last_unstale":"2024-09-12T00:04:46.557949+0000","last_undegraded":"2024-09-12T00:04:46.557949+0000","last_fullsized":"2024-09-12T00:04:46.557949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_clean_scrub_stamp":"2024-09-12T00:03:10.462069+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:26.289955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":103,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.573545+0000","last_change":"2024-09-12T00:03:18.567644+0000","last_active":"2024-09-12T00:04:46.573545+0000","last_peered":"2024-09-12T00:04:46.573545+0000","last_clean":"2024-09-12T00:04:46.573545+0000","last_became_active":"2024-09-12T00:03:16.592765+0000","last_became_peered":"2024-09-12T00:03:16.592765+0000","last_unstale":"2024-09-12T00:04:46.573545+0000","last_undegraded":"2024-09-12T00:04:46.573545+0000","last_fullsized":"2024-09-12T00:04:46.573545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:06.283894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001924708,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"63'4","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.930370+0000","last_change":"2024-09-12T00:03:23.621849+0000","last_active":"2024-09-12T00:04:46.930370+0000","last_peered":"2024-09-12T00:04:46.930370+0000","last_clean":"2024-09-12T00:04:46.930370+0000","last_became_active":"2024-09-12T00:03:23.621146+0000","last_became_peered":"2024-09-12T00:03:23.621146+0000","last_unstale":"2024-09-12T00:04:46.930370+0000","last_undegraded":"2024-09-12T00:04:46.930370+0000","last_fullsized":"2024-09-12T00:04:46.930370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:38.426691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574592+0000","last_change":"2024-09-12T00:03:27.316175+0000","last_active":"2024-09-12T00:04:46.574592+0000","last_peered":"2024-09-12T00:04:46.574592+0000","last_clean":"2024-09-12T00:04:46.574592+0000","last_became_active":"2024-09-12T00:03:27.315502+0000","last_became_peered":"2024-09-12T00:03:27.315502+0000","last_unstale":"2024-09-12T00:04:46.574592+0000","last_undegraded":"2024-09-12T00:04:46.574592+0000","last_fullsized":"2024-09-12T00:04:46.574592+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:21.448686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"63'35","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.534036+0000","last_change":"2024-09-12T00:03:29.348743+0000","last_active":"2024-09-12T00:04:48.534036+0000","last_peered":"2024-09-12T00:04:48.534036+0000","last_clean":"2024-09-12T00:04:48.534036+0000","last_became_active":"2024-09-12T00:03:29.348073+0000","last_became_peered":"2024-09-12T00:03:29.348073+0000","last_unstale":"2024-09-12T00:04:48.534036+0000","last_undegraded":"2024-09-12T00:04:48.534036+0000","last_fullsized":"2024-09-12T00:04:48.534036+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:27.315678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":72,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.560600+0000","last_change":"2024-09-12T00:03:31.361408+0000","last_active":"2024-09-12T00:04:46.560600+0000","last_peered":"2024-09-12T00:04:46.560600+0000","last_clean":"2024-09-12T00:04:46.560600+0000","last_became_active":"2024-09-12T00:03:31.360462+0000","last_became_peered":"2024-09-12T00:03:31.360462+0000","last_unstale":"2024-09-12T00:04:46.560600+0000","last_undegraded":"2024-09-12T00:04:46.560600+0000","last_fullsized":"2024-09-12T00:04:46.560600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:58.407571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"59'4","reported_seq":75,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.575549+0000","last_change":"2024-09-12T00:03:33.388253+0000","last_active":"2024-09-12T00:04:46.575549+0000","last_peered":"2024-09-12T00:04:46.575549+0000","last_clean":"2024-09-12T00:04:46.575549+0000","last_became_active":"2024-09-12T00:03:33.387457+0000","last_became_peered":"2024-09-12T00:03:33.387457+0000","last_unstale":"2024-09-12T00:04:46.575549+0000","last_undegraded":"2024-09-12T00:04:46.575549+0000","last_fullsized":"2024-09-12T00:04:46.575549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:46.021740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'2","reported_seq":93,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.561428+0000","last_change":"2024-09-12T00:03:25.357970+0000","last_active":"2024-09-12T00:04:46.561428+0000","last_peered":"2024-09-12T00:04:46.561428+0000","last_clean":"2024-09-12T00:04:46.561428+0000","last_became_active":"2024-09-12T00:03:25.355306+0000","last_became_peered":"2024-09-12T00:03:25.355306+0000","last_unstale":"2024-09-12T00:04:46.561428+0000","last_undegraded":"2024-09-12T00:04:46.561428+0000","last_fullsized":"2024-09-12T00:04:46.561428+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:17.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":102,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.573169+0000","last_change":"2024-09-12T00:03:18.567433+0000","last_active":"2024-09-12T00:04:46.573169+0000","last_peered":"2024-09-12T00:04:46.573169+0000","last_clean":"2024-09-12T00:04:46.573169+0000","last_became_active":"2024-09-12T00:03:16.557489+0000","last_became_peered":"2024-09-12T00:03:16.557489+0000","last_unstale":"2024-09-12T00:04:46.573169+0000","last_undegraded":"2024-09-12T00:04:46.573169+0000","last_fullsized":"2024-09-12T00:04:46.573169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:26.187640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001769713,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"63'10","reported_seq":100,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.815706+0000","last_change":"2024-09-12T00:03:23.622111+0000","last_active":"2024-09-12T00:04:47.815706+0000","last_peered":"2024-09-12T00:04:47.815706+0000","last_clean":"2024-09-12T00:04:47.815706+0000","last_became_active":"2024-09-12T00:03:23.621358+0000","last_became_peered":"2024-09-12T00:03:23.621358+0000","last_unstale":"2024-09-12T00:04:47.815706+0000","last_undegraded":"2024-09-12T00:04:47.815706+0000","last_fullsized":"2024-09-12T00:04:47.815706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:02.202230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.573867+0000","last_change":"2024-09-12T00:03:27.338241+0000","last_active":"2024-09-12T00:04:46.573867+0000","last_peered":"2024-09-12T00:04:46.573867+0000","last_clean":"2024-09-12T00:04:46.573867+0000","last_became_active":"2024-09-12T00:03:27.337391+0000","last_became_peered":"2024-09-12T00:03:27.337391+0000","last_unstale":"2024-09-12T00:04:46.573867+0000","last_undegraded":"2024-09-12T00:04:46.573867+0000","last_fullsized":"2024-09-12T00:04:46.573867+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:00.949475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"63'104","reported_seq":249,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.531773+0000","last_change":"2024-09-12T00:03:29.346819+0000","last_active":"2024-09-12T00:04:48.531773+0000","last_peered":"2024-09-12T00:04:48.531773+0000","last_clean":"2024-09-12T00:04:48.531773+0000","last_became_active":"2024-09-12T00:03:29.346101+0000","last_became_peered":"2024-09-12T00:03:29.346101+0000","last_unstale":"2024-09-12T00:04:48.531773+0000","last_undegraded":"2024-09-12T00:04:48.531773+0000","last_fullsized":"2024-09-12T00:04:48.531773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:27.268327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":141,"num_read_kb":125,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":73,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574928+0000","last_change":"2024-09-12T00:03:31.361817+0000","last_active":"2024-09-12T00:04:46.574928+0000","last_peered":"2024-09-12T00:04:46.574928+0000","last_clean":"2024-09-12T00:04:46.574928+0000","last_became_active":"2024-09-12T00:03:31.361309+0000","last_became_peered":"2024-09-12T00:03:31.361309+0000","last_unstale":"2024-09-12T00:04:46.574928+0000","last_undegraded":"2024-09-12T00:04:46.574928+0000","last_fullsized":"2024-09-12T00:04:46.574928+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:19.554189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":68,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.559822+0000","last_change":"2024-09-12T00:03:33.386144+0000","last_active":"2024-09-12T00:04:46.559822+0000","last_peered":"2024-09-12T00:04:46.559822+0000","last_clean":"2024-09-12T00:04:46.559822+0000","last_became_active":"2024-09-12T00:03:33.384951+0000","last_became_peered":"2024-09-12T00:03:33.384951+0000","last_unstale":"2024-09-12T00:04:46.559822+0000","last_undegraded":"2024-09-12T00:04:46.559822+0000","last_fullsized":"2024-09-12T00:04:46.559822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:49.807501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"59'2","reported_seq":93,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.563747+0000","last_change":"2024-09-12T00:03:25.332801+0000","last_active":"2024-09-12T00:04:46.563747+0000","last_peered":"2024-09-12T00:04:46.563747+0000","last_clean":"2024-09-12T00:04:46.563747+0000","last_became_active":"2024-09-12T00:03:25.331652+0000","last_became_peered":"2024-09-12T00:03:25.331652+0000","last_unstale":"2024-09-12T00:04:46.563747+0000","last_undegraded":"2024-09-12T00:04:46.563747+0000","last_fullsized":"2024-09-12T00:04:46.563747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":100,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.614804+0000","last_change":"2024-09-12T00:03:18.892423+0000","last_active":"2024-09-12T00:04:46.614804+0000","last_peered":"2024-09-12T00:04:46.614804+0000","last_clean":"2024-09-12T00:04:46.614804+0000","last_became_active":"2024-09-12T00:03:16.559698+0000","last_became_peered":"2024-09-12T00:03:16.559698+0000","last_unstale":"2024-09-12T00:04:46.614804+0000","last_undegraded":"2024-09-12T00:04:46.614804+0000","last_fullsized":"2024-09-12T00:04:46.614804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:21.453461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082440599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"63'6","reported_seq":94,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.619274+0000","last_change":"2024-09-12T00:03:23.633606+0000","last_active":"2024-09-12T00:04:47.619274+0000","last_peered":"2024-09-12T00:04:47.619274+0000","last_clean":"2024-09-12T00:04:47.619274+0000","last_became_active":"2024-09-12T00:03:23.632795+0000","last_became_peered":"2024-09-12T00:03:23.632795+0000","last_unstale":"2024-09-12T00:04:47.619274+0000","last_undegraded":"2024-09-12T00:04:47.619274+0000","last_fullsized":"2024-09-12T00:04:47.619274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:08.214455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":80,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.615734+0000","last_change":"2024-09-12T00:03:27.326932+0000","last_active":"2024-09-12T00:04:46.615734+0000","last_peered":"2024-09-12T00:04:46.615734+0000","last_clean":"2024-09-12T00:04:46.615734+0000","last_became_active":"2024-09-12T00:03:27.326173+0000","last_became_peered":"2024-09-12T00:03:27.326173+0000","last_unstale":"2024-09-12T00:04:46.615734+0000","last_undegraded":"2024-09-12T00:04:46.615734+0000","last_fullsized":"2024-09-12T00:04:46.615734+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:12.286539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"58'16","reported_seq":115,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.575241+0000","last_change":"2024-09-12T00:03:29.338829+0000","last_active":"2024-09-12T00:04:46.575241+0000","last_peered":"2024-09-12T00:04:46.575241+0000","last_clean":"2024-09-12T00:04:46.575241+0000","last_became_active":"2024-09-12T00:03:29.337364+0000","last_became_peered":"2024-09-12T00:03:29.337364+0000","last_unstale":"2024-09-12T00:04:46.575241+0000","last_undegraded":"2024-09-12T00:04:46.575241+0000","last_fullsized":"2024-09-12T00:04:46.575241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:01.584359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":71,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.586326+0000","last_change":"2024-09-12T00:03:31.346734+0000","last_active":"2024-09-12T00:04:46.586326+0000","last_peered":"2024-09-12T00:04:46.586326+0000","last_clean":"2024-09-12T00:04:46.586326+0000","last_became_active":"2024-09-12T00:03:31.346035+0000","last_became_peered":"2024-09-12T00:03:31.346035+0000","last_unstale":"2024-09-12T00:04:46.586326+0000","last_undegraded":"2024-09-12T00:04:46.586326+0000","last_fullsized":"2024-09-12T00:04:46.586326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:10.417936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":67,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.584696+0000","last_change":"2024-09-12T00:03:33.354171+0000","last_active":"2024-09-12T00:04:46.584696+0000","last_peered":"2024-09-12T00:04:46.584696+0000","last_clean":"2024-09-12T00:04:46.584696+0000","last_became_active":"2024-09-12T00:03:33.353460+0000","last_became_peered":"2024-09-12T00:03:33.353460+0000","last_unstale":"2024-09-12T00:04:46.584696+0000","last_undegraded":"2024-09-12T00:04:46.584696+0000","last_fullsized":"2024-09-12T00:04:46.584696+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:34.356970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"59'6","reported_seq":111,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.562864+0000","last_change":"2024-09-12T00:03:25.336320+0000","last_active":"2024-09-12T00:04:46.562864+0000","last_peered":"2024-09-12T00:04:46.562864+0000","last_clean":"2024-09-12T00:04:46.562864+0000","last_became_active":"2024-09-12T00:03:25.333449+0000","last_became_peered":"2024-09-12T00:03:25.333449+0000","last_unstale":"2024-09-12T00:04:46.562864+0000","last_undegraded":"2024-09-12T00:04:46.562864+0000","last_fullsized":"2024-09-12T00:04:46.562864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":104,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.573940+0000","last_change":"2024-09-12T00:03:18.568246+0000","last_active":"2024-09-12T00:04:46.573940+0000","last_peered":"2024-09-12T00:04:46.573940+0000","last_clean":"2024-09-12T00:04:46.573940+0000","last_became_active":"2024-09-12T00:03:16.554663+0000","last_became_peered":"2024-09-12T00:03:16.554663+0000","last_unstale":"2024-09-12T00:04:46.573940+0000","last_undegraded":"2024-09-12T00:04:46.573940+0000","last_fullsized":"2024-09-12T00:04:46.573940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:52.802404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025471840000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"63'4","reported_seq":93,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.476348+0000","last_change":"2024-09-12T00:03:23.611064+0000","last_active":"2024-09-12T00:04:47.476348+0000","last_peered":"2024-09-12T00:04:47.476348+0000","last_clean":"2024-09-12T00:04:47.476348+0000","last_became_active":"2024-09-12T00:03:23.610612+0000","last_became_peered":"2024-09-12T00:03:23.610612+0000","last_unstale":"2024-09-12T00:04:47.476348+0000","last_undegraded":"2024-09-12T00:04:47.476348+0000","last_fullsized":"2024-09-12T00:04:47.476348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:04.201688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":79,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.615455+0000","last_change":"2024-09-12T00:03:27.339197+0000","last_active":"2024-09-12T00:04:46.615455+0000","last_peered":"2024-09-12T00:04:46.615455+0000","last_clean":"2024-09-12T00:04:46.615455+0000","last_became_active":"2024-09-12T00:03:27.338508+0000","last_became_peered":"2024-09-12T00:03:27.338508+0000","last_unstale":"2024-09-12T00:04:46.615455+0000","last_undegraded":"2024-09-12T00:04:46.615455+0000","last_fullsized":"2024-09-12T00:04:46.615455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:08.306289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":94,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.560849+0000","last_change":"2024-09-12T00:03:29.358418+0000","last_active":"2024-09-12T00:04:46.560849+0000","last_peered":"2024-09-12T00:04:46.560849+0000","last_clean":"2024-09-12T00:04:46.560849+0000","last_became_active":"2024-09-12T00:03:29.357949+0000","last_became_peered":"2024-09-12T00:03:29.357949+0000","last_unstale":"2024-09-12T00:04:46.560849+0000","last_undegraded":"2024-09-12T00:04:46.560849+0000","last_fullsized":"2024-09-12T00:04:46.560849+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:53.457363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":73,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574487+0000","last_change":"2024-09-12T00:03:31.352559+0000","last_active":"2024-09-12T00:04:46.574487+0000","last_peered":"2024-09-12T00:04:46.574487+0000","last_clean":"2024-09-12T00:04:46.574487+0000","last_became_active":"2024-09-12T00:03:31.351663+0000","last_became_peered":"2024-09-12T00:03:31.351663+0000","last_unstale":"2024-09-12T00:04:46.574487+0000","last_undegraded":"2024-09-12T00:04:46.574487+0000","last_fullsized":"2024-09-12T00:04:46.574487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:03.662016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"63'7","reported_seq":79,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.557453+0000","last_change":"2024-09-12T00:03:33.367035+0000","last_active":"2024-09-12T00:04:46.557453+0000","last_peered":"2024-09-12T00:04:46.557453+0000","last_clean":"2024-09-12T00:04:46.557453+0000","last_became_active":"2024-09-12T00:03:33.366311+0000","last_became_peered":"2024-09-12T00:03:33.366311+0000","last_unstale":"2024-09-12T00:04:46.557453+0000","last_undegraded":"2024-09-12T00:04:46.557453+0000","last_fullsized":"2024-09-12T00:04:46.557453+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"59'4","reported_seq":103,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.557823+0000","last_change":"2024-09-12T00:03:25.322258+0000","last_active":"2024-09-12T00:04:46.557823+0000","last_peered":"2024-09-12T00:04:46.557823+0000","last_clean":"2024-09-12T00:04:46.557823+0000","last_became_active":"2024-09-12T00:03:25.320903+0000","last_became_peered":"2024-09-12T00:03:25.320903+0000","last_unstale":"2024-09-12T00:04:46.557823+0000","last_undegraded":"2024-09-12T00:04:46.557823+0000","last_fullsized":"2024-09-12T00:04:46.557823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:05.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"63'4","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.162074+0000","last_change":"2024-09-12T00:03:23.619024+0000","last_active":"2024-09-12T00:04:48.162074+0000","last_peered":"2024-09-12T00:04:48.162074+0000","last_clean":"2024-09-12T00:04:48.162074+0000","last_became_active":"2024-09-12T00:03:23.618716+0000","last_became_peered":"2024-09-12T00:03:23.618716+0000","last_unstale":"2024-09-12T00:04:48.162074+0000","last_undegraded":"2024-09-12T00:04:48.162074+0000","last_fullsized":"2024-09-12T00:04:48.162074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.560497+0000","last_change":"2024-09-12T00:03:18.562010+0000","last_active":"2024-09-12T00:04:46.560497+0000","last_peered":"2024-09-12T00:04:46.560497+0000","last_clean":"2024-09-12T00:04:46.560497+0000","last_became_active":"2024-09-12T00:03:16.561218+0000","last_became_peered":"2024-09-12T00:03:16.561218+0000","last_unstale":"2024-09-12T00:04:46.560497+0000","last_undegraded":"2024-09-12T00:04:46.560497+0000","last_fullsized":"2024-09-12T00:04:46.560497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:43.089686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084170299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":79,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.585504+0000","last_change":"2024-09-12T00:03:27.341079+0000","last_active":"2024-09-12T00:04:46.585504+0000","last_peered":"2024-09-12T00:04:46.585504+0000","last_clean":"2024-09-12T00:04:46.585504+0000","last_became_active":"2024-09-12T00:03:27.340391+0000","last_became_peered":"2024-09-12T00:03:27.340391+0000","last_unstale":"2024-09-12T00:04:46.585504+0000","last_undegraded":"2024-09-12T00:04:46.585504+0000","last_fullsized":"2024-09-12T00:04:46.585504+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:10.048469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"63'42","reported_seq":143,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.555474+0000","last_change":"2024-09-12T00:03:29.346823+0000","last_active":"2024-09-12T00:04:48.555474+0000","last_peered":"2024-09-12T00:04:48.555474+0000","last_clean":"2024-09-12T00:04:48.555474+0000","last_became_active":"2024-09-12T00:03:29.346066+0000","last_became_peered":"2024-09-12T00:03:29.346066+0000","last_unstale":"2024-09-12T00:04:48.555474+0000","last_undegraded":"2024-09-12T00:04:48.555474+0000","last_fullsized":"2024-09-12T00:04:48.555474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:12.080794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62415,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":36,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":71,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.603749+0000","last_change":"2024-09-12T00:03:31.348574+0000","last_active":"2024-09-12T00:04:46.603749+0000","last_peered":"2024-09-12T00:04:46.603749+0000","last_clean":"2024-09-12T00:04:46.603749+0000","last_became_active":"2024-09-12T00:03:31.346511+0000","last_became_peered":"2024-09-12T00:03:31.346511+0000","last_unstale":"2024-09-12T00:04:46.603749+0000","last_undegraded":"2024-09-12T00:04:46.603749+0000","last_fullsized":"2024-09-12T00:04:46.603749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:14.061486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"59'7","reported_seq":78,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.560615+0000","last_change":"2024-09-12T00:03:33.385232+0000","last_active":"2024-09-12T00:04:46.560615+0000","last_peered":"2024-09-12T00:04:46.560615+0000","last_clean":"2024-09-12T00:04:46.560615+0000","last_became_active":"2024-09-12T00:03:33.384457+0000","last_became_peered":"2024-09-12T00:03:33.384457+0000","last_unstale":"2024-09-12T00:04:46.560615+0000","last_undegraded":"2024-09-12T00:04:46.560615+0000","last_fullsized":"2024-09-12T00:04:46.560615+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:34.615256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"58'2","reported_seq":94,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.563234+0000","last_change":"2024-09-12T00:03:25.334767+0000","last_active":"2024-09-12T00:04:46.563234+0000","last_peered":"2024-09-12T00:04:46.563234+0000","last_clean":"2024-09-12T00:04:46.563234+0000","last_became_active":"2024-09-12T00:03:25.332814+0000","last_became_peered":"2024-09-12T00:03:25.332814+0000","last_unstale":"2024-09-12T00:04:46.563234+0000","last_undegraded":"2024-09-12T00:04:46.563234+0000","last_fullsized":"2024-09-12T00:04:46.563234+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"63'6","reported_seq":95,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.813343+0000","last_change":"2024-09-12T00:03:23.628752+0000","last_active":"2024-09-12T00:04:47.813343+0000","last_peered":"2024-09-12T00:04:47.813343+0000","last_clean":"2024-09-12T00:04:47.813343+0000","last_became_active":"2024-09-12T00:03:23.628128+0000","last_became_peered":"2024-09-12T00:03:23.628128+0000","last_unstale":"2024-09-12T00:04:47.813343+0000","last_undegraded":"2024-09-12T00:04:47.813343+0000","last_fullsized":"2024-09-12T00:04:47.813343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":102,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574238+0000","last_change":"2024-09-12T00:03:18.566691+0000","last_active":"2024-09-12T00:04:46.574238+0000","last_peered":"2024-09-12T00:04:46.574238+0000","last_clean":"2024-09-12T00:04:46.574238+0000","last_became_active":"2024-09-12T00:03:16.553662+0000","last_became_peered":"2024-09-12T00:03:16.553662+0000","last_unstale":"2024-09-12T00:04:46.574238+0000","last_undegraded":"2024-09-12T00:04:46.574238+0000","last_fullsized":"2024-09-12T00:04:46.574238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:14.502459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011030910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574546+0000","last_change":"2024-09-12T00:03:27.316317+0000","last_active":"2024-09-12T00:04:46.574546+0000","last_peered":"2024-09-12T00:04:46.574546+0000","last_clean":"2024-09-12T00:04:46.574546+0000","last_became_active":"2024-09-12T00:03:27.315704+0000","last_became_peered":"2024-09-12T00:03:27.315704+0000","last_unstale":"2024-09-12T00:04:46.574546+0000","last_undegraded":"2024-09-12T00:04:46.574546+0000","last_fullsized":"2024-09-12T00:04:46.574546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:07.883485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'20","reported_seq":110,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.557573+0000","last_change":"2024-09-12T00:03:29.357640+0000","last_active":"2024-09-12T00:04:46.557573+0000","last_peered":"2024-09-12T00:04:46.557573+0000","last_clean":"2024-09-12T00:04:46.557573+0000","last_became_active":"2024-09-12T00:03:29.356183+0000","last_became_peered":"2024-09-12T00:03:29.356183+0000","last_unstale":"2024-09-12T00:04:46.557573+0000","last_undegraded":"2024-09-12T00:04:46.557573+0000","last_fullsized":"2024-09-12T00:04:46.557573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:41.818794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"63'92","reported_seq":181,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.470219+0000","last_change":"2024-09-12T00:03:31.357011+0000","last_active":"2024-09-12T00:04:48.470219+0000","last_peered":"2024-09-12T00:04:48.470219+0000","last_clean":"2024-09-12T00:04:48.470219+0000","last_became_active":"2024-09-12T00:03:31.356108+0000","last_became_peered":"2024-09-12T00:03:31.356108+0000","last_unstale":"2024-09-12T00:04:48.470219+0000","last_undegraded":"2024-09-12T00:04:48.470219+0000","last_fullsized":"2024-09-12T00:04:48.470219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"58'2","reported_seq":71,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.616446+0000","last_change":"2024-09-12T00:03:33.372465+0000","last_active":"2024-09-12T00:04:46.616446+0000","last_peered":"2024-09-12T00:04:46.616446+0000","last_clean":"2024-09-12T00:04:46.616446+0000","last_became_active":"2024-09-12T00:03:33.371214+0000","last_became_peered":"2024-09-12T00:03:33.371214+0000","last_unstale":"2024-09-12T00:04:46.616446+0000","last_undegraded":"2024-09-12T00:04:46.616446+0000","last_fullsized":"2024-09-12T00:04:46.616446+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:40.880933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":83,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.585154+0000","last_change":"2024-09-12T00:03:25.332405+0000","last_active":"2024-09-12T00:04:46.585154+0000","last_peered":"2024-09-12T00:04:46.585154+0000","last_clean":"2024-09-12T00:04:46.585154+0000","last_became_active":"2024-09-12T00:03:25.331250+0000","last_became_peered":"2024-09-12T00:03:25.331250+0000","last_unstale":"2024-09-12T00:04:46.585154+0000","last_undegraded":"2024-09-12T00:04:46.585154+0000","last_fullsized":"2024-09-12T00:04:46.585154+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"63'6","reported_seq":93,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.930398+0000","last_change":"2024-09-12T00:03:23.602222+0000","last_active":"2024-09-12T00:04:47.930398+0000","last_peered":"2024-09-12T00:04:47.930398+0000","last_clean":"2024-09-12T00:04:47.930398+0000","last_became_active":"2024-09-12T00:03:23.601481+0000","last_became_peered":"2024-09-12T00:03:23.601481+0000","last_unstale":"2024-09-12T00:04:47.930398+0000","last_undegraded":"2024-09-12T00:04:47.930398+0000","last_fullsized":"2024-09-12T00:04:47.930398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:56.636638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":100,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.586077+0000","last_change":"2024-09-12T00:03:18.716648+0000","last_active":"2024-09-12T00:04:46.586077+0000","last_peered":"2024-09-12T00:04:46.586077+0000","last_clean":"2024-09-12T00:04:46.586077+0000","last_became_active":"2024-09-12T00:03:16.594609+0000","last_became_peered":"2024-09-12T00:03:16.594609+0000","last_unstale":"2024-09-12T00:04:46.586077+0000","last_undegraded":"2024-09-12T00:04:46.586077+0000","last_fullsized":"2024-09-12T00:04:46.586077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:34.635008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010254439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.572885+0000","last_change":"2024-09-12T00:03:27.337871+0000","last_active":"2024-09-12T00:04:46.572885+0000","last_peered":"2024-09-12T00:04:46.572885+0000","last_clean":"2024-09-12T00:04:46.572885+0000","last_became_active":"2024-09-12T00:03:27.337299+0000","last_became_peered":"2024-09-12T00:03:27.337299+0000","last_unstale":"2024-09-12T00:04:46.572885+0000","last_undegraded":"2024-09-12T00:04:46.572885+0000","last_fullsized":"2024-09-12T00:04:46.572885+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:37.289387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"58'18","reported_seq":106,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.573419+0000","last_change":"2024-09-12T00:03:29.354380+0000","last_active":"2024-09-12T00:04:46.573419+0000","last_peered":"2024-09-12T00:04:46.573419+0000","last_clean":"2024-09-12T00:04:46.573419+0000","last_became_active":"2024-09-12T00:03:29.353644+0000","last_became_peered":"2024-09-12T00:03:29.353644+0000","last_unstale":"2024-09-12T00:04:46.573419+0000","last_undegraded":"2024-09-12T00:04:46.573419+0000","last_fullsized":"2024-09-12T00:04:46.573419+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:15.452219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"63'92","reported_seq":180,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.478531+0000","last_change":"2024-09-12T00:03:31.361616+0000","last_active":"2024-09-12T00:04:48.478531+0000","last_peered":"2024-09-12T00:04:48.478531+0000","last_clean":"2024-09-12T00:04:48.478531+0000","last_became_active":"2024-09-12T00:03:31.360518+0000","last_became_peered":"2024-09-12T00:03:31.360518+0000","last_unstale":"2024-09-12T00:04:48.478531+0000","last_undegraded":"2024-09-12T00:04:48.478531+0000","last_fullsized":"2024-09-12T00:04:48.478531+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:40.640537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":68,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.559929+0000","last_change":"2024-09-12T00:03:33.378417+0000","last_active":"2024-09-12T00:04:46.559929+0000","last_peered":"2024-09-12T00:04:46.559929+0000","last_clean":"2024-09-12T00:04:46.559929+0000","last_became_active":"2024-09-12T00:03:33.377669+0000","last_became_peered":"2024-09-12T00:03:33.377669+0000","last_unstale":"2024-09-12T00:04:46.559929+0000","last_undegraded":"2024-09-12T00:04:46.559929+0000","last_fullsized":"2024-09-12T00:04:46.559929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:04.623906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":109,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.604034+0000","last_change":"2024-09-12T00:03:25.318286+0000","last_active":"2024-09-12T00:04:46.604034+0000","last_peered":"2024-09-12T00:04:46.604034+0000","last_clean":"2024-09-12T00:04:46.604034+0000","last_became_active":"2024-09-12T00:03:25.317820+0000","last_became_peered":"2024-09-12T00:03:25.317820+0000","last_unstale":"2024-09-12T00:04:46.604034+0000","last_undegraded":"2024-09-12T00:04:46.604034+0000","last_fullsized":"2024-09-12T00:04:46.604034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:05.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"63'3","reported_seq":90,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.586005+0000","last_change":"2024-09-12T00:03:23.616319+0000","last_active":"2024-09-12T00:04:46.586005+0000","last_peered":"2024-09-12T00:04:46.586005+0000","last_clean":"2024-09-12T00:04:46.586005+0000","last_became_active":"2024-09-12T00:03:23.615158+0000","last_became_peered":"2024-09-12T00:03:23.615158+0000","last_unstale":"2024-09-12T00:04:46.586005+0000","last_undegraded":"2024-09-12T00:04:46.586005+0000","last_fullsized":"2024-09-12T00:04:46.586005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:15.677228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":102,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574723+0000","last_change":"2024-09-12T00:03:18.566832+0000","last_active":"2024-09-12T00:04:46.574723+0000","last_peered":"2024-09-12T00:04:46.574723+0000","last_clean":"2024-09-12T00:04:46.574723+0000","last_became_active":"2024-09-12T00:03:16.592377+0000","last_became_peered":"2024-09-12T00:03:16.592377+0000","last_unstale":"2024-09-12T00:04:46.574723+0000","last_undegraded":"2024-09-12T00:04:46.574723+0000","last_fullsized":"2024-09-12T00:04:46.574723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:31.379733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001199625,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":79,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.584764+0000","last_change":"2024-09-12T00:03:27.337359+0000","last_active":"2024-09-12T00:04:46.584764+0000","last_peered":"2024-09-12T00:04:46.584764+0000","last_clean":"2024-09-12T00:04:46.584764+0000","last_became_active":"2024-09-12T00:03:27.336289+0000","last_became_peered":"2024-09-12T00:03:27.336289+0000","last_unstale":"2024-09-12T00:04:46.584764+0000","last_undegraded":"2024-09-12T00:04:46.584764+0000","last_fullsized":"2024-09-12T00:04:46.584764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:39.147272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"63'41","reported_seq":141,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.525849+0000","last_change":"2024-09-12T00:03:29.344621+0000","last_active":"2024-09-12T00:04:48.525849+0000","last_peered":"2024-09-12T00:04:48.525849+0000","last_clean":"2024-09-12T00:04:48.525849+0000","last_became_active":"2024-09-12T00:03:29.343779+0000","last_became_peered":"2024-09-12T00:03:29.343779+0000","last_unstale":"2024-09-12T00:04:48.525849+0000","last_undegraded":"2024-09-12T00:04:48.525849+0000","last_fullsized":"2024-09-12T00:04:48.525849+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:49.518432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":71,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.585127+0000","last_change":"2024-09-12T00:03:31.335460+0000","last_active":"2024-09-12T00:04:46.585127+0000","last_peered":"2024-09-12T00:04:46.585127+0000","last_clean":"2024-09-12T00:04:46.585127+0000","last_became_active":"2024-09-12T00:03:31.334701+0000","last_became_peered":"2024-09-12T00:03:31.334701+0000","last_unstale":"2024-09-12T00:04:46.585127+0000","last_undegraded":"2024-09-12T00:04:46.585127+0000","last_fullsized":"2024-09-12T00:04:46.585127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:28.484366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"58'4","reported_seq":73,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.604149+0000","last_change":"2024-09-12T00:03:33.386404+0000","last_active":"2024-09-12T00:04:46.604149+0000","last_peered":"2024-09-12T00:04:46.604149+0000","last_clean":"2024-09-12T00:04:46.604149+0000","last_became_active":"2024-09-12T00:03:33.385090+0000","last_became_peered":"2024-09-12T00:03:33.385090+0000","last_unstale":"2024-09-12T00:04:46.604149+0000","last_undegraded":"2024-09-12T00:04:46.604149+0000","last_fullsized":"2024-09-12T00:04:46.604149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":67,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.586011+0000","last_change":"2024-09-12T00:03:33.361690+0000","last_active":"2024-09-12T00:04:46.586011+0000","last_peered":"2024-09-12T00:04:46.586011+0000","last_clean":"2024-09-12T00:04:46.586011+0000","last_became_active":"2024-09-12T00:03:33.360980+0000","last_became_peered":"2024-09-12T00:03:33.360980+0000","last_unstale":"2024-09-12T00:04:46.586011+0000","last_undegraded":"2024-09-12T00:04:46.586011+0000","last_fullsized":"2024-09-12T00:04:46.586011+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:24.954577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"59'2","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.604270+0000","last_change":"2024-09-12T00:03:25.335027+0000","last_active":"2024-09-12T00:04:46.604270+0000","last_peered":"2024-09-12T00:04:46.604270+0000","last_clean":"2024-09-12T00:04:46.604270+0000","last_became_active":"2024-09-12T00:03:25.334530+0000","last_became_peered":"2024-09-12T00:03:25.334530+0000","last_unstale":"2024-09-12T00:04:46.604270+0000","last_undegraded":"2024-09-12T00:04:46.604270+0000","last_fullsized":"2024-09-12T00:04:46.604270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"63'1","reported_seq":90,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574056+0000","last_change":"2024-09-12T00:03:23.618114+0000","last_active":"2024-09-12T00:04:46.574056+0000","last_peered":"2024-09-12T00:04:46.574056+0000","last_clean":"2024-09-12T00:04:46.574056+0000","last_became_active":"2024-09-12T00:03:23.617781+0000","last_became_peered":"2024-09-12T00:03:23.617781+0000","last_unstale":"2024-09-12T00:04:46.574056+0000","last_undegraded":"2024-09-12T00:04:46.574056+0000","last_fullsized":"2024-09-12T00:04:46.574056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:30.629135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"28'2","reported_seq":205,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.441603+0000","last_change":"2024-09-12T00:03:27.332281+0000","last_active":"2024-09-12T00:04:48.441603+0000","last_peered":"2024-09-12T00:04:48.441603+0000","last_clean":"2024-09-12T00:04:48.441603+0000","last_became_active":"2024-09-12T00:03:27.331527+0000","last_became_peered":"2024-09-12T00:03:27.331527+0000","last_unstale":"2024-09-12T00:04:48.441603+0000","last_undegraded":"2024-09-12T00:04:48.441603+0000","last_fullsized":"2024-09-12T00:04:48.441603+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"63'22","reported_seq":113,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.557728+0000","last_change":"2024-09-12T00:03:29.338655+0000","last_active":"2024-09-12T00:04:46.557728+0000","last_peered":"2024-09-12T00:04:46.557728+0000","last_clean":"2024-09-12T00:04:46.557728+0000","last_became_active":"2024-09-12T00:03:29.337905+0000","last_became_peered":"2024-09-12T00:03:29.337905+0000","last_unstale":"2024-09-12T00:04:46.557728+0000","last_undegraded":"2024-09-12T00:04:46.557728+0000","last_fullsized":"2024-09-12T00:04:46.557728+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":71,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.614389+0000","last_change":"2024-09-12T00:03:31.351716+0000","last_active":"2024-09-12T00:04:46.614389+0000","last_peered":"2024-09-12T00:04:46.614389+0000","last_clean":"2024-09-12T00:04:46.614389+0000","last_became_active":"2024-09-12T00:03:31.350917+0000","last_became_peered":"2024-09-12T00:03:31.350917+0000","last_unstale":"2024-09-12T00:04:46.614389+0000","last_undegraded":"2024-09-12T00:04:46.614389+0000","last_fullsized":"2024-09-12T00:04:46.614389+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:45.880820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":67,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.615465+0000","last_change":"2024-09-12T00:03:33.374233+0000","last_active":"2024-09-12T00:04:46.615465+0000","last_peered":"2024-09-12T00:04:46.615465+0000","last_clean":"2024-09-12T00:04:46.615465+0000","last_became_active":"2024-09-12T00:03:33.373466+0000","last_became_peered":"2024-09-12T00:03:33.373466+0000","last_unstale":"2024-09-12T00:04:46.615465+0000","last_undegraded":"2024-09-12T00:04:46.615465+0000","last_fullsized":"2024-09-12T00:04:46.615465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:55.598892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"59'2","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.584883+0000","last_change":"2024-09-12T00:03:25.319144+0000","last_active":"2024-09-12T00:04:46.584883+0000","last_peered":"2024-09-12T00:04:46.584883+0000","last_clean":"2024-09-12T00:04:46.584883+0000","last_became_active":"2024-09-12T00:03:25.318362+0000","last_became_peered":"2024-09-12T00:03:25.318362+0000","last_unstale":"2024-09-12T00:04:46.584883+0000","last_undegraded":"2024-09-12T00:04:46.584883+0000","last_fullsized":"2024-09-12T00:04:46.584883+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"63'3","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.422845+0000","last_change":"2024-09-12T00:03:23.613274+0000","last_active":"2024-09-12T00:04:47.422845+0000","last_peered":"2024-09-12T00:04:47.422845+0000","last_clean":"2024-09-12T00:04:47.422845+0000","last_became_active":"2024-09-12T00:03:23.612941+0000","last_became_peered":"2024-09-12T00:03:23.612941+0000","last_unstale":"2024-09-12T00:04:47.422845+0000","last_undegraded":"2024-09-12T00:04:47.422845+0000","last_fullsized":"2024-09-12T00:04:47.422845+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:56.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":79,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.585053+0000","last_change":"2024-09-12T00:03:27.336144+0000","last_active":"2024-09-12T00:04:46.585053+0000","last_peered":"2024-09-12T00:04:46.585053+0000","last_clean":"2024-09-12T00:04:46.585053+0000","last_became_active":"2024-09-12T00:03:27.335372+0000","last_became_peered":"2024-09-12T00:03:27.335372+0000","last_unstale":"2024-09-12T00:04:46.585053+0000","last_undegraded":"2024-09-12T00:04:46.585053+0000","last_fullsized":"2024-09-12T00:04:46.585053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:33.978665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"59'6","reported_seq":83,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.584460+0000","last_change":"2024-09-12T00:03:29.332051+0000","last_active":"2024-09-12T00:04:46.584460+0000","last_peered":"2024-09-12T00:04:46.584460+0000","last_clean":"2024-09-12T00:04:46.584460+0000","last_became_active":"2024-09-12T00:03:29.331243+0000","last_became_peered":"2024-09-12T00:03:29.331243+0000","last_unstale":"2024-09-12T00:04:46.584460+0000","last_undegraded":"2024-09-12T00:04:46.584460+0000","last_fullsized":"2024-09-12T00:04:46.584460+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:52.544770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":14,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":71,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.603658+0000","last_change":"2024-09-12T00:03:31.347021+0000","last_active":"2024-09-12T00:04:46.603658+0000","last_peered":"2024-09-12T00:04:46.603658+0000","last_clean":"2024-09-12T00:04:46.603658+0000","last_became_active":"2024-09-12T00:03:31.344407+0000","last_became_peered":"2024-09-12T00:03:31.344407+0000","last_unstale":"2024-09-12T00:04:46.603658+0000","last_undegraded":"2024-09-12T00:04:46.603658+0000","last_fullsized":"2024-09-12T00:04:46.603658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:32.139742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":69,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.562964+0000","last_change":"2024-09-12T00:03:33.370271+0000","last_active":"2024-09-12T00:04:46.562964+0000","last_peered":"2024-09-12T00:04:46.562964+0000","last_clean":"2024-09-12T00:04:46.562964+0000","last_became_active":"2024-09-12T00:03:33.369538+0000","last_became_peered":"2024-09-12T00:03:33.369538+0000","last_unstale":"2024-09-12T00:04:46.562964+0000","last_undegraded":"2024-09-12T00:04:46.562964+0000","last_fullsized":"2024-09-12T00:04:46.562964+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"59'2","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.585771+0000","last_change":"2024-09-12T00:03:25.341025+0000","last_active":"2024-09-12T00:04:46.585771+0000","last_peered":"2024-09-12T00:04:46.585771+0000","last_clean":"2024-09-12T00:04:46.585771+0000","last_became_active":"2024-09-12T00:03:25.340288+0000","last_became_peered":"2024-09-12T00:03:25.340288+0000","last_unstale":"2024-09-12T00:04:46.585771+0000","last_undegraded":"2024-09-12T00:04:46.585771+0000","last_fullsized":"2024-09-12T00:04:46.585771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"63'7","reported_seq":95,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.708434+0000","last_change":"2024-09-12T00:03:23.612814+0000","last_active":"2024-09-12T00:04:47.708434+0000","last_peered":"2024-09-12T00:04:47.708434+0000","last_clean":"2024-09-12T00:04:47.708434+0000","last_became_active":"2024-09-12T00:03:23.612332+0000","last_became_peered":"2024-09-12T00:03:23.612332+0000","last_unstale":"2024-09-12T00:04:47.708434+0000","last_undegraded":"2024-09-12T00:04:47.708434+0000","last_fullsized":"2024-09-12T00:04:47.708434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:02.202230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":79,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.603558+0000","last_change":"2024-09-12T00:03:27.329869+0000","last_active":"2024-09-12T00:04:46.603558+0000","last_peered":"2024-09-12T00:04:46.603558+0000","last_clean":"2024-09-12T00:04:46.603558+0000","last_became_active":"2024-09-12T00:03:27.329077+0000","last_became_peered":"2024-09-12T00:03:27.329077+0000","last_unstale":"2024-09-12T00:04:46.603558+0000","last_undegraded":"2024-09-12T00:04:46.603558+0000","last_fullsized":"2024-09-12T00:04:46.603558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"63'16","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.615460+0000","last_change":"2024-09-12T00:03:29.346878+0000","last_active":"2024-09-12T00:04:46.615460+0000","last_peered":"2024-09-12T00:04:46.615460+0000","last_clean":"2024-09-12T00:04:46.615460+0000","last_became_active":"2024-09-12T00:03:29.345990+0000","last_became_peered":"2024-09-12T00:03:29.345990+0000","last_unstale":"2024-09-12T00:04:46.615460+0000","last_undegraded":"2024-09-12T00:04:46.615460+0000","last_fullsized":"2024-09-12T00:04:46.615460+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:06.398979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":73,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.557567+0000","last_change":"2024-09-12T00:03:31.363658+0000","last_active":"2024-09-12T00:04:46.557567+0000","last_peered":"2024-09-12T00:04:46.557567+0000","last_clean":"2024-09-12T00:04:46.557567+0000","last_became_active":"2024-09-12T00:03:31.363080+0000","last_became_peered":"2024-09-12T00:03:31.363080+0000","last_unstale":"2024-09-12T00:04:46.557567+0000","last_undegraded":"2024-09-12T00:04:46.557567+0000","last_fullsized":"2024-09-12T00:04:46.557567+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:05.901608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":69,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.573639+0000","last_change":"2024-09-12T00:03:33.380447+0000","last_active":"2024-09-12T00:04:46.573639+0000","last_peered":"2024-09-12T00:04:46.573639+0000","last_clean":"2024-09-12T00:04:46.573639+0000","last_became_active":"2024-09-12T00:03:33.379701+0000","last_became_peered":"2024-09-12T00:03:33.379701+0000","last_unstale":"2024-09-12T00:04:46.573639+0000","last_undegraded":"2024-09-12T00:04:46.573639+0000","last_fullsized":"2024-09-12T00:04:46.573639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:55.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"59'2","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.615956+0000","last_change":"2024-09-12T00:03:25.330916+0000","last_active":"2024-09-12T00:04:46.615956+0000","last_peered":"2024-09-12T00:04:46.615956+0000","last_clean":"2024-09-12T00:04:46.615956+0000","last_became_active":"2024-09-12T00:03:25.330181+0000","last_became_peered":"2024-09-12T00:03:25.330181+0000","last_unstale":"2024-09-12T00:04:46.615956+0000","last_undegraded":"2024-09-12T00:04:46.615956+0000","last_fullsized":"2024-09-12T00:04:46.615956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:03.153020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"63'5","reported_seq":93,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.044592+0000","last_change":"2024-09-12T00:03:23.618613+0000","last_active":"2024-09-12T00:04:48.044592+0000","last_peered":"2024-09-12T00:04:48.044592+0000","last_clean":"2024-09-12T00:04:48.044592+0000","last_became_active":"2024-09-12T00:03:23.617587+0000","last_became_peered":"2024-09-12T00:03:23.617587+0000","last_unstale":"2024-09-12T00:04:48.044592+0000","last_undegraded":"2024-09-12T00:04:48.044592+0000","last_fullsized":"2024-09-12T00:04:48.044592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:54.211904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.572776+0000","last_change":"2024-09-12T00:03:27.330320+0000","last_active":"2024-09-12T00:04:46.572776+0000","last_peered":"2024-09-12T00:04:46.572776+0000","last_clean":"2024-09-12T00:04:46.572776+0000","last_became_active":"2024-09-12T00:03:27.329236+0000","last_became_peered":"2024-09-12T00:03:27.329236+0000","last_unstale":"2024-09-12T00:04:46.572776+0000","last_undegraded":"2024-09-12T00:04:46.572776+0000","last_fullsized":"2024-09-12T00:04:46.572776+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:57.407947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"63'15","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574520+0000","last_change":"2024-09-12T00:03:29.346312+0000","last_active":"2024-09-12T00:04:46.574520+0000","last_peered":"2024-09-12T00:04:46.574520+0000","last_clean":"2024-09-12T00:04:46.574520+0000","last_became_active":"2024-09-12T00:03:29.345883+0000","last_became_peered":"2024-09-12T00:03:29.345883+0000","last_unstale":"2024-09-12T00:04:46.574520+0000","last_undegraded":"2024-09-12T00:04:46.574520+0000","last_fullsized":"2024-09-12T00:04:46.574520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:46.723370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":71,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.615000+0000","last_change":"2024-09-12T00:03:31.358786+0000","last_active":"2024-09-12T00:04:46.615000+0000","last_peered":"2024-09-12T00:04:46.615000+0000","last_clean":"2024-09-12T00:04:46.615000+0000","last_became_active":"2024-09-12T00:03:31.358011+0000","last_became_peered":"2024-09-12T00:03:31.358011+0000","last_unstale":"2024-09-12T00:04:46.615000+0000","last_undegraded":"2024-09-12T00:04:46.615000+0000","last_fullsized":"2024-09-12T00:04:46.615000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:29.394163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"59'2","reported_seq":93,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574291+0000","last_change":"2024-09-12T00:03:25.351065+0000","last_active":"2024-09-12T00:04:46.574291+0000","last_peered":"2024-09-12T00:04:46.574291+0000","last_clean":"2024-09-12T00:04:46.574291+0000","last_became_active":"2024-09-12T00:03:25.350719+0000","last_became_peered":"2024-09-12T00:03:25.350719+0000","last_unstale":"2024-09-12T00:04:46.574291+0000","last_undegraded":"2024-09-12T00:04:46.574291+0000","last_fullsized":"2024-09-12T00:04:46.574291+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:54.693130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"63'5","reported_seq":93,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.108745+0000","last_change":"2024-09-12T00:03:23.627584+0000","last_active":"2024-09-12T00:04:47.108745+0000","last_peered":"2024-09-12T00:04:47.108745+0000","last_clean":"2024-09-12T00:04:47.108745+0000","last_became_active":"2024-09-12T00:03:23.626026+0000","last_became_peered":"2024-09-12T00:03:23.626026+0000","last_unstale":"2024-09-12T00:04:47.108745+0000","last_undegraded":"2024-09-12T00:04:47.108745+0000","last_fullsized":"2024-09-12T00:04:47.108745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:38.192583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.563476+0000","last_change":"2024-09-12T00:03:27.335297+0000","last_active":"2024-09-12T00:04:46.563476+0000","last_peered":"2024-09-12T00:04:46.563476+0000","last_clean":"2024-09-12T00:04:46.563476+0000","last_became_active":"2024-09-12T00:03:27.334570+0000","last_became_peered":"2024-09-12T00:03:27.334570+0000","last_unstale":"2024-09-12T00:04:46.563476+0000","last_undegraded":"2024-09-12T00:04:46.563476+0000","last_fullsized":"2024-09-12T00:04:46.563476+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"63'29","reported_seq":123,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.505282+0000","last_change":"2024-09-12T00:03:29.340387+0000","last_active":"2024-09-12T00:04:48.505282+0000","last_peered":"2024-09-12T00:04:48.505282+0000","last_clean":"2024-09-12T00:04:48.505282+0000","last_became_active":"2024-09-12T00:03:29.339781+0000","last_became_peered":"2024-09-12T00:03:29.339781+0000","last_unstale":"2024-09-12T00:04:48.505282+0000","last_undegraded":"2024-09-12T00:04:48.505282+0000","last_fullsized":"2024-09-12T00:04:48.505282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:30.132716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":71,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.604232+0000","last_change":"2024-09-12T00:03:31.350303+0000","last_active":"2024-09-12T00:04:46.604232+0000","last_peered":"2024-09-12T00:04:46.604232+0000","last_clean":"2024-09-12T00:04:46.604232+0000","last_became_active":"2024-09-12T00:03:31.349591+0000","last_became_peered":"2024-09-12T00:03:31.349591+0000","last_unstale":"2024-09-12T00:04:46.604232+0000","last_undegraded":"2024-09-12T00:04:46.604232+0000","last_fullsized":"2024-09-12T00:04:46.604232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:00.263644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":68,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.559754+0000","last_change":"2024-09-12T00:03:33.385028+0000","last_active":"2024-09-12T00:04:46.559754+0000","last_peered":"2024-09-12T00:04:46.559754+0000","last_clean":"2024-09-12T00:04:46.559754+0000","last_became_active":"2024-09-12T00:03:33.384274+0000","last_became_peered":"2024-09-12T00:03:33.384274+0000","last_unstale":"2024-09-12T00:04:46.559754+0000","last_undegraded":"2024-09-12T00:04:46.559754+0000","last_fullsized":"2024-09-12T00:04:46.559754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:11.634604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"58'2","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.585920+0000","last_change":"2024-09-12T00:03:25.329888+0000","last_active":"2024-09-12T00:04:46.585920+0000","last_peered":"2024-09-12T00:04:46.585920+0000","last_clean":"2024-09-12T00:04:46.585920+0000","last_became_active":"2024-09-12T00:03:25.329151+0000","last_became_peered":"2024-09-12T00:03:25.329151+0000","last_unstale":"2024-09-12T00:04:46.585920+0000","last_undegraded":"2024-09-12T00:04:46.585920+0000","last_fullsized":"2024-09-12T00:04:46.585920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:47.272383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"62'2","reported_seq":89,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.588039+0000","last_change":"2024-09-12T00:03:23.600146+0000","last_active":"2024-09-12T00:04:46.588039+0000","last_peered":"2024-09-12T00:04:46.588039+0000","last_clean":"2024-09-12T00:04:46.588039+0000","last_became_active":"2024-09-12T00:03:23.598862+0000","last_became_peered":"2024-09-12T00:03:23.598862+0000","last_unstale":"2024-09-12T00:04:46.588039+0000","last_undegraded":"2024-09-12T00:04:46.588039+0000","last_fullsized":"2024-09-12T00:04:46.588039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:13.330852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":79,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.604446+0000","last_change":"2024-09-12T00:03:27.341032+0000","last_active":"2024-09-12T00:04:46.604446+0000","last_peered":"2024-09-12T00:04:46.604446+0000","last_clean":"2024-09-12T00:04:46.604446+0000","last_became_active":"2024-09-12T00:03:27.340199+0000","last_became_peered":"2024-09-12T00:03:27.340199+0000","last_unstale":"2024-09-12T00:04:46.604446+0000","last_undegraded":"2024-09-12T00:04:46.604446+0000","last_fullsized":"2024-09-12T00:04:46.604446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:23.673080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"63'20","reported_seq":107,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.573904+0000","last_change":"2024-09-12T00:03:29.349125+0000","last_active":"2024-09-12T00:04:46.573904+0000","last_peered":"2024-09-12T00:04:46.573904+0000","last_clean":"2024-09-12T00:04:46.573904+0000","last_became_active":"2024-09-12T00:03:29.348145+0000","last_became_peered":"2024-09-12T00:03:29.348145+0000","last_unstale":"2024-09-12T00:04:46.573904+0000","last_undegraded":"2024-09-12T00:04:46.573904+0000","last_fullsized":"2024-09-12T00:04:46.573904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:55.699040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":72,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.560276+0000","last_change":"2024-09-12T00:03:31.363427+0000","last_active":"2024-09-12T00:04:46.560276+0000","last_peered":"2024-09-12T00:04:46.560276+0000","last_clean":"2024-09-12T00:04:46.560276+0000","last_became_active":"2024-09-12T00:03:31.362578+0000","last_became_peered":"2024-09-12T00:03:31.362578+0000","last_unstale":"2024-09-12T00:04:46.560276+0000","last_undegraded":"2024-09-12T00:04:46.560276+0000","last_fullsized":"2024-09-12T00:04:46.560276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:17.357647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"59'3","reported_seq":73,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.573831+0000","last_change":"2024-09-12T00:03:33.375115+0000","last_active":"2024-09-12T00:04:46.573831+0000","last_peered":"2024-09-12T00:04:46.573831+0000","last_clean":"2024-09-12T00:04:46.573831+0000","last_became_active":"2024-09-12T00:03:33.374310+0000","last_became_peered":"2024-09-12T00:03:33.374310+0000","last_unstale":"2024-09-12T00:04:46.573831+0000","last_undegraded":"2024-09-12T00:04:46.573831+0000","last_fullsized":"2024-09-12T00:04:46.573831+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:46.466723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"59'2","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.615721+0000","last_change":"2024-09-12T00:03:25.360355+0000","last_active":"2024-09-12T00:04:46.615721+0000","last_peered":"2024-09-12T00:04:46.615721+0000","last_clean":"2024-09-12T00:04:46.615721+0000","last_became_active":"2024-09-12T00:03:25.359682+0000","last_became_peered":"2024-09-12T00:03:25.359682+0000","last_unstale":"2024-09-12T00:04:46.615721+0000","last_undegraded":"2024-09-12T00:04:46.615721+0000","last_fullsized":"2024-09-12T00:04:46.615721+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:11.808081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"63'6","reported_seq":95,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.300827+0000","last_change":"2024-09-12T00:03:23.621199+0000","last_active":"2024-09-12T00:04:48.300827+0000","last_peered":"2024-09-12T00:04:48.300827+0000","last_clean":"2024-09-12T00:04:48.300827+0000","last_became_active":"2024-09-12T00:03:23.620961+0000","last_became_peered":"2024-09-12T00:03:23.620961+0000","last_unstale":"2024-09-12T00:04:48.300827+0000","last_undegraded":"2024-09-12T00:04:48.300827+0000","last_fullsized":"2024-09-12T00:04:48.300827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":79,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.604588+0000","last_change":"2024-09-12T00:03:27.336918+0000","last_active":"2024-09-12T00:04:46.604588+0000","last_peered":"2024-09-12T00:04:46.604588+0000","last_clean":"2024-09-12T00:04:46.604588+0000","last_became_active":"2024-09-12T00:03:27.336045+0000","last_became_peered":"2024-09-12T00:03:27.336045+0000","last_unstale":"2024-09-12T00:04:46.604588+0000","last_undegraded":"2024-09-12T00:04:46.604588+0000","last_fullsized":"2024-09-12T00:04:46.604588+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"63'22","reported_seq":113,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.563603+0000","last_change":"2024-09-12T00:03:29.338667+0000","last_active":"2024-09-12T00:04:46.563603+0000","last_peered":"2024-09-12T00:04:46.563603+0000","last_clean":"2024-09-12T00:04:46.563603+0000","last_became_active":"2024-09-12T00:03:29.338010+0000","last_became_peered":"2024-09-12T00:03:29.338010+0000","last_unstale":"2024-09-12T00:04:46.563603+0000","last_undegraded":"2024-09-12T00:04:46.563603+0000","last_fullsized":"2024-09-12T00:04:46.563603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:58.256619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":71,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.615382+0000","last_change":"2024-09-12T00:03:31.352823+0000","last_active":"2024-09-12T00:04:46.615382+0000","last_peered":"2024-09-12T00:04:46.615382+0000","last_clean":"2024-09-12T00:04:46.615382+0000","last_became_active":"2024-09-12T00:03:31.352143+0000","last_became_peered":"2024-09-12T00:03:31.352143+0000","last_unstale":"2024-09-12T00:04:46.615382+0000","last_undegraded":"2024-09-12T00:04:46.615382+0000","last_fullsized":"2024-09-12T00:04:46.615382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:25.168692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"59'6","reported_seq":79,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.572478+0000","last_change":"2024-09-12T00:03:33.379330+0000","last_active":"2024-09-12T00:04:46.572478+0000","last_peered":"2024-09-12T00:04:46.572478+0000","last_clean":"2024-09-12T00:04:46.572478+0000","last_became_active":"2024-09-12T00:03:33.376228+0000","last_became_peered":"2024-09-12T00:03:33.376228+0000","last_unstale":"2024-09-12T00:04:46.572478+0000","last_undegraded":"2024-09-12T00:04:46.572478+0000","last_fullsized":"2024-09-12T00:04:46.572478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:44.364562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"58'2","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.586417+0000","last_change":"2024-09-12T00:03:25.325094+0000","last_active":"2024-09-12T00:04:46.586417+0000","last_peered":"2024-09-12T00:04:46.586417+0000","last_clean":"2024-09-12T00:04:46.586417+0000","last_became_active":"2024-09-12T00:03:25.324315+0000","last_became_peered":"2024-09-12T00:03:25.324315+0000","last_unstale":"2024-09-12T00:04:46.586417+0000","last_undegraded":"2024-09-12T00:04:46.586417+0000","last_fullsized":"2024-09-12T00:04:46.586417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:18.727732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"63'7","reported_seq":94,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.838013+0000","last_change":"2024-09-12T00:03:23.606163+0000","last_active":"2024-09-12T00:04:47.838013+0000","last_peered":"2024-09-12T00:04:47.838013+0000","last_clean":"2024-09-12T00:04:47.838013+0000","last_became_active":"2024-09-12T00:03:23.605402+0000","last_became_peered":"2024-09-12T00:03:23.605402+0000","last_unstale":"2024-09-12T00:04:47.838013+0000","last_undegraded":"2024-09-12T00:04:47.838013+0000","last_fullsized":"2024-09-12T00:04:47.838013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:02.432313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":79,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.586580+0000","last_change":"2024-09-12T00:03:27.336716+0000","last_active":"2024-09-12T00:04:46.586580+0000","last_peered":"2024-09-12T00:04:46.586580+0000","last_clean":"2024-09-12T00:04:46.586580+0000","last_became_active":"2024-09-12T00:03:27.335658+0000","last_became_peered":"2024-09-12T00:03:27.335658+0000","last_unstale":"2024-09-12T00:04:46.586580+0000","last_undegraded":"2024-09-12T00:04:46.586580+0000","last_fullsized":"2024-09-12T00:04:46.586580+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:47.355798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"35'16","reported_seq":104,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574011+0000","last_change":"2024-09-12T00:03:29.354481+0000","last_active":"2024-09-12T00:04:46.574011+0000","last_peered":"2024-09-12T00:04:46.574011+0000","last_clean":"2024-09-12T00:04:46.574011+0000","last_became_active":"2024-09-12T00:03:29.353656+0000","last_became_peered":"2024-09-12T00:03:29.353656+0000","last_unstale":"2024-09-12T00:04:46.574011+0000","last_undegraded":"2024-09-12T00:04:46.574011+0000","last_fullsized":"2024-09-12T00:04:46.574011+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:42.984798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"63'92","reported_seq":181,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.468053+0000","last_change":"2024-09-12T00:03:31.351362+0000","last_active":"2024-09-12T00:04:48.468053+0000","last_peered":"2024-09-12T00:04:48.468053+0000","last_clean":"2024-09-12T00:04:48.468053+0000","last_became_active":"2024-09-12T00:03:31.350925+0000","last_became_peered":"2024-09-12T00:03:31.350925+0000","last_unstale":"2024-09-12T00:04:48.468053+0000","last_undegraded":"2024-09-12T00:04:48.468053+0000","last_fullsized":"2024-09-12T00:04:48.468053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:03.147968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":69,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.572482+0000","last_change":"2024-09-12T00:03:33.374932+0000","last_active":"2024-09-12T00:04:46.572482+0000","last_peered":"2024-09-12T00:04:46.572482+0000","last_clean":"2024-09-12T00:04:46.572482+0000","last_became_active":"2024-09-12T00:03:33.374185+0000","last_became_peered":"2024-09-12T00:03:33.374185+0000","last_unstale":"2024-09-12T00:04:46.572482+0000","last_undegraded":"2024-09-12T00:04:46.572482+0000","last_fullsized":"2024-09-12T00:04:46.572482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:54.883339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"59'4","reported_seq":100,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.604171+0000","last_change":"2024-09-12T00:03:25.357999+0000","last_active":"2024-09-12T00:04:46.604171+0000","last_peered":"2024-09-12T00:04:46.604171+0000","last_clean":"2024-09-12T00:04:46.604171+0000","last_became_active":"2024-09-12T00:03:25.357623+0000","last_became_peered":"2024-09-12T00:03:25.357623+0000","last_unstale":"2024-09-12T00:04:46.604171+0000","last_undegraded":"2024-09-12T00:04:46.604171+0000","last_fullsized":"2024-09-12T00:04:46.604171+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"63'3","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.833045+0000","last_change":"2024-09-12T00:03:23.605954+0000","last_active":"2024-09-12T00:04:46.833045+0000","last_peered":"2024-09-12T00:04:46.833045+0000","last_clean":"2024-09-12T00:04:46.833045+0000","last_became_active":"2024-09-12T00:03:23.604773+0000","last_became_peered":"2024-09-12T00:03:23.604773+0000","last_unstale":"2024-09-12T00:04:46.833045+0000","last_undegraded":"2024-09-12T00:04:46.833045+0000","last_fullsized":"2024-09-12T00:04:46.833045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.558871+0000","last_change":"2024-09-12T00:03:27.346785+0000","last_active":"2024-09-12T00:04:46.558871+0000","last_peered":"2024-09-12T00:04:46.558871+0000","last_clean":"2024-09-12T00:04:46.558871+0000","last_became_active":"2024-09-12T00:03:27.346168+0000","last_became_peered":"2024-09-12T00:03:27.346168+0000","last_unstale":"2024-09-12T00:04:46.558871+0000","last_undegraded":"2024-09-12T00:04:46.558871+0000","last_fullsized":"2024-09-12T00:04:46.558871+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"63'45","reported_seq":156,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574542+0000","last_change":"2024-09-12T00:03:29.343942+0000","last_active":"2024-09-12T00:04:46.574542+0000","last_peered":"2024-09-12T00:04:46.574542+0000","last_clean":"2024-09-12T00:04:46.574542+0000","last_became_active":"2024-09-12T00:03:29.343238+0000","last_became_peered":"2024-09-12T00:03:29.343238+0000","last_unstale":"2024-09-12T00:04:46.574542+0000","last_undegraded":"2024-09-12T00:04:46.574542+0000","last_fullsized":"2024-09-12T00:04:46.574542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:30.949892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":71,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.584658+0000","last_change":"2024-09-12T00:03:31.348120+0000","last_active":"2024-09-12T00:04:46.584658+0000","last_peered":"2024-09-12T00:04:46.584658+0000","last_clean":"2024-09-12T00:04:46.584658+0000","last_became_active":"2024-09-12T00:03:31.344599+0000","last_became_peered":"2024-09-12T00:03:31.344599+0000","last_unstale":"2024-09-12T00:04:46.584658+0000","last_undegraded":"2024-09-12T00:04:46.584658+0000","last_fullsized":"2024-09-12T00:04:46.584658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:00.279625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":69,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.561672+0000","last_change":"2024-09-12T00:03:33.363188+0000","last_active":"2024-09-12T00:04:46.561672+0000","last_peered":"2024-09-12T00:04:46.561672+0000","last_clean":"2024-09-12T00:04:46.561672+0000","last_became_active":"2024-09-12T00:03:33.360672+0000","last_became_peered":"2024-09-12T00:03:33.360672+0000","last_unstale":"2024-09-12T00:04:46.561672+0000","last_undegraded":"2024-09-12T00:04:46.561672+0000","last_fullsized":"2024-09-12T00:04:46.561672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:33.646117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"59'4","reported_seq":100,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.603835+0000","last_change":"2024-09-12T00:03:25.336626+0000","last_active":"2024-09-12T00:04:46.603835+0000","last_peered":"2024-09-12T00:04:46.603835+0000","last_clean":"2024-09-12T00:04:46.603835+0000","last_became_active":"2024-09-12T00:03:25.336095+0000","last_became_peered":"2024-09-12T00:03:25.336095+0000","last_unstale":"2024-09-12T00:04:46.603835+0000","last_undegraded":"2024-09-12T00:04:46.603835+0000","last_fullsized":"2024-09-12T00:04:46.603835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"63'5","reported_seq":94,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.650677+0000","last_change":"2024-09-12T00:03:23.601889+0000","last_active":"2024-09-12T00:04:47.650677+0000","last_peered":"2024-09-12T00:04:47.650677+0000","last_clean":"2024-09-12T00:04:47.650677+0000","last_became_active":"2024-09-12T00:03:23.601553+0000","last_became_peered":"2024-09-12T00:03:23.601553+0000","last_unstale":"2024-09-12T00:04:47.650677+0000","last_undegraded":"2024-09-12T00:04:47.650677+0000","last_fullsized":"2024-09-12T00:04:47.650677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:08.758769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":79,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.604011+0000","last_change":"2024-09-12T00:03:27.326174+0000","last_active":"2024-09-12T00:04:46.604011+0000","last_peered":"2024-09-12T00:04:46.604011+0000","last_clean":"2024-09-12T00:04:46.604011+0000","last_became_active":"2024-09-12T00:03:27.325336+0000","last_became_peered":"2024-09-12T00:03:27.325336+0000","last_unstale":"2024-09-12T00:04:46.604011+0000","last_undegraded":"2024-09-12T00:04:46.604011+0000","last_fullsized":"2024-09-12T00:04:46.604011+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:08.659813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"63'20","reported_seq":108,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.585296+0000","last_change":"2024-09-12T00:03:29.335957+0000","last_active":"2024-09-12T00:04:46.585296+0000","last_peered":"2024-09-12T00:04:46.585296+0000","last_clean":"2024-09-12T00:04:46.585296+0000","last_became_active":"2024-09-12T00:03:29.335186+0000","last_became_peered":"2024-09-12T00:03:29.335186+0000","last_unstale":"2024-09-12T00:04:46.585296+0000","last_undegraded":"2024-09-12T00:04:46.585296+0000","last_fullsized":"2024-09-12T00:04:46.585296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:20.551758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":73,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.572801+0000","last_change":"2024-09-12T00:03:31.350287+0000","last_active":"2024-09-12T00:04:46.572801+0000","last_peered":"2024-09-12T00:04:46.572801+0000","last_clean":"2024-09-12T00:04:46.572801+0000","last_became_active":"2024-09-12T00:03:31.349890+0000","last_became_peered":"2024-09-12T00:03:31.349890+0000","last_unstale":"2024-09-12T00:04:46.572801+0000","last_undegraded":"2024-09-12T00:04:46.572801+0000","last_fullsized":"2024-09-12T00:04:46.572801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:33.081032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":68,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.560337+0000","last_change":"2024-09-12T00:03:33.385037+0000","last_active":"2024-09-12T00:04:46.560337+0000","last_peered":"2024-09-12T00:04:46.560337+0000","last_clean":"2024-09-12T00:04:46.560337+0000","last_became_active":"2024-09-12T00:03:33.384379+0000","last_became_peered":"2024-09-12T00:03:33.384379+0000","last_unstale":"2024-09-12T00:04:46.560337+0000","last_undegraded":"2024-09-12T00:04:46.560337+0000","last_fullsized":"2024-09-12T00:04:46.560337+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:00.153475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"59'6","reported_seq":108,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.614694+0000","last_change":"2024-09-12T00:03:25.339110+0000","last_active":"2024-09-12T00:04:46.614694+0000","last_peered":"2024-09-12T00:04:46.614694+0000","last_clean":"2024-09-12T00:04:46.614694+0000","last_became_active":"2024-09-12T00:03:25.338417+0000","last_became_peered":"2024-09-12T00:03:25.338417+0000","last_unstale":"2024-09-12T00:04:46.614694+0000","last_undegraded":"2024-09-12T00:04:46.614694+0000","last_fullsized":"2024-09-12T00:04:46.614694+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:48.866021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"63'4","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.327987+0000","last_change":"2024-09-12T00:03:23.625514+0000","last_active":"2024-09-12T00:04:47.327987+0000","last_peered":"2024-09-12T00:04:47.327987+0000","last_clean":"2024-09-12T00:04:47.327987+0000","last_became_active":"2024-09-12T00:03:23.621654+0000","last_became_peered":"2024-09-12T00:03:23.621654+0000","last_unstale":"2024-09-12T00:04:47.327987+0000","last_undegraded":"2024-09-12T00:04:47.327987+0000","last_fullsized":"2024-09-12T00:04:47.327987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:43.784497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.557515+0000","last_change":"2024-09-12T00:03:27.330377+0000","last_active":"2024-09-12T00:04:46.557515+0000","last_peered":"2024-09-12T00:04:46.557515+0000","last_clean":"2024-09-12T00:04:46.557515+0000","last_became_active":"2024-09-12T00:03:27.329713+0000","last_became_peered":"2024-09-12T00:03:27.329713+0000","last_unstale":"2024-09-12T00:04:46.557515+0000","last_undegraded":"2024-09-12T00:04:46.557515+0000","last_fullsized":"2024-09-12T00:04:46.557515+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"63'16","reported_seq":104,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.562829+0000","last_change":"2024-09-12T00:03:29.337028+0000","last_active":"2024-09-12T00:04:46.562829+0000","last_peered":"2024-09-12T00:04:46.562829+0000","last_clean":"2024-09-12T00:04:46.562829+0000","last_became_active":"2024-09-12T00:03:29.335440+0000","last_became_peered":"2024-09-12T00:03:29.335440+0000","last_unstale":"2024-09-12T00:04:46.562829+0000","last_undegraded":"2024-09-12T00:04:46.562829+0000","last_fullsized":"2024-09-12T00:04:46.562829+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:19.288395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":73,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.572645+0000","last_change":"2024-09-12T00:03:31.351990+0000","last_active":"2024-09-12T00:04:46.572645+0000","last_peered":"2024-09-12T00:04:46.572645+0000","last_clean":"2024-09-12T00:04:46.572645+0000","last_became_active":"2024-09-12T00:03:31.351580+0000","last_became_peered":"2024-09-12T00:03:31.351580+0000","last_unstale":"2024-09-12T00:04:46.572645+0000","last_undegraded":"2024-09-12T00:04:46.572645+0000","last_fullsized":"2024-09-12T00:04:46.572645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:38.095033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"58'2","reported_seq":73,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574060+0000","last_change":"2024-09-12T00:03:33.383008+0000","last_active":"2024-09-12T00:04:46.574060+0000","last_peered":"2024-09-12T00:04:46.574060+0000","last_clean":"2024-09-12T00:04:46.574060+0000","last_became_active":"2024-09-12T00:03:33.381496+0000","last_became_peered":"2024-09-12T00:03:33.381496+0000","last_unstale":"2024-09-12T00:04:46.574060+0000","last_undegraded":"2024-09-12T00:04:46.574060+0000","last_fullsized":"2024-09-12T00:04:46.574060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:44.996509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"58'2","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.603621+0000","last_change":"2024-09-12T00:03:25.337999+0000","last_active":"2024-09-12T00:04:46.603621+0000","last_peered":"2024-09-12T00:04:46.603621+0000","last_clean":"2024-09-12T00:04:46.603621+0000","last_became_active":"2024-09-12T00:03:25.337237+0000","last_became_peered":"2024-09-12T00:03:25.337237+0000","last_unstale":"2024-09-12T00:04:46.603621+0000","last_undegraded":"2024-09-12T00:04:46.603621+0000","last_fullsized":"2024-09-12T00:04:46.603621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"63'7","reported_seq":95,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.954553+0000","last_change":"2024-09-12T00:03:23.631744+0000","last_active":"2024-09-12T00:04:47.954553+0000","last_peered":"2024-09-12T00:04:47.954553+0000","last_clean":"2024-09-12T00:04:47.954553+0000","last_became_active":"2024-09-12T00:03:23.630928+0000","last_became_peered":"2024-09-12T00:03:23.630928+0000","last_unstale":"2024-09-12T00:04:47.954553+0000","last_undegraded":"2024-09-12T00:04:47.954553+0000","last_fullsized":"2024-09-12T00:04:47.954553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:35.772832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":80,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.585078+0000","last_change":"2024-09-12T00:03:27.345980+0000","last_active":"2024-09-12T00:04:46.585078+0000","last_peered":"2024-09-12T00:04:46.585078+0000","last_clean":"2024-09-12T00:04:46.585078+0000","last_became_active":"2024-09-12T00:03:27.345225+0000","last_became_peered":"2024-09-12T00:03:27.345225+0000","last_unstale":"2024-09-12T00:04:46.585078+0000","last_undegraded":"2024-09-12T00:04:46.585078+0000","last_fullsized":"2024-09-12T00:04:46.585078+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:47.990032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"63'26","reported_seq":122,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.573099+0000","last_change":"2024-09-12T00:03:29.359254+0000","last_active":"2024-09-12T00:04:46.573099+0000","last_peered":"2024-09-12T00:04:46.573099+0000","last_clean":"2024-09-12T00:04:46.573099+0000","last_became_active":"2024-09-12T00:03:29.355711+0000","last_became_peered":"2024-09-12T00:03:29.355711+0000","last_unstale":"2024-09-12T00:04:46.573099+0000","last_undegraded":"2024-09-12T00:04:46.573099+0000","last_fullsized":"2024-09-12T00:04:46.573099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:49.919008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":71,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.587988+0000","last_change":"2024-09-12T00:03:31.355300+0000","last_active":"2024-09-12T00:04:46.587988+0000","last_peered":"2024-09-12T00:04:46.587988+0000","last_clean":"2024-09-12T00:04:46.587988+0000","last_became_active":"2024-09-12T00:03:31.354506+0000","last_became_peered":"2024-09-12T00:03:31.354506+0000","last_unstale":"2024-09-12T00:04:46.587988+0000","last_undegraded":"2024-09-12T00:04:46.587988+0000","last_fullsized":"2024-09-12T00:04:46.587988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:51.564710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"58'1","reported_seq":70,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.575233+0000","last_change":"2024-09-12T00:03:33.384262+0000","last_active":"2024-09-12T00:04:46.575233+0000","last_peered":"2024-09-12T00:04:46.575233+0000","last_clean":"2024-09-12T00:04:46.575233+0000","last_became_active":"2024-09-12T00:03:33.383358+0000","last_became_peered":"2024-09-12T00:03:33.383358+0000","last_unstale":"2024-09-12T00:04:46.575233+0000","last_undegraded":"2024-09-12T00:04:46.575233+0000","last_fullsized":"2024-09-12T00:04:46.575233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:45.060131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"58'2","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.588499+0000","last_change":"2024-09-12T00:03:25.321452+0000","last_active":"2024-09-12T00:04:46.588499+0000","last_peered":"2024-09-12T00:04:46.588499+0000","last_clean":"2024-09-12T00:04:46.588499+0000","last_became_active":"2024-09-12T00:03:25.320503+0000","last_became_peered":"2024-09-12T00:03:25.320503+0000","last_unstale":"2024-09-12T00:04:46.588499+0000","last_undegraded":"2024-09-12T00:04:46.588499+0000","last_fullsized":"2024-09-12T00:04:46.588499+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:22.789487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"63'6","reported_seq":93,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.792637+0000","last_change":"2024-09-12T00:03:23.617643+0000","last_active":"2024-09-12T00:04:47.792637+0000","last_peered":"2024-09-12T00:04:47.792637+0000","last_clean":"2024-09-12T00:04:47.792637+0000","last_became_active":"2024-09-12T00:03:23.617138+0000","last_became_peered":"2024-09-12T00:03:23.617138+0000","last_unstale":"2024-09-12T00:04:47.792637+0000","last_undegraded":"2024-09-12T00:04:47.792637+0000","last_fullsized":"2024-09-12T00:04:47.792637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"59'2","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.616343+0000","last_change":"2024-09-12T00:03:25.335650+0000","last_active":"2024-09-12T00:04:46.616343+0000","last_peered":"2024-09-12T00:04:46.616343+0000","last_clean":"2024-09-12T00:04:46.616343+0000","last_became_active":"2024-09-12T00:03:25.334965+0000","last_became_peered":"2024-09-12T00:03:25.334965+0000","last_unstale":"2024-09-12T00:04:46.616343+0000","last_undegraded":"2024-09-12T00:04:46.616343+0000","last_fullsized":"2024-09-12T00:04:46.616343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:13.501672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"63'3","reported_seq":90,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.853296+0000","last_change":"2024-09-12T00:03:23.618651+0000","last_active":"2024-09-12T00:04:47.853296+0000","last_peered":"2024-09-12T00:04:47.853296+0000","last_clean":"2024-09-12T00:04:47.853296+0000","last_became_active":"2024-09-12T00:03:23.612542+0000","last_became_peered":"2024-09-12T00:03:23.612542+0000","last_unstale":"2024-09-12T00:04:47.853296+0000","last_undegraded":"2024-09-12T00:04:47.853296+0000","last_fullsized":"2024-09-12T00:04:47.853296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":85,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574325+0000","last_change":"2024-09-12T00:03:25.327224+0000","last_active":"2024-09-12T00:04:46.574325+0000","last_peered":"2024-09-12T00:04:46.574325+0000","last_clean":"2024-09-12T00:04:46.574325+0000","last_became_active":"2024-09-12T00:03:25.326635+0000","last_became_peered":"2024-09-12T00:03:25.326635+0000","last_unstale":"2024-09-12T00:04:46.574325+0000","last_undegraded":"2024-09-12T00:04:46.574325+0000","last_fullsized":"2024-09-12T00:04:46.574325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:16.827573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"63'3","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.577719+0000","last_change":"2024-09-12T00:03:23.626043+0000","last_active":"2024-09-12T00:04:46.577719+0000","last_peered":"2024-09-12T00:04:46.577719+0000","last_clean":"2024-09-12T00:04:46.577719+0000","last_became_active":"2024-09-12T00:03:23.625717+0000","last_became_peered":"2024-09-12T00:03:23.625717+0000","last_unstale":"2024-09-12T00:04:46.577719+0000","last_undegraded":"2024-09-12T00:04:46.577719+0000","last_fullsized":"2024-09-12T00:04:46.577719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:45.258601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"63'2","reported_seq":93,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.634231+0000","last_change":"2024-09-12T00:03:25.354015+0000","last_active":"2024-09-12T00:04:48.634231+0000","last_peered":"2024-09-12T00:04:48.634231+0000","last_clean":"2024-09-12T00:04:48.634231+0000","last_became_active":"2024-09-12T00:03:25.352319+0000","last_became_peered":"2024-09-12T00:03:25.352319+0000","last_unstale":"2024-09-12T00:04:48.634231+0000","last_undegraded":"2024-09-12T00:04:48.634231+0000","last_fullsized":"2024-09-12T00:04:48.634231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:08.033834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":88,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.561261+0000","last_change":"2024-09-12T00:03:23.633614+0000","last_active":"2024-09-12T00:04:46.561261+0000","last_peered":"2024-09-12T00:04:46.561261+0000","last_clean":"2024-09-12T00:04:46.561261+0000","last_became_active":"2024-09-12T00:03:23.632850+0000","last_became_peered":"2024-09-12T00:03:23.632850+0000","last_unstale":"2024-09-12T00:04:46.561261+0000","last_undegraded":"2024-09-12T00:04:46.561261+0000","last_fullsized":"2024-09-12T00:04:46.561261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"59'2","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.560442+0000","last_change":"2024-09-12T00:03:25.357453+0000","last_active":"2024-09-12T00:04:46.560442+0000","last_peered":"2024-09-12T00:04:46.560442+0000","last_clean":"2024-09-12T00:04:46.560442+0000","last_became_active":"2024-09-12T00:03:25.353815+0000","last_became_peered":"2024-09-12T00:03:25.353815+0000","last_unstale":"2024-09-12T00:04:46.560442+0000","last_undegraded":"2024-09-12T00:04:46.560442+0000","last_fullsized":"2024-09-12T00:04:46.560442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:27.562174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"63'5","reported_seq":94,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.673745+0000","last_change":"2024-09-12T00:03:23.609055+0000","last_active":"2024-09-12T00:04:47.673745+0000","last_peered":"2024-09-12T00:04:47.673745+0000","last_clean":"2024-09-12T00:04:47.673745+0000","last_became_active":"2024-09-12T00:03:23.608101+0000","last_became_peered":"2024-09-12T00:03:23.608101+0000","last_unstale":"2024-09-12T00:04:47.673745+0000","last_undegraded":"2024-09-12T00:04:47.673745+0000","last_fullsized":"2024-09-12T00:04:47.673745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"59'8","reported_seq":119,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574825+0000","last_change":"2024-09-12T00:03:25.324744+0000","last_active":"2024-09-12T00:04:46.574825+0000","last_peered":"2024-09-12T00:04:46.574825+0000","last_clean":"2024-09-12T00:04:46.574825+0000","last_became_active":"2024-09-12T00:03:25.324199+0000","last_became_peered":"2024-09-12T00:03:25.324199+0000","last_unstale":"2024-09-12T00:04:46.574825+0000","last_undegraded":"2024-09-12T00:04:46.574825+0000","last_fullsized":"2024-09-12T00:04:46.574825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:12.547802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"63'7","reported_seq":97,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.007863+0000","last_change":"2024-09-12T00:03:23.616706+0000","last_active":"2024-09-12T00:04:48.007863+0000","last_peered":"2024-09-12T00:04:48.007863+0000","last_clean":"2024-09-12T00:04:48.007863+0000","last_became_active":"2024-09-12T00:03:23.615970+0000","last_became_peered":"2024-09-12T00:03:23.615970+0000","last_unstale":"2024-09-12T00:04:48.007863+0000","last_undegraded":"2024-09-12T00:04:48.007863+0000","last_fullsized":"2024-09-12T00:04:48.007863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"63'8","reported_seq":107,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.653419+0000","last_change":"2024-09-12T00:03:25.343716+0000","last_active":"2024-09-12T00:04:48.653419+0000","last_peered":"2024-09-12T00:04:48.653419+0000","last_clean":"2024-09-12T00:04:48.653419+0000","last_became_active":"2024-09-12T00:03:25.342930+0000","last_became_peered":"2024-09-12T00:03:25.342930+0000","last_unstale":"2024-09-12T00:04:48.653419+0000","last_undegraded":"2024-09-12T00:04:48.653419+0000","last_fullsized":"2024-09-12T00:04:48.653419+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"63'4","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.689519+0000","last_change":"2024-09-12T00:03:23.612903+0000","last_active":"2024-09-12T00:04:46.689519+0000","last_peered":"2024-09-12T00:04:46.689519+0000","last_clean":"2024-09-12T00:04:46.689519+0000","last_became_active":"2024-09-12T00:03:23.612448+0000","last_became_peered":"2024-09-12T00:03:23.612448+0000","last_unstale":"2024-09-12T00:04:46.689519+0000","last_undegraded":"2024-09-12T00:04:46.689519+0000","last_fullsized":"2024-09-12T00:04:46.689519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:14.913580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"59'2","reported_seq":94,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.557834+0000","last_change":"2024-09-12T00:03:25.326620+0000","last_active":"2024-09-12T00:04:46.557834+0000","last_peered":"2024-09-12T00:04:46.557834+0000","last_clean":"2024-09-12T00:04:46.557834+0000","last_became_active":"2024-09-12T00:03:25.326262+0000","last_became_peered":"2024-09-12T00:03:25.326262+0000","last_unstale":"2024-09-12T00:04:46.557834+0000","last_undegraded":"2024-09-12T00:04:46.557834+0000","last_fullsized":"2024-09-12T00:04:46.557834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"63'3","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.680692+0000","last_change":"2024-09-12T00:03:23.632200+0000","last_active":"2024-09-12T00:04:46.680692+0000","last_peered":"2024-09-12T00:04:46.680692+0000","last_clean":"2024-09-12T00:04:46.680692+0000","last_became_active":"2024-09-12T00:03:23.631510+0000","last_became_peered":"2024-09-12T00:03:23.631510+0000","last_unstale":"2024-09-12T00:04:46.680692+0000","last_undegraded":"2024-09-12T00:04:46.680692+0000","last_fullsized":"2024-09-12T00:04:46.680692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:07.177242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"58'2","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.616750+0000","last_change":"2024-09-12T00:03:25.342763+0000","last_active":"2024-09-12T00:04:46.616750+0000","last_peered":"2024-09-12T00:04:46.616750+0000","last_clean":"2024-09-12T00:04:46.616750+0000","last_became_active":"2024-09-12T00:03:25.337834+0000","last_became_peered":"2024-09-12T00:03:25.337834+0000","last_unstale":"2024-09-12T00:04:46.616750+0000","last_undegraded":"2024-09-12T00:04:46.616750+0000","last_fullsized":"2024-09-12T00:04:46.616750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:35.920599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"63'3","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.037117+0000","last_change":"2024-09-12T00:03:23.630533+0000","last_active":"2024-09-12T00:04:47.037117+0000","last_peered":"2024-09-12T00:04:47.037117+0000","last_clean":"2024-09-12T00:04:47.037117+0000","last_became_active":"2024-09-12T00:03:23.630187+0000","last_became_peered":"2024-09-12T00:03:23.630187+0000","last_unstale":"2024-09-12T00:04:47.037117+0000","last_undegraded":"2024-09-12T00:04:47.037117+0000","last_fullsized":"2024-09-12T00:04:47.037117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:18.692638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2","reported_seq":93,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.575532+0000","last_change":"2024-09-12T00:03:25.339910+0000","last_active":"2024-09-12T00:04:46.575532+0000","last_peered":"2024-09-12T00:04:46.575532+0000","last_clean":"2024-09-12T00:04:46.575532+0000","last_became_active":"2024-09-12T00:03:25.336511+0000","last_became_peered":"2024-09-12T00:03:25.336511+0000","last_unstale":"2024-09-12T00:04:46.575532+0000","last_undegraded":"2024-09-12T00:04:46.575532+0000","last_fullsized":"2024-09-12T00:04:46.575532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:30.647474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"63'1","reported_seq":89,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.560128+0000","last_change":"2024-09-12T00:03:23.626232+0000","last_active":"2024-09-12T00:04:46.560128+0000","last_peered":"2024-09-12T00:04:46.560128+0000","last_clean":"2024-09-12T00:04:46.560128+0000","last_became_active":"2024-09-12T00:03:23.621761+0000","last_became_peered":"2024-09-12T00:03:23.621761+0000","last_unstale":"2024-09-12T00:04:46.560128+0000","last_undegraded":"2024-09-12T00:04:46.560128+0000","last_fullsized":"2024-09-12T00:04:46.560128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:31.587668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"59'4","reported_seq":100,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.560717+0000","last_change":"2024-09-12T00:03:25.341017+0000","last_active":"2024-09-12T00:04:46.560717+0000","last_peered":"2024-09-12T00:04:46.560717+0000","last_clean":"2024-09-12T00:04:46.560717+0000","last_became_active":"2024-09-12T00:03:25.340279+0000","last_became_peered":"2024-09-12T00:03:25.340279+0000","last_unstale":"2024-09-12T00:04:46.560717+0000","last_undegraded":"2024-09-12T00:04:46.560717+0000","last_fullsized":"2024-09-12T00:04:46.560717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:08.066950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"63'3","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.243374+0000","last_change":"2024-09-12T00:03:23.600956+0000","last_active":"2024-09-12T00:04:47.243374+0000","last_peered":"2024-09-12T00:04:47.243374+0000","last_clean":"2024-09-12T00:04:47.243374+0000","last_became_active":"2024-09-12T00:03:23.600673+0000","last_became_peered":"2024-09-12T00:03:23.600673+0000","last_unstale":"2024-09-12T00:04:47.243374+0000","last_undegraded":"2024-09-12T00:04:47.243374+0000","last_fullsized":"2024-09-12T00:04:47.243374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"59'4","reported_seq":101,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.558261+0000","last_change":"2024-09-12T00:03:25.325088+0000","last_active":"2024-09-12T00:04:46.558261+0000","last_peered":"2024-09-12T00:04:46.558261+0000","last_clean":"2024-09-12T00:04:46.558261+0000","last_became_active":"2024-09-12T00:03:25.324597+0000","last_became_peered":"2024-09-12T00:03:25.324597+0000","last_unstale":"2024-09-12T00:04:46.558261+0000","last_undegraded":"2024-09-12T00:04:46.558261+0000","last_fullsized":"2024-09-12T00:04:46.558261+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"63'9","reported_seq":96,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.589314+0000","last_change":"2024-09-12T00:03:23.621791+0000","last_active":"2024-09-12T00:04:47.589314+0000","last_peered":"2024-09-12T00:04:47.589314+0000","last_clean":"2024-09-12T00:04:47.589314+0000","last_became_active":"2024-09-12T00:03:23.621063+0000","last_became_peered":"2024-09-12T00:03:23.621063+0000","last_unstale":"2024-09-12T00:04:47.589314+0000","last_undegraded":"2024-09-12T00:04:47.589314+0000","last_fullsized":"2024-09-12T00:04:47.589314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:33.234598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":85,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.558066+0000","last_change":"2024-09-12T00:03:25.357605+0000","last_active":"2024-09-12T00:04:46.558066+0000","last_peered":"2024-09-12T00:04:46.558066+0000","last_clean":"2024-09-12T00:04:46.558066+0000","last_became_active":"2024-09-12T00:03:25.357286+0000","last_became_peered":"2024-09-12T00:03:25.357286+0000","last_unstale":"2024-09-12T00:04:46.558066+0000","last_undegraded":"2024-09-12T00:04:46.558066+0000","last_fullsized":"2024-09-12T00:04:46.558066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"63'5","reported_seq":95,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.596936+0000","last_change":"2024-09-12T00:03:23.600931+0000","last_active":"2024-09-12T00:04:48.596936+0000","last_peered":"2024-09-12T00:04:48.596936+0000","last_clean":"2024-09-12T00:04:48.596936+0000","last_became_active":"2024-09-12T00:03:23.600591+0000","last_became_peered":"2024-09-12T00:03:23.600591+0000","last_unstale":"2024-09-12T00:04:48.596936+0000","last_undegraded":"2024-09-12T00:04:48.596936+0000","last_fullsized":"2024-09-12T00:04:48.596936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":13,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":83,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.614703+0000","last_change":"2024-09-12T00:03:25.330869+0000","last_active":"2024-09-12T00:04:46.614703+0000","last_peered":"2024-09-12T00:04:46.614703+0000","last_clean":"2024-09-12T00:04:46.614703+0000","last_became_active":"2024-09-12T00:03:25.329742+0000","last_became_peered":"2024-09-12T00:03:25.329742+0000","last_unstale":"2024-09-12T00:04:46.614703+0000","last_undegraded":"2024-09-12T00:04:46.614703+0000","last_fullsized":"2024-09-12T00:04:46.614703+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:01.365985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"63'7","reported_seq":96,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.533803+0000","last_change":"2024-09-12T00:03:23.604388+0000","last_active":"2024-09-12T00:04:47.533803+0000","last_peered":"2024-09-12T00:04:47.533803+0000","last_clean":"2024-09-12T00:04:47.533803+0000","last_became_active":"2024-09-12T00:03:23.603608+0000","last_became_peered":"2024-09-12T00:03:23.603608+0000","last_unstale":"2024-09-12T00:04:47.533803+0000","last_undegraded":"2024-09-12T00:04:47.533803+0000","last_fullsized":"2024-09-12T00:04:47.533803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:19.941103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"59'4","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.586068+0000","last_change":"2024-09-12T00:03:25.347570+0000","last_active":"2024-09-12T00:04:46.586068+0000","last_peered":"2024-09-12T00:04:46.586068+0000","last_clean":"2024-09-12T00:04:46.586068+0000","last_became_active":"2024-09-12T00:03:25.346874+0000","last_became_peered":"2024-09-12T00:03:25.346874+0000","last_unstale":"2024-09-12T00:04:46.586068+0000","last_undegraded":"2024-09-12T00:04:46.586068+0000","last_fullsized":"2024-09-12T00:04:46.586068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"63'4","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.775686+0000","last_change":"2024-09-12T00:03:23.623417+0000","last_active":"2024-09-12T00:04:46.775686+0000","last_peered":"2024-09-12T00:04:46.775686+0000","last_clean":"2024-09-12T00:04:46.775686+0000","last_became_active":"2024-09-12T00:03:23.620261+0000","last_became_peered":"2024-09-12T00:03:23.620261+0000","last_unstale":"2024-09-12T00:04:46.775686+0000","last_undegraded":"2024-09-12T00:04:46.775686+0000","last_fullsized":"2024-09-12T00:04:46.775686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"63'8","reported_seq":119,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.637512+0000","last_change":"2024-09-12T00:03:25.357492+0000","last_active":"2024-09-12T00:04:48.637512+0000","last_peered":"2024-09-12T00:04:48.637512+0000","last_clean":"2024-09-12T00:04:48.637512+0000","last_became_active":"2024-09-12T00:03:25.357186+0000","last_became_peered":"2024-09-12T00:03:25.357186+0000","last_unstale":"2024-09-12T00:04:48.637512+0000","last_undegraded":"2024-09-12T00:04:48.637512+0000","last_fullsized":"2024-09-12T00:04:48.637512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"62'1","reported_seq":90,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.574634+0000","last_change":"2024-09-12T00:03:23.607247+0000","last_active":"2024-09-12T00:04:46.574634+0000","last_peered":"2024-09-12T00:04:46.574634+0000","last_clean":"2024-09-12T00:04:46.574634+0000","last_became_active":"2024-09-12T00:03:23.606625+0000","last_became_peered":"2024-09-12T00:03:23.606625+0000","last_unstale":"2024-09-12T00:04:46.574634+0000","last_undegraded":"2024-09-12T00:04:46.574634+0000","last_fullsized":"2024-09-12T00:04:46.574634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:04.927836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"63'8","reported_seq":97,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:47.719227+0000","last_change":"2024-09-12T00:03:23.611398+0000","last_active":"2024-09-12T00:04:47.719227+0000","last_peered":"2024-09-12T00:04:47.719227+0000","last_clean":"2024-09-12T00:04:47.719227+0000","last_became_active":"2024-09-12T00:03:23.610918+0000","last_became_peered":"2024-09-12T00:03:23.610918+0000","last_unstale":"2024-09-12T00:04:47.719227+0000","last_undegraded":"2024-09-12T00:04:47.719227+0000","last_fullsized":"2024-09-12T00:04:47.719227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:28.688159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"63'4","reported_seq":101,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:48.636227+0000","last_change":"2024-09-12T00:03:25.350116+0000","last_active":"2024-09-12T00:04:48.636227+0000","last_peered":"2024-09-12T00:04:48.636227+0000","last_clean":"2024-09-12T00:04:48.636227+0000","last_became_active":"2024-09-12T00:03:25.349281+0000","last_became_peered":"2024-09-12T00:03:25.349281+0000","last_unstale":"2024-09-12T00:04:48.636227+0000","last_undegraded":"2024-09-12T00:04:48.636227+0000","last_fullsized":"2024-09-12T00:04:48.636227+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:33.350458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"63'1","reported_seq":89,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.559995+0000","last_change":"2024-09-12T00:03:23.619574+0000","last_active":"2024-09-12T00:04:46.559995+0000","last_peered":"2024-09-12T00:04:46.559995+0000","last_clean":"2024-09-12T00:04:46.559995+0000","last_became_active":"2024-09-12T00:03:23.616154+0000","last_became_peered":"2024-09-12T00:03:23.616154+0000","last_unstale":"2024-09-12T00:04:46.559995+0000","last_undegraded":"2024-09-12T00:04:46.559995+0000","last_fullsized":"2024-09-12T00:04:46.559995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:46.335775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"58'2","reported_seq":94,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T00:04:46.559845+0000","last_change":"2024-09-12T00:03:25.345327+0000","last_active":"2024-09-12T00:04:46.559845+0000","last_peered":"2024-09-12T00:04:46.559845+0000","last_clean":"2024-09-12T00:04:46.559845+0000","last_became_active":"2024-09-12T00:03:25.344917+0000","last_became_peered":"2024-09-12T00:03:25.344917+0000","last_unstale":"2024-09-12T00:04:46.559845+0000","last_undegraded":"2024-09-12T00:04:46.559845+0000","last_fullsized":"2024-09-12T00:04:46.559845+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":256,"num_read_kb":242,"num_write":218,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":90,"ondisk_log_size":90,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":736,"ondisk_log_size":736,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":79526,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1081,"num_read_kb":811,"num_write":629,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":127164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":817,"ondisk_log_size":817,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":304,"num_read_kb":304,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1125,"num_read_kb":1105,"num_write":228,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1069547520,"num_objects":257,"num_object_clones":0,"num_object_copies":514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":257,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":307,"num_write_kb":1064960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2139095040,"data_stored":2139095040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542168,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177296,"kb_used_data":150268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94194544,"statfs":{"total":96636764160,"available":96455213056,"internally_reserved":0,"allocated":153874432,"data_stored":153480771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542168,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214160,"kb_used_data":187132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94157680,"statfs":{"total":96636764160,"available":96417464320,"internally_reserved":0,"allocated":191623168,"data_stored":191229899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542168,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339784,"kb_used_data":304436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94032056,"statfs":{"total":96636764160,"available":96288825344,"internally_reserved":0,"allocated":311742464,"data_stored":311356379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542168,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255184,"kb_used_data":223996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94116656,"statfs":{"total":96636764160,"available":96375455744,"internally_reserved":0,"allocated":229371904,"data_stored":228978408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281788,"kb_used_data":250600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94090052,"statfs":{"total":96636764160,"available":96348213248,"internally_reserved":0,"allocated":256614400,"data_stored":256239402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302188,"kb_used_data":275160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94069652,"statfs":{"total":96636764160,"available":96327323648,"internally_reserved":0,"allocated":281763840,"data_stored":281404842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":223024,"kb_used_data":191836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94148816,"statfs":{"total":96636764160,"available":96408387584,"internally_reserved":0,"allocated":196440064,"data_stored":196016078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542167,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314592,"kb_used_data":283404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94057248,"statfs":{"total":96636764160,"available":96314621952,"internally_reserved":0,"allocated":290205696,"data_stored":289795179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":289406976,"data_stored":289406976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":207618048,"data_stored":207618048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":318767104,"data_stored":318767104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":285212672,"data_stored":285212672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":266338304,"data_stored":266338304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":310378496,"data_stored":310378496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":274726912,"data_stored":274726912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":186646528,"data_stored":186646528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":60313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:04:52.700 INFO:tasks.thrashosds.thrasher:Setting 4.31 to [5, 3, 6, 1] 2024-09-12T00:04:52.700 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.31', '5', '3', '6', '1'] 2024-09-12T00:04:52.701 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.31 5 3 6 1 2024-09-12T00:04:52.729 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:52.732+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:52.777 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:52.777 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:52.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:52.777 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:52.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.777 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1641 3.26 3:658fe58e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2__shadow_.hDHTDpIswwqRA2bHiHVxkhWqZde6XEj_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:52.777 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:04:52.777 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 19.721826475, 2024-09-12T00:04:52.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017888905, 2024-09-12T00:04:52.778 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.778 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.778 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.778 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.778 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:52.778 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:52.778 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1641 2024-09-12T00:04:52.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.778 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.778 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.778 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:04:52.778 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:04:52.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056289+0000", 2024-09-12T00:04:52.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5349999999999999e-06 2024-09-12T00:04:52.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058595+0000", 2024-09-12T00:04:52.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002306083 2024-09-12T00:04:52.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058621+0000", 2024-09-12T00:04:52.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6431000000000002e-05 2024-09-12T00:04:52.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058631+0000", 2024-09-12T00:04:52.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0166000000000001e-05 2024-09-12T00:04:52.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.780 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.780 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058712+0000", 2024-09-12T00:04:52.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0122000000000003e-05 2024-09-12T00:04:52.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.781 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058821+0000", 2024-09-12T00:04:52.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010907400000000001 2024-09-12T00:04:52.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.781 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:52.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058910+0000", 2024-09-12T00:04:52.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9523000000000003e-05 2024-09-12T00:04:52.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.781 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073881+0000", 2024-09-12T00:04:52.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014971224 2024-09-12T00:04:52.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.782 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.782 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074101+0000", 2024-09-12T00:04:52.782 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0002195 2024-09-12T00:04:52.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.782 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.782 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074133+0000", 2024-09-12T00:04:52.782 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2138000000000003e-05 2024-09-12T00:04:52.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.782 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.782 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074175+0000", 2024-09-12T00:04:52.782 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2109e-05 2024-09-12T00:04:52.783 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.783 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.783 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.783 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1775 3.30 e58/23 3:0c2ae78d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_1:head v 58'1, mlcod=0'0)", 2024-09-12T00:04:52.783 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:04:52.783 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.776351515000002, 2024-09-12T00:04:52.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017585038000000001, 2024-09-12T00:04:52.784 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.784 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.784 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.784 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:04:52.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:04:52.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001763+0000", 2024-09-12T00:04:52.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2730000000000001e-06 2024-09-12T00:04:52.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005217+0000", 2024-09-12T00:04:52.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0034533810000000002 2024-09-12T00:04:52.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005241+0000", 2024-09-12T00:04:52.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4403e-05 2024-09-12T00:04:52.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.786 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.786 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005253+0000", 2024-09-12T00:04:52.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2007e-05 2024-09-12T00:04:52.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.786 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.786 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005324+0000", 2024-09-12T00:04:52.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0765000000000004e-05 2024-09-12T00:04:52.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.786 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.786 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005348+0000", 2024-09-12T00:04:52.787 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3762000000000001e-05 2024-09-12T00:04:52.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.787 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.787 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.787 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019291+0000", 2024-09-12T00:04:52.787 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013943707 2024-09-12T00:04:52.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.787 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.787 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.787 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019346+0000", 2024-09-12T00:04:52.787 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4740000000000001e-05 2024-09-12T00:04:52.787 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.787 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.787 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.788 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1780 3.16 3:69d8ee52:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:52.788 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:04:52.788 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.754742603, 2024-09-12T00:04:52.788 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016232362, 2024-09-12T00:04:52.788 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.788 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.788 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.788 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.788 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:52.788 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:52.788 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1780 2024-09-12T00:04:52.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.788 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.789 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:04:52.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.789 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:04:52.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023372+0000", 2024-09-12T00:04:52.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0209999999999998e-06 2024-09-12T00:04:52.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024447+0000", 2024-09-12T00:04:52.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0010749550000000001 2024-09-12T00:04:52.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024473+0000", 2024-09-12T00:04:52.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5689000000000001e-05 2024-09-12T00:04:52.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024484+0000", 2024-09-12T00:04:52.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1153e-05 2024-09-12T00:04:52.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024547+0000", 2024-09-12T00:04:52.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3400999999999998e-05 2024-09-12T00:04:52.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024669+0000", 2024-09-12T00:04:52.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012184999999999999 2024-09-12T00:04:52.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:52.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025014+0000", 2024-09-12T00:04:52.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000344505 2024-09-12T00:04:52.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039161+0000", 2024-09-12T00:04:52.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014147799000000001 2024-09-12T00:04:52.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039434+0000", 2024-09-12T00:04:52.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00027254699999999999 2024-09-12T00:04:52.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.793 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.793 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.793 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039521+0000", 2024-09-12T00:04:52.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6663999999999996e-05 2024-09-12T00:04:52.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.793 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.793 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.793 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039602+0000", 2024-09-12T00:04:52.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1778000000000002e-05 2024-09-12T00:04:52.793 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.793 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.793 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.794 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1912 3.16 3:6a08f78f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.4__shadow_.EKM6BwfpK8ZqXIKQk7k4yJFkOWS2UlN_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:04:52.794 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:35.139256+0000", 2024-09-12T00:04:52.794 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 17.638856682, 2024-09-12T00:04:52.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01537029, 2024-09-12T00:04:52.794 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.794 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.794 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.794 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.794 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:52.794 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:52.794 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1912 2024-09-12T00:04:52.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.794 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.139256+0000", 2024-09-12T00:04:52.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.139256+0000", 2024-09-12T00:04:52.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.139258+0000", 2024-09-12T00:04:52.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3439999999999999e-06 2024-09-12T00:04:52.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141028+0000", 2024-09-12T00:04:52.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001770183 2024-09-12T00:04:52.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141054+0000", 2024-09-12T00:04:52.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5928e-05 2024-09-12T00:04:52.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141065+0000", 2024-09-12T00:04:52.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0589e-05 2024-09-12T00:04:52.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141145+0000", 2024-09-12T00:04:52.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0121000000000001e-05 2024-09-12T00:04:52.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141257+0000", 2024-09-12T00:04:52.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000111672 2024-09-12T00:04:52.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:52.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141361+0000", 2024-09-12T00:04:52.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103705 2024-09-12T00:04:52.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.798 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.152422+0000", 2024-09-12T00:04:52.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011061586999999999 2024-09-12T00:04:52.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.798 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154552+0000", 2024-09-12T00:04:52.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021297120000000002 2024-09-12T00:04:52.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.799 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.799 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154590+0000", 2024-09-12T00:04:52.799 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7942999999999999e-05 2024-09-12T00:04:52.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.799 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.799 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154626+0000", 2024-09-12T00:04:52.799 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6505999999999999e-05 2024-09-12T00:04:52.799 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.799 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.799 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.799 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2650 3.5 3:a19f3a83:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:52.799 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.189998+0000", 2024-09-12T00:04:52.800 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.5881147069999999, 2024-09-12T00:04:52.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016025257000000001, 2024-09-12T00:04:52.800 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.800 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.800 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.800 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.800 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:52.800 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:52.800 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2650 2024-09-12T00:04:52.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.800 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.189998+0000", 2024-09-12T00:04:52.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.189998+0000", 2024-09-12T00:04:52.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.190001+0000", 2024-09-12T00:04:52.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5830000000000001e-06 2024-09-12T00:04:52.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191320+0000", 2024-09-12T00:04:52.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0013192449999999999 2024-09-12T00:04:52.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191341+0000", 2024-09-12T00:04:52.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1690000000000001e-05 2024-09-12T00:04:52.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191355+0000", 2024-09-12T00:04:52.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3147e-05 2024-09-12T00:04:52.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191444+0000", 2024-09-12T00:04:52.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9809999999999996e-05 2024-09-12T00:04:52.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.803 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191623+0000", 2024-09-12T00:04:52.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017869399999999999 2024-09-12T00:04:52.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.803 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:52.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191786+0000", 2024-09-12T00:04:52.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000163203 2024-09-12T00:04:52.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.803 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.198758+0000", 2024-09-12T00:04:52.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069714440000000003 2024-09-12T00:04:52.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.205895+0000", 2024-09-12T00:04:52.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.007137404 2024-09-12T00:04:52.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.205966+0000", 2024-09-12T00:04:52.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0797999999999995e-05 2024-09-12T00:04:52.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.805 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.206023+0000", 2024-09-12T00:04:52.805 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7238999999999999e-05 2024-09-12T00:04:52.805 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.805 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.805 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.805 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.805 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2655 3.5 3:a26caaa1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:52.805 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.241675+0000", 2024-09-12T00:04:52.805 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.5364374449999998, 2024-09-12T00:04:52.805 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018338047999999999, 2024-09-12T00:04:52.805 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.805 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.805 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.806 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.806 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:52.806 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:52.806 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2655 2024-09-12T00:04:52.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.806 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.241675+0000", 2024-09-12T00:04:52.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.241675+0000", 2024-09-12T00:04:52.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.241678+0000", 2024-09-12T00:04:52.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4430000000000002e-06 2024-09-12T00:04:52.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243471+0000", 2024-09-12T00:04:52.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017937369999999999 2024-09-12T00:04:52.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243493+0000", 2024-09-12T00:04:52.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2001000000000002e-05 2024-09-12T00:04:52.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243505+0000", 2024-09-12T00:04:52.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1632e-05 2024-09-12T00:04:52.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243579+0000", 2024-09-12T00:04:52.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4165999999999994e-05 2024-09-12T00:04:52.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.809 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243766+0000", 2024-09-12T00:04:52.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018714599999999999 2024-09-12T00:04:52.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.809 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.809 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:52.809 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243937+0000", 2024-09-12T00:04:52.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017038700000000001 2024-09-12T00:04:52.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.809 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.809 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.809 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.250274+0000", 2024-09-12T00:04:52.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063369070000000001 2024-09-12T00:04:52.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.810 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.810 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.259911+0000", 2024-09-12T00:04:52.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0096378669999999996 2024-09-12T00:04:52.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.810 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.810 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.259960+0000", 2024-09-12T00:04:52.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8763000000000001e-05 2024-09-12T00:04:52.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.810 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.810 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.260013+0000", 2024-09-12T00:04:52.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2998999999999999e-05 2024-09-12T00:04:52.810 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.811 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.811 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.811 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2657 3.3c 3:3e583291:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:52.811 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.263916+0000", 2024-09-12T00:04:52.811 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.5141967540000003, 2024-09-12T00:04:52.811 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020609368999999999, 2024-09-12T00:04:52.811 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.811 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.811 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.811 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.811 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:52.811 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:52.811 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2657 2024-09-12T00:04:52.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.812 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.263916+0000", 2024-09-12T00:04:52.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.263916+0000", 2024-09-12T00:04:52.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.813 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.813 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.263919+0000", 2024-09-12T00:04:52.813 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.92e-06 2024-09-12T00:04:52.813 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.813 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.813 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.813 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266277+0000", 2024-09-12T00:04:52.813 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023579310000000002 2024-09-12T00:04:52.813 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.813 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.813 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.813 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266302+0000", 2024-09-12T00:04:52.813 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4807000000000002e-05 2024-09-12T00:04:52.813 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.813 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266317+0000", 2024-09-12T00:04:52.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5209e-05 2024-09-12T00:04:52.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266414+0000", 2024-09-12T00:04:52.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7658000000000006e-05 2024-09-12T00:04:52.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266556+0000", 2024-09-12T00:04:52.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014166100000000001 2024-09-12T00:04:52.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:52.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266680+0000", 2024-09-12T00:04:52.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012421099999999999 2024-09-12T00:04:52.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275396+0000", 2024-09-12T00:04:52.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0087156609999999995 2024-09-12T00:04:52.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.284426+0000", 2024-09-12T00:04:52.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0090300039999999995 2024-09-12T00:04:52.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.816 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.816 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.284472+0000", 2024-09-12T00:04:52.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6273000000000002e-05 2024-09-12T00:04:52.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.816 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.816 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.816 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.284525+0000", 2024-09-12T00:04:52.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3034000000000001e-05 2024-09-12T00:04:52.816 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.816 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.816 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.816 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.816 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2658 3.3a 3:5ec14981:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:52.817 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.274153+0000", 2024-09-12T00:04:52.817 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.5039593120000001, 2024-09-12T00:04:52.817 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017963626, 2024-09-12T00:04:52.817 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.817 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.817 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.817 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.817 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:52.817 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:52.817 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2658 2024-09-12T00:04:52.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.817 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.817 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.817 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.818 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.274153+0000", 2024-09-12T00:04:52.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.818 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.818 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.274153+0000", 2024-09-12T00:04:52.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.818 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.818 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.274156+0000", 2024-09-12T00:04:52.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5299999999999999e-06 2024-09-12T00:04:52.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.818 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.819 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275746+0000", 2024-09-12T00:04:52.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001589741 2024-09-12T00:04:52.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.819 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.819 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275770+0000", 2024-09-12T00:04:52.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4539999999999999e-05 2024-09-12T00:04:52.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.819 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.819 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275785+0000", 2024-09-12T00:04:52.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4783000000000001e-05 2024-09-12T00:04:52.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.820 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275867+0000", 2024-09-12T00:04:52.820 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2362999999999997e-05 2024-09-12T00:04:52.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.820 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275990+0000", 2024-09-12T00:04:52.820 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012287100000000001 2024-09-12T00:04:52.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:52.820 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.276085+0000", 2024-09-12T00:04:52.820 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5172000000000003e-05 2024-09-12T00:04:52.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.282993+0000", 2024-09-12T00:04:52.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069076210000000001 2024-09-12T00:04:52.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.291976+0000", 2024-09-12T00:04:52.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0089835269999999998 2024-09-12T00:04:52.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.292054+0000", 2024-09-12T00:04:52.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7804000000000002e-05 2024-09-12T00:04:52.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.822 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.822 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.292117+0000", 2024-09-12T00:04:52.822 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2674000000000003e-05 2024-09-12T00:04:52.822 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.822 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.822 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.822 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.822 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2661 3.1e e63/23 3:7a671bd1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_156:head v 63'3, mlcod=62'1)", 2024-09-12T00:04:52.822 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.312780+0000", 2024-09-12T00:04:52.822 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.4653326829999997, 2024-09-12T00:04:52.822 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015038723, 2024-09-12T00:04:52.822 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.822 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.823 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.823 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.312780+0000", 2024-09-12T00:04:52.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.312780+0000", 2024-09-12T00:04:52.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.312783+0000", 2024-09-12T00:04:52.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.756e-06 2024-09-12T00:04:52.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.824 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.824 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317423+0000", 2024-09-12T00:04:52.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004640323 2024-09-12T00:04:52.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.824 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.824 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317453+0000", 2024-09-12T00:04:52.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0301e-05 2024-09-12T00:04:52.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.824 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.825 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317468+0000", 2024-09-12T00:04:52.825 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4989e-05 2024-09-12T00:04:52.825 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.825 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.825 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.825 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317551+0000", 2024-09-12T00:04:52.825 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2712000000000004e-05 2024-09-12T00:04:52.825 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.825 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.825 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.825 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317578+0000", 2024-09-12T00:04:52.825 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7161999999999998e-05 2024-09-12T00:04:52.825 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.825 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.825 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.826 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.327765+0000", 2024-09-12T00:04:52.826 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010187229000000001 2024-09-12T00:04:52.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.826 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.327819+0000", 2024-09-12T00:04:52.826 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3251000000000002e-05 2024-09-12T00:04:52.826 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.826 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.826 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.826 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2675 3.20 3:0529bfef:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:52.826 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.454008+0000", 2024-09-12T00:04:52.826 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.324104427, 2024-09-12T00:04:52.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017972776999999999, 2024-09-12T00:04:52.827 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.827 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.827 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.827 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.827 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:52.827 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:52.827 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2675 2024-09-12T00:04:52.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.827 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.454008+0000", 2024-09-12T00:04:52.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.454008+0000", 2024-09-12T00:04:52.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.454011+0000", 2024-09-12T00:04:52.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1379999999999999e-06 2024-09-12T00:04:52.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455547+0000", 2024-09-12T00:04:52.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001535919 2024-09-12T00:04:52.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455580+0000", 2024-09-12T00:04:52.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2789000000000001e-05 2024-09-12T00:04:52.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455591+0000", 2024-09-12T00:04:52.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0531e-05 2024-09-12T00:04:52.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455670+0000", 2024-09-12T00:04:52.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9822999999999998e-05 2024-09-12T00:04:52.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455863+0000", 2024-09-12T00:04:52.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019248799999999999 2024-09-12T00:04:52.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:52.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.456021+0000", 2024-09-12T00:04:52.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000157627 2024-09-12T00:04:52.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.462847+0000", 2024-09-12T00:04:52.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0068268230000000001 2024-09-12T00:04:52.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.471901+0000", 2024-09-12T00:04:52.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0090533820000000004 2024-09-12T00:04:52.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.832 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.471939+0000", 2024-09-12T00:04:52.832 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8334999999999998e-05 2024-09-12T00:04:52.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.832 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.832 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.471981+0000", 2024-09-12T00:04:52.832 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1922000000000003e-05 2024-09-12T00:04:52.832 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.832 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.832 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.833 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2693 3.1e e63/23 3:7a8f9e2c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_178:head v 63'4, mlcod=63'2)", 2024-09-12T00:04:52.833 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.541097+0000", 2024-09-12T00:04:52.833 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.2370157150000001, 2024-09-12T00:04:52.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013470268000000001, 2024-09-12T00:04:52.833 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.833 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.833 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.833 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.833 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.541097+0000", 2024-09-12T00:04:52.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.541097+0000", 2024-09-12T00:04:52.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.541098+0000", 2024-09-12T00:04:52.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.454e-06 2024-09-12T00:04:52.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545193+0000", 2024-09-12T00:04:52.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040943899999999998 2024-09-12T00:04:52.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545221+0000", 2024-09-12T00:04:52.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8595e-05 2024-09-12T00:04:52.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545235+0000", 2024-09-12T00:04:52.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3329999999999999e-05 2024-09-12T00:04:52.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545320+0000", 2024-09-12T00:04:52.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5371000000000006e-05 2024-09-12T00:04:52.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.836 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.836 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545348+0000", 2024-09-12T00:04:52.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7532e-05 2024-09-12T00:04:52.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.836 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.836 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.554493+0000", 2024-09-12T00:04:52.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091452400000000007 2024-09-12T00:04:52.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.836 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.836 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.554567+0000", 2024-09-12T00:04:52.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4356000000000004e-05 2024-09-12T00:04:52.837 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.837 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.837 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.837 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.837 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2696 3.2b e63/23 3:d7c776f8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_181:head v 63'8, mlcod=63'6)", 2024-09-12T00:04:52.837 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.572942+0000", 2024-09-12T00:04:52.837 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.2051701770000003, 2024-09-12T00:04:52.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016050795999999999, 2024-09-12T00:04:52.837 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.837 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.837 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.837 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.572942+0000", 2024-09-12T00:04:52.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.572942+0000", 2024-09-12T00:04:52.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.572945+0000", 2024-09-12T00:04:52.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1730000000000002e-06 2024-09-12T00:04:52.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577465+0000", 2024-09-12T00:04:52.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045199649999999999 2024-09-12T00:04:52.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577495+0000", 2024-09-12T00:04:52.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0473000000000001e-05 2024-09-12T00:04:52.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577512+0000", 2024-09-12T00:04:52.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7215999999999999e-05 2024-09-12T00:04:52.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577616+0000", 2024-09-12T00:04:52.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103304 2024-09-12T00:04:52.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577649+0000", 2024-09-12T00:04:52.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3695999999999997e-05 2024-09-12T00:04:52.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.588945+0000", 2024-09-12T00:04:52.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011295556 2024-09-12T00:04:52.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.841 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.841 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.841 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.588993+0000", 2024-09-12T00:04:52.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8412999999999999e-05 2024-09-12T00:04:52.841 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.841 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.841 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.841 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.841 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2702 3.3c 3:3d6a0b3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:52.841 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.626588+0000", 2024-09-12T00:04:52.841 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.1515244830000002, 2024-09-12T00:04:52.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018349791000000001, 2024-09-12T00:04:52.842 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.842 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.842 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.842 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.842 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:52.842 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:52.842 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2702 2024-09-12T00:04:52.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.842 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.626588+0000", 2024-09-12T00:04:52.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.843 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.843 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.626588+0000", 2024-09-12T00:04:52.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.843 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.843 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.626591+0000", 2024-09-12T00:04:52.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0469999999999998e-06 2024-09-12T00:04:52.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.843 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.843 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.627983+0000", 2024-09-12T00:04:52.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001391541 2024-09-12T00:04:52.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.844 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.844 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.844 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628016+0000", 2024-09-12T00:04:52.844 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3556999999999997e-05 2024-09-12T00:04:52.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.844 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.844 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.844 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628035+0000", 2024-09-12T00:04:52.844 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9162999999999999e-05 2024-09-12T00:04:52.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.844 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.844 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.844 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628108+0000", 2024-09-12T00:04:52.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2336999999999995e-05 2024-09-12T00:04:52.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.845 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.845 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.845 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628237+0000", 2024-09-12T00:04:52.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000128706 2024-09-12T00:04:52.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.845 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.845 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:52.845 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628329+0000", 2024-09-12T00:04:52.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2761000000000002e-05 2024-09-12T00:04:52.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.845 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.845 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.846 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.632309+0000", 2024-09-12T00:04:52.846 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003979692 2024-09-12T00:04:52.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.846 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.846 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.846 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.644845+0000", 2024-09-12T00:04:52.846 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012536112 2024-09-12T00:04:52.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.846 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.846 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.846 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.644898+0000", 2024-09-12T00:04:52.846 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.329e-05 2024-09-12T00:04:52.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.846 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.847 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.847 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.644938+0000", 2024-09-12T00:04:52.847 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9585000000000001e-05 2024-09-12T00:04:52.847 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.847 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.847 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.847 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.847 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2716 3.20 3:042f7231:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:52.847 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.766936+0000", 2024-09-12T00:04:52.847 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.0111763500000004, 2024-09-12T00:04:52.847 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025751422999999999, 2024-09-12T00:04:52.847 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.847 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.847 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.848 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.848 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:52.848 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:52.848 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2716 2024-09-12T00:04:52.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.848 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.848 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.848 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.848 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766936+0000", 2024-09-12T00:04:52.848 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.848 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.848 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.849 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766936+0000", 2024-09-12T00:04:52.849 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.849 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.849 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.849 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.849 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766939+0000", 2024-09-12T00:04:52.849 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8499999999999998e-06 2024-09-12T00:04:52.849 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.849 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.849 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.849 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769471+0000", 2024-09-12T00:04:52.849 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025320780000000001 2024-09-12T00:04:52.849 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.849 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.849 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.850 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769506+0000", 2024-09-12T00:04:52.850 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4842999999999998e-05 2024-09-12T00:04:52.850 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.850 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.850 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.850 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769522+0000", 2024-09-12T00:04:52.850 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5548000000000001e-05 2024-09-12T00:04:52.850 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.850 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.850 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.850 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769602+0000", 2024-09-12T00:04:52.850 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0291999999999996e-05 2024-09-12T00:04:52.850 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.850 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.851 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.851 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769726+0000", 2024-09-12T00:04:52.851 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012447900000000001 2024-09-12T00:04:52.851 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.851 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.851 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:52.851 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769833+0000", 2024-09-12T00:04:52.851 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010621899999999999 2024-09-12T00:04:52.851 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.851 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.851 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.851 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.775790+0000", 2024-09-12T00:04:52.851 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0059571529999999998 2024-09-12T00:04:52.851 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.851 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.852 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.852 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.792589+0000", 2024-09-12T00:04:52.852 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016799445 2024-09-12T00:04:52.852 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.852 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.852 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.852 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.792634+0000", 2024-09-12T00:04:52.852 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4543999999999999e-05 2024-09-12T00:04:52.852 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.852 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.852 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.852 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.792688+0000", 2024-09-12T00:04:52.852 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3971999999999998e-05 2024-09-12T00:04:52.852 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.853 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.853 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.853 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.853 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.853 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2719 3.1 e63/23 3:83b62cc7:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_204:head v 63'9, mlcod=63'7)", 2024-09-12T00:04:52.853 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.801392+0000", 2024-09-12T00:04:52.853 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.9767206530000001, 2024-09-12T00:04:52.853 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014562542, 2024-09-12T00:04:52.853 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.853 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.853 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.853 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.853 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.853 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.853 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.801392+0000", 2024-09-12T00:04:52.854 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.854 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.854 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.854 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.801392+0000", 2024-09-12T00:04:52.854 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.854 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.854 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.854 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.801394+0000", 2024-09-12T00:04:52.854 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0090000000000002e-06 2024-09-12T00:04:52.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.854 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.854 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.854 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807832+0000", 2024-09-12T00:04:52.855 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064375989999999996 2024-09-12T00:04:52.855 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.855 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.855 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.855 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807863+0000", 2024-09-12T00:04:52.855 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1114000000000001e-05 2024-09-12T00:04:52.855 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.855 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.855 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.855 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807877+0000", 2024-09-12T00:04:52.855 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4386000000000001e-05 2024-09-12T00:04:52.855 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.855 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.856 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.856 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807948+0000", 2024-09-12T00:04:52.856 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1055000000000003e-05 2024-09-12T00:04:52.856 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.856 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.856 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.856 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807965+0000", 2024-09-12T00:04:52.856 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7025999999999999e-05 2024-09-12T00:04:52.856 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.856 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.856 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.856 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.815469+0000", 2024-09-12T00:04:52.856 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075039979999999996 2024-09-12T00:04:52.856 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.857 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.857 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.857 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.815955+0000", 2024-09-12T00:04:52.857 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00048535499999999998 2024-09-12T00:04:52.857 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.857 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.857 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.857 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.857 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.857 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2739 3.3a 3:5e74d49c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_224:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:52.857 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.006819+0000", 2024-09-12T00:04:52.857 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.771293794, 2024-09-12T00:04:52.857 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018768888000000001, 2024-09-12T00:04:52.857 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.857 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.858 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.858 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.858 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:52.858 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:52.858 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2739 2024-09-12T00:04:52.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.858 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.858 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.858 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.006819+0000", 2024-09-12T00:04:52.858 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.858 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.859 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.006819+0000", 2024-09-12T00:04:52.859 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.859 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.859 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.006821+0000", 2024-09-12T00:04:52.859 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5959999999999998e-06 2024-09-12T00:04:52.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.859 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.859 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008558+0000", 2024-09-12T00:04:52.859 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017366840000000001 2024-09-12T00:04:52.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.859 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.860 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008585+0000", 2024-09-12T00:04:52.860 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7129000000000001e-05 2024-09-12T00:04:52.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.860 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.860 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.860 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008599+0000", 2024-09-12T00:04:52.860 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.326e-05 2024-09-12T00:04:52.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.860 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.860 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.860 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008679+0000", 2024-09-12T00:04:52.860 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0174999999999997e-05 2024-09-12T00:04:52.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.861 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.861 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.861 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008800+0000", 2024-09-12T00:04:52.861 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012106499999999999 2024-09-12T00:04:52.861 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.861 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.861 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:52.861 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008921+0000", 2024-09-12T00:04:52.861 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012163900000000001 2024-09-12T00:04:52.861 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.861 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.862 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.862 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.015366+0000", 2024-09-12T00:04:52.862 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064442309999999999 2024-09-12T00:04:52.862 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.862 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.862 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.862 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.025511+0000", 2024-09-12T00:04:52.862 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010145636 2024-09-12T00:04:52.862 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.862 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.862 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.862 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.025555+0000", 2024-09-12T00:04:52.862 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3426000000000001e-05 2024-09-12T00:04:52.862 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.863 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.863 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.863 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.025588+0000", 2024-09-12T00:04:52.863 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3046999999999997e-05 2024-09-12T00:04:52.863 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.863 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.863 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.863 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.863 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.863 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2743 3.16 3:696a1d44:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:52.863 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.046229+0000", 2024-09-12T00:04:52.863 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.7318837199999999, 2024-09-12T00:04:52.863 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015475686000000001, 2024-09-12T00:04:52.863 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.863 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.864 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.864 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.864 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:52.864 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:52.864 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2743 2024-09-12T00:04:52.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.864 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.864 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.864 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.864 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.046229+0000", 2024-09-12T00:04:52.864 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.864 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.864 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.046229+0000", 2024-09-12T00:04:52.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.046232+0000", 2024-09-12T00:04:52.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.802e-06 2024-09-12T00:04:52.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047565+0000", 2024-09-12T00:04:52.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0013334670000000001 2024-09-12T00:04:52.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.866 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047600+0000", 2024-09-12T00:04:52.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4431000000000003e-05 2024-09-12T00:04:52.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.866 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047616+0000", 2024-09-12T00:04:52.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5928999999999999e-05 2024-09-12T00:04:52.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.866 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047703+0000", 2024-09-12T00:04:52.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7557000000000002e-05 2024-09-12T00:04:52.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.867 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.867 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.867 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047863+0000", 2024-09-12T00:04:52.867 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015991700000000001 2024-09-12T00:04:52.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.867 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.867 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:52.867 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047993+0000", 2024-09-12T00:04:52.867 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000129591 2024-09-12T00:04:52.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.867 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.867 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.867 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.058764+0000", 2024-09-12T00:04:52.867 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010770956 2024-09-12T00:04:52.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.868 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.868 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.868 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.061632+0000", 2024-09-12T00:04:52.868 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0028681639999999999 2024-09-12T00:04:52.868 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.868 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.868 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.868 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.061675+0000", 2024-09-12T00:04:52.868 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3288999999999998e-05 2024-09-12T00:04:52.868 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.868 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.868 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.868 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.061705+0000", 2024-09-12T00:04:52.868 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9583000000000001e-05 2024-09-12T00:04:52.869 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.869 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.869 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.869 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.869 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2744 3.20 3:0785dd58:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:52.869 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.057454+0000", 2024-09-12T00:04:52.869 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.7206586670000004, 2024-09-12T00:04:52.869 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018728709, 2024-09-12T00:04:52.869 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.869 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.869 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.869 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.869 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:52.870 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:52.870 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2744 2024-09-12T00:04:52.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.870 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.870 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.870 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.870 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.057454+0000", 2024-09-12T00:04:52.870 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.870 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.870 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.870 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.057454+0000", 2024-09-12T00:04:52.870 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.870 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.871 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.871 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.057457+0000", 2024-09-12T00:04:52.871 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6680000000000001e-06 2024-09-12T00:04:52.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.871 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.871 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.871 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059191+0000", 2024-09-12T00:04:52.871 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001734766 2024-09-12T00:04:52.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.871 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.871 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.871 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059216+0000", 2024-09-12T00:04:52.871 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4933e-05 2024-09-12T00:04:52.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.872 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.872 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059230+0000", 2024-09-12T00:04:52.872 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3737000000000001e-05 2024-09-12T00:04:52.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.872 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.872 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059310+0000", 2024-09-12T00:04:52.872 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0086999999999994e-05 2024-09-12T00:04:52.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.872 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.872 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059415+0000", 2024-09-12T00:04:52.873 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010509 2024-09-12T00:04:52.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.873 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.873 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:52.873 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059521+0000", 2024-09-12T00:04:52.873 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105454 2024-09-12T00:04:52.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.873 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.873 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.873 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.066050+0000", 2024-09-12T00:04:52.873 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0065290620000000004 2024-09-12T00:04:52.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.873 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.874 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.874 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.076044+0000", 2024-09-12T00:04:52.874 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0099942539999999993 2024-09-12T00:04:52.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.874 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.874 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.874 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.076123+0000", 2024-09-12T00:04:52.874 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8980000000000006e-05 2024-09-12T00:04:52.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.874 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.874 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.874 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.076183+0000", 2024-09-12T00:04:52.874 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9678e-05 2024-09-12T00:04:52.874 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.874 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.875 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.875 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.875 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.875 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2752 3.5 3:a07c0cce:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:52.875 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.145032+0000", 2024-09-12T00:04:52.875 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.6330810229999999, 2024-09-12T00:04:52.875 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017073703999999999, 2024-09-12T00:04:52.875 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.875 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.875 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.875 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.875 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:52.875 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:52.875 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2752 2024-09-12T00:04:52.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.876 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.876 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.876 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.145032+0000", 2024-09-12T00:04:52.876 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.876 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.876 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.145032+0000", 2024-09-12T00:04:52.876 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.876 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.877 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.145035+0000", 2024-09-12T00:04:52.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1810000000000001e-06 2024-09-12T00:04:52.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.877 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.877 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.877 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.146817+0000", 2024-09-12T00:04:52.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017823439999999999 2024-09-12T00:04:52.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.877 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.877 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.877 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.146860+0000", 2024-09-12T00:04:52.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2549999999999997e-05 2024-09-12T00:04:52.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.877 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.878 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.878 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.146880+0000", 2024-09-12T00:04:52.878 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9947000000000001e-05 2024-09-12T00:04:52.878 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.878 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.878 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.878 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.146984+0000", 2024-09-12T00:04:52.878 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104503 2024-09-12T00:04:52.878 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.878 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.878 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.878 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.147170+0000", 2024-09-12T00:04:52.878 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018568100000000001 2024-09-12T00:04:52.878 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.878 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.879 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:52.879 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.147326+0000", 2024-09-12T00:04:52.879 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000155993 2024-09-12T00:04:52.879 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.879 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.879 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.879 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.154513+0000", 2024-09-12T00:04:52.879 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071872910000000002 2024-09-12T00:04:52.879 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.879 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.879 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.879 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.162030+0000", 2024-09-12T00:04:52.880 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075170030000000004 2024-09-12T00:04:52.880 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.880 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.880 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.880 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.162071+0000", 2024-09-12T00:04:52.880 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0834999999999998e-05 2024-09-12T00:04:52.880 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.880 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.880 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.880 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.162105+0000", 2024-09-12T00:04:52.880 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4375999999999997e-05 2024-09-12T00:04:52.880 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.880 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.880 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.881 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.881 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.881 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2760 3.5 3:a26ca13d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_245:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:52.881 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.273495+0000", 2024-09-12T00:04:52.881 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.5046171450000001, 2024-09-12T00:04:52.881 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014619127000000001, 2024-09-12T00:04:52.881 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:52.881 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:52.881 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:52.881 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:52.881 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:52.881 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:52.881 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2760 2024-09-12T00:04:52.881 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.882 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:52.882 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.882 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:52.882 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.273495+0000", 2024-09-12T00:04:52.882 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.882 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.882 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:52.882 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.273495+0000", 2024-09-12T00:04:52.882 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:52.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.882 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.883 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:52.883 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.273499+0000", 2024-09-12T00:04:52.883 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3100000000000001e-06 2024-09-12T00:04:52.883 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.883 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.883 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:52.883 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275445+0000", 2024-09-12T00:04:52.883 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001946454 2024-09-12T00:04:52.883 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.883 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.883 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:52.883 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275468+0000", 2024-09-12T00:04:52.884 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2768999999999998e-05 2024-09-12T00:04:52.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.884 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.884 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:52.884 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275481+0000", 2024-09-12T00:04:52.884 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3302000000000001e-05 2024-09-12T00:04:52.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.884 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.884 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:52.884 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275549+0000", 2024-09-12T00:04:52.884 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7220999999999999e-05 2024-09-12T00:04:52.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.884 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.884 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:52.884 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275676+0000", 2024-09-12T00:04:52.885 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012752 2024-09-12T00:04:52.885 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.885 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.885 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:52.885 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275766+0000", 2024-09-12T00:04:52.885 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9577e-05 2024-09-12T00:04:52.885 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.885 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.885 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:52.885 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.281827+0000", 2024-09-12T00:04:52.885 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0060609970000000003 2024-09-12T00:04:52.885 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.885 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.885 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:52.885 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.287996+0000", 2024-09-12T00:04:52.886 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061689359999999999 2024-09-12T00:04:52.886 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.886 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.886 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:52.886 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.288061+0000", 2024-09-12T00:04:52.886 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5519999999999996e-05 2024-09-12T00:04:52.886 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:52.886 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:52.886 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:52.886 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.288115+0000", 2024-09-12T00:04:52.886 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3520999999999998e-05 2024-09-12T00:04:52.886 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.886 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.886 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.887 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:52.887 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:52.887 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:52.888 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:04:52.889 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:52.886+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:52.989 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:52.990+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:53.049 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:53.050 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:53.050 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:53.050 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:53.062 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:04:53.109 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:53.112+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:53.173 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:53.173 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:53.173 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:53.173 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:53.173 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:53.186 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:04:53.229 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:53.232+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:53.292 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:53.292+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:53.358 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:53.359 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:53.359 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:53.359 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:53.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.359 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4232.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-12T00:04:53.359 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:04:53.359 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 96.811355384999999, 2024-09-12T00:04:53.359 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.049385680000000001, 2024-09-12T00:04:53.359 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:53.359 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:53.360 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.360 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:53.360 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4232", 2024-09-12T00:04:53.360 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/3037249369", 2024-09-12T00:04:53.360 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:04:53.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.360 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:53.360 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.360 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:53.360 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:04:53.360 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.360 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.360 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:53.361 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:04:53.361 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.361 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.361 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.361 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:53.361 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548454+0000", 2024-09-12T00:04:53.361 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2259999999999999e-06 2024-09-12T00:04:53.361 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.361 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.361 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:53.361 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548466+0000", 2024-09-12T00:04:53.361 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1361e-05 2024-09-12T00:04:53.361 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.361 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.362 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:53.362 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548492+0000", 2024-09-12T00:04:53.362 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6225999999999999e-05 2024-09-12T00:04:53.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.362 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.362 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.362 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548509+0000", 2024-09-12T00:04:53.362 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7452000000000002e-05 2024-09-12T00:04:53.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.362 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.362 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.362 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549371+0000", 2024-09-12T00:04:53.362 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00086204300000000005 2024-09-12T00:04:53.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.363 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:53.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549396+0000", 2024-09-12T00:04:53.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.51e-05 2024-09-12T00:04:53.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.363 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593253+0000", 2024-09-12T00:04:53.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.043856248 2024-09-12T00:04:53.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:53.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593517+0000", 2024-09-12T00:04:53.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026439299999999997 2024-09-12T00:04:53.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:53.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594046+0000", 2024-09-12T00:04:53.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00052854200000000001 2024-09-12T00:04:53.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:53.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597642+0000", 2024-09-12T00:04:53.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0035959070000000002 2024-09-12T00:04:53.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.365 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:53.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597670+0000", 2024-09-12T00:04:53.365 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8235999999999999e-05 2024-09-12T00:04:53.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.365 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:53.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597754+0000", 2024-09-12T00:04:53.365 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4009000000000002e-05 2024-09-12T00:04:53.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.365 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:53.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597833+0000", 2024-09-12T00:04:53.366 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8937000000000007e-05 2024-09-12T00:04:53.366 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.366 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:53.366 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.366 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.366 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T00:04:53.366 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:04:53.366 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 84.030145617000002, 2024-09-12T00:04:53.366 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025928692999999999, 2024-09-12T00:04:53.366 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:53.366 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:53.366 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "reached pg", 2024-09-12T00:04:53.366 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:53.367 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:53.367 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:53.367 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 43 2024-09-12T00:04:53.367 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.367 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:53.367 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.367 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:53.367 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:04:53.367 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.367 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.367 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.367 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:53.367 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:04:53.367 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.368 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:53.368 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329660+0000", 2024-09-12T00:04:53.368 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.965e-06 2024-09-12T00:04:53.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.368 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:53.368 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329673+0000", 2024-09-12T00:04:53.368 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3402e-05 2024-09-12T00:04:53.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.368 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:53.368 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329706+0000", 2024-09-12T00:04:53.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2441000000000003e-05 2024-09-12T00:04:53.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329723+0000", 2024-09-12T00:04:53.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7609e-05 2024-09-12T00:04:53.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330437+0000", 2024-09-12T00:04:53.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00071403500000000002 2024-09-12T00:04:53.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:53.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330454+0000", 2024-09-12T00:04:53.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6820000000000002e-05 2024-09-12T00:04:53.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347344+0000", 2024-09-12T00:04:53.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016890275 2024-09-12T00:04:53.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:53.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347365+0000", 2024-09-12T00:04:53.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0350999999999999e-05 2024-09-12T00:04:53.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355323+0000", 2024-09-12T00:04:53.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079579400000000002 2024-09-12T00:04:53.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.371 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:53.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355585+0000", 2024-09-12T00:04:53.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026285499999999999 2024-09-12T00:04:53.371 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.371 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:53.371 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.371 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.372 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1641 3.26 e58/23 3:658fe58e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2__shadow_.hDHTDpIswwqRA2bHiHVxkhWqZde6XEj_1:head v 58'1, mlcod=0'0)", 2024-09-12T00:04:53.372 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:04:53.372 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 20.300787113999998, 2024-09-12T00:04:53.372 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014950144, 2024-09-12T00:04:53.372 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:53.372 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:53.372 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.372 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:53.372 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.372 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:53.372 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:04:53.372 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.372 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.372 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.373 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:53.373 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:04:53.373 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.373 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.373 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.373 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:53.373 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059017+0000", 2024-09-12T00:04:53.373 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.508e-06 2024-09-12T00:04:53.373 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.373 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.373 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:53.373 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061582+0000", 2024-09-12T00:04:53.373 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025654010000000001 2024-09-12T00:04:53.373 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.374 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.374 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:53.374 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061607+0000", 2024-09-12T00:04:53.374 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5028000000000002e-05 2024-09-12T00:04:53.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.374 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.374 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.374 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061619+0000", 2024-09-12T00:04:53.374 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1905999999999999e-05 2024-09-12T00:04:53.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.374 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.374 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.374 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061696+0000", 2024-09-12T00:04:53.375 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7305999999999995e-05 2024-09-12T00:04:53.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.375 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:53.375 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061717+0000", 2024-09-12T00:04:53.375 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0380000000000001e-05 2024-09-12T00:04:53.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.375 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:53.375 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073925+0000", 2024-09-12T00:04:53.375 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012208088000000001 2024-09-12T00:04:53.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.376 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:53.376 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073965+0000", 2024-09-12T00:04:53.376 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0527e-05 2024-09-12T00:04:53.376 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.376 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:53.376 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.376 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.376 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1775 3.30 3:0c2ae78d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:53.376 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:04:53.376 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 19.360949796, 2024-09-12T00:04:53.376 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020783729000000001, 2024-09-12T00:04:53.376 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:53.376 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:53.377 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.377 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:53.377 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:53.377 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:53.377 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1775 2024-09-12T00:04:53.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.377 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:53.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.377 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:53.377 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:04:53.377 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.377 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:53.378 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:04:53.378 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.378 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.378 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:53.378 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998856+0000", 2024-09-12T00:04:53.378 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6849999999999999e-06 2024-09-12T00:04:53.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.378 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.378 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:53.378 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001327+0000", 2024-09-12T00:04:53.378 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024706279999999999 2024-09-12T00:04:53.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.379 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.379 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:53.379 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001355+0000", 2024-09-12T00:04:53.379 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8419999999999999e-05 2024-09-12T00:04:53.379 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.379 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.379 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.379 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001366+0000", 2024-09-12T00:04:53.379 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1073999999999999e-05 2024-09-12T00:04:53.379 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.379 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.379 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.379 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001438+0000", 2024-09-12T00:04:53.379 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1389000000000004e-05 2024-09-12T00:04:53.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.380 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.380 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:53.380 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001548+0000", 2024-09-12T00:04:53.380 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110612 2024-09-12T00:04:53.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.380 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.380 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:53.380 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001639+0000", 2024-09-12T00:04:53.380 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0192999999999995e-05 2024-09-12T00:04:53.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.380 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.380 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:53.381 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019057+0000", 2024-09-12T00:04:53.381 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017418411000000002 2024-09-12T00:04:53.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.381 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.381 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:53.381 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019528+0000", 2024-09-12T00:04:53.381 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00047075699999999998 2024-09-12T00:04:53.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.381 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.381 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:53.381 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019577+0000", 2024-09-12T00:04:53.381 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8714999999999997e-05 2024-09-12T00:04:53.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.381 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.382 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:53.382 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019636+0000", 2024-09-12T00:04:53.382 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9845e-05 2024-09-12T00:04:53.382 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.382 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:53.382 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.382 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.382 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.382 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1780 3.16 e58/23 3:69d8ee52:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3_10Mb.:head v 58'1, mlcod=0'0)", 2024-09-12T00:04:53.382 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:04:53.382 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 19.334656504000002, 2024-09-12T00:04:53.382 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01408911, 2024-09-12T00:04:53.382 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:53.382 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:53.382 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.383 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:53.383 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.383 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:53.383 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:04:53.383 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.383 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.383 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:53.383 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:04:53.383 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.383 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.383 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:53.383 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025148+0000", 2024-09-12T00:04:53.384 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4229999999999999e-06 2024-09-12T00:04:53.384 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.384 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.384 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:53.384 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026337+0000", 2024-09-12T00:04:53.384 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011890589999999999 2024-09-12T00:04:53.384 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.384 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.384 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:53.385 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026362+0000", 2024-09-12T00:04:53.385 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4566000000000002e-05 2024-09-12T00:04:53.385 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.385 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.385 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.385 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026372+0000", 2024-09-12T00:04:53.385 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8509999999999994e-06 2024-09-12T00:04:53.385 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.385 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.385 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.385 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026448+0000", 2024-09-12T00:04:53.385 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6626999999999997e-05 2024-09-12T00:04:53.385 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.385 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.386 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:53.386 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026473+0000", 2024-09-12T00:04:53.386 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4647e-05 2024-09-12T00:04:53.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.386 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.386 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:53.386 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039120+0000", 2024-09-12T00:04:53.386 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012647122 2024-09-12T00:04:53.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.386 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.386 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:53.386 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039235+0000", 2024-09-12T00:04:53.386 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000114815 2024-09-12T00:04:53.386 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.387 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:53.387 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.387 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2648 3.13 3:c936a360:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:53.387 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.164782+0000", 2024-09-12T00:04:53.387 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 6.1950202169999997, 2024-09-12T00:04:53.387 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019628063000000001, 2024-09-12T00:04:53.387 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:53.387 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:53.387 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.387 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:53.387 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:53.388 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:53.388 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2648 2024-09-12T00:04:53.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.388 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:53.388 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.388 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:53.388 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.164782+0000", 2024-09-12T00:04:53.388 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.388 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.388 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:53.388 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.164782+0000", 2024-09-12T00:04:53.388 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.389 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.389 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.389 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:53.389 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.164786+0000", 2024-09-12T00:04:53.389 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3450000000000002e-06 2024-09-12T00:04:53.389 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.389 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.389 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:53.389 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166758+0000", 2024-09-12T00:04:53.389 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019721629999999999 2024-09-12T00:04:53.389 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.389 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.389 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:53.389 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166785+0000", 2024-09-12T00:04:53.390 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7676000000000001e-05 2024-09-12T00:04:53.390 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.390 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.390 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.390 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166799+0000", 2024-09-12T00:04:53.390 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3716e-05 2024-09-12T00:04:53.390 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.390 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.390 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.390 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166895+0000", 2024-09-12T00:04:53.390 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6243999999999995e-05 2024-09-12T00:04:53.390 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.390 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.390 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:53.391 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.167092+0000", 2024-09-12T00:04:53.391 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019639200000000001 2024-09-12T00:04:53.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.391 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.391 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:53.391 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.167273+0000", 2024-09-12T00:04:53.391 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000181533 2024-09-12T00:04:53.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.391 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.391 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:53.391 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.174331+0000", 2024-09-12T00:04:53.391 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0070577879999999997 2024-09-12T00:04:53.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.391 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:53.392 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.184172+0000", 2024-09-12T00:04:53.392 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0098409469999999992 2024-09-12T00:04:53.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.392 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:53.392 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.184238+0000", 2024-09-12T00:04:53.392 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6036000000000003e-05 2024-09-12T00:04:53.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.392 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:53.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.184410+0000", 2024-09-12T00:04:53.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017222299999999999 2024-09-12T00:04:53.393 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.393 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:53.393 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.393 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2659 3.2d 3:b4a71344:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:53.393 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.285246+0000", 2024-09-12T00:04:53.393 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 6.0745563139999996, 2024-09-12T00:04:53.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020000217000000001, 2024-09-12T00:04:53.393 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:53.393 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:53.393 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.394 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:53.394 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:53.394 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:53.394 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2659 2024-09-12T00:04:53.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.394 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:53.394 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.394 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:53.394 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.285246+0000", 2024-09-12T00:04:53.394 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.394 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.394 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:53.394 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.285246+0000", 2024-09-12T00:04:53.395 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.395 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.395 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.395 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:53.395 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.285249+0000", 2024-09-12T00:04:53.395 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3890000000000001e-06 2024-09-12T00:04:53.395 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.395 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.395 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:53.395 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287047+0000", 2024-09-12T00:04:53.395 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017978099999999999 2024-09-12T00:04:53.395 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.396 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.396 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:53.396 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287084+0000", 2024-09-12T00:04:53.396 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6358e-05 2024-09-12T00:04:53.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.396 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.396 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.396 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287101+0000", 2024-09-12T00:04:53.396 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7815000000000001e-05 2024-09-12T00:04:53.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.396 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.396 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287198+0000", 2024-09-12T00:04:53.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6482000000000002e-05 2024-09-12T00:04:53.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.397 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:53.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287337+0000", 2024-09-12T00:04:53.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013917500000000001 2024-09-12T00:04:53.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.397 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:53.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287451+0000", 2024-09-12T00:04:53.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000113962 2024-09-12T00:04:53.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.398 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:53.398 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.293889+0000", 2024-09-12T00:04:53.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064380110000000004 2024-09-12T00:04:53.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.398 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:53.398 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.305119+0000", 2024-09-12T00:04:53.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011229872 2024-09-12T00:04:53.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:53.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.305191+0000", 2024-09-12T00:04:53.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2002000000000006e-05 2024-09-12T00:04:53.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:53.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.305246+0000", 2024-09-12T00:04:53.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5340999999999998e-05 2024-09-12T00:04:53.399 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.399 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:53.399 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.400 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2662 3.28 3:1791a19e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:53.400 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.317519+0000", 2024-09-12T00:04:53.400 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 6.0422833660000004, 2024-09-12T00:04:53.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016495961999999999, 2024-09-12T00:04:53.400 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:53.400 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:53.400 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.400 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:53.400 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:53.400 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:53.400 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2662 2024-09-12T00:04:53.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.400 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:53.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.401 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:53.401 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317519+0000", 2024-09-12T00:04:53.401 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.401 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:53.401 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317519+0000", 2024-09-12T00:04:53.401 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.401 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:53.401 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317522+0000", 2024-09-12T00:04:53.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7389999999999999e-06 2024-09-12T00:04:53.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.402 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:53.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319683+0000", 2024-09-12T00:04:53.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021614970000000001 2024-09-12T00:04:53.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.402 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:53.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319715+0000", 2024-09-12T00:04:53.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1574e-05 2024-09-12T00:04:53.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.403 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319730+0000", 2024-09-12T00:04:53.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5543e-05 2024-09-12T00:04:53.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.403 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319820+0000", 2024-09-12T00:04:53.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9402999999999998e-05 2024-09-12T00:04:53.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.403 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:53.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319976+0000", 2024-09-12T00:04:53.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015662900000000001 2024-09-12T00:04:53.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:53.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.320143+0000", 2024-09-12T00:04:53.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000166207 2024-09-12T00:04:53.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:53.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.327504+0000", 2024-09-12T00:04:53.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0073616189999999998 2024-09-12T00:04:53.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:53.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.333886+0000", 2024-09-12T00:04:53.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063817650000000002 2024-09-12T00:04:53.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:53.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.333952+0000", 2024-09-12T00:04:53.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5889999999999994e-05 2024-09-12T00:04:53.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:53.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.334015+0000", 2024-09-12T00:04:53.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3095999999999994e-05 2024-09-12T00:04:53.405 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.405 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:53.405 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.406 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2664 3.1d 3:b8bd1b2d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:53.406 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.341755+0000", 2024-09-12T00:04:53.406 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 6.0180475099999997, 2024-09-12T00:04:53.406 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017365477000000001, 2024-09-12T00:04:53.406 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:53.406 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:53.406 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.406 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:53.406 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:53.406 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:53.406 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2664 2024-09-12T00:04:53.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.407 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:53.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:53.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.341755+0000", 2024-09-12T00:04:53.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:53.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.341755+0000", 2024-09-12T00:04:53.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:53.408 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.341758+0000", 2024-09-12T00:04:53.408 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6560000000000001e-06 2024-09-12T00:04:53.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.408 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:53.408 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343741+0000", 2024-09-12T00:04:53.408 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019832389999999999 2024-09-12T00:04:53.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.408 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:53.408 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343766+0000", 2024-09-12T00:04:53.408 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4967e-05 2024-09-12T00:04:53.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.409 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343776+0000", 2024-09-12T00:04:53.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0686000000000001e-05 2024-09-12T00:04:53.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.409 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343854+0000", 2024-09-12T00:04:53.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7210000000000001e-05 2024-09-12T00:04:53.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:53.409 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.344027+0000", 2024-09-12T00:04:53.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000173065 2024-09-12T00:04:53.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:53.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.344194+0000", 2024-09-12T00:04:53.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016688900000000001 2024-09-12T00:04:53.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:53.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.358530+0000", 2024-09-12T00:04:53.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014336877 2024-09-12T00:04:53.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:53.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.359009+0000", 2024-09-12T00:04:53.411 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00047882099999999999 2024-09-12T00:04:53.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.411 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:53.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.359069+0000", 2024-09-12T00:04:53.411 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9892999999999997e-05 2024-09-12T00:04:53.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.411 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:53.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.359120+0000", 2024-09-12T00:04:53.411 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1174000000000002e-05 2024-09-12T00:04:53.411 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.412 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:53.412 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.412 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.412 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2666 3.13 3:cbd43ea3:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:53.412 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.362905+0000", 2024-09-12T00:04:53.412 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.9968971279999996, 2024-09-12T00:04:53.412 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017815950000000001, 2024-09-12T00:04:53.412 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:53.412 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:53.412 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.412 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:53.412 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:53.413 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:53.413 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2666 2024-09-12T00:04:53.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.413 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:53.413 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:53.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.362905+0000", 2024-09-12T00:04:53.413 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.413 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:53.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.362905+0000", 2024-09-12T00:04:53.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.414 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:53.414 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.362909+0000", 2024-09-12T00:04:53.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4529999999999998e-06 2024-09-12T00:04:53.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.414 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:53.414 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364466+0000", 2024-09-12T00:04:53.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015570060000000001 2024-09-12T00:04:53.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.414 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:53.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364500+0000", 2024-09-12T00:04:53.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4289999999999999e-05 2024-09-12T00:04:53.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364515+0000", 2024-09-12T00:04:53.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4537e-05 2024-09-12T00:04:53.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364615+0000", 2024-09-12T00:04:53.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100782 2024-09-12T00:04:53.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:53.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364805+0000", 2024-09-12T00:04:53.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018921399999999999 2024-09-12T00:04:53.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:53.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364984+0000", 2024-09-12T00:04:53.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017972299999999999 2024-09-12T00:04:53.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:53.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.372042+0000", 2024-09-12T00:04:53.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0070581120000000001 2024-09-12T00:04:53.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.417 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:53.417 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.380620+0000", 2024-09-12T00:04:53.417 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085774309999999999 2024-09-12T00:04:53.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.417 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:53.417 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.380666+0000", 2024-09-12T00:04:53.417 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5881000000000003e-05 2024-09-12T00:04:53.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.417 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:53.418 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.380721+0000", 2024-09-12T00:04:53.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5520999999999999e-05 2024-09-12T00:04:53.418 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.418 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:53.418 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.418 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.418 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2677 3.13 3:c9d59693:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:53.418 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.474053+0000", 2024-09-12T00:04:53.418 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.8857497810000003, 2024-09-12T00:04:53.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017985961000000002, 2024-09-12T00:04:53.418 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:53.418 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:53.418 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.419 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:53.419 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:53.419 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:53.419 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2677 2024-09-12T00:04:53.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.419 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:53.419 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.419 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:53.419 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.474053+0000", 2024-09-12T00:04:53.419 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.419 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.419 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:53.419 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.474053+0000", 2024-09-12T00:04:53.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.420 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.420 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:53.420 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.474055+0000", 2024-09-12T00:04:53.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.711e-06 2024-09-12T00:04:53.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.420 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.420 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:53.420 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475342+0000", 2024-09-12T00:04:53.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001286508 2024-09-12T00:04:53.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:53.421 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475373+0000", 2024-09-12T00:04:53.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1130000000000002e-05 2024-09-12T00:04:53.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.421 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475387+0000", 2024-09-12T00:04:53.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4280999999999999e-05 2024-09-12T00:04:53.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.421 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475476+0000", 2024-09-12T00:04:53.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8621000000000004e-05 2024-09-12T00:04:53.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:53.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475644+0000", 2024-09-12T00:04:53.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016785699999999999 2024-09-12T00:04:53.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:53.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475742+0000", 2024-09-12T00:04:53.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8016000000000005e-05 2024-09-12T00:04:53.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:53.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.480305+0000", 2024-09-12T00:04:53.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045629049999999999 2024-09-12T00:04:53.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:53.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.491948+0000", 2024-09-12T00:04:53.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011643280000000001 2024-09-12T00:04:53.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:53.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.492000+0000", 2024-09-12T00:04:53.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2482000000000003e-05 2024-09-12T00:04:53.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:53.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.492039+0000", 2024-09-12T00:04:53.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8170000000000002e-05 2024-09-12T00:04:53.424 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.424 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:53.424 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.424 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2691 3.2d 3:b4a2284d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:53.424 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.515274+0000", 2024-09-12T00:04:53.424 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.844528725, 2024-09-12T00:04:53.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018577757, 2024-09-12T00:04:53.424 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:53.425 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:53.425 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.425 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:53.425 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:53.425 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:53.425 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2691 2024-09-12T00:04:53.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.425 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:53.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.425 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:53.425 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.515274+0000", 2024-09-12T00:04:53.425 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.426 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:53.426 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.515274+0000", 2024-09-12T00:04:53.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.426 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.426 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:53.426 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.515276+0000", 2024-09-12T00:04:53.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3499999999999999e-06 2024-09-12T00:04:53.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.426 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.426 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:53.426 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.516900+0000", 2024-09-12T00:04:53.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001623633 2024-09-12T00:04:53.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.426 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:53.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.516929+0000", 2024-09-12T00:04:53.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9009999999999998e-05 2024-09-12T00:04:53.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.516942+0000", 2024-09-12T00:04:53.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3551e-05 2024-09-12T00:04:53.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.517022+0000", 2024-09-12T00:04:53.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0167999999999995e-05 2024-09-12T00:04:53.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.428 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:53.428 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.517216+0000", 2024-09-12T00:04:53.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000193919 2024-09-12T00:04:53.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.428 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:53.428 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.517380+0000", 2024-09-12T00:04:53.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016336000000000001 2024-09-12T00:04:53.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.428 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:53.428 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.522907+0000", 2024-09-12T00:04:53.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055276420000000001 2024-09-12T00:04:53.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.429 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:53.429 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.533735+0000", 2024-09-12T00:04:53.429 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010827997000000001 2024-09-12T00:04:53.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.429 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:53.429 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.533800+0000", 2024-09-12T00:04:53.429 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4738000000000003e-05 2024-09-12T00:04:53.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.429 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:53.430 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.533851+0000", 2024-09-12T00:04:53.430 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1388999999999999e-05 2024-09-12T00:04:53.430 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.430 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:53.430 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.430 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2697 3.13 3:c87ccb22:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:53.430 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.577849+0000", 2024-09-12T00:04:53.431 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.7819534050000003, 2024-09-12T00:04:53.431 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019139156000000001, 2024-09-12T00:04:53.431 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:53.431 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:53.431 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.431 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:53.431 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:53.431 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:53.431 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2697 2024-09-12T00:04:53.431 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.431 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:53.431 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.431 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:53.432 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577849+0000", 2024-09-12T00:04:53.432 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.432 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.432 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.432 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:53.432 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577849+0000", 2024-09-12T00:04:53.432 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.432 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.432 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.432 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:53.432 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577853+0000", 2024-09-12T00:04:53.432 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7510000000000002e-06 2024-09-12T00:04:53.432 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:53.433 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579595+0000", 2024-09-12T00:04:53.433 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001741954 2024-09-12T00:04:53.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:53.433 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579625+0000", 2024-09-12T00:04:53.433 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9907999999999999e-05 2024-09-12T00:04:53.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.433 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579640+0000", 2024-09-12T00:04:53.433 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4894e-05 2024-09-12T00:04:53.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.434 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.434 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579728+0000", 2024-09-12T00:04:53.434 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8704999999999999e-05 2024-09-12T00:04:53.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.434 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:53.434 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579922+0000", 2024-09-12T00:04:53.434 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000194019 2024-09-12T00:04:53.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.434 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:53.434 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.580092+0000", 2024-09-12T00:04:53.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016984300000000001 2024-09-12T00:04:53.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.435 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:53.435 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.591944+0000", 2024-09-12T00:04:53.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011852252000000001 2024-09-12T00:04:53.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.435 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:53.435 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.596913+0000", 2024-09-12T00:04:53.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049688279999999998 2024-09-12T00:04:53.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.436 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:53.436 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.596955+0000", 2024-09-12T00:04:53.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2290999999999999e-05 2024-09-12T00:04:53.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.436 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.436 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:53.436 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.596988+0000", 2024-09-12T00:04:53.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2710999999999999e-05 2024-09-12T00:04:53.436 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.436 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:53.436 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.436 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.436 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2701 3.11 3:8babcc8d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:53.437 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.617191+0000", 2024-09-12T00:04:53.437 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.7426117919999999, 2024-09-12T00:04:53.437 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013760204999999999, 2024-09-12T00:04:53.437 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:53.437 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:53.437 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.437 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:53.437 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:53.437 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:53.437 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2701 2024-09-12T00:04:53.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.437 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:53.438 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.438 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:53.438 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.617191+0000", 2024-09-12T00:04:53.438 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.438 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.438 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.438 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:53.438 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.617191+0000", 2024-09-12T00:04:53.438 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.438 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.438 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.438 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:53.438 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.617194+0000", 2024-09-12T00:04:53.438 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.788e-06 2024-09-12T00:04:53.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.439 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.439 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:53.439 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618652+0000", 2024-09-12T00:04:53.439 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001457716 2024-09-12T00:04:53.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.439 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.439 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:53.439 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618682+0000", 2024-09-12T00:04:53.439 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9668000000000001e-05 2024-09-12T00:04:53.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.439 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.439 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.439 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618692+0000", 2024-09-12T00:04:53.439 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0429e-05 2024-09-12T00:04:53.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.440 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.440 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.440 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618766+0000", 2024-09-12T00:04:53.440 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4190999999999995e-05 2024-09-12T00:04:53.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.440 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.440 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:53.440 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618932+0000", 2024-09-12T00:04:53.440 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000165923 2024-09-12T00:04:53.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.440 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.440 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:53.440 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.619026+0000", 2024-09-12T00:04:53.441 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3906999999999994e-05 2024-09-12T00:04:53.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.441 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.441 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:53.441 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.623168+0000", 2024-09-12T00:04:53.441 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041419309999999997 2024-09-12T00:04:53.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.441 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.441 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:53.441 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.630815+0000", 2024-09-12T00:04:53.441 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0076470100000000001 2024-09-12T00:04:53.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.441 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.441 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:53.442 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.630887+0000", 2024-09-12T00:04:53.442 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2218999999999994e-05 2024-09-12T00:04:53.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.442 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:53.442 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.630951+0000", 2024-09-12T00:04:53.442 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3423000000000006e-05 2024-09-12T00:04:53.442 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.442 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:53.442 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.442 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2704 3.13 3:c90afc39:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:53.442 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.647542+0000", 2024-09-12T00:04:53.443 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.712259929, 2024-09-12T00:04:53.443 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017595339000000002, 2024-09-12T00:04:53.443 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:53.443 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:53.443 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.443 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:53.443 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:53.443 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:53.443 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2704 2024-09-12T00:04:53.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.443 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:53.443 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.443 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:53.443 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.647542+0000", 2024-09-12T00:04:53.444 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.444 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:53.444 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.647542+0000", 2024-09-12T00:04:53.444 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.444 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:53.444 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.647544+0000", 2024-09-12T00:04:53.444 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6339999999999999e-06 2024-09-12T00:04:53.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.445 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:53.445 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649032+0000", 2024-09-12T00:04:53.445 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001488063 2024-09-12T00:04:53.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.445 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.445 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:53.445 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649053+0000", 2024-09-12T00:04:53.445 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0761e-05 2024-09-12T00:04:53.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.445 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.445 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.445 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649066+0000", 2024-09-12T00:04:53.446 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2597e-05 2024-09-12T00:04:53.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.446 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.446 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.446 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649142+0000", 2024-09-12T00:04:53.446 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6254999999999994e-05 2024-09-12T00:04:53.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.446 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.446 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:53.446 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649250+0000", 2024-09-12T00:04:53.446 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010774500000000001 2024-09-12T00:04:53.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.447 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:53.447 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649364+0000", 2024-09-12T00:04:53.447 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000114401 2024-09-12T00:04:53.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.447 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:53.447 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.658970+0000", 2024-09-12T00:04:53.447 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0096065260000000006 2024-09-12T00:04:53.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.447 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:53.448 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.665022+0000", 2024-09-12T00:04:53.448 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0060516459999999999 2024-09-12T00:04:53.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.448 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.448 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:53.448 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.665086+0000", 2024-09-12T00:04:53.448 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3940000000000001e-05 2024-09-12T00:04:53.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.448 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.448 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:53.448 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.665138+0000", 2024-09-12T00:04:53.448 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1771000000000003e-05 2024-09-12T00:04:53.448 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.449 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:53.449 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.449 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2706 3.d 3:b1b5d8c6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:53.449 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.667263+0000", 2024-09-12T00:04:53.449 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.6925389749999997, 2024-09-12T00:04:53.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017030099999999999, 2024-09-12T00:04:53.449 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:53.449 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:53.449 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.449 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:53.450 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:53.450 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:53.450 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2706 2024-09-12T00:04:53.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.450 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:53.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:53.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.667263+0000", 2024-09-12T00:04:53.450 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:53.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.667263+0000", 2024-09-12T00:04:53.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.451 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:53.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.667267+0000", 2024-09-12T00:04:53.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1540000000000002e-06 2024-09-12T00:04:53.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.451 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:53.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672789+0000", 2024-09-12T00:04:53.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055222819999999999 2024-09-12T00:04:53.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.452 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:53.452 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672817+0000", 2024-09-12T00:04:53.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8510999999999999e-05 2024-09-12T00:04:53.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.452 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.452 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672831+0000", 2024-09-12T00:04:53.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3919e-05 2024-09-12T00:04:53.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.453 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.453 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672988+0000", 2024-09-12T00:04:53.453 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015688 2024-09-12T00:04:53.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.453 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:53.453 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.673174+0000", 2024-09-12T00:04:53.453 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018615400000000001 2024-09-12T00:04:53.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.453 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:53.453 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.673352+0000", 2024-09-12T00:04:53.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017803599999999999 2024-09-12T00:04:53.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.454 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:53.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.683897+0000", 2024-09-12T00:04:53.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010544239 2024-09-12T00:04:53.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.454 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:53.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.684176+0000", 2024-09-12T00:04:53.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000279506 2024-09-12T00:04:53.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.455 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:53.455 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.684235+0000", 2024-09-12T00:04:53.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9101000000000002e-05 2024-09-12T00:04:53.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.455 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:53.455 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.684294+0000", 2024-09-12T00:04:53.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8318e-05 2024-09-12T00:04:53.455 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.456 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:53.456 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.456 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2714 3.17 e63/23 3:eac65a57:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_199:head v 63'3, mlcod=62'1)", 2024-09-12T00:04:53.456 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.752259+0000", 2024-09-12T00:04:53.456 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.6075434409999998, 2024-09-12T00:04:53.456 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013747212, 2024-09-12T00:04:53.456 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:53.456 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:53.456 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.457 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:53.457 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.457 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:53.457 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.752259+0000", 2024-09-12T00:04:53.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.457 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.457 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:53.457 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.752259+0000", 2024-09-12T00:04:53.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.457 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.457 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:53.458 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.752261+0000", 2024-09-12T00:04:53.458 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2390000000000001e-06 2024-09-12T00:04:53.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.458 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.458 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:53.458 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757723+0000", 2024-09-12T00:04:53.458 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054619569999999999 2024-09-12T00:04:53.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.458 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.458 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:53.458 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757749+0000", 2024-09-12T00:04:53.458 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5732999999999999e-05 2024-09-12T00:04:53.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.459 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.459 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757762+0000", 2024-09-12T00:04:53.459 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3556e-05 2024-09-12T00:04:53.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.459 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.459 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757841+0000", 2024-09-12T00:04:53.459 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8644000000000001e-05 2024-09-12T00:04:53.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.460 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:53.460 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757864+0000", 2024-09-12T00:04:53.460 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3112000000000002e-05 2024-09-12T00:04:53.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.460 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:53.460 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.765956+0000", 2024-09-12T00:04:53.460 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080919679999999997 2024-09-12T00:04:53.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.460 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:53.460 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766006+0000", 2024-09-12T00:04:53.461 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0003000000000002e-05 2024-09-12T00:04:53.461 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.461 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:53.461 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.461 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2742 3.1d 3:b8ae26ad:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:53.461 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.035857+0000", 2024-09-12T00:04:53.461 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.3239457589999999, 2024-09-12T00:04:53.461 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025139262999999998, 2024-09-12T00:04:53.461 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:53.461 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:53.462 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.462 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:53.462 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:53.462 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:53.462 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2742 2024-09-12T00:04:53.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.462 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:53.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.462 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:53.462 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.035857+0000", 2024-09-12T00:04:53.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.463 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:53.463 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.035857+0000", 2024-09-12T00:04:53.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.463 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:53.463 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.035859+0000", 2024-09-12T00:04:53.464 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0899999999999999e-06 2024-09-12T00:04:53.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.464 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:53.464 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038486+0000", 2024-09-12T00:04:53.464 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026273749999999999 2024-09-12T00:04:53.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.464 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:53.464 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038511+0000", 2024-09-12T00:04:53.464 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5327e-05 2024-09-12T00:04:53.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.465 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.465 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038527+0000", 2024-09-12T00:04:53.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5196e-05 2024-09-12T00:04:53.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.465 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.465 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038604+0000", 2024-09-12T00:04:53.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6921000000000004e-05 2024-09-12T00:04:53.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.465 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:53.465 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038789+0000", 2024-09-12T00:04:53.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018526400000000001 2024-09-12T00:04:53.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.466 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:53.466 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.039001+0000", 2024-09-12T00:04:53.466 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021200400000000001 2024-09-12T00:04:53.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.466 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:53.466 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.056879+0000", 2024-09-12T00:04:53.466 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017877783000000001 2024-09-12T00:04:53.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.466 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:53.466 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.060872+0000", 2024-09-12T00:04:53.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039929529999999996 2024-09-12T00:04:53.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.467 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:53.467 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.060942+0000", 2024-09-12T00:04:53.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0060000000000003e-05 2024-09-12T00:04:53.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.467 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:53.467 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.060996+0000", 2024-09-12T00:04:53.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4289999999999997e-05 2024-09-12T00:04:53.467 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.467 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:53.468 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.468 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2747 3.17 e63/23 3:eaa4528d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_232:head v 63'5, mlcod=63'3)", 2024-09-12T00:04:53.468 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.094555+0000", 2024-09-12T00:04:53.468 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.2652469320000002, 2024-09-12T00:04:53.468 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017679139, 2024-09-12T00:04:53.468 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:53.468 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:53.468 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.468 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:53.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:53.469 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.094555+0000", 2024-09-12T00:04:53.469 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:53.469 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.094555+0000", 2024-09-12T00:04:53.469 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:53.469 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.094558+0000", 2024-09-12T00:04:53.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.232e-06 2024-09-12T00:04:53.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.470 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:53.470 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098897+0000", 2024-09-12T00:04:53.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0043397840000000002 2024-09-12T00:04:53.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.470 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:53.470 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098930+0000", 2024-09-12T00:04:53.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2592000000000002e-05 2024-09-12T00:04:53.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.471 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.471 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098945+0000", 2024-09-12T00:04:53.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4759e-05 2024-09-12T00:04:53.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.471 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.471 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.099033+0000", 2024-09-12T00:04:53.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8535000000000005e-05 2024-09-12T00:04:53.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.471 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:53.471 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.099065+0000", 2024-09-12T00:04:53.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1825000000000001e-05 2024-09-12T00:04:53.472 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.472 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.472 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:53.472 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112134+0000", 2024-09-12T00:04:53.472 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013068329 2024-09-12T00:04:53.472 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.472 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.472 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:53.472 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112235+0000", 2024-09-12T00:04:53.472 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010108299999999999 2024-09-12T00:04:53.472 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.473 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:53.473 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.473 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.473 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2764 3.2d 3:b7a0f55d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_249:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:53.473 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.325396+0000", 2024-09-12T00:04:53.473 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.0344059840000002, 2024-09-12T00:04:53.473 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022487040999999999, 2024-09-12T00:04:53.473 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:53.473 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:53.473 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.473 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:53.474 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:53.474 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:53.474 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2764 2024-09-12T00:04:53.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.474 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:53.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.474 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:53.474 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.325396+0000", 2024-09-12T00:04:53.474 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.474 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:53.474 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.325396+0000", 2024-09-12T00:04:53.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:53.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.475 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:53.475 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.325400+0000", 2024-09-12T00:04:53.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2370000000000001e-06 2024-09-12T00:04:53.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.475 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:53.475 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328424+0000", 2024-09-12T00:04:53.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003024657 2024-09-12T00:04:53.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.475 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.476 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:53.476 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328456+0000", 2024-09-12T00:04:53.476 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1819999999999997e-05 2024-09-12T00:04:53.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.476 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.476 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.476 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328476+0000", 2024-09-12T00:04:53.476 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9673999999999998e-05 2024-09-12T00:04:53.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.476 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.476 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:53.476 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328567+0000", 2024-09-12T00:04:53.476 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1640999999999999e-05 2024-09-12T00:04:53.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.477 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:53.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328734+0000", 2024-09-12T00:04:53.477 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016619200000000001 2024-09-12T00:04:53.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.477 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:53.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328910+0000", 2024-09-12T00:04:53.477 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017652299999999999 2024-09-12T00:04:53.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.477 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:53.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.333757+0000", 2024-09-12T00:04:53.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048465060000000004 2024-09-12T00:04:53.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.478 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:53.478 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.347806+0000", 2024-09-12T00:04:53.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01404908 2024-09-12T00:04:53.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.478 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:53.478 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.347847+0000", 2024-09-12T00:04:53.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1396999999999997e-05 2024-09-12T00:04:53.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:53.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:53.479 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:53.479 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.347883+0000", 2024-09-12T00:04:53.479 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6313999999999998e-05 2024-09-12T00:04:53.479 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.479 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:53.479 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.479 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:53.479 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:53.479 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:53.481 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:04:53.481 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:53.480+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:53.581 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:53.578+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:53.589 INFO:teuthology.orchestra.run.smithi019.stderr:set 4.31 pg_upmap_items mapping to [5->3,6->1] 2024-09-12T00:04:53.618 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:53.618 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:04:53.618 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:04:53.618 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:53.633 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:04:53.718 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:53.718+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:53.783 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:53.782+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:53.796 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:53.796 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:04:53.796 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:04:53.796 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:04:53.796 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:53.812 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:04:53.898 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:53.898+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:53.953 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:04:53.974 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:53.974 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:04:53.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:04:53.974 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:04:53.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.974 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2657 3.3c e63/23 3:3e583291:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_152:head v 63'4, mlcod=62'2)", 2024-09-12T00:04:53.975 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:04:53.975 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.7066464180000001, 2024-09-12T00:04:53.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017073642999999999, 2024-09-12T00:04:53.975 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:53.975 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:53.975 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.975 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:53.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.975 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:53.975 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:04:53.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:53.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.976 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.976 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:53.976 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:04:53.976 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:53.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.976 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.976 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:53.976 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266877+0000", 2024-09-12T00:04:53.976 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3630000000000001e-06 2024-09-12T00:04:53.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.976 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.976 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:53.976 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271243+0000", 2024-09-12T00:04:53.977 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043659730000000004 2024-09-12T00:04:53.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.977 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:53.977 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271279+0000", 2024-09-12T00:04:53.977 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6334999999999997e-05 2024-09-12T00:04:53.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.977 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.977 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271296+0000", 2024-09-12T00:04:53.977 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6619000000000001e-05 2024-09-12T00:04:53.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.977 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:53.978 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271429+0000", 2024-09-12T00:04:53.978 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133132 2024-09-12T00:04:53.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.978 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:53.978 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271468+0000", 2024-09-12T00:04:53.978 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8483999999999999e-05 2024-09-12T00:04:53.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.978 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:53.978 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.283854+0000", 2024-09-12T00:04:53.978 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012386645999999999 2024-09-12T00:04:53.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.979 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:53.979 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.283948+0000", 2024-09-12T00:04:53.979 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4091000000000004e-05 2024-09-12T00:04:53.979 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:53.979 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:53.979 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:53.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.979 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.979 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2658 3.3a e63/23 3:5ec14981:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_153:head v 63'1, mlcod=0'0)", 2024-09-12T00:04:53.979 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.276052+0000", 2024-09-12T00:04:53.979 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.6974695280000001, 2024-09-12T00:04:53.979 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015387336999999999, 2024-09-12T00:04:53.979 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:53.979 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:53.980 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.980 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:53.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.980 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:53.980 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.276052+0000", 2024-09-12T00:04:53.980 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:53.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.980 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:53.980 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.276052+0000", 2024-09-12T00:04:53.980 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:53.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.980 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:53.981 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.276054+0000", 2024-09-12T00:04:53.981 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3199999999999998e-06 2024-09-12T00:04:53.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.981 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:53.981 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282165+0000", 2024-09-12T00:04:53.981 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061108359999999997 2024-09-12T00:04:53.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.981 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:53.981 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282192+0000", 2024-09-12T00:04:53.981 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7008999999999998e-05 2024-09-12T00:04:53.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.981 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.982 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282206+0000", 2024-09-12T00:04:53.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4705999999999999e-05 2024-09-12T00:04:53.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.982 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:53.982 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282387+0000", 2024-09-12T00:04:53.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018015199999999999 2024-09-12T00:04:53.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.982 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:53.982 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282426+0000", 2024-09-12T00:04:53.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9323999999999998e-05 2024-09-12T00:04:53.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.983 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:53.983 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291241+0000", 2024-09-12T00:04:53.983 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0088146950000000009 2024-09-12T00:04:53.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.983 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.983 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:53.983 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291439+0000", 2024-09-12T00:04:53.983 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000198295 2024-09-12T00:04:53.983 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:53.983 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:53.984 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:53.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.984 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.984 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2659 3.2d e63/23 3:b4a71344:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_154:head v 63'5, mlcod=63'3)", 2024-09-12T00:04:53.984 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:04:53.984 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.6858421239999997, 2024-09-12T00:04:53.984 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016913793, 2024-09-12T00:04:53.984 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:53.984 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:53.984 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.984 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:53.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.985 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:53.985 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:04:53.985 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:53.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.985 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:53.985 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:04:53.985 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:53.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.985 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:53.985 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287682+0000", 2024-09-12T00:04:53.985 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9799999999999998e-06 2024-09-12T00:04:53.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.986 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:53.986 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291872+0000", 2024-09-12T00:04:53.986 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041904070000000002 2024-09-12T00:04:53.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.986 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:53.986 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291901+0000", 2024-09-12T00:04:53.986 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9017999999999999e-05 2024-09-12T00:04:53.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.987 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.987 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291917+0000", 2024-09-12T00:04:53.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5775999999999999e-05 2024-09-12T00:04:53.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.987 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:53.987 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.292061+0000", 2024-09-12T00:04:53.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014356800000000001 2024-09-12T00:04:53.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.987 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:53.987 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.292123+0000", 2024-09-12T00:04:53.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2799999999999995e-05 2024-09-12T00:04:53.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.988 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:53.988 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.304456+0000", 2024-09-12T00:04:53.988 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012332865 2024-09-12T00:04:53.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.988 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:53.988 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.304593+0000", 2024-09-12T00:04:53.988 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000136379 2024-09-12T00:04:53.988 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:53.988 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:53.988 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:53.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.988 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2667 3.8 3:1177e826:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:53.989 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:04:53.989 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.6004002059999998, 2024-09-12T00:04:53.989 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024306991999999999, 2024-09-12T00:04:53.989 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:53.989 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:53.989 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.989 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:53.989 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:53.989 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:53.989 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2667 2024-09-12T00:04:53.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.989 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:53.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.989 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:53.990 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:04:53.990 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:53.990 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.990 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.990 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:53.990 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:04:53.990 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:53.990 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.990 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.990 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:53.991 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373124+0000", 2024-09-12T00:04:53.991 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.19e-06 2024-09-12T00:04:53.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.991 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.991 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:53.991 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377167+0000", 2024-09-12T00:04:53.991 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040430329999999997 2024-09-12T00:04:53.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.991 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.991 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:53.991 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377201+0000", 2024-09-12T00:04:53.991 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3868000000000002e-05 2024-09-12T00:04:53.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.992 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.992 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.992 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377219+0000", 2024-09-12T00:04:53.992 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8019000000000001e-05 2024-09-12T00:04:53.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.992 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.992 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:53.992 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377362+0000", 2024-09-12T00:04:53.992 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000143001 2024-09-12T00:04:53.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.992 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.992 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:53.993 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377603+0000", 2024-09-12T00:04:53.993 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024115200000000001 2024-09-12T00:04:53.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.993 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:53.993 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377833+0000", 2024-09-12T00:04:53.993 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022952000000000001 2024-09-12T00:04:53.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.993 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:53.993 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.386771+0000", 2024-09-12T00:04:53.993 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0089385739999999995 2024-09-12T00:04:53.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.994 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:53.994 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397160+0000", 2024-09-12T00:04:53.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010388391 2024-09-12T00:04:53.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.994 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:53.994 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397307+0000", 2024-09-12T00:04:53.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014745099999999999 2024-09-12T00:04:53.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.994 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:53.994 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397428+0000", 2024-09-12T00:04:53.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012079299999999999 2024-09-12T00:04:53.994 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:53.995 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:53.995 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:53.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.995 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.995 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2669 3.1b 3:d9b9bd82:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:53.995 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:04:53.995 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.5807235569999998, 2024-09-12T00:04:53.995 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016867298999999999, 2024-09-12T00:04:53.995 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:53.995 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:53.995 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:53.995 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:53.995 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:53.996 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:53.996 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2669 2024-09-12T00:04:53.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.996 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:53.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.996 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:53.996 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:04:53.996 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:53.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.996 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:53.996 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:04:53.996 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:53.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.997 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:53.997 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392800+0000", 2024-09-12T00:04:53.997 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8629999999999999e-06 2024-09-12T00:04:53.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.997 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.997 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:53.997 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396812+0000", 2024-09-12T00:04:53.997 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040120140000000004 2024-09-12T00:04:53.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.997 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.997 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:53.997 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396849+0000", 2024-09-12T00:04:53.997 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6291000000000002e-05 2024-09-12T00:04:53.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.998 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.998 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:53.998 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396906+0000", 2024-09-12T00:04:53.998 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7692999999999998e-05 2024-09-12T00:04:53.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.998 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.998 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:53.998 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397059+0000", 2024-09-12T00:04:53.998 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015268399999999999 2024-09-12T00:04:53.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.998 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.998 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:53.998 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397472+0000", 2024-09-12T00:04:53.998 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041270899999999998 2024-09-12T00:04:53.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.999 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:53.999 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397697+0000", 2024-09-12T00:04:53.999 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022526299999999999 2024-09-12T00:04:53.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.999 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:53.999 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.406380+0000", 2024-09-12T00:04:53.999 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086830429999999997 2024-09-12T00:04:53.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:53.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:53.999 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:53.999 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409367+0000", 2024-09-12T00:04:53.999 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002987403 2024-09-12T00:04:54.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.000 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.000 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:54.000 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409532+0000", 2024-09-12T00:04:54.000 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016417 2024-09-12T00:04:54.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.000 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.000 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:54.000 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409665+0000", 2024-09-12T00:04:54.000 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013316599999999999 2024-09-12T00:04:54.000 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.000 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:54.000 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.001 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.001 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2678 3.2b 3:d57f7217:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:54.001 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:04:54.001 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.4893061090000002, 2024-09-12T00:04:54.001 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018772965999999999, 2024-09-12T00:04:54.001 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:54.001 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:54.001 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:54.001 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:54.001 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:54.001 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:54.001 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2678 2024-09-12T00:04:54.001 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.001 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:54.001 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.002 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:54.002 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:04:54.002 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.002 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.002 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:54.002 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:04:54.002 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.002 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.002 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:54.002 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484219+0000", 2024-09-12T00:04:54.002 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7299999999999999e-06 2024-09-12T00:04:54.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.003 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:54.003 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488148+0000", 2024-09-12T00:04:54.003 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039289859999999998 2024-09-12T00:04:54.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.003 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:54.003 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488214+0000", 2024-09-12T00:04:54.003 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6202000000000001e-05 2024-09-12T00:04:54.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.003 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:54.003 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488239+0000", 2024-09-12T00:04:54.003 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4839000000000001e-05 2024-09-12T00:04:54.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.004 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:54.004 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488374+0000", 2024-09-12T00:04:54.004 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000135189 2024-09-12T00:04:54.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.004 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:54.004 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488626+0000", 2024-09-12T00:04:54.004 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025242800000000002 2024-09-12T00:04:54.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.004 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:54.004 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488849+0000", 2024-09-12T00:04:54.004 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022295 2024-09-12T00:04:54.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.005 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:54.005 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498947+0000", 2024-09-12T00:04:54.005 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010098072 2024-09-12T00:04:54.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.005 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:54.005 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502674+0000", 2024-09-12T00:04:54.005 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037269149999999999 2024-09-12T00:04:54.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.005 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:54.005 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502856+0000", 2024-09-12T00:04:54.006 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018163599999999999 2024-09-12T00:04:54.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.006 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:54.006 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502988+0000", 2024-09-12T00:04:54.006 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013201900000000001 2024-09-12T00:04:54.006 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.006 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:54.006 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.006 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2691 3.2d e63/23 3:b4a2284d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_176:head v 63'6, mlcod=63'4)", 2024-09-12T00:04:54.006 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:04:54.006 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.456181408, 2024-09-12T00:04:54.007 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015889306999999998, 2024-09-12T00:04:54.007 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:54.007 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:54.007 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:54.007 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:54.007 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.007 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:54.007 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:04:54.007 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.007 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.007 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.007 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:54.007 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:04:54.007 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.008 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.008 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.008 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:54.008 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517342+0000", 2024-09-12T00:04:54.008 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3700000000000002e-06 2024-09-12T00:04:54.008 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.008 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.008 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:54.008 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521776+0000", 2024-09-12T00:04:54.008 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044339790000000002 2024-09-12T00:04:54.008 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.008 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.008 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:54.009 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521806+0000", 2024-09-12T00:04:54.009 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9855000000000001e-05 2024-09-12T00:04:54.009 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.009 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.009 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:54.009 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521820+0000", 2024-09-12T00:04:54.009 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4496e-05 2024-09-12T00:04:54.009 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.009 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.009 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:54.009 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521963+0000", 2024-09-12T00:04:54.009 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014277199999999999 2024-09-12T00:04:54.009 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.009 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.010 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:54.010 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.522029+0000", 2024-09-12T00:04:54.010 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6186000000000006e-05 2024-09-12T00:04:54.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.010 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.010 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:54.010 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.533123+0000", 2024-09-12T00:04:54.010 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011093252 2024-09-12T00:04:54.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.010 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.010 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:54.010 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.533229+0000", 2024-09-12T00:04:54.010 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000106397 2024-09-12T00:04:54.010 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.011 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:54.011 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.011 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.011 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2694 3.3d e63/23 3:bd0bdafc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_179:head v 63'7, mlcod=63'5)", 2024-09-12T00:04:54.011 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:04:54.011 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.4209666360000002, 2024-09-12T00:04:54.011 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016398093999999998, 2024-09-12T00:04:54.011 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:54.011 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:54.011 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:54.011 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:54.011 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.011 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:54.012 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:04:54.012 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.012 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:54.012 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:04:54.012 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.012 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:54.012 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552558+0000", 2024-09-12T00:04:54.012 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6030000000000001e-06 2024-09-12T00:04:54.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.013 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:54.013 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556085+0000", 2024-09-12T00:04:54.013 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0035274339999999999 2024-09-12T00:04:54.013 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.013 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.013 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:54.013 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556126+0000", 2024-09-12T00:04:54.013 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0290999999999998e-05 2024-09-12T00:04:54.013 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.013 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.013 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:54.013 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556154+0000", 2024-09-12T00:04:54.013 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7965000000000001e-05 2024-09-12T00:04:54.013 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.013 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.014 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:54.014 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556298+0000", 2024-09-12T00:04:54.014 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014459799999999999 2024-09-12T00:04:54.014 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.014 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.014 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:54.014 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556339+0000", 2024-09-12T00:04:54.014 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0577000000000001e-05 2024-09-12T00:04:54.014 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.014 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.014 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:54.014 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.568778+0000", 2024-09-12T00:04:54.014 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012438886999999999 2024-09-12T00:04:54.014 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.015 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.015 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:54.015 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.568953+0000", 2024-09-12T00:04:54.015 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017473900000000001 2024-09-12T00:04:54.015 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.015 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:54.015 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.015 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.015 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.015 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2696 3.2b 3:d7c776f8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:54.015 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:04:54.015 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.4061197390000002, 2024-09-12T00:04:54.015 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022026211, 2024-09-12T00:04:54.015 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:54.016 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:54.016 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:54.016 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:54.016 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:54.016 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:54.016 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2696 2024-09-12T00:04:54.016 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.016 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:54.016 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.016 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:54.016 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:04:54.016 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.016 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.016 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.017 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:54.017 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:04:54.017 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.017 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.017 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:54.017 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567406+0000", 2024-09-12T00:04:54.017 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9389999999999996e-06 2024-09-12T00:04:54.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.017 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.017 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:54.017 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571490+0000", 2024-09-12T00:04:54.017 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040837870000000002 2024-09-12T00:04:54.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.018 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.018 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:54.018 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571530+0000", 2024-09-12T00:04:54.018 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9894999999999997e-05 2024-09-12T00:04:54.018 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.018 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.018 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:54.018 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571554+0000", 2024-09-12T00:04:54.018 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4011000000000001e-05 2024-09-12T00:04:54.018 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.018 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.018 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:54.018 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571726+0000", 2024-09-12T00:04:54.018 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0001717 2024-09-12T00:04:54.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.019 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.019 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:54.019 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.572130+0000", 2024-09-12T00:04:54.019 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040465299999999999 2024-09-12T00:04:54.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.019 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.019 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:54.019 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.572470+0000", 2024-09-12T00:04:54.019 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00033946999999999997 2024-09-12T00:04:54.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.019 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.019 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:54.019 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.579159+0000", 2024-09-12T00:04:54.019 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0066893009999999999 2024-09-12T00:04:54.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.020 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.020 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:54.020 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589136+0000", 2024-09-12T00:04:54.020 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099772060000000006 2024-09-12T00:04:54.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.020 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.020 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:54.020 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589309+0000", 2024-09-12T00:04:54.020 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017264299999999999 2024-09-12T00:04:54.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.020 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.020 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:54.020 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589428+0000", 2024-09-12T00:04:54.021 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118606 2024-09-12T00:04:54.021 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.021 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:54.021 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.021 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.021 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.021 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2698 3.3d e63/23 3:bcafb0f9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_183:head v 63'8, mlcod=63'6)", 2024-09-12T00:04:54.021 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:04:54.021 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.3784166899999999, 2024-09-12T00:04:54.021 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016019080000000002, 2024-09-12T00:04:54.021 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:54.021 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:54.021 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:54.022 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:54.022 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.022 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:54.022 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:04:54.022 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.022 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.022 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:54.022 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:04:54.022 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.022 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.022 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:54.023 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595107+0000", 2024-09-12T00:04:54.023 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.497e-06 2024-09-12T00:04:54.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.023 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:54.023 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598465+0000", 2024-09-12T00:04:54.023 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033583129999999999 2024-09-12T00:04:54.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.023 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:54.023 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598502+0000", 2024-09-12T00:04:54.023 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6814999999999999e-05 2024-09-12T00:04:54.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.024 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:54.024 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598520+0000", 2024-09-12T00:04:54.024 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8264999999999999e-05 2024-09-12T00:04:54.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.024 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.024 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:54.024 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598666+0000", 2024-09-12T00:04:54.024 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014574499999999999 2024-09-12T00:04:54.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.024 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.024 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:54.024 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598706+0000", 2024-09-12T00:04:54.024 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9993999999999997e-05 2024-09-12T00:04:54.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.025 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:54.025 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.611012+0000", 2024-09-12T00:04:54.025 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012306381 2024-09-12T00:04:54.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.025 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:54.025 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.611123+0000", 2024-09-12T00:04:54.025 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011107000000000001 2024-09-12T00:04:54.025 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.025 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:54.025 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.026 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2702 3.3c e63/23 3:3d6a0b3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_187:head v 63'5, mlcod=63'3)", 2024-09-12T00:04:54.026 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:04:54.026 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.3449418529999999, 2024-09-12T00:04:54.026 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015754475, 2024-09-12T00:04:54.026 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:54.026 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:54.026 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:54.026 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:54.026 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.026 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:54.026 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:04:54.026 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.026 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.026 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:54.027 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:04:54.027 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.027 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.027 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:54.027 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628581+0000", 2024-09-12T00:04:54.027 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2129999999999998e-06 2024-09-12T00:04:54.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.027 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.027 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:54.027 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633160+0000", 2024-09-12T00:04:54.027 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045784470000000002 2024-09-12T00:04:54.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.027 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.027 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:54.028 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633193+0000", 2024-09-12T00:04:54.028 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3015000000000002e-05 2024-09-12T00:04:54.028 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.028 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.028 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:54.028 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633213+0000", 2024-09-12T00:04:54.028 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0271999999999998e-05 2024-09-12T00:04:54.028 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.028 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.028 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:54.028 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633397+0000", 2024-09-12T00:04:54.028 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018359299999999999 2024-09-12T00:04:54.028 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.028 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.029 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:54.029 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633440+0000", 2024-09-12T00:04:54.029 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2984e-05 2024-09-12T00:04:54.029 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.029 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.029 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:54.029 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.644242+0000", 2024-09-12T00:04:54.029 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010802673 2024-09-12T00:04:54.029 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.029 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.029 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:54.029 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.644334+0000", 2024-09-12T00:04:54.029 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1278000000000003e-05 2024-09-12T00:04:54.029 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.030 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:54.030 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.030 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2707 3.8 3:10a400a4:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:54.030 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:04:54.030 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.2966642850000003, 2024-09-12T00:04:54.030 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019444162000000001, 2024-09-12T00:04:54.030 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:54.030 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:54.030 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:54.030 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:54.030 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:54.030 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:54.031 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2707 2024-09-12T00:04:54.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.031 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:54.031 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.031 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:54.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:04:54.031 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.031 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.031 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:54.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:04:54.031 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.031 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.032 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:54.032 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676879+0000", 2024-09-12T00:04:54.032 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1886e-05 2024-09-12T00:04:54.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.032 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:54.032 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680743+0000", 2024-09-12T00:04:54.032 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038648060000000001 2024-09-12T00:04:54.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.032 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:54.032 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680783+0000", 2024-09-12T00:04:54.032 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9511000000000002e-05 2024-09-12T00:04:54.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.033 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.033 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:54.033 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680801+0000", 2024-09-12T00:04:54.033 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8056000000000001e-05 2024-09-12T00:04:54.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.033 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.033 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:54.033 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680948+0000", 2024-09-12T00:04:54.033 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014682399999999999 2024-09-12T00:04:54.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.033 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.033 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:54.033 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.681206+0000", 2024-09-12T00:04:54.033 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025860500000000002 2024-09-12T00:04:54.034 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.034 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.034 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:54.034 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.681439+0000", 2024-09-12T00:04:54.034 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023246599999999999 2024-09-12T00:04:54.034 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.034 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.034 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:54.034 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.689277+0000", 2024-09-12T00:04:54.034 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0078379000000000001 2024-09-12T00:04:54.034 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.034 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.034 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:54.034 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696136+0000", 2024-09-12T00:04:54.035 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0068593439999999999 2024-09-12T00:04:54.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.035 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.035 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:54.035 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696228+0000", 2024-09-12T00:04:54.035 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2038000000000002e-05 2024-09-12T00:04:54.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.035 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.035 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:54.035 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696301+0000", 2024-09-12T00:04:54.035 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2725999999999995e-05 2024-09-12T00:04:54.035 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.035 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:54.036 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.036 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.036 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2720 3.6 3:61c9c6cd:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:54.036 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:04:54.036 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.1699449690000003, 2024-09-12T00:04:54.036 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021831761000000002, 2024-09-12T00:04:54.036 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:54.036 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:54.036 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:54.036 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:54.036 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:54.037 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:54.037 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2720 2024-09-12T00:04:54.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.037 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:54.037 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.037 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:54.037 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:04:54.037 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.037 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.037 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:54.037 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:04:54.037 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.038 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.038 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:54.038 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803580+0000", 2024-09-12T00:04:54.038 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9870000000000001e-06 2024-09-12T00:04:54.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.038 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.038 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:54.038 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808102+0000", 2024-09-12T00:04:54.038 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004521677 2024-09-12T00:04:54.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.038 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.038 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:54.038 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808152+0000", 2024-09-12T00:04:54.039 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9923999999999998e-05 2024-09-12T00:04:54.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.039 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:54.039 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808178+0000", 2024-09-12T00:04:54.039 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5911999999999999e-05 2024-09-12T00:04:54.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.039 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:54.039 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808365+0000", 2024-09-12T00:04:54.039 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000187839 2024-09-12T00:04:54.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.039 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:54.040 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808757+0000", 2024-09-12T00:04:54.040 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039202900000000001 2024-09-12T00:04:54.040 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.040 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.040 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:54.040 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.809162+0000", 2024-09-12T00:04:54.040 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040460300000000002 2024-09-12T00:04:54.040 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.040 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.040 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:54.040 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.816553+0000", 2024-09-12T00:04:54.040 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.007390537 2024-09-12T00:04:54.040 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.040 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.041 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:54.041 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.824836+0000", 2024-09-12T00:04:54.041 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082834369999999994 2024-09-12T00:04:54.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.041 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.041 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:54.041 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.825223+0000", 2024-09-12T00:04:54.041 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00038724700000000001 2024-09-12T00:04:54.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.041 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.041 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:54.041 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.825408+0000", 2024-09-12T00:04:54.041 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018456899999999999 2024-09-12T00:04:54.041 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.041 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:54.042 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.042 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.042 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2722 3.1b 3:d95d04cc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_207:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:54.042 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.822403+0000", 2024-09-12T00:04:54.042 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.1511182760000001, 2024-09-12T00:04:54.042 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015693082000000001, 2024-09-12T00:04:54.042 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:54.042 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:54.042 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:54.042 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:54.042 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:54.042 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:54.042 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2722 2024-09-12T00:04:54.043 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.043 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:54.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.043 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:54.043 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.822403+0000", 2024-09-12T00:04:54.043 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.043 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.043 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:54.043 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.822403+0000", 2024-09-12T00:04:54.043 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.043 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.044 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:54.044 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.822405+0000", 2024-09-12T00:04:54.044 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4169999999999999e-06 2024-09-12T00:04:54.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.044 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.044 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:54.044 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826387+0000", 2024-09-12T00:04:54.044 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039818379999999997 2024-09-12T00:04:54.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.044 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.044 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:54.044 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826412+0000", 2024-09-12T00:04:54.044 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5159000000000001e-05 2024-09-12T00:04:54.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.045 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.045 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:54.045 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826425+0000", 2024-09-12T00:04:54.045 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3283e-05 2024-09-12T00:04:54.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.045 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.045 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:54.045 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826536+0000", 2024-09-12T00:04:54.045 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110109 2024-09-12T00:04:54.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.045 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.045 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:54.045 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826725+0000", 2024-09-12T00:04:54.045 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018966600000000001 2024-09-12T00:04:54.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.046 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:54.046 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826904+0000", 2024-09-12T00:04:54.046 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017913200000000001 2024-09-12T00:04:54.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.046 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:54.046 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.835018+0000", 2024-09-12T00:04:54.046 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0081138300000000007 2024-09-12T00:04:54.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.046 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:54.046 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837918+0000", 2024-09-12T00:04:54.047 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002899535 2024-09-12T00:04:54.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.047 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:54.047 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838010+0000", 2024-09-12T00:04:54.047 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1901e-05 2024-09-12T00:04:54.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.047 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:54.047 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838096+0000", 2024-09-12T00:04:54.047 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6211999999999994e-05 2024-09-12T00:04:54.047 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.047 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:54.047 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.048 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.048 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.048 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2724 3.1b 3:da32d84b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:54.048 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:04:54.048 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.1297345329999997, 2024-09-12T00:04:54.048 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019410604000000001, 2024-09-12T00:04:54.048 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:54.048 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:54.048 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:54.048 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:54.048 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:54.048 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:54.048 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2724 2024-09-12T00:04:54.048 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.049 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:54.049 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.049 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:54.049 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:04:54.049 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.049 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.049 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:54.049 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:04:54.049 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.049 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.049 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:54.049 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843790+0000", 2024-09-12T00:04:54.049 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.393e-06 2024-09-12T00:04:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847786+0000", 2024-09-12T00:04:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039965579999999999 2024-09-12T00:04:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847836+0000", 2024-09-12T00:04:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9731000000000002e-05 2024-09-12T00:04:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847856+0000", 2024-09-12T00:04:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0245e-05 2024-09-12T00:04:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848053+0000", 2024-09-12T00:04:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000196882 2024-09-12T00:04:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848291+0000", 2024-09-12T00:04:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000237762 2024-09-12T00:04:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848544+0000", 2024-09-12T00:04:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025307500000000001 2024-09-12T00:04:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.860024+0000", 2024-09-12T00:04:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011479390000000001 2024-09-12T00:04:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.862880+0000", 2024-09-12T00:04:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002856833 2024-09-12T00:04:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.863048+0000", 2024-09-12T00:04:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016796700000000001 2024-09-12T00:04:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.863197+0000", 2024-09-12T00:04:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148768 2024-09-12T00:04:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2727 3.39 e63/23 3:9c63b475:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_212:head v 63'3, mlcod=62'1)", 2024-09-12T00:04:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:04:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.095705937, 2024-09-12T00:04:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016224526999999999, 2024-09-12T00:04:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:04:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:04:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877818+0000", 2024-09-12T00:04:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.813e-06 2024-09-12T00:04:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883917+0000", 2024-09-12T00:04:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0060993009999999997 2024-09-12T00:04:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883961+0000", 2024-09-12T00:04:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3951e-05 2024-09-12T00:04:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883992+0000", 2024-09-12T00:04:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0565000000000003e-05 2024-09-12T00:04:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884176+0000", 2024-09-12T00:04:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018378200000000001 2024-09-12T00:04:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884252+0000", 2024-09-12T00:04:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6209000000000002e-05 2024-09-12T00:04:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.893904+0000", 2024-09-12T00:04:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0096519339999999992 2024-09-12T00:04:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.894040+0000", 2024-09-12T00:04:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013597199999999999 2024-09-12T00:04:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2730 3.7 3:e3fca83c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:04:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.0651778109999999, 2024-09-12T00:04:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022178479000000001, 2024-09-12T00:04:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2730 2024-09-12T00:04:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:04:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:04:54.060 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:54.060 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908346+0000", 2024-09-12T00:04:54.060 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1999999999999999e-06 2024-09-12T00:04:54.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:54.060 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912423+0000", 2024-09-12T00:04:54.060 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004076423 2024-09-12T00:04:54.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:54.061 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912472+0000", 2024-09-12T00:04:54.061 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9023999999999997e-05 2024-09-12T00:04:54.061 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.061 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.061 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:54.061 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912498+0000", 2024-09-12T00:04:54.061 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6591999999999999e-05 2024-09-12T00:04:54.061 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.061 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.061 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:54.061 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912677+0000", 2024-09-12T00:04:54.061 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017824599999999999 2024-09-12T00:04:54.061 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.061 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.062 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:54.062 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913094+0000", 2024-09-12T00:04:54.062 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041757799999999999 2024-09-12T00:04:54.062 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.062 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.062 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:54.062 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913512+0000", 2024-09-12T00:04:54.062 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000417475 2024-09-12T00:04:54.062 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.062 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.062 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:54.062 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.929229+0000", 2024-09-12T00:04:54.062 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015717294999999999 2024-09-12T00:04:54.062 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.062 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.063 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:54.063 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930204+0000", 2024-09-12T00:04:54.063 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00097506199999999996 2024-09-12T00:04:54.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.063 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.063 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:54.063 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930392+0000", 2024-09-12T00:04:54.063 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000187775 2024-09-12T00:04:54.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.063 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.063 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:54.063 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930522+0000", 2024-09-12T00:04:54.063 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012980899999999999 2024-09-12T00:04:54.063 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.064 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:54.064 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.064 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.064 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.064 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2753 3.7 3:e119c99e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_238:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:54.064 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:04:54.064 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 5.8194897409999999, 2024-09-12T00:04:54.064 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.023674186999999999, 2024-09-12T00:04:54.064 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:54.064 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:54.064 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:54.064 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:54.064 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:54.064 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:54.065 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2753 2024-09-12T00:04:54.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.065 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:54.065 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.065 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:54.065 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:04:54.065 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.065 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.065 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:54.065 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:04:54.065 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.065 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.066 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:54.066 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154035+0000", 2024-09-12T00:04:54.066 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2799999999999999e-06 2024-09-12T00:04:54.066 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.066 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.066 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:54.066 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159459+0000", 2024-09-12T00:04:54.066 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054242190000000001 2024-09-12T00:04:54.066 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.066 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.066 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:54.066 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159509+0000", 2024-09-12T00:04:54.066 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9830999999999998e-05 2024-09-12T00:04:54.066 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.067 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.067 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:54.067 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159536+0000", 2024-09-12T00:04:54.067 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7438000000000001e-05 2024-09-12T00:04:54.067 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.067 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.067 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:54.067 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159710+0000", 2024-09-12T00:04:54.067 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017342 2024-09-12T00:04:54.067 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.067 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.067 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:54.067 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159961+0000", 2024-09-12T00:04:54.067 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025164499999999999 2024-09-12T00:04:54.067 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.068 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.068 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:54.068 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.160206+0000", 2024-09-12T00:04:54.068 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024534200000000001 2024-09-12T00:04:54.068 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.068 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.068 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:54.068 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177421+0000", 2024-09-12T00:04:54.068 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017214956 2024-09-12T00:04:54.068 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.068 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.068 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:54.068 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177534+0000", 2024-09-12T00:04:54.068 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000112223 2024-09-12T00:04:54.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.069 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.069 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:54.069 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177625+0000", 2024-09-12T00:04:54.069 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0947999999999997e-05 2024-09-12T00:04:54.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.069 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.069 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:54.069 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177706+0000", 2024-09-12T00:04:54.069 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0884999999999996e-05 2024-09-12T00:04:54.069 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.069 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:54.069 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.070 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.070 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2757 3.2b 3:d6dac417:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:54.070 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:04:54.070 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 5.7534209189999999, 2024-09-12T00:04:54.070 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017779708000000002, 2024-09-12T00:04:54.070 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:54.070 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:54.070 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:54.070 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:54.070 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:54.070 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:54.070 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2757 2024-09-12T00:04:54.070 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.070 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:54.070 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.071 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:54.071 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:04:54.071 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.071 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.071 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:54.071 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:04:54.071 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.071 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.071 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:54.071 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220103+0000", 2024-09-12T00:04:54.071 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.32e-06 2024-09-12T00:04:54.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.072 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.072 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:54.072 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225042+0000", 2024-09-12T00:04:54.072 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049386200000000003 2024-09-12T00:04:54.072 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.072 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.072 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:54.072 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225083+0000", 2024-09-12T00:04:54.072 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1304000000000003e-05 2024-09-12T00:04:54.072 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.072 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.072 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:54.072 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225102+0000", 2024-09-12T00:04:54.072 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8502e-05 2024-09-12T00:04:54.072 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.073 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.073 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:54.073 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225256+0000", 2024-09-12T00:04:54.073 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015436099999999999 2024-09-12T00:04:54.073 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.073 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.073 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:54.073 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225513+0000", 2024-09-12T00:04:54.073 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000256562 2024-09-12T00:04:54.073 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.073 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.073 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:54.073 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225737+0000", 2024-09-12T00:04:54.073 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022379 2024-09-12T00:04:54.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.074 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.074 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:54.074 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.234281+0000", 2024-09-12T00:04:54.074 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0085440540000000006 2024-09-12T00:04:54.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.074 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.074 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:54.074 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237710+0000", 2024-09-12T00:04:54.074 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0034298380000000002 2024-09-12T00:04:54.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.074 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.074 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:54.074 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237805+0000", 2024-09-12T00:04:54.074 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4804999999999998e-05 2024-09-12T00:04:54.075 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.075 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.075 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:54.075 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237880+0000", 2024-09-12T00:04:54.075 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4552e-05 2024-09-12T00:04:54.075 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.075 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:54.075 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.075 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.075 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.075 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2764 3.2d e63/23 3:b7a0f55d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_249:head v 63'7, mlcod=63'5)", 2024-09-12T00:04:54.075 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:04:54.075 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 5.6446434490000001, 2024-09-12T00:04:54.075 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018235872, 2024-09-12T00:04:54.075 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:54.076 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:54.076 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:54.076 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:54.076 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.076 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:54.076 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:04:54.076 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.076 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.076 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:54.076 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:04:54.076 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:54.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.076 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.077 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:54.077 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328882+0000", 2024-09-12T00:04:54.077 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5000000000000001e-06 2024-09-12T00:04:54.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.077 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.077 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:54.077 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335092+0000", 2024-09-12T00:04:54.077 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0062094730000000001 2024-09-12T00:04:54.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.077 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.077 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:54.077 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335127+0000", 2024-09-12T00:04:54.077 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5717999999999999e-05 2024-09-12T00:04:54.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.078 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.078 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:54.078 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335144+0000", 2024-09-12T00:04:54.078 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7119e-05 2024-09-12T00:04:54.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.078 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.078 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:54.078 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335308+0000", 2024-09-12T00:04:54.078 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000163757 2024-09-12T00:04:54.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.078 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.078 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:54.078 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335354+0000", 2024-09-12T00:04:54.079 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6164e-05 2024-09-12T00:04:54.079 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.079 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.079 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:54.079 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.346991+0000", 2024-09-12T00:04:54.079 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011636851 2024-09-12T00:04:54.079 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:54.079 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:54.079 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:54.079 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.347113+0000", 2024-09-12T00:04:54.079 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012229 2024-09-12T00:04:54.079 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.079 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:54.079 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.080 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:54.080 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:54.080 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:54.081 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:04:54.081 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:54.078+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:54.114 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:54.114 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:54.131 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:54.148 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:54.149 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:54.166 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:54.182 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:54.182+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:54.185 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:54.186 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:54.204 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:54.205 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:54.224 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:54.224 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:54.245 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:54.246 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:54.249 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:54.250 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:54.265 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:04:54.283 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:54.284+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:54.383 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:54.382+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:54.427 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:54.428 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:54.441 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:04:54.484 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:54.484+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:54.585 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:54.584+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:54.597 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T00:04:54.612 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:54.613 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:54.627 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:04:54.686 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:54.686+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:54.748 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:54.748 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:54.763 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:04:54.806 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:54.806+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:54.887 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:54.886+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:54.930 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:54.930 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:54.944 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:04:54.988 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:54.986+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:55.089 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:55.086+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:55.109 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:55.109 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:55.123 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:04:55.210 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:55.210+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:55.285 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:55.285 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:55.291 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:55.290+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:55.299 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:04:55.393 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:55.392+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:55.460 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:55.460 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:55.474 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:04:55.518 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:55.518+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:55.592 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T00:04:55.593 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:55.594 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:55.594 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:55.594+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:55.613 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:04:55.695 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:55.696+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:55.742 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:55.742 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:55.756 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:04:55.797 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:55.800+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:55.896 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:55.893+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:55.924 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:55.924 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:55.938 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:04:55.997 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:55.993+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:56.072 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:56.072 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:56.087 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:04:56.097 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:56.093+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:56.198 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:56.200+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:56.212 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:56.212 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:56.226 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:04:56.266 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:04:56.300 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:56.297+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:56.400 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:56.400+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:56.404 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:56.404 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:56.416 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:56.417 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:56.419 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:04:56.434 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:56.435 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:56.451 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:56.468 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:56.469 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:56.489 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:56.490 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:56.501 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:56.504+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:56.510 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:56.510 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:56.531 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:56.531 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:56.553 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:56.553 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:56.556 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:56.556 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:56.556 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:56.556 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:56.556 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.556 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:56.556 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:56.556 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 105.061902743, 2024-09-12T00:04:56.557 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.278479906, 2024-09-12T00:04:56.557 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:56.557 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:56.557 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:56.557 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:56.557 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:56.557 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:56.557 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:04:56.557 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.557 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:56.557 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.557 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:56.557 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:56.557 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.558 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.558 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.558 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:56.558 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:04:56.558 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.558 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.558 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.558 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:56.558 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493422+0000", 2024-09-12T00:04:56.558 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.807e-06 2024-09-12T00:04:56.558 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.558 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.558 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:56.558 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493435+0000", 2024-09-12T00:04:56.559 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.375e-05 2024-09-12T00:04:56.559 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.559 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.559 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:56.559 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493457+0000", 2024-09-12T00:04:56.559 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2166000000000001e-05 2024-09-12T00:04:56.559 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.559 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.559 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:56.559 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493475+0000", 2024-09-12T00:04:56.559 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7184e-05 2024-09-12T00:04:56.559 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.559 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.559 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:56.560 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493617+0000", 2024-09-12T00:04:56.560 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014274200000000001 2024-09-12T00:04:56.560 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.560 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.560 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:56.560 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493632+0000", 2024-09-12T00:04:56.560 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4293e-05 2024-09-12T00:04:56.560 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.560 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.561 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:56.561 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.768657+0000", 2024-09-12T00:04:56.561 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.27502575400000001 2024-09-12T00:04:56.561 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.561 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.561 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:56.561 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769042+0000", 2024-09-12T00:04:56.561 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00038463700000000001 2024-09-12T00:04:56.561 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.561 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.561 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:56.561 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769430+0000", 2024-09-12T00:04:56.561 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000388014 2024-09-12T00:04:56.561 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.562 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.562 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:56.562 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.770784+0000", 2024-09-12T00:04:56.562 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00135402 2024-09-12T00:04:56.562 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.562 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.562 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:56.562 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771735+0000", 2024-09-12T00:04:56.562 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00095068599999999996 2024-09-12T00:04:56.562 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.562 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.562 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:56.562 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771828+0000", 2024-09-12T00:04:56.563 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3468999999999996e-05 2024-09-12T00:04:56.563 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.563 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.563 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:56.563 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771899+0000", 2024-09-12T00:04:56.563 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0383999999999996e-05 2024-09-12T00:04:56.563 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.563 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:56.563 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.563 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.563 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.563 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:56.563 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:56.563 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 104.633407672, 2024-09-12T00:04:56.564 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017189138999999999, 2024-09-12T00:04:56.564 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:56.564 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:56.564 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:56.564 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:56.564 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:56.564 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:56.564 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 48 2024-09-12T00:04:56.564 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.564 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:56.564 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.564 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:56.564 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:56.565 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.565 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.565 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.565 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:56.565 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:56.565 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.565 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.565 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.565 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:56.565 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921914+0000", 2024-09-12T00:04:56.565 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7399999999999998e-07 2024-09-12T00:04:56.565 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.565 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.565 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:56.565 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921918+0000", 2024-09-12T00:04:56.566 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6399999999999999e-06 2024-09-12T00:04:56.566 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.566 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.566 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:56.566 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921925+0000", 2024-09-12T00:04:56.566 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7190000000000004e-06 2024-09-12T00:04:56.566 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.566 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.566 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:56.566 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921931+0000", 2024-09-12T00:04:56.566 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2519999999999996e-06 2024-09-12T00:04:56.566 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.566 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.566 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:56.567 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933475+0000", 2024-09-12T00:04:56.567 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011543759000000001 2024-09-12T00:04:56.567 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.567 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.567 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:56.567 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933617+0000", 2024-09-12T00:04:56.567 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000142282 2024-09-12T00:04:56.567 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.567 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.567 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:56.567 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.933860+0000", 2024-09-12T00:04:56.567 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024276199999999999 2024-09-12T00:04:56.567 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.567 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.568 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:56.568 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.937933+0000", 2024-09-12T00:04:56.568 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040734680000000002 2024-09-12T00:04:56.568 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.568 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.568 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:56.568 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938955+0000", 2024-09-12T00:04:56.568 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001021987 2024-09-12T00:04:56.568 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.568 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.568 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:56.568 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939038+0000", 2024-09-12T00:04:56.568 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2449999999999998e-05 2024-09-12T00:04:56.568 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.569 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.569 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:56.569 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939103+0000", 2024-09-12T00:04:56.569 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5345999999999994e-05 2024-09-12T00:04:56.569 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.569 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:56.569 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.569 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.569 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.569 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:56.569 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:56.569 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 104.63338213, 2024-09-12T00:04:56.569 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018247975, 2024-09-12T00:04:56.569 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:56.569 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:56.570 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:56.570 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:56.570 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:56.570 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:56.570 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 49 2024-09-12T00:04:56.570 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.570 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:56.570 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.570 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:56.571 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:56.571 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.571 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.571 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.571 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:56.571 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921939+0000", 2024-09-12T00:04:56.571 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.571 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.571 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.571 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:56.571 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921940+0000", 2024-09-12T00:04:56.571 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7e-07 2024-09-12T00:04:56.571 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.571 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.572 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:56.572 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921943+0000", 2024-09-12T00:04:56.572 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1889999999999999e-06 2024-09-12T00:04:56.572 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.572 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.572 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:56.572 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921952+0000", 2024-09-12T00:04:56.572 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0010000000000007e-06 2024-09-12T00:04:56.572 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.572 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.572 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:56.572 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921959+0000", 2024-09-12T00:04:56.572 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2570000000000001e-06 2024-09-12T00:04:56.573 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.573 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.573 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:56.573 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935333+0000", 2024-09-12T00:04:56.573 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013373368 2024-09-12T00:04:56.573 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.573 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.573 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:56.573 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935472+0000", 2024-09-12T00:04:56.573 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013987900000000001 2024-09-12T00:04:56.573 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.573 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.573 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:56.573 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.935700+0000", 2024-09-12T00:04:56.574 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000227922 2024-09-12T00:04:56.574 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.574 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.574 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:56.574 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939858+0000", 2024-09-12T00:04:56.574 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041571300000000002 2024-09-12T00:04:56.574 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.574 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.574 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:56.574 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940018+0000", 2024-09-12T00:04:56.574 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016060400000000001 2024-09-12T00:04:56.574 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.574 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.574 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:56.575 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940114+0000", 2024-09-12T00:04:56.575 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5692999999999993e-05 2024-09-12T00:04:56.575 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.575 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.575 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:56.575 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940187+0000", 2024-09-12T00:04:56.575 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3561999999999998e-05 2024-09-12T00:04:56.575 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.575 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:56.575 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.575 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.575 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.575 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:56.576 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:56.576 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 104.633339343, 2024-09-12T00:04:56.576 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021018614000000001, 2024-09-12T00:04:56.576 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:56.576 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:56.576 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:56.576 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:56.576 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:56.576 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:56.576 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 50 2024-09-12T00:04:56.576 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.576 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:56.576 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.576 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:56.577 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:56.577 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.577 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.577 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.577 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:56.577 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:04:56.577 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.577 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.577 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.577 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:56.577 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921983+0000", 2024-09-12T00:04:56.577 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4499999999999996e-07 2024-09-12T00:04:56.577 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.577 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.578 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:56.578 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922071+0000", 2024-09-12T00:04:56.578 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8010000000000006e-05 2024-09-12T00:04:56.578 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.578 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.578 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:56.578 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922084+0000", 2024-09-12T00:04:56.578 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3275000000000001e-05 2024-09-12T00:04:56.578 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.578 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.578 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:56.578 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922093+0000", 2024-09-12T00:04:56.578 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0580000000000004e-06 2024-09-12T00:04:56.578 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.578 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.579 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:56.579 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936515+0000", 2024-09-12T00:04:56.579 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014421270999999999 2024-09-12T00:04:56.579 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.579 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.579 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:56.579 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936677+0000", 2024-09-12T00:04:56.579 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162003 2024-09-12T00:04:56.579 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.579 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.579 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:56.579 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936908+0000", 2024-09-12T00:04:56.579 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023115700000000001 2024-09-12T00:04:56.579 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.580 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.580 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:56.580 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939985+0000", 2024-09-12T00:04:56.580 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030773879999999999 2024-09-12T00:04:56.580 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.580 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.580 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:56.580 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942623+0000", 2024-09-12T00:04:56.580 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026377929999999998 2024-09-12T00:04:56.580 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.580 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.580 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:56.580 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942818+0000", 2024-09-12T00:04:56.580 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019556200000000001 2024-09-12T00:04:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943001+0000", 2024-09-12T00:04:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018235199999999999 2024-09-12T00:04:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 104.633204951, 2024-09-12T00:04:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021092493, 2024-09-12T00:04:56.582 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:56.584 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:56.584 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:56.585 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:56.585 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:56.585 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:56.585 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 51 2024-09-12T00:04:56.585 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.585 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:56.585 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.585 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:56.585 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:56.585 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.585 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.585 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.585 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:56.586 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:04:56.586 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.586 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.586 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.586 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:56.586 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922118+0000", 2024-09-12T00:04:56.586 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0389999999999999e-06 2024-09-12T00:04:56.586 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.586 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.586 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:56.586 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922124+0000", 2024-09-12T00:04:56.586 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5409999999999997e-06 2024-09-12T00:04:56.586 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.586 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.587 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:56.587 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922136+0000", 2024-09-12T00:04:56.587 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.205e-05 2024-09-12T00:04:56.587 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.587 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.587 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:56.587 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922147+0000", 2024-09-12T00:04:56.587 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0451e-05 2024-09-12T00:04:56.587 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.587 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.587 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:56.587 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938000+0000", 2024-09-12T00:04:56.587 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015853682000000001 2024-09-12T00:04:56.588 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.588 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.588 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:56.588 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938142+0000", 2024-09-12T00:04:56.588 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014148899999999999 2024-09-12T00:04:56.588 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.588 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.588 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:56.588 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938362+0000", 2024-09-12T00:04:56.588 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022034800000000001 2024-09-12T00:04:56.589 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.589 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.589 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:56.589 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940330+0000", 2024-09-12T00:04:56.589 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001967459 2024-09-12T00:04:56.589 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.589 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.589 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:56.589 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943064+0000", 2024-09-12T00:04:56.589 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027346219999999999 2024-09-12T00:04:56.589 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.589 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.589 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:56.590 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943152+0000", 2024-09-12T00:04:56.590 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7563000000000002e-05 2024-09-12T00:04:56.590 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.590 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.590 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:56.590 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943209+0000", 2024-09-12T00:04:56.590 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7249e-05 2024-09-12T00:04:56.590 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.590 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:56.590 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.590 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.590 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.590 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:56.590 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:56.591 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 104.633155458, 2024-09-12T00:04:56.591 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021175616000000001, 2024-09-12T00:04:56.591 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:56.591 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:56.591 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:56.591 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:56.591 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:56.591 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:56.591 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 52 2024-09-12T00:04:56.591 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.591 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:56.592 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.592 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:56.592 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:56.592 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.592 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.592 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.592 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:56.592 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:04:56.592 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.592 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.592 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.592 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:56.593 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922167+0000", 2024-09-12T00:04:56.593 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3300000000000001e-07 2024-09-12T00:04:56.593 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.593 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.593 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:56.593 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922174+0000", 2024-09-12T00:04:56.593 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7070000000000003e-06 2024-09-12T00:04:56.593 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.593 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.593 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:56.593 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922184+0000", 2024-09-12T00:04:56.593 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682e-05 2024-09-12T00:04:56.593 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.594 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.594 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:56.594 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922195+0000", 2024-09-12T00:04:56.594 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0489000000000001e-05 2024-09-12T00:04:56.594 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.594 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.594 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:56.594 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939166+0000", 2024-09-12T00:04:56.594 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016971245999999999 2024-09-12T00:04:56.594 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.594 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.594 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:56.594 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939243+0000", 2024-09-12T00:04:56.594 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7201999999999997e-05 2024-09-12T00:04:56.595 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.595 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.595 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:56.595 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939381+0000", 2024-09-12T00:04:56.595 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013770699999999999 2024-09-12T00:04:56.595 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.595 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.595 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:56.595 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940923+0000", 2024-09-12T00:04:56.595 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001542302 2024-09-12T00:04:56.595 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.595 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.595 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:56.595 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943221+0000", 2024-09-12T00:04:56.595 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022979720000000001 2024-09-12T00:04:56.596 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.596 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.596 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:56.596 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943295+0000", 2024-09-12T00:04:56.596 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3317000000000003e-05 2024-09-12T00:04:56.596 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.596 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.596 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:56.596 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943342+0000", 2024-09-12T00:04:56.596 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7159e-05 2024-09-12T00:04:56.596 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.596 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:56.596 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.597 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.597 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:56.597 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:56.597 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 104.384097646, 2024-09-12T00:04:56.597 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020001835999999999, 2024-09-12T00:04:56.597 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:56.597 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:56.597 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:56.597 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:56.597 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:56.597 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:56.597 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 69 2024-09-12T00:04:56.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.598 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:56.598 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.598 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:56.598 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:56.598 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.598 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.598 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:56.599 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171224+0000", 2024-09-12T00:04:56.599 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.599 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.599 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.599 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:56.599 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171225+0000", 2024-09-12T00:04:56.599 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0599999999999999e-07 2024-09-12T00:04:56.599 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.600 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:56.600 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171349+0000", 2024-09-12T00:04:56.600 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012407299999999999 2024-09-12T00:04:56.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.600 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:56.600 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171367+0000", 2024-09-12T00:04:56.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8413000000000001e-05 2024-09-12T00:04:56.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.601 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:56.601 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171376+0000", 2024-09-12T00:04:56.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8170000000000005e-06 2024-09-12T00:04:56.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.602 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.602 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:56.602 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177692+0000", 2024-09-12T00:04:56.602 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063156729999999999 2024-09-12T00:04:56.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.602 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.602 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:56.602 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.177817+0000", 2024-09-12T00:04:56.603 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012581499999999999 2024-09-12T00:04:56.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.603 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.603 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:56.603 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.178015+0000", 2024-09-12T00:04:56.603 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019715100000000001 2024-09-12T00:04:56.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.603 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.603 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:56.604 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181798+0000", 2024-09-12T00:04:56.604 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003783308 2024-09-12T00:04:56.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.604 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.604 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:56.604 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190976+0000", 2024-09-12T00:04:56.604 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091776519999999997 2024-09-12T00:04:56.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.605 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.605 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:56.605 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191122+0000", 2024-09-12T00:04:56.605 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000145966 2024-09-12T00:04:56.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.605 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.605 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:56.605 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191226+0000", 2024-09-12T00:04:56.606 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104162 2024-09-12T00:04:56.606 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.606 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:56.606 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.606 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.606 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:56.606 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:56.606 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 104.383928911, 2024-09-12T00:04:56.606 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019997773, 2024-09-12T00:04:56.606 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:56.606 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:56.606 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:56.607 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:56.607 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:56.607 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:56.607 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 70 2024-09-12T00:04:56.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.607 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:56.607 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.607 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:56.607 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:56.607 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.607 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.607 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:56.607 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:56.607 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.608 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:56.608 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171393+0000", 2024-09-12T00:04:56.608 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3699999999999999e-07 2024-09-12T00:04:56.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.608 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:56.608 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171403+0000", 2024-09-12T00:04:56.608 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6199999999999994e-06 2024-09-12T00:04:56.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.608 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:56.609 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171416+0000", 2024-09-12T00:04:56.609 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2636000000000001e-05 2024-09-12T00:04:56.609 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.609 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.609 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:56.609 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171423+0000", 2024-09-12T00:04:56.609 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5440000000000001e-06 2024-09-12T00:04:56.609 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.609 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.609 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:56.610 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179458+0000", 2024-09-12T00:04:56.610 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080351989999999998 2024-09-12T00:04:56.610 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.610 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.610 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:56.610 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179604+0000", 2024-09-12T00:04:56.610 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014519899999999999 2024-09-12T00:04:56.610 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.610 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.610 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:56.611 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.179831+0000", 2024-09-12T00:04:56.611 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022704800000000001 2024-09-12T00:04:56.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.611 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.611 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:56.611 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181918+0000", 2024-09-12T00:04:56.611 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020873950000000001 2024-09-12T00:04:56.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.611 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.611 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:56.611 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191243+0000", 2024-09-12T00:04:56.611 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0093244729999999998 2024-09-12T00:04:56.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.611 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.612 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:56.612 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191309+0000", 2024-09-12T00:04:56.612 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6116000000000002e-05 2024-09-12T00:04:56.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.612 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.612 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:56.612 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191390+0000", 2024-09-12T00:04:56.612 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1705999999999993e-05 2024-09-12T00:04:56.612 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.612 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:56.612 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.612 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.612 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:56.613 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:56.613 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 104.38388283800001, 2024-09-12T00:04:56.613 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020263554, 2024-09-12T00:04:56.613 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:56.613 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:56.613 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:56.613 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:56.613 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:56.613 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:56.613 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 71 2024-09-12T00:04:56.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.613 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:56.613 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.613 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:56.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:56.614 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.614 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:56.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:56.614 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.614 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:56.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:04:56.614 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5000000000000002e-07 2024-09-12T00:04:56.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:56.615 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171454+0000", 2024-09-12T00:04:56.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5046e-05 2024-09-12T00:04:56.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:56.615 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171471+0000", 2024-09-12T00:04:56.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6923999999999999e-05 2024-09-12T00:04:56.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:56.615 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171487+0000", 2024-09-12T00:04:56.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5823000000000001e-05 2024-09-12T00:04:56.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.616 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:56.616 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180765+0000", 2024-09-12T00:04:56.616 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0092774399999999996 2024-09-12T00:04:56.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.616 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:56.616 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180900+0000", 2024-09-12T00:04:56.616 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013556700000000001 2024-09-12T00:04:56.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.616 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:56.616 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181108+0000", 2024-09-12T00:04:56.616 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020727899999999999 2024-09-12T00:04:56.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.617 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:56.617 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184725+0000", 2024-09-12T00:04:56.617 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036171340000000001 2024-09-12T00:04:56.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.617 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:56.617 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191413+0000", 2024-09-12T00:04:56.617 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066881830000000003 2024-09-12T00:04:56.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.617 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:56.617 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191540+0000", 2024-09-12T00:04:56.618 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000126823 2024-09-12T00:04:56.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.618 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:56.618 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191702+0000", 2024-09-12T00:04:56.618 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162585 2024-09-12T00:04:56.618 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.618 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:56.618 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.618 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:56.618 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:56.618 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 104.383804262, 2024-09-12T00:04:56.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020448573000000001, 2024-09-12T00:04:56.619 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:56.619 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:56.619 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:56.619 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:56.619 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:56.619 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:56.619 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 72 2024-09-12T00:04:56.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.619 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:56.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:56.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:56.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:56.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:04:56.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:56.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171518+0000", 2024-09-12T00:04:56.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0440000000000001e-06 2024-09-12T00:04:56.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:56.621 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171647+0000", 2024-09-12T00:04:56.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012912899999999999 2024-09-12T00:04:56.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.621 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:56.621 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171664+0000", 2024-09-12T00:04:56.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6079999999999999e-05 2024-09-12T00:04:56.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.621 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:56.621 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171675+0000", 2024-09-12T00:04:56.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1223000000000001e-05 2024-09-12T00:04:56.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.622 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.622 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:56.622 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182000+0000", 2024-09-12T00:04:56.622 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010324949 2024-09-12T00:04:56.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.622 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.622 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:56.622 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182178+0000", 2024-09-12T00:04:56.622 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017808799999999999 2024-09-12T00:04:56.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.622 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.622 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:56.622 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182402+0000", 2024-09-12T00:04:56.623 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022381199999999999 2024-09-12T00:04:56.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.623 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.623 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:56.623 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190935+0000", 2024-09-12T00:04:56.623 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085331560000000001 2024-09-12T00:04:56.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.623 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.623 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:56.623 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191728+0000", 2024-09-12T00:04:56.623 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079325700000000001 2024-09-12T00:04:56.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.623 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.623 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:56.624 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191864+0000", 2024-09-12T00:04:56.624 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013606299999999999 2024-09-12T00:04:56.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.624 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:56.624 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191966+0000", 2024-09-12T00:04:56.624 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101772 2024-09-12T00:04:56.624 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.624 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:56.624 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.624 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:56.625 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:56.625 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 104.38362106700001, 2024-09-12T00:04:56.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020675235, 2024-09-12T00:04:56.625 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:56.625 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:56.625 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:56.625 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:56.625 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:56.625 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:56.625 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 73 2024-09-12T00:04:56.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.625 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:56.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:56.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:56.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:56.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:04:56.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:56.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171701+0000", 2024-09-12T00:04:56.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0999999999999997e-07 2024-09-12T00:04:56.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:56.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171709+0000", 2024-09-12T00:04:56.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2540000000000003e-06 2024-09-12T00:04:56.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:56.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171724+0000", 2024-09-12T00:04:56.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5569e-05 2024-09-12T00:04:56.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:56.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171734+0000", 2024-09-12T00:04:56.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6139999999999998e-06 2024-09-12T00:04:56.628 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.628 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.628 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:56.628 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183774+0000", 2024-09-12T00:04:56.628 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012040444000000001 2024-09-12T00:04:56.628 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.628 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.628 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:56.628 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183896+0000", 2024-09-12T00:04:56.628 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012204199999999999 2024-09-12T00:04:56.628 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.628 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.628 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:56.628 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184084+0000", 2024-09-12T00:04:56.629 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018792599999999999 2024-09-12T00:04:56.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.629 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.629 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:56.629 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191984+0000", 2024-09-12T00:04:56.629 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079003790000000008 2024-09-12T00:04:56.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.629 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.629 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:56.629 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192093+0000", 2024-09-12T00:04:56.629 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000108942 2024-09-12T00:04:56.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.629 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.629 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:56.630 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192250+0000", 2024-09-12T00:04:56.630 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015637600000000001 2024-09-12T00:04:56.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.630 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.630 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:56.630 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192376+0000", 2024-09-12T00:04:56.630 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012587899999999999 2024-09-12T00:04:56.630 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.630 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:56.630 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.630 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.630 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:56.630 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:56.630 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 104.383572857, 2024-09-12T00:04:56.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021088828, 2024-09-12T00:04:56.631 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:56.631 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:56.631 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:56.631 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:56.631 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:56.631 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:56.631 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 74 2024-09-12T00:04:56.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.631 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:56.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:56.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:56.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:56.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:56.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:56.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:04:56.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1699999999999997e-07 2024-09-12T00:04:56.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:56.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171758+0000", 2024-09-12T00:04:56.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0860000000000008e-06 2024-09-12T00:04:56.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:56.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171774+0000", 2024-09-12T00:04:56.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:04:56.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:56.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171788+0000", 2024-09-12T00:04:56.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4793999999999999e-05 2024-09-12T00:04:56.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:56.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184842+0000", 2024-09-12T00:04:56.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013053607 2024-09-12T00:04:56.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.634 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:56.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185130+0000", 2024-09-12T00:04:56.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00028779199999999998 2024-09-12T00:04:56.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.634 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:56.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185378+0000", 2024-09-12T00:04:56.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024780100000000002 2024-09-12T00:04:56.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.635 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:56.635 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192513+0000", 2024-09-12T00:04:56.635 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071350770000000001 2024-09-12T00:04:56.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.635 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:56.635 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192690+0000", 2024-09-12T00:04:56.635 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000176892 2024-09-12T00:04:56.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.635 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:56.635 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192769+0000", 2024-09-12T00:04:56.635 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9466000000000001e-05 2024-09-12T00:04:56.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.636 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.636 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:56.636 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192837+0000", 2024-09-12T00:04:56.636 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8466000000000005e-05 2024-09-12T00:04:56.636 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.636 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:56.636 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.636 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.636 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.636 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:56.636 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:56.636 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 104.38352028, 2024-09-12T00:04:56.636 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.02121994, 2024-09-12T00:04:56.636 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:56.637 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:56.637 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:56.637 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:56.637 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:56.637 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:56.637 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 75 2024-09-12T00:04:56.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.637 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:56.637 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.637 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:56.637 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:56.637 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.637 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.638 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:56.638 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:04:56.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.638 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:56.638 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171802+0000", 2024-09-12T00:04:56.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5000000000000002e-07 2024-09-12T00:04:56.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.638 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:56.638 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171954+0000", 2024-09-12T00:04:56.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015215500000000001 2024-09-12T00:04:56.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:56.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171966+0000", 2024-09-12T00:04:56.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1548e-05 2024-09-12T00:04:56.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:56.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171970+0000", 2024-09-12T00:04:56.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8729999999999998e-06 2024-09-12T00:04:56.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:56.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186552+0000", 2024-09-12T00:04:56.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014581775 2024-09-12T00:04:56.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:56.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186702+0000", 2024-09-12T00:04:56.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014946 2024-09-12T00:04:56.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:56.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186897+0000", 2024-09-12T00:04:56.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000195071 2024-09-12T00:04:56.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:56.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192666+0000", 2024-09-12T00:04:56.641 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057693470000000002 2024-09-12T00:04:56.641 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.641 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.641 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:56.641 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192857+0000", 2024-09-12T00:04:56.641 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191149 2024-09-12T00:04:56.641 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.641 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.641 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:56.641 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192967+0000", 2024-09-12T00:04:56.641 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110202 2024-09-12T00:04:56.641 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.641 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.641 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:56.642 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193021+0000", 2024-09-12T00:04:56.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3709999999999999e-05 2024-09-12T00:04:56.642 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.642 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:56.642 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.642 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.642 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.642 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:04:56.642 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:56.642 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 104.383340985, 2024-09-12T00:04:56.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026297425999999999, 2024-09-12T00:04:56.642 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:56.642 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:56.642 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:56.643 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:56.643 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:04:56.643 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:04:56.643 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 76 2024-09-12T00:04:56.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.643 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:56.643 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.643 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:56.643 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:56.643 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.643 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.643 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:56.643 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:56.644 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.644 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:56.644 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:04:56.644 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9399999999999995e-07 2024-09-12T00:04:56.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.644 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:56.644 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171987+0000", 2024-09-12T00:04:56.644 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5230000000000003e-06 2024-09-12T00:04:56.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.644 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:56.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172005+0000", 2024-09-12T00:04:56.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8788e-05 2024-09-12T00:04:56.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.645 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:56.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172010+0000", 2024-09-12T00:04:56.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7570000000000004e-06 2024-09-12T00:04:56.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.645 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:56.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193104+0000", 2024-09-12T00:04:56.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021094112000000002 2024-09-12T00:04:56.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.646 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:56.646 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193334+0000", 2024-09-12T00:04:56.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000229855 2024-09-12T00:04:56.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.646 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:56.646 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193697+0000", 2024-09-12T00:04:56.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00036272399999999998 2024-09-12T00:04:56.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.646 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:56.646 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.195602+0000", 2024-09-12T00:04:56.647 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019049620000000001 2024-09-12T00:04:56.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:56.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198123+0000", 2024-09-12T00:04:56.647 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025216520000000001 2024-09-12T00:04:56.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:56.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198213+0000", 2024-09-12T00:04:56.647 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0008999999999998e-05 2024-09-12T00:04:56.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:56.648 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198278+0000", 2024-09-12T00:04:56.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4549999999999997e-05 2024-09-12T00:04:56.648 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.648 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:56.648 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.648 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.648 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1776 3.10 3:0ad809ca:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:56.648 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.002444+0000", 2024-09-12T00:04:56.648 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 22.552877923, 2024-09-12T00:04:56.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016768360999999999, 2024-09-12T00:04:56.648 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:56.648 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:56.649 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:56.649 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:56.649 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:56.649 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:56.649 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1776 2024-09-12T00:04:56.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.649 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:56.649 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.649 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:56.649 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.002444+0000", 2024-09-12T00:04:56.649 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.649 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.649 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:56.650 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.002444+0000", 2024-09-12T00:04:56.650 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.650 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:56.650 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.002446+0000", 2024-09-12T00:04:56.650 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5830000000000001e-06 2024-09-12T00:04:56.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.650 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:56.650 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003441+0000", 2024-09-12T00:04:56.650 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00099495500000000006 2024-09-12T00:04:56.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.651 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:56.651 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003468+0000", 2024-09-12T00:04:56.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6514000000000001e-05 2024-09-12T00:04:56.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.651 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:56.651 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003481+0000", 2024-09-12T00:04:56.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3016999999999999e-05 2024-09-12T00:04:56.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.651 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:56.651 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003556+0000", 2024-09-12T00:04:56.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5556999999999995e-05 2024-09-12T00:04:56.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.652 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:56.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003705+0000", 2024-09-12T00:04:56.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014846799999999999 2024-09-12T00:04:56.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.652 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:56.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.003828+0000", 2024-09-12T00:04:56.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000123621 2024-09-12T00:04:56.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.652 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:56.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.013795+0000", 2024-09-12T00:04:56.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0099663170000000006 2024-09-12T00:04:56.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:56.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019048+0000", 2024-09-12T00:04:56.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0052537729999999998 2024-09-12T00:04:56.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:56.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019126+0000", 2024-09-12T00:04:56.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7224999999999993e-05 2024-09-12T00:04:56.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:56.654 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019212+0000", 2024-09-12T00:04:56.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6330999999999997e-05 2024-09-12T00:04:56.654 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.654 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:56.654 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.654 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2646 3.37 3:ee59c452:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:56.654 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.142558+0000", 2024-09-12T00:04:56.654 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.4127635620000003, 2024-09-12T00:04:56.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018660066999999999, 2024-09-12T00:04:56.654 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:56.654 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:56.654 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:56.655 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:56.655 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:56.655 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:56.655 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2646 2024-09-12T00:04:56.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.655 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:56.655 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.655 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:56.655 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.142558+0000", 2024-09-12T00:04:56.655 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.655 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.655 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:56.655 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.142558+0000", 2024-09-12T00:04:56.656 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.656 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.656 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:56.656 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.142562+0000", 2024-09-12T00:04:56.656 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7950000000000001e-06 2024-09-12T00:04:56.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.656 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.656 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:56.656 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.144592+0000", 2024-09-12T00:04:56.656 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020297890000000002 2024-09-12T00:04:56.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.656 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.656 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:56.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.144609+0000", 2024-09-12T00:04:56.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7634000000000001e-05 2024-09-12T00:04:56.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.657 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:56.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.144619+0000", 2024-09-12T00:04:56.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3989999999999993e-06 2024-09-12T00:04:56.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.657 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:56.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.144703+0000", 2024-09-12T00:04:56.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4648000000000007e-05 2024-09-12T00:04:56.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:56.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.144837+0000", 2024-09-12T00:04:56.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000133709 2024-09-12T00:04:56.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:56.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.145006+0000", 2024-09-12T00:04:56.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000169073 2024-09-12T00:04:56.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:56.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.152562+0000", 2024-09-12T00:04:56.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075562399999999997 2024-09-12T00:04:56.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:56.659 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.161086+0000", 2024-09-12T00:04:56.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085240349999999993 2024-09-12T00:04:56.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:56.659 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.161158+0000", 2024-09-12T00:04:56.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1929999999999997e-05 2024-09-12T00:04:56.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:56.659 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.161218+0000", 2024-09-12T00:04:56.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9815000000000002e-05 2024-09-12T00:04:56.659 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.660 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:56.660 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.660 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.660 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2695 3.10 3:08f22abb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:56.660 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.555842+0000", 2024-09-12T00:04:56.660 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 8.999479998, 2024-09-12T00:04:56.660 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017506441000000001, 2024-09-12T00:04:56.660 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:56.660 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:56.660 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:56.660 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:56.660 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:56.661 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:56.661 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2695 2024-09-12T00:04:56.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.661 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:56.661 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.661 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:56.661 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.555842+0000", 2024-09-12T00:04:56.661 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.661 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.661 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:56.661 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.555842+0000", 2024-09-12T00:04:56.661 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:56.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.555844+0000", 2024-09-12T00:04:56.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8430000000000001e-06 2024-09-12T00:04:56.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:56.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.558169+0000", 2024-09-12T00:04:56.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023244939999999999 2024-09-12T00:04:56.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:56.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.558191+0000", 2024-09-12T00:04:56.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2062e-05 2024-09-12T00:04:56.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:56.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.558201+0000", 2024-09-12T00:04:56.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.91e-06 2024-09-12T00:04:56.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:56.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.558276+0000", 2024-09-12T00:04:56.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5408999999999996e-05 2024-09-12T00:04:56.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:56.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.558445+0000", 2024-09-12T00:04:56.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000168326 2024-09-12T00:04:56.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:56.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.558554+0000", 2024-09-12T00:04:56.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000109274 2024-09-12T00:04:56.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:56.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.564596+0000", 2024-09-12T00:04:56.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0060426350000000002 2024-09-12T00:04:56.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:56.665 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.573228+0000", 2024-09-12T00:04:56.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0086312960000000001 2024-09-12T00:04:56.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.665 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:56.665 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.573296+0000", 2024-09-12T00:04:56.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8402e-05 2024-09-12T00:04:56.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.665 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:56.665 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.573348+0000", 2024-09-12T00:04:56.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1789999999999997e-05 2024-09-12T00:04:56.665 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.665 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:56.666 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.666 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.666 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.666 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2717 3.1a 3:5be58560:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:56.666 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.775712+0000", 2024-09-12T00:04:56.666 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 8.7796095479999998, 2024-09-12T00:04:56.666 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018214033000000001, 2024-09-12T00:04:56.666 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:56.666 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:56.666 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:56.666 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:56.666 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:56.666 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:56.666 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2717 2024-09-12T00:04:56.666 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.667 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:56.667 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.667 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:56.667 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.775712+0000", 2024-09-12T00:04:56.667 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.667 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.667 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:56.667 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.775712+0000", 2024-09-12T00:04:56.667 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.667 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.667 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:56.667 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.775715+0000", 2024-09-12T00:04:56.668 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.678e-06 2024-09-12T00:04:56.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.668 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:56.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.777487+0000", 2024-09-12T00:04:56.668 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001772657 2024-09-12T00:04:56.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.668 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:56.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.777511+0000", 2024-09-12T00:04:56.668 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3359000000000001e-05 2024-09-12T00:04:56.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:56.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.777521+0000", 2024-09-12T00:04:56.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0078000000000001e-05 2024-09-12T00:04:56.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:56.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.777608+0000", 2024-09-12T00:04:56.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7084999999999997e-05 2024-09-12T00:04:56.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:56.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.777800+0000", 2024-09-12T00:04:56.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000192299 2024-09-12T00:04:56.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:56.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.777984+0000", 2024-09-12T00:04:56.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018348099999999999 2024-09-12T00:04:56.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:56.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.791888+0000", 2024-09-12T00:04:56.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013904626999999999 2024-09-12T00:04:56.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:56.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.793860+0000", 2024-09-12T00:04:56.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019722339999999998 2024-09-12T00:04:56.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.671 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:56.671 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.793897+0000", 2024-09-12T00:04:56.671 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6384000000000003e-05 2024-09-12T00:04:56.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.671 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:56.671 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.793926+0000", 2024-09-12T00:04:56.671 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9150999999999999e-05 2024-09-12T00:04:56.671 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.671 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:56.671 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.672 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2761 3.1a 3:5b171b72:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:56.672 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.284447+0000", 2024-09-12T00:04:56.672 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 8.2708749079999997, 2024-09-12T00:04:56.672 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016409588999999999, 2024-09-12T00:04:56.672 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:56.672 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:56.672 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:56.672 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:56.672 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:56.672 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:56.672 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2761 2024-09-12T00:04:56.672 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.672 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:56.672 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.673 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:56.673 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.284447+0000", 2024-09-12T00:04:56.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.673 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:56.673 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.284447+0000", 2024-09-12T00:04:56.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.673 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:56.673 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.284450+0000", 2024-09-12T00:04:56.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5899999999999999e-06 2024-09-12T00:04:56.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.674 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:56.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.286501+0000", 2024-09-12T00:04:56.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0020512199999999999 2024-09-12T00:04:56.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.674 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:56.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.286557+0000", 2024-09-12T00:04:56.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5721999999999999e-05 2024-09-12T00:04:56.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.674 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:56.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.286585+0000", 2024-09-12T00:04:56.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8274000000000001e-05 2024-09-12T00:04:56.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:56.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.286684+0000", 2024-09-12T00:04:56.675 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8894000000000006e-05 2024-09-12T00:04:56.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:56.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.286823+0000", 2024-09-12T00:04:56.675 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000138617 2024-09-12T00:04:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.286922+0000", 2024-09-12T00:04:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.9507999999999997e-05 2024-09-12T00:04:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.291710+0000", 2024-09-12T00:04:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047878850000000004 2024-09-12T00:04:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.300784+0000", 2024-09-12T00:04:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0090731879999999994 2024-09-12T00:04:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.300825+0000", 2024-09-12T00:04:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1418000000000002e-05 2024-09-12T00:04:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.300856+0000", 2024-09-12T00:04:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1272999999999997e-05 2024-09-12T00:04:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2763 3.1a 3:59bb7aeb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_248:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.315032+0000", 2024-09-12T00:04:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 8.2402890909999993, 2024-09-12T00:04:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018477223000000001, 2024-09-12T00:04:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2763 2024-09-12T00:04:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.315032+0000", 2024-09-12T00:04:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.315032+0000", 2024-09-12T00:04:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.315036+0000", 2024-09-12T00:04:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1669999999999999e-06 2024-09-12T00:04:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.317265+0000", 2024-09-12T00:04:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022292129999999999 2024-09-12T00:04:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.317308+0000", 2024-09-12T00:04:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3597000000000003e-05 2024-09-12T00:04:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:56.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.317331+0000", 2024-09-12T00:04:56.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2101999999999999e-05 2024-09-12T00:04:56.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.681 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:56.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.317552+0000", 2024-09-12T00:04:56.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000221189 2024-09-12T00:04:56.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.681 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:56.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.317751+0000", 2024-09-12T00:04:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019959599999999999 2024-09-12T00:04:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.317931+0000", 2024-09-12T00:04:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017935600000000001 2024-09-12T00:04:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.323667+0000", 2024-09-12T00:04:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057359739999999996 2024-09-12T00:04:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.333314+0000", 2024-09-12T00:04:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0096473759999999992 2024-09-12T00:04:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.333406+0000", 2024-09-12T00:04:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2164999999999996e-05 2024-09-12T00:04:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.333510+0000", 2024-09-12T00:04:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103488 2024-09-12T00:04:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:56.684 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.684 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:56.684 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:56.684 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:56.685 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:04:56.686 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:56.688+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:56.786 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:56.788+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:56.865 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:56.865 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:56.865 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:56.865 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:56.881 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:04:56.887 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:56.885+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:56.989 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:56.988+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:57.050 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:57.050 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:57.050 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:57.050 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:57.050 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:57.065 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:04:57.105 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:57.108+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:57.191 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:57.189+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:57.231 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:57.232 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:57.232 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:57.232 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:57.232 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.232 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1641 3.26 3:658fe58e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2__shadow_.hDHTDpIswwqRA2bHiHVxkhWqZde6XEj_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:57.233 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:04:57.233 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 24.174315167, 2024-09-12T00:04:57.233 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017888905, 2024-09-12T00:04:57.233 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.233 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.234 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.234 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.234 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.234 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.234 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1641 2024-09-12T00:04:57.235 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.235 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.235 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.235 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.235 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:04:57.235 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.236 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.236 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.236 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.236 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:04:57.236 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.237 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.237 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.237 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.237 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056289+0000", 2024-09-12T00:04:57.237 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5349999999999999e-06 2024-09-12T00:04:57.237 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.238 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.238 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.238 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058595+0000", 2024-09-12T00:04:57.238 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002306083 2024-09-12T00:04:57.238 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.239 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.239 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.239 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058621+0000", 2024-09-12T00:04:57.239 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6431000000000002e-05 2024-09-12T00:04:57.239 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.239 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.240 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.240 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058631+0000", 2024-09-12T00:04:57.240 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0166000000000001e-05 2024-09-12T00:04:57.240 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.240 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.240 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.241 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058712+0000", 2024-09-12T00:04:57.241 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0122000000000003e-05 2024-09-12T00:04:57.241 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.241 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.241 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.241 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058821+0000", 2024-09-12T00:04:57.242 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010907400000000001 2024-09-12T00:04:57.242 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.242 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.242 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:57.242 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058910+0000", 2024-09-12T00:04:57.242 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9523000000000003e-05 2024-09-12T00:04:57.243 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.243 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.243 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.243 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073881+0000", 2024-09-12T00:04:57.243 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014971224 2024-09-12T00:04:57.243 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.244 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.244 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.244 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074101+0000", 2024-09-12T00:04:57.244 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0002195 2024-09-12T00:04:57.244 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.244 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.245 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.245 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074133+0000", 2024-09-12T00:04:57.245 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2138000000000003e-05 2024-09-12T00:04:57.245 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.245 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.246 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.246 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074175+0000", 2024-09-12T00:04:57.246 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2109e-05 2024-09-12T00:04:57.246 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.246 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.246 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.247 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.247 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.247 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1775 3.30 e58/23 3:0c2ae78d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_1:head v 58'1, mlcod=0'0)", 2024-09-12T00:04:57.247 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:04:57.247 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.228840207000001, 2024-09-12T00:04:57.247 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017585038000000001, 2024-09-12T00:04:57.248 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.248 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.248 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.248 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.248 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.248 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.249 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:04:57.249 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.249 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.249 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.249 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.250 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:04:57.250 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.250 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.250 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.250 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.250 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001763+0000", 2024-09-12T00:04:57.251 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2730000000000001e-06 2024-09-12T00:04:57.251 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.251 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.251 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.251 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005217+0000", 2024-09-12T00:04:57.252 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0034533810000000002 2024-09-12T00:04:57.252 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.252 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.252 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.252 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005241+0000", 2024-09-12T00:04:57.252 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4403e-05 2024-09-12T00:04:57.253 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.253 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.253 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.253 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005253+0000", 2024-09-12T00:04:57.254 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2007e-05 2024-09-12T00:04:57.254 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.254 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.254 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.254 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005324+0000", 2024-09-12T00:04:57.255 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0765000000000004e-05 2024-09-12T00:04:57.255 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.255 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.255 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.255 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005348+0000", 2024-09-12T00:04:57.255 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3762000000000001e-05 2024-09-12T00:04:57.256 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.256 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.256 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.256 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019291+0000", 2024-09-12T00:04:57.256 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013943707 2024-09-12T00:04:57.257 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.257 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.257 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.257 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019346+0000", 2024-09-12T00:04:57.257 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4740000000000001e-05 2024-09-12T00:04:57.257 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.258 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.258 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.258 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.258 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.258 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1780 3.16 3:69d8ee52:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:57.258 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:04:57.259 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.207231295, 2024-09-12T00:04:57.259 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016232362, 2024-09-12T00:04:57.259 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.259 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.259 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.259 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.260 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.260 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.260 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1780 2024-09-12T00:04:57.260 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.260 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.260 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.261 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.261 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:04:57.261 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.261 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.261 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.261 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.262 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:04:57.262 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.262 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.262 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.262 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.263 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023372+0000", 2024-09-12T00:04:57.263 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0209999999999998e-06 2024-09-12T00:04:57.263 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.263 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.263 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.263 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024447+0000", 2024-09-12T00:04:57.264 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0010749550000000001 2024-09-12T00:04:57.264 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.264 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.264 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.264 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024473+0000", 2024-09-12T00:04:57.265 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5689000000000001e-05 2024-09-12T00:04:57.265 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.265 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.265 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.265 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024484+0000", 2024-09-12T00:04:57.266 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1153e-05 2024-09-12T00:04:57.266 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.266 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.266 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.266 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024547+0000", 2024-09-12T00:04:57.266 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3400999999999998e-05 2024-09-12T00:04:57.267 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.267 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.267 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.267 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024669+0000", 2024-09-12T00:04:57.267 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012184999999999999 2024-09-12T00:04:57.267 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.268 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.268 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:57.268 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025014+0000", 2024-09-12T00:04:57.268 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000344505 2024-09-12T00:04:57.268 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.269 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.269 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.269 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039161+0000", 2024-09-12T00:04:57.269 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014147799000000001 2024-09-12T00:04:57.269 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.269 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.270 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.270 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039434+0000", 2024-09-12T00:04:57.270 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00027254699999999999 2024-09-12T00:04:57.270 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.270 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.271 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.271 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039521+0000", 2024-09-12T00:04:57.271 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6663999999999996e-05 2024-09-12T00:04:57.271 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.271 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.271 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.271 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039602+0000", 2024-09-12T00:04:57.271 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1778000000000002e-05 2024-09-12T00:04:57.271 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.271 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.271 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.271 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.271 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.272 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1912 3.16 3:6a08f78f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.4__shadow_.EKM6BwfpK8ZqXIKQk7k4yJFkOWS2UlN_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:04:57.272 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:35.139256+0000", 2024-09-12T00:04:57.272 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 22.091345373999999, 2024-09-12T00:04:57.272 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01537029, 2024-09-12T00:04:57.272 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.272 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.272 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.272 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.272 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.272 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.272 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1912 2024-09-12T00:04:57.272 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.272 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.273 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.273 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.273 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.139256+0000", 2024-09-12T00:04:57.273 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.273 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.273 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.273 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.273 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.139256+0000", 2024-09-12T00:04:57.273 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.273 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.273 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.273 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.273 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.139258+0000", 2024-09-12T00:04:57.274 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3439999999999999e-06 2024-09-12T00:04:57.274 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.274 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.274 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.274 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141028+0000", 2024-09-12T00:04:57.274 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001770183 2024-09-12T00:04:57.274 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.274 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.274 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.274 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141054+0000", 2024-09-12T00:04:57.274 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5928e-05 2024-09-12T00:04:57.274 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.274 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.274 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.275 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141065+0000", 2024-09-12T00:04:57.275 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0589e-05 2024-09-12T00:04:57.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.275 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.275 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.275 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141145+0000", 2024-09-12T00:04:57.275 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0121000000000001e-05 2024-09-12T00:04:57.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.275 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.275 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.275 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141257+0000", 2024-09-12T00:04:57.275 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000111672 2024-09-12T00:04:57.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.275 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.275 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:57.276 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141361+0000", 2024-09-12T00:04:57.276 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103705 2024-09-12T00:04:57.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.276 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.276 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.276 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.152422+0000", 2024-09-12T00:04:57.276 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011061586999999999 2024-09-12T00:04:57.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.276 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.276 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.276 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154552+0000", 2024-09-12T00:04:57.276 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021297120000000002 2024-09-12T00:04:57.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.277 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.277 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.277 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154590+0000", 2024-09-12T00:04:57.277 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7942999999999999e-05 2024-09-12T00:04:57.277 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.277 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.277 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.277 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154626+0000", 2024-09-12T00:04:57.277 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6505999999999999e-05 2024-09-12T00:04:57.277 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.277 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.277 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.278 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.278 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.278 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2650 3.5 3:a19f3a83:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.278 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.189998+0000", 2024-09-12T00:04:57.278 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.040603399, 2024-09-12T00:04:57.278 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016025257000000001, 2024-09-12T00:04:57.278 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.278 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.278 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.278 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.278 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.278 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.278 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2650 2024-09-12T00:04:57.278 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.279 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.279 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.279 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.279 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.189998+0000", 2024-09-12T00:04:57.279 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.279 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.279 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.279 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.279 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.189998+0000", 2024-09-12T00:04:57.279 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.279 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.279 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.279 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.279 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.190001+0000", 2024-09-12T00:04:57.280 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5830000000000001e-06 2024-09-12T00:04:57.280 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.280 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.280 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.280 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191320+0000", 2024-09-12T00:04:57.280 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0013192449999999999 2024-09-12T00:04:57.280 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.280 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.280 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.280 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191341+0000", 2024-09-12T00:04:57.280 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1690000000000001e-05 2024-09-12T00:04:57.280 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.280 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.280 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.281 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191355+0000", 2024-09-12T00:04:57.281 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3147e-05 2024-09-12T00:04:57.281 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.281 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.281 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.281 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191444+0000", 2024-09-12T00:04:57.281 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9809999999999996e-05 2024-09-12T00:04:57.281 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.281 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.281 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.281 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191623+0000", 2024-09-12T00:04:57.281 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017869399999999999 2024-09-12T00:04:57.281 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.281 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.282 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:57.282 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191786+0000", 2024-09-12T00:04:57.282 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000163203 2024-09-12T00:04:57.282 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.282 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.282 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.282 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.198758+0000", 2024-09-12T00:04:57.282 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069714440000000003 2024-09-12T00:04:57.282 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.282 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.282 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.282 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.205895+0000", 2024-09-12T00:04:57.282 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.007137404 2024-09-12T00:04:57.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.283 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.283 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.283 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.205966+0000", 2024-09-12T00:04:57.283 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0797999999999995e-05 2024-09-12T00:04:57.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.283 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.283 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.283 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.206023+0000", 2024-09-12T00:04:57.283 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7238999999999999e-05 2024-09-12T00:04:57.283 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.283 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.284 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.284 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.284 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.284 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2655 3.5 3:a26caaa1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.284 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.241675+0000", 2024-09-12T00:04:57.284 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.988926137, 2024-09-12T00:04:57.284 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018338047999999999, 2024-09-12T00:04:57.284 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.284 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.284 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.284 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.284 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.284 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.285 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2655 2024-09-12T00:04:57.285 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.285 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.285 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.285 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.285 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.241675+0000", 2024-09-12T00:04:57.285 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.285 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.285 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.285 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.285 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.241675+0000", 2024-09-12T00:04:57.285 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.285 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.285 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.286 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.286 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.241678+0000", 2024-09-12T00:04:57.286 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4430000000000002e-06 2024-09-12T00:04:57.286 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.286 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.286 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.286 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243471+0000", 2024-09-12T00:04:57.286 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017937369999999999 2024-09-12T00:04:57.286 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.286 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.286 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.286 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243493+0000", 2024-09-12T00:04:57.286 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2001000000000002e-05 2024-09-12T00:04:57.287 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.287 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.287 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.287 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243505+0000", 2024-09-12T00:04:57.287 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1632e-05 2024-09-12T00:04:57.287 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.287 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.287 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.287 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243579+0000", 2024-09-12T00:04:57.287 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4165999999999994e-05 2024-09-12T00:04:57.287 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.287 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.287 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.287 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243766+0000", 2024-09-12T00:04:57.288 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018714599999999999 2024-09-12T00:04:57.288 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.288 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.288 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:57.288 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243937+0000", 2024-09-12T00:04:57.288 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017038700000000001 2024-09-12T00:04:57.288 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.288 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.288 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.288 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.250274+0000", 2024-09-12T00:04:57.288 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063369070000000001 2024-09-12T00:04:57.288 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.289 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.289 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.289 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.259911+0000", 2024-09-12T00:04:57.289 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0096378669999999996 2024-09-12T00:04:57.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.289 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.289 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.289 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.259960+0000", 2024-09-12T00:04:57.289 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8763000000000001e-05 2024-09-12T00:04:57.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.289 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.289 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.290 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.260013+0000", 2024-09-12T00:04:57.290 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2998999999999999e-05 2024-09-12T00:04:57.290 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.290 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.290 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.290 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.290 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.290 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2657 3.3c 3:3e583291:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.290 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.263916+0000", 2024-09-12T00:04:57.290 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.9666854459999996, 2024-09-12T00:04:57.290 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020609368999999999, 2024-09-12T00:04:57.290 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.290 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.290 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.291 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.291 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.291 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.291 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2657 2024-09-12T00:04:57.291 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.291 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.291 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.291 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.291 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.263916+0000", 2024-09-12T00:04:57.291 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.291 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.291 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.291 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.291 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.263916+0000", 2024-09-12T00:04:57.291 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.292 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.292 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.292 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.292 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.263919+0000", 2024-09-12T00:04:57.292 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.92e-06 2024-09-12T00:04:57.292 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.292 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.292 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.292 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266277+0000", 2024-09-12T00:04:57.292 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023579310000000002 2024-09-12T00:04:57.292 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.292 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.292 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.293 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266302+0000", 2024-09-12T00:04:57.293 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4807000000000002e-05 2024-09-12T00:04:57.293 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.293 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.293 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.293 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266317+0000", 2024-09-12T00:04:57.293 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5209e-05 2024-09-12T00:04:57.293 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.293 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.293 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.293 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266414+0000", 2024-09-12T00:04:57.293 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7658000000000006e-05 2024-09-12T00:04:57.293 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.294 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.294 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.294 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266556+0000", 2024-09-12T00:04:57.294 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014166100000000001 2024-09-12T00:04:57.294 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.294 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.294 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:57.294 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266680+0000", 2024-09-12T00:04:57.294 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012421099999999999 2024-09-12T00:04:57.294 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.294 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.294 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.294 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275396+0000", 2024-09-12T00:04:57.294 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0087156609999999995 2024-09-12T00:04:57.295 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.295 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.295 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.295 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.284426+0000", 2024-09-12T00:04:57.295 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0090300039999999995 2024-09-12T00:04:57.295 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.295 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.295 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.295 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.284472+0000", 2024-09-12T00:04:57.295 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6273000000000002e-05 2024-09-12T00:04:57.295 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.295 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.295 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.295 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.284525+0000", 2024-09-12T00:04:57.296 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3034000000000001e-05 2024-09-12T00:04:57.296 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.296 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.296 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.296 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.296 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.296 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2658 3.3a 3:5ec14981:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.296 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.274153+0000", 2024-09-12T00:04:57.296 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.9564480040000003, 2024-09-12T00:04:57.296 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017963626, 2024-09-12T00:04:57.296 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.296 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.296 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.297 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.297 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.297 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.297 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2658 2024-09-12T00:04:57.297 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.297 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.297 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.297 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.297 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.274153+0000", 2024-09-12T00:04:57.297 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.297 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.297 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.297 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.298 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.274153+0000", 2024-09-12T00:04:57.298 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.298 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.298 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.298 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.274156+0000", 2024-09-12T00:04:57.298 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5299999999999999e-06 2024-09-12T00:04:57.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.298 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.298 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.298 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275746+0000", 2024-09-12T00:04:57.298 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001589741 2024-09-12T00:04:57.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.298 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.299 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.299 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275770+0000", 2024-09-12T00:04:57.299 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4539999999999999e-05 2024-09-12T00:04:57.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.299 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.299 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.299 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275785+0000", 2024-09-12T00:04:57.299 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4783000000000001e-05 2024-09-12T00:04:57.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.299 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.299 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.299 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275867+0000", 2024-09-12T00:04:57.299 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2362999999999997e-05 2024-09-12T00:04:57.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.300 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.300 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.300 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275990+0000", 2024-09-12T00:04:57.300 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012287100000000001 2024-09-12T00:04:57.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.300 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.300 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:57.300 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.276085+0000", 2024-09-12T00:04:57.300 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5172000000000003e-05 2024-09-12T00:04:57.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.300 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.300 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.300 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.282993+0000", 2024-09-12T00:04:57.301 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069076210000000001 2024-09-12T00:04:57.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.301 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.301 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.301 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.291976+0000", 2024-09-12T00:04:57.301 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0089835269999999998 2024-09-12T00:04:57.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.301 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.301 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.301 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.292054+0000", 2024-09-12T00:04:57.301 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7804000000000002e-05 2024-09-12T00:04:57.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.301 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.301 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.302 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.292117+0000", 2024-09-12T00:04:57.302 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2674000000000003e-05 2024-09-12T00:04:57.302 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.302 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.302 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.302 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.302 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2661 3.1e e63/23 3:7a671bd1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_156:head v 63'3, mlcod=62'1)", 2024-09-12T00:04:57.302 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.312780+0000", 2024-09-12T00:04:57.302 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.9178213750000008, 2024-09-12T00:04:57.302 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015038723, 2024-09-12T00:04:57.302 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.302 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.303 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.303 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.303 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.303 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.303 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.312780+0000", 2024-09-12T00:04:57.303 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.303 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.303 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.303 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.303 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.312780+0000", 2024-09-12T00:04:57.303 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.303 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.303 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.304 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.304 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.312783+0000", 2024-09-12T00:04:57.304 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.756e-06 2024-09-12T00:04:57.304 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.304 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.304 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.304 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317423+0000", 2024-09-12T00:04:57.304 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004640323 2024-09-12T00:04:57.304 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.304 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.304 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.304 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317453+0000", 2024-09-12T00:04:57.304 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0301e-05 2024-09-12T00:04:57.304 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.305 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.305 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.305 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317468+0000", 2024-09-12T00:04:57.305 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4989e-05 2024-09-12T00:04:57.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.305 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.305 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.305 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317551+0000", 2024-09-12T00:04:57.305 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2712000000000004e-05 2024-09-12T00:04:57.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.305 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.305 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.305 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317578+0000", 2024-09-12T00:04:57.306 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7161999999999998e-05 2024-09-12T00:04:57.306 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.306 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.306 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.306 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.327765+0000", 2024-09-12T00:04:57.306 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010187229000000001 2024-09-12T00:04:57.306 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.306 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.306 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.306 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.327819+0000", 2024-09-12T00:04:57.306 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3251000000000002e-05 2024-09-12T00:04:57.306 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.306 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.306 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.307 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.307 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2675 3.20 3:0529bfef:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.307 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.454008+0000", 2024-09-12T00:04:57.307 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.7765931189999993, 2024-09-12T00:04:57.307 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017972776999999999, 2024-09-12T00:04:57.307 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.307 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.307 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.307 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.307 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.307 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.307 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2675 2024-09-12T00:04:57.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.308 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.308 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.308 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.308 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.454008+0000", 2024-09-12T00:04:57.308 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.308 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.308 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.308 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.308 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.454008+0000", 2024-09-12T00:04:57.308 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.308 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.308 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.308 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.308 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.454011+0000", 2024-09-12T00:04:57.308 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1379999999999999e-06 2024-09-12T00:04:57.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.309 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.309 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.309 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455547+0000", 2024-09-12T00:04:57.309 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001535919 2024-09-12T00:04:57.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.309 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.309 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.309 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455580+0000", 2024-09-12T00:04:57.309 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2789000000000001e-05 2024-09-12T00:04:57.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.309 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.309 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.310 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455591+0000", 2024-09-12T00:04:57.310 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0531e-05 2024-09-12T00:04:57.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.310 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.310 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.310 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455670+0000", 2024-09-12T00:04:57.310 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9822999999999998e-05 2024-09-12T00:04:57.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.310 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.310 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.310 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455863+0000", 2024-09-12T00:04:57.310 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019248799999999999 2024-09-12T00:04:57.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.311 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.311 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:57.311 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.456021+0000", 2024-09-12T00:04:57.311 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000157627 2024-09-12T00:04:57.311 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.311 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.311 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.311 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.462847+0000", 2024-09-12T00:04:57.311 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0068268230000000001 2024-09-12T00:04:57.311 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.311 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.311 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.311 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.471901+0000", 2024-09-12T00:04:57.311 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0090533820000000004 2024-09-12T00:04:57.312 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.312 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.312 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.312 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.471939+0000", 2024-09-12T00:04:57.312 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8334999999999998e-05 2024-09-12T00:04:57.312 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.312 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.312 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.312 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.471981+0000", 2024-09-12T00:04:57.312 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1922000000000003e-05 2024-09-12T00:04:57.312 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.312 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.312 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.313 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.313 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.313 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2693 3.1e e63/23 3:7a8f9e2c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_178:head v 63'4, mlcod=63'2)", 2024-09-12T00:04:57.313 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.541097+0000", 2024-09-12T00:04:57.313 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.6895044069999994, 2024-09-12T00:04:57.313 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013470268000000001, 2024-09-12T00:04:57.313 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.313 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.313 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.313 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.313 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.313 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.314 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.541097+0000", 2024-09-12T00:04:57.314 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.314 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.314 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.314 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.541097+0000", 2024-09-12T00:04:57.314 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.314 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.314 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.314 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.541098+0000", 2024-09-12T00:04:57.314 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.454e-06 2024-09-12T00:04:57.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.314 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.315 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.315 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545193+0000", 2024-09-12T00:04:57.315 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040943899999999998 2024-09-12T00:04:57.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.315 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.315 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.315 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545221+0000", 2024-09-12T00:04:57.315 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8595e-05 2024-09-12T00:04:57.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.315 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.315 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.315 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545235+0000", 2024-09-12T00:04:57.315 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3329999999999999e-05 2024-09-12T00:04:57.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.316 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.316 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.316 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545320+0000", 2024-09-12T00:04:57.316 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5371000000000006e-05 2024-09-12T00:04:57.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.316 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.316 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.316 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545348+0000", 2024-09-12T00:04:57.316 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7532e-05 2024-09-12T00:04:57.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.316 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.316 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.317 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.554493+0000", 2024-09-12T00:04:57.317 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091452400000000007 2024-09-12T00:04:57.317 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.317 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.317 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.317 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.554567+0000", 2024-09-12T00:04:57.317 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4356000000000004e-05 2024-09-12T00:04:57.317 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.317 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.317 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.317 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.317 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.317 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2696 3.2b e63/23 3:d7c776f8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_181:head v 63'8, mlcod=63'6)", 2024-09-12T00:04:57.318 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.572942+0000", 2024-09-12T00:04:57.318 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.6576588690000005, 2024-09-12T00:04:57.318 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016050795999999999, 2024-09-12T00:04:57.318 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.318 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.318 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.318 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.318 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.318 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.318 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.572942+0000", 2024-09-12T00:04:57.318 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.318 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.318 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.318 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.319 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.572942+0000", 2024-09-12T00:04:57.319 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.319 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.319 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.319 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.572945+0000", 2024-09-12T00:04:57.319 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1730000000000002e-06 2024-09-12T00:04:57.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.319 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.319 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.319 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577465+0000", 2024-09-12T00:04:57.319 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045199649999999999 2024-09-12T00:04:57.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.319 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.320 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.320 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577495+0000", 2024-09-12T00:04:57.320 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0473000000000001e-05 2024-09-12T00:04:57.320 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.320 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.320 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.320 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577512+0000", 2024-09-12T00:04:57.320 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7215999999999999e-05 2024-09-12T00:04:57.320 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.320 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.320 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.320 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577616+0000", 2024-09-12T00:04:57.320 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103304 2024-09-12T00:04:57.320 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.321 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.321 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.321 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577649+0000", 2024-09-12T00:04:57.321 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3695999999999997e-05 2024-09-12T00:04:57.321 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.321 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.321 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.321 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.588945+0000", 2024-09-12T00:04:57.321 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011295556 2024-09-12T00:04:57.321 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.321 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.321 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.321 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.588993+0000", 2024-09-12T00:04:57.322 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8412999999999999e-05 2024-09-12T00:04:57.322 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.322 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.322 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.322 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.322 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.322 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2702 3.3c 3:3d6a0b3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.322 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.626588+0000", 2024-09-12T00:04:57.322 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.6040131750000004, 2024-09-12T00:04:57.322 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018349791000000001, 2024-09-12T00:04:57.322 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.322 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.322 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.322 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.322 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.323 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.323 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2702 2024-09-12T00:04:57.323 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.323 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.323 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.323 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.323 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.626588+0000", 2024-09-12T00:04:57.323 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.323 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.323 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.323 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.323 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.626588+0000", 2024-09-12T00:04:57.323 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.323 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.324 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.324 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.324 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.626591+0000", 2024-09-12T00:04:57.324 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0469999999999998e-06 2024-09-12T00:04:57.324 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.324 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.324 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.324 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.627983+0000", 2024-09-12T00:04:57.324 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001391541 2024-09-12T00:04:57.324 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.324 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.324 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.325 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628016+0000", 2024-09-12T00:04:57.325 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3556999999999997e-05 2024-09-12T00:04:57.325 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.325 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.325 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.325 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628035+0000", 2024-09-12T00:04:57.325 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9162999999999999e-05 2024-09-12T00:04:57.325 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.325 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.325 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.325 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628108+0000", 2024-09-12T00:04:57.325 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2336999999999995e-05 2024-09-12T00:04:57.325 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.325 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.326 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.326 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628237+0000", 2024-09-12T00:04:57.326 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000128706 2024-09-12T00:04:57.326 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.326 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.326 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:57.326 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628329+0000", 2024-09-12T00:04:57.326 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2761000000000002e-05 2024-09-12T00:04:57.326 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.326 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.326 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.326 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.632309+0000", 2024-09-12T00:04:57.326 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003979692 2024-09-12T00:04:57.326 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.327 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.327 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.327 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.644845+0000", 2024-09-12T00:04:57.327 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012536112 2024-09-12T00:04:57.327 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.327 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.327 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.327 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.644898+0000", 2024-09-12T00:04:57.327 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.329e-05 2024-09-12T00:04:57.327 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.327 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.327 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.327 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.644938+0000", 2024-09-12T00:04:57.327 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9585000000000001e-05 2024-09-12T00:04:57.328 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.328 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.328 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.328 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.328 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.328 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2716 3.20 3:042f7231:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.328 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.766936+0000", 2024-09-12T00:04:57.328 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.4636650420000006, 2024-09-12T00:04:57.328 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025751422999999999, 2024-09-12T00:04:57.328 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.328 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.328 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.328 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.328 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.329 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.329 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2716 2024-09-12T00:04:57.329 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.329 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.329 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.329 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.329 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766936+0000", 2024-09-12T00:04:57.329 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.329 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.329 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.329 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.329 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766936+0000", 2024-09-12T00:04:57.329 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.330 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.330 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.330 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.330 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766939+0000", 2024-09-12T00:04:57.330 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8499999999999998e-06 2024-09-12T00:04:57.330 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.330 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.330 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.330 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769471+0000", 2024-09-12T00:04:57.330 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025320780000000001 2024-09-12T00:04:57.330 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.330 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.330 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.330 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769506+0000", 2024-09-12T00:04:57.331 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4842999999999998e-05 2024-09-12T00:04:57.331 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.331 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.331 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.331 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769522+0000", 2024-09-12T00:04:57.331 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5548000000000001e-05 2024-09-12T00:04:57.331 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.331 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.331 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.331 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769602+0000", 2024-09-12T00:04:57.331 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0291999999999996e-05 2024-09-12T00:04:57.331 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.331 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.331 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.332 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769726+0000", 2024-09-12T00:04:57.332 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012447900000000001 2024-09-12T00:04:57.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.332 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.332 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:57.332 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769833+0000", 2024-09-12T00:04:57.332 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010621899999999999 2024-09-12T00:04:57.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.332 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.332 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.332 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.775790+0000", 2024-09-12T00:04:57.332 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0059571529999999998 2024-09-12T00:04:57.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.333 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.333 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.333 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.792589+0000", 2024-09-12T00:04:57.333 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016799445 2024-09-12T00:04:57.333 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.333 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.333 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.333 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.792634+0000", 2024-09-12T00:04:57.333 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4543999999999999e-05 2024-09-12T00:04:57.333 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.333 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.333 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.333 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.792688+0000", 2024-09-12T00:04:57.333 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3971999999999998e-05 2024-09-12T00:04:57.334 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.334 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.334 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.334 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.334 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2719 3.1 e63/23 3:83b62cc7:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_204:head v 63'9, mlcod=63'7)", 2024-09-12T00:04:57.334 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.801392+0000", 2024-09-12T00:04:57.334 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.4292093450000003, 2024-09-12T00:04:57.334 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014562542, 2024-09-12T00:04:57.334 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.334 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.334 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.334 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.334 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.335 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.335 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.801392+0000", 2024-09-12T00:04:57.335 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.335 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.335 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.335 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.801392+0000", 2024-09-12T00:04:57.335 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.335 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.335 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.335 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.801394+0000", 2024-09-12T00:04:57.335 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0090000000000002e-06 2024-09-12T00:04:57.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.336 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.336 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.336 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807832+0000", 2024-09-12T00:04:57.336 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064375989999999996 2024-09-12T00:04:57.336 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.336 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.336 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.336 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807863+0000", 2024-09-12T00:04:57.336 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1114000000000001e-05 2024-09-12T00:04:57.336 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.336 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.336 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.336 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807877+0000", 2024-09-12T00:04:57.336 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4386000000000001e-05 2024-09-12T00:04:57.337 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.337 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.337 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.337 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807948+0000", 2024-09-12T00:04:57.337 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1055000000000003e-05 2024-09-12T00:04:57.337 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.337 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.337 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.337 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807965+0000", 2024-09-12T00:04:57.337 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7025999999999999e-05 2024-09-12T00:04:57.337 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.337 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.337 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.337 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.815469+0000", 2024-09-12T00:04:57.338 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075039979999999996 2024-09-12T00:04:57.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.338 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.338 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.338 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.815955+0000", 2024-09-12T00:04:57.338 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00048535499999999998 2024-09-12T00:04:57.338 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.338 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.338 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.338 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.338 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2739 3.3a 3:5e74d49c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_224:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.338 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.006819+0000", 2024-09-12T00:04:57.338 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.2237824859999993, 2024-09-12T00:04:57.339 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018768888000000001, 2024-09-12T00:04:57.339 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.339 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.339 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.339 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.339 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.339 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.339 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2739 2024-09-12T00:04:57.339 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.339 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.339 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.339 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.340 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.006819+0000", 2024-09-12T00:04:57.340 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.340 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.340 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.340 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.006819+0000", 2024-09-12T00:04:57.340 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.340 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.340 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.340 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.006821+0000", 2024-09-12T00:04:57.340 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5959999999999998e-06 2024-09-12T00:04:57.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.340 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.341 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.341 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008558+0000", 2024-09-12T00:04:57.341 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017366840000000001 2024-09-12T00:04:57.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.341 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.341 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.341 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008585+0000", 2024-09-12T00:04:57.341 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7129000000000001e-05 2024-09-12T00:04:57.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.341 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.341 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.342 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008599+0000", 2024-09-12T00:04:57.342 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.326e-05 2024-09-12T00:04:57.342 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.342 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.342 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.342 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008679+0000", 2024-09-12T00:04:57.342 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0174999999999997e-05 2024-09-12T00:04:57.342 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.342 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.342 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.342 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008800+0000", 2024-09-12T00:04:57.342 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012106499999999999 2024-09-12T00:04:57.342 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.343 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.343 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:57.343 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008921+0000", 2024-09-12T00:04:57.343 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012163900000000001 2024-09-12T00:04:57.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.343 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.343 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.343 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.015366+0000", 2024-09-12T00:04:57.343 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064442309999999999 2024-09-12T00:04:57.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.343 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.343 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.343 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.025511+0000", 2024-09-12T00:04:57.343 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010145636 2024-09-12T00:04:57.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.344 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.344 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.344 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.025555+0000", 2024-09-12T00:04:57.344 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3426000000000001e-05 2024-09-12T00:04:57.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.344 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.344 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.344 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.025588+0000", 2024-09-12T00:04:57.344 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3046999999999997e-05 2024-09-12T00:04:57.344 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.344 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.344 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.345 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.345 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.345 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2743 3.16 3:696a1d44:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.345 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.046229+0000", 2024-09-12T00:04:57.345 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.1843724120000001, 2024-09-12T00:04:57.345 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015475686000000001, 2024-09-12T00:04:57.345 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.345 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.345 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.345 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.345 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.345 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.345 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2743 2024-09-12T00:04:57.345 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.346 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.346 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.346 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.346 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.046229+0000", 2024-09-12T00:04:57.346 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.346 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.346 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.346 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.046229+0000", 2024-09-12T00:04:57.346 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.346 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.346 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.346 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.046232+0000", 2024-09-12T00:04:57.347 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.802e-06 2024-09-12T00:04:57.347 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.347 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.347 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047565+0000", 2024-09-12T00:04:57.347 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0013334670000000001 2024-09-12T00:04:57.347 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.347 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.347 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047600+0000", 2024-09-12T00:04:57.347 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4431000000000003e-05 2024-09-12T00:04:57.347 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.347 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.348 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047616+0000", 2024-09-12T00:04:57.348 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5928999999999999e-05 2024-09-12T00:04:57.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.348 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.348 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.348 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047703+0000", 2024-09-12T00:04:57.348 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7557000000000002e-05 2024-09-12T00:04:57.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.348 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.348 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.348 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047863+0000", 2024-09-12T00:04:57.348 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015991700000000001 2024-09-12T00:04:57.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.348 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.349 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:04:57.349 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047993+0000", 2024-09-12T00:04:57.349 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000129591 2024-09-12T00:04:57.349 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.349 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.349 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.349 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.058764+0000", 2024-09-12T00:04:57.349 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010770956 2024-09-12T00:04:57.350 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.350 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.350 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.350 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.061632+0000", 2024-09-12T00:04:57.350 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0028681639999999999 2024-09-12T00:04:57.350 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.350 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.350 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.350 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.061675+0000", 2024-09-12T00:04:57.350 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3288999999999998e-05 2024-09-12T00:04:57.350 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.350 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.350 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.351 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.061705+0000", 2024-09-12T00:04:57.351 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9583000000000001e-05 2024-09-12T00:04:57.351 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.351 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.351 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.351 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.351 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2744 3.20 3:0785dd58:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.351 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.057454+0000", 2024-09-12T00:04:57.351 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.1731473589999997, 2024-09-12T00:04:57.351 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018728709, 2024-09-12T00:04:57.351 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.351 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.352 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.352 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.352 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.352 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.352 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2744 2024-09-12T00:04:57.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.352 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.352 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.352 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.352 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.057454+0000", 2024-09-12T00:04:57.352 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.352 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.353 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.353 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.057454+0000", 2024-09-12T00:04:57.353 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.353 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.353 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.353 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.057457+0000", 2024-09-12T00:04:57.353 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6680000000000001e-06 2024-09-12T00:04:57.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.353 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.353 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.353 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059191+0000", 2024-09-12T00:04:57.353 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001734766 2024-09-12T00:04:57.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.354 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.354 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.354 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059216+0000", 2024-09-12T00:04:57.354 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4933e-05 2024-09-12T00:04:57.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.354 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.354 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.354 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059230+0000", 2024-09-12T00:04:57.354 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3737000000000001e-05 2024-09-12T00:04:57.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.354 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.354 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.354 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059310+0000", 2024-09-12T00:04:57.354 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0086999999999994e-05 2024-09-12T00:04:57.355 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.355 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.355 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.355 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059415+0000", 2024-09-12T00:04:57.355 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010509 2024-09-12T00:04:57.355 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.355 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.355 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:57.355 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059521+0000", 2024-09-12T00:04:57.355 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105454 2024-09-12T00:04:57.355 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.355 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.355 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.355 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.066050+0000", 2024-09-12T00:04:57.356 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0065290620000000004 2024-09-12T00:04:57.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.356 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.356 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.356 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.076044+0000", 2024-09-12T00:04:57.356 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0099942539999999993 2024-09-12T00:04:57.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.356 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.356 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.356 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.076123+0000", 2024-09-12T00:04:57.357 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8980000000000006e-05 2024-09-12T00:04:57.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.357 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.357 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.357 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.076183+0000", 2024-09-12T00:04:57.357 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9678e-05 2024-09-12T00:04:57.357 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.357 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.357 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.357 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.357 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2752 3.5 3:a07c0cce:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.358 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.145032+0000", 2024-09-12T00:04:57.358 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.0855697150000001, 2024-09-12T00:04:57.358 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017073703999999999, 2024-09-12T00:04:57.358 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.358 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.358 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.358 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.358 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.358 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.358 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2752 2024-09-12T00:04:57.358 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.358 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.358 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.358 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.359 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.145032+0000", 2024-09-12T00:04:57.359 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.359 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.145032+0000", 2024-09-12T00:04:57.359 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.359 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.145035+0000", 2024-09-12T00:04:57.360 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1810000000000001e-06 2024-09-12T00:04:57.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.360 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.360 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.360 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.146817+0000", 2024-09-12T00:04:57.360 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017823439999999999 2024-09-12T00:04:57.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.360 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.361 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.361 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.146860+0000", 2024-09-12T00:04:57.361 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2549999999999997e-05 2024-09-12T00:04:57.361 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.361 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.361 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.361 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.146880+0000", 2024-09-12T00:04:57.361 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9947000000000001e-05 2024-09-12T00:04:57.361 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.361 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.361 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.362 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.146984+0000", 2024-09-12T00:04:57.362 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104503 2024-09-12T00:04:57.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.362 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.362 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.362 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.147170+0000", 2024-09-12T00:04:57.362 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018568100000000001 2024-09-12T00:04:57.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.362 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.362 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:57.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.147326+0000", 2024-09-12T00:04:57.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000155993 2024-09-12T00:04:57.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.363 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.154513+0000", 2024-09-12T00:04:57.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071872910000000002 2024-09-12T00:04:57.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.363 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.162030+0000", 2024-09-12T00:04:57.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075170030000000004 2024-09-12T00:04:57.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.363 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.162071+0000", 2024-09-12T00:04:57.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0834999999999998e-05 2024-09-12T00:04:57.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.162105+0000", 2024-09-12T00:04:57.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4375999999999997e-05 2024-09-12T00:04:57.364 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.365 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.365 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.365 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2760 3.5 3:a26ca13d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_245:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.365 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.273495+0000", 2024-09-12T00:04:57.365 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 8.9571058370000003, 2024-09-12T00:04:57.365 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014619127000000001, 2024-09-12T00:04:57.365 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.365 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.365 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.365 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.365 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.366 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.366 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2760 2024-09-12T00:04:57.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.366 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.366 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.366 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.366 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.273495+0000", 2024-09-12T00:04:57.366 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.366 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.366 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.367 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.273495+0000", 2024-09-12T00:04:57.367 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.367 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.367 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.367 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.367 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.273499+0000", 2024-09-12T00:04:57.367 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3100000000000001e-06 2024-09-12T00:04:57.367 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.367 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.367 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.367 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275445+0000", 2024-09-12T00:04:57.367 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001946454 2024-09-12T00:04:57.367 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.368 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.368 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275468+0000", 2024-09-12T00:04:57.368 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2768999999999998e-05 2024-09-12T00:04:57.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.368 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.368 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275481+0000", 2024-09-12T00:04:57.368 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3302000000000001e-05 2024-09-12T00:04:57.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275549+0000", 2024-09-12T00:04:57.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7220999999999999e-05 2024-09-12T00:04:57.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275676+0000", 2024-09-12T00:04:57.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012752 2024-09-12T00:04:57.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:57.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275766+0000", 2024-09-12T00:04:57.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9577e-05 2024-09-12T00:04:57.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.281827+0000", 2024-09-12T00:04:57.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0060609970000000003 2024-09-12T00:04:57.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.287996+0000", 2024-09-12T00:04:57.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061689359999999999 2024-09-12T00:04:57.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.371 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.288061+0000", 2024-09-12T00:04:57.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5519999999999996e-05 2024-09-12T00:04:57.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.371 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.288115+0000", 2024-09-12T00:04:57.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3520999999999998e-05 2024-09-12T00:04:57.372 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.372 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.372 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.372 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.372 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.372 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:57.374 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:04:57.374 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:04:57.376+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:04:57.474 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:57.473+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:57.551 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:57.551 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:57.551 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:04:57.552 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:57.566 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:04:57.613 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:57.616+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:57.625 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T00:04:57.676 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:57.673+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:57.688 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:57.688 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:04:57.688 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:04:57.688 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:04:57.688 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:57.703 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:04:57.777 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:57.773+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:57.827 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:04:57.828 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:04:57.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:04:57.828 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:04:57.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.828 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4232.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-12T00:04:57.828 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:04:57.828 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 101.27877776699999, 2024-09-12T00:04:57.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.049385680000000001, 2024-09-12T00:04:57.828 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.828 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.828 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.828 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.828 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4232", 2024-09-12T00:04:57.829 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/3037249369", 2024-09-12T00:04:57.829 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:04:57.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.829 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:04:57.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:04:57.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548454+0000", 2024-09-12T00:04:57.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2259999999999999e-06 2024-09-12T00:04:57.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548466+0000", 2024-09-12T00:04:57.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1361e-05 2024-09-12T00:04:57.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548492+0000", 2024-09-12T00:04:57.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6225999999999999e-05 2024-09-12T00:04:57.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548509+0000", 2024-09-12T00:04:57.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7452000000000002e-05 2024-09-12T00:04:57.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549371+0000", 2024-09-12T00:04:57.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00086204300000000005 2024-09-12T00:04:57.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:57.832 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549396+0000", 2024-09-12T00:04:57.832 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.51e-05 2024-09-12T00:04:57.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.832 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.832 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593253+0000", 2024-09-12T00:04:57.832 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.043856248 2024-09-12T00:04:57.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.832 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.832 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593517+0000", 2024-09-12T00:04:57.832 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026439299999999997 2024-09-12T00:04:57.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:57.833 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594046+0000", 2024-09-12T00:04:57.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00052854200000000001 2024-09-12T00:04:57.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.833 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597642+0000", 2024-09-12T00:04:57.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0035959070000000002 2024-09-12T00:04:57.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.833 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597670+0000", 2024-09-12T00:04:57.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8235999999999999e-05 2024-09-12T00:04:57.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597754+0000", 2024-09-12T00:04:57.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4009000000000002e-05 2024-09-12T00:04:57.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597833+0000", 2024-09-12T00:04:57.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8937000000000007e-05 2024-09-12T00:04:57.834 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.834 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.835 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.835 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T00:04:57.835 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:04:57.835 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 88.497567998999997, 2024-09-12T00:04:57.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025928692999999999, 2024-09-12T00:04:57.835 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.835 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.835 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "reached pg", 2024-09-12T00:04:57.835 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.836 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.836 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.836 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 43 2024-09-12T00:04:57.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.836 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.836 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.836 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:04:57.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.836 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.836 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:04:57.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.837 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.837 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.837 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329660+0000", 2024-09-12T00:04:57.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.965e-06 2024-09-12T00:04:57.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.837 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.837 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329673+0000", 2024-09-12T00:04:57.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3402e-05 2024-09-12T00:04:57.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329706+0000", 2024-09-12T00:04:57.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2441000000000003e-05 2024-09-12T00:04:57.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329723+0000", 2024-09-12T00:04:57.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7609e-05 2024-09-12T00:04:57.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330437+0000", 2024-09-12T00:04:57.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00071403500000000002 2024-09-12T00:04:57.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:04:57.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330454+0000", 2024-09-12T00:04:57.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6820000000000002e-05 2024-09-12T00:04:57.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347344+0000", 2024-09-12T00:04:57.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016890275 2024-09-12T00:04:57.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:04:57.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347365+0000", 2024-09-12T00:04:57.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0350999999999999e-05 2024-09-12T00:04:57.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355323+0000", 2024-09-12T00:04:57.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079579400000000002 2024-09-12T00:04:57.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355585+0000", 2024-09-12T00:04:57.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026285499999999999 2024-09-12T00:04:57.841 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.841 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.841 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.841 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.841 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1641 3.26 e58/23 3:658fe58e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2__shadow_.hDHTDpIswwqRA2bHiHVxkhWqZde6XEj_1:head v 58'1, mlcod=0'0)", 2024-09-12T00:04:57.841 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:04:57.841 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 24.768209496000001, 2024-09-12T00:04:57.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014950144, 2024-09-12T00:04:57.841 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.841 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.841 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.841 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:04:57.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:04:57.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059017+0000", 2024-09-12T00:04:57.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.508e-06 2024-09-12T00:04:57.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.843 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.843 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061582+0000", 2024-09-12T00:04:57.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025654010000000001 2024-09-12T00:04:57.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.843 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.843 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061607+0000", 2024-09-12T00:04:57.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5028000000000002e-05 2024-09-12T00:04:57.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.844 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.844 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061619+0000", 2024-09-12T00:04:57.844 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1905999999999999e-05 2024-09-12T00:04:57.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.844 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.844 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.844 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061696+0000", 2024-09-12T00:04:57.844 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7305999999999995e-05 2024-09-12T00:04:57.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.844 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.844 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.844 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061717+0000", 2024-09-12T00:04:57.844 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0380000000000001e-05 2024-09-12T00:04:57.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.845 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.845 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.845 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073925+0000", 2024-09-12T00:04:57.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012208088000000001 2024-09-12T00:04:57.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.845 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.845 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.845 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073965+0000", 2024-09-12T00:04:57.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0527e-05 2024-09-12T00:04:57.845 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.845 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.845 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.846 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.846 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1775 3.30 3:0c2ae78d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:04:57.846 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:04:57.846 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.828372177999999, 2024-09-12T00:04:57.846 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020783729000000001, 2024-09-12T00:04:57.846 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.846 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.846 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.846 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.846 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.846 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.846 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1775 2024-09-12T00:04:57.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.846 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.847 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.847 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.847 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:04:57.847 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.847 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.847 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.847 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:04:57.847 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.847 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.847 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.847 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998856+0000", 2024-09-12T00:04:57.848 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6849999999999999e-06 2024-09-12T00:04:57.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.848 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.848 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.848 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001327+0000", 2024-09-12T00:04:57.848 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024706279999999999 2024-09-12T00:04:57.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.848 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.848 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.848 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001355+0000", 2024-09-12T00:04:57.848 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8419999999999999e-05 2024-09-12T00:04:57.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.848 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.848 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.849 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001366+0000", 2024-09-12T00:04:57.849 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1073999999999999e-05 2024-09-12T00:04:57.849 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.849 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.849 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.849 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001438+0000", 2024-09-12T00:04:57.849 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1389000000000004e-05 2024-09-12T00:04:57.849 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.849 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.849 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.849 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001548+0000", 2024-09-12T00:04:57.849 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110612 2024-09-12T00:04:57.849 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.849 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.850 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:57.850 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001639+0000", 2024-09-12T00:04:57.850 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0192999999999995e-05 2024-09-12T00:04:57.850 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.850 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.850 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.850 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019057+0000", 2024-09-12T00:04:57.850 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017418411000000002 2024-09-12T00:04:57.850 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.850 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.850 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.850 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019528+0000", 2024-09-12T00:04:57.850 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00047075699999999998 2024-09-12T00:04:57.850 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.851 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.851 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.851 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019577+0000", 2024-09-12T00:04:57.851 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8714999999999997e-05 2024-09-12T00:04:57.851 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.851 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.851 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.851 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019636+0000", 2024-09-12T00:04:57.851 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9845e-05 2024-09-12T00:04:57.851 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.851 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.851 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.851 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.852 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.852 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1780 3.16 e58/23 3:69d8ee52:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3_10Mb.:head v 58'1, mlcod=0'0)", 2024-09-12T00:04:57.852 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:04:57.852 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.802078886, 2024-09-12T00:04:57.852 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01408911, 2024-09-12T00:04:57.852 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.852 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.852 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.852 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.852 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.852 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.852 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:04:57.852 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.852 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.853 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.853 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.853 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:04:57.853 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.853 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.853 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.853 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.853 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025148+0000", 2024-09-12T00:04:57.853 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4229999999999999e-06 2024-09-12T00:04:57.853 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.853 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.853 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.853 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026337+0000", 2024-09-12T00:04:57.853 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011890589999999999 2024-09-12T00:04:57.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.854 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.854 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.854 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026362+0000", 2024-09-12T00:04:57.854 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4566000000000002e-05 2024-09-12T00:04:57.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.854 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.854 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.854 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026372+0000", 2024-09-12T00:04:57.854 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8509999999999994e-06 2024-09-12T00:04:57.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.854 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.854 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.854 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026448+0000", 2024-09-12T00:04:57.854 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6626999999999997e-05 2024-09-12T00:04:57.855 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.855 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.855 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.855 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026473+0000", 2024-09-12T00:04:57.855 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4647e-05 2024-09-12T00:04:57.855 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.855 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.855 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.855 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039120+0000", 2024-09-12T00:04:57.855 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012647122 2024-09-12T00:04:57.855 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.855 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.855 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.855 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039235+0000", 2024-09-12T00:04:57.856 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000114815 2024-09-12T00:04:57.856 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.856 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.856 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.856 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.856 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.856 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2648 3.13 3:c936a360:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.856 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.164782+0000", 2024-09-12T00:04:57.856 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.662442599, 2024-09-12T00:04:57.856 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019628063000000001, 2024-09-12T00:04:57.856 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.856 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.856 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.857 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.857 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.857 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.857 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2648 2024-09-12T00:04:57.857 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.857 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.857 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.857 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.857 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.164782+0000", 2024-09-12T00:04:57.857 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.857 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.857 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.857 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.858 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.164782+0000", 2024-09-12T00:04:57.858 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.858 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.858 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.164786+0000", 2024-09-12T00:04:57.858 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3450000000000002e-06 2024-09-12T00:04:57.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.858 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.858 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166758+0000", 2024-09-12T00:04:57.858 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019721629999999999 2024-09-12T00:04:57.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.859 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.859 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166785+0000", 2024-09-12T00:04:57.859 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7676000000000001e-05 2024-09-12T00:04:57.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.859 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.859 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166799+0000", 2024-09-12T00:04:57.859 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3716e-05 2024-09-12T00:04:57.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.859 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.859 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166895+0000", 2024-09-12T00:04:57.859 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6243999999999995e-05 2024-09-12T00:04:57.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.860 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.860 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.860 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.167092+0000", 2024-09-12T00:04:57.860 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019639200000000001 2024-09-12T00:04:57.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.860 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.860 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:57.860 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.167273+0000", 2024-09-12T00:04:57.860 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000181533 2024-09-12T00:04:57.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.860 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.860 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.860 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.174331+0000", 2024-09-12T00:04:57.860 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0070577879999999997 2024-09-12T00:04:57.861 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.861 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.861 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.861 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.184172+0000", 2024-09-12T00:04:57.861 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0098409469999999992 2024-09-12T00:04:57.861 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.861 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.861 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.861 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.184238+0000", 2024-09-12T00:04:57.861 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6036000000000003e-05 2024-09-12T00:04:57.861 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.861 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.861 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.862 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.184410+0000", 2024-09-12T00:04:57.862 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017222299999999999 2024-09-12T00:04:57.862 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.862 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.862 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.862 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.862 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.862 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2659 3.2d 3:b4a71344:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.862 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.285246+0000", 2024-09-12T00:04:57.862 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.541978695999999, 2024-09-12T00:04:57.862 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020000217000000001, 2024-09-12T00:04:57.862 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.862 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.863 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.863 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.863 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.863 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.863 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2659 2024-09-12T00:04:57.863 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.863 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.863 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.863 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.863 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.285246+0000", 2024-09-12T00:04:57.863 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.863 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.863 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.863 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.864 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.285246+0000", 2024-09-12T00:04:57.864 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.864 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.864 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.864 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.285249+0000", 2024-09-12T00:04:57.864 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3890000000000001e-06 2024-09-12T00:04:57.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.864 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.864 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.864 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287047+0000", 2024-09-12T00:04:57.864 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017978099999999999 2024-09-12T00:04:57.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287084+0000", 2024-09-12T00:04:57.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6358e-05 2024-09-12T00:04:57.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287101+0000", 2024-09-12T00:04:57.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7815000000000001e-05 2024-09-12T00:04:57.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287198+0000", 2024-09-12T00:04:57.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6482000000000002e-05 2024-09-12T00:04:57.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.866 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287337+0000", 2024-09-12T00:04:57.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013917500000000001 2024-09-12T00:04:57.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:57.866 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287451+0000", 2024-09-12T00:04:57.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000113962 2024-09-12T00:04:57.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.867 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.293889+0000", 2024-09-12T00:04:57.867 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064380110000000004 2024-09-12T00:04:57.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.867 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.867 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.867 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.305119+0000", 2024-09-12T00:04:57.867 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011229872 2024-09-12T00:04:57.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.867 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.867 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.867 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.305191+0000", 2024-09-12T00:04:57.867 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2002000000000006e-05 2024-09-12T00:04:57.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.867 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.868 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.868 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.305246+0000", 2024-09-12T00:04:57.868 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5340999999999998e-05 2024-09-12T00:04:57.868 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.868 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.868 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.868 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.868 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.868 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2662 3.28 3:1791a19e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.868 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.317519+0000", 2024-09-12T00:04:57.868 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.509705748, 2024-09-12T00:04:57.868 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016495961999999999, 2024-09-12T00:04:57.868 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.869 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.869 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.869 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.869 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.869 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.869 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2662 2024-09-12T00:04:57.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.869 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.869 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.869 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.869 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317519+0000", 2024-09-12T00:04:57.869 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.869 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.870 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.870 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317519+0000", 2024-09-12T00:04:57.870 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.870 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.870 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.870 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317522+0000", 2024-09-12T00:04:57.870 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7389999999999999e-06 2024-09-12T00:04:57.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.870 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.870 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.870 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319683+0000", 2024-09-12T00:04:57.870 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021614970000000001 2024-09-12T00:04:57.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.871 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.871 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.871 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319715+0000", 2024-09-12T00:04:57.871 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1574e-05 2024-09-12T00:04:57.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.871 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.871 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.871 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319730+0000", 2024-09-12T00:04:57.871 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5543e-05 2024-09-12T00:04:57.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.871 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.871 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.871 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319820+0000", 2024-09-12T00:04:57.872 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9402999999999998e-05 2024-09-12T00:04:57.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.872 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.872 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319976+0000", 2024-09-12T00:04:57.872 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015662900000000001 2024-09-12T00:04:57.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.872 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:04:57.872 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.320143+0000", 2024-09-12T00:04:57.872 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000166207 2024-09-12T00:04:57.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.873 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.873 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.873 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.327504+0000", 2024-09-12T00:04:57.873 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0073616189999999998 2024-09-12T00:04:57.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.873 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.873 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.873 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.333886+0000", 2024-09-12T00:04:57.873 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063817650000000002 2024-09-12T00:04:57.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.873 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.873 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.873 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.333952+0000", 2024-09-12T00:04:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5889999999999994e-05 2024-09-12T00:04:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.334015+0000", 2024-09-12T00:04:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3095999999999994e-05 2024-09-12T00:04:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2664 3.1d 3:b8bd1b2d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.341755+0000", 2024-09-12T00:04:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.485469891999999, 2024-09-12T00:04:57.875 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017365477000000001, 2024-09-12T00:04:57.875 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.875 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.875 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.875 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.875 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.875 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.875 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2664 2024-09-12T00:04:57.875 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.875 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.875 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.875 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.875 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.341755+0000", 2024-09-12T00:04:57.875 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.876 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.876 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.341755+0000", 2024-09-12T00:04:57.876 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.876 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.876 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.341758+0000", 2024-09-12T00:04:57.876 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6560000000000001e-06 2024-09-12T00:04:57.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.876 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.877 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343741+0000", 2024-09-12T00:04:57.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019832389999999999 2024-09-12T00:04:57.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.877 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.877 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.877 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343766+0000", 2024-09-12T00:04:57.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4967e-05 2024-09-12T00:04:57.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.877 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.877 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.877 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343776+0000", 2024-09-12T00:04:57.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0686000000000001e-05 2024-09-12T00:04:57.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.877 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.878 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.878 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343854+0000", 2024-09-12T00:04:57.878 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7210000000000001e-05 2024-09-12T00:04:57.878 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.878 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.878 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.878 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.344027+0000", 2024-09-12T00:04:57.878 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000173065 2024-09-12T00:04:57.878 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.878 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.878 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:57.878 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.344194+0000", 2024-09-12T00:04:57.878 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016688900000000001 2024-09-12T00:04:57.879 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.879 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.879 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.879 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.358530+0000", 2024-09-12T00:04:57.879 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014336877 2024-09-12T00:04:57.879 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.879 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.879 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.879 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.359009+0000", 2024-09-12T00:04:57.879 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00047882099999999999 2024-09-12T00:04:57.880 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.880 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.880 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.880 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.359069+0000", 2024-09-12T00:04:57.880 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9892999999999997e-05 2024-09-12T00:04:57.880 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.880 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.880 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.880 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.359120+0000", 2024-09-12T00:04:57.880 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1174000000000002e-05 2024-09-12T00:04:57.880 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.880 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.881 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.881 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.881 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.881 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2666 3.13 3:cbd43ea3:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.881 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.362905+0000", 2024-09-12T00:04:57.881 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.464319509999999, 2024-09-12T00:04:57.881 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017815950000000001, 2024-09-12T00:04:57.881 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.881 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.881 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.881 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.881 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.881 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.881 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2666 2024-09-12T00:04:57.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.882 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.882 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.882 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.882 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.362905+0000", 2024-09-12T00:04:57.882 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.882 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.882 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.882 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.362905+0000", 2024-09-12T00:04:57.882 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.882 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.882 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.883 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.362909+0000", 2024-09-12T00:04:57.883 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4529999999999998e-06 2024-09-12T00:04:57.883 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.883 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.883 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.883 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364466+0000", 2024-09-12T00:04:57.883 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015570060000000001 2024-09-12T00:04:57.883 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.883 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.883 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.883 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364500+0000", 2024-09-12T00:04:57.883 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4289999999999999e-05 2024-09-12T00:04:57.883 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.884 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.884 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.884 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364515+0000", 2024-09-12T00:04:57.884 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4537e-05 2024-09-12T00:04:57.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.884 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.884 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.884 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364615+0000", 2024-09-12T00:04:57.884 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100782 2024-09-12T00:04:57.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.884 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.884 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.884 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364805+0000", 2024-09-12T00:04:57.885 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018921399999999999 2024-09-12T00:04:57.885 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.885 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.885 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:57.885 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364984+0000", 2024-09-12T00:04:57.885 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017972299999999999 2024-09-12T00:04:57.885 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.885 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.885 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.885 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.372042+0000", 2024-09-12T00:04:57.885 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0070581120000000001 2024-09-12T00:04:57.885 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.885 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.885 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.886 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.380620+0000", 2024-09-12T00:04:57.886 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085774309999999999 2024-09-12T00:04:57.886 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.886 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.886 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.886 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.380666+0000", 2024-09-12T00:04:57.886 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5881000000000003e-05 2024-09-12T00:04:57.886 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.886 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.886 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.886 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.380721+0000", 2024-09-12T00:04:57.886 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5520999999999999e-05 2024-09-12T00:04:57.886 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.886 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.887 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.887 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.887 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.887 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2677 3.13 3:c9d59693:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.887 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.474053+0000", 2024-09-12T00:04:57.887 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.353172163, 2024-09-12T00:04:57.887 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017985961000000002, 2024-09-12T00:04:57.887 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.887 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.887 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.887 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.887 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.887 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.887 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2677 2024-09-12T00:04:57.888 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.888 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.888 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.888 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.888 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.474053+0000", 2024-09-12T00:04:57.888 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.888 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.888 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.888 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.888 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.474053+0000", 2024-09-12T00:04:57.888 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.888 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.888 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.889 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.889 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.474055+0000", 2024-09-12T00:04:57.889 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.711e-06 2024-09-12T00:04:57.889 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.889 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.889 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.889 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475342+0000", 2024-09-12T00:04:57.889 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001286508 2024-09-12T00:04:57.889 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.889 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.889 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.889 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475373+0000", 2024-09-12T00:04:57.889 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1130000000000002e-05 2024-09-12T00:04:57.889 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.890 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.890 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.890 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475387+0000", 2024-09-12T00:04:57.890 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4280999999999999e-05 2024-09-12T00:04:57.890 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.890 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.890 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.890 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475476+0000", 2024-09-12T00:04:57.890 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8621000000000004e-05 2024-09-12T00:04:57.890 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.890 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.890 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.890 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475644+0000", 2024-09-12T00:04:57.891 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016785699999999999 2024-09-12T00:04:57.891 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.891 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.891 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:57.891 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475742+0000", 2024-09-12T00:04:57.891 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8016000000000005e-05 2024-09-12T00:04:57.891 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.891 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.891 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.891 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.480305+0000", 2024-09-12T00:04:57.891 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045629049999999999 2024-09-12T00:04:57.891 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.892 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.892 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.892 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.491948+0000", 2024-09-12T00:04:57.892 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011643280000000001 2024-09-12T00:04:57.892 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.892 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.892 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.892 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.492000+0000", 2024-09-12T00:04:57.892 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2482000000000003e-05 2024-09-12T00:04:57.892 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.892 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.892 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.893 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.492039+0000", 2024-09-12T00:04:57.893 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8170000000000002e-05 2024-09-12T00:04:57.893 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.893 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.893 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.893 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.893 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.893 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2691 3.2d 3:b4a2284d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.893 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.515274+0000", 2024-09-12T00:04:57.893 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.311951107000001, 2024-09-12T00:04:57.893 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018577757, 2024-09-12T00:04:57.893 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.893 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.894 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.894 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.894 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.894 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.894 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2691 2024-09-12T00:04:57.894 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.894 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.894 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.894 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.894 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.515274+0000", 2024-09-12T00:04:57.894 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.894 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.894 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.894 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.895 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.515274+0000", 2024-09-12T00:04:57.895 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.895 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.895 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.895 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.895 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.515276+0000", 2024-09-12T00:04:57.895 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3499999999999999e-06 2024-09-12T00:04:57.895 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.895 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.895 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.895 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.516900+0000", 2024-09-12T00:04:57.895 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001623633 2024-09-12T00:04:57.895 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.895 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.896 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.896 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.516929+0000", 2024-09-12T00:04:57.896 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9009999999999998e-05 2024-09-12T00:04:57.896 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.896 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.896 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.896 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.516942+0000", 2024-09-12T00:04:57.896 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3551e-05 2024-09-12T00:04:57.896 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.896 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.896 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.896 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.517022+0000", 2024-09-12T00:04:57.896 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0167999999999995e-05 2024-09-12T00:04:57.896 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.897 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.897 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.897 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.517216+0000", 2024-09-12T00:04:57.897 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000193919 2024-09-12T00:04:57.897 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.897 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.897 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:57.897 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.517380+0000", 2024-09-12T00:04:57.897 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016336000000000001 2024-09-12T00:04:57.897 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.897 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.897 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.897 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.522907+0000", 2024-09-12T00:04:57.897 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055276420000000001 2024-09-12T00:04:57.898 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.898 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.898 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.898 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.533735+0000", 2024-09-12T00:04:57.898 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010827997000000001 2024-09-12T00:04:57.898 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.898 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.898 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.898 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.533800+0000", 2024-09-12T00:04:57.898 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4738000000000003e-05 2024-09-12T00:04:57.898 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.898 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.898 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.899 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.533851+0000", 2024-09-12T00:04:57.899 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1388999999999999e-05 2024-09-12T00:04:57.899 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.899 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.899 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.899 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.899 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.899 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2697 3.13 3:c87ccb22:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.899 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.577849+0000", 2024-09-12T00:04:57.899 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.249375787, 2024-09-12T00:04:57.899 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019139156000000001, 2024-09-12T00:04:57.899 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.899 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.899 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.900 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.900 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.900 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.900 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2697 2024-09-12T00:04:57.900 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.900 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.900 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.900 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.900 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577849+0000", 2024-09-12T00:04:57.900 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.900 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.900 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.900 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.901 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577849+0000", 2024-09-12T00:04:57.901 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.901 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.901 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.901 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.901 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577853+0000", 2024-09-12T00:04:57.901 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7510000000000002e-06 2024-09-12T00:04:57.901 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.901 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.901 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.901 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579595+0000", 2024-09-12T00:04:57.901 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001741954 2024-09-12T00:04:57.901 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.901 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.902 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.902 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579625+0000", 2024-09-12T00:04:57.902 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9907999999999999e-05 2024-09-12T00:04:57.902 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.902 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.902 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.902 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579640+0000", 2024-09-12T00:04:57.902 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4894e-05 2024-09-12T00:04:57.902 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.902 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.902 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.902 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579728+0000", 2024-09-12T00:04:57.902 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8704999999999999e-05 2024-09-12T00:04:57.903 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.903 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.903 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.903 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579922+0000", 2024-09-12T00:04:57.903 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000194019 2024-09-12T00:04:57.903 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.903 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.903 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:57.903 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.580092+0000", 2024-09-12T00:04:57.903 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016984300000000001 2024-09-12T00:04:57.903 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.903 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.903 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.903 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.591944+0000", 2024-09-12T00:04:57.904 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011852252000000001 2024-09-12T00:04:57.904 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.904 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.904 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.904 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.596913+0000", 2024-09-12T00:04:57.904 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049688279999999998 2024-09-12T00:04:57.904 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.904 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.904 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.904 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.596955+0000", 2024-09-12T00:04:57.904 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2290999999999999e-05 2024-09-12T00:04:57.904 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.904 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.904 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.905 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.596988+0000", 2024-09-12T00:04:57.905 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2710999999999999e-05 2024-09-12T00:04:57.905 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.905 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.905 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.905 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.905 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.905 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2701 3.11 3:8babcc8d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.905 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.617191+0000", 2024-09-12T00:04:57.905 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.210034174, 2024-09-12T00:04:57.905 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013760204999999999, 2024-09-12T00:04:57.905 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.905 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.906 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.906 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.906 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.906 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.906 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2701 2024-09-12T00:04:57.906 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.906 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.906 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.906 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.906 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.617191+0000", 2024-09-12T00:04:57.906 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.906 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.906 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.906 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.907 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.617191+0000", 2024-09-12T00:04:57.907 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.907 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.907 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.907 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.907 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.617194+0000", 2024-09-12T00:04:57.907 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.788e-06 2024-09-12T00:04:57.907 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.907 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.907 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.907 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618652+0000", 2024-09-12T00:04:57.907 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001457716 2024-09-12T00:04:57.907 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.907 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.908 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.908 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618682+0000", 2024-09-12T00:04:57.908 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9668000000000001e-05 2024-09-12T00:04:57.908 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.908 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.908 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.908 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618692+0000", 2024-09-12T00:04:57.908 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0429e-05 2024-09-12T00:04:57.908 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.908 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.908 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.908 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618766+0000", 2024-09-12T00:04:57.908 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4190999999999995e-05 2024-09-12T00:04:57.908 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.909 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.909 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.909 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618932+0000", 2024-09-12T00:04:57.909 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000165923 2024-09-12T00:04:57.909 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.909 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.909 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:57.909 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.619026+0000", 2024-09-12T00:04:57.909 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3906999999999994e-05 2024-09-12T00:04:57.909 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.909 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.909 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.909 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.623168+0000", 2024-09-12T00:04:57.909 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041419309999999997 2024-09-12T00:04:57.910 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.910 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.910 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.910 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.630815+0000", 2024-09-12T00:04:57.910 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0076470100000000001 2024-09-12T00:04:57.910 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.910 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.910 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.910 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.630887+0000", 2024-09-12T00:04:57.910 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2218999999999994e-05 2024-09-12T00:04:57.910 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.910 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.910 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.910 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.630951+0000", 2024-09-12T00:04:57.911 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3423000000000006e-05 2024-09-12T00:04:57.911 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.911 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.911 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.911 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.911 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.911 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2704 3.13 3:c90afc39:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.911 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.647542+0000", 2024-09-12T00:04:57.911 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.179682311000001, 2024-09-12T00:04:57.911 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017595339000000002, 2024-09-12T00:04:57.911 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.911 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.911 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.911 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.912 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.912 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.912 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2704 2024-09-12T00:04:57.912 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.912 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.912 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.912 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.912 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.647542+0000", 2024-09-12T00:04:57.912 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.912 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.912 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.912 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.912 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.647542+0000", 2024-09-12T00:04:57.912 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.913 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.913 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.913 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.913 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.647544+0000", 2024-09-12T00:04:57.913 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6339999999999999e-06 2024-09-12T00:04:57.913 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.913 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.913 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.913 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649032+0000", 2024-09-12T00:04:57.913 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001488063 2024-09-12T00:04:57.913 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.913 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.913 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.914 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649053+0000", 2024-09-12T00:04:57.914 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0761e-05 2024-09-12T00:04:57.914 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.914 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.914 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.914 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649066+0000", 2024-09-12T00:04:57.914 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2597e-05 2024-09-12T00:04:57.914 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.914 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.914 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.914 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649142+0000", 2024-09-12T00:04:57.914 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6254999999999994e-05 2024-09-12T00:04:57.914 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.914 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.915 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.915 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649250+0000", 2024-09-12T00:04:57.915 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010774500000000001 2024-09-12T00:04:57.915 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.915 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.915 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:57.915 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649364+0000", 2024-09-12T00:04:57.915 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000114401 2024-09-12T00:04:57.915 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.915 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.915 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.915 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.658970+0000", 2024-09-12T00:04:57.915 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0096065260000000006 2024-09-12T00:04:57.916 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.916 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.916 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.916 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.665022+0000", 2024-09-12T00:04:57.916 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0060516459999999999 2024-09-12T00:04:57.916 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.916 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.916 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.916 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.665086+0000", 2024-09-12T00:04:57.916 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3940000000000001e-05 2024-09-12T00:04:57.916 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.916 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.916 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.916 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.665138+0000", 2024-09-12T00:04:57.917 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1771000000000003e-05 2024-09-12T00:04:57.917 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.917 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.917 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.917 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.917 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.917 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2706 3.d 3:b1b5d8c6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.917 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.667263+0000", 2024-09-12T00:04:57.917 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.159961357, 2024-09-12T00:04:57.917 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017030099999999999, 2024-09-12T00:04:57.917 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.917 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.917 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.918 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.918 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.918 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.918 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2706 2024-09-12T00:04:57.918 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.918 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.918 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.918 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.918 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.667263+0000", 2024-09-12T00:04:57.918 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.918 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.918 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.918 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.918 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.667263+0000", 2024-09-12T00:04:57.919 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.919 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.919 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.919 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.919 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.667267+0000", 2024-09-12T00:04:57.919 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1540000000000002e-06 2024-09-12T00:04:57.919 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.919 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.919 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.919 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672789+0000", 2024-09-12T00:04:57.919 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055222819999999999 2024-09-12T00:04:57.919 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.919 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.919 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.920 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672817+0000", 2024-09-12T00:04:57.920 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8510999999999999e-05 2024-09-12T00:04:57.920 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.920 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.920 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.920 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672831+0000", 2024-09-12T00:04:57.920 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3919e-05 2024-09-12T00:04:57.920 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.920 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.920 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.920 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672988+0000", 2024-09-12T00:04:57.920 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015688 2024-09-12T00:04:57.920 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.920 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.921 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.921 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.673174+0000", 2024-09-12T00:04:57.921 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018615400000000001 2024-09-12T00:04:57.921 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.921 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.921 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:04:57.921 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.673352+0000", 2024-09-12T00:04:57.921 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017803599999999999 2024-09-12T00:04:57.921 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.921 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.921 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.921 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.683897+0000", 2024-09-12T00:04:57.921 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010544239 2024-09-12T00:04:57.921 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.922 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.922 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.922 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.684176+0000", 2024-09-12T00:04:57.922 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000279506 2024-09-12T00:04:57.922 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.922 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.922 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.922 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.684235+0000", 2024-09-12T00:04:57.922 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9101000000000002e-05 2024-09-12T00:04:57.922 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.922 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.922 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.922 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.684294+0000", 2024-09-12T00:04:57.922 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8318e-05 2024-09-12T00:04:57.923 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.923 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.923 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.923 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.923 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.923 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2714 3.17 e63/23 3:eac65a57:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_199:head v 63'3, mlcod=62'1)", 2024-09-12T00:04:57.923 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.752259+0000", 2024-09-12T00:04:57.923 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.074965822999999, 2024-09-12T00:04:57.923 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013747212, 2024-09-12T00:04:57.923 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.923 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.923 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.923 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.923 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.924 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.924 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.752259+0000", 2024-09-12T00:04:57.924 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.924 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.924 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.924 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.924 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.752259+0000", 2024-09-12T00:04:57.924 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.924 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.924 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.924 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.924 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.752261+0000", 2024-09-12T00:04:57.924 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2390000000000001e-06 2024-09-12T00:04:57.924 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.925 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.925 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.925 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757723+0000", 2024-09-12T00:04:57.925 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054619569999999999 2024-09-12T00:04:57.925 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.925 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.925 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.925 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757749+0000", 2024-09-12T00:04:57.925 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5732999999999999e-05 2024-09-12T00:04:57.925 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.925 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.925 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.925 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757762+0000", 2024-09-12T00:04:57.925 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3556e-05 2024-09-12T00:04:57.926 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.926 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.926 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.926 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757841+0000", 2024-09-12T00:04:57.926 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8644000000000001e-05 2024-09-12T00:04:57.926 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.926 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.926 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.926 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757864+0000", 2024-09-12T00:04:57.926 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3112000000000002e-05 2024-09-12T00:04:57.926 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.926 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.926 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.926 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.765956+0000", 2024-09-12T00:04:57.927 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080919679999999997 2024-09-12T00:04:57.927 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.927 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.927 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.927 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766006+0000", 2024-09-12T00:04:57.927 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0003000000000002e-05 2024-09-12T00:04:57.927 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.927 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.927 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.927 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.927 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.927 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2742 3.1d 3:b8ae26ad:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.927 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.035857+0000", 2024-09-12T00:04:57.928 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.7913681409999995, 2024-09-12T00:04:57.928 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025139262999999998, 2024-09-12T00:04:57.928 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.928 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.928 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.928 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.928 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.928 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.928 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2742 2024-09-12T00:04:57.928 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.928 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.928 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.928 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.928 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.035857+0000", 2024-09-12T00:04:57.929 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.929 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.929 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.929 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.929 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.035857+0000", 2024-09-12T00:04:57.929 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.929 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.929 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.929 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.929 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.035859+0000", 2024-09-12T00:04:57.929 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0899999999999999e-06 2024-09-12T00:04:57.929 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.929 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.930 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.930 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038486+0000", 2024-09-12T00:04:57.930 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026273749999999999 2024-09-12T00:04:57.930 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.930 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.930 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.930 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038511+0000", 2024-09-12T00:04:57.930 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5327e-05 2024-09-12T00:04:57.930 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.930 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.930 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.930 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038527+0000", 2024-09-12T00:04:57.930 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5196e-05 2024-09-12T00:04:57.930 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.931 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.931 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.931 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038604+0000", 2024-09-12T00:04:57.931 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6921000000000004e-05 2024-09-12T00:04:57.931 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.931 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.931 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.931 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038789+0000", 2024-09-12T00:04:57.931 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018526400000000001 2024-09-12T00:04:57.931 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.931 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.931 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:57.931 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.039001+0000", 2024-09-12T00:04:57.931 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021200400000000001 2024-09-12T00:04:57.931 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.932 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.932 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.932 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.056879+0000", 2024-09-12T00:04:57.932 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017877783000000001 2024-09-12T00:04:57.932 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.932 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.932 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.932 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.060872+0000", 2024-09-12T00:04:57.932 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039929529999999996 2024-09-12T00:04:57.932 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.932 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.932 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.932 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.060942+0000", 2024-09-12T00:04:57.933 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0060000000000003e-05 2024-09-12T00:04:57.933 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.933 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.933 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.933 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.060996+0000", 2024-09-12T00:04:57.933 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4289999999999997e-05 2024-09-12T00:04:57.933 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.933 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.933 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.933 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.933 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.933 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2747 3.17 e63/23 3:eaa4528d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_232:head v 63'5, mlcod=63'3)", 2024-09-12T00:04:57.933 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.094555+0000", 2024-09-12T00:04:57.933 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.7326693140000007, 2024-09-12T00:04:57.934 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017679139, 2024-09-12T00:04:57.934 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.934 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.934 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.934 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.934 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.934 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.934 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.094555+0000", 2024-09-12T00:04:57.934 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.934 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.934 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.934 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.934 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.094555+0000", 2024-09-12T00:04:57.934 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.935 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.935 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.935 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.935 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.094558+0000", 2024-09-12T00:04:57.935 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.232e-06 2024-09-12T00:04:57.935 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.935 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.935 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.935 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098897+0000", 2024-09-12T00:04:57.935 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0043397840000000002 2024-09-12T00:04:57.935 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.935 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.935 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.935 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098930+0000", 2024-09-12T00:04:57.936 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2592000000000002e-05 2024-09-12T00:04:57.936 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.936 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.936 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.936 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098945+0000", 2024-09-12T00:04:57.936 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4759e-05 2024-09-12T00:04:57.936 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.936 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.936 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.936 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.099033+0000", 2024-09-12T00:04:57.936 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8535000000000005e-05 2024-09-12T00:04:57.936 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.936 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.936 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.937 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.099065+0000", 2024-09-12T00:04:57.937 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1825000000000001e-05 2024-09-12T00:04:57.937 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.937 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.937 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.937 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112134+0000", 2024-09-12T00:04:57.937 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013068329 2024-09-12T00:04:57.937 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.937 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.937 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.938 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112235+0000", 2024-09-12T00:04:57.938 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010108299999999999 2024-09-12T00:04:57.938 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.938 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.938 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.938 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.938 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.938 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2764 3.2d 3:b7a0f55d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_249:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:57.938 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.325396+0000", 2024-09-12T00:04:57.938 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.5018283659999998, 2024-09-12T00:04:57.938 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022487040999999999, 2024-09-12T00:04:57.938 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:04:57.938 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:04:57.938 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:57.939 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:04:57.939 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:04:57.939 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:57.939 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2764 2024-09-12T00:04:57.939 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.939 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:04:57.939 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.939 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:04:57.939 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.325396+0000", 2024-09-12T00:04:57.939 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.939 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.939 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.939 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:04:57.940 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.325396+0000", 2024-09-12T00:04:57.940 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:04:57.940 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.940 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.940 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:04:57.940 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.325400+0000", 2024-09-12T00:04:57.940 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2370000000000001e-06 2024-09-12T00:04:57.940 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.940 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.940 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:04:57.940 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328424+0000", 2024-09-12T00:04:57.940 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003024657 2024-09-12T00:04:57.940 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.940 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.941 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:04:57.941 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328456+0000", 2024-09-12T00:04:57.941 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1819999999999997e-05 2024-09-12T00:04:57.941 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.941 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.941 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:04:57.941 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328476+0000", 2024-09-12T00:04:57.941 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9673999999999998e-05 2024-09-12T00:04:57.941 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.941 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.941 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:04:57.941 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328567+0000", 2024-09-12T00:04:57.941 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1640999999999999e-05 2024-09-12T00:04:57.941 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.942 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.942 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:04:57.942 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328734+0000", 2024-09-12T00:04:57.942 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016619200000000001 2024-09-12T00:04:57.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.942 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.942 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:04:57.942 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328910+0000", 2024-09-12T00:04:57.942 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017652299999999999 2024-09-12T00:04:57.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.942 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.942 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:04:57.942 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.333757+0000", 2024-09-12T00:04:57.942 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048465060000000004 2024-09-12T00:04:57.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.943 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.943 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:57.943 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.347806+0000", 2024-09-12T00:04:57.943 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01404908 2024-09-12T00:04:57.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.943 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.943 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:04:57.943 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.347847+0000", 2024-09-12T00:04:57.943 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1396999999999997e-05 2024-09-12T00:04:57.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:04:57.943 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:04:57.943 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:04:57.943 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.347883+0000", 2024-09-12T00:04:57.943 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6313999999999998e-05 2024-09-12T00:04:57.944 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.944 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.944 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.944 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:04:57.944 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:04:57.944 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:04:57.945 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:04:57.946 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:57.948+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:58.046 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:58.048+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:58.076 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:58.076 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:04:58.076 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:04:58.076 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:58.090 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:04:58.148 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:04:58.148+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:04:58.208 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:58.209 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:04:58.209 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:04:58.209 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:04:58.209 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:58.224 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:04:58.249 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:58.252+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:58.350 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:58.352+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:58.352 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:58.353 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:04:58.353 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:04:58.353 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:04:58.353 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.353 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2657 3.3c e63/23 3:3e583291:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_152:head v 63'4, mlcod=62'2)", 2024-09-12T00:04:58.353 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:04:58.353 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.085147288, 2024-09-12T00:04:58.353 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017073642999999999, 2024-09-12T00:04:58.353 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:58.353 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:58.353 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:58.354 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:58.354 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.354 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:58.354 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:04:58.354 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.354 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.354 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.354 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:58.354 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:04:58.354 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.354 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.354 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.354 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:58.355 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266877+0000", 2024-09-12T00:04:58.355 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3630000000000001e-06 2024-09-12T00:04:58.355 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.355 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.355 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:58.355 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271243+0000", 2024-09-12T00:04:58.355 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043659730000000004 2024-09-12T00:04:58.355 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.355 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.355 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:58.355 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271279+0000", 2024-09-12T00:04:58.355 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6334999999999997e-05 2024-09-12T00:04:58.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.356 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.356 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:58.356 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271296+0000", 2024-09-12T00:04:58.356 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6619000000000001e-05 2024-09-12T00:04:58.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.356 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.356 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:58.356 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271429+0000", 2024-09-12T00:04:58.356 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133132 2024-09-12T00:04:58.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.356 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.357 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:58.357 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271468+0000", 2024-09-12T00:04:58.357 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8483999999999999e-05 2024-09-12T00:04:58.357 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.357 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.357 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:58.357 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.283854+0000", 2024-09-12T00:04:58.357 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012386645999999999 2024-09-12T00:04:58.357 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.357 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.357 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:58.357 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.283948+0000", 2024-09-12T00:04:58.357 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4091000000000004e-05 2024-09-12T00:04:58.358 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.358 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:58.358 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.358 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.358 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.358 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2658 3.3a e63/23 3:5ec14981:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_153:head v 63'1, mlcod=0'0)", 2024-09-12T00:04:58.358 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.276052+0000", 2024-09-12T00:04:58.358 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.075970398000001, 2024-09-12T00:04:58.358 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015387336999999999, 2024-09-12T00:04:58.358 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:58.358 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:58.358 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:58.358 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:58.359 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.359 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:58.359 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.276052+0000", 2024-09-12T00:04:58.359 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.359 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.359 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.359 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:58.359 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.276052+0000", 2024-09-12T00:04:58.359 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.359 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.359 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.359 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:58.359 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.276054+0000", 2024-09-12T00:04:58.360 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3199999999999998e-06 2024-09-12T00:04:58.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.360 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.360 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:58.360 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282165+0000", 2024-09-12T00:04:58.360 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061108359999999997 2024-09-12T00:04:58.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.360 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.360 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:58.360 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282192+0000", 2024-09-12T00:04:58.360 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7008999999999998e-05 2024-09-12T00:04:58.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.360 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.361 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:58.361 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282206+0000", 2024-09-12T00:04:58.361 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4705999999999999e-05 2024-09-12T00:04:58.361 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.361 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.361 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:58.361 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282387+0000", 2024-09-12T00:04:58.361 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018015199999999999 2024-09-12T00:04:58.361 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.361 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.361 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:58.361 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282426+0000", 2024-09-12T00:04:58.361 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9323999999999998e-05 2024-09-12T00:04:58.362 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.362 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.362 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:58.362 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291241+0000", 2024-09-12T00:04:58.362 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0088146950000000009 2024-09-12T00:04:58.362 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.362 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.362 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:58.362 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291439+0000", 2024-09-12T00:04:58.362 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000198295 2024-09-12T00:04:58.362 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.362 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:58.363 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.363 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.363 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.363 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2659 3.2d e63/23 3:b4a71344:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_154:head v 63'5, mlcod=63'3)", 2024-09-12T00:04:58.363 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:04:58.363 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.064342994, 2024-09-12T00:04:58.363 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016913793, 2024-09-12T00:04:58.363 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:58.363 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:58.363 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:58.364 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:58.364 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.364 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:58.364 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:04:58.364 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.364 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.364 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.364 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:58.364 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:04:58.364 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.364 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.364 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.365 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:58.365 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287682+0000", 2024-09-12T00:04:58.365 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9799999999999998e-06 2024-09-12T00:04:58.365 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.365 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.365 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:58.365 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291872+0000", 2024-09-12T00:04:58.365 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041904070000000002 2024-09-12T00:04:58.365 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.365 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.365 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:58.365 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291901+0000", 2024-09-12T00:04:58.365 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9017999999999999e-05 2024-09-12T00:04:58.366 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.366 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.366 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:58.366 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291917+0000", 2024-09-12T00:04:58.366 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5775999999999999e-05 2024-09-12T00:04:58.366 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.366 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.366 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:58.366 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.292061+0000", 2024-09-12T00:04:58.366 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014356800000000001 2024-09-12T00:04:58.366 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.366 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.367 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:58.367 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.292123+0000", 2024-09-12T00:04:58.367 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2799999999999995e-05 2024-09-12T00:04:58.367 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.367 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.367 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:58.367 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.304456+0000", 2024-09-12T00:04:58.367 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012332865 2024-09-12T00:04:58.367 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.367 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.367 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:58.367 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.304593+0000", 2024-09-12T00:04:58.367 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000136379 2024-09-12T00:04:58.367 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.368 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:58.368 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.368 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.368 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.368 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2667 3.8 3:1177e826:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:58.368 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:04:58.368 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.978901076, 2024-09-12T00:04:58.368 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024306991999999999, 2024-09-12T00:04:58.368 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:58.368 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:58.368 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:58.369 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:58.369 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:58.369 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:58.369 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2667 2024-09-12T00:04:58.369 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.369 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:58.369 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.369 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:58.369 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:04:58.369 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.369 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.369 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.369 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:58.370 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:04:58.370 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.370 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.370 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:58.370 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373124+0000", 2024-09-12T00:04:58.370 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.19e-06 2024-09-12T00:04:58.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.370 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.370 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:58.370 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377167+0000", 2024-09-12T00:04:58.370 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040430329999999997 2024-09-12T00:04:58.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.371 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.371 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:58.371 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377201+0000", 2024-09-12T00:04:58.371 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3868000000000002e-05 2024-09-12T00:04:58.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.371 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.371 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:58.371 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377219+0000", 2024-09-12T00:04:58.371 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8019000000000001e-05 2024-09-12T00:04:58.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.371 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.371 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:58.372 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377362+0000", 2024-09-12T00:04:58.372 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000143001 2024-09-12T00:04:58.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.372 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.372 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:58.372 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377603+0000", 2024-09-12T00:04:58.372 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024115200000000001 2024-09-12T00:04:58.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.372 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.372 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:58.372 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377833+0000", 2024-09-12T00:04:58.373 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022952000000000001 2024-09-12T00:04:58.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.373 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.373 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:58.373 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.386771+0000", 2024-09-12T00:04:58.373 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0089385739999999995 2024-09-12T00:04:58.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.373 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.373 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:58.373 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397160+0000", 2024-09-12T00:04:58.373 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010388391 2024-09-12T00:04:58.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.373 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.374 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:58.374 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397307+0000", 2024-09-12T00:04:58.374 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014745099999999999 2024-09-12T00:04:58.374 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.374 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.374 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:58.374 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397428+0000", 2024-09-12T00:04:58.374 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012079299999999999 2024-09-12T00:04:58.374 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.374 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:58.374 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.375 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.375 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.375 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2669 3.1b 3:d9b9bd82:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:58.375 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:04:58.375 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.959224427000001, 2024-09-12T00:04:58.375 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016867298999999999, 2024-09-12T00:04:58.375 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:58.375 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:58.375 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:58.375 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:58.376 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:58.376 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:58.376 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2669 2024-09-12T00:04:58.376 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.376 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:58.376 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.376 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:58.376 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:04:58.376 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.376 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.376 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.376 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:58.376 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:04:58.377 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.377 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.377 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:58.377 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392800+0000", 2024-09-12T00:04:58.377 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8629999999999999e-06 2024-09-12T00:04:58.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.377 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.377 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:58.377 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396812+0000", 2024-09-12T00:04:58.377 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040120140000000004 2024-09-12T00:04:58.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.377 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.378 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:58.378 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396849+0000", 2024-09-12T00:04:58.378 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6291000000000002e-05 2024-09-12T00:04:58.378 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.378 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.378 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:58.378 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396906+0000", 2024-09-12T00:04:58.378 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7692999999999998e-05 2024-09-12T00:04:58.378 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.378 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.378 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:58.378 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397059+0000", 2024-09-12T00:04:58.378 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015268399999999999 2024-09-12T00:04:58.379 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.379 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.379 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:58.379 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397472+0000", 2024-09-12T00:04:58.379 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041270899999999998 2024-09-12T00:04:58.379 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.379 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.379 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:58.379 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397697+0000", 2024-09-12T00:04:58.379 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022526299999999999 2024-09-12T00:04:58.379 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.379 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.379 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:58.380 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.406380+0000", 2024-09-12T00:04:58.380 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086830429999999997 2024-09-12T00:04:58.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.380 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.380 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:58.380 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409367+0000", 2024-09-12T00:04:58.380 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002987403 2024-09-12T00:04:58.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.380 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.380 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:58.380 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409532+0000", 2024-09-12T00:04:58.380 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016417 2024-09-12T00:04:58.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.381 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.381 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:58.381 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409665+0000", 2024-09-12T00:04:58.381 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013316599999999999 2024-09-12T00:04:58.381 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.381 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:58.381 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.381 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.381 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2678 3.2b 3:d57f7217:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:58.381 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:04:58.381 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.867806979000001, 2024-09-12T00:04:58.381 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018772965999999999, 2024-09-12T00:04:58.382 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:58.382 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:58.382 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:58.382 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:58.382 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:58.382 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:58.382 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2678 2024-09-12T00:04:58.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.382 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:58.382 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.382 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:58.382 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:04:58.382 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.383 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.383 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:58.383 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:04:58.383 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.383 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.383 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:58.383 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484219+0000", 2024-09-12T00:04:58.383 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7299999999999999e-06 2024-09-12T00:04:58.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.383 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.383 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:58.384 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488148+0000", 2024-09-12T00:04:58.384 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039289859999999998 2024-09-12T00:04:58.384 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.384 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.384 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:58.384 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488214+0000", 2024-09-12T00:04:58.384 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6202000000000001e-05 2024-09-12T00:04:58.384 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.384 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.384 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:58.384 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488239+0000", 2024-09-12T00:04:58.384 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4839000000000001e-05 2024-09-12T00:04:58.384 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.385 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.385 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:58.385 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488374+0000", 2024-09-12T00:04:58.385 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000135189 2024-09-12T00:04:58.385 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.385 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.385 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:58.385 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488626+0000", 2024-09-12T00:04:58.385 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025242800000000002 2024-09-12T00:04:58.385 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.385 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.385 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:58.385 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488849+0000", 2024-09-12T00:04:58.386 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022295 2024-09-12T00:04:58.386 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.386 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.386 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:58.386 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498947+0000", 2024-09-12T00:04:58.386 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010098072 2024-09-12T00:04:58.386 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.386 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.386 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:58.386 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502674+0000", 2024-09-12T00:04:58.386 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037269149999999999 2024-09-12T00:04:58.387 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.387 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.387 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:58.387 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502856+0000", 2024-09-12T00:04:58.387 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018163599999999999 2024-09-12T00:04:58.387 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.387 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.387 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:58.387 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502988+0000", 2024-09-12T00:04:58.387 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013201900000000001 2024-09-12T00:04:58.387 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.387 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:58.387 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.388 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.388 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.388 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2691 3.2d e63/23 3:b4a2284d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_176:head v 63'6, mlcod=63'4)", 2024-09-12T00:04:58.388 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:04:58.388 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.834682278000001, 2024-09-12T00:04:58.388 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015889306999999998, 2024-09-12T00:04:58.388 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:58.388 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:58.388 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:58.388 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:58.388 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.388 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:58.389 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:04:58.389 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.389 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.389 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:58.389 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:04:58.389 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.389 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.389 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:58.389 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517342+0000", 2024-09-12T00:04:58.389 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3700000000000002e-06 2024-09-12T00:04:58.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.390 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.390 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:58.390 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521776+0000", 2024-09-12T00:04:58.390 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044339790000000002 2024-09-12T00:04:58.390 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.390 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.390 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:58.390 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521806+0000", 2024-09-12T00:04:58.390 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9855000000000001e-05 2024-09-12T00:04:58.390 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.390 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.390 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:58.390 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521820+0000", 2024-09-12T00:04:58.391 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4496e-05 2024-09-12T00:04:58.391 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.391 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.391 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:58.391 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521963+0000", 2024-09-12T00:04:58.391 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014277199999999999 2024-09-12T00:04:58.391 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.391 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.391 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:58.391 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.522029+0000", 2024-09-12T00:04:58.391 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6186000000000006e-05 2024-09-12T00:04:58.391 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.391 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.391 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:58.392 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.533123+0000", 2024-09-12T00:04:58.392 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011093252 2024-09-12T00:04:58.392 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.392 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.392 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:58.392 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.533229+0000", 2024-09-12T00:04:58.392 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000106397 2024-09-12T00:04:58.392 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.392 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:58.392 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.392 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.392 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.393 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2694 3.3d e63/23 3:bd0bdafc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_179:head v 63'7, mlcod=63'5)", 2024-09-12T00:04:58.393 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:04:58.393 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.799467505999999, 2024-09-12T00:04:58.393 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016398093999999998, 2024-09-12T00:04:58.393 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:58.393 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:58.393 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:58.393 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:58.393 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.393 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:58.393 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:04:58.393 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.393 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.394 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.394 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:58.394 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:04:58.394 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.394 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.394 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:58.394 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552558+0000", 2024-09-12T00:04:58.394 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6030000000000001e-06 2024-09-12T00:04:58.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.394 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.394 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:58.394 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556085+0000", 2024-09-12T00:04:58.395 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0035274339999999999 2024-09-12T00:04:58.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.395 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.395 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:58.395 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556126+0000", 2024-09-12T00:04:58.395 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0290999999999998e-05 2024-09-12T00:04:58.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.395 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.395 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:58.395 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556154+0000", 2024-09-12T00:04:58.395 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7965000000000001e-05 2024-09-12T00:04:58.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.395 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.396 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:58.396 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556298+0000", 2024-09-12T00:04:58.396 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014459799999999999 2024-09-12T00:04:58.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.396 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.396 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:58.396 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556339+0000", 2024-09-12T00:04:58.396 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0577000000000001e-05 2024-09-12T00:04:58.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.396 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.396 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:58.396 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.568778+0000", 2024-09-12T00:04:58.396 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012438886999999999 2024-09-12T00:04:58.397 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.397 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.397 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:58.397 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.568953+0000", 2024-09-12T00:04:58.397 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017473900000000001 2024-09-12T00:04:58.397 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.397 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:58.397 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.397 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.397 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.397 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2696 3.2b 3:d7c776f8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:58.397 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:04:58.397 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.784620608999999, 2024-09-12T00:04:58.398 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022026211, 2024-09-12T00:04:58.398 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:58.398 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:58.398 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:58.398 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:58.398 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:58.398 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:58.398 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2696 2024-09-12T00:04:58.398 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.398 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:58.398 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.398 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:58.398 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:04:58.399 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.399 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.399 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.399 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:58.399 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:04:58.399 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.399 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.399 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.399 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:58.399 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567406+0000", 2024-09-12T00:04:58.399 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9389999999999996e-06 2024-09-12T00:04:58.399 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.399 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.400 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:58.400 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571490+0000", 2024-09-12T00:04:58.400 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040837870000000002 2024-09-12T00:04:58.400 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.400 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.400 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:58.400 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571530+0000", 2024-09-12T00:04:58.400 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9894999999999997e-05 2024-09-12T00:04:58.400 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.400 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.400 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:58.400 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571554+0000", 2024-09-12T00:04:58.401 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4011000000000001e-05 2024-09-12T00:04:58.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.401 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.401 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:58.401 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571726+0000", 2024-09-12T00:04:58.401 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0001717 2024-09-12T00:04:58.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.401 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.401 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:58.401 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.572130+0000", 2024-09-12T00:04:58.401 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040465299999999999 2024-09-12T00:04:58.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.401 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.402 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:58.402 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.572470+0000", 2024-09-12T00:04:58.402 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00033946999999999997 2024-09-12T00:04:58.402 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.402 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.402 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:58.402 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.579159+0000", 2024-09-12T00:04:58.402 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0066893009999999999 2024-09-12T00:04:58.402 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.402 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.402 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:58.402 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589136+0000", 2024-09-12T00:04:58.402 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099772060000000006 2024-09-12T00:04:58.403 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.403 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.403 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:58.403 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589309+0000", 2024-09-12T00:04:58.403 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017264299999999999 2024-09-12T00:04:58.403 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.403 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.403 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:58.403 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589428+0000", 2024-09-12T00:04:58.403 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118606 2024-09-12T00:04:58.403 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.403 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:58.404 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.404 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.404 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.404 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2698 3.3d e63/23 3:bcafb0f9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_183:head v 63'8, mlcod=63'6)", 2024-09-12T00:04:58.404 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:04:58.404 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.75691756, 2024-09-12T00:04:58.404 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016019080000000002, 2024-09-12T00:04:58.404 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:58.404 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:58.404 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:58.404 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:58.404 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.404 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:58.405 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:04:58.405 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.405 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.405 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:58.405 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:04:58.405 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.405 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.405 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:58.405 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595107+0000", 2024-09-12T00:04:58.405 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.497e-06 2024-09-12T00:04:58.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.406 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.406 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:58.406 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598465+0000", 2024-09-12T00:04:58.406 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033583129999999999 2024-09-12T00:04:58.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.406 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.406 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:58.406 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598502+0000", 2024-09-12T00:04:58.406 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6814999999999999e-05 2024-09-12T00:04:58.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.406 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.406 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:58.406 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598520+0000", 2024-09-12T00:04:58.407 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8264999999999999e-05 2024-09-12T00:04:58.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.407 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.407 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:58.407 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598666+0000", 2024-09-12T00:04:58.407 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014574499999999999 2024-09-12T00:04:58.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.407 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.407 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:58.407 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598706+0000", 2024-09-12T00:04:58.407 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9993999999999997e-05 2024-09-12T00:04:58.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.407 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.407 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:58.408 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.611012+0000", 2024-09-12T00:04:58.408 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012306381 2024-09-12T00:04:58.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.408 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.408 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:58.408 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.611123+0000", 2024-09-12T00:04:58.408 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011107000000000001 2024-09-12T00:04:58.408 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.408 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:58.408 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.408 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.409 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2702 3.3c e63/23 3:3d6a0b3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_187:head v 63'5, mlcod=63'3)", 2024-09-12T00:04:58.409 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:04:58.409 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.723442723, 2024-09-12T00:04:58.409 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015754475, 2024-09-12T00:04:58.409 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:58.409 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:58.409 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:58.409 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:58.409 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.409 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:58.409 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:04:58.409 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.409 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.409 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.410 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:58.410 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:04:58.410 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.410 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.410 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:58.410 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628581+0000", 2024-09-12T00:04:58.410 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2129999999999998e-06 2024-09-12T00:04:58.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.410 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.410 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:58.410 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633160+0000", 2024-09-12T00:04:58.410 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045784470000000002 2024-09-12T00:04:58.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.411 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.411 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:58.411 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633193+0000", 2024-09-12T00:04:58.411 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3015000000000002e-05 2024-09-12T00:04:58.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.411 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.411 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:58.411 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633213+0000", 2024-09-12T00:04:58.411 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0271999999999998e-05 2024-09-12T00:04:58.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.411 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.411 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:58.412 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633397+0000", 2024-09-12T00:04:58.412 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018359299999999999 2024-09-12T00:04:58.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.412 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.412 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:58.412 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633440+0000", 2024-09-12T00:04:58.412 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2984e-05 2024-09-12T00:04:58.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.412 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.412 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:58.412 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.644242+0000", 2024-09-12T00:04:58.412 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010802673 2024-09-12T00:04:58.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.413 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.413 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:58.413 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.644334+0000", 2024-09-12T00:04:58.413 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1278000000000003e-05 2024-09-12T00:04:58.413 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.413 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:58.413 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.413 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.413 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2707 3.8 3:10a400a4:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:58.413 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:04:58.413 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.675165155, 2024-09-12T00:04:58.413 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019444162000000001, 2024-09-12T00:04:58.414 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:58.414 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:58.414 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:58.414 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:58.414 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:58.414 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:58.414 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2707 2024-09-12T00:04:58.414 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.414 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:58.414 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.414 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:58.414 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:04:58.414 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.415 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.415 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:58.415 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:04:58.415 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.415 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.415 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:58.415 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676879+0000", 2024-09-12T00:04:58.415 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1886e-05 2024-09-12T00:04:58.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.415 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.415 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:58.416 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680743+0000", 2024-09-12T00:04:58.416 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038648060000000001 2024-09-12T00:04:58.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.416 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.416 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:58.416 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680783+0000", 2024-09-12T00:04:58.416 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9511000000000002e-05 2024-09-12T00:04:58.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.416 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.416 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:58.416 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680801+0000", 2024-09-12T00:04:58.416 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8056000000000001e-05 2024-09-12T00:04:58.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.417 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.417 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:58.417 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680948+0000", 2024-09-12T00:04:58.417 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014682399999999999 2024-09-12T00:04:58.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.417 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.417 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:58.417 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.681206+0000", 2024-09-12T00:04:58.417 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025860500000000002 2024-09-12T00:04:58.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.417 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.417 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:58.417 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.681439+0000", 2024-09-12T00:04:58.418 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023246599999999999 2024-09-12T00:04:58.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.418 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.418 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:58.418 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.689277+0000", 2024-09-12T00:04:58.418 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0078379000000000001 2024-09-12T00:04:58.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.418 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.418 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:58.418 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696136+0000", 2024-09-12T00:04:58.418 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0068593439999999999 2024-09-12T00:04:58.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.418 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.418 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:58.419 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696228+0000", 2024-09-12T00:04:58.419 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2038000000000002e-05 2024-09-12T00:04:58.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.419 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.419 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:58.419 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696301+0000", 2024-09-12T00:04:58.419 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2725999999999995e-05 2024-09-12T00:04:58.419 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.419 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:58.419 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.419 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.419 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2720 3.6 3:61c9c6cd:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:58.420 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:04:58.420 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.548445838999999, 2024-09-12T00:04:58.420 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021831761000000002, 2024-09-12T00:04:58.420 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:58.420 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:58.420 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:58.420 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:58.420 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:58.420 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:58.420 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2720 2024-09-12T00:04:58.420 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.420 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:58.420 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.420 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:58.421 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:04:58.421 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.421 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.421 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.421 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:58.421 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:04:58.421 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.421 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.421 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.421 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:58.421 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803580+0000", 2024-09-12T00:04:58.421 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9870000000000001e-06 2024-09-12T00:04:58.421 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.422 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.422 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:58.422 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808102+0000", 2024-09-12T00:04:58.422 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004521677 2024-09-12T00:04:58.422 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.422 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.422 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:58.422 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808152+0000", 2024-09-12T00:04:58.422 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9923999999999998e-05 2024-09-12T00:04:58.422 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.422 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.422 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:58.422 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808178+0000", 2024-09-12T00:04:58.422 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5911999999999999e-05 2024-09-12T00:04:58.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.423 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:58.423 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808365+0000", 2024-09-12T00:04:58.423 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000187839 2024-09-12T00:04:58.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.423 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:58.423 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808757+0000", 2024-09-12T00:04:58.423 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039202900000000001 2024-09-12T00:04:58.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.423 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:04:58.423 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.809162+0000", 2024-09-12T00:04:58.424 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040460300000000002 2024-09-12T00:04:58.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.424 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.424 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:58.424 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.816553+0000", 2024-09-12T00:04:58.424 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.007390537 2024-09-12T00:04:58.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.424 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.424 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:58.424 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.824836+0000", 2024-09-12T00:04:58.424 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082834369999999994 2024-09-12T00:04:58.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.424 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.425 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:58.425 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.825223+0000", 2024-09-12T00:04:58.425 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00038724700000000001 2024-09-12T00:04:58.425 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.425 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.425 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:58.425 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.825408+0000", 2024-09-12T00:04:58.425 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018456899999999999 2024-09-12T00:04:58.425 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.425 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:58.425 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.425 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.425 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.425 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2722 3.1b 3:d95d04cc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_207:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:58.425 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.822403+0000", 2024-09-12T00:04:58.426 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.529619146, 2024-09-12T00:04:58.426 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015693082000000001, 2024-09-12T00:04:58.426 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:58.426 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:58.426 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:58.426 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:58.426 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:58.426 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:58.426 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2722 2024-09-12T00:04:58.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.426 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:58.426 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.426 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:58.426 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.822403+0000", 2024-09-12T00:04:58.427 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.427 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.427 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:58.427 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.822403+0000", 2024-09-12T00:04:58.427 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.427 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.427 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:58.427 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.822405+0000", 2024-09-12T00:04:58.427 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4169999999999999e-06 2024-09-12T00:04:58.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.427 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.427 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:58.428 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826387+0000", 2024-09-12T00:04:58.428 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039818379999999997 2024-09-12T00:04:58.428 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.428 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.428 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:58.428 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826412+0000", 2024-09-12T00:04:58.428 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5159000000000001e-05 2024-09-12T00:04:58.428 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.428 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.428 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:58.428 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826425+0000", 2024-09-12T00:04:58.428 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3283e-05 2024-09-12T00:04:58.428 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.429 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.429 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:58.429 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826536+0000", 2024-09-12T00:04:58.429 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110109 2024-09-12T00:04:58.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.429 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.429 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:58.429 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826725+0000", 2024-09-12T00:04:58.429 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018966600000000001 2024-09-12T00:04:58.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.429 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.429 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:58.429 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826904+0000", 2024-09-12T00:04:58.429 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017913200000000001 2024-09-12T00:04:58.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.430 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.430 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:58.430 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.835018+0000", 2024-09-12T00:04:58.430 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0081138300000000007 2024-09-12T00:04:58.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.430 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.430 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:58.430 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837918+0000", 2024-09-12T00:04:58.430 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002899535 2024-09-12T00:04:58.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.430 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.430 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:58.430 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838010+0000", 2024-09-12T00:04:58.431 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1901e-05 2024-09-12T00:04:58.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.431 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.431 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:58.431 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838096+0000", 2024-09-12T00:04:58.431 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6211999999999994e-05 2024-09-12T00:04:58.431 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.431 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:58.431 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.431 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.431 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2724 3.1b 3:da32d84b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:58.431 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:04:58.432 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.508235403, 2024-09-12T00:04:58.432 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019410604000000001, 2024-09-12T00:04:58.432 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:58.432 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:58.432 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:58.432 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:58.432 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:58.432 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:58.432 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2724 2024-09-12T00:04:58.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.432 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:58.432 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.432 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:58.433 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:04:58.433 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.433 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.433 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:58.433 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:04:58.433 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.433 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.433 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:58.433 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843790+0000", 2024-09-12T00:04:58.433 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.393e-06 2024-09-12T00:04:58.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.434 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.434 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:58.434 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847786+0000", 2024-09-12T00:04:58.434 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039965579999999999 2024-09-12T00:04:58.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.434 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.434 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:58.434 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847836+0000", 2024-09-12T00:04:58.435 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9731000000000002e-05 2024-09-12T00:04:58.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.435 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.435 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:58.435 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847856+0000", 2024-09-12T00:04:58.435 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0245e-05 2024-09-12T00:04:58.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.435 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.435 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:58.435 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848053+0000", 2024-09-12T00:04:58.435 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000196882 2024-09-12T00:04:58.436 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.436 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.436 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:58.436 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848291+0000", 2024-09-12T00:04:58.436 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000237762 2024-09-12T00:04:58.436 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.436 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.436 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:04:58.436 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848544+0000", 2024-09-12T00:04:58.436 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025307500000000001 2024-09-12T00:04:58.436 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.436 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.436 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:58.436 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.860024+0000", 2024-09-12T00:04:58.437 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011479390000000001 2024-09-12T00:04:58.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.437 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.437 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:58.437 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.862880+0000", 2024-09-12T00:04:58.437 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002856833 2024-09-12T00:04:58.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.437 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.437 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:58.437 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.863048+0000", 2024-09-12T00:04:58.437 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016796700000000001 2024-09-12T00:04:58.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.437 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.438 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:58.438 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.863197+0000", 2024-09-12T00:04:58.438 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148768 2024-09-12T00:04:58.438 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.438 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:58.438 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.438 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.438 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2727 3.39 e63/23 3:9c63b475:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_212:head v 63'3, mlcod=62'1)", 2024-09-12T00:04:58.438 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:04:58.438 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.474206807, 2024-09-12T00:04:58.438 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016224526999999999, 2024-09-12T00:04:58.439 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:58.439 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:58.439 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:58.439 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:58.439 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.439 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:58.440 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:04:58.440 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.440 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.440 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:58.440 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:04:58.440 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.440 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.440 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:58.441 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877818+0000", 2024-09-12T00:04:58.441 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.813e-06 2024-09-12T00:04:58.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.441 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.441 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:58.441 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883917+0000", 2024-09-12T00:04:58.441 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0060993009999999997 2024-09-12T00:04:58.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.441 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.441 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:58.441 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883961+0000", 2024-09-12T00:04:58.441 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3951e-05 2024-09-12T00:04:58.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.442 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.442 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:58.442 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883992+0000", 2024-09-12T00:04:58.442 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0565000000000003e-05 2024-09-12T00:04:58.442 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.442 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.442 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:58.442 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884176+0000", 2024-09-12T00:04:58.442 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018378200000000001 2024-09-12T00:04:58.442 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.442 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.442 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:58.442 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884252+0000", 2024-09-12T00:04:58.442 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6209000000000002e-05 2024-09-12T00:04:58.442 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.443 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.443 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:58.443 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.893904+0000", 2024-09-12T00:04:58.443 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0096519339999999992 2024-09-12T00:04:58.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.443 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.443 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:58.443 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.894040+0000", 2024-09-12T00:04:58.443 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013597199999999999 2024-09-12T00:04:58.443 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.443 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:58.443 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.444 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.444 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2730 3.7 3:e3fca83c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:58.444 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:04:58.444 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.443678681, 2024-09-12T00:04:58.444 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022178479000000001, 2024-09-12T00:04:58.444 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:58.444 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:58.444 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:58.444 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:58.444 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:58.444 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:58.444 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2730 2024-09-12T00:04:58.444 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.445 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:58.445 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.445 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:58.445 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:04:58.445 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.445 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.445 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.445 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:58.445 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:04:58.445 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.445 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.445 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.445 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:58.446 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908346+0000", 2024-09-12T00:04:58.446 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1999999999999999e-06 2024-09-12T00:04:58.446 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.446 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.446 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:58.446 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912423+0000", 2024-09-12T00:04:58.446 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004076423 2024-09-12T00:04:58.446 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.446 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.446 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:58.446 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912472+0000", 2024-09-12T00:04:58.446 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9023999999999997e-05 2024-09-12T00:04:58.446 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.446 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.446 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:58.447 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912498+0000", 2024-09-12T00:04:58.447 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6591999999999999e-05 2024-09-12T00:04:58.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.447 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.447 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:58.447 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912677+0000", 2024-09-12T00:04:58.447 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017824599999999999 2024-09-12T00:04:58.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.447 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.447 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:58.447 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913094+0000", 2024-09-12T00:04:58.447 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041757799999999999 2024-09-12T00:04:58.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.447 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.447 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:58.448 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913512+0000", 2024-09-12T00:04:58.448 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000417475 2024-09-12T00:04:58.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.448 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:58.448 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.929229+0000", 2024-09-12T00:04:58.448 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015717294999999999 2024-09-12T00:04:58.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.448 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:58.448 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930204+0000", 2024-09-12T00:04:58.448 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00097506199999999996 2024-09-12T00:04:58.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.449 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:58.449 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930392+0000", 2024-09-12T00:04:58.449 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000187775 2024-09-12T00:04:58.449 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.449 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.449 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:58.449 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930522+0000", 2024-09-12T00:04:58.449 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012980899999999999 2024-09-12T00:04:58.449 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.449 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:58.449 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.449 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.449 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.449 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2753 3.7 3:e119c99e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_238:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:58.449 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:04:58.450 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.197990611, 2024-09-12T00:04:58.450 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.023674186999999999, 2024-09-12T00:04:58.450 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:58.450 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:58.450 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:58.450 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:58.450 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:58.450 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:58.450 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2753 2024-09-12T00:04:58.450 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.450 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:58.450 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.450 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:58.450 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:04:58.451 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.451 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.451 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:58.451 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:04:58.451 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.451 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.451 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:58.451 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154035+0000", 2024-09-12T00:04:58.451 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2799999999999999e-06 2024-09-12T00:04:58.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.451 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.451 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:58.451 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159459+0000", 2024-09-12T00:04:58.452 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054242190000000001 2024-09-12T00:04:58.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.452 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.452 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:58.452 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159509+0000", 2024-09-12T00:04:58.452 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9830999999999998e-05 2024-09-12T00:04:58.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.452 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.452 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:58.452 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159536+0000", 2024-09-12T00:04:58.452 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7438000000000001e-05 2024-09-12T00:04:58.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.452 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.452 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159710+0000", 2024-09-12T00:04:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017342 2024-09-12T00:04:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159961+0000", 2024-09-12T00:04:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025164499999999999 2024-09-12T00:04:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:04:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.160206+0000", 2024-09-12T00:04:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024534200000000001 2024-09-12T00:04:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.453 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177421+0000", 2024-09-12T00:04:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017214956 2024-09-12T00:04:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177534+0000", 2024-09-12T00:04:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000112223 2024-09-12T00:04:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177625+0000", 2024-09-12T00:04:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0947999999999997e-05 2024-09-12T00:04:58.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177706+0000", 2024-09-12T00:04:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0884999999999996e-05 2024-09-12T00:04:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2757 3.2b 3:d6dac417:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:04:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:04:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.131921789, 2024-09-12T00:04:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017779708000000002, 2024-09-12T00:04:58.455 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:04:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:04:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:04:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2757 2024-09-12T00:04:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:04:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.456 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:04:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220103+0000", 2024-09-12T00:04:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.32e-06 2024-09-12T00:04:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225042+0000", 2024-09-12T00:04:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049386200000000003 2024-09-12T00:04:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225083+0000", 2024-09-12T00:04:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1304000000000003e-05 2024-09-12T00:04:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225102+0000", 2024-09-12T00:04:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8502e-05 2024-09-12T00:04:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225256+0000", 2024-09-12T00:04:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015436099999999999 2024-09-12T00:04:58.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225513+0000", 2024-09-12T00:04:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000256562 2024-09-12T00:04:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:04:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225737+0000", 2024-09-12T00:04:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022379 2024-09-12T00:04:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:04:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.234281+0000", 2024-09-12T00:04:58.459 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0085440540000000006 2024-09-12T00:04:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:04:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237710+0000", 2024-09-12T00:04:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0034298380000000002 2024-09-12T00:04:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237805+0000", 2024-09-12T00:04:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4804999999999998e-05 2024-09-12T00:04:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:58.460 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237880+0000", 2024-09-12T00:04:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4552e-05 2024-09-12T00:04:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2764 3.2d e63/23 3:b7a0f55d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_249:head v 63'7, mlcod=63'5)", 2024-09-12T00:04:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:04:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.023144319, 2024-09-12T00:04:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018235872, 2024-09-12T00:04:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:04:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:04:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:04:58.461 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:04:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:04:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:04:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:04:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:04:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:04:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:04:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328882+0000", 2024-09-12T00:04:58.462 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5000000000000001e-06 2024-09-12T00:04:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:04:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335092+0000", 2024-09-12T00:04:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0062094730000000001 2024-09-12T00:04:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:04:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335127+0000", 2024-09-12T00:04:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5717999999999999e-05 2024-09-12T00:04:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:04:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335144+0000", 2024-09-12T00:04:58.463 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7119e-05 2024-09-12T00:04:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:04:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335308+0000", 2024-09-12T00:04:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000163757 2024-09-12T00:04:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:04:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335354+0000", 2024-09-12T00:04:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6164e-05 2024-09-12T00:04:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.464 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:04:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.346991+0000", 2024-09-12T00:04:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011636851 2024-09-12T00:04:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:04:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:04:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:04:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.347113+0000", 2024-09-12T00:04:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012229 2024-09-12T00:04:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:04:58.465 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:04:58.465 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:58.467 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:04:58.467 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:58.465+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:58.568 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:58.565+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T00:04:58.642 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:58.642 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:04:58.642 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:04:58.642 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:58.657 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:04:58.687 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:04:58.699 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:58.697+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:58.771 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:04:58.769+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:04:58.822 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:04:58.822 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:04:58.822 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:04:58.823 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:04:58.823 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:04:58.837 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:04:58.851 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:04:58.851 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:04:58.868 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:04:58.868 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:04:58.879 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:58.877+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:58.884 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:04:58.884 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:04:58.902 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:04:58.902 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:04:58.921 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:04:58.921 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:04:58.939 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:04:58.940 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:04:58.960 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:04:58.960 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:04:58.972 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:58.972+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:58.980 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:04:58.981 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:04:59.003 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:59.003 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:59.018 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:04:59.074 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:59.073+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:59.137 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:59.137 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:59.152 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:04:59.175 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:59.176+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:59.275 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:04:59.276+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:04:59.315 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:59.316 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:59.330 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:04:59.376 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:04:59.376+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:04:59.448 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:59.448 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:59.463 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:04:59.514 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:59.513+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:59.579 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:04:59.577+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:04:59.582 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:59.582 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:59.596 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:04:59.682 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:59.681+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:59.763 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:59.763 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:59.777 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:04:59.822 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:04:59.821+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:04:59.882 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:04:59.881+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:04:59.947 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:04:59.947 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:04:59.962 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:05:00.009 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:00.012+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:00.083 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:00.084+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:00.100 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:00.100 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:00.115 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:05:00.201 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:00.204+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:00.283 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:00.283 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:00.285 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:00.284+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:00.298 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:05:00.386 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:00.385+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:00.465 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:00.465 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:00.478 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:05:00.487 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:00.485+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:00.588 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:00.588+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:00.608 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:00.608 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:00.623 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:05:00.645 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:05:00.717 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:00.720+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:00.790 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:00.790 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:00.790 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:00.792+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:00.806 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:05:00.897 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:00.900+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:00.969 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:00.969 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:00.983 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:05:00.999 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:05:01.026 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:01.028+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:01.093 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:01.092+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:01.148 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:01.148 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:01.162 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:05:01.182 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:01.183 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:01.194 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:01.193+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:01.199 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:01.199 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:01.216 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:01.216 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:01.233 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:01.233 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:01.253 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:01.253 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:01.275 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:01.275 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:01.295 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:01.293+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:01.297 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:01.299 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:01.299 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:01.299 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:05:01.299 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:05:01.299 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:01.315 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:05:01.320 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:01.321 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:01.396 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:01.396+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:01.446 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:01.446 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:05:01.446 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:05:01.446 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:05:01.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.447 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1641 3.26 3:658fe58e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2__shadow_.hDHTDpIswwqRA2bHiHVxkhWqZde6XEj_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:05:01.447 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:05:01.447 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 28.389552199000001, 2024-09-12T00:05:01.447 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017888905, 2024-09-12T00:05:01.447 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:01.447 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:01.447 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1641 2024-09-12T00:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:01.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:05:01.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.449 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:01.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056289+0000", 2024-09-12T00:05:01.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5349999999999999e-06 2024-09-12T00:05:01.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.449 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:01.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058595+0000", 2024-09-12T00:05:01.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002306083 2024-09-12T00:05:01.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058621+0000", 2024-09-12T00:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6431000000000002e-05 2024-09-12T00:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058631+0000", 2024-09-12T00:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0166000000000001e-05 2024-09-12T00:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058712+0000", 2024-09-12T00:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0122000000000003e-05 2024-09-12T00:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058821+0000", 2024-09-12T00:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010907400000000001 2024-09-12T00:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058910+0000", 2024-09-12T00:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9523000000000003e-05 2024-09-12T00:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073881+0000", 2024-09-12T00:05:01.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014971224 2024-09-12T00:05:01.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.452 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:01.452 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074101+0000", 2024-09-12T00:05:01.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0002195 2024-09-12T00:05:01.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.452 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074133+0000", 2024-09-12T00:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2138000000000003e-05 2024-09-12T00:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074175+0000", 2024-09-12T00:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2109e-05 2024-09-12T00:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1775 3.30 e58/23 3:0c2ae78d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_1:head v 58'1, mlcod=0'0)", 2024-09-12T00:05:01.454 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:05:01.454 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 27.444077238999999, 2024-09-12T00:05:01.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017585038000000001, 2024-09-12T00:05:01.454 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:01.454 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:01.454 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:01.454 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:01.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.454 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:01.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:05:01.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001763+0000", 2024-09-12T00:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2730000000000001e-06 2024-09-12T00:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005217+0000", 2024-09-12T00:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0034533810000000002 2024-09-12T00:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005241+0000", 2024-09-12T00:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4403e-05 2024-09-12T00:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005253+0000", 2024-09-12T00:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2007e-05 2024-09-12T00:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005324+0000", 2024-09-12T00:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0765000000000004e-05 2024-09-12T00:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005348+0000", 2024-09-12T00:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3762000000000001e-05 2024-09-12T00:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019291+0000", 2024-09-12T00:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013943707 2024-09-12T00:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019346+0000", 2024-09-12T00:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4740000000000001e-05 2024-09-12T00:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1780 3.16 3:69d8ee52:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 27.422468327000001, 2024-09-12T00:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016232362, 2024-09-12T00:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1780 2024-09-12T00:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023372+0000", 2024-09-12T00:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0209999999999998e-06 2024-09-12T00:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024447+0000", 2024-09-12T00:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0010749550000000001 2024-09-12T00:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024473+0000", 2024-09-12T00:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5689000000000001e-05 2024-09-12T00:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024484+0000", 2024-09-12T00:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1153e-05 2024-09-12T00:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024547+0000", 2024-09-12T00:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3400999999999998e-05 2024-09-12T00:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024669+0000", 2024-09-12T00:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012184999999999999 2024-09-12T00:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025014+0000", 2024-09-12T00:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000344505 2024-09-12T00:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039161+0000", 2024-09-12T00:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014147799000000001 2024-09-12T00:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039434+0000", 2024-09-12T00:05:01.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00027254699999999999 2024-09-12T00:05:01.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.463 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:01.463 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039521+0000", 2024-09-12T00:05:01.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6663999999999996e-05 2024-09-12T00:05:01.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.463 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:01.463 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039602+0000", 2024-09-12T00:05:01.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1778000000000002e-05 2024-09-12T00:05:01.463 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.463 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1912 3.16 3:6a08f78f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.4__shadow_.EKM6BwfpK8ZqXIKQk7k4yJFkOWS2UlN_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:35.139256+0000", 2024-09-12T00:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 26.306582406, 2024-09-12T00:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01537029, 2024-09-12T00:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1912 2024-09-12T00:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.139256+0000", 2024-09-12T00:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.139256+0000", 2024-09-12T00:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.466 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:01.466 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.139258+0000", 2024-09-12T00:05:01.466 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3439999999999999e-06 2024-09-12T00:05:01.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.466 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:01.466 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141028+0000", 2024-09-12T00:05:01.466 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001770183 2024-09-12T00:05:01.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141054+0000", 2024-09-12T00:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5928e-05 2024-09-12T00:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141065+0000", 2024-09-12T00:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0589e-05 2024-09-12T00:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141145+0000", 2024-09-12T00:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0121000000000001e-05 2024-09-12T00:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141257+0000", 2024-09-12T00:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000111672 2024-09-12T00:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141361+0000", 2024-09-12T00:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103705 2024-09-12T00:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.152422+0000", 2024-09-12T00:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011061586999999999 2024-09-12T00:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154552+0000", 2024-09-12T00:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021297120000000002 2024-09-12T00:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154590+0000", 2024-09-12T00:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7942999999999999e-05 2024-09-12T00:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154626+0000", 2024-09-12T00:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6505999999999999e-05 2024-09-12T00:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2650 3.5 3:a19f3a83:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.189998+0000", 2024-09-12T00:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.255840430999999, 2024-09-12T00:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016025257000000001, 2024-09-12T00:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2650 2024-09-12T00:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.189998+0000", 2024-09-12T00:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.189998+0000", 2024-09-12T00:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.190001+0000", 2024-09-12T00:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5830000000000001e-06 2024-09-12T00:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191320+0000", 2024-09-12T00:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0013192449999999999 2024-09-12T00:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191341+0000", 2024-09-12T00:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1690000000000001e-05 2024-09-12T00:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191355+0000", 2024-09-12T00:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3147e-05 2024-09-12T00:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191444+0000", 2024-09-12T00:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9809999999999996e-05 2024-09-12T00:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191623+0000", 2024-09-12T00:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017869399999999999 2024-09-12T00:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191786+0000", 2024-09-12T00:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000163203 2024-09-12T00:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.198758+0000", 2024-09-12T00:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069714440000000003 2024-09-12T00:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.205895+0000", 2024-09-12T00:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.007137404 2024-09-12T00:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.205966+0000", 2024-09-12T00:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0797999999999995e-05 2024-09-12T00:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.206023+0000", 2024-09-12T00:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7238999999999999e-05 2024-09-12T00:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2655 3.5 3:a26caaa1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.241675+0000", 2024-09-12T00:05:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.204163168999999, 2024-09-12T00:05:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018338047999999999, 2024-09-12T00:05:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2655 2024-09-12T00:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.241675+0000", 2024-09-12T00:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.241675+0000", 2024-09-12T00:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.241678+0000", 2024-09-12T00:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4430000000000002e-06 2024-09-12T00:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243471+0000", 2024-09-12T00:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017937369999999999 2024-09-12T00:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243493+0000", 2024-09-12T00:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2001000000000002e-05 2024-09-12T00:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243505+0000", 2024-09-12T00:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1632e-05 2024-09-12T00:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243579+0000", 2024-09-12T00:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4165999999999994e-05 2024-09-12T00:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243766+0000", 2024-09-12T00:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018714599999999999 2024-09-12T00:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243937+0000", 2024-09-12T00:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017038700000000001 2024-09-12T00:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.250274+0000", 2024-09-12T00:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063369070000000001 2024-09-12T00:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.259911+0000", 2024-09-12T00:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0096378669999999996 2024-09-12T00:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.259960+0000", 2024-09-12T00:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8763000000000001e-05 2024-09-12T00:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.260013+0000", 2024-09-12T00:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2998999999999999e-05 2024-09-12T00:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.482 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:01.482 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.482 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.482 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.482 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2657 3.3c 3:3e583291:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:01.482 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.263916+0000", 2024-09-12T00:05:01.482 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.181922478000001, 2024-09-12T00:05:01.482 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020609368999999999, 2024-09-12T00:05:01.482 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:01.484 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:01.484 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:01.484 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:01.484 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:01.484 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:01.484 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2657 2024-09-12T00:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.263916+0000", 2024-09-12T00:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.263916+0000", 2024-09-12T00:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.263919+0000", 2024-09-12T00:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.92e-06 2024-09-12T00:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266277+0000", 2024-09-12T00:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023579310000000002 2024-09-12T00:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266302+0000", 2024-09-12T00:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4807000000000002e-05 2024-09-12T00:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:01.487 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266317+0000", 2024-09-12T00:05:01.487 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5209e-05 2024-09-12T00:05:01.487 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.487 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.487 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:01.487 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266414+0000", 2024-09-12T00:05:01.487 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7658000000000006e-05 2024-09-12T00:05:01.487 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.487 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.488 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:01.488 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266556+0000", 2024-09-12T00:05:01.488 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014166100000000001 2024-09-12T00:05:01.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.488 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.488 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:01.488 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266680+0000", 2024-09-12T00:05:01.488 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012421099999999999 2024-09-12T00:05:01.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.488 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.488 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:01.488 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275396+0000", 2024-09-12T00:05:01.488 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0087156609999999995 2024-09-12T00:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.284426+0000", 2024-09-12T00:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0090300039999999995 2024-09-12T00:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.284472+0000", 2024-09-12T00:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6273000000000002e-05 2024-09-12T00:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.284525+0000", 2024-09-12T00:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3034000000000001e-05 2024-09-12T00:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2658 3.3a 3:5ec14981:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.274153+0000", 2024-09-12T00:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.171685036, 2024-09-12T00:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017963626, 2024-09-12T00:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2658 2024-09-12T00:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.274153+0000", 2024-09-12T00:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.274153+0000", 2024-09-12T00:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.492 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.492 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.492 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:01.492 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.274156+0000", 2024-09-12T00:05:01.492 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5299999999999999e-06 2024-09-12T00:05:01.492 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.492 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.492 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:01.492 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275746+0000", 2024-09-12T00:05:01.492 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001589741 2024-09-12T00:05:01.492 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.492 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.492 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:01.493 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275770+0000", 2024-09-12T00:05:01.493 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4539999999999999e-05 2024-09-12T00:05:01.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.493 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.493 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:01.493 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275785+0000", 2024-09-12T00:05:01.493 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4783000000000001e-05 2024-09-12T00:05:01.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.493 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.493 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:01.493 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275867+0000", 2024-09-12T00:05:01.493 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2362999999999997e-05 2024-09-12T00:05:01.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.493 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.494 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:01.494 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275990+0000", 2024-09-12T00:05:01.494 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012287100000000001 2024-09-12T00:05:01.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.494 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:01.494 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.276085+0000", 2024-09-12T00:05:01.494 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5172000000000003e-05 2024-09-12T00:05:01.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.494 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:01.494 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.282993+0000", 2024-09-12T00:05:01.494 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069076210000000001 2024-09-12T00:05:01.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.495 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:01.495 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.291976+0000", 2024-09-12T00:05:01.495 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0089835269999999998 2024-09-12T00:05:01.495 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.495 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.495 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:01.495 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.292054+0000", 2024-09-12T00:05:01.495 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7804000000000002e-05 2024-09-12T00:05:01.496 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.496 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.496 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.292117+0000", 2024-09-12T00:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2674000000000003e-05 2024-09-12T00:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2661 3.1e e63/23 3:7a671bd1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_156:head v 63'3, mlcod=62'1)", 2024-09-12T00:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.312780+0000", 2024-09-12T00:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.133058407, 2024-09-12T00:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015038723, 2024-09-12T00:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:01.498 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.312780+0000", 2024-09-12T00:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.312780+0000", 2024-09-12T00:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.312783+0000", 2024-09-12T00:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.756e-06 2024-09-12T00:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317423+0000", 2024-09-12T00:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004640323 2024-09-12T00:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317453+0000", 2024-09-12T00:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0301e-05 2024-09-12T00:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317468+0000", 2024-09-12T00:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4989e-05 2024-09-12T00:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317551+0000", 2024-09-12T00:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2712000000000004e-05 2024-09-12T00:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317578+0000", 2024-09-12T00:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7161999999999998e-05 2024-09-12T00:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.327765+0000", 2024-09-12T00:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010187229000000001 2024-09-12T00:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.327819+0000", 2024-09-12T00:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3251000000000002e-05 2024-09-12T00:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2675 3.20 3:0529bfef:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.454008+0000", 2024-09-12T00:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.991830151, 2024-09-12T00:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017972776999999999, 2024-09-12T00:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2675 2024-09-12T00:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.454008+0000", 2024-09-12T00:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.454008+0000", 2024-09-12T00:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.454011+0000", 2024-09-12T00:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1379999999999999e-06 2024-09-12T00:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455547+0000", 2024-09-12T00:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001535919 2024-09-12T00:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455580+0000", 2024-09-12T00:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2789000000000001e-05 2024-09-12T00:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455591+0000", 2024-09-12T00:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0531e-05 2024-09-12T00:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:01.506 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455670+0000", 2024-09-12T00:05:01.506 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9822999999999998e-05 2024-09-12T00:05:01.506 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.506 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.506 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:01.506 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455863+0000", 2024-09-12T00:05:01.506 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019248799999999999 2024-09-12T00:05:01.506 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.506 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.506 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:01.506 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.456021+0000", 2024-09-12T00:05:01.506 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000157627 2024-09-12T00:05:01.507 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.507 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.507 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:01.507 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.462847+0000", 2024-09-12T00:05:01.507 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0068268230000000001 2024-09-12T00:05:01.507 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.507 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.507 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:01.507 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.471901+0000", 2024-09-12T00:05:01.507 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0090533820000000004 2024-09-12T00:05:01.507 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.507 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.507 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.471939+0000", 2024-09-12T00:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8334999999999998e-05 2024-09-12T00:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.471981+0000", 2024-09-12T00:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1922000000000003e-05 2024-09-12T00:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2693 3.1e e63/23 3:7a8f9e2c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_178:head v 63'4, mlcod=63'2)", 2024-09-12T00:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.541097+0000", 2024-09-12T00:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.904741439, 2024-09-12T00:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013470268000000001, 2024-09-12T00:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.541097+0000", 2024-09-12T00:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.541097+0000", 2024-09-12T00:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.541098+0000", 2024-09-12T00:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.454e-06 2024-09-12T00:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545193+0000", 2024-09-12T00:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040943899999999998 2024-09-12T00:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545221+0000", 2024-09-12T00:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8595e-05 2024-09-12T00:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545235+0000", 2024-09-12T00:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3329999999999999e-05 2024-09-12T00:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545320+0000", 2024-09-12T00:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5371000000000006e-05 2024-09-12T00:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:01.512 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545348+0000", 2024-09-12T00:05:01.512 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7532e-05 2024-09-12T00:05:01.512 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.512 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.512 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:01.512 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.554493+0000", 2024-09-12T00:05:01.512 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091452400000000007 2024-09-12T00:05:01.512 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.512 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.512 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:01.512 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.554567+0000", 2024-09-12T00:05:01.512 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4356000000000004e-05 2024-09-12T00:05:01.512 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2696 3.2b e63/23 3:d7c776f8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_181:head v 63'8, mlcod=63'6)", 2024-09-12T00:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.572942+0000", 2024-09-12T00:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.872895901, 2024-09-12T00:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016050795999999999, 2024-09-12T00:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.572942+0000", 2024-09-12T00:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.572942+0000", 2024-09-12T00:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.572945+0000", 2024-09-12T00:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1730000000000002e-06 2024-09-12T00:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.515 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:01.515 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577465+0000", 2024-09-12T00:05:01.515 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045199649999999999 2024-09-12T00:05:01.515 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.515 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.515 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:01.515 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577495+0000", 2024-09-12T00:05:01.515 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0473000000000001e-05 2024-09-12T00:05:01.515 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.515 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.515 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:01.515 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577512+0000", 2024-09-12T00:05:01.515 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7215999999999999e-05 2024-09-12T00:05:01.516 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.516 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.516 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:01.516 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577616+0000", 2024-09-12T00:05:01.516 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103304 2024-09-12T00:05:01.516 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.516 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.516 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:01.517 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577649+0000", 2024-09-12T00:05:01.517 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3695999999999997e-05 2024-09-12T00:05:01.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.517 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.517 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:01.517 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.588945+0000", 2024-09-12T00:05:01.517 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011295556 2024-09-12T00:05:01.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.517 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.517 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:01.517 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.588993+0000", 2024-09-12T00:05:01.517 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8412999999999999e-05 2024-09-12T00:05:01.517 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.518 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:01.518 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.518 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.518 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.518 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2702 3.3c 3:3d6a0b3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:01.518 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.626588+0000", 2024-09-12T00:05:01.518 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.819250207, 2024-09-12T00:05:01.518 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018349791000000001, 2024-09-12T00:05:01.518 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:01.518 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:01.518 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:01.519 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:01.519 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:01.519 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:01.519 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2702 2024-09-12T00:05:01.519 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.519 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:01.519 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.519 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:01.520 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.626588+0000", 2024-09-12T00:05:01.520 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.520 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.520 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.520 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:01.520 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.626588+0000", 2024-09-12T00:05:01.520 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.626591+0000", 2024-09-12T00:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0469999999999998e-06 2024-09-12T00:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.627983+0000", 2024-09-12T00:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001391541 2024-09-12T00:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:01.522 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628016+0000", 2024-09-12T00:05:01.522 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3556999999999997e-05 2024-09-12T00:05:01.522 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.522 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.522 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:01.522 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628035+0000", 2024-09-12T00:05:01.522 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9162999999999999e-05 2024-09-12T00:05:01.522 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.522 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.522 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:01.522 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628108+0000", 2024-09-12T00:05:01.522 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2336999999999995e-05 2024-09-12T00:05:01.523 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.523 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.523 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:01.523 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628237+0000", 2024-09-12T00:05:01.523 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000128706 2024-09-12T00:05:01.523 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.523 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.523 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:01.523 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628329+0000", 2024-09-12T00:05:01.523 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2761000000000002e-05 2024-09-12T00:05:01.523 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.524 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.524 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:01.524 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.632309+0000", 2024-09-12T00:05:01.524 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003979692 2024-09-12T00:05:01.524 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.524 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.524 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:01.524 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.644845+0000", 2024-09-12T00:05:01.524 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012536112 2024-09-12T00:05:01.524 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.524 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.525 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:01.525 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.644898+0000", 2024-09-12T00:05:01.525 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.329e-05 2024-09-12T00:05:01.525 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.525 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.525 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:01.525 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.644938+0000", 2024-09-12T00:05:01.526 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9585000000000001e-05 2024-09-12T00:05:01.526 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.526 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:01.526 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.526 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.526 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.526 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2716 3.20 3:042f7231:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:01.526 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.766936+0000", 2024-09-12T00:05:01.527 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.678902074, 2024-09-12T00:05:01.527 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025751422999999999, 2024-09-12T00:05:01.527 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:01.527 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:01.527 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:01.527 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:01.527 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:01.527 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:01.527 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2716 2024-09-12T00:05:01.528 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.528 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:01.528 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.528 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:01.528 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766936+0000", 2024-09-12T00:05:01.528 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.528 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.529 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.529 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:01.529 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766936+0000", 2024-09-12T00:05:01.529 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.529 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.529 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.529 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:01.529 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766939+0000", 2024-09-12T00:05:01.529 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8499999999999998e-06 2024-09-12T00:05:01.529 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.529 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.529 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:01.530 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769471+0000", 2024-09-12T00:05:01.530 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025320780000000001 2024-09-12T00:05:01.530 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.530 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.530 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:01.530 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769506+0000", 2024-09-12T00:05:01.530 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4842999999999998e-05 2024-09-12T00:05:01.530 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.530 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.530 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:01.530 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769522+0000", 2024-09-12T00:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5548000000000001e-05 2024-09-12T00:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769602+0000", 2024-09-12T00:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0291999999999996e-05 2024-09-12T00:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769726+0000", 2024-09-12T00:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012447900000000001 2024-09-12T00:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:01.532 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769833+0000", 2024-09-12T00:05:01.532 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010621899999999999 2024-09-12T00:05:01.532 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.532 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.532 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:01.532 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.775790+0000", 2024-09-12T00:05:01.532 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0059571529999999998 2024-09-12T00:05:01.532 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.532 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.532 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:01.532 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.792589+0000", 2024-09-12T00:05:01.532 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016799445 2024-09-12T00:05:01.533 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.533 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.533 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:01.533 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.792634+0000", 2024-09-12T00:05:01.533 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4543999999999999e-05 2024-09-12T00:05:01.533 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.533 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.533 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:01.533 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.792688+0000", 2024-09-12T00:05:01.533 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3971999999999998e-05 2024-09-12T00:05:01.534 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.534 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:01.534 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.534 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.534 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.534 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2719 3.1 e63/23 3:83b62cc7:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_204:head v 63'9, mlcod=63'7)", 2024-09-12T00:05:01.534 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.801392+0000", 2024-09-12T00:05:01.534 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.644446377, 2024-09-12T00:05:01.534 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014562542, 2024-09-12T00:05:01.534 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:01.534 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:01.534 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:01.535 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:01.535 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.535 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:01.535 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.801392+0000", 2024-09-12T00:05:01.535 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.535 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.535 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.535 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:01.535 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.801392+0000", 2024-09-12T00:05:01.536 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.536 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.536 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.536 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:01.536 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.801394+0000", 2024-09-12T00:05:01.536 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0090000000000002e-06 2024-09-12T00:05:01.536 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.536 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.536 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:01.536 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807832+0000", 2024-09-12T00:05:01.536 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064375989999999996 2024-09-12T00:05:01.537 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.537 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.537 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:01.537 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807863+0000", 2024-09-12T00:05:01.537 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1114000000000001e-05 2024-09-12T00:05:01.537 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.537 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.537 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:01.537 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807877+0000", 2024-09-12T00:05:01.538 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4386000000000001e-05 2024-09-12T00:05:01.538 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.538 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.538 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:01.538 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807948+0000", 2024-09-12T00:05:01.538 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1055000000000003e-05 2024-09-12T00:05:01.538 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.538 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.538 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:01.538 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807965+0000", 2024-09-12T00:05:01.538 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7025999999999999e-05 2024-09-12T00:05:01.538 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.538 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.539 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:01.539 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.815469+0000", 2024-09-12T00:05:01.539 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075039979999999996 2024-09-12T00:05:01.539 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.539 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.539 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:01.539 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.815955+0000", 2024-09-12T00:05:01.539 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00048535499999999998 2024-09-12T00:05:01.539 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.539 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:01.539 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.539 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.540 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.540 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2739 3.3a 3:5e74d49c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_224:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:01.540 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.006819+0000", 2024-09-12T00:05:01.540 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.439019518, 2024-09-12T00:05:01.540 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018768888000000001, 2024-09-12T00:05:01.540 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:01.540 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:01.540 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:01.540 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:01.540 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:01.540 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:01.540 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2739 2024-09-12T00:05:01.540 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.006819+0000", 2024-09-12T00:05:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.006819+0000", 2024-09-12T00:05:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.006821+0000", 2024-09-12T00:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5959999999999998e-06 2024-09-12T00:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008558+0000", 2024-09-12T00:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017366840000000001 2024-09-12T00:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008585+0000", 2024-09-12T00:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7129000000000001e-05 2024-09-12T00:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008599+0000", 2024-09-12T00:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.326e-05 2024-09-12T00:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008679+0000", 2024-09-12T00:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0174999999999997e-05 2024-09-12T00:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008800+0000", 2024-09-12T00:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012106499999999999 2024-09-12T00:05:01.544 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.544 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.544 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:01.544 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008921+0000", 2024-09-12T00:05:01.544 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012163900000000001 2024-09-12T00:05:01.544 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.544 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.544 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:01.544 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.015366+0000", 2024-09-12T00:05:01.544 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064442309999999999 2024-09-12T00:05:01.544 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.544 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.544 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:01.545 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.025511+0000", 2024-09-12T00:05:01.545 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010145636 2024-09-12T00:05:01.545 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.545 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.545 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:01.545 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.025555+0000", 2024-09-12T00:05:01.545 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3426000000000001e-05 2024-09-12T00:05:01.545 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.545 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.545 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:01.545 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.025588+0000", 2024-09-12T00:05:01.545 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3046999999999997e-05 2024-09-12T00:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2743 3.16 3:696a1d44:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.046229+0000", 2024-09-12T00:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.399609443999999, 2024-09-12T00:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015475686000000001, 2024-09-12T00:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2743 2024-09-12T00:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.046229+0000", 2024-09-12T00:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.046229+0000", 2024-09-12T00:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.046232+0000", 2024-09-12T00:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.802e-06 2024-09-12T00:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047565+0000", 2024-09-12T00:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0013334670000000001 2024-09-12T00:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047600+0000", 2024-09-12T00:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4431000000000003e-05 2024-09-12T00:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047616+0000", 2024-09-12T00:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5928999999999999e-05 2024-09-12T00:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047703+0000", 2024-09-12T00:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7557000000000002e-05 2024-09-12T00:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047863+0000", 2024-09-12T00:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015991700000000001 2024-09-12T00:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047993+0000", 2024-09-12T00:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000129591 2024-09-12T00:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.058764+0000", 2024-09-12T00:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010770956 2024-09-12T00:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.061632+0000", 2024-09-12T00:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0028681639999999999 2024-09-12T00:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.061675+0000", 2024-09-12T00:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3288999999999998e-05 2024-09-12T00:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.061705+0000", 2024-09-12T00:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9583000000000001e-05 2024-09-12T00:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.552 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2744 3.20 3:0785dd58:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:01.552 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.057454+0000", 2024-09-12T00:05:01.552 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.388384391000001, 2024-09-12T00:05:01.552 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018728709, 2024-09-12T00:05:01.552 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:01.552 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:01.552 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:01.552 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:01.552 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:01.552 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:01.552 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2744 2024-09-12T00:05:01.552 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.553 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:01.553 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.553 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:01.553 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.057454+0000", 2024-09-12T00:05:01.553 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.553 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.553 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.553 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:01.553 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.057454+0000", 2024-09-12T00:05:01.553 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.553 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.553 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.057457+0000", 2024-09-12T00:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6680000000000001e-06 2024-09-12T00:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059191+0000", 2024-09-12T00:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001734766 2024-09-12T00:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059216+0000", 2024-09-12T00:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4933e-05 2024-09-12T00:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059230+0000", 2024-09-12T00:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3737000000000001e-05 2024-09-12T00:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059310+0000", 2024-09-12T00:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0086999999999994e-05 2024-09-12T00:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059415+0000", 2024-09-12T00:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010509 2024-09-12T00:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059521+0000", 2024-09-12T00:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105454 2024-09-12T00:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.066050+0000", 2024-09-12T00:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0065290620000000004 2024-09-12T00:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.076044+0000", 2024-09-12T00:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0099942539999999993 2024-09-12T00:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.076123+0000", 2024-09-12T00:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8980000000000006e-05 2024-09-12T00:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.076183+0000", 2024-09-12T00:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9678e-05 2024-09-12T00:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2752 3.5 3:a07c0cce:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.145032+0000", 2024-09-12T00:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.300806746999999, 2024-09-12T00:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017073703999999999, 2024-09-12T00:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2752 2024-09-12T00:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.145032+0000", 2024-09-12T00:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.145032+0000", 2024-09-12T00:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.145035+0000", 2024-09-12T00:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1810000000000001e-06 2024-09-12T00:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.146817+0000", 2024-09-12T00:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017823439999999999 2024-09-12T00:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.146860+0000", 2024-09-12T00:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2549999999999997e-05 2024-09-12T00:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.146880+0000", 2024-09-12T00:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9947000000000001e-05 2024-09-12T00:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.146984+0000", 2024-09-12T00:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104503 2024-09-12T00:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.147170+0000", 2024-09-12T00:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018568100000000001 2024-09-12T00:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.147326+0000", 2024-09-12T00:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000155993 2024-09-12T00:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.154513+0000", 2024-09-12T00:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071872910000000002 2024-09-12T00:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.162030+0000", 2024-09-12T00:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075170030000000004 2024-09-12T00:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.162071+0000", 2024-09-12T00:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0834999999999998e-05 2024-09-12T00:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.162105+0000", 2024-09-12T00:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4375999999999997e-05 2024-09-12T00:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2760 3.5 3:a26ca13d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_245:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.273495+0000", 2024-09-12T00:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.172342869, 2024-09-12T00:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014619127000000001, 2024-09-12T00:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2760 2024-09-12T00:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.273495+0000", 2024-09-12T00:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.273495+0000", 2024-09-12T00:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.273499+0000", 2024-09-12T00:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3100000000000001e-06 2024-09-12T00:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275445+0000", 2024-09-12T00:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001946454 2024-09-12T00:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275468+0000", 2024-09-12T00:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2768999999999998e-05 2024-09-12T00:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275481+0000", 2024-09-12T00:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3302000000000001e-05 2024-09-12T00:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275549+0000", 2024-09-12T00:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7220999999999999e-05 2024-09-12T00:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275676+0000", 2024-09-12T00:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012752 2024-09-12T00:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275766+0000", 2024-09-12T00:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9577e-05 2024-09-12T00:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.281827+0000", 2024-09-12T00:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0060609970000000003 2024-09-12T00:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.287996+0000", 2024-09-12T00:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061689359999999999 2024-09-12T00:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.288061+0000", 2024-09-12T00:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5519999999999996e-05 2024-09-12T00:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.288115+0000", 2024-09-12T00:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3520999999999998e-05 2024-09-12T00:05:01.569 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.569 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:01.569 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.569 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:01.569 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:01.569 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:01.570 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:05:01.571 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:01.569+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:01.626 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T00:05:01.672 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:01.669+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:01.736 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:01.736 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:01.736 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:05:01.736 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:01.749 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:05:01.801 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:01.804+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:01.873 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:01.876+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:01.877 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:01.877 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:01.877 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:05:01.877 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:05:01.877 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:01.898 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:05:01.975 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:01.973+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:02.076 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:02.076 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:05:02.076 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:05:02.076 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:05:02.076 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.076 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4232.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-12T00:05:02.076 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:05:02.077 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 105.526675901, 2024-09-12T00:05:02.077 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.049385680000000001, 2024-09-12T00:05:02.077 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:02.077 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:02.077 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.077 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:02.077 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4232", 2024-09-12T00:05:02.077 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/3037249369", 2024-09-12T00:05:02.077 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:05:02.077 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.077 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:02.077 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.077 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548454+0000", 2024-09-12T00:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2259999999999999e-06 2024-09-12T00:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548466+0000", 2024-09-12T00:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1361e-05 2024-09-12T00:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548492+0000", 2024-09-12T00:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6225999999999999e-05 2024-09-12T00:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548509+0000", 2024-09-12T00:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7452000000000002e-05 2024-09-12T00:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549371+0000", 2024-09-12T00:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00086204300000000005 2024-09-12T00:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549396+0000", 2024-09-12T00:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.51e-05 2024-09-12T00:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593253+0000", 2024-09-12T00:05:02.081 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.043856248 2024-09-12T00:05:02.081 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.081 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.081 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:02.081 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593517+0000", 2024-09-12T00:05:02.081 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026439299999999997 2024-09-12T00:05:02.081 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.081 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.081 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:02.081 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594046+0000", 2024-09-12T00:05:02.081 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00052854200000000001 2024-09-12T00:05:02.081 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.081 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.082 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.082 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597642+0000", 2024-09-12T00:05:02.082 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0035959070000000002 2024-09-12T00:05:02.082 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.082 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.083 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:02.083 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597670+0000", 2024-09-12T00:05:02.083 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8235999999999999e-05 2024-09-12T00:05:02.083 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.083 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.083 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:02.083 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597754+0000", 2024-09-12T00:05:02.084 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4009000000000002e-05 2024-09-12T00:05:02.084 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.084 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.084 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:02.084 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597833+0000", 2024-09-12T00:05:02.084 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8937000000000007e-05 2024-09-12T00:05:02.084 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.084 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:02.084 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.084 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.084 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.084 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T00:05:02.084 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:05:02.085 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 92.745466132999994, 2024-09-12T00:05:02.085 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025928692999999999, 2024-09-12T00:05:02.085 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:02.085 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:02.085 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "reached pg", 2024-09-12T00:05:02.085 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:02.085 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:02.085 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.085 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 43 2024-09-12T00:05:02.085 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.085 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:02.085 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329660+0000", 2024-09-12T00:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.965e-06 2024-09-12T00:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329673+0000", 2024-09-12T00:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3402e-05 2024-09-12T00:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329706+0000", 2024-09-12T00:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2441000000000003e-05 2024-09-12T00:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329723+0000", 2024-09-12T00:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7609e-05 2024-09-12T00:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330437+0000", 2024-09-12T00:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00071403500000000002 2024-09-12T00:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330454+0000", 2024-09-12T00:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6820000000000002e-05 2024-09-12T00:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347344+0000", 2024-09-12T00:05:02.089 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016890275 2024-09-12T00:05:02.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.089 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.089 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:05:02.089 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347365+0000", 2024-09-12T00:05:02.089 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0350999999999999e-05 2024-09-12T00:05:02.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.089 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.089 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.089 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355323+0000", 2024-09-12T00:05:02.089 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079579400000000002 2024-09-12T00:05:02.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.089 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355585+0000", 2024-09-12T00:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026285499999999999 2024-09-12T00:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1641 3.26 e58/23 3:658fe58e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2__shadow_.hDHTDpIswwqRA2bHiHVxkhWqZde6XEj_1:head v 58'1, mlcod=0'0)", 2024-09-12T00:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 29.01610763, 2024-09-12T00:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014950144, 2024-09-12T00:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:02.092 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059017+0000", 2024-09-12T00:05:02.092 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.508e-06 2024-09-12T00:05:02.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.092 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.092 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:02.092 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061582+0000", 2024-09-12T00:05:02.092 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025654010000000001 2024-09-12T00:05:02.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.092 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.092 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:02.092 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061607+0000", 2024-09-12T00:05:02.092 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5028000000000002e-05 2024-09-12T00:05:02.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.093 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.093 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.093 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061619+0000", 2024-09-12T00:05:02.093 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1905999999999999e-05 2024-09-12T00:05:02.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.093 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.093 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.093 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061696+0000", 2024-09-12T00:05:02.093 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7305999999999995e-05 2024-09-12T00:05:02.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.093 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.093 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061717+0000", 2024-09-12T00:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0380000000000001e-05 2024-09-12T00:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073925+0000", 2024-09-12T00:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012208088000000001 2024-09-12T00:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073965+0000", 2024-09-12T00:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0527e-05 2024-09-12T00:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1775 3.30 3:0c2ae78d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:05:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:05:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 28.076270311999998, 2024-09-12T00:05:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020783729000000001, 2024-09-12T00:05:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1775 2024-09-12T00:05:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:05:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:05:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998856+0000", 2024-09-12T00:05:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6849999999999999e-06 2024-09-12T00:05:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001327+0000", 2024-09-12T00:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024706279999999999 2024-09-12T00:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001355+0000", 2024-09-12T00:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8419999999999999e-05 2024-09-12T00:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001366+0000", 2024-09-12T00:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1073999999999999e-05 2024-09-12T00:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001438+0000", 2024-09-12T00:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1389000000000004e-05 2024-09-12T00:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001548+0000", 2024-09-12T00:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110612 2024-09-12T00:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001639+0000", 2024-09-12T00:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0192999999999995e-05 2024-09-12T00:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019057+0000", 2024-09-12T00:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017418411000000002 2024-09-12T00:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019528+0000", 2024-09-12T00:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00047075699999999998 2024-09-12T00:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019577+0000", 2024-09-12T00:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8714999999999997e-05 2024-09-12T00:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019636+0000", 2024-09-12T00:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9845e-05 2024-09-12T00:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1780 3.16 e58/23 3:69d8ee52:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3_10Mb.:head v 58'1, mlcod=0'0)", 2024-09-12T00:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 28.04997702, 2024-09-12T00:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01408911, 2024-09-12T00:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025148+0000", 2024-09-12T00:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4229999999999999e-06 2024-09-12T00:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026337+0000", 2024-09-12T00:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011890589999999999 2024-09-12T00:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026362+0000", 2024-09-12T00:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4566000000000002e-05 2024-09-12T00:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026372+0000", 2024-09-12T00:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8509999999999994e-06 2024-09-12T00:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026448+0000", 2024-09-12T00:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6626999999999997e-05 2024-09-12T00:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026473+0000", 2024-09-12T00:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4647e-05 2024-09-12T00:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039120+0000", 2024-09-12T00:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012647122 2024-09-12T00:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039235+0000", 2024-09-12T00:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000114815 2024-09-12T00:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2648 3.13 3:c936a360:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.164782+0000", 2024-09-12T00:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.910340733, 2024-09-12T00:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019628063000000001, 2024-09-12T00:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2648 2024-09-12T00:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.164782+0000", 2024-09-12T00:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.164782+0000", 2024-09-12T00:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.164786+0000", 2024-09-12T00:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3450000000000002e-06 2024-09-12T00:05:02.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.108 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.108 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:02.108 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166758+0000", 2024-09-12T00:05:02.108 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019721629999999999 2024-09-12T00:05:02.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.108 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.108 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:02.108 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166785+0000", 2024-09-12T00:05:02.108 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7676000000000001e-05 2024-09-12T00:05:02.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.108 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.108 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166799+0000", 2024-09-12T00:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3716e-05 2024-09-12T00:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166895+0000", 2024-09-12T00:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6243999999999995e-05 2024-09-12T00:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.167092+0000", 2024-09-12T00:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019639200000000001 2024-09-12T00:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.167273+0000", 2024-09-12T00:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000181533 2024-09-12T00:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.174331+0000", 2024-09-12T00:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0070577879999999997 2024-09-12T00:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.184172+0000", 2024-09-12T00:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0098409469999999992 2024-09-12T00:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.184238+0000", 2024-09-12T00:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6036000000000003e-05 2024-09-12T00:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.184410+0000", 2024-09-12T00:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017222299999999999 2024-09-12T00:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2659 3.2d 3:b4a71344:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.285246+0000", 2024-09-12T00:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.789876830000001, 2024-09-12T00:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020000217000000001, 2024-09-12T00:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2659 2024-09-12T00:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.285246+0000", 2024-09-12T00:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.285246+0000", 2024-09-12T00:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.285249+0000", 2024-09-12T00:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3890000000000001e-06 2024-09-12T00:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.114 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.114 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:02.114 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287047+0000", 2024-09-12T00:05:02.114 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017978099999999999 2024-09-12T00:05:02.114 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.114 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.114 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:02.114 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287084+0000", 2024-09-12T00:05:02.114 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6358e-05 2024-09-12T00:05:02.114 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287101+0000", 2024-09-12T00:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7815000000000001e-05 2024-09-12T00:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287198+0000", 2024-09-12T00:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6482000000000002e-05 2024-09-12T00:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287337+0000", 2024-09-12T00:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013917500000000001 2024-09-12T00:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.116 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.116 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:02.116 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287451+0000", 2024-09-12T00:05:02.117 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000113962 2024-09-12T00:05:02.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.117 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.117 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:02.117 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.293889+0000", 2024-09-12T00:05:02.117 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064380110000000004 2024-09-12T00:05:02.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.117 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.117 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.117 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.305119+0000", 2024-09-12T00:05:02.117 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011229872 2024-09-12T00:05:02.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.117 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.305191+0000", 2024-09-12T00:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2002000000000006e-05 2024-09-12T00:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.305246+0000", 2024-09-12T00:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5340999999999998e-05 2024-09-12T00:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2662 3.28 3:1791a19e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.317519+0000", 2024-09-12T00:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.757603882, 2024-09-12T00:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016495961999999999, 2024-09-12T00:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2662 2024-09-12T00:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:02.120 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317519+0000", 2024-09-12T00:05:02.120 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.120 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317519+0000", 2024-09-12T00:05:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317522+0000", 2024-09-12T00:05:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7389999999999999e-06 2024-09-12T00:05:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319683+0000", 2024-09-12T00:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021614970000000001 2024-09-12T00:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319715+0000", 2024-09-12T00:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1574e-05 2024-09-12T00:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319730+0000", 2024-09-12T00:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5543e-05 2024-09-12T00:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.123 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.123 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319820+0000", 2024-09-12T00:05:02.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9402999999999998e-05 2024-09-12T00:05:02.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.123 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.123 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:02.123 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319976+0000", 2024-09-12T00:05:02.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015662900000000001 2024-09-12T00:05:02.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.123 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.123 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:02.123 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.320143+0000", 2024-09-12T00:05:02.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000166207 2024-09-12T00:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.327504+0000", 2024-09-12T00:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0073616189999999998 2024-09-12T00:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.333886+0000", 2024-09-12T00:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063817650000000002 2024-09-12T00:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.333952+0000", 2024-09-12T00:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5889999999999994e-05 2024-09-12T00:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.334015+0000", 2024-09-12T00:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3095999999999994e-05 2024-09-12T00:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2664 3.1d 3:b8bd1b2d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.341755+0000", 2024-09-12T00:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.733368026000001, 2024-09-12T00:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017365477000000001, 2024-09-12T00:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2664 2024-09-12T00:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.341755+0000", 2024-09-12T00:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.341755+0000", 2024-09-12T00:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.341758+0000", 2024-09-12T00:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6560000000000001e-06 2024-09-12T00:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343741+0000", 2024-09-12T00:05:02.128 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019832389999999999 2024-09-12T00:05:02.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.128 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.128 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:02.128 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343766+0000", 2024-09-12T00:05:02.128 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4967e-05 2024-09-12T00:05:02.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.128 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.128 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.128 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343776+0000", 2024-09-12T00:05:02.128 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0686000000000001e-05 2024-09-12T00:05:02.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.128 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343854+0000", 2024-09-12T00:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7210000000000001e-05 2024-09-12T00:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.344027+0000", 2024-09-12T00:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000173065 2024-09-12T00:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.344194+0000", 2024-09-12T00:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016688900000000001 2024-09-12T00:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.358530+0000", 2024-09-12T00:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014336877 2024-09-12T00:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.359009+0000", 2024-09-12T00:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00047882099999999999 2024-09-12T00:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.359069+0000", 2024-09-12T00:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9892999999999997e-05 2024-09-12T00:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.359120+0000", 2024-09-12T00:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1174000000000002e-05 2024-09-12T00:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2666 3.13 3:cbd43ea3:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.362905+0000", 2024-09-12T00:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.712217644000001, 2024-09-12T00:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017815950000000001, 2024-09-12T00:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2666 2024-09-12T00:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.362905+0000", 2024-09-12T00:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.362905+0000", 2024-09-12T00:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.362909+0000", 2024-09-12T00:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4529999999999998e-06 2024-09-12T00:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364466+0000", 2024-09-12T00:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015570060000000001 2024-09-12T00:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364500+0000", 2024-09-12T00:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4289999999999999e-05 2024-09-12T00:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364515+0000", 2024-09-12T00:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4537e-05 2024-09-12T00:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364615+0000", 2024-09-12T00:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100782 2024-09-12T00:05:02.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.135 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.135 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:02.135 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364805+0000", 2024-09-12T00:05:02.135 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018921399999999999 2024-09-12T00:05:02.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.135 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.135 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:02.135 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364984+0000", 2024-09-12T00:05:02.135 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017972299999999999 2024-09-12T00:05:02.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.135 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.135 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.372042+0000", 2024-09-12T00:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0070581120000000001 2024-09-12T00:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.380620+0000", 2024-09-12T00:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085774309999999999 2024-09-12T00:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.380666+0000", 2024-09-12T00:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5881000000000003e-05 2024-09-12T00:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.380721+0000", 2024-09-12T00:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5520999999999999e-05 2024-09-12T00:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2677 3.13 3:c9d59693:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.474053+0000", 2024-09-12T00:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.601070297, 2024-09-12T00:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017985961000000002, 2024-09-12T00:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2677 2024-09-12T00:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.474053+0000", 2024-09-12T00:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:02.139 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.474053+0000", 2024-09-12T00:05:02.139 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.139 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.139 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.139 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:02.139 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.474055+0000", 2024-09-12T00:05:02.139 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.711e-06 2024-09-12T00:05:02.139 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.139 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.139 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:02.139 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475342+0000", 2024-09-12T00:05:02.139 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001286508 2024-09-12T00:05:02.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.140 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.140 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:02.140 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475373+0000", 2024-09-12T00:05:02.140 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1130000000000002e-05 2024-09-12T00:05:02.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.140 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.140 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.140 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475387+0000", 2024-09-12T00:05:02.140 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4280999999999999e-05 2024-09-12T00:05:02.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.140 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.140 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475476+0000", 2024-09-12T00:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8621000000000004e-05 2024-09-12T00:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475644+0000", 2024-09-12T00:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016785699999999999 2024-09-12T00:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475742+0000", 2024-09-12T00:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8016000000000005e-05 2024-09-12T00:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.480305+0000", 2024-09-12T00:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045629049999999999 2024-09-12T00:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.491948+0000", 2024-09-12T00:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011643280000000001 2024-09-12T00:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.492000+0000", 2024-09-12T00:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2482000000000003e-05 2024-09-12T00:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.492039+0000", 2024-09-12T00:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8170000000000002e-05 2024-09-12T00:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2691 3.2d 3:b4a2284d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.515274+0000", 2024-09-12T00:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.559849241, 2024-09-12T00:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018577757, 2024-09-12T00:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:02.144 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:02.144 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.144 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:02.144 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:02.144 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.144 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2691 2024-09-12T00:05:02.144 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.144 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:02.144 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.144 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:02.144 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.515274+0000", 2024-09-12T00:05:02.144 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.144 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.515274+0000", 2024-09-12T00:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.515276+0000", 2024-09-12T00:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3499999999999999e-06 2024-09-12T00:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.516900+0000", 2024-09-12T00:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001623633 2024-09-12T00:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.516929+0000", 2024-09-12T00:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9009999999999998e-05 2024-09-12T00:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.516942+0000", 2024-09-12T00:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3551e-05 2024-09-12T00:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.517022+0000", 2024-09-12T00:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0167999999999995e-05 2024-09-12T00:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.517216+0000", 2024-09-12T00:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000193919 2024-09-12T00:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.517380+0000", 2024-09-12T00:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016336000000000001 2024-09-12T00:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.522907+0000", 2024-09-12T00:05:02.148 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055276420000000001 2024-09-12T00:05:02.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.148 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.148 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.148 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.533735+0000", 2024-09-12T00:05:02.148 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010827997000000001 2024-09-12T00:05:02.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.148 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.148 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:02.148 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.533800+0000", 2024-09-12T00:05:02.148 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4738000000000003e-05 2024-09-12T00:05:02.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.148 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.533851+0000", 2024-09-12T00:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1388999999999999e-05 2024-09-12T00:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2697 3.13 3:c87ccb22:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.577849+0000", 2024-09-12T00:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.497273921, 2024-09-12T00:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019139156000000001, 2024-09-12T00:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:02.150 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.150 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:02.150 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:02.150 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.150 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2697 2024-09-12T00:05:02.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.150 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577849+0000", 2024-09-12T00:05:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577849+0000", 2024-09-12T00:05:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577853+0000", 2024-09-12T00:05:02.152 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7510000000000002e-06 2024-09-12T00:05:02.152 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.152 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.152 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:02.152 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579595+0000", 2024-09-12T00:05:02.152 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001741954 2024-09-12T00:05:02.152 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.152 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.152 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:02.152 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579625+0000", 2024-09-12T00:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9907999999999999e-05 2024-09-12T00:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579640+0000", 2024-09-12T00:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4894e-05 2024-09-12T00:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579728+0000", 2024-09-12T00:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8704999999999999e-05 2024-09-12T00:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579922+0000", 2024-09-12T00:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000194019 2024-09-12T00:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.580092+0000", 2024-09-12T00:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016984300000000001 2024-09-12T00:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.591944+0000", 2024-09-12T00:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011852252000000001 2024-09-12T00:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.596913+0000", 2024-09-12T00:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049688279999999998 2024-09-12T00:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.596955+0000", 2024-09-12T00:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2290999999999999e-05 2024-09-12T00:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.596988+0000", 2024-09-12T00:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2710999999999999e-05 2024-09-12T00:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2701 3.11 3:8babcc8d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.617191+0000", 2024-09-12T00:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.457932308, 2024-09-12T00:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013760204999999999, 2024-09-12T00:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2701 2024-09-12T00:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.617191+0000", 2024-09-12T00:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.617191+0000", 2024-09-12T00:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.617194+0000", 2024-09-12T00:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.788e-06 2024-09-12T00:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618652+0000", 2024-09-12T00:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001457716 2024-09-12T00:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618682+0000", 2024-09-12T00:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9668000000000001e-05 2024-09-12T00:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618692+0000", 2024-09-12T00:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0429e-05 2024-09-12T00:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618766+0000", 2024-09-12T00:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4190999999999995e-05 2024-09-12T00:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618932+0000", 2024-09-12T00:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000165923 2024-09-12T00:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.619026+0000", 2024-09-12T00:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3906999999999994e-05 2024-09-12T00:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.623168+0000", 2024-09-12T00:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041419309999999997 2024-09-12T00:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.630815+0000", 2024-09-12T00:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0076470100000000001 2024-09-12T00:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.630887+0000", 2024-09-12T00:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2218999999999994e-05 2024-09-12T00:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.630951+0000", 2024-09-12T00:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3423000000000006e-05 2024-09-12T00:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2704 3.13 3:c90afc39:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.647542+0000", 2024-09-12T00:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.427580445, 2024-09-12T00:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017595339000000002, 2024-09-12T00:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2704 2024-09-12T00:05:02.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.163 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:02.163 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.163 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:02.163 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.647542+0000", 2024-09-12T00:05:02.163 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.163 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.163 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:02.163 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.647542+0000", 2024-09-12T00:05:02.163 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.647544+0000", 2024-09-12T00:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6339999999999999e-06 2024-09-12T00:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649032+0000", 2024-09-12T00:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001488063 2024-09-12T00:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649053+0000", 2024-09-12T00:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0761e-05 2024-09-12T00:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649066+0000", 2024-09-12T00:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2597e-05 2024-09-12T00:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649142+0000", 2024-09-12T00:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6254999999999994e-05 2024-09-12T00:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649250+0000", 2024-09-12T00:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010774500000000001 2024-09-12T00:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649364+0000", 2024-09-12T00:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000114401 2024-09-12T00:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.658970+0000", 2024-09-12T00:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0096065260000000006 2024-09-12T00:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.665022+0000", 2024-09-12T00:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0060516459999999999 2024-09-12T00:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.665086+0000", 2024-09-12T00:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3940000000000001e-05 2024-09-12T00:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.665138+0000", 2024-09-12T00:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1771000000000003e-05 2024-09-12T00:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:02.168 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.168 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.168 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.168 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2706 3.d 3:b1b5d8c6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.168 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.667263+0000", 2024-09-12T00:05:02.168 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.407859491, 2024-09-12T00:05:02.168 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017030099999999999, 2024-09-12T00:05:02.168 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:02.168 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:02.168 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.168 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:02.168 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2706 2024-09-12T00:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.667263+0000", 2024-09-12T00:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.667263+0000", 2024-09-12T00:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.667267+0000", 2024-09-12T00:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1540000000000002e-06 2024-09-12T00:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672789+0000", 2024-09-12T00:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055222819999999999 2024-09-12T00:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672817+0000", 2024-09-12T00:05:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8510999999999999e-05 2024-09-12T00:05:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672831+0000", 2024-09-12T00:05:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3919e-05 2024-09-12T00:05:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672988+0000", 2024-09-12T00:05:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015688 2024-09-12T00:05:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.673174+0000", 2024-09-12T00:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018615400000000001 2024-09-12T00:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.673352+0000", 2024-09-12T00:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017803599999999999 2024-09-12T00:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.683897+0000", 2024-09-12T00:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010544239 2024-09-12T00:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.684176+0000", 2024-09-12T00:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000279506 2024-09-12T00:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.684235+0000", 2024-09-12T00:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9101000000000002e-05 2024-09-12T00:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.684294+0000", 2024-09-12T00:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8318e-05 2024-09-12T00:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2714 3.17 e63/23 3:eac65a57:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_199:head v 63'3, mlcod=62'1)", 2024-09-12T00:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.752259+0000", 2024-09-12T00:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.322863956999999, 2024-09-12T00:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013747212, 2024-09-12T00:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.752259+0000", 2024-09-12T00:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.752259+0000", 2024-09-12T00:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.752261+0000", 2024-09-12T00:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2390000000000001e-06 2024-09-12T00:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.176 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.176 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:02.176 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757723+0000", 2024-09-12T00:05:02.176 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054619569999999999 2024-09-12T00:05:02.176 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.176 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.176 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:02.176 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757749+0000", 2024-09-12T00:05:02.176 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5732999999999999e-05 2024-09-12T00:05:02.176 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.176 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.176 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.176 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757762+0000", 2024-09-12T00:05:02.177 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3556e-05 2024-09-12T00:05:02.177 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.177 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.177 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.177 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757841+0000", 2024-09-12T00:05:02.177 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8644000000000001e-05 2024-09-12T00:05:02.177 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.177 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.177 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:02.177 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757864+0000", 2024-09-12T00:05:02.177 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3112000000000002e-05 2024-09-12T00:05:02.177 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.177 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.765956+0000", 2024-09-12T00:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080919679999999997 2024-09-12T00:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766006+0000", 2024-09-12T00:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0003000000000002e-05 2024-09-12T00:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2742 3.1d 3:b8ae26ad:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.035857+0000", 2024-09-12T00:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.039266274999999, 2024-09-12T00:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025139262999999998, 2024-09-12T00:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2742 2024-09-12T00:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.035857+0000", 2024-09-12T00:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.035857+0000", 2024-09-12T00:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.035859+0000", 2024-09-12T00:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0899999999999999e-06 2024-09-12T00:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.181 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.181 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:02.181 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038486+0000", 2024-09-12T00:05:02.181 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026273749999999999 2024-09-12T00:05:02.181 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.181 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.181 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:02.181 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038511+0000", 2024-09-12T00:05:02.181 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5327e-05 2024-09-12T00:05:02.181 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.181 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.181 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.181 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038527+0000", 2024-09-12T00:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5196e-05 2024-09-12T00:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038604+0000", 2024-09-12T00:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6921000000000004e-05 2024-09-12T00:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038789+0000", 2024-09-12T00:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018526400000000001 2024-09-12T00:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.039001+0000", 2024-09-12T00:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021200400000000001 2024-09-12T00:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.056879+0000", 2024-09-12T00:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017877783000000001 2024-09-12T00:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.060872+0000", 2024-09-12T00:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039929529999999996 2024-09-12T00:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.184 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:02.184 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.060942+0000", 2024-09-12T00:05:02.184 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0060000000000003e-05 2024-09-12T00:05:02.184 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.184 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.184 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:02.184 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.060996+0000", 2024-09-12T00:05:02.184 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4289999999999997e-05 2024-09-12T00:05:02.184 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.184 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:02.184 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.184 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.184 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2747 3.17 e63/23 3:eaa4528d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_232:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.094555+0000", 2024-09-12T00:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.980567448, 2024-09-12T00:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017679139, 2024-09-12T00:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.094555+0000", 2024-09-12T00:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.094555+0000", 2024-09-12T00:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.094558+0000", 2024-09-12T00:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.232e-06 2024-09-12T00:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098897+0000", 2024-09-12T00:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0043397840000000002 2024-09-12T00:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098930+0000", 2024-09-12T00:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2592000000000002e-05 2024-09-12T00:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098945+0000", 2024-09-12T00:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4759e-05 2024-09-12T00:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.099033+0000", 2024-09-12T00:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8535000000000005e-05 2024-09-12T00:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.099065+0000", 2024-09-12T00:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1825000000000001e-05 2024-09-12T00:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112134+0000", 2024-09-12T00:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013068329 2024-09-12T00:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112235+0000", 2024-09-12T00:05:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010108299999999999 2024-09-12T00:05:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2764 3.2d 3:b7a0f55d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_249:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.325396+0000", 2024-09-12T00:05:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.7497265, 2024-09-12T00:05:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022487040999999999, 2024-09-12T00:05:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2764 2024-09-12T00:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.325396+0000", 2024-09-12T00:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.325396+0000", 2024-09-12T00:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.325400+0000", 2024-09-12T00:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2370000000000001e-06 2024-09-12T00:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328424+0000", 2024-09-12T00:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003024657 2024-09-12T00:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:02.192 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328456+0000", 2024-09-12T00:05:02.192 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1819999999999997e-05 2024-09-12T00:05:02.192 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.192 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.192 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.192 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328476+0000", 2024-09-12T00:05:02.192 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9673999999999998e-05 2024-09-12T00:05:02.192 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.192 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.192 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:02.192 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328567+0000", 2024-09-12T00:05:02.192 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1640999999999999e-05 2024-09-12T00:05:02.192 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328734+0000", 2024-09-12T00:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016619200000000001 2024-09-12T00:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328910+0000", 2024-09-12T00:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017652299999999999 2024-09-12T00:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.333757+0000", 2024-09-12T00:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048465060000000004 2024-09-12T00:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.347806+0000", 2024-09-12T00:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01404908 2024-09-12T00:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.347847+0000", 2024-09-12T00:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1396999999999997e-05 2024-09-12T00:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.347883+0000", 2024-09-12T00:05:02.195 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6313999999999998e-05 2024-09-12T00:05:02.195 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.195 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:02.195 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.195 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:02.195 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:02.195 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:02.195 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:02.076+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:02.196 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:05:02.198 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:02.197+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:02.299 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:02.297+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:02.330 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:02.330 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:02.330 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:02.330 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:02.344 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:05:02.434 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:02.433+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:02.500 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:02.497+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:02.513 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:02.513 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:02.513 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:02.513 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:02.513 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:02.526 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:05:02.601 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:02.600+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:02.700 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:02.700 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:02.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:02.700 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:02.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.700 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2657 3.3c e63/23 3:3e583291:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_152:head v 63'4, mlcod=62'2)", 2024-09-12T00:05:02.700 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:05:02.700 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.432026677, 2024-09-12T00:05:02.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017073642999999999, 2024-09-12T00:05:02.700 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:02.701 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:02.701 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.701 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:02.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:02.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:05:02.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:02.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:05:02.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:02.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266877+0000", 2024-09-12T00:05:02.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3630000000000001e-06 2024-09-12T00:05:02.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:02.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271243+0000", 2024-09-12T00:05:02.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043659730000000004 2024-09-12T00:05:02.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:02.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271279+0000", 2024-09-12T00:05:02.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6334999999999997e-05 2024-09-12T00:05:02.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271296+0000", 2024-09-12T00:05:02.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6619000000000001e-05 2024-09-12T00:05:02.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:02.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271429+0000", 2024-09-12T00:05:02.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133132 2024-09-12T00:05:02.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:02.704 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271468+0000", 2024-09-12T00:05:02.704 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8483999999999999e-05 2024-09-12T00:05:02.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.704 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.704 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:02.704 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.283854+0000", 2024-09-12T00:05:02.704 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012386645999999999 2024-09-12T00:05:02.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.704 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.704 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:02.704 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.283948+0000", 2024-09-12T00:05:02.704 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4091000000000004e-05 2024-09-12T00:05:02.704 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.704 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:02.705 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.705 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2658 3.3a e63/23 3:5ec14981:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_153:head v 63'1, mlcod=0'0)", 2024-09-12T00:05:02.705 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.276052+0000", 2024-09-12T00:05:02.705 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.422849787000001, 2024-09-12T00:05:02.705 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015387336999999999, 2024-09-12T00:05:02.705 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:02.705 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:02.705 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.705 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:02.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.705 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:02.705 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.276052+0000", 2024-09-12T00:05:02.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.706 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:02.706 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.276052+0000", 2024-09-12T00:05:02.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.706 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:02.706 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.276054+0000", 2024-09-12T00:05:02.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3199999999999998e-06 2024-09-12T00:05:02.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.706 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:02.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282165+0000", 2024-09-12T00:05:02.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061108359999999997 2024-09-12T00:05:02.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:02.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282192+0000", 2024-09-12T00:05:02.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7008999999999998e-05 2024-09-12T00:05:02.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282206+0000", 2024-09-12T00:05:02.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4705999999999999e-05 2024-09-12T00:05:02.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.708 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:02.708 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282387+0000", 2024-09-12T00:05:02.708 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018015199999999999 2024-09-12T00:05:02.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.708 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.708 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:02.708 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282426+0000", 2024-09-12T00:05:02.708 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9323999999999998e-05 2024-09-12T00:05:02.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.708 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.708 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:02.708 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291241+0000", 2024-09-12T00:05:02.708 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0088146950000000009 2024-09-12T00:05:02.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.709 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.709 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:02.709 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291439+0000", 2024-09-12T00:05:02.709 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000198295 2024-09-12T00:05:02.709 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.709 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:02.709 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.709 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.709 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2659 3.2d e63/23 3:b4a71344:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_154:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:02.709 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:05:02.709 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.411222383, 2024-09-12T00:05:02.709 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016913793, 2024-09-12T00:05:02.709 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:02.710 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:02.710 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.710 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:02.710 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.710 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:02.710 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:05:02.710 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.710 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.710 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.710 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:02.710 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:05:02.710 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.710 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.710 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.711 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:02.711 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287682+0000", 2024-09-12T00:05:02.711 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9799999999999998e-06 2024-09-12T00:05:02.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.711 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.711 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:02.711 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291872+0000", 2024-09-12T00:05:02.711 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041904070000000002 2024-09-12T00:05:02.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.711 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.711 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:02.711 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291901+0000", 2024-09-12T00:05:02.711 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9017999999999999e-05 2024-09-12T00:05:02.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291917+0000", 2024-09-12T00:05:02.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5775999999999999e-05 2024-09-12T00:05:02.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:02.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.292061+0000", 2024-09-12T00:05:02.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014356800000000001 2024-09-12T00:05:02.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:02.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.292123+0000", 2024-09-12T00:05:02.713 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2799999999999995e-05 2024-09-12T00:05:02.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.713 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.713 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:02.713 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.304456+0000", 2024-09-12T00:05:02.713 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012332865 2024-09-12T00:05:02.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.713 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.713 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:02.713 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.304593+0000", 2024-09-12T00:05:02.713 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000136379 2024-09-12T00:05:02.713 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.714 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:02.714 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.714 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.714 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2667 3.8 3:1177e826:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.714 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:05:02.714 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.325780464999999, 2024-09-12T00:05:02.714 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024306991999999999, 2024-09-12T00:05:02.714 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:02.714 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:02.714 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.714 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:02.714 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:02.715 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.715 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2667 2024-09-12T00:05:02.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.715 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:02.715 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.715 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:02.715 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:05:02.715 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.715 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.715 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:02.715 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:05:02.715 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.716 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.716 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.716 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:02.716 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373124+0000", 2024-09-12T00:05:02.716 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.19e-06 2024-09-12T00:05:02.716 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.716 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.716 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:02.716 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377167+0000", 2024-09-12T00:05:02.716 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040430329999999997 2024-09-12T00:05:02.716 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.716 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.716 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:02.716 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377201+0000", 2024-09-12T00:05:02.717 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3868000000000002e-05 2024-09-12T00:05:02.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.717 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.717 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.717 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377219+0000", 2024-09-12T00:05:02.717 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8019000000000001e-05 2024-09-12T00:05:02.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.717 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.717 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:02.717 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377362+0000", 2024-09-12T00:05:02.717 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000143001 2024-09-12T00:05:02.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.717 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.717 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:02.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377603+0000", 2024-09-12T00:05:02.718 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024115200000000001 2024-09-12T00:05:02.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:02.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377833+0000", 2024-09-12T00:05:02.718 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022952000000000001 2024-09-12T00:05:02.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:02.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.386771+0000", 2024-09-12T00:05:02.718 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0089385739999999995 2024-09-12T00:05:02.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.719 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.719 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397160+0000", 2024-09-12T00:05:02.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010388391 2024-09-12T00:05:02.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.719 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:02.719 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397307+0000", 2024-09-12T00:05:02.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014745099999999999 2024-09-12T00:05:02.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.720 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:02.720 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397428+0000", 2024-09-12T00:05:02.720 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012079299999999999 2024-09-12T00:05:02.720 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.720 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:02.720 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.720 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.721 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2669 3.1b 3:d9b9bd82:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.721 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:05:02.721 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.306103816, 2024-09-12T00:05:02.721 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016867298999999999, 2024-09-12T00:05:02.721 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:02.721 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:02.721 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.721 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:02.721 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:02.721 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.721 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2669 2024-09-12T00:05:02.721 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.721 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:02.721 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.722 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:02.722 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:05:02.722 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.722 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.722 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:02.722 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:05:02.722 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.722 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.722 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:02.722 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392800+0000", 2024-09-12T00:05:02.722 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8629999999999999e-06 2024-09-12T00:05:02.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.723 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:02.723 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396812+0000", 2024-09-12T00:05:02.723 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040120140000000004 2024-09-12T00:05:02.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.723 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:02.723 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396849+0000", 2024-09-12T00:05:02.723 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6291000000000002e-05 2024-09-12T00:05:02.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.723 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.723 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396906+0000", 2024-09-12T00:05:02.723 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7692999999999998e-05 2024-09-12T00:05:02.724 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.724 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.724 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:02.724 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397059+0000", 2024-09-12T00:05:02.724 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015268399999999999 2024-09-12T00:05:02.724 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.724 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.724 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:02.724 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397472+0000", 2024-09-12T00:05:02.725 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041270899999999998 2024-09-12T00:05:02.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.725 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.725 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:02.725 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397697+0000", 2024-09-12T00:05:02.725 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022526299999999999 2024-09-12T00:05:02.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.725 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.725 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:02.725 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.406380+0000", 2024-09-12T00:05:02.725 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086830429999999997 2024-09-12T00:05:02.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.725 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.725 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.726 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409367+0000", 2024-09-12T00:05:02.726 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002987403 2024-09-12T00:05:02.726 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.726 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.726 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:02.726 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409532+0000", 2024-09-12T00:05:02.726 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016417 2024-09-12T00:05:02.726 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.726 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.726 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:02.726 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409665+0000", 2024-09-12T00:05:02.726 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013316599999999999 2024-09-12T00:05:02.726 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.726 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:02.727 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.727 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.727 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.727 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2678 3.2b 3:d57f7217:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.727 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:05:02.727 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.214686368000001, 2024-09-12T00:05:02.727 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018772965999999999, 2024-09-12T00:05:02.727 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:02.727 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:02.727 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.727 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:02.727 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:02.727 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.727 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2678 2024-09-12T00:05:02.728 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.728 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:02.728 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.728 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:02.728 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:05:02.728 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.728 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.728 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.728 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:02.728 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:05:02.728 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.728 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.728 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.729 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:02.729 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484219+0000", 2024-09-12T00:05:02.729 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7299999999999999e-06 2024-09-12T00:05:02.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.729 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.729 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:02.729 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488148+0000", 2024-09-12T00:05:02.729 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039289859999999998 2024-09-12T00:05:02.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.729 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.729 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:02.729 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488214+0000", 2024-09-12T00:05:02.729 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6202000000000001e-05 2024-09-12T00:05:02.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.730 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.730 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.730 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488239+0000", 2024-09-12T00:05:02.730 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4839000000000001e-05 2024-09-12T00:05:02.730 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.730 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.730 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:02.730 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488374+0000", 2024-09-12T00:05:02.730 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000135189 2024-09-12T00:05:02.730 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.730 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.730 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:02.730 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488626+0000", 2024-09-12T00:05:02.730 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025242800000000002 2024-09-12T00:05:02.731 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.731 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.731 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:02.731 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488849+0000", 2024-09-12T00:05:02.731 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022295 2024-09-12T00:05:02.731 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.731 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.731 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:02.731 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498947+0000", 2024-09-12T00:05:02.731 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010098072 2024-09-12T00:05:02.731 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.731 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.731 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.732 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502674+0000", 2024-09-12T00:05:02.732 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037269149999999999 2024-09-12T00:05:02.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.732 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.732 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:02.732 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502856+0000", 2024-09-12T00:05:02.732 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018163599999999999 2024-09-12T00:05:02.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.732 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.732 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:02.732 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502988+0000", 2024-09-12T00:05:02.732 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013201900000000001 2024-09-12T00:05:02.732 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.733 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:02.733 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.733 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.733 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.733 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2691 3.2d e63/23 3:b4a2284d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_176:head v 63'6, mlcod=63'4)", 2024-09-12T00:05:02.733 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:05:02.733 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.181561667, 2024-09-12T00:05:02.733 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015889306999999998, 2024-09-12T00:05:02.733 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:02.733 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:02.733 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.733 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:02.733 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.733 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:02.734 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:05:02.734 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.734 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.734 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:02.734 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:05:02.734 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.734 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.734 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:02.734 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517342+0000", 2024-09-12T00:05:02.734 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3700000000000002e-06 2024-09-12T00:05:02.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.734 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.735 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:02.735 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521776+0000", 2024-09-12T00:05:02.735 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044339790000000002 2024-09-12T00:05:02.735 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.735 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.735 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:02.735 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521806+0000", 2024-09-12T00:05:02.735 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9855000000000001e-05 2024-09-12T00:05:02.735 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.735 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.735 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.735 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521820+0000", 2024-09-12T00:05:02.735 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4496e-05 2024-09-12T00:05:02.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.736 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.736 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:02.736 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521963+0000", 2024-09-12T00:05:02.736 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014277199999999999 2024-09-12T00:05:02.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.736 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.736 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:02.736 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.522029+0000", 2024-09-12T00:05:02.736 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6186000000000006e-05 2024-09-12T00:05:02.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.736 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.736 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:02.736 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.533123+0000", 2024-09-12T00:05:02.737 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011093252 2024-09-12T00:05:02.737 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.737 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.737 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:02.737 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.533229+0000", 2024-09-12T00:05:02.737 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000106397 2024-09-12T00:05:02.737 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.737 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:02.737 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.737 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.737 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.737 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2694 3.3d e63/23 3:bd0bdafc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_179:head v 63'7, mlcod=63'5)", 2024-09-12T00:05:02.737 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:05:02.737 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.146346895000001, 2024-09-12T00:05:02.737 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016398093999999998, 2024-09-12T00:05:02.738 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:02.738 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:02.738 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.738 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:02.738 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.738 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:02.738 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:05:02.738 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.738 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.738 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.738 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:02.738 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:05:02.738 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.738 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.739 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.739 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:02.739 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552558+0000", 2024-09-12T00:05:02.739 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6030000000000001e-06 2024-09-12T00:05:02.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.739 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.739 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:02.739 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556085+0000", 2024-09-12T00:05:02.739 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0035274339999999999 2024-09-12T00:05:02.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.739 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.739 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:02.739 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556126+0000", 2024-09-12T00:05:02.739 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0290999999999998e-05 2024-09-12T00:05:02.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.740 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.740 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.740 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556154+0000", 2024-09-12T00:05:02.740 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7965000000000001e-05 2024-09-12T00:05:02.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.740 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.740 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:02.740 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556298+0000", 2024-09-12T00:05:02.740 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014459799999999999 2024-09-12T00:05:02.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.740 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.740 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:02.740 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556339+0000", 2024-09-12T00:05:02.741 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0577000000000001e-05 2024-09-12T00:05:02.741 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.741 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.741 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:02.741 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.568778+0000", 2024-09-12T00:05:02.741 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012438886999999999 2024-09-12T00:05:02.741 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.741 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.741 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:02.741 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.568953+0000", 2024-09-12T00:05:02.741 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017473900000000001 2024-09-12T00:05:02.741 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.741 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2696 3.2b 3:d7c776f8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:05:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.131499998000001, 2024-09-12T00:05:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022026211, 2024-09-12T00:05:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2696 2024-09-12T00:05:02.743 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.743 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:02.743 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.743 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:02.743 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:05:02.743 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.743 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.743 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.743 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:02.743 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:05:02.743 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.743 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.743 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.744 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:02.744 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567406+0000", 2024-09-12T00:05:02.744 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9389999999999996e-06 2024-09-12T00:05:02.744 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.744 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.744 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:02.744 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571490+0000", 2024-09-12T00:05:02.744 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040837870000000002 2024-09-12T00:05:02.744 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.744 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.744 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:02.744 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571530+0000", 2024-09-12T00:05:02.744 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9894999999999997e-05 2024-09-12T00:05:02.744 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.745 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.745 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.745 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571554+0000", 2024-09-12T00:05:02.745 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4011000000000001e-05 2024-09-12T00:05:02.745 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.745 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.745 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:02.745 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571726+0000", 2024-09-12T00:05:02.745 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0001717 2024-09-12T00:05:02.745 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.745 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.745 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:02.745 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.572130+0000", 2024-09-12T00:05:02.746 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040465299999999999 2024-09-12T00:05:02.746 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.746 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.746 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:02.746 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.572470+0000", 2024-09-12T00:05:02.746 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00033946999999999997 2024-09-12T00:05:02.746 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.746 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.746 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:02.746 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.579159+0000", 2024-09-12T00:05:02.746 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0066893009999999999 2024-09-12T00:05:02.746 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.746 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.746 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.747 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589136+0000", 2024-09-12T00:05:02.747 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099772060000000006 2024-09-12T00:05:02.747 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.747 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.747 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:02.747 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589309+0000", 2024-09-12T00:05:02.747 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017264299999999999 2024-09-12T00:05:02.747 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.747 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.747 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:02.747 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589428+0000", 2024-09-12T00:05:02.747 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118606 2024-09-12T00:05:02.747 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.747 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:02.748 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.748 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.748 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.748 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2698 3.3d e63/23 3:bcafb0f9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_183:head v 63'8, mlcod=63'6)", 2024-09-12T00:05:02.748 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:05:02.748 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.103796948999999, 2024-09-12T00:05:02.748 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016019080000000002, 2024-09-12T00:05:02.748 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:02.748 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:02.748 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.748 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:02.748 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.748 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:02.749 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:05:02.749 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.749 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.749 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.749 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:02.749 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:05:02.749 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.749 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.749 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.749 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:02.749 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595107+0000", 2024-09-12T00:05:02.749 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.497e-06 2024-09-12T00:05:02.750 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.750 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.750 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:02.750 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598465+0000", 2024-09-12T00:05:02.750 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033583129999999999 2024-09-12T00:05:02.750 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.750 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.750 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:02.750 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598502+0000", 2024-09-12T00:05:02.750 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6814999999999999e-05 2024-09-12T00:05:02.750 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.750 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.750 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.750 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598520+0000", 2024-09-12T00:05:02.751 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8264999999999999e-05 2024-09-12T00:05:02.751 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.751 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.751 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:02.751 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598666+0000", 2024-09-12T00:05:02.751 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014574499999999999 2024-09-12T00:05:02.751 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.751 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.751 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:02.751 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598706+0000", 2024-09-12T00:05:02.751 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9993999999999997e-05 2024-09-12T00:05:02.751 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.751 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.751 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:02.752 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.611012+0000", 2024-09-12T00:05:02.752 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012306381 2024-09-12T00:05:02.752 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.752 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.752 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:02.752 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.611123+0000", 2024-09-12T00:05:02.752 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011107000000000001 2024-09-12T00:05:02.752 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.752 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:02.752 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.752 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.752 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.752 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2702 3.3c e63/23 3:3d6a0b3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_187:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:02.752 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:05:02.753 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.070322111999999, 2024-09-12T00:05:02.753 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015754475, 2024-09-12T00:05:02.753 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:02.753 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:02.753 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.753 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:02.753 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.753 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:02.753 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:05:02.753 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.753 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.753 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.753 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:02.754 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:05:02.754 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.754 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.754 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:02.754 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628581+0000", 2024-09-12T00:05:02.754 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2129999999999998e-06 2024-09-12T00:05:02.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.754 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.754 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:02.754 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633160+0000", 2024-09-12T00:05:02.754 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045784470000000002 2024-09-12T00:05:02.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.754 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.754 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:02.755 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633193+0000", 2024-09-12T00:05:02.755 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3015000000000002e-05 2024-09-12T00:05:02.755 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.755 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.755 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.755 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633213+0000", 2024-09-12T00:05:02.755 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0271999999999998e-05 2024-09-12T00:05:02.755 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.755 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.755 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:02.755 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633397+0000", 2024-09-12T00:05:02.755 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018359299999999999 2024-09-12T00:05:02.755 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.755 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.756 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:02.756 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633440+0000", 2024-09-12T00:05:02.756 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2984e-05 2024-09-12T00:05:02.756 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.756 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.756 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:02.756 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.644242+0000", 2024-09-12T00:05:02.756 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010802673 2024-09-12T00:05:02.756 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.756 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.756 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:02.756 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.644334+0000", 2024-09-12T00:05:02.756 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1278000000000003e-05 2024-09-12T00:05:02.757 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.757 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:02.757 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.757 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.757 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.757 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2707 3.8 3:10a400a4:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.757 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:05:02.757 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.022044544, 2024-09-12T00:05:02.757 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019444162000000001, 2024-09-12T00:05:02.757 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:02.757 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:02.757 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.757 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:02.758 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:02.758 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.758 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2707 2024-09-12T00:05:02.758 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.758 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:02.758 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.758 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:02.758 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:05:02.758 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.758 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.758 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.758 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:02.758 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:05:02.759 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.759 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.759 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.759 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:02.759 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676879+0000", 2024-09-12T00:05:02.759 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1886e-05 2024-09-12T00:05:02.759 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.759 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.759 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:02.759 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680743+0000", 2024-09-12T00:05:02.759 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038648060000000001 2024-09-12T00:05:02.759 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.759 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.759 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:02.760 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680783+0000", 2024-09-12T00:05:02.760 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9511000000000002e-05 2024-09-12T00:05:02.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.760 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.760 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.760 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680801+0000", 2024-09-12T00:05:02.760 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8056000000000001e-05 2024-09-12T00:05:02.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.760 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.760 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:02.760 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680948+0000", 2024-09-12T00:05:02.760 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014682399999999999 2024-09-12T00:05:02.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.760 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.681206+0000", 2024-09-12T00:05:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025860500000000002 2024-09-12T00:05:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.681439+0000", 2024-09-12T00:05:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023246599999999999 2024-09-12T00:05:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.689277+0000", 2024-09-12T00:05:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0078379000000000001 2024-09-12T00:05:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696136+0000", 2024-09-12T00:05:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0068593439999999999 2024-09-12T00:05:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696228+0000", 2024-09-12T00:05:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2038000000000002e-05 2024-09-12T00:05:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696301+0000", 2024-09-12T00:05:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2725999999999995e-05 2024-09-12T00:05:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2720 3.6 3:61c9c6cd:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:05:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.895325228000001, 2024-09-12T00:05:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021831761000000002, 2024-09-12T00:05:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2720 2024-09-12T00:05:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:05:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:05:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803580+0000", 2024-09-12T00:05:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9870000000000001e-06 2024-09-12T00:05:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808102+0000", 2024-09-12T00:05:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004521677 2024-09-12T00:05:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808152+0000", 2024-09-12T00:05:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9923999999999998e-05 2024-09-12T00:05:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808178+0000", 2024-09-12T00:05:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5911999999999999e-05 2024-09-12T00:05:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808365+0000", 2024-09-12T00:05:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000187839 2024-09-12T00:05:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808757+0000", 2024-09-12T00:05:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039202900000000001 2024-09-12T00:05:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.809162+0000", 2024-09-12T00:05:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040460300000000002 2024-09-12T00:05:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.816553+0000", 2024-09-12T00:05:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.007390537 2024-09-12T00:05:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.824836+0000", 2024-09-12T00:05:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082834369999999994 2024-09-12T00:05:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.825223+0000", 2024-09-12T00:05:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00038724700000000001 2024-09-12T00:05:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.825408+0000", 2024-09-12T00:05:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018456899999999999 2024-09-12T00:05:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2722 3.1b 3:d95d04cc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_207:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.822403+0000", 2024-09-12T00:05:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.876498535, 2024-09-12T00:05:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015693082000000001, 2024-09-12T00:05:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2722 2024-09-12T00:05:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.822403+0000", 2024-09-12T00:05:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.822403+0000", 2024-09-12T00:05:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.822405+0000", 2024-09-12T00:05:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4169999999999999e-06 2024-09-12T00:05:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826387+0000", 2024-09-12T00:05:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039818379999999997 2024-09-12T00:05:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826412+0000", 2024-09-12T00:05:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5159000000000001e-05 2024-09-12T00:05:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826425+0000", 2024-09-12T00:05:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3283e-05 2024-09-12T00:05:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826536+0000", 2024-09-12T00:05:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110109 2024-09-12T00:05:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826725+0000", 2024-09-12T00:05:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018966600000000001 2024-09-12T00:05:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826904+0000", 2024-09-12T00:05:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017913200000000001 2024-09-12T00:05:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.835018+0000", 2024-09-12T00:05:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0081138300000000007 2024-09-12T00:05:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837918+0000", 2024-09-12T00:05:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002899535 2024-09-12T00:05:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838010+0000", 2024-09-12T00:05:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1901e-05 2024-09-12T00:05:02.775 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.775 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.775 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:02.775 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838096+0000", 2024-09-12T00:05:02.775 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6211999999999994e-05 2024-09-12T00:05:02.775 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.775 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:02.775 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.775 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.775 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.775 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2724 3.1b 3:da32d84b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.775 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:05:02.775 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.855114792, 2024-09-12T00:05:02.775 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019410604000000001, 2024-09-12T00:05:02.776 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:02.776 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:02.776 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.776 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:02.776 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:02.776 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.776 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2724 2024-09-12T00:05:02.776 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.776 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:02.776 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.776 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:02.776 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:05:02.776 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.777 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.777 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.777 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:02.777 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:05:02.777 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.777 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.777 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.777 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:02.777 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843790+0000", 2024-09-12T00:05:02.777 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.393e-06 2024-09-12T00:05:02.777 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.777 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.777 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:02.778 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847786+0000", 2024-09-12T00:05:02.778 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039965579999999999 2024-09-12T00:05:02.778 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.778 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.778 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:02.778 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847836+0000", 2024-09-12T00:05:02.778 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9731000000000002e-05 2024-09-12T00:05:02.778 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.778 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.778 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.778 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847856+0000", 2024-09-12T00:05:02.778 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0245e-05 2024-09-12T00:05:02.778 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.778 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.779 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:02.779 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848053+0000", 2024-09-12T00:05:02.779 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000196882 2024-09-12T00:05:02.779 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.779 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.779 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:02.779 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848291+0000", 2024-09-12T00:05:02.779 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000237762 2024-09-12T00:05:02.779 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.779 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.779 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:02.779 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848544+0000", 2024-09-12T00:05:02.779 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025307500000000001 2024-09-12T00:05:02.780 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.780 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.780 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.780 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.860024+0000", 2024-09-12T00:05:02.780 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011479390000000001 2024-09-12T00:05:02.780 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.780 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.780 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:02.780 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.862880+0000", 2024-09-12T00:05:02.780 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002856833 2024-09-12T00:05:02.780 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.780 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.780 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:02.781 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.863048+0000", 2024-09-12T00:05:02.781 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016796700000000001 2024-09-12T00:05:02.781 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.781 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.781 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:02.781 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.863197+0000", 2024-09-12T00:05:02.781 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148768 2024-09-12T00:05:02.781 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.781 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:02.781 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.781 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.781 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.781 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2727 3.39 e63/23 3:9c63b475:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_212:head v 63'3, mlcod=62'1)", 2024-09-12T00:05:02.782 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:05:02.782 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.821086196, 2024-09-12T00:05:02.782 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016224526999999999, 2024-09-12T00:05:02.782 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:02.782 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:02.782 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.782 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:02.782 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.782 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:02.782 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:05:02.782 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.782 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.782 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.783 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:02.783 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:05:02.783 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.783 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.783 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.783 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:02.783 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877818+0000", 2024-09-12T00:05:02.783 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.813e-06 2024-09-12T00:05:02.783 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.783 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.783 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:02.783 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883917+0000", 2024-09-12T00:05:02.783 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0060993009999999997 2024-09-12T00:05:02.784 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.784 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.784 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:02.784 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883961+0000", 2024-09-12T00:05:02.784 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3951e-05 2024-09-12T00:05:02.784 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.784 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.784 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.784 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883992+0000", 2024-09-12T00:05:02.784 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0565000000000003e-05 2024-09-12T00:05:02.784 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.784 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.784 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:02.784 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884176+0000", 2024-09-12T00:05:02.785 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018378200000000001 2024-09-12T00:05:02.785 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.785 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.785 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:02.785 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884252+0000", 2024-09-12T00:05:02.785 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6209000000000002e-05 2024-09-12T00:05:02.785 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.785 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.785 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:02.785 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.893904+0000", 2024-09-12T00:05:02.785 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0096519339999999992 2024-09-12T00:05:02.785 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.785 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.786 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:02.786 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.894040+0000", 2024-09-12T00:05:02.786 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013597199999999999 2024-09-12T00:05:02.786 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.786 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:02.786 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.786 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.786 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.786 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2730 3.7 3:e3fca83c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.786 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:05:02.786 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.790558069999999, 2024-09-12T00:05:02.786 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022178479000000001, 2024-09-12T00:05:02.786 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:02.787 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:02.787 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.787 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:02.787 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:02.787 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.787 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2730 2024-09-12T00:05:02.787 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.787 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:02.787 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.787 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:02.787 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:05:02.787 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.787 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.787 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.788 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:02.788 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:05:02.788 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.788 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.788 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.788 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:02.788 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908346+0000", 2024-09-12T00:05:02.788 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1999999999999999e-06 2024-09-12T00:05:02.788 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.788 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.788 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:02.788 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912423+0000", 2024-09-12T00:05:02.788 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004076423 2024-09-12T00:05:02.789 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.789 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.789 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:02.789 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912472+0000", 2024-09-12T00:05:02.789 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9023999999999997e-05 2024-09-12T00:05:02.789 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.789 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.789 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.789 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912498+0000", 2024-09-12T00:05:02.789 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6591999999999999e-05 2024-09-12T00:05:02.789 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.789 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.789 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:02.789 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912677+0000", 2024-09-12T00:05:02.790 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017824599999999999 2024-09-12T00:05:02.790 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.790 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.790 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:02.790 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913094+0000", 2024-09-12T00:05:02.790 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041757799999999999 2024-09-12T00:05:02.790 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.790 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.790 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:02.790 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913512+0000", 2024-09-12T00:05:02.790 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000417475 2024-09-12T00:05:02.790 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.790 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.790 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:02.791 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.929229+0000", 2024-09-12T00:05:02.791 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015717294999999999 2024-09-12T00:05:02.791 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.791 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.791 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.791 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930204+0000", 2024-09-12T00:05:02.791 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00097506199999999996 2024-09-12T00:05:02.791 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.791 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.791 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:02.791 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930392+0000", 2024-09-12T00:05:02.791 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000187775 2024-09-12T00:05:02.791 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.791 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.792 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:02.792 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930522+0000", 2024-09-12T00:05:02.792 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012980899999999999 2024-09-12T00:05:02.792 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.792 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:02.792 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.792 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.792 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.792 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2753 3.7 3:e119c99e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_238:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.792 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:05:02.792 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.54487, 2024-09-12T00:05:02.792 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.023674186999999999, 2024-09-12T00:05:02.792 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:02.792 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:02.793 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.793 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:02.793 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:02.793 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.793 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2753 2024-09-12T00:05:02.793 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.793 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:02.793 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.793 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:02.793 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:05:02.793 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.793 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.793 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.794 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:02.794 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:05:02.794 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.794 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.794 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.794 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:02.794 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154035+0000", 2024-09-12T00:05:02.794 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2799999999999999e-06 2024-09-12T00:05:02.794 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.794 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.794 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:02.794 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159459+0000", 2024-09-12T00:05:02.794 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054242190000000001 2024-09-12T00:05:02.794 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.795 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.795 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:02.795 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159509+0000", 2024-09-12T00:05:02.795 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9830999999999998e-05 2024-09-12T00:05:02.795 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.795 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.795 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.795 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159536+0000", 2024-09-12T00:05:02.795 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7438000000000001e-05 2024-09-12T00:05:02.795 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.795 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.795 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:02.795 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159710+0000", 2024-09-12T00:05:02.795 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017342 2024-09-12T00:05:02.796 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.796 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.796 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:02.796 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159961+0000", 2024-09-12T00:05:02.796 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025164499999999999 2024-09-12T00:05:02.796 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.796 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.796 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:02.796 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.160206+0000", 2024-09-12T00:05:02.796 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024534200000000001 2024-09-12T00:05:02.796 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.796 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.796 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:02.797 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177421+0000", 2024-09-12T00:05:02.797 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017214956 2024-09-12T00:05:02.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.797 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.797 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.797 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177534+0000", 2024-09-12T00:05:02.797 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000112223 2024-09-12T00:05:02.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.797 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.797 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:02.797 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177625+0000", 2024-09-12T00:05:02.797 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0947999999999997e-05 2024-09-12T00:05:02.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.797 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.798 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:02.798 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177706+0000", 2024-09-12T00:05:02.798 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0884999999999996e-05 2024-09-12T00:05:02.798 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.798 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:02.798 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.798 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.798 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.798 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2757 3.2b 3:d6dac417:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:02.798 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:05:02.798 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.478801177999999, 2024-09-12T00:05:02.798 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017779708000000002, 2024-09-12T00:05:02.798 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:02.799 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:02.799 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.799 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:02.799 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:02.799 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:02.799 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2757 2024-09-12T00:05:02.799 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.799 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:02.799 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.799 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:02.799 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:05:02.799 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.799 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.799 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.800 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:02.800 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:05:02.800 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.800 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.800 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.800 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:02.800 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220103+0000", 2024-09-12T00:05:02.800 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.32e-06 2024-09-12T00:05:02.800 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.800 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.800 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:02.800 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225042+0000", 2024-09-12T00:05:02.800 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049386200000000003 2024-09-12T00:05:02.800 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225083+0000", 2024-09-12T00:05:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1304000000000003e-05 2024-09-12T00:05:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225102+0000", 2024-09-12T00:05:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8502e-05 2024-09-12T00:05:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225256+0000", 2024-09-12T00:05:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015436099999999999 2024-09-12T00:05:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225513+0000", 2024-09-12T00:05:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000256562 2024-09-12T00:05:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225737+0000", 2024-09-12T00:05:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022379 2024-09-12T00:05:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.234281+0000", 2024-09-12T00:05:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0085440540000000006 2024-09-12T00:05:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237710+0000", 2024-09-12T00:05:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0034298380000000002 2024-09-12T00:05:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237805+0000", 2024-09-12T00:05:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4804999999999998e-05 2024-09-12T00:05:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237880+0000", 2024-09-12T00:05:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4552e-05 2024-09-12T00:05:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2764 3.2d e63/23 3:b7a0f55d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_249:head v 63'7, mlcod=63'5)", 2024-09-12T00:05:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:05:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.370023708, 2024-09-12T00:05:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018235872, 2024-09-12T00:05:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:05:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:05:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328882+0000", 2024-09-12T00:05:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5000000000000001e-06 2024-09-12T00:05:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335092+0000", 2024-09-12T00:05:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0062094730000000001 2024-09-12T00:05:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335127+0000", 2024-09-12T00:05:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5717999999999999e-05 2024-09-12T00:05:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335144+0000", 2024-09-12T00:05:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7119e-05 2024-09-12T00:05:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335308+0000", 2024-09-12T00:05:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000163757 2024-09-12T00:05:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335354+0000", 2024-09-12T00:05:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6164e-05 2024-09-12T00:05:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.346991+0000", 2024-09-12T00:05:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011636851 2024-09-12T00:05:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.347113+0000", 2024-09-12T00:05:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012229 2024-09-12T00:05:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.809 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:02.809 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:02.809 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:02.810 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:05:02.811 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:02.809+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:02.911 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:02.912+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:02.982 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:02.982 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:02.983 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:02.983 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:02.997 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:05:03.012 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:03.012+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:03.113 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:03.116+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:03.120 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:03.120 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:03.120 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:03.121 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:03.121 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:03.135 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:05:03.215 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:03.213+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:03.257 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:03.258 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:03.258 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:03.258 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:03.258 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.258 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2656 3.29 3:951a8707:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:03.258 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.253332+0000", 2024-09-12T00:05:03.258 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.00172147, 2024-09-12T00:05:03.259 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018697930000000001, 2024-09-12T00:05:03.259 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:03.259 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:03.259 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:03.259 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:03.259 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:03.259 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:03.259 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2656 2024-09-12T00:05:03.260 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.260 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:03.260 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.260 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:03.260 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.253332+0000", 2024-09-12T00:05:03.261 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.261 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.261 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.261 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:03.261 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.253332+0000", 2024-09-12T00:05:03.261 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.262 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.262 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.262 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:03.262 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.253336+0000", 2024-09-12T00:05:03.262 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8469999999999998e-06 2024-09-12T00:05:03.262 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.262 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.262 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:03.263 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.257408+0000", 2024-09-12T00:05:03.263 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040728209999999999 2024-09-12T00:05:03.263 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.263 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.263 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:03.264 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.257445+0000", 2024-09-12T00:05:03.264 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6284e-05 2024-09-12T00:05:03.264 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.264 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.264 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:03.264 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.257470+0000", 2024-09-12T00:05:03.264 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5684999999999999e-05 2024-09-12T00:05:03.264 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.264 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.265 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:03.265 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.257608+0000", 2024-09-12T00:05:03.265 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013792200000000001 2024-09-12T00:05:03.265 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.266 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.266 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:03.266 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.257855+0000", 2024-09-12T00:05:03.266 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024628900000000001 2024-09-12T00:05:03.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.266 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.266 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:03.266 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.258062+0000", 2024-09-12T00:05:03.267 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020795699999999999 2024-09-12T00:05:03.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.267 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.267 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:03.267 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266228+0000", 2024-09-12T00:05:03.267 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0081652600000000006 2024-09-12T00:05:03.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.267 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.267 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:03.268 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271871+0000", 2024-09-12T00:05:03.268 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0056437179999999998 2024-09-12T00:05:03.268 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.268 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.268 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:03.268 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271958+0000", 2024-09-12T00:05:03.268 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6800999999999998e-05 2024-09-12T00:05:03.268 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.268 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.269 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:03.269 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.272030+0000", 2024-09-12T00:05:03.269 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1346000000000004e-05 2024-09-12T00:05:03.269 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.269 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:03.269 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.270 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.270 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.270 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2661 3.1e 3:7a671bd1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:03.270 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.307344+0000", 2024-09-12T00:05:03.270 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.947709379999999, 2024-09-12T00:05:03.270 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020716793000000001, 2024-09-12T00:05:03.270 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:03.270 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:03.270 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:03.271 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:03.271 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:03.271 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:03.271 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2661 2024-09-12T00:05:03.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.272 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:03.272 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.272 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:03.272 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.307344+0000", 2024-09-12T00:05:03.272 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.273 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.273 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:03.273 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.307344+0000", 2024-09-12T00:05:03.273 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.274 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.274 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:03.274 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.307347+0000", 2024-09-12T00:05:03.274 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.546e-06 2024-09-12T00:05:03.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.275 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.275 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:03.275 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311373+0000", 2024-09-12T00:05:03.276 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040257940000000001 2024-09-12T00:05:03.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.276 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.276 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:03.276 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311407+0000", 2024-09-12T00:05:03.277 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4038000000000002e-05 2024-09-12T00:05:03.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.277 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.277 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:03.277 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311427+0000", 2024-09-12T00:05:03.277 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0305e-05 2024-09-12T00:05:03.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.277 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.277 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:03.277 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311547+0000", 2024-09-12T00:05:03.277 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011904999999999999 2024-09-12T00:05:03.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.278 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.278 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:03.278 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311877+0000", 2024-09-12T00:05:03.278 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00033003699999999998 2024-09-12T00:05:03.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.278 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.278 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:03.278 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.312137+0000", 2024-09-12T00:05:03.278 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026013499999999999 2024-09-12T00:05:03.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.279 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.279 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:03.279 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.320695+0000", 2024-09-12T00:05:03.279 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0085586029999999997 2024-09-12T00:05:03.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.279 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.279 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:03.279 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.327883+0000", 2024-09-12T00:05:03.279 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0071877419999999996 2024-09-12T00:05:03.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.279 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.279 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:03.279 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.327983+0000", 2024-09-12T00:05:03.280 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010008100000000001 2024-09-12T00:05:03.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.280 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.280 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:03.280 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.328061+0000", 2024-09-12T00:05:03.280 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7461999999999998e-05 2024-09-12T00:05:03.280 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.281 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:03.281 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.281 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.281 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.281 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2665 3.3d 3:bff83547:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:03.281 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.351951+0000", 2024-09-12T00:05:03.281 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.903101743000001, 2024-09-12T00:05:03.281 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019663572000000001, 2024-09-12T00:05:03.281 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:03.282 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:03.282 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:03.282 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:03.282 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:03.283 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:03.283 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2665 2024-09-12T00:05:03.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.284 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:03.284 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.284 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:03.284 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.351951+0000", 2024-09-12T00:05:03.284 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.284 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.285 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.285 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:03.285 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.351951+0000", 2024-09-12T00:05:03.285 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.285 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.285 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:03.285 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.351954+0000", 2024-09-12T00:05:03.285 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9330000000000001e-06 2024-09-12T00:05:03.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.286 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.286 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:03.286 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.355966+0000", 2024-09-12T00:05:03.286 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040118009999999997 2024-09-12T00:05:03.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.286 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.286 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:03.286 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356000+0000", 2024-09-12T00:05:03.286 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3967999999999997e-05 2024-09-12T00:05:03.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.286 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.286 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:03.287 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356025+0000", 2024-09-12T00:05:03.287 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4658e-05 2024-09-12T00:05:03.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.287 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.287 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:03.287 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356202+0000", 2024-09-12T00:05:03.287 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000176756 2024-09-12T00:05:03.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.287 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.287 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:03.287 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356445+0000", 2024-09-12T00:05:03.287 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024318300000000001 2024-09-12T00:05:03.288 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.288 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.288 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:03.288 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356671+0000", 2024-09-12T00:05:03.288 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000226276 2024-09-12T00:05:03.288 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.288 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.288 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:03.288 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.370776+0000", 2024-09-12T00:05:03.288 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014104604 2024-09-12T00:05:03.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.289 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:03.289 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.371306+0000", 2024-09-12T00:05:03.289 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00053036499999999998 2024-09-12T00:05:03.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.289 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:03.289 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.371521+0000", 2024-09-12T00:05:03.289 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021477000000000001 2024-09-12T00:05:03.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.290 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:03.290 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.371615+0000", 2024-09-12T00:05:03.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4258000000000005e-05 2024-09-12T00:05:03.290 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.290 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:03.290 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.290 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.290 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2689 3.3d 3:bfc0a94d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:03.290 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.494580+0000", 2024-09-12T00:05:03.290 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.760473468000001, 2024-09-12T00:05:03.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019076037000000001, 2024-09-12T00:05:03.291 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:03.291 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:03.291 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:03.291 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:03.291 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:03.291 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:03.291 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2689 2024-09-12T00:05:03.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.291 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:03.291 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.291 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:03.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.494580+0000", 2024-09-12T00:05:03.292 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.292 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.292 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:03.292 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.494580+0000", 2024-09-12T00:05:03.292 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.292 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.292 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:03.292 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.494582+0000", 2024-09-12T00:05:03.292 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2029999999999999e-06 2024-09-12T00:05:03.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.293 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.293 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:03.293 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498633+0000", 2024-09-12T00:05:03.293 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040508430000000002 2024-09-12T00:05:03.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.293 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.293 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:03.293 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498664+0000", 2024-09-12T00:05:03.293 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1273999999999999e-05 2024-09-12T00:05:03.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.293 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.293 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:03.294 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498680+0000", 2024-09-12T00:05:03.294 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5783000000000001e-05 2024-09-12T00:05:03.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.294 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.294 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:03.294 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498864+0000", 2024-09-12T00:05:03.294 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184635 2024-09-12T00:05:03.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.294 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.294 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:03.294 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.499108+0000", 2024-09-12T00:05:03.295 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000243883 2024-09-12T00:05:03.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.295 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.295 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:03.295 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.499335+0000", 2024-09-12T00:05:03.295 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000226729 2024-09-12T00:05:03.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.295 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.295 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:03.295 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.512376+0000", 2024-09-12T00:05:03.295 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013040629999999999 2024-09-12T00:05:03.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.295 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:03.296 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.513496+0000", 2024-09-12T00:05:03.296 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0011198409999999999 2024-09-12T00:05:03.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:03.296 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.513587+0000", 2024-09-12T00:05:03.296 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1199999999999994e-05 2024-09-12T00:05:03.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:03.297 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.513656+0000", 2024-09-12T00:05:03.297 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9016000000000005e-05 2024-09-12T00:05:03.297 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.297 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:03.297 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.297 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.297 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2693 3.1e 3:7a8f9e2c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:03.297 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.536006+0000", 2024-09-12T00:05:03.297 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.719047345, 2024-09-12T00:05:03.297 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019831418999999999, 2024-09-12T00:05:03.297 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:03.298 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:03.298 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:03.298 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:03.298 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:03.298 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:03.298 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2693 2024-09-12T00:05:03.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.298 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:03.298 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.298 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:03.299 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.536006+0000", 2024-09-12T00:05:03.299 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:03.299 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.536006+0000", 2024-09-12T00:05:03.299 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:03.299 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.536010+0000", 2024-09-12T00:05:03.300 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.737e-06 2024-09-12T00:05:03.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.300 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.300 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:03.300 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.539958+0000", 2024-09-12T00:05:03.300 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003948315 2024-09-12T00:05:03.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.300 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.301 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:03.301 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.539997+0000", 2024-09-12T00:05:03.301 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9131000000000002e-05 2024-09-12T00:05:03.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.301 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:03.301 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.540016+0000", 2024-09-12T00:05:03.301 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9018e-05 2024-09-12T00:05:03.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.302 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:03.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.540148+0000", 2024-09-12T00:05:03.302 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013242899999999999 2024-09-12T00:05:03.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.302 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:03.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.540394+0000", 2024-09-12T00:05:03.302 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024580899999999999 2024-09-12T00:05:03.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.302 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:03.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.540622+0000", 2024-09-12T00:05:03.302 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022765599999999999 2024-09-12T00:05:03.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:03.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.547587+0000", 2024-09-12T00:05:03.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0069649259999999998 2024-09-12T00:05:03.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:03.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.555622+0000", 2024-09-12T00:05:03.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0080352640000000003 2024-09-12T00:05:03.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.304 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.304 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:03.304 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.555724+0000", 2024-09-12T00:05:03.304 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010187399999999999 2024-09-12T00:05:03.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.304 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.304 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:03.304 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.555837+0000", 2024-09-12T00:05:03.304 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011326 2024-09-12T00:05:03.304 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.304 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:03.304 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.305 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.305 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2694 3.3d 3:bd0bdafc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:03.305 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:03.305 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.709524792, 2024-09-12T00:05:03.305 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.026139741000000001, 2024-09-12T00:05:03.305 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:03.305 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:03.305 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:03.305 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:03.305 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:03.306 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:03.306 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2694 2024-09-12T00:05:03.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.306 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:03.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.306 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:03.306 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:03.306 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.306 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:03.306 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:03.306 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.307 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.307 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:03.307 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545532+0000", 2024-09-12T00:05:03.307 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8199999999999998e-06 2024-09-12T00:05:03.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.307 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.307 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:03.307 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551454+0000", 2024-09-12T00:05:03.307 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059222340000000002 2024-09-12T00:05:03.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.307 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.308 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:03.308 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551485+0000", 2024-09-12T00:05:03.308 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0173999999999999e-05 2024-09-12T00:05:03.308 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.308 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.308 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:03.308 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551504+0000", 2024-09-12T00:05:03.308 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9726000000000001e-05 2024-09-12T00:05:03.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.309 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.309 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:03.309 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551708+0000", 2024-09-12T00:05:03.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020344100000000001 2024-09-12T00:05:03.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.309 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.309 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:03.309 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552087+0000", 2024-09-12T00:05:03.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000379327 2024-09-12T00:05:03.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.310 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.310 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:03.310 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552351+0000", 2024-09-12T00:05:03.310 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026349199999999999 2024-09-12T00:05:03.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.310 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.310 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:03.310 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.569375+0000", 2024-09-12T00:05:03.310 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017024432999999999 2024-09-12T00:05:03.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.310 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.310 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:03.311 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571222+0000", 2024-09-12T00:05:03.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00184688 2024-09-12T00:05:03.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.311 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:03.311 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571511+0000", 2024-09-12T00:05:03.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028897599999999998 2024-09-12T00:05:03.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.311 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:03.311 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571668+0000", 2024-09-12T00:05:03.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000157238 2024-09-12T00:05:03.311 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.312 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:03.312 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.312 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2698 3.3d 3:bcafb0f9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:03.312 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:03.312 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.665071089, 2024-09-12T00:05:03.312 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025133152999999998, 2024-09-12T00:05:03.312 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:03.312 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:03.312 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:03.313 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:03.313 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:03.313 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:03.313 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2698 2024-09-12T00:05:03.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.313 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:03.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.313 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:03.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:03.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.314 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:03.314 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:03.314 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.314 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.314 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.314 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:03.314 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589986+0000", 2024-09-12T00:05:03.314 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5999999999999998e-06 2024-09-12T00:05:03.314 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.314 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.314 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:03.314 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594109+0000", 2024-09-12T00:05:03.314 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041230770000000002 2024-09-12T00:05:03.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.315 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.315 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:03.315 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594146+0000", 2024-09-12T00:05:03.315 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7722000000000002e-05 2024-09-12T00:05:03.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.315 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.315 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:03.315 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594167+0000", 2024-09-12T00:05:03.315 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0100999999999999e-05 2024-09-12T00:05:03.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.315 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.316 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:03.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594297+0000", 2024-09-12T00:05:03.316 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013051600000000001 2024-09-12T00:05:03.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.316 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.316 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:03.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594570+0000", 2024-09-12T00:05:03.316 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000272837 2024-09-12T00:05:03.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.316 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.316 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:03.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594846+0000", 2024-09-12T00:05:03.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027622399999999999 2024-09-12T00:05:03.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.317 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.317 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:03.317 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.606026+0000", 2024-09-12T00:05:03.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011179947000000001 2024-09-12T00:05:03.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.317 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.317 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:03.317 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.614827+0000", 2024-09-12T00:05:03.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0088013259999999999 2024-09-12T00:05:03.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.318 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.318 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:03.318 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.614988+0000", 2024-09-12T00:05:03.318 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016018799999999999 2024-09-12T00:05:03.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.318 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.318 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:03.318 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.615115+0000", 2024-09-12T00:05:03.318 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000127615 2024-09-12T00:05:03.318 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.318 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:03.318 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.319 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.319 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2699 3.0 3:02470ff9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:03.319 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.597879+0000", 2024-09-12T00:05:03.319 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.657173999999999, 2024-09-12T00:05:03.319 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021498363, 2024-09-12T00:05:03.319 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:03.319 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:03.319 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:03.319 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:03.319 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:03.320 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:03.320 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2699 2024-09-12T00:05:03.320 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.320 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:03.320 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.320 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:03.320 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.597879+0000", 2024-09-12T00:05:03.320 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.320 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.320 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.320 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.597879+0000", 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.597884+0000", 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1769999999999997e-06 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602129+0000", 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042451399999999997 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602170+0000", 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0194000000000002e-05 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602198+0000", 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7861999999999999e-05 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602392+0000", 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000194122 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602801+0000", 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040957199999999997 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.603203+0000", 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040166900000000001 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.611989+0000", 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0087860170000000001 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.619177+0000", 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0071878819999999996 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.619270+0000", 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2930999999999995e-05 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.619378+0000", 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000107797 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.326 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.326 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.326 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2712 3.3e 3:7d3d0242:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:03.326 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:03.326 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.528170812000001, 2024-09-12T00:05:03.326 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022816941, 2024-09-12T00:05:03.326 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:03.326 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:03.326 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:03.326 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:03.326 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:03.326 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:03.326 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2712 2024-09-12T00:05:03.327 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.327 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:03.327 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.327 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:03.327 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:03.327 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.327 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.327 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.327 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:03.327 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:03.327 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.327 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.327 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.328 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:03.328 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726886+0000", 2024-09-12T00:05:03.328 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5329999999999999e-06 2024-09-12T00:05:03.328 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.328 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.328 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:03.328 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730802+0000", 2024-09-12T00:05:03.328 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039158700000000001 2024-09-12T00:05:03.328 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.328 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.328 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:03.328 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730839+0000", 2024-09-12T00:05:03.329 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6857999999999998e-05 2024-09-12T00:05:03.329 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.329 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.329 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:03.329 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730856+0000", 2024-09-12T00:05:03.333 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7371999999999999e-05 2024-09-12T00:05:03.333 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.333 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.333 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:03.333 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731026+0000", 2024-09-12T00:05:03.333 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017011000000000001 2024-09-12T00:05:03.333 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.333 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.333 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731444+0000", 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041766500000000001 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731860+0000", 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041618500000000001 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.743012+0000", 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011152123 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749386+0000", 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0063743130000000004 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749562+0000", 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017590300000000001 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749699+0000", 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000137009 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2714 3.17 3:eac65a57:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:03.337 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.746943+0000", 2024-09-12T00:05:03.337 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.508110569999999, 2024-09-12T00:05:03.337 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019462007, 2024-09-12T00:05:03.337 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:03.337 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:03.337 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:03.337 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:03.337 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:03.337 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:03.337 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2714 2024-09-12T00:05:03.337 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.337 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:03.338 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.338 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:03.338 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.746943+0000", 2024-09-12T00:05:03.338 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.338 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.338 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.338 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:03.338 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.746943+0000", 2024-09-12T00:05:03.338 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.338 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.338 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.338 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:03.339 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.746946+0000", 2024-09-12T00:05:03.339 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9529999999999999e-06 2024-09-12T00:05:03.339 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.339 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.339 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:03.339 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751163+0000", 2024-09-12T00:05:03.339 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042169859999999998 2024-09-12T00:05:03.339 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.339 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.339 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:03.339 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751188+0000", 2024-09-12T00:05:03.340 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5908e-05 2024-09-12T00:05:03.340 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.340 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.340 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:03.340 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751203+0000", 2024-09-12T00:05:03.340 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4491999999999999e-05 2024-09-12T00:05:03.340 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.340 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.340 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:03.340 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751324+0000", 2024-09-12T00:05:03.340 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120866 2024-09-12T00:05:03.340 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.341 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.341 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:03.341 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751572+0000", 2024-09-12T00:05:03.341 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024774900000000002 2024-09-12T00:05:03.341 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.341 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.341 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:03.341 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751798+0000", 2024-09-12T00:05:03.341 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022655700000000001 2024-09-12T00:05:03.341 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.341 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.341 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:03.342 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761058+0000", 2024-09-12T00:05:03.342 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0092603110000000002 2024-09-12T00:05:03.342 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.342 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.342 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:03.342 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.766067+0000", 2024-09-12T00:05:03.342 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005009009 2024-09-12T00:05:03.342 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.342 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.342 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:03.342 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.766264+0000", 2024-09-12T00:05:03.342 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00019632800000000001 2024-09-12T00:05:03.342 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.343 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.343 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:03.343 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.766405+0000", 2024-09-12T00:05:03.343 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000140848 2024-09-12T00:05:03.343 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.343 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:03.343 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.343 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.343 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.343 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2715 3.18 3:19a9b410:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:03.343 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:03.343 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.498794522000001, 2024-09-12T00:05:03.344 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022391956000000001, 2024-09-12T00:05:03.344 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:03.344 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:03.344 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:03.344 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:03.344 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:03.344 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:03.344 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2715 2024-09-12T00:05:03.344 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.344 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:03.344 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756262+0000", 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9629999999999998e-06 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760936+0000", 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046745750000000003 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760968+0000", 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1470999999999997e-05 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760985+0000", 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7771999999999999e-05 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761154+0000", 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016875399999999999 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761571+0000", 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000417231 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761996+0000", 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042500200000000001 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777182+0000", 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015185664999999999 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778484+0000", 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00130225 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778575+0000", 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0258000000000002e-05 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778651+0000", 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6014999999999996e-05 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2717 3.1a e63/23 3:5be58560:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_202:head v 63'4, mlcod=63'2)", 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.777964+0000", 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.477089502, 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015392704, 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.351 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:03.351 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777964+0000", 2024-09-12T00:05:03.351 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.351 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.351 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.351 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:03.351 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777964+0000", 2024-09-12T00:05:03.351 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.351 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.351 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.351 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:03.351 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777966+0000", 2024-09-12T00:05:03.352 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6400000000000001e-06 2024-09-12T00:05:03.352 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.352 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.352 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:03.352 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.784444+0000", 2024-09-12T00:05:03.352 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064781179999999997 2024-09-12T00:05:03.352 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.352 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.352 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:03.352 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.784479+0000", 2024-09-12T00:05:03.352 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4267999999999998e-05 2024-09-12T00:05:03.352 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.353 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.353 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:03.353 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.784495+0000", 2024-09-12T00:05:03.353 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6388999999999998e-05 2024-09-12T00:05:03.353 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.353 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.353 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:03.353 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.784609+0000", 2024-09-12T00:05:03.353 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000114209 2024-09-12T00:05:03.353 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.353 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.353 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:03.354 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.784650+0000", 2024-09-12T00:05:03.354 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0515000000000001e-05 2024-09-12T00:05:03.354 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.354 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.354 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:03.354 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793224+0000", 2024-09-12T00:05:03.354 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0085740060000000003 2024-09-12T00:05:03.354 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.354 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.354 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:03.354 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793356+0000", 2024-09-12T00:05:03.354 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000132559 2024-09-12T00:05:03.355 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.355 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:03.355 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.355 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.355 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.355 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2718 3.4 e63/23 3:20fe36bb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_203:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:03.355 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.793296+0000", 2024-09-12T00:05:03.355 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.461756681000001, 2024-09-12T00:05:03.355 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015716714, 2024-09-12T00:05:03.355 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:03.355 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:03.355 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:03.356 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:03.356 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.356 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:03.356 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793296+0000", 2024-09-12T00:05:03.356 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.356 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.356 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:03.356 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793296+0000", 2024-09-12T00:05:03.356 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.356 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.357 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:03.357 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793298+0000", 2024-09-12T00:05:03.357 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0200000000000001e-06 2024-09-12T00:05:03.357 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.357 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.357 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:03.357 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.797364+0000", 2024-09-12T00:05:03.357 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040657039999999998 2024-09-12T00:05:03.357 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.357 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.357 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:03.357 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.797404+0000", 2024-09-12T00:05:03.358 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0302000000000001e-05 2024-09-12T00:05:03.358 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.358 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.358 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:03.358 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.797423+0000", 2024-09-12T00:05:03.358 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8308000000000002e-05 2024-09-12T00:05:03.358 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.358 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.358 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:03.358 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.797582+0000", 2024-09-12T00:05:03.358 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000159047 2024-09-12T00:05:03.359 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.359 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.359 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:03.359 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.797650+0000", 2024-09-12T00:05:03.359 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.7832999999999999e-05 2024-09-12T00:05:03.359 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.359 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.359 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:03.359 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808882+0000", 2024-09-12T00:05:03.359 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011231837999999999 2024-09-12T00:05:03.359 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.359 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.359 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:03.360 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.809013+0000", 2024-09-12T00:05:03.360 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000131662 2024-09-12T00:05:03.360 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.360 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:03.360 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.360 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.360 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2726 3.3e 3:7fc616c8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:03.360 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.866346+0000", 2024-09-12T00:05:03.360 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.388706912, 2024-09-12T00:05:03.360 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018314736000000002, 2024-09-12T00:05:03.360 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:03.361 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:03.361 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:03.361 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:03.361 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:03.361 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:03.361 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2726 2024-09-12T00:05:03.361 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.361 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:03.361 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.361 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:03.361 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.866346+0000", 2024-09-12T00:05:03.361 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.361 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.362 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.362 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:03.362 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.866346+0000", 2024-09-12T00:05:03.362 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.362 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.362 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.362 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:03.362 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.866350+0000", 2024-09-12T00:05:03.362 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.54e-06 2024-09-12T00:05:03.362 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.362 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.362 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:03.362 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.870325+0000", 2024-09-12T00:05:03.363 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003975353 2024-09-12T00:05:03.363 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.363 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.363 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:03.363 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.870362+0000", 2024-09-12T00:05:03.363 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6591000000000003e-05 2024-09-12T00:05:03.363 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.363 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.363 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:03.363 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.870380+0000", 2024-09-12T00:05:03.363 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7921999999999999e-05 2024-09-12T00:05:03.363 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.364 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.364 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:03.364 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.870510+0000", 2024-09-12T00:05:03.364 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013024600000000001 2024-09-12T00:05:03.364 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.364 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.364 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:03.364 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.870921+0000", 2024-09-12T00:05:03.364 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041149600000000002 2024-09-12T00:05:03.364 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.364 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.364 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:03.365 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.871207+0000", 2024-09-12T00:05:03.365 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028534600000000002 2024-09-12T00:05:03.365 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.365 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.365 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:03.365 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.880787+0000", 2024-09-12T00:05:03.365 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095802300000000003 2024-09-12T00:05:03.365 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.365 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.365 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:03.366 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884454+0000", 2024-09-12T00:05:03.366 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0036669480000000002 2024-09-12T00:05:03.366 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.366 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.366 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:03.366 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884546+0000", 2024-09-12T00:05:03.366 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1625000000000005e-05 2024-09-12T00:05:03.366 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.366 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.367 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:03.367 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884661+0000", 2024-09-12T00:05:03.367 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000115439 2024-09-12T00:05:03.367 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.367 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:03.367 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.367 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.367 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.367 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2728 3.1f 3:faea8f78:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:03.368 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.887643+0000", 2024-09-12T00:05:03.368 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.367410214, 2024-09-12T00:05:03.368 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017919767, 2024-09-12T00:05:03.368 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:03.368 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:03.368 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:03.368 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:03.368 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:03.368 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:03.368 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2728 2024-09-12T00:05:03.369 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.369 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:03.369 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.369 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:03.369 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.887643+0000", 2024-09-12T00:05:03.369 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.369 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.369 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.369 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:03.369 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.887643+0000", 2024-09-12T00:05:03.369 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.369 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.370 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.370 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:03.370 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.887647+0000", 2024-09-12T00:05:03.370 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.754e-06 2024-09-12T00:05:03.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.370 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.370 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:03.370 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.891952+0000", 2024-09-12T00:05:03.370 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043048690000000002 2024-09-12T00:05:03.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.370 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.371 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:03.371 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.891990+0000", 2024-09-12T00:05:03.371 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8005e-05 2024-09-12T00:05:03.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.371 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.371 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:03.371 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.892008+0000", 2024-09-12T00:05:03.371 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7995999999999998e-05 2024-09-12T00:05:03.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.371 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.371 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:03.371 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.892140+0000", 2024-09-12T00:05:03.371 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013216200000000001 2024-09-12T00:05:03.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.372 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.372 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:03.372 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.892393+0000", 2024-09-12T00:05:03.372 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025355799999999997 2024-09-12T00:05:03.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.372 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.372 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:03.372 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.892620+0000", 2024-09-12T00:05:03.372 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022690000000000001 2024-09-12T00:05:03.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.372 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.372 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:03.373 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902865+0000", 2024-09-12T00:05:03.373 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010244684 2024-09-12T00:05:03.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.373 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.373 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:03.373 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.905386+0000", 2024-09-12T00:05:03.373 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0025208800000000001 2024-09-12T00:05:03.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.373 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.373 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:03.373 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.905480+0000", 2024-09-12T00:05:03.373 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4493999999999993e-05 2024-09-12T00:05:03.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.373 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.374 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:03.374 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.905563+0000", 2024-09-12T00:05:03.374 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2465000000000004e-05 2024-09-12T00:05:03.374 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.374 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:03.374 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.374 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.374 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.374 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2729 3.0 3:01c0e0c9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:03.374 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:03.374 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.357913706, 2024-09-12T00:05:03.374 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025173068, 2024-09-12T00:05:03.375 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:03.375 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:03.375 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:03.375 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:03.375 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:03.375 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:03.375 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2729 2024-09-12T00:05:03.375 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.375 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:03.375 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.375 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:03.375 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:03.375 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.375 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.376 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.376 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:03.376 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:03.376 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.376 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.376 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.376 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:03.376 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897143+0000", 2024-09-12T00:05:03.376 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6600000000000001e-06 2024-09-12T00:05:03.376 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.376 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.376 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:03.376 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901595+0000", 2024-09-12T00:05:03.376 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044514680000000001 2024-09-12T00:05:03.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.377 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.377 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:03.377 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901629+0000", 2024-09-12T00:05:03.377 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4864999999999999e-05 2024-09-12T00:05:03.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.377 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.377 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:03.377 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901647+0000", 2024-09-12T00:05:03.377 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7699000000000001e-05 2024-09-12T00:05:03.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.377 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.377 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:03.378 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901780+0000", 2024-09-12T00:05:03.378 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013271499999999999 2024-09-12T00:05:03.378 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.378 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.378 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:03.378 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902010+0000", 2024-09-12T00:05:03.378 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022977300000000001 2024-09-12T00:05:03.378 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.378 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.378 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:03.378 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902222+0000", 2024-09-12T00:05:03.378 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021262399999999999 2024-09-12T00:05:03.378 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.378 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.379 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:03.379 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912402+0000", 2024-09-12T00:05:03.379 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010180203000000001 2024-09-12T00:05:03.379 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.379 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.379 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:03.379 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.921990+0000", 2024-09-12T00:05:03.379 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095871900000000006 2024-09-12T00:05:03.379 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.379 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.379 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:03.379 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.922166+0000", 2024-09-12T00:05:03.379 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017591899999999999 2024-09-12T00:05:03.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.380 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.380 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:03.380 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.922313+0000", 2024-09-12T00:05:03.380 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000146952 2024-09-12T00:05:03.380 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.380 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:03.380 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.380 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.380 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2732 3.1f 3:f85b64cb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:03.380 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:03.380 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.326467918000001, 2024-09-12T00:05:03.381 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022644154, 2024-09-12T00:05:03.381 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:03.381 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:03.381 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:03.381 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:03.381 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:03.381 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:03.381 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2732 2024-09-12T00:05:03.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.381 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:03.381 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.381 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:03.381 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:03.381 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.382 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.382 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:03.382 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:03.382 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.382 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.382 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:03.382 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928589+0000", 2024-09-12T00:05:03.382 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1230000000000002e-06 2024-09-12T00:05:03.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.382 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.382 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:03.382 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932650+0000", 2024-09-12T00:05:03.383 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040611049999999997 2024-09-12T00:05:03.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.383 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.383 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:03.383 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932692+0000", 2024-09-12T00:05:03.383 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1677000000000001e-05 2024-09-12T00:05:03.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.383 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.383 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:03.383 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932711+0000", 2024-09-12T00:05:03.383 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8749e-05 2024-09-12T00:05:03.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.383 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.384 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:03.384 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932834+0000", 2024-09-12T00:05:03.384 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012278300000000001 2024-09-12T00:05:03.384 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.384 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.384 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:03.384 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.933095+0000", 2024-09-12T00:05:03.384 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026151100000000002 2024-09-12T00:05:03.384 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.384 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.384 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:03.384 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.933385+0000", 2024-09-12T00:05:03.384 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028993900000000002 2024-09-12T00:05:03.385 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.385 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.385 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:03.385 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.950988+0000", 2024-09-12T00:05:03.385 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017603119 2024-09-12T00:05:03.385 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.385 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.385 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:03.385 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951018+0000", 2024-09-12T00:05:03.385 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9343999999999999e-05 2024-09-12T00:05:03.385 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.385 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.385 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:03.386 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951109+0000", 2024-09-12T00:05:03.386 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1157999999999997e-05 2024-09-12T00:05:03.386 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.386 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.386 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:03.386 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951229+0000", 2024-09-12T00:05:03.386 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120646 2024-09-12T00:05:03.386 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.386 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:03.386 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.386 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.386 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.386 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2741 3.17 3:e9d72553:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:03.387 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.026321+0000", 2024-09-12T00:05:03.387 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.228732291, 2024-09-12T00:05:03.387 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018394443, 2024-09-12T00:05:03.387 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:03.387 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:03.387 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:03.387 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:03.387 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:03.387 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:03.387 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2741 2024-09-12T00:05:03.387 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.387 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:03.387 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.388 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:03.388 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.026321+0000", 2024-09-12T00:05:03.388 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.388 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.388 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.388 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:03.388 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.026321+0000", 2024-09-12T00:05:03.388 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.388 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.388 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.388 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:03.388 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.026325+0000", 2024-09-12T00:05:03.388 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9670000000000003e-06 2024-09-12T00:05:03.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.389 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.389 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:03.389 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030370+0000", 2024-09-12T00:05:03.389 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040448189999999998 2024-09-12T00:05:03.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.389 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.389 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:03.389 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030408+0000", 2024-09-12T00:05:03.389 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8481e-05 2024-09-12T00:05:03.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.389 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.390 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:03.390 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030426+0000", 2024-09-12T00:05:03.390 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8236e-05 2024-09-12T00:05:03.390 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.390 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.390 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:03.390 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030588+0000", 2024-09-12T00:05:03.390 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000161614 2024-09-12T00:05:03.390 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.390 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.390 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:03.390 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030854+0000", 2024-09-12T00:05:03.390 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026595699999999999 2024-09-12T00:05:03.391 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.391 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.391 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:03.391 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.031124+0000", 2024-09-12T00:05:03.391 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027049799999999998 2024-09-12T00:05:03.391 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.391 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.391 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:03.391 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.039845+0000", 2024-09-12T00:05:03.391 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00872063 2024-09-12T00:05:03.391 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.391 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.391 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:03.392 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.044412+0000", 2024-09-12T00:05:03.392 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045666860000000004 2024-09-12T00:05:03.392 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.392 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.392 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:03.392 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.044589+0000", 2024-09-12T00:05:03.392 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000176789 2024-09-12T00:05:03.392 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.392 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.392 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:03.392 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.044715+0000", 2024-09-12T00:05:03.392 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000126766 2024-09-12T00:05:03.393 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.393 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:03.393 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.393 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.393 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.393 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2747 3.17 3:eaa4528d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:03.393 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:03.393 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.166131433, 2024-09-12T00:05:03.393 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025552734000000001, 2024-09-12T00:05:03.393 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:03.393 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:03.393 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:03.393 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:03.394 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:03.394 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:03.394 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2747 2024-09-12T00:05:03.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.394 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:03.394 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.394 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:03.394 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:03.394 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.394 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.394 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:03.394 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:03.395 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.395 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.395 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:03.395 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088925+0000", 2024-09-12T00:05:03.395 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7759999999999999e-06 2024-09-12T00:05:03.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.395 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.395 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:03.395 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093002+0000", 2024-09-12T00:05:03.395 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004076405 2024-09-12T00:05:03.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.395 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.395 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:03.395 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093040+0000", 2024-09-12T00:05:03.396 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8093999999999998e-05 2024-09-12T00:05:03.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.396 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.396 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:03.396 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093059+0000", 2024-09-12T00:05:03.396 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8736000000000002e-05 2024-09-12T00:05:03.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.396 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.396 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:03.396 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093230+0000", 2024-09-12T00:05:03.396 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000170853 2024-09-12T00:05:03.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.396 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.397 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:03.397 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093627+0000", 2024-09-12T00:05:03.397 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039781400000000002 2024-09-12T00:05:03.397 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.397 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.397 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:03.397 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.094044+0000", 2024-09-12T00:05:03.397 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000416205 2024-09-12T00:05:03.397 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.397 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.397 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:03.397 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.103528+0000", 2024-09-12T00:05:03.397 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0094841549999999993 2024-09-12T00:05:03.397 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.398 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.398 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:03.398 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112299+0000", 2024-09-12T00:05:03.398 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0087711590000000006 2024-09-12T00:05:03.398 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.398 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.398 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:03.398 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112397+0000", 2024-09-12T00:05:03.398 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8095000000000002e-05 2024-09-12T00:05:03.398 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.398 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.398 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:03.398 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.114474+0000", 2024-09-12T00:05:03.399 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020774420000000001 2024-09-12T00:05:03.399 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.399 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:03.399 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.399 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.399 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.399 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2748 3.3b e63/23 3:df6d92a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_233:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:03.399 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.104676+0000", 2024-09-12T00:05:03.399 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.150377056, 2024-09-12T00:05:03.399 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016872637999999999, 2024-09-12T00:05:03.399 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:03.399 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:03.399 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:03.400 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:03.400 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.400 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:03.400 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.104676+0000", 2024-09-12T00:05:03.400 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.400 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.400 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.400 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:03.400 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.104676+0000", 2024-09-12T00:05:03.400 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:03.400 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.400 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.401 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:03.401 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.104678+0000", 2024-09-12T00:05:03.401 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5400000000000001e-06 2024-09-12T00:05:03.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.401 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.401 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:03.401 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.108632+0000", 2024-09-12T00:05:03.401 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039548650000000001 2024-09-12T00:05:03.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.401 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.401 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:03.401 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.108662+0000", 2024-09-12T00:05:03.401 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9235999999999999e-05 2024-09-12T00:05:03.402 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.402 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.402 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:03.402 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.108677+0000", 2024-09-12T00:05:03.402 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5455999999999999e-05 2024-09-12T00:05:03.402 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.402 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.402 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:03.402 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.108845+0000", 2024-09-12T00:05:03.402 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016741299999999999 2024-09-12T00:05:03.402 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.402 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.402 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:03.403 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.108906+0000", 2024-09-12T00:05:03.403 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1283000000000003e-05 2024-09-12T00:05:03.403 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.403 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.403 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:03.403 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.121360+0000", 2024-09-12T00:05:03.403 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012454036 2024-09-12T00:05:03.403 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:03.403 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:03.403 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:03.403 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.121549+0000", 2024-09-12T00:05:03.403 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018880899999999999 2024-09-12T00:05:03.403 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.404 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:03.404 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.404 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:03.404 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:03.404 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:03.404 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:05:03.406 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:05:03.407 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:03.405+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:03.506 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:03.505+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:03.563 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:03.563 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:03.581 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:03.582 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:03.582 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:03.582 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:03.582 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:03.596 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:05:03.598 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:03.598 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:03.615 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:03.615 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:03.635 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:03.635 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:03.642 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:03.641+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:03.654 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:05:03.654 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:03.654 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:03.674 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:03.675 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:03.708 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:03.708+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:03.712 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:03.712 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:03.766 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:03.767 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:03.781 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:05:03.830 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:03.829+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:03.905 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:03.905 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:03.910 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:03.909+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:03.919 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:05:04.011 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:04.009+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:04.085 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:04.085 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:04.099 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:05:04.142 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:04.141+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:04.212 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:04.212+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:04.259 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:04.260 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:04.274 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:05:04.312 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:04.312+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:04.394 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:04.394 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:04.410 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:05:04.413 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:04.412+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:04.514 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:04.516+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:04.548 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:04.548 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:04.563 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:05:04.650 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:04.652+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:04.666 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T00:05:04.716 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:04.717+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:04.740 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:04.740 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:04.754 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:05:04.817 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:04.817+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:04.878 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:04.878 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:04.894 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:05:04.938 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:04.940+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:05.014 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:05.015 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:05.019 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:05.017+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:05.028 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:05:05.121 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:05.124+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:05.201 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:05.202 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:05.216 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:05:05.258 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:05.260+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:05.321 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:05.324+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:05.386 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:05.387 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:05.401 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:05:05.446 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:05.448+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:05.522 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:05.524+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:05.567 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:05.567 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:05.582 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:05:05.624 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:05.621+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:05.725 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:05.728+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:05.738 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:05:05.760 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:05.760 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:05.776 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:05:05.865 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:05.868+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:05.918 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:05.918 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:05.926 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:05.928+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:05.950 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:05.950 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:05.965 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:05.966 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:05.968 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:05.969 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:05.981 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:05:05.987 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:05.988 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:06.009 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:06.010 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:06.027 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:06.025+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:06.031 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:06.031 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:06.052 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:06.052 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:06.074 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:06.075 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:06.114 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:06.115 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:06.115 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:05:06.115 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:06.128 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:06.128+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:06.129 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:05:06.229 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:06.229+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:06.299 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:06.300 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:06.300 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:05:06.300 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:05:06.300 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:06.314 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:05:06.365 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:06.368+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:06.431 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:06.429+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:06.447 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:06.447 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:05:06.447 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:05:06.448 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:05:06.448 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.448 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4232.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-12T00:05:06.448 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:05:06.448 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 109.89846057600001, 2024-09-12T00:05:06.448 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.049385680000000001, 2024-09-12T00:05:06.448 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:06.448 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:06.448 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:06.448 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:06.448 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4232", 2024-09-12T00:05:06.448 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/3037249369", 2024-09-12T00:05:06.449 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:05:06.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.449 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:06.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.449 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:06.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:05:06.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.449 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:06.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:05:06.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:06.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548454+0000", 2024-09-12T00:05:06.450 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2259999999999999e-06 2024-09-12T00:05:06.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:06.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548466+0000", 2024-09-12T00:05:06.450 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1361e-05 2024-09-12T00:05:06.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:06.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548492+0000", 2024-09-12T00:05:06.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6225999999999999e-05 2024-09-12T00:05:06.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.451 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:06.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548509+0000", 2024-09-12T00:05:06.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7452000000000002e-05 2024-09-12T00:05:06.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.451 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549371+0000", 2024-09-12T00:05:06.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00086204300000000005 2024-09-12T00:05:06.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.452 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:05:06.452 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549396+0000", 2024-09-12T00:05:06.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.51e-05 2024-09-12T00:05:06.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.452 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.452 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593253+0000", 2024-09-12T00:05:06.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.043856248 2024-09-12T00:05:06.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.452 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:06.452 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593517+0000", 2024-09-12T00:05:06.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026439299999999997 2024-09-12T00:05:06.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.453 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:06.453 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594046+0000", 2024-09-12T00:05:06.453 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00052854200000000001 2024-09-12T00:05:06.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.453 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:06.453 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597642+0000", 2024-09-12T00:05:06.453 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0035959070000000002 2024-09-12T00:05:06.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.453 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:06.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597670+0000", 2024-09-12T00:05:06.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8235999999999999e-05 2024-09-12T00:05:06.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.454 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:06.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597754+0000", 2024-09-12T00:05:06.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4009000000000002e-05 2024-09-12T00:05:06.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.454 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:06.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597833+0000", 2024-09-12T00:05:06.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8937000000000007e-05 2024-09-12T00:05:06.454 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.455 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:06.455 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.455 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T00:05:06.455 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:05:06.455 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 97.117250807999994, 2024-09-12T00:05:06.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025928692999999999, 2024-09-12T00:05:06.455 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:06.455 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:06.455 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "reached pg", 2024-09-12T00:05:06.455 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:06.455 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:06.455 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 43 2024-09-12T00:05:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:05:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:05:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329660+0000", 2024-09-12T00:05:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.965e-06 2024-09-12T00:05:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329673+0000", 2024-09-12T00:05:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3402e-05 2024-09-12T00:05:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329706+0000", 2024-09-12T00:05:06.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2441000000000003e-05 2024-09-12T00:05:06.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.458 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.458 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:06.458 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329723+0000", 2024-09-12T00:05:06.458 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7609e-05 2024-09-12T00:05:06.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.458 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.458 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.458 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330437+0000", 2024-09-12T00:05:06.458 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00071403500000000002 2024-09-12T00:05:06.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.458 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.458 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:05:06.459 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330454+0000", 2024-09-12T00:05:06.459 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6820000000000002e-05 2024-09-12T00:05:06.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.459 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.459 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347344+0000", 2024-09-12T00:05:06.459 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016890275 2024-09-12T00:05:06.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.459 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:05:06.459 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347365+0000", 2024-09-12T00:05:06.459 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0350999999999999e-05 2024-09-12T00:05:06.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.459 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.460 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355323+0000", 2024-09-12T00:05:06.460 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079579400000000002 2024-09-12T00:05:06.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.460 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:06.460 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355585+0000", 2024-09-12T00:05:06.460 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026285499999999999 2024-09-12T00:05:06.460 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.460 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:06.460 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.460 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1641 3.26 e58/23 3:658fe58e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2__shadow_.hDHTDpIswwqRA2bHiHVxkhWqZde6XEj_1:head v 58'1, mlcod=0'0)", 2024-09-12T00:05:06.460 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:05:06.461 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 33.387892305000001, 2024-09-12T00:05:06.461 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014950144, 2024-09-12T00:05:06.461 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:06.461 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:06.461 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:06.461 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:06.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.461 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:06.461 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:05:06.461 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.461 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:06.461 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:05:06.462 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.462 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:06.462 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059017+0000", 2024-09-12T00:05:06.462 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.508e-06 2024-09-12T00:05:06.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.463 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:06.463 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061582+0000", 2024-09-12T00:05:06.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025654010000000001 2024-09-12T00:05:06.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.463 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:06.463 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061607+0000", 2024-09-12T00:05:06.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5028000000000002e-05 2024-09-12T00:05:06.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.463 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:06.463 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061619+0000", 2024-09-12T00:05:06.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1905999999999999e-05 2024-09-12T00:05:06.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.464 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.464 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061696+0000", 2024-09-12T00:05:06.464 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7305999999999995e-05 2024-09-12T00:05:06.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.464 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:06.464 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061717+0000", 2024-09-12T00:05:06.464 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0380000000000001e-05 2024-09-12T00:05:06.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.464 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:06.465 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073925+0000", 2024-09-12T00:05:06.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012208088000000001 2024-09-12T00:05:06.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.465 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:06.465 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073965+0000", 2024-09-12T00:05:06.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0527e-05 2024-09-12T00:05:06.465 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.465 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:06.465 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.465 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1775 3.30 3:0c2ae78d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:05:06.466 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:05:06.466 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 32.448054986999999, 2024-09-12T00:05:06.466 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020783729000000001, 2024-09-12T00:05:06.466 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:06.466 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:06.466 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:06.466 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:06.466 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:06.466 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:06.466 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1775 2024-09-12T00:05:06.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.466 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:06.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.467 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:06.467 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:05:06.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.467 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:06.467 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:05:06.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.467 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:06.467 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998856+0000", 2024-09-12T00:05:06.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6849999999999999e-06 2024-09-12T00:05:06.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.468 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:06.468 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001327+0000", 2024-09-12T00:05:06.468 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024706279999999999 2024-09-12T00:05:06.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.468 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:06.468 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001355+0000", 2024-09-12T00:05:06.468 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8419999999999999e-05 2024-09-12T00:05:06.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.468 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:06.468 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001366+0000", 2024-09-12T00:05:06.468 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1073999999999999e-05 2024-09-12T00:05:06.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.469 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001438+0000", 2024-09-12T00:05:06.469 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1389000000000004e-05 2024-09-12T00:05:06.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:06.469 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001548+0000", 2024-09-12T00:05:06.469 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110612 2024-09-12T00:05:06.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.469 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:06.470 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001639+0000", 2024-09-12T00:05:06.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0192999999999995e-05 2024-09-12T00:05:06.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.470 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:06.470 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019057+0000", 2024-09-12T00:05:06.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017418411000000002 2024-09-12T00:05:06.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.470 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:06.470 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019528+0000", 2024-09-12T00:05:06.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00047075699999999998 2024-09-12T00:05:06.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.470 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:06.471 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019577+0000", 2024-09-12T00:05:06.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8714999999999997e-05 2024-09-12T00:05:06.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.471 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:06.471 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019636+0000", 2024-09-12T00:05:06.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9845e-05 2024-09-12T00:05:06.471 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.471 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:06.471 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.471 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1780 3.16 e58/23 3:69d8ee52:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3_10Mb.:head v 58'1, mlcod=0'0)", 2024-09-12T00:05:06.471 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:05:06.472 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 32.421761695000001, 2024-09-12T00:05:06.472 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01408911, 2024-09-12T00:05:06.472 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:06.472 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:06.472 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:06.472 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:06.472 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.472 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:06.472 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:05:06.472 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.472 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.472 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.472 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:06.472 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:05:06.473 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.473 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.473 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:06.473 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025148+0000", 2024-09-12T00:05:06.473 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4229999999999999e-06 2024-09-12T00:05:06.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.473 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.473 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:06.473 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026337+0000", 2024-09-12T00:05:06.473 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011890589999999999 2024-09-12T00:05:06.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.474 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:06.474 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026362+0000", 2024-09-12T00:05:06.474 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4566000000000002e-05 2024-09-12T00:05:06.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.474 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:06.474 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026372+0000", 2024-09-12T00:05:06.474 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8509999999999994e-06 2024-09-12T00:05:06.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.474 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.474 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026448+0000", 2024-09-12T00:05:06.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6626999999999997e-05 2024-09-12T00:05:06.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.475 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:06.475 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026473+0000", 2024-09-12T00:05:06.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4647e-05 2024-09-12T00:05:06.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.475 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:06.475 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039120+0000", 2024-09-12T00:05:06.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012647122 2024-09-12T00:05:06.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.475 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:06.476 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039235+0000", 2024-09-12T00:05:06.476 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000114815 2024-09-12T00:05:06.476 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.476 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:06.476 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.476 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.476 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2648 3.13 3:c936a360:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:06.476 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.164782+0000", 2024-09-12T00:05:06.476 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 19.282125407999999, 2024-09-12T00:05:06.476 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019628063000000001, 2024-09-12T00:05:06.476 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:06.476 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:06.477 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:06.477 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:06.477 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:06.477 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:06.477 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2648 2024-09-12T00:05:06.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.477 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:06.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.477 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:06.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.164782+0000", 2024-09-12T00:05:06.477 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.478 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:06.478 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.164782+0000", 2024-09-12T00:05:06.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.478 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:06.478 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.164786+0000", 2024-09-12T00:05:06.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3450000000000002e-06 2024-09-12T00:05:06.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.478 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:06.478 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166758+0000", 2024-09-12T00:05:06.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019721629999999999 2024-09-12T00:05:06.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.479 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:06.479 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166785+0000", 2024-09-12T00:05:06.479 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7676000000000001e-05 2024-09-12T00:05:06.479 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.479 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.479 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:06.479 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166799+0000", 2024-09-12T00:05:06.479 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3716e-05 2024-09-12T00:05:06.479 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.479 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.479 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.479 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166895+0000", 2024-09-12T00:05:06.480 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6243999999999995e-05 2024-09-12T00:05:06.480 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.480 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.480 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:06.480 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.167092+0000", 2024-09-12T00:05:06.480 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019639200000000001 2024-09-12T00:05:06.480 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.480 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.480 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:06.480 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.167273+0000", 2024-09-12T00:05:06.480 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000181533 2024-09-12T00:05:06.480 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.480 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.480 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:06.481 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.174331+0000", 2024-09-12T00:05:06.481 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0070577879999999997 2024-09-12T00:05:06.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.481 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.481 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:06.481 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.184172+0000", 2024-09-12T00:05:06.481 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0098409469999999992 2024-09-12T00:05:06.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.481 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.481 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:06.481 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.184238+0000", 2024-09-12T00:05:06.481 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6036000000000003e-05 2024-09-12T00:05:06.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.482 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.482 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:06.482 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.184410+0000", 2024-09-12T00:05:06.482 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017222299999999999 2024-09-12T00:05:06.482 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.482 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:06.482 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.482 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.482 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.482 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2659 3.2d 3:b4a71344:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:06.482 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.285246+0000", 2024-09-12T00:05:06.482 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 19.161661505000001, 2024-09-12T00:05:06.482 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020000217000000001, 2024-09-12T00:05:06.482 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:06.483 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:06.483 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:06.483 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:06.483 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:06.483 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:06.483 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2659 2024-09-12T00:05:06.483 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.483 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:06.483 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.483 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:06.483 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.285246+0000", 2024-09-12T00:05:06.483 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.483 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.483 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.484 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:06.484 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.285246+0000", 2024-09-12T00:05:06.484 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.484 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.484 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.484 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:06.484 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.285249+0000", 2024-09-12T00:05:06.484 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3890000000000001e-06 2024-09-12T00:05:06.484 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.484 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.484 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:06.484 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287047+0000", 2024-09-12T00:05:06.484 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017978099999999999 2024-09-12T00:05:06.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.485 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.485 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:06.485 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287084+0000", 2024-09-12T00:05:06.485 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6358e-05 2024-09-12T00:05:06.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.485 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.485 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:06.485 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287101+0000", 2024-09-12T00:05:06.485 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7815000000000001e-05 2024-09-12T00:05:06.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.485 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.485 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.486 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287198+0000", 2024-09-12T00:05:06.486 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6482000000000002e-05 2024-09-12T00:05:06.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.486 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.486 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:06.486 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287337+0000", 2024-09-12T00:05:06.486 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013917500000000001 2024-09-12T00:05:06.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.486 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.486 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:06.486 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287451+0000", 2024-09-12T00:05:06.486 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000113962 2024-09-12T00:05:06.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.487 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.487 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:06.487 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.293889+0000", 2024-09-12T00:05:06.487 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064380110000000004 2024-09-12T00:05:06.487 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.487 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.487 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:06.487 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.305119+0000", 2024-09-12T00:05:06.487 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011229872 2024-09-12T00:05:06.487 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.487 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.487 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:06.487 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.305191+0000", 2024-09-12T00:05:06.487 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2002000000000006e-05 2024-09-12T00:05:06.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.488 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.488 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:06.488 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.305246+0000", 2024-09-12T00:05:06.488 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5340999999999998e-05 2024-09-12T00:05:06.488 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.488 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:06.488 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.488 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.488 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2662 3.28 3:1791a19e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:06.488 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.317519+0000", 2024-09-12T00:05:06.488 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 19.129388556999999, 2024-09-12T00:05:06.489 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016495961999999999, 2024-09-12T00:05:06.489 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:06.489 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:06.489 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:06.489 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:06.489 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:06.489 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:06.489 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2662 2024-09-12T00:05:06.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.489 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:06.489 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.489 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:06.489 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317519+0000", 2024-09-12T00:05:06.489 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.490 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.490 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.490 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:06.490 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317519+0000", 2024-09-12T00:05:06.490 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.490 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.490 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.490 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:06.490 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317522+0000", 2024-09-12T00:05:06.490 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7389999999999999e-06 2024-09-12T00:05:06.490 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.490 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.490 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:06.491 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319683+0000", 2024-09-12T00:05:06.491 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021614970000000001 2024-09-12T00:05:06.491 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.491 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.491 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:06.491 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319715+0000", 2024-09-12T00:05:06.491 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1574e-05 2024-09-12T00:05:06.491 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.491 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.491 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:06.491 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319730+0000", 2024-09-12T00:05:06.491 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5543e-05 2024-09-12T00:05:06.491 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.491 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.492 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.492 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319820+0000", 2024-09-12T00:05:06.492 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9402999999999998e-05 2024-09-12T00:05:06.492 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.492 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.492 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:06.492 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319976+0000", 2024-09-12T00:05:06.492 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015662900000000001 2024-09-12T00:05:06.492 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.492 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.492 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:06.492 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.320143+0000", 2024-09-12T00:05:06.492 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000166207 2024-09-12T00:05:06.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.493 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.493 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:06.493 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.327504+0000", 2024-09-12T00:05:06.493 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0073616189999999998 2024-09-12T00:05:06.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.493 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.493 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:06.493 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.333886+0000", 2024-09-12T00:05:06.493 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063817650000000002 2024-09-12T00:05:06.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.493 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.493 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:06.494 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.333952+0000", 2024-09-12T00:05:06.494 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5889999999999994e-05 2024-09-12T00:05:06.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.494 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:06.494 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.334015+0000", 2024-09-12T00:05:06.494 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3095999999999994e-05 2024-09-12T00:05:06.494 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.494 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:06.494 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.494 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2664 3.1d 3:b8bd1b2d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:06.495 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.341755+0000", 2024-09-12T00:05:06.495 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 19.105152701000002, 2024-09-12T00:05:06.495 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017365477000000001, 2024-09-12T00:05:06.495 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:06.495 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:06.495 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:06.495 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:06.495 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:06.495 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:06.495 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2664 2024-09-12T00:05:06.495 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.495 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:06.495 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.495 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:06.495 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.341755+0000", 2024-09-12T00:05:06.496 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.496 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.496 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.496 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:06.496 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.341755+0000", 2024-09-12T00:05:06.496 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.496 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.496 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.496 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:06.496 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.341758+0000", 2024-09-12T00:05:06.496 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6560000000000001e-06 2024-09-12T00:05:06.496 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.496 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.497 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:06.497 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343741+0000", 2024-09-12T00:05:06.497 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019832389999999999 2024-09-12T00:05:06.497 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.497 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.497 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:06.497 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343766+0000", 2024-09-12T00:05:06.497 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4967e-05 2024-09-12T00:05:06.497 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.497 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.497 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:06.497 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343776+0000", 2024-09-12T00:05:06.497 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0686000000000001e-05 2024-09-12T00:05:06.498 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.498 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.498 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.498 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343854+0000", 2024-09-12T00:05:06.498 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7210000000000001e-05 2024-09-12T00:05:06.498 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.498 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.498 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:06.498 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.344027+0000", 2024-09-12T00:05:06.498 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000173065 2024-09-12T00:05:06.498 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.498 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.498 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:06.499 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.344194+0000", 2024-09-12T00:05:06.499 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016688900000000001 2024-09-12T00:05:06.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.499 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.499 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:06.499 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.358530+0000", 2024-09-12T00:05:06.499 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014336877 2024-09-12T00:05:06.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.499 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.499 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:06.499 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.359009+0000", 2024-09-12T00:05:06.499 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00047882099999999999 2024-09-12T00:05:06.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.500 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.500 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:06.500 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.359069+0000", 2024-09-12T00:05:06.500 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9892999999999997e-05 2024-09-12T00:05:06.500 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.500 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.500 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:06.500 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.359120+0000", 2024-09-12T00:05:06.500 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1174000000000002e-05 2024-09-12T00:05:06.500 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.500 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:06.500 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.500 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.500 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.501 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2666 3.13 3:cbd43ea3:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:06.501 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.362905+0000", 2024-09-12T00:05:06.501 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 19.084002319, 2024-09-12T00:05:06.501 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017815950000000001, 2024-09-12T00:05:06.501 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:06.501 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:06.501 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:06.501 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:06.501 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:06.501 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:06.501 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2666 2024-09-12T00:05:06.501 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.501 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:06.502 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.502 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:06.502 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.362905+0000", 2024-09-12T00:05:06.502 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.502 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.502 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.502 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:06.502 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.362905+0000", 2024-09-12T00:05:06.502 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.502 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.502 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.502 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:06.502 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.362909+0000", 2024-09-12T00:05:06.502 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4529999999999998e-06 2024-09-12T00:05:06.503 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.503 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.503 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:06.503 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364466+0000", 2024-09-12T00:05:06.503 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015570060000000001 2024-09-12T00:05:06.503 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.503 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.503 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:06.503 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364500+0000", 2024-09-12T00:05:06.503 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4289999999999999e-05 2024-09-12T00:05:06.503 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.503 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.503 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:06.503 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364515+0000", 2024-09-12T00:05:06.504 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4537e-05 2024-09-12T00:05:06.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.504 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.504 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.504 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364615+0000", 2024-09-12T00:05:06.504 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100782 2024-09-12T00:05:06.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.504 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.504 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:06.504 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364805+0000", 2024-09-12T00:05:06.504 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018921399999999999 2024-09-12T00:05:06.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.504 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.505 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:06.505 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364984+0000", 2024-09-12T00:05:06.505 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017972299999999999 2024-09-12T00:05:06.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.505 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.505 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:06.505 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.372042+0000", 2024-09-12T00:05:06.505 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0070581120000000001 2024-09-12T00:05:06.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.505 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.505 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:06.505 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.380620+0000", 2024-09-12T00:05:06.505 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085774309999999999 2024-09-12T00:05:06.506 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.506 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.506 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:06.506 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.380666+0000", 2024-09-12T00:05:06.506 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5881000000000003e-05 2024-09-12T00:05:06.506 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.506 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.506 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:06.506 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.380721+0000", 2024-09-12T00:05:06.506 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5520999999999999e-05 2024-09-12T00:05:06.506 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.506 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:06.506 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.507 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.507 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.507 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2677 3.13 3:c9d59693:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:06.507 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.474053+0000", 2024-09-12T00:05:06.507 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.972854972, 2024-09-12T00:05:06.507 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017985961000000002, 2024-09-12T00:05:06.507 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:06.507 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:06.507 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:06.507 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:06.507 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:06.507 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:06.507 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2677 2024-09-12T00:05:06.508 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.508 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:06.508 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.508 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:06.508 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.474053+0000", 2024-09-12T00:05:06.508 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.508 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.508 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.508 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:06.508 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.474053+0000", 2024-09-12T00:05:06.508 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.508 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.508 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.474055+0000", 2024-09-12T00:05:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.711e-06 2024-09-12T00:05:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475342+0000", 2024-09-12T00:05:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001286508 2024-09-12T00:05:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475373+0000", 2024-09-12T00:05:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1130000000000002e-05 2024-09-12T00:05:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475387+0000", 2024-09-12T00:05:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4280999999999999e-05 2024-09-12T00:05:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475476+0000", 2024-09-12T00:05:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8621000000000004e-05 2024-09-12T00:05:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475644+0000", 2024-09-12T00:05:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016785699999999999 2024-09-12T00:05:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475742+0000", 2024-09-12T00:05:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8016000000000005e-05 2024-09-12T00:05:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.480305+0000", 2024-09-12T00:05:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045629049999999999 2024-09-12T00:05:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.491948+0000", 2024-09-12T00:05:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011643280000000001 2024-09-12T00:05:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.492000+0000", 2024-09-12T00:05:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2482000000000003e-05 2024-09-12T00:05:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.492039+0000", 2024-09-12T00:05:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8170000000000002e-05 2024-09-12T00:05:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:06.513 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.513 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.513 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.513 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2691 3.2d 3:b4a2284d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:06.513 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.515274+0000", 2024-09-12T00:05:06.513 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.931633915999999, 2024-09-12T00:05:06.513 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018577757, 2024-09-12T00:05:06.513 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:06.513 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:06.513 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:06.513 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:06.513 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:06.513 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:06.514 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2691 2024-09-12T00:05:06.514 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.514 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:06.514 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.514 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:06.514 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.515274+0000", 2024-09-12T00:05:06.514 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.514 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.514 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.514 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:06.514 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.515274+0000", 2024-09-12T00:05:06.514 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.514 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.514 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.515 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:06.515 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.515276+0000", 2024-09-12T00:05:06.515 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3499999999999999e-06 2024-09-12T00:05:06.515 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.515 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.515 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:06.515 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.516900+0000", 2024-09-12T00:05:06.515 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001623633 2024-09-12T00:05:06.515 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.515 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.515 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:06.515 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.516929+0000", 2024-09-12T00:05:06.515 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9009999999999998e-05 2024-09-12T00:05:06.515 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.516 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.516 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:06.516 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.516942+0000", 2024-09-12T00:05:06.516 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3551e-05 2024-09-12T00:05:06.516 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.516 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.516 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.516 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.517022+0000", 2024-09-12T00:05:06.516 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0167999999999995e-05 2024-09-12T00:05:06.516 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.516 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.516 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:06.517 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.517216+0000", 2024-09-12T00:05:06.517 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000193919 2024-09-12T00:05:06.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.517 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.517 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:06.517 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.517380+0000", 2024-09-12T00:05:06.517 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016336000000000001 2024-09-12T00:05:06.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.517 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.517 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:06.517 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.522907+0000", 2024-09-12T00:05:06.517 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055276420000000001 2024-09-12T00:05:06.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.518 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.518 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:06.518 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.533735+0000", 2024-09-12T00:05:06.518 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010827997000000001 2024-09-12T00:05:06.518 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.518 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.518 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:06.518 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.533800+0000", 2024-09-12T00:05:06.518 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4738000000000003e-05 2024-09-12T00:05:06.518 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.518 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.518 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:06.518 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.533851+0000", 2024-09-12T00:05:06.518 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1388999999999999e-05 2024-09-12T00:05:06.519 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.519 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:06.519 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.519 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.519 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.519 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2697 3.13 3:c87ccb22:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:06.519 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.577849+0000", 2024-09-12T00:05:06.519 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.869058595999999, 2024-09-12T00:05:06.519 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019139156000000001, 2024-09-12T00:05:06.519 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:06.519 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:06.519 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:06.520 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:06.520 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:06.520 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:06.520 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2697 2024-09-12T00:05:06.520 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.520 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:06.520 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.520 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:06.520 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577849+0000", 2024-09-12T00:05:06.520 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.520 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.520 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.520 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:06.521 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577849+0000", 2024-09-12T00:05:06.521 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.521 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.521 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.521 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:06.521 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577853+0000", 2024-09-12T00:05:06.521 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7510000000000002e-06 2024-09-12T00:05:06.521 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.521 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.521 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:06.521 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579595+0000", 2024-09-12T00:05:06.521 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001741954 2024-09-12T00:05:06.521 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.521 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.522 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:06.522 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579625+0000", 2024-09-12T00:05:06.522 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9907999999999999e-05 2024-09-12T00:05:06.522 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.522 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.522 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:06.522 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579640+0000", 2024-09-12T00:05:06.522 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4894e-05 2024-09-12T00:05:06.522 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.522 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.522 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.522 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579728+0000", 2024-09-12T00:05:06.522 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8704999999999999e-05 2024-09-12T00:05:06.523 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.523 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.523 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:06.523 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579922+0000", 2024-09-12T00:05:06.523 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000194019 2024-09-12T00:05:06.523 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.523 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.523 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:06.523 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.580092+0000", 2024-09-12T00:05:06.523 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016984300000000001 2024-09-12T00:05:06.523 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.523 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.523 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:06.524 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.591944+0000", 2024-09-12T00:05:06.524 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011852252000000001 2024-09-12T00:05:06.524 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.524 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.524 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:06.524 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.596913+0000", 2024-09-12T00:05:06.524 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049688279999999998 2024-09-12T00:05:06.524 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.524 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.524 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:06.524 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.596955+0000", 2024-09-12T00:05:06.524 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2290999999999999e-05 2024-09-12T00:05:06.524 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.525 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.525 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:06.525 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.596988+0000", 2024-09-12T00:05:06.525 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2710999999999999e-05 2024-09-12T00:05:06.525 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.525 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:06.525 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.525 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.525 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.525 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2701 3.11 3:8babcc8d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:06.525 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.617191+0000", 2024-09-12T00:05:06.525 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.829716983000001, 2024-09-12T00:05:06.525 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013760204999999999, 2024-09-12T00:05:06.526 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:06.526 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:06.526 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:06.526 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:06.526 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:06.526 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:06.526 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2701 2024-09-12T00:05:06.526 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.526 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:06.526 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.526 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:06.526 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.617191+0000", 2024-09-12T00:05:06.526 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.527 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.527 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.527 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:06.527 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.617191+0000", 2024-09-12T00:05:06.527 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.527 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.527 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.527 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:06.527 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.617194+0000", 2024-09-12T00:05:06.527 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.788e-06 2024-09-12T00:05:06.527 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.527 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.527 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:06.528 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618652+0000", 2024-09-12T00:05:06.528 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001457716 2024-09-12T00:05:06.528 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.528 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.528 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:06.528 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618682+0000", 2024-09-12T00:05:06.528 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9668000000000001e-05 2024-09-12T00:05:06.528 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.528 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.528 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:06.528 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618692+0000", 2024-09-12T00:05:06.528 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0429e-05 2024-09-12T00:05:06.528 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.529 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.529 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.529 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618766+0000", 2024-09-12T00:05:06.529 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4190999999999995e-05 2024-09-12T00:05:06.529 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.529 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.529 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:06.529 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618932+0000", 2024-09-12T00:05:06.529 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000165923 2024-09-12T00:05:06.529 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.529 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.529 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:06.529 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.619026+0000", 2024-09-12T00:05:06.530 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3906999999999994e-05 2024-09-12T00:05:06.530 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.530 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.530 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:06.530 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.623168+0000", 2024-09-12T00:05:06.530 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041419309999999997 2024-09-12T00:05:06.530 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.530 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.530 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:06.530 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.630815+0000", 2024-09-12T00:05:06.530 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0076470100000000001 2024-09-12T00:05:06.530 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.530 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.530 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:06.531 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.630887+0000", 2024-09-12T00:05:06.531 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2218999999999994e-05 2024-09-12T00:05:06.531 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.531 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.531 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:06.531 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.630951+0000", 2024-09-12T00:05:06.531 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3423000000000006e-05 2024-09-12T00:05:06.531 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.531 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:06.531 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.531 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.531 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.531 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2704 3.13 3:c90afc39:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:06.532 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.647542+0000", 2024-09-12T00:05:06.532 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.799365120000001, 2024-09-12T00:05:06.532 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017595339000000002, 2024-09-12T00:05:06.532 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:06.532 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:06.532 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:06.532 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:06.532 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:06.532 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:06.532 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2704 2024-09-12T00:05:06.532 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.532 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:06.532 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.533 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:06.533 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.647542+0000", 2024-09-12T00:05:06.533 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.533 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.533 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.533 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:06.533 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.647542+0000", 2024-09-12T00:05:06.533 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.533 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.533 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.533 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:06.533 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.647544+0000", 2024-09-12T00:05:06.534 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6339999999999999e-06 2024-09-12T00:05:06.534 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.534 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.534 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:06.534 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649032+0000", 2024-09-12T00:05:06.534 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001488063 2024-09-12T00:05:06.534 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.534 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.534 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:06.534 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649053+0000", 2024-09-12T00:05:06.534 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0761e-05 2024-09-12T00:05:06.534 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.534 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.535 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:06.535 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649066+0000", 2024-09-12T00:05:06.535 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2597e-05 2024-09-12T00:05:06.535 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.535 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.535 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.535 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649142+0000", 2024-09-12T00:05:06.535 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6254999999999994e-05 2024-09-12T00:05:06.535 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.535 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.535 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:06.535 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649250+0000", 2024-09-12T00:05:06.535 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010774500000000001 2024-09-12T00:05:06.536 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.536 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.536 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:06.536 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649364+0000", 2024-09-12T00:05:06.536 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000114401 2024-09-12T00:05:06.536 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.536 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.536 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:06.536 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.658970+0000", 2024-09-12T00:05:06.536 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0096065260000000006 2024-09-12T00:05:06.536 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.536 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.537 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:06.537 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.665022+0000", 2024-09-12T00:05:06.537 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0060516459999999999 2024-09-12T00:05:06.537 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.537 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.537 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:06.537 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.665086+0000", 2024-09-12T00:05:06.537 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3940000000000001e-05 2024-09-12T00:05:06.537 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.537 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.537 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:06.537 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.665138+0000", 2024-09-12T00:05:06.537 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1771000000000003e-05 2024-09-12T00:05:06.538 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.538 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:06.538 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.538 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.538 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.538 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2706 3.d 3:b1b5d8c6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:06.538 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.667263+0000", 2024-09-12T00:05:06.538 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.779644166000001, 2024-09-12T00:05:06.538 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017030099999999999, 2024-09-12T00:05:06.538 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:06.538 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:06.538 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:06.538 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:06.539 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:06.539 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:06.539 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2706 2024-09-12T00:05:06.539 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.539 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:06.539 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.539 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:06.539 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.667263+0000", 2024-09-12T00:05:06.539 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.539 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.539 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.539 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:06.539 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.667263+0000", 2024-09-12T00:05:06.540 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.540 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.540 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.540 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:06.540 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.667267+0000", 2024-09-12T00:05:06.540 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1540000000000002e-06 2024-09-12T00:05:06.540 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.540 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.540 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:06.540 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672789+0000", 2024-09-12T00:05:06.540 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055222819999999999 2024-09-12T00:05:06.540 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.541 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.541 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:06.541 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672817+0000", 2024-09-12T00:05:06.541 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8510999999999999e-05 2024-09-12T00:05:06.541 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.541 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.541 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:06.541 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672831+0000", 2024-09-12T00:05:06.541 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3919e-05 2024-09-12T00:05:06.541 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.541 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.541 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.542 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672988+0000", 2024-09-12T00:05:06.542 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015688 2024-09-12T00:05:06.542 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.542 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.542 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:06.542 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.673174+0000", 2024-09-12T00:05:06.542 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018615400000000001 2024-09-12T00:05:06.542 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.542 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.542 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:06.542 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.673352+0000", 2024-09-12T00:05:06.542 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017803599999999999 2024-09-12T00:05:06.542 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.542 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.542 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.683897+0000", 2024-09-12T00:05:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010544239 2024-09-12T00:05:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.684176+0000", 2024-09-12T00:05:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000279506 2024-09-12T00:05:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.684235+0000", 2024-09-12T00:05:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9101000000000002e-05 2024-09-12T00:05:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.544 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:06.544 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.684294+0000", 2024-09-12T00:05:06.544 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8318e-05 2024-09-12T00:05:06.544 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.544 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:06.544 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.544 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.544 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.544 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2714 3.17 e63/23 3:eac65a57:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_199:head v 63'3, mlcod=62'1)", 2024-09-12T00:05:06.544 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.752259+0000", 2024-09-12T00:05:06.544 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.694648632, 2024-09-12T00:05:06.544 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013747212, 2024-09-12T00:05:06.545 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:06.545 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:06.545 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:06.545 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:06.545 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.545 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:06.545 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.752259+0000", 2024-09-12T00:05:06.545 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.545 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.545 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.545 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:06.545 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.752259+0000", 2024-09-12T00:05:06.545 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.545 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.545 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.546 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:06.546 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.752261+0000", 2024-09-12T00:05:06.546 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2390000000000001e-06 2024-09-12T00:05:06.546 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.546 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.546 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:06.546 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757723+0000", 2024-09-12T00:05:06.546 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054619569999999999 2024-09-12T00:05:06.546 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.546 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.546 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:06.546 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757749+0000", 2024-09-12T00:05:06.546 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5732999999999999e-05 2024-09-12T00:05:06.546 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.547 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.547 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:06.547 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757762+0000", 2024-09-12T00:05:06.547 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3556e-05 2024-09-12T00:05:06.547 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.547 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.547 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.547 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757841+0000", 2024-09-12T00:05:06.547 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8644000000000001e-05 2024-09-12T00:05:06.547 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.547 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.547 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:06.547 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757864+0000", 2024-09-12T00:05:06.548 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3112000000000002e-05 2024-09-12T00:05:06.548 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.548 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.548 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:06.548 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.765956+0000", 2024-09-12T00:05:06.548 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080919679999999997 2024-09-12T00:05:06.548 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.548 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.548 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:06.548 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766006+0000", 2024-09-12T00:05:06.548 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0003000000000002e-05 2024-09-12T00:05:06.548 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.548 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:06.549 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.549 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.549 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.549 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2742 3.1d 3:b8ae26ad:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:06.549 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.035857+0000", 2024-09-12T00:05:06.549 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.41105095, 2024-09-12T00:05:06.549 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025139262999999998, 2024-09-12T00:05:06.549 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:06.549 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:06.549 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:06.549 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:06.549 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:06.549 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:06.550 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2742 2024-09-12T00:05:06.550 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.550 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:06.550 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.550 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:06.550 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.035857+0000", 2024-09-12T00:05:06.550 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.550 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.550 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.550 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:06.550 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.035857+0000", 2024-09-12T00:05:06.550 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.550 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.550 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.551 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:06.551 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.035859+0000", 2024-09-12T00:05:06.551 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0899999999999999e-06 2024-09-12T00:05:06.551 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.551 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.551 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:06.551 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038486+0000", 2024-09-12T00:05:06.551 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026273749999999999 2024-09-12T00:05:06.551 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.551 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.551 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:06.551 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038511+0000", 2024-09-12T00:05:06.551 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5327e-05 2024-09-12T00:05:06.552 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.552 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.552 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:06.552 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038527+0000", 2024-09-12T00:05:06.552 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5196e-05 2024-09-12T00:05:06.552 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.552 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.552 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.552 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038604+0000", 2024-09-12T00:05:06.552 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6921000000000004e-05 2024-09-12T00:05:06.552 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.552 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.552 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:06.553 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038789+0000", 2024-09-12T00:05:06.553 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018526400000000001 2024-09-12T00:05:06.553 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.553 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.553 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:06.553 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.039001+0000", 2024-09-12T00:05:06.553 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021200400000000001 2024-09-12T00:05:06.553 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.553 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.553 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:06.553 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.056879+0000", 2024-09-12T00:05:06.553 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017877783000000001 2024-09-12T00:05:06.553 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.554 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.554 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:06.554 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.060872+0000", 2024-09-12T00:05:06.554 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039929529999999996 2024-09-12T00:05:06.554 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.554 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.554 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:06.554 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.060942+0000", 2024-09-12T00:05:06.554 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0060000000000003e-05 2024-09-12T00:05:06.554 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.554 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.554 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:06.554 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.060996+0000", 2024-09-12T00:05:06.555 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4289999999999997e-05 2024-09-12T00:05:06.555 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.555 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:06.555 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.555 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.555 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.555 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2747 3.17 e63/23 3:eaa4528d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_232:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:06.555 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.094555+0000", 2024-09-12T00:05:06.555 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.352352122999999, 2024-09-12T00:05:06.555 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017679139, 2024-09-12T00:05:06.555 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:06.555 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:06.555 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:06.555 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:06.556 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.556 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:06.556 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.094555+0000", 2024-09-12T00:05:06.556 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.556 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.556 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.556 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:06.556 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.094555+0000", 2024-09-12T00:05:06.556 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.556 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.556 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.556 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:06.556 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.094558+0000", 2024-09-12T00:05:06.557 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.232e-06 2024-09-12T00:05:06.557 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.557 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.557 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:06.557 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098897+0000", 2024-09-12T00:05:06.557 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0043397840000000002 2024-09-12T00:05:06.557 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.557 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.557 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:06.557 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098930+0000", 2024-09-12T00:05:06.557 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2592000000000002e-05 2024-09-12T00:05:06.557 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.557 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.557 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:06.558 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098945+0000", 2024-09-12T00:05:06.558 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4759e-05 2024-09-12T00:05:06.558 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.558 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.558 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.558 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.099033+0000", 2024-09-12T00:05:06.558 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8535000000000005e-05 2024-09-12T00:05:06.558 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.558 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.558 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:06.558 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.099065+0000", 2024-09-12T00:05:06.558 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1825000000000001e-05 2024-09-12T00:05:06.558 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.559 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.559 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:06.559 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112134+0000", 2024-09-12T00:05:06.559 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013068329 2024-09-12T00:05:06.559 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.559 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.559 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:06.559 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112235+0000", 2024-09-12T00:05:06.559 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010108299999999999 2024-09-12T00:05:06.559 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.559 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:06.559 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.559 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.560 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.560 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2764 3.2d 3:b7a0f55d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_249:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:06.560 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.325396+0000", 2024-09-12T00:05:06.560 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.121511174999998, 2024-09-12T00:05:06.560 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022487040999999999, 2024-09-12T00:05:06.560 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:06.560 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:06.560 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:06.560 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:06.560 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:06.560 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:06.560 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2764 2024-09-12T00:05:06.560 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.561 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:06.561 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.561 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:06.561 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.325396+0000", 2024-09-12T00:05:06.561 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.561 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.561 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.561 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:06.561 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.325396+0000", 2024-09-12T00:05:06.561 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:06.561 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.561 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.561 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:06.562 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.325400+0000", 2024-09-12T00:05:06.562 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2370000000000001e-06 2024-09-12T00:05:06.562 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.562 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.562 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:06.562 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328424+0000", 2024-09-12T00:05:06.562 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003024657 2024-09-12T00:05:06.562 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.562 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.562 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:06.562 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328456+0000", 2024-09-12T00:05:06.562 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1819999999999997e-05 2024-09-12T00:05:06.562 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.563 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.563 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:06.563 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328476+0000", 2024-09-12T00:05:06.563 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9673999999999998e-05 2024-09-12T00:05:06.563 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.563 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.563 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:06.563 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328567+0000", 2024-09-12T00:05:06.563 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1640999999999999e-05 2024-09-12T00:05:06.563 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.563 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.563 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:06.563 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328734+0000", 2024-09-12T00:05:06.564 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016619200000000001 2024-09-12T00:05:06.564 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.564 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.564 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:06.564 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328910+0000", 2024-09-12T00:05:06.564 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017652299999999999 2024-09-12T00:05:06.564 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.564 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.564 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:06.564 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.333757+0000", 2024-09-12T00:05:06.564 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048465060000000004 2024-09-12T00:05:06.564 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.564 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.564 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:06.565 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.347806+0000", 2024-09-12T00:05:06.565 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01404908 2024-09-12T00:05:06.565 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.565 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.565 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:06.565 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.347847+0000", 2024-09-12T00:05:06.565 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1396999999999997e-05 2024-09-12T00:05:06.565 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:06.565 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:06.565 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:06.565 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.347883+0000", 2024-09-12T00:05:06.565 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6313999999999998e-05 2024-09-12T00:05:06.565 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.565 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:06.566 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.566 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:06.566 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:06.566 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:06.567 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:05:06.568 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:06.565+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:06.668 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:06.668+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:06.689 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T00:05:06.700 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:06.700 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:06.700 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:06.700 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:06.716 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:05:06.749 INFO:tasks.workunit.client.0.smithi019.stderr:200+0 records in 2024-09-12T00:05:06.749 INFO:tasks.workunit.client.0.smithi019.stderr:200+0 records out 2024-09-12T00:05:06.749 INFO:tasks.workunit.client.0.smithi019.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 17.8459 s, 118 MB/s 2024-09-12T00:05:06.770 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:06.765+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:06.836 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:06.836 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:06.836 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:06.836 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:06.836 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:06.851 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:05:06.894 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:06.893+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:06.931 INFO:tasks.workunit.client.0.smithi019.stdout:Bucket Created: buck_2024_08_12_00_05_06 2024-09-12T00:05:06.971 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:06.972+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:07.020 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:07.020 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:07.020 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:07.020 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:07.020 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.020 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2657 3.3c e63/23 3:3e583291:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_152:head v 63'4, mlcod=62'2)", 2024-09-12T00:05:07.020 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:05:07.021 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.753908137, 2024-09-12T00:05:07.021 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017073642999999999, 2024-09-12T00:05:07.021 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.021 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.021 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.021 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.021 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.021 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.021 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:05:07.021 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.021 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.021 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.021 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.022 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:05:07.022 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.022 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.022 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.022 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266877+0000", 2024-09-12T00:05:07.022 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3630000000000001e-06 2024-09-12T00:05:07.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.022 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.022 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.022 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271243+0000", 2024-09-12T00:05:07.022 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043659730000000004 2024-09-12T00:05:07.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.022 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.022 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.023 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271279+0000", 2024-09-12T00:05:07.023 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6334999999999997e-05 2024-09-12T00:05:07.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.023 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.023 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271296+0000", 2024-09-12T00:05:07.023 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6619000000000001e-05 2024-09-12T00:05:07.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.023 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.023 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271429+0000", 2024-09-12T00:05:07.023 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133132 2024-09-12T00:05:07.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.024 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.024 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271468+0000", 2024-09-12T00:05:07.024 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8483999999999999e-05 2024-09-12T00:05:07.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.024 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.024 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.024 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.283854+0000", 2024-09-12T00:05:07.024 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012386645999999999 2024-09-12T00:05:07.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.024 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.024 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.024 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.283948+0000", 2024-09-12T00:05:07.024 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4091000000000004e-05 2024-09-12T00:05:07.024 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.025 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.025 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.025 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2658 3.3a e63/23 3:5ec14981:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_153:head v 63'1, mlcod=0'0)", 2024-09-12T00:05:07.025 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.276052+0000", 2024-09-12T00:05:07.025 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.744731247000001, 2024-09-12T00:05:07.025 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015387336999999999, 2024-09-12T00:05:07.025 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.025 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.025 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.025 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.025 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.026 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.276052+0000", 2024-09-12T00:05:07.026 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.026 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.026 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.026 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.276052+0000", 2024-09-12T00:05:07.026 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.026 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.026 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.026 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.276054+0000", 2024-09-12T00:05:07.026 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3199999999999998e-06 2024-09-12T00:05:07.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.026 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.027 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.027 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282165+0000", 2024-09-12T00:05:07.027 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061108359999999997 2024-09-12T00:05:07.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.027 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.027 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.027 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282192+0000", 2024-09-12T00:05:07.027 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7008999999999998e-05 2024-09-12T00:05:07.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.027 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.027 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.027 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282206+0000", 2024-09-12T00:05:07.027 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4705999999999999e-05 2024-09-12T00:05:07.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.028 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.028 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.028 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282387+0000", 2024-09-12T00:05:07.028 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018015199999999999 2024-09-12T00:05:07.028 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.028 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.028 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.028 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282426+0000", 2024-09-12T00:05:07.028 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9323999999999998e-05 2024-09-12T00:05:07.028 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.028 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.028 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.028 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291241+0000", 2024-09-12T00:05:07.028 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0088146950000000009 2024-09-12T00:05:07.029 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.029 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.029 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.029 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291439+0000", 2024-09-12T00:05:07.029 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000198295 2024-09-12T00:05:07.029 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.029 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.029 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.029 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.029 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.029 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2659 3.2d e63/23 3:b4a71344:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_154:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:07.029 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:05:07.029 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.733103842999999, 2024-09-12T00:05:07.029 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016913793, 2024-09-12T00:05:07.029 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.030 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.030 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.030 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.030 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.030 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:05:07.030 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.030 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.030 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:05:07.030 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.031 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287682+0000", 2024-09-12T00:05:07.031 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9799999999999998e-06 2024-09-12T00:05:07.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.031 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.031 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291872+0000", 2024-09-12T00:05:07.031 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041904070000000002 2024-09-12T00:05:07.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.031 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.031 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291901+0000", 2024-09-12T00:05:07.031 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9017999999999999e-05 2024-09-12T00:05:07.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.031 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.032 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.032 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291917+0000", 2024-09-12T00:05:07.032 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5775999999999999e-05 2024-09-12T00:05:07.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.032 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.032 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.292061+0000", 2024-09-12T00:05:07.032 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014356800000000001 2024-09-12T00:05:07.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.032 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.032 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.292123+0000", 2024-09-12T00:05:07.032 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2799999999999995e-05 2024-09-12T00:05:07.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.033 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.033 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.304456+0000", 2024-09-12T00:05:07.033 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012332865 2024-09-12T00:05:07.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.033 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.033 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.033 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.304593+0000", 2024-09-12T00:05:07.033 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000136379 2024-09-12T00:05:07.033 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.033 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.033 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.033 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.033 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2667 3.8 3:1177e826:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.034 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:05:07.034 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.647661925000001, 2024-09-12T00:05:07.034 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024306991999999999, 2024-09-12T00:05:07.034 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.034 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.034 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.034 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.034 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.034 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.034 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2667 2024-09-12T00:05:07.034 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.034 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.034 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.034 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.035 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:05:07.035 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.035 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.035 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.035 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:05:07.035 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.035 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.035 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.035 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373124+0000", 2024-09-12T00:05:07.035 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.19e-06 2024-09-12T00:05:07.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.036 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.036 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.036 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377167+0000", 2024-09-12T00:05:07.036 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040430329999999997 2024-09-12T00:05:07.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.036 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.036 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.036 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377201+0000", 2024-09-12T00:05:07.036 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3868000000000002e-05 2024-09-12T00:05:07.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.036 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.036 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.036 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377219+0000", 2024-09-12T00:05:07.037 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8019000000000001e-05 2024-09-12T00:05:07.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.037 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.037 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.037 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377362+0000", 2024-09-12T00:05:07.037 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000143001 2024-09-12T00:05:07.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.037 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.037 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.037 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377603+0000", 2024-09-12T00:05:07.037 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024115200000000001 2024-09-12T00:05:07.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.037 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.037 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:07.038 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377833+0000", 2024-09-12T00:05:07.038 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022952000000000001 2024-09-12T00:05:07.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.038 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.038 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.038 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.386771+0000", 2024-09-12T00:05:07.038 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0089385739999999995 2024-09-12T00:05:07.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.038 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.038 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.038 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397160+0000", 2024-09-12T00:05:07.038 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010388391 2024-09-12T00:05:07.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.039 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.039 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397307+0000", 2024-09-12T00:05:07.039 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014745099999999999 2024-09-12T00:05:07.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.039 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.039 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397428+0000", 2024-09-12T00:05:07.039 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012079299999999999 2024-09-12T00:05:07.039 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.039 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.039 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.040 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2669 3.1b 3:d9b9bd82:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.040 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:05:07.040 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.627985276, 2024-09-12T00:05:07.040 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016867298999999999, 2024-09-12T00:05:07.040 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.040 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.040 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.040 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.040 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.040 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.040 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2669 2024-09-12T00:05:07.040 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.040 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.040 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.041 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.041 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:05:07.041 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.041 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.041 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.041 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:05:07.041 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.041 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.041 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.041 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392800+0000", 2024-09-12T00:05:07.041 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8629999999999999e-06 2024-09-12T00:05:07.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.042 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.042 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.042 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396812+0000", 2024-09-12T00:05:07.042 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040120140000000004 2024-09-12T00:05:07.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.042 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.042 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.042 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396849+0000", 2024-09-12T00:05:07.042 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6291000000000002e-05 2024-09-12T00:05:07.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.042 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.042 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.042 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396906+0000", 2024-09-12T00:05:07.042 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7692999999999998e-05 2024-09-12T00:05:07.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.043 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.043 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397059+0000", 2024-09-12T00:05:07.043 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015268399999999999 2024-09-12T00:05:07.043 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.043 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.043 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397472+0000", 2024-09-12T00:05:07.043 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041270899999999998 2024-09-12T00:05:07.043 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.043 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:07.043 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397697+0000", 2024-09-12T00:05:07.044 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022526299999999999 2024-09-12T00:05:07.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.044 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.044 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.044 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.406380+0000", 2024-09-12T00:05:07.044 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086830429999999997 2024-09-12T00:05:07.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.044 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.044 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.044 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409367+0000", 2024-09-12T00:05:07.044 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002987403 2024-09-12T00:05:07.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.044 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.044 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.045 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409532+0000", 2024-09-12T00:05:07.045 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016417 2024-09-12T00:05:07.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.045 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.045 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.045 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409665+0000", 2024-09-12T00:05:07.045 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013316599999999999 2024-09-12T00:05:07.045 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.045 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.045 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.045 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.046 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2678 3.2b 3:d57f7217:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.046 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:05:07.046 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.536567827999999, 2024-09-12T00:05:07.046 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018772965999999999, 2024-09-12T00:05:07.046 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.046 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.046 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.046 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.046 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.046 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.046 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2678 2024-09-12T00:05:07.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.047 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.047 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.047 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:05:07.047 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.047 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.047 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:05:07.047 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.047 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.048 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484219+0000", 2024-09-12T00:05:07.048 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7299999999999999e-06 2024-09-12T00:05:07.048 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.048 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.048 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.048 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488148+0000", 2024-09-12T00:05:07.048 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039289859999999998 2024-09-12T00:05:07.048 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.048 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.049 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.049 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488214+0000", 2024-09-12T00:05:07.049 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6202000000000001e-05 2024-09-12T00:05:07.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.049 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.049 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.049 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488239+0000", 2024-09-12T00:05:07.049 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4839000000000001e-05 2024-09-12T00:05:07.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.050 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.050 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.050 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488374+0000", 2024-09-12T00:05:07.050 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000135189 2024-09-12T00:05:07.050 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.050 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.050 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.050 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488626+0000", 2024-09-12T00:05:07.050 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025242800000000002 2024-09-12T00:05:07.050 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.051 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:07.051 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488849+0000", 2024-09-12T00:05:07.051 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022295 2024-09-12T00:05:07.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.051 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.051 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498947+0000", 2024-09-12T00:05:07.051 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010098072 2024-09-12T00:05:07.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.052 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.052 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.052 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502674+0000", 2024-09-12T00:05:07.052 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037269149999999999 2024-09-12T00:05:07.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.052 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.052 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.052 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502856+0000", 2024-09-12T00:05:07.052 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018163599999999999 2024-09-12T00:05:07.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.053 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.053 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.053 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502988+0000", 2024-09-12T00:05:07.053 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013201900000000001 2024-09-12T00:05:07.053 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.053 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.053 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.053 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.053 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2691 3.2d e63/23 3:b4a2284d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_176:head v 63'6, mlcod=63'4)", 2024-09-12T00:05:07.054 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:05:07.054 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.503443127000001, 2024-09-12T00:05:07.054 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015889306999999998, 2024-09-12T00:05:07.054 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.054 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.054 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.054 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.054 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.054 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.054 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:05:07.055 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.055 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.055 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:05:07.055 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.055 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.055 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517342+0000", 2024-09-12T00:05:07.055 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3700000000000002e-06 2024-09-12T00:05:07.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.056 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.056 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.056 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521776+0000", 2024-09-12T00:05:07.056 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044339790000000002 2024-09-12T00:05:07.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.056 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.056 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.056 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521806+0000", 2024-09-12T00:05:07.056 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9855000000000001e-05 2024-09-12T00:05:07.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.057 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.057 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521820+0000", 2024-09-12T00:05:07.057 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4496e-05 2024-09-12T00:05:07.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.057 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.057 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521963+0000", 2024-09-12T00:05:07.057 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014277199999999999 2024-09-12T00:05:07.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.058 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.058 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.522029+0000", 2024-09-12T00:05:07.058 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6186000000000006e-05 2024-09-12T00:05:07.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.058 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.058 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.058 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.533123+0000", 2024-09-12T00:05:07.058 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011093252 2024-09-12T00:05:07.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.058 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.059 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.059 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.533229+0000", 2024-09-12T00:05:07.059 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000106397 2024-09-12T00:05:07.059 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.059 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.059 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.059 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.059 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2694 3.3d e63/23 3:bd0bdafc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_179:head v 63'7, mlcod=63'5)", 2024-09-12T00:05:07.059 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:05:07.059 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.468228355000001, 2024-09-12T00:05:07.060 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016398093999999998, 2024-09-12T00:05:07.060 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.060 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.060 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.060 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.060 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:05:07.060 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.061 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.061 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.061 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:05:07.061 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.061 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.061 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.061 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.061 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552558+0000", 2024-09-12T00:05:07.061 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6030000000000001e-06 2024-09-12T00:05:07.061 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.061 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.062 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.062 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556085+0000", 2024-09-12T00:05:07.062 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0035274339999999999 2024-09-12T00:05:07.062 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.062 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.062 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.062 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556126+0000", 2024-09-12T00:05:07.062 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0290999999999998e-05 2024-09-12T00:05:07.062 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.062 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.062 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.063 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556154+0000", 2024-09-12T00:05:07.063 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7965000000000001e-05 2024-09-12T00:05:07.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.063 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.063 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.063 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556298+0000", 2024-09-12T00:05:07.063 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014459799999999999 2024-09-12T00:05:07.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.063 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.063 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.064 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556339+0000", 2024-09-12T00:05:07.064 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0577000000000001e-05 2024-09-12T00:05:07.064 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.064 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.064 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.064 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.568778+0000", 2024-09-12T00:05:07.064 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012438886999999999 2024-09-12T00:05:07.064 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.064 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.065 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.065 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.568953+0000", 2024-09-12T00:05:07.065 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017473900000000001 2024-09-12T00:05:07.065 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.065 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.065 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.065 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.065 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2696 3.2b 3:d7c776f8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.065 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:05:07.065 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.453381457999999, 2024-09-12T00:05:07.066 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022026211, 2024-09-12T00:05:07.066 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.066 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.066 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.066 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.066 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.066 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.066 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2696 2024-09-12T00:05:07.066 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.066 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.066 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.067 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.067 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:05:07.067 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.067 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.067 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.067 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.067 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:05:07.067 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.067 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.067 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.068 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.068 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567406+0000", 2024-09-12T00:05:07.068 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9389999999999996e-06 2024-09-12T00:05:07.068 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.068 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.068 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.068 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571490+0000", 2024-09-12T00:05:07.068 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040837870000000002 2024-09-12T00:05:07.068 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.069 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.069 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.069 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571530+0000", 2024-09-12T00:05:07.069 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9894999999999997e-05 2024-09-12T00:05:07.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.069 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.069 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.069 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571554+0000", 2024-09-12T00:05:07.069 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4011000000000001e-05 2024-09-12T00:05:07.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.069 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.069 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.070 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571726+0000", 2024-09-12T00:05:07.070 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0001717 2024-09-12T00:05:07.070 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.070 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.070 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.070 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.572130+0000", 2024-09-12T00:05:07.070 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040465299999999999 2024-09-12T00:05:07.070 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.070 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.070 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:07.071 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.572470+0000", 2024-09-12T00:05:07.071 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00033946999999999997 2024-09-12T00:05:07.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.071 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.071 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.071 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.579159+0000", 2024-09-12T00:05:07.071 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0066893009999999999 2024-09-12T00:05:07.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.071 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.071 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.072 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589136+0000", 2024-09-12T00:05:07.072 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099772060000000006 2024-09-12T00:05:07.072 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.072 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.072 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.072 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589309+0000", 2024-09-12T00:05:07.072 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017264299999999999 2024-09-12T00:05:07.072 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.072 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.072 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.073 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589428+0000", 2024-09-12T00:05:07.073 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118606 2024-09-12T00:05:07.073 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.073 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.073 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.073 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.073 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.073 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2698 3.3d e63/23 3:bcafb0f9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_183:head v 63'8, mlcod=63'6)", 2024-09-12T00:05:07.073 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:05:07.073 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.425678409, 2024-09-12T00:05:07.073 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016019080000000002, 2024-09-12T00:05:07.073 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.074 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.074 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.074 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.074 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.074 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.074 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:05:07.074 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.074 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.074 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.075 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:05:07.075 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.075 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.075 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.075 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.075 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595107+0000", 2024-09-12T00:05:07.075 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.497e-06 2024-09-12T00:05:07.075 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.075 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.075 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.075 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598465+0000", 2024-09-12T00:05:07.075 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033583129999999999 2024-09-12T00:05:07.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.076 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.076 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.076 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598502+0000", 2024-09-12T00:05:07.076 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6814999999999999e-05 2024-09-12T00:05:07.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.076 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.076 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.076 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598520+0000", 2024-09-12T00:05:07.076 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8264999999999999e-05 2024-09-12T00:05:07.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.077 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.077 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.077 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598666+0000", 2024-09-12T00:05:07.077 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014574499999999999 2024-09-12T00:05:07.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.077 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.077 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.077 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598706+0000", 2024-09-12T00:05:07.077 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9993999999999997e-05 2024-09-12T00:05:07.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.078 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.078 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.078 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.611012+0000", 2024-09-12T00:05:07.078 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012306381 2024-09-12T00:05:07.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.078 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.078 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.078 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.611123+0000", 2024-09-12T00:05:07.078 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011107000000000001 2024-09-12T00:05:07.078 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.079 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.079 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.079 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.079 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.079 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2702 3.3c e63/23 3:3d6a0b3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_187:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:07.079 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:05:07.079 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.392203572, 2024-09-12T00:05:07.079 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015754475, 2024-09-12T00:05:07.079 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.079 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.079 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.080 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.080 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.080 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.080 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:05:07.080 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.080 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.080 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.080 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.080 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:05:07.080 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.081 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.081 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.081 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.081 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628581+0000", 2024-09-12T00:05:07.081 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2129999999999998e-06 2024-09-12T00:05:07.081 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.081 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.081 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.081 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633160+0000", 2024-09-12T00:05:07.081 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045784470000000002 2024-09-12T00:05:07.081 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.082 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.082 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.082 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633193+0000", 2024-09-12T00:05:07.082 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3015000000000002e-05 2024-09-12T00:05:07.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.082 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.082 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.082 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633213+0000", 2024-09-12T00:05:07.082 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0271999999999998e-05 2024-09-12T00:05:07.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.083 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.083 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.083 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633397+0000", 2024-09-12T00:05:07.083 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018359299999999999 2024-09-12T00:05:07.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.083 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.083 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.083 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633440+0000", 2024-09-12T00:05:07.083 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2984e-05 2024-09-12T00:05:07.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.084 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.084 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.084 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.644242+0000", 2024-09-12T00:05:07.084 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010802673 2024-09-12T00:05:07.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.084 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.084 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.084 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.644334+0000", 2024-09-12T00:05:07.085 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1278000000000003e-05 2024-09-12T00:05:07.085 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.085 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.085 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.085 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.085 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2707 3.8 3:10a400a4:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.085 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:05:07.085 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.343926004, 2024-09-12T00:05:07.086 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019444162000000001, 2024-09-12T00:05:07.086 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.086 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.086 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.086 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.086 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.086 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.086 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2707 2024-09-12T00:05:07.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.086 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.087 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.087 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.087 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:05:07.087 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.087 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.087 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.087 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:05:07.087 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.088 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.088 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.088 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676879+0000", 2024-09-12T00:05:07.088 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1886e-05 2024-09-12T00:05:07.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.088 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.088 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.088 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680743+0000", 2024-09-12T00:05:07.088 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038648060000000001 2024-09-12T00:05:07.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.089 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.089 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.089 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680783+0000", 2024-09-12T00:05:07.089 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9511000000000002e-05 2024-09-12T00:05:07.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.089 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.089 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.089 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680801+0000", 2024-09-12T00:05:07.089 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8056000000000001e-05 2024-09-12T00:05:07.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.090 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.090 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.090 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680948+0000", 2024-09-12T00:05:07.090 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014682399999999999 2024-09-12T00:05:07.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.090 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.090 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.090 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.681206+0000", 2024-09-12T00:05:07.090 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025860500000000002 2024-09-12T00:05:07.091 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.091 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.091 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:07.091 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.681439+0000", 2024-09-12T00:05:07.091 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023246599999999999 2024-09-12T00:05:07.091 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.091 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.091 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.091 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.689277+0000", 2024-09-12T00:05:07.091 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0078379000000000001 2024-09-12T00:05:07.092 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.092 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.092 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.092 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696136+0000", 2024-09-12T00:05:07.092 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0068593439999999999 2024-09-12T00:05:07.092 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.092 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.092 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.092 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696228+0000", 2024-09-12T00:05:07.092 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2038000000000002e-05 2024-09-12T00:05:07.093 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.093 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.093 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.093 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696301+0000", 2024-09-12T00:05:07.093 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2725999999999995e-05 2024-09-12T00:05:07.093 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.093 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.093 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.093 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.093 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.093 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2720 3.6 3:61c9c6cd:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.094 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:05:07.094 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.217206688000001, 2024-09-12T00:05:07.094 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021831761000000002, 2024-09-12T00:05:07.094 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.094 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.094 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.094 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.094 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.094 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.094 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2720 2024-09-12T00:05:07.095 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.095 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.095 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.095 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.095 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:05:07.095 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.095 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.095 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.095 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.095 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:05:07.095 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.096 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.096 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.096 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.096 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803580+0000", 2024-09-12T00:05:07.096 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9870000000000001e-06 2024-09-12T00:05:07.096 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.096 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.096 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.096 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808102+0000", 2024-09-12T00:05:07.096 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004521677 2024-09-12T00:05:07.097 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.097 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.097 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.097 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808152+0000", 2024-09-12T00:05:07.097 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9923999999999998e-05 2024-09-12T00:05:07.097 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.097 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.097 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.097 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808178+0000", 2024-09-12T00:05:07.097 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5911999999999999e-05 2024-09-12T00:05:07.097 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.098 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.098 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.098 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808365+0000", 2024-09-12T00:05:07.098 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000187839 2024-09-12T00:05:07.098 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.098 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.098 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.098 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808757+0000", 2024-09-12T00:05:07.098 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039202900000000001 2024-09-12T00:05:07.098 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.099 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.099 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:07.099 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.809162+0000", 2024-09-12T00:05:07.099 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040460300000000002 2024-09-12T00:05:07.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.099 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.099 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.099 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.816553+0000", 2024-09-12T00:05:07.099 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.007390537 2024-09-12T00:05:07.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.099 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.100 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.100 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.824836+0000", 2024-09-12T00:05:07.100 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082834369999999994 2024-09-12T00:05:07.100 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.100 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.100 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.100 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.825223+0000", 2024-09-12T00:05:07.100 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00038724700000000001 2024-09-12T00:05:07.100 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.100 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.100 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.101 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.825408+0000", 2024-09-12T00:05:07.101 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018456899999999999 2024-09-12T00:05:07.101 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.101 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.101 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.101 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.101 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.101 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2722 3.1b 3:d95d04cc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_207:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.101 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.822403+0000", 2024-09-12T00:05:07.101 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.198379995, 2024-09-12T00:05:07.101 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015693082000000001, 2024-09-12T00:05:07.102 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.102 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.102 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.102 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.102 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.102 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.102 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2722 2024-09-12T00:05:07.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.102 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.102 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.103 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.103 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.822403+0000", 2024-09-12T00:05:07.103 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.103 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.103 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.103 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.822403+0000", 2024-09-12T00:05:07.103 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.103 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.104 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.104 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.822405+0000", 2024-09-12T00:05:07.104 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4169999999999999e-06 2024-09-12T00:05:07.104 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.104 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.104 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.104 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826387+0000", 2024-09-12T00:05:07.104 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039818379999999997 2024-09-12T00:05:07.104 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.104 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.105 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.105 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826412+0000", 2024-09-12T00:05:07.105 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5159000000000001e-05 2024-09-12T00:05:07.105 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.105 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.105 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.105 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826425+0000", 2024-09-12T00:05:07.105 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3283e-05 2024-09-12T00:05:07.105 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.105 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.106 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.106 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826536+0000", 2024-09-12T00:05:07.106 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110109 2024-09-12T00:05:07.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.106 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.106 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.106 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826725+0000", 2024-09-12T00:05:07.106 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018966600000000001 2024-09-12T00:05:07.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.106 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.106 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:07.107 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826904+0000", 2024-09-12T00:05:07.107 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017913200000000001 2024-09-12T00:05:07.107 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.107 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.107 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.107 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.835018+0000", 2024-09-12T00:05:07.107 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0081138300000000007 2024-09-12T00:05:07.107 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.107 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.107 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.107 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837918+0000", 2024-09-12T00:05:07.107 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002899535 2024-09-12T00:05:07.108 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.108 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.108 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.108 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838010+0000", 2024-09-12T00:05:07.108 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1901e-05 2024-09-12T00:05:07.108 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.108 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.108 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.108 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838096+0000", 2024-09-12T00:05:07.108 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6211999999999994e-05 2024-09-12T00:05:07.108 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.108 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.108 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.109 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.109 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.109 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2724 3.1b 3:da32d84b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.109 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:05:07.109 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.176996251999999, 2024-09-12T00:05:07.109 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019410604000000001, 2024-09-12T00:05:07.109 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.109 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.109 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.109 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.109 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.109 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.109 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2724 2024-09-12T00:05:07.109 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.109 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.110 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.110 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.110 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:05:07.110 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.110 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.110 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.110 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.110 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:05:07.110 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.110 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.110 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.110 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.110 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843790+0000", 2024-09-12T00:05:07.110 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.393e-06 2024-09-12T00:05:07.111 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.111 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.111 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.111 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847786+0000", 2024-09-12T00:05:07.111 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039965579999999999 2024-09-12T00:05:07.111 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.111 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.111 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.111 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847836+0000", 2024-09-12T00:05:07.111 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9731000000000002e-05 2024-09-12T00:05:07.111 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.111 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.111 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.111 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847856+0000", 2024-09-12T00:05:07.111 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0245e-05 2024-09-12T00:05:07.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.112 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.112 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.112 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848053+0000", 2024-09-12T00:05:07.112 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000196882 2024-09-12T00:05:07.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.112 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.112 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.112 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848291+0000", 2024-09-12T00:05:07.112 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000237762 2024-09-12T00:05:07.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.112 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.112 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:07.112 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848544+0000", 2024-09-12T00:05:07.113 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025307500000000001 2024-09-12T00:05:07.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.113 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.113 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.113 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.860024+0000", 2024-09-12T00:05:07.113 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011479390000000001 2024-09-12T00:05:07.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.113 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.113 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.113 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.862880+0000", 2024-09-12T00:05:07.113 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002856833 2024-09-12T00:05:07.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.113 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.113 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.113 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.863048+0000", 2024-09-12T00:05:07.114 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016796700000000001 2024-09-12T00:05:07.114 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.114 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.114 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.114 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.863197+0000", 2024-09-12T00:05:07.114 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148768 2024-09-12T00:05:07.114 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.114 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.114 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.114 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.114 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.114 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2727 3.39 e63/23 3:9c63b475:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_212:head v 63'3, mlcod=62'1)", 2024-09-12T00:05:07.114 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:05:07.114 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.142967656, 2024-09-12T00:05:07.115 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016224526999999999, 2024-09-12T00:05:07.115 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.115 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.115 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.115 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.115 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.115 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.115 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:05:07.115 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.115 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.115 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.115 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.115 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:05:07.115 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.115 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.116 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.116 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.116 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877818+0000", 2024-09-12T00:05:07.116 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.813e-06 2024-09-12T00:05:07.116 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.116 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.116 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.116 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883917+0000", 2024-09-12T00:05:07.116 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0060993009999999997 2024-09-12T00:05:07.116 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.116 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.116 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.116 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883961+0000", 2024-09-12T00:05:07.116 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3951e-05 2024-09-12T00:05:07.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.117 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.117 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.117 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883992+0000", 2024-09-12T00:05:07.117 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0565000000000003e-05 2024-09-12T00:05:07.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.117 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.117 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.117 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884176+0000", 2024-09-12T00:05:07.117 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018378200000000001 2024-09-12T00:05:07.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.117 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.117 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.117 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884252+0000", 2024-09-12T00:05:07.118 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6209000000000002e-05 2024-09-12T00:05:07.118 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.118 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.118 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.118 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.893904+0000", 2024-09-12T00:05:07.118 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0096519339999999992 2024-09-12T00:05:07.118 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.118 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.118 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.118 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.894040+0000", 2024-09-12T00:05:07.118 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013597199999999999 2024-09-12T00:05:07.118 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.118 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.118 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.119 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.119 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2730 3.7 3:e3fca83c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.119 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:05:07.119 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.11243953, 2024-09-12T00:05:07.119 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022178479000000001, 2024-09-12T00:05:07.119 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.119 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.119 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.119 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.119 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.119 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.119 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2730 2024-09-12T00:05:07.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.119 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.120 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.120 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.120 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:05:07.120 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.120 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.120 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.120 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:05:07.120 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.120 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.120 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.120 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908346+0000", 2024-09-12T00:05:07.120 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1999999999999999e-06 2024-09-12T00:05:07.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.121 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.121 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.121 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912423+0000", 2024-09-12T00:05:07.121 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004076423 2024-09-12T00:05:07.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.121 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.121 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.121 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912472+0000", 2024-09-12T00:05:07.121 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9023999999999997e-05 2024-09-12T00:05:07.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.121 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.121 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.121 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912498+0000", 2024-09-12T00:05:07.122 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6591999999999999e-05 2024-09-12T00:05:07.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.122 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.122 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.122 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912677+0000", 2024-09-12T00:05:07.122 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017824599999999999 2024-09-12T00:05:07.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.122 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.122 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.122 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913094+0000", 2024-09-12T00:05:07.122 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041757799999999999 2024-09-12T00:05:07.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.122 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.122 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:07.122 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913512+0000", 2024-09-12T00:05:07.123 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000417475 2024-09-12T00:05:07.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.123 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.123 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.929229+0000", 2024-09-12T00:05:07.123 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015717294999999999 2024-09-12T00:05:07.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.123 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.123 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930204+0000", 2024-09-12T00:05:07.123 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00097506199999999996 2024-09-12T00:05:07.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.123 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.124 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930392+0000", 2024-09-12T00:05:07.124 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000187775 2024-09-12T00:05:07.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.124 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.124 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.124 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930522+0000", 2024-09-12T00:05:07.124 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012980899999999999 2024-09-12T00:05:07.124 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.124 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.124 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.124 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.124 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2753 3.7 3:e119c99e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_238:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.125 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:05:07.125 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 18.86675146, 2024-09-12T00:05:07.125 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.023674186999999999, 2024-09-12T00:05:07.125 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.125 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.125 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.125 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.125 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.125 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.125 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2753 2024-09-12T00:05:07.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.125 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.125 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.125 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.125 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:05:07.126 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.126 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.126 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.126 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:05:07.126 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.126 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.126 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.126 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154035+0000", 2024-09-12T00:05:07.126 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2799999999999999e-06 2024-09-12T00:05:07.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.126 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.126 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.127 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159459+0000", 2024-09-12T00:05:07.127 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054242190000000001 2024-09-12T00:05:07.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.127 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.127 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.127 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159509+0000", 2024-09-12T00:05:07.127 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9830999999999998e-05 2024-09-12T00:05:07.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.127 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.127 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.127 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159536+0000", 2024-09-12T00:05:07.127 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7438000000000001e-05 2024-09-12T00:05:07.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.127 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.127 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.128 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159710+0000", 2024-09-12T00:05:07.128 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017342 2024-09-12T00:05:07.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.128 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.128 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.128 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159961+0000", 2024-09-12T00:05:07.128 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025164499999999999 2024-09-12T00:05:07.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.128 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.128 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:07.128 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.160206+0000", 2024-09-12T00:05:07.128 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024534200000000001 2024-09-12T00:05:07.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.128 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.128 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.129 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177421+0000", 2024-09-12T00:05:07.129 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017214956 2024-09-12T00:05:07.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.129 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.129 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.129 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177534+0000", 2024-09-12T00:05:07.129 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000112223 2024-09-12T00:05:07.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.129 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.129 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.129 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177625+0000", 2024-09-12T00:05:07.129 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0947999999999997e-05 2024-09-12T00:05:07.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.129 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.130 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.130 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177706+0000", 2024-09-12T00:05:07.130 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0884999999999996e-05 2024-09-12T00:05:07.130 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.130 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.130 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.130 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.130 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.130 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2757 3.2b 3:d6dac417:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.130 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:05:07.130 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 18.800682638000001, 2024-09-12T00:05:07.130 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017779708000000002, 2024-09-12T00:05:07.130 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.130 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.131 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.131 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.131 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.131 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.131 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2757 2024-09-12T00:05:07.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.131 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.131 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.131 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.131 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:05:07.131 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.131 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.131 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.132 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:05:07.132 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.132 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.132 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.132 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.132 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220103+0000", 2024-09-12T00:05:07.132 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.32e-06 2024-09-12T00:05:07.132 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.132 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.132 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.132 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225042+0000", 2024-09-12T00:05:07.132 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049386200000000003 2024-09-12T00:05:07.132 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.132 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.133 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.133 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225083+0000", 2024-09-12T00:05:07.133 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1304000000000003e-05 2024-09-12T00:05:07.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.133 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.133 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.133 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225102+0000", 2024-09-12T00:05:07.133 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8502e-05 2024-09-12T00:05:07.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.133 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.133 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.133 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225256+0000", 2024-09-12T00:05:07.133 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015436099999999999 2024-09-12T00:05:07.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.134 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.134 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.134 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225513+0000", 2024-09-12T00:05:07.134 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000256562 2024-09-12T00:05:07.134 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.134 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.134 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:07.134 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225737+0000", 2024-09-12T00:05:07.134 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022379 2024-09-12T00:05:07.134 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.134 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.134 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.135 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.234281+0000", 2024-09-12T00:05:07.135 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0085440540000000006 2024-09-12T00:05:07.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.135 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.135 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.135 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237710+0000", 2024-09-12T00:05:07.135 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0034298380000000002 2024-09-12T00:05:07.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.135 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.135 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.135 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237805+0000", 2024-09-12T00:05:07.135 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4804999999999998e-05 2024-09-12T00:05:07.136 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.136 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.136 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.136 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237880+0000", 2024-09-12T00:05:07.136 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4552e-05 2024-09-12T00:05:07.136 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.136 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.136 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.136 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.136 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.136 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2764 3.2d e63/23 3:b7a0f55d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_249:head v 63'7, mlcod=63'5)", 2024-09-12T00:05:07.137 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:05:07.137 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 18.691905168000002, 2024-09-12T00:05:07.137 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018235872, 2024-09-12T00:05:07.137 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.137 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.137 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.137 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.137 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.137 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.137 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:05:07.137 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.137 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.138 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.138 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.138 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:05:07.138 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.138 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.138 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.138 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328882+0000", 2024-09-12T00:05:07.138 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5000000000000001e-06 2024-09-12T00:05:07.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.138 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.138 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.138 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335092+0000", 2024-09-12T00:05:07.139 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0062094730000000001 2024-09-12T00:05:07.139 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.139 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.139 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.139 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335127+0000", 2024-09-12T00:05:07.139 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5717999999999999e-05 2024-09-12T00:05:07.139 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.139 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.139 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.139 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335144+0000", 2024-09-12T00:05:07.139 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7119e-05 2024-09-12T00:05:07.139 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.139 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.140 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.140 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335308+0000", 2024-09-12T00:05:07.140 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000163757 2024-09-12T00:05:07.140 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.140 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.140 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.140 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335354+0000", 2024-09-12T00:05:07.140 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6164e-05 2024-09-12T00:05:07.140 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.140 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.140 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.140 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.346991+0000", 2024-09-12T00:05:07.140 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011636851 2024-09-12T00:05:07.141 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.141 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.141 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.141 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.347113+0000", 2024-09-12T00:05:07.141 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012229 2024-09-12T00:05:07.141 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.141 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.141 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.141 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.141 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.141 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:07.143 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:05:07.143 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:07.141+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:07.226 INFO:tasks.workunit.client.0.smithi019.stdout:bucket quota max size set for the given user: buck_2024_08_12_00_05_06 2024-09-12T00:05:07.243 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:07.244+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:07.318 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:07.319 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:07.319 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.319 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.5622.0:47 7.0 e70/31 7:05bf5b68:::notify.1:head v 70'103, mlcod=70'101)", 2024-09-12T00:05:07.319 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:07.320369+0000", 2024-09-12T00:05:07.319 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.00044606099999999998, 2024-09-12T00:05:07.319 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00048018300000000002, 2024-09-12T00:05:07.319 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.319 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.319 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "started", 2024-09-12T00:05:07.319 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.319 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.319 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.320 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:07.320369+0000", 2024-09-12T00:05:07.320 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.320 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.320 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.320 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.320 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:07.320369+0000", 2024-09-12T00:05:07.320 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.320 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.320 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.320 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.320 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:07.320371+0000", 2024-09-12T00:05:07.320 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6670000000000001e-06 2024-09-12T00:05:07.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.321 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.321 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.321 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:07.320380+0000", 2024-09-12T00:05:07.321 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4599999999999992e-06 2024-09-12T00:05:07.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.321 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.321 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.321 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:07.320433+0000", 2024-09-12T00:05:07.321 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3140999999999998e-05 2024-09-12T00:05:07.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.321 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.321 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.321 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:07.320445+0000", 2024-09-12T00:05:07.322 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2223e-05 2024-09-12T00:05:07.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.322 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.322 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.322 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:07.320531+0000", 2024-09-12T00:05:07.322 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.5908999999999994e-05 2024-09-12T00:05:07.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.322 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.322 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.322 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:07.320551+0000", 2024-09-12T00:05:07.322 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9304999999999999e-05 2024-09-12T00:05:07.322 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.322 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.323 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.323 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.323 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.323 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.5622.0:48 7.15 e70/31 7:a93a5511:::notify.2:head v 70'102, mlcod=70'100)", 2024-09-12T00:05:07.323 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:07.320433+0000", 2024-09-12T00:05:07.323 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.00038245599999999999, 2024-09-12T00:05:07.323 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00053389400000000004, 2024-09-12T00:05:07.323 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.323 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.323 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "started", 2024-09-12T00:05:07.323 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.324 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.324 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.324 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:07.320433+0000", 2024-09-12T00:05:07.324 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.324 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.324 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.324 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.324 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:07.320433+0000", 2024-09-12T00:05:07.324 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.324 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.324 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.324 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.325 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:07.320434+0000", 2024-09-12T00:05:07.325 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5999999999999999e-06 2024-09-12T00:05:07.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.325 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.325 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.325 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:07.320445+0000", 2024-09-12T00:05:07.325 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0573e-05 2024-09-12T00:05:07.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.325 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.325 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.325 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:07.320470+0000", 2024-09-12T00:05:07.326 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5485000000000001e-05 2024-09-12T00:05:07.326 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.326 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.326 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.326 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:07.320497+0000", 2024-09-12T00:05:07.326 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.73e-05 2024-09-12T00:05:07.326 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.326 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.326 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.326 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:07.320644+0000", 2024-09-12T00:05:07.326 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014671399999999999 2024-09-12T00:05:07.327 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.327 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.327 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.327 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:07.320675+0000", 2024-09-12T00:05:07.327 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0976000000000003e-05 2024-09-12T00:05:07.327 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.327 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.327 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.327 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.327 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-09-12T00:05:07.327 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 2 2024-09-12T00:05:07.327 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:07.335 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:05:07.344 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:07.344+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:07.445 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:07.444+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:07.457 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:07.457 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:07.457 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:07.457 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:07.458 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:07.472 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:05:07.546 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:07.545+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:07.596 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:07.596 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:07.596 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:07.597 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:07.597 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.597 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2656 3.29 3:951a8707:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.597 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.253332+0000", 2024-09-12T00:05:07.597 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.341905946000001, 2024-09-12T00:05:07.597 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018697930000000001, 2024-09-12T00:05:07.597 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.597 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.597 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.597 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.597 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.597 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.597 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2656 2024-09-12T00:05:07.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.598 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.598 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.598 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.598 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.253332+0000", 2024-09-12T00:05:07.598 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.598 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.598 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.598 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.253332+0000", 2024-09-12T00:05:07.598 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.598 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.598 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.598 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.253336+0000", 2024-09-12T00:05:07.599 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8469999999999998e-06 2024-09-12T00:05:07.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.599 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.599 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.599 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.257408+0000", 2024-09-12T00:05:07.599 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040728209999999999 2024-09-12T00:05:07.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.599 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.599 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.599 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.257445+0000", 2024-09-12T00:05:07.599 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6284e-05 2024-09-12T00:05:07.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.599 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.599 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.599 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.257470+0000", 2024-09-12T00:05:07.600 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5684999999999999e-05 2024-09-12T00:05:07.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.600 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.600 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.600 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.257608+0000", 2024-09-12T00:05:07.600 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013792200000000001 2024-09-12T00:05:07.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.600 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.600 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.600 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.257855+0000", 2024-09-12T00:05:07.600 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024628900000000001 2024-09-12T00:05:07.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.600 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.600 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:07.601 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.258062+0000", 2024-09-12T00:05:07.601 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020795699999999999 2024-09-12T00:05:07.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.601 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.601 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.601 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266228+0000", 2024-09-12T00:05:07.601 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0081652600000000006 2024-09-12T00:05:07.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.601 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.601 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.601 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271871+0000", 2024-09-12T00:05:07.601 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0056437179999999998 2024-09-12T00:05:07.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.602 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.602 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.602 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271958+0000", 2024-09-12T00:05:07.602 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6800999999999998e-05 2024-09-12T00:05:07.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.602 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.602 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.602 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.272030+0000", 2024-09-12T00:05:07.602 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1346000000000004e-05 2024-09-12T00:05:07.602 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.602 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.602 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.602 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.603 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2661 3.1e 3:7a671bd1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.603 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.307344+0000", 2024-09-12T00:05:07.603 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.287893856, 2024-09-12T00:05:07.603 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020716793000000001, 2024-09-12T00:05:07.603 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.603 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.603 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.603 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.603 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.603 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.603 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2661 2024-09-12T00:05:07.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.603 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.307344+0000", 2024-09-12T00:05:07.604 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.307344+0000", 2024-09-12T00:05:07.604 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.307347+0000", 2024-09-12T00:05:07.605 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.546e-06 2024-09-12T00:05:07.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311373+0000", 2024-09-12T00:05:07.605 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040257940000000001 2024-09-12T00:05:07.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311407+0000", 2024-09-12T00:05:07.605 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4038000000000002e-05 2024-09-12T00:05:07.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311427+0000", 2024-09-12T00:05:07.606 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0305e-05 2024-09-12T00:05:07.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.606 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.606 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.606 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311547+0000", 2024-09-12T00:05:07.606 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011904999999999999 2024-09-12T00:05:07.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.606 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.606 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.606 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311877+0000", 2024-09-12T00:05:07.606 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00033003699999999998 2024-09-12T00:05:07.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.606 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.606 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:07.606 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.312137+0000", 2024-09-12T00:05:07.606 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026013499999999999 2024-09-12T00:05:07.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.607 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.607 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.607 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.320695+0000", 2024-09-12T00:05:07.607 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0085586029999999997 2024-09-12T00:05:07.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.607 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.607 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.607 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.327883+0000", 2024-09-12T00:05:07.607 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0071877419999999996 2024-09-12T00:05:07.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.607 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.607 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.607 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.327983+0000", 2024-09-12T00:05:07.607 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010008100000000001 2024-09-12T00:05:07.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.608 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.608 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.608 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.328061+0000", 2024-09-12T00:05:07.608 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7461999999999998e-05 2024-09-12T00:05:07.608 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.608 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.608 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.608 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.608 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2665 3.3d 3:bff83547:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.608 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.351951+0000", 2024-09-12T00:05:07.608 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.243286219000002, 2024-09-12T00:05:07.608 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019663572000000001, 2024-09-12T00:05:07.608 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.609 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.609 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.609 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.609 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.609 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.609 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2665 2024-09-12T00:05:07.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.609 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.609 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.609 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.609 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.351951+0000", 2024-09-12T00:05:07.609 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.609 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.610 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.610 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.351951+0000", 2024-09-12T00:05:07.610 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.610 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.610 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.610 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.610 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.351954+0000", 2024-09-12T00:05:07.610 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9330000000000001e-06 2024-09-12T00:05:07.610 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.610 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.610 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.610 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.355966+0000", 2024-09-12T00:05:07.610 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040118009999999997 2024-09-12T00:05:07.610 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.611 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.611 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.611 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356000+0000", 2024-09-12T00:05:07.611 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3967999999999997e-05 2024-09-12T00:05:07.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.611 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.611 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.611 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356025+0000", 2024-09-12T00:05:07.611 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4658e-05 2024-09-12T00:05:07.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.611 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.611 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.611 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356202+0000", 2024-09-12T00:05:07.611 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000176756 2024-09-12T00:05:07.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.611 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.612 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.612 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356445+0000", 2024-09-12T00:05:07.612 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024318300000000001 2024-09-12T00:05:07.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.612 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:07.612 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356671+0000", 2024-09-12T00:05:07.612 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000226276 2024-09-12T00:05:07.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.612 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.612 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.370776+0000", 2024-09-12T00:05:07.612 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014104604 2024-09-12T00:05:07.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.613 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.613 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.371306+0000", 2024-09-12T00:05:07.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00053036499999999998 2024-09-12T00:05:07.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.613 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.613 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.371521+0000", 2024-09-12T00:05:07.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021477000000000001 2024-09-12T00:05:07.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.613 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.613 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.371615+0000", 2024-09-12T00:05:07.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4258000000000005e-05 2024-09-12T00:05:07.614 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.614 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.614 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.614 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2689 3.3d 3:bfc0a94d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.614 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.494580+0000", 2024-09-12T00:05:07.614 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.100657944000002, 2024-09-12T00:05:07.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019076037000000001, 2024-09-12T00:05:07.614 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.614 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.614 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.614 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.614 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.614 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.614 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2689 2024-09-12T00:05:07.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.615 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.494580+0000", 2024-09-12T00:05:07.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.494580+0000", 2024-09-12T00:05:07.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.616 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.494582+0000", 2024-09-12T00:05:07.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2029999999999999e-06 2024-09-12T00:05:07.616 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.616 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.616 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.616 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498633+0000", 2024-09-12T00:05:07.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040508430000000002 2024-09-12T00:05:07.616 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.616 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.616 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.616 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498664+0000", 2024-09-12T00:05:07.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1273999999999999e-05 2024-09-12T00:05:07.616 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.616 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.616 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.617 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498680+0000", 2024-09-12T00:05:07.617 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5783000000000001e-05 2024-09-12T00:05:07.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.617 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498864+0000", 2024-09-12T00:05:07.617 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184635 2024-09-12T00:05:07.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.617 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.499108+0000", 2024-09-12T00:05:07.617 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000243883 2024-09-12T00:05:07.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:07.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.499335+0000", 2024-09-12T00:05:07.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000226729 2024-09-12T00:05:07.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.618 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.512376+0000", 2024-09-12T00:05:07.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013040629999999999 2024-09-12T00:05:07.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.618 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.513496+0000", 2024-09-12T00:05:07.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0011198409999999999 2024-09-12T00:05:07.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.618 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.513587+0000", 2024-09-12T00:05:07.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1199999999999994e-05 2024-09-12T00:05:07.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.619 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.619 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.513656+0000", 2024-09-12T00:05:07.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9016000000000005e-05 2024-09-12T00:05:07.619 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.619 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.619 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.620 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2693 3.1e 3:7a8f9e2c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.620 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.536006+0000", 2024-09-12T00:05:07.620 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.059231821000001, 2024-09-12T00:05:07.620 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019831418999999999, 2024-09-12T00:05:07.620 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.620 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.620 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.620 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.620 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.620 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.620 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2693 2024-09-12T00:05:07.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.621 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.621 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.536006+0000", 2024-09-12T00:05:07.621 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.621 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.536006+0000", 2024-09-12T00:05:07.621 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.621 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.536010+0000", 2024-09-12T00:05:07.621 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.737e-06 2024-09-12T00:05:07.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.622 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.622 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.539958+0000", 2024-09-12T00:05:07.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003948315 2024-09-12T00:05:07.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.622 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.622 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.539997+0000", 2024-09-12T00:05:07.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9131000000000002e-05 2024-09-12T00:05:07.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.622 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.622 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.540016+0000", 2024-09-12T00:05:07.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9018e-05 2024-09-12T00:05:07.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.623 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.623 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.540148+0000", 2024-09-12T00:05:07.623 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013242899999999999 2024-09-12T00:05:07.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.623 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.623 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.540394+0000", 2024-09-12T00:05:07.623 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024580899999999999 2024-09-12T00:05:07.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.623 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:07.623 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.540622+0000", 2024-09-12T00:05:07.623 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022765599999999999 2024-09-12T00:05:07.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.547587+0000", 2024-09-12T00:05:07.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0069649259999999998 2024-09-12T00:05:07.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.555622+0000", 2024-09-12T00:05:07.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0080352640000000003 2024-09-12T00:05:07.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.555724+0000", 2024-09-12T00:05:07.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010187399999999999 2024-09-12T00:05:07.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.555837+0000", 2024-09-12T00:05:07.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011326 2024-09-12T00:05:07.625 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.625 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.625 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.625 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2694 3.3d 3:bd0bdafc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.625 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:07.625 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.049709268000001, 2024-09-12T00:05:07.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.026139741000000001, 2024-09-12T00:05:07.626 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.626 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.626 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.626 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.626 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.626 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.626 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2694 2024-09-12T00:05:07.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.626 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:07.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:07.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545532+0000", 2024-09-12T00:05:07.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8199999999999998e-06 2024-09-12T00:05:07.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551454+0000", 2024-09-12T00:05:07.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059222340000000002 2024-09-12T00:05:07.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.628 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.628 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551485+0000", 2024-09-12T00:05:07.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0173999999999999e-05 2024-09-12T00:05:07.628 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.628 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.628 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551504+0000", 2024-09-12T00:05:07.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9726000000000001e-05 2024-09-12T00:05:07.628 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.628 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.628 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551708+0000", 2024-09-12T00:05:07.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020344100000000001 2024-09-12T00:05:07.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.629 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.629 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.629 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552087+0000", 2024-09-12T00:05:07.629 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000379327 2024-09-12T00:05:07.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.629 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.629 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:07.629 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552351+0000", 2024-09-12T00:05:07.629 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026349199999999999 2024-09-12T00:05:07.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.629 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.629 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.629 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.569375+0000", 2024-09-12T00:05:07.630 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017024432999999999 2024-09-12T00:05:07.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.630 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.630 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571222+0000", 2024-09-12T00:05:07.630 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00184688 2024-09-12T00:05:07.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.630 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.630 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571511+0000", 2024-09-12T00:05:07.630 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028897599999999998 2024-09-12T00:05:07.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.630 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571668+0000", 2024-09-12T00:05:07.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000157238 2024-09-12T00:05:07.631 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.631 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.631 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.631 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.631 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2698 3.3d 3:bcafb0f9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.631 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:07.631 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.005255564999999, 2024-09-12T00:05:07.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025133152999999998, 2024-09-12T00:05:07.631 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.631 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.631 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.631 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.632 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.632 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.632 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2698 2024-09-12T00:05:07.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.632 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.632 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.632 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:07.632 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.632 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.632 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:07.632 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.633 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.633 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589986+0000", 2024-09-12T00:05:07.633 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5999999999999998e-06 2024-09-12T00:05:07.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.633 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.633 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594109+0000", 2024-09-12T00:05:07.634 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041230770000000002 2024-09-12T00:05:07.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.634 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.634 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594146+0000", 2024-09-12T00:05:07.634 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7722000000000002e-05 2024-09-12T00:05:07.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.634 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.634 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594167+0000", 2024-09-12T00:05:07.634 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0100999999999999e-05 2024-09-12T00:05:07.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.634 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.635 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594297+0000", 2024-09-12T00:05:07.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013051600000000001 2024-09-12T00:05:07.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.635 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.635 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.635 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594570+0000", 2024-09-12T00:05:07.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000272837 2024-09-12T00:05:07.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.635 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.635 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:07.635 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594846+0000", 2024-09-12T00:05:07.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027622399999999999 2024-09-12T00:05:07.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.635 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.635 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.636 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.606026+0000", 2024-09-12T00:05:07.636 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011179947000000001 2024-09-12T00:05:07.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.636 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.636 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.636 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.614827+0000", 2024-09-12T00:05:07.636 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0088013259999999999 2024-09-12T00:05:07.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.636 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.636 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.636 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.614988+0000", 2024-09-12T00:05:07.636 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016018799999999999 2024-09-12T00:05:07.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.637 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.637 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.637 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.615115+0000", 2024-09-12T00:05:07.637 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000127615 2024-09-12T00:05:07.637 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.637 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.637 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.637 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.637 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.637 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2699 3.0 3:02470ff9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.637 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.597879+0000", 2024-09-12T00:05:07.637 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.997358475999999, 2024-09-12T00:05:07.637 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021498363, 2024-09-12T00:05:07.637 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.638 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.638 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.638 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.638 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.638 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.638 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2699 2024-09-12T00:05:07.638 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.638 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.638 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.638 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.638 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.597879+0000", 2024-09-12T00:05:07.638 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.638 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.638 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.639 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.639 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.597879+0000", 2024-09-12T00:05:07.639 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.639 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.639 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.639 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.597884+0000", 2024-09-12T00:05:07.639 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1769999999999997e-06 2024-09-12T00:05:07.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.639 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.639 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.639 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602129+0000", 2024-09-12T00:05:07.639 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042451399999999997 2024-09-12T00:05:07.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.640 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.640 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.640 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602170+0000", 2024-09-12T00:05:07.640 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0194000000000002e-05 2024-09-12T00:05:07.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.640 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.640 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.640 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602198+0000", 2024-09-12T00:05:07.640 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7861999999999999e-05 2024-09-12T00:05:07.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.640 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.640 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.640 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602392+0000", 2024-09-12T00:05:07.640 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000194122 2024-09-12T00:05:07.641 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.641 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.641 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.641 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602801+0000", 2024-09-12T00:05:07.641 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040957199999999997 2024-09-12T00:05:07.641 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.641 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.641 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:07.641 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.603203+0000", 2024-09-12T00:05:07.641 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040166900000000001 2024-09-12T00:05:07.641 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.641 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.641 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.641 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.611989+0000", 2024-09-12T00:05:07.642 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0087860170000000001 2024-09-12T00:05:07.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.642 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.642 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.642 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.619177+0000", 2024-09-12T00:05:07.642 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0071878819999999996 2024-09-12T00:05:07.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.642 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.642 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.642 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.619270+0000", 2024-09-12T00:05:07.642 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2930999999999995e-05 2024-09-12T00:05:07.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.642 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.642 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.643 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.619378+0000", 2024-09-12T00:05:07.643 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000107797 2024-09-12T00:05:07.643 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.643 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.643 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.643 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.643 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.643 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2712 3.3e 3:7d3d0242:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.643 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:07.643 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.868355288, 2024-09-12T00:05:07.643 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022816941, 2024-09-12T00:05:07.643 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.643 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.644 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.644 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.644 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.644 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.644 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2712 2024-09-12T00:05:07.644 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.644 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.644 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.644 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.644 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:07.644 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.644 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.644 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.645 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.645 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:07.645 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.645 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.645 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.645 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.645 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726886+0000", 2024-09-12T00:05:07.645 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5329999999999999e-06 2024-09-12T00:05:07.645 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.645 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.645 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.645 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730802+0000", 2024-09-12T00:05:07.645 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039158700000000001 2024-09-12T00:05:07.645 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.646 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.646 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.646 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730839+0000", 2024-09-12T00:05:07.646 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6857999999999998e-05 2024-09-12T00:05:07.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.646 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.646 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.646 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730856+0000", 2024-09-12T00:05:07.646 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7371999999999999e-05 2024-09-12T00:05:07.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.646 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.646 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.646 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731026+0000", 2024-09-12T00:05:07.646 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017011000000000001 2024-09-12T00:05:07.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.647 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.647 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.647 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731444+0000", 2024-09-12T00:05:07.647 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041766500000000001 2024-09-12T00:05:07.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.647 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.647 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:07.647 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731860+0000", 2024-09-12T00:05:07.647 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041618500000000001 2024-09-12T00:05:07.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.647 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.647 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.647 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.743012+0000", 2024-09-12T00:05:07.648 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011152123 2024-09-12T00:05:07.648 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.648 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.648 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.648 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749386+0000", 2024-09-12T00:05:07.648 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0063743130000000004 2024-09-12T00:05:07.648 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.648 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.648 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.648 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749562+0000", 2024-09-12T00:05:07.648 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017590300000000001 2024-09-12T00:05:07.648 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.648 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.649 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.649 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749699+0000", 2024-09-12T00:05:07.649 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000137009 2024-09-12T00:05:07.649 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.649 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.649 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.649 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.649 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.649 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2714 3.17 3:eac65a57:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.649 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.746943+0000", 2024-09-12T00:05:07.649 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.848295046, 2024-09-12T00:05:07.649 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019462007, 2024-09-12T00:05:07.650 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.650 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.650 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.650 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.650 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.650 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.650 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2714 2024-09-12T00:05:07.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.650 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.650 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.650 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.650 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.746943+0000", 2024-09-12T00:05:07.650 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.651 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.651 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.651 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.746943+0000", 2024-09-12T00:05:07.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.651 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.651 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.651 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.746946+0000", 2024-09-12T00:05:07.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9529999999999999e-06 2024-09-12T00:05:07.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.651 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.651 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.651 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751163+0000", 2024-09-12T00:05:07.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042169859999999998 2024-09-12T00:05:07.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.652 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.652 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.652 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751188+0000", 2024-09-12T00:05:07.652 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5908e-05 2024-09-12T00:05:07.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.652 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.652 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.652 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751203+0000", 2024-09-12T00:05:07.652 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4491999999999999e-05 2024-09-12T00:05:07.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.652 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.652 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.652 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751324+0000", 2024-09-12T00:05:07.653 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120866 2024-09-12T00:05:07.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.653 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.653 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.653 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751572+0000", 2024-09-12T00:05:07.653 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024774900000000002 2024-09-12T00:05:07.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.653 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.653 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:07.653 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751798+0000", 2024-09-12T00:05:07.653 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022655700000000001 2024-09-12T00:05:07.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.653 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.653 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.654 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761058+0000", 2024-09-12T00:05:07.654 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0092603110000000002 2024-09-12T00:05:07.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.654 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.654 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.654 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.766067+0000", 2024-09-12T00:05:07.654 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005009009 2024-09-12T00:05:07.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.654 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.654 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.654 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.766264+0000", 2024-09-12T00:05:07.654 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00019632800000000001 2024-09-12T00:05:07.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.654 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.654 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.655 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.766405+0000", 2024-09-12T00:05:07.655 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000140848 2024-09-12T00:05:07.655 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.655 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.655 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.655 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.655 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.655 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2715 3.18 3:19a9b410:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.655 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:07.655 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.838978998000002, 2024-09-12T00:05:07.655 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022391956000000001, 2024-09-12T00:05:07.655 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.655 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.655 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.655 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.656 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.656 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.656 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2715 2024-09-12T00:05:07.656 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.656 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.656 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.656 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.656 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:07.656 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.656 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.656 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.656 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.656 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:07.656 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.657 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.657 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.657 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.657 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756262+0000", 2024-09-12T00:05:07.657 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9629999999999998e-06 2024-09-12T00:05:07.657 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.657 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.657 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.657 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760936+0000", 2024-09-12T00:05:07.657 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046745750000000003 2024-09-12T00:05:07.657 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.657 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.657 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.657 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760968+0000", 2024-09-12T00:05:07.658 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1470999999999997e-05 2024-09-12T00:05:07.658 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.658 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.658 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.658 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760985+0000", 2024-09-12T00:05:07.658 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7771999999999999e-05 2024-09-12T00:05:07.658 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.658 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.658 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.658 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761154+0000", 2024-09-12T00:05:07.658 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016875399999999999 2024-09-12T00:05:07.658 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.658 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.658 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.659 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761571+0000", 2024-09-12T00:05:07.659 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000417231 2024-09-12T00:05:07.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.659 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:07.659 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761996+0000", 2024-09-12T00:05:07.659 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042500200000000001 2024-09-12T00:05:07.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.659 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.659 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777182+0000", 2024-09-12T00:05:07.659 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015185664999999999 2024-09-12T00:05:07.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.660 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.660 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778484+0000", 2024-09-12T00:05:07.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00130225 2024-09-12T00:05:07.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.660 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.660 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778575+0000", 2024-09-12T00:05:07.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0258000000000002e-05 2024-09-12T00:05:07.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.660 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.660 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778651+0000", 2024-09-12T00:05:07.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6014999999999996e-05 2024-09-12T00:05:07.661 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.661 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.661 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.661 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.661 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2717 3.1a e63/23 3:5be58560:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_202:head v 63'4, mlcod=63'2)", 2024-09-12T00:05:07.661 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.777964+0000", 2024-09-12T00:05:07.661 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.817273977999999, 2024-09-12T00:05:07.661 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015392704, 2024-09-12T00:05:07.661 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.661 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.661 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.661 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.661 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.661 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777964+0000", 2024-09-12T00:05:07.662 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777964+0000", 2024-09-12T00:05:07.662 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777966+0000", 2024-09-12T00:05:07.662 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6400000000000001e-06 2024-09-12T00:05:07.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.784444+0000", 2024-09-12T00:05:07.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064781179999999997 2024-09-12T00:05:07.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.663 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.784479+0000", 2024-09-12T00:05:07.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4267999999999998e-05 2024-09-12T00:05:07.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.663 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.784495+0000", 2024-09-12T00:05:07.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6388999999999998e-05 2024-09-12T00:05:07.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.663 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.784609+0000", 2024-09-12T00:05:07.664 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000114209 2024-09-12T00:05:07.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.664 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.664 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.664 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.784650+0000", 2024-09-12T00:05:07.664 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0515000000000001e-05 2024-09-12T00:05:07.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.664 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.664 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.664 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793224+0000", 2024-09-12T00:05:07.664 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0085740060000000003 2024-09-12T00:05:07.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.664 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.665 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.665 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793356+0000", 2024-09-12T00:05:07.665 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000132559 2024-09-12T00:05:07.665 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.665 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.665 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.665 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.665 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2718 3.4 e63/23 3:20fe36bb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_203:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:07.665 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.793296+0000", 2024-09-12T00:05:07.665 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.801941157000002, 2024-09-12T00:05:07.665 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015716714, 2024-09-12T00:05:07.665 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.665 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.666 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.666 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.666 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.666 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.666 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793296+0000", 2024-09-12T00:05:07.666 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.666 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.666 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.666 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793296+0000", 2024-09-12T00:05:07.666 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.666 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.666 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793298+0000", 2024-09-12T00:05:07.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0200000000000001e-06 2024-09-12T00:05:07.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.797364+0000", 2024-09-12T00:05:07.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040657039999999998 2024-09-12T00:05:07.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.797404+0000", 2024-09-12T00:05:07.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0302000000000001e-05 2024-09-12T00:05:07.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.797423+0000", 2024-09-12T00:05:07.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8308000000000002e-05 2024-09-12T00:05:07.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.668 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.797582+0000", 2024-09-12T00:05:07.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000159047 2024-09-12T00:05:07.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.668 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.797650+0000", 2024-09-12T00:05:07.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.7832999999999999e-05 2024-09-12T00:05:07.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.669 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.669 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.669 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808882+0000", 2024-09-12T00:05:07.669 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011231837999999999 2024-09-12T00:05:07.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.669 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.669 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.669 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.809013+0000", 2024-09-12T00:05:07.669 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000131662 2024-09-12T00:05:07.669 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.669 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.669 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.669 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.669 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2726 3.3e 3:7fc616c8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.670 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.866346+0000", 2024-09-12T00:05:07.670 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.728891388000001, 2024-09-12T00:05:07.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018314736000000002, 2024-09-12T00:05:07.670 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.670 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.670 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.670 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.670 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.670 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.670 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2726 2024-09-12T00:05:07.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.670 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.671 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.866346+0000", 2024-09-12T00:05:07.671 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.671 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.671 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.866346+0000", 2024-09-12T00:05:07.671 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.671 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.671 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.866350+0000", 2024-09-12T00:05:07.671 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.54e-06 2024-09-12T00:05:07.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.672 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.672 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.870325+0000", 2024-09-12T00:05:07.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003975353 2024-09-12T00:05:07.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.672 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.672 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.672 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.870362+0000", 2024-09-12T00:05:07.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6591000000000003e-05 2024-09-12T00:05:07.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.672 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.672 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.672 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.870380+0000", 2024-09-12T00:05:07.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7921999999999999e-05 2024-09-12T00:05:07.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.870510+0000", 2024-09-12T00:05:07.673 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013024600000000001 2024-09-12T00:05:07.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.870921+0000", 2024-09-12T00:05:07.673 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041149600000000002 2024-09-12T00:05:07.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:07.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.871207+0000", 2024-09-12T00:05:07.673 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028534600000000002 2024-09-12T00:05:07.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.674 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.674 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.674 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.880787+0000", 2024-09-12T00:05:07.674 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095802300000000003 2024-09-12T00:05:07.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.674 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.674 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.674 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884454+0000", 2024-09-12T00:05:07.674 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0036669480000000002 2024-09-12T00:05:07.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.674 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.674 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.674 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884546+0000", 2024-09-12T00:05:07.674 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1625000000000005e-05 2024-09-12T00:05:07.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.675 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.675 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884661+0000", 2024-09-12T00:05:07.675 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000115439 2024-09-12T00:05:07.675 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.675 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.675 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.676 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2728 3.1f 3:faea8f78:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.676 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.887643+0000", 2024-09-12T00:05:07.676 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.707594690000001, 2024-09-12T00:05:07.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017919767, 2024-09-12T00:05:07.676 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.676 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.676 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.676 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.676 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.676 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.676 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2728 2024-09-12T00:05:07.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.677 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.887643+0000", 2024-09-12T00:05:07.677 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.887643+0000", 2024-09-12T00:05:07.677 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.887647+0000", 2024-09-12T00:05:07.678 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.754e-06 2024-09-12T00:05:07.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.678 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.678 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.678 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.891952+0000", 2024-09-12T00:05:07.678 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043048690000000002 2024-09-12T00:05:07.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.678 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.678 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.678 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.891990+0000", 2024-09-12T00:05:07.678 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8005e-05 2024-09-12T00:05:07.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.678 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.678 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.678 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.892008+0000", 2024-09-12T00:05:07.679 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7995999999999998e-05 2024-09-12T00:05:07.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.679 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.679 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.892140+0000", 2024-09-12T00:05:07.679 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013216200000000001 2024-09-12T00:05:07.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.679 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.679 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.892393+0000", 2024-09-12T00:05:07.679 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025355799999999997 2024-09-12T00:05:07.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.679 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:07.680 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.892620+0000", 2024-09-12T00:05:07.680 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022690000000000001 2024-09-12T00:05:07.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.680 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.680 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.680 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902865+0000", 2024-09-12T00:05:07.680 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010244684 2024-09-12T00:05:07.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.680 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.680 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.680 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.905386+0000", 2024-09-12T00:05:07.680 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0025208800000000001 2024-09-12T00:05:07.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.680 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.681 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.681 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.905480+0000", 2024-09-12T00:05:07.681 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4493999999999993e-05 2024-09-12T00:05:07.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.681 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.681 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.681 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.905563+0000", 2024-09-12T00:05:07.681 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2465000000000004e-05 2024-09-12T00:05:07.681 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.681 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.681 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.681 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.681 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2729 3.0 3:01c0e0c9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.682 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:07.682 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.698098181999999, 2024-09-12T00:05:07.682 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025173068, 2024-09-12T00:05:07.682 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.682 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.682 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.682 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.682 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.682 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.682 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2729 2024-09-12T00:05:07.682 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.682 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.682 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.682 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.682 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:07.683 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.683 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.683 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.683 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.683 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:07.683 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.683 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.683 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.683 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.683 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897143+0000", 2024-09-12T00:05:07.683 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6600000000000001e-06 2024-09-12T00:05:07.683 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.683 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.683 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.683 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901595+0000", 2024-09-12T00:05:07.683 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044514680000000001 2024-09-12T00:05:07.684 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.684 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.684 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.684 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901629+0000", 2024-09-12T00:05:07.684 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4864999999999999e-05 2024-09-12T00:05:07.684 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.684 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.684 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.684 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901647+0000", 2024-09-12T00:05:07.684 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7699000000000001e-05 2024-09-12T00:05:07.684 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.684 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.684 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.685 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901780+0000", 2024-09-12T00:05:07.685 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013271499999999999 2024-09-12T00:05:07.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.685 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.685 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.685 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902010+0000", 2024-09-12T00:05:07.685 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022977300000000001 2024-09-12T00:05:07.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.685 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.685 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:07.685 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902222+0000", 2024-09-12T00:05:07.685 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021262399999999999 2024-09-12T00:05:07.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.685 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.686 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.686 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912402+0000", 2024-09-12T00:05:07.686 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010180203000000001 2024-09-12T00:05:07.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.686 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.686 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.686 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.921990+0000", 2024-09-12T00:05:07.686 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095871900000000006 2024-09-12T00:05:07.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.686 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.686 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.686 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.922166+0000", 2024-09-12T00:05:07.686 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017591899999999999 2024-09-12T00:05:07.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.687 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.687 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.687 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.922313+0000", 2024-09-12T00:05:07.687 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000146952 2024-09-12T00:05:07.687 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.687 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.687 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.687 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.687 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.687 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2732 3.1f 3:f85b64cb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.687 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:07.687 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.666652394, 2024-09-12T00:05:07.687 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022644154, 2024-09-12T00:05:07.687 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.687 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.688 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.688 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.688 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.688 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.688 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2732 2024-09-12T00:05:07.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.688 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.688 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.688 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.688 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:07.688 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.688 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.688 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.688 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:07.689 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.689 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.689 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928589+0000", 2024-09-12T00:05:07.689 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1230000000000002e-06 2024-09-12T00:05:07.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.689 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.689 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932650+0000", 2024-09-12T00:05:07.689 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040611049999999997 2024-09-12T00:05:07.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.690 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.690 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932692+0000", 2024-09-12T00:05:07.690 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1677000000000001e-05 2024-09-12T00:05:07.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.690 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.690 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.690 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932711+0000", 2024-09-12T00:05:07.690 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8749e-05 2024-09-12T00:05:07.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.690 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.690 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.690 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932834+0000", 2024-09-12T00:05:07.690 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012278300000000001 2024-09-12T00:05:07.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.690 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.691 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.691 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.933095+0000", 2024-09-12T00:05:07.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026151100000000002 2024-09-12T00:05:07.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.691 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.691 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:07.691 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.933385+0000", 2024-09-12T00:05:07.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028993900000000002 2024-09-12T00:05:07.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.691 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.691 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.691 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.950988+0000", 2024-09-12T00:05:07.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017603119 2024-09-12T00:05:07.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.691 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.691 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.692 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951018+0000", 2024-09-12T00:05:07.692 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9343999999999999e-05 2024-09-12T00:05:07.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.692 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.692 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.692 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951109+0000", 2024-09-12T00:05:07.692 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1157999999999997e-05 2024-09-12T00:05:07.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.692 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.692 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.692 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951229+0000", 2024-09-12T00:05:07.692 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120646 2024-09-12T00:05:07.692 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.692 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.693 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.693 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.693 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2741 3.17 3:e9d72553:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.693 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.026321+0000", 2024-09-12T00:05:07.693 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.568916767000001, 2024-09-12T00:05:07.693 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018394443, 2024-09-12T00:05:07.693 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.693 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.693 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.693 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.693 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.693 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.693 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2741 2024-09-12T00:05:07.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.694 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.694 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.694 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.694 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.026321+0000", 2024-09-12T00:05:07.694 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.694 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.694 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.694 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.026321+0000", 2024-09-12T00:05:07.694 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.694 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.694 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.694 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.026325+0000", 2024-09-12T00:05:07.694 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9670000000000003e-06 2024-09-12T00:05:07.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.695 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.695 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030370+0000", 2024-09-12T00:05:07.695 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040448189999999998 2024-09-12T00:05:07.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.695 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.695 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030408+0000", 2024-09-12T00:05:07.695 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8481e-05 2024-09-12T00:05:07.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.695 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.695 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030426+0000", 2024-09-12T00:05:07.696 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8236e-05 2024-09-12T00:05:07.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.696 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.696 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.696 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030588+0000", 2024-09-12T00:05:07.696 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000161614 2024-09-12T00:05:07.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.696 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.696 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.696 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030854+0000", 2024-09-12T00:05:07.696 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026595699999999999 2024-09-12T00:05:07.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.696 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.697 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:07.697 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.031124+0000", 2024-09-12T00:05:07.697 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027049799999999998 2024-09-12T00:05:07.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.697 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.697 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.697 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.039845+0000", 2024-09-12T00:05:07.697 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00872063 2024-09-12T00:05:07.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.697 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.697 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.697 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.044412+0000", 2024-09-12T00:05:07.697 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045666860000000004 2024-09-12T00:05:07.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.698 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.698 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.698 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.044589+0000", 2024-09-12T00:05:07.698 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000176789 2024-09-12T00:05:07.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.698 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.698 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.698 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.044715+0000", 2024-09-12T00:05:07.698 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000126766 2024-09-12T00:05:07.698 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.698 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.698 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.698 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.698 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2747 3.17 3:eaa4528d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:07.699 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:07.699 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.506315909000001, 2024-09-12T00:05:07.699 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025552734000000001, 2024-09-12T00:05:07.699 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.699 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.699 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.699 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:07.699 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:07.699 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:07.699 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2747 2024-09-12T00:05:07.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.699 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.699 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.699 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.700 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:07.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.700 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.700 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:07.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.700 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.700 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088925+0000", 2024-09-12T00:05:07.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7759999999999999e-06 2024-09-12T00:05:07.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093002+0000", 2024-09-12T00:05:07.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004076405 2024-09-12T00:05:07.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093040+0000", 2024-09-12T00:05:07.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8093999999999998e-05 2024-09-12T00:05:07.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093059+0000", 2024-09-12T00:05:07.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8736000000000002e-05 2024-09-12T00:05:07.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093230+0000", 2024-09-12T00:05:07.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000170853 2024-09-12T00:05:07.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093627+0000", 2024-09-12T00:05:07.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039781400000000002 2024-09-12T00:05:07.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:07.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.094044+0000", 2024-09-12T00:05:07.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000416205 2024-09-12T00:05:07.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:07.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.103528+0000", 2024-09-12T00:05:07.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0094841549999999993 2024-09-12T00:05:07.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:07.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112299+0000", 2024-09-12T00:05:07.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0087711590000000006 2024-09-12T00:05:07.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112397+0000", 2024-09-12T00:05:07.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8095000000000002e-05 2024-09-12T00:05:07.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.704 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.704 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.704 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.114474+0000", 2024-09-12T00:05:07.704 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020774420000000001 2024-09-12T00:05:07.704 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.704 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.704 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.704 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.704 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2748 3.3b e63/23 3:df6d92a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_233:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:07.704 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.104676+0000", 2024-09-12T00:05:07.704 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.490561532000001, 2024-09-12T00:05:07.704 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016872637999999999, 2024-09-12T00:05:07.704 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:07.705 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:07.705 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:07.705 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:07.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.705 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:07.705 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.104676+0000", 2024-09-12T00:05:07.705 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.705 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:07.705 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.104676+0000", 2024-09-12T00:05:07.705 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:07.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.706 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:07.706 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.104678+0000", 2024-09-12T00:05:07.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5400000000000001e-06 2024-09-12T00:05:07.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.706 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:07.706 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.108632+0000", 2024-09-12T00:05:07.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039548650000000001 2024-09-12T00:05:07.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.706 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:07.706 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.108662+0000", 2024-09-12T00:05:07.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9235999999999999e-05 2024-09-12T00:05:07.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:07.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.108677+0000", 2024-09-12T00:05:07.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5455999999999999e-05 2024-09-12T00:05:07.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:07.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.108845+0000", 2024-09-12T00:05:07.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016741299999999999 2024-09-12T00:05:07.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:07.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.108906+0000", 2024-09-12T00:05:07.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1283000000000003e-05 2024-09-12T00:05:07.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.708 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:07.708 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.121360+0000", 2024-09-12T00:05:07.708 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012454036 2024-09-12T00:05:07.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:07.708 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:07.708 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:07.708 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.121549+0000", 2024-09-12T00:05:07.708 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018880899999999999 2024-09-12T00:05:07.708 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.708 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.708 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.708 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:07.708 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:07.708 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:07.710 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T00:05:07.711 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:05:07.711 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:07.709+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:07.811 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:07.812+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:07.885 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:07.886 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:07.886 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:07.886 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:07.900 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:05:07.946 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:07.945+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:08.013 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:08.012+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:08.021 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:08.021 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:08.021 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:08.021 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:08.021 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:08.036 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:05:08.094 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:05:08.141 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:08.144+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:08.204 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:08.205 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:08.205 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:08.205 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:08.205 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.205 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1646 3.25 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:05:08.205 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:08.205 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 35.126519031999997, 2024-09-12T00:05:08.205 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030091884999999999, 2024-09-12T00:05:08.205 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:08.205 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:08.205 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:08.205 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:08.206 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:08.206 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:08.206 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1646 2024-09-12T00:05:08.206 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.206 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:08.206 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.206 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:08.206 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:08.206 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.206 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.206 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.206 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:08.206 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:08.207 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.207 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.207 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.207 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:08.207 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077113+0000", 2024-09-12T00:05:08.207 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0186e-05 2024-09-12T00:05:08.207 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.207 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.207 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:08.207 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084821+0000", 2024-09-12T00:05:08.207 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077083450000000001 2024-09-12T00:05:08.207 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.207 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.207 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:08.208 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084857+0000", 2024-09-12T00:05:08.208 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6245000000000003e-05 2024-09-12T00:05:08.208 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.208 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.208 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:08.208 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084900+0000", 2024-09-12T00:05:08.208 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2369e-05 2024-09-12T00:05:08.208 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.208 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.208 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:08.208 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085058+0000", 2024-09-12T00:05:08.209 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015858199999999999 2024-09-12T00:05:08.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.209 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.209 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:08.209 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085307+0000", 2024-09-12T00:05:08.209 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024867999999999998 2024-09-12T00:05:08.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.209 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.209 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:08.209 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086107+0000", 2024-09-12T00:05:08.209 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00080040099999999996 2024-09-12T00:05:08.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.210 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.210 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:08.210 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.100477+0000", 2024-09-12T00:05:08.210 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014369508 2024-09-12T00:05:08.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.210 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.210 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:08.210 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107016+0000", 2024-09-12T00:05:08.210 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006538894 2024-09-12T00:05:08.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.210 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.210 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:08.210 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107121+0000", 2024-09-12T00:05:08.211 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105284 2024-09-12T00:05:08.211 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.211 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.211 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:08.211 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107194+0000", 2024-09-12T00:05:08.211 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3391000000000003e-05 2024-09-12T00:05:08.211 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.211 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:08.211 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.211 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.211 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.211 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1917 3.1 3:829295ac:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.4_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:05:08.211 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:08.212 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.038435552000003, 2024-09-12T00:05:08.212 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021401453000000001, 2024-09-12T00:05:08.212 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:08.212 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:08.212 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:08.212 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:08.212 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:08.212 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:08.212 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1917 2024-09-12T00:05:08.212 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.212 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:08.212 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.212 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:08.212 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:08.213 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.213 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.213 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:08.213 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:08.213 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.213 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.213 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:08.213 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165188+0000", 2024-09-12T00:05:08.213 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5409999999999999e-06 2024-09-12T00:05:08.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.213 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.213 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:08.214 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169353+0000", 2024-09-12T00:05:08.214 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00416446 2024-09-12T00:05:08.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.214 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.214 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:08.214 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169380+0000", 2024-09-12T00:05:08.214 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6919000000000001e-05 2024-09-12T00:05:08.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.214 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.214 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:08.214 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169392+0000", 2024-09-12T00:05:08.214 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1967000000000001e-05 2024-09-12T00:05:08.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.214 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.215 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:08.215 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169519+0000", 2024-09-12T00:05:08.215 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012686199999999999 2024-09-12T00:05:08.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.215 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.215 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:08.215 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169789+0000", 2024-09-12T00:05:08.215 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027062700000000001 2024-09-12T00:05:08.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.215 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.215 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:08.215 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.170614+0000", 2024-09-12T00:05:08.215 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00082475799999999998 2024-09-12T00:05:08.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.216 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.216 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:08.216 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.183665+0000", 2024-09-12T00:05:08.216 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013051269000000001 2024-09-12T00:05:08.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.216 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.216 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:08.216 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186367+0000", 2024-09-12T00:05:08.216 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002701789 2024-09-12T00:05:08.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.216 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.216 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:08.216 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186485+0000", 2024-09-12T00:05:08.217 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011763400000000001 2024-09-12T00:05:08.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.217 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.217 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:08.217 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186587+0000", 2024-09-12T00:05:08.217 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010262700000000001 2024-09-12T00:05:08.217 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.217 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:08.217 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.217 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.217 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2670 3.15 e63/23 3:aae67b25:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_165:head v 63'2, mlcod=0'0)", 2024-09-12T00:05:08.217 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.405423+0000", 2024-09-12T00:05:08.217 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.798198014, 2024-09-12T00:05:08.218 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016803036, 2024-09-12T00:05:08.218 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:08.218 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:08.218 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:08.218 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:08.218 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.218 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:08.218 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.405423+0000", 2024-09-12T00:05:08.218 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.218 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.218 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.218 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:08.218 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.405423+0000", 2024-09-12T00:05:08.218 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.219 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.219 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:08.219 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.405426+0000", 2024-09-12T00:05:08.219 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7669999999999999e-06 2024-09-12T00:05:08.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.219 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.219 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:08.219 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.410512+0000", 2024-09-12T00:05:08.219 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0050861370000000001 2024-09-12T00:05:08.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.219 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.219 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:08.220 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.410546+0000", 2024-09-12T00:05:08.220 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3167999999999998e-05 2024-09-12T00:05:08.220 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.220 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.220 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:08.220 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.410560+0000", 2024-09-12T00:05:08.220 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4703e-05 2024-09-12T00:05:08.220 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.220 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.220 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:08.220 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.410743+0000", 2024-09-12T00:05:08.220 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018231899999999999 2024-09-12T00:05:08.220 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.220 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.221 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:08.221 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.410811+0000", 2024-09-12T00:05:08.221 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8548999999999997e-05 2024-09-12T00:05:08.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.221 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.221 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:08.221 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.422127+0000", 2024-09-12T00:05:08.221 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011316109 2024-09-12T00:05:08.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.221 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.221 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:08.221 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.422226+0000", 2024-09-12T00:05:08.222 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9283999999999993e-05 2024-09-12T00:05:08.222 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.222 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:08.222 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.222 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.222 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2675 3.20 e63/23 3:0529bfef:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_170:head v 63'4, mlcod=62'2)", 2024-09-12T00:05:08.222 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.456051+0000", 2024-09-12T00:05:08.222 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.747570139, 2024-09-12T00:05:08.222 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015360705000000001, 2024-09-12T00:05:08.222 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:08.222 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:08.222 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:08.223 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:08.223 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.223 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:08.223 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.456051+0000", 2024-09-12T00:05:08.223 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.223 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.223 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.223 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:08.223 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.456051+0000", 2024-09-12T00:05:08.223 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.223 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.223 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.223 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:08.223 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.456054+0000", 2024-09-12T00:05:08.224 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.92e-06 2024-09-12T00:05:08.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.224 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.224 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:08.224 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.460182+0000", 2024-09-12T00:05:08.224 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004127571 2024-09-12T00:05:08.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.224 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.224 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:08.224 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.460228+0000", 2024-09-12T00:05:08.224 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6551000000000002e-05 2024-09-12T00:05:08.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.224 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.225 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:08.225 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.460253+0000", 2024-09-12T00:05:08.225 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4615000000000001e-05 2024-09-12T00:05:08.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.225 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.225 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:08.225 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.460416+0000", 2024-09-12T00:05:08.225 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016267699999999999 2024-09-12T00:05:08.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.225 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.225 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:08.225 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.460479+0000", 2024-09-12T00:05:08.225 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3507e-05 2024-09-12T00:05:08.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.226 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.226 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:08.226 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.471281+0000", 2024-09-12T00:05:08.226 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010802169 2024-09-12T00:05:08.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.226 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.226 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:08.226 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.471412+0000", 2024-09-12T00:05:08.226 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013069500000000001 2024-09-12T00:05:08.226 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.226 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:08.226 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.226 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.227 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2705 3.24 3:26f37004:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:08.227 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.657414+0000", 2024-09-12T00:05:08.227 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.546207061, 2024-09-12T00:05:08.227 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016400229999999998, 2024-09-12T00:05:08.227 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:08.227 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:08.227 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:08.227 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:08.227 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:08.227 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:08.227 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2705 2024-09-12T00:05:08.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.227 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:08.227 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.228 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:08.228 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.657414+0000", 2024-09-12T00:05:08.228 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.228 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.228 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:08.228 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.657414+0000", 2024-09-12T00:05:08.228 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.228 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.228 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:08.228 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.657418+0000", 2024-09-12T00:05:08.228 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9029999999999997e-06 2024-09-12T00:05:08.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.229 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.229 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:08.229 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.661748+0000", 2024-09-12T00:05:08.229 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004329729 2024-09-12T00:05:08.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.229 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.229 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:08.229 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.661790+0000", 2024-09-12T00:05:08.229 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1921000000000001e-05 2024-09-12T00:05:08.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.229 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.229 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:08.229 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.661811+0000", 2024-09-12T00:05:08.230 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1058999999999999e-05 2024-09-12T00:05:08.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.230 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.230 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:08.230 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.661975+0000", 2024-09-12T00:05:08.230 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016390999999999999 2024-09-12T00:05:08.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.230 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.230 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:08.230 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.662220+0000", 2024-09-12T00:05:08.230 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024466499999999998 2024-09-12T00:05:08.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.230 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.230 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:08.231 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.662451+0000", 2024-09-12T00:05:08.231 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000231463 2024-09-12T00:05:08.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:08.231 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.671543+0000", 2024-09-12T00:05:08.231 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0090919320000000005 2024-09-12T00:05:08.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:08.231 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.673650+0000", 2024-09-12T00:05:08.231 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0021065509999999999 2024-09-12T00:05:08.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.232 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:08.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.673742+0000", 2024-09-12T00:05:08.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2108000000000006e-05 2024-09-12T00:05:08.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.232 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:08.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.673815+0000", 2024-09-12T00:05:08.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2989000000000002e-05 2024-09-12T00:05:08.232 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.232 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:08.232 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.233 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.233 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2712 3.3e e63/23 3:7d3d0242:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_197:head v 63'4, mlcod=63'2)", 2024-09-12T00:05:08.233 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.732097+0000", 2024-09-12T00:05:08.233 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.471524112000001, 2024-09-12T00:05:08.233 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016924379, 2024-09-12T00:05:08.233 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:08.233 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:08.233 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:08.233 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:08.233 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.234 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:08.234 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.732097+0000", 2024-09-12T00:05:08.234 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.234 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.234 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:08.234 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.732097+0000", 2024-09-12T00:05:08.234 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.234 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.234 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:08.234 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.732100+0000", 2024-09-12T00:05:08.234 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8789999999999999e-06 2024-09-12T00:05:08.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.235 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.235 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:08.235 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.736405+0000", 2024-09-12T00:05:08.235 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043048139999999997 2024-09-12T00:05:08.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.235 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.235 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:08.235 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.736443+0000", 2024-09-12T00:05:08.235 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7968e-05 2024-09-12T00:05:08.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.235 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.235 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:08.235 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.736460+0000", 2024-09-12T00:05:08.236 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6878999999999999e-05 2024-09-12T00:05:08.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.236 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.236 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:08.236 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.736645+0000", 2024-09-12T00:05:08.236 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000185176 2024-09-12T00:05:08.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.236 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.236 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:08.236 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.736689+0000", 2024-09-12T00:05:08.236 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3956999999999999e-05 2024-09-12T00:05:08.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.236 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.237 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:08.237 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.748895+0000", 2024-09-12T00:05:08.237 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.01220592 2024-09-12T00:05:08.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.237 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.237 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:08.237 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749022+0000", 2024-09-12T00:05:08.237 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012678599999999999 2024-09-12T00:05:08.237 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.237 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:08.237 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.237 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.237 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2716 3.20 e63/23 3:042f7231:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_201:head v 63'5, mlcod=62'3)", 2024-09-12T00:05:08.238 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.769786+0000", 2024-09-12T00:05:08.238 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.433835649999999, 2024-09-12T00:05:08.238 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018005950999999999, 2024-09-12T00:05:08.238 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:08.238 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:08.238 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:08.238 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:08.238 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.238 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:08.238 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.769786+0000", 2024-09-12T00:05:08.238 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.238 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.239 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:08.239 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.769786+0000", 2024-09-12T00:05:08.239 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.239 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:08.239 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.769788+0000", 2024-09-12T00:05:08.239 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4729999999999999e-06 2024-09-12T00:05:08.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.239 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:08.239 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777256+0000", 2024-09-12T00:05:08.239 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0074680579999999996 2024-09-12T00:05:08.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.240 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.240 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:08.240 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777288+0000", 2024-09-12T00:05:08.240 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1322000000000003e-05 2024-09-12T00:05:08.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.240 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.240 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:08.240 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777303+0000", 2024-09-12T00:05:08.240 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5139e-05 2024-09-12T00:05:08.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.240 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.240 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:08.240 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777399+0000", 2024-09-12T00:05:08.241 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5711000000000006e-05 2024-09-12T00:05:08.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.241 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.241 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:08.241 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777437+0000", 2024-09-12T00:05:08.241 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8056999999999998e-05 2024-09-12T00:05:08.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.241 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.241 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:08.241 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.787696+0000", 2024-09-12T00:05:08.241 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010259127 2024-09-12T00:05:08.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.241 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.241 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:08.242 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.787792+0000", 2024-09-12T00:05:08.242 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.6063999999999994e-05 2024-09-12T00:05:08.242 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.242 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:08.242 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.242 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.242 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.242 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2718 3.4 3:20fe36bb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:08.242 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:08.242 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.418040873999999, 2024-09-12T00:05:08.242 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027867928, 2024-09-12T00:05:08.242 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:08.242 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:08.242 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:08.243 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:08.243 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:08.243 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:08.243 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2718 2024-09-12T00:05:08.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.243 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:08.243 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.243 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:08.243 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:08.243 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.243 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.243 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:08.243 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:08.244 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.244 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.244 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:08.244 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785584+0000", 2024-09-12T00:05:08.244 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.056e-06 2024-09-12T00:05:08.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.244 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.244 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:08.244 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792023+0000", 2024-09-12T00:05:08.244 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064398069999999996 2024-09-12T00:05:08.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.244 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.245 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:08.245 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792058+0000", 2024-09-12T00:05:08.245 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5018000000000003e-05 2024-09-12T00:05:08.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.245 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.245 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:08.245 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792078+0000", 2024-09-12T00:05:08.245 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9862000000000001e-05 2024-09-12T00:05:08.249 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.249 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.249 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:08.249 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792248+0000", 2024-09-12T00:05:08.249 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017006399999999999 2024-09-12T00:05:08.249 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.249 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.249 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:08.249 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792660+0000", 2024-09-12T00:05:08.249 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041189500000000001 2024-09-12T00:05:08.249 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.249 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.249 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:08.250 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793081+0000", 2024-09-12T00:05:08.250 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000420395 2024-09-12T00:05:08.250 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.250 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.250 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:08.250 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808422+0000", 2024-09-12T00:05:08.250 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015341626000000001 2024-09-12T00:05:08.250 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.250 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.250 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:08.250 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813192+0000", 2024-09-12T00:05:08.250 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047701799999999997 2024-09-12T00:05:08.250 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.251 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.251 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:08.251 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813339+0000", 2024-09-12T00:05:08.251 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014643800000000001 2024-09-12T00:05:08.251 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.251 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.251 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:08.251 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813449+0000", 2024-09-12T00:05:08.251 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010958700000000001 2024-09-12T00:05:08.251 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.251 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:08.251 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.251 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.251 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.252 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2719 3.1 3:83b62cc7:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:08.252 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:08.252 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.409533437, 2024-09-12T00:05:08.252 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021687128999999999, 2024-09-12T00:05:08.252 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:08.252 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:08.252 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:08.252 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:08.252 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:08.252 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:08.252 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2719 2024-09-12T00:05:08.252 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.252 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:08.253 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.253 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:08.253 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:08.253 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.253 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.253 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.253 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:08.253 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:08.253 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.253 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.253 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.253 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:08.253 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794091+0000", 2024-09-12T00:05:08.254 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0630000000000002e-06 2024-09-12T00:05:08.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.254 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.254 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:08.254 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800194+0000", 2024-09-12T00:05:08.254 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061025089999999999 2024-09-12T00:05:08.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.254 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.254 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:08.254 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800234+0000", 2024-09-12T00:05:08.254 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0114999999999998e-05 2024-09-12T00:05:08.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.254 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.254 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:08.255 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800255+0000", 2024-09-12T00:05:08.255 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1548000000000001e-05 2024-09-12T00:05:08.255 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.255 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.255 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:08.255 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800400+0000", 2024-09-12T00:05:08.255 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014438499999999999 2024-09-12T00:05:08.255 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.255 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.255 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:08.255 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800654+0000", 2024-09-12T00:05:08.255 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025430500000000003 2024-09-12T00:05:08.255 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.255 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.256 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:08.256 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800908+0000", 2024-09-12T00:05:08.256 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025422800000000001 2024-09-12T00:05:08.256 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.256 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.256 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:08.256 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.814197+0000", 2024-09-12T00:05:08.256 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013289216 2024-09-12T00:05:08.256 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.256 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.256 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:08.256 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815578+0000", 2024-09-12T00:05:08.256 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00138079 2024-09-12T00:05:08.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.257 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.257 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:08.257 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815704+0000", 2024-09-12T00:05:08.257 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012551500000000001 2024-09-12T00:05:08.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.257 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.257 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:08.257 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815775+0000", 2024-09-12T00:05:08.257 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1454999999999999e-05 2024-09-12T00:05:08.257 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.257 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:08.257 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.258 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.258 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.258 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2730 3.7 e63/23 3:e3fca83c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_215:head v 63'5, mlcod=62'3)", 2024-09-12T00:05:08.258 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.913714+0000", 2024-09-12T00:05:08.258 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.289907341999999, 2024-09-12T00:05:08.258 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016065969999999999, 2024-09-12T00:05:08.258 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:08.258 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:08.258 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:08.258 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:08.258 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.258 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:08.258 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913714+0000", 2024-09-12T00:05:08.258 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.259 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.259 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.259 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:08.259 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913714+0000", 2024-09-12T00:05:08.259 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.259 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.259 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.259 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:08.259 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913717+0000", 2024-09-12T00:05:08.259 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2229999999999999e-06 2024-09-12T00:05:08.259 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.259 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.259 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:08.259 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.916396+0000", 2024-09-12T00:05:08.260 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026787909999999998 2024-09-12T00:05:08.260 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.260 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.260 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:08.260 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.916432+0000", 2024-09-12T00:05:08.260 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6193999999999999e-05 2024-09-12T00:05:08.260 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.260 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.260 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:08.260 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.916449+0000", 2024-09-12T00:05:08.260 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6575999999999999e-05 2024-09-12T00:05:08.260 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.260 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.261 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:08.261 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.916604+0000", 2024-09-12T00:05:08.261 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015556700000000001 2024-09-12T00:05:08.261 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.261 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.261 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:08.261 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.916647+0000", 2024-09-12T00:05:08.261 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2630999999999999e-05 2024-09-12T00:05:08.261 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.261 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.261 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:08.261 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.929614+0000", 2024-09-12T00:05:08.261 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012967215000000001 2024-09-12T00:05:08.261 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.262 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.262 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:08.262 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.929780+0000", 2024-09-12T00:05:08.262 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000165773 2024-09-12T00:05:08.262 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.262 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:08.262 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.262 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.262 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.262 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2736 3.25 3:a750a681:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:08.262 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:08.262 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.228268512, 2024-09-12T00:05:08.262 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025701234999999999, 2024-09-12T00:05:08.262 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:08.263 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:08.263 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:08.263 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:08.263 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:08.263 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:08.263 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2736 2024-09-12T00:05:08.263 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.263 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:08.263 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.263 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:08.263 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:08.263 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.263 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.264 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.264 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:08.264 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:08.264 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.264 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.264 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.264 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:08.264 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975357+0000", 2024-09-12T00:05:08.264 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9389999999999999e-06 2024-09-12T00:05:08.264 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.264 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.264 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:08.264 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979365+0000", 2024-09-12T00:05:08.264 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040076679999999998 2024-09-12T00:05:08.265 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.265 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.265 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:08.265 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979402+0000", 2024-09-12T00:05:08.265 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7557e-05 2024-09-12T00:05:08.265 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.265 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.265 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:08.265 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979419+0000", 2024-09-12T00:05:08.265 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7203000000000001e-05 2024-09-12T00:05:08.265 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.265 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.265 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:08.266 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979543+0000", 2024-09-12T00:05:08.266 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000123423 2024-09-12T00:05:08.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.266 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.266 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:08.266 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979784+0000", 2024-09-12T00:05:08.266 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024097800000000001 2024-09-12T00:05:08.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.266 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.266 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:08.266 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980013+0000", 2024-09-12T00:05:08.266 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022881999999999999 2024-09-12T00:05:08.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.266 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.267 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:08.267 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.999860+0000", 2024-09-12T00:05:08.267 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019847908000000001 2024-09-12T00:05:08.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.267 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.267 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:08.267 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000741+0000", 2024-09-12T00:05:08.267 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00088041499999999995 2024-09-12T00:05:08.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.267 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.267 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:08.267 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000915+0000", 2024-09-12T00:05:08.267 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017460300000000001 2024-09-12T00:05:08.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.267 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.268 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:08.268 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.001054+0000", 2024-09-12T00:05:08.268 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013872099999999999 2024-09-12T00:05:08.268 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.268 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:08.268 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.268 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.268 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.268 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2737 3.25 3:a794c975:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:08.268 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:08.268 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.218255706000001, 2024-09-12T00:05:08.268 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022562862999999999, 2024-09-12T00:05:08.268 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:08.268 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:08.269 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:08.269 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:08.269 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:08.269 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:08.269 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2737 2024-09-12T00:05:08.269 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.269 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:08.269 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.269 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:08.269 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:08.269 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.269 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.269 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.269 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:08.270 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:08.270 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.270 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.270 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.270 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:08.270 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985368+0000", 2024-09-12T00:05:08.270 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.323e-06 2024-09-12T00:05:08.270 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.270 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.270 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:08.270 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990209+0000", 2024-09-12T00:05:08.270 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004840446 2024-09-12T00:05:08.270 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.270 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.271 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:08.271 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990255+0000", 2024-09-12T00:05:08.271 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6526999999999997e-05 2024-09-12T00:05:08.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.271 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.271 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:08.271 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990283+0000", 2024-09-12T00:05:08.271 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7631e-05 2024-09-12T00:05:08.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.271 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.271 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:08.271 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990445+0000", 2024-09-12T00:05:08.271 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016238400000000001 2024-09-12T00:05:08.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.271 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.272 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:08.272 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990732+0000", 2024-09-12T00:05:08.272 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028698299999999999 2024-09-12T00:05:08.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.272 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.272 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:08.272 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.991001+0000", 2024-09-12T00:05:08.272 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026869099999999999 2024-09-12T00:05:08.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.272 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.272 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:08.272 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007077+0000", 2024-09-12T00:05:08.272 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016076686999999999 2024-09-12T00:05:08.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.273 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.273 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:08.273 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007761+0000", 2024-09-12T00:05:08.273 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00068366399999999995 2024-09-12T00:05:08.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.273 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.273 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:08.273 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007860+0000", 2024-09-12T00:05:08.273 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8513999999999999e-05 2024-09-12T00:05:08.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.273 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.273 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:08.273 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007929+0000", 2024-09-12T00:05:08.273 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9012999999999998e-05 2024-09-12T00:05:08.274 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.274 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:08.274 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.274 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.274 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2740 3.33 3:cd810b27:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:08.274 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.016302+0000", 2024-09-12T00:05:08.274 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.187319346999999, 2024-09-12T00:05:08.274 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017338635000000002, 2024-09-12T00:05:08.274 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:08.274 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:08.274 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:08.274 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:08.274 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:08.275 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:08.275 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2740 2024-09-12T00:05:08.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.275 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:08.275 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.275 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:08.275 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.016302+0000", 2024-09-12T00:05:08.275 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.275 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.275 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:08.275 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.016302+0000", 2024-09-12T00:05:08.275 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.275 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.276 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:08.276 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.016306+0000", 2024-09-12T00:05:08.276 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6169999999999998e-06 2024-09-12T00:05:08.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.276 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.276 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:08.276 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.020590+0000", 2024-09-12T00:05:08.276 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042843320000000001 2024-09-12T00:05:08.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.276 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.276 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:08.276 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.020633+0000", 2024-09-12T00:05:08.276 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3124999999999998e-05 2024-09-12T00:05:08.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.277 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.277 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:08.277 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.020656+0000", 2024-09-12T00:05:08.277 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2738000000000002e-05 2024-09-12T00:05:08.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.277 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.278 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:08.278 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.020838+0000", 2024-09-12T00:05:08.278 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000181826 2024-09-12T00:05:08.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.278 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.278 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:08.278 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.021137+0000", 2024-09-12T00:05:08.278 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00029887199999999999 2024-09-12T00:05:08.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.278 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.279 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:08.279 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.021365+0000", 2024-09-12T00:05:08.279 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022853700000000001 2024-09-12T00:05:08.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.279 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.279 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:08.279 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030957+0000", 2024-09-12T00:05:08.279 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095913879999999993 2024-09-12T00:05:08.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.279 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.279 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:08.279 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.033328+0000", 2024-09-12T00:05:08.279 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0023717450000000002 2024-09-12T00:05:08.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.280 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.280 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:08.280 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.033509+0000", 2024-09-12T00:05:08.280 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018055999999999999 2024-09-12T00:05:08.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.280 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.280 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:08.280 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.033641+0000", 2024-09-12T00:05:08.280 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013189500000000001 2024-09-12T00:05:08.280 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.280 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:08.280 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.281 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.281 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.281 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2744 3.20 e63/23 3:0785dd58:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_229:head v 63'6, mlcod=63'4)", 2024-09-12T00:05:08.281 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.059590+0000", 2024-09-12T00:05:08.281 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.144031498, 2024-09-12T00:05:08.281 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015921535000000001, 2024-09-12T00:05:08.281 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:08.281 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:08.281 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:08.281 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:08.281 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.281 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:08.281 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.059590+0000", 2024-09-12T00:05:08.282 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.282 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.282 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.282 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:08.282 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.059590+0000", 2024-09-12T00:05:08.282 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.282 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.282 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.282 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:08.282 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.059592+0000", 2024-09-12T00:05:08.282 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4899999999999999e-06 2024-09-12T00:05:08.282 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.282 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.282 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:08.283 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.063909+0000", 2024-09-12T00:05:08.283 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043162510000000001 2024-09-12T00:05:08.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.283 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.283 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:08.283 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.063940+0000", 2024-09-12T00:05:08.283 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1724000000000003e-05 2024-09-12T00:05:08.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.283 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.283 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:08.283 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.063955+0000", 2024-09-12T00:05:08.283 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4353e-05 2024-09-12T00:05:08.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.284 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.284 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:08.284 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.064145+0000", 2024-09-12T00:05:08.284 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018995199999999999 2024-09-12T00:05:08.284 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.284 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.284 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:08.284 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.064187+0000", 2024-09-12T00:05:08.284 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2264000000000001e-05 2024-09-12T00:05:08.284 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.284 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.284 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:08.284 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.075348+0000", 2024-09-12T00:05:08.285 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011161453 2024-09-12T00:05:08.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.285 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.285 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:08.285 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.075512+0000", 2024-09-12T00:05:08.285 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000163048 2024-09-12T00:05:08.285 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.285 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:08.285 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.285 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.285 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2746 3.24 3:24549c49:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_231:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:08.285 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.078769+0000", 2024-09-12T00:05:08.286 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.124852564000001, 2024-09-12T00:05:08.286 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016657594000000001, 2024-09-12T00:05:08.286 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:08.286 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:08.286 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:08.286 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:08.286 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:08.286 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:08.286 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2746 2024-09-12T00:05:08.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.286 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:08.286 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.287 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:08.287 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.078769+0000", 2024-09-12T00:05:08.287 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.287 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.287 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:08.287 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.078769+0000", 2024-09-12T00:05:08.287 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.287 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.287 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:08.287 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.078773+0000", 2024-09-12T00:05:08.288 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3830000000000002e-06 2024-09-12T00:05:08.288 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.288 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.288 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:08.288 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.083071+0000", 2024-09-12T00:05:08.288 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042978419999999996 2024-09-12T00:05:08.288 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.288 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.288 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:08.288 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.083105+0000", 2024-09-12T00:05:08.288 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3983999999999999e-05 2024-09-12T00:05:08.288 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.289 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:08.289 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.083122+0000", 2024-09-12T00:05:08.289 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6399e-05 2024-09-12T00:05:08.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.289 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:08.289 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.083286+0000", 2024-09-12T00:05:08.289 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016477700000000001 2024-09-12T00:05:08.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.289 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:08.289 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.083681+0000", 2024-09-12T00:05:08.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000394387 2024-09-12T00:05:08.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.290 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.290 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:08.290 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.084084+0000", 2024-09-12T00:05:08.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000403263 2024-09-12T00:05:08.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.290 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.290 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:08.290 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093372+0000", 2024-09-12T00:05:08.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0092879490000000002 2024-09-12T00:05:08.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.290 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.291 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:08.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.095074+0000", 2024-09-12T00:05:08.291 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001702371 2024-09-12T00:05:08.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.291 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.291 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:08.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.095205+0000", 2024-09-12T00:05:08.291 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000130572 2024-09-12T00:05:08.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.291 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.291 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:08.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.095426+0000", 2024-09-12T00:05:08.291 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022166699999999999 2024-09-12T00:05:08.291 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.292 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:08.292 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.292 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.292 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2749 3.33 3:ce43df22:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:08.292 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.112848+0000", 2024-09-12T00:05:08.292 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.090772987000001, 2024-09-12T00:05:08.292 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016292930000000001, 2024-09-12T00:05:08.292 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:08.292 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:08.292 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:08.292 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:08.292 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:08.293 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:08.293 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2749 2024-09-12T00:05:08.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.293 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:08.293 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.293 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:08.293 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112848+0000", 2024-09-12T00:05:08.293 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.293 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.293 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:08.293 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112848+0000", 2024-09-12T00:05:08.293 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.294 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.294 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:08.294 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112853+0000", 2024-09-12T00:05:08.294 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0799999999999999e-06 2024-09-12T00:05:08.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.294 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.294 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:08.294 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.116860+0000", 2024-09-12T00:05:08.294 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040070690000000003 2024-09-12T00:05:08.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.294 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.294 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:08.295 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.116923+0000", 2024-09-12T00:05:08.295 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3156000000000003e-05 2024-09-12T00:05:08.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.295 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.295 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:08.295 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.116941+0000", 2024-09-12T00:05:08.295 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8289000000000001e-05 2024-09-12T00:05:08.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.295 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.295 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:08.295 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.117071+0000", 2024-09-12T00:05:08.295 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000130006 2024-09-12T00:05:08.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:08.296 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.117315+0000", 2024-09-12T00:05:08.296 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024368600000000001 2024-09-12T00:05:08.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:08.296 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.117549+0000", 2024-09-12T00:05:08.296 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023425299999999999 2024-09-12T00:05:08.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:08.296 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.128076+0000", 2024-09-12T00:05:08.296 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010526604 2024-09-12T00:05:08.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.297 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.297 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:08.297 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.128993+0000", 2024-09-12T00:05:08.297 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00091696599999999996 2024-09-12T00:05:08.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.297 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.297 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:08.297 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.129072+0000", 2024-09-12T00:05:08.297 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9747999999999996e-05 2024-09-12T00:05:08.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.297 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.297 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:08.297 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.129141+0000", 2024-09-12T00:05:08.298 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9072999999999994e-05 2024-09-12T00:05:08.298 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.298 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:08.298 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.298 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.298 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2750 3.1 3:834b8715:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:08.298 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.123528+0000", 2024-09-12T00:05:08.298 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.080093495, 2024-09-12T00:05:08.298 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017652673000000001, 2024-09-12T00:05:08.298 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:08.298 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:08.298 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:08.299 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:08.299 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:08.299 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:08.299 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2750 2024-09-12T00:05:08.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.299 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:08.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:08.299 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.123528+0000", 2024-09-12T00:05:08.299 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:08.299 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.123528+0000", 2024-09-12T00:05:08.300 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.300 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.300 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:08.300 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.123531+0000", 2024-09-12T00:05:08.300 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9160000000000001e-06 2024-09-12T00:05:08.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.300 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.300 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:08.300 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.127554+0000", 2024-09-12T00:05:08.300 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040235210000000004 2024-09-12T00:05:08.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.300 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.301 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:08.301 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.127587+0000", 2024-09-12T00:05:08.301 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2777999999999997e-05 2024-09-12T00:05:08.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.301 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:08.301 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.127604+0000", 2024-09-12T00:05:08.301 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6492999999999999e-05 2024-09-12T00:05:08.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.301 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:08.301 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.127766+0000", 2024-09-12T00:05:08.301 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016200399999999999 2024-09-12T00:05:08.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.302 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:08.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.128157+0000", 2024-09-12T00:05:08.302 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039180399999999999 2024-09-12T00:05:08.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.302 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:08.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.128596+0000", 2024-09-12T00:05:08.302 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00043888999999999999 2024-09-12T00:05:08.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.302 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:08.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.139321+0000", 2024-09-12T00:05:08.302 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010724466 2024-09-12T00:05:08.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:08.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.140855+0000", 2024-09-12T00:05:08.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00153382 2024-09-12T00:05:08.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:08.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.141054+0000", 2024-09-12T00:05:08.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00019907799999999999 2024-09-12T00:05:08.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:08.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.141181+0000", 2024-09-12T00:05:08.304 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012690299999999999 2024-09-12T00:05:08.304 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.304 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:08.304 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.304 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.304 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2751 3.4 3:20d2ffb1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:08.304 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.134356+0000", 2024-09-12T00:05:08.304 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.069265923, 2024-09-12T00:05:08.304 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020400522000000001, 2024-09-12T00:05:08.304 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:08.304 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:08.304 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:08.305 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:08.305 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:08.305 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:08.305 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2751 2024-09-12T00:05:08.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.305 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:08.305 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.305 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:08.305 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.134356+0000", 2024-09-12T00:05:08.305 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.305 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.305 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:08.305 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.134356+0000", 2024-09-12T00:05:08.306 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.306 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:08.306 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.134359+0000", 2024-09-12T00:05:08.306 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9900000000000002e-06 2024-09-12T00:05:08.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.306 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:08.306 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138490+0000", 2024-09-12T00:05:08.306 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041315609999999997 2024-09-12T00:05:08.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.307 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:08.307 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138524+0000", 2024-09-12T00:05:08.307 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3868000000000002e-05 2024-09-12T00:05:08.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.307 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.307 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:08.307 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138544+0000", 2024-09-12T00:05:08.307 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9539e-05 2024-09-12T00:05:08.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.307 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.307 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:08.307 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138697+0000", 2024-09-12T00:05:08.307 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015332400000000001 2024-09-12T00:05:08.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.308 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.308 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:08.308 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138931+0000", 2024-09-12T00:05:08.308 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023418700000000001 2024-09-12T00:05:08.308 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.308 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.308 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:08.308 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.139162+0000", 2024-09-12T00:05:08.308 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000230943 2024-09-12T00:05:08.308 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.308 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.308 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:08.308 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.149454+0000", 2024-09-12T00:05:08.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010291560999999999 2024-09-12T00:05:08.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.309 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.309 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:08.309 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.153905+0000", 2024-09-12T00:05:08.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004451666 2024-09-12T00:05:08.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.309 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.309 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:08.309 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154405+0000", 2024-09-12T00:05:08.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00049978100000000003 2024-09-12T00:05:08.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.309 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.309 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:08.310 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154756+0000", 2024-09-12T00:05:08.310 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000351102 2024-09-12T00:05:08.310 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.310 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:08.310 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.310 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.310 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2753 3.7 e63/23 3:e119c99e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_238:head v 63'6, mlcod=63'4)", 2024-09-12T00:05:08.310 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.160435+0000", 2024-09-12T00:05:08.310 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.043186539000001, 2024-09-12T00:05:08.310 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016757787999999999, 2024-09-12T00:05:08.310 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:08.310 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:08.310 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:08.311 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:08.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.311 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:08.311 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.160435+0000", 2024-09-12T00:05:08.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.311 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:08.311 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.160435+0000", 2024-09-12T00:05:08.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.311 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:08.311 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.160437+0000", 2024-09-12T00:05:08.312 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1560000000000002e-06 2024-09-12T00:05:08.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:08.312 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.163440+0000", 2024-09-12T00:05:08.312 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0030024280000000001 2024-09-12T00:05:08.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:08.312 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.163467+0000", 2024-09-12T00:05:08.312 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7631e-05 2024-09-12T00:05:08.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:08.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.163482+0000", 2024-09-12T00:05:08.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5031999999999999e-05 2024-09-12T00:05:08.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.313 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:08.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.163601+0000", 2024-09-12T00:05:08.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011861700000000001 2024-09-12T00:05:08.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.313 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:08.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.163649+0000", 2024-09-12T00:05:08.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.799e-05 2024-09-12T00:05:08.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.314 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.314 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:08.314 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177079+0000", 2024-09-12T00:05:08.314 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013430291 2024-09-12T00:05:08.314 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.314 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.314 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:08.314 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177193+0000", 2024-09-12T00:05:08.314 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113643 2024-09-12T00:05:08.314 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.314 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:08.314 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.314 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.314 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.315 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2755 3.25 3:a666dbcf:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:08.315 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.181692+0000", 2024-09-12T00:05:08.315 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 20.021929507999999, 2024-09-12T00:05:08.315 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020464659, 2024-09-12T00:05:08.315 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:08.315 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:08.315 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:08.315 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:08.315 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:08.315 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:08.315 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2755 2024-09-12T00:05:08.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.315 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:08.315 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.316 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:08.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.181692+0000", 2024-09-12T00:05:08.316 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.316 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.316 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:08.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.181692+0000", 2024-09-12T00:05:08.316 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:08.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.316 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.316 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:08.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.181695+0000", 2024-09-12T00:05:08.316 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0800000000000002e-06 2024-09-12T00:05:08.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.317 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.317 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:08.317 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185668+0000", 2024-09-12T00:05:08.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039727970000000001 2024-09-12T00:05:08.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.317 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.317 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:08.317 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185699+0000", 2024-09-12T00:05:08.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1424999999999998e-05 2024-09-12T00:05:08.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.317 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.317 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:08.317 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185722+0000", 2024-09-12T00:05:08.318 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2972e-05 2024-09-12T00:05:08.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.318 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.318 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:08.318 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185860+0000", 2024-09-12T00:05:08.318 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000138016 2024-09-12T00:05:08.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.318 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.318 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:08.318 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.186096+0000", 2024-09-12T00:05:08.318 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023611899999999999 2024-09-12T00:05:08.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.318 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.318 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:08.319 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.186318+0000", 2024-09-12T00:05:08.319 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000221177 2024-09-12T00:05:08.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.319 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.319 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:08.319 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.199301+0000", 2024-09-12T00:05:08.319 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012983949999999999 2024-09-12T00:05:08.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.319 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.319 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:08.319 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.201991+0000", 2024-09-12T00:05:08.319 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026896889999999999 2024-09-12T00:05:08.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.319 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.320 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:08.320 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.202083+0000", 2024-09-12T00:05:08.320 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1598e-05 2024-09-12T00:05:08.320 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:08.320 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:08.320 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:08.320 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.202157+0000", 2024-09-12T00:05:08.320 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3836000000000003e-05 2024-09-12T00:05:08.320 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.320 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:08.320 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.320 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:08.320 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:08.321 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:08.321 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:08.322 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:08.323 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:08.323 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:08.323 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:05:08.324 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:08.321+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:08.324 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:08.324 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:08.324 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:08.325 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:08.325 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:08.325 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:08.333 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:08.334 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:08.355 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:08.375 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:08.375 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:08.433 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:08.436+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:08.500 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:08.501 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:08.514 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:05:08.558 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:08.557+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:08.624 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:08.621+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:08.636 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:08.636 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:08.650 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:05:08.725 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:08.724+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:08.824 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:08.824 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:08.825 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:08.821+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:08.838 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:05:08.926 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:08.928+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:08.958 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:08.958 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:08.972 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:05:09.028 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:09.029+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:09.131 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:09.129+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:09.539 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:09.539 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:09.540 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:05:09.540 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:09.537+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:09.640 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:09.637+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:09.664 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:09.665 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:09.678 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:05:09.711 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T00:05:09.741 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:09.741+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:09.802 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:09.802 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:09.816 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:05:09.861 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:09.864+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:09.931 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:09.931 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:09.944 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:05:09.944 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:09.944+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:10.044 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:10.044+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:10.084 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T00:05:10.115 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:10.116 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:10.129 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:05:10.173 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:10.176+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:10.246 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:10.245+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:10.287 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:10.288 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:10.301 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:05:10.347 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:10.348+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:10.392 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:05:10.422 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:10.422 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:10.436 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:05:10.447 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:10.445+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:10.545 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:10.545 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:10.548 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:10.548+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:10.562 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:10.562 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:10.579 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:10.580 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:10.594 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:10.594 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:05:10.594 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:05:10.594 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:05:10.594 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.594 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1641 3.26 3:658fe58e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2__shadow_.hDHTDpIswwqRA2bHiHVxkhWqZde6XEj_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:05:10.594 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:05:10.594 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 37.539279905000001, 2024-09-12T00:05:10.594 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017888905, 2024-09-12T00:05:10.594 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:10.595 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:10.595 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:10.595 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:10.595 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:10.595 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:10.595 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1641 2024-09-12T00:05:10.595 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.595 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:10.595 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.595 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:10.595 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:05:10.595 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.596 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.596 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.596 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:10.596 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056286+0000", 2024-09-12T00:05:10.596 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.596 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.596 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.596 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:10.596 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.056289+0000", 2024-09-12T00:05:10.596 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5349999999999999e-06 2024-09-12T00:05:10.596 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.597 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.597 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:10.597 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058595+0000", 2024-09-12T00:05:10.597 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002306083 2024-09-12T00:05:10.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.597 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.597 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:10.597 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058621+0000", 2024-09-12T00:05:10.597 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6431000000000002e-05 2024-09-12T00:05:10.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.597 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.597 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:10.598 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058631+0000", 2024-09-12T00:05:10.598 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0166000000000001e-05 2024-09-12T00:05:10.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.598 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.598 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:10.598 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058712+0000", 2024-09-12T00:05:10.598 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0122000000000003e-05 2024-09-12T00:05:10.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.598 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.598 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:10.598 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058821+0000", 2024-09-12T00:05:10.598 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010907400000000001 2024-09-12T00:05:10.599 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.599 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.599 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:10.599 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.058910+0000", 2024-09-12T00:05:10.599 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9523000000000003e-05 2024-09-12T00:05:10.599 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.599 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.599 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:10.599 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073881+0000", 2024-09-12T00:05:10.599 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014971224 2024-09-12T00:05:10.599 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.599 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.599 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:10.599 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074101+0000", 2024-09-12T00:05:10.600 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0002195 2024-09-12T00:05:10.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.600 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:10.600 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074133+0000", 2024-09-12T00:05:10.600 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2138000000000003e-05 2024-09-12T00:05:10.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.600 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:10.600 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.074175+0000", 2024-09-12T00:05:10.600 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2109e-05 2024-09-12T00:05:10.600 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.600 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:10.600 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.601 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1775 3.30 e58/23 3:0c2ae78d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_1:head v 58'1, mlcod=0'0)", 2024-09-12T00:05:10.601 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:05:10.601 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 36.593804945000002, 2024-09-12T00:05:10.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017585038000000001, 2024-09-12T00:05:10.601 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:10.601 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:10.601 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:10.601 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:10.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.601 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:10.601 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:05:10.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.602 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.602 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:10.602 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001761+0000", 2024-09-12T00:05:10.602 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.602 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.602 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:10.602 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001763+0000", 2024-09-12T00:05:10.602 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2730000000000001e-06 2024-09-12T00:05:10.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.602 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.602 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:10.602 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005217+0000", 2024-09-12T00:05:10.603 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0034533810000000002 2024-09-12T00:05:10.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.603 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.603 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:10.603 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005241+0000", 2024-09-12T00:05:10.603 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4403e-05 2024-09-12T00:05:10.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.603 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.603 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:10.603 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005253+0000", 2024-09-12T00:05:10.603 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2007e-05 2024-09-12T00:05:10.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.603 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.603 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:10.603 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005324+0000", 2024-09-12T00:05:10.604 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0765000000000004e-05 2024-09-12T00:05:10.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.604 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.604 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:10.604 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.005348+0000", 2024-09-12T00:05:10.604 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3762000000000001e-05 2024-09-12T00:05:10.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.604 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.604 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:10.604 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019291+0000", 2024-09-12T00:05:10.604 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013943707 2024-09-12T00:05:10.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.604 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.604 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:10.605 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019346+0000", 2024-09-12T00:05:10.605 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4740000000000001e-05 2024-09-12T00:05:10.605 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.605 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:10.605 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.605 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.605 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1780 3.16 3:69d8ee52:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:05:10.605 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:05:10.605 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 36.572196032999997, 2024-09-12T00:05:10.605 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016232362, 2024-09-12T00:05:10.605 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:10.605 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:10.605 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:10.606 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:10.606 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:10.606 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:10.606 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1780 2024-09-12T00:05:10.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.606 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:10.606 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.606 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:10.606 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:05:10.606 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.606 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.606 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:10.606 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023370+0000", 2024-09-12T00:05:10.607 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.607 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.607 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:10.607 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.023372+0000", 2024-09-12T00:05:10.607 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0209999999999998e-06 2024-09-12T00:05:10.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.607 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.607 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:10.607 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024447+0000", 2024-09-12T00:05:10.607 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0010749550000000001 2024-09-12T00:05:10.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.607 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.607 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:10.607 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024473+0000", 2024-09-12T00:05:10.608 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5689000000000001e-05 2024-09-12T00:05:10.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.608 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:10.608 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024484+0000", 2024-09-12T00:05:10.608 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1153e-05 2024-09-12T00:05:10.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.608 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:10.608 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024547+0000", 2024-09-12T00:05:10.608 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3400999999999998e-05 2024-09-12T00:05:10.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.609 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:10.609 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.024669+0000", 2024-09-12T00:05:10.609 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012184999999999999 2024-09-12T00:05:10.609 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.609 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.609 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:10.609 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025014+0000", 2024-09-12T00:05:10.609 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000344505 2024-09-12T00:05:10.609 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.609 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.609 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:10.609 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039161+0000", 2024-09-12T00:05:10.609 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014147799000000001 2024-09-12T00:05:10.609 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.610 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.610 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:10.610 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039434+0000", 2024-09-12T00:05:10.610 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00027254699999999999 2024-09-12T00:05:10.610 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.610 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.610 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:10.610 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039521+0000", 2024-09-12T00:05:10.610 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6663999999999996e-05 2024-09-12T00:05:10.610 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.610 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.610 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:10.610 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039602+0000", 2024-09-12T00:05:10.610 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1778000000000002e-05 2024-09-12T00:05:10.611 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.611 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:10.611 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.611 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.611 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1912 3.16 3:6a08f78f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.4__shadow_.EKM6BwfpK8ZqXIKQk7k4yJFkOWS2UlN_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:05:10.611 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:35.139256+0000", 2024-09-12T00:05:10.611 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 35.456310111999997, 2024-09-12T00:05:10.611 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01537029, 2024-09-12T00:05:10.611 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:10.611 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:10.611 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:10.611 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:10.611 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:10.612 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:10.612 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1912 2024-09-12T00:05:10.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.612 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:10.612 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.612 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:10.612 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.139256+0000", 2024-09-12T00:05:10.612 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.612 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.612 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:10.612 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.139256+0000", 2024-09-12T00:05:10.612 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.613 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.613 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:10.613 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.139258+0000", 2024-09-12T00:05:10.613 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3439999999999999e-06 2024-09-12T00:05:10.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.613 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.613 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:10.613 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141028+0000", 2024-09-12T00:05:10.613 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001770183 2024-09-12T00:05:10.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.614 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:10.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141054+0000", 2024-09-12T00:05:10.614 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5928e-05 2024-09-12T00:05:10.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.614 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:10.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141065+0000", 2024-09-12T00:05:10.614 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0589e-05 2024-09-12T00:05:10.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.614 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:10.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141145+0000", 2024-09-12T00:05:10.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0121000000000001e-05 2024-09-12T00:05:10.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:10.615 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141257+0000", 2024-09-12T00:05:10.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000111672 2024-09-12T00:05:10.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:10.615 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.141361+0000", 2024-09-12T00:05:10.616 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103705 2024-09-12T00:05:10.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.616 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:10.616 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.152422+0000", 2024-09-12T00:05:10.616 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011061586999999999 2024-09-12T00:05:10.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.616 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:10.616 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154552+0000", 2024-09-12T00:05:10.616 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021297120000000002 2024-09-12T00:05:10.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:10.617 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154590+0000", 2024-09-12T00:05:10.617 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7942999999999999e-05 2024-09-12T00:05:10.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.617 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:10.617 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:35.154626+0000", 2024-09-12T00:05:10.617 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6505999999999999e-05 2024-09-12T00:05:10.617 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.617 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:10.617 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.618 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2650 3.5 3:a19f3a83:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:10.618 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.189998+0000", 2024-09-12T00:05:10.618 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.405568136999999, 2024-09-12T00:05:10.618 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016025257000000001, 2024-09-12T00:05:10.618 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:10.618 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:10.618 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:10.618 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:10.618 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:10.618 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:10.618 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2650 2024-09-12T00:05:10.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.618 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:10.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:10.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.189998+0000", 2024-09-12T00:05:10.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:10.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.189998+0000", 2024-09-12T00:05:10.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:10.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.190001+0000", 2024-09-12T00:05:10.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5830000000000001e-06 2024-09-12T00:05:10.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:10.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191320+0000", 2024-09-12T00:05:10.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0013192449999999999 2024-09-12T00:05:10.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:10.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191341+0000", 2024-09-12T00:05:10.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1690000000000001e-05 2024-09-12T00:05:10.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:10.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191355+0000", 2024-09-12T00:05:10.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3147e-05 2024-09-12T00:05:10.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.621 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:10.621 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191444+0000", 2024-09-12T00:05:10.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9809999999999996e-05 2024-09-12T00:05:10.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.621 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:10.621 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191623+0000", 2024-09-12T00:05:10.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017869399999999999 2024-09-12T00:05:10.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.621 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:10.622 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.191786+0000", 2024-09-12T00:05:10.622 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000163203 2024-09-12T00:05:10.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.622 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.622 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:10.622 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.198758+0000", 2024-09-12T00:05:10.622 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069714440000000003 2024-09-12T00:05:10.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.622 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.622 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:10.622 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.205895+0000", 2024-09-12T00:05:10.622 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.007137404 2024-09-12T00:05:10.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.622 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.623 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:10.623 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.205966+0000", 2024-09-12T00:05:10.623 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0797999999999995e-05 2024-09-12T00:05:10.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.623 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.623 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:10.623 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.206023+0000", 2024-09-12T00:05:10.623 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7238999999999999e-05 2024-09-12T00:05:10.623 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.623 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:10.623 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.623 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.624 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2655 3.5 3:a26caaa1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:10.624 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.241675+0000", 2024-09-12T00:05:10.624 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.353890875000001, 2024-09-12T00:05:10.624 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018338047999999999, 2024-09-12T00:05:10.624 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:10.624 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:10.624 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:10.624 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:10.624 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:10.624 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:10.624 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2655 2024-09-12T00:05:10.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.624 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:10.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:10.625 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.241675+0000", 2024-09-12T00:05:10.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:10.625 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.241675+0000", 2024-09-12T00:05:10.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:10.625 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.241678+0000", 2024-09-12T00:05:10.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4430000000000002e-06 2024-09-12T00:05:10.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:10.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243471+0000", 2024-09-12T00:05:10.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017937369999999999 2024-09-12T00:05:10.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:10.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243493+0000", 2024-09-12T00:05:10.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2001000000000002e-05 2024-09-12T00:05:10.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:10.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243505+0000", 2024-09-12T00:05:10.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1632e-05 2024-09-12T00:05:10.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:10.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243579+0000", 2024-09-12T00:05:10.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4165999999999994e-05 2024-09-12T00:05:10.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:10.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243766+0000", 2024-09-12T00:05:10.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018714599999999999 2024-09-12T00:05:10.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:10.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.243937+0000", 2024-09-12T00:05:10.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017038700000000001 2024-09-12T00:05:10.628 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.628 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.628 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:10.628 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.250274+0000", 2024-09-12T00:05:10.628 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063369070000000001 2024-09-12T00:05:10.628 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.628 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.628 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:10.628 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.259911+0000", 2024-09-12T00:05:10.628 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0096378669999999996 2024-09-12T00:05:10.628 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.628 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.628 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:10.628 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.259960+0000", 2024-09-12T00:05:10.629 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8763000000000001e-05 2024-09-12T00:05:10.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.629 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.629 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:10.629 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.260013+0000", 2024-09-12T00:05:10.629 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2998999999999999e-05 2024-09-12T00:05:10.629 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.629 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:10.629 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.629 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.629 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2657 3.3c 3:3e583291:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:10.629 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.263916+0000", 2024-09-12T00:05:10.629 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.331650184000001, 2024-09-12T00:05:10.630 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020609368999999999, 2024-09-12T00:05:10.630 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:10.630 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:10.630 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:10.630 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:10.630 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:10.630 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:10.630 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2657 2024-09-12T00:05:10.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.630 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:10.630 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.630 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:10.630 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.263916+0000", 2024-09-12T00:05:10.630 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:10.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.263916+0000", 2024-09-12T00:05:10.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:10.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.263919+0000", 2024-09-12T00:05:10.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.92e-06 2024-09-12T00:05:10.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:10.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266277+0000", 2024-09-12T00:05:10.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023579310000000002 2024-09-12T00:05:10.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:10.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266302+0000", 2024-09-12T00:05:10.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4807000000000002e-05 2024-09-12T00:05:10.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:10.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266317+0000", 2024-09-12T00:05:10.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5209e-05 2024-09-12T00:05:10.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:10.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266414+0000", 2024-09-12T00:05:10.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7658000000000006e-05 2024-09-12T00:05:10.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:10.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266556+0000", 2024-09-12T00:05:10.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014166100000000001 2024-09-12T00:05:10.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:10.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.266680+0000", 2024-09-12T00:05:10.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012421099999999999 2024-09-12T00:05:10.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.634 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:10.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275396+0000", 2024-09-12T00:05:10.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0087156609999999995 2024-09-12T00:05:10.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.634 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:10.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.284426+0000", 2024-09-12T00:05:10.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0090300039999999995 2024-09-12T00:05:10.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.634 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:10.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.284472+0000", 2024-09-12T00:05:10.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6273000000000002e-05 2024-09-12T00:05:10.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.635 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:10.635 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.284525+0000", 2024-09-12T00:05:10.635 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3034000000000001e-05 2024-09-12T00:05:10.635 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.635 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:10.635 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.635 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2658 3.3a 3:5ec14981:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:10.635 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.274153+0000", 2024-09-12T00:05:10.635 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.321412742, 2024-09-12T00:05:10.635 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017963626, 2024-09-12T00:05:10.635 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:10.636 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:10.636 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:10.636 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:10.636 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:10.636 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:10.636 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2658 2024-09-12T00:05:10.636 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.636 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:10.636 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.636 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:10.636 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.274153+0000", 2024-09-12T00:05:10.636 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.636 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.636 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.637 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:10.637 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.274153+0000", 2024-09-12T00:05:10.637 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.637 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.637 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:10.637 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.274156+0000", 2024-09-12T00:05:10.637 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5299999999999999e-06 2024-09-12T00:05:10.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.637 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.637 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:10.637 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275746+0000", 2024-09-12T00:05:10.637 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001589741 2024-09-12T00:05:10.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.638 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:10.638 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275770+0000", 2024-09-12T00:05:10.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4539999999999999e-05 2024-09-12T00:05:10.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.638 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:10.638 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275785+0000", 2024-09-12T00:05:10.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4783000000000001e-05 2024-09-12T00:05:10.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.638 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:10.638 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275867+0000", 2024-09-12T00:05:10.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2362999999999997e-05 2024-09-12T00:05:10.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:10.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.275990+0000", 2024-09-12T00:05:10.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012287100000000001 2024-09-12T00:05:10.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:10.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.276085+0000", 2024-09-12T00:05:10.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5172000000000003e-05 2024-09-12T00:05:10.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:10.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.282993+0000", 2024-09-12T00:05:10.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0069076210000000001 2024-09-12T00:05:10.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:10.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.291976+0000", 2024-09-12T00:05:10.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0089835269999999998 2024-09-12T00:05:10.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:10.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.292054+0000", 2024-09-12T00:05:10.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7804000000000002e-05 2024-09-12T00:05:10.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:10.641 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.292117+0000", 2024-09-12T00:05:10.641 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2674000000000003e-05 2024-09-12T00:05:10.641 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.641 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:10.641 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.641 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.641 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.641 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2661 3.1e e63/23 3:7a671bd1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_156:head v 63'3, mlcod=62'1)", 2024-09-12T00:05:10.641 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.312780+0000", 2024-09-12T00:05:10.641 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.282786113, 2024-09-12T00:05:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015038723, 2024-09-12T00:05:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.312780+0000", 2024-09-12T00:05:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.312780+0000", 2024-09-12T00:05:10.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.312783+0000", 2024-09-12T00:05:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.756e-06 2024-09-12T00:05:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317423+0000", 2024-09-12T00:05:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004640323 2024-09-12T00:05:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:10.643 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317453+0000", 2024-09-12T00:05:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0301e-05 2024-09-12T00:05:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317468+0000", 2024-09-12T00:05:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4989e-05 2024-09-12T00:05:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317551+0000", 2024-09-12T00:05:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2712000000000004e-05 2024-09-12T00:05:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.644 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317578+0000", 2024-09-12T00:05:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7161999999999998e-05 2024-09-12T00:05:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.327765+0000", 2024-09-12T00:05:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010187229000000001 2024-09-12T00:05:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.327819+0000", 2024-09-12T00:05:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3251000000000002e-05 2024-09-12T00:05:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2675 3.20 3:0529bfef:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.454008+0000", 2024-09-12T00:05:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.141557856999999, 2024-09-12T00:05:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017972776999999999, 2024-09-12T00:05:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2675 2024-09-12T00:05:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.454008+0000", 2024-09-12T00:05:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.454008+0000", 2024-09-12T00:05:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.454011+0000", 2024-09-12T00:05:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1379999999999999e-06 2024-09-12T00:05:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455547+0000", 2024-09-12T00:05:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001535919 2024-09-12T00:05:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455580+0000", 2024-09-12T00:05:10.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2789000000000001e-05 2024-09-12T00:05:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455591+0000", 2024-09-12T00:05:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0531e-05 2024-09-12T00:05:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455670+0000", 2024-09-12T00:05:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9822999999999998e-05 2024-09-12T00:05:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:10.649 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.455863+0000", 2024-09-12T00:05:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019248799999999999 2024-09-12T00:05:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.456021+0000", 2024-09-12T00:05:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000157627 2024-09-12T00:05:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.462847+0000", 2024-09-12T00:05:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0068268230000000001 2024-09-12T00:05:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.471901+0000", 2024-09-12T00:05:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0090533820000000004 2024-09-12T00:05:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.471939+0000", 2024-09-12T00:05:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8334999999999998e-05 2024-09-12T00:05:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.471981+0000", 2024-09-12T00:05:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1922000000000003e-05 2024-09-12T00:05:10.651 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2693 3.1e e63/23 3:7a8f9e2c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_178:head v 63'4, mlcod=63'2)", 2024-09-12T00:05:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.541097+0000", 2024-09-12T00:05:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.054469144999999, 2024-09-12T00:05:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013470268000000001, 2024-09-12T00:05:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:10.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.541097+0000", 2024-09-12T00:05:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.541097+0000", 2024-09-12T00:05:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.541098+0000", 2024-09-12T00:05:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.454e-06 2024-09-12T00:05:10.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545193+0000", 2024-09-12T00:05:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040943899999999998 2024-09-12T00:05:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545221+0000", 2024-09-12T00:05:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8595e-05 2024-09-12T00:05:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545235+0000", 2024-09-12T00:05:10.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3329999999999999e-05 2024-09-12T00:05:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545320+0000", 2024-09-12T00:05:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5371000000000006e-05 2024-09-12T00:05:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.545348+0000", 2024-09-12T00:05:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7532e-05 2024-09-12T00:05:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.655 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.554493+0000", 2024-09-12T00:05:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091452400000000007 2024-09-12T00:05:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.554567+0000", 2024-09-12T00:05:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4356000000000004e-05 2024-09-12T00:05:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2696 3.2b e63/23 3:d7c776f8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_181:head v 63'8, mlcod=63'6)", 2024-09-12T00:05:10.656 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.572942+0000", 2024-09-12T00:05:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.022623607, 2024-09-12T00:05:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016050795999999999, 2024-09-12T00:05:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.572942+0000", 2024-09-12T00:05:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:10.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.572942+0000", 2024-09-12T00:05:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.572945+0000", 2024-09-12T00:05:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1730000000000002e-06 2024-09-12T00:05:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577465+0000", 2024-09-12T00:05:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045199649999999999 2024-09-12T00:05:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:10.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577495+0000", 2024-09-12T00:05:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0473000000000001e-05 2024-09-12T00:05:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577512+0000", 2024-09-12T00:05:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7215999999999999e-05 2024-09-12T00:05:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577616+0000", 2024-09-12T00:05:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103304 2024-09-12T00:05:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577649+0000", 2024-09-12T00:05:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3695999999999997e-05 2024-09-12T00:05:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.588945+0000", 2024-09-12T00:05:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011295556 2024-09-12T00:05:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.588993+0000", 2024-09-12T00:05:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8412999999999999e-05 2024-09-12T00:05:10.660 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2702 3.3c 3:3d6a0b3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.626588+0000", 2024-09-12T00:05:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 22.968977913, 2024-09-12T00:05:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018349791000000001, 2024-09-12T00:05:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:10.661 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2702 2024-09-12T00:05:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.626588+0000", 2024-09-12T00:05:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.626588+0000", 2024-09-12T00:05:10.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.626591+0000", 2024-09-12T00:05:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0469999999999998e-06 2024-09-12T00:05:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.627983+0000", 2024-09-12T00:05:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001391541 2024-09-12T00:05:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628016+0000", 2024-09-12T00:05:10.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3556999999999997e-05 2024-09-12T00:05:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628035+0000", 2024-09-12T00:05:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9162999999999999e-05 2024-09-12T00:05:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628108+0000", 2024-09-12T00:05:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2336999999999995e-05 2024-09-12T00:05:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628237+0000", 2024-09-12T00:05:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000128706 2024-09-12T00:05:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.628329+0000", 2024-09-12T00:05:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2761000000000002e-05 2024-09-12T00:05:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.632309+0000", 2024-09-12T00:05:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003979692 2024-09-12T00:05:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.644845+0000", 2024-09-12T00:05:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012536112 2024-09-12T00:05:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.644898+0000", 2024-09-12T00:05:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.329e-05 2024-09-12T00:05:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.644938+0000", 2024-09-12T00:05:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9585000000000001e-05 2024-09-12T00:05:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.666 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2716 3.20 3:042f7231:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.766936+0000", 2024-09-12T00:05:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 22.82862978, 2024-09-12T00:05:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025751422999999999, 2024-09-12T00:05:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2716 2024-09-12T00:05:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766936+0000", 2024-09-12T00:05:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766936+0000", 2024-09-12T00:05:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.668 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766939+0000", 2024-09-12T00:05:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8499999999999998e-06 2024-09-12T00:05:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769471+0000", 2024-09-12T00:05:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025320780000000001 2024-09-12T00:05:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769506+0000", 2024-09-12T00:05:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4842999999999998e-05 2024-09-12T00:05:10.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769522+0000", 2024-09-12T00:05:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5548000000000001e-05 2024-09-12T00:05:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769602+0000", 2024-09-12T00:05:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0291999999999996e-05 2024-09-12T00:05:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769726+0000", 2024-09-12T00:05:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012447900000000001 2024-09-12T00:05:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.769833+0000", 2024-09-12T00:05:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010621899999999999 2024-09-12T00:05:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.775790+0000", 2024-09-12T00:05:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0059571529999999998 2024-09-12T00:05:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.792589+0000", 2024-09-12T00:05:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016799445 2024-09-12T00:05:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.671 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.792634+0000", 2024-09-12T00:05:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4543999999999999e-05 2024-09-12T00:05:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.792688+0000", 2024-09-12T00:05:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3971999999999998e-05 2024-09-12T00:05:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.672 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2719 3.1 e63/23 3:83b62cc7:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_204:head v 63'9, mlcod=63'7)", 2024-09-12T00:05:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.801392+0000", 2024-09-12T00:05:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 22.794174083000001, 2024-09-12T00:05:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014562542, 2024-09-12T00:05:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.801392+0000", 2024-09-12T00:05:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.673 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.801392+0000", 2024-09-12T00:05:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.801394+0000", 2024-09-12T00:05:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0090000000000002e-06 2024-09-12T00:05:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807832+0000", 2024-09-12T00:05:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064375989999999996 2024-09-12T00:05:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:10.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807863+0000", 2024-09-12T00:05:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1114000000000001e-05 2024-09-12T00:05:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807877+0000", 2024-09-12T00:05:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4386000000000001e-05 2024-09-12T00:05:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807948+0000", 2024-09-12T00:05:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1055000000000003e-05 2024-09-12T00:05:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:10.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.807965+0000", 2024-09-12T00:05:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7025999999999999e-05 2024-09-12T00:05:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.815469+0000", 2024-09-12T00:05:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075039979999999996 2024-09-12T00:05:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.815955+0000", 2024-09-12T00:05:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00048535499999999998 2024-09-12T00:05:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.676 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2739 3.3a 3:5e74d49c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_224:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.006819+0000", 2024-09-12T00:05:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 22.588747223999999, 2024-09-12T00:05:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018768888000000001, 2024-09-12T00:05:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:10.677 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2739 2024-09-12T00:05:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.006819+0000", 2024-09-12T00:05:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.006819+0000", 2024-09-12T00:05:10.678 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.006821+0000", 2024-09-12T00:05:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5959999999999998e-06 2024-09-12T00:05:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008558+0000", 2024-09-12T00:05:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017366840000000001 2024-09-12T00:05:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008585+0000", 2024-09-12T00:05:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7129000000000001e-05 2024-09-12T00:05:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008599+0000", 2024-09-12T00:05:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.326e-05 2024-09-12T00:05:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008679+0000", 2024-09-12T00:05:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0174999999999997e-05 2024-09-12T00:05:10.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008800+0000", 2024-09-12T00:05:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012106499999999999 2024-09-12T00:05:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.008921+0000", 2024-09-12T00:05:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012163900000000001 2024-09-12T00:05:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.015366+0000", 2024-09-12T00:05:10.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064442309999999999 2024-09-12T00:05:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.025511+0000", 2024-09-12T00:05:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010145636 2024-09-12T00:05:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.025555+0000", 2024-09-12T00:05:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3426000000000001e-05 2024-09-12T00:05:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.025588+0000", 2024-09-12T00:05:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3046999999999997e-05 2024-09-12T00:05:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2743 3.16 3:696a1d44:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.046229+0000", 2024-09-12T00:05:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 22.549337149999999, 2024-09-12T00:05:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015475686000000001, 2024-09-12T00:05:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2743 2024-09-12T00:05:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.046229+0000", 2024-09-12T00:05:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.046229+0000", 2024-09-12T00:05:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.046232+0000", 2024-09-12T00:05:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.802e-06 2024-09-12T00:05:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047565+0000", 2024-09-12T00:05:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0013334670000000001 2024-09-12T00:05:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047600+0000", 2024-09-12T00:05:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4431000000000003e-05 2024-09-12T00:05:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047616+0000", 2024-09-12T00:05:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5928999999999999e-05 2024-09-12T00:05:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.686 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047703+0000", 2024-09-12T00:05:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7557000000000002e-05 2024-09-12T00:05:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047863+0000", 2024-09-12T00:05:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015991700000000001 2024-09-12T00:05:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.047993+0000", 2024-09-12T00:05:10.687 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000129591 2024-09-12T00:05:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.058764+0000", 2024-09-12T00:05:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010770956 2024-09-12T00:05:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.061632+0000", 2024-09-12T00:05:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0028681639999999999 2024-09-12T00:05:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:10.688 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.061675+0000", 2024-09-12T00:05:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3288999999999998e-05 2024-09-12T00:05:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.061705+0000", 2024-09-12T00:05:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9583000000000001e-05 2024-09-12T00:05:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2744 3.20 3:0785dd58:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.057454+0000", 2024-09-12T00:05:10.689 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 22.538112096999999, 2024-09-12T00:05:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018728709, 2024-09-12T00:05:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2744 2024-09-12T00:05:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.057454+0000", 2024-09-12T00:05:10.690 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.057454+0000", 2024-09-12T00:05:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.057457+0000", 2024-09-12T00:05:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6680000000000001e-06 2024-09-12T00:05:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.691 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059191+0000", 2024-09-12T00:05:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001734766 2024-09-12T00:05:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059216+0000", 2024-09-12T00:05:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4933e-05 2024-09-12T00:05:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059230+0000", 2024-09-12T00:05:10.692 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3737000000000001e-05 2024-09-12T00:05:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059310+0000", 2024-09-12T00:05:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0086999999999994e-05 2024-09-12T00:05:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059415+0000", 2024-09-12T00:05:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010509 2024-09-12T00:05:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.693 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.059521+0000", 2024-09-12T00:05:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105454 2024-09-12T00:05:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.066050+0000", 2024-09-12T00:05:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0065290620000000004 2024-09-12T00:05:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.076044+0000", 2024-09-12T00:05:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0099942539999999993 2024-09-12T00:05:10.694 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.076123+0000", 2024-09-12T00:05:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8980000000000006e-05 2024-09-12T00:05:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.076183+0000", 2024-09-12T00:05:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9678e-05 2024-09-12T00:05:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.695 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2752 3.5 3:a07c0cce:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.145032+0000", 2024-09-12T00:05:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 22.450534453, 2024-09-12T00:05:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017073703999999999, 2024-09-12T00:05:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2752 2024-09-12T00:05:10.696 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.145032+0000", 2024-09-12T00:05:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.145032+0000", 2024-09-12T00:05:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.697 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.145035+0000", 2024-09-12T00:05:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1810000000000001e-06 2024-09-12T00:05:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.146817+0000", 2024-09-12T00:05:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017823439999999999 2024-09-12T00:05:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.146860+0000", 2024-09-12T00:05:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2549999999999997e-05 2024-09-12T00:05:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.698 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.146880+0000", 2024-09-12T00:05:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9947000000000001e-05 2024-09-12T00:05:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.146984+0000", 2024-09-12T00:05:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104503 2024-09-12T00:05:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:10.699 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.147170+0000", 2024-09-12T00:05:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018568100000000001 2024-09-12T00:05:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.147326+0000", 2024-09-12T00:05:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000155993 2024-09-12T00:05:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.154513+0000", 2024-09-12T00:05:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071872910000000002 2024-09-12T00:05:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.162030+0000", 2024-09-12T00:05:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075170030000000004 2024-09-12T00:05:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.162071+0000", 2024-09-12T00:05:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0834999999999998e-05 2024-09-12T00:05:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.162105+0000", 2024-09-12T00:05:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4375999999999997e-05 2024-09-12T00:05:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2760 3.5 3:a26ca13d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_245:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.273495+0000", 2024-09-12T00:05:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 22.322070575000001, 2024-09-12T00:05:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014619127000000001, 2024-09-12T00:05:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2760 2024-09-12T00:05:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.273495+0000", 2024-09-12T00:05:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.273495+0000", 2024-09-12T00:05:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.273499+0000", 2024-09-12T00:05:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3100000000000001e-06 2024-09-12T00:05:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275445+0000", 2024-09-12T00:05:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001946454 2024-09-12T00:05:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275468+0000", 2024-09-12T00:05:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2768999999999998e-05 2024-09-12T00:05:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275481+0000", 2024-09-12T00:05:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3302000000000001e-05 2024-09-12T00:05:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275549+0000", 2024-09-12T00:05:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7220999999999999e-05 2024-09-12T00:05:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275676+0000", 2024-09-12T00:05:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012752 2024-09-12T00:05:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.275766+0000", 2024-09-12T00:05:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9577e-05 2024-09-12T00:05:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.281827+0000", 2024-09-12T00:05:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0060609970000000003 2024-09-12T00:05:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.287996+0000", 2024-09-12T00:05:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061689359999999999 2024-09-12T00:05:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.288061+0000", 2024-09-12T00:05:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5519999999999996e-05 2024-09-12T00:05:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.288115+0000", 2024-09-12T00:05:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3520999999999998e-05 2024-09-12T00:05:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:10.711 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:10.712 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:10.712 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:10.713 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:05:10.713 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:10.713 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:10.714 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:10.714 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:10.714 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:10.715 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:10.715 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:10.716 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:10.716 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:10.712+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:10.813 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:10.812+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:10.879 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:10.879 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:10.879 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:05:10.879 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:10.894 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:05:10.913 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:10.913+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:11.015 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:11.013+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:11.051 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:11.051 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:11.051 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:05:11.051 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:05:11.051 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:11.064 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:05:11.116 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:11.113+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:11.184 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:11.184 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:05:11.184 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:05:11.184 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:05:11.185 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.185 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4232.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-12T00:05:11.185 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:05:11.185 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 114.63651959000001, 2024-09-12T00:05:11.185 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.049385680000000001, 2024-09-12T00:05:11.185 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:11.185 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:11.185 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.185 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:11.185 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4232", 2024-09-12T00:05:11.185 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/3037249369", 2024-09-12T00:05:11.185 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:05:11.185 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.185 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:11.186 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.186 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:11.186 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:05:11.186 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.186 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.186 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:11.186 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:05:11.186 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.186 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.186 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:11.186 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548454+0000", 2024-09-12T00:05:11.186 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2259999999999999e-06 2024-09-12T00:05:11.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.187 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.187 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:11.187 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548466+0000", 2024-09-12T00:05:11.187 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1361e-05 2024-09-12T00:05:11.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.187 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.187 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:11.187 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548492+0000", 2024-09-12T00:05:11.187 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6225999999999999e-05 2024-09-12T00:05:11.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.187 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.187 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.188 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548509+0000", 2024-09-12T00:05:11.188 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7452000000000002e-05 2024-09-12T00:05:11.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.188 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.188 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549371+0000", 2024-09-12T00:05:11.188 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00086204300000000005 2024-09-12T00:05:11.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.188 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:05:11.188 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549396+0000", 2024-09-12T00:05:11.188 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.51e-05 2024-09-12T00:05:11.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.189 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.189 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593253+0000", 2024-09-12T00:05:11.189 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.043856248 2024-09-12T00:05:11.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.189 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.189 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:11.189 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593517+0000", 2024-09-12T00:05:11.189 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026439299999999997 2024-09-12T00:05:11.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.189 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.189 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:11.189 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594046+0000", 2024-09-12T00:05:11.189 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00052854200000000001 2024-09-12T00:05:11.190 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.190 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.190 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.190 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597642+0000", 2024-09-12T00:05:11.190 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0035959070000000002 2024-09-12T00:05:11.190 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.190 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.190 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:11.190 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597670+0000", 2024-09-12T00:05:11.190 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8235999999999999e-05 2024-09-12T00:05:11.190 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.190 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.190 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:11.190 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597754+0000", 2024-09-12T00:05:11.190 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4009000000000002e-05 2024-09-12T00:05:11.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.191 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.191 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:11.191 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597833+0000", 2024-09-12T00:05:11.191 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8937000000000007e-05 2024-09-12T00:05:11.191 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.191 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:11.191 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.191 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.191 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T00:05:11.191 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:05:11.191 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 101.855309822, 2024-09-12T00:05:11.191 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025928692999999999, 2024-09-12T00:05:11.191 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:11.192 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:11.192 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "reached pg", 2024-09-12T00:05:11.192 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:11.192 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:11.192 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.192 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 43 2024-09-12T00:05:11.192 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.192 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:11.192 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.192 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:11.192 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:05:11.192 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.192 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.192 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.192 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:11.193 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:05:11.193 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.193 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.193 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:11.193 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329660+0000", 2024-09-12T00:05:11.193 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.965e-06 2024-09-12T00:05:11.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.193 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.193 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:11.193 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329673+0000", 2024-09-12T00:05:11.193 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3402e-05 2024-09-12T00:05:11.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.194 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.194 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:11.194 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329706+0000", 2024-09-12T00:05:11.194 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2441000000000003e-05 2024-09-12T00:05:11.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.194 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.194 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.194 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329723+0000", 2024-09-12T00:05:11.194 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7609e-05 2024-09-12T00:05:11.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.194 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.194 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.194 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330437+0000", 2024-09-12T00:05:11.194 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00071403500000000002 2024-09-12T00:05:11.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.195 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.195 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:05:11.195 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330454+0000", 2024-09-12T00:05:11.195 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6820000000000002e-05 2024-09-12T00:05:11.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.195 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.195 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.195 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347344+0000", 2024-09-12T00:05:11.195 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016890275 2024-09-12T00:05:11.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.195 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.195 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:05:11.195 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347365+0000", 2024-09-12T00:05:11.195 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0350999999999999e-05 2024-09-12T00:05:11.196 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.196 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.196 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.196 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355323+0000", 2024-09-12T00:05:11.196 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079579400000000002 2024-09-12T00:05:11.196 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.196 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.196 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:11.196 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355585+0000", 2024-09-12T00:05:11.196 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026285499999999999 2024-09-12T00:05:11.196 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.196 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:11.196 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.196 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.197 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.197 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1641 3.26 e58/23 3:658fe58e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2__shadow_.hDHTDpIswwqRA2bHiHVxkhWqZde6XEj_1:head v 58'1, mlcod=0'0)", 2024-09-12T00:05:11.197 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:05:11.197 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 38.125951319000002, 2024-09-12T00:05:11.197 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014950144, 2024-09-12T00:05:11.197 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:11.197 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:11.197 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.197 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:11.197 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.197 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:11.197 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:05:11.197 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.197 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.198 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.198 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:11.198 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:05:11.198 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.198 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.198 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.198 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:11.198 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059017+0000", 2024-09-12T00:05:11.198 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.508e-06 2024-09-12T00:05:11.198 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.198 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.198 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:11.198 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061582+0000", 2024-09-12T00:05:11.198 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025654010000000001 2024-09-12T00:05:11.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.199 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.199 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:11.199 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061607+0000", 2024-09-12T00:05:11.199 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5028000000000002e-05 2024-09-12T00:05:11.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.199 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.199 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.199 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061619+0000", 2024-09-12T00:05:11.199 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1905999999999999e-05 2024-09-12T00:05:11.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.199 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.200 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.200 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061696+0000", 2024-09-12T00:05:11.200 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7305999999999995e-05 2024-09-12T00:05:11.200 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.200 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.200 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:11.200 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061717+0000", 2024-09-12T00:05:11.200 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0380000000000001e-05 2024-09-12T00:05:11.200 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.200 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.200 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:11.200 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073925+0000", 2024-09-12T00:05:11.200 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012208088000000001 2024-09-12T00:05:11.201 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.201 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.201 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:11.201 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073965+0000", 2024-09-12T00:05:11.201 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0527e-05 2024-09-12T00:05:11.201 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.201 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:11.201 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.201 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.201 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.201 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1775 3.30 3:0c2ae78d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:05:11.201 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:05:11.201 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 37.186114001, 2024-09-12T00:05:11.201 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020783729000000001, 2024-09-12T00:05:11.202 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:11.202 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:11.202 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.202 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:11.202 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:11.202 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.202 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1775 2024-09-12T00:05:11.202 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.202 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:11.202 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.202 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:11.202 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:05:11.202 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.202 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.203 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.203 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:11.203 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:05:11.203 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.203 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.203 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.203 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:11.203 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998856+0000", 2024-09-12T00:05:11.203 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6849999999999999e-06 2024-09-12T00:05:11.203 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.203 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.203 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:11.203 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001327+0000", 2024-09-12T00:05:11.204 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024706279999999999 2024-09-12T00:05:11.204 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.204 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.204 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:11.204 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001355+0000", 2024-09-12T00:05:11.204 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8419999999999999e-05 2024-09-12T00:05:11.204 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.204 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.204 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.204 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001366+0000", 2024-09-12T00:05:11.204 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1073999999999999e-05 2024-09-12T00:05:11.204 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.204 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.204 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.205 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001438+0000", 2024-09-12T00:05:11.205 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1389000000000004e-05 2024-09-12T00:05:11.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.205 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.205 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:11.205 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001548+0000", 2024-09-12T00:05:11.205 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110612 2024-09-12T00:05:11.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.205 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.205 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:11.205 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001639+0000", 2024-09-12T00:05:11.205 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0192999999999995e-05 2024-09-12T00:05:11.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.205 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.206 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:11.206 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019057+0000", 2024-09-12T00:05:11.206 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017418411000000002 2024-09-12T00:05:11.206 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.206 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.206 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.206 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019528+0000", 2024-09-12T00:05:11.206 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00047075699999999998 2024-09-12T00:05:11.206 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.206 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.206 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:11.206 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019577+0000", 2024-09-12T00:05:11.206 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8714999999999997e-05 2024-09-12T00:05:11.206 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.207 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.207 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:11.207 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019636+0000", 2024-09-12T00:05:11.207 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9845e-05 2024-09-12T00:05:11.207 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.207 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:11.207 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.207 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.207 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.207 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1780 3.16 e58/23 3:69d8ee52:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3_10Mb.:head v 58'1, mlcod=0'0)", 2024-09-12T00:05:11.207 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:05:11.207 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 37.159820709000002, 2024-09-12T00:05:11.207 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01408911, 2024-09-12T00:05:11.208 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:11.208 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:11.208 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.208 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:11.208 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.208 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:11.208 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:05:11.208 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.208 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.208 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.208 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:11.208 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:05:11.208 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.208 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.209 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.209 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:11.209 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025148+0000", 2024-09-12T00:05:11.209 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4229999999999999e-06 2024-09-12T00:05:11.209 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.209 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.209 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:11.209 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026337+0000", 2024-09-12T00:05:11.209 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011890589999999999 2024-09-12T00:05:11.209 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.209 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.209 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:11.209 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026362+0000", 2024-09-12T00:05:11.209 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4566000000000002e-05 2024-09-12T00:05:11.210 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.210 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.210 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.210 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026372+0000", 2024-09-12T00:05:11.210 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8509999999999994e-06 2024-09-12T00:05:11.210 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.210 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.210 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.210 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026448+0000", 2024-09-12T00:05:11.210 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6626999999999997e-05 2024-09-12T00:05:11.211 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.211 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.211 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:11.211 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026473+0000", 2024-09-12T00:05:11.211 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4647e-05 2024-09-12T00:05:11.211 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.211 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.211 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:11.211 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039120+0000", 2024-09-12T00:05:11.211 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012647122 2024-09-12T00:05:11.211 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.211 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.211 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:11.211 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039235+0000", 2024-09-12T00:05:11.212 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000114815 2024-09-12T00:05:11.212 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.212 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:11.212 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.212 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.212 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.212 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2648 3.13 3:c936a360:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.212 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.164782+0000", 2024-09-12T00:05:11.212 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 24.020184422, 2024-09-12T00:05:11.212 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019628063000000001, 2024-09-12T00:05:11.212 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:11.212 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:11.212 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.213 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:11.213 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:11.213 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.213 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2648 2024-09-12T00:05:11.213 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.213 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:11.213 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.213 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:11.213 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.164782+0000", 2024-09-12T00:05:11.213 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.213 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.213 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.213 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:11.213 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.164782+0000", 2024-09-12T00:05:11.214 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.214 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.214 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:11.214 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.164786+0000", 2024-09-12T00:05:11.214 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3450000000000002e-06 2024-09-12T00:05:11.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.214 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.214 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:11.214 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166758+0000", 2024-09-12T00:05:11.214 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019721629999999999 2024-09-12T00:05:11.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.214 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.215 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:11.215 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166785+0000", 2024-09-12T00:05:11.215 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7676000000000001e-05 2024-09-12T00:05:11.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.215 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.215 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.215 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166799+0000", 2024-09-12T00:05:11.215 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3716e-05 2024-09-12T00:05:11.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.215 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.215 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.215 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166895+0000", 2024-09-12T00:05:11.215 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6243999999999995e-05 2024-09-12T00:05:11.216 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.216 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.216 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:11.216 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.167092+0000", 2024-09-12T00:05:11.216 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019639200000000001 2024-09-12T00:05:11.216 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.216 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.216 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:11.216 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.167273+0000", 2024-09-12T00:05:11.216 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000181533 2024-09-12T00:05:11.216 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.216 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.216 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:11.216 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.174331+0000", 2024-09-12T00:05:11.217 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0070577879999999997 2024-09-12T00:05:11.217 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.217 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.217 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.217 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.184172+0000", 2024-09-12T00:05:11.217 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0098409469999999992 2024-09-12T00:05:11.217 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.217 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.217 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:11.217 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.184238+0000", 2024-09-12T00:05:11.217 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6036000000000003e-05 2024-09-12T00:05:11.217 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.217 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.218 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:11.218 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.184410+0000", 2024-09-12T00:05:11.218 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017222299999999999 2024-09-12T00:05:11.218 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.218 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:11.218 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.218 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.218 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.218 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2659 3.2d 3:b4a71344:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.218 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.285246+0000", 2024-09-12T00:05:11.218 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.899720518999999, 2024-09-12T00:05:11.218 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020000217000000001, 2024-09-12T00:05:11.218 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:11.218 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:11.219 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.219 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:11.219 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:11.219 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.219 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2659 2024-09-12T00:05:11.219 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.219 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:11.219 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.219 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:11.219 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.285246+0000", 2024-09-12T00:05:11.219 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.219 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.219 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.219 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:11.220 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.285246+0000", 2024-09-12T00:05:11.220 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.220 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.220 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:11.220 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.285249+0000", 2024-09-12T00:05:11.220 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3890000000000001e-06 2024-09-12T00:05:11.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.220 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.220 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:11.221 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287047+0000", 2024-09-12T00:05:11.221 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017978099999999999 2024-09-12T00:05:11.221 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.221 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.221 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:11.221 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287084+0000", 2024-09-12T00:05:11.221 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6358e-05 2024-09-12T00:05:11.221 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.221 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.221 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.221 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287101+0000", 2024-09-12T00:05:11.221 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7815000000000001e-05 2024-09-12T00:05:11.221 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.222 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.222 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.222 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287198+0000", 2024-09-12T00:05:11.222 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6482000000000002e-05 2024-09-12T00:05:11.222 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.222 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.222 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:11.222 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287337+0000", 2024-09-12T00:05:11.222 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013917500000000001 2024-09-12T00:05:11.222 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.222 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.222 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:11.222 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287451+0000", 2024-09-12T00:05:11.223 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000113962 2024-09-12T00:05:11.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.223 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.223 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:11.223 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.293889+0000", 2024-09-12T00:05:11.223 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064380110000000004 2024-09-12T00:05:11.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.223 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.223 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.223 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.305119+0000", 2024-09-12T00:05:11.223 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011229872 2024-09-12T00:05:11.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.223 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.223 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:11.224 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.305191+0000", 2024-09-12T00:05:11.224 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2002000000000006e-05 2024-09-12T00:05:11.224 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.224 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.224 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:11.224 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.305246+0000", 2024-09-12T00:05:11.224 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5340999999999998e-05 2024-09-12T00:05:11.224 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.224 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:11.224 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.224 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.224 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.224 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2662 3.28 3:1791a19e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.225 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.317519+0000", 2024-09-12T00:05:11.225 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.867447571, 2024-09-12T00:05:11.225 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016495961999999999, 2024-09-12T00:05:11.225 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:11.225 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:11.225 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.225 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:11.225 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:11.225 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.225 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2662 2024-09-12T00:05:11.225 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.225 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:11.225 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.225 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:11.226 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317519+0000", 2024-09-12T00:05:11.226 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.226 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.226 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.226 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:11.226 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317519+0000", 2024-09-12T00:05:11.226 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.226 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.226 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.226 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:11.226 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317522+0000", 2024-09-12T00:05:11.226 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7389999999999999e-06 2024-09-12T00:05:11.226 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.226 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.227 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:11.227 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319683+0000", 2024-09-12T00:05:11.227 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021614970000000001 2024-09-12T00:05:11.227 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.227 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.227 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:11.227 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319715+0000", 2024-09-12T00:05:11.227 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1574e-05 2024-09-12T00:05:11.227 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.227 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.227 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.227 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319730+0000", 2024-09-12T00:05:11.227 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5543e-05 2024-09-12T00:05:11.227 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.228 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.228 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.228 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319820+0000", 2024-09-12T00:05:11.228 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9402999999999998e-05 2024-09-12T00:05:11.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.228 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.228 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:11.228 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319976+0000", 2024-09-12T00:05:11.228 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015662900000000001 2024-09-12T00:05:11.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.228 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.228 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:11.228 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.320143+0000", 2024-09-12T00:05:11.229 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000166207 2024-09-12T00:05:11.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.229 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.229 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:11.229 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.327504+0000", 2024-09-12T00:05:11.229 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0073616189999999998 2024-09-12T00:05:11.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.229 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.229 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.229 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.333886+0000", 2024-09-12T00:05:11.229 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063817650000000002 2024-09-12T00:05:11.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.229 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.229 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:11.230 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.333952+0000", 2024-09-12T00:05:11.230 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5889999999999994e-05 2024-09-12T00:05:11.230 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.230 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.230 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:11.230 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.334015+0000", 2024-09-12T00:05:11.230 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3095999999999994e-05 2024-09-12T00:05:11.230 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.230 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:11.230 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.230 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.230 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.230 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2664 3.1d 3:b8bd1b2d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.230 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.341755+0000", 2024-09-12T00:05:11.231 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.843211714999999, 2024-09-12T00:05:11.231 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017365477000000001, 2024-09-12T00:05:11.231 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:11.231 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:11.231 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.231 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:11.231 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:11.231 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.231 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2664 2024-09-12T00:05:11.231 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.231 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:11.231 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.231 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:11.231 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.341755+0000", 2024-09-12T00:05:11.232 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.232 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.232 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.232 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:11.232 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.341755+0000", 2024-09-12T00:05:11.232 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.232 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.232 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.232 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:11.232 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.341758+0000", 2024-09-12T00:05:11.232 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6560000000000001e-06 2024-09-12T00:05:11.232 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.232 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.232 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:11.233 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343741+0000", 2024-09-12T00:05:11.233 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019832389999999999 2024-09-12T00:05:11.233 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.233 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.233 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:11.233 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343766+0000", 2024-09-12T00:05:11.233 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4967e-05 2024-09-12T00:05:11.233 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.233 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.233 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.233 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343776+0000", 2024-09-12T00:05:11.233 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0686000000000001e-05 2024-09-12T00:05:11.233 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.233 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.234 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.234 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343854+0000", 2024-09-12T00:05:11.234 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7210000000000001e-05 2024-09-12T00:05:11.234 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.234 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.234 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:11.234 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.344027+0000", 2024-09-12T00:05:11.234 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000173065 2024-09-12T00:05:11.234 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.234 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.234 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:11.234 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.344194+0000", 2024-09-12T00:05:11.234 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016688900000000001 2024-09-12T00:05:11.234 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.235 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.235 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:11.235 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.358530+0000", 2024-09-12T00:05:11.235 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014336877 2024-09-12T00:05:11.235 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.235 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.235 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.235 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.359009+0000", 2024-09-12T00:05:11.235 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00047882099999999999 2024-09-12T00:05:11.235 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.235 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.235 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:11.235 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.359069+0000", 2024-09-12T00:05:11.235 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9892999999999997e-05 2024-09-12T00:05:11.236 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.236 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.236 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:11.236 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.359120+0000", 2024-09-12T00:05:11.236 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1174000000000002e-05 2024-09-12T00:05:11.236 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.236 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:11.236 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.236 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.236 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.236 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2666 3.13 3:cbd43ea3:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.236 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.362905+0000", 2024-09-12T00:05:11.236 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.822061333000001, 2024-09-12T00:05:11.236 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017815950000000001, 2024-09-12T00:05:11.237 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:11.237 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:11.237 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.237 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:11.237 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:11.237 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.237 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2666 2024-09-12T00:05:11.237 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.237 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:11.237 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.237 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:11.237 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.362905+0000", 2024-09-12T00:05:11.237 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.237 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.238 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.238 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:11.238 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.362905+0000", 2024-09-12T00:05:11.238 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.238 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.238 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.238 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:11.238 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.362909+0000", 2024-09-12T00:05:11.238 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4529999999999998e-06 2024-09-12T00:05:11.238 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.238 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.238 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:11.238 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364466+0000", 2024-09-12T00:05:11.239 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015570060000000001 2024-09-12T00:05:11.239 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.239 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.239 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:11.239 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364500+0000", 2024-09-12T00:05:11.239 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4289999999999999e-05 2024-09-12T00:05:11.239 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.239 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.239 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.239 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364515+0000", 2024-09-12T00:05:11.239 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4537e-05 2024-09-12T00:05:11.239 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.239 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.239 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.240 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364615+0000", 2024-09-12T00:05:11.240 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100782 2024-09-12T00:05:11.240 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.240 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.240 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:11.240 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364805+0000", 2024-09-12T00:05:11.240 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018921399999999999 2024-09-12T00:05:11.240 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.240 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.240 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:11.240 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364984+0000", 2024-09-12T00:05:11.240 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017972299999999999 2024-09-12T00:05:11.240 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.240 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.241 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:11.241 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.372042+0000", 2024-09-12T00:05:11.241 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0070581120000000001 2024-09-12T00:05:11.241 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.241 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.241 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.241 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.380620+0000", 2024-09-12T00:05:11.241 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085774309999999999 2024-09-12T00:05:11.241 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.241 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.241 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:11.241 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.380666+0000", 2024-09-12T00:05:11.241 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5881000000000003e-05 2024-09-12T00:05:11.242 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.242 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.242 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:11.242 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.380721+0000", 2024-09-12T00:05:11.242 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5520999999999999e-05 2024-09-12T00:05:11.242 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.242 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:11.242 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.242 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.242 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.242 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2677 3.13 3:c9d59693:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.242 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.474053+0000", 2024-09-12T00:05:11.242 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.710913986000001, 2024-09-12T00:05:11.242 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017985961000000002, 2024-09-12T00:05:11.243 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:11.243 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:11.243 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.243 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:11.243 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:11.243 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.243 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2677 2024-09-12T00:05:11.243 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.243 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:11.243 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.243 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:11.243 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.474053+0000", 2024-09-12T00:05:11.243 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.243 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.244 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.244 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:11.244 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.474053+0000", 2024-09-12T00:05:11.244 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.244 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.244 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.244 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:11.244 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.474055+0000", 2024-09-12T00:05:11.244 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.711e-06 2024-09-12T00:05:11.244 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.244 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.244 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:11.244 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475342+0000", 2024-09-12T00:05:11.244 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001286508 2024-09-12T00:05:11.245 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.245 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.245 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:11.245 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475373+0000", 2024-09-12T00:05:11.245 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1130000000000002e-05 2024-09-12T00:05:11.245 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.245 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.245 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.245 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475387+0000", 2024-09-12T00:05:11.245 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4280999999999999e-05 2024-09-12T00:05:11.245 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.245 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.246 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.246 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475476+0000", 2024-09-12T00:05:11.246 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8621000000000004e-05 2024-09-12T00:05:11.246 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.246 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.246 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:11.246 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475644+0000", 2024-09-12T00:05:11.246 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016785699999999999 2024-09-12T00:05:11.246 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.246 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.246 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:11.246 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475742+0000", 2024-09-12T00:05:11.246 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8016000000000005e-05 2024-09-12T00:05:11.247 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.247 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.247 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:11.247 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.480305+0000", 2024-09-12T00:05:11.247 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045629049999999999 2024-09-12T00:05:11.247 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.247 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.247 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.247 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.491948+0000", 2024-09-12T00:05:11.247 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011643280000000001 2024-09-12T00:05:11.247 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.247 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.248 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:11.248 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.492000+0000", 2024-09-12T00:05:11.248 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2482000000000003e-05 2024-09-12T00:05:11.248 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.248 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.248 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:11.248 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.492039+0000", 2024-09-12T00:05:11.248 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8170000000000002e-05 2024-09-12T00:05:11.248 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.249 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:11.249 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.249 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.249 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.249 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2691 3.2d 3:b4a2284d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.249 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.515274+0000", 2024-09-12T00:05:11.249 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.66969293, 2024-09-12T00:05:11.249 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018577757, 2024-09-12T00:05:11.249 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:11.249 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:11.249 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.250 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:11.250 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:11.250 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.250 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2691 2024-09-12T00:05:11.250 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.250 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:11.250 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.250 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:11.250 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.515274+0000", 2024-09-12T00:05:11.251 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.251 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.251 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.251 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:11.251 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.515274+0000", 2024-09-12T00:05:11.251 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.251 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.251 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.251 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:11.251 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.515276+0000", 2024-09-12T00:05:11.251 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3499999999999999e-06 2024-09-12T00:05:11.252 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.252 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.252 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:11.252 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.516900+0000", 2024-09-12T00:05:11.252 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001623633 2024-09-12T00:05:11.252 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.252 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.252 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:11.252 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.516929+0000", 2024-09-12T00:05:11.252 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9009999999999998e-05 2024-09-12T00:05:11.253 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.253 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.253 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.253 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.516942+0000", 2024-09-12T00:05:11.253 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3551e-05 2024-09-12T00:05:11.253 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.253 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.253 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.253 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.517022+0000", 2024-09-12T00:05:11.253 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0167999999999995e-05 2024-09-12T00:05:11.254 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.254 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.254 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:11.254 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.517216+0000", 2024-09-12T00:05:11.254 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000193919 2024-09-12T00:05:11.254 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.254 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.254 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:11.254 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.517380+0000", 2024-09-12T00:05:11.254 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016336000000000001 2024-09-12T00:05:11.255 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.255 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.255 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:11.255 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.522907+0000", 2024-09-12T00:05:11.255 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055276420000000001 2024-09-12T00:05:11.255 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.255 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.255 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.255 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.533735+0000", 2024-09-12T00:05:11.255 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010827997000000001 2024-09-12T00:05:11.256 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.256 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.256 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:11.256 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.533800+0000", 2024-09-12T00:05:11.256 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4738000000000003e-05 2024-09-12T00:05:11.256 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.256 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.256 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:11.256 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.533851+0000", 2024-09-12T00:05:11.256 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1388999999999999e-05 2024-09-12T00:05:11.257 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.257 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:11.257 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.257 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.257 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.257 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2697 3.13 3:c87ccb22:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.257 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.577849+0000", 2024-09-12T00:05:11.257 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.60711761, 2024-09-12T00:05:11.257 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019139156000000001, 2024-09-12T00:05:11.258 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:11.258 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:11.258 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.258 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:11.258 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:11.258 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.258 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2697 2024-09-12T00:05:11.258 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.258 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:11.258 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.259 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:11.259 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577849+0000", 2024-09-12T00:05:11.259 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.259 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.259 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.259 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:11.259 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577849+0000", 2024-09-12T00:05:11.259 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.259 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.259 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.260 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:11.260 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577853+0000", 2024-09-12T00:05:11.260 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7510000000000002e-06 2024-09-12T00:05:11.260 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.260 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.260 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:11.260 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579595+0000", 2024-09-12T00:05:11.260 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001741954 2024-09-12T00:05:11.260 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.261 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.261 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:11.261 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579625+0000", 2024-09-12T00:05:11.261 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9907999999999999e-05 2024-09-12T00:05:11.261 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.261 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.261 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.261 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579640+0000", 2024-09-12T00:05:11.261 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4894e-05 2024-09-12T00:05:11.261 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.261 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.261 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.261 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579728+0000", 2024-09-12T00:05:11.262 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8704999999999999e-05 2024-09-12T00:05:11.262 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.262 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.262 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:11.262 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579922+0000", 2024-09-12T00:05:11.262 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000194019 2024-09-12T00:05:11.262 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.262 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.262 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:11.262 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.580092+0000", 2024-09-12T00:05:11.262 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016984300000000001 2024-09-12T00:05:11.262 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.263 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.263 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:11.263 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.591944+0000", 2024-09-12T00:05:11.263 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011852252000000001 2024-09-12T00:05:11.263 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.263 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.263 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.263 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.596913+0000", 2024-09-12T00:05:11.263 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049688279999999998 2024-09-12T00:05:11.263 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.263 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.263 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:11.263 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.596955+0000", 2024-09-12T00:05:11.264 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2290999999999999e-05 2024-09-12T00:05:11.264 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.264 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.264 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:11.264 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.596988+0000", 2024-09-12T00:05:11.264 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2710999999999999e-05 2024-09-12T00:05:11.264 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.264 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:11.264 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.264 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.264 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.264 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2701 3.11 3:8babcc8d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.264 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.617191+0000", 2024-09-12T00:05:11.264 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.567775996999998, 2024-09-12T00:05:11.265 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013760204999999999, 2024-09-12T00:05:11.265 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:11.265 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:11.265 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.265 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:11.265 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:11.265 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.265 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2701 2024-09-12T00:05:11.265 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.265 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:11.265 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.265 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:11.265 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.617191+0000", 2024-09-12T00:05:11.266 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.266 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.266 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.266 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:11.266 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.617191+0000", 2024-09-12T00:05:11.266 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.266 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.266 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.266 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:11.266 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.617194+0000", 2024-09-12T00:05:11.266 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.788e-06 2024-09-12T00:05:11.266 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.266 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.266 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:11.267 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618652+0000", 2024-09-12T00:05:11.267 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001457716 2024-09-12T00:05:11.267 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.267 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.267 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:11.267 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618682+0000", 2024-09-12T00:05:11.267 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9668000000000001e-05 2024-09-12T00:05:11.267 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.267 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.267 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.267 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618692+0000", 2024-09-12T00:05:11.267 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0429e-05 2024-09-12T00:05:11.267 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.267 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.268 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.268 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618766+0000", 2024-09-12T00:05:11.268 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4190999999999995e-05 2024-09-12T00:05:11.268 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.268 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.268 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:11.268 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618932+0000", 2024-09-12T00:05:11.268 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000165923 2024-09-12T00:05:11.268 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.268 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.268 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:11.268 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.619026+0000", 2024-09-12T00:05:11.268 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3906999999999994e-05 2024-09-12T00:05:11.268 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.269 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.269 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:11.269 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.623168+0000", 2024-09-12T00:05:11.269 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041419309999999997 2024-09-12T00:05:11.269 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.269 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.269 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.269 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.630815+0000", 2024-09-12T00:05:11.269 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0076470100000000001 2024-09-12T00:05:11.269 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.269 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.269 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:11.269 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.630887+0000", 2024-09-12T00:05:11.269 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2218999999999994e-05 2024-09-12T00:05:11.270 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.270 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.270 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:11.270 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.630951+0000", 2024-09-12T00:05:11.270 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3423000000000006e-05 2024-09-12T00:05:11.270 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.270 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:11.270 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.270 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.270 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.270 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2704 3.13 3:c90afc39:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.270 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.647542+0000", 2024-09-12T00:05:11.270 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.537424133999998, 2024-09-12T00:05:11.270 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017595339000000002, 2024-09-12T00:05:11.271 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:11.271 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:11.271 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.271 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:11.271 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:11.271 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.271 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2704 2024-09-12T00:05:11.271 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.271 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:11.271 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.271 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:11.271 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.647542+0000", 2024-09-12T00:05:11.271 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.271 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.272 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.272 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:11.272 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.647542+0000", 2024-09-12T00:05:11.272 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.272 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.272 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.272 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:11.272 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.647544+0000", 2024-09-12T00:05:11.272 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6339999999999999e-06 2024-09-12T00:05:11.272 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.272 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.272 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:11.272 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649032+0000", 2024-09-12T00:05:11.273 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001488063 2024-09-12T00:05:11.273 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.273 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.273 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:11.273 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649053+0000", 2024-09-12T00:05:11.273 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0761e-05 2024-09-12T00:05:11.273 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.273 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.273 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.273 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649066+0000", 2024-09-12T00:05:11.273 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2597e-05 2024-09-12T00:05:11.273 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.273 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.273 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.274 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649142+0000", 2024-09-12T00:05:11.274 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6254999999999994e-05 2024-09-12T00:05:11.274 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.274 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.274 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:11.274 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649250+0000", 2024-09-12T00:05:11.274 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010774500000000001 2024-09-12T00:05:11.274 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.274 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.274 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:11.274 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649364+0000", 2024-09-12T00:05:11.274 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000114401 2024-09-12T00:05:11.274 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.274 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.275 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:11.275 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.658970+0000", 2024-09-12T00:05:11.275 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0096065260000000006 2024-09-12T00:05:11.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.275 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.275 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.275 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.665022+0000", 2024-09-12T00:05:11.275 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0060516459999999999 2024-09-12T00:05:11.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.275 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.275 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:11.275 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.665086+0000", 2024-09-12T00:05:11.275 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3940000000000001e-05 2024-09-12T00:05:11.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.276 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.276 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:11.276 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.665138+0000", 2024-09-12T00:05:11.276 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1771000000000003e-05 2024-09-12T00:05:11.276 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.276 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:11.276 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.276 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.276 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2706 3.d 3:b1b5d8c6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.276 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.667263+0000", 2024-09-12T00:05:11.276 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.517703180000002, 2024-09-12T00:05:11.276 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017030099999999999, 2024-09-12T00:05:11.276 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:11.277 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:11.277 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.277 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:11.277 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:11.277 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.277 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2706 2024-09-12T00:05:11.277 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.277 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:11.277 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.277 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:11.277 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.667263+0000", 2024-09-12T00:05:11.277 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.277 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.277 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.278 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:11.278 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.667263+0000", 2024-09-12T00:05:11.278 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.278 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.278 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.278 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:11.278 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.667267+0000", 2024-09-12T00:05:11.278 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1540000000000002e-06 2024-09-12T00:05:11.278 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.278 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.278 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:11.278 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672789+0000", 2024-09-12T00:05:11.278 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055222819999999999 2024-09-12T00:05:11.278 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.279 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.279 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:11.279 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672817+0000", 2024-09-12T00:05:11.279 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8510999999999999e-05 2024-09-12T00:05:11.279 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.279 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.279 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.279 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672831+0000", 2024-09-12T00:05:11.279 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3919e-05 2024-09-12T00:05:11.279 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.279 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.279 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.279 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672988+0000", 2024-09-12T00:05:11.279 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015688 2024-09-12T00:05:11.280 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.280 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.280 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:11.280 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.673174+0000", 2024-09-12T00:05:11.280 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018615400000000001 2024-09-12T00:05:11.280 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.280 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.280 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:11.280 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.673352+0000", 2024-09-12T00:05:11.280 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017803599999999999 2024-09-12T00:05:11.280 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.280 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.280 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:11.280 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.683897+0000", 2024-09-12T00:05:11.281 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010544239 2024-09-12T00:05:11.281 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.281 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.281 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.281 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.684176+0000", 2024-09-12T00:05:11.281 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000279506 2024-09-12T00:05:11.281 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.281 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.281 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:11.281 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.684235+0000", 2024-09-12T00:05:11.281 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9101000000000002e-05 2024-09-12T00:05:11.281 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.281 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.281 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:11.282 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.684294+0000", 2024-09-12T00:05:11.282 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8318e-05 2024-09-12T00:05:11.282 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.282 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:11.282 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.282 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.282 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.282 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2714 3.17 e63/23 3:eac65a57:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_199:head v 63'3, mlcod=62'1)", 2024-09-12T00:05:11.282 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.752259+0000", 2024-09-12T00:05:11.282 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.432707646000001, 2024-09-12T00:05:11.282 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013747212, 2024-09-12T00:05:11.282 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:11.282 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:11.282 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.283 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:11.283 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.283 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:11.283 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.752259+0000", 2024-09-12T00:05:11.283 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.283 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.283 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:11.283 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.752259+0000", 2024-09-12T00:05:11.283 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.283 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.283 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:11.283 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.752261+0000", 2024-09-12T00:05:11.284 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2390000000000001e-06 2024-09-12T00:05:11.284 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.284 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.284 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:11.284 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757723+0000", 2024-09-12T00:05:11.284 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054619569999999999 2024-09-12T00:05:11.284 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.284 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.284 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:11.284 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757749+0000", 2024-09-12T00:05:11.284 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5732999999999999e-05 2024-09-12T00:05:11.284 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.284 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.284 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.285 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757762+0000", 2024-09-12T00:05:11.285 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3556e-05 2024-09-12T00:05:11.285 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.285 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.285 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.285 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757841+0000", 2024-09-12T00:05:11.285 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8644000000000001e-05 2024-09-12T00:05:11.285 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.285 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.285 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:11.285 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757864+0000", 2024-09-12T00:05:11.285 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3112000000000002e-05 2024-09-12T00:05:11.285 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.286 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.286 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:11.286 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.765956+0000", 2024-09-12T00:05:11.286 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080919679999999997 2024-09-12T00:05:11.286 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.286 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.286 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:11.286 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766006+0000", 2024-09-12T00:05:11.286 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0003000000000002e-05 2024-09-12T00:05:11.286 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.286 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:11.286 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.286 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.287 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.287 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2742 3.1d 3:b8ae26ad:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.287 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.035857+0000", 2024-09-12T00:05:11.287 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.149109964000001, 2024-09-12T00:05:11.287 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025139262999999998, 2024-09-12T00:05:11.287 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:11.287 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:11.287 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.287 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:11.287 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:11.287 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.287 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2742 2024-09-12T00:05:11.288 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.288 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:11.288 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.288 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:11.288 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.035857+0000", 2024-09-12T00:05:11.288 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.288 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.288 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.288 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:11.288 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.035857+0000", 2024-09-12T00:05:11.288 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.288 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.288 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.289 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:11.289 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.035859+0000", 2024-09-12T00:05:11.289 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0899999999999999e-06 2024-09-12T00:05:11.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.289 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.289 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:11.289 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038486+0000", 2024-09-12T00:05:11.289 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026273749999999999 2024-09-12T00:05:11.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.289 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.289 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:11.289 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038511+0000", 2024-09-12T00:05:11.289 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5327e-05 2024-09-12T00:05:11.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.290 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.290 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.290 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038527+0000", 2024-09-12T00:05:11.290 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5196e-05 2024-09-12T00:05:11.290 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.290 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.290 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.290 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038604+0000", 2024-09-12T00:05:11.290 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6921000000000004e-05 2024-09-12T00:05:11.290 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.290 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.290 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:11.290 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038789+0000", 2024-09-12T00:05:11.290 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018526400000000001 2024-09-12T00:05:11.291 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.291 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.291 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:11.291 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.039001+0000", 2024-09-12T00:05:11.291 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021200400000000001 2024-09-12T00:05:11.291 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.291 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.291 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.291 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.056879+0000", 2024-09-12T00:05:11.291 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017877783000000001 2024-09-12T00:05:11.291 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.291 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.291 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:11.291 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.060872+0000", 2024-09-12T00:05:11.292 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039929529999999996 2024-09-12T00:05:11.292 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.292 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.292 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:11.292 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.060942+0000", 2024-09-12T00:05:11.292 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0060000000000003e-05 2024-09-12T00:05:11.292 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.292 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.292 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:11.292 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.060996+0000", 2024-09-12T00:05:11.292 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4289999999999997e-05 2024-09-12T00:05:11.292 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.292 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:11.292 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.293 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.293 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.293 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2747 3.17 e63/23 3:eaa4528d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_232:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:11.293 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.094555+0000", 2024-09-12T00:05:11.293 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.090411137, 2024-09-12T00:05:11.293 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017679139, 2024-09-12T00:05:11.293 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:11.293 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:11.293 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.293 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:11.293 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.293 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:11.293 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.094555+0000", 2024-09-12T00:05:11.293 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.294 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.294 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.294 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:11.294 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.094555+0000", 2024-09-12T00:05:11.294 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.294 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.294 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.294 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:11.294 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.094558+0000", 2024-09-12T00:05:11.294 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.232e-06 2024-09-12T00:05:11.294 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.294 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.294 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:11.294 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098897+0000", 2024-09-12T00:05:11.295 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0043397840000000002 2024-09-12T00:05:11.295 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.295 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.295 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:11.295 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098930+0000", 2024-09-12T00:05:11.295 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2592000000000002e-05 2024-09-12T00:05:11.295 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.295 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.295 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.295 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098945+0000", 2024-09-12T00:05:11.295 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4759e-05 2024-09-12T00:05:11.295 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.295 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.295 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.295 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.099033+0000", 2024-09-12T00:05:11.296 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8535000000000005e-05 2024-09-12T00:05:11.296 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.296 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.296 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:11.296 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.099065+0000", 2024-09-12T00:05:11.296 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1825000000000001e-05 2024-09-12T00:05:11.296 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.296 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.296 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:11.296 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112134+0000", 2024-09-12T00:05:11.296 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013068329 2024-09-12T00:05:11.296 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.296 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.296 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:11.297 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112235+0000", 2024-09-12T00:05:11.297 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010108299999999999 2024-09-12T00:05:11.297 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.297 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:11.297 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.297 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.297 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.297 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2764 3.2d 3:b7a0f55d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_249:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.297 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.325396+0000", 2024-09-12T00:05:11.297 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 22.859570188999999, 2024-09-12T00:05:11.297 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022487040999999999, 2024-09-12T00:05:11.297 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:11.297 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:11.297 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.298 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:11.298 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:11.298 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.298 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2764 2024-09-12T00:05:11.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.298 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:11.298 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.298 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:11.298 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.325396+0000", 2024-09-12T00:05:11.298 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.298 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.298 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:11.299 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.325396+0000", 2024-09-12T00:05:11.299 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:11.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.299 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.299 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:11.299 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.325400+0000", 2024-09-12T00:05:11.299 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2370000000000001e-06 2024-09-12T00:05:11.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.299 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.299 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:11.299 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328424+0000", 2024-09-12T00:05:11.299 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003024657 2024-09-12T00:05:11.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.299 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.300 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:11.300 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328456+0000", 2024-09-12T00:05:11.300 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1819999999999997e-05 2024-09-12T00:05:11.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.300 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.300 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.300 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328476+0000", 2024-09-12T00:05:11.300 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9673999999999998e-05 2024-09-12T00:05:11.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.300 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.300 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:11.300 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328567+0000", 2024-09-12T00:05:11.300 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1640999999999999e-05 2024-09-12T00:05:11.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.301 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.301 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:11.301 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328734+0000", 2024-09-12T00:05:11.301 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016619200000000001 2024-09-12T00:05:11.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.301 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.301 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:11.301 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328910+0000", 2024-09-12T00:05:11.301 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017652299999999999 2024-09-12T00:05:11.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.301 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.301 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:11.301 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.333757+0000", 2024-09-12T00:05:11.301 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048465060000000004 2024-09-12T00:05:11.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.302 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.302 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.302 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.347806+0000", 2024-09-12T00:05:11.302 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01404908 2024-09-12T00:05:11.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.302 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.302 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:11.302 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.347847+0000", 2024-09-12T00:05:11.302 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1396999999999997e-05 2024-09-12T00:05:11.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:11.302 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:11.302 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:11.302 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.347883+0000", 2024-09-12T00:05:11.302 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6313999999999998e-05 2024-09-12T00:05:11.303 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.303 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:11.303 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.303 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:11.303 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:11.303 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:11.304 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:05:11.305 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:11.305+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:11.339 INFO:tasks.workunit.client.0.smithi019.stdout:quota enabled for the bucket: buck_2024_08_12_00_05_06 2024-09-12T00:05:11.339 INFO:tasks.workunit.client.0.smithi019.stdout:adding file to bucket: 2Gb. 2024-09-12T00:05:11.339 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:05:11.339 INFO:tasks.workunit.client.0.smithi019.stdout:Test case: PASSED - set max size for a given user and ensure that objects upload beyond max size is not entertained 2024-09-12T00:05:11.339 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:05:11.339 INFO:tasks.workunit.client.0.smithi019.stdout:delete objects successful 2024-09-12T00:05:11.405 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:11.401+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:11.440 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:11.440 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:11.440 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:11.440 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:11.455 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:05:11.542 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:11.541+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:11.607 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:11.605+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:11.619 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:11.620 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:11.620 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:11.620 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:11.620 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:11.634 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:05:11.722 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:11.721+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:11.802 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:11.802 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:11.803 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:11.803 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:11.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.803 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2657 3.3c e63/23 3:3e583291:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_152:head v 63'4, mlcod=62'2)", 2024-09-12T00:05:11.803 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:05:11.803 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.534848997000001, 2024-09-12T00:05:11.803 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017073642999999999, 2024-09-12T00:05:11.803 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:11.803 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:11.803 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.803 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:11.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.803 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:11.804 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:05:11.804 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.804 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.804 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:11.804 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:05:11.804 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.804 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.804 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:11.804 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266877+0000", 2024-09-12T00:05:11.804 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3630000000000001e-06 2024-09-12T00:05:11.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.805 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:11.805 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271243+0000", 2024-09-12T00:05:11.805 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043659730000000004 2024-09-12T00:05:11.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.805 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:11.805 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271279+0000", 2024-09-12T00:05:11.805 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6334999999999997e-05 2024-09-12T00:05:11.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.805 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.805 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271296+0000", 2024-09-12T00:05:11.805 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6619000000000001e-05 2024-09-12T00:05:11.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.806 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.806 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:11.806 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271429+0000", 2024-09-12T00:05:11.806 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133132 2024-09-12T00:05:11.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.806 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.806 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:11.806 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271468+0000", 2024-09-12T00:05:11.806 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8483999999999999e-05 2024-09-12T00:05:11.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.806 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.806 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:11.807 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.283854+0000", 2024-09-12T00:05:11.807 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012386645999999999 2024-09-12T00:05:11.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.807 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:11.807 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.283948+0000", 2024-09-12T00:05:11.807 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4091000000000004e-05 2024-09-12T00:05:11.807 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.807 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:11.807 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.807 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2658 3.3a e63/23 3:5ec14981:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_153:head v 63'1, mlcod=0'0)", 2024-09-12T00:05:11.807 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.276052+0000", 2024-09-12T00:05:11.808 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.525672106999998, 2024-09-12T00:05:11.808 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015387336999999999, 2024-09-12T00:05:11.808 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:11.808 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:11.808 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.808 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:11.808 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.808 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:11.808 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.276052+0000", 2024-09-12T00:05:11.808 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.808 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.808 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:11.809 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.276052+0000", 2024-09-12T00:05:11.809 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.809 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.809 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.809 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:11.809 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.276054+0000", 2024-09-12T00:05:11.809 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3199999999999998e-06 2024-09-12T00:05:11.809 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.809 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.809 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:11.809 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282165+0000", 2024-09-12T00:05:11.809 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061108359999999997 2024-09-12T00:05:11.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.810 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.810 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:11.810 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282192+0000", 2024-09-12T00:05:11.810 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7008999999999998e-05 2024-09-12T00:05:11.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.810 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.810 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.810 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282206+0000", 2024-09-12T00:05:11.810 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4705999999999999e-05 2024-09-12T00:05:11.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.810 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.810 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:11.811 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282387+0000", 2024-09-12T00:05:11.811 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018015199999999999 2024-09-12T00:05:11.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.811 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.811 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:11.811 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282426+0000", 2024-09-12T00:05:11.811 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9323999999999998e-05 2024-09-12T00:05:11.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.811 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.811 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:11.811 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291241+0000", 2024-09-12T00:05:11.811 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0088146950000000009 2024-09-12T00:05:11.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.811 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.812 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:11.812 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291439+0000", 2024-09-12T00:05:11.812 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000198295 2024-09-12T00:05:11.812 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.812 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:11.812 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.812 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.812 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.812 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2659 3.2d e63/23 3:b4a71344:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_154:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:11.812 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:05:11.812 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.514044703, 2024-09-12T00:05:11.812 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016913793, 2024-09-12T00:05:11.812 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:11.813 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:11.813 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.813 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:11.813 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.813 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:11.813 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:05:11.813 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.813 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.813 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.813 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:11.813 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:05:11.813 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.813 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.814 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.814 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:11.814 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287682+0000", 2024-09-12T00:05:11.814 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9799999999999998e-06 2024-09-12T00:05:11.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.814 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.814 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:11.814 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291872+0000", 2024-09-12T00:05:11.814 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041904070000000002 2024-09-12T00:05:11.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.814 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.814 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:11.814 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291901+0000", 2024-09-12T00:05:11.814 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9017999999999999e-05 2024-09-12T00:05:11.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.815 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.815 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.815 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291917+0000", 2024-09-12T00:05:11.815 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5775999999999999e-05 2024-09-12T00:05:11.815 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.815 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.815 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:11.815 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.292061+0000", 2024-09-12T00:05:11.815 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014356800000000001 2024-09-12T00:05:11.815 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.815 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.815 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:11.815 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.292123+0000", 2024-09-12T00:05:11.815 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2799999999999995e-05 2024-09-12T00:05:11.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.816 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.816 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:11.816 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.304456+0000", 2024-09-12T00:05:11.816 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012332865 2024-09-12T00:05:11.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.816 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.816 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:11.816 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.304593+0000", 2024-09-12T00:05:11.816 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000136379 2024-09-12T00:05:11.816 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.816 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:11.816 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.817 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.817 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2667 3.8 3:1177e826:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.817 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:05:11.817 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.428602784999999, 2024-09-12T00:05:11.817 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024306991999999999, 2024-09-12T00:05:11.817 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:11.817 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:11.817 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.817 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:11.817 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:11.817 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.817 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2667 2024-09-12T00:05:11.817 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.817 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:11.818 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.818 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:11.818 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:05:11.818 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.818 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.818 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:11.818 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:05:11.818 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.818 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.818 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:11.818 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373124+0000", 2024-09-12T00:05:11.818 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.19e-06 2024-09-12T00:05:11.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.819 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.819 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:11.819 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377167+0000", 2024-09-12T00:05:11.819 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040430329999999997 2024-09-12T00:05:11.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.819 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.819 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:11.819 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377201+0000", 2024-09-12T00:05:11.819 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3868000000000002e-05 2024-09-12T00:05:11.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.819 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.820 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.820 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377219+0000", 2024-09-12T00:05:11.820 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8019000000000001e-05 2024-09-12T00:05:11.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.820 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.820 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:11.820 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377362+0000", 2024-09-12T00:05:11.820 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000143001 2024-09-12T00:05:11.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.821 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.821 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:11.821 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377603+0000", 2024-09-12T00:05:11.821 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024115200000000001 2024-09-12T00:05:11.821 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.821 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.821 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:11.821 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377833+0000", 2024-09-12T00:05:11.821 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022952000000000001 2024-09-12T00:05:11.821 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.821 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.821 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:11.821 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.386771+0000", 2024-09-12T00:05:11.821 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0089385739999999995 2024-09-12T00:05:11.822 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.822 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.822 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.822 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397160+0000", 2024-09-12T00:05:11.822 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010388391 2024-09-12T00:05:11.822 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.822 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.822 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:11.822 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397307+0000", 2024-09-12T00:05:11.822 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014745099999999999 2024-09-12T00:05:11.822 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.822 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.822 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:11.823 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397428+0000", 2024-09-12T00:05:11.823 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012079299999999999 2024-09-12T00:05:11.823 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.823 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:11.823 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.823 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.823 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.823 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2669 3.1b 3:d9b9bd82:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.823 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:05:11.823 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.408926136000002, 2024-09-12T00:05:11.823 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016867298999999999, 2024-09-12T00:05:11.823 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:11.823 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:11.823 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.824 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:11.824 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:11.824 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.824 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2669 2024-09-12T00:05:11.824 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.824 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:11.824 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.824 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:11.824 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:05:11.824 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.824 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.824 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.824 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:11.825 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:05:11.825 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.825 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.825 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.825 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:11.825 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392800+0000", 2024-09-12T00:05:11.825 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8629999999999999e-06 2024-09-12T00:05:11.825 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.825 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.825 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:11.825 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396812+0000", 2024-09-12T00:05:11.825 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040120140000000004 2024-09-12T00:05:11.825 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.825 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.826 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:11.826 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396849+0000", 2024-09-12T00:05:11.826 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6291000000000002e-05 2024-09-12T00:05:11.826 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.826 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.826 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.826 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396906+0000", 2024-09-12T00:05:11.826 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7692999999999998e-05 2024-09-12T00:05:11.826 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.826 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.826 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:11.826 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397059+0000", 2024-09-12T00:05:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015268399999999999 2024-09-12T00:05:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397472+0000", 2024-09-12T00:05:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041270899999999998 2024-09-12T00:05:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397697+0000", 2024-09-12T00:05:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022526299999999999 2024-09-12T00:05:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.406380+0000", 2024-09-12T00:05:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086830429999999997 2024-09-12T00:05:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409367+0000", 2024-09-12T00:05:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002987403 2024-09-12T00:05:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409532+0000", 2024-09-12T00:05:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016417 2024-09-12T00:05:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409665+0000", 2024-09-12T00:05:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013316599999999999 2024-09-12T00:05:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2678 3.2b 3:d57f7217:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:05:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.317508688, 2024-09-12T00:05:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018772965999999999, 2024-09-12T00:05:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2678 2024-09-12T00:05:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:05:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:05:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484219+0000", 2024-09-12T00:05:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7299999999999999e-06 2024-09-12T00:05:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488148+0000", 2024-09-12T00:05:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039289859999999998 2024-09-12T00:05:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488214+0000", 2024-09-12T00:05:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6202000000000001e-05 2024-09-12T00:05:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488239+0000", 2024-09-12T00:05:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4839000000000001e-05 2024-09-12T00:05:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488374+0000", 2024-09-12T00:05:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000135189 2024-09-12T00:05:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488626+0000", 2024-09-12T00:05:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025242800000000002 2024-09-12T00:05:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488849+0000", 2024-09-12T00:05:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022295 2024-09-12T00:05:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498947+0000", 2024-09-12T00:05:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010098072 2024-09-12T00:05:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502674+0000", 2024-09-12T00:05:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037269149999999999 2024-09-12T00:05:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502856+0000", 2024-09-12T00:05:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018163599999999999 2024-09-12T00:05:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502988+0000", 2024-09-12T00:05:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013201900000000001 2024-09-12T00:05:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2691 3.2d e63/23 3:b4a2284d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_176:head v 63'6, mlcod=63'4)", 2024-09-12T00:05:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:05:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.284383986999998, 2024-09-12T00:05:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015889306999999998, 2024-09-12T00:05:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:05:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:05:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517342+0000", 2024-09-12T00:05:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3700000000000002e-06 2024-09-12T00:05:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521776+0000", 2024-09-12T00:05:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044339790000000002 2024-09-12T00:05:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521806+0000", 2024-09-12T00:05:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9855000000000001e-05 2024-09-12T00:05:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521820+0000", 2024-09-12T00:05:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4496e-05 2024-09-12T00:05:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521963+0000", 2024-09-12T00:05:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014277199999999999 2024-09-12T00:05:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.522029+0000", 2024-09-12T00:05:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6186000000000006e-05 2024-09-12T00:05:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.533123+0000", 2024-09-12T00:05:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011093252 2024-09-12T00:05:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.533229+0000", 2024-09-12T00:05:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000106397 2024-09-12T00:05:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2694 3.3d e63/23 3:bd0bdafc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_179:head v 63'7, mlcod=63'5)", 2024-09-12T00:05:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:05:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.249169214999998, 2024-09-12T00:05:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016398093999999998, 2024-09-12T00:05:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:05:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:05:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552558+0000", 2024-09-12T00:05:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6030000000000001e-06 2024-09-12T00:05:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556085+0000", 2024-09-12T00:05:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0035274339999999999 2024-09-12T00:05:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556126+0000", 2024-09-12T00:05:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0290999999999998e-05 2024-09-12T00:05:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556154+0000", 2024-09-12T00:05:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7965000000000001e-05 2024-09-12T00:05:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556298+0000", 2024-09-12T00:05:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014459799999999999 2024-09-12T00:05:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556339+0000", 2024-09-12T00:05:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0577000000000001e-05 2024-09-12T00:05:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.568778+0000", 2024-09-12T00:05:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012438886999999999 2024-09-12T00:05:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.568953+0000", 2024-09-12T00:05:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017473900000000001 2024-09-12T00:05:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2696 3.2b 3:d7c776f8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:05:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.234322318, 2024-09-12T00:05:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022026211, 2024-09-12T00:05:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:11.846 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.846 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:11.846 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:11.846 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.846 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2696 2024-09-12T00:05:11.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.846 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:11.846 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.846 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:11.846 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:05:11.846 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.846 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:05:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567406+0000", 2024-09-12T00:05:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9389999999999996e-06 2024-09-12T00:05:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571490+0000", 2024-09-12T00:05:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040837870000000002 2024-09-12T00:05:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571530+0000", 2024-09-12T00:05:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9894999999999997e-05 2024-09-12T00:05:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571554+0000", 2024-09-12T00:05:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4011000000000001e-05 2024-09-12T00:05:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571726+0000", 2024-09-12T00:05:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0001717 2024-09-12T00:05:11.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.849 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.849 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:11.849 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.572130+0000", 2024-09-12T00:05:11.849 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040465299999999999 2024-09-12T00:05:11.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.849 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.849 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:11.849 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.572470+0000", 2024-09-12T00:05:11.849 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00033946999999999997 2024-09-12T00:05:11.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.849 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.849 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:11.849 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.579159+0000", 2024-09-12T00:05:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0066893009999999999 2024-09-12T00:05:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589136+0000", 2024-09-12T00:05:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099772060000000006 2024-09-12T00:05:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589309+0000", 2024-09-12T00:05:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017264299999999999 2024-09-12T00:05:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589428+0000", 2024-09-12T00:05:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118606 2024-09-12T00:05:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2698 3.3d e63/23 3:bcafb0f9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_183:head v 63'8, mlcod=63'6)", 2024-09-12T00:05:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:05:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.206619269000001, 2024-09-12T00:05:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016019080000000002, 2024-09-12T00:05:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:05:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:05:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595107+0000", 2024-09-12T00:05:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.497e-06 2024-09-12T00:05:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598465+0000", 2024-09-12T00:05:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033583129999999999 2024-09-12T00:05:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598502+0000", 2024-09-12T00:05:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6814999999999999e-05 2024-09-12T00:05:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598520+0000", 2024-09-12T00:05:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8264999999999999e-05 2024-09-12T00:05:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598666+0000", 2024-09-12T00:05:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014574499999999999 2024-09-12T00:05:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598706+0000", 2024-09-12T00:05:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9993999999999997e-05 2024-09-12T00:05:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.611012+0000", 2024-09-12T00:05:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012306381 2024-09-12T00:05:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.611123+0000", 2024-09-12T00:05:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011107000000000001 2024-09-12T00:05:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2702 3.3c e63/23 3:3d6a0b3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_187:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:05:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.173144432000001, 2024-09-12T00:05:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015754475, 2024-09-12T00:05:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:05:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:05:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628581+0000", 2024-09-12T00:05:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2129999999999998e-06 2024-09-12T00:05:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633160+0000", 2024-09-12T00:05:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045784470000000002 2024-09-12T00:05:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633193+0000", 2024-09-12T00:05:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3015000000000002e-05 2024-09-12T00:05:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633213+0000", 2024-09-12T00:05:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0271999999999998e-05 2024-09-12T00:05:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633397+0000", 2024-09-12T00:05:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018359299999999999 2024-09-12T00:05:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633440+0000", 2024-09-12T00:05:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2984e-05 2024-09-12T00:05:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.644242+0000", 2024-09-12T00:05:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010802673 2024-09-12T00:05:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.644334+0000", 2024-09-12T00:05:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1278000000000003e-05 2024-09-12T00:05:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2707 3.8 3:10a400a4:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:05:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.124866864000001, 2024-09-12T00:05:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019444162000000001, 2024-09-12T00:05:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2707 2024-09-12T00:05:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:05:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:05:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676879+0000", 2024-09-12T00:05:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1886e-05 2024-09-12T00:05:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680743+0000", 2024-09-12T00:05:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038648060000000001 2024-09-12T00:05:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680783+0000", 2024-09-12T00:05:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9511000000000002e-05 2024-09-12T00:05:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680801+0000", 2024-09-12T00:05:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8056000000000001e-05 2024-09-12T00:05:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680948+0000", 2024-09-12T00:05:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014682399999999999 2024-09-12T00:05:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.681206+0000", 2024-09-12T00:05:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025860500000000002 2024-09-12T00:05:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.681439+0000", 2024-09-12T00:05:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023246599999999999 2024-09-12T00:05:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.689277+0000", 2024-09-12T00:05:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0078379000000000001 2024-09-12T00:05:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696136+0000", 2024-09-12T00:05:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0068593439999999999 2024-09-12T00:05:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696228+0000", 2024-09-12T00:05:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2038000000000002e-05 2024-09-12T00:05:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696301+0000", 2024-09-12T00:05:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2725999999999995e-05 2024-09-12T00:05:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2720 3.6 3:61c9c6cd:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:05:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 23.998147547999999, 2024-09-12T00:05:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021831761000000002, 2024-09-12T00:05:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2720 2024-09-12T00:05:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:05:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:05:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803580+0000", 2024-09-12T00:05:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9870000000000001e-06 2024-09-12T00:05:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808102+0000", 2024-09-12T00:05:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004521677 2024-09-12T00:05:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808152+0000", 2024-09-12T00:05:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9923999999999998e-05 2024-09-12T00:05:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808178+0000", 2024-09-12T00:05:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5911999999999999e-05 2024-09-12T00:05:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808365+0000", 2024-09-12T00:05:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000187839 2024-09-12T00:05:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808757+0000", 2024-09-12T00:05:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039202900000000001 2024-09-12T00:05:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.809162+0000", 2024-09-12T00:05:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040460300000000002 2024-09-12T00:05:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.816553+0000", 2024-09-12T00:05:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.007390537 2024-09-12T00:05:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.824836+0000", 2024-09-12T00:05:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082834369999999994 2024-09-12T00:05:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.825223+0000", 2024-09-12T00:05:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00038724700000000001 2024-09-12T00:05:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.825408+0000", 2024-09-12T00:05:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018456899999999999 2024-09-12T00:05:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2722 3.1b 3:d95d04cc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_207:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.822403+0000", 2024-09-12T00:05:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 23.979320855000001, 2024-09-12T00:05:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015693082000000001, 2024-09-12T00:05:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2722 2024-09-12T00:05:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.822403+0000", 2024-09-12T00:05:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.822403+0000", 2024-09-12T00:05:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.822405+0000", 2024-09-12T00:05:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4169999999999999e-06 2024-09-12T00:05:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826387+0000", 2024-09-12T00:05:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039818379999999997 2024-09-12T00:05:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826412+0000", 2024-09-12T00:05:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5159000000000001e-05 2024-09-12T00:05:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826425+0000", 2024-09-12T00:05:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3283e-05 2024-09-12T00:05:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826536+0000", 2024-09-12T00:05:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110109 2024-09-12T00:05:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826725+0000", 2024-09-12T00:05:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018966600000000001 2024-09-12T00:05:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826904+0000", 2024-09-12T00:05:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017913200000000001 2024-09-12T00:05:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.835018+0000", 2024-09-12T00:05:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0081138300000000007 2024-09-12T00:05:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837918+0000", 2024-09-12T00:05:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002899535 2024-09-12T00:05:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838010+0000", 2024-09-12T00:05:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1901e-05 2024-09-12T00:05:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838096+0000", 2024-09-12T00:05:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6211999999999994e-05 2024-09-12T00:05:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2724 3.1b 3:da32d84b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:05:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 23.957937112, 2024-09-12T00:05:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019410604000000001, 2024-09-12T00:05:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2724 2024-09-12T00:05:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:05:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:05:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843790+0000", 2024-09-12T00:05:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.393e-06 2024-09-12T00:05:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847786+0000", 2024-09-12T00:05:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039965579999999999 2024-09-12T00:05:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847836+0000", 2024-09-12T00:05:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9731000000000002e-05 2024-09-12T00:05:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.882 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.882 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.882 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847856+0000", 2024-09-12T00:05:11.882 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0245e-05 2024-09-12T00:05:11.882 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.882 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.882 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848053+0000", 2024-09-12T00:05:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000196882 2024-09-12T00:05:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848291+0000", 2024-09-12T00:05:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000237762 2024-09-12T00:05:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848544+0000", 2024-09-12T00:05:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025307500000000001 2024-09-12T00:05:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.860024+0000", 2024-09-12T00:05:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011479390000000001 2024-09-12T00:05:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.862880+0000", 2024-09-12T00:05:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002856833 2024-09-12T00:05:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.863048+0000", 2024-09-12T00:05:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016796700000000001 2024-09-12T00:05:11.885 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.885 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.885 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:11.885 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.863197+0000", 2024-09-12T00:05:11.885 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148768 2024-09-12T00:05:11.885 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.885 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:11.885 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.885 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.885 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.885 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2727 3.39 e63/23 3:9c63b475:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_212:head v 63'3, mlcod=62'1)", 2024-09-12T00:05:11.886 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:05:11.886 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 23.923908516000001, 2024-09-12T00:05:11.886 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016224526999999999, 2024-09-12T00:05:11.886 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:11.886 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:11.886 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.886 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:11.886 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.886 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:11.886 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:05:11.886 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.886 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.886 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:05:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877818+0000", 2024-09-12T00:05:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.813e-06 2024-09-12T00:05:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883917+0000", 2024-09-12T00:05:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0060993009999999997 2024-09-12T00:05:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883961+0000", 2024-09-12T00:05:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3951e-05 2024-09-12T00:05:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883992+0000", 2024-09-12T00:05:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0565000000000003e-05 2024-09-12T00:05:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884176+0000", 2024-09-12T00:05:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018378200000000001 2024-09-12T00:05:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884252+0000", 2024-09-12T00:05:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6209000000000002e-05 2024-09-12T00:05:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.893904+0000", 2024-09-12T00:05:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0096519339999999992 2024-09-12T00:05:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.894040+0000", 2024-09-12T00:05:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013597199999999999 2024-09-12T00:05:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2730 3.7 3:e3fca83c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:05:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 23.893380390000001, 2024-09-12T00:05:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022178479000000001, 2024-09-12T00:05:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2730 2024-09-12T00:05:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:05:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:05:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908346+0000", 2024-09-12T00:05:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1999999999999999e-06 2024-09-12T00:05:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912423+0000", 2024-09-12T00:05:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004076423 2024-09-12T00:05:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912472+0000", 2024-09-12T00:05:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9023999999999997e-05 2024-09-12T00:05:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912498+0000", 2024-09-12T00:05:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6591999999999999e-05 2024-09-12T00:05:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912677+0000", 2024-09-12T00:05:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017824599999999999 2024-09-12T00:05:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913094+0000", 2024-09-12T00:05:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041757799999999999 2024-09-12T00:05:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913512+0000", 2024-09-12T00:05:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000417475 2024-09-12T00:05:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.929229+0000", 2024-09-12T00:05:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015717294999999999 2024-09-12T00:05:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930204+0000", 2024-09-12T00:05:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00097506199999999996 2024-09-12T00:05:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930392+0000", 2024-09-12T00:05:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000187775 2024-09-12T00:05:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930522+0000", 2024-09-12T00:05:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012980899999999999 2024-09-12T00:05:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2753 3.7 3:e119c99e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_238:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:05:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 23.647692320000001, 2024-09-12T00:05:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.023674186999999999, 2024-09-12T00:05:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2753 2024-09-12T00:05:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:05:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:05:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154035+0000", 2024-09-12T00:05:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2799999999999999e-06 2024-09-12T00:05:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159459+0000", 2024-09-12T00:05:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054242190000000001 2024-09-12T00:05:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159509+0000", 2024-09-12T00:05:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9830999999999998e-05 2024-09-12T00:05:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159536+0000", 2024-09-12T00:05:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7438000000000001e-05 2024-09-12T00:05:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159710+0000", 2024-09-12T00:05:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017342 2024-09-12T00:05:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159961+0000", 2024-09-12T00:05:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025164499999999999 2024-09-12T00:05:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.160206+0000", 2024-09-12T00:05:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024534200000000001 2024-09-12T00:05:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177421+0000", 2024-09-12T00:05:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017214956 2024-09-12T00:05:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177534+0000", 2024-09-12T00:05:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000112223 2024-09-12T00:05:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177625+0000", 2024-09-12T00:05:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0947999999999997e-05 2024-09-12T00:05:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177706+0000", 2024-09-12T00:05:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0884999999999996e-05 2024-09-12T00:05:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2757 3.2b 3:d6dac417:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:05:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 23.581623497999999, 2024-09-12T00:05:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017779708000000002, 2024-09-12T00:05:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2757 2024-09-12T00:05:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:05:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:05:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220103+0000", 2024-09-12T00:05:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.32e-06 2024-09-12T00:05:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225042+0000", 2024-09-12T00:05:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049386200000000003 2024-09-12T00:05:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225083+0000", 2024-09-12T00:05:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1304000000000003e-05 2024-09-12T00:05:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225102+0000", 2024-09-12T00:05:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8502e-05 2024-09-12T00:05:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225256+0000", 2024-09-12T00:05:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015436099999999999 2024-09-12T00:05:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225513+0000", 2024-09-12T00:05:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000256562 2024-09-12T00:05:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225737+0000", 2024-09-12T00:05:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022379 2024-09-12T00:05:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.234281+0000", 2024-09-12T00:05:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0085440540000000006 2024-09-12T00:05:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237710+0000", 2024-09-12T00:05:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0034298380000000002 2024-09-12T00:05:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237805+0000", 2024-09-12T00:05:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4804999999999998e-05 2024-09-12T00:05:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237880+0000", 2024-09-12T00:05:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4552e-05 2024-09-12T00:05:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2764 3.2d e63/23 3:b7a0f55d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_249:head v 63'7, mlcod=63'5)", 2024-09-12T00:05:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:05:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 23.472846027999999, 2024-09-12T00:05:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018235872, 2024-09-12T00:05:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:05:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:05:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328882+0000", 2024-09-12T00:05:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5000000000000001e-06 2024-09-12T00:05:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335092+0000", 2024-09-12T00:05:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0062094730000000001 2024-09-12T00:05:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335127+0000", 2024-09-12T00:05:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5717999999999999e-05 2024-09-12T00:05:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335144+0000", 2024-09-12T00:05:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7119e-05 2024-09-12T00:05:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335308+0000", 2024-09-12T00:05:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000163757 2024-09-12T00:05:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335354+0000", 2024-09-12T00:05:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6164e-05 2024-09-12T00:05:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.346991+0000", 2024-09-12T00:05:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011636851 2024-09-12T00:05:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.347113+0000", 2024-09-12T00:05:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012229 2024-09-12T00:05:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.913 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:11.913 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:11.913 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:11.914 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:05:11.915 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:11.916+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:12.015 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:12.013+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:12.086 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:12.086 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:12.086 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:12.087 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:12.101 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:05:12.107 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:05:12.153 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:12.156+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:12.216 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:12.216+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:12.268 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:12.268 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:12.268 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:12.268 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:12.268 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:12.282 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:05:12.317 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:12.320+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:12.405 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:12.405 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:12.405 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:12.405 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:12.405 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.405 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2656 3.29 3:951a8707:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:12.405 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.253332+0000", 2024-09-12T00:05:12.405 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 25.150062868999999, 2024-09-12T00:05:12.405 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018697930000000001, 2024-09-12T00:05:12.406 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:12.406 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:12.406 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:12.406 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:12.406 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:12.406 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:12.406 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2656 2024-09-12T00:05:12.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.406 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:12.406 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.406 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:12.406 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.253332+0000", 2024-09-12T00:05:12.406 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.407 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.407 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:12.407 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.253332+0000", 2024-09-12T00:05:12.407 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.407 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.407 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:12.407 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.253336+0000", 2024-09-12T00:05:12.407 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8469999999999998e-06 2024-09-12T00:05:12.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.407 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.407 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:12.408 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.257408+0000", 2024-09-12T00:05:12.408 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040728209999999999 2024-09-12T00:05:12.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.408 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.408 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:12.408 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.257445+0000", 2024-09-12T00:05:12.408 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6284e-05 2024-09-12T00:05:12.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.408 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.408 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:12.408 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.257470+0000", 2024-09-12T00:05:12.408 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5684999999999999e-05 2024-09-12T00:05:12.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.409 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.409 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:12.409 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.257608+0000", 2024-09-12T00:05:12.409 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013792200000000001 2024-09-12T00:05:12.409 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.409 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.409 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:12.409 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.257855+0000", 2024-09-12T00:05:12.409 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024628900000000001 2024-09-12T00:05:12.409 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.409 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.409 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:12.409 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.258062+0000", 2024-09-12T00:05:12.410 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020795699999999999 2024-09-12T00:05:12.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.410 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.410 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:12.410 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266228+0000", 2024-09-12T00:05:12.410 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0081652600000000006 2024-09-12T00:05:12.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.410 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.410 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:12.411 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271871+0000", 2024-09-12T00:05:12.411 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0056437179999999998 2024-09-12T00:05:12.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.411 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.411 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:12.411 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271958+0000", 2024-09-12T00:05:12.411 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6800999999999998e-05 2024-09-12T00:05:12.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.411 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.411 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:12.411 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.272030+0000", 2024-09-12T00:05:12.411 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1346000000000004e-05 2024-09-12T00:05:12.412 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.412 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:12.412 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.412 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.412 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2661 3.1e 3:7a671bd1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:12.412 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.307344+0000", 2024-09-12T00:05:12.412 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 25.096050778999999, 2024-09-12T00:05:12.412 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020716793000000001, 2024-09-12T00:05:12.412 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:12.412 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:12.412 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:12.413 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:12.413 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:12.413 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:12.413 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2661 2024-09-12T00:05:12.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.413 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:12.413 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.413 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:12.413 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.307344+0000", 2024-09-12T00:05:12.413 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.413 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.413 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:12.414 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.307344+0000", 2024-09-12T00:05:12.414 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.414 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.414 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.414 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:12.414 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.307347+0000", 2024-09-12T00:05:12.414 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.546e-06 2024-09-12T00:05:12.414 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.414 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.414 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:12.414 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311373+0000", 2024-09-12T00:05:12.414 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040257940000000001 2024-09-12T00:05:12.414 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.415 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.415 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:12.415 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311407+0000", 2024-09-12T00:05:12.415 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4038000000000002e-05 2024-09-12T00:05:12.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.415 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.415 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:12.415 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311427+0000", 2024-09-12T00:05:12.415 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0305e-05 2024-09-12T00:05:12.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.415 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.415 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:12.415 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311547+0000", 2024-09-12T00:05:12.415 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011904999999999999 2024-09-12T00:05:12.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.416 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.416 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:12.416 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311877+0000", 2024-09-12T00:05:12.416 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00033003699999999998 2024-09-12T00:05:12.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.416 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.416 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:12.416 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.312137+0000", 2024-09-12T00:05:12.416 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026013499999999999 2024-09-12T00:05:12.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.416 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.416 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:12.417 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.320695+0000", 2024-09-12T00:05:12.417 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0085586029999999997 2024-09-12T00:05:12.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.417 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.417 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:12.417 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.327883+0000", 2024-09-12T00:05:12.417 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0071877419999999996 2024-09-12T00:05:12.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.417 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.417 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:12.417 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.327983+0000", 2024-09-12T00:05:12.417 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010008100000000001 2024-09-12T00:05:12.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.418 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.418 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:12.418 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.328061+0000", 2024-09-12T00:05:12.418 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7461999999999998e-05 2024-09-12T00:05:12.418 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.418 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:12.418 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.418 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.418 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2665 3.3d 3:bff83547:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:12.418 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.351951+0000", 2024-09-12T00:05:12.418 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 25.051443142, 2024-09-12T00:05:12.418 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019663572000000001, 2024-09-12T00:05:12.419 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:12.419 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:12.419 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:12.419 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:12.419 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:12.419 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:12.419 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2665 2024-09-12T00:05:12.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.419 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:12.419 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.419 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:12.419 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.351951+0000", 2024-09-12T00:05:12.419 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.420 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.420 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:12.420 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.351951+0000", 2024-09-12T00:05:12.420 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.420 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.420 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.420 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:12.420 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.351954+0000", 2024-09-12T00:05:12.420 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9330000000000001e-06 2024-09-12T00:05:12.420 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.420 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.420 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:12.420 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.355966+0000", 2024-09-12T00:05:12.421 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040118009999999997 2024-09-12T00:05:12.421 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.421 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.421 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:12.421 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356000+0000", 2024-09-12T00:05:12.421 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3967999999999997e-05 2024-09-12T00:05:12.421 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.421 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.421 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:12.421 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356025+0000", 2024-09-12T00:05:12.421 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4658e-05 2024-09-12T00:05:12.421 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.421 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.422 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:12.422 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356202+0000", 2024-09-12T00:05:12.422 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000176756 2024-09-12T00:05:12.422 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.422 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.422 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:12.422 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356445+0000", 2024-09-12T00:05:12.422 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024318300000000001 2024-09-12T00:05:12.422 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.422 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.422 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:12.422 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356671+0000", 2024-09-12T00:05:12.422 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000226276 2024-09-12T00:05:12.422 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.423 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:12.423 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.370776+0000", 2024-09-12T00:05:12.423 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014104604 2024-09-12T00:05:12.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.423 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:12.423 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.371306+0000", 2024-09-12T00:05:12.423 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00053036499999999998 2024-09-12T00:05:12.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.423 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:12.424 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.371521+0000", 2024-09-12T00:05:12.424 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021477000000000001 2024-09-12T00:05:12.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.424 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.424 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:12.424 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.371615+0000", 2024-09-12T00:05:12.424 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4258000000000005e-05 2024-09-12T00:05:12.424 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.424 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:12.424 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.424 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.424 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2689 3.3d 3:bfc0a94d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:12.424 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.494580+0000", 2024-09-12T00:05:12.425 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.908814867, 2024-09-12T00:05:12.425 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019076037000000001, 2024-09-12T00:05:12.425 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:12.425 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:12.425 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:12.425 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:12.425 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:12.425 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:12.425 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2689 2024-09-12T00:05:12.425 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.425 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:12.425 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.425 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:12.426 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.494580+0000", 2024-09-12T00:05:12.426 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.426 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.426 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:12.426 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.494580+0000", 2024-09-12T00:05:12.426 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.426 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.426 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:12.426 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.494582+0000", 2024-09-12T00:05:12.426 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2029999999999999e-06 2024-09-12T00:05:12.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.427 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.427 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:12.427 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498633+0000", 2024-09-12T00:05:12.427 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040508430000000002 2024-09-12T00:05:12.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.427 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.427 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:12.427 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498664+0000", 2024-09-12T00:05:12.427 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1273999999999999e-05 2024-09-12T00:05:12.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.427 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.427 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:12.427 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498680+0000", 2024-09-12T00:05:12.428 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5783000000000001e-05 2024-09-12T00:05:12.428 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.428 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.428 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:12.428 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498864+0000", 2024-09-12T00:05:12.428 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184635 2024-09-12T00:05:12.428 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.428 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.428 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:12.428 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.499108+0000", 2024-09-12T00:05:12.428 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000243883 2024-09-12T00:05:12.428 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.428 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.428 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:12.429 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.499335+0000", 2024-09-12T00:05:12.429 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000226729 2024-09-12T00:05:12.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.429 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.429 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:12.429 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.512376+0000", 2024-09-12T00:05:12.429 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013040629999999999 2024-09-12T00:05:12.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.429 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.429 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:12.429 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.513496+0000", 2024-09-12T00:05:12.429 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0011198409999999999 2024-09-12T00:05:12.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.429 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.430 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:12.430 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.513587+0000", 2024-09-12T00:05:12.430 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1199999999999994e-05 2024-09-12T00:05:12.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.430 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.430 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:12.430 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.513656+0000", 2024-09-12T00:05:12.430 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9016000000000005e-05 2024-09-12T00:05:12.430 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.430 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:12.430 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.430 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.431 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2693 3.1e 3:7a8f9e2c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:12.431 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.536006+0000", 2024-09-12T00:05:12.431 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.867388743999999, 2024-09-12T00:05:12.431 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019831418999999999, 2024-09-12T00:05:12.431 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:12.431 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:12.431 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:12.431 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:12.431 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:12.431 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:12.431 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2693 2024-09-12T00:05:12.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.431 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:12.431 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.431 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:12.432 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.536006+0000", 2024-09-12T00:05:12.432 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.432 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.432 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:12.432 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.536006+0000", 2024-09-12T00:05:12.432 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.432 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.432 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:12.432 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.536010+0000", 2024-09-12T00:05:12.432 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.737e-06 2024-09-12T00:05:12.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.432 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.433 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:12.433 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.539958+0000", 2024-09-12T00:05:12.433 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003948315 2024-09-12T00:05:12.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.433 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.433 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:12.433 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.539997+0000", 2024-09-12T00:05:12.433 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9131000000000002e-05 2024-09-12T00:05:12.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.433 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.433 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:12.433 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.540016+0000", 2024-09-12T00:05:12.433 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9018e-05 2024-09-12T00:05:12.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.434 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.434 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:12.434 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.540148+0000", 2024-09-12T00:05:12.434 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013242899999999999 2024-09-12T00:05:12.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.434 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.434 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:12.434 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.540394+0000", 2024-09-12T00:05:12.434 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024580899999999999 2024-09-12T00:05:12.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.434 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.435 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:12.435 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.540622+0000", 2024-09-12T00:05:12.435 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022765599999999999 2024-09-12T00:05:12.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.435 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.435 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:12.435 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.547587+0000", 2024-09-12T00:05:12.435 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0069649259999999998 2024-09-12T00:05:12.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.435 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.435 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:12.435 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.555622+0000", 2024-09-12T00:05:12.435 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0080352640000000003 2024-09-12T00:05:12.436 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.436 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.436 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:12.436 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.555724+0000", 2024-09-12T00:05:12.436 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010187399999999999 2024-09-12T00:05:12.436 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.436 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.436 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:12.436 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.555837+0000", 2024-09-12T00:05:12.436 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011326 2024-09-12T00:05:12.436 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.436 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:12.436 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.437 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.437 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2694 3.3d 3:bd0bdafc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:12.437 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:12.437 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.857866190999999, 2024-09-12T00:05:12.437 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.026139741000000001, 2024-09-12T00:05:12.437 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:12.437 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:12.437 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:12.437 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:12.437 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:12.437 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:12.437 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2694 2024-09-12T00:05:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545532+0000", 2024-09-12T00:05:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8199999999999998e-06 2024-09-12T00:05:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551454+0000", 2024-09-12T00:05:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059222340000000002 2024-09-12T00:05:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551485+0000", 2024-09-12T00:05:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0173999999999999e-05 2024-09-12T00:05:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551504+0000", 2024-09-12T00:05:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9726000000000001e-05 2024-09-12T00:05:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551708+0000", 2024-09-12T00:05:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020344100000000001 2024-09-12T00:05:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552087+0000", 2024-09-12T00:05:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000379327 2024-09-12T00:05:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552351+0000", 2024-09-12T00:05:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026349199999999999 2024-09-12T00:05:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.569375+0000", 2024-09-12T00:05:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017024432999999999 2024-09-12T00:05:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571222+0000", 2024-09-12T00:05:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00184688 2024-09-12T00:05:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571511+0000", 2024-09-12T00:05:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028897599999999998 2024-09-12T00:05:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571668+0000", 2024-09-12T00:05:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000157238 2024-09-12T00:05:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2698 3.3d 3:bcafb0f9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.813412488000001, 2024-09-12T00:05:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025133152999999998, 2024-09-12T00:05:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2698 2024-09-12T00:05:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589986+0000", 2024-09-12T00:05:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5999999999999998e-06 2024-09-12T00:05:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594109+0000", 2024-09-12T00:05:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041230770000000002 2024-09-12T00:05:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594146+0000", 2024-09-12T00:05:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7722000000000002e-05 2024-09-12T00:05:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594167+0000", 2024-09-12T00:05:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0100999999999999e-05 2024-09-12T00:05:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594297+0000", 2024-09-12T00:05:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013051600000000001 2024-09-12T00:05:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594570+0000", 2024-09-12T00:05:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000272837 2024-09-12T00:05:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594846+0000", 2024-09-12T00:05:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027622399999999999 2024-09-12T00:05:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.606026+0000", 2024-09-12T00:05:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011179947000000001 2024-09-12T00:05:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.614827+0000", 2024-09-12T00:05:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0088013259999999999 2024-09-12T00:05:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.614988+0000", 2024-09-12T00:05:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016018799999999999 2024-09-12T00:05:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.615115+0000", 2024-09-12T00:05:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000127615 2024-09-12T00:05:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2699 3.0 3:02470ff9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.597879+0000", 2024-09-12T00:05:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.805515399000001, 2024-09-12T00:05:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021498363, 2024-09-12T00:05:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2699 2024-09-12T00:05:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.597879+0000", 2024-09-12T00:05:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.597879+0000", 2024-09-12T00:05:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.597884+0000", 2024-09-12T00:05:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1769999999999997e-06 2024-09-12T00:05:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602129+0000", 2024-09-12T00:05:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042451399999999997 2024-09-12T00:05:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602170+0000", 2024-09-12T00:05:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0194000000000002e-05 2024-09-12T00:05:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602198+0000", 2024-09-12T00:05:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7861999999999999e-05 2024-09-12T00:05:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602392+0000", 2024-09-12T00:05:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000194122 2024-09-12T00:05:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602801+0000", 2024-09-12T00:05:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040957199999999997 2024-09-12T00:05:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.603203+0000", 2024-09-12T00:05:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040166900000000001 2024-09-12T00:05:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.611989+0000", 2024-09-12T00:05:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0087860170000000001 2024-09-12T00:05:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.619177+0000", 2024-09-12T00:05:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0071878819999999996 2024-09-12T00:05:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.619270+0000", 2024-09-12T00:05:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2930999999999995e-05 2024-09-12T00:05:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.619378+0000", 2024-09-12T00:05:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000107797 2024-09-12T00:05:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2712 3.3e 3:7d3d0242:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.676512210999999, 2024-09-12T00:05:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022816941, 2024-09-12T00:05:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2712 2024-09-12T00:05:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726886+0000", 2024-09-12T00:05:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5329999999999999e-06 2024-09-12T00:05:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730802+0000", 2024-09-12T00:05:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039158700000000001 2024-09-12T00:05:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730839+0000", 2024-09-12T00:05:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6857999999999998e-05 2024-09-12T00:05:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730856+0000", 2024-09-12T00:05:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7371999999999999e-05 2024-09-12T00:05:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731026+0000", 2024-09-12T00:05:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017011000000000001 2024-09-12T00:05:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731444+0000", 2024-09-12T00:05:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041766500000000001 2024-09-12T00:05:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731860+0000", 2024-09-12T00:05:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041618500000000001 2024-09-12T00:05:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.743012+0000", 2024-09-12T00:05:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011152123 2024-09-12T00:05:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749386+0000", 2024-09-12T00:05:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0063743130000000004 2024-09-12T00:05:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749562+0000", 2024-09-12T00:05:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017590300000000001 2024-09-12T00:05:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749699+0000", 2024-09-12T00:05:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000137009 2024-09-12T00:05:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2714 3.17 3:eac65a57:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.746943+0000", 2024-09-12T00:05:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.656451968999999, 2024-09-12T00:05:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019462007, 2024-09-12T00:05:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2714 2024-09-12T00:05:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.746943+0000", 2024-09-12T00:05:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.746943+0000", 2024-09-12T00:05:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.746946+0000", 2024-09-12T00:05:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9529999999999999e-06 2024-09-12T00:05:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751163+0000", 2024-09-12T00:05:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042169859999999998 2024-09-12T00:05:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751188+0000", 2024-09-12T00:05:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5908e-05 2024-09-12T00:05:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751203+0000", 2024-09-12T00:05:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4491999999999999e-05 2024-09-12T00:05:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751324+0000", 2024-09-12T00:05:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120866 2024-09-12T00:05:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751572+0000", 2024-09-12T00:05:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024774900000000002 2024-09-12T00:05:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751798+0000", 2024-09-12T00:05:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022655700000000001 2024-09-12T00:05:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761058+0000", 2024-09-12T00:05:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0092603110000000002 2024-09-12T00:05:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.766067+0000", 2024-09-12T00:05:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005009009 2024-09-12T00:05:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.766264+0000", 2024-09-12T00:05:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00019632800000000001 2024-09-12T00:05:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.766405+0000", 2024-09-12T00:05:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000140848 2024-09-12T00:05:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2715 3.18 3:19a9b410:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.647135921, 2024-09-12T00:05:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022391956000000001, 2024-09-12T00:05:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2715 2024-09-12T00:05:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756262+0000", 2024-09-12T00:05:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9629999999999998e-06 2024-09-12T00:05:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760936+0000", 2024-09-12T00:05:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046745750000000003 2024-09-12T00:05:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.470 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.470 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:12.470 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760968+0000", 2024-09-12T00:05:12.470 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1470999999999997e-05 2024-09-12T00:05:12.470 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.470 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.470 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:12.470 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760985+0000", 2024-09-12T00:05:12.470 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7771999999999999e-05 2024-09-12T00:05:12.470 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.470 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.470 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:12.470 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761154+0000", 2024-09-12T00:05:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016875399999999999 2024-09-12T00:05:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761571+0000", 2024-09-12T00:05:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000417231 2024-09-12T00:05:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761996+0000", 2024-09-12T00:05:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042500200000000001 2024-09-12T00:05:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777182+0000", 2024-09-12T00:05:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015185664999999999 2024-09-12T00:05:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778484+0000", 2024-09-12T00:05:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00130225 2024-09-12T00:05:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778575+0000", 2024-09-12T00:05:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0258000000000002e-05 2024-09-12T00:05:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778651+0000", 2024-09-12T00:05:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6014999999999996e-05 2024-09-12T00:05:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2717 3.1a e63/23 3:5be58560:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_202:head v 63'4, mlcod=63'2)", 2024-09-12T00:05:12.474 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.777964+0000", 2024-09-12T00:05:12.474 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.625430901000001, 2024-09-12T00:05:12.474 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015392704, 2024-09-12T00:05:12.474 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:12.474 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:12.474 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:12.474 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:12.474 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.474 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:12.474 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777964+0000", 2024-09-12T00:05:12.474 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.474 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.474 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.474 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:12.475 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777964+0000", 2024-09-12T00:05:12.475 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.475 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.475 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.475 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:12.475 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777966+0000", 2024-09-12T00:05:12.475 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6400000000000001e-06 2024-09-12T00:05:12.475 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.475 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.475 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:12.475 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.784444+0000", 2024-09-12T00:05:12.475 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064781179999999997 2024-09-12T00:05:12.475 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.784479+0000", 2024-09-12T00:05:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4267999999999998e-05 2024-09-12T00:05:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.784495+0000", 2024-09-12T00:05:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6388999999999998e-05 2024-09-12T00:05:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.784609+0000", 2024-09-12T00:05:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000114209 2024-09-12T00:05:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.784650+0000", 2024-09-12T00:05:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0515000000000001e-05 2024-09-12T00:05:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793224+0000", 2024-09-12T00:05:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0085740060000000003 2024-09-12T00:05:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793356+0000", 2024-09-12T00:05:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000132559 2024-09-12T00:05:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2718 3.4 e63/23 3:20fe36bb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_203:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.793296+0000", 2024-09-12T00:05:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.61009808, 2024-09-12T00:05:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015716714, 2024-09-12T00:05:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:12.479 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:12.479 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:12.479 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:12.479 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.479 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:12.479 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793296+0000", 2024-09-12T00:05:12.480 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.480 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.480 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.480 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:12.480 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793296+0000", 2024-09-12T00:05:12.480 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.481 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.481 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.481 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:12.481 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793298+0000", 2024-09-12T00:05:12.481 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0200000000000001e-06 2024-09-12T00:05:12.481 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.481 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.797364+0000", 2024-09-12T00:05:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040657039999999998 2024-09-12T00:05:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.797404+0000", 2024-09-12T00:05:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0302000000000001e-05 2024-09-12T00:05:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.797423+0000", 2024-09-12T00:05:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8308000000000002e-05 2024-09-12T00:05:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.797582+0000", 2024-09-12T00:05:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000159047 2024-09-12T00:05:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.797650+0000", 2024-09-12T00:05:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.7832999999999999e-05 2024-09-12T00:05:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808882+0000", 2024-09-12T00:05:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011231837999999999 2024-09-12T00:05:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.487 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:12.487 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.809013+0000", 2024-09-12T00:05:12.487 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000131662 2024-09-12T00:05:12.487 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.487 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:12.487 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.488 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.488 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.488 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2726 3.3e 3:7fc616c8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:12.488 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.866346+0000", 2024-09-12T00:05:12.488 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.537048311, 2024-09-12T00:05:12.489 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018314736000000002, 2024-09-12T00:05:12.489 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:12.489 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:12.489 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:12.489 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:12.489 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:12.490 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:12.490 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2726 2024-09-12T00:05:12.490 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.490 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:12.490 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.490 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:12.491 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.866346+0000", 2024-09-12T00:05:12.491 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.491 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.491 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:12.491 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.866346+0000", 2024-09-12T00:05:12.492 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.492 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.492 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.492 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:12.492 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.866350+0000", 2024-09-12T00:05:12.493 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.54e-06 2024-09-12T00:05:12.493 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.493 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.493 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:12.493 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.870325+0000", 2024-09-12T00:05:12.493 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003975353 2024-09-12T00:05:12.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.494 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.494 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:12.494 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.870362+0000", 2024-09-12T00:05:12.494 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6591000000000003e-05 2024-09-12T00:05:12.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.495 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.495 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:12.495 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.870380+0000", 2024-09-12T00:05:12.495 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7921999999999999e-05 2024-09-12T00:05:12.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.495 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.496 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:12.496 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.870510+0000", 2024-09-12T00:05:12.496 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013024600000000001 2024-09-12T00:05:12.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.496 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.496 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:12.497 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.870921+0000", 2024-09-12T00:05:12.497 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041149600000000002 2024-09-12T00:05:12.497 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.497 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.497 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:12.497 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.871207+0000", 2024-09-12T00:05:12.498 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028534600000000002 2024-09-12T00:05:12.498 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.498 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.498 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:12.498 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.880787+0000", 2024-09-12T00:05:12.498 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095802300000000003 2024-09-12T00:05:12.499 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.499 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.499 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:12.499 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884454+0000", 2024-09-12T00:05:12.499 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0036669480000000002 2024-09-12T00:05:12.499 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.500 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.500 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:12.500 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884546+0000", 2024-09-12T00:05:12.500 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1625000000000005e-05 2024-09-12T00:05:12.500 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.500 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.500 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:12.501 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884661+0000", 2024-09-12T00:05:12.501 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000115439 2024-09-12T00:05:12.501 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.501 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:12.501 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.502 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.502 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2728 3.1f 3:faea8f78:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:12.502 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.887643+0000", 2024-09-12T00:05:12.502 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.515751612999999, 2024-09-12T00:05:12.502 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017919767, 2024-09-12T00:05:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:12.504 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:12.504 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2728 2024-09-12T00:05:12.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.504 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:12.504 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.504 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:12.504 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.887643+0000", 2024-09-12T00:05:12.505 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.505 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.505 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:12.505 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.887643+0000", 2024-09-12T00:05:12.505 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.506 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.506 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:12.506 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.887647+0000", 2024-09-12T00:05:12.506 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.754e-06 2024-09-12T00:05:12.506 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.506 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.506 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.891952+0000", 2024-09-12T00:05:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043048690000000002 2024-09-12T00:05:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.891990+0000", 2024-09-12T00:05:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8005e-05 2024-09-12T00:05:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.508 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.508 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:12.508 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.892008+0000", 2024-09-12T00:05:12.508 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7995999999999998e-05 2024-09-12T00:05:12.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.508 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.508 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:12.509 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.892140+0000", 2024-09-12T00:05:12.509 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013216200000000001 2024-09-12T00:05:12.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.509 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.509 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:12.509 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.892393+0000", 2024-09-12T00:05:12.509 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025355799999999997 2024-09-12T00:05:12.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.510 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.510 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:12.510 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.892620+0000", 2024-09-12T00:05:12.510 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022690000000000001 2024-09-12T00:05:12.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.510 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902865+0000", 2024-09-12T00:05:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010244684 2024-09-12T00:05:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.905386+0000", 2024-09-12T00:05:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0025208800000000001 2024-09-12T00:05:12.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.512 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:12.512 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.905480+0000", 2024-09-12T00:05:12.512 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4493999999999993e-05 2024-09-12T00:05:12.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.513 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:12.513 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.905563+0000", 2024-09-12T00:05:12.513 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2465000000000004e-05 2024-09-12T00:05:12.513 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.513 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:12.513 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.514 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.514 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2729 3.0 3:01c0e0c9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:12.514 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:12.514 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.506255105000001, 2024-09-12T00:05:12.514 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025173068, 2024-09-12T00:05:12.515 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:12.515 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:12.515 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:12.515 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:12.515 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:12.515 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2729 2024-09-12T00:05:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:12.517 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:12.517 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.517 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:12.517 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:12.518 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.518 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.518 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:12.518 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897143+0000", 2024-09-12T00:05:12.518 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6600000000000001e-06 2024-09-12T00:05:12.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.519 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.519 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:12.519 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901595+0000", 2024-09-12T00:05:12.519 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044514680000000001 2024-09-12T00:05:12.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.520 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:12.520 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901629+0000", 2024-09-12T00:05:12.520 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4864999999999999e-05 2024-09-12T00:05:12.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.521 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:12.521 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901647+0000", 2024-09-12T00:05:12.521 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7699000000000001e-05 2024-09-12T00:05:12.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.521 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.522 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:12.522 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901780+0000", 2024-09-12T00:05:12.522 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013271499999999999 2024-09-12T00:05:12.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.522 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.522 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:12.522 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902010+0000", 2024-09-12T00:05:12.523 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022977300000000001 2024-09-12T00:05:12.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.523 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:12.523 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902222+0000", 2024-09-12T00:05:12.524 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021262399999999999 2024-09-12T00:05:12.524 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.524 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.524 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:12.524 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912402+0000", 2024-09-12T00:05:12.524 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010180203000000001 2024-09-12T00:05:12.525 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.525 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.525 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:12.525 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.921990+0000", 2024-09-12T00:05:12.525 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095871900000000006 2024-09-12T00:05:12.525 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.526 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.526 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:12.526 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.922166+0000", 2024-09-12T00:05:12.526 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017591899999999999 2024-09-12T00:05:12.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.527 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.527 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:12.527 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.922313+0000", 2024-09-12T00:05:12.527 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000146952 2024-09-12T00:05:12.527 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.527 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:12.528 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.528 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.528 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.528 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2732 3.1f 3:f85b64cb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:12.528 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:12.528 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.474809316999998, 2024-09-12T00:05:12.529 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022644154, 2024-09-12T00:05:12.529 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:12.529 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:12.529 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:12.529 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:12.529 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:12.530 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:12.530 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2732 2024-09-12T00:05:12.530 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.530 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:12.530 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.531 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:12.531 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:12.531 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.531 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.531 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.531 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:12.532 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:12.532 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.532 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.532 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.532 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:12.532 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928589+0000", 2024-09-12T00:05:12.533 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1230000000000002e-06 2024-09-12T00:05:12.533 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.533 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.533 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:12.533 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932650+0000", 2024-09-12T00:05:12.533 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040611049999999997 2024-09-12T00:05:12.534 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.534 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.534 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:12.534 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932692+0000", 2024-09-12T00:05:12.534 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1677000000000001e-05 2024-09-12T00:05:12.535 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.535 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.535 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:12.535 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932711+0000", 2024-09-12T00:05:12.535 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8749e-05 2024-09-12T00:05:12.535 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.536 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.536 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:12.536 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932834+0000", 2024-09-12T00:05:12.536 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012278300000000001 2024-09-12T00:05:12.536 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.536 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.537 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:12.537 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.933095+0000", 2024-09-12T00:05:12.537 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026151100000000002 2024-09-12T00:05:12.537 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.537 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.537 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:12.538 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.933385+0000", 2024-09-12T00:05:12.538 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028993900000000002 2024-09-12T00:05:12.538 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.538 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.538 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:12.538 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.950988+0000", 2024-09-12T00:05:12.539 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017603119 2024-09-12T00:05:12.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.539 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.539 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:12.539 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951018+0000", 2024-09-12T00:05:12.539 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9343999999999999e-05 2024-09-12T00:05:12.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.540 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.540 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:12.540 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951109+0000", 2024-09-12T00:05:12.540 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1157999999999997e-05 2024-09-12T00:05:12.540 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.540 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.541 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:12.541 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951229+0000", 2024-09-12T00:05:12.541 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120646 2024-09-12T00:05:12.541 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.541 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:12.541 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.542 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.542 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.542 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2741 3.17 3:e9d72553:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:12.542 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.026321+0000", 2024-09-12T00:05:12.542 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.37707369, 2024-09-12T00:05:12.542 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018394443, 2024-09-12T00:05:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2741 2024-09-12T00:05:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:12.544 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.544 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:12.544 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.026321+0000", 2024-09-12T00:05:12.544 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.544 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.544 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.544 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:12.544 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.026321+0000", 2024-09-12T00:05:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.026325+0000", 2024-09-12T00:05:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9670000000000003e-06 2024-09-12T00:05:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030370+0000", 2024-09-12T00:05:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040448189999999998 2024-09-12T00:05:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030408+0000", 2024-09-12T00:05:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8481e-05 2024-09-12T00:05:12.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.547 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.547 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:12.547 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030426+0000", 2024-09-12T00:05:12.547 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8236e-05 2024-09-12T00:05:12.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.548 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.548 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:12.548 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030588+0000", 2024-09-12T00:05:12.548 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000161614 2024-09-12T00:05:12.548 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.548 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.548 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030854+0000", 2024-09-12T00:05:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026595699999999999 2024-09-12T00:05:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.031124+0000", 2024-09-12T00:05:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027049799999999998 2024-09-12T00:05:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.039845+0000", 2024-09-12T00:05:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00872063 2024-09-12T00:05:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.044412+0000", 2024-09-12T00:05:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045666860000000004 2024-09-12T00:05:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.044589+0000", 2024-09-12T00:05:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000176789 2024-09-12T00:05:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.044715+0000", 2024-09-12T00:05:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000126766 2024-09-12T00:05:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.552 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2747 3.17 3:eaa4528d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:12.552 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:12.552 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.314472832, 2024-09-12T00:05:12.552 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025552734000000001, 2024-09-12T00:05:12.552 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:12.552 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:12.553 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:12.553 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:12.553 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:12.553 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:12.553 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2747 2024-09-12T00:05:12.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.554 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:12.554 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.554 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:12.554 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:12.554 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.555 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.555 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:12.555 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:12.555 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.555 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.555 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.556 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:12.556 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088925+0000", 2024-09-12T00:05:12.556 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7759999999999999e-06 2024-09-12T00:05:12.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.556 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.557 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:12.557 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093002+0000", 2024-09-12T00:05:12.557 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004076405 2024-09-12T00:05:12.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.557 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:12.558 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093040+0000", 2024-09-12T00:05:12.558 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8093999999999998e-05 2024-09-12T00:05:12.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.558 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.558 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:12.558 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093059+0000", 2024-09-12T00:05:12.558 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8736000000000002e-05 2024-09-12T00:05:12.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.559 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.559 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:12.559 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093230+0000", 2024-09-12T00:05:12.559 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000170853 2024-09-12T00:05:12.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.559 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.559 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:12.559 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093627+0000", 2024-09-12T00:05:12.559 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039781400000000002 2024-09-12T00:05:12.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.559 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.559 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:12.560 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.094044+0000", 2024-09-12T00:05:12.560 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000416205 2024-09-12T00:05:12.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.560 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.560 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:12.560 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.103528+0000", 2024-09-12T00:05:12.560 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0094841549999999993 2024-09-12T00:05:12.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.561 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.561 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:12.561 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112299+0000", 2024-09-12T00:05:12.561 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0087711590000000006 2024-09-12T00:05:12.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.561 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.562 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:12.562 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112397+0000", 2024-09-12T00:05:12.562 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8095000000000002e-05 2024-09-12T00:05:12.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.562 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:12.562 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.114474+0000", 2024-09-12T00:05:12.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020774420000000001 2024-09-12T00:05:12.563 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.563 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:12.563 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.563 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.564 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2748 3.3b e63/23 3:df6d92a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_233:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:12.564 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.104676+0000", 2024-09-12T00:05:12.564 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.298718454999999, 2024-09-12T00:05:12.564 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016872637999999999, 2024-09-12T00:05:12.564 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:12.564 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:12.564 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:12.564 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:12.565 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.565 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:12.565 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.104676+0000", 2024-09-12T00:05:12.565 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.565 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.565 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:12.566 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.104676+0000", 2024-09-12T00:05:12.566 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:12.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.566 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:12.566 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.104678+0000", 2024-09-12T00:05:12.566 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5400000000000001e-06 2024-09-12T00:05:12.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.567 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.567 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:12.567 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.108632+0000", 2024-09-12T00:05:12.567 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039548650000000001 2024-09-12T00:05:12.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.567 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.568 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:12.568 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.108662+0000", 2024-09-12T00:05:12.568 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9235999999999999e-05 2024-09-12T00:05:12.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.568 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:12.568 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.108677+0000", 2024-09-12T00:05:12.569 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5455999999999999e-05 2024-09-12T00:05:12.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.569 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.569 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:12.569 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.108845+0000", 2024-09-12T00:05:12.569 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016741299999999999 2024-09-12T00:05:12.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:12.570 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.108906+0000", 2024-09-12T00:05:12.570 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1283000000000003e-05 2024-09-12T00:05:12.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:12.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.121360+0000", 2024-09-12T00:05:12.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012454036 2024-09-12T00:05:12.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:12.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:12.571 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:12.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.121549+0000", 2024-09-12T00:05:12.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018880899999999999 2024-09-12T00:05:12.572 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.572 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:12.572 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.572 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:12.572 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:12.572 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:12.575 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T00:05:12.576 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:05:12.576 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:12.573+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:12.674 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:12.676+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:12.717 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:05:12.751 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:12.751 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:12.751 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:12.751 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:12.765 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:05:12.775 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:12.776+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:12.876 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:12.876+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:12.878 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:12.878 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:12.890 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:12.890 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:12.890 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:12.891 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:12.891 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:12.895 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:12.895 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:12.905 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:05:12.912 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:12.912 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:12.928 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:12.929 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:12.948 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:12.948 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:12.966 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:12.966 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:12.976 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:12.976+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:12.984 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:13.003 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:13.004 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:13.028 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:13.028 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:13.042 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:05:13.077 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:13.080+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:13.159 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:13.159 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:13.174 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:05:13.178 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:13.173+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:13.278 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:13.277+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:13.292 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:13.292 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:13.307 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:05:13.379 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:13.380+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:13.477 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:13.478 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:13.481 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:13.480+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:13.492 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:05:13.581 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:13.584+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:13.628 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:13.628 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:13.643 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:05:13.686 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:13.688+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:13.784 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:13.781+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:13.814 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:13.814 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:13.828 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:05:13.885 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:13.884+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:13.947 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:13.948 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:13.962 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:05:13.986 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:13.985+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:14.086 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:14.088+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:14.135 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:14.135 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:14.149 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:05:14.187 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:14.185+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:14.288 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:14.289+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:14.321 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:14.321 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:14.336 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:05:14.389 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:14.385+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:14.466 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:14.466 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:14.480 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:05:14.489 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:14.485+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:14.578 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:05:14.592 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:14.589+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:14.607 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:14.607 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:14.622 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:05:14.691 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:14.693+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:14.792 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:14.792+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:14.797 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:14.799 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:14.812 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:05:14.893 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:14.889+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:14.975 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:14.975 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:14.990 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:05:14.994 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:14.993+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:15.023 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:05:15.095 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:15.097+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:15.114 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:15.114 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:15.128 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:05:15.176 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:15.176 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:15.194 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:15.194 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:15.195 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:15.196+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:15.211 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:15.211 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:15.227 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:15.228 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:15.247 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:15.247 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:15.247 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:05:15.247 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:05:15.248 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:15.249 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:15.249 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:15.261 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:05:15.270 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:15.270 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:15.292 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:15.292 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:15.297 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:15.293+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:15.314 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:15.314 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:15.391 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:15.391 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:05:15.391 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:05:15.391 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:05:15.391 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.391 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4232.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-12T00:05:15.391 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:05:15.392 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 118.842890744, 2024-09-12T00:05:15.392 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.049385680000000001, 2024-09-12T00:05:15.392 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:15.392 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:15.392 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:15.392 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:15.392 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4232", 2024-09-12T00:05:15.392 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/3037249369", 2024-09-12T00:05:15.392 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:05:15.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.392 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:15.392 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:15.392 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:05:15.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.393 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:15.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548447+0000", 2024-09-12T00:05:15.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.393 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:15.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548454+0000", 2024-09-12T00:05:15.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2259999999999999e-06 2024-09-12T00:05:15.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.393 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:15.394 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548466+0000", 2024-09-12T00:05:15.394 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1361e-05 2024-09-12T00:05:15.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.394 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.394 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:15.394 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548492+0000", 2024-09-12T00:05:15.394 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6225999999999999e-05 2024-09-12T00:05:15.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.394 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.394 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:15.394 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.548509+0000", 2024-09-12T00:05:15.394 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7452000000000002e-05 2024-09-12T00:05:15.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.395 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.395 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.395 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549371+0000", 2024-09-12T00:05:15.395 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00086204300000000005 2024-09-12T00:05:15.395 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.395 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.395 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:05:15.395 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.549396+0000", 2024-09-12T00:05:15.395 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.51e-05 2024-09-12T00:05:15.395 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.395 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.395 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.395 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593253+0000", 2024-09-12T00:05:15.395 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.043856248 2024-09-12T00:05:15.395 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.396 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.396 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:15.396 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.593517+0000", 2024-09-12T00:05:15.396 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026439299999999997 2024-09-12T00:05:15.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.396 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.396 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:15.396 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.594046+0000", 2024-09-12T00:05:15.396 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00052854200000000001 2024-09-12T00:05:15.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.396 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.396 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:15.396 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597642+0000", 2024-09-12T00:05:15.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0035959070000000002 2024-09-12T00:05:15.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.397 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:15.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597670+0000", 2024-09-12T00:05:15.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8235999999999999e-05 2024-09-12T00:05:15.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.397 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:15.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597754+0000", 2024-09-12T00:05:15.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4009000000000002e-05 2024-09-12T00:05:15.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.397 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:15.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:16.597833+0000", 2024-09-12T00:05:15.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8937000000000007e-05 2024-09-12T00:05:15.398 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.398 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:15.398 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.398 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T00:05:15.398 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:05:15.398 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 106.06168097600001, 2024-09-12T00:05:15.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025928692999999999, 2024-09-12T00:05:15.398 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:15.398 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:15.398 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "reached pg", 2024-09-12T00:05:15.398 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:15.399 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:15.399 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:15.399 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 43 2024-09-12T00:05:15.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.399 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:15.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:15.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:05:15.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:15.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329657+0000", 2024-09-12T00:05:15.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.400 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:15.400 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329660+0000", 2024-09-12T00:05:15.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.965e-06 2024-09-12T00:05:15.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.400 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:15.400 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329673+0000", 2024-09-12T00:05:15.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3402e-05 2024-09-12T00:05:15.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.400 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:15.400 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329706+0000", 2024-09-12T00:05:15.401 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2441000000000003e-05 2024-09-12T00:05:15.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.401 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:15.401 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.329723+0000", 2024-09-12T00:05:15.401 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7609e-05 2024-09-12T00:05:15.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.401 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.401 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330437+0000", 2024-09-12T00:05:15.401 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00071403500000000002 2024-09-12T00:05:15.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.401 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op must wait for map", 2024-09-12T00:05:15.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.330454+0000", 2024-09-12T00:05:15.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6820000000000002e-05 2024-09-12T00:05:15.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.402 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347344+0000", 2024-09-12T00:05:15.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016890275 2024-09-12T00:05:15.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.402 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:05:15.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.347365+0000", 2024-09-12T00:05:15.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0350999999999999e-05 2024-09-12T00:05:15.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.402 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355323+0000", 2024-09-12T00:05:15.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079579400000000002 2024-09-12T00:05:15.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.403 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:15.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:29.355585+0000", 2024-09-12T00:05:15.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026285499999999999 2024-09-12T00:05:15.403 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.403 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:15.403 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.403 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1641 3.26 e58/23 3:658fe58e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2__shadow_.hDHTDpIswwqRA2bHiHVxkhWqZde6XEj_1:head v 58'1, mlcod=0'0)", 2024-09-12T00:05:15.403 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:05:15.403 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 42.332322472999998, 2024-09-12T00:05:15.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014950144, 2024-09-12T00:05:15.404 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:15.404 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:15.404 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:15.404 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:15.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:15.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:05:15.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:15.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059015+0000", 2024-09-12T00:05:15.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:15.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.059017+0000", 2024-09-12T00:05:15.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.508e-06 2024-09-12T00:05:15.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:15.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061582+0000", 2024-09-12T00:05:15.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025654010000000001 2024-09-12T00:05:15.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:15.406 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061607+0000", 2024-09-12T00:05:15.406 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5028000000000002e-05 2024-09-12T00:05:15.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.406 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:15.406 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061619+0000", 2024-09-12T00:05:15.406 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1905999999999999e-05 2024-09-12T00:05:15.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.406 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.406 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061696+0000", 2024-09-12T00:05:15.406 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7305999999999995e-05 2024-09-12T00:05:15.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.406 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:15.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.061717+0000", 2024-09-12T00:05:15.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0380000000000001e-05 2024-09-12T00:05:15.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:15.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073925+0000", 2024-09-12T00:05:15.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012208088000000001 2024-09-12T00:05:15.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:15.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.073965+0000", 2024-09-12T00:05:15.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0527e-05 2024-09-12T00:05:15.407 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.407 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:15.408 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.408 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:1775 3.30 3:0c2ae78d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3__shadow_.mOl9TXXMg31caFEDICGSLJDUqsimU2V_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:05:15.408 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:05:15.408 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 41.392485155000003, 2024-09-12T00:05:15.408 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020783729000000001, 2024-09-12T00:05:15.408 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:15.408 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:15.408 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:15.408 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:15.408 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:15.408 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:15.408 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1775 2024-09-12T00:05:15.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.409 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:15.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:15.409 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:05:15.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.412 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.412 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:15.412 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998853+0000", 2024-09-12T00:05:15.412 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.413 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:15.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:33.998856+0000", 2024-09-12T00:05:15.413 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6849999999999999e-06 2024-09-12T00:05:15.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.413 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:15.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001327+0000", 2024-09-12T00:05:15.413 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024706279999999999 2024-09-12T00:05:15.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.413 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:15.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001355+0000", 2024-09-12T00:05:15.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8419999999999999e-05 2024-09-12T00:05:15.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.414 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:15.414 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001366+0000", 2024-09-12T00:05:15.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1073999999999999e-05 2024-09-12T00:05:15.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.414 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.414 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001438+0000", 2024-09-12T00:05:15.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1389000000000004e-05 2024-09-12T00:05:15.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.414 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:15.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001548+0000", 2024-09-12T00:05:15.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110612 2024-09-12T00:05:15.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:15.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.001639+0000", 2024-09-12T00:05:15.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0192999999999995e-05 2024-09-12T00:05:15.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:15.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019057+0000", 2024-09-12T00:05:15.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017418411000000002 2024-09-12T00:05:15.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:15.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019528+0000", 2024-09-12T00:05:15.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00047075699999999998 2024-09-12T00:05:15.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:15.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019577+0000", 2024-09-12T00:05:15.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8714999999999997e-05 2024-09-12T00:05:15.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:15.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.019636+0000", 2024-09-12T00:05:15.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9845e-05 2024-09-12T00:05:15.416 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.416 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:15.417 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.417 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:1780 3.16 e58/23 3:69d8ee52:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.3_10Mb.:head v 58'1, mlcod=0'0)", 2024-09-12T00:05:15.417 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:05:15.417 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 41.366191862999997, 2024-09-12T00:05:15.417 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01408911, 2024-09-12T00:05:15.417 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:15.417 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:15.417 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:15.417 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:15.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.417 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:15.417 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:05:15.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.418 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.418 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:15.418 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025146+0000", 2024-09-12T00:05:15.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.418 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.418 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:15.418 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.025148+0000", 2024-09-12T00:05:15.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4229999999999999e-06 2024-09-12T00:05:15.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.418 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.418 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:15.418 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026337+0000", 2024-09-12T00:05:15.419 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0011890589999999999 2024-09-12T00:05:15.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.419 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.419 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:15.419 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026362+0000", 2024-09-12T00:05:15.419 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4566000000000002e-05 2024-09-12T00:05:15.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.419 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.419 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:15.419 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026372+0000", 2024-09-12T00:05:15.419 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8509999999999994e-06 2024-09-12T00:05:15.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.419 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.419 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.420 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026448+0000", 2024-09-12T00:05:15.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6626999999999997e-05 2024-09-12T00:05:15.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.420 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.420 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:15.420 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.026473+0000", 2024-09-12T00:05:15.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4647e-05 2024-09-12T00:05:15.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.420 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.420 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:15.420 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039120+0000", 2024-09-12T00:05:15.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012647122 2024-09-12T00:05:15.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.420 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:15.421 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:34.039235+0000", 2024-09-12T00:05:15.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000114815 2024-09-12T00:05:15.421 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.421 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:15.421 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.421 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2648 3.13 3:c936a360:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:15.421 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.164782+0000", 2024-09-12T00:05:15.421 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 28.226555575999999, 2024-09-12T00:05:15.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019628063000000001, 2024-09-12T00:05:15.421 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:15.421 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:15.422 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:15.422 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:15.422 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:15.422 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:15.422 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2648 2024-09-12T00:05:15.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.422 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:15.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.422 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:15.422 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.164782+0000", 2024-09-12T00:05:15.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:15.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.164782+0000", 2024-09-12T00:05:15.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:15.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.164786+0000", 2024-09-12T00:05:15.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3450000000000002e-06 2024-09-12T00:05:15.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:15.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166758+0000", 2024-09-12T00:05:15.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019721629999999999 2024-09-12T00:05:15.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:15.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166785+0000", 2024-09-12T00:05:15.425 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7676000000000001e-05 2024-09-12T00:05:15.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.425 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:15.425 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166799+0000", 2024-09-12T00:05:15.425 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3716e-05 2024-09-12T00:05:15.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.425 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.425 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.166895+0000", 2024-09-12T00:05:15.425 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6243999999999995e-05 2024-09-12T00:05:15.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.425 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:15.426 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.167092+0000", 2024-09-12T00:05:15.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019639200000000001 2024-09-12T00:05:15.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.426 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.426 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:15.426 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.167273+0000", 2024-09-12T00:05:15.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000181533 2024-09-12T00:05:15.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.426 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.426 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:15.426 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.174331+0000", 2024-09-12T00:05:15.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0070577879999999997 2024-09-12T00:05:15.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.426 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.426 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:15.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.184172+0000", 2024-09-12T00:05:15.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0098409469999999992 2024-09-12T00:05:15.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:15.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.184238+0000", 2024-09-12T00:05:15.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6036000000000003e-05 2024-09-12T00:05:15.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:15.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.184410+0000", 2024-09-12T00:05:15.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017222299999999999 2024-09-12T00:05:15.427 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.427 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:15.428 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.428 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.428 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2659 3.2d 3:b4a71344:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:15.428 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.285246+0000", 2024-09-12T00:05:15.428 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 28.106091673000002, 2024-09-12T00:05:15.428 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020000217000000001, 2024-09-12T00:05:15.428 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:15.428 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:15.428 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:15.428 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:15.428 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:15.428 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:15.428 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2659 2024-09-12T00:05:15.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.429 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:15.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.429 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:15.429 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.285246+0000", 2024-09-12T00:05:15.429 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.429 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:15.429 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.285246+0000", 2024-09-12T00:05:15.429 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.429 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.429 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:15.430 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.285249+0000", 2024-09-12T00:05:15.430 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3890000000000001e-06 2024-09-12T00:05:15.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.430 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:15.430 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287047+0000", 2024-09-12T00:05:15.430 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017978099999999999 2024-09-12T00:05:15.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.430 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:15.430 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287084+0000", 2024-09-12T00:05:15.430 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6358e-05 2024-09-12T00:05:15.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.430 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:15.431 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287101+0000", 2024-09-12T00:05:15.431 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7815000000000001e-05 2024-09-12T00:05:15.431 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.431 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.431 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.431 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287198+0000", 2024-09-12T00:05:15.431 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6482000000000002e-05 2024-09-12T00:05:15.431 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.431 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.431 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:15.431 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287337+0000", 2024-09-12T00:05:15.431 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013917500000000001 2024-09-12T00:05:15.431 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.431 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.432 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:15.432 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.287451+0000", 2024-09-12T00:05:15.432 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000113962 2024-09-12T00:05:15.432 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.432 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.432 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:15.432 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.293889+0000", 2024-09-12T00:05:15.432 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0064380110000000004 2024-09-12T00:05:15.432 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.432 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.432 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:15.432 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.305119+0000", 2024-09-12T00:05:15.432 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011229872 2024-09-12T00:05:15.432 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.432 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:15.433 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.305191+0000", 2024-09-12T00:05:15.433 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2002000000000006e-05 2024-09-12T00:05:15.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.433 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:15.433 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.305246+0000", 2024-09-12T00:05:15.433 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5340999999999998e-05 2024-09-12T00:05:15.433 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.433 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:15.433 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.433 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.433 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2662 3.28 3:1791a19e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:15.434 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.317519+0000", 2024-09-12T00:05:15.434 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 28.073818724999999, 2024-09-12T00:05:15.434 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016495961999999999, 2024-09-12T00:05:15.434 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:15.434 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:15.434 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:15.434 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:15.434 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:15.434 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:15.434 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2662 2024-09-12T00:05:15.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.434 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:15.434 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.434 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:15.435 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317519+0000", 2024-09-12T00:05:15.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.435 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:15.435 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317519+0000", 2024-09-12T00:05:15.435 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.435 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:15.435 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.317522+0000", 2024-09-12T00:05:15.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7389999999999999e-06 2024-09-12T00:05:15.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.436 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.436 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:15.436 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319683+0000", 2024-09-12T00:05:15.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021614970000000001 2024-09-12T00:05:15.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.436 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.436 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:15.436 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319715+0000", 2024-09-12T00:05:15.436 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1574e-05 2024-09-12T00:05:15.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.436 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.437 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:15.437 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319730+0000", 2024-09-12T00:05:15.437 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5543e-05 2024-09-12T00:05:15.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.437 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.437 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319820+0000", 2024-09-12T00:05:15.437 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.9402999999999998e-05 2024-09-12T00:05:15.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.437 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:15.437 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.319976+0000", 2024-09-12T00:05:15.437 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015662900000000001 2024-09-12T00:05:15.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.438 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.438 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:15.438 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.320143+0000", 2024-09-12T00:05:15.438 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000166207 2024-09-12T00:05:15.438 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.438 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.438 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:15.438 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.327504+0000", 2024-09-12T00:05:15.438 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0073616189999999998 2024-09-12T00:05:15.438 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.438 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.438 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:15.438 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.333886+0000", 2024-09-12T00:05:15.438 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0063817650000000002 2024-09-12T00:05:15.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.439 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.439 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:15.439 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.333952+0000", 2024-09-12T00:05:15.439 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5889999999999994e-05 2024-09-12T00:05:15.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.439 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.439 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:15.439 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.334015+0000", 2024-09-12T00:05:15.439 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3095999999999994e-05 2024-09-12T00:05:15.439 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.439 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:15.439 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.439 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.440 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2664 3.1d 3:b8bd1b2d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:15.440 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.341755+0000", 2024-09-12T00:05:15.440 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 28.049582869000002, 2024-09-12T00:05:15.440 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017365477000000001, 2024-09-12T00:05:15.440 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:15.440 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:15.440 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:15.440 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:15.440 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:15.440 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:15.440 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2664 2024-09-12T00:05:15.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.440 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:15.440 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.441 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:15.441 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.341755+0000", 2024-09-12T00:05:15.441 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.441 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.441 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:15.441 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.341755+0000", 2024-09-12T00:05:15.441 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.441 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.441 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:15.441 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.341758+0000", 2024-09-12T00:05:15.441 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6560000000000001e-06 2024-09-12T00:05:15.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.442 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:15.442 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343741+0000", 2024-09-12T00:05:15.442 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019832389999999999 2024-09-12T00:05:15.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.442 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:15.442 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343766+0000", 2024-09-12T00:05:15.442 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4967e-05 2024-09-12T00:05:15.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.442 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.442 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:15.442 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343776+0000", 2024-09-12T00:05:15.443 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0686000000000001e-05 2024-09-12T00:05:15.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.443 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.443 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.443 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.343854+0000", 2024-09-12T00:05:15.443 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7210000000000001e-05 2024-09-12T00:05:15.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.443 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.443 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:15.443 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.344027+0000", 2024-09-12T00:05:15.443 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000173065 2024-09-12T00:05:15.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.443 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.443 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:15.443 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.344194+0000", 2024-09-12T00:05:15.444 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016688900000000001 2024-09-12T00:05:15.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.444 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:15.444 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.358530+0000", 2024-09-12T00:05:15.444 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014336877 2024-09-12T00:05:15.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.444 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:15.444 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.359009+0000", 2024-09-12T00:05:15.444 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00047882099999999999 2024-09-12T00:05:15.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.444 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:15.445 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.359069+0000", 2024-09-12T00:05:15.445 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9892999999999997e-05 2024-09-12T00:05:15.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.445 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.445 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:15.445 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.359120+0000", 2024-09-12T00:05:15.445 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1174000000000002e-05 2024-09-12T00:05:15.445 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.445 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:15.445 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.445 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.445 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2666 3.13 3:cbd43ea3:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:15.445 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.362905+0000", 2024-09-12T00:05:15.446 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 28.028432487, 2024-09-12T00:05:15.446 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017815950000000001, 2024-09-12T00:05:15.446 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:15.446 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:15.446 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:15.446 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:15.446 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:15.446 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:15.446 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2666 2024-09-12T00:05:15.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.446 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:15.446 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.446 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:15.446 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.362905+0000", 2024-09-12T00:05:15.446 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.447 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:15.447 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.362905+0000", 2024-09-12T00:05:15.447 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.447 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:15.447 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.362909+0000", 2024-09-12T00:05:15.447 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4529999999999998e-06 2024-09-12T00:05:15.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.447 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.447 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:15.447 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364466+0000", 2024-09-12T00:05:15.448 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015570060000000001 2024-09-12T00:05:15.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.448 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.448 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:15.448 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364500+0000", 2024-09-12T00:05:15.448 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4289999999999999e-05 2024-09-12T00:05:15.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.448 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.448 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:15.448 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364515+0000", 2024-09-12T00:05:15.448 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4537e-05 2024-09-12T00:05:15.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.448 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.448 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364615+0000", 2024-09-12T00:05:15.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100782 2024-09-12T00:05:15.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.449 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:15.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364805+0000", 2024-09-12T00:05:15.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018921399999999999 2024-09-12T00:05:15.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.449 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:15.449 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.364984+0000", 2024-09-12T00:05:15.449 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017972299999999999 2024-09-12T00:05:15.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.449 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:15.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.372042+0000", 2024-09-12T00:05:15.450 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0070581120000000001 2024-09-12T00:05:15.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:15.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.380620+0000", 2024-09-12T00:05:15.450 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085774309999999999 2024-09-12T00:05:15.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.450 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.450 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:15.450 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.380666+0000", 2024-09-12T00:05:15.450 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5881000000000003e-05 2024-09-12T00:05:15.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.451 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:15.451 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.380721+0000", 2024-09-12T00:05:15.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5520999999999999e-05 2024-09-12T00:05:15.451 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.451 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:15.451 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.451 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2677 3.13 3:c9d59693:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:15.451 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.474053+0000", 2024-09-12T00:05:15.451 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 27.917285140000001, 2024-09-12T00:05:15.451 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017985961000000002, 2024-09-12T00:05:15.451 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:15.452 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:15.452 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:15.452 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:15.452 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:15.452 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:15.452 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2677 2024-09-12T00:05:15.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.452 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:15.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.452 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:15.452 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.474053+0000", 2024-09-12T00:05:15.452 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.452 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.453 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:15.453 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.474053+0000", 2024-09-12T00:05:15.453 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.453 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:15.453 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.474055+0000", 2024-09-12T00:05:15.453 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.711e-06 2024-09-12T00:05:15.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.453 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:15.453 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475342+0000", 2024-09-12T00:05:15.453 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001286508 2024-09-12T00:05:15.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.454 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:15.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475373+0000", 2024-09-12T00:05:15.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1130000000000002e-05 2024-09-12T00:05:15.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.454 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:15.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475387+0000", 2024-09-12T00:05:15.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4280999999999999e-05 2024-09-12T00:05:15.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.454 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.454 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475476+0000", 2024-09-12T00:05:15.454 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8621000000000004e-05 2024-09-12T00:05:15.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.455 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:15.455 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475644+0000", 2024-09-12T00:05:15.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016785699999999999 2024-09-12T00:05:15.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.455 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:15.455 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.475742+0000", 2024-09-12T00:05:15.455 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8016000000000005e-05 2024-09-12T00:05:15.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.455 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:15.455 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.480305+0000", 2024-09-12T00:05:15.456 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0045629049999999999 2024-09-12T00:05:15.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:15.456 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.491948+0000", 2024-09-12T00:05:15.456 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011643280000000001 2024-09-12T00:05:15.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:15.456 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.492000+0000", 2024-09-12T00:05:15.456 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2482000000000003e-05 2024-09-12T00:05:15.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.456 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:15.457 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.492039+0000", 2024-09-12T00:05:15.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8170000000000002e-05 2024-09-12T00:05:15.457 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.457 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:15.457 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.457 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.457 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2691 3.2d 3:b4a2284d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:15.457 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.515274+0000", 2024-09-12T00:05:15.457 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 27.876064083999999, 2024-09-12T00:05:15.457 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018577757, 2024-09-12T00:05:15.457 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:15.457 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:15.457 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:15.457 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:15.458 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:15.458 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:15.458 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2691 2024-09-12T00:05:15.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.458 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:15.458 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.458 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:15.458 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.515274+0000", 2024-09-12T00:05:15.458 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.458 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.458 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:15.458 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.515274+0000", 2024-09-12T00:05:15.458 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.459 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:15.459 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.515276+0000", 2024-09-12T00:05:15.459 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3499999999999999e-06 2024-09-12T00:05:15.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.459 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:15.459 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.516900+0000", 2024-09-12T00:05:15.459 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001623633 2024-09-12T00:05:15.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.459 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:15.459 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.516929+0000", 2024-09-12T00:05:15.460 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9009999999999998e-05 2024-09-12T00:05:15.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.460 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:15.460 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.516942+0000", 2024-09-12T00:05:15.460 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3551e-05 2024-09-12T00:05:15.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.460 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.460 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.517022+0000", 2024-09-12T00:05:15.460 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0167999999999995e-05 2024-09-12T00:05:15.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.460 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:15.461 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.517216+0000", 2024-09-12T00:05:15.461 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000193919 2024-09-12T00:05:15.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.461 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:15.461 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.517380+0000", 2024-09-12T00:05:15.461 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016336000000000001 2024-09-12T00:05:15.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.461 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:15.461 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.522907+0000", 2024-09-12T00:05:15.461 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055276420000000001 2024-09-12T00:05:15.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.462 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:15.462 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.533735+0000", 2024-09-12T00:05:15.462 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010827997000000001 2024-09-12T00:05:15.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.462 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:15.462 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.533800+0000", 2024-09-12T00:05:15.462 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4738000000000003e-05 2024-09-12T00:05:15.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.462 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:15.462 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.533851+0000", 2024-09-12T00:05:15.462 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1388999999999999e-05 2024-09-12T00:05:15.462 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.463 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:15.463 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.463 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.463 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2697 3.13 3:c87ccb22:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:15.463 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.577849+0000", 2024-09-12T00:05:15.463 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 27.813488763999999, 2024-09-12T00:05:15.463 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019139156000000001, 2024-09-12T00:05:15.463 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:15.463 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:15.463 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:15.463 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:15.463 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:15.463 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:15.464 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2697 2024-09-12T00:05:15.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.464 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:15.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.464 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:15.464 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577849+0000", 2024-09-12T00:05:15.464 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.464 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:15.464 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577849+0000", 2024-09-12T00:05:15.464 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.465 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:15.465 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.577853+0000", 2024-09-12T00:05:15.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7510000000000002e-06 2024-09-12T00:05:15.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.465 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:15.465 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579595+0000", 2024-09-12T00:05:15.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001741954 2024-09-12T00:05:15.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.465 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:15.465 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579625+0000", 2024-09-12T00:05:15.465 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9907999999999999e-05 2024-09-12T00:05:15.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.466 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:15.466 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579640+0000", 2024-09-12T00:05:15.466 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4894e-05 2024-09-12T00:05:15.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.466 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.466 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579728+0000", 2024-09-12T00:05:15.466 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8704999999999999e-05 2024-09-12T00:05:15.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.466 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:15.466 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.579922+0000", 2024-09-12T00:05:15.466 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000194019 2024-09-12T00:05:15.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.467 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:15.467 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.580092+0000", 2024-09-12T00:05:15.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016984300000000001 2024-09-12T00:05:15.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.467 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:15.467 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.591944+0000", 2024-09-12T00:05:15.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011852252000000001 2024-09-12T00:05:15.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.467 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:15.467 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.596913+0000", 2024-09-12T00:05:15.467 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0049688279999999998 2024-09-12T00:05:15.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.468 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:15.468 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.596955+0000", 2024-09-12T00:05:15.468 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2290999999999999e-05 2024-09-12T00:05:15.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.468 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:15.468 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.596988+0000", 2024-09-12T00:05:15.468 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2710999999999999e-05 2024-09-12T00:05:15.468 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.468 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:15.468 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.469 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2701 3.11 3:8babcc8d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:15.469 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.617191+0000", 2024-09-12T00:05:15.469 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 27.774147151000001, 2024-09-12T00:05:15.469 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013760204999999999, 2024-09-12T00:05:15.469 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:15.469 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:15.469 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:15.469 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:15.469 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:15.469 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:15.469 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2701 2024-09-12T00:05:15.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.469 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:15.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.470 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:15.470 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.617191+0000", 2024-09-12T00:05:15.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.470 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:15.470 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.617191+0000", 2024-09-12T00:05:15.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.470 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:15.470 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.617194+0000", 2024-09-12T00:05:15.470 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.788e-06 2024-09-12T00:05:15.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.471 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:15.471 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618652+0000", 2024-09-12T00:05:15.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001457716 2024-09-12T00:05:15.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.471 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:15.471 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618682+0000", 2024-09-12T00:05:15.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9668000000000001e-05 2024-09-12T00:05:15.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.471 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:15.471 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618692+0000", 2024-09-12T00:05:15.471 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0429e-05 2024-09-12T00:05:15.472 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.472 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.472 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.472 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618766+0000", 2024-09-12T00:05:15.472 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4190999999999995e-05 2024-09-12T00:05:15.472 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.472 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.472 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:15.472 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.618932+0000", 2024-09-12T00:05:15.472 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000165923 2024-09-12T00:05:15.472 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.472 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.472 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:15.472 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.619026+0000", 2024-09-12T00:05:15.472 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3906999999999994e-05 2024-09-12T00:05:15.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.473 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.473 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:15.473 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.623168+0000", 2024-09-12T00:05:15.473 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0041419309999999997 2024-09-12T00:05:15.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.473 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.473 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:15.473 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.630815+0000", 2024-09-12T00:05:15.473 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0076470100000000001 2024-09-12T00:05:15.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.473 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.473 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:15.473 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.630887+0000", 2024-09-12T00:05:15.474 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2218999999999994e-05 2024-09-12T00:05:15.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.474 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:15.474 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.630951+0000", 2024-09-12T00:05:15.474 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3423000000000006e-05 2024-09-12T00:05:15.474 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.474 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:15.474 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.474 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2704 3.13 3:c90afc39:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:15.474 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.647542+0000", 2024-09-12T00:05:15.474 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 27.743795288000001, 2024-09-12T00:05:15.474 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017595339000000002, 2024-09-12T00:05:15.475 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:15.475 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:15.475 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:15.475 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:15.475 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:15.475 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:15.475 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2704 2024-09-12T00:05:15.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.475 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:15.475 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.475 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:15.475 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.647542+0000", 2024-09-12T00:05:15.475 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.476 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.476 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:15.476 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.647542+0000", 2024-09-12T00:05:15.476 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.476 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.476 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:15.476 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.647544+0000", 2024-09-12T00:05:15.476 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6339999999999999e-06 2024-09-12T00:05:15.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.476 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.476 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:15.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649032+0000", 2024-09-12T00:05:15.477 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001488063 2024-09-12T00:05:15.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.477 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:15.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649053+0000", 2024-09-12T00:05:15.477 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0761e-05 2024-09-12T00:05:15.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.477 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:15.477 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649066+0000", 2024-09-12T00:05:15.477 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2597e-05 2024-09-12T00:05:15.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.477 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.478 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.478 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649142+0000", 2024-09-12T00:05:15.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6254999999999994e-05 2024-09-12T00:05:15.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.478 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:15.478 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649250+0000", 2024-09-12T00:05:15.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010774500000000001 2024-09-12T00:05:15.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.478 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.478 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:15.478 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.649364+0000", 2024-09-12T00:05:15.478 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000114401 2024-09-12T00:05:15.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.479 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.479 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:15.479 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.658970+0000", 2024-09-12T00:05:15.479 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0096065260000000006 2024-09-12T00:05:15.479 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.479 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.479 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:15.479 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.665022+0000", 2024-09-12T00:05:15.479 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0060516459999999999 2024-09-12T00:05:15.479 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.479 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.479 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:15.479 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.665086+0000", 2024-09-12T00:05:15.480 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.3940000000000001e-05 2024-09-12T00:05:15.480 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.480 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.480 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:15.480 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.665138+0000", 2024-09-12T00:05:15.480 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1771000000000003e-05 2024-09-12T00:05:15.480 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.480 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:15.480 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.480 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.480 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.480 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2706 3.d 3:b1b5d8c6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:15.480 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.667263+0000", 2024-09-12T00:05:15.480 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 27.724074334000001, 2024-09-12T00:05:15.481 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017030099999999999, 2024-09-12T00:05:15.481 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:15.481 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:15.481 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:15.481 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:15.481 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:15.481 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:15.481 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2706 2024-09-12T00:05:15.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.481 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:15.481 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.481 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:15.481 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.667263+0000", 2024-09-12T00:05:15.482 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.482 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.482 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.482 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:15.482 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.667263+0000", 2024-09-12T00:05:15.482 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.482 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.482 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.482 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:15.482 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.667267+0000", 2024-09-12T00:05:15.482 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1540000000000002e-06 2024-09-12T00:05:15.482 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.482 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.482 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:15.482 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672789+0000", 2024-09-12T00:05:15.483 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055222819999999999 2024-09-12T00:05:15.483 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.483 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.483 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:15.483 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672817+0000", 2024-09-12T00:05:15.483 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8510999999999999e-05 2024-09-12T00:05:15.483 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.483 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.483 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:15.483 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672831+0000", 2024-09-12T00:05:15.483 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3919e-05 2024-09-12T00:05:15.483 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.483 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.483 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.484 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.672988+0000", 2024-09-12T00:05:15.484 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015688 2024-09-12T00:05:15.484 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.484 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.484 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:15.484 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.673174+0000", 2024-09-12T00:05:15.484 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018615400000000001 2024-09-12T00:05:15.484 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.484 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.484 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:15.484 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.673352+0000", 2024-09-12T00:05:15.484 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017803599999999999 2024-09-12T00:05:15.484 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.484 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.485 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:15.485 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.683897+0000", 2024-09-12T00:05:15.485 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010544239 2024-09-12T00:05:15.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.485 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.485 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:15.485 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.684176+0000", 2024-09-12T00:05:15.485 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000279506 2024-09-12T00:05:15.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.485 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.485 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:15.485 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.684235+0000", 2024-09-12T00:05:15.485 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.9101000000000002e-05 2024-09-12T00:05:15.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.486 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.486 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:15.486 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.684294+0000", 2024-09-12T00:05:15.486 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8318e-05 2024-09-12T00:05:15.486 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.486 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:15.486 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.486 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.486 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2714 3.17 e63/23 3:eac65a57:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_199:head v 63'3, mlcod=62'1)", 2024-09-12T00:05:15.486 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.752259+0000", 2024-09-12T00:05:15.486 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 27.6390788, 2024-09-12T00:05:15.486 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013747212, 2024-09-12T00:05:15.486 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:15.487 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:15.487 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:15.487 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:15.487 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.487 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:15.487 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.752259+0000", 2024-09-12T00:05:15.487 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.487 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.487 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.487 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:15.487 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.752259+0000", 2024-09-12T00:05:15.487 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.487 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.487 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.487 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:15.488 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.752261+0000", 2024-09-12T00:05:15.488 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2390000000000001e-06 2024-09-12T00:05:15.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.488 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.488 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:15.488 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757723+0000", 2024-09-12T00:05:15.488 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0054619569999999999 2024-09-12T00:05:15.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.488 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.488 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:15.488 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757749+0000", 2024-09-12T00:05:15.488 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5732999999999999e-05 2024-09-12T00:05:15.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.488 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.489 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:15.489 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757762+0000", 2024-09-12T00:05:15.489 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3556e-05 2024-09-12T00:05:15.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.489 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.489 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.489 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757841+0000", 2024-09-12T00:05:15.489 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8644000000000001e-05 2024-09-12T00:05:15.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.489 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.489 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:15.489 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.757864+0000", 2024-09-12T00:05:15.489 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3112000000000002e-05 2024-09-12T00:05:15.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.490 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.490 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:15.490 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.765956+0000", 2024-09-12T00:05:15.490 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080919679999999997 2024-09-12T00:05:15.490 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.490 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.490 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:15.490 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.766006+0000", 2024-09-12T00:05:15.490 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0003000000000002e-05 2024-09-12T00:05:15.490 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.490 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:15.490 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.490 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.491 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.491 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2742 3.1d 3:b8ae26ad:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:15.491 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.035857+0000", 2024-09-12T00:05:15.491 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 27.355481118, 2024-09-12T00:05:15.491 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025139262999999998, 2024-09-12T00:05:15.491 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:15.491 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:15.491 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:15.491 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:15.491 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:15.491 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:15.491 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2742 2024-09-12T00:05:15.491 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.491 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:15.492 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.492 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:15.492 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.035857+0000", 2024-09-12T00:05:15.492 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.492 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.492 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.492 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:15.492 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.035857+0000", 2024-09-12T00:05:15.492 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.492 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.492 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.492 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:15.492 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.035859+0000", 2024-09-12T00:05:15.492 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0899999999999999e-06 2024-09-12T00:05:15.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.493 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.493 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:15.493 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038486+0000", 2024-09-12T00:05:15.493 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026273749999999999 2024-09-12T00:05:15.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.493 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.493 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:15.493 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038511+0000", 2024-09-12T00:05:15.493 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5327e-05 2024-09-12T00:05:15.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.493 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.493 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:15.493 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038527+0000", 2024-09-12T00:05:15.494 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5196e-05 2024-09-12T00:05:15.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.494 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.494 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038604+0000", 2024-09-12T00:05:15.494 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6921000000000004e-05 2024-09-12T00:05:15.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.494 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:15.494 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.038789+0000", 2024-09-12T00:05:15.494 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018526400000000001 2024-09-12T00:05:15.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.494 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.494 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:15.495 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.039001+0000", 2024-09-12T00:05:15.495 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021200400000000001 2024-09-12T00:05:15.495 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.495 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.495 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:15.495 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.056879+0000", 2024-09-12T00:05:15.495 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017877783000000001 2024-09-12T00:05:15.495 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.495 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.495 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:15.495 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.060872+0000", 2024-09-12T00:05:15.495 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039929529999999996 2024-09-12T00:05:15.495 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.495 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.495 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:15.496 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.060942+0000", 2024-09-12T00:05:15.496 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0060000000000003e-05 2024-09-12T00:05:15.496 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.496 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.496 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:15.496 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.060996+0000", 2024-09-12T00:05:15.496 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.4289999999999997e-05 2024-09-12T00:05:15.496 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.496 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:15.496 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.496 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.496 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.496 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2747 3.17 e63/23 3:eaa4528d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_232:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:15.496 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.094555+0000", 2024-09-12T00:05:15.497 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 27.296782291, 2024-09-12T00:05:15.497 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017679139, 2024-09-12T00:05:15.497 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:15.497 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:15.497 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:15.497 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:15.497 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.497 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:15.497 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.094555+0000", 2024-09-12T00:05:15.497 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.497 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.497 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.497 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:15.497 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.094555+0000", 2024-09-12T00:05:15.498 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.498 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.498 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.498 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:15.498 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.094558+0000", 2024-09-12T00:05:15.498 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.232e-06 2024-09-12T00:05:15.498 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.498 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.498 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:15.498 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098897+0000", 2024-09-12T00:05:15.498 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0043397840000000002 2024-09-12T00:05:15.498 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.498 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.498 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:15.499 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098930+0000", 2024-09-12T00:05:15.499 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2592000000000002e-05 2024-09-12T00:05:15.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.499 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.499 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:15.499 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098945+0000", 2024-09-12T00:05:15.499 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4759e-05 2024-09-12T00:05:15.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.499 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.499 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.499 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.099033+0000", 2024-09-12T00:05:15.499 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8535000000000005e-05 2024-09-12T00:05:15.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.499 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.499 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:15.500 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.099065+0000", 2024-09-12T00:05:15.500 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1825000000000001e-05 2024-09-12T00:05:15.500 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.500 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.500 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:15.500 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112134+0000", 2024-09-12T00:05:15.500 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013068329 2024-09-12T00:05:15.500 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.500 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.500 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:15.500 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112235+0000", 2024-09-12T00:05:15.500 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010108299999999999 2024-09-12T00:05:15.500 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.500 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:15.501 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.501 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.501 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.501 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2764 3.2d 3:b7a0f55d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_249:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:15.501 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.325396+0000", 2024-09-12T00:05:15.501 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 27.065941342999999, 2024-09-12T00:05:15.501 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022487040999999999, 2024-09-12T00:05:15.501 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:15.501 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:15.501 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:15.501 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:15.501 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:15.501 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:15.501 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2764 2024-09-12T00:05:15.501 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.502 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:15.502 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.502 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:15.502 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.325396+0000", 2024-09-12T00:05:15.502 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.502 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.502 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.502 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:15.502 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.325396+0000", 2024-09-12T00:05:15.502 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:15.502 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.502 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.502 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:15.502 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.325400+0000", 2024-09-12T00:05:15.503 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2370000000000001e-06 2024-09-12T00:05:15.503 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.503 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.503 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:15.503 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328424+0000", 2024-09-12T00:05:15.503 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003024657 2024-09-12T00:05:15.503 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.503 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.503 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:15.503 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328456+0000", 2024-09-12T00:05:15.503 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1819999999999997e-05 2024-09-12T00:05:15.503 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.503 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.503 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:15.503 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328476+0000", 2024-09-12T00:05:15.504 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9673999999999998e-05 2024-09-12T00:05:15.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.504 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.504 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:15.504 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328567+0000", 2024-09-12T00:05:15.504 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1640999999999999e-05 2024-09-12T00:05:15.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.504 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.504 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:15.504 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328734+0000", 2024-09-12T00:05:15.504 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016619200000000001 2024-09-12T00:05:15.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.504 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.505 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:15.505 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.328910+0000", 2024-09-12T00:05:15.505 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017652299999999999 2024-09-12T00:05:15.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.505 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.505 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:15.505 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.333757+0000", 2024-09-12T00:05:15.505 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048465060000000004 2024-09-12T00:05:15.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.505 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.505 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:15.505 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.347806+0000", 2024-09-12T00:05:15.505 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01404908 2024-09-12T00:05:15.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.505 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.506 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:15.506 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.347847+0000", 2024-09-12T00:05:15.506 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1396999999999997e-05 2024-09-12T00:05:15.506 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:15.506 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:15.506 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:15.506 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.347883+0000", 2024-09-12T00:05:15.506 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6313999999999998e-05 2024-09-12T00:05:15.506 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.506 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:15.506 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.506 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:15.506 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:15.506 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:15.508 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:05:15.509 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T00:05:15.512 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:15.505+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:15.609 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:15.605+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:15.645 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:15.646 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:15.646 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:15.646 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:15.660 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:05:15.750 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:15.749+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:15.811 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:15.812+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:15.824 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:15.824 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:15.824 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:15.824 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:15.825 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:15.839 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:05:15.912 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:15.912+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:16.011 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:16.012 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:16.012 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:16.012 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:16.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.012 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2657 3.3c e63/23 3:3e583291:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_152:head v 63'4, mlcod=62'2)", 2024-09-12T00:05:16.012 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:05:16.013 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.742828957, 2024-09-12T00:05:16.013 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017073642999999999, 2024-09-12T00:05:16.013 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.013 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.014 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.014 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.014 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.014 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.014 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:05:16.015 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.015 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.015 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.015 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.015 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:05:16.015 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.016 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.016 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.016 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.016 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266877+0000", 2024-09-12T00:05:16.016 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3630000000000001e-06 2024-09-12T00:05:16.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.017 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.017 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.017 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271243+0000", 2024-09-12T00:05:16.018 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043659730000000004 2024-09-12T00:05:16.018 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.018 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.018 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.018 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271279+0000", 2024-09-12T00:05:16.018 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6334999999999997e-05 2024-09-12T00:05:16.018 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.018 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.018 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.018 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271296+0000", 2024-09-12T00:05:16.019 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6619000000000001e-05 2024-09-12T00:05:16.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.019 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.019 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.019 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271429+0000", 2024-09-12T00:05:16.019 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133132 2024-09-12T00:05:16.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.019 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.019 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.019 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271468+0000", 2024-09-12T00:05:16.019 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8483999999999999e-05 2024-09-12T00:05:16.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.020 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.020 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.020 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.283854+0000", 2024-09-12T00:05:16.020 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012386645999999999 2024-09-12T00:05:16.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.020 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.020 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.020 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.283948+0000", 2024-09-12T00:05:16.020 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4091000000000004e-05 2024-09-12T00:05:16.020 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.020 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.020 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.021 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.021 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.021 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2658 3.3a e63/23 3:5ec14981:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_153:head v 63'1, mlcod=0'0)", 2024-09-12T00:05:16.021 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.276052+0000", 2024-09-12T00:05:16.021 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.733652067000001, 2024-09-12T00:05:16.021 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015387336999999999, 2024-09-12T00:05:16.021 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.021 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.021 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.021 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.021 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.021 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.021 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.276052+0000", 2024-09-12T00:05:16.022 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.022 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.025 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.025 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.276052+0000", 2024-09-12T00:05:16.025 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.025 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.025 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.276054+0000", 2024-09-12T00:05:16.025 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3199999999999998e-06 2024-09-12T00:05:16.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.025 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.026 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282165+0000", 2024-09-12T00:05:16.026 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061108359999999997 2024-09-12T00:05:16.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.026 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.026 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.026 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282192+0000", 2024-09-12T00:05:16.026 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7008999999999998e-05 2024-09-12T00:05:16.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.026 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.026 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.026 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282206+0000", 2024-09-12T00:05:16.026 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4705999999999999e-05 2024-09-12T00:05:16.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.027 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.027 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.027 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282387+0000", 2024-09-12T00:05:16.027 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018015199999999999 2024-09-12T00:05:16.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.027 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.027 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.027 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.282426+0000", 2024-09-12T00:05:16.027 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9323999999999998e-05 2024-09-12T00:05:16.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.027 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.027 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.028 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291241+0000", 2024-09-12T00:05:16.028 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0088146950000000009 2024-09-12T00:05:16.028 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.028 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.028 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.028 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291439+0000", 2024-09-12T00:05:16.028 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000198295 2024-09-12T00:05:16.028 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.028 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.028 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.028 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.028 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.028 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2659 3.2d e63/23 3:b4a71344:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_154:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:16.028 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:05:16.029 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.722024662999999, 2024-09-12T00:05:16.029 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016913793, 2024-09-12T00:05:16.029 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.029 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.029 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.029 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.029 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.029 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.029 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:05:16.029 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.029 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.029 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.029 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.029 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:05:16.030 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.030 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.030 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287682+0000", 2024-09-12T00:05:16.030 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9799999999999998e-06 2024-09-12T00:05:16.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.030 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.030 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291872+0000", 2024-09-12T00:05:16.030 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041904070000000002 2024-09-12T00:05:16.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.030 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291901+0000", 2024-09-12T00:05:16.031 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9017999999999999e-05 2024-09-12T00:05:16.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.031 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.031 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291917+0000", 2024-09-12T00:05:16.031 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5775999999999999e-05 2024-09-12T00:05:16.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.031 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.031 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.292061+0000", 2024-09-12T00:05:16.031 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014356800000000001 2024-09-12T00:05:16.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.032 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.032 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.292123+0000", 2024-09-12T00:05:16.032 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2799999999999995e-05 2024-09-12T00:05:16.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.032 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.032 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.304456+0000", 2024-09-12T00:05:16.032 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012332865 2024-09-12T00:05:16.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.033 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.033 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.033 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.304593+0000", 2024-09-12T00:05:16.033 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000136379 2024-09-12T00:05:16.033 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.033 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.033 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.033 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.033 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2667 3.8 3:1177e826:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.033 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:05:16.034 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.636582744999998, 2024-09-12T00:05:16.034 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024306991999999999, 2024-09-12T00:05:16.034 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.034 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.034 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.034 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.034 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.034 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.034 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2667 2024-09-12T00:05:16.034 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.034 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.035 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.035 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.035 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:05:16.035 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.035 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.035 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.035 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:05:16.035 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.035 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.036 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.036 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373124+0000", 2024-09-12T00:05:16.036 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.19e-06 2024-09-12T00:05:16.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.036 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.036 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.036 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377167+0000", 2024-09-12T00:05:16.036 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040430329999999997 2024-09-12T00:05:16.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.036 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.037 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.037 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377201+0000", 2024-09-12T00:05:16.037 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3868000000000002e-05 2024-09-12T00:05:16.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.037 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.037 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.037 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377219+0000", 2024-09-12T00:05:16.037 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8019000000000001e-05 2024-09-12T00:05:16.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.037 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.037 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.037 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377362+0000", 2024-09-12T00:05:16.038 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000143001 2024-09-12T00:05:16.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.038 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.038 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.038 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377603+0000", 2024-09-12T00:05:16.038 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024115200000000001 2024-09-12T00:05:16.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.038 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.038 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:16.038 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377833+0000", 2024-09-12T00:05:16.038 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022952000000000001 2024-09-12T00:05:16.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.039 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.039 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.386771+0000", 2024-09-12T00:05:16.039 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0089385739999999995 2024-09-12T00:05:16.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.039 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.039 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397160+0000", 2024-09-12T00:05:16.039 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010388391 2024-09-12T00:05:16.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.040 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.040 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.040 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397307+0000", 2024-09-12T00:05:16.040 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014745099999999999 2024-09-12T00:05:16.040 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.040 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.040 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.040 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397428+0000", 2024-09-12T00:05:16.041 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012079299999999999 2024-09-12T00:05:16.041 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.041 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.041 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.041 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.041 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2669 3.1b 3:d9b9bd82:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.041 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:05:16.041 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.616906096000001, 2024-09-12T00:05:16.041 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016867298999999999, 2024-09-12T00:05:16.042 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.042 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.042 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.042 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.042 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.042 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.042 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2669 2024-09-12T00:05:16.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.042 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.042 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.042 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.042 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:05:16.042 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.043 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.043 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:05:16.043 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.043 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.043 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.043 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392800+0000", 2024-09-12T00:05:16.043 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8629999999999999e-06 2024-09-12T00:05:16.043 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.043 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.043 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396812+0000", 2024-09-12T00:05:16.043 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040120140000000004 2024-09-12T00:05:16.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.044 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.044 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.044 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396849+0000", 2024-09-12T00:05:16.044 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6291000000000002e-05 2024-09-12T00:05:16.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.044 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.045 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.045 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396906+0000", 2024-09-12T00:05:16.045 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7692999999999998e-05 2024-09-12T00:05:16.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.045 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.045 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.045 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397059+0000", 2024-09-12T00:05:16.045 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015268399999999999 2024-09-12T00:05:16.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.045 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.045 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.045 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397472+0000", 2024-09-12T00:05:16.046 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041270899999999998 2024-09-12T00:05:16.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.046 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:16.046 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397697+0000", 2024-09-12T00:05:16.046 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022526299999999999 2024-09-12T00:05:16.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.046 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.046 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.406380+0000", 2024-09-12T00:05:16.046 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086830429999999997 2024-09-12T00:05:16.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.047 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.047 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409367+0000", 2024-09-12T00:05:16.047 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002987403 2024-09-12T00:05:16.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.047 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.047 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409532+0000", 2024-09-12T00:05:16.047 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016417 2024-09-12T00:05:16.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.048 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.048 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409665+0000", 2024-09-12T00:05:16.048 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013316599999999999 2024-09-12T00:05:16.048 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.048 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.048 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.048 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.048 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.048 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2678 3.2b 3:d57f7217:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.048 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:05:16.048 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.525488648, 2024-09-12T00:05:16.048 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018772965999999999, 2024-09-12T00:05:16.048 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2678 2024-09-12T00:05:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:05:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.049 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.050 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:05:16.050 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.050 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.050 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.050 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.050 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484219+0000", 2024-09-12T00:05:16.050 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7299999999999999e-06 2024-09-12T00:05:16.050 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.050 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.050 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.050 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488148+0000", 2024-09-12T00:05:16.050 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039289859999999998 2024-09-12T00:05:16.050 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.051 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.051 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488214+0000", 2024-09-12T00:05:16.051 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6202000000000001e-05 2024-09-12T00:05:16.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.051 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.051 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488239+0000", 2024-09-12T00:05:16.051 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4839000000000001e-05 2024-09-12T00:05:16.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.051 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.052 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488374+0000", 2024-09-12T00:05:16.052 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000135189 2024-09-12T00:05:16.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.052 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.052 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.052 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488626+0000", 2024-09-12T00:05:16.052 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025242800000000002 2024-09-12T00:05:16.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.052 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.052 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:16.052 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488849+0000", 2024-09-12T00:05:16.052 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022295 2024-09-12T00:05:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498947+0000", 2024-09-12T00:05:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010098072 2024-09-12T00:05:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502674+0000", 2024-09-12T00:05:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037269149999999999 2024-09-12T00:05:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.053 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.054 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502856+0000", 2024-09-12T00:05:16.054 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018163599999999999 2024-09-12T00:05:16.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.054 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.054 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.054 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502988+0000", 2024-09-12T00:05:16.054 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013201900000000001 2024-09-12T00:05:16.054 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.054 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.054 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2691 3.2d e63/23 3:b4a2284d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_176:head v 63'6, mlcod=63'4)", 2024-09-12T00:05:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:05:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.492363947000001, 2024-09-12T00:05:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015889306999999998, 2024-09-12T00:05:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.055 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:05:16.056 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.056 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.056 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.056 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:05:16.056 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.057 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.057 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517342+0000", 2024-09-12T00:05:16.057 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3700000000000002e-06 2024-09-12T00:05:16.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.058 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.058 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.058 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521776+0000", 2024-09-12T00:05:16.058 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044339790000000002 2024-09-12T00:05:16.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521806+0000", 2024-09-12T00:05:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9855000000000001e-05 2024-09-12T00:05:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521820+0000", 2024-09-12T00:05:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4496e-05 2024-09-12T00:05:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521963+0000", 2024-09-12T00:05:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014277199999999999 2024-09-12T00:05:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.522029+0000", 2024-09-12T00:05:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6186000000000006e-05 2024-09-12T00:05:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.533123+0000", 2024-09-12T00:05:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011093252 2024-09-12T00:05:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.061 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.533229+0000", 2024-09-12T00:05:16.061 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000106397 2024-09-12T00:05:16.061 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.061 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.061 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.061 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.061 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.061 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2694 3.3d e63/23 3:bd0bdafc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_179:head v 63'7, mlcod=63'5)", 2024-09-12T00:05:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:05:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.457149175000001, 2024-09-12T00:05:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016398093999999998, 2024-09-12T00:05:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:05:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.062 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:05:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552558+0000", 2024-09-12T00:05:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6030000000000001e-06 2024-09-12T00:05:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556085+0000", 2024-09-12T00:05:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0035274339999999999 2024-09-12T00:05:16.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.064 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.064 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.064 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556126+0000", 2024-09-12T00:05:16.064 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0290999999999998e-05 2024-09-12T00:05:16.064 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.064 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.064 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.064 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556154+0000", 2024-09-12T00:05:16.064 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7965000000000001e-05 2024-09-12T00:05:16.064 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.064 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556298+0000", 2024-09-12T00:05:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014459799999999999 2024-09-12T00:05:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556339+0000", 2024-09-12T00:05:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0577000000000001e-05 2024-09-12T00:05:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.568778+0000", 2024-09-12T00:05:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012438886999999999 2024-09-12T00:05:16.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.066 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.066 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.066 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.568953+0000", 2024-09-12T00:05:16.066 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017473900000000001 2024-09-12T00:05:16.066 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.066 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.066 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.066 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.066 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.066 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2696 3.2b 3:d7c776f8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.066 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:05:16.066 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.442302278, 2024-09-12T00:05:16.067 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022026211, 2024-09-12T00:05:16.067 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.067 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.067 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.067 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.067 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.067 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.067 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2696 2024-09-12T00:05:16.067 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.067 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.068 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.068 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.068 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:05:16.068 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.068 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.068 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.068 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.068 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:05:16.068 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.068 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.068 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.069 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.069 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567406+0000", 2024-09-12T00:05:16.069 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9389999999999996e-06 2024-09-12T00:05:16.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.069 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.069 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.070 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571490+0000", 2024-09-12T00:05:16.070 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040837870000000002 2024-09-12T00:05:16.070 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.070 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.070 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.070 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571530+0000", 2024-09-12T00:05:16.071 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9894999999999997e-05 2024-09-12T00:05:16.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.071 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.071 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.071 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571554+0000", 2024-09-12T00:05:16.072 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4011000000000001e-05 2024-09-12T00:05:16.072 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.072 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.073 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.073 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571726+0000", 2024-09-12T00:05:16.073 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0001717 2024-09-12T00:05:16.073 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.073 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.073 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.074 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.572130+0000", 2024-09-12T00:05:16.074 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040465299999999999 2024-09-12T00:05:16.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.074 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.074 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:16.074 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.572470+0000", 2024-09-12T00:05:16.075 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00033946999999999997 2024-09-12T00:05:16.075 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.075 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.075 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.075 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.579159+0000", 2024-09-12T00:05:16.075 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0066893009999999999 2024-09-12T00:05:16.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.076 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.076 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.076 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589136+0000", 2024-09-12T00:05:16.076 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099772060000000006 2024-09-12T00:05:16.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.077 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.077 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.077 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589309+0000", 2024-09-12T00:05:16.077 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017264299999999999 2024-09-12T00:05:16.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.077 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.078 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.078 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589428+0000", 2024-09-12T00:05:16.078 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118606 2024-09-12T00:05:16.078 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.078 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.078 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.079 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.079 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2698 3.3d e63/23 3:bcafb0f9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_183:head v 63'8, mlcod=63'6)", 2024-09-12T00:05:16.079 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:05:16.079 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.414599229, 2024-09-12T00:05:16.079 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016019080000000002, 2024-09-12T00:05:16.079 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:05:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:05:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.082 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.082 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.082 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595107+0000", 2024-09-12T00:05:16.082 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.497e-06 2024-09-12T00:05:16.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.082 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.083 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.083 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598465+0000", 2024-09-12T00:05:16.083 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033583129999999999 2024-09-12T00:05:16.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.083 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.083 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.083 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598502+0000", 2024-09-12T00:05:16.084 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6814999999999999e-05 2024-09-12T00:05:16.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.084 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.084 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.084 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598520+0000", 2024-09-12T00:05:16.084 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8264999999999999e-05 2024-09-12T00:05:16.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.084 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.085 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.085 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598666+0000", 2024-09-12T00:05:16.085 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014574499999999999 2024-09-12T00:05:16.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.085 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.085 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.085 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598706+0000", 2024-09-12T00:05:16.086 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9993999999999997e-05 2024-09-12T00:05:16.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.086 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.086 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.086 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.611012+0000", 2024-09-12T00:05:16.086 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012306381 2024-09-12T00:05:16.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.087 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.087 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.087 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.611123+0000", 2024-09-12T00:05:16.087 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011107000000000001 2024-09-12T00:05:16.087 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.088 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.088 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.088 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.088 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2702 3.3c e63/23 3:3d6a0b3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_187:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:16.089 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:05:16.089 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.381124392, 2024-09-12T00:05:16.089 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015754475, 2024-09-12T00:05:16.089 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.089 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.090 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.090 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.090 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.090 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.090 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:05:16.090 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.091 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.091 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.091 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.091 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:05:16.091 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.092 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.092 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.092 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.092 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628581+0000", 2024-09-12T00:05:16.092 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2129999999999998e-06 2024-09-12T00:05:16.092 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.092 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.093 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.093 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633160+0000", 2024-09-12T00:05:16.093 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045784470000000002 2024-09-12T00:05:16.093 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.093 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.093 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.093 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633193+0000", 2024-09-12T00:05:16.093 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3015000000000002e-05 2024-09-12T00:05:16.094 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.094 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.094 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.094 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633213+0000", 2024-09-12T00:05:16.094 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0271999999999998e-05 2024-09-12T00:05:16.094 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.094 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.095 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.095 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633397+0000", 2024-09-12T00:05:16.095 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018359299999999999 2024-09-12T00:05:16.095 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.095 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.095 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.095 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633440+0000", 2024-09-12T00:05:16.095 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2984e-05 2024-09-12T00:05:16.095 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.096 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.096 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.096 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.644242+0000", 2024-09-12T00:05:16.096 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010802673 2024-09-12T00:05:16.096 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.096 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.096 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.096 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.644334+0000", 2024-09-12T00:05:16.096 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1278000000000003e-05 2024-09-12T00:05:16.096 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.096 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.097 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.097 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.097 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.097 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2707 3.8 3:10a400a4:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.097 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:05:16.097 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.332846824000001, 2024-09-12T00:05:16.097 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019444162000000001, 2024-09-12T00:05:16.097 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.097 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.097 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.097 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.097 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.097 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2707 2024-09-12T00:05:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:05:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:05:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.098 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.099 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.099 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676879+0000", 2024-09-12T00:05:16.099 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1886e-05 2024-09-12T00:05:16.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.099 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.099 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.099 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680743+0000", 2024-09-12T00:05:16.099 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038648060000000001 2024-09-12T00:05:16.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.099 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.099 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.099 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680783+0000", 2024-09-12T00:05:16.099 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9511000000000002e-05 2024-09-12T00:05:16.100 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.100 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.100 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.100 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680801+0000", 2024-09-12T00:05:16.100 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8056000000000001e-05 2024-09-12T00:05:16.100 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.100 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.100 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.100 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680948+0000", 2024-09-12T00:05:16.100 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014682399999999999 2024-09-12T00:05:16.100 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.100 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.100 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.101 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.681206+0000", 2024-09-12T00:05:16.101 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025860500000000002 2024-09-12T00:05:16.101 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.101 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.101 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:16.101 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.681439+0000", 2024-09-12T00:05:16.101 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023246599999999999 2024-09-12T00:05:16.101 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.101 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.101 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.101 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.689277+0000", 2024-09-12T00:05:16.101 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0078379000000000001 2024-09-12T00:05:16.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.102 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.102 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.102 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696136+0000", 2024-09-12T00:05:16.102 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0068593439999999999 2024-09-12T00:05:16.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.102 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.102 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.102 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696228+0000", 2024-09-12T00:05:16.102 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2038000000000002e-05 2024-09-12T00:05:16.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.102 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.102 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696301+0000", 2024-09-12T00:05:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2725999999999995e-05 2024-09-12T00:05:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2720 3.6 3:61c9c6cd:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:05:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.206127508000002, 2024-09-12T00:05:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021831761000000002, 2024-09-12T00:05:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.103 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.104 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.104 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.104 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.104 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2720 2024-09-12T00:05:16.104 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.104 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.104 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.104 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.104 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:05:16.104 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.104 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.104 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.105 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.105 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:05:16.105 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.105 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.105 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.105 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.105 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803580+0000", 2024-09-12T00:05:16.105 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9870000000000001e-06 2024-09-12T00:05:16.105 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808102+0000", 2024-09-12T00:05:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004521677 2024-09-12T00:05:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808152+0000", 2024-09-12T00:05:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9923999999999998e-05 2024-09-12T00:05:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808178+0000", 2024-09-12T00:05:16.106 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5911999999999999e-05 2024-09-12T00:05:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808365+0000", 2024-09-12T00:05:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000187839 2024-09-12T00:05:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808757+0000", 2024-09-12T00:05:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039202900000000001 2024-09-12T00:05:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.107 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.809162+0000", 2024-09-12T00:05:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040460300000000002 2024-09-12T00:05:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.816553+0000", 2024-09-12T00:05:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.007390537 2024-09-12T00:05:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.824836+0000", 2024-09-12T00:05:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082834369999999994 2024-09-12T00:05:16.108 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.825223+0000", 2024-09-12T00:05:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00038724700000000001 2024-09-12T00:05:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.825408+0000", 2024-09-12T00:05:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018456899999999999 2024-09-12T00:05:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.109 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.110 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.110 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2722 3.1b 3:d95d04cc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_207:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.110 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.822403+0000", 2024-09-12T00:05:16.110 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.187300815, 2024-09-12T00:05:16.110 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015693082000000001, 2024-09-12T00:05:16.110 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.110 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.110 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.110 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.110 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.110 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2722 2024-09-12T00:05:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.822403+0000", 2024-09-12T00:05:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.822403+0000", 2024-09-12T00:05:16.111 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.112 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.112 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.112 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.822405+0000", 2024-09-12T00:05:16.112 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4169999999999999e-06 2024-09-12T00:05:16.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.112 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.112 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.112 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826387+0000", 2024-09-12T00:05:16.112 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039818379999999997 2024-09-12T00:05:16.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.112 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.113 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.113 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826412+0000", 2024-09-12T00:05:16.113 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5159000000000001e-05 2024-09-12T00:05:16.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.113 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.113 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.113 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826425+0000", 2024-09-12T00:05:16.113 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3283e-05 2024-09-12T00:05:16.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.113 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.113 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826536+0000", 2024-09-12T00:05:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110109 2024-09-12T00:05:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826725+0000", 2024-09-12T00:05:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018966600000000001 2024-09-12T00:05:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.826904+0000", 2024-09-12T00:05:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017913200000000001 2024-09-12T00:05:16.114 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.835018+0000", 2024-09-12T00:05:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0081138300000000007 2024-09-12T00:05:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837918+0000", 2024-09-12T00:05:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002899535 2024-09-12T00:05:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838010+0000", 2024-09-12T00:05:16.115 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1901e-05 2024-09-12T00:05:16.116 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.116 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.116 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.116 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838096+0000", 2024-09-12T00:05:16.116 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6211999999999994e-05 2024-09-12T00:05:16.116 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.116 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.116 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.116 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.116 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.116 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2724 3.1b 3:da32d84b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.116 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:05:16.117 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.165917071999999, 2024-09-12T00:05:16.117 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019410604000000001, 2024-09-12T00:05:16.117 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.117 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.117 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.117 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.117 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.117 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.117 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2724 2024-09-12T00:05:16.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.118 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.118 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.118 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.118 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:05:16.118 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.118 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.118 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.118 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.118 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:05:16.119 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.119 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.119 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.119 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843790+0000", 2024-09-12T00:05:16.119 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.393e-06 2024-09-12T00:05:16.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.119 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.119 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.119 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847786+0000", 2024-09-12T00:05:16.119 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039965579999999999 2024-09-12T00:05:16.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.120 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.120 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.120 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847836+0000", 2024-09-12T00:05:16.120 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9731000000000002e-05 2024-09-12T00:05:16.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.120 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.120 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.120 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847856+0000", 2024-09-12T00:05:16.120 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0245e-05 2024-09-12T00:05:16.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.120 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.121 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.121 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848053+0000", 2024-09-12T00:05:16.121 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000196882 2024-09-12T00:05:16.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.121 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.121 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.121 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848291+0000", 2024-09-12T00:05:16.121 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000237762 2024-09-12T00:05:16.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.121 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.121 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:16.121 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848544+0000", 2024-09-12T00:05:16.121 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025307500000000001 2024-09-12T00:05:16.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.122 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.122 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.122 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.860024+0000", 2024-09-12T00:05:16.122 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011479390000000001 2024-09-12T00:05:16.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.122 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.122 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.122 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.862880+0000", 2024-09-12T00:05:16.122 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002856833 2024-09-12T00:05:16.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.122 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.122 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.122 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.863048+0000", 2024-09-12T00:05:16.123 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016796700000000001 2024-09-12T00:05:16.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.123 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.123 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.863197+0000", 2024-09-12T00:05:16.123 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148768 2024-09-12T00:05:16.123 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.123 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.124 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.124 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.124 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2727 3.39 e63/23 3:9c63b475:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_212:head v 63'3, mlcod=62'1)", 2024-09-12T00:05:16.124 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:05:16.125 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.131888476, 2024-09-12T00:05:16.125 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016224526999999999, 2024-09-12T00:05:16.125 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.125 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.125 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.125 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.126 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.126 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.126 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:05:16.126 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.126 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.126 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.126 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:05:16.127 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.127 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.127 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.127 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877818+0000", 2024-09-12T00:05:16.127 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.813e-06 2024-09-12T00:05:16.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.128 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.128 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.128 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883917+0000", 2024-09-12T00:05:16.128 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0060993009999999997 2024-09-12T00:05:16.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.128 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.128 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.128 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883961+0000", 2024-09-12T00:05:16.129 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3951e-05 2024-09-12T00:05:16.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.129 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.129 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.129 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883992+0000", 2024-09-12T00:05:16.130 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0565000000000003e-05 2024-09-12T00:05:16.130 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.130 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.130 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.130 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884176+0000", 2024-09-12T00:05:16.130 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018378200000000001 2024-09-12T00:05:16.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.131 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.131 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.131 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884252+0000", 2024-09-12T00:05:16.131 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6209000000000002e-05 2024-09-12T00:05:16.132 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.132 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.132 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.132 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.893904+0000", 2024-09-12T00:05:16.132 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0096519339999999992 2024-09-12T00:05:16.132 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.132 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.132 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.133 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.894040+0000", 2024-09-12T00:05:16.133 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013597199999999999 2024-09-12T00:05:16.133 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.133 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.133 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.133 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.133 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2730 3.7 3:e3fca83c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.133 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:05:16.133 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.10136035, 2024-09-12T00:05:16.133 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022178479000000001, 2024-09-12T00:05:16.133 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.134 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.134 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.134 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.134 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.134 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.134 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2730 2024-09-12T00:05:16.134 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.134 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.134 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.134 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.134 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:05:16.134 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.134 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.134 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.135 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.135 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:05:16.135 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.135 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.135 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.135 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908346+0000", 2024-09-12T00:05:16.135 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1999999999999999e-06 2024-09-12T00:05:16.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.135 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.135 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.135 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912423+0000", 2024-09-12T00:05:16.135 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004076423 2024-09-12T00:05:16.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.136 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.136 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.136 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912472+0000", 2024-09-12T00:05:16.136 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9023999999999997e-05 2024-09-12T00:05:16.136 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.136 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.136 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.136 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912498+0000", 2024-09-12T00:05:16.136 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6591999999999999e-05 2024-09-12T00:05:16.136 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.136 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.137 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.137 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912677+0000", 2024-09-12T00:05:16.137 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017824599999999999 2024-09-12T00:05:16.137 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.137 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.137 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.137 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913094+0000", 2024-09-12T00:05:16.137 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041757799999999999 2024-09-12T00:05:16.137 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.137 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.137 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:16.137 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913512+0000", 2024-09-12T00:05:16.137 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000417475 2024-09-12T00:05:16.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.138 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.138 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.138 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.929229+0000", 2024-09-12T00:05:16.138 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015717294999999999 2024-09-12T00:05:16.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.138 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.138 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.138 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930204+0000", 2024-09-12T00:05:16.138 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00097506199999999996 2024-09-12T00:05:16.139 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.139 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.139 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.139 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930392+0000", 2024-09-12T00:05:16.139 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000187775 2024-09-12T00:05:16.139 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.139 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.139 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.139 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930522+0000", 2024-09-12T00:05:16.139 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012980899999999999 2024-09-12T00:05:16.139 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.140 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.140 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.140 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.140 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.140 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2753 3.7 3:e119c99e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_238:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.140 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:05:16.140 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 27.85567228, 2024-09-12T00:05:16.140 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.023674186999999999, 2024-09-12T00:05:16.140 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.140 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.140 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.140 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.140 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.141 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.141 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2753 2024-09-12T00:05:16.141 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.141 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.141 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.141 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.141 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:05:16.141 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.141 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.141 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.141 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.141 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:05:16.142 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.142 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.142 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.142 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.142 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154035+0000", 2024-09-12T00:05:16.142 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2799999999999999e-06 2024-09-12T00:05:16.142 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.142 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.142 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.142 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159459+0000", 2024-09-12T00:05:16.142 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054242190000000001 2024-09-12T00:05:16.142 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.142 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.142 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.143 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159509+0000", 2024-09-12T00:05:16.143 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9830999999999998e-05 2024-09-12T00:05:16.143 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.143 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.143 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.143 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159536+0000", 2024-09-12T00:05:16.143 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7438000000000001e-05 2024-09-12T00:05:16.143 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.143 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.143 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.143 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159710+0000", 2024-09-12T00:05:16.143 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017342 2024-09-12T00:05:16.143 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.143 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.144 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.144 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159961+0000", 2024-09-12T00:05:16.144 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025164499999999999 2024-09-12T00:05:16.144 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.144 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.144 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:16.144 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.160206+0000", 2024-09-12T00:05:16.144 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024534200000000001 2024-09-12T00:05:16.144 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.144 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.144 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.144 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177421+0000", 2024-09-12T00:05:16.145 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017214956 2024-09-12T00:05:16.145 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.145 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.145 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.145 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177534+0000", 2024-09-12T00:05:16.145 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000112223 2024-09-12T00:05:16.145 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.145 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.145 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.145 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177625+0000", 2024-09-12T00:05:16.145 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0947999999999997e-05 2024-09-12T00:05:16.145 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.145 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.145 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.145 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177706+0000", 2024-09-12T00:05:16.146 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0884999999999996e-05 2024-09-12T00:05:16.146 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.146 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.146 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.146 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.146 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.146 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2757 3.2b 3:d6dac417:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.146 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:05:16.146 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 27.789603457999998, 2024-09-12T00:05:16.146 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017779708000000002, 2024-09-12T00:05:16.146 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.146 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.146 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.146 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.147 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.147 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.147 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2757 2024-09-12T00:05:16.147 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.147 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.147 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.147 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.147 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:05:16.147 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.147 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.147 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.148 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.148 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:05:16.148 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.148 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.148 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.148 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.148 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220103+0000", 2024-09-12T00:05:16.148 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.32e-06 2024-09-12T00:05:16.148 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.148 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.148 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.148 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225042+0000", 2024-09-12T00:05:16.148 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049386200000000003 2024-09-12T00:05:16.149 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.149 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.149 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.149 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225083+0000", 2024-09-12T00:05:16.149 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1304000000000003e-05 2024-09-12T00:05:16.149 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.149 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.149 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.149 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225102+0000", 2024-09-12T00:05:16.149 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8502e-05 2024-09-12T00:05:16.149 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.149 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.149 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.150 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225256+0000", 2024-09-12T00:05:16.150 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015436099999999999 2024-09-12T00:05:16.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.150 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.150 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.150 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225513+0000", 2024-09-12T00:05:16.150 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000256562 2024-09-12T00:05:16.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.150 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.150 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:16.150 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225737+0000", 2024-09-12T00:05:16.150 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022379 2024-09-12T00:05:16.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.150 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.150 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.151 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.234281+0000", 2024-09-12T00:05:16.151 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0085440540000000006 2024-09-12T00:05:16.151 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.151 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.151 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.151 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237710+0000", 2024-09-12T00:05:16.151 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0034298380000000002 2024-09-12T00:05:16.151 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.151 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.151 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.151 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237805+0000", 2024-09-12T00:05:16.151 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4804999999999998e-05 2024-09-12T00:05:16.151 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.151 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.152 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.152 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237880+0000", 2024-09-12T00:05:16.152 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4552e-05 2024-09-12T00:05:16.152 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.152 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.152 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.152 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.152 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.152 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2764 3.2d e63/23 3:b7a0f55d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_249:head v 63'7, mlcod=63'5)", 2024-09-12T00:05:16.152 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:05:16.152 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 27.680825987999999, 2024-09-12T00:05:16.152 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018235872, 2024-09-12T00:05:16.152 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.152 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.153 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.153 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.153 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.153 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.153 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:05:16.153 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.153 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.153 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.153 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.153 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:05:16.153 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.153 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.153 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.153 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.154 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328882+0000", 2024-09-12T00:05:16.154 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5000000000000001e-06 2024-09-12T00:05:16.154 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.154 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.154 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.154 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335092+0000", 2024-09-12T00:05:16.154 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0062094730000000001 2024-09-12T00:05:16.154 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.154 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.154 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.154 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335127+0000", 2024-09-12T00:05:16.154 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5717999999999999e-05 2024-09-12T00:05:16.154 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.154 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.155 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.155 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335144+0000", 2024-09-12T00:05:16.155 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7119e-05 2024-09-12T00:05:16.155 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.155 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.155 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.155 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335308+0000", 2024-09-12T00:05:16.155 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000163757 2024-09-12T00:05:16.155 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.155 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.155 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.155 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335354+0000", 2024-09-12T00:05:16.155 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6164e-05 2024-09-12T00:05:16.156 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.156 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.156 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.156 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.346991+0000", 2024-09-12T00:05:16.156 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011636851 2024-09-12T00:05:16.156 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.156 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.156 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.156 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.347113+0000", 2024-09-12T00:05:16.156 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012229 2024-09-12T00:05:16.156 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.156 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.156 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.157 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.157 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.157 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:16.158 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:05:16.159 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:16.160+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:16.260 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:16.257+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:16.286 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:16.286 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:16.286 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:16.286 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:16.300 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:05:16.360 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:16.360+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:16.461 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:16.464+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:16.469 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:16.469 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:16.469 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:16.469 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:16.469 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:16.483 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:05:16.562 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:16.564+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:16.609 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:16.609 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:16.609 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:16.609 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:16.609 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.609 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2656 3.29 3:951a8707:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.609 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.253332+0000", 2024-09-12T00:05:16.609 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.354111584999998, 2024-09-12T00:05:16.609 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018697930000000001, 2024-09-12T00:05:16.610 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.610 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.610 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.610 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.610 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.610 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.610 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2656 2024-09-12T00:05:16.610 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.610 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.610 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.611 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.611 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.253332+0000", 2024-09-12T00:05:16.611 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.611 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.611 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.611 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.253332+0000", 2024-09-12T00:05:16.611 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.611 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.611 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.612 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.253336+0000", 2024-09-12T00:05:16.612 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8469999999999998e-06 2024-09-12T00:05:16.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.612 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.612 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.257408+0000", 2024-09-12T00:05:16.612 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040728209999999999 2024-09-12T00:05:16.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.612 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.612 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.257445+0000", 2024-09-12T00:05:16.612 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6284e-05 2024-09-12T00:05:16.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.613 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.613 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.257470+0000", 2024-09-12T00:05:16.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5684999999999999e-05 2024-09-12T00:05:16.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.613 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.613 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.257608+0000", 2024-09-12T00:05:16.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013792200000000001 2024-09-12T00:05:16.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.613 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.613 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.257855+0000", 2024-09-12T00:05:16.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024628900000000001 2024-09-12T00:05:16.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.614 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:16.614 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.258062+0000", 2024-09-12T00:05:16.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020795699999999999 2024-09-12T00:05:16.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.614 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.614 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266228+0000", 2024-09-12T00:05:16.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0081652600000000006 2024-09-12T00:05:16.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271871+0000", 2024-09-12T00:05:16.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0056437179999999998 2024-09-12T00:05:16.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271958+0000", 2024-09-12T00:05:16.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6800999999999998e-05 2024-09-12T00:05:16.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.616 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.272030+0000", 2024-09-12T00:05:16.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1346000000000004e-05 2024-09-12T00:05:16.616 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.616 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.616 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.616 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.616 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.616 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2661 3.1e 3:7a671bd1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.616 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.307344+0000", 2024-09-12T00:05:16.616 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.300099495000001, 2024-09-12T00:05:16.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020716793000000001, 2024-09-12T00:05:16.616 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.616 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.617 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.617 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.617 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.617 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.617 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2661 2024-09-12T00:05:16.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.617 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.617 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.307344+0000", 2024-09-12T00:05:16.617 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.307344+0000", 2024-09-12T00:05:16.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.618 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.307347+0000", 2024-09-12T00:05:16.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.546e-06 2024-09-12T00:05:16.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.618 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311373+0000", 2024-09-12T00:05:16.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040257940000000001 2024-09-12T00:05:16.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.619 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.619 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311407+0000", 2024-09-12T00:05:16.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4038000000000002e-05 2024-09-12T00:05:16.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.619 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.619 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311427+0000", 2024-09-12T00:05:16.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0305e-05 2024-09-12T00:05:16.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.619 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.619 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311547+0000", 2024-09-12T00:05:16.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011904999999999999 2024-09-12T00:05:16.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.620 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.620 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311877+0000", 2024-09-12T00:05:16.620 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00033003699999999998 2024-09-12T00:05:16.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.620 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:16.620 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.312137+0000", 2024-09-12T00:05:16.620 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026013499999999999 2024-09-12T00:05:16.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.620 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.620 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.320695+0000", 2024-09-12T00:05:16.621 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0085586029999999997 2024-09-12T00:05:16.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.621 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.327883+0000", 2024-09-12T00:05:16.621 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0071877419999999996 2024-09-12T00:05:16.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.621 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.327983+0000", 2024-09-12T00:05:16.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010008100000000001 2024-09-12T00:05:16.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.622 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.622 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.328061+0000", 2024-09-12T00:05:16.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7461999999999998e-05 2024-09-12T00:05:16.622 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.622 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.622 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.622 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2665 3.3d 3:bff83547:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.622 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.351951+0000", 2024-09-12T00:05:16.622 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.255491857999999, 2024-09-12T00:05:16.623 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019663572000000001, 2024-09-12T00:05:16.623 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.623 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.623 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.623 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.623 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.623 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.623 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2665 2024-09-12T00:05:16.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.623 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.623 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.351951+0000", 2024-09-12T00:05:16.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.351951+0000", 2024-09-12T00:05:16.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.351954+0000", 2024-09-12T00:05:16.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9330000000000001e-06 2024-09-12T00:05:16.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.355966+0000", 2024-09-12T00:05:16.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040118009999999997 2024-09-12T00:05:16.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356000+0000", 2024-09-12T00:05:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3967999999999997e-05 2024-09-12T00:05:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356025+0000", 2024-09-12T00:05:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4658e-05 2024-09-12T00:05:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356202+0000", 2024-09-12T00:05:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000176756 2024-09-12T00:05:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356445+0000", 2024-09-12T00:05:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024318300000000001 2024-09-12T00:05:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356671+0000", 2024-09-12T00:05:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000226276 2024-09-12T00:05:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.370776+0000", 2024-09-12T00:05:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014104604 2024-09-12T00:05:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.371306+0000", 2024-09-12T00:05:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00053036499999999998 2024-09-12T00:05:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.371521+0000", 2024-09-12T00:05:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021477000000000001 2024-09-12T00:05:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.371615+0000", 2024-09-12T00:05:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4258000000000005e-05 2024-09-12T00:05:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2689 3.3d 3:bfc0a94d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.494580+0000", 2024-09-12T00:05:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.112863582999999, 2024-09-12T00:05:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019076037000000001, 2024-09-12T00:05:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2689 2024-09-12T00:05:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.494580+0000", 2024-09-12T00:05:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.494580+0000", 2024-09-12T00:05:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.494582+0000", 2024-09-12T00:05:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2029999999999999e-06 2024-09-12T00:05:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498633+0000", 2024-09-12T00:05:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040508430000000002 2024-09-12T00:05:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498664+0000", 2024-09-12T00:05:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1273999999999999e-05 2024-09-12T00:05:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498680+0000", 2024-09-12T00:05:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5783000000000001e-05 2024-09-12T00:05:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498864+0000", 2024-09-12T00:05:16.633 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184635 2024-09-12T00:05:16.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.633 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.633 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.499108+0000", 2024-09-12T00:05:16.633 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000243883 2024-09-12T00:05:16.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.633 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:16.633 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.499335+0000", 2024-09-12T00:05:16.633 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000226729 2024-09-12T00:05:16.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.633 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.634 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.512376+0000", 2024-09-12T00:05:16.634 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013040629999999999 2024-09-12T00:05:16.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.634 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.634 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.513496+0000", 2024-09-12T00:05:16.634 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0011198409999999999 2024-09-12T00:05:16.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.634 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.634 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.513587+0000", 2024-09-12T00:05:16.634 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1199999999999994e-05 2024-09-12T00:05:16.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.635 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.635 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.513656+0000", 2024-09-12T00:05:16.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9016000000000005e-05 2024-09-12T00:05:16.635 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.635 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.635 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.635 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.635 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2693 3.1e 3:7a8f9e2c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.635 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.536006+0000", 2024-09-12T00:05:16.636 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.071437459999999, 2024-09-12T00:05:16.636 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019831418999999999, 2024-09-12T00:05:16.636 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.636 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.636 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.636 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.636 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.636 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.636 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2693 2024-09-12T00:05:16.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.636 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.636 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.636 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.636 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.536006+0000", 2024-09-12T00:05:16.637 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.637 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.637 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.637 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.637 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.536006+0000", 2024-09-12T00:05:16.637 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.637 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.637 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.638 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.638 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.536010+0000", 2024-09-12T00:05:16.638 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.737e-06 2024-09-12T00:05:16.638 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.638 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.638 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.638 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.539958+0000", 2024-09-12T00:05:16.638 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003948315 2024-09-12T00:05:16.638 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.641 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.641 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.641 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.539997+0000", 2024-09-12T00:05:16.641 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9131000000000002e-05 2024-09-12T00:05:16.641 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.642 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.642 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.642 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.540016+0000", 2024-09-12T00:05:16.642 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9018e-05 2024-09-12T00:05:16.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.642 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.642 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.642 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.540148+0000", 2024-09-12T00:05:16.642 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013242899999999999 2024-09-12T00:05:16.643 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.643 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.643 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.643 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.540394+0000", 2024-09-12T00:05:16.643 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024580899999999999 2024-09-12T00:05:16.643 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.643 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.643 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:16.644 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.540622+0000", 2024-09-12T00:05:16.644 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022765599999999999 2024-09-12T00:05:16.644 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.644 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.644 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.644 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.547587+0000", 2024-09-12T00:05:16.645 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0069649259999999998 2024-09-12T00:05:16.645 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.645 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.645 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.645 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.555622+0000", 2024-09-12T00:05:16.645 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0080352640000000003 2024-09-12T00:05:16.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.646 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.646 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.646 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.555724+0000", 2024-09-12T00:05:16.646 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010187399999999999 2024-09-12T00:05:16.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.646 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.646 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.646 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.555837+0000", 2024-09-12T00:05:16.646 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011326 2024-09-12T00:05:16.646 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.646 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.647 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.647 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.647 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2694 3.3d 3:bd0bdafc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.647 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:16.647 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.061914906999998, 2024-09-12T00:05:16.647 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.026139741000000001, 2024-09-12T00:05:16.647 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.647 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.647 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.648 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.648 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.648 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.648 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2694 2024-09-12T00:05:16.648 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.648 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.648 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.648 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.648 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:16.648 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.648 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.648 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.648 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.649 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:16.649 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.649 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.649 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.649 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.649 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545532+0000", 2024-09-12T00:05:16.649 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8199999999999998e-06 2024-09-12T00:05:16.649 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.649 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.649 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.649 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551454+0000", 2024-09-12T00:05:16.649 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059222340000000002 2024-09-12T00:05:16.649 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.649 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.650 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.650 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551485+0000", 2024-09-12T00:05:16.650 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0173999999999999e-05 2024-09-12T00:05:16.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.650 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.650 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.650 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551504+0000", 2024-09-12T00:05:16.650 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9726000000000001e-05 2024-09-12T00:05:16.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.650 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.650 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.650 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551708+0000", 2024-09-12T00:05:16.650 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020344100000000001 2024-09-12T00:05:16.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.650 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.651 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.651 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552087+0000", 2024-09-12T00:05:16.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000379327 2024-09-12T00:05:16.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.651 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.651 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:16.651 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552351+0000", 2024-09-12T00:05:16.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026349199999999999 2024-09-12T00:05:16.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.651 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.651 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.651 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.569375+0000", 2024-09-12T00:05:16.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017024432999999999 2024-09-12T00:05:16.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.652 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.652 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.652 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571222+0000", 2024-09-12T00:05:16.652 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00184688 2024-09-12T00:05:16.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.652 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.652 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.652 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571511+0000", 2024-09-12T00:05:16.652 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028897599999999998 2024-09-12T00:05:16.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.653 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.653 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.653 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571668+0000", 2024-09-12T00:05:16.653 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000157238 2024-09-12T00:05:16.653 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.653 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.653 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.653 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.653 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2698 3.3d 3:bcafb0f9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.653 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:16.654 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.017461204, 2024-09-12T00:05:16.654 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025133152999999998, 2024-09-12T00:05:16.654 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.654 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.654 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.654 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.654 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.654 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.654 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2698 2024-09-12T00:05:16.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.654 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.654 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.654 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.655 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:16.655 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.655 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.655 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.655 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.655 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:16.655 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.655 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.655 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.655 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.656 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589986+0000", 2024-09-12T00:05:16.656 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5999999999999998e-06 2024-09-12T00:05:16.656 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.656 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.656 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.656 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594109+0000", 2024-09-12T00:05:16.656 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041230770000000002 2024-09-12T00:05:16.656 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.656 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.656 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.656 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594146+0000", 2024-09-12T00:05:16.656 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7722000000000002e-05 2024-09-12T00:05:16.656 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.657 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.657 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.657 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594167+0000", 2024-09-12T00:05:16.657 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0100999999999999e-05 2024-09-12T00:05:16.657 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.657 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.657 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.657 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594297+0000", 2024-09-12T00:05:16.657 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013051600000000001 2024-09-12T00:05:16.657 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.657 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.657 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.657 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594570+0000", 2024-09-12T00:05:16.657 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000272837 2024-09-12T00:05:16.658 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.658 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.658 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:16.658 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594846+0000", 2024-09-12T00:05:16.658 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027622399999999999 2024-09-12T00:05:16.658 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.658 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.658 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.658 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.606026+0000", 2024-09-12T00:05:16.658 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011179947000000001 2024-09-12T00:05:16.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.659 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.659 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.614827+0000", 2024-09-12T00:05:16.659 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0088013259999999999 2024-09-12T00:05:16.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.659 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.659 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.614988+0000", 2024-09-12T00:05:16.659 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016018799999999999 2024-09-12T00:05:16.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.660 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.660 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.615115+0000", 2024-09-12T00:05:16.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000127615 2024-09-12T00:05:16.660 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.660 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.660 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.660 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2699 3.0 3:02470ff9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.660 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.597879+0000", 2024-09-12T00:05:16.660 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.009564115, 2024-09-12T00:05:16.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021498363, 2024-09-12T00:05:16.661 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.661 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.661 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.661 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.661 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.661 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.661 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2699 2024-09-12T00:05:16.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.661 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.661 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.661 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.661 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.597879+0000", 2024-09-12T00:05:16.661 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.597879+0000", 2024-09-12T00:05:16.662 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.597884+0000", 2024-09-12T00:05:16.662 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1769999999999997e-06 2024-09-12T00:05:16.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602129+0000", 2024-09-12T00:05:16.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042451399999999997 2024-09-12T00:05:16.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.663 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602170+0000", 2024-09-12T00:05:16.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0194000000000002e-05 2024-09-12T00:05:16.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.664 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.664 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.664 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602198+0000", 2024-09-12T00:05:16.664 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7861999999999999e-05 2024-09-12T00:05:16.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.664 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.664 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.664 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602392+0000", 2024-09-12T00:05:16.664 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000194122 2024-09-12T00:05:16.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.664 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.665 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.665 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602801+0000", 2024-09-12T00:05:16.665 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040957199999999997 2024-09-12T00:05:16.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.665 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.665 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:16.665 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.603203+0000", 2024-09-12T00:05:16.665 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040166900000000001 2024-09-12T00:05:16.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.665 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.665 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.665 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.611989+0000", 2024-09-12T00:05:16.666 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0087860170000000001 2024-09-12T00:05:16.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.666 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.666 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.666 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.619177+0000", 2024-09-12T00:05:16.666 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0071878819999999996 2024-09-12T00:05:16.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.666 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.666 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.619270+0000", 2024-09-12T00:05:16.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2930999999999995e-05 2024-09-12T00:05:16.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.619378+0000", 2024-09-12T00:05:16.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000107797 2024-09-12T00:05:16.667 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.667 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.667 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.667 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2712 3.3e 3:7d3d0242:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.667 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:16.667 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.880560927000001, 2024-09-12T00:05:16.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022816941, 2024-09-12T00:05:16.668 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.668 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.668 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.668 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.668 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.668 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.668 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2712 2024-09-12T00:05:16.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.668 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.668 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:16.669 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.669 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.669 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.669 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:16.669 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.669 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.669 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.669 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726886+0000", 2024-09-12T00:05:16.669 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5329999999999999e-06 2024-09-12T00:05:16.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.669 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730802+0000", 2024-09-12T00:05:16.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039158700000000001 2024-09-12T00:05:16.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730839+0000", 2024-09-12T00:05:16.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6857999999999998e-05 2024-09-12T00:05:16.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730856+0000", 2024-09-12T00:05:16.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7371999999999999e-05 2024-09-12T00:05:16.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.671 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.671 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731026+0000", 2024-09-12T00:05:16.671 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017011000000000001 2024-09-12T00:05:16.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.671 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.671 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731444+0000", 2024-09-12T00:05:16.671 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041766500000000001 2024-09-12T00:05:16.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.671 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:16.672 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731860+0000", 2024-09-12T00:05:16.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041618500000000001 2024-09-12T00:05:16.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.672 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.672 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.672 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.743012+0000", 2024-09-12T00:05:16.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011152123 2024-09-12T00:05:16.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.672 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.672 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.672 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749386+0000", 2024-09-12T00:05:16.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0063743130000000004 2024-09-12T00:05:16.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749562+0000", 2024-09-12T00:05:16.673 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017590300000000001 2024-09-12T00:05:16.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.674 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.674 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749699+0000", 2024-09-12T00:05:16.674 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000137009 2024-09-12T00:05:16.674 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.674 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.674 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.674 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.674 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2714 3.17 3:eac65a57:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.674 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.746943+0000", 2024-09-12T00:05:16.674 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.860500685000002, 2024-09-12T00:05:16.675 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019462007, 2024-09-12T00:05:16.675 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.675 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.675 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.675 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.675 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.675 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.675 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2714 2024-09-12T00:05:16.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.675 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.675 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.675 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.746943+0000", 2024-09-12T00:05:16.675 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.676 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.676 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.676 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.746943+0000", 2024-09-12T00:05:16.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.676 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.676 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.676 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.746946+0000", 2024-09-12T00:05:16.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9529999999999999e-06 2024-09-12T00:05:16.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.676 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.676 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751163+0000", 2024-09-12T00:05:16.677 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042169859999999998 2024-09-12T00:05:16.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751188+0000", 2024-09-12T00:05:16.677 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5908e-05 2024-09-12T00:05:16.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751203+0000", 2024-09-12T00:05:16.677 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4491999999999999e-05 2024-09-12T00:05:16.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.678 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.678 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751324+0000", 2024-09-12T00:05:16.678 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120866 2024-09-12T00:05:16.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.678 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.678 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.678 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751572+0000", 2024-09-12T00:05:16.678 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024774900000000002 2024-09-12T00:05:16.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.678 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.678 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:16.678 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751798+0000", 2024-09-12T00:05:16.678 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022655700000000001 2024-09-12T00:05:16.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.679 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.679 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761058+0000", 2024-09-12T00:05:16.679 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0092603110000000002 2024-09-12T00:05:16.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.679 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.679 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.766067+0000", 2024-09-12T00:05:16.679 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005009009 2024-09-12T00:05:16.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.679 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.679 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.766264+0000", 2024-09-12T00:05:16.680 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00019632800000000001 2024-09-12T00:05:16.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.680 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.680 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.680 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.766405+0000", 2024-09-12T00:05:16.680 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000140848 2024-09-12T00:05:16.680 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.680 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.680 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.680 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.680 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2715 3.18 3:19a9b410:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.680 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:16.681 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.851184636999999, 2024-09-12T00:05:16.681 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022391956000000001, 2024-09-12T00:05:16.681 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.681 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.681 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.681 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.681 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.681 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.681 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2715 2024-09-12T00:05:16.682 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.682 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.682 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.682 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.682 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:16.682 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.682 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.682 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.682 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.682 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:16.682 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.682 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.682 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.682 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.683 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756262+0000", 2024-09-12T00:05:16.683 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9629999999999998e-06 2024-09-12T00:05:16.683 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.683 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.683 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.683 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760936+0000", 2024-09-12T00:05:16.683 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046745750000000003 2024-09-12T00:05:16.683 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.683 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.683 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.683 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760968+0000", 2024-09-12T00:05:16.683 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1470999999999997e-05 2024-09-12T00:05:16.683 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.684 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.684 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.684 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760985+0000", 2024-09-12T00:05:16.684 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7771999999999999e-05 2024-09-12T00:05:16.684 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.684 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.684 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.684 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761154+0000", 2024-09-12T00:05:16.684 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016875399999999999 2024-09-12T00:05:16.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.685 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.685 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.685 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761571+0000", 2024-09-12T00:05:16.685 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000417231 2024-09-12T00:05:16.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.685 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.685 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:16.685 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761996+0000", 2024-09-12T00:05:16.685 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042500200000000001 2024-09-12T00:05:16.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.685 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.685 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.686 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777182+0000", 2024-09-12T00:05:16.686 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015185664999999999 2024-09-12T00:05:16.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.686 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.686 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.686 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778484+0000", 2024-09-12T00:05:16.686 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00130225 2024-09-12T00:05:16.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.686 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.686 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.686 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778575+0000", 2024-09-12T00:05:16.686 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0258000000000002e-05 2024-09-12T00:05:16.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.687 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.687 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.687 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778651+0000", 2024-09-12T00:05:16.687 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6014999999999996e-05 2024-09-12T00:05:16.687 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.687 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.687 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.687 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.687 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.687 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2717 3.1a e63/23 3:5be58560:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_202:head v 63'4, mlcod=63'2)", 2024-09-12T00:05:16.687 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.777964+0000", 2024-09-12T00:05:16.687 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.829479617000001, 2024-09-12T00:05:16.687 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015392704, 2024-09-12T00:05:16.688 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.688 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.688 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.688 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.688 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.688 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.688 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777964+0000", 2024-09-12T00:05:16.688 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.688 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.688 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.688 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777964+0000", 2024-09-12T00:05:16.688 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.689 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.689 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777966+0000", 2024-09-12T00:05:16.689 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6400000000000001e-06 2024-09-12T00:05:16.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.689 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.689 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.784444+0000", 2024-09-12T00:05:16.689 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064781179999999997 2024-09-12T00:05:16.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.689 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.689 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.784479+0000", 2024-09-12T00:05:16.689 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4267999999999998e-05 2024-09-12T00:05:16.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.690 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.690 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.690 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.784495+0000", 2024-09-12T00:05:16.690 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6388999999999998e-05 2024-09-12T00:05:16.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.690 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.690 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.690 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.784609+0000", 2024-09-12T00:05:16.690 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000114209 2024-09-12T00:05:16.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.690 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.690 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.691 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.784650+0000", 2024-09-12T00:05:16.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0515000000000001e-05 2024-09-12T00:05:16.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.691 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.691 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.691 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793224+0000", 2024-09-12T00:05:16.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0085740060000000003 2024-09-12T00:05:16.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.691 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.691 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.691 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793356+0000", 2024-09-12T00:05:16.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000132559 2024-09-12T00:05:16.691 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.692 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.692 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.692 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.692 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2718 3.4 e63/23 3:20fe36bb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_203:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:16.692 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.793296+0000", 2024-09-12T00:05:16.692 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.814146795999999, 2024-09-12T00:05:16.692 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015716714, 2024-09-12T00:05:16.692 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.692 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.692 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.692 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.692 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.693 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.693 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793296+0000", 2024-09-12T00:05:16.693 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.693 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.693 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.693 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793296+0000", 2024-09-12T00:05:16.693 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.693 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.693 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.693 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793298+0000", 2024-09-12T00:05:16.693 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0200000000000001e-06 2024-09-12T00:05:16.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.694 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.694 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.694 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.797364+0000", 2024-09-12T00:05:16.694 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040657039999999998 2024-09-12T00:05:16.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.694 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.694 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.694 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.797404+0000", 2024-09-12T00:05:16.694 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0302000000000001e-05 2024-09-12T00:05:16.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.695 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.695 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.797423+0000", 2024-09-12T00:05:16.695 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8308000000000002e-05 2024-09-12T00:05:16.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.695 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.695 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.797582+0000", 2024-09-12T00:05:16.695 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000159047 2024-09-12T00:05:16.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.695 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.695 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.797650+0000", 2024-09-12T00:05:16.696 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.7832999999999999e-05 2024-09-12T00:05:16.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.696 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.696 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.696 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808882+0000", 2024-09-12T00:05:16.696 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011231837999999999 2024-09-12T00:05:16.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.697 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.697 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.697 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.809013+0000", 2024-09-12T00:05:16.697 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000131662 2024-09-12T00:05:16.697 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.697 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.697 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.697 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.697 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2726 3.3e 3:7fc616c8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.697 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.866346+0000", 2024-09-12T00:05:16.697 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.741097026999999, 2024-09-12T00:05:16.697 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018314736000000002, 2024-09-12T00:05:16.698 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.698 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.698 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.698 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.698 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.698 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.698 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2726 2024-09-12T00:05:16.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.698 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.698 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.698 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.698 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.866346+0000", 2024-09-12T00:05:16.698 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.698 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.699 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.699 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.866346+0000", 2024-09-12T00:05:16.699 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.699 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.699 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.699 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.866350+0000", 2024-09-12T00:05:16.699 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.54e-06 2024-09-12T00:05:16.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.699 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.699 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.699 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.870325+0000", 2024-09-12T00:05:16.699 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003975353 2024-09-12T00:05:16.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.700 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.700 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.870362+0000", 2024-09-12T00:05:16.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6591000000000003e-05 2024-09-12T00:05:16.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.700 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.700 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.870380+0000", 2024-09-12T00:05:16.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7921999999999999e-05 2024-09-12T00:05:16.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.700 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.700 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.870510+0000", 2024-09-12T00:05:16.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013024600000000001 2024-09-12T00:05:16.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.870921+0000", 2024-09-12T00:05:16.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041149600000000002 2024-09-12T00:05:16.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:16.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.871207+0000", 2024-09-12T00:05:16.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028534600000000002 2024-09-12T00:05:16.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.880787+0000", 2024-09-12T00:05:16.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095802300000000003 2024-09-12T00:05:16.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884454+0000", 2024-09-12T00:05:16.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0036669480000000002 2024-09-12T00:05:16.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884546+0000", 2024-09-12T00:05:16.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1625000000000005e-05 2024-09-12T00:05:16.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884661+0000", 2024-09-12T00:05:16.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000115439 2024-09-12T00:05:16.703 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.703 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.703 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.703 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2728 3.1f 3:faea8f78:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.703 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.887643+0000", 2024-09-12T00:05:16.703 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.719800329000002, 2024-09-12T00:05:16.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017919767, 2024-09-12T00:05:16.703 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.704 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.704 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.704 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.704 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.704 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.704 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2728 2024-09-12T00:05:16.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.704 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.704 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.704 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.705 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.887643+0000", 2024-09-12T00:05:16.705 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.705 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.705 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.887643+0000", 2024-09-12T00:05:16.705 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.705 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.705 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.887647+0000", 2024-09-12T00:05:16.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.754e-06 2024-09-12T00:05:16.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.706 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.706 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.891952+0000", 2024-09-12T00:05:16.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043048690000000002 2024-09-12T00:05:16.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.891990+0000", 2024-09-12T00:05:16.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8005e-05 2024-09-12T00:05:16.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.892008+0000", 2024-09-12T00:05:16.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7995999999999998e-05 2024-09-12T00:05:16.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.892140+0000", 2024-09-12T00:05:16.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013216200000000001 2024-09-12T00:05:16.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.708 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.708 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.708 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.892393+0000", 2024-09-12T00:05:16.708 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025355799999999997 2024-09-12T00:05:16.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.708 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.708 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:16.708 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.892620+0000", 2024-09-12T00:05:16.708 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022690000000000001 2024-09-12T00:05:16.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.708 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.708 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.709 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902865+0000", 2024-09-12T00:05:16.709 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010244684 2024-09-12T00:05:16.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.709 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.709 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.709 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.905386+0000", 2024-09-12T00:05:16.709 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0025208800000000001 2024-09-12T00:05:16.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.709 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.709 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.709 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.905480+0000", 2024-09-12T00:05:16.709 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4493999999999993e-05 2024-09-12T00:05:16.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.710 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.710 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.710 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.905563+0000", 2024-09-12T00:05:16.710 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2465000000000004e-05 2024-09-12T00:05:16.710 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.710 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.710 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.710 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.710 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.710 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2729 3.0 3:01c0e0c9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.710 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:16.711 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.710303821, 2024-09-12T00:05:16.711 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025173068, 2024-09-12T00:05:16.711 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.711 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.711 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.711 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.711 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.711 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.711 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2729 2024-09-12T00:05:16.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.711 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.711 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:16.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:16.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897143+0000", 2024-09-12T00:05:16.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6600000000000001e-06 2024-09-12T00:05:16.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.713 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.713 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.713 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901595+0000", 2024-09-12T00:05:16.713 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044514680000000001 2024-09-12T00:05:16.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.713 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.713 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.713 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901629+0000", 2024-09-12T00:05:16.713 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4864999999999999e-05 2024-09-12T00:05:16.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.713 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.713 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.714 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901647+0000", 2024-09-12T00:05:16.714 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7699000000000001e-05 2024-09-12T00:05:16.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.714 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.714 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.714 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901780+0000", 2024-09-12T00:05:16.714 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013271499999999999 2024-09-12T00:05:16.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.714 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.714 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.714 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902010+0000", 2024-09-12T00:05:16.714 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022977300000000001 2024-09-12T00:05:16.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.714 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.715 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:16.715 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902222+0000", 2024-09-12T00:05:16.715 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021262399999999999 2024-09-12T00:05:16.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.715 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.715 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.715 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912402+0000", 2024-09-12T00:05:16.715 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010180203000000001 2024-09-12T00:05:16.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.715 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.715 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.715 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.921990+0000", 2024-09-12T00:05:16.715 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095871900000000006 2024-09-12T00:05:16.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.716 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.716 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.716 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.922166+0000", 2024-09-12T00:05:16.716 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017591899999999999 2024-09-12T00:05:16.716 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.716 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.716 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.716 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.922313+0000", 2024-09-12T00:05:16.716 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000146952 2024-09-12T00:05:16.716 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.716 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.716 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.717 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.717 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2732 3.1f 3:f85b64cb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.717 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:16.717 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.678858033000001, 2024-09-12T00:05:16.717 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022644154, 2024-09-12T00:05:16.717 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.717 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.717 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.717 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.717 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.717 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.717 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2732 2024-09-12T00:05:16.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.718 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:16.718 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:16.718 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.719 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.719 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928589+0000", 2024-09-12T00:05:16.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1230000000000002e-06 2024-09-12T00:05:16.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.719 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.719 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932650+0000", 2024-09-12T00:05:16.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040611049999999997 2024-09-12T00:05:16.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.719 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.719 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932692+0000", 2024-09-12T00:05:16.720 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1677000000000001e-05 2024-09-12T00:05:16.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.720 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.720 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.720 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932711+0000", 2024-09-12T00:05:16.720 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8749e-05 2024-09-12T00:05:16.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.720 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.720 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.720 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932834+0000", 2024-09-12T00:05:16.720 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012278300000000001 2024-09-12T00:05:16.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.720 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.721 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.721 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.933095+0000", 2024-09-12T00:05:16.721 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026151100000000002 2024-09-12T00:05:16.721 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.721 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.721 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:16.721 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.933385+0000", 2024-09-12T00:05:16.721 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028993900000000002 2024-09-12T00:05:16.721 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.721 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.721 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.721 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.950988+0000", 2024-09-12T00:05:16.721 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017603119 2024-09-12T00:05:16.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.722 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.722 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.722 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951018+0000", 2024-09-12T00:05:16.722 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9343999999999999e-05 2024-09-12T00:05:16.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.722 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.722 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.722 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951109+0000", 2024-09-12T00:05:16.722 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1157999999999997e-05 2024-09-12T00:05:16.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.723 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.723 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951229+0000", 2024-09-12T00:05:16.723 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120646 2024-09-12T00:05:16.723 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.723 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.723 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.723 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2741 3.17 3:e9d72553:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.723 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.026321+0000", 2024-09-12T00:05:16.724 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.581122405999999, 2024-09-12T00:05:16.724 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018394443, 2024-09-12T00:05:16.724 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.724 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.724 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.724 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.724 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.724 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.724 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2741 2024-09-12T00:05:16.724 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.724 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.724 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.724 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.725 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.026321+0000", 2024-09-12T00:05:16.725 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.725 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.725 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.725 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.026321+0000", 2024-09-12T00:05:16.725 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.725 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.725 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.725 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.026325+0000", 2024-09-12T00:05:16.726 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9670000000000003e-06 2024-09-12T00:05:16.726 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.726 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.726 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.726 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030370+0000", 2024-09-12T00:05:16.726 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040448189999999998 2024-09-12T00:05:16.726 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.727 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.727 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.727 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030408+0000", 2024-09-12T00:05:16.727 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8481e-05 2024-09-12T00:05:16.727 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.727 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.727 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.728 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030426+0000", 2024-09-12T00:05:16.728 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8236e-05 2024-09-12T00:05:16.728 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.728 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.728 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.728 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030588+0000", 2024-09-12T00:05:16.728 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000161614 2024-09-12T00:05:16.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.729 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.729 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.729 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030854+0000", 2024-09-12T00:05:16.729 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026595699999999999 2024-09-12T00:05:16.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.729 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.730 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:16.730 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.031124+0000", 2024-09-12T00:05:16.730 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027049799999999998 2024-09-12T00:05:16.730 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.730 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.730 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.731 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.039845+0000", 2024-09-12T00:05:16.731 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00872063 2024-09-12T00:05:16.731 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.731 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.731 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.731 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.044412+0000", 2024-09-12T00:05:16.732 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045666860000000004 2024-09-12T00:05:16.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.732 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.732 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.732 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.044589+0000", 2024-09-12T00:05:16.732 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000176789 2024-09-12T00:05:16.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.732 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.733 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.733 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.044715+0000", 2024-09-12T00:05:16.733 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000126766 2024-09-12T00:05:16.733 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.733 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.733 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.733 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.733 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.733 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2747 3.17 3:eaa4528d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:16.733 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:16.733 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.518521547999999, 2024-09-12T00:05:16.734 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025552734000000001, 2024-09-12T00:05:16.734 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.734 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.734 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.734 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:16.734 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:16.734 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:16.734 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2747 2024-09-12T00:05:16.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.734 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.734 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.734 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.734 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:16.735 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.735 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.735 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.735 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.735 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:16.735 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.735 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.735 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.735 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.735 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088925+0000", 2024-09-12T00:05:16.735 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7759999999999999e-06 2024-09-12T00:05:16.735 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.735 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.735 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.736 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093002+0000", 2024-09-12T00:05:16.736 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004076405 2024-09-12T00:05:16.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.736 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.736 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.736 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093040+0000", 2024-09-12T00:05:16.736 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8093999999999998e-05 2024-09-12T00:05:16.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.736 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.736 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.736 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093059+0000", 2024-09-12T00:05:16.736 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8736000000000002e-05 2024-09-12T00:05:16.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.736 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.737 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.737 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093230+0000", 2024-09-12T00:05:16.737 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000170853 2024-09-12T00:05:16.737 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.737 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.737 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.737 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093627+0000", 2024-09-12T00:05:16.737 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039781400000000002 2024-09-12T00:05:16.737 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.737 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.737 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:16.737 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.094044+0000", 2024-09-12T00:05:16.737 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000416205 2024-09-12T00:05:16.737 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.738 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.738 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:16.738 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.103528+0000", 2024-09-12T00:05:16.738 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0094841549999999993 2024-09-12T00:05:16.738 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.738 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.738 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:16.738 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112299+0000", 2024-09-12T00:05:16.738 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0087711590000000006 2024-09-12T00:05:16.738 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.738 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.738 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.738 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112397+0000", 2024-09-12T00:05:16.738 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8095000000000002e-05 2024-09-12T00:05:16.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.739 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.739 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.739 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.114474+0000", 2024-09-12T00:05:16.739 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020774420000000001 2024-09-12T00:05:16.739 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.739 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.739 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.739 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.739 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2748 3.3b e63/23 3:df6d92a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_233:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:16.739 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.104676+0000", 2024-09-12T00:05:16.739 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.502767170999999, 2024-09-12T00:05:16.739 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016872637999999999, 2024-09-12T00:05:16.740 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:16.740 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:16.740 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:16.740 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:16.740 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.740 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:16.740 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.104676+0000", 2024-09-12T00:05:16.740 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.740 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.740 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:16.740 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.104676+0000", 2024-09-12T00:05:16.740 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:16.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.741 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.741 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:16.741 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.104678+0000", 2024-09-12T00:05:16.741 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5400000000000001e-06 2024-09-12T00:05:16.741 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.741 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.741 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:16.741 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.108632+0000", 2024-09-12T00:05:16.741 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039548650000000001 2024-09-12T00:05:16.742 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.742 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.742 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:16.742 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.108662+0000", 2024-09-12T00:05:16.742 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9235999999999999e-05 2024-09-12T00:05:16.742 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.742 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.743 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:16.743 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.108677+0000", 2024-09-12T00:05:16.743 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5455999999999999e-05 2024-09-12T00:05:16.743 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.743 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.743 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:16.743 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.108845+0000", 2024-09-12T00:05:16.743 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016741299999999999 2024-09-12T00:05:16.743 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.744 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.744 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:16.744 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.108906+0000", 2024-09-12T00:05:16.744 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1283000000000003e-05 2024-09-12T00:05:16.744 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.744 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.744 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:16.744 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.121360+0000", 2024-09-12T00:05:16.744 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012454036 2024-09-12T00:05:16.744 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:16.744 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:16.744 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:16.745 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.121549+0000", 2024-09-12T00:05:16.745 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018880899999999999 2024-09-12T00:05:16.745 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.745 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.745 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.745 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:16.745 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:16.745 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:16.746 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:05:16.747 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:16.745+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:16.847 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:16.845+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:16.918 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:16.918 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:16.919 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:16.919 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:16.934 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:05:16.978 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:16.977+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:17.049 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:17.045+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:17.104 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:17.104 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:17.104 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:17.104 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:17.104 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:17.118 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:05:17.151 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:17.152+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:17.252 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:17.252+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:17.287 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:17.288 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:17.288 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:17.288 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:17.288 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.288 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1646 3.25 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:05:17.288 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:17.288 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 44.210917258000002, 2024-09-12T00:05:17.288 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030091884999999999, 2024-09-12T00:05:17.288 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:17.288 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:17.288 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:17.288 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:17.289 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:17.289 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:17.289 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1646 2024-09-12T00:05:17.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.289 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:17.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.289 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:17.289 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:17.289 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.289 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:17.289 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:17.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.290 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.290 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:17.290 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077113+0000", 2024-09-12T00:05:17.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0186e-05 2024-09-12T00:05:17.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.290 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.290 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:17.290 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084821+0000", 2024-09-12T00:05:17.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077083450000000001 2024-09-12T00:05:17.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.290 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.290 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:17.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084857+0000", 2024-09-12T00:05:17.291 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6245000000000003e-05 2024-09-12T00:05:17.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.291 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.291 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:17.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084900+0000", 2024-09-12T00:05:17.291 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2369e-05 2024-09-12T00:05:17.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.291 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.291 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:17.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085058+0000", 2024-09-12T00:05:17.291 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015858199999999999 2024-09-12T00:05:17.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.291 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.292 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:17.292 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085307+0000", 2024-09-12T00:05:17.292 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024867999999999998 2024-09-12T00:05:17.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.292 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.292 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:17.292 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086107+0000", 2024-09-12T00:05:17.292 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00080040099999999996 2024-09-12T00:05:17.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.292 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.292 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:17.292 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.100477+0000", 2024-09-12T00:05:17.292 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014369508 2024-09-12T00:05:17.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.293 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.293 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:17.293 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107016+0000", 2024-09-12T00:05:17.293 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006538894 2024-09-12T00:05:17.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.293 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.293 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:17.293 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107121+0000", 2024-09-12T00:05:17.293 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105284 2024-09-12T00:05:17.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.293 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.293 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:17.293 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107194+0000", 2024-09-12T00:05:17.294 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3391000000000003e-05 2024-09-12T00:05:17.294 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.294 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:17.294 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.294 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.294 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1917 3.1 3:829295ac:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.4_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:05:17.294 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:17.294 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 42.122833778, 2024-09-12T00:05:17.294 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021401453000000001, 2024-09-12T00:05:17.294 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:17.294 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:17.294 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:17.294 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:17.295 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:17.295 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:17.295 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1917 2024-09-12T00:05:17.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.295 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:17.295 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.295 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:17.295 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:17.295 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.295 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.295 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:17.295 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:17.295 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:17.296 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165188+0000", 2024-09-12T00:05:17.296 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5409999999999999e-06 2024-09-12T00:05:17.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:17.296 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169353+0000", 2024-09-12T00:05:17.296 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00416446 2024-09-12T00:05:17.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:17.297 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169380+0000", 2024-09-12T00:05:17.297 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6919000000000001e-05 2024-09-12T00:05:17.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.297 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.297 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:17.297 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169392+0000", 2024-09-12T00:05:17.297 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1967000000000001e-05 2024-09-12T00:05:17.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.297 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.297 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:17.297 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169519+0000", 2024-09-12T00:05:17.297 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012686199999999999 2024-09-12T00:05:17.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.297 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.298 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:17.298 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169789+0000", 2024-09-12T00:05:17.298 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027062700000000001 2024-09-12T00:05:17.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.298 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.298 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:17.298 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.170614+0000", 2024-09-12T00:05:17.298 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00082475799999999998 2024-09-12T00:05:17.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.298 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.298 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:17.298 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.183665+0000", 2024-09-12T00:05:17.298 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013051269000000001 2024-09-12T00:05:17.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:17.299 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186367+0000", 2024-09-12T00:05:17.299 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002701789 2024-09-12T00:05:17.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:17.299 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186485+0000", 2024-09-12T00:05:17.299 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011763400000000001 2024-09-12T00:05:17.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:17.299 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186587+0000", 2024-09-12T00:05:17.299 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010262700000000001 2024-09-12T00:05:17.300 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.300 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:17.300 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.300 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.300 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2670 3.15 e63/23 3:aae67b25:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_165:head v 63'2, mlcod=0'0)", 2024-09-12T00:05:17.300 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.405423+0000", 2024-09-12T00:05:17.300 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.882596240000002, 2024-09-12T00:05:17.300 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016803036, 2024-09-12T00:05:17.300 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:17.300 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:17.300 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:17.300 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:17.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.301 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:17.301 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.405423+0000", 2024-09-12T00:05:17.301 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.301 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:17.301 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.405423+0000", 2024-09-12T00:05:17.301 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.301 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:17.301 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.405426+0000", 2024-09-12T00:05:17.301 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7669999999999999e-06 2024-09-12T00:05:17.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.302 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:17.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.410512+0000", 2024-09-12T00:05:17.302 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0050861370000000001 2024-09-12T00:05:17.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.302 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:17.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.410546+0000", 2024-09-12T00:05:17.302 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3167999999999998e-05 2024-09-12T00:05:17.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.302 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:17.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.410560+0000", 2024-09-12T00:05:17.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4703e-05 2024-09-12T00:05:17.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:17.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.410743+0000", 2024-09-12T00:05:17.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018231899999999999 2024-09-12T00:05:17.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:17.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.410811+0000", 2024-09-12T00:05:17.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8548999999999997e-05 2024-09-12T00:05:17.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:17.304 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.422127+0000", 2024-09-12T00:05:17.304 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011316109 2024-09-12T00:05:17.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.304 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.304 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:17.304 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.422226+0000", 2024-09-12T00:05:17.304 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9283999999999993e-05 2024-09-12T00:05:17.304 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.304 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:17.304 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.304 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.304 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2675 3.20 e63/23 3:0529bfef:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_170:head v 63'4, mlcod=62'2)", 2024-09-12T00:05:17.305 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.456051+0000", 2024-09-12T00:05:17.305 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.831968365000002, 2024-09-12T00:05:17.305 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015360705000000001, 2024-09-12T00:05:17.305 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:17.305 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:17.305 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:17.305 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:17.305 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.305 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:17.305 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.456051+0000", 2024-09-12T00:05:17.305 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.305 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.305 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:17.306 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.456051+0000", 2024-09-12T00:05:17.306 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.306 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:17.306 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.456054+0000", 2024-09-12T00:05:17.306 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.92e-06 2024-09-12T00:05:17.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.306 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:17.306 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.460182+0000", 2024-09-12T00:05:17.306 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004127571 2024-09-12T00:05:17.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.307 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:17.307 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.460228+0000", 2024-09-12T00:05:17.307 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6551000000000002e-05 2024-09-12T00:05:17.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.307 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.307 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:17.307 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.460253+0000", 2024-09-12T00:05:17.307 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4615000000000001e-05 2024-09-12T00:05:17.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.307 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.307 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:17.307 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.460416+0000", 2024-09-12T00:05:17.307 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016267699999999999 2024-09-12T00:05:17.308 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.308 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.308 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:17.308 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.460479+0000", 2024-09-12T00:05:17.308 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3507e-05 2024-09-12T00:05:17.308 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.308 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.308 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:17.308 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.471281+0000", 2024-09-12T00:05:17.308 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010802169 2024-09-12T00:05:17.308 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.308 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.308 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:17.308 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.471412+0000", 2024-09-12T00:05:17.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013069500000000001 2024-09-12T00:05:17.309 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.309 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:17.309 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.309 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.309 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2705 3.24 3:26f37004:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:17.309 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.657414+0000", 2024-09-12T00:05:17.309 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.630605287000002, 2024-09-12T00:05:17.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016400229999999998, 2024-09-12T00:05:17.309 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:17.309 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:17.309 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:17.310 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:17.310 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:17.310 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:17.310 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2705 2024-09-12T00:05:17.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.310 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:17.310 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.310 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:17.310 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.657414+0000", 2024-09-12T00:05:17.310 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.310 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.310 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:17.310 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.657414+0000", 2024-09-12T00:05:17.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.311 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:17.311 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.657418+0000", 2024-09-12T00:05:17.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9029999999999997e-06 2024-09-12T00:05:17.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.311 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:17.311 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.661748+0000", 2024-09-12T00:05:17.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004329729 2024-09-12T00:05:17.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.311 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:17.312 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.661790+0000", 2024-09-12T00:05:17.312 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1921000000000001e-05 2024-09-12T00:05:17.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:17.312 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.661811+0000", 2024-09-12T00:05:17.312 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1058999999999999e-05 2024-09-12T00:05:17.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:17.312 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.661975+0000", 2024-09-12T00:05:17.312 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016390999999999999 2024-09-12T00:05:17.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.313 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:17.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.662220+0000", 2024-09-12T00:05:17.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024466499999999998 2024-09-12T00:05:17.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.313 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:17.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.662451+0000", 2024-09-12T00:05:17.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000231463 2024-09-12T00:05:17.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.313 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:17.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.671543+0000", 2024-09-12T00:05:17.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0090919320000000005 2024-09-12T00:05:17.314 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.314 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.314 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:17.314 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.673650+0000", 2024-09-12T00:05:17.314 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0021065509999999999 2024-09-12T00:05:17.314 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.314 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.314 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:17.314 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.673742+0000", 2024-09-12T00:05:17.314 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2108000000000006e-05 2024-09-12T00:05:17.314 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.314 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.314 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:17.314 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.673815+0000", 2024-09-12T00:05:17.315 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2989000000000002e-05 2024-09-12T00:05:17.315 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.315 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:17.315 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.315 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.315 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2712 3.3e e63/23 3:7d3d0242:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_197:head v 63'4, mlcod=63'2)", 2024-09-12T00:05:17.315 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.732097+0000", 2024-09-12T00:05:17.315 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.555922337999998, 2024-09-12T00:05:17.315 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016924379, 2024-09-12T00:05:17.315 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:17.315 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:17.315 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:17.316 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:17.316 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.316 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:17.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.732097+0000", 2024-09-12T00:05:17.316 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.316 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.316 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:17.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.732097+0000", 2024-09-12T00:05:17.316 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.316 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.316 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:17.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.732100+0000", 2024-09-12T00:05:17.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8789999999999999e-06 2024-09-12T00:05:17.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.317 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.317 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:17.317 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.736405+0000", 2024-09-12T00:05:17.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043048139999999997 2024-09-12T00:05:17.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.317 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.317 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:17.317 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.736443+0000", 2024-09-12T00:05:17.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7968e-05 2024-09-12T00:05:17.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.317 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.318 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:17.318 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.736460+0000", 2024-09-12T00:05:17.318 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6878999999999999e-05 2024-09-12T00:05:17.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.318 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.318 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:17.318 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.736645+0000", 2024-09-12T00:05:17.318 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000185176 2024-09-12T00:05:17.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.318 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.318 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:17.318 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.736689+0000", 2024-09-12T00:05:17.318 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3956999999999999e-05 2024-09-12T00:05:17.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.319 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.319 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:17.319 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.748895+0000", 2024-09-12T00:05:17.319 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.01220592 2024-09-12T00:05:17.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.319 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.319 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:17.319 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749022+0000", 2024-09-12T00:05:17.319 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012678599999999999 2024-09-12T00:05:17.319 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.319 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:17.319 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.320 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.320 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2716 3.20 e63/23 3:042f7231:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_201:head v 63'5, mlcod=62'3)", 2024-09-12T00:05:17.320 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.769786+0000", 2024-09-12T00:05:17.320 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.518233876, 2024-09-12T00:05:17.320 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018005950999999999, 2024-09-12T00:05:17.320 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:17.320 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:17.320 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:17.320 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:17.320 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.320 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:17.320 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.769786+0000", 2024-09-12T00:05:17.320 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.321 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.321 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:17.321 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.769786+0000", 2024-09-12T00:05:17.321 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.321 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.321 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:17.321 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.769788+0000", 2024-09-12T00:05:17.321 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4729999999999999e-06 2024-09-12T00:05:17.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.321 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.321 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:17.322 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777256+0000", 2024-09-12T00:05:17.322 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0074680579999999996 2024-09-12T00:05:17.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.322 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.322 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:17.322 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777288+0000", 2024-09-12T00:05:17.322 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1322000000000003e-05 2024-09-12T00:05:17.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.322 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.322 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:17.322 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777303+0000", 2024-09-12T00:05:17.322 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5139e-05 2024-09-12T00:05:17.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.322 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.322 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:17.323 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777399+0000", 2024-09-12T00:05:17.323 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5711000000000006e-05 2024-09-12T00:05:17.323 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.323 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.323 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:17.323 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777437+0000", 2024-09-12T00:05:17.323 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8056999999999998e-05 2024-09-12T00:05:17.323 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.323 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.323 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:17.323 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.787696+0000", 2024-09-12T00:05:17.323 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010259127 2024-09-12T00:05:17.323 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.323 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.324 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:17.324 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.787792+0000", 2024-09-12T00:05:17.324 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.6063999999999994e-05 2024-09-12T00:05:17.324 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.324 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:17.324 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.324 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.324 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.324 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2718 3.4 3:20fe36bb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:17.324 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:17.324 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.5024391, 2024-09-12T00:05:17.324 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027867928, 2024-09-12T00:05:17.324 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:17.324 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:17.325 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:17.325 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:17.325 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:17.325 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:17.325 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2718 2024-09-12T00:05:17.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.325 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:17.325 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.325 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:17.325 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:17.325 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.325 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.326 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:17.326 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:17.326 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.326 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.326 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.326 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:17.326 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785584+0000", 2024-09-12T00:05:17.326 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.056e-06 2024-09-12T00:05:17.326 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.326 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.326 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:17.326 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792023+0000", 2024-09-12T00:05:17.326 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064398069999999996 2024-09-12T00:05:17.326 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.326 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.327 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:17.327 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792058+0000", 2024-09-12T00:05:17.327 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5018000000000003e-05 2024-09-12T00:05:17.327 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.327 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.327 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:17.327 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792078+0000", 2024-09-12T00:05:17.327 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9862000000000001e-05 2024-09-12T00:05:17.327 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.327 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.327 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:17.327 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792248+0000", 2024-09-12T00:05:17.327 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017006399999999999 2024-09-12T00:05:17.327 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.327 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.328 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:17.328 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792660+0000", 2024-09-12T00:05:17.328 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041189500000000001 2024-09-12T00:05:17.328 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.328 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.328 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:17.328 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793081+0000", 2024-09-12T00:05:17.328 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000420395 2024-09-12T00:05:17.328 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.328 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.328 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:17.328 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808422+0000", 2024-09-12T00:05:17.328 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015341626000000001 2024-09-12T00:05:17.329 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.329 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.329 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:17.329 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813192+0000", 2024-09-12T00:05:17.329 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047701799999999997 2024-09-12T00:05:17.329 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.329 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.329 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:17.329 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813339+0000", 2024-09-12T00:05:17.329 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014643800000000001 2024-09-12T00:05:17.329 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.329 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.329 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:17.330 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813449+0000", 2024-09-12T00:05:17.330 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010958700000000001 2024-09-12T00:05:17.330 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.330 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:17.330 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.330 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.330 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.330 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2719 3.1 3:83b62cc7:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:17.330 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:17.330 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.493931663000001, 2024-09-12T00:05:17.330 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021687128999999999, 2024-09-12T00:05:17.330 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:17.330 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:17.331 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:17.331 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:17.331 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:17.331 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:17.331 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2719 2024-09-12T00:05:17.331 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.331 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:17.331 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.331 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:17.331 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:17.331 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.331 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.331 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.331 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:17.332 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:17.332 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.332 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.332 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.332 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:17.332 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794091+0000", 2024-09-12T00:05:17.332 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0630000000000002e-06 2024-09-12T00:05:17.332 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.332 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.332 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:17.332 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800194+0000", 2024-09-12T00:05:17.332 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061025089999999999 2024-09-12T00:05:17.332 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.332 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.333 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:17.333 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800234+0000", 2024-09-12T00:05:17.333 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0114999999999998e-05 2024-09-12T00:05:17.333 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.333 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.333 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:17.333 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800255+0000", 2024-09-12T00:05:17.333 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1548000000000001e-05 2024-09-12T00:05:17.333 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.333 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.333 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:17.333 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800400+0000", 2024-09-12T00:05:17.333 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014438499999999999 2024-09-12T00:05:17.334 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.334 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.334 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:17.334 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800654+0000", 2024-09-12T00:05:17.334 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025430500000000003 2024-09-12T00:05:17.334 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.334 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.334 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:17.334 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800908+0000", 2024-09-12T00:05:17.334 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025422800000000001 2024-09-12T00:05:17.334 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.334 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.334 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:17.334 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.814197+0000", 2024-09-12T00:05:17.334 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013289216 2024-09-12T00:05:17.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.335 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.335 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:17.335 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815578+0000", 2024-09-12T00:05:17.335 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00138079 2024-09-12T00:05:17.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.335 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.335 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:17.335 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815704+0000", 2024-09-12T00:05:17.335 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012551500000000001 2024-09-12T00:05:17.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.335 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.335 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:17.335 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815775+0000", 2024-09-12T00:05:17.336 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1454999999999999e-05 2024-09-12T00:05:17.336 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.336 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:17.336 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.336 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.336 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.336 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2730 3.7 e63/23 3:e3fca83c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_215:head v 63'5, mlcod=62'3)", 2024-09-12T00:05:17.336 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.913714+0000", 2024-09-12T00:05:17.336 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.374305568, 2024-09-12T00:05:17.336 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016065969999999999, 2024-09-12T00:05:17.336 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:17.336 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:17.336 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:17.336 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:17.337 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.337 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:17.337 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913714+0000", 2024-09-12T00:05:17.337 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.337 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.337 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.337 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:17.337 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913714+0000", 2024-09-12T00:05:17.337 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.337 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.337 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.337 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:17.337 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913717+0000", 2024-09-12T00:05:17.337 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2229999999999999e-06 2024-09-12T00:05:17.338 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.338 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.338 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:17.338 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.916396+0000", 2024-09-12T00:05:17.338 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026787909999999998 2024-09-12T00:05:17.338 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.338 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.338 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:17.338 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.916432+0000", 2024-09-12T00:05:17.338 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6193999999999999e-05 2024-09-12T00:05:17.338 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.338 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.338 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:17.338 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.916449+0000", 2024-09-12T00:05:17.339 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6575999999999999e-05 2024-09-12T00:05:17.339 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.339 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.339 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:17.339 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.916604+0000", 2024-09-12T00:05:17.339 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015556700000000001 2024-09-12T00:05:17.339 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.339 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.339 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:17.339 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.916647+0000", 2024-09-12T00:05:17.339 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2630999999999999e-05 2024-09-12T00:05:17.339 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.339 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.339 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:17.340 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.929614+0000", 2024-09-12T00:05:17.340 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012967215000000001 2024-09-12T00:05:17.340 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.340 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.340 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:17.340 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.929780+0000", 2024-09-12T00:05:17.340 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000165773 2024-09-12T00:05:17.340 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.340 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:17.340 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.340 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.340 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.340 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2736 3.25 3:a750a681:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:17.340 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:17.341 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.312666738000001, 2024-09-12T00:05:17.341 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025701234999999999, 2024-09-12T00:05:17.341 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:17.341 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:17.341 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:17.341 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:17.341 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:17.341 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:17.341 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2736 2024-09-12T00:05:17.341 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.341 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:17.341 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.341 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:17.342 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:17.342 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.342 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.342 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.342 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:17.342 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:17.342 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.342 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.342 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.342 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:17.342 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975357+0000", 2024-09-12T00:05:17.342 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9389999999999999e-06 2024-09-12T00:05:17.342 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.343 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.343 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:17.343 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979365+0000", 2024-09-12T00:05:17.343 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040076679999999998 2024-09-12T00:05:17.343 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.343 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.343 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:17.343 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979402+0000", 2024-09-12T00:05:17.343 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7557e-05 2024-09-12T00:05:17.343 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.343 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.343 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:17.343 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979419+0000", 2024-09-12T00:05:17.344 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7203000000000001e-05 2024-09-12T00:05:17.344 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.344 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.344 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:17.344 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979543+0000", 2024-09-12T00:05:17.344 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000123423 2024-09-12T00:05:17.344 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.344 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.344 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:17.344 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979784+0000", 2024-09-12T00:05:17.344 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024097800000000001 2024-09-12T00:05:17.344 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.344 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.345 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:17.345 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980013+0000", 2024-09-12T00:05:17.345 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022881999999999999 2024-09-12T00:05:17.345 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.345 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.345 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:17.345 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.999860+0000", 2024-09-12T00:05:17.345 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019847908000000001 2024-09-12T00:05:17.345 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.345 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.345 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:17.345 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000741+0000", 2024-09-12T00:05:17.345 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00088041499999999995 2024-09-12T00:05:17.345 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.346 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.346 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:17.346 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000915+0000", 2024-09-12T00:05:17.346 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017460300000000001 2024-09-12T00:05:17.346 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.346 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.346 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:17.346 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.001054+0000", 2024-09-12T00:05:17.346 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013872099999999999 2024-09-12T00:05:17.346 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.346 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:17.346 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.346 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.347 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.347 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2737 3.25 3:a794c975:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:17.347 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:17.347 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.302653931999998, 2024-09-12T00:05:17.347 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022562862999999999, 2024-09-12T00:05:17.347 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:17.347 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:17.347 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:17.347 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:17.347 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:17.347 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:17.347 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2737 2024-09-12T00:05:17.347 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.348 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:17.348 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.348 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:17.348 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:17.348 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.348 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.348 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.348 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:17.348 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:17.348 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.348 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.348 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.348 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:17.349 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985368+0000", 2024-09-12T00:05:17.349 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.323e-06 2024-09-12T00:05:17.349 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.349 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.349 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:17.349 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990209+0000", 2024-09-12T00:05:17.349 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004840446 2024-09-12T00:05:17.349 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.349 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.349 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:17.349 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990255+0000", 2024-09-12T00:05:17.349 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6526999999999997e-05 2024-09-12T00:05:17.349 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.350 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.350 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:17.350 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990283+0000", 2024-09-12T00:05:17.350 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7631e-05 2024-09-12T00:05:17.350 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.350 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.350 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:17.350 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990445+0000", 2024-09-12T00:05:17.350 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016238400000000001 2024-09-12T00:05:17.350 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.350 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.350 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:17.350 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990732+0000", 2024-09-12T00:05:17.350 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028698299999999999 2024-09-12T00:05:17.351 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.351 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.351 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:17.351 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.991001+0000", 2024-09-12T00:05:17.351 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026869099999999999 2024-09-12T00:05:17.351 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.351 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.351 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:17.351 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007077+0000", 2024-09-12T00:05:17.351 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016076686999999999 2024-09-12T00:05:17.351 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.351 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.351 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:17.352 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007761+0000", 2024-09-12T00:05:17.352 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00068366399999999995 2024-09-12T00:05:17.352 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.352 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.352 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:17.352 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007860+0000", 2024-09-12T00:05:17.352 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8513999999999999e-05 2024-09-12T00:05:17.352 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.352 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.352 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:17.352 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007929+0000", 2024-09-12T00:05:17.352 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9012999999999998e-05 2024-09-12T00:05:17.352 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.352 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:17.353 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.353 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.353 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.353 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2740 3.33 3:cd810b27:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:17.353 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.016302+0000", 2024-09-12T00:05:17.353 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.271717573, 2024-09-12T00:05:17.353 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017338635000000002, 2024-09-12T00:05:17.353 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:17.353 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:17.353 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:17.353 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:17.353 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:17.353 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:17.354 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2740 2024-09-12T00:05:17.354 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.354 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:17.354 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.354 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:17.354 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.016302+0000", 2024-09-12T00:05:17.354 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.354 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.354 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.354 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:17.354 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.016302+0000", 2024-09-12T00:05:17.354 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.354 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.355 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.355 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:17.355 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.016306+0000", 2024-09-12T00:05:17.355 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6169999999999998e-06 2024-09-12T00:05:17.355 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.355 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.355 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:17.355 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.020590+0000", 2024-09-12T00:05:17.355 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042843320000000001 2024-09-12T00:05:17.355 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.355 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.355 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:17.355 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.020633+0000", 2024-09-12T00:05:17.355 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3124999999999998e-05 2024-09-12T00:05:17.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.356 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.356 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:17.356 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.020656+0000", 2024-09-12T00:05:17.356 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2738000000000002e-05 2024-09-12T00:05:17.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.356 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.356 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:17.356 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.020838+0000", 2024-09-12T00:05:17.356 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000181826 2024-09-12T00:05:17.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.356 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.357 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:17.357 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.021137+0000", 2024-09-12T00:05:17.357 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00029887199999999999 2024-09-12T00:05:17.357 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.357 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.357 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:17.357 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.021365+0000", 2024-09-12T00:05:17.357 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022853700000000001 2024-09-12T00:05:17.357 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.357 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.357 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:17.357 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030957+0000", 2024-09-12T00:05:17.357 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095913879999999993 2024-09-12T00:05:17.357 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.358 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.358 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:17.358 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.033328+0000", 2024-09-12T00:05:17.358 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0023717450000000002 2024-09-12T00:05:17.358 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.358 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.358 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:17.358 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.033509+0000", 2024-09-12T00:05:17.358 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018055999999999999 2024-09-12T00:05:17.358 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.358 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.358 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:17.358 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.033641+0000", 2024-09-12T00:05:17.359 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013189500000000001 2024-09-12T00:05:17.359 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.359 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:17.359 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.359 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.359 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.359 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2744 3.20 e63/23 3:0785dd58:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_229:head v 63'6, mlcod=63'4)", 2024-09-12T00:05:17.359 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.059590+0000", 2024-09-12T00:05:17.359 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.228429724000001, 2024-09-12T00:05:17.359 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015921535000000001, 2024-09-12T00:05:17.359 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:17.359 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:17.359 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:17.360 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:17.360 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.360 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:17.360 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.059590+0000", 2024-09-12T00:05:17.360 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.360 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.360 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:17.360 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.059590+0000", 2024-09-12T00:05:17.360 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.360 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.360 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:17.361 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.059592+0000", 2024-09-12T00:05:17.361 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4899999999999999e-06 2024-09-12T00:05:17.361 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.361 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.361 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:17.361 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.063909+0000", 2024-09-12T00:05:17.361 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043162510000000001 2024-09-12T00:05:17.361 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.361 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.361 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:17.361 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.063940+0000", 2024-09-12T00:05:17.361 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1724000000000003e-05 2024-09-12T00:05:17.361 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.361 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.362 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:17.362 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.063955+0000", 2024-09-12T00:05:17.362 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4353e-05 2024-09-12T00:05:17.362 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.362 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.362 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:17.362 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.064145+0000", 2024-09-12T00:05:17.362 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018995199999999999 2024-09-12T00:05:17.362 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.362 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.362 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:17.362 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.064187+0000", 2024-09-12T00:05:17.362 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2264000000000001e-05 2024-09-12T00:05:17.362 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.363 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.363 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:17.363 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.075348+0000", 2024-09-12T00:05:17.363 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011161453 2024-09-12T00:05:17.363 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.363 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.363 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:17.363 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.075512+0000", 2024-09-12T00:05:17.363 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000163048 2024-09-12T00:05:17.363 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.363 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:17.363 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.363 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.363 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.364 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2746 3.24 3:24549c49:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_231:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:17.364 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.078769+0000", 2024-09-12T00:05:17.364 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.209250789999999, 2024-09-12T00:05:17.364 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016657594000000001, 2024-09-12T00:05:17.364 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:17.364 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:17.364 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:17.364 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:17.364 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:17.364 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:17.364 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2746 2024-09-12T00:05:17.364 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.364 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:17.364 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.365 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:17.365 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.078769+0000", 2024-09-12T00:05:17.365 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.365 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.365 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.365 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:17.365 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.078769+0000", 2024-09-12T00:05:17.365 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.365 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.365 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.365 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:17.365 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.078773+0000", 2024-09-12T00:05:17.365 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3830000000000002e-06 2024-09-12T00:05:17.365 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.366 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.366 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:17.366 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.083071+0000", 2024-09-12T00:05:17.366 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042978419999999996 2024-09-12T00:05:17.366 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.366 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.366 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:17.366 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.083105+0000", 2024-09-12T00:05:17.366 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3983999999999999e-05 2024-09-12T00:05:17.366 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.366 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.366 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:17.366 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.083122+0000", 2024-09-12T00:05:17.366 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6399e-05 2024-09-12T00:05:17.367 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.367 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.367 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:17.367 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.083286+0000", 2024-09-12T00:05:17.367 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016477700000000001 2024-09-12T00:05:17.367 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.367 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.367 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:17.367 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.083681+0000", 2024-09-12T00:05:17.367 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000394387 2024-09-12T00:05:17.367 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.367 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.367 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:17.368 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.084084+0000", 2024-09-12T00:05:17.368 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000403263 2024-09-12T00:05:17.368 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.368 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.368 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:17.368 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093372+0000", 2024-09-12T00:05:17.368 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0092879490000000002 2024-09-12T00:05:17.368 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.368 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.368 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:17.368 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.095074+0000", 2024-09-12T00:05:17.368 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.001702371 2024-09-12T00:05:17.368 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.368 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.368 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:17.369 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.095205+0000", 2024-09-12T00:05:17.369 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000130572 2024-09-12T00:05:17.369 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.369 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.369 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:17.369 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.095426+0000", 2024-09-12T00:05:17.369 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022166699999999999 2024-09-12T00:05:17.369 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.369 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:17.369 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.369 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.369 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.369 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2749 3.33 3:ce43df22:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:17.370 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.112848+0000", 2024-09-12T00:05:17.370 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.175171212999999, 2024-09-12T00:05:17.370 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016292930000000001, 2024-09-12T00:05:17.370 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:17.370 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:17.370 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:17.370 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:17.370 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:17.370 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:17.370 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2749 2024-09-12T00:05:17.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.370 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:17.370 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.370 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:17.371 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112848+0000", 2024-09-12T00:05:17.371 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.371 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.371 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:17.371 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112848+0000", 2024-09-12T00:05:17.371 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.371 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.371 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:17.371 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112853+0000", 2024-09-12T00:05:17.371 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0799999999999999e-06 2024-09-12T00:05:17.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.371 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.372 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:17.372 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.116860+0000", 2024-09-12T00:05:17.372 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040070690000000003 2024-09-12T00:05:17.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.372 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.372 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:17.372 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.116923+0000", 2024-09-12T00:05:17.372 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3156000000000003e-05 2024-09-12T00:05:17.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.372 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.372 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:17.372 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.116941+0000", 2024-09-12T00:05:17.372 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8289000000000001e-05 2024-09-12T00:05:17.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.373 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.373 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:17.373 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.117071+0000", 2024-09-12T00:05:17.373 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000130006 2024-09-12T00:05:17.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.373 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.373 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:17.373 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.117315+0000", 2024-09-12T00:05:17.373 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024368600000000001 2024-09-12T00:05:17.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.373 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.373 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:17.373 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.117549+0000", 2024-09-12T00:05:17.374 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023425299999999999 2024-09-12T00:05:17.374 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.374 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.374 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:17.374 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.128076+0000", 2024-09-12T00:05:17.374 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010526604 2024-09-12T00:05:17.374 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.374 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.374 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:17.374 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.128993+0000", 2024-09-12T00:05:17.374 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00091696599999999996 2024-09-12T00:05:17.374 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.374 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.374 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:17.374 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.129072+0000", 2024-09-12T00:05:17.375 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9747999999999996e-05 2024-09-12T00:05:17.375 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.375 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.375 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:17.375 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.129141+0000", 2024-09-12T00:05:17.375 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9072999999999994e-05 2024-09-12T00:05:17.375 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.375 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:17.375 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.375 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.375 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.375 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2750 3.1 3:834b8715:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:17.376 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.123528+0000", 2024-09-12T00:05:17.376 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.164491721000001, 2024-09-12T00:05:17.376 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017652673000000001, 2024-09-12T00:05:17.376 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:17.376 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:17.376 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:17.376 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:17.376 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:17.376 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:17.376 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2750 2024-09-12T00:05:17.376 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.376 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:17.376 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.376 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:17.377 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.123528+0000", 2024-09-12T00:05:17.377 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.377 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.377 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:17.377 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.123528+0000", 2024-09-12T00:05:17.377 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.377 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.377 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:17.377 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.123531+0000", 2024-09-12T00:05:17.377 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9160000000000001e-06 2024-09-12T00:05:17.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.377 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.378 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:17.378 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.127554+0000", 2024-09-12T00:05:17.378 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040235210000000004 2024-09-12T00:05:17.378 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.378 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.378 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:17.378 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.127587+0000", 2024-09-12T00:05:17.378 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2777999999999997e-05 2024-09-12T00:05:17.378 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.378 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.378 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:17.378 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.127604+0000", 2024-09-12T00:05:17.378 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6492999999999999e-05 2024-09-12T00:05:17.378 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.379 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.379 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:17.379 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.127766+0000", 2024-09-12T00:05:17.379 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016200399999999999 2024-09-12T00:05:17.379 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.379 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.379 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:17.379 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.128157+0000", 2024-09-12T00:05:17.379 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039180399999999999 2024-09-12T00:05:17.379 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.379 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.379 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:17.379 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.128596+0000", 2024-09-12T00:05:17.379 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00043888999999999999 2024-09-12T00:05:17.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.380 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.380 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:17.380 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.139321+0000", 2024-09-12T00:05:17.380 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010724466 2024-09-12T00:05:17.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.380 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.380 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:17.380 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.140855+0000", 2024-09-12T00:05:17.380 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00153382 2024-09-12T00:05:17.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.380 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.380 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:17.380 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.141054+0000", 2024-09-12T00:05:17.381 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00019907799999999999 2024-09-12T00:05:17.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.381 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.381 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:17.381 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.141181+0000", 2024-09-12T00:05:17.381 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012690299999999999 2024-09-12T00:05:17.381 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.381 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:17.381 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.381 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.381 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2751 3.4 3:20d2ffb1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:17.381 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.134356+0000", 2024-09-12T00:05:17.381 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.153664149000001, 2024-09-12T00:05:17.382 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020400522000000001, 2024-09-12T00:05:17.382 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:17.382 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:17.382 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:17.382 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:17.382 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:17.382 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:17.382 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2751 2024-09-12T00:05:17.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.382 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:17.382 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.382 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:17.382 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.134356+0000", 2024-09-12T00:05:17.382 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.383 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.383 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:17.383 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.134356+0000", 2024-09-12T00:05:17.383 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.383 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.383 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:17.383 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.134359+0000", 2024-09-12T00:05:17.383 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9900000000000002e-06 2024-09-12T00:05:17.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.383 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.383 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:17.383 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138490+0000", 2024-09-12T00:05:17.384 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041315609999999997 2024-09-12T00:05:17.384 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.384 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.384 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:17.384 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138524+0000", 2024-09-12T00:05:17.384 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3868000000000002e-05 2024-09-12T00:05:17.384 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.384 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.384 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:17.384 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138544+0000", 2024-09-12T00:05:17.384 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9539e-05 2024-09-12T00:05:17.384 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.384 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.385 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:17.385 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138697+0000", 2024-09-12T00:05:17.385 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015332400000000001 2024-09-12T00:05:17.385 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.385 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.385 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:17.385 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138931+0000", 2024-09-12T00:05:17.385 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023418700000000001 2024-09-12T00:05:17.385 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.385 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.385 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:17.385 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.139162+0000", 2024-09-12T00:05:17.385 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000230943 2024-09-12T00:05:17.385 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.386 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.386 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:17.386 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.149454+0000", 2024-09-12T00:05:17.386 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010291560999999999 2024-09-12T00:05:17.386 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.386 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.386 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:17.386 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.153905+0000", 2024-09-12T00:05:17.386 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004451666 2024-09-12T00:05:17.386 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.386 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.386 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:17.386 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154405+0000", 2024-09-12T00:05:17.387 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00049978100000000003 2024-09-12T00:05:17.387 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.387 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.387 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:17.387 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154756+0000", 2024-09-12T00:05:17.387 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000351102 2024-09-12T00:05:17.387 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.387 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:17.387 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.387 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.387 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.387 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2753 3.7 e63/23 3:e119c99e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_238:head v 63'6, mlcod=63'4)", 2024-09-12T00:05:17.387 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.160435+0000", 2024-09-12T00:05:17.387 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.127584765000002, 2024-09-12T00:05:17.388 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016757787999999999, 2024-09-12T00:05:17.388 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:17.388 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:17.388 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:17.388 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:17.388 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.388 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:17.388 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.160435+0000", 2024-09-12T00:05:17.388 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.388 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.388 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.388 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:17.388 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.160435+0000", 2024-09-12T00:05:17.389 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.389 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.389 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:17.389 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.160437+0000", 2024-09-12T00:05:17.389 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1560000000000002e-06 2024-09-12T00:05:17.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.389 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.389 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:17.389 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.163440+0000", 2024-09-12T00:05:17.389 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0030024280000000001 2024-09-12T00:05:17.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.389 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.389 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:17.390 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.163467+0000", 2024-09-12T00:05:17.390 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7631e-05 2024-09-12T00:05:17.390 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.390 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.390 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:17.390 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.163482+0000", 2024-09-12T00:05:17.390 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5031999999999999e-05 2024-09-12T00:05:17.390 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.390 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.390 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:17.390 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.163601+0000", 2024-09-12T00:05:17.390 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011861700000000001 2024-09-12T00:05:17.390 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.390 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.390 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:17.391 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.163649+0000", 2024-09-12T00:05:17.391 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.799e-05 2024-09-12T00:05:17.391 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.391 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.391 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:17.391 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177079+0000", 2024-09-12T00:05:17.391 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013430291 2024-09-12T00:05:17.391 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.391 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.391 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:17.391 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177193+0000", 2024-09-12T00:05:17.391 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113643 2024-09-12T00:05:17.391 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.391 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:17.392 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.392 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.392 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.392 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2755 3.25 3:a666dbcf:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:17.392 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.181692+0000", 2024-09-12T00:05:17.392 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.106327734000001, 2024-09-12T00:05:17.392 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020464659, 2024-09-12T00:05:17.392 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:17.392 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:17.392 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:17.392 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:17.392 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:17.392 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:17.392 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2755 2024-09-12T00:05:17.393 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.393 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:17.393 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.393 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:17.393 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.181692+0000", 2024-09-12T00:05:17.393 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.393 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.393 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.393 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:17.393 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.181692+0000", 2024-09-12T00:05:17.393 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:17.393 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.393 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.393 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:17.394 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.181695+0000", 2024-09-12T00:05:17.394 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0800000000000002e-06 2024-09-12T00:05:17.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.394 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.394 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:17.394 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185668+0000", 2024-09-12T00:05:17.394 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039727970000000001 2024-09-12T00:05:17.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.394 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.394 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:17.394 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185699+0000", 2024-09-12T00:05:17.394 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1424999999999998e-05 2024-09-12T00:05:17.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.395 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.395 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:17.395 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185722+0000", 2024-09-12T00:05:17.395 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2972e-05 2024-09-12T00:05:17.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.395 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.395 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:17.395 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185860+0000", 2024-09-12T00:05:17.395 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000138016 2024-09-12T00:05:17.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.395 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.395 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:17.395 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.186096+0000", 2024-09-12T00:05:17.395 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023611899999999999 2024-09-12T00:05:17.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.396 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.396 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:17.396 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.186318+0000", 2024-09-12T00:05:17.396 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000221177 2024-09-12T00:05:17.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.396 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.396 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:17.396 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.199301+0000", 2024-09-12T00:05:17.396 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012983949999999999 2024-09-12T00:05:17.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.396 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.396 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:17.396 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.201991+0000", 2024-09-12T00:05:17.396 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026896889999999999 2024-09-12T00:05:17.397 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.397 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.397 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:17.397 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.202083+0000", 2024-09-12T00:05:17.397 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1598e-05 2024-09-12T00:05:17.397 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:17.397 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:17.397 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:17.397 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.202157+0000", 2024-09-12T00:05:17.397 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3836000000000003e-05 2024-09-12T00:05:17.397 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.397 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:17.397 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.397 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:17.398 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:17.398 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:17.398 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:05:17.400 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:05:17.400 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:17.400+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:17.501 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:17.500+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:17.528 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:17.528 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:17.528 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:17.528 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:17.533 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T00:05:17.544 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:05:17.563 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:17.563 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:17.581 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:17.581 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:17.598 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:17.598 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:17.601 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:17.597+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:17.615 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:17.615 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:17.635 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:17.635 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:17.655 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:17.655 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:17.669 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:17.669 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:17.669 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:17.669 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:17.669 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:17.675 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:17.675 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:17.684 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:05:17.693 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:17.693 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:17.702 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:17.704+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:17.803 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:17.804+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:17.842 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:17.843 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:17.857 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:05:17.905 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:17.901+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:17.975 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:17.975 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:17.984 INFO:tasks.workunit.client.0.smithi019.stderr:100+0 records in 2024-09-12T00:05:17.984 INFO:tasks.workunit.client.0.smithi019.stderr:100+0 records out 2024-09-12T00:05:17.984 INFO:tasks.workunit.client.0.smithi019.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 6.53096 s, 161 MB/s 2024-09-12T00:05:17.989 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:05:18.037 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:18.040+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:18.104 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:18.104 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:18.107 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:18.105+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:18.117 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:05:18.208 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:18.208+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:18.278 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:18.278 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:18.292 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:05:18.310 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:18.305+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:18.411 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:18.412+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:18.456 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:18.456 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:18.470 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:05:18.512 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:18.513+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:18.533 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T00:05:18.612 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:18.609+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:18.639 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:18.639 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:18.653 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:05:18.713 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:18.709+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:18.769 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:18.769 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:18.782 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:05:18.814 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:18.813+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:18.898 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:18.898 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:18.911 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:05:18.957 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:18.960+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:19.016 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:19.016+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:19.031 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:19.031 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:19.044 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:05:19.116 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:19.117+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:19.201 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:19.201 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:19.214 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:05:19.217 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:19.217+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:19.317 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:19.320+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:19.336 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:19.336 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:19.350 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:05:19.419 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:19.417+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:19.514 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:19.514 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:19.520 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:19.517+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:19.528 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:05:19.623 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:19.624+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:19.642 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:19.642 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:19.656 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:05:19.712 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:05:19.722 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:19.721+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:19.795 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:19.795 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:19.809 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:05:19.822 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:19.824+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:19.855 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:19.855 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:19.872 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:19.872 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:19.889 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:19.889 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:19.906 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:19.906 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:19.922 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:19.921+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:19.924 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:19.925 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:19.943 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:19.943 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:19.963 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:19.975 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:19.975 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:19.975 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:19.976 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:19.976 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:19.985 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:19.985 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:19.991 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:05:20.034 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:20.033+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:20.125 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:20.121+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:20.175 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:20.175 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:20.175 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:20.176 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:20.176 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.176 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2657 3.3c e63/23 3:3e583291:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_152:head v 63'4, mlcod=62'2)", 2024-09-12T00:05:20.176 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:05:20.176 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.907563723000003, 2024-09-12T00:05:20.176 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017073642999999999, 2024-09-12T00:05:20.176 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.176 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.176 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.176 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.176 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.176 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.177 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:05:20.177 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.177 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.177 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.177 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.177 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266875+0000", 2024-09-12T00:05:20.177 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.177 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.177 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.177 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.177 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.266877+0000", 2024-09-12T00:05:20.177 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3630000000000001e-06 2024-09-12T00:05:20.177 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.177 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.178 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.178 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271243+0000", 2024-09-12T00:05:20.178 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043659730000000004 2024-09-12T00:05:20.178 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.178 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.178 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.178 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271279+0000", 2024-09-12T00:05:20.178 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6334999999999997e-05 2024-09-12T00:05:20.178 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.178 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.178 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.178 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271296+0000", 2024-09-12T00:05:20.178 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6619000000000001e-05 2024-09-12T00:05:20.178 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.179 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.179 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.179 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271429+0000", 2024-09-12T00:05:20.179 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133132 2024-09-12T00:05:20.179 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.179 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.179 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.179 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.271468+0000", 2024-09-12T00:05:20.179 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8483999999999999e-05 2024-09-12T00:05:20.179 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.179 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.179 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.179 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.283854+0000", 2024-09-12T00:05:20.180 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012386645999999999 2024-09-12T00:05:20.180 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.180 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.180 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.180 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.283948+0000", 2024-09-12T00:05:20.180 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4091000000000004e-05 2024-09-12T00:05:20.180 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.180 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.180 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.180 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.180 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.180 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2659 3.2d e63/23 3:b4a71344:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_154:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:20.180 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:05:20.180 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.886759429000001, 2024-09-12T00:05:20.181 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016913793, 2024-09-12T00:05:20.181 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.181 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.181 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.181 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.181 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.181 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.181 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:05:20.181 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.181 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.181 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.181 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.182 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287679+0000", 2024-09-12T00:05:20.182 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.182 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.182 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.182 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.287682+0000", 2024-09-12T00:05:20.182 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9799999999999998e-06 2024-09-12T00:05:20.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.182 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.182 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.182 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291872+0000", 2024-09-12T00:05:20.182 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041904070000000002 2024-09-12T00:05:20.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.182 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.183 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.183 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291901+0000", 2024-09-12T00:05:20.183 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9017999999999999e-05 2024-09-12T00:05:20.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.183 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.183 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.183 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.291917+0000", 2024-09-12T00:05:20.183 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5775999999999999e-05 2024-09-12T00:05:20.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.183 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.183 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.183 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.292061+0000", 2024-09-12T00:05:20.183 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014356800000000001 2024-09-12T00:05:20.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.184 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.184 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.184 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.292123+0000", 2024-09-12T00:05:20.184 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2799999999999995e-05 2024-09-12T00:05:20.184 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.184 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.184 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.184 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.304456+0000", 2024-09-12T00:05:20.184 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012332865 2024-09-12T00:05:20.184 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.184 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.184 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.185 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.304593+0000", 2024-09-12T00:05:20.185 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000136379 2024-09-12T00:05:20.185 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.185 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.185 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.185 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.185 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.185 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2667 3.8 3:1177e826:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.185 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:05:20.185 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.801317511000001, 2024-09-12T00:05:20.185 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024306991999999999, 2024-09-12T00:05:20.185 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.185 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.185 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.185 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.186 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.186 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.186 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2667 2024-09-12T00:05:20.186 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.186 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.186 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.186 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.186 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:05:20.186 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.186 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.186 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.186 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.186 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:05:20.186 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.187 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.187 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.187 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.187 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373124+0000", 2024-09-12T00:05:20.187 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.19e-06 2024-09-12T00:05:20.187 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.187 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.187 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.187 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377167+0000", 2024-09-12T00:05:20.187 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040430329999999997 2024-09-12T00:05:20.187 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.187 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.187 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.188 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377201+0000", 2024-09-12T00:05:20.188 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3868000000000002e-05 2024-09-12T00:05:20.188 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.188 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.188 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.188 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377219+0000", 2024-09-12T00:05:20.188 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8019000000000001e-05 2024-09-12T00:05:20.188 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.188 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.188 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.188 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377362+0000", 2024-09-12T00:05:20.188 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000143001 2024-09-12T00:05:20.188 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.188 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.189 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.189 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377603+0000", 2024-09-12T00:05:20.189 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024115200000000001 2024-09-12T00:05:20.189 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.189 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.189 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:20.189 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377833+0000", 2024-09-12T00:05:20.189 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022952000000000001 2024-09-12T00:05:20.189 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.189 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.189 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.190 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.386771+0000", 2024-09-12T00:05:20.190 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0089385739999999995 2024-09-12T00:05:20.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.190 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.190 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.190 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397160+0000", 2024-09-12T00:05:20.190 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010388391 2024-09-12T00:05:20.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.190 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.190 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.190 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397307+0000", 2024-09-12T00:05:20.190 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014745099999999999 2024-09-12T00:05:20.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.191 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.191 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.191 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397428+0000", 2024-09-12T00:05:20.191 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012079299999999999 2024-09-12T00:05:20.191 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.191 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.191 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.191 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.191 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.191 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2669 3.1b 3:d9b9bd82:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.191 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:05:20.191 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.781640862000003, 2024-09-12T00:05:20.191 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016867298999999999, 2024-09-12T00:05:20.191 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.191 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.192 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.192 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.192 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.192 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.192 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2669 2024-09-12T00:05:20.192 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.192 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.192 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.192 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.192 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:05:20.192 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.192 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.193 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.193 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.193 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392798+0000", 2024-09-12T00:05:20.193 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.193 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.193 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.193 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.193 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.392800+0000", 2024-09-12T00:05:20.193 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8629999999999999e-06 2024-09-12T00:05:20.193 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.193 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.193 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.193 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396812+0000", 2024-09-12T00:05:20.193 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040120140000000004 2024-09-12T00:05:20.194 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.194 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.194 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.194 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396849+0000", 2024-09-12T00:05:20.194 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6291000000000002e-05 2024-09-12T00:05:20.194 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.194 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.194 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.194 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396906+0000", 2024-09-12T00:05:20.194 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7692999999999998e-05 2024-09-12T00:05:20.194 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.194 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.194 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.194 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397059+0000", 2024-09-12T00:05:20.194 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015268399999999999 2024-09-12T00:05:20.195 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.195 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.195 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.195 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397472+0000", 2024-09-12T00:05:20.195 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041270899999999998 2024-09-12T00:05:20.195 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.195 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.195 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:20.195 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397697+0000", 2024-09-12T00:05:20.195 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022526299999999999 2024-09-12T00:05:20.195 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.195 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.195 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.196 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.406380+0000", 2024-09-12T00:05:20.196 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086830429999999997 2024-09-12T00:05:20.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.196 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.196 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.196 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409367+0000", 2024-09-12T00:05:20.196 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002987403 2024-09-12T00:05:20.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.196 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.196 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.196 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409532+0000", 2024-09-12T00:05:20.196 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016417 2024-09-12T00:05:20.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.197 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.197 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.197 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.409665+0000", 2024-09-12T00:05:20.197 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013316599999999999 2024-09-12T00:05:20.197 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.197 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.197 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.197 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.197 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.197 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2678 3.2b 3:d57f7217:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.197 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:05:20.197 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.690223414000002, 2024-09-12T00:05:20.197 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018772965999999999, 2024-09-12T00:05:20.198 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.198 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.198 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.198 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.198 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.198 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.198 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2678 2024-09-12T00:05:20.198 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.198 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.198 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.198 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.198 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:05:20.198 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.198 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.198 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.199 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.199 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484215+0000", 2024-09-12T00:05:20.199 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.199 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.199 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.199 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.199 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.484219+0000", 2024-09-12T00:05:20.199 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7299999999999999e-06 2024-09-12T00:05:20.199 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.199 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.199 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.199 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488148+0000", 2024-09-12T00:05:20.199 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039289859999999998 2024-09-12T00:05:20.199 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.200 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.200 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.200 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488214+0000", 2024-09-12T00:05:20.200 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6202000000000001e-05 2024-09-12T00:05:20.200 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.200 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.200 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.200 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488239+0000", 2024-09-12T00:05:20.200 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4839000000000001e-05 2024-09-12T00:05:20.200 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.200 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.200 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.200 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488374+0000", 2024-09-12T00:05:20.200 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000135189 2024-09-12T00:05:20.201 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.201 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.201 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.201 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488626+0000", 2024-09-12T00:05:20.201 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025242800000000002 2024-09-12T00:05:20.201 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.201 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.201 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:20.201 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.488849+0000", 2024-09-12T00:05:20.201 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022295 2024-09-12T00:05:20.201 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.201 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.201 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.201 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.498947+0000", 2024-09-12T00:05:20.202 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010098072 2024-09-12T00:05:20.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.202 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.202 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.202 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502674+0000", 2024-09-12T00:05:20.202 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037269149999999999 2024-09-12T00:05:20.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.202 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.202 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.202 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502856+0000", 2024-09-12T00:05:20.202 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018163599999999999 2024-09-12T00:05:20.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.202 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.202 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.202 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.502988+0000", 2024-09-12T00:05:20.203 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013201900000000001 2024-09-12T00:05:20.203 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.203 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.203 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.203 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.203 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.203 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2691 3.2d e63/23 3:b4a2284d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_176:head v 63'6, mlcod=63'4)", 2024-09-12T00:05:20.203 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:05:20.203 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.657098713000003, 2024-09-12T00:05:20.203 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015889306999999998, 2024-09-12T00:05:20.203 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.203 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.203 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.204 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.204 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.204 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.204 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:05:20.204 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.204 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.204 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.204 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.204 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517340+0000", 2024-09-12T00:05:20.204 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.204 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.204 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.204 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.205 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.517342+0000", 2024-09-12T00:05:20.205 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3700000000000002e-06 2024-09-12T00:05:20.205 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.205 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.205 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.205 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521776+0000", 2024-09-12T00:05:20.205 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044339790000000002 2024-09-12T00:05:20.205 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.205 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.205 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.205 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521806+0000", 2024-09-12T00:05:20.205 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9855000000000001e-05 2024-09-12T00:05:20.205 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.205 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.206 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.206 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521820+0000", 2024-09-12T00:05:20.206 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4496e-05 2024-09-12T00:05:20.206 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.206 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.206 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.206 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.521963+0000", 2024-09-12T00:05:20.206 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014277199999999999 2024-09-12T00:05:20.206 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.206 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.206 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.206 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.522029+0000", 2024-09-12T00:05:20.206 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6186000000000006e-05 2024-09-12T00:05:20.206 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.207 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.207 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.207 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.533123+0000", 2024-09-12T00:05:20.207 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011093252 2024-09-12T00:05:20.207 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.207 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.207 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.207 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.533229+0000", 2024-09-12T00:05:20.207 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000106397 2024-09-12T00:05:20.207 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.207 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.207 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.207 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.207 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.208 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2694 3.3d e63/23 3:bd0bdafc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_179:head v 63'7, mlcod=63'5)", 2024-09-12T00:05:20.208 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:05:20.208 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.621883941, 2024-09-12T00:05:20.208 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016398093999999998, 2024-09-12T00:05:20.208 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.208 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.208 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.208 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.208 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.208 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.208 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:05:20.208 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.208 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.209 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.209 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.209 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552554+0000", 2024-09-12T00:05:20.209 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.209 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.209 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.209 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552558+0000", 2024-09-12T00:05:20.209 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6030000000000001e-06 2024-09-12T00:05:20.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.209 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.209 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.209 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556085+0000", 2024-09-12T00:05:20.210 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0035274339999999999 2024-09-12T00:05:20.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.210 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.210 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.210 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556126+0000", 2024-09-12T00:05:20.210 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0290999999999998e-05 2024-09-12T00:05:20.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.210 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.210 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.210 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556154+0000", 2024-09-12T00:05:20.210 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7965000000000001e-05 2024-09-12T00:05:20.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.210 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.211 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.211 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556298+0000", 2024-09-12T00:05:20.211 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014459799999999999 2024-09-12T00:05:20.211 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.211 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.211 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.211 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.556339+0000", 2024-09-12T00:05:20.211 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0577000000000001e-05 2024-09-12T00:05:20.211 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.211 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.211 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.211 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.568778+0000", 2024-09-12T00:05:20.211 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012438886999999999 2024-09-12T00:05:20.211 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.212 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.212 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.212 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.568953+0000", 2024-09-12T00:05:20.212 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017473900000000001 2024-09-12T00:05:20.212 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.212 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.212 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.212 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.212 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.212 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2696 3.2b 3:d7c776f8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.212 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:05:20.212 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.607037044000002, 2024-09-12T00:05:20.212 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022026211, 2024-09-12T00:05:20.213 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.213 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.213 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.213 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.213 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.213 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.213 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2696 2024-09-12T00:05:20.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.213 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.213 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.213 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.213 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:05:20.213 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.214 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.214 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.214 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:05:20.214 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.214 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.214 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.214 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567406+0000", 2024-09-12T00:05:20.214 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9389999999999996e-06 2024-09-12T00:05:20.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.214 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.214 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.214 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571490+0000", 2024-09-12T00:05:20.214 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040837870000000002 2024-09-12T00:05:20.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.215 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.215 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.215 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571530+0000", 2024-09-12T00:05:20.215 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9894999999999997e-05 2024-09-12T00:05:20.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.215 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.215 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.215 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571554+0000", 2024-09-12T00:05:20.215 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4011000000000001e-05 2024-09-12T00:05:20.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.215 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.215 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.215 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571726+0000", 2024-09-12T00:05:20.216 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0001717 2024-09-12T00:05:20.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.216 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.216 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.216 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.572130+0000", 2024-09-12T00:05:20.216 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040465299999999999 2024-09-12T00:05:20.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.216 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.216 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:20.216 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.572470+0000", 2024-09-12T00:05:20.216 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00033946999999999997 2024-09-12T00:05:20.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.216 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.216 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.217 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.579159+0000", 2024-09-12T00:05:20.217 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0066893009999999999 2024-09-12T00:05:20.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.217 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.217 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.217 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589136+0000", 2024-09-12T00:05:20.217 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099772060000000006 2024-09-12T00:05:20.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.217 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.217 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.217 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589309+0000", 2024-09-12T00:05:20.217 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017264299999999999 2024-09-12T00:05:20.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.218 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.218 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.218 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589428+0000", 2024-09-12T00:05:20.218 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118606 2024-09-12T00:05:20.218 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.218 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.218 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.218 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.218 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.218 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2698 3.3d e63/23 3:bcafb0f9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_183:head v 63'8, mlcod=63'6)", 2024-09-12T00:05:20.218 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:05:20.218 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.579333994999999, 2024-09-12T00:05:20.218 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016019080000000002, 2024-09-12T00:05:20.218 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.219 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.219 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.219 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.219 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.219 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.219 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:05:20.219 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.219 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.219 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.219 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595104+0000", 2024-09-12T00:05:20.219 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.219 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.219 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.220 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.595107+0000", 2024-09-12T00:05:20.220 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.497e-06 2024-09-12T00:05:20.220 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.220 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.220 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.220 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598465+0000", 2024-09-12T00:05:20.220 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0033583129999999999 2024-09-12T00:05:20.220 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.220 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.220 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.220 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598502+0000", 2024-09-12T00:05:20.220 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6814999999999999e-05 2024-09-12T00:05:20.220 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.220 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.221 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.221 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598520+0000", 2024-09-12T00:05:20.221 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8264999999999999e-05 2024-09-12T00:05:20.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.221 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.221 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.221 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598666+0000", 2024-09-12T00:05:20.221 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014574499999999999 2024-09-12T00:05:20.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.221 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.221 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.221 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.598706+0000", 2024-09-12T00:05:20.221 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9993999999999997e-05 2024-09-12T00:05:20.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.222 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.222 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.222 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.611012+0000", 2024-09-12T00:05:20.222 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012306381 2024-09-12T00:05:20.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.222 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.222 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.222 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.611123+0000", 2024-09-12T00:05:20.222 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011107000000000001 2024-09-12T00:05:20.222 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.222 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.222 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.223 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.223 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2702 3.3c e63/23 3:3d6a0b3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_187:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:20.223 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:05:20.223 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.545859157999999, 2024-09-12T00:05:20.223 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015754475, 2024-09-12T00:05:20.223 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.223 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.223 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.223 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.223 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.223 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.223 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:05:20.223 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.224 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.224 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.224 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628579+0000", 2024-09-12T00:05:20.224 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.224 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.224 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.224 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.628581+0000", 2024-09-12T00:05:20.224 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2129999999999998e-06 2024-09-12T00:05:20.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.224 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.224 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.225 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633160+0000", 2024-09-12T00:05:20.225 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045784470000000002 2024-09-12T00:05:20.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.225 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.225 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.225 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633193+0000", 2024-09-12T00:05:20.225 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3015000000000002e-05 2024-09-12T00:05:20.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.225 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.225 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.225 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633213+0000", 2024-09-12T00:05:20.225 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0271999999999998e-05 2024-09-12T00:05:20.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.225 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.226 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.226 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633397+0000", 2024-09-12T00:05:20.226 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018359299999999999 2024-09-12T00:05:20.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.226 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.226 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.226 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.633440+0000", 2024-09-12T00:05:20.226 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2984e-05 2024-09-12T00:05:20.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.226 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.226 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.226 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.644242+0000", 2024-09-12T00:05:20.226 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010802673 2024-09-12T00:05:20.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.227 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.227 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.227 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.644334+0000", 2024-09-12T00:05:20.227 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1278000000000003e-05 2024-09-12T00:05:20.227 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.227 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.227 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.227 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.227 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2707 3.8 3:10a400a4:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.227 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:05:20.227 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.497581590000003, 2024-09-12T00:05:20.227 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019444162000000001, 2024-09-12T00:05:20.227 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.228 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.228 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.228 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.228 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.228 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.228 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2707 2024-09-12T00:05:20.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.228 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.228 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.228 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.228 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:05:20.228 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.229 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.229 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.229 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:05:20.229 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.229 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.229 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.229 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676879+0000", 2024-09-12T00:05:20.229 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1886e-05 2024-09-12T00:05:20.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.229 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.229 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.229 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680743+0000", 2024-09-12T00:05:20.229 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038648060000000001 2024-09-12T00:05:20.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.230 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.230 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.230 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680783+0000", 2024-09-12T00:05:20.230 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9511000000000002e-05 2024-09-12T00:05:20.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.230 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.230 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.230 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680801+0000", 2024-09-12T00:05:20.230 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8056000000000001e-05 2024-09-12T00:05:20.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.230 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.230 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.230 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680948+0000", 2024-09-12T00:05:20.230 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014682399999999999 2024-09-12T00:05:20.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.231 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.681206+0000", 2024-09-12T00:05:20.231 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025860500000000002 2024-09-12T00:05:20.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:20.231 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.681439+0000", 2024-09-12T00:05:20.231 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023246599999999999 2024-09-12T00:05:20.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.689277+0000", 2024-09-12T00:05:20.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0078379000000000001 2024-09-12T00:05:20.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.232 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696136+0000", 2024-09-12T00:05:20.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0068593439999999999 2024-09-12T00:05:20.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.232 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696228+0000", 2024-09-12T00:05:20.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2038000000000002e-05 2024-09-12T00:05:20.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.233 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.233 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696301+0000", 2024-09-12T00:05:20.233 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2725999999999995e-05 2024-09-12T00:05:20.233 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.233 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.233 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.233 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.233 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2720 3.6 3:61c9c6cd:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.233 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:05:20.233 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.370862273999997, 2024-09-12T00:05:20.233 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021831761000000002, 2024-09-12T00:05:20.234 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.234 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.234 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.234 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.234 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.234 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.234 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2720 2024-09-12T00:05:20.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.234 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.234 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.234 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.234 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:05:20.234 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.235 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.235 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.235 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:05:20.235 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.235 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.235 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.235 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803580+0000", 2024-09-12T00:05:20.235 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9870000000000001e-06 2024-09-12T00:05:20.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.235 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.235 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.235 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808102+0000", 2024-09-12T00:05:20.235 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004521677 2024-09-12T00:05:20.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.236 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.236 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.236 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808152+0000", 2024-09-12T00:05:20.236 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9923999999999998e-05 2024-09-12T00:05:20.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.236 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.236 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.236 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808178+0000", 2024-09-12T00:05:20.236 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5911999999999999e-05 2024-09-12T00:05:20.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.236 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.236 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.237 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808365+0000", 2024-09-12T00:05:20.237 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000187839 2024-09-12T00:05:20.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.237 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.237 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.237 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808757+0000", 2024-09-12T00:05:20.237 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039202900000000001 2024-09-12T00:05:20.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.237 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.237 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:20.237 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.809162+0000", 2024-09-12T00:05:20.237 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040460300000000002 2024-09-12T00:05:20.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.237 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.237 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.238 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.816553+0000", 2024-09-12T00:05:20.238 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.007390537 2024-09-12T00:05:20.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.238 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.238 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.238 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.824836+0000", 2024-09-12T00:05:20.238 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082834369999999994 2024-09-12T00:05:20.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.238 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.238 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.238 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.825223+0000", 2024-09-12T00:05:20.238 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00038724700000000001 2024-09-12T00:05:20.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.238 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.239 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.239 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.825408+0000", 2024-09-12T00:05:20.239 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018456899999999999 2024-09-12T00:05:20.239 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.239 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.239 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.239 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2724 3.1b 3:da32d84b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.239 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:05:20.239 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.330651838000001, 2024-09-12T00:05:20.239 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019410604000000001, 2024-09-12T00:05:20.239 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.239 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.240 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.240 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.240 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.240 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.240 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2724 2024-09-12T00:05:20.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.240 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.240 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.240 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.240 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:05:20.240 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.240 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.240 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.241 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:05:20.241 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.241 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.241 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.241 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843790+0000", 2024-09-12T00:05:20.241 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.393e-06 2024-09-12T00:05:20.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.241 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.241 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.241 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847786+0000", 2024-09-12T00:05:20.241 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039965579999999999 2024-09-12T00:05:20.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.242 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.242 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.242 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847836+0000", 2024-09-12T00:05:20.242 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9731000000000002e-05 2024-09-12T00:05:20.242 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.242 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.242 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.242 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847856+0000", 2024-09-12T00:05:20.242 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0245e-05 2024-09-12T00:05:20.242 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.242 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.242 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.242 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848053+0000", 2024-09-12T00:05:20.242 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000196882 2024-09-12T00:05:20.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.243 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.243 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.243 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848291+0000", 2024-09-12T00:05:20.243 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000237762 2024-09-12T00:05:20.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.243 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.243 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:20.243 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848544+0000", 2024-09-12T00:05:20.243 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025307500000000001 2024-09-12T00:05:20.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.243 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.243 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.243 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.860024+0000", 2024-09-12T00:05:20.244 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011479390000000001 2024-09-12T00:05:20.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.244 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.244 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.244 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.862880+0000", 2024-09-12T00:05:20.244 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002856833 2024-09-12T00:05:20.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.244 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.244 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.244 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.863048+0000", 2024-09-12T00:05:20.244 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016796700000000001 2024-09-12T00:05:20.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.244 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.245 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.245 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.863197+0000", 2024-09-12T00:05:20.245 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148768 2024-09-12T00:05:20.245 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.245 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.245 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.245 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.245 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2727 3.39 e63/23 3:9c63b475:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_212:head v 63'3, mlcod=62'1)", 2024-09-12T00:05:20.245 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:05:20.245 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.296623242000003, 2024-09-12T00:05:20.245 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016224526999999999, 2024-09-12T00:05:20.245 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.246 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.247 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.247 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.248 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.248 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.249 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:05:20.249 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.249 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.250 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.250 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.250 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877815+0000", 2024-09-12T00:05:20.250 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.251 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.251 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.251 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.252 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.877818+0000", 2024-09-12T00:05:20.252 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.813e-06 2024-09-12T00:05:20.253 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.253 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.254 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.254 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883917+0000", 2024-09-12T00:05:20.255 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0060993009999999997 2024-09-12T00:05:20.255 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.256 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.256 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.257 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883961+0000", 2024-09-12T00:05:20.257 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3951e-05 2024-09-12T00:05:20.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.257 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.258 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.258 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.883992+0000", 2024-09-12T00:05:20.259 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0565000000000003e-05 2024-09-12T00:05:20.260 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.261 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.261 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.261 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884176+0000", 2024-09-12T00:05:20.262 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018378200000000001 2024-09-12T00:05:20.262 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.262 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.263 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.263 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.884252+0000", 2024-09-12T00:05:20.264 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6209000000000002e-05 2024-09-12T00:05:20.264 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.264 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.264 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.265 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.893904+0000", 2024-09-12T00:05:20.265 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0096519339999999992 2024-09-12T00:05:20.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.266 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.267 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.267 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.894040+0000", 2024-09-12T00:05:20.269 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013597199999999999 2024-09-12T00:05:20.269 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.269 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.269 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.269 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.269 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.269 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2730 3.7 3:e3fca83c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.269 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:05:20.269 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.266095116000002, 2024-09-12T00:05:20.270 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022178479000000001, 2024-09-12T00:05:20.270 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.270 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.270 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.270 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.270 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.270 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.270 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2730 2024-09-12T00:05:20.270 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.270 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.270 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.270 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.270 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:05:20.271 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.271 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.271 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.271 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:05:20.271 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.271 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.271 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.271 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908346+0000", 2024-09-12T00:05:20.271 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1999999999999999e-06 2024-09-12T00:05:20.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.271 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.272 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.272 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912423+0000", 2024-09-12T00:05:20.272 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004076423 2024-09-12T00:05:20.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.272 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.272 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.272 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912472+0000", 2024-09-12T00:05:20.272 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9023999999999997e-05 2024-09-12T00:05:20.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.272 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.272 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.272 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912498+0000", 2024-09-12T00:05:20.272 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6591999999999999e-05 2024-09-12T00:05:20.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.273 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.273 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.273 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912677+0000", 2024-09-12T00:05:20.273 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017824599999999999 2024-09-12T00:05:20.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.273 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.273 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.273 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913094+0000", 2024-09-12T00:05:20.273 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041757799999999999 2024-09-12T00:05:20.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.273 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.273 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:20.273 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913512+0000", 2024-09-12T00:05:20.274 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000417475 2024-09-12T00:05:20.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.274 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.274 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.274 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.929229+0000", 2024-09-12T00:05:20.274 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015717294999999999 2024-09-12T00:05:20.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.274 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.274 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.274 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930204+0000", 2024-09-12T00:05:20.274 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00097506199999999996 2024-09-12T00:05:20.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.274 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.275 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.275 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930392+0000", 2024-09-12T00:05:20.275 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000187775 2024-09-12T00:05:20.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.275 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.275 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.275 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930522+0000", 2024-09-12T00:05:20.275 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012980899999999999 2024-09-12T00:05:20.275 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.275 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.275 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.275 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.275 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2753 3.7 3:e119c99e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_238:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.276 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:05:20.276 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.020407046000003, 2024-09-12T00:05:20.276 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.023674186999999999, 2024-09-12T00:05:20.276 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.276 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.276 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.276 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.276 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.276 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.276 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2753 2024-09-12T00:05:20.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.276 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.276 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.277 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.277 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:05:20.277 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.277 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.277 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.277 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:05:20.277 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.277 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.277 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.277 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154035+0000", 2024-09-12T00:05:20.277 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2799999999999999e-06 2024-09-12T00:05:20.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.278 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.278 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.278 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159459+0000", 2024-09-12T00:05:20.278 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054242190000000001 2024-09-12T00:05:20.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.278 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.278 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.278 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159509+0000", 2024-09-12T00:05:20.278 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9830999999999998e-05 2024-09-12T00:05:20.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.278 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.278 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.278 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159536+0000", 2024-09-12T00:05:20.279 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7438000000000001e-05 2024-09-12T00:05:20.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.279 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.279 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.279 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159710+0000", 2024-09-12T00:05:20.279 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017342 2024-09-12T00:05:20.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.279 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.279 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.279 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159961+0000", 2024-09-12T00:05:20.279 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025164499999999999 2024-09-12T00:05:20.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.280 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.280 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:20.280 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.160206+0000", 2024-09-12T00:05:20.280 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024534200000000001 2024-09-12T00:05:20.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.280 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.280 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.280 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177421+0000", 2024-09-12T00:05:20.280 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017214956 2024-09-12T00:05:20.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.280 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.280 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.281 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177534+0000", 2024-09-12T00:05:20.281 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000112223 2024-09-12T00:05:20.281 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.281 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.281 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.281 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177625+0000", 2024-09-12T00:05:20.281 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0947999999999997e-05 2024-09-12T00:05:20.281 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.281 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.281 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.281 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177706+0000", 2024-09-12T00:05:20.281 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0884999999999996e-05 2024-09-12T00:05:20.281 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.282 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.282 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.282 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.282 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.282 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2757 3.2b 3:d6dac417:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.282 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:05:20.282 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 31.954338224000001, 2024-09-12T00:05:20.282 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017779708000000002, 2024-09-12T00:05:20.282 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.282 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.282 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.282 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.282 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.282 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.283 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2757 2024-09-12T00:05:20.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.283 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.283 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.283 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.283 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:05:20.283 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.283 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.283 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.283 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220100+0000", 2024-09-12T00:05:20.283 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.284 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.284 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.284 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.220103+0000", 2024-09-12T00:05:20.284 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.32e-06 2024-09-12T00:05:20.284 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.284 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.284 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.284 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225042+0000", 2024-09-12T00:05:20.284 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049386200000000003 2024-09-12T00:05:20.284 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.284 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.284 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.284 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225083+0000", 2024-09-12T00:05:20.284 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1304000000000003e-05 2024-09-12T00:05:20.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.285 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.285 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.285 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225102+0000", 2024-09-12T00:05:20.285 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8502e-05 2024-09-12T00:05:20.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.285 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.285 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.285 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225256+0000", 2024-09-12T00:05:20.285 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015436099999999999 2024-09-12T00:05:20.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.285 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.285 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.285 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225513+0000", 2024-09-12T00:05:20.286 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000256562 2024-09-12T00:05:20.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.286 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.286 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:20.286 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.225737+0000", 2024-09-12T00:05:20.286 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022379 2024-09-12T00:05:20.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.286 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.286 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.286 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.234281+0000", 2024-09-12T00:05:20.286 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0085440540000000006 2024-09-12T00:05:20.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.286 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.286 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.287 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237710+0000", 2024-09-12T00:05:20.287 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0034298380000000002 2024-09-12T00:05:20.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.287 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.287 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.287 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237805+0000", 2024-09-12T00:05:20.287 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4804999999999998e-05 2024-09-12T00:05:20.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.287 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.287 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.287 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.237880+0000", 2024-09-12T00:05:20.287 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4552e-05 2024-09-12T00:05:20.287 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.287 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.287 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.288 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.288 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.288 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2764 3.2d e63/23 3:b7a0f55d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_249:head v 63'7, mlcod=63'5)", 2024-09-12T00:05:20.288 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:05:20.288 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 31.845560754000001, 2024-09-12T00:05:20.288 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018235872, 2024-09-12T00:05:20.288 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.288 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.288 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.288 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.288 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.288 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.288 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:05:20.288 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.289 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.289 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328878+0000", 2024-09-12T00:05:20.289 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.289 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.289 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.328882+0000", 2024-09-12T00:05:20.289 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5000000000000001e-06 2024-09-12T00:05:20.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.289 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.290 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335092+0000", 2024-09-12T00:05:20.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0062094730000000001 2024-09-12T00:05:20.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.290 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.290 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.290 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335127+0000", 2024-09-12T00:05:20.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5717999999999999e-05 2024-09-12T00:05:20.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.290 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.290 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.290 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335144+0000", 2024-09-12T00:05:20.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7119e-05 2024-09-12T00:05:20.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.290 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.290 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335308+0000", 2024-09-12T00:05:20.291 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000163757 2024-09-12T00:05:20.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.291 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.291 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.335354+0000", 2024-09-12T00:05:20.291 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6164e-05 2024-09-12T00:05:20.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.291 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.291 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.346991+0000", 2024-09-12T00:05:20.291 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011636851 2024-09-12T00:05:20.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.291 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.291 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.292 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.347113+0000", 2024-09-12T00:05:20.292 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012229 2024-09-12T00:05:20.292 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.292 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.292 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.292 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.292 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2963 3.2d e75/23 3:b6bc0367:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_2:head v 75'8, mlcod=63'6)", 2024-09-12T00:05:20.292 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:19.998698+0000", 2024-09-12T00:05:20.292 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.17574039699999999, 2024-09-12T00:05:20.292 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.023451277, 2024-09-12T00:05:20.292 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.292 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.293 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.293 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.293 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.293 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.294 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.998698+0000", 2024-09-12T00:05:20.294 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.294 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.294 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.294 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.998698+0000", 2024-09-12T00:05:20.294 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.294 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.295 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.295 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.998698+0000", 2024-09-12T00:05:20.295 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9699999999999996e-07 2024-09-12T00:05:20.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.295 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.295 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.295 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.004335+0000", 2024-09-12T00:05:20.295 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0056365570000000004 2024-09-12T00:05:20.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.295 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.295 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.295 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.004370+0000", 2024-09-12T00:05:20.296 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5275999999999999e-05 2024-09-12T00:05:20.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.296 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.004386+0000", 2024-09-12T00:05:20.296 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5939000000000001e-05 2024-09-12T00:05:20.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.296 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.004516+0000", 2024-09-12T00:05:20.296 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012985699999999999 2024-09-12T00:05:20.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.297 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.297 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.004558+0000", 2024-09-12T00:05:20.297 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2369e-05 2024-09-12T00:05:20.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.297 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.297 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.297 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.022094+0000", 2024-09-12T00:05:20.297 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017535057 2024-09-12T00:05:20.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.298 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.298 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.298 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.022149+0000", 2024-09-12T00:05:20.298 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5724999999999999e-05 2024-09-12T00:05:20.298 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.298 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.298 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.298 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.298 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2970 3.7 3:e36c9f9c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:20.298 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.066566+0000", 2024-09-12T00:05:20.298 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.107872755, 2024-09-12T00:05:20.298 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.023775837000000001, 2024-09-12T00:05:20.299 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.299 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.299 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.299 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.299 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.299 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.299 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2970 2024-09-12T00:05:20.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.299 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.299 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.066566+0000", 2024-09-12T00:05:20.299 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.300 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.300 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.300 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.066566+0000", 2024-09-12T00:05:20.300 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.300 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.300 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.300 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.066569+0000", 2024-09-12T00:05:20.300 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.315e-06 2024-09-12T00:05:20.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.301 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.301 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.071215+0000", 2024-09-12T00:05:20.301 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046463679999999997 2024-09-12T00:05:20.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.301 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.301 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.071237+0000", 2024-09-12T00:05:20.301 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1963999999999998e-05 2024-09-12T00:05:20.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.301 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.071248+0000", 2024-09-12T00:05:20.302 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0307e-05 2024-09-12T00:05:20.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.302 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.071331+0000", 2024-09-12T00:05:20.302 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3819999999999994e-05 2024-09-12T00:05:20.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.302 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.071476+0000", 2024-09-12T00:05:20.302 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000144377 2024-09-12T00:05:20.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:20.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.071602+0000", 2024-09-12T00:05:20.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012584200000000001 2024-09-12T00:05:20.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.086573+0000", 2024-09-12T00:05:20.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014971714000000001 2024-09-12T00:05:20.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.090186+0000", 2024-09-12T00:05:20.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0036128380000000002 2024-09-12T00:05:20.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.304 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.304 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.304 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.090275+0000", 2024-09-12T00:05:20.304 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8486000000000006e-05 2024-09-12T00:05:20.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.304 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.304 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.304 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.090341+0000", 2024-09-12T00:05:20.304 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6805999999999997e-05 2024-09-12T00:05:20.304 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.304 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.305 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.305 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.305 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.305 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:20.306 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:05:20.307 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:20.305+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:20.407 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:20.408+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:20.490 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:20.490 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:20.490 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.490 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3008 3.29 3:9599f6df:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:20.490 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.485227+0000", 2024-09-12T00:05:20.490 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.0064491419999999997, 2024-09-12T00:05:20.490 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0065057609999999997, 2024-09-12T00:05:20.490 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.490 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.491 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "waiting for sub ops", 2024-09-12T00:05:20.491 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.491 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.491 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.491 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3008 2024-09-12T00:05:20.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.491 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.491 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.491 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.491 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.485227+0000", 2024-09-12T00:05:20.491 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.491 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.491 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.492 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.485227+0000", 2024-09-12T00:05:20.492 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.492 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.492 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.492 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.492 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.485230+0000", 2024-09-12T00:05:20.492 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6100000000000002e-06 2024-09-12T00:05:20.492 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.492 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.492 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.492 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.489640+0000", 2024-09-12T00:05:20.492 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044098699999999998 2024-09-12T00:05:20.493 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.493 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.493 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.493 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.489680+0000", 2024-09-12T00:05:20.493 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9935000000000003e-05 2024-09-12T00:05:20.493 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.493 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.493 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.493 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.489698+0000", 2024-09-12T00:05:20.494 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8053000000000001e-05 2024-09-12T00:05:20.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.494 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.494 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.494 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.489854+0000", 2024-09-12T00:05:20.494 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015581300000000001 2024-09-12T00:05:20.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.494 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.494 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.495 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.490108+0000", 2024-09-12T00:05:20.495 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025445600000000002 2024-09-12T00:05:20.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.495 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.495 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:20.495 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.490334+0000", 2024-09-12T00:05:20.495 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022519700000000001 2024-09-12T00:05:20.495 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.495 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.496 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.496 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.496 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-09-12T00:05:20.496 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 1 2024-09-12T00:05:20.496 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:20.506 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:05:20.509 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:20.505+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:20.554 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T00:05:20.609 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:20.605+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:20.639 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:20.639 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:20.639 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:20.640 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:20.640 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:20.659 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:05:20.713 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:20.712+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:20.814 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:20.816+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:20.844 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:20.844 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:20.844 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:20.844 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:20.844 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.844 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2661 3.1e 3:7a671bd1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.845 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.307344+0000", 2024-09-12T00:05:20.845 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.535243741000002, 2024-09-12T00:05:20.845 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020716793000000001, 2024-09-12T00:05:20.845 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.845 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.845 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.845 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.845 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.845 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.845 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2661 2024-09-12T00:05:20.845 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.845 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.845 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.846 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.846 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.307344+0000", 2024-09-12T00:05:20.846 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.846 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.846 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.846 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.307344+0000", 2024-09-12T00:05:20.846 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.846 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.846 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.846 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.307347+0000", 2024-09-12T00:05:20.846 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.546e-06 2024-09-12T00:05:20.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.847 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.847 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.847 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311373+0000", 2024-09-12T00:05:20.847 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040257940000000001 2024-09-12T00:05:20.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.847 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.847 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.847 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311407+0000", 2024-09-12T00:05:20.847 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4038000000000002e-05 2024-09-12T00:05:20.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.847 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.847 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.847 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311427+0000", 2024-09-12T00:05:20.847 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0305e-05 2024-09-12T00:05:20.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.848 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.848 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.848 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311547+0000", 2024-09-12T00:05:20.848 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011904999999999999 2024-09-12T00:05:20.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.848 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.848 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.848 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.311877+0000", 2024-09-12T00:05:20.848 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00033003699999999998 2024-09-12T00:05:20.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.848 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.848 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:20.848 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.312137+0000", 2024-09-12T00:05:20.849 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026013499999999999 2024-09-12T00:05:20.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.849 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.849 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.849 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.320695+0000", 2024-09-12T00:05:20.849 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0085586029999999997 2024-09-12T00:05:20.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.849 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.849 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.849 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.327883+0000", 2024-09-12T00:05:20.849 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0071877419999999996 2024-09-12T00:05:20.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.849 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.849 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.850 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.327983+0000", 2024-09-12T00:05:20.850 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010008100000000001 2024-09-12T00:05:20.850 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.850 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.850 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.850 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.328061+0000", 2024-09-12T00:05:20.850 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7461999999999998e-05 2024-09-12T00:05:20.850 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.850 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.850 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.850 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.850 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.850 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2665 3.3d 3:bff83547:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.850 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.351951+0000", 2024-09-12T00:05:20.851 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.490636104000004, 2024-09-12T00:05:20.851 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019663572000000001, 2024-09-12T00:05:20.851 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.851 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.851 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.851 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.851 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.851 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.851 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2665 2024-09-12T00:05:20.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.851 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.851 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.851 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.851 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.351951+0000", 2024-09-12T00:05:20.852 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.852 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.852 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.852 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.351951+0000", 2024-09-12T00:05:20.852 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.852 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.852 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.852 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.351954+0000", 2024-09-12T00:05:20.852 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9330000000000001e-06 2024-09-12T00:05:20.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.852 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.852 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.853 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.355966+0000", 2024-09-12T00:05:20.853 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040118009999999997 2024-09-12T00:05:20.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.853 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.853 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.853 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356000+0000", 2024-09-12T00:05:20.853 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3967999999999997e-05 2024-09-12T00:05:20.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.853 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.853 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.853 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356025+0000", 2024-09-12T00:05:20.853 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4658e-05 2024-09-12T00:05:20.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.853 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.854 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.854 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356202+0000", 2024-09-12T00:05:20.854 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000176756 2024-09-12T00:05:20.854 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.854 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.854 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.854 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356445+0000", 2024-09-12T00:05:20.854 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024318300000000001 2024-09-12T00:05:20.854 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.854 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.854 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:20.854 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.356671+0000", 2024-09-12T00:05:20.854 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000226276 2024-09-12T00:05:20.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.855 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.855 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.855 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.370776+0000", 2024-09-12T00:05:20.855 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014104604 2024-09-12T00:05:20.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.855 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.855 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.855 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.371306+0000", 2024-09-12T00:05:20.855 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00053036499999999998 2024-09-12T00:05:20.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.855 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.855 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.855 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.371521+0000", 2024-09-12T00:05:20.855 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021477000000000001 2024-09-12T00:05:20.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.856 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.856 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.856 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.371615+0000", 2024-09-12T00:05:20.856 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4258000000000005e-05 2024-09-12T00:05:20.856 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.856 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.856 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.856 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.856 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2693 3.1e 3:7a8f9e2c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.856 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.536006+0000", 2024-09-12T00:05:20.856 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.306581706000003, 2024-09-12T00:05:20.856 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019831418999999999, 2024-09-12T00:05:20.856 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.857 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.857 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.857 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.857 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.857 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.857 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2693 2024-09-12T00:05:20.857 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.857 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.857 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.857 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.857 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.536006+0000", 2024-09-12T00:05:20.857 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.857 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.858 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.858 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.858 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.536006+0000", 2024-09-12T00:05:20.858 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.858 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.858 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.858 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.536010+0000", 2024-09-12T00:05:20.858 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.737e-06 2024-09-12T00:05:20.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.858 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.858 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.859 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.539958+0000", 2024-09-12T00:05:20.859 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003948315 2024-09-12T00:05:20.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.859 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.859 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.859 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.539997+0000", 2024-09-12T00:05:20.859 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9131000000000002e-05 2024-09-12T00:05:20.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.859 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.859 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.859 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.540016+0000", 2024-09-12T00:05:20.859 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9018e-05 2024-09-12T00:05:20.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.860 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.860 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.860 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.540148+0000", 2024-09-12T00:05:20.860 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013242899999999999 2024-09-12T00:05:20.860 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.860 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.860 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.860 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.540394+0000", 2024-09-12T00:05:20.860 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024580899999999999 2024-09-12T00:05:20.860 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.860 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.860 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:20.861 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.540622+0000", 2024-09-12T00:05:20.861 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022765599999999999 2024-09-12T00:05:20.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.861 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.861 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.861 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.547587+0000", 2024-09-12T00:05:20.861 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0069649259999999998 2024-09-12T00:05:20.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.861 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.861 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.861 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.555622+0000", 2024-09-12T00:05:20.861 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0080352640000000003 2024-09-12T00:05:20.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.862 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.862 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.862 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.555724+0000", 2024-09-12T00:05:20.862 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010187399999999999 2024-09-12T00:05:20.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.862 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.862 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.862 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.555837+0000", 2024-09-12T00:05:20.862 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011326 2024-09-12T00:05:20.862 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.862 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.862 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.862 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.863 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2694 3.3d 3:bd0bdafc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.863 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:20.863 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.297059152999999, 2024-09-12T00:05:20.863 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.026139741000000001, 2024-09-12T00:05:20.863 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.863 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.863 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.863 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.863 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.863 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.863 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2694 2024-09-12T00:05:20.863 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.863 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.863 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.864 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.864 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:20.864 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.864 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.864 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.864 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.864 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:20.864 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.864 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.864 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.864 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.864 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545532+0000", 2024-09-12T00:05:20.864 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8199999999999998e-06 2024-09-12T00:05:20.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.865 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.865 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.865 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551454+0000", 2024-09-12T00:05:20.865 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059222340000000002 2024-09-12T00:05:20.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.865 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.865 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.865 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551485+0000", 2024-09-12T00:05:20.865 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0173999999999999e-05 2024-09-12T00:05:20.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.865 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.865 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.866 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551504+0000", 2024-09-12T00:05:20.866 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9726000000000001e-05 2024-09-12T00:05:20.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.866 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.866 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.866 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551708+0000", 2024-09-12T00:05:20.866 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020344100000000001 2024-09-12T00:05:20.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.866 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.866 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.866 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552087+0000", 2024-09-12T00:05:20.866 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000379327 2024-09-12T00:05:20.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.866 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.867 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:20.867 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552351+0000", 2024-09-12T00:05:20.867 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026349199999999999 2024-09-12T00:05:20.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.867 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.867 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.867 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.569375+0000", 2024-09-12T00:05:20.867 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017024432999999999 2024-09-12T00:05:20.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.867 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.867 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.867 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571222+0000", 2024-09-12T00:05:20.867 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00184688 2024-09-12T00:05:20.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.867 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.868 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.868 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571511+0000", 2024-09-12T00:05:20.868 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028897599999999998 2024-09-12T00:05:20.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.868 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.868 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.868 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571668+0000", 2024-09-12T00:05:20.868 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000157238 2024-09-12T00:05:20.868 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.868 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.868 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.868 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.869 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2698 3.3d 3:bcafb0f9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.869 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:20.869 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.252605449999997, 2024-09-12T00:05:20.869 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025133152999999998, 2024-09-12T00:05:20.869 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.869 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.869 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.869 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.869 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.869 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.869 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2698 2024-09-12T00:05:20.869 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.869 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.869 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.870 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.870 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:20.870 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.870 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.870 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.870 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:20.870 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.870 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.870 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.870 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589986+0000", 2024-09-12T00:05:20.870 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5999999999999998e-06 2024-09-12T00:05:20.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.871 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.871 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.871 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594109+0000", 2024-09-12T00:05:20.871 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041230770000000002 2024-09-12T00:05:20.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.871 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.871 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.871 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594146+0000", 2024-09-12T00:05:20.871 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7722000000000002e-05 2024-09-12T00:05:20.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.871 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.871 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.871 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594167+0000", 2024-09-12T00:05:20.872 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0100999999999999e-05 2024-09-12T00:05:20.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.872 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.872 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.872 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594297+0000", 2024-09-12T00:05:20.872 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013051600000000001 2024-09-12T00:05:20.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.872 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.872 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.872 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594570+0000", 2024-09-12T00:05:20.872 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000272837 2024-09-12T00:05:20.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.873 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.873 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:20.873 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594846+0000", 2024-09-12T00:05:20.873 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027622399999999999 2024-09-12T00:05:20.873 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.873 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.873 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.873 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.606026+0000", 2024-09-12T00:05:20.873 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011179947000000001 2024-09-12T00:05:20.873 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.873 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.873 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.873 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.614827+0000", 2024-09-12T00:05:20.874 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0088013259999999999 2024-09-12T00:05:20.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.874 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.874 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.874 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.614988+0000", 2024-09-12T00:05:20.874 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016018799999999999 2024-09-12T00:05:20.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.874 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.874 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.874 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.615115+0000", 2024-09-12T00:05:20.874 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000127615 2024-09-12T00:05:20.874 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.874 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.874 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.875 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.875 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2699 3.0 3:02470ff9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.875 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.597879+0000", 2024-09-12T00:05:20.875 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.244708361000001, 2024-09-12T00:05:20.875 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021498363, 2024-09-12T00:05:20.875 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.875 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.875 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.875 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.875 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.875 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.875 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2699 2024-09-12T00:05:20.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.876 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.876 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.876 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.876 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.597879+0000", 2024-09-12T00:05:20.876 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.876 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.876 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.876 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.597879+0000", 2024-09-12T00:05:20.876 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.876 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.876 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.877 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.597884+0000", 2024-09-12T00:05:20.877 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1769999999999997e-06 2024-09-12T00:05:20.877 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.877 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.877 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.877 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602129+0000", 2024-09-12T00:05:20.877 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042451399999999997 2024-09-12T00:05:20.877 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.877 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.877 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.877 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602170+0000", 2024-09-12T00:05:20.877 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0194000000000002e-05 2024-09-12T00:05:20.877 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.877 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.878 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.878 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602198+0000", 2024-09-12T00:05:20.878 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7861999999999999e-05 2024-09-12T00:05:20.878 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.878 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.878 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.878 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602392+0000", 2024-09-12T00:05:20.878 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000194122 2024-09-12T00:05:20.878 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.878 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.878 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.878 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.602801+0000", 2024-09-12T00:05:20.879 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040957199999999997 2024-09-12T00:05:20.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.879 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.879 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:20.879 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.603203+0000", 2024-09-12T00:05:20.879 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040166900000000001 2024-09-12T00:05:20.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.879 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.879 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.879 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.611989+0000", 2024-09-12T00:05:20.879 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0087860170000000001 2024-09-12T00:05:20.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.879 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.879 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.879 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.619177+0000", 2024-09-12T00:05:20.880 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0071878819999999996 2024-09-12T00:05:20.880 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.880 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.880 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.880 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.619270+0000", 2024-09-12T00:05:20.880 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2930999999999995e-05 2024-09-12T00:05:20.880 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.880 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.880 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.880 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.619378+0000", 2024-09-12T00:05:20.881 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000107797 2024-09-12T00:05:20.881 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.881 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.881 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.881 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.881 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.881 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2712 3.3e 3:7d3d0242:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.881 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:20.881 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.115705173000002, 2024-09-12T00:05:20.881 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022816941, 2024-09-12T00:05:20.882 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.882 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.882 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.882 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.882 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.882 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.882 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2712 2024-09-12T00:05:20.882 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.882 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.883 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.883 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.883 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:20.883 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.883 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.883 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.883 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.883 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:20.883 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.883 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.884 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.884 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.884 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726886+0000", 2024-09-12T00:05:20.884 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5329999999999999e-06 2024-09-12T00:05:20.884 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.884 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.884 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.884 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730802+0000", 2024-09-12T00:05:20.884 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039158700000000001 2024-09-12T00:05:20.885 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.885 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.885 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.885 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730839+0000", 2024-09-12T00:05:20.885 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6857999999999998e-05 2024-09-12T00:05:20.885 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.885 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.885 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.885 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730856+0000", 2024-09-12T00:05:20.886 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7371999999999999e-05 2024-09-12T00:05:20.886 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.886 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.886 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.886 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731026+0000", 2024-09-12T00:05:20.886 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017011000000000001 2024-09-12T00:05:20.886 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.886 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.886 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.886 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731444+0000", 2024-09-12T00:05:20.887 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041766500000000001 2024-09-12T00:05:20.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.887 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.887 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:20.887 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731860+0000", 2024-09-12T00:05:20.887 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041618500000000001 2024-09-12T00:05:20.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.887 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.887 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.887 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.743012+0000", 2024-09-12T00:05:20.887 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011152123 2024-09-12T00:05:20.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.888 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.888 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749386+0000", 2024-09-12T00:05:20.888 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0063743130000000004 2024-09-12T00:05:20.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.888 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.888 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749562+0000", 2024-09-12T00:05:20.888 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017590300000000001 2024-09-12T00:05:20.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.888 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.889 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749699+0000", 2024-09-12T00:05:20.889 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000137009 2024-09-12T00:05:20.889 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.889 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.889 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.889 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.889 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2714 3.17 3:eac65a57:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.889 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.746943+0000", 2024-09-12T00:05:20.890 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.095644931000002, 2024-09-12T00:05:20.890 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019462007, 2024-09-12T00:05:20.890 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.890 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.890 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.890 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.890 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.890 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.890 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2714 2024-09-12T00:05:20.890 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.890 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.890 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.890 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.891 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.746943+0000", 2024-09-12T00:05:20.891 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.891 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.891 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.891 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.891 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.746943+0000", 2024-09-12T00:05:20.891 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.891 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.891 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.891 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.891 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.746946+0000", 2024-09-12T00:05:20.891 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9529999999999999e-06 2024-09-12T00:05:20.892 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.892 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.892 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.892 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751163+0000", 2024-09-12T00:05:20.892 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042169859999999998 2024-09-12T00:05:20.892 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.892 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.892 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.892 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751188+0000", 2024-09-12T00:05:20.892 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5908e-05 2024-09-12T00:05:20.893 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.893 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.893 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.893 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751203+0000", 2024-09-12T00:05:20.893 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4491999999999999e-05 2024-09-12T00:05:20.893 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.893 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.893 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.893 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751324+0000", 2024-09-12T00:05:20.893 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120866 2024-09-12T00:05:20.893 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.893 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.894 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.894 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751572+0000", 2024-09-12T00:05:20.894 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024774900000000002 2024-09-12T00:05:20.894 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.894 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.894 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:20.894 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.751798+0000", 2024-09-12T00:05:20.894 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022655700000000001 2024-09-12T00:05:20.894 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.894 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.894 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.895 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761058+0000", 2024-09-12T00:05:20.895 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0092603110000000002 2024-09-12T00:05:20.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.895 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.895 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.895 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.766067+0000", 2024-09-12T00:05:20.895 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005009009 2024-09-12T00:05:20.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.895 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.895 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.895 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.766264+0000", 2024-09-12T00:05:20.895 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00019632800000000001 2024-09-12T00:05:20.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.896 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.896 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.896 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.766405+0000", 2024-09-12T00:05:20.896 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000140848 2024-09-12T00:05:20.896 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.896 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.896 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.896 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.896 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.896 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2715 3.18 3:19a9b410:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.896 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:20.897 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.086328883, 2024-09-12T00:05:20.897 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022391956000000001, 2024-09-12T00:05:20.897 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.897 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.897 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.897 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.897 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.897 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.897 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2715 2024-09-12T00:05:20.897 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.897 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.898 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.898 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.898 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:20.898 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.898 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.898 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.898 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.898 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:20.898 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.898 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.898 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.898 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.898 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756262+0000", 2024-09-12T00:05:20.898 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9629999999999998e-06 2024-09-12T00:05:20.899 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.899 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.899 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.899 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760936+0000", 2024-09-12T00:05:20.899 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046745750000000003 2024-09-12T00:05:20.899 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.899 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.899 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.899 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760968+0000", 2024-09-12T00:05:20.899 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1470999999999997e-05 2024-09-12T00:05:20.899 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.899 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.900 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.900 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760985+0000", 2024-09-12T00:05:20.900 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7771999999999999e-05 2024-09-12T00:05:20.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.900 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.900 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.900 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761154+0000", 2024-09-12T00:05:20.900 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016875399999999999 2024-09-12T00:05:20.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.900 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.900 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.901 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761571+0000", 2024-09-12T00:05:20.901 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000417231 2024-09-12T00:05:20.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.901 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:20.901 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761996+0000", 2024-09-12T00:05:20.901 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042500200000000001 2024-09-12T00:05:20.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.901 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.901 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777182+0000", 2024-09-12T00:05:20.901 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015185664999999999 2024-09-12T00:05:20.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.902 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.902 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778484+0000", 2024-09-12T00:05:20.902 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00130225 2024-09-12T00:05:20.902 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.902 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.902 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.902 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778575+0000", 2024-09-12T00:05:20.902 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0258000000000002e-05 2024-09-12T00:05:20.902 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.902 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.902 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.903 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778651+0000", 2024-09-12T00:05:20.903 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6014999999999996e-05 2024-09-12T00:05:20.903 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.903 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.903 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.903 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.903 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.903 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2729 3.0 3:01c0e0c9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.903 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:20.903 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.945448067000001, 2024-09-12T00:05:20.903 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025173068, 2024-09-12T00:05:20.903 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.903 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.903 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.904 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.904 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.904 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.904 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2729 2024-09-12T00:05:20.904 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.904 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.904 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.904 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.904 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:20.904 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.904 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.905 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.905 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.905 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:20.905 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.905 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.905 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.905 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897143+0000", 2024-09-12T00:05:20.905 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6600000000000001e-06 2024-09-12T00:05:20.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.905 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.905 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.906 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901595+0000", 2024-09-12T00:05:20.906 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044514680000000001 2024-09-12T00:05:20.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.906 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.906 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.906 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901629+0000", 2024-09-12T00:05:20.906 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4864999999999999e-05 2024-09-12T00:05:20.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.906 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.906 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.906 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901647+0000", 2024-09-12T00:05:20.906 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7699000000000001e-05 2024-09-12T00:05:20.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.907 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.907 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.907 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901780+0000", 2024-09-12T00:05:20.907 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013271499999999999 2024-09-12T00:05:20.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.907 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.907 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.907 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902010+0000", 2024-09-12T00:05:20.907 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022977300000000001 2024-09-12T00:05:20.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.907 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.907 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:20.908 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902222+0000", 2024-09-12T00:05:20.908 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021262399999999999 2024-09-12T00:05:20.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.908 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.908 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.908 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912402+0000", 2024-09-12T00:05:20.908 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010180203000000001 2024-09-12T00:05:20.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.908 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.908 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.909 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.921990+0000", 2024-09-12T00:05:20.909 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095871900000000006 2024-09-12T00:05:20.909 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.909 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.909 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.909 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.922166+0000", 2024-09-12T00:05:20.909 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017591899999999999 2024-09-12T00:05:20.909 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.909 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.910 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.910 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.922313+0000", 2024-09-12T00:05:20.910 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000146952 2024-09-12T00:05:20.910 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.910 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.910 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.910 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.910 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.910 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2732 3.1f 3:f85b64cb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.911 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:20.911 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.914002279000002, 2024-09-12T00:05:20.911 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022644154, 2024-09-12T00:05:20.911 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.911 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.911 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.911 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.911 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.911 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.911 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2732 2024-09-12T00:05:20.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.912 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.912 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.912 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.912 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:20.912 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.912 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.912 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.912 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.912 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:20.913 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.913 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.913 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.913 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.913 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928589+0000", 2024-09-12T00:05:20.913 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1230000000000002e-06 2024-09-12T00:05:20.913 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.913 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.913 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.913 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932650+0000", 2024-09-12T00:05:20.914 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040611049999999997 2024-09-12T00:05:20.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.914 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.914 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.914 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932692+0000", 2024-09-12T00:05:20.914 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1677000000000001e-05 2024-09-12T00:05:20.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.914 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.914 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.915 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932711+0000", 2024-09-12T00:05:20.915 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8749e-05 2024-09-12T00:05:20.915 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.915 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.915 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.915 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932834+0000", 2024-09-12T00:05:20.915 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012278300000000001 2024-09-12T00:05:20.915 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.915 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.915 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.915 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.933095+0000", 2024-09-12T00:05:20.916 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026151100000000002 2024-09-12T00:05:20.916 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.916 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.916 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:20.916 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.933385+0000", 2024-09-12T00:05:20.916 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028993900000000002 2024-09-12T00:05:20.916 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.917 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.917 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.917 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.950988+0000", 2024-09-12T00:05:20.917 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017603119 2024-09-12T00:05:20.917 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.917 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.917 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.917 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951018+0000", 2024-09-12T00:05:20.917 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9343999999999999e-05 2024-09-12T00:05:20.917 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.917 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.917 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.917 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951109+0000", 2024-09-12T00:05:20.918 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1157999999999997e-05 2024-09-12T00:05:20.918 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.918 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.918 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.918 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951229+0000", 2024-09-12T00:05:20.918 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120646 2024-09-12T00:05:20.918 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.918 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.918 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.918 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.918 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.919 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2747 3.17 3:eaa4528d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:20.919 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:20.919 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.753665794, 2024-09-12T00:05:20.919 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025552734000000001, 2024-09-12T00:05:20.919 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.919 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.919 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.919 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.919 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.919 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.919 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2747 2024-09-12T00:05:20.920 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.920 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.920 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.920 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.920 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:20.920 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.920 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.920 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.920 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.920 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:20.921 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.921 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.921 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.921 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.921 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088925+0000", 2024-09-12T00:05:20.921 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7759999999999999e-06 2024-09-12T00:05:20.921 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.921 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.921 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.921 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093002+0000", 2024-09-12T00:05:20.921 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004076405 2024-09-12T00:05:20.922 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.922 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.922 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.922 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093040+0000", 2024-09-12T00:05:20.922 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8093999999999998e-05 2024-09-12T00:05:20.922 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.922 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.922 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.922 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093059+0000", 2024-09-12T00:05:20.922 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8736000000000002e-05 2024-09-12T00:05:20.922 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.923 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.923 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.923 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093230+0000", 2024-09-12T00:05:20.923 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000170853 2024-09-12T00:05:20.923 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.923 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.923 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.923 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093627+0000", 2024-09-12T00:05:20.923 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039781400000000002 2024-09-12T00:05:20.923 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.923 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.924 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:20.924 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.094044+0000", 2024-09-12T00:05:20.924 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000416205 2024-09-12T00:05:20.924 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.924 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.924 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.924 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.103528+0000", 2024-09-12T00:05:20.924 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0094841549999999993 2024-09-12T00:05:20.924 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.924 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.924 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.925 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112299+0000", 2024-09-12T00:05:20.925 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0087711590000000006 2024-09-12T00:05:20.925 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.925 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.925 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.925 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112397+0000", 2024-09-12T00:05:20.925 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8095000000000002e-05 2024-09-12T00:05:20.925 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.925 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.925 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.925 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.114474+0000", 2024-09-12T00:05:20.926 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020774420000000001 2024-09-12T00:05:20.926 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.926 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.926 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.926 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.926 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.926 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2962 3.18 3:1b55431a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:20.926 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:19.985385+0000", 2024-09-12T00:05:20.926 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.857202503, 2024-09-12T00:05:20.926 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024097998999999998, 2024-09-12T00:05:20.926 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.927 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.927 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.927 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.927 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.927 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.927 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2962 2024-09-12T00:05:20.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.927 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.927 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.927 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.927 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.985385+0000", 2024-09-12T00:05:20.927 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.928 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.928 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.928 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.928 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.985385+0000", 2024-09-12T00:05:20.928 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.928 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.928 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.928 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.928 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.985388+0000", 2024-09-12T00:05:20.928 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8899999999999999e-06 2024-09-12T00:05:20.928 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.928 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.929 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.929 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990021+0000", 2024-09-12T00:05:20.929 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046326850000000001 2024-09-12T00:05:20.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.929 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.929 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.929 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990049+0000", 2024-09-12T00:05:20.929 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8007000000000001e-05 2024-09-12T00:05:20.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.929 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.929 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.929 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990064+0000", 2024-09-12T00:05:20.929 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4918e-05 2024-09-12T00:05:20.930 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.930 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.930 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.930 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990182+0000", 2024-09-12T00:05:20.930 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118958 2024-09-12T00:05:20.930 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.930 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.930 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.930 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990449+0000", 2024-09-12T00:05:20.930 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026634899999999998 2024-09-12T00:05:20.930 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.930 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.930 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:20.931 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990677+0000", 2024-09-12T00:05:20.931 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022768800000000001 2024-09-12T00:05:20.931 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.931 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.931 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.931 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.007621+0000", 2024-09-12T00:05:20.931 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016944866999999999 2024-09-12T00:05:20.931 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.931 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.931 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.931 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.009365+0000", 2024-09-12T00:05:20.931 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0017433399999999999 2024-09-12T00:05:20.931 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.932 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.932 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.932 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.009430+0000", 2024-09-12T00:05:20.932 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4813000000000004e-05 2024-09-12T00:05:20.932 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.932 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.932 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.932 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.009483+0000", 2024-09-12T00:05:20.932 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3483999999999998e-05 2024-09-12T00:05:20.932 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.932 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.932 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.933 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.933 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.933 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2976 3.1f 3:fb47302f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:20.933 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.128338+0000", 2024-09-12T00:05:20.933 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.71424906700000002, 2024-09-12T00:05:20.933 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.01995475, 2024-09-12T00:05:20.933 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.933 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.933 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.933 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.933 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.933 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.933 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2976 2024-09-12T00:05:20.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.934 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.934 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.934 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.934 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.128338+0000", 2024-09-12T00:05:20.934 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.934 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.934 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.934 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.128338+0000", 2024-09-12T00:05:20.934 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.934 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.935 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.935 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.128342+0000", 2024-09-12T00:05:20.935 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4999999999999999e-06 2024-09-12T00:05:20.935 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.935 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.935 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.935 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.132343+0000", 2024-09-12T00:05:20.935 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040013640000000003 2024-09-12T00:05:20.935 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.935 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.935 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.935 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.132385+0000", 2024-09-12T00:05:20.935 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1362000000000001e-05 2024-09-12T00:05:20.935 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.936 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.936 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.936 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.132405+0000", 2024-09-12T00:05:20.936 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9993e-05 2024-09-12T00:05:20.936 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.936 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.936 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.936 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.132519+0000", 2024-09-12T00:05:20.936 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000114096 2024-09-12T00:05:20.936 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.936 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.936 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.937 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.132727+0000", 2024-09-12T00:05:20.937 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020779899999999999 2024-09-12T00:05:20.937 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.937 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.937 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:20.937 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.132936+0000", 2024-09-12T00:05:20.937 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020971 2024-09-12T00:05:20.937 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.937 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.937 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.937 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.139549+0000", 2024-09-12T00:05:20.937 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006612578 2024-09-12T00:05:20.937 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.938 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.938 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.938 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.147948+0000", 2024-09-12T00:05:20.938 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0083986640000000001 2024-09-12T00:05:20.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.938 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.938 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.938 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.148155+0000", 2024-09-12T00:05:20.938 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000207605 2024-09-12T00:05:20.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.938 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.938 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.938 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.148293+0000", 2024-09-12T00:05:20.938 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013807899999999999 2024-09-12T00:05:20.939 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.939 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.939 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.939 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.939 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.939 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2977 3.0 3:020c9773:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:20.939 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.137214+0000", 2024-09-12T00:05:20.939 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.70537307000000005, 2024-09-12T00:05:20.939 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020324783999999999, 2024-09-12T00:05:20.939 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.939 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.939 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.939 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.940 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.940 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.940 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2977 2024-09-12T00:05:20.940 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.940 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.940 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.940 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.940 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.137214+0000", 2024-09-12T00:05:20.940 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.940 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.940 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.940 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.940 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.137214+0000", 2024-09-12T00:05:20.941 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.941 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.941 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.941 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.941 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.137217+0000", 2024-09-12T00:05:20.941 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9900000000000002e-06 2024-09-12T00:05:20.941 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.941 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.941 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.941 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.142561+0000", 2024-09-12T00:05:20.941 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005343815 2024-09-12T00:05:20.941 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.941 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.942 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.942 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.142593+0000", 2024-09-12T00:05:20.942 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2209000000000003e-05 2024-09-12T00:05:20.942 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.942 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.942 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.942 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.142610+0000", 2024-09-12T00:05:20.942 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6773e-05 2024-09-12T00:05:20.942 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.942 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.942 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.944 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.142742+0000", 2024-09-12T00:05:20.944 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013156999999999999 2024-09-12T00:05:20.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.944 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.944 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.944 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.143003+0000", 2024-09-12T00:05:20.944 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026138300000000001 2024-09-12T00:05:20.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.944 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.944 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:20.944 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.143245+0000", 2024-09-12T00:05:20.944 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024192699999999999 2024-09-12T00:05:20.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.945 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.945 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.156010+0000", 2024-09-12T00:05:20.945 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012765235999999999 2024-09-12T00:05:20.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.945 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.945 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.157357+0000", 2024-09-12T00:05:20.945 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0013464659999999999 2024-09-12T00:05:20.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.945 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.946 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.157470+0000", 2024-09-12T00:05:20.946 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011366000000000001 2024-09-12T00:05:20.946 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.946 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.946 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.946 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.157539+0000", 2024-09-12T00:05:20.946 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8755000000000002e-05 2024-09-12T00:05:20.946 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.946 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.946 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.946 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.946 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.946 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2990 3.18 3:1a40c35e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:20.947 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.291518+0000", 2024-09-12T00:05:20.947 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.55106901699999999, 2024-09-12T00:05:20.947 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021141275000000001, 2024-09-12T00:05:20.947 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.947 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.947 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.947 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.947 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.947 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.947 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2990 2024-09-12T00:05:20.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.947 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.947 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.948 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.948 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.291518+0000", 2024-09-12T00:05:20.948 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.948 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.948 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.291518+0000", 2024-09-12T00:05:20.948 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.948 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.948 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.291522+0000", 2024-09-12T00:05:20.949 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8029999999999998e-06 2024-09-12T00:05:20.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.949 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.949 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.295948+0000", 2024-09-12T00:05:20.949 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044258359999999998 2024-09-12T00:05:20.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.949 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.949 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.295986+0000", 2024-09-12T00:05:20.949 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7546000000000003e-05 2024-09-12T00:05:20.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.950 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.950 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.296004+0000", 2024-09-12T00:05:20.950 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7909000000000001e-05 2024-09-12T00:05:20.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.950 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.950 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.950 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.296211+0000", 2024-09-12T00:05:20.950 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020724099999999999 2024-09-12T00:05:20.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.950 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.950 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.950 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.296457+0000", 2024-09-12T00:05:20.950 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000246357 2024-09-12T00:05:20.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.951 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.951 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:20.951 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.296682+0000", 2024-09-12T00:05:20.951 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000224358 2024-09-12T00:05:20.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.951 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.951 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.951 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.306056+0000", 2024-09-12T00:05:20.951 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0093745080000000001 2024-09-12T00:05:20.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.951 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.951 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.951 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.312492+0000", 2024-09-12T00:05:20.952 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064359020000000003 2024-09-12T00:05:20.952 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.952 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.952 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.952 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.312585+0000", 2024-09-12T00:05:20.952 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3404000000000002e-05 2024-09-12T00:05:20.952 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.952 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.952 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.952 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.312660+0000", 2024-09-12T00:05:20.952 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4411000000000003e-05 2024-09-12T00:05:20.952 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.953 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.953 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.953 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.953 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.953 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2995 3.29 3:96b1390d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:20.953 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.340290+0000", 2024-09-12T00:05:20.953 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.50229736199999997, 2024-09-12T00:05:20.953 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022765251, 2024-09-12T00:05:20.953 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.953 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.953 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.953 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.953 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.953 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.954 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2995 2024-09-12T00:05:20.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.954 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.954 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.954 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.954 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.340290+0000", 2024-09-12T00:05:20.954 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.954 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.954 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.954 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.340290+0000", 2024-09-12T00:05:20.954 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.955 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.955 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.955 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.340293+0000", 2024-09-12T00:05:20.955 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2200000000000001e-06 2024-09-12T00:05:20.955 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.955 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.955 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.955 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.346557+0000", 2024-09-12T00:05:20.955 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0062637070000000003 2024-09-12T00:05:20.955 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.955 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.955 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.955 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.346595+0000", 2024-09-12T00:05:20.956 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7672000000000001e-05 2024-09-12T00:05:20.956 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.956 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.956 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.956 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.346620+0000", 2024-09-12T00:05:20.956 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4769999999999998e-05 2024-09-12T00:05:20.956 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.956 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.956 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.956 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.346757+0000", 2024-09-12T00:05:20.956 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000137319 2024-09-12T00:05:20.956 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.956 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.957 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.957 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.347013+0000", 2024-09-12T00:05:20.957 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025612299999999997 2024-09-12T00:05:20.957 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.957 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.957 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:20.957 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.347237+0000", 2024-09-12T00:05:20.957 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000224348 2024-09-12T00:05:20.957 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.957 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.957 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.957 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.357526+0000", 2024-09-12T00:05:20.957 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010288693 2024-09-12T00:05:20.958 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.958 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.958 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.958 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.362902+0000", 2024-09-12T00:05:20.958 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053764659999999999 2024-09-12T00:05:20.958 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.958 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.958 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.958 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.362988+0000", 2024-09-12T00:05:20.958 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.5086000000000005e-05 2024-09-12T00:05:20.958 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.958 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.958 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.959 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.363055+0000", 2024-09-12T00:05:20.959 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.7847000000000003e-05 2024-09-12T00:05:20.959 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.959 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.959 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.959 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.959 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.959 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3017 3.1e 3:792e6842:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:20.959 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.605222+0000", 2024-09-12T00:05:20.959 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.23736514, 2024-09-12T00:05:20.959 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021662359999999999, 2024-09-12T00:05:20.959 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.959 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.960 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.960 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.960 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.960 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.960 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3017 2024-09-12T00:05:20.960 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.960 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.960 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.960 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.960 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.605222+0000", 2024-09-12T00:05:20.960 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.961 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.961 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.961 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.961 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.605222+0000", 2024-09-12T00:05:20.961 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.961 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.961 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.961 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.961 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.605227+0000", 2024-09-12T00:05:20.961 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3100000000000002e-06 2024-09-12T00:05:20.961 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.961 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.962 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.962 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.610360+0000", 2024-09-12T00:05:20.962 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0051331609999999998 2024-09-12T00:05:20.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.962 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.962 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.962 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.610400+0000", 2024-09-12T00:05:20.962 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9795000000000001e-05 2024-09-12T00:05:20.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.962 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.962 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.962 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.610418+0000", 2024-09-12T00:05:20.962 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8539e-05 2024-09-12T00:05:20.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.963 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.963 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.963 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.610552+0000", 2024-09-12T00:05:20.963 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013348400000000001 2024-09-12T00:05:20.963 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.963 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.963 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.963 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.610799+0000", 2024-09-12T00:05:20.963 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024735600000000001 2024-09-12T00:05:20.963 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.963 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.963 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:20.963 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611118+0000", 2024-09-12T00:05:20.963 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000318676 2024-09-12T00:05:20.964 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.964 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.964 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.964 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.620061+0000", 2024-09-12T00:05:20.964 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0089429920000000003 2024-09-12T00:05:20.964 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.964 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.964 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.964 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.626735+0000", 2024-09-12T00:05:20.964 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006674803 2024-09-12T00:05:20.964 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.964 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.965 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.965 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.626826+0000", 2024-09-12T00:05:20.965 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0532000000000007e-05 2024-09-12T00:05:20.965 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.965 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.965 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.965 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.626885+0000", 2024-09-12T00:05:20.965 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8712000000000003e-05 2024-09-12T00:05:20.965 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.965 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.965 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.965 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.965 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.966 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3033 3.1e 3:79681e1a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:20.966 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.771222+0000", 2024-09-12T00:05:20.966 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.071365034999999993, 2024-09-12T00:05:20.966 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.033700292, 2024-09-12T00:05:20.966 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.966 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.966 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.966 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.966 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.966 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.966 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3033 2024-09-12T00:05:20.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.966 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.967 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.967 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.967 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.771222+0000", 2024-09-12T00:05:20.967 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.967 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.967 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.967 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.967 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.771222+0000", 2024-09-12T00:05:20.967 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.967 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.967 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.967 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.967 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.771225+0000", 2024-09-12T00:05:20.968 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.74e-06 2024-09-12T00:05:20.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.968 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.968 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.968 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.775948+0000", 2024-09-12T00:05:20.968 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047228419999999997 2024-09-12T00:05:20.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.968 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.968 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.968 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.775971+0000", 2024-09-12T00:05:20.968 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2634999999999999e-05 2024-09-12T00:05:20.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.968 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.969 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.969 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.775981+0000", 2024-09-12T00:05:20.969 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8579999999999995e-06 2024-09-12T00:05:20.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.969 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.969 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.969 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.776126+0000", 2024-09-12T00:05:20.969 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014540500000000001 2024-09-12T00:05:20.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.969 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.969 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.969 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.776391+0000", 2024-09-12T00:05:20.969 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026489699999999999 2024-09-12T00:05:20.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.970 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.970 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:20.970 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.776613+0000", 2024-09-12T00:05:20.970 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022235700000000001 2024-09-12T00:05:20.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.970 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.970 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.970 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.783586+0000", 2024-09-12T00:05:20.970 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006972705 2024-09-12T00:05:20.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.970 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.970 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.970 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.804641+0000", 2024-09-12T00:05:20.971 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021055470999999999 2024-09-12T00:05:20.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.971 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.971 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.971 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.804798+0000", 2024-09-12T00:05:20.971 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015695600000000001 2024-09-12T00:05:20.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.971 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.971 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.971 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.804923+0000", 2024-09-12T00:05:20.971 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012442599999999999 2024-09-12T00:05:20.971 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.971 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.971 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.972 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.972 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.972 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3036 3.1e 3:7aa0a48a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:20.972 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.802567+0000", 2024-09-12T00:05:20.972 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.040020924999999999, 2024-09-12T00:05:20.972 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022998985, 2024-09-12T00:05:20.972 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:20.972 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:20.972 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:20.972 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:20.972 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:20.972 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:20.972 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3036 2024-09-12T00:05:20.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.973 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:20.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.973 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:20.973 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.802567+0000", 2024-09-12T00:05:20.973 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.973 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:20.973 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.802567+0000", 2024-09-12T00:05:20.973 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:20.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.973 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:20.974 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.802570+0000", 2024-09-12T00:05:20.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3100000000000001e-06 2024-09-12T00:05:20.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.974 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:20.974 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.807884+0000", 2024-09-12T00:05:20.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053139809999999997 2024-09-12T00:05:20.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.974 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:20.974 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.807917+0000", 2024-09-12T00:05:20.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3334999999999998e-05 2024-09-12T00:05:20.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.975 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:20.975 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.807934+0000", 2024-09-12T00:05:20.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6543000000000001e-05 2024-09-12T00:05:20.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.975 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:20.975 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.808082+0000", 2024-09-12T00:05:20.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148639 2024-09-12T00:05:20.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.975 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:20.975 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.808332+0000", 2024-09-12T00:05:20.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024954699999999997 2024-09-12T00:05:20.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.976 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.976 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:20.976 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.808560+0000", 2024-09-12T00:05:20.976 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000228314 2024-09-12T00:05:20.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.976 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.976 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:20.976 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.817415+0000", 2024-09-12T00:05:20.976 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0088550780000000006 2024-09-12T00:05:20.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.976 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.976 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:20.976 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.825488+0000", 2024-09-12T00:05:20.977 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.008072638 2024-09-12T00:05:20.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.977 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:20.977 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.825531+0000", 2024-09-12T00:05:20.977 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3272000000000002e-05 2024-09-12T00:05:20.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:20.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:20.977 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:20.977 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.825566+0000", 2024-09-12T00:05:20.977 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4328000000000001e-05 2024-09-12T00:05:20.977 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.977 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.977 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.978 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:20.978 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:20.978 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:20.979 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:05:20.980 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:20.977+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:21.080 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:21.077+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:21.121 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:21.121 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:21.121 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.121 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3064 3.4 3:209c6609:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:21.122 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:21.122 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.010950092, 2024-09-12T00:05:21.122 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.01104692, 2024-09-12T00:05:21.122 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.122 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.122 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "waiting for sub ops", 2024-09-12T00:05:21.122 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:21.122 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:21.122 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:21.122 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3064 2024-09-12T00:05:21.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.122 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111980+0000", 2024-09-12T00:05:21.124 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.005e-06 2024-09-12T00:05:21.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.124 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.124 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.124 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116464+0000", 2024-09-12T00:05:21.124 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044839210000000001 2024-09-12T00:05:21.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.124 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.125 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.125 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116490+0000", 2024-09-12T00:05:21.125 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6690999999999999e-05 2024-09-12T00:05:21.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.125 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.125 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.125 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116504+0000", 2024-09-12T00:05:21.125 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4109e-05 2024-09-12T00:05:21.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.125 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.125 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.125 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116639+0000", 2024-09-12T00:05:21.125 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013427 2024-09-12T00:05:21.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.126 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.126 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.126 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116931+0000", 2024-09-12T00:05:21.126 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000292603 2024-09-12T00:05:21.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.127 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.127 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:21.127 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.117174+0000", 2024-09-12T00:05:21.127 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024240700000000001 2024-09-12T00:05:21.127 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.127 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.127 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.127 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.127 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-09-12T00:05:21.127 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 1 2024-09-12T00:05:21.127 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:21.147 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:05:21.181 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:21.180+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:21.281 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:21.284+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:21.330 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:21.330 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:21.330 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:21.330 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:21.330 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:21.345 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:05:21.390 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:21.389+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:21.483 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:21.481+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:21.491 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:21.491 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:21.491 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:21.491 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:21.491 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.492 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1646 3.25 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:05:21.492 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:21.492 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 48.413013804999999, 2024-09-12T00:05:21.492 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030091884999999999, 2024-09-12T00:05:21.492 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.492 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.492 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:21.492 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:21.492 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:21.492 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:21.492 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1646 2024-09-12T00:05:21.492 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.492 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.493 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.493 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.493 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:21.493 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.493 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.493 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.493 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.493 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:21.493 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.493 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.493 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.493 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.493 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077113+0000", 2024-09-12T00:05:21.494 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0186e-05 2024-09-12T00:05:21.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.494 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.494 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.494 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084821+0000", 2024-09-12T00:05:21.494 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077083450000000001 2024-09-12T00:05:21.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.494 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.494 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.494 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084857+0000", 2024-09-12T00:05:21.494 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6245000000000003e-05 2024-09-12T00:05:21.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.494 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.494 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.495 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084900+0000", 2024-09-12T00:05:21.495 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2369e-05 2024-09-12T00:05:21.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.495 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.495 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.495 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085058+0000", 2024-09-12T00:05:21.495 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015858199999999999 2024-09-12T00:05:21.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.495 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.495 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.495 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085307+0000", 2024-09-12T00:05:21.495 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024867999999999998 2024-09-12T00:05:21.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.496 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.496 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:21.496 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086107+0000", 2024-09-12T00:05:21.496 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00080040099999999996 2024-09-12T00:05:21.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.496 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.496 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:21.496 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.100477+0000", 2024-09-12T00:05:21.496 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014369508 2024-09-12T00:05:21.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.496 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.496 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:21.497 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107016+0000", 2024-09-12T00:05:21.497 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006538894 2024-09-12T00:05:21.497 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.497 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.497 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:21.497 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107121+0000", 2024-09-12T00:05:21.497 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105284 2024-09-12T00:05:21.497 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.497 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.497 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:21.497 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107194+0000", 2024-09-12T00:05:21.497 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3391000000000003e-05 2024-09-12T00:05:21.497 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.498 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.498 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.498 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.498 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.498 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1917 3.1 3:829295ac:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.4_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:05:21.498 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:21.498 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 46.324930324999997, 2024-09-12T00:05:21.498 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021401453000000001, 2024-09-12T00:05:21.498 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.498 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.498 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:21.498 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:21.499 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:21.499 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:21.499 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1917 2024-09-12T00:05:21.499 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.499 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.499 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.499 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.499 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:21.499 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.499 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.499 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.499 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.499 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:21.499 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.500 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.500 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.500 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.500 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165188+0000", 2024-09-12T00:05:21.500 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5409999999999999e-06 2024-09-12T00:05:21.500 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.500 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.500 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.500 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169353+0000", 2024-09-12T00:05:21.500 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00416446 2024-09-12T00:05:21.500 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.500 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.500 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.501 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169380+0000", 2024-09-12T00:05:21.501 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6919000000000001e-05 2024-09-12T00:05:21.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.501 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.501 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.501 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169392+0000", 2024-09-12T00:05:21.501 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1967000000000001e-05 2024-09-12T00:05:21.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.501 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.501 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.501 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169519+0000", 2024-09-12T00:05:21.501 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012686199999999999 2024-09-12T00:05:21.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.502 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.502 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.502 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169789+0000", 2024-09-12T00:05:21.502 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027062700000000001 2024-09-12T00:05:21.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.502 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.502 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:21.502 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.170614+0000", 2024-09-12T00:05:21.502 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00082475799999999998 2024-09-12T00:05:21.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.502 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.502 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:21.502 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.183665+0000", 2024-09-12T00:05:21.503 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013051269000000001 2024-09-12T00:05:21.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.503 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.503 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:21.503 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186367+0000", 2024-09-12T00:05:21.503 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002701789 2024-09-12T00:05:21.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.503 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.503 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:21.503 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186485+0000", 2024-09-12T00:05:21.503 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011763400000000001 2024-09-12T00:05:21.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.503 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.503 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:21.504 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186587+0000", 2024-09-12T00:05:21.504 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010262700000000001 2024-09-12T00:05:21.504 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.504 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.504 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.504 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.504 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2670 3.15 e63/23 3:aae67b25:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_165:head v 63'2, mlcod=0'0)", 2024-09-12T00:05:21.504 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.405423+0000", 2024-09-12T00:05:21.504 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.084692787000002, 2024-09-12T00:05:21.504 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016803036, 2024-09-12T00:05:21.504 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.504 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.505 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:21.505 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.505 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.505 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.505 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.405423+0000", 2024-09-12T00:05:21.505 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.505 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.505 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.505 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.405423+0000", 2024-09-12T00:05:21.505 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.505 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.506 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.506 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.405426+0000", 2024-09-12T00:05:21.506 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7669999999999999e-06 2024-09-12T00:05:21.506 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.506 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.506 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.506 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.410512+0000", 2024-09-12T00:05:21.506 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0050861370000000001 2024-09-12T00:05:21.506 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.506 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.506 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.506 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.410546+0000", 2024-09-12T00:05:21.506 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3167999999999998e-05 2024-09-12T00:05:21.506 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.507 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.507 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.507 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.410560+0000", 2024-09-12T00:05:21.507 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4703e-05 2024-09-12T00:05:21.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.507 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.507 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.507 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.410743+0000", 2024-09-12T00:05:21.507 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018231899999999999 2024-09-12T00:05:21.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.507 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.507 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.507 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.410811+0000", 2024-09-12T00:05:21.507 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8548999999999997e-05 2024-09-12T00:05:21.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.508 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.508 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:21.508 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.422127+0000", 2024-09-12T00:05:21.508 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011316109 2024-09-12T00:05:21.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.508 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.508 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:21.508 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.422226+0000", 2024-09-12T00:05:21.508 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9283999999999993e-05 2024-09-12T00:05:21.508 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.508 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.509 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.509 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.509 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2712 3.3e e63/23 3:7d3d0242:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_197:head v 63'4, mlcod=63'2)", 2024-09-12T00:05:21.509 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.732097+0000", 2024-09-12T00:05:21.509 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.758018884999998, 2024-09-12T00:05:21.509 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016924379, 2024-09-12T00:05:21.509 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.509 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.509 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:21.509 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.509 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.509 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.509 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.732097+0000", 2024-09-12T00:05:21.510 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.510 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.510 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.510 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.732097+0000", 2024-09-12T00:05:21.510 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.510 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.510 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.510 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.732100+0000", 2024-09-12T00:05:21.510 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8789999999999999e-06 2024-09-12T00:05:21.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.510 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.511 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.511 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.736405+0000", 2024-09-12T00:05:21.511 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043048139999999997 2024-09-12T00:05:21.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.511 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.511 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.511 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.736443+0000", 2024-09-12T00:05:21.511 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7968e-05 2024-09-12T00:05:21.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.511 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.511 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.511 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.736460+0000", 2024-09-12T00:05:21.511 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6878999999999999e-05 2024-09-12T00:05:21.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.512 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.512 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.736645+0000", 2024-09-12T00:05:21.512 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000185176 2024-09-12T00:05:21.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.512 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.512 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.736689+0000", 2024-09-12T00:05:21.512 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3956999999999999e-05 2024-09-12T00:05:21.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.512 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:21.512 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.748895+0000", 2024-09-12T00:05:21.513 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.01220592 2024-09-12T00:05:21.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.513 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.513 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:21.513 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749022+0000", 2024-09-12T00:05:21.513 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012678599999999999 2024-09-12T00:05:21.513 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.513 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.513 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.513 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.513 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2716 3.20 e63/23 3:042f7231:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_201:head v 63'5, mlcod=62'3)", 2024-09-12T00:05:21.513 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.769786+0000", 2024-09-12T00:05:21.514 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.720330423, 2024-09-12T00:05:21.514 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018005950999999999, 2024-09-12T00:05:21.514 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.514 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.514 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:21.514 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.514 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.514 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.514 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.769786+0000", 2024-09-12T00:05:21.514 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.514 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.514 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.514 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.769786+0000", 2024-09-12T00:05:21.515 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.515 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.515 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.515 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.769788+0000", 2024-09-12T00:05:21.515 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4729999999999999e-06 2024-09-12T00:05:21.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.515 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.515 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.515 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777256+0000", 2024-09-12T00:05:21.515 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0074680579999999996 2024-09-12T00:05:21.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.515 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.515 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.516 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777288+0000", 2024-09-12T00:05:21.516 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1322000000000003e-05 2024-09-12T00:05:21.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.516 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.516 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.516 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777303+0000", 2024-09-12T00:05:21.516 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5139e-05 2024-09-12T00:05:21.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.516 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.516 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.516 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777399+0000", 2024-09-12T00:05:21.516 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5711000000000006e-05 2024-09-12T00:05:21.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.517 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.517 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777437+0000", 2024-09-12T00:05:21.517 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8056999999999998e-05 2024-09-12T00:05:21.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.517 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:21.517 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.787696+0000", 2024-09-12T00:05:21.517 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010259127 2024-09-12T00:05:21.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.517 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:21.517 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.787792+0000", 2024-09-12T00:05:21.517 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.6063999999999994e-05 2024-09-12T00:05:21.518 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.518 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.518 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.518 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.518 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2718 3.4 3:20fe36bb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:21.518 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:21.518 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.704535647, 2024-09-12T00:05:21.518 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027867928, 2024-09-12T00:05:21.518 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.518 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.518 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:21.518 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:21.519 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:21.519 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:21.519 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2718 2024-09-12T00:05:21.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.519 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.519 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.519 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.519 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:21.519 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.519 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.519 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.519 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:21.520 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.520 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.520 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785584+0000", 2024-09-12T00:05:21.520 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.056e-06 2024-09-12T00:05:21.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.520 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.520 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792023+0000", 2024-09-12T00:05:21.520 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064398069999999996 2024-09-12T00:05:21.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.521 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.521 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792058+0000", 2024-09-12T00:05:21.521 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5018000000000003e-05 2024-09-12T00:05:21.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.521 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.521 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.521 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792078+0000", 2024-09-12T00:05:21.521 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9862000000000001e-05 2024-09-12T00:05:21.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.521 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.521 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.521 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792248+0000", 2024-09-12T00:05:21.521 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017006399999999999 2024-09-12T00:05:21.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.522 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.522 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.522 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792660+0000", 2024-09-12T00:05:21.522 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041189500000000001 2024-09-12T00:05:21.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.522 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.522 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:21.522 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793081+0000", 2024-09-12T00:05:21.522 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000420395 2024-09-12T00:05:21.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.522 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.522 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:21.522 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808422+0000", 2024-09-12T00:05:21.523 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015341626000000001 2024-09-12T00:05:21.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.523 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:21.523 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813192+0000", 2024-09-12T00:05:21.523 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047701799999999997 2024-09-12T00:05:21.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.523 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:21.523 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813339+0000", 2024-09-12T00:05:21.523 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014643800000000001 2024-09-12T00:05:21.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.523 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:21.524 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813449+0000", 2024-09-12T00:05:21.524 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010958700000000001 2024-09-12T00:05:21.524 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.524 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.524 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.524 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.524 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.524 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2719 3.1 3:83b62cc7:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:21.524 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:21.524 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.696028210000001, 2024-09-12T00:05:21.524 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021687128999999999, 2024-09-12T00:05:21.524 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.524 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.525 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:21.525 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:21.525 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:21.525 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:21.525 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2719 2024-09-12T00:05:21.525 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.525 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.525 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.525 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.525 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:21.525 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.525 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.525 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.525 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.526 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:21.526 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.526 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.526 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.526 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794091+0000", 2024-09-12T00:05:21.526 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0630000000000002e-06 2024-09-12T00:05:21.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.526 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.526 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.526 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800194+0000", 2024-09-12T00:05:21.526 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061025089999999999 2024-09-12T00:05:21.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.527 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.527 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.527 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800234+0000", 2024-09-12T00:05:21.527 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0114999999999998e-05 2024-09-12T00:05:21.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.527 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.527 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.527 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800255+0000", 2024-09-12T00:05:21.527 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1548000000000001e-05 2024-09-12T00:05:21.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.527 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.527 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.527 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800400+0000", 2024-09-12T00:05:21.527 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014438499999999999 2024-09-12T00:05:21.528 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.528 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.528 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.528 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800654+0000", 2024-09-12T00:05:21.528 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025430500000000003 2024-09-12T00:05:21.528 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.528 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.528 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:21.528 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800908+0000", 2024-09-12T00:05:21.528 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025422800000000001 2024-09-12T00:05:21.528 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.528 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.528 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:21.529 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.814197+0000", 2024-09-12T00:05:21.529 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013289216 2024-09-12T00:05:21.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.529 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.529 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:21.529 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815578+0000", 2024-09-12T00:05:21.529 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00138079 2024-09-12T00:05:21.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.529 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.529 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:21.529 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815704+0000", 2024-09-12T00:05:21.529 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012551500000000001 2024-09-12T00:05:21.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.530 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.530 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:21.530 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815775+0000", 2024-09-12T00:05:21.530 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1454999999999999e-05 2024-09-12T00:05:21.530 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.530 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.530 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.530 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.530 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.530 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2736 3.25 3:a750a681:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:21.530 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:21.530 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.514763285000001, 2024-09-12T00:05:21.530 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025701234999999999, 2024-09-12T00:05:21.531 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.531 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.531 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:21.531 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:21.531 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:21.531 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:21.531 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2736 2024-09-12T00:05:21.531 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.531 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.531 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.531 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.531 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:21.531 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.531 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.532 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.532 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.532 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:21.532 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.532 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.532 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.532 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.532 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975357+0000", 2024-09-12T00:05:21.532 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9389999999999999e-06 2024-09-12T00:05:21.532 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.532 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.532 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.532 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979365+0000", 2024-09-12T00:05:21.532 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040076679999999998 2024-09-12T00:05:21.533 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.533 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.533 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.533 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979402+0000", 2024-09-12T00:05:21.533 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7557e-05 2024-09-12T00:05:21.533 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.533 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.533 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.533 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979419+0000", 2024-09-12T00:05:21.533 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7203000000000001e-05 2024-09-12T00:05:21.533 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.533 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.534 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.534 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979543+0000", 2024-09-12T00:05:21.534 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000123423 2024-09-12T00:05:21.534 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.534 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.534 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.534 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979784+0000", 2024-09-12T00:05:21.534 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024097800000000001 2024-09-12T00:05:21.534 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.534 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.534 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:21.534 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980013+0000", 2024-09-12T00:05:21.534 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022881999999999999 2024-09-12T00:05:21.535 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.535 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.535 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:21.535 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.999860+0000", 2024-09-12T00:05:21.535 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019847908000000001 2024-09-12T00:05:21.535 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.535 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.535 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:21.535 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000741+0000", 2024-09-12T00:05:21.535 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00088041499999999995 2024-09-12T00:05:21.535 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.535 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.535 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:21.535 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000915+0000", 2024-09-12T00:05:21.536 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017460300000000001 2024-09-12T00:05:21.536 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.536 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.536 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:21.536 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.001054+0000", 2024-09-12T00:05:21.536 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013872099999999999 2024-09-12T00:05:21.536 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.536 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.536 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.536 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.536 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.536 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2737 3.25 3:a794c975:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:21.536 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:21.537 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.504750479000002, 2024-09-12T00:05:21.537 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022562862999999999, 2024-09-12T00:05:21.537 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.537 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.537 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:21.537 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:21.537 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:21.537 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:21.537 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2737 2024-09-12T00:05:21.537 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.537 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.537 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.537 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.538 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:21.538 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.538 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.538 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.538 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.538 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:21.538 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.538 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.538 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.538 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.538 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985368+0000", 2024-09-12T00:05:21.538 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.323e-06 2024-09-12T00:05:21.538 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.538 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.539 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.539 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990209+0000", 2024-09-12T00:05:21.539 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004840446 2024-09-12T00:05:21.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.539 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.539 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.539 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990255+0000", 2024-09-12T00:05:21.539 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6526999999999997e-05 2024-09-12T00:05:21.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.539 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.539 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.539 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990283+0000", 2024-09-12T00:05:21.539 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7631e-05 2024-09-12T00:05:21.540 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.540 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.540 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.540 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990445+0000", 2024-09-12T00:05:21.540 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016238400000000001 2024-09-12T00:05:21.540 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.540 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.540 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.540 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990732+0000", 2024-09-12T00:05:21.540 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028698299999999999 2024-09-12T00:05:21.540 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.540 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.540 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:21.540 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.991001+0000", 2024-09-12T00:05:21.541 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026869099999999999 2024-09-12T00:05:21.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.541 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.541 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:21.541 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007077+0000", 2024-09-12T00:05:21.541 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016076686999999999 2024-09-12T00:05:21.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.541 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.541 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:21.541 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007761+0000", 2024-09-12T00:05:21.541 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00068366399999999995 2024-09-12T00:05:21.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.541 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.542 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:21.542 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007860+0000", 2024-09-12T00:05:21.542 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8513999999999999e-05 2024-09-12T00:05:21.542 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.542 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.542 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:21.542 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007929+0000", 2024-09-12T00:05:21.542 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9012999999999998e-05 2024-09-12T00:05:21.542 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.542 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.542 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.542 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.542 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.543 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2740 3.33 3:cd810b27:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:21.543 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.016302+0000", 2024-09-12T00:05:21.543 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.47381412, 2024-09-12T00:05:21.543 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017338635000000002, 2024-09-12T00:05:21.543 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.543 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.543 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:21.543 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:21.543 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:21.543 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:21.543 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2740 2024-09-12T00:05:21.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.543 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.543 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.544 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.544 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.016302+0000", 2024-09-12T00:05:21.544 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.544 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.544 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.544 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.544 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.016302+0000", 2024-09-12T00:05:21.544 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.544 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.544 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.544 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.544 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.016306+0000", 2024-09-12T00:05:21.544 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6169999999999998e-06 2024-09-12T00:05:21.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.545 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.545 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.545 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.020590+0000", 2024-09-12T00:05:21.545 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042843320000000001 2024-09-12T00:05:21.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.545 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.545 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.545 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.020633+0000", 2024-09-12T00:05:21.545 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3124999999999998e-05 2024-09-12T00:05:21.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.545 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.545 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.545 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.020656+0000", 2024-09-12T00:05:21.546 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2738000000000002e-05 2024-09-12T00:05:21.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.546 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.546 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.546 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.020838+0000", 2024-09-12T00:05:21.546 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000181826 2024-09-12T00:05:21.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.546 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.546 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.546 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.021137+0000", 2024-09-12T00:05:21.546 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00029887199999999999 2024-09-12T00:05:21.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.546 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.546 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:21.546 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.021365+0000", 2024-09-12T00:05:21.547 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022853700000000001 2024-09-12T00:05:21.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.547 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.547 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:21.547 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.030957+0000", 2024-09-12T00:05:21.547 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095913879999999993 2024-09-12T00:05:21.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.547 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.547 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:21.547 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.033328+0000", 2024-09-12T00:05:21.547 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0023717450000000002 2024-09-12T00:05:21.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.547 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.548 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:21.548 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.033509+0000", 2024-09-12T00:05:21.548 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018055999999999999 2024-09-12T00:05:21.548 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.548 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.548 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:21.548 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.033641+0000", 2024-09-12T00:05:21.548 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013189500000000001 2024-09-12T00:05:21.548 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.548 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.548 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.548 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.549 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.549 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2750 3.1 3:834b8715:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:21.549 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.123528+0000", 2024-09-12T00:05:21.549 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.366588268000001, 2024-09-12T00:05:21.549 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017652673000000001, 2024-09-12T00:05:21.549 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.549 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.549 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:21.549 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:21.549 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:21.549 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:21.549 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2750 2024-09-12T00:05:21.549 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.549 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.550 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.550 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.550 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.123528+0000", 2024-09-12T00:05:21.550 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.550 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.550 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.550 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.550 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.123528+0000", 2024-09-12T00:05:21.550 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.550 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.550 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.550 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.550 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.123531+0000", 2024-09-12T00:05:21.551 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9160000000000001e-06 2024-09-12T00:05:21.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.551 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.551 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.127554+0000", 2024-09-12T00:05:21.551 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040235210000000004 2024-09-12T00:05:21.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.551 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.551 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.127587+0000", 2024-09-12T00:05:21.551 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2777999999999997e-05 2024-09-12T00:05:21.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.552 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.552 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.127604+0000", 2024-09-12T00:05:21.552 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6492999999999999e-05 2024-09-12T00:05:21.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.552 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.552 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.127766+0000", 2024-09-12T00:05:21.552 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016200399999999999 2024-09-12T00:05:21.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.552 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.552 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.128157+0000", 2024-09-12T00:05:21.553 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039180399999999999 2024-09-12T00:05:21.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.553 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:21.553 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.128596+0000", 2024-09-12T00:05:21.553 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00043888999999999999 2024-09-12T00:05:21.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.553 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:21.553 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.139321+0000", 2024-09-12T00:05:21.553 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010724466 2024-09-12T00:05:21.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.554 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:21.554 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.140855+0000", 2024-09-12T00:05:21.554 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00153382 2024-09-12T00:05:21.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.554 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.554 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:21.554 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.141054+0000", 2024-09-12T00:05:21.554 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00019907799999999999 2024-09-12T00:05:21.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.554 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.554 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:21.554 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.141181+0000", 2024-09-12T00:05:21.554 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012690299999999999 2024-09-12T00:05:21.554 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.555 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.555 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.555 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.555 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.555 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2751 3.4 3:20d2ffb1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:21.555 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.134356+0000", 2024-09-12T00:05:21.555 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.355760695999997, 2024-09-12T00:05:21.555 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020400522000000001, 2024-09-12T00:05:21.555 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.555 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.555 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:21.555 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:21.555 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:21.555 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:21.556 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2751 2024-09-12T00:05:21.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.556 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.556 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.556 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.556 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.134356+0000", 2024-09-12T00:05:21.556 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.556 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.556 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.556 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.134356+0000", 2024-09-12T00:05:21.556 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.557 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.557 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.134359+0000", 2024-09-12T00:05:21.557 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9900000000000002e-06 2024-09-12T00:05:21.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.557 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.557 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138490+0000", 2024-09-12T00:05:21.557 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041315609999999997 2024-09-12T00:05:21.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.557 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.557 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138524+0000", 2024-09-12T00:05:21.558 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3868000000000002e-05 2024-09-12T00:05:21.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.558 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.558 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.558 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138544+0000", 2024-09-12T00:05:21.558 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9539e-05 2024-09-12T00:05:21.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.558 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.558 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.558 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138697+0000", 2024-09-12T00:05:21.558 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015332400000000001 2024-09-12T00:05:21.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.558 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.559 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.559 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138931+0000", 2024-09-12T00:05:21.559 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023418700000000001 2024-09-12T00:05:21.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.559 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.559 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:21.559 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.139162+0000", 2024-09-12T00:05:21.559 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000230943 2024-09-12T00:05:21.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.559 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.559 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:21.559 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.149454+0000", 2024-09-12T00:05:21.559 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010291560999999999 2024-09-12T00:05:21.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.560 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.560 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:21.560 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.153905+0000", 2024-09-12T00:05:21.560 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004451666 2024-09-12T00:05:21.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.560 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.560 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:21.560 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154405+0000", 2024-09-12T00:05:21.560 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00049978100000000003 2024-09-12T00:05:21.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.560 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.560 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:21.560 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154756+0000", 2024-09-12T00:05:21.561 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000351102 2024-09-12T00:05:21.561 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.561 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.561 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.561 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.561 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2755 3.25 3:a666dbcf:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:21.561 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.181692+0000", 2024-09-12T00:05:21.561 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.308424281000001, 2024-09-12T00:05:21.561 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020464659, 2024-09-12T00:05:21.561 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.561 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.562 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:21.562 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:21.562 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:21.562 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:21.562 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2755 2024-09-12T00:05:21.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.562 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.562 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.562 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.181692+0000", 2024-09-12T00:05:21.562 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.562 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.563 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.181692+0000", 2024-09-12T00:05:21.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.563 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.563 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.563 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.181695+0000", 2024-09-12T00:05:21.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0800000000000002e-06 2024-09-12T00:05:21.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.563 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.563 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.563 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185668+0000", 2024-09-12T00:05:21.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039727970000000001 2024-09-12T00:05:21.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.564 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.564 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185699+0000", 2024-09-12T00:05:21.564 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1424999999999998e-05 2024-09-12T00:05:21.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.564 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.564 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185722+0000", 2024-09-12T00:05:21.564 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2972e-05 2024-09-12T00:05:21.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.564 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.565 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185860+0000", 2024-09-12T00:05:21.565 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000138016 2024-09-12T00:05:21.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.565 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.565 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.565 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.186096+0000", 2024-09-12T00:05:21.565 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023611899999999999 2024-09-12T00:05:21.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.565 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.565 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:21.565 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.186318+0000", 2024-09-12T00:05:21.565 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000221177 2024-09-12T00:05:21.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.566 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:21.566 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.199301+0000", 2024-09-12T00:05:21.566 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012983949999999999 2024-09-12T00:05:21.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.566 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:21.566 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.201991+0000", 2024-09-12T00:05:21.566 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026896889999999999 2024-09-12T00:05:21.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.566 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:21.566 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.202083+0000", 2024-09-12T00:05:21.567 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1598e-05 2024-09-12T00:05:21.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.567 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.567 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:21.567 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.202157+0000", 2024-09-12T00:05:21.567 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3836000000000003e-05 2024-09-12T00:05:21.567 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.567 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.567 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.567 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.567 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2962 3.18 e75/23 3:1b55431a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_1:head v 75'6, mlcod=63'4)", 2024-09-12T00:05:21.567 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:19.990870+0000", 2024-09-12T00:05:21.567 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.4992462950000001, 2024-09-12T00:05:21.568 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018164309999999999, 2024-09-12T00:05:21.568 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.568 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.568 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:21.568 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.568 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.568 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990870+0000", 2024-09-12T00:05:21.568 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.568 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.568 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990870+0000", 2024-09-12T00:05:21.569 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.569 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.569 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.569 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990873+0000", 2024-09-12T00:05:21.569 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3799999999999998e-06 2024-09-12T00:05:21.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.569 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.569 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.569 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995189+0000", 2024-09-12T00:05:21.569 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004315859 2024-09-12T00:05:21.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.569 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.570 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995232+0000", 2024-09-12T00:05:21.570 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2636000000000003e-05 2024-09-12T00:05:21.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.570 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995249+0000", 2024-09-12T00:05:21.570 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7563000000000001e-05 2024-09-12T00:05:21.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.570 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995357+0000", 2024-09-12T00:05:21.570 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010737 2024-09-12T00:05:21.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.571 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995386+0000", 2024-09-12T00:05:21.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8895999999999999e-05 2024-09-12T00:05:21.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.571 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:21.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.008964+0000", 2024-09-12T00:05:21.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013578209000000001 2024-09-12T00:05:21.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.571 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:21.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.009034+0000", 2024-09-12T00:05:21.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.0396999999999997e-05 2024-09-12T00:05:21.572 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.572 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.572 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.572 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.572 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2964 3.24 3:26c83ec0:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:21.572 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:21.572 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.484701483, 2024-09-12T00:05:21.572 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028979713000000001, 2024-09-12T00:05:21.572 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.572 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.572 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:21.573 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:21.573 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:21.573 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:21.573 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2964 2024-09-12T00:05:21.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.573 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.573 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.573 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:21.573 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.573 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.574 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:21.574 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.574 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.574 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005417+0000", 2024-09-12T00:05:21.574 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2450000000000001e-06 2024-09-12T00:05:21.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.574 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.574 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010885+0000", 2024-09-12T00:05:21.574 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054684809999999999 2024-09-12T00:05:21.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.575 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.575 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.575 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010901+0000", 2024-09-12T00:05:21.575 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5097e-05 2024-09-12T00:05:21.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.575 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.575 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.575 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010908+0000", 2024-09-12T00:05:21.575 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7419999999999997e-06 2024-09-12T00:05:21.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.575 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.575 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.575 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010968+0000", 2024-09-12T00:05:21.576 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.9837000000000003e-05 2024-09-12T00:05:21.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.576 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.576 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011082+0000", 2024-09-12T00:05:21.576 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011357399999999999 2024-09-12T00:05:21.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.576 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:21.576 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011174+0000", 2024-09-12T00:05:21.576 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2703999999999999e-05 2024-09-12T00:05:21.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.577 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:21.577 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.021639+0000", 2024-09-12T00:05:21.577 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010464641 2024-09-12T00:05:21.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.577 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.577 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:21.577 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034210+0000", 2024-09-12T00:05:21.577 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012570463 2024-09-12T00:05:21.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.577 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.577 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:21.577 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034300+0000", 2024-09-12T00:05:21.578 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0691000000000003e-05 2024-09-12T00:05:21.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.578 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:21.578 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034394+0000", 2024-09-12T00:05:21.578 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4238000000000001e-05 2024-09-12T00:05:21.578 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.578 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.578 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.578 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2968 3.25 3:a7d7195d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:21.578 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.046591+0000", 2024-09-12T00:05:21.579 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.4435253800000001, 2024-09-12T00:05:21.579 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019137155999999999, 2024-09-12T00:05:21.579 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.579 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.579 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:21.579 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:21.579 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:21.579 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:21.579 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2968 2024-09-12T00:05:21.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.579 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.579 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.579 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.580 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.046591+0000", 2024-09-12T00:05:21.580 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.580 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.580 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.580 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.046591+0000", 2024-09-12T00:05:21.580 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.580 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.580 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.580 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.046594+0000", 2024-09-12T00:05:21.580 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0759999999999999e-06 2024-09-12T00:05:21.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.581 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.581 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.581 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.050723+0000", 2024-09-12T00:05:21.581 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041287700000000004 2024-09-12T00:05:21.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.581 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.581 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.581 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.050749+0000", 2024-09-12T00:05:21.581 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5958000000000001e-05 2024-09-12T00:05:21.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.581 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.581 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.581 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.050760+0000", 2024-09-12T00:05:21.582 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1367e-05 2024-09-12T00:05:21.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.582 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.582 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.050855+0000", 2024-09-12T00:05:21.582 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5043999999999993e-05 2024-09-12T00:05:21.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.582 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.582 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.051009+0000", 2024-09-12T00:05:21.582 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015416799999999999 2024-09-12T00:05:21.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.583 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:21.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.051169+0000", 2024-09-12T00:05:21.583 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000159858 2024-09-12T00:05:21.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.583 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.583 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:21.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.057181+0000", 2024-09-12T00:05:21.583 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006011438 2024-09-12T00:05:21.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.583 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.583 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:21.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.065613+0000", 2024-09-12T00:05:21.583 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0084321569999999992 2024-09-12T00:05:21.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.584 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.584 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:21.584 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.065670+0000", 2024-09-12T00:05:21.584 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7089000000000002e-05 2024-09-12T00:05:21.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.584 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.584 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:21.584 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.065728+0000", 2024-09-12T00:05:21.584 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8230999999999999e-05 2024-09-12T00:05:21.584 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.584 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.584 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.585 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.585 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2970 3.7 e75/23 3:e36c9f9c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_9:head v 75'7, mlcod=63'5)", 2024-09-12T00:05:21.585 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.071718+0000", 2024-09-12T00:05:21.585 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.4183981669999999, 2024-09-12T00:05:21.585 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017819432, 2024-09-12T00:05:21.585 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.585 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.585 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:21.585 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.585 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.585 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.585 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.071718+0000", 2024-09-12T00:05:21.585 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.586 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.586 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.586 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.586 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.071718+0000", 2024-09-12T00:05:21.586 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.586 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.586 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.586 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.586 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.071720+0000", 2024-09-12T00:05:21.586 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.708e-06 2024-09-12T00:05:21.586 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.586 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.586 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.587 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.074522+0000", 2024-09-12T00:05:21.587 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002802321 2024-09-12T00:05:21.587 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.587 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.587 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.587 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.074562+0000", 2024-09-12T00:05:21.587 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0076000000000001e-05 2024-09-12T00:05:21.587 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.587 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.587 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.587 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.074581+0000", 2024-09-12T00:05:21.587 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8488999999999999e-05 2024-09-12T00:05:21.587 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.587 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.588 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.588 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.074688+0000", 2024-09-12T00:05:21.588 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000106866 2024-09-12T00:05:21.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.588 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.588 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.588 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.074715+0000", 2024-09-12T00:05:21.588 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7331999999999999e-05 2024-09-12T00:05:21.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.588 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.588 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:21.588 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.089469+0000", 2024-09-12T00:05:21.588 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014753992 2024-09-12T00:05:21.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.589 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.589 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:21.589 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.089538+0000", 2024-09-12T00:05:21.589 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8647999999999997e-05 2024-09-12T00:05:21.589 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.589 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.589 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.589 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.589 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3050 3.b e75/23 3:d26f7141:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_89:head v 75'6, mlcod=62'4)", 2024-09-12T00:05:21.589 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.962337+0000", 2024-09-12T00:05:21.589 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.52777909099999998, 2024-09-12T00:05:21.590 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016998205999999998, 2024-09-12T00:05:21.590 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.590 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.590 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:21.590 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.590 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.590 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.590 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.962337+0000", 2024-09-12T00:05:21.590 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.590 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.590 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.590 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.962337+0000", 2024-09-12T00:05:21.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.591 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.591 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.962344+0000", 2024-09-12T00:05:21.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5370000000000003e-06 2024-09-12T00:05:21.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.591 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.591 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.966937+0000", 2024-09-12T00:05:21.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045928610000000002 2024-09-12T00:05:21.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.591 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.592 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.966970+0000", 2024-09-12T00:05:21.592 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3543000000000001e-05 2024-09-12T00:05:21.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.592 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.592 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.592 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.966985+0000", 2024-09-12T00:05:21.592 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4463e-05 2024-09-12T00:05:21.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.592 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.592 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.592 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.967118+0000", 2024-09-12T00:05:21.592 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133213 2024-09-12T00:05:21.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.593 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.593 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.967162+0000", 2024-09-12T00:05:21.593 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4311999999999999e-05 2024-09-12T00:05:21.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.593 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:21.593 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979247+0000", 2024-09-12T00:05:21.593 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012085261999999999 2024-09-12T00:05:21.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.593 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:21.594 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979335+0000", 2024-09-12T00:05:21.594 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8015000000000003e-05 2024-09-12T00:05:21.594 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.594 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.594 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.594 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.594 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3052 3.32 3:4d6db9ea:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:21.594 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:21.594 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.51045485700000004, 2024-09-12T00:05:21.594 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028091277000000001, 2024-09-12T00:05:21.594 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.594 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.595 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:21.595 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:21.595 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:21.595 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:21.595 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3052 2024-09-12T00:05:21.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.595 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.595 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.595 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:21.595 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.596 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.596 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:21.596 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.596 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.596 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.596 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979664+0000", 2024-09-12T00:05:21.596 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:05:21.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.596 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.596 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.596 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986918+0000", 2024-09-12T00:05:21.596 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0072537110000000004 2024-09-12T00:05:21.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.597 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.597 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.597 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986956+0000", 2024-09-12T00:05:21.597 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8111999999999997e-05 2024-09-12T00:05:21.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.597 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.597 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.597 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986975+0000", 2024-09-12T00:05:21.597 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9245999999999998e-05 2024-09-12T00:05:21.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.597 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.598 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.598 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987159+0000", 2024-09-12T00:05:21.598 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000183828 2024-09-12T00:05:21.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.598 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.598 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.598 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987552+0000", 2024-09-12T00:05:21.598 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039349699999999998 2024-09-12T00:05:21.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.598 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.598 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:21.598 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987943+0000", 2024-09-12T00:05:21.598 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000390579 2024-09-12T00:05:21.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.599 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.599 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:21.599 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.999384+0000", 2024-09-12T00:05:21.599 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011441563 2024-09-12T00:05:21.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.599 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.599 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:21.599 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007634+0000", 2024-09-12T00:05:21.599 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082496240000000005 2024-09-12T00:05:21.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.599 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.599 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:21.599 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007699+0000", 2024-09-12T00:05:21.600 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5089e-05 2024-09-12T00:05:21.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.600 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.600 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:21.600 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007753+0000", 2024-09-12T00:05:21.600 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3588000000000003e-05 2024-09-12T00:05:21.600 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.600 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.600 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.600 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.600 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3064 3.4 3:209c6609:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:21.600 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:21.601 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.378139579, 2024-09-12T00:05:21.601 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024628305999999999, 2024-09-12T00:05:21.601 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.601 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.601 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:21.601 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:21.601 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:21.601 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:21.601 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3064 2024-09-12T00:05:21.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.601 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.601 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.601 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.601 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:21.602 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.602 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.602 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.602 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:21.602 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.602 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.602 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.602 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111980+0000", 2024-09-12T00:05:21.602 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.005e-06 2024-09-12T00:05:21.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.602 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.603 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.603 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116464+0000", 2024-09-12T00:05:21.603 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044839210000000001 2024-09-12T00:05:21.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.603 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.603 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.603 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116490+0000", 2024-09-12T00:05:21.603 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6690999999999999e-05 2024-09-12T00:05:21.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.603 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.603 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.603 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116504+0000", 2024-09-12T00:05:21.603 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4109e-05 2024-09-12T00:05:21.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.603 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116639+0000", 2024-09-12T00:05:21.604 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013427 2024-09-12T00:05:21.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116931+0000", 2024-09-12T00:05:21.604 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000292603 2024-09-12T00:05:21.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:21.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.117174+0000", 2024-09-12T00:05:21.604 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024240700000000001 2024-09-12T00:05:21.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:21.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126449+0000", 2024-09-12T00:05:21.605 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0092748699999999993 2024-09-12T00:05:21.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:21.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136438+0000", 2024-09-12T00:05:21.605 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099898539999999994 2024-09-12T00:05:21.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:21.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136532+0000", 2024-09-12T00:05:21.606 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3898000000000001e-05 2024-09-12T00:05:21.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.606 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.606 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:21.606 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136605+0000", 2024-09-12T00:05:21.606 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2677999999999998e-05 2024-09-12T00:05:21.606 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.606 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.606 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.606 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.606 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.606 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:21.608 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T00:05:21.609 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:05:21.609 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:21.605+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:21.708 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:21.708+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:21.803 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:21.803 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:21.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.803 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3115 3.2e 3:75803fec:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:21.803 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:21.804 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.016580859, 2024-09-12T00:05:21.804 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016626403000000001, 2024-09-12T00:05:21.804 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:21.804 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:21.804 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "waiting for sub ops", 2024-09-12T00:05:21.804 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:21.804 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:21.804 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:21.804 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3115 2024-09-12T00:05:21.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.804 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:21.804 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.804 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:21.804 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:21.804 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.805 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:21.805 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:21.805 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:21.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.805 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:21.805 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788700+0000", 2024-09-12T00:05:21.805 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.614e-06 2024-09-12T00:05:21.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.806 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:21.806 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793576+0000", 2024-09-12T00:05:21.806 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048760920000000003 2024-09-12T00:05:21.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.806 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.806 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:21.806 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793610+0000", 2024-09-12T00:05:21.806 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4184999999999999e-05 2024-09-12T00:05:21.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.806 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.806 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:21.806 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793633+0000", 2024-09-12T00:05:21.806 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2551000000000001e-05 2024-09-12T00:05:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793750+0000", 2024-09-12T00:05:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117057 2024-09-12T00:05:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793975+0000", 2024-09-12T00:05:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022493099999999999 2024-09-12T00:05:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:21.808 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.794178+0000", 2024-09-12T00:05:21.808 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000202726 2024-09-12T00:05:21.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:21.808 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:21.808 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:21.808 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.803725+0000", 2024-09-12T00:05:21.808 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095470599999999996 2024-09-12T00:05:21.808 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.808 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:21.808 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.808 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:21.808 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-09-12T00:05:21.808 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 1 2024-09-12T00:05:21.809 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:21.810 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:21.805+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:21.823 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:05:21.911 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:21.912+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:22.007 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:05:22.012 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:22.009+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:22.017 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:22.018 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:22.018 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:22.018 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:22.018 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:22.038 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:05:22.131 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:22.129+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:22.213 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:22.212+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:22.217 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:22.218 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:22.228 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:22.228 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:22.228 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:22.228 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:22.228 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.228 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:1646 3.25 e58/23 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head v 58'1, mlcod=0'0)", 2024-09-12T00:05:22.228 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:22.228 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 49.139594977000002, 2024-09-12T00:05:22.229 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020301987000000001, 2024-09-12T00:05:22.229 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:22.229 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:22.229 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:22.229 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:22.229 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.229 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:22.229 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:22.229 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.229 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.230 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:22.230 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:22.230 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.230 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.230 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:22.230 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086308+0000", 2024-09-12T00:05:22.230 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.95e-06 2024-09-12T00:05:22.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.230 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.230 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:22.231 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091174+0000", 2024-09-12T00:05:22.231 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048660559999999997 2024-09-12T00:05:22.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:22.231 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091218+0000", 2024-09-12T00:05:22.231 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4678999999999997e-05 2024-09-12T00:05:22.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:22.231 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091238+0000", 2024-09-12T00:05:22.231 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9839000000000001e-05 2024-09-12T00:05:22.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.232 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:22.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091396+0000", 2024-09-12T00:05:22.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000157396 2024-09-12T00:05:22.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.232 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:22.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091451+0000", 2024-09-12T00:05:22.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5547999999999997e-05 2024-09-12T00:05:22.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.232 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:22.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106474+0000", 2024-09-12T00:05:22.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015023287 2024-09-12T00:05:22.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.233 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.233 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:22.233 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106608+0000", 2024-09-12T00:05:22.233 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133232 2024-09-12T00:05:22.233 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.233 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:22.233 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.233 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.233 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2667 3.8 e63/23 3:1177e826:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_162:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:22.233 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.378028+0000", 2024-09-12T00:05:22.233 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.847873104000001, 2024-09-12T00:05:22.234 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018606185000000001, 2024-09-12T00:05:22.234 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:22.234 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:22.234 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:22.234 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:22.234 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.234 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:22.234 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.378028+0000", 2024-09-12T00:05:22.234 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.234 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.234 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:22.234 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.378028+0000", 2024-09-12T00:05:22.234 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.235 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.235 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:22.235 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.378031+0000", 2024-09-12T00:05:22.235 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9330000000000001e-06 2024-09-12T00:05:22.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.235 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.235 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:22.235 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383422+0000", 2024-09-12T00:05:22.235 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005391163 2024-09-12T00:05:22.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.235 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.235 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:22.235 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383455+0000", 2024-09-12T00:05:22.236 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3640999999999999e-05 2024-09-12T00:05:22.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.236 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.236 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:22.236 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383472+0000", 2024-09-12T00:05:22.236 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7005999999999999e-05 2024-09-12T00:05:22.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.236 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.236 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:22.236 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383626+0000", 2024-09-12T00:05:22.236 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015317 2024-09-12T00:05:22.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.236 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.236 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:22.237 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383691+0000", 2024-09-12T00:05:22.237 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5740000000000004e-05 2024-09-12T00:05:22.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.237 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.237 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:22.237 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396505+0000", 2024-09-12T00:05:22.237 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012813702999999999 2024-09-12T00:05:22.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.237 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.237 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:22.237 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396634+0000", 2024-09-12T00:05:22.237 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012882900000000001 2024-09-12T00:05:22.237 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.237 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:22.238 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.238 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.238 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2723 3.21 3:86535907:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:22.238 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:22.238 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.393747509999997, 2024-09-12T00:05:22.238 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021210407000000001, 2024-09-12T00:05:22.238 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:22.238 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:22.238 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:22.238 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:22.238 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:22.238 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:22.239 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2723 2024-09-12T00:05:22.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.239 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:22.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.239 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:22.239 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:22.239 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.239 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:22.239 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:22.239 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.240 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:22.240 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832157+0000", 2024-09-12T00:05:22.240 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3270000000000001e-06 2024-09-12T00:05:22.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.240 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.240 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:22.240 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837403+0000", 2024-09-12T00:05:22.240 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005246784 2024-09-12T00:05:22.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.240 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.240 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:22.240 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837439+0000", 2024-09-12T00:05:22.240 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5848e-05 2024-09-12T00:05:22.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.241 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.241 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:22.241 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837459+0000", 2024-09-12T00:05:22.241 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9585e-05 2024-09-12T00:05:22.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.241 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.241 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:22.241 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837574+0000", 2024-09-12T00:05:22.241 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000114917 2024-09-12T00:05:22.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.241 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.241 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:22.241 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837803+0000", 2024-09-12T00:05:22.241 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022967699999999999 2024-09-12T00:05:22.242 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.242 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.242 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:22.242 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838174+0000", 2024-09-12T00:05:22.242 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037083899999999998 2024-09-12T00:05:22.242 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.242 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.242 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:22.242 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848447+0000", 2024-09-12T00:05:22.242 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010272439 2024-09-12T00:05:22.242 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.242 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.242 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:22.243 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853191+0000", 2024-09-12T00:05:22.243 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047441109999999996 2024-09-12T00:05:22.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.243 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.243 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:22.243 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853292+0000", 2024-09-12T00:05:22.243 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000101474 2024-09-12T00:05:22.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.243 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.243 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:22.243 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853364+0000", 2024-09-12T00:05:22.243 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1406e-05 2024-09-12T00:05:22.243 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.244 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:22.244 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.244 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.244 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2729 3.0 e63/23 3:01c0e0c9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_214:head v 63'6, mlcod=63'4)", 2024-09-12T00:05:22.244 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.902446+0000", 2024-09-12T00:05:22.244 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.323455166000002, 2024-09-12T00:05:22.244 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019099029, 2024-09-12T00:05:22.244 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:22.244 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:22.244 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:22.244 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:22.244 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.244 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:22.245 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902446+0000", 2024-09-12T00:05:22.245 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.245 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.245 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:22.245 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902446+0000", 2024-09-12T00:05:22.245 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.245 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.245 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:22.245 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902448+0000", 2024-09-12T00:05:22.245 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.503e-06 2024-09-12T00:05:22.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.246 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.246 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:22.246 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906706+0000", 2024-09-12T00:05:22.246 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042580500000000002 2024-09-12T00:05:22.246 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.246 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.246 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:22.246 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906743+0000", 2024-09-12T00:05:22.246 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6637999999999997e-05 2024-09-12T00:05:22.246 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.246 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.246 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:22.246 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906760+0000", 2024-09-12T00:05:22.246 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6779e-05 2024-09-12T00:05:22.247 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.247 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.247 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:22.247 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906891+0000", 2024-09-12T00:05:22.247 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013193499999999999 2024-09-12T00:05:22.247 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.247 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.247 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:22.247 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906932+0000", 2024-09-12T00:05:22.247 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0980999999999999e-05 2024-09-12T00:05:22.247 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.247 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.247 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:22.247 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.921375+0000", 2024-09-12T00:05:22.248 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014442119999999999 2024-09-12T00:05:22.248 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.248 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.248 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:22.248 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.921545+0000", 2024-09-12T00:05:22.248 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017002299999999999 2024-09-12T00:05:22.248 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.248 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:22.248 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.248 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.248 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.248 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2731 3.c e63/23 3:33671167:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_216:head v 63'5, mlcod=62'3)", 2024-09-12T00:05:22.248 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.919428+0000", 2024-09-12T00:05:22.248 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.306472951000003, 2024-09-12T00:05:22.249 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018148885999999999, 2024-09-12T00:05:22.249 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:22.249 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:22.249 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:22.249 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:22.249 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.249 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:22.249 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.919428+0000", 2024-09-12T00:05:22.249 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.249 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.249 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.249 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:22.249 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.919428+0000", 2024-09-12T00:05:22.249 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.250 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.250 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.250 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:22.250 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.919431+0000", 2024-09-12T00:05:22.250 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9569999999999998e-06 2024-09-12T00:05:22.250 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.250 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.250 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:22.250 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.925930+0000", 2024-09-12T00:05:22.250 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064991060000000002 2024-09-12T00:05:22.250 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.250 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.250 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:22.250 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.925962+0000", 2024-09-12T00:05:22.251 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2128000000000001e-05 2024-09-12T00:05:22.251 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.251 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.251 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:22.251 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.925985+0000", 2024-09-12T00:05:22.251 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2895999999999999e-05 2024-09-12T00:05:22.251 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.251 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.251 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:22.251 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.926124+0000", 2024-09-12T00:05:22.251 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000139121 2024-09-12T00:05:22.251 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.251 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.251 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:22.252 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.926163+0000", 2024-09-12T00:05:22.252 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9480999999999997e-05 2024-09-12T00:05:22.252 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.252 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.252 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:22.252 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.937446+0000", 2024-09-12T00:05:22.252 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011282927999999999 2024-09-12T00:05:22.252 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.252 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.252 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:22.252 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.937577+0000", 2024-09-12T00:05:22.252 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000130269 2024-09-12T00:05:22.252 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.252 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:22.253 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.253 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.253 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.253 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2736 3.25 e63/23 3:a750a681:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_221:head v 63'5, mlcod=62'3)", 2024-09-12T00:05:22.253 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.980248+0000", 2024-09-12T00:05:22.253 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.245652640000003, 2024-09-12T00:05:22.253 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020132552000000001, 2024-09-12T00:05:22.253 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:22.253 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:22.253 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:22.253 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:22.253 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.253 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:22.254 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980248+0000", 2024-09-12T00:05:22.254 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.254 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.254 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:22.254 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980248+0000", 2024-09-12T00:05:22.254 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.254 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.254 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:22.254 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980251+0000", 2024-09-12T00:05:22.254 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7329999999999999e-06 2024-09-12T00:05:22.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.254 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.255 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:22.255 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.982917+0000", 2024-09-12T00:05:22.255 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026662679999999998 2024-09-12T00:05:22.255 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.255 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.255 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:22.255 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.982960+0000", 2024-09-12T00:05:22.255 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3000999999999997e-05 2024-09-12T00:05:22.255 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.255 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.255 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:22.255 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.982985+0000", 2024-09-12T00:05:22.255 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5092e-05 2024-09-12T00:05:22.256 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.256 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.256 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:22.256 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.983163+0000", 2024-09-12T00:05:22.256 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000177942 2024-09-12T00:05:22.256 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.256 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.256 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:22.256 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.983221+0000", 2024-09-12T00:05:22.256 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7476999999999999e-05 2024-09-12T00:05:22.256 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.256 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.256 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:22.257 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000301+0000", 2024-09-12T00:05:22.257 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017080503 2024-09-12T00:05:22.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.257 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.257 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:22.257 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000381+0000", 2024-09-12T00:05:22.257 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9536000000000006e-05 2024-09-12T00:05:22.257 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.257 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:22.257 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.257 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.257 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2756 3.21 3:849c909c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_241:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:22.257 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.197450+0000", 2024-09-12T00:05:22.258 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 34.028450356, 2024-09-12T00:05:22.258 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020201090000000001, 2024-09-12T00:05:22.258 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:22.258 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:22.258 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:22.258 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:22.258 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:22.258 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:22.258 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2756 2024-09-12T00:05:22.258 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.258 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:22.258 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.258 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:22.259 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.197450+0000", 2024-09-12T00:05:22.259 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.259 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.259 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.259 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:22.259 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.197450+0000", 2024-09-12T00:05:22.259 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.259 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.259 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.259 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:22.259 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.197455+0000", 2024-09-12T00:05:22.259 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4070000000000003e-06 2024-09-12T00:05:22.259 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.259 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.260 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:22.260 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.202967+0000", 2024-09-12T00:05:22.260 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0055122299999999999 2024-09-12T00:05:22.260 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.260 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.260 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:22.260 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203001+0000", 2024-09-12T00:05:22.260 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3685e-05 2024-09-12T00:05:22.260 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.260 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.260 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:22.260 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203017+0000", 2024-09-12T00:05:22.260 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6622000000000001e-05 2024-09-12T00:05:22.260 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.261 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.261 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:22.261 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203134+0000", 2024-09-12T00:05:22.261 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117166 2024-09-12T00:05:22.261 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.261 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.261 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:22.261 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203389+0000", 2024-09-12T00:05:22.261 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025456200000000001 2024-09-12T00:05:22.261 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.261 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.261 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:22.261 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203625+0000", 2024-09-12T00:05:22.262 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000235856 2024-09-12T00:05:22.262 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.262 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.262 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:22.262 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.212670+0000", 2024-09-12T00:05:22.262 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0090446639999999991 2024-09-12T00:05:22.262 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.262 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.262 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:22.262 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.217469+0000", 2024-09-12T00:05:22.262 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047998559999999999 2024-09-12T00:05:22.262 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.262 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.263 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:22.263 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.217569+0000", 2024-09-12T00:05:22.263 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9753999999999994e-05 2024-09-12T00:05:22.263 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.263 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.263 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:22.263 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.217651+0000", 2024-09-12T00:05:22.263 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2287999999999995e-05 2024-09-12T00:05:22.263 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.263 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:22.263 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.263 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.263 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.263 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2969 3.b 3:d2cd1e23:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:22.263 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.057390+0000", 2024-09-12T00:05:22.264 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 2.1685107370000001, 2024-09-12T00:05:22.264 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019453666000000001, 2024-09-12T00:05:22.264 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:22.264 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:22.264 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:22.264 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:22.264 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:22.264 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:22.264 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2969 2024-09-12T00:05:22.264 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.264 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:22.264 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.264 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:22.265 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.057390+0000", 2024-09-12T00:05:22.265 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.265 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.265 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.265 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:22.265 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.057390+0000", 2024-09-12T00:05:22.265 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.265 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.265 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.265 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:22.265 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.057393+0000", 2024-09-12T00:05:22.265 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8430000000000001e-06 2024-09-12T00:05:22.265 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.265 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.266 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:22.266 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062108+0000", 2024-09-12T00:05:22.266 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047149640000000003 2024-09-12T00:05:22.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.266 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.266 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:22.266 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062130+0000", 2024-09-12T00:05:22.266 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.23e-05 2024-09-12T00:05:22.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.266 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.266 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:22.266 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062141+0000", 2024-09-12T00:05:22.266 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.111e-05 2024-09-12T00:05:22.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.267 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.267 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:22.267 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062222+0000", 2024-09-12T00:05:22.267 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0486000000000002e-05 2024-09-12T00:05:22.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.267 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.267 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:22.267 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062364+0000", 2024-09-12T00:05:22.267 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014189500000000001 2024-09-12T00:05:22.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.267 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.267 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:22.267 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062496+0000", 2024-09-12T00:05:22.267 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000132182 2024-09-12T00:05:22.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.268 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.268 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:22.268 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.076301+0000", 2024-09-12T00:05:22.268 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013805128 2024-09-12T00:05:22.268 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.268 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.268 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:22.268 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.076652+0000", 2024-09-12T00:05:22.268 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00035156899999999998 2024-09-12T00:05:22.268 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.268 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.268 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:22.268 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.076734+0000", 2024-09-12T00:05:22.269 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1161000000000004e-05 2024-09-12T00:05:22.269 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.269 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.269 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:22.269 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.076844+0000", 2024-09-12T00:05:22.269 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110028 2024-09-12T00:05:22.269 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.269 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:22.269 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.269 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.269 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.269 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2971 3.2e 3:76f45d45:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:22.269 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:22.269 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 2.1500331730000002, 2024-09-12T00:05:22.270 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022571213, 2024-09-12T00:05:22.270 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:22.270 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:22.270 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:22.270 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:22.270 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:22.270 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:22.270 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2971 2024-09-12T00:05:22.270 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.270 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:22.270 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.270 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:22.270 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:22.271 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.271 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.271 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:22.271 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:22.271 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.271 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.271 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:22.271 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075871+0000", 2024-09-12T00:05:22.271 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.467e-06 2024-09-12T00:05:22.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.271 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.271 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:22.272 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080307+0000", 2024-09-12T00:05:22.272 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044356359999999997 2024-09-12T00:05:22.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.272 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.272 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:22.272 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080346+0000", 2024-09-12T00:05:22.272 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9267999999999997e-05 2024-09-12T00:05:22.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.272 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.272 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:22.272 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080368+0000", 2024-09-12T00:05:22.272 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2603e-05 2024-09-12T00:05:22.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.273 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.273 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:22.273 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080489+0000", 2024-09-12T00:05:22.273 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0001209 2024-09-12T00:05:22.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.273 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.273 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:22.273 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080830+0000", 2024-09-12T00:05:22.273 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00034099 2024-09-12T00:05:22.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.273 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.273 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:22.273 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.081119+0000", 2024-09-12T00:05:22.274 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028860300000000001 2024-09-12T00:05:22.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.274 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.274 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:22.274 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.093241+0000", 2024-09-12T00:05:22.274 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012121609 2024-09-12T00:05:22.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.274 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.274 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:22.274 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098277+0000", 2024-09-12T00:05:22.274 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0050359710000000002 2024-09-12T00:05:22.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.274 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.275 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:22.275 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098366+0000", 2024-09-12T00:05:22.275 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9052000000000001e-05 2024-09-12T00:05:22.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.275 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.275 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:22.275 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098439+0000", 2024-09-12T00:05:22.275 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3114000000000005e-05 2024-09-12T00:05:22.275 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.275 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:22.275 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.275 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.276 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2996 3.21 3:872b1c12:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:22.276 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:22.276 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.8754084359999998, 2024-09-12T00:05:22.276 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027562314000000001, 2024-09-12T00:05:22.276 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:22.276 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:22.276 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:22.276 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:22.276 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:22.276 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:22.276 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2996 2024-09-12T00:05:22.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.276 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:22.277 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.277 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:22.277 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:22.277 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.277 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.277 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:22.277 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:22.277 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.277 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.277 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:22.277 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350496+0000", 2024-09-12T00:05:22.277 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9160000000000003e-06 2024-09-12T00:05:22.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.278 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.278 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:22.278 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355187+0000", 2024-09-12T00:05:22.278 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046904989999999999 2024-09-12T00:05:22.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.278 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.278 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:22.278 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355223+0000", 2024-09-12T00:05:22.278 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6125999999999999e-05 2024-09-12T00:05:22.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.278 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.278 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:22.278 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355241+0000", 2024-09-12T00:05:22.279 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8686e-05 2024-09-12T00:05:22.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.279 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.279 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:22.279 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355373+0000", 2024-09-12T00:05:22.279 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013129299999999999 2024-09-12T00:05:22.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.279 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.279 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:22.279 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355619+0000", 2024-09-12T00:05:22.279 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024662700000000002 2024-09-12T00:05:22.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.279 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.280 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:22.280 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355855+0000", 2024-09-12T00:05:22.280 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023604299999999999 2024-09-12T00:05:22.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.280 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.280 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:22.280 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.367983+0000", 2024-09-12T00:05:22.280 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012127104999999999 2024-09-12T00:05:22.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.280 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.280 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:22.280 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377884+0000", 2024-09-12T00:05:22.280 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099013680000000007 2024-09-12T00:05:22.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.281 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.281 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:22.281 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377974+0000", 2024-09-12T00:05:22.281 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9932999999999994e-05 2024-09-12T00:05:22.281 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.281 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.281 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:22.281 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.378055+0000", 2024-09-12T00:05:22.281 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0717999999999995e-05 2024-09-12T00:05:22.281 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.281 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:22.281 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.281 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.282 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.282 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3016 3.21 3:876e25ab:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:22.282 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.592959+0000", 2024-09-12T00:05:22.282 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.632942001, 2024-09-12T00:05:22.282 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018852352999999999, 2024-09-12T00:05:22.282 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:22.282 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:22.282 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:22.282 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:22.282 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:22.282 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:22.282 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3016 2024-09-12T00:05:22.282 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.283 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:22.283 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.283 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:22.283 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.592959+0000", 2024-09-12T00:05:22.283 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.283 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.283 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:22.283 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.592959+0000", 2024-09-12T00:05:22.283 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.283 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.283 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:22.283 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.592961+0000", 2024-09-12T00:05:22.283 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7939999999999998e-06 2024-09-12T00:05:22.284 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.284 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.284 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:22.284 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.597664+0000", 2024-09-12T00:05:22.284 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047023550000000001 2024-09-12T00:05:22.284 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.284 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.284 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:22.284 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.597702+0000", 2024-09-12T00:05:22.284 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8235000000000002e-05 2024-09-12T00:05:22.284 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.284 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.284 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:22.285 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.597721+0000", 2024-09-12T00:05:22.285 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8442999999999999e-05 2024-09-12T00:05:22.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.285 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.285 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:22.285 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.597853+0000", 2024-09-12T00:05:22.285 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013213299999999999 2024-09-12T00:05:22.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.285 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.285 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:22.285 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.598128+0000", 2024-09-12T00:05:22.285 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000275347 2024-09-12T00:05:22.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.286 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.286 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:22.286 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.598362+0000", 2024-09-12T00:05:22.286 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023358999999999999 2024-09-12T00:05:22.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.286 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.286 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:22.286 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611029+0000", 2024-09-12T00:05:22.286 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012667487999999999 2024-09-12T00:05:22.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.286 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.286 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:22.286 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611437+0000", 2024-09-12T00:05:22.286 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000407518 2024-09-12T00:05:22.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.287 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.287 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:22.287 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611629+0000", 2024-09-12T00:05:22.287 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00019254799999999999 2024-09-12T00:05:22.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.287 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.287 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:22.287 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611811+0000", 2024-09-12T00:05:22.287 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018190200000000001 2024-09-12T00:05:22.287 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.287 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:22.287 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.288 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.288 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3030 3.2e 3:740afe3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:22.288 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:22.288 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.4860782779999999, 2024-09-12T00:05:22.288 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.033756331000000001, 2024-09-12T00:05:22.288 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:22.288 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:22.288 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:22.288 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:22.288 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:22.288 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:22.288 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3030 2024-09-12T00:05:22.288 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.288 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:22.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.289 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:22.289 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:22.289 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.289 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:22.289 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:22.289 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.289 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:22.289 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739825+0000", 2024-09-12T00:05:22.289 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7920000000000001e-06 2024-09-12T00:05:22.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.290 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.290 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:22.290 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744217+0000", 2024-09-12T00:05:22.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043922529999999996 2024-09-12T00:05:22.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.290 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.290 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:22.290 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744243+0000", 2024-09-12T00:05:22.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5253e-05 2024-09-12T00:05:22.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.290 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.290 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:22.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744254+0000", 2024-09-12T00:05:22.291 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1430999999999999e-05 2024-09-12T00:05:22.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.291 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.291 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:22.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744325+0000", 2024-09-12T00:05:22.291 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1340999999999993e-05 2024-09-12T00:05:22.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.291 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.291 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:22.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744461+0000", 2024-09-12T00:05:22.291 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013531700000000001 2024-09-12T00:05:22.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.291 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.292 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:22.292 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744574+0000", 2024-09-12T00:05:22.292 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113513 2024-09-12T00:05:22.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.292 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.292 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:22.292 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.752813+0000", 2024-09-12T00:05:22.292 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082384750000000003 2024-09-12T00:05:22.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.292 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.292 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:22.292 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773444+0000", 2024-09-12T00:05:22.292 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020630773000000002 2024-09-12T00:05:22.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.293 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.293 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:22.293 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773510+0000", 2024-09-12T00:05:22.293 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6711000000000006e-05 2024-09-12T00:05:22.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.293 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.293 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:22.293 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773579+0000", 2024-09-12T00:05:22.293 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8472000000000004e-05 2024-09-12T00:05:22.293 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.293 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:22.293 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.294 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.294 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3039 3.2e 3:74587332:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:22.294 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:22.294 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.3903983499999999, 2024-09-12T00:05:22.294 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.036215114, 2024-09-12T00:05:22.294 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:22.294 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:22.294 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:22.294 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:22.294 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:22.294 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:22.294 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3039 2024-09-12T00:05:22.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.294 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:22.295 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.295 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:22.295 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:22.295 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.295 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.295 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:22.295 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:22.295 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.295 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.295 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:22.295 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835507+0000", 2024-09-12T00:05:22.295 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6e-06 2024-09-12T00:05:22.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:22.296 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848930+0000", 2024-09-12T00:05:22.296 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013423242 2024-09-12T00:05:22.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:22.296 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848969+0000", 2024-09-12T00:05:22.296 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9270000000000002e-05 2024-09-12T00:05:22.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:22.296 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848991+0000", 2024-09-12T00:05:22.297 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1565000000000001e-05 2024-09-12T00:05:22.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.297 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.297 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:22.297 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849089+0000", 2024-09-12T00:05:22.297 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8408999999999999e-05 2024-09-12T00:05:22.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.297 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.297 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:22.297 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849518+0000", 2024-09-12T00:05:22.297 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042813900000000002 2024-09-12T00:05:22.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.297 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.298 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:22.298 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849897+0000", 2024-09-12T00:05:22.298 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037936600000000001 2024-09-12T00:05:22.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.298 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.298 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:22.298 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.858549+0000", 2024-09-12T00:05:22.298 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086520820000000002 2024-09-12T00:05:22.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.298 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.298 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:22.298 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871522+0000", 2024-09-12T00:05:22.298 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012973182999999999 2024-09-12T00:05:22.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:22.299 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871633+0000", 2024-09-12T00:05:22.299 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011085 2024-09-12T00:05:22.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:22.299 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871717+0000", 2024-09-12T00:05:22.299 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.4407999999999996e-05 2024-09-12T00:05:22.299 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.299 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:22.299 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.300 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.300 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3050 3.b 3:d26f7141:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:22.300 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:22.300 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.268786094, 2024-09-12T00:05:22.300 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022896481999999999, 2024-09-12T00:05:22.300 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:22.300 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:22.300 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:22.300 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:22.300 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:22.300 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:22.300 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3050 2024-09-12T00:05:22.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.300 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:22.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.301 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:22.301 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:22.301 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.301 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:22.301 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:22.301 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.301 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:22.301 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957117+0000", 2024-09-12T00:05:22.301 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7e-06 2024-09-12T00:05:22.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.302 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:22.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961673+0000", 2024-09-12T00:05:22.302 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045558059999999999 2024-09-12T00:05:22.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.302 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:22.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961698+0000", 2024-09-12T00:05:22.302 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5017000000000001e-05 2024-09-12T00:05:22.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.302 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:22.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961710+0000", 2024-09-12T00:05:22.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1963999999999999e-05 2024-09-12T00:05:22.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:22.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961785+0000", 2024-09-12T00:05:22.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5153000000000004e-05 2024-09-12T00:05:22.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:22.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961926+0000", 2024-09-12T00:05:22.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000141194 2024-09-12T00:05:22.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.304 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:22.304 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.962055+0000", 2024-09-12T00:05:22.304 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012882400000000001 2024-09-12T00:05:22.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.304 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.304 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:22.304 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.970716+0000", 2024-09-12T00:05:22.304 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086603610000000001 2024-09-12T00:05:22.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.304 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.304 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:22.304 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979700+0000", 2024-09-12T00:05:22.304 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.008984054 2024-09-12T00:05:22.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.305 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.305 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:22.305 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979884+0000", 2024-09-12T00:05:22.305 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184215 2024-09-12T00:05:22.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.305 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.305 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:22.305 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.980011+0000", 2024-09-12T00:05:22.305 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012719399999999999 2024-09-12T00:05:22.305 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.305 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:22.305 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.306 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3052 3.32 e75/23 3:4d6db9ea:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_91:head v 75'3, mlcod=62'1)", 2024-09-12T00:05:22.306 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.988152+0000", 2024-09-12T00:05:22.306 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.237748538, 2024-09-12T00:05:22.306 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019198494999999999, 2024-09-12T00:05:22.306 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:22.306 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:22.306 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:22.306 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:22.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.306 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:22.306 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.988152+0000", 2024-09-12T00:05:22.306 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.307 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.307 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:22.307 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.988152+0000", 2024-09-12T00:05:22.307 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.307 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.307 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:22.307 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.988155+0000", 2024-09-12T00:05:22.307 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.253e-06 2024-09-12T00:05:22.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.307 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.307 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:22.307 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993485+0000", 2024-09-12T00:05:22.308 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053298479999999999 2024-09-12T00:05:22.308 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.308 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.308 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:22.308 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993520+0000", 2024-09-12T00:05:22.308 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4393000000000001e-05 2024-09-12T00:05:22.308 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.308 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.308 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:22.308 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993538+0000", 2024-09-12T00:05:22.308 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8193e-05 2024-09-12T00:05:22.308 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.309 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.309 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:22.309 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993701+0000", 2024-09-12T00:05:22.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016265499999999999 2024-09-12T00:05:22.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.309 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.309 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:22.309 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993771+0000", 2024-09-12T00:05:22.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.0884999999999996e-05 2024-09-12T00:05:22.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.309 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.309 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:22.309 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007261+0000", 2024-09-12T00:05:22.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013489142000000001 2024-09-12T00:05:22.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.310 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.310 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:22.310 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007351+0000", 2024-09-12T00:05:22.310 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0125999999999997e-05 2024-09-12T00:05:22.310 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.310 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:22.310 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.310 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.310 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3065 3.b 3:d10bf58d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:22.310 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:22.310 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.103838474, 2024-09-12T00:05:22.310 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021843261999999999, 2024-09-12T00:05:22.310 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:22.311 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:22.311 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:22.311 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:22.311 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:22.311 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:22.311 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3065 2024-09-12T00:05:22.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.311 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:22.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.311 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:22.311 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:22.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:22.312 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:22.312 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:22.312 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122067+0000", 2024-09-12T00:05:22.312 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4970000000000003e-06 2024-09-12T00:05:22.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:22.312 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126931+0000", 2024-09-12T00:05:22.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048641090000000001 2024-09-12T00:05:22.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.313 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:22.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126973+0000", 2024-09-12T00:05:22.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1678999999999999e-05 2024-09-12T00:05:22.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.313 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:22.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126999+0000", 2024-09-12T00:05:22.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6536000000000001e-05 2024-09-12T00:05:22.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.314 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.314 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:22.314 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127118+0000", 2024-09-12T00:05:22.314 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000119373 2024-09-12T00:05:22.314 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.314 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.314 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:22.314 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127289+0000", 2024-09-12T00:05:22.314 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017020199999999999 2024-09-12T00:05:22.314 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.314 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.314 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:22.314 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127437+0000", 2024-09-12T00:05:22.314 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148682 2024-09-12T00:05:22.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.315 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.315 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:22.315 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138539+0000", 2024-09-12T00:05:22.315 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011101418 2024-09-12T00:05:22.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.315 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.315 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:22.315 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143355+0000", 2024-09-12T00:05:22.315 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048161499999999999 2024-09-12T00:05:22.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.315 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.316 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:22.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143777+0000", 2024-09-12T00:05:22.316 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000421896 2024-09-12T00:05:22.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.316 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.316 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:22.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143905+0000", 2024-09-12T00:05:22.316 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012872 2024-09-12T00:05:22.316 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.316 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:22.316 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.316 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.316 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3066 3.21 3:8448517d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:22.317 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:22.317 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 1.0938923920000001, 2024-09-12T00:05:22.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025911652, 2024-09-12T00:05:22.317 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:22.317 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:22.317 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:22.317 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:22.317 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:22.317 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:22.317 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3066 2024-09-12T00:05:22.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.317 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:22.317 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.317 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:22.318 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:22.318 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.318 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.318 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:22.318 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:22.318 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.318 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.318 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:22.318 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132011+0000", 2024-09-12T00:05:22.318 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8270000000000002e-06 2024-09-12T00:05:22.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.319 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.319 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:22.319 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137934+0000", 2024-09-12T00:05:22.319 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059226119999999998 2024-09-12T00:05:22.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.319 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.319 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:22.319 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137968+0000", 2024-09-12T00:05:22.319 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3933000000000002e-05 2024-09-12T00:05:22.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.319 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.319 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:22.319 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137985+0000", 2024-09-12T00:05:22.319 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7725999999999999e-05 2024-09-12T00:05:22.320 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.320 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.320 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:22.320 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138084+0000", 2024-09-12T00:05:22.320 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8450999999999996e-05 2024-09-12T00:05:22.320 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.320 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.320 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:22.320 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138285+0000", 2024-09-12T00:05:22.320 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000201411 2024-09-12T00:05:22.320 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.320 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.320 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:22.321 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138510+0000", 2024-09-12T00:05:22.321 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000224551 2024-09-12T00:05:22.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.321 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.321 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:22.321 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.146242+0000", 2024-09-12T00:05:22.321 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077317649999999998 2024-09-12T00:05:22.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.321 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.321 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:22.321 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157728+0000", 2024-09-12T00:05:22.321 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011486424 2024-09-12T00:05:22.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.322 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.322 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:22.322 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157833+0000", 2024-09-12T00:05:22.322 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105234 2024-09-12T00:05:22.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.322 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.322 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:22.322 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157920+0000", 2024-09-12T00:05:22.322 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6718000000000006e-05 2024-09-12T00:05:22.322 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.322 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:22.322 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.322 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.323 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3111 3.2e 3:7749b0e6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:22.323 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.741096+0000", 2024-09-12T00:05:22.323 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.48480480199999998, 2024-09-12T00:05:22.323 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019635658, 2024-09-12T00:05:22.323 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:22.323 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:22.323 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:22.323 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:22.323 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:22.323 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:22.323 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3111 2024-09-12T00:05:22.323 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.323 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:22.323 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.324 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:22.324 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.741096+0000", 2024-09-12T00:05:22.324 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.324 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.324 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.324 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:22.324 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.741096+0000", 2024-09-12T00:05:22.324 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.324 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.324 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.324 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:22.324 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.741099+0000", 2024-09-12T00:05:22.324 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0800000000000002e-06 2024-09-12T00:05:22.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.325 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.325 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:22.325 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745487+0000", 2024-09-12T00:05:22.325 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043876540000000004 2024-09-12T00:05:22.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.325 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.325 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:22.325 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745510+0000", 2024-09-12T00:05:22.325 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3099999999999999e-05 2024-09-12T00:05:22.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.325 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.325 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:22.326 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745521+0000", 2024-09-12T00:05:22.326 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0813e-05 2024-09-12T00:05:22.326 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.326 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.326 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:22.326 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745639+0000", 2024-09-12T00:05:22.326 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011862399999999999 2024-09-12T00:05:22.326 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.326 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.326 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:22.326 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745895+0000", 2024-09-12T00:05:22.327 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025625300000000001 2024-09-12T00:05:22.327 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.327 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.327 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:22.327 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.746140+0000", 2024-09-12T00:05:22.327 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000244467 2024-09-12T00:05:22.327 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.327 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.327 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:22.327 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755206+0000", 2024-09-12T00:05:22.327 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0090663250000000001 2024-09-12T00:05:22.327 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.327 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.327 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:22.328 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.760620+0000", 2024-09-12T00:05:22.328 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054141040000000003 2024-09-12T00:05:22.328 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.328 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.328 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:22.328 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.760673+0000", 2024-09-12T00:05:22.328 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2519999999999999e-05 2024-09-12T00:05:22.328 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.328 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.328 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:22.328 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.760732+0000", 2024-09-12T00:05:22.328 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8718000000000003e-05 2024-09-12T00:05:22.328 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.328 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:22.329 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.329 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.329 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.329 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3112 3.b 3:d1cf91a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:22.329 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:22.329 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.47517526500000001, 2024-09-12T00:05:22.329 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021203475999999999, 2024-09-12T00:05:22.329 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:22.329 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:22.329 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:22.329 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:22.329 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:22.329 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:22.329 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3112 2024-09-12T00:05:22.330 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.330 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:22.330 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.330 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:22.330 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:22.330 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.330 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.330 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.330 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:22.330 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:22.330 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.330 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.330 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.331 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:22.331 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750728+0000", 2024-09-12T00:05:22.331 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.165e-06 2024-09-12T00:05:22.331 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.331 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.331 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:22.331 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755063+0000", 2024-09-12T00:05:22.331 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043355379999999999 2024-09-12T00:05:22.331 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.331 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.331 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:22.331 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755103+0000", 2024-09-12T00:05:22.331 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9962000000000001e-05 2024-09-12T00:05:22.332 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.332 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.332 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:22.332 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755120+0000", 2024-09-12T00:05:22.332 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6793e-05 2024-09-12T00:05:22.332 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.332 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.332 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:22.332 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755299+0000", 2024-09-12T00:05:22.332 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017904499999999999 2024-09-12T00:05:22.332 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.332 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.332 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:22.333 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755758+0000", 2024-09-12T00:05:22.333 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000458815 2024-09-12T00:05:22.333 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.333 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.333 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:22.333 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.756304+0000", 2024-09-12T00:05:22.333 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000546183 2024-09-12T00:05:22.333 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.333 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.333 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:22.333 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771518+0000", 2024-09-12T00:05:22.333 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015214236000000001 2024-09-12T00:05:22.333 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.333 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.334 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:22.334 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771827+0000", 2024-09-12T00:05:22.334 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000309308 2024-09-12T00:05:22.334 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.334 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.334 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:22.334 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771874+0000", 2024-09-12T00:05:22.334 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6119999999999999e-05 2024-09-12T00:05:22.334 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.334 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.334 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:22.334 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771929+0000", 2024-09-12T00:05:22.334 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5310999999999999e-05 2024-09-12T00:05:22.334 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.335 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:22.335 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.335 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.335 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3115 3.2e 3:75803fec:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:22.335 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:22.335 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.43720421500000001, 2024-09-12T00:05:22.335 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020205041, 2024-09-12T00:05:22.335 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:22.335 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:22.335 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:22.335 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:22.335 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:22.336 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:22.336 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3115 2024-09-12T00:05:22.336 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.336 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:22.336 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.336 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:22.336 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:22.336 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.336 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.336 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.336 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:22.336 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:22.336 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:22.337 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.337 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.337 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:22.337 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788700+0000", 2024-09-12T00:05:22.337 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.614e-06 2024-09-12T00:05:22.337 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.337 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.337 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:22.337 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793576+0000", 2024-09-12T00:05:22.337 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048760920000000003 2024-09-12T00:05:22.337 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.337 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.337 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:22.337 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793610+0000", 2024-09-12T00:05:22.338 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4184999999999999e-05 2024-09-12T00:05:22.338 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.338 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.338 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:22.338 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793633+0000", 2024-09-12T00:05:22.338 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2551000000000001e-05 2024-09-12T00:05:22.338 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.338 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.338 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:22.338 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793750+0000", 2024-09-12T00:05:22.338 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117057 2024-09-12T00:05:22.338 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.338 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.338 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:22.338 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793975+0000", 2024-09-12T00:05:22.339 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022493099999999999 2024-09-12T00:05:22.339 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.339 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.339 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:22.339 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.794178+0000", 2024-09-12T00:05:22.339 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000202726 2024-09-12T00:05:22.339 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.339 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.339 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:22.339 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.803725+0000", 2024-09-12T00:05:22.339 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095470599999999996 2024-09-12T00:05:22.339 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.339 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.339 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:22.340 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808706+0000", 2024-09-12T00:05:22.340 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049814519999999999 2024-09-12T00:05:22.340 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.340 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.340 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:22.340 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808785+0000", 2024-09-12T00:05:22.340 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9160999999999996e-05 2024-09-12T00:05:22.340 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:22.340 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:22.340 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:22.340 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808902+0000", 2024-09-12T00:05:22.340 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000116212 2024-09-12T00:05:22.340 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.341 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:22.341 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.341 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:22.341 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:22.341 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:22.342 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:22.342 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:22.343 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:22.343 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:22.343 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:22.341+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:22.344 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:05:22.344 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:22.344 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:22.345 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:22.345 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:22.354 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:22.354 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:22.390 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:22.390 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:22.417 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:22.418 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:22.443 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:22.441+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:22.505 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:22.505 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:22.528 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:05:22.574 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:22.576+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:22.645 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:22.641+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:22.694 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:22.694 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:22.713 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:05:22.746 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:22.745+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:22.847 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:22.845+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:22.898 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:22.899 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:22.911 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:05:22.961 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:22.964+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:22.971 INFO:tasks.workunit.client.0.smithi019.stdout:adding file to bucket: 1Gb. 2024-09-12T00:05:22.971 INFO:tasks.workunit.client.0.smithi019.stdout:upload file successful 2024-09-12T00:05:22.971 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:05:22.971 INFO:tasks.workunit.client.0.smithi019.stdout:Test case: PASSED - set max size for a given user and ensure that the max size is in effect 2024-09-12T00:05:22.971 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:05:23.033 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:23.033 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:23.049 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:05:23.049 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:23.045+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:23.149 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:23.152+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:23.205 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:23.205 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:23.219 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:05:23.247 INFO:tasks.workunit.client.0.smithi019.stdout:user qa_user deleted 2024-09-12T00:05:23.247 INFO:tasks.workunit.client.0.smithi019.stdout:bucket delete succeeded 2024-09-12T00:05:23.250 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:23.249+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:23.351 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:23.352+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:23.359 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:23.359 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:23.373 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:05:23.452 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:23.449+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:23.537 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:23.537 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:23.553 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:23.553+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:23.554 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:05:23.610 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:05:23.614 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T00:05:23.614 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T00:05:23.657 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:23.660+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:23.674 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:23.674 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:23.692 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:05:23.756 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:23.753+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:23.851 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:23.851 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:23.857 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:23.856+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:23.868 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:05:23.958 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:23.953+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:24.025 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:24.025 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:24.041 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:05:24.085 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:24.088+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:24.155 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:24.155 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:24.160 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:24.160+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:24.172 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:05:24.261 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:24.261+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:24.332 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:24.332 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:24.348 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:05:24.361 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:24.364+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:24.452 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:05:24.462 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:24.461+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:24.483 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:24.483 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:24.498 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:05:24.580 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T00:05:24.586 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:24.585+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:24.593 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:24.594 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:24.615 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:24.615 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:24.632 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:24.632 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:24.648 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:24.648 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:24.664 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:24.661+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:24.668 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:24.669 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:24.670 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:24.670 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:24.670 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:24.670 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:24.670 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:24.685 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:05:24.687 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:24.687 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:24.706 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:24.706 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:24.726 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:24.727 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:24.781 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:24.776+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:24.862 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:24.862 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:24.863 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:24.863 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:24.863 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.863 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2667 3.8 3:1177e826:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:24.863 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:05:24.863 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 37.486575995000003, 2024-09-12T00:05:24.863 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024306991999999999, 2024-09-12T00:05:24.863 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:24.863 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:24.863 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:24.863 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:24.863 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:24.864 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:24.864 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2667 2024-09-12T00:05:24.864 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.864 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:24.864 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.864 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:24.864 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:05:24.864 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.864 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.864 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.864 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:24.864 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373121+0000", 2024-09-12T00:05:24.864 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.865 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.865 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:24.865 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.373124+0000", 2024-09-12T00:05:24.865 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.19e-06 2024-09-12T00:05:24.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.865 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.865 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:24.865 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377167+0000", 2024-09-12T00:05:24.865 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040430329999999997 2024-09-12T00:05:24.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.865 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.865 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:24.865 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377201+0000", 2024-09-12T00:05:24.866 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3868000000000002e-05 2024-09-12T00:05:24.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.866 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.866 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:24.866 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377219+0000", 2024-09-12T00:05:24.866 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8019000000000001e-05 2024-09-12T00:05:24.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.866 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.866 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:24.866 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377362+0000", 2024-09-12T00:05:24.866 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000143001 2024-09-12T00:05:24.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.866 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.867 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:24.867 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377603+0000", 2024-09-12T00:05:24.867 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024115200000000001 2024-09-12T00:05:24.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.867 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.867 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:24.867 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.377833+0000", 2024-09-12T00:05:24.867 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022952000000000001 2024-09-12T00:05:24.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.867 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.867 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:24.867 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.386771+0000", 2024-09-12T00:05:24.867 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0089385739999999995 2024-09-12T00:05:24.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.868 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.868 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:24.868 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397160+0000", 2024-09-12T00:05:24.868 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010388391 2024-09-12T00:05:24.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.868 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.868 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:24.868 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397307+0000", 2024-09-12T00:05:24.868 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014745099999999999 2024-09-12T00:05:24.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.868 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.868 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:24.869 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.397428+0000", 2024-09-12T00:05:24.869 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012079299999999999 2024-09-12T00:05:24.869 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.869 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:24.869 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.869 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.869 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.869 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2696 3.2b 3:d7c776f8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:24.869 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:05:24.869 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 37.292295527999997, 2024-09-12T00:05:24.869 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022026211, 2024-09-12T00:05:24.869 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:24.869 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:24.869 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:24.870 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:24.870 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:24.870 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:24.870 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2696 2024-09-12T00:05:24.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.870 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:24.870 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.870 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:24.870 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:05:24.870 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.870 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.870 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:24.871 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567401+0000", 2024-09-12T00:05:24.871 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.871 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.871 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:24.871 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.567406+0000", 2024-09-12T00:05:24.871 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9389999999999996e-06 2024-09-12T00:05:24.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.871 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.872 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:24.872 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571490+0000", 2024-09-12T00:05:24.872 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040837870000000002 2024-09-12T00:05:24.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.872 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.872 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:24.872 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571530+0000", 2024-09-12T00:05:24.872 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9894999999999997e-05 2024-09-12T00:05:24.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.872 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.872 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:24.872 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571554+0000", 2024-09-12T00:05:24.872 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4011000000000001e-05 2024-09-12T00:05:24.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.873 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.873 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:24.873 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571726+0000", 2024-09-12T00:05:24.873 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0001717 2024-09-12T00:05:24.873 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.873 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.873 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:24.873 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.572130+0000", 2024-09-12T00:05:24.873 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040465299999999999 2024-09-12T00:05:24.873 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.873 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.873 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:24.873 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.572470+0000", 2024-09-12T00:05:24.873 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00033946999999999997 2024-09-12T00:05:24.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.874 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.874 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:24.874 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.579159+0000", 2024-09-12T00:05:24.874 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0066893009999999999 2024-09-12T00:05:24.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.874 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.874 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:24.874 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589136+0000", 2024-09-12T00:05:24.874 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099772060000000006 2024-09-12T00:05:24.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.874 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.874 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:24.874 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589309+0000", 2024-09-12T00:05:24.874 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017264299999999999 2024-09-12T00:05:24.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.875 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.875 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:24.875 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589428+0000", 2024-09-12T00:05:24.875 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118606 2024-09-12T00:05:24.875 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.875 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:24.875 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.875 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.875 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2707 3.8 3:10a400a4:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:24.875 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:05:24.875 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 37.182840073999998, 2024-09-12T00:05:24.875 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019444162000000001, 2024-09-12T00:05:24.876 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:24.876 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:24.876 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:24.876 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:24.876 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:24.876 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:24.876 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2707 2024-09-12T00:05:24.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.876 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:24.876 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.876 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:24.876 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:05:24.876 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.877 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.877 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:24.877 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676857+0000", 2024-09-12T00:05:24.877 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.877 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.877 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.878 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:24.878 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.676879+0000", 2024-09-12T00:05:24.878 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1886e-05 2024-09-12T00:05:24.878 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.878 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.878 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:24.878 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680743+0000", 2024-09-12T00:05:24.878 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038648060000000001 2024-09-12T00:05:24.878 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.878 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.878 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:24.878 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680783+0000", 2024-09-12T00:05:24.878 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9511000000000002e-05 2024-09-12T00:05:24.878 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.879 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.879 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:24.879 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680801+0000", 2024-09-12T00:05:24.879 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8056000000000001e-05 2024-09-12T00:05:24.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.879 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.879 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:24.879 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.680948+0000", 2024-09-12T00:05:24.879 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014682399999999999 2024-09-12T00:05:24.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.879 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.879 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:24.879 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.681206+0000", 2024-09-12T00:05:24.880 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025860500000000002 2024-09-12T00:05:24.880 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.880 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.880 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:24.880 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.681439+0000", 2024-09-12T00:05:24.880 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023246599999999999 2024-09-12T00:05:24.880 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.880 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.880 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:24.880 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.689277+0000", 2024-09-12T00:05:24.880 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0078379000000000001 2024-09-12T00:05:24.880 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.880 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.880 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:24.881 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696136+0000", 2024-09-12T00:05:24.881 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0068593439999999999 2024-09-12T00:05:24.881 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.881 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.881 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:24.881 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696228+0000", 2024-09-12T00:05:24.881 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2038000000000002e-05 2024-09-12T00:05:24.881 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.882 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.882 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:24.882 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.696301+0000", 2024-09-12T00:05:24.883 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2725999999999995e-05 2024-09-12T00:05:24.883 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.884 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:24.884 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.884 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.884 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.884 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2720 3.6 3:61c9c6cd:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:24.884 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:05:24.884 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 37.056120757999999, 2024-09-12T00:05:24.885 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021831761000000002, 2024-09-12T00:05:24.885 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:24.885 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:24.885 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:24.885 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:24.885 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:24.885 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:24.886 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2720 2024-09-12T00:05:24.886 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.886 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:24.886 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.886 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:24.886 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803576+0000", 2024-09-12T00:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.803580+0000", 2024-09-12T00:05:24.888 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9870000000000001e-06 2024-09-12T00:05:24.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.888 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:24.888 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808102+0000", 2024-09-12T00:05:24.888 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004521677 2024-09-12T00:05:24.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808152+0000", 2024-09-12T00:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9923999999999998e-05 2024-09-12T00:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808178+0000", 2024-09-12T00:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5911999999999999e-05 2024-09-12T00:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.890 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:24.890 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808365+0000", 2024-09-12T00:05:24.890 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000187839 2024-09-12T00:05:24.890 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.890 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.890 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:24.890 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808757+0000", 2024-09-12T00:05:24.891 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039202900000000001 2024-09-12T00:05:24.891 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.891 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.891 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:24.891 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.809162+0000", 2024-09-12T00:05:24.891 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040460300000000002 2024-09-12T00:05:24.891 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.891 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.816553+0000", 2024-09-12T00:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.007390537 2024-09-12T00:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.824836+0000", 2024-09-12T00:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082834369999999994 2024-09-12T00:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.825223+0000", 2024-09-12T00:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00038724700000000001 2024-09-12T00:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.825408+0000", 2024-09-12T00:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018456899999999999 2024-09-12T00:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.894 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2724 3.1b 3:da32d84b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:24.894 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:05:24.894 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 37.015910322000003, 2024-09-12T00:05:24.894 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019410604000000001, 2024-09-12T00:05:24.894 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:24.894 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:24.894 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:24.894 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:24.895 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:24.895 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:24.895 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2724 2024-09-12T00:05:24.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.895 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:24.895 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.895 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:24.895 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843787+0000", 2024-09-12T00:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.843790+0000", 2024-09-12T00:05:24.897 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.393e-06 2024-09-12T00:05:24.897 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.897 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.897 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:24.897 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847786+0000", 2024-09-12T00:05:24.897 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039965579999999999 2024-09-12T00:05:24.898 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.898 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.898 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:24.898 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847836+0000", 2024-09-12T00:05:24.898 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9731000000000002e-05 2024-09-12T00:05:24.898 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.898 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.899 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:24.899 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.847856+0000", 2024-09-12T00:05:24.899 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0245e-05 2024-09-12T00:05:24.899 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.899 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.899 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:24.899 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848053+0000", 2024-09-12T00:05:24.899 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000196882 2024-09-12T00:05:24.899 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.899 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.899 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:24.900 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848291+0000", 2024-09-12T00:05:24.900 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000237762 2024-09-12T00:05:24.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.900 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.900 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:24.900 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848544+0000", 2024-09-12T00:05:24.900 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025307500000000001 2024-09-12T00:05:24.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.900 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.900 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:24.900 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.860024+0000", 2024-09-12T00:05:24.901 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011479390000000001 2024-09-12T00:05:24.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.901 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:24.901 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.862880+0000", 2024-09-12T00:05:24.901 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002856833 2024-09-12T00:05:24.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.901 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:24.902 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.863048+0000", 2024-09-12T00:05:24.902 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016796700000000001 2024-09-12T00:05:24.902 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.902 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.902 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:24.902 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.863197+0000", 2024-09-12T00:05:24.902 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148768 2024-09-12T00:05:24.902 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.902 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:24.902 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.902 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.902 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.902 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2730 3.7 3:e3fca83c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:24.902 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:05:24.903 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 36.951353599999997, 2024-09-12T00:05:24.903 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022178479000000001, 2024-09-12T00:05:24.903 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:24.903 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:24.903 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:24.903 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:24.903 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:24.903 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:24.903 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2730 2024-09-12T00:05:24.903 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.903 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:24.903 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.903 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:24.903 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:05:24.904 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.904 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.904 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.904 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:24.904 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908343+0000", 2024-09-12T00:05:24.904 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.904 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.904 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.905 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:24.905 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.908346+0000", 2024-09-12T00:05:24.905 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1999999999999999e-06 2024-09-12T00:05:24.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.905 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.905 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:24.905 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912423+0000", 2024-09-12T00:05:24.905 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004076423 2024-09-12T00:05:24.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.905 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.905 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:24.905 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912472+0000", 2024-09-12T00:05:24.905 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9023999999999997e-05 2024-09-12T00:05:24.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.906 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.906 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:24.906 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912498+0000", 2024-09-12T00:05:24.906 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6591999999999999e-05 2024-09-12T00:05:24.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.906 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.906 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:24.906 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912677+0000", 2024-09-12T00:05:24.906 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017824599999999999 2024-09-12T00:05:24.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.906 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.907 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:24.907 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913094+0000", 2024-09-12T00:05:24.907 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041757799999999999 2024-09-12T00:05:24.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.907 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.907 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:24.907 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.913512+0000", 2024-09-12T00:05:24.907 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000417475 2024-09-12T00:05:24.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.908 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.908 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:24.908 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.929229+0000", 2024-09-12T00:05:24.908 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015717294999999999 2024-09-12T00:05:24.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.908 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.908 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:24.908 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930204+0000", 2024-09-12T00:05:24.908 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00097506199999999996 2024-09-12T00:05:24.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.909 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.909 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:24.909 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930392+0000", 2024-09-12T00:05:24.909 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000187775 2024-09-12T00:05:24.909 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.909 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.909 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:24.909 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.930522+0000", 2024-09-12T00:05:24.909 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012980899999999999 2024-09-12T00:05:24.909 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.910 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:24.910 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.910 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.910 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.910 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2753 3.7 3:e119c99e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_238:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:24.910 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:05:24.910 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 36.705665529999997, 2024-09-12T00:05:24.910 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.023674186999999999, 2024-09-12T00:05:24.910 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:24.910 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:24.910 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:24.910 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:24.910 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:24.910 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:24.911 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2753 2024-09-12T00:05:24.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.911 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:24.911 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.911 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:24.911 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:05:24.911 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.911 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.911 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:24.911 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154031+0000", 2024-09-12T00:05:24.911 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.911 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.912 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:24.912 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154035+0000", 2024-09-12T00:05:24.912 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2799999999999999e-06 2024-09-12T00:05:24.912 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.912 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.912 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:24.912 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159459+0000", 2024-09-12T00:05:24.912 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054242190000000001 2024-09-12T00:05:24.912 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.912 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.912 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:24.912 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159509+0000", 2024-09-12T00:05:24.912 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9830999999999998e-05 2024-09-12T00:05:24.912 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.913 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.913 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:24.913 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159536+0000", 2024-09-12T00:05:24.913 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7438000000000001e-05 2024-09-12T00:05:24.913 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.913 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.913 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:24.913 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159710+0000", 2024-09-12T00:05:24.913 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017342 2024-09-12T00:05:24.913 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.913 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.913 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:24.913 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.159961+0000", 2024-09-12T00:05:24.914 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025164499999999999 2024-09-12T00:05:24.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.914 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.914 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:24.914 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.160206+0000", 2024-09-12T00:05:24.914 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024534200000000001 2024-09-12T00:05:24.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.914 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.914 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:24.914 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177421+0000", 2024-09-12T00:05:24.914 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017214956 2024-09-12T00:05:24.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.914 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.915 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:24.915 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177534+0000", 2024-09-12T00:05:24.915 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000112223 2024-09-12T00:05:24.915 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.915 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.915 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:24.915 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177625+0000", 2024-09-12T00:05:24.915 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0947999999999997e-05 2024-09-12T00:05:24.915 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.915 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.915 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:24.915 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.177706+0000", 2024-09-12T00:05:24.915 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0884999999999996e-05 2024-09-12T00:05:24.916 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.916 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:24.916 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.916 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.916 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.916 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2963 3.2d e75/23 3:b6bc0367:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_2:head v 75'8, mlcod=63'6)", 2024-09-12T00:05:24.916 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:19.998698+0000", 2024-09-12T00:05:24.916 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.8609988810000004, 2024-09-12T00:05:24.916 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.023451277, 2024-09-12T00:05:24.916 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:24.916 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:24.916 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:24.916 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:24.917 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.917 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:24.917 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.998698+0000", 2024-09-12T00:05:24.917 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.917 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.917 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.917 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:24.917 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.998698+0000", 2024-09-12T00:05:24.917 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.917 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.917 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.917 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:24.917 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.998698+0000", 2024-09-12T00:05:24.917 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9699999999999996e-07 2024-09-12T00:05:24.918 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.918 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.918 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:24.918 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.004335+0000", 2024-09-12T00:05:24.918 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0056365570000000004 2024-09-12T00:05:24.918 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.918 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.918 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:24.918 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.004370+0000", 2024-09-12T00:05:24.918 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5275999999999999e-05 2024-09-12T00:05:24.918 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.918 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.918 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:24.918 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.004386+0000", 2024-09-12T00:05:24.919 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5939000000000001e-05 2024-09-12T00:05:24.919 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.919 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.919 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:24.919 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.004516+0000", 2024-09-12T00:05:24.919 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012985699999999999 2024-09-12T00:05:24.919 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.919 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.919 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:24.919 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.004558+0000", 2024-09-12T00:05:24.919 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2369e-05 2024-09-12T00:05:24.919 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.920 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.920 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:24.920 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.022094+0000", 2024-09-12T00:05:24.920 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017535057 2024-09-12T00:05:24.920 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.920 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.920 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:24.920 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.022149+0000", 2024-09-12T00:05:24.920 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5724999999999999e-05 2024-09-12T00:05:24.921 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.921 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:24.921 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.921 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.921 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.921 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2970 3.7 3:e36c9f9c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:24.921 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.066566+0000", 2024-09-12T00:05:24.921 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.793131239, 2024-09-12T00:05:24.921 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.023775837000000001, 2024-09-12T00:05:24.921 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:24.921 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:24.921 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:24.922 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:24.922 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:24.922 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:24.922 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2970 2024-09-12T00:05:24.922 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.922 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:24.922 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.922 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:24.922 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.066566+0000", 2024-09-12T00:05:24.922 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.922 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.922 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.922 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:24.922 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.066566+0000", 2024-09-12T00:05:24.923 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.923 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.923 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.923 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:24.923 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.066569+0000", 2024-09-12T00:05:24.923 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.315e-06 2024-09-12T00:05:24.923 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.923 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.923 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:24.923 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.071215+0000", 2024-09-12T00:05:24.924 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046463679999999997 2024-09-12T00:05:24.924 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.924 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.924 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:24.924 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.071237+0000", 2024-09-12T00:05:24.924 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1963999999999998e-05 2024-09-12T00:05:24.924 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.924 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.924 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:24.924 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.071248+0000", 2024-09-12T00:05:24.924 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0307e-05 2024-09-12T00:05:24.924 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.925 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.925 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:24.925 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.071331+0000", 2024-09-12T00:05:24.925 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3819999999999994e-05 2024-09-12T00:05:24.925 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.925 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.925 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:24.925 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.071476+0000", 2024-09-12T00:05:24.925 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000144377 2024-09-12T00:05:24.925 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.925 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.925 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:24.925 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.071602+0000", 2024-09-12T00:05:24.925 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012584200000000001 2024-09-12T00:05:24.926 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.926 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.926 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:24.926 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.086573+0000", 2024-09-12T00:05:24.926 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014971714000000001 2024-09-12T00:05:24.926 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.926 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.926 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:24.926 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.090186+0000", 2024-09-12T00:05:24.926 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0036128380000000002 2024-09-12T00:05:24.926 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.926 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.926 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:24.926 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.090275+0000", 2024-09-12T00:05:24.926 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8486000000000006e-05 2024-09-12T00:05:24.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.927 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.927 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:24.927 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.090341+0000", 2024-09-12T00:05:24.927 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6805999999999997e-05 2024-09-12T00:05:24.927 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.927 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:24.927 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.927 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.927 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2981 3.19 3:9862bd97:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:24.927 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.186012+0000", 2024-09-12T00:05:24.927 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.6736845000000002, 2024-09-12T00:05:24.928 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021351716, 2024-09-12T00:05:24.928 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:24.928 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:24.928 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:24.928 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:24.928 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:24.928 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:24.928 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2981 2024-09-12T00:05:24.928 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.928 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:24.928 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.928 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:24.928 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.186012+0000", 2024-09-12T00:05:24.929 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.929 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.929 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:24.929 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.186012+0000", 2024-09-12T00:05:24.929 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.930 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.931 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:24.931 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.186016+0000", 2024-09-12T00:05:24.931 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5370000000000002e-06 2024-09-12T00:05:24.931 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.931 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.931 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:24.931 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.192824+0000", 2024-09-12T00:05:24.931 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006808494 2024-09-12T00:05:24.931 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.931 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.931 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:24.931 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.192881+0000", 2024-09-12T00:05:24.932 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6304000000000002e-05 2024-09-12T00:05:24.932 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.932 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.932 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:24.932 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.192902+0000", 2024-09-12T00:05:24.932 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1182000000000001e-05 2024-09-12T00:05:24.932 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.932 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.932 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:24.932 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.193002+0000", 2024-09-12T00:05:24.932 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000100039 2024-09-12T00:05:24.932 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.932 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.933 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:24.933 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.193168+0000", 2024-09-12T00:05:24.933 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016642600000000001 2024-09-12T00:05:24.933 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.933 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.933 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:24.933 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.193319+0000", 2024-09-12T00:05:24.933 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015086599999999999 2024-09-12T00:05:24.933 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.933 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.933 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:24.933 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.201909+0000", 2024-09-12T00:05:24.933 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0085896259999999995 2024-09-12T00:05:24.933 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.934 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.934 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:24.934 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.207252+0000", 2024-09-12T00:05:24.934 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053431679999999997 2024-09-12T00:05:24.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.934 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.934 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:24.934 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.207302+0000", 2024-09-12T00:05:24.934 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9988000000000003e-05 2024-09-12T00:05:24.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.934 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.934 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:24.934 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.207364+0000", 2024-09-12T00:05:24.934 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2086000000000002e-05 2024-09-12T00:05:24.935 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.935 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:24.935 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.935 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.935 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.935 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2992 3.2d e75/23 3:b5081e71:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_31:head v 75'10, mlcod=75'8)", 2024-09-12T00:05:24.935 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.316325+0000", 2024-09-12T00:05:24.935 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.5433717050000002, 2024-09-12T00:05:24.935 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019991542000000001, 2024-09-12T00:05:24.935 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:24.935 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:24.935 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:24.935 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:24.935 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.936 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:24.936 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.316325+0000", 2024-09-12T00:05:24.936 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.936 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.936 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.936 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:24.936 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.316325+0000", 2024-09-12T00:05:24.936 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.936 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.936 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.936 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:24.936 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.316328+0000", 2024-09-12T00:05:24.936 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2430000000000001e-06 2024-09-12T00:05:24.937 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.937 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.937 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:24.937 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.320764+0000", 2024-09-12T00:05:24.937 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004435629 2024-09-12T00:05:24.937 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.937 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.937 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:24.937 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.320799+0000", 2024-09-12T00:05:24.937 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5188999999999998e-05 2024-09-12T00:05:24.937 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.937 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.937 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:24.937 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.320816+0000", 2024-09-12T00:05:24.938 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6555999999999999e-05 2024-09-12T00:05:24.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.938 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.938 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:24.938 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.320984+0000", 2024-09-12T00:05:24.938 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000168135 2024-09-12T00:05:24.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.938 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.938 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:24.938 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.321050+0000", 2024-09-12T00:05:24.938 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5726000000000001e-05 2024-09-12T00:05:24.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.938 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.938 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:24.939 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.336190+0000", 2024-09-12T00:05:24.939 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015139981 2024-09-12T00:05:24.939 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.939 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.939 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:24.939 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.336317+0000", 2024-09-12T00:05:24.939 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000127083 2024-09-12T00:05:24.939 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.939 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:24.939 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.939 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.939 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.939 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2993 3.6 3:629c7ad7:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:24.939 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.322213+0000", 2024-09-12T00:05:24.940 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.5374835650000005, 2024-09-12T00:05:24.940 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022799073999999999, 2024-09-12T00:05:24.940 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:24.940 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:24.940 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:24.940 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:24.940 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:24.940 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:24.940 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2993 2024-09-12T00:05:24.940 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.940 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:24.940 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.940 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:24.941 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.322213+0000", 2024-09-12T00:05:24.941 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.941 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.941 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.941 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:24.941 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.322213+0000", 2024-09-12T00:05:24.941 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.941 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.941 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.941 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:24.941 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.322216+0000", 2024-09-12T00:05:24.941 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9469999999999999e-06 2024-09-12T00:05:24.941 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.941 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.942 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:24.942 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.326622+0000", 2024-09-12T00:05:24.942 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044058559999999997 2024-09-12T00:05:24.942 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.942 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.942 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:24.942 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.326657+0000", 2024-09-12T00:05:24.942 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5061999999999997e-05 2024-09-12T00:05:24.942 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.942 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.942 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:24.942 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.326676+0000", 2024-09-12T00:05:24.942 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8450000000000001e-05 2024-09-12T00:05:24.943 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.943 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.943 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:24.943 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.326812+0000", 2024-09-12T00:05:24.943 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013617999999999999 2024-09-12T00:05:24.943 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.943 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.943 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:24.943 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.327062+0000", 2024-09-12T00:05:24.943 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025033599999999998 2024-09-12T00:05:24.943 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.943 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.943 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:24.943 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.327307+0000", 2024-09-12T00:05:24.944 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024453000000000002 2024-09-12T00:05:24.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.944 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.944 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:24.944 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.343659+0000", 2024-09-12T00:05:24.944 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016351899 2024-09-12T00:05:24.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.944 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.944 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:24.944 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.344815+0000", 2024-09-12T00:05:24.944 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0011565359999999999 2024-09-12T00:05:24.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.945 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:24.945 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.344944+0000", 2024-09-12T00:05:24.945 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012852 2024-09-12T00:05:24.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.945 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:24.945 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.345012+0000", 2024-09-12T00:05:24.945 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8757999999999995e-05 2024-09-12T00:05:24.945 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.945 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:24.945 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.946 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3000 3.2 3:42ad9b5d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:24.946 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.390942+0000", 2024-09-12T00:05:24.946 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.4687545399999999, 2024-09-12T00:05:24.946 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.023247832, 2024-09-12T00:05:24.946 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:24.946 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:24.946 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:24.946 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:24.946 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:24.946 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:24.946 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3000 2024-09-12T00:05:24.946 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.946 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:24.946 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.947 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:24.947 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.390942+0000", 2024-09-12T00:05:24.947 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.947 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.947 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:24.947 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.390942+0000", 2024-09-12T00:05:24.947 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.947 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.947 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:24.947 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.390950+0000", 2024-09-12T00:05:24.947 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.8269999999999998e-06 2024-09-12T00:05:24.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.948 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:24.948 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.395307+0000", 2024-09-12T00:05:24.948 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043565970000000002 2024-09-12T00:05:24.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.948 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:24.948 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.395326+0000", 2024-09-12T00:05:24.948 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9522e-05 2024-09-12T00:05:24.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.948 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:24.948 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.395337+0000", 2024-09-12T00:05:24.949 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.031e-05 2024-09-12T00:05:24.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.949 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:24.949 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.395409+0000", 2024-09-12T00:05:24.949 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2444e-05 2024-09-12T00:05:24.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.949 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:24.949 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.395556+0000", 2024-09-12T00:05:24.949 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000146539 2024-09-12T00:05:24.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.949 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:24.950 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.395689+0000", 2024-09-12T00:05:24.950 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013360299999999999 2024-09-12T00:05:24.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.950 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.950 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:24.950 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.402234+0000", 2024-09-12T00:05:24.950 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0065446599999999999 2024-09-12T00:05:24.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.950 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.950 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:24.950 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.414086+0000", 2024-09-12T00:05:24.950 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011851723 2024-09-12T00:05:24.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.950 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.951 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:24.951 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.414135+0000", 2024-09-12T00:05:24.951 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.9388000000000002e-05 2024-09-12T00:05:24.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.951 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.951 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:24.951 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.414190+0000", 2024-09-12T00:05:24.951 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5219000000000001e-05 2024-09-12T00:05:24.951 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.951 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:24.951 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.951 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.951 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3047 3.2b 3:d4a45713:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:24.952 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.924157+0000", 2024-09-12T00:05:24.952 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.9355396219999998, 2024-09-12T00:05:24.952 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019514426000000001, 2024-09-12T00:05:24.952 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:24.952 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:24.952 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:24.952 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:24.952 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:24.952 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:24.952 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3047 2024-09-12T00:05:24.952 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.952 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:24.952 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.952 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:24.953 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.924157+0000", 2024-09-12T00:05:24.953 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.953 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.953 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.953 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:24.953 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.924157+0000", 2024-09-12T00:05:24.953 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.953 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.953 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.953 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:24.953 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.924161+0000", 2024-09-12T00:05:24.953 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3529999999999999e-06 2024-09-12T00:05:24.953 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.953 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.953 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:24.954 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.929005+0000", 2024-09-12T00:05:24.954 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048444680000000002 2024-09-12T00:05:24.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.954 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.954 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:24.954 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.929033+0000", 2024-09-12T00:05:24.954 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7512999999999999e-05 2024-09-12T00:05:24.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.954 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.954 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:24.954 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.929049+0000", 2024-09-12T00:05:24.954 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6096e-05 2024-09-12T00:05:24.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.955 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.955 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:24.955 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.929143+0000", 2024-09-12T00:05:24.955 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4606999999999997e-05 2024-09-12T00:05:24.955 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.955 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.955 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:24.955 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.929284+0000", 2024-09-12T00:05:24.955 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000140507 2024-09-12T00:05:24.955 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.955 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.955 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:24.955 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.929404+0000", 2024-09-12T00:05:24.955 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012071 2024-09-12T00:05:24.956 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.956 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.956 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:24.956 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.937818+0000", 2024-09-12T00:05:24.956 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0084135000000000008 2024-09-12T00:05:24.956 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.956 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.956 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:24.956 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.943506+0000", 2024-09-12T00:05:24.956 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0056880949999999998 2024-09-12T00:05:24.956 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.956 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.956 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:24.956 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.943601+0000", 2024-09-12T00:05:24.956 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4463999999999995e-05 2024-09-12T00:05:24.957 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.957 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.957 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:24.957 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.943672+0000", 2024-09-12T00:05:24.957 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1112999999999995e-05 2024-09-12T00:05:24.957 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.957 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:24.957 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.957 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.957 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.957 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3083 3.2 3:4083972b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:24.957 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.360579+0000", 2024-09-12T00:05:24.957 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.4991179049999999, 2024-09-12T00:05:24.958 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019691730000000001, 2024-09-12T00:05:24.958 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:24.958 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:24.958 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:24.958 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:24.958 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:24.958 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:24.958 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3083 2024-09-12T00:05:24.958 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.958 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:24.958 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.958 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:24.958 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.360579+0000", 2024-09-12T00:05:24.958 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.959 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.959 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.959 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:24.959 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.360579+0000", 2024-09-12T00:05:24.959 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.959 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.959 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.959 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:24.959 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.360583+0000", 2024-09-12T00:05:24.959 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9999999999999998e-06 2024-09-12T00:05:24.959 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.959 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.959 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:24.959 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.364959+0000", 2024-09-12T00:05:24.960 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043760819999999999 2024-09-12T00:05:24.960 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.960 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.960 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:24.960 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.364988+0000", 2024-09-12T00:05:24.960 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8523000000000001e-05 2024-09-12T00:05:24.960 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.960 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.960 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:24.960 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.365004+0000", 2024-09-12T00:05:24.960 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6762999999999999e-05 2024-09-12T00:05:24.960 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.960 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.960 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:24.961 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.365076+0000", 2024-09-12T00:05:24.961 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1426000000000004e-05 2024-09-12T00:05:24.961 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.961 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.961 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:24.961 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.365194+0000", 2024-09-12T00:05:24.961 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118649 2024-09-12T00:05:24.961 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.961 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.961 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:24.961 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.365297+0000", 2024-09-12T00:05:24.961 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000102358 2024-09-12T00:05:24.961 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.961 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.962 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:24.962 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.373115+0000", 2024-09-12T00:05:24.962 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0078186650000000007 2024-09-12T00:05:24.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.962 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.962 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:24.962 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.380144+0000", 2024-09-12T00:05:24.962 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0070287580000000004 2024-09-12T00:05:24.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.962 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.962 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:24.962 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.380214+0000", 2024-09-12T00:05:24.963 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9361000000000002e-05 2024-09-12T00:05:24.963 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.963 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.963 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:24.963 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.380271+0000", 2024-09-12T00:05:24.963 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7145000000000003e-05 2024-09-12T00:05:24.963 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.963 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:24.963 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.963 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.963 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.963 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3102 3.1b 3:db06e448:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:24.963 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.646603+0000", 2024-09-12T00:05:24.963 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.2130934400000002, 2024-09-12T00:05:24.964 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024949201000000001, 2024-09-12T00:05:24.964 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:24.964 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:24.964 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:24.964 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:24.964 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:24.964 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:24.964 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3102 2024-09-12T00:05:24.964 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.964 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:24.964 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.964 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:24.964 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.646603+0000", 2024-09-12T00:05:24.964 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.965 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.965 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.965 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:24.965 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.646603+0000", 2024-09-12T00:05:24.965 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.965 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.965 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.965 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:24.965 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.646607+0000", 2024-09-12T00:05:24.965 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7100000000000001e-06 2024-09-12T00:05:24.965 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.965 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.965 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:24.965 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.650860+0000", 2024-09-12T00:05:24.965 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042526780000000002 2024-09-12T00:05:24.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.966 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.966 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:24.966 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.650902+0000", 2024-09-12T00:05:24.966 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2667999999999999e-05 2024-09-12T00:05:24.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.966 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.966 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:24.966 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.650928+0000", 2024-09-12T00:05:24.966 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5639999999999998e-05 2024-09-12T00:05:24.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.966 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.966 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:24.966 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.651088+0000", 2024-09-12T00:05:24.967 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000159939 2024-09-12T00:05:24.967 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.967 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.967 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:24.967 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.651349+0000", 2024-09-12T00:05:24.967 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026133299999999999 2024-09-12T00:05:24.967 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.967 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.967 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:24.967 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.651578+0000", 2024-09-12T00:05:24.967 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000228734 2024-09-12T00:05:24.967 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.967 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.967 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:24.968 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.662780+0000", 2024-09-12T00:05:24.968 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011202017999999999 2024-09-12T00:05:24.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.968 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.968 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:24.968 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.671461+0000", 2024-09-12T00:05:24.968 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086809939999999992 2024-09-12T00:05:24.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.968 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.968 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:24.968 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.671512+0000", 2024-09-12T00:05:24.968 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.0815000000000001e-05 2024-09-12T00:05:24.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.968 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.969 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:24.969 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.671553+0000", 2024-09-12T00:05:24.969 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0672e-05 2024-09-12T00:05:24.969 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.969 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:24.969 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.969 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.969 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3122 3.19 3:9af06406:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:24.969 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.875544+0000", 2024-09-12T00:05:24.969 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 2.984153101, 2024-09-12T00:05:24.969 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019108757000000001, 2024-09-12T00:05:24.969 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:24.969 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:24.969 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:24.970 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:24.970 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:24.970 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:24.970 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3122 2024-09-12T00:05:24.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.970 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:24.970 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.970 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:24.970 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.875544+0000", 2024-09-12T00:05:24.970 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.970 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.970 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:24.970 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.875544+0000", 2024-09-12T00:05:24.971 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.971 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.971 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:24.971 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.875548+0000", 2024-09-12T00:05:24.971 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.16e-06 2024-09-12T00:05:24.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.971 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.971 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:24.971 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.880003+0000", 2024-09-12T00:05:24.971 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004454693 2024-09-12T00:05:24.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.971 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.971 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:24.972 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.880041+0000", 2024-09-12T00:05:24.972 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8118999999999999e-05 2024-09-12T00:05:24.972 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.972 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.972 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:24.972 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.880059+0000", 2024-09-12T00:05:24.972 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7856999999999999e-05 2024-09-12T00:05:24.972 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.972 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.972 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:24.972 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.880148+0000", 2024-09-12T00:05:24.972 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9295999999999993e-05 2024-09-12T00:05:24.972 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.973 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:24.973 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.880265+0000", 2024-09-12T00:05:24.973 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117429 2024-09-12T00:05:24.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.973 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:24.973 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.880367+0000", 2024-09-12T00:05:24.973 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000101242 2024-09-12T00:05:24.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.973 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:24.973 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.888209+0000", 2024-09-12T00:05:24.973 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0078422579999999995 2024-09-12T00:05:24.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.974 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:24.974 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.894512+0000", 2024-09-12T00:05:24.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0063032779999999998 2024-09-12T00:05:24.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.974 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:24.974 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.894591+0000", 2024-09-12T00:05:24.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.8768000000000002e-05 2024-09-12T00:05:24.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.974 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:24.974 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.894653+0000", 2024-09-12T00:05:24.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.1656999999999996e-05 2024-09-12T00:05:24.975 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.975 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:24.975 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.975 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3124 3.8 3:13846906:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:24.975 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.904356+0000", 2024-09-12T00:05:24.975 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 2.955340815, 2024-09-12T00:05:24.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020008991, 2024-09-12T00:05:24.975 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:24.975 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:24.975 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:24.975 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:24.976 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:24.976 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:24.976 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3124 2024-09-12T00:05:24.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.976 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:24.976 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.976 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:24.976 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.904356+0000", 2024-09-12T00:05:24.976 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.976 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.976 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:24.976 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.904356+0000", 2024-09-12T00:05:24.977 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.977 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:24.977 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.904358+0000", 2024-09-12T00:05:24.977 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1940000000000001e-06 2024-09-12T00:05:24.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.977 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:24.977 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.908346+0000", 2024-09-12T00:05:24.977 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039878800000000001 2024-09-12T00:05:24.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.977 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:24.978 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.908375+0000", 2024-09-12T00:05:24.978 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8941999999999998e-05 2024-09-12T00:05:24.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.978 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:24.978 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.908391+0000", 2024-09-12T00:05:24.978 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5945000000000001e-05 2024-09-12T00:05:24.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.978 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:24.978 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.908555+0000", 2024-09-12T00:05:24.978 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016399000000000001 2024-09-12T00:05:24.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.979 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:24.979 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.908812+0000", 2024-09-12T00:05:24.979 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025653699999999999 2024-09-12T00:05:24.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.979 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.979 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:24.979 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.909089+0000", 2024-09-12T00:05:24.979 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027733599999999999 2024-09-12T00:05:24.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.979 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.979 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:24.979 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.922938+0000", 2024-09-12T00:05:24.979 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013848897000000001 2024-09-12T00:05:24.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.980 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:24.980 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.923801+0000", 2024-09-12T00:05:24.980 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00086284700000000003 2024-09-12T00:05:24.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.980 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:24.980 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.924117+0000", 2024-09-12T00:05:24.980 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00031605199999999999 2024-09-12T00:05:24.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.980 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:24.980 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.924365+0000", 2024-09-12T00:05:24.980 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000248371 2024-09-12T00:05:24.981 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.981 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:24.981 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.981 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3143 3.8 3:121efc62:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:24.981 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.156520+0000", 2024-09-12T00:05:24.981 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 2.7031772580000002, 2024-09-12T00:05:24.981 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020758321, 2024-09-12T00:05:24.981 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:24.981 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:24.982 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:24.982 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:24.982 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:24.982 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:24.982 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3143 2024-09-12T00:05:24.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.982 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:24.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.982 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:24.982 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.156520+0000", 2024-09-12T00:05:24.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.982 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:24.983 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.156520+0000", 2024-09-12T00:05:24.983 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.983 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.983 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:24.983 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.156523+0000", 2024-09-12T00:05:24.983 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0929999999999999e-06 2024-09-12T00:05:24.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.983 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.983 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:24.983 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.160397+0000", 2024-09-12T00:05:24.983 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038745300000000002 2024-09-12T00:05:24.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.983 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.984 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:24.984 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.160422+0000", 2024-09-12T00:05:24.984 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5208999999999999e-05 2024-09-12T00:05:24.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.984 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.984 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:24.984 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.160434+0000", 2024-09-12T00:05:24.984 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.154e-05 2024-09-12T00:05:24.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.984 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.984 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:24.984 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.160556+0000", 2024-09-12T00:05:24.984 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000122426 2024-09-12T00:05:24.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.985 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:24.985 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.160816+0000", 2024-09-12T00:05:24.985 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025935699999999999 2024-09-12T00:05:24.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.985 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:24.985 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.161087+0000", 2024-09-12T00:05:24.985 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027167000000000001 2024-09-12T00:05:24.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.985 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:24.985 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.176441+0000", 2024-09-12T00:05:24.985 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015354036 2024-09-12T00:05:24.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.986 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:24.986 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.176824+0000", 2024-09-12T00:05:24.986 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00038297100000000002 2024-09-12T00:05:24.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.986 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:24.986 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.177067+0000", 2024-09-12T00:05:24.986 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024230700000000001 2024-09-12T00:05:24.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.986 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:24.986 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.177278+0000", 2024-09-12T00:05:24.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000211182 2024-09-12T00:05:24.987 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.987 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:24.987 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.987 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3146 3.9 e76/23 3:93a22c51:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_185:head v 76'7, mlcod=75'5)", 2024-09-12T00:05:24.987 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.196151+0000", 2024-09-12T00:05:24.987 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 2.6635458779999999, 2024-09-12T00:05:24.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020130293, 2024-09-12T00:05:24.987 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:24.987 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:24.987 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:24.987 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:24.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.988 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:24.988 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.196151+0000", 2024-09-12T00:05:24.988 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.988 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:24.988 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.196151+0000", 2024-09-12T00:05:24.988 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:24.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.988 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:24.988 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.196153+0000", 2024-09-12T00:05:24.988 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9190000000000002e-06 2024-09-12T00:05:24.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.989 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:24.989 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.201384+0000", 2024-09-12T00:05:24.989 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052314789999999998 2024-09-12T00:05:24.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.989 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:24.989 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.201420+0000", 2024-09-12T00:05:24.989 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5191999999999998e-05 2024-09-12T00:05:24.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.989 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:24.989 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.201436+0000", 2024-09-12T00:05:24.990 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.668e-05 2024-09-12T00:05:24.990 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.990 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.990 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:24.990 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.201571+0000", 2024-09-12T00:05:24.990 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013439999999999999 2024-09-12T00:05:24.990 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.990 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.990 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:24.990 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.201613+0000", 2024-09-12T00:05:24.990 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2812000000000003e-05 2024-09-12T00:05:24.990 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.990 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.990 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:24.990 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.216202+0000", 2024-09-12T00:05:24.991 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014588133 2024-09-12T00:05:24.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:24.991 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:24.991 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:24.991 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.216281+0000", 2024-09-12T00:05:24.991 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9678000000000005e-05 2024-09-12T00:05:24.991 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.991 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:24.991 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.991 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:24.991 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:24.991 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:24.992 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:05:24.992 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:24.932+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:25.038 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:25.036+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:25.119 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:25.119 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:25.120 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:25.120 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:25.132 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:25.132+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:25.133 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:05:25.233 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:25.228+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:25.298 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:25.298 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:25.298 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:25.298 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:25.298 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:25.313 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:05:25.334 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:25.336+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:25.435 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:25.436+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:25.484 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:25.484 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:25.484 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:25.484 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:25.484 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.484 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2694 3.3d 3:bd0bdafc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:25.485 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:25.485 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 37.936696755, 2024-09-12T00:05:25.485 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.026139741000000001, 2024-09-12T00:05:25.485 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:25.485 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:25.485 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:25.485 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:25.486 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:25.486 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:25.486 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2694 2024-09-12T00:05:25.486 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.486 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:25.486 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.486 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:25.486 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:25.486 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.486 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.486 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.486 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:25.487 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:25.487 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.487 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.487 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.487 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:25.487 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545532+0000", 2024-09-12T00:05:25.487 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8199999999999998e-06 2024-09-12T00:05:25.487 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.487 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.487 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:25.487 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551454+0000", 2024-09-12T00:05:25.487 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059222340000000002 2024-09-12T00:05:25.487 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.487 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.488 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:25.488 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551485+0000", 2024-09-12T00:05:25.488 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0173999999999999e-05 2024-09-12T00:05:25.488 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.488 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.488 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:25.488 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551504+0000", 2024-09-12T00:05:25.488 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9726000000000001e-05 2024-09-12T00:05:25.488 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.488 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.488 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:25.488 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551708+0000", 2024-09-12T00:05:25.488 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020344100000000001 2024-09-12T00:05:25.488 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.489 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.489 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:25.489 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552087+0000", 2024-09-12T00:05:25.489 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000379327 2024-09-12T00:05:25.489 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.489 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.489 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:25.489 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552351+0000", 2024-09-12T00:05:25.490 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026349199999999999 2024-09-12T00:05:25.490 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.490 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.490 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:25.490 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.569375+0000", 2024-09-12T00:05:25.490 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017024432999999999 2024-09-12T00:05:25.490 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.490 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.490 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:25.490 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571222+0000", 2024-09-12T00:05:25.490 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00184688 2024-09-12T00:05:25.490 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.491 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.491 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:25.491 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571511+0000", 2024-09-12T00:05:25.491 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028897599999999998 2024-09-12T00:05:25.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.491 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.491 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:25.491 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571668+0000", 2024-09-12T00:05:25.491 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000157238 2024-09-12T00:05:25.491 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.491 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:25.491 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.491 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.491 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2698 3.3d 3:bcafb0f9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:25.492 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:25.492 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 37.892243051999998, 2024-09-12T00:05:25.492 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025133152999999998, 2024-09-12T00:05:25.492 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:25.492 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:25.492 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:25.492 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:25.492 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:25.492 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:25.492 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2698 2024-09-12T00:05:25.492 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.492 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:25.492 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.492 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:25.492 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:25.493 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.493 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.493 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.493 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:25.493 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:25.493 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.493 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.493 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.493 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:25.494 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589986+0000", 2024-09-12T00:05:25.494 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5999999999999998e-06 2024-09-12T00:05:25.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.494 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.494 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:25.494 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594109+0000", 2024-09-12T00:05:25.494 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041230770000000002 2024-09-12T00:05:25.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.494 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.494 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:25.495 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594146+0000", 2024-09-12T00:05:25.495 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7722000000000002e-05 2024-09-12T00:05:25.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.495 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.495 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:25.495 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594167+0000", 2024-09-12T00:05:25.495 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0100999999999999e-05 2024-09-12T00:05:25.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.495 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.495 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:25.495 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594297+0000", 2024-09-12T00:05:25.495 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013051600000000001 2024-09-12T00:05:25.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.495 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.495 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:25.496 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594570+0000", 2024-09-12T00:05:25.496 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000272837 2024-09-12T00:05:25.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.496 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.496 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:25.496 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594846+0000", 2024-09-12T00:05:25.496 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027622399999999999 2024-09-12T00:05:25.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.496 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.496 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:25.496 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.606026+0000", 2024-09-12T00:05:25.497 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011179947000000001 2024-09-12T00:05:25.497 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.497 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.497 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:25.497 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.614827+0000", 2024-09-12T00:05:25.497 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0088013259999999999 2024-09-12T00:05:25.497 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.497 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.497 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:25.497 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.614988+0000", 2024-09-12T00:05:25.497 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016018799999999999 2024-09-12T00:05:25.497 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.497 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.497 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:25.498 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.615115+0000", 2024-09-12T00:05:25.498 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000127615 2024-09-12T00:05:25.498 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.498 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:25.498 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.498 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.498 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.498 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2712 3.3e 3:7d3d0242:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:25.498 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:25.498 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 37.755342775000003, 2024-09-12T00:05:25.498 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022816941, 2024-09-12T00:05:25.498 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:25.498 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:25.498 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:25.498 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:25.499 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:25.499 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:25.499 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2712 2024-09-12T00:05:25.499 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.499 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:25.499 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.499 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:25.499 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:25.499 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.499 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.499 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.499 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:25.500 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:25.500 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.500 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.500 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.500 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:25.500 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726886+0000", 2024-09-12T00:05:25.500 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5329999999999999e-06 2024-09-12T00:05:25.500 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.500 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.500 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:25.501 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730802+0000", 2024-09-12T00:05:25.501 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039158700000000001 2024-09-12T00:05:25.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.501 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.501 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:25.501 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730839+0000", 2024-09-12T00:05:25.501 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6857999999999998e-05 2024-09-12T00:05:25.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.501 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.502 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:25.502 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730856+0000", 2024-09-12T00:05:25.502 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7371999999999999e-05 2024-09-12T00:05:25.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.502 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.502 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:25.502 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731026+0000", 2024-09-12T00:05:25.502 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017011000000000001 2024-09-12T00:05:25.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.502 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.502 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:25.503 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731444+0000", 2024-09-12T00:05:25.503 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041766500000000001 2024-09-12T00:05:25.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.503 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.503 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:25.503 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731860+0000", 2024-09-12T00:05:25.503 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041618500000000001 2024-09-12T00:05:25.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.503 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.503 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:25.504 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.743012+0000", 2024-09-12T00:05:25.504 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011152123 2024-09-12T00:05:25.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.504 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.505 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:25.505 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749386+0000", 2024-09-12T00:05:25.505 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0063743130000000004 2024-09-12T00:05:25.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.505 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.505 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:25.505 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749562+0000", 2024-09-12T00:05:25.505 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017590300000000001 2024-09-12T00:05:25.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.506 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.506 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:25.506 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749699+0000", 2024-09-12T00:05:25.506 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000137009 2024-09-12T00:05:25.506 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.506 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:25.506 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.506 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.506 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.506 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2715 3.18 3:19a9b410:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:25.506 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:25.506 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 37.725966485000001, 2024-09-12T00:05:25.506 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022391956000000001, 2024-09-12T00:05:25.506 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:25.507 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:25.507 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:25.507 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:25.507 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:25.507 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:25.507 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2715 2024-09-12T00:05:25.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.507 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:25.507 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.507 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:25.507 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:25.508 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.508 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.508 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:25.508 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:25.508 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.509 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.509 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:25.509 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756262+0000", 2024-09-12T00:05:25.509 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9629999999999998e-06 2024-09-12T00:05:25.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.509 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.509 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:25.510 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760936+0000", 2024-09-12T00:05:25.510 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046745750000000003 2024-09-12T00:05:25.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.510 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.510 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:25.510 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760968+0000", 2024-09-12T00:05:25.510 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1470999999999997e-05 2024-09-12T00:05:25.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.511 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.511 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:25.511 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760985+0000", 2024-09-12T00:05:25.511 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7771999999999999e-05 2024-09-12T00:05:25.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.511 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.511 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:25.511 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761154+0000", 2024-09-12T00:05:25.512 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016875399999999999 2024-09-12T00:05:25.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.512 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:25.512 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761571+0000", 2024-09-12T00:05:25.512 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000417231 2024-09-12T00:05:25.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.512 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:25.512 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761996+0000", 2024-09-12T00:05:25.513 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042500200000000001 2024-09-12T00:05:25.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.513 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.513 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:25.513 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777182+0000", 2024-09-12T00:05:25.513 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015185664999999999 2024-09-12T00:05:25.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.513 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.514 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:25.514 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778484+0000", 2024-09-12T00:05:25.514 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00130225 2024-09-12T00:05:25.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.514 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.514 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:25.514 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778575+0000", 2024-09-12T00:05:25.514 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0258000000000002e-05 2024-09-12T00:05:25.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.515 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.515 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:25.515 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778651+0000", 2024-09-12T00:05:25.515 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6014999999999996e-05 2024-09-12T00:05:25.515 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.515 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:25.515 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.515 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.516 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2729 3.0 3:01c0e0c9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:25.516 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:25.516 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 37.585085669000001, 2024-09-12T00:05:25.516 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025173068, 2024-09-12T00:05:25.516 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:25.516 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:25.516 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:25.516 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:25.516 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:25.516 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:25.516 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2729 2024-09-12T00:05:25.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.516 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:25.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.517 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:25.517 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:25.517 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.517 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:25.517 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:25.517 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.518 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:25.518 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897143+0000", 2024-09-12T00:05:25.518 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6600000000000001e-06 2024-09-12T00:05:25.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.519 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.519 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:25.519 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901595+0000", 2024-09-12T00:05:25.519 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044514680000000001 2024-09-12T00:05:25.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.520 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:25.520 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901629+0000", 2024-09-12T00:05:25.520 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4864999999999999e-05 2024-09-12T00:05:25.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.520 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:25.520 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901647+0000", 2024-09-12T00:05:25.520 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7699000000000001e-05 2024-09-12T00:05:25.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.521 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.521 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:25.521 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901780+0000", 2024-09-12T00:05:25.521 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013271499999999999 2024-09-12T00:05:25.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.521 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.521 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:25.521 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902010+0000", 2024-09-12T00:05:25.522 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022977300000000001 2024-09-12T00:05:25.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.522 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.522 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:25.522 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902222+0000", 2024-09-12T00:05:25.522 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021262399999999999 2024-09-12T00:05:25.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.522 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.522 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:25.522 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912402+0000", 2024-09-12T00:05:25.522 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010180203000000001 2024-09-12T00:05:25.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.523 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:25.523 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.921990+0000", 2024-09-12T00:05:25.523 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095871900000000006 2024-09-12T00:05:25.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.523 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:25.523 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.922166+0000", 2024-09-12T00:05:25.523 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017591899999999999 2024-09-12T00:05:25.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.523 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:25.523 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.922313+0000", 2024-09-12T00:05:25.524 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000146952 2024-09-12T00:05:25.524 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.524 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:25.524 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.524 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.524 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.524 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2732 3.1f 3:f85b64cb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:25.524 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:25.524 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 37.553639881000002, 2024-09-12T00:05:25.524 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022644154, 2024-09-12T00:05:25.525 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:25.525 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:25.525 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:25.525 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:25.525 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:25.525 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:25.525 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2732 2024-09-12T00:05:25.525 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.525 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:25.525 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.525 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:25.525 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:25.525 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.526 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.526 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:25.526 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:25.526 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.527 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.527 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:25.527 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928589+0000", 2024-09-12T00:05:25.527 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1230000000000002e-06 2024-09-12T00:05:25.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.527 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.527 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:25.527 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932650+0000", 2024-09-12T00:05:25.527 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040611049999999997 2024-09-12T00:05:25.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.528 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.528 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:25.528 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932692+0000", 2024-09-12T00:05:25.528 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1677000000000001e-05 2024-09-12T00:05:25.528 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.528 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.528 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:25.528 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932711+0000", 2024-09-12T00:05:25.528 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8749e-05 2024-09-12T00:05:25.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.529 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.529 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:25.529 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932834+0000", 2024-09-12T00:05:25.529 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012278300000000001 2024-09-12T00:05:25.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.529 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.529 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:25.529 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.933095+0000", 2024-09-12T00:05:25.529 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026151100000000002 2024-09-12T00:05:25.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.530 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.530 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:25.530 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.933385+0000", 2024-09-12T00:05:25.530 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028993900000000002 2024-09-12T00:05:25.530 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.530 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.530 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:25.530 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.950988+0000", 2024-09-12T00:05:25.530 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017603119 2024-09-12T00:05:25.530 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.530 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.530 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:25.530 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951018+0000", 2024-09-12T00:05:25.531 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9343999999999999e-05 2024-09-12T00:05:25.531 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.531 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.531 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:25.531 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951109+0000", 2024-09-12T00:05:25.531 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1157999999999997e-05 2024-09-12T00:05:25.531 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.531 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.531 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:25.531 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951229+0000", 2024-09-12T00:05:25.532 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120646 2024-09-12T00:05:25.532 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.532 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:25.532 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.532 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.532 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.533 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2747 3.17 3:eaa4528d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:25.533 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:25.533 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 37.393303396, 2024-09-12T00:05:25.533 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025552734000000001, 2024-09-12T00:05:25.533 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:25.533 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:25.533 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:25.533 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:25.534 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:25.534 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:25.534 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2747 2024-09-12T00:05:25.534 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.534 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:25.534 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.534 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:25.534 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:25.534 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.534 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.535 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.535 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:25.535 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:25.535 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.535 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.535 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.535 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:25.535 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088925+0000", 2024-09-12T00:05:25.535 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7759999999999999e-06 2024-09-12T00:05:25.535 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.535 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.535 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:25.536 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093002+0000", 2024-09-12T00:05:25.536 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004076405 2024-09-12T00:05:25.536 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.536 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.536 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:25.536 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093040+0000", 2024-09-12T00:05:25.536 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8093999999999998e-05 2024-09-12T00:05:25.536 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.536 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.537 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:25.537 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093059+0000", 2024-09-12T00:05:25.537 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8736000000000002e-05 2024-09-12T00:05:25.537 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.537 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.537 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:25.537 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093230+0000", 2024-09-12T00:05:25.537 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000170853 2024-09-12T00:05:25.537 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.537 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.537 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:25.537 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093627+0000", 2024-09-12T00:05:25.537 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039781400000000002 2024-09-12T00:05:25.538 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.538 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.538 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:25.538 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.094044+0000", 2024-09-12T00:05:25.538 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000416205 2024-09-12T00:05:25.538 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.538 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.538 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:25.538 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.103528+0000", 2024-09-12T00:05:25.538 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0094841549999999993 2024-09-12T00:05:25.538 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.538 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.538 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:25.539 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112299+0000", 2024-09-12T00:05:25.539 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0087711590000000006 2024-09-12T00:05:25.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.539 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.539 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:25.539 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112397+0000", 2024-09-12T00:05:25.539 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8095000000000002e-05 2024-09-12T00:05:25.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.539 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.539 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:25.539 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.114474+0000", 2024-09-12T00:05:25.539 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020774420000000001 2024-09-12T00:05:25.539 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.540 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:25.540 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.540 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.540 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.540 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2962 3.18 3:1b55431a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:25.540 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:19.985385+0000", 2024-09-12T00:05:25.540 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 5.4968401050000004, 2024-09-12T00:05:25.540 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024097998999999998, 2024-09-12T00:05:25.540 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:25.541 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:25.541 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:25.541 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:25.541 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:25.541 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:25.541 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2962 2024-09-12T00:05:25.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.541 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:25.541 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.541 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:25.541 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.985385+0000", 2024-09-12T00:05:25.541 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.541 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.542 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:25.542 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.985385+0000", 2024-09-12T00:05:25.542 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.542 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.542 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.542 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:25.542 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.985388+0000", 2024-09-12T00:05:25.542 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8899999999999999e-06 2024-09-12T00:05:25.542 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.542 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.543 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:25.543 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990021+0000", 2024-09-12T00:05:25.543 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046326850000000001 2024-09-12T00:05:25.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.543 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.543 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:25.543 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990049+0000", 2024-09-12T00:05:25.543 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8007000000000001e-05 2024-09-12T00:05:25.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.543 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.543 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:25.544 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990064+0000", 2024-09-12T00:05:25.544 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4918e-05 2024-09-12T00:05:25.544 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.544 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.544 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:25.544 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990182+0000", 2024-09-12T00:05:25.544 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118958 2024-09-12T00:05:25.544 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.544 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.544 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:25.544 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990449+0000", 2024-09-12T00:05:25.544 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026634899999999998 2024-09-12T00:05:25.544 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.545 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.545 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:25.545 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990677+0000", 2024-09-12T00:05:25.545 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022768800000000001 2024-09-12T00:05:25.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.545 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.545 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:25.545 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.007621+0000", 2024-09-12T00:05:25.545 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016944866999999999 2024-09-12T00:05:25.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.545 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.546 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:25.546 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.009365+0000", 2024-09-12T00:05:25.546 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0017433399999999999 2024-09-12T00:05:25.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.546 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.546 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:25.546 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.009430+0000", 2024-09-12T00:05:25.546 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4813000000000004e-05 2024-09-12T00:05:25.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.546 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.546 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:25.546 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.009483+0000", 2024-09-12T00:05:25.546 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3483999999999998e-05 2024-09-12T00:05:25.547 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.547 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:25.547 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.547 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.547 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2995 3.29 3:96b1390d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:25.547 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.340290+0000", 2024-09-12T00:05:25.547 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 5.1419349639999998, 2024-09-12T00:05:25.547 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022765251, 2024-09-12T00:05:25.548 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:25.548 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:25.548 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:25.548 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:25.548 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:25.548 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:25.548 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2995 2024-09-12T00:05:25.548 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.548 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:25.548 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.548 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:25.548 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.340290+0000", 2024-09-12T00:05:25.549 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.549 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.549 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.549 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:25.549 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.340290+0000", 2024-09-12T00:05:25.549 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.549 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.549 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.549 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:25.549 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.340293+0000", 2024-09-12T00:05:25.549 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2200000000000001e-06 2024-09-12T00:05:25.549 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.549 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.550 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:25.550 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.346557+0000", 2024-09-12T00:05:25.550 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0062637070000000003 2024-09-12T00:05:25.550 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.550 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.550 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:25.550 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.346595+0000", 2024-09-12T00:05:25.550 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7672000000000001e-05 2024-09-12T00:05:25.550 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.550 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.550 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:25.550 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.346620+0000", 2024-09-12T00:05:25.550 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4769999999999998e-05 2024-09-12T00:05:25.550 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.550 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.551 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:25.551 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.346757+0000", 2024-09-12T00:05:25.551 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000137319 2024-09-12T00:05:25.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.551 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:25.551 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.347013+0000", 2024-09-12T00:05:25.551 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025612299999999997 2024-09-12T00:05:25.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.551 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:25.551 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.347237+0000", 2024-09-12T00:05:25.551 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000224348 2024-09-12T00:05:25.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.552 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:25.552 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.357526+0000", 2024-09-12T00:05:25.552 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010288693 2024-09-12T00:05:25.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.552 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:25.552 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.362902+0000", 2024-09-12T00:05:25.552 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053764659999999999 2024-09-12T00:05:25.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.553 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:25.553 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.362988+0000", 2024-09-12T00:05:25.553 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.5086000000000005e-05 2024-09-12T00:05:25.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.553 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:25.553 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.363055+0000", 2024-09-12T00:05:25.553 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.7847000000000003e-05 2024-09-12T00:05:25.553 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.553 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:25.554 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.554 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.554 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3017 3.1e 3:792e6842:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:25.554 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.605222+0000", 2024-09-12T00:05:25.554 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.8770027420000002, 2024-09-12T00:05:25.554 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021662359999999999, 2024-09-12T00:05:25.554 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:25.554 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:25.554 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:25.554 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:25.554 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:25.554 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:25.555 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3017 2024-09-12T00:05:25.555 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.555 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:25.555 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.555 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:25.555 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.605222+0000", 2024-09-12T00:05:25.555 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.555 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.555 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.555 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:25.555 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.605222+0000", 2024-09-12T00:05:25.555 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.555 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.555 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.556 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:25.556 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.605227+0000", 2024-09-12T00:05:25.556 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3100000000000002e-06 2024-09-12T00:05:25.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.556 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.556 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:25.556 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.610360+0000", 2024-09-12T00:05:25.556 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0051331609999999998 2024-09-12T00:05:25.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.556 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.556 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:25.556 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.610400+0000", 2024-09-12T00:05:25.556 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9795000000000001e-05 2024-09-12T00:05:25.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.557 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:25.557 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.610418+0000", 2024-09-12T00:05:25.557 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8539e-05 2024-09-12T00:05:25.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.557 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:25.557 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.610552+0000", 2024-09-12T00:05:25.557 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013348400000000001 2024-09-12T00:05:25.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.558 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.558 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:25.558 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.610799+0000", 2024-09-12T00:05:25.558 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024735600000000001 2024-09-12T00:05:25.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.558 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.558 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:25.558 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611118+0000", 2024-09-12T00:05:25.558 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000318676 2024-09-12T00:05:25.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.558 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.558 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:25.558 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.620061+0000", 2024-09-12T00:05:25.559 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0089429920000000003 2024-09-12T00:05:25.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.559 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.559 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:25.559 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.626735+0000", 2024-09-12T00:05:25.559 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006674803 2024-09-12T00:05:25.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.559 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.559 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:25.559 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.626826+0000", 2024-09-12T00:05:25.559 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0532000000000007e-05 2024-09-12T00:05:25.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.559 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.559 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:25.560 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.626885+0000", 2024-09-12T00:05:25.560 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8712000000000003e-05 2024-09-12T00:05:25.560 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.560 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:25.560 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.560 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.560 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3033 3.1e 3:79681e1a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:25.560 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.771222+0000", 2024-09-12T00:05:25.560 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.711002637, 2024-09-12T00:05:25.560 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.033700292, 2024-09-12T00:05:25.560 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:25.560 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:25.561 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:25.561 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:25.561 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:25.561 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:25.561 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3033 2024-09-12T00:05:25.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.561 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:25.561 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.561 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:25.561 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.771222+0000", 2024-09-12T00:05:25.561 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.561 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.561 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:25.562 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.771222+0000", 2024-09-12T00:05:25.562 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.562 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:25.562 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.771225+0000", 2024-09-12T00:05:25.562 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.74e-06 2024-09-12T00:05:25.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.562 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:25.562 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.775948+0000", 2024-09-12T00:05:25.562 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047228419999999997 2024-09-12T00:05:25.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.563 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:25.563 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.775971+0000", 2024-09-12T00:05:25.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2634999999999999e-05 2024-09-12T00:05:25.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.563 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.563 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:25.563 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.775981+0000", 2024-09-12T00:05:25.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8579999999999995e-06 2024-09-12T00:05:25.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.563 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.563 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:25.563 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.776126+0000", 2024-09-12T00:05:25.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014540500000000001 2024-09-12T00:05:25.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.563 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.564 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:25.564 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.776391+0000", 2024-09-12T00:05:25.564 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026489699999999999 2024-09-12T00:05:25.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.564 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:25.564 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.776613+0000", 2024-09-12T00:05:25.564 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022235700000000001 2024-09-12T00:05:25.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.564 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:25.564 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.783586+0000", 2024-09-12T00:05:25.564 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006972705 2024-09-12T00:05:25.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.565 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.565 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:25.565 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.804641+0000", 2024-09-12T00:05:25.565 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021055470999999999 2024-09-12T00:05:25.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.565 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.565 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:25.565 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.804798+0000", 2024-09-12T00:05:25.565 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015695600000000001 2024-09-12T00:05:25.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.565 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.565 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:25.566 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.804923+0000", 2024-09-12T00:05:25.566 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012442599999999999 2024-09-12T00:05:25.566 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.566 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:25.566 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.566 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3036 3.1e 3:7aa0a48a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:25.566 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.802567+0000", 2024-09-12T00:05:25.567 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.679658527, 2024-09-12T00:05:25.567 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022998985, 2024-09-12T00:05:25.567 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:25.567 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:25.567 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:25.567 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:25.567 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:25.567 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:25.567 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3036 2024-09-12T00:05:25.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.568 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:25.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.568 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:25.568 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.802567+0000", 2024-09-12T00:05:25.568 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.568 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:25.568 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.802567+0000", 2024-09-12T00:05:25.568 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.569 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.569 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:25.569 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.802570+0000", 2024-09-12T00:05:25.569 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3100000000000001e-06 2024-09-12T00:05:25.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.569 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.569 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:25.569 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.807884+0000", 2024-09-12T00:05:25.569 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053139809999999997 2024-09-12T00:05:25.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:25.570 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.807917+0000", 2024-09-12T00:05:25.570 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3334999999999998e-05 2024-09-12T00:05:25.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:25.570 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.807934+0000", 2024-09-12T00:05:25.570 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6543000000000001e-05 2024-09-12T00:05:25.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:25.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.808082+0000", 2024-09-12T00:05:25.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148639 2024-09-12T00:05:25.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.571 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:25.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.808332+0000", 2024-09-12T00:05:25.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024954699999999997 2024-09-12T00:05:25.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.571 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:25.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.808560+0000", 2024-09-12T00:05:25.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000228314 2024-09-12T00:05:25.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.572 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.572 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:25.572 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.817415+0000", 2024-09-12T00:05:25.572 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0088550780000000006 2024-09-12T00:05:25.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.572 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.572 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:25.572 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.825488+0000", 2024-09-12T00:05:25.572 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.008072638 2024-09-12T00:05:25.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.572 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.572 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:25.572 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.825531+0000", 2024-09-12T00:05:25.573 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3272000000000002e-05 2024-09-12T00:05:25.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.573 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:25.573 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.825566+0000", 2024-09-12T00:05:25.573 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4328000000000001e-05 2024-09-12T00:05:25.573 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.573 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:25.573 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.573 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3048 3.29 3:9595c6a5:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:25.573 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.934655+0000", 2024-09-12T00:05:25.573 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.5475704700000001, 2024-09-12T00:05:25.574 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.031642133000000003, 2024-09-12T00:05:25.574 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:25.574 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:25.574 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:25.574 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:25.574 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:25.574 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:25.574 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3048 2024-09-12T00:05:25.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.574 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:25.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.574 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:25.574 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.934655+0000", 2024-09-12T00:05:25.574 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.575 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.575 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:25.575 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.934655+0000", 2024-09-12T00:05:25.575 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.575 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.575 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:25.575 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.934658+0000", 2024-09-12T00:05:25.575 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4970000000000001e-06 2024-09-12T00:05:25.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.575 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.575 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:25.576 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.940147+0000", 2024-09-12T00:05:25.576 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054891940000000002 2024-09-12T00:05:25.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.576 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:25.576 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.940185+0000", 2024-09-12T00:05:25.576 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8056000000000003e-05 2024-09-12T00:05:25.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.576 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:25.576 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.940207+0000", 2024-09-12T00:05:25.576 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2069000000000002e-05 2024-09-12T00:05:25.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.577 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:25.577 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.940392+0000", 2024-09-12T00:05:25.577 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018462200000000001 2024-09-12T00:05:25.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.577 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.577 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:25.577 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.940795+0000", 2024-09-12T00:05:25.577 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040330599999999998 2024-09-12T00:05:25.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.577 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.577 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:25.577 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.941226+0000", 2024-09-12T00:05:25.577 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00043093899999999997 2024-09-12T00:05:25.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.578 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:25.578 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.950900+0000", 2024-09-12T00:05:25.578 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0096740950000000006 2024-09-12T00:05:25.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.578 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:25.578 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.966201+0000", 2024-09-12T00:05:25.578 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015301069 2024-09-12T00:05:25.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.579 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.579 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:25.579 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.966254+0000", 2024-09-12T00:05:25.579 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2825000000000003e-05 2024-09-12T00:05:25.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.579 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.579 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:25.579 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.966297+0000", 2024-09-12T00:05:25.579 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2460999999999999e-05 2024-09-12T00:05:25.579 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.579 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:25.579 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.580 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.580 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3070 3.29 3:96d4e2a7:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:25.580 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.178172+0000", 2024-09-12T00:05:25.580 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.3040533840000004, 2024-09-12T00:05:25.580 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022157735000000001, 2024-09-12T00:05:25.580 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:25.580 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:25.581 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:25.581 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:25.581 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:25.581 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:25.581 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3070 2024-09-12T00:05:25.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.581 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:25.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.582 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:25.582 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.178172+0000", 2024-09-12T00:05:25.582 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.582 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:25.582 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.178172+0000", 2024-09-12T00:05:25.582 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.583 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.583 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:25.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.178175+0000", 2024-09-12T00:05:25.583 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1e-06 2024-09-12T00:05:25.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.583 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.583 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:25.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.182708+0000", 2024-09-12T00:05:25.583 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045331640000000001 2024-09-12T00:05:25.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.583 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.583 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:25.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.182732+0000", 2024-09-12T00:05:25.583 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4034999999999999e-05 2024-09-12T00:05:25.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.584 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.584 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:25.584 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.182744+0000", 2024-09-12T00:05:25.584 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1892999999999999e-05 2024-09-12T00:05:25.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.584 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.584 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:25.584 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.182898+0000", 2024-09-12T00:05:25.584 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015410200000000001 2024-09-12T00:05:25.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.584 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.584 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:25.585 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.183288+0000", 2024-09-12T00:05:25.585 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00038976700000000001 2024-09-12T00:05:25.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.585 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.585 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:25.585 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.183703+0000", 2024-09-12T00:05:25.585 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041542199999999998 2024-09-12T00:05:25.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.585 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.585 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:25.585 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.195712+0000", 2024-09-12T00:05:25.585 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012008705 2024-09-12T00:05:25.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.586 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.586 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:25.586 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.200106+0000", 2024-09-12T00:05:25.586 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043939000000000001 2024-09-12T00:05:25.586 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.586 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.586 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:25.586 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.200212+0000", 2024-09-12T00:05:25.586 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010597700000000001 2024-09-12T00:05:25.586 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.587 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.587 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:25.587 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.200329+0000", 2024-09-12T00:05:25.587 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011767 2024-09-12T00:05:25.587 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.587 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:25.587 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.587 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.587 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.587 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3093 3.1e 3:7a820553:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:25.587 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.517971+0000", 2024-09-12T00:05:25.587 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.9642544260000001, 2024-09-12T00:05:25.587 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022817258999999999, 2024-09-12T00:05:25.588 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:25.588 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:25.588 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:25.588 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:25.588 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:25.588 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:25.588 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3093 2024-09-12T00:05:25.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.588 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:25.588 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.588 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:25.588 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.517971+0000", 2024-09-12T00:05:25.588 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.589 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.589 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:25.589 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.517971+0000", 2024-09-12T00:05:25.589 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.589 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.589 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:25.589 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.517974+0000", 2024-09-12T00:05:25.590 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.05e-06 2024-09-12T00:05:25.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.590 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.590 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:25.590 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.522902+0000", 2024-09-12T00:05:25.590 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049284039999999999 2024-09-12T00:05:25.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.590 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.590 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:25.591 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.522937+0000", 2024-09-12T00:05:25.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4968999999999997e-05 2024-09-12T00:05:25.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.591 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:25.591 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.522953+0000", 2024-09-12T00:05:25.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6186999999999999e-05 2024-09-12T00:05:25.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.591 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:25.591 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.523066+0000", 2024-09-12T00:05:25.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000112506 2024-09-12T00:05:25.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.592 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:25.592 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.523296+0000", 2024-09-12T00:05:25.592 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000229903 2024-09-12T00:05:25.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.592 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.592 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:25.592 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.523530+0000", 2024-09-12T00:05:25.592 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023455700000000001 2024-09-12T00:05:25.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.592 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.592 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:25.592 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.534622+0000", 2024-09-12T00:05:25.592 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011092039999999999 2024-09-12T00:05:25.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.593 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:25.593 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540615+0000", 2024-09-12T00:05:25.593 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059929190000000002 2024-09-12T00:05:25.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.593 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:25.593 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540710+0000", 2024-09-12T00:05:25.593 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5239000000000001e-05 2024-09-12T00:05:25.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.593 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:25.593 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540788+0000", 2024-09-12T00:05:25.594 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7484999999999994e-05 2024-09-12T00:05:25.594 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.594 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:25.594 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.594 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.594 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3099 3.18 3:182e7247:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:25.594 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.611202+0000", 2024-09-12T00:05:25.594 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.8710231880000001, 2024-09-12T00:05:25.594 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.023647292, 2024-09-12T00:05:25.594 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:25.594 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:25.594 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:25.594 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:25.595 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:25.595 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:25.595 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3099 2024-09-12T00:05:25.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.595 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:25.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.595 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:25.595 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.611202+0000", 2024-09-12T00:05:25.595 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.595 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:25.595 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.611202+0000", 2024-09-12T00:05:25.596 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.596 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.596 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:25.596 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.611218+0000", 2024-09-12T00:05:25.596 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5959000000000001e-05 2024-09-12T00:05:25.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.596 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.596 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:25.596 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.615976+0000", 2024-09-12T00:05:25.596 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047581259999999997 2024-09-12T00:05:25.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.597 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.597 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:25.597 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.616010+0000", 2024-09-12T00:05:25.597 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3515e-05 2024-09-12T00:05:25.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.597 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.597 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:25.597 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.616034+0000", 2024-09-12T00:05:25.597 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4956e-05 2024-09-12T00:05:25.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.598 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.598 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:25.598 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.616134+0000", 2024-09-12T00:05:25.598 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9114e-05 2024-09-12T00:05:25.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.598 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.598 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op must wait for map", 2024-09-12T00:05:25.598 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.616140+0000", 2024-09-12T00:05:25.598 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4110000000000001e-06 2024-09-12T00:05:25.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.598 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.598 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:25.598 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.619890+0000", 2024-09-12T00:05:25.599 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037501169999999999 2024-09-12T00:05:25.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.599 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.599 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:25.599 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.620108+0000", 2024-09-12T00:05:25.599 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021770399999999999 2024-09-12T00:05:25.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.599 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.599 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:25.599 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.620327+0000", 2024-09-12T00:05:25.600 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021896799999999999 2024-09-12T00:05:25.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.600 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.600 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:25.600 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.633688+0000", 2024-09-12T00:05:25.600 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013361642 2024-09-12T00:05:25.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.600 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.600 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:25.601 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.634683+0000", 2024-09-12T00:05:25.601 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000994745 2024-09-12T00:05:25.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.601 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.601 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:25.601 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.634779+0000", 2024-09-12T00:05:25.601 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.6059999999999998e-05 2024-09-12T00:05:25.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.601 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.601 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:25.601 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.634849+0000", 2024-09-12T00:05:25.602 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9974999999999993e-05 2024-09-12T00:05:25.602 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.602 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:25.602 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.602 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.602 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3119 3.31 3:8fd3d951:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:25.602 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.840627+0000", 2024-09-12T00:05:25.602 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.6415976919999999, 2024-09-12T00:05:25.602 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022334611000000001, 2024-09-12T00:05:25.602 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:25.602 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:25.603 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:25.603 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:25.603 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:25.603 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:25.603 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3119 2024-09-12T00:05:25.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.603 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:25.603 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.603 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:25.603 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.840627+0000", 2024-09-12T00:05:25.603 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:25.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.840627+0000", 2024-09-12T00:05:25.604 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:25.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.840659+0000", 2024-09-12T00:05:25.605 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1534e-05 2024-09-12T00:05:25.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:25.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.844903+0000", 2024-09-12T00:05:25.605 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042441659999999997 2024-09-12T00:05:25.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:25.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.844932+0000", 2024-09-12T00:05:25.605 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8605000000000001e-05 2024-09-12T00:05:25.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:25.606 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.844948+0000", 2024-09-12T00:05:25.606 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5914e-05 2024-09-12T00:05:25.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.606 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.606 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:25.606 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.845021+0000", 2024-09-12T00:05:25.606 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.339e-05 2024-09-12T00:05:25.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.606 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.606 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:25.606 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.845141+0000", 2024-09-12T00:05:25.606 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000119821 2024-09-12T00:05:25.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.607 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.607 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:25.607 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.845242+0000", 2024-09-12T00:05:25.607 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000101545 2024-09-12T00:05:25.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.607 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.607 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:25.607 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.852177+0000", 2024-09-12T00:05:25.607 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0069342809999999996 2024-09-12T00:05:25.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.607 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.607 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:25.607 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.862873+0000", 2024-09-12T00:05:25.607 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010696359000000001 2024-09-12T00:05:25.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.608 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.608 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:25.608 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.862921+0000", 2024-09-12T00:05:25.608 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7793000000000001e-05 2024-09-12T00:05:25.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.608 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.608 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:25.608 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.862962+0000", 2024-09-12T00:05:25.608 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1202999999999998e-05 2024-09-12T00:05:25.608 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.608 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:25.609 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.609 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.609 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3123 3.3d 3:bd29fd76:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:25.609 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.893071+0000", 2024-09-12T00:05:25.609 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.5891545570000001, 2024-09-12T00:05:25.609 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022412392999999999, 2024-09-12T00:05:25.609 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:25.609 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:25.609 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:25.609 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:25.609 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:25.609 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:25.610 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3123 2024-09-12T00:05:25.610 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.610 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:25.610 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.610 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:25.610 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.893071+0000", 2024-09-12T00:05:25.610 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.610 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.610 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.610 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:25.611 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.893071+0000", 2024-09-12T00:05:25.611 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.611 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.611 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:25.611 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.893073+0000", 2024-09-12T00:05:25.611 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3479999999999998e-06 2024-09-12T00:05:25.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.611 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.611 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:25.611 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.897186+0000", 2024-09-12T00:05:25.611 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004112709 2024-09-12T00:05:25.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.611 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.612 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:25.612 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.897210+0000", 2024-09-12T00:05:25.612 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4763999999999999e-05 2024-09-12T00:05:25.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.612 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:25.612 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.897220+0000", 2024-09-12T00:05:25.612 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3810000000000005e-06 2024-09-12T00:05:25.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.612 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:25.612 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.897340+0000", 2024-09-12T00:05:25.612 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012034199999999999 2024-09-12T00:05:25.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.613 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:25.613 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.897604+0000", 2024-09-12T00:05:25.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026359300000000001 2024-09-12T00:05:25.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.613 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:25.613 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.897868+0000", 2024-09-12T00:05:25.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026388300000000002 2024-09-12T00:05:25.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.613 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:25.614 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.913985+0000", 2024-09-12T00:05:25.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016117359000000001 2024-09-12T00:05:25.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.614 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:25.614 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915189+0000", 2024-09-12T00:05:25.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012040250000000001 2024-09-12T00:05:25.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.614 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:25.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915349+0000", 2024-09-12T00:05:25.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015957999999999999 2024-09-12T00:05:25.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:25.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915483+0000", 2024-09-12T00:05:25.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013440899999999999 2024-09-12T00:05:25.615 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.615 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:25.615 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.615 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3133 3.10 e76/23 3:0bd95b9d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_172:head v 76'8, mlcod=63'6)", 2024-09-12T00:05:25.615 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.030942+0000", 2024-09-12T00:05:25.616 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.451282907, 2024-09-12T00:05:25.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024435973999999999, 2024-09-12T00:05:25.616 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:25.616 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:25.616 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:25.616 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:25.616 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.616 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:25.616 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.030942+0000", 2024-09-12T00:05:25.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.616 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.616 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.616 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:25.617 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.030942+0000", 2024-09-12T00:05:25.617 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:25.617 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.030950+0000", 2024-09-12T00:05:25.617 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0499999999999992e-06 2024-09-12T00:05:25.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:25.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039165+0000", 2024-09-12T00:05:25.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082151329999999995 2024-09-12T00:05:25.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.618 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:25.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039194+0000", 2024-09-12T00:05:25.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8425999999999999e-05 2024-09-12T00:05:25.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.618 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:25.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039210+0000", 2024-09-12T00:05:25.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5886e-05 2024-09-12T00:05:25.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.618 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:25.619 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039366+0000", 2024-09-12T00:05:25.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015638300000000001 2024-09-12T00:05:25.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.619 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:25.619 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039410+0000", 2024-09-12T00:05:25.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3958999999999997e-05 2024-09-12T00:05:25.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.619 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:25.619 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.055263+0000", 2024-09-12T00:05:25.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015852926 2024-09-12T00:05:25.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.620 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:25.620 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.055378+0000", 2024-09-12T00:05:25.620 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011521100000000001 2024-09-12T00:05:25.620 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.620 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:25.620 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.621 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3147 3.3e 3:7c719451:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:25.621 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.204783+0000", 2024-09-12T00:05:25.621 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.277441729, 2024-09-12T00:05:25.621 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028014297000000001, 2024-09-12T00:05:25.621 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:25.621 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:25.621 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:25.621 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:25.621 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:25.621 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:25.621 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3147 2024-09-12T00:05:25.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.622 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:25.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.622 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:25.622 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.204783+0000", 2024-09-12T00:05:25.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.622 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:25.622 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.204783+0000", 2024-09-12T00:05:25.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:25.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.623 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:25.623 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.204787+0000", 2024-09-12T00:05:25.623 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0759999999999996e-06 2024-09-12T00:05:25.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.623 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:25.623 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.210868+0000", 2024-09-12T00:05:25.623 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0060804530000000004 2024-09-12T00:05:25.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.623 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:25.623 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.210894+0000", 2024-09-12T00:05:25.623 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6571999999999999e-05 2024-09-12T00:05:25.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:25.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.210907+0000", 2024-09-12T00:05:25.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2437e-05 2024-09-12T00:05:25.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:25.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.211064+0000", 2024-09-12T00:05:25.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015706800000000001 2024-09-12T00:05:25.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:25.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.211461+0000", 2024-09-12T00:05:25.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039665300000000001 2024-09-12T00:05:25.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:25.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.211880+0000", 2024-09-12T00:05:25.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000419503 2024-09-12T00:05:25.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:25.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.226312+0000", 2024-09-12T00:05:25.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014432228 2024-09-12T00:05:25.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:25.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.232496+0000", 2024-09-12T00:05:25.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061839579999999998 2024-09-12T00:05:25.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:25.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.232677+0000", 2024-09-12T00:05:25.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000181132 2024-09-12T00:05:25.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:25.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:25.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:25.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.232798+0000", 2024-09-12T00:05:25.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120217 2024-09-12T00:05:25.627 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.627 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:25.627 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.627 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:25.627 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:25.627 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:25.629 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:05:25.629 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:25.628+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:25.730 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:25.732+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:25.760 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:25.760 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:25.760 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:25.760 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:25.774 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:05:25.831 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:25.828+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:25.896 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:25.897 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:25.897 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:25.897 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:25.897 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:25.910 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:05:25.955 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:25.952+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:26.033 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:26.032+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:26.082 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:26.082 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:26.082 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:26.082 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:26.082 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.082 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1646 3.25 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:05:26.082 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:26.082 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 53.003304946999997, 2024-09-12T00:05:26.082 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030091884999999999, 2024-09-12T00:05:26.082 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.082 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.082 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.083 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.083 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.083 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.083 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1646 2024-09-12T00:05:26.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.083 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.083 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.083 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.083 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:26.083 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.083 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.083 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.083 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:26.084 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.084 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.084 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.084 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077113+0000", 2024-09-12T00:05:26.084 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0186e-05 2024-09-12T00:05:26.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.084 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.084 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.084 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084821+0000", 2024-09-12T00:05:26.084 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077083450000000001 2024-09-12T00:05:26.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.084 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.084 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.085 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084857+0000", 2024-09-12T00:05:26.085 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6245000000000003e-05 2024-09-12T00:05:26.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.085 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.085 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.085 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084900+0000", 2024-09-12T00:05:26.085 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2369e-05 2024-09-12T00:05:26.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.085 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.085 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.085 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085058+0000", 2024-09-12T00:05:26.085 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015858199999999999 2024-09-12T00:05:26.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.086 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.086 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.086 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085307+0000", 2024-09-12T00:05:26.086 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024867999999999998 2024-09-12T00:05:26.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.086 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.086 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:26.086 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086107+0000", 2024-09-12T00:05:26.086 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00080040099999999996 2024-09-12T00:05:26.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.086 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.086 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.086 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.100477+0000", 2024-09-12T00:05:26.086 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014369508 2024-09-12T00:05:26.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.087 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.087 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.087 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107016+0000", 2024-09-12T00:05:26.087 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006538894 2024-09-12T00:05:26.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.087 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.087 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.087 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107121+0000", 2024-09-12T00:05:26.087 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105284 2024-09-12T00:05:26.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.087 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.087 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.087 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107194+0000", 2024-09-12T00:05:26.088 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3391000000000003e-05 2024-09-12T00:05:26.088 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.088 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.088 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.088 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.088 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1917 3.1 3:829295ac:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.4_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:05:26.088 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:26.088 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 50.915221467000002, 2024-09-12T00:05:26.088 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021401453000000001, 2024-09-12T00:05:26.088 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.088 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.088 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.089 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.089 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.089 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.089 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1917 2024-09-12T00:05:26.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.089 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.089 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.089 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.089 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:26.089 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.089 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.090 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.090 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:26.090 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.090 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.090 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.090 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165188+0000", 2024-09-12T00:05:26.090 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5409999999999999e-06 2024-09-12T00:05:26.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.090 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.090 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.090 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169353+0000", 2024-09-12T00:05:26.090 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00416446 2024-09-12T00:05:26.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.091 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.091 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.091 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169380+0000", 2024-09-12T00:05:26.091 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6919000000000001e-05 2024-09-12T00:05:26.091 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.091 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.091 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.091 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169392+0000", 2024-09-12T00:05:26.091 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1967000000000001e-05 2024-09-12T00:05:26.091 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.091 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.091 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.091 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169519+0000", 2024-09-12T00:05:26.091 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012686199999999999 2024-09-12T00:05:26.092 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.092 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.092 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.092 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169789+0000", 2024-09-12T00:05:26.092 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027062700000000001 2024-09-12T00:05:26.092 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.092 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.092 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:26.092 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.170614+0000", 2024-09-12T00:05:26.092 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00082475799999999998 2024-09-12T00:05:26.092 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.092 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.092 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.092 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.183665+0000", 2024-09-12T00:05:26.093 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013051269000000001 2024-09-12T00:05:26.093 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.093 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.093 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.093 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186367+0000", 2024-09-12T00:05:26.093 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002701789 2024-09-12T00:05:26.093 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.093 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.093 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.093 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186485+0000", 2024-09-12T00:05:26.093 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011763400000000001 2024-09-12T00:05:26.093 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.093 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.093 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.094 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186587+0000", 2024-09-12T00:05:26.094 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010262700000000001 2024-09-12T00:05:26.094 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.094 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.094 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.094 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.094 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.094 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2718 3.4 3:20fe36bb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:26.094 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:26.094 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 38.294826788999998, 2024-09-12T00:05:26.094 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027867928, 2024-09-12T00:05:26.094 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.095 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.095 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.095 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.095 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.095 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.095 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2718 2024-09-12T00:05:26.095 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.095 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.095 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.095 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.095 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:26.095 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.095 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.096 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.096 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.096 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:26.096 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.096 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.096 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.096 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.096 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785584+0000", 2024-09-12T00:05:26.096 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.056e-06 2024-09-12T00:05:26.096 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.096 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.096 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.096 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792023+0000", 2024-09-12T00:05:26.097 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064398069999999996 2024-09-12T00:05:26.097 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.097 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.097 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.097 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792058+0000", 2024-09-12T00:05:26.097 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5018000000000003e-05 2024-09-12T00:05:26.097 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.097 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.097 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.097 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792078+0000", 2024-09-12T00:05:26.097 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9862000000000001e-05 2024-09-12T00:05:26.097 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.097 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.097 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.098 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792248+0000", 2024-09-12T00:05:26.098 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017006399999999999 2024-09-12T00:05:26.098 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.098 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.098 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.098 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792660+0000", 2024-09-12T00:05:26.098 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041189500000000001 2024-09-12T00:05:26.098 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.098 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.098 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:26.098 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793081+0000", 2024-09-12T00:05:26.098 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000420395 2024-09-12T00:05:26.098 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.098 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.098 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.099 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808422+0000", 2024-09-12T00:05:26.099 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015341626000000001 2024-09-12T00:05:26.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.099 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.099 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.099 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813192+0000", 2024-09-12T00:05:26.099 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047701799999999997 2024-09-12T00:05:26.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.099 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.099 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.099 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813339+0000", 2024-09-12T00:05:26.099 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014643800000000001 2024-09-12T00:05:26.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.099 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.100 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.100 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813449+0000", 2024-09-12T00:05:26.100 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010958700000000001 2024-09-12T00:05:26.100 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.100 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.100 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.100 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.100 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.100 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2719 3.1 3:83b62cc7:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:26.100 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:26.101 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 38.286319352, 2024-09-12T00:05:26.101 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021687128999999999, 2024-09-12T00:05:26.101 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.101 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.101 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.101 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.101 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.102 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.102 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2719 2024-09-12T00:05:26.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.102 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.102 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.102 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.102 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:26.102 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.102 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.102 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.102 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:26.103 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.103 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.103 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.103 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794091+0000", 2024-09-12T00:05:26.103 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0630000000000002e-06 2024-09-12T00:05:26.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.103 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.104 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.104 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800194+0000", 2024-09-12T00:05:26.104 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061025089999999999 2024-09-12T00:05:26.104 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.104 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.104 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.104 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800234+0000", 2024-09-12T00:05:26.104 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0114999999999998e-05 2024-09-12T00:05:26.104 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.105 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.105 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.105 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800255+0000", 2024-09-12T00:05:26.105 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1548000000000001e-05 2024-09-12T00:05:26.105 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.105 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.105 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.105 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800400+0000", 2024-09-12T00:05:26.106 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014438499999999999 2024-09-12T00:05:26.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.106 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.106 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.106 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800654+0000", 2024-09-12T00:05:26.106 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025430500000000003 2024-09-12T00:05:26.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.106 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.106 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:26.106 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800908+0000", 2024-09-12T00:05:26.106 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025422800000000001 2024-09-12T00:05:26.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.106 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.106 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.106 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.814197+0000", 2024-09-12T00:05:26.107 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013289216 2024-09-12T00:05:26.107 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.107 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.107 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.107 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815578+0000", 2024-09-12T00:05:26.107 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00138079 2024-09-12T00:05:26.107 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.107 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.107 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.107 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815704+0000", 2024-09-12T00:05:26.107 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012551500000000001 2024-09-12T00:05:26.107 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.107 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.108 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.108 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815775+0000", 2024-09-12T00:05:26.108 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1454999999999999e-05 2024-09-12T00:05:26.108 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.108 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.108 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.108 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.108 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.108 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2736 3.25 3:a750a681:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:26.108 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:26.108 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 38.105054426999999, 2024-09-12T00:05:26.108 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025701234999999999, 2024-09-12T00:05:26.108 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.108 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.109 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.109 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.109 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.109 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.109 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2736 2024-09-12T00:05:26.109 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.109 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.109 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.109 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.109 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:26.109 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.109 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.109 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.110 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.110 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:26.110 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.110 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.110 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.110 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.110 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975357+0000", 2024-09-12T00:05:26.110 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9389999999999999e-06 2024-09-12T00:05:26.110 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.110 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.110 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.110 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979365+0000", 2024-09-12T00:05:26.110 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040076679999999998 2024-09-12T00:05:26.110 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.111 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.111 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.111 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979402+0000", 2024-09-12T00:05:26.111 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7557e-05 2024-09-12T00:05:26.111 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.111 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.111 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.111 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979419+0000", 2024-09-12T00:05:26.111 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7203000000000001e-05 2024-09-12T00:05:26.111 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.111 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.111 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.111 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979543+0000", 2024-09-12T00:05:26.112 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000123423 2024-09-12T00:05:26.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.112 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.112 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.112 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979784+0000", 2024-09-12T00:05:26.112 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024097800000000001 2024-09-12T00:05:26.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.112 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.112 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:26.112 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980013+0000", 2024-09-12T00:05:26.112 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022881999999999999 2024-09-12T00:05:26.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.112 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.113 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.113 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.999860+0000", 2024-09-12T00:05:26.113 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019847908000000001 2024-09-12T00:05:26.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.113 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.113 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.113 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000741+0000", 2024-09-12T00:05:26.113 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00088041499999999995 2024-09-12T00:05:26.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.113 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.113 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.113 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000915+0000", 2024-09-12T00:05:26.113 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017460300000000001 2024-09-12T00:05:26.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.114 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.114 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.114 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.001054+0000", 2024-09-12T00:05:26.114 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013872099999999999 2024-09-12T00:05:26.114 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.114 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.114 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.114 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.114 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.114 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2737 3.25 3:a794c975:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:26.114 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:26.114 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 38.095041621, 2024-09-12T00:05:26.114 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022562862999999999, 2024-09-12T00:05:26.114 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.115 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.115 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.115 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.115 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.115 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.115 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2737 2024-09-12T00:05:26.115 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.115 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.115 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.115 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.115 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:26.115 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.115 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.115 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.116 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.116 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:26.116 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.116 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.116 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.116 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.116 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985368+0000", 2024-09-12T00:05:26.116 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.323e-06 2024-09-12T00:05:26.116 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.116 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.116 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.116 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990209+0000", 2024-09-12T00:05:26.116 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004840446 2024-09-12T00:05:26.116 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.117 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.117 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.117 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990255+0000", 2024-09-12T00:05:26.117 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6526999999999997e-05 2024-09-12T00:05:26.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.117 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.117 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.117 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990283+0000", 2024-09-12T00:05:26.117 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7631e-05 2024-09-12T00:05:26.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.117 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.117 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.117 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990445+0000", 2024-09-12T00:05:26.117 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016238400000000001 2024-09-12T00:05:26.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.118 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.118 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.118 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990732+0000", 2024-09-12T00:05:26.118 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028698299999999999 2024-09-12T00:05:26.118 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.118 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.118 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:26.118 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.991001+0000", 2024-09-12T00:05:26.118 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026869099999999999 2024-09-12T00:05:26.118 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.118 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.118 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.118 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007077+0000", 2024-09-12T00:05:26.118 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016076686999999999 2024-09-12T00:05:26.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.119 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.119 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.119 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007761+0000", 2024-09-12T00:05:26.119 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00068366399999999995 2024-09-12T00:05:26.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.119 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.119 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.119 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007860+0000", 2024-09-12T00:05:26.119 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8513999999999999e-05 2024-09-12T00:05:26.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.119 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.119 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.119 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007929+0000", 2024-09-12T00:05:26.120 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9012999999999998e-05 2024-09-12T00:05:26.120 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.120 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.120 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.120 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.120 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2751 3.4 3:20d2ffb1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:26.120 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.134356+0000", 2024-09-12T00:05:26.120 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 37.946051838000002, 2024-09-12T00:05:26.120 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020400522000000001, 2024-09-12T00:05:26.120 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.120 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.120 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.120 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.121 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.121 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.121 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2751 2024-09-12T00:05:26.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.121 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.121 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.121 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.121 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.134356+0000", 2024-09-12T00:05:26.121 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.121 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.121 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.121 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.134356+0000", 2024-09-12T00:05:26.121 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.122 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.122 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.122 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.134359+0000", 2024-09-12T00:05:26.122 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9900000000000002e-06 2024-09-12T00:05:26.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.122 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.122 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.122 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138490+0000", 2024-09-12T00:05:26.122 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041315609999999997 2024-09-12T00:05:26.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.122 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.122 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.122 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138524+0000", 2024-09-12T00:05:26.123 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3868000000000002e-05 2024-09-12T00:05:26.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.123 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.123 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138544+0000", 2024-09-12T00:05:26.123 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9539e-05 2024-09-12T00:05:26.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.123 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.123 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138697+0000", 2024-09-12T00:05:26.123 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015332400000000001 2024-09-12T00:05:26.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.123 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.124 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138931+0000", 2024-09-12T00:05:26.124 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023418700000000001 2024-09-12T00:05:26.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.124 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.124 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:26.124 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.139162+0000", 2024-09-12T00:05:26.124 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000230943 2024-09-12T00:05:26.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.124 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.124 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.124 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.149454+0000", 2024-09-12T00:05:26.124 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010291560999999999 2024-09-12T00:05:26.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.125 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.125 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.125 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.153905+0000", 2024-09-12T00:05:26.125 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004451666 2024-09-12T00:05:26.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.125 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.125 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.125 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154405+0000", 2024-09-12T00:05:26.125 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00049978100000000003 2024-09-12T00:05:26.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.125 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.125 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.126 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154756+0000", 2024-09-12T00:05:26.126 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000351102 2024-09-12T00:05:26.126 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.126 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.126 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.126 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.126 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2755 3.25 3:a666dbcf:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:26.126 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.181692+0000", 2024-09-12T00:05:26.126 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 37.898715422999999, 2024-09-12T00:05:26.126 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020464659, 2024-09-12T00:05:26.126 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.126 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.127 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.127 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.127 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.127 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.127 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2755 2024-09-12T00:05:26.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.127 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.127 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.127 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.127 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.181692+0000", 2024-09-12T00:05:26.127 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.127 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.127 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.128 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.181692+0000", 2024-09-12T00:05:26.128 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.128 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.128 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.128 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.181695+0000", 2024-09-12T00:05:26.128 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0800000000000002e-06 2024-09-12T00:05:26.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.128 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.128 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.128 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185668+0000", 2024-09-12T00:05:26.128 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039727970000000001 2024-09-12T00:05:26.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.129 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.129 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.129 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185699+0000", 2024-09-12T00:05:26.129 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1424999999999998e-05 2024-09-12T00:05:26.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.129 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.129 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.129 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185722+0000", 2024-09-12T00:05:26.129 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2972e-05 2024-09-12T00:05:26.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.129 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.129 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.129 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185860+0000", 2024-09-12T00:05:26.129 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000138016 2024-09-12T00:05:26.130 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.130 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.130 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.130 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.186096+0000", 2024-09-12T00:05:26.130 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023611899999999999 2024-09-12T00:05:26.130 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.130 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.130 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:26.130 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.186318+0000", 2024-09-12T00:05:26.130 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000221177 2024-09-12T00:05:26.130 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.130 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.130 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.130 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.199301+0000", 2024-09-12T00:05:26.130 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012983949999999999 2024-09-12T00:05:26.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.131 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.131 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.131 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.201991+0000", 2024-09-12T00:05:26.131 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026896889999999999 2024-09-12T00:05:26.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.131 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.131 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.131 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.202083+0000", 2024-09-12T00:05:26.131 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1598e-05 2024-09-12T00:05:26.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.131 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.131 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.131 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.202157+0000", 2024-09-12T00:05:26.132 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3836000000000003e-05 2024-09-12T00:05:26.132 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.132 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.132 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.132 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.132 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.132 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2962 3.18 e75/23 3:1b55431a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_1:head v 75'6, mlcod=63'4)", 2024-09-12T00:05:26.132 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:19.990870+0000", 2024-09-12T00:05:26.132 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.0895374369999997, 2024-09-12T00:05:26.132 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018164309999999999, 2024-09-12T00:05:26.132 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.132 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.132 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.133 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.133 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.133 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.133 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990870+0000", 2024-09-12T00:05:26.133 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.133 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.133 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.133 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990870+0000", 2024-09-12T00:05:26.133 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.133 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.133 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.133 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990873+0000", 2024-09-12T00:05:26.134 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3799999999999998e-06 2024-09-12T00:05:26.134 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.134 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.134 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.134 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995189+0000", 2024-09-12T00:05:26.134 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004315859 2024-09-12T00:05:26.134 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.134 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.134 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.134 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995232+0000", 2024-09-12T00:05:26.134 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2636000000000003e-05 2024-09-12T00:05:26.134 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.134 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.134 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.135 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995249+0000", 2024-09-12T00:05:26.135 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7563000000000001e-05 2024-09-12T00:05:26.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.135 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.135 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.135 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995357+0000", 2024-09-12T00:05:26.135 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010737 2024-09-12T00:05:26.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.135 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.135 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.135 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995386+0000", 2024-09-12T00:05:26.135 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8895999999999999e-05 2024-09-12T00:05:26.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.135 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.136 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.136 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.008964+0000", 2024-09-12T00:05:26.136 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013578209000000001 2024-09-12T00:05:26.136 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.136 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.136 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.136 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.009034+0000", 2024-09-12T00:05:26.136 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.0396999999999997e-05 2024-09-12T00:05:26.136 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.136 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.136 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.136 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.136 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.136 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2964 3.24 3:26c83ec0:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:26.137 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:26.137 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.0749926250000001, 2024-09-12T00:05:26.137 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028979713000000001, 2024-09-12T00:05:26.137 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.137 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.137 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.137 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.137 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.137 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.137 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2964 2024-09-12T00:05:26.137 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.137 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.137 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.138 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.138 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:26.138 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.138 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.138 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.138 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:26.138 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.138 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.138 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.138 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005417+0000", 2024-09-12T00:05:26.138 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2450000000000001e-06 2024-09-12T00:05:26.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.139 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.139 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.139 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010885+0000", 2024-09-12T00:05:26.139 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054684809999999999 2024-09-12T00:05:26.139 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.139 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.139 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.139 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010901+0000", 2024-09-12T00:05:26.139 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5097e-05 2024-09-12T00:05:26.139 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.139 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.139 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.139 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010908+0000", 2024-09-12T00:05:26.139 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7419999999999997e-06 2024-09-12T00:05:26.140 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.140 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.140 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.140 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010968+0000", 2024-09-12T00:05:26.140 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.9837000000000003e-05 2024-09-12T00:05:26.140 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.140 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.140 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.140 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011082+0000", 2024-09-12T00:05:26.140 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011357399999999999 2024-09-12T00:05:26.140 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.140 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.140 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:26.140 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011174+0000", 2024-09-12T00:05:26.141 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2703999999999999e-05 2024-09-12T00:05:26.141 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.141 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.141 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.141 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.021639+0000", 2024-09-12T00:05:26.141 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010464641 2024-09-12T00:05:26.141 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.141 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.141 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.141 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034210+0000", 2024-09-12T00:05:26.141 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012570463 2024-09-12T00:05:26.141 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.141 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.141 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.142 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034300+0000", 2024-09-12T00:05:26.142 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0691000000000003e-05 2024-09-12T00:05:26.142 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.142 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.142 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.142 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034394+0000", 2024-09-12T00:05:26.142 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4238000000000001e-05 2024-09-12T00:05:26.142 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.142 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.142 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.142 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.142 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.142 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2968 3.25 3:a7d7195d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:26.143 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.046591+0000", 2024-09-12T00:05:26.143 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.0338165220000004, 2024-09-12T00:05:26.143 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019137155999999999, 2024-09-12T00:05:26.143 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.143 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.143 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.143 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.143 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.143 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.143 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2968 2024-09-12T00:05:26.143 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.143 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.143 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.143 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.143 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.046591+0000", 2024-09-12T00:05:26.144 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.144 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.144 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.144 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.144 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.046591+0000", 2024-09-12T00:05:26.144 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.144 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.144 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.144 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.144 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.046594+0000", 2024-09-12T00:05:26.144 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0759999999999999e-06 2024-09-12T00:05:26.144 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.144 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.144 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.145 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.050723+0000", 2024-09-12T00:05:26.145 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041287700000000004 2024-09-12T00:05:26.145 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.145 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.145 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.145 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.050749+0000", 2024-09-12T00:05:26.145 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5958000000000001e-05 2024-09-12T00:05:26.145 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.145 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.145 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.145 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.050760+0000", 2024-09-12T00:05:26.145 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1367e-05 2024-09-12T00:05:26.145 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.145 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.146 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.146 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.050855+0000", 2024-09-12T00:05:26.146 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5043999999999993e-05 2024-09-12T00:05:26.146 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.146 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.146 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.146 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.051009+0000", 2024-09-12T00:05:26.146 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015416799999999999 2024-09-12T00:05:26.146 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.146 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.146 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:26.146 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.051169+0000", 2024-09-12T00:05:26.146 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000159858 2024-09-12T00:05:26.146 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.147 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.147 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.147 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.057181+0000", 2024-09-12T00:05:26.147 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006011438 2024-09-12T00:05:26.147 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.147 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.147 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.147 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.065613+0000", 2024-09-12T00:05:26.147 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0084321569999999992 2024-09-12T00:05:26.147 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.147 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.147 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.147 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.065670+0000", 2024-09-12T00:05:26.147 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7089000000000002e-05 2024-09-12T00:05:26.147 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.148 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.148 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.148 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.065728+0000", 2024-09-12T00:05:26.148 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8230999999999999e-05 2024-09-12T00:05:26.148 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.148 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.148 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.148 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.148 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.148 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3052 3.32 3:4d6db9ea:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:26.148 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:26.148 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 5.1007459989999999, 2024-09-12T00:05:26.148 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028091277000000001, 2024-09-12T00:05:26.148 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.149 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.149 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.149 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.149 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.149 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.149 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3052 2024-09-12T00:05:26.149 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.149 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.149 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.150 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.150 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:26.150 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.150 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.150 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.150 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:26.150 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.150 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.150 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.150 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979664+0000", 2024-09-12T00:05:26.150 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:05:26.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.151 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.151 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.151 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986918+0000", 2024-09-12T00:05:26.151 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0072537110000000004 2024-09-12T00:05:26.151 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.151 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.151 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.151 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986956+0000", 2024-09-12T00:05:26.151 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8111999999999997e-05 2024-09-12T00:05:26.151 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.151 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.151 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.151 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986975+0000", 2024-09-12T00:05:26.152 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9245999999999998e-05 2024-09-12T00:05:26.152 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.152 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.152 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.152 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987159+0000", 2024-09-12T00:05:26.152 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000183828 2024-09-12T00:05:26.152 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.152 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.152 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.152 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987552+0000", 2024-09-12T00:05:26.152 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039349699999999998 2024-09-12T00:05:26.152 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.152 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.153 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:26.153 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987943+0000", 2024-09-12T00:05:26.153 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000390579 2024-09-12T00:05:26.153 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.153 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.153 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.153 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.999384+0000", 2024-09-12T00:05:26.153 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011441563 2024-09-12T00:05:26.153 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.153 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.153 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.154 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007634+0000", 2024-09-12T00:05:26.154 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082496240000000005 2024-09-12T00:05:26.154 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.154 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.154 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.154 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007699+0000", 2024-09-12T00:05:26.154 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5089e-05 2024-09-12T00:05:26.154 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.154 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.154 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.154 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007753+0000", 2024-09-12T00:05:26.154 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3588000000000003e-05 2024-09-12T00:05:26.155 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.155 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.155 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.155 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.155 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.155 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3064 3.4 3:209c6609:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:26.155 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:26.155 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.9684307209999998, 2024-09-12T00:05:26.155 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024628305999999999, 2024-09-12T00:05:26.155 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.155 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.156 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.156 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.156 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.156 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.156 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3064 2024-09-12T00:05:26.156 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.156 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.156 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.156 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.156 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:26.156 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.156 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.156 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.157 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.157 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:26.157 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.157 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.157 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.157 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.157 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111980+0000", 2024-09-12T00:05:26.157 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.005e-06 2024-09-12T00:05:26.157 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.157 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.157 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.157 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116464+0000", 2024-09-12T00:05:26.157 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044839210000000001 2024-09-12T00:05:26.157 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.158 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.158 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.158 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116490+0000", 2024-09-12T00:05:26.158 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6690999999999999e-05 2024-09-12T00:05:26.158 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.158 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.158 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.158 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116504+0000", 2024-09-12T00:05:26.158 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4109e-05 2024-09-12T00:05:26.158 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.158 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.158 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.158 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116639+0000", 2024-09-12T00:05:26.158 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013427 2024-09-12T00:05:26.159 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.159 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.159 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.159 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116931+0000", 2024-09-12T00:05:26.159 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000292603 2024-09-12T00:05:26.159 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.159 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.159 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:26.159 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.117174+0000", 2024-09-12T00:05:26.159 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024240700000000001 2024-09-12T00:05:26.159 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.159 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.159 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.159 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126449+0000", 2024-09-12T00:05:26.160 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0092748699999999993 2024-09-12T00:05:26.160 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.160 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.160 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.160 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136438+0000", 2024-09-12T00:05:26.160 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099898539999999994 2024-09-12T00:05:26.160 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.160 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.160 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.160 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136532+0000", 2024-09-12T00:05:26.160 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3898000000000001e-05 2024-09-12T00:05:26.160 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.160 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.160 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.160 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136605+0000", 2024-09-12T00:05:26.161 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2677999999999998e-05 2024-09-12T00:05:26.161 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.161 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.161 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.161 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.161 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.161 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3094 3.33 3:cfcc7f7f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:26.161 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.540440+0000", 2024-09-12T00:05:26.161 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.5399675980000005, 2024-09-12T00:05:26.161 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021132270000000002, 2024-09-12T00:05:26.161 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.161 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.161 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.161 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.162 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.162 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.162 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3094 2024-09-12T00:05:26.162 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.162 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.162 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.162 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.162 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540440+0000", 2024-09-12T00:05:26.162 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.162 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.162 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.162 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.162 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540440+0000", 2024-09-12T00:05:26.162 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.163 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.163 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.163 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.163 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540442+0000", 2024-09-12T00:05:26.163 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9599999999999999e-06 2024-09-12T00:05:26.163 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.163 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.163 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.163 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545099+0000", 2024-09-12T00:05:26.163 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046570359999999998 2024-09-12T00:05:26.163 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.163 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.163 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.163 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545122+0000", 2024-09-12T00:05:26.163 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3485999999999998e-05 2024-09-12T00:05:26.164 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.164 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.164 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.164 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545135+0000", 2024-09-12T00:05:26.164 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3073e-05 2024-09-12T00:05:26.164 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.164 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.164 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.164 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545252+0000", 2024-09-12T00:05:26.164 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011621299999999999 2024-09-12T00:05:26.164 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.164 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.164 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.164 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545450+0000", 2024-09-12T00:05:26.165 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000198474 2024-09-12T00:05:26.165 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.165 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.165 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:26.165 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545580+0000", 2024-09-12T00:05:26.165 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013033899999999999 2024-09-12T00:05:26.165 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.165 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.165 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.165 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.552356+0000", 2024-09-12T00:05:26.165 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0067756240000000001 2024-09-12T00:05:26.165 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.165 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.165 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.166 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.560831+0000", 2024-09-12T00:05:26.166 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0084745440000000005 2024-09-12T00:05:26.166 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.166 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.166 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.166 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.561038+0000", 2024-09-12T00:05:26.166 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000207565 2024-09-12T00:05:26.166 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.166 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.166 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.166 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.561572+0000", 2024-09-12T00:05:26.166 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00053395600000000004 2024-09-12T00:05:26.166 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.166 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.167 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.167 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.167 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.167 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3097 3.33 3:cc1991a3:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:26.167 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.588213+0000", 2024-09-12T00:05:26.167 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.49219481, 2024-09-12T00:05:26.167 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021968250000000002, 2024-09-12T00:05:26.167 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.167 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.167 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.167 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.167 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.167 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.167 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3097 2024-09-12T00:05:26.167 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.168 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.168 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.168 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.168 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.588213+0000", 2024-09-12T00:05:26.168 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.168 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.168 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.168 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.168 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.588213+0000", 2024-09-12T00:05:26.168 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.168 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.168 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.168 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.168 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.588215+0000", 2024-09-12T00:05:26.169 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7049999999999999e-06 2024-09-12T00:05:26.169 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.169 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.169 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.169 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592148+0000", 2024-09-12T00:05:26.169 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039329639999999997 2024-09-12T00:05:26.169 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.169 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.169 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.169 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592173+0000", 2024-09-12T00:05:26.169 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4596999999999998e-05 2024-09-12T00:05:26.169 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.169 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.170 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.170 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592188+0000", 2024-09-12T00:05:26.170 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4994000000000001e-05 2024-09-12T00:05:26.170 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.170 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.170 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.170 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592372+0000", 2024-09-12T00:05:26.170 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018397899999999999 2024-09-12T00:05:26.170 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.170 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.170 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.170 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592639+0000", 2024-09-12T00:05:26.170 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026700299999999998 2024-09-12T00:05:26.170 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.170 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.171 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:26.171 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592916+0000", 2024-09-12T00:05:26.171 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027759300000000002 2024-09-12T00:05:26.171 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.171 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.171 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.171 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.602239+0000", 2024-09-12T00:05:26.171 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0093227550000000003 2024-09-12T00:05:26.171 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.171 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.171 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.171 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.609997+0000", 2024-09-12T00:05:26.171 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077576390000000002 2024-09-12T00:05:26.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.172 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.172 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.172 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.610109+0000", 2024-09-12T00:05:26.172 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000111753 2024-09-12T00:05:26.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.172 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.172 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.172 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.610181+0000", 2024-09-12T00:05:26.172 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2268000000000007e-05 2024-09-12T00:05:26.172 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.172 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.172 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.173 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.173 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3107 3.25 3:a6170c4d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:26.173 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.700176+0000", 2024-09-12T00:05:26.173 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.380231491, 2024-09-12T00:05:26.173 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018099869000000001, 2024-09-12T00:05:26.173 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.173 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.173 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.173 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.173 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.173 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.173 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3107 2024-09-12T00:05:26.173 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.173 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.174 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.174 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.174 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.700176+0000", 2024-09-12T00:05:26.174 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.174 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.174 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.174 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.174 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.700176+0000", 2024-09-12T00:05:26.174 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.174 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.174 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.174 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.174 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.700179+0000", 2024-09-12T00:05:26.174 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8760000000000001e-06 2024-09-12T00:05:26.175 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.175 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.175 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.175 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704197+0000", 2024-09-12T00:05:26.175 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040179689999999997 2024-09-12T00:05:26.175 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.175 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.175 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.175 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704226+0000", 2024-09-12T00:05:26.175 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8943000000000001e-05 2024-09-12T00:05:26.175 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.175 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.175 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.175 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704238+0000", 2024-09-12T00:05:26.176 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1911e-05 2024-09-12T00:05:26.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.176 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.176 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.176 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704344+0000", 2024-09-12T00:05:26.176 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000106259 2024-09-12T00:05:26.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.176 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.176 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.176 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704582+0000", 2024-09-12T00:05:26.176 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000238371 2024-09-12T00:05:26.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.176 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.176 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:26.177 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704823+0000", 2024-09-12T00:05:26.177 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000240304 2024-09-12T00:05:26.177 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.177 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.177 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.177 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.716320+0000", 2024-09-12T00:05:26.177 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011497965000000001 2024-09-12T00:05:26.177 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.177 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.177 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.177 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.718165+0000", 2024-09-12T00:05:26.177 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00184453 2024-09-12T00:05:26.177 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.177 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.178 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.178 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.718238+0000", 2024-09-12T00:05:26.178 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2847000000000002e-05 2024-09-12T00:05:26.178 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.178 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.178 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.178 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.718276+0000", 2024-09-12T00:05:26.178 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7894e-05 2024-09-12T00:05:26.178 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.178 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.178 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.178 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.178 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.179 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3125 3.12 3:495b0235:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:26.179 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:26.179 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.1646367160000004, 2024-09-12T00:05:26.179 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030616648999999999, 2024-09-12T00:05:26.179 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.179 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.179 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.179 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.179 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.179 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.179 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3125 2024-09-12T00:05:26.179 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.180 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.180 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.180 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.180 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:26.180 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.180 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.180 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.180 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.180 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:26.180 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.180 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.180 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.180 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.181 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915773+0000", 2024-09-12T00:05:26.181 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2800000000000002e-06 2024-09-12T00:05:26.181 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.181 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.181 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.181 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919856+0000", 2024-09-12T00:05:26.181 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004082713 2024-09-12T00:05:26.181 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.181 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.181 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.181 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919879+0000", 2024-09-12T00:05:26.181 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3782e-05 2024-09-12T00:05:26.181 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.182 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.182 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.182 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919891+0000", 2024-09-12T00:05:26.182 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1440000000000001e-05 2024-09-12T00:05:26.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.182 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.182 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.182 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920037+0000", 2024-09-12T00:05:26.182 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014562700000000001 2024-09-12T00:05:26.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.182 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.182 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.182 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920280+0000", 2024-09-12T00:05:26.183 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000243274 2024-09-12T00:05:26.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.183 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.183 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:26.183 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920527+0000", 2024-09-12T00:05:26.183 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024692699999999998 2024-09-12T00:05:26.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.183 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.183 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.183 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.932485+0000", 2024-09-12T00:05:26.183 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011957857000000001 2024-09-12T00:05:26.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.183 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.184 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.184 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946197+0000", 2024-09-12T00:05:26.184 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013712436999999999 2024-09-12T00:05:26.184 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.184 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.184 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.184 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946305+0000", 2024-09-12T00:05:26.184 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000107914 2024-09-12T00:05:26.184 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.184 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.184 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.184 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946387+0000", 2024-09-12T00:05:26.185 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2398000000000006e-05 2024-09-12T00:05:26.185 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.185 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.185 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.185 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.185 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.185 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3127 3.24 3:2477ff85:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:26.185 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.943043+0000", 2024-09-12T00:05:26.185 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.1373642070000001, 2024-09-12T00:05:26.185 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020914724999999999, 2024-09-12T00:05:26.185 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.185 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.186 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.186 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.186 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.186 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.186 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3127 2024-09-12T00:05:26.186 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.186 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.186 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.186 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.186 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.943043+0000", 2024-09-12T00:05:26.186 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.186 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.187 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.187 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.187 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.943043+0000", 2024-09-12T00:05:26.187 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.187 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.187 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.187 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.187 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.943046+0000", 2024-09-12T00:05:26.187 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3069999999999998e-06 2024-09-12T00:05:26.187 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.187 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.187 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.188 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947004+0000", 2024-09-12T00:05:26.188 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039575360000000002 2024-09-12T00:05:26.188 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.188 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.188 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.188 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947022+0000", 2024-09-12T00:05:26.188 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7847e-05 2024-09-12T00:05:26.188 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.188 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.188 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.188 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947030+0000", 2024-09-12T00:05:26.188 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.5399999999999996e-06 2024-09-12T00:05:26.188 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.189 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.189 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.189 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947087+0000", 2024-09-12T00:05:26.189 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6496999999999998e-05 2024-09-12T00:05:26.189 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.189 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.189 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.189 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947251+0000", 2024-09-12T00:05:26.189 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016407499999999999 2024-09-12T00:05:26.189 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.189 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.189 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:26.189 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947422+0000", 2024-09-12T00:05:26.190 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017108 2024-09-12T00:05:26.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.190 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.190 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.190 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.953910+0000", 2024-09-12T00:05:26.190 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064883980000000003 2024-09-12T00:05:26.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.190 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.190 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.190 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.963872+0000", 2024-09-12T00:05:26.190 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099617839999999996 2024-09-12T00:05:26.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.191 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.191 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.191 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.963918+0000", 2024-09-12T00:05:26.191 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5692999999999998e-05 2024-09-12T00:05:26.191 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.191 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.191 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.191 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.963958+0000", 2024-09-12T00:05:26.191 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9968000000000001e-05 2024-09-12T00:05:26.191 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.191 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.191 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.191 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.192 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.192 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3132 3.4 3:216a5295:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:26.192 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.015391+0000", 2024-09-12T00:05:26.192 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.0650165109999996, 2024-09-12T00:05:26.192 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022006318, 2024-09-12T00:05:26.192 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.192 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.192 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.192 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.192 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.192 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.193 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3132 2024-09-12T00:05:26.193 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.193 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.193 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.193 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.193 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.015391+0000", 2024-09-12T00:05:26.193 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.193 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.193 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.193 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.193 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.015391+0000", 2024-09-12T00:05:26.194 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.194 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.194 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.194 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.194 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.015394+0000", 2024-09-12T00:05:26.194 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6260000000000001e-06 2024-09-12T00:05:26.194 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.194 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.194 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.194 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.019828+0000", 2024-09-12T00:05:26.195 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044333109999999997 2024-09-12T00:05:26.195 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.195 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.195 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.195 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.019859+0000", 2024-09-12T00:05:26.195 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1575999999999997e-05 2024-09-12T00:05:26.195 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.195 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.195 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.195 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.019875+0000", 2024-09-12T00:05:26.195 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5875999999999998e-05 2024-09-12T00:05:26.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.196 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.196 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.196 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.020009+0000", 2024-09-12T00:05:26.196 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133953 2024-09-12T00:05:26.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.196 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.196 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.196 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.020264+0000", 2024-09-12T00:05:26.196 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025509000000000003 2024-09-12T00:05:26.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.197 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.197 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:26.197 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.020504+0000", 2024-09-12T00:05:26.197 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000240184 2024-09-12T00:05:26.197 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.197 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.197 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.197 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.031616+0000", 2024-09-12T00:05:26.197 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011111843 2024-09-12T00:05:26.197 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.197 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.197 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.197 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.037072+0000", 2024-09-12T00:05:26.197 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054553400000000004 2024-09-12T00:05:26.198 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.198 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.198 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.198 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.037271+0000", 2024-09-12T00:05:26.198 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000199199 2024-09-12T00:05:26.198 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.198 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.198 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.198 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.037397+0000", 2024-09-12T00:05:26.198 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012632 2024-09-12T00:05:26.198 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.198 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.198 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.198 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.198 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.199 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3134 3.24 3:2525a955:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:26.199 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:26.199 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.0405599859999999, 2024-09-12T00:05:26.199 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025606806999999999, 2024-09-12T00:05:26.199 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.199 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.199 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.199 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.199 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.199 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.199 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3134 2024-09-12T00:05:26.199 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.199 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.199 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.200 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.200 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:26.200 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.200 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.200 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.200 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.200 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:26.200 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.200 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.200 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.200 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.200 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039850+0000", 2024-09-12T00:05:26.200 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9780000000000001e-06 2024-09-12T00:05:26.200 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.201 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.201 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.201 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045256+0000", 2024-09-12T00:05:26.201 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054058129999999998 2024-09-12T00:05:26.201 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.201 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.201 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.201 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045284+0000", 2024-09-12T00:05:26.201 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8065e-05 2024-09-12T00:05:26.201 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.201 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.201 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.201 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045297+0000", 2024-09-12T00:05:26.201 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2788e-05 2024-09-12T00:05:26.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.202 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.202 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.202 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045378+0000", 2024-09-12T00:05:26.202 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1079000000000001e-05 2024-09-12T00:05:26.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.202 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.202 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.202 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045530+0000", 2024-09-12T00:05:26.202 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015206099999999999 2024-09-12T00:05:26.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.202 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.202 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:26.202 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045655+0000", 2024-09-12T00:05:26.203 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012525899999999999 2024-09-12T00:05:26.203 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.203 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.203 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.203 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.054817+0000", 2024-09-12T00:05:26.203 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0091611049999999992 2024-09-12T00:05:26.203 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.203 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.203 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.203 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065354+0000", 2024-09-12T00:05:26.203 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010537625 2024-09-12T00:05:26.203 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.204 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.204 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.204 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065410+0000", 2024-09-12T00:05:26.204 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6141999999999999e-05 2024-09-12T00:05:26.204 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.204 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.204 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.204 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065454+0000", 2024-09-12T00:05:26.204 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3891999999999999e-05 2024-09-12T00:05:26.204 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.204 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.204 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.204 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.205 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.205 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:26.206 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:05:26.207 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:26.208+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:26.308 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:26.304+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:26.334 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:26.334 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:26.334 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:26.334 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:26.348 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:05:26.435 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:26.432+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:26.510 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:26.512+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:26.513 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:26.513 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:26.513 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:26.514 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:26.514 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:26.528 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:05:26.607 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:05:26.618 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:26.616+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:26.700 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:26.700 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:26.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:26.700 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:26.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.700 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:1646 3.25 e58/23 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head v 58'1, mlcod=0'0)", 2024-09-12T00:05:26.700 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:26.700 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 53.612347710000002, 2024-09-12T00:05:26.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020301987000000001, 2024-09-12T00:05:26.701 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.701 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.701 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.701 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:26.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:26.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086308+0000", 2024-09-12T00:05:26.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.95e-06 2024-09-12T00:05:26.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091174+0000", 2024-09-12T00:05:26.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048660559999999997 2024-09-12T00:05:26.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091218+0000", 2024-09-12T00:05:26.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4678999999999997e-05 2024-09-12T00:05:26.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091238+0000", 2024-09-12T00:05:26.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9839000000000001e-05 2024-09-12T00:05:26.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091396+0000", 2024-09-12T00:05:26.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000157396 2024-09-12T00:05:26.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.704 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.704 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.704 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091451+0000", 2024-09-12T00:05:26.704 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5547999999999997e-05 2024-09-12T00:05:26.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.704 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.704 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.704 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106474+0000", 2024-09-12T00:05:26.704 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015023287 2024-09-12T00:05:26.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.704 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.704 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.704 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106608+0000", 2024-09-12T00:05:26.705 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133232 2024-09-12T00:05:26.705 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.705 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.705 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.705 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2667 3.8 e63/23 3:1177e826:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_162:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:26.705 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.378028+0000", 2024-09-12T00:05:26.705 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 39.320625837000001, 2024-09-12T00:05:26.705 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018606185000000001, 2024-09-12T00:05:26.705 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.705 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.705 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.705 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.706 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.706 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.378028+0000", 2024-09-12T00:05:26.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.706 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.706 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.378028+0000", 2024-09-12T00:05:26.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.706 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.706 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.378031+0000", 2024-09-12T00:05:26.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9330000000000001e-06 2024-09-12T00:05:26.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383422+0000", 2024-09-12T00:05:26.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005391163 2024-09-12T00:05:26.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383455+0000", 2024-09-12T00:05:26.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3640999999999999e-05 2024-09-12T00:05:26.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.708 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383472+0000", 2024-09-12T00:05:26.708 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7005999999999999e-05 2024-09-12T00:05:26.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.708 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.708 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.708 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383626+0000", 2024-09-12T00:05:26.708 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015317 2024-09-12T00:05:26.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.709 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.709 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.709 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383691+0000", 2024-09-12T00:05:26.709 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5740000000000004e-05 2024-09-12T00:05:26.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.709 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.709 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.709 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396505+0000", 2024-09-12T00:05:26.709 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012813702999999999 2024-09-12T00:05:26.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.709 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.709 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.709 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396634+0000", 2024-09-12T00:05:26.709 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012882900000000001 2024-09-12T00:05:26.710 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.710 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.710 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.710 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.710 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.710 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2723 3.21 3:86535907:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:26.710 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:26.710 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 38.866500242999997, 2024-09-12T00:05:26.710 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021210407000000001, 2024-09-12T00:05:26.710 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.710 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.710 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.710 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.710 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.711 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.711 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2723 2024-09-12T00:05:26.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.711 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.711 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.711 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.711 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:26.711 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.711 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.711 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.711 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:26.711 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832157+0000", 2024-09-12T00:05:26.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3270000000000001e-06 2024-09-12T00:05:26.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837403+0000", 2024-09-12T00:05:26.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005246784 2024-09-12T00:05:26.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837439+0000", 2024-09-12T00:05:26.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5848e-05 2024-09-12T00:05:26.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.713 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.713 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.713 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837459+0000", 2024-09-12T00:05:26.713 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9585e-05 2024-09-12T00:05:26.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.713 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.713 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.713 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837574+0000", 2024-09-12T00:05:26.713 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000114917 2024-09-12T00:05:26.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.713 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.713 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.713 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837803+0000", 2024-09-12T00:05:26.714 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022967699999999999 2024-09-12T00:05:26.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.714 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.714 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:26.714 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838174+0000", 2024-09-12T00:05:26.714 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037083899999999998 2024-09-12T00:05:26.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.714 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.714 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.714 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848447+0000", 2024-09-12T00:05:26.714 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010272439 2024-09-12T00:05:26.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.714 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.714 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.715 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853191+0000", 2024-09-12T00:05:26.715 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047441109999999996 2024-09-12T00:05:26.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.715 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.715 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.715 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853292+0000", 2024-09-12T00:05:26.715 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000101474 2024-09-12T00:05:26.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.715 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.715 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.715 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853364+0000", 2024-09-12T00:05:26.715 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1406e-05 2024-09-12T00:05:26.715 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.715 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.716 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.716 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.716 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.716 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2729 3.0 e63/23 3:01c0e0c9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_214:head v 63'6, mlcod=63'4)", 2024-09-12T00:05:26.716 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.902446+0000", 2024-09-12T00:05:26.716 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 38.796207899000002, 2024-09-12T00:05:26.716 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019099029, 2024-09-12T00:05:26.716 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.716 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.716 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.716 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.716 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.716 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.717 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902446+0000", 2024-09-12T00:05:26.717 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.717 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.717 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.717 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902446+0000", 2024-09-12T00:05:26.717 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.717 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.717 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.717 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902448+0000", 2024-09-12T00:05:26.717 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.503e-06 2024-09-12T00:05:26.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906706+0000", 2024-09-12T00:05:26.718 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042580500000000002 2024-09-12T00:05:26.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906743+0000", 2024-09-12T00:05:26.718 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6637999999999997e-05 2024-09-12T00:05:26.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906760+0000", 2024-09-12T00:05:26.718 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6779e-05 2024-09-12T00:05:26.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.719 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.719 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906891+0000", 2024-09-12T00:05:26.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013193499999999999 2024-09-12T00:05:26.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.719 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.719 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906932+0000", 2024-09-12T00:05:26.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0980999999999999e-05 2024-09-12T00:05:26.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.719 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.720 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.921375+0000", 2024-09-12T00:05:26.720 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014442119999999999 2024-09-12T00:05:26.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.720 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.720 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.720 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.921545+0000", 2024-09-12T00:05:26.720 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017002299999999999 2024-09-12T00:05:26.720 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.720 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.720 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.720 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.720 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2736 3.25 e63/23 3:a750a681:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_221:head v 63'5, mlcod=62'3)", 2024-09-12T00:05:26.720 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.980248+0000", 2024-09-12T00:05:26.721 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 38.718405373000003, 2024-09-12T00:05:26.721 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020132552000000001, 2024-09-12T00:05:26.721 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.721 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.721 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.721 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.721 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.721 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.721 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980248+0000", 2024-09-12T00:05:26.721 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.721 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.721 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.721 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.721 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980248+0000", 2024-09-12T00:05:26.722 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.722 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.722 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.722 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980251+0000", 2024-09-12T00:05:26.722 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7329999999999999e-06 2024-09-12T00:05:26.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.722 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.722 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.722 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.982917+0000", 2024-09-12T00:05:26.722 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026662679999999998 2024-09-12T00:05:26.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.722 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.722 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.723 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.982960+0000", 2024-09-12T00:05:26.723 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3000999999999997e-05 2024-09-12T00:05:26.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.723 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.723 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.982985+0000", 2024-09-12T00:05:26.723 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5092e-05 2024-09-12T00:05:26.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.723 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.723 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.983163+0000", 2024-09-12T00:05:26.723 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000177942 2024-09-12T00:05:26.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.723 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.724 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.983221+0000", 2024-09-12T00:05:26.724 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7476999999999999e-05 2024-09-12T00:05:26.724 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.724 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.724 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.724 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000301+0000", 2024-09-12T00:05:26.724 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017080503 2024-09-12T00:05:26.724 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.724 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.724 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.724 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000381+0000", 2024-09-12T00:05:26.724 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9536000000000006e-05 2024-09-12T00:05:26.725 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.725 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.725 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.725 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.725 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2756 3.21 3:849c909c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_241:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:26.725 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.197450+0000", 2024-09-12T00:05:26.725 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 38.501203089000001, 2024-09-12T00:05:26.725 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020201090000000001, 2024-09-12T00:05:26.725 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.725 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.725 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.725 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.725 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.726 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.726 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2756 2024-09-12T00:05:26.726 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.726 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.726 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.726 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.726 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.197450+0000", 2024-09-12T00:05:26.726 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.726 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.726 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.726 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.726 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.197450+0000", 2024-09-12T00:05:26.726 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.726 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.727 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.727 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.727 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.197455+0000", 2024-09-12T00:05:26.727 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4070000000000003e-06 2024-09-12T00:05:26.727 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.727 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.727 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.727 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.202967+0000", 2024-09-12T00:05:26.727 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0055122299999999999 2024-09-12T00:05:26.727 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.727 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.727 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.727 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203001+0000", 2024-09-12T00:05:26.727 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3685e-05 2024-09-12T00:05:26.728 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.728 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.728 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.728 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203017+0000", 2024-09-12T00:05:26.728 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6622000000000001e-05 2024-09-12T00:05:26.728 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.728 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.728 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.728 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203134+0000", 2024-09-12T00:05:26.728 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117166 2024-09-12T00:05:26.728 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.728 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.729 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.729 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203389+0000", 2024-09-12T00:05:26.729 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025456200000000001 2024-09-12T00:05:26.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.729 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.729 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:26.729 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203625+0000", 2024-09-12T00:05:26.729 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000235856 2024-09-12T00:05:26.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.729 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.729 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.729 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.212670+0000", 2024-09-12T00:05:26.729 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0090446639999999991 2024-09-12T00:05:26.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.730 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.730 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.730 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.217469+0000", 2024-09-12T00:05:26.730 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047998559999999999 2024-09-12T00:05:26.730 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.730 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.730 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.730 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.217569+0000", 2024-09-12T00:05:26.730 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9753999999999994e-05 2024-09-12T00:05:26.730 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.730 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.730 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.730 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.217651+0000", 2024-09-12T00:05:26.730 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2287999999999995e-05 2024-09-12T00:05:26.731 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.731 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.731 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.731 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.731 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.731 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2969 3.b 3:d2cd1e23:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:26.731 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.057390+0000", 2024-09-12T00:05:26.731 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.6412634700000002, 2024-09-12T00:05:26.731 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019453666000000001, 2024-09-12T00:05:26.731 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.731 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.731 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.731 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.731 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.732 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.732 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2969 2024-09-12T00:05:26.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.732 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.732 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.732 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.732 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.057390+0000", 2024-09-12T00:05:26.732 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.732 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.732 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.732 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.057390+0000", 2024-09-12T00:05:26.732 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.733 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.733 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.733 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.057393+0000", 2024-09-12T00:05:26.733 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8430000000000001e-06 2024-09-12T00:05:26.733 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.733 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.733 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.733 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062108+0000", 2024-09-12T00:05:26.733 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047149640000000003 2024-09-12T00:05:26.733 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.733 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.733 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.733 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062130+0000", 2024-09-12T00:05:26.734 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.23e-05 2024-09-12T00:05:26.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.734 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.734 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.734 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062141+0000", 2024-09-12T00:05:26.734 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.111e-05 2024-09-12T00:05:26.735 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.735 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.735 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.735 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062222+0000", 2024-09-12T00:05:26.735 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0486000000000002e-05 2024-09-12T00:05:26.735 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.735 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.735 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.735 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062364+0000", 2024-09-12T00:05:26.735 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014189500000000001 2024-09-12T00:05:26.735 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.735 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.735 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:26.735 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062496+0000", 2024-09-12T00:05:26.736 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000132182 2024-09-12T00:05:26.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.736 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.736 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.736 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.076301+0000", 2024-09-12T00:05:26.736 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013805128 2024-09-12T00:05:26.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.736 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.736 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.736 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.076652+0000", 2024-09-12T00:05:26.736 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00035156899999999998 2024-09-12T00:05:26.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.736 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.737 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.737 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.076734+0000", 2024-09-12T00:05:26.737 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1161000000000004e-05 2024-09-12T00:05:26.737 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.737 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.737 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.737 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.076844+0000", 2024-09-12T00:05:26.737 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110028 2024-09-12T00:05:26.737 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.737 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.737 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.738 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.738 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.738 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2971 3.2e 3:76f45d45:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:26.738 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:26.738 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.6227859059999998, 2024-09-12T00:05:26.738 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022571213, 2024-09-12T00:05:26.738 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.738 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.738 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.738 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.738 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.738 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.738 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2971 2024-09-12T00:05:26.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.739 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.739 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.739 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.739 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:26.739 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.739 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.739 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.739 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:26.739 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.739 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.739 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.740 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075871+0000", 2024-09-12T00:05:26.740 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.467e-06 2024-09-12T00:05:26.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.740 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.740 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.740 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080307+0000", 2024-09-12T00:05:26.740 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044356359999999997 2024-09-12T00:05:26.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.740 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.740 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.740 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080346+0000", 2024-09-12T00:05:26.740 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9267999999999997e-05 2024-09-12T00:05:26.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.740 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.741 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.741 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080368+0000", 2024-09-12T00:05:26.741 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2603e-05 2024-09-12T00:05:26.741 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.741 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.741 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.741 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080489+0000", 2024-09-12T00:05:26.741 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0001209 2024-09-12T00:05:26.741 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.741 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.741 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.741 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080830+0000", 2024-09-12T00:05:26.741 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00034099 2024-09-12T00:05:26.741 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.741 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.742 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:26.742 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.081119+0000", 2024-09-12T00:05:26.742 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028860300000000001 2024-09-12T00:05:26.742 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.742 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.742 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.742 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.093241+0000", 2024-09-12T00:05:26.742 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012121609 2024-09-12T00:05:26.742 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.742 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.742 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.742 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098277+0000", 2024-09-12T00:05:26.742 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0050359710000000002 2024-09-12T00:05:26.742 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.743 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.743 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.743 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098366+0000", 2024-09-12T00:05:26.743 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9052000000000001e-05 2024-09-12T00:05:26.743 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.743 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.743 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.743 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098439+0000", 2024-09-12T00:05:26.743 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3114000000000005e-05 2024-09-12T00:05:26.743 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.743 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.743 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.743 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.744 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.744 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2996 3.21 3:872b1c12:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:26.744 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:26.744 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.3481611689999999, 2024-09-12T00:05:26.744 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027562314000000001, 2024-09-12T00:05:26.744 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.744 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.744 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.744 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.744 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.744 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.744 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2996 2024-09-12T00:05:26.744 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.744 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.745 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.745 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.745 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:26.745 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.745 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.745 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.745 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.745 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:26.745 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.745 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.745 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.745 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.745 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350496+0000", 2024-09-12T00:05:26.745 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9160000000000003e-06 2024-09-12T00:05:26.746 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.746 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.746 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.746 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355187+0000", 2024-09-12T00:05:26.746 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046904989999999999 2024-09-12T00:05:26.746 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.746 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.746 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.746 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355223+0000", 2024-09-12T00:05:26.746 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6125999999999999e-05 2024-09-12T00:05:26.746 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.746 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.746 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.746 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355241+0000", 2024-09-12T00:05:26.747 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8686e-05 2024-09-12T00:05:26.747 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.747 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.747 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.747 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355373+0000", 2024-09-12T00:05:26.747 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013129299999999999 2024-09-12T00:05:26.747 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.747 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.747 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.747 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355619+0000", 2024-09-12T00:05:26.747 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024662700000000002 2024-09-12T00:05:26.747 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.747 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.747 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:26.748 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355855+0000", 2024-09-12T00:05:26.748 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023604299999999999 2024-09-12T00:05:26.748 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.748 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.748 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.748 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.367983+0000", 2024-09-12T00:05:26.748 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012127104999999999 2024-09-12T00:05:26.748 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.748 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.748 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.748 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377884+0000", 2024-09-12T00:05:26.748 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099013680000000007 2024-09-12T00:05:26.748 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.748 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.749 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.749 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377974+0000", 2024-09-12T00:05:26.749 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9932999999999994e-05 2024-09-12T00:05:26.749 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.749 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.749 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.749 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.378055+0000", 2024-09-12T00:05:26.749 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0717999999999995e-05 2024-09-12T00:05:26.749 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.749 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.749 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.749 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.749 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.749 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3016 3.21 3:876e25ab:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:26.750 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.592959+0000", 2024-09-12T00:05:26.750 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 6.1056947340000001, 2024-09-12T00:05:26.750 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018852352999999999, 2024-09-12T00:05:26.750 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.750 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.750 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.750 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.750 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.750 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.750 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3016 2024-09-12T00:05:26.750 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.750 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.750 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.750 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.751 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.592959+0000", 2024-09-12T00:05:26.751 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.751 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.751 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.751 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.751 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.592959+0000", 2024-09-12T00:05:26.751 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.751 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.751 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.751 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.751 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.592961+0000", 2024-09-12T00:05:26.751 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7939999999999998e-06 2024-09-12T00:05:26.751 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.751 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.752 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.752 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.597664+0000", 2024-09-12T00:05:26.752 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047023550000000001 2024-09-12T00:05:26.752 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.752 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.752 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.752 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.597702+0000", 2024-09-12T00:05:26.752 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8235000000000002e-05 2024-09-12T00:05:26.752 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.752 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.752 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.752 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.597721+0000", 2024-09-12T00:05:26.752 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8442999999999999e-05 2024-09-12T00:05:26.752 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.753 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.753 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.753 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.597853+0000", 2024-09-12T00:05:26.753 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013213299999999999 2024-09-12T00:05:26.753 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.753 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.753 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.753 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.598128+0000", 2024-09-12T00:05:26.753 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000275347 2024-09-12T00:05:26.753 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.753 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.753 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:26.753 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.598362+0000", 2024-09-12T00:05:26.753 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023358999999999999 2024-09-12T00:05:26.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.754 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.754 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.754 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611029+0000", 2024-09-12T00:05:26.754 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012667487999999999 2024-09-12T00:05:26.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.754 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.754 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.754 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611437+0000", 2024-09-12T00:05:26.754 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000407518 2024-09-12T00:05:26.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.754 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.754 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.754 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611629+0000", 2024-09-12T00:05:26.755 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00019254799999999999 2024-09-12T00:05:26.755 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.755 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.755 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.755 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611811+0000", 2024-09-12T00:05:26.755 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018190200000000001 2024-09-12T00:05:26.755 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.755 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.755 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.755 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.755 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.755 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3030 3.2e 3:740afe3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:26.755 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:26.755 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 5.958831011, 2024-09-12T00:05:26.755 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.033756331000000001, 2024-09-12T00:05:26.756 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.756 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.756 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.756 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.756 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.756 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.756 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3030 2024-09-12T00:05:26.757 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.757 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.757 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.757 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.757 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:26.757 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.757 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.757 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.757 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.757 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:26.758 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.758 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.758 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.758 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.758 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739825+0000", 2024-09-12T00:05:26.758 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7920000000000001e-06 2024-09-12T00:05:26.758 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.758 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.758 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.758 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744217+0000", 2024-09-12T00:05:26.758 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043922529999999996 2024-09-12T00:05:26.759 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.759 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.759 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.759 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744243+0000", 2024-09-12T00:05:26.759 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5253e-05 2024-09-12T00:05:26.759 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.759 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.759 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.759 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744254+0000", 2024-09-12T00:05:26.759 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1430999999999999e-05 2024-09-12T00:05:26.759 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.759 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.759 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.760 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744325+0000", 2024-09-12T00:05:26.760 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1340999999999993e-05 2024-09-12T00:05:26.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.760 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.760 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.760 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744461+0000", 2024-09-12T00:05:26.760 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013531700000000001 2024-09-12T00:05:26.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.760 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.760 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:26.760 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744574+0000", 2024-09-12T00:05:26.760 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113513 2024-09-12T00:05:26.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.760 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.761 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.761 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.752813+0000", 2024-09-12T00:05:26.761 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082384750000000003 2024-09-12T00:05:26.761 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.761 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.761 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.761 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773444+0000", 2024-09-12T00:05:26.761 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020630773000000002 2024-09-12T00:05:26.761 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.761 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.761 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.761 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773510+0000", 2024-09-12T00:05:26.761 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6711000000000006e-05 2024-09-12T00:05:26.762 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.762 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.762 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.762 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773579+0000", 2024-09-12T00:05:26.762 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8472000000000004e-05 2024-09-12T00:05:26.762 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.762 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.762 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.762 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.762 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.762 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3039 3.2e 3:74587332:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:26.762 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:26.762 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 5.863151083, 2024-09-12T00:05:26.762 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.036215114, 2024-09-12T00:05:26.762 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.763 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.763 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.763 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.763 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.763 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.763 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3039 2024-09-12T00:05:26.763 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.763 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.763 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.763 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.763 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:26.763 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.763 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.763 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.764 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.764 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:26.764 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.764 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.764 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.764 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.764 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835507+0000", 2024-09-12T00:05:26.764 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6e-06 2024-09-12T00:05:26.764 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.764 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.764 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.764 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848930+0000", 2024-09-12T00:05:26.764 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013423242 2024-09-12T00:05:26.764 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.764 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.765 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.765 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848969+0000", 2024-09-12T00:05:26.765 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9270000000000002e-05 2024-09-12T00:05:26.765 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.765 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.765 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.765 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848991+0000", 2024-09-12T00:05:26.765 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1565000000000001e-05 2024-09-12T00:05:26.765 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.765 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.765 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.765 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849089+0000", 2024-09-12T00:05:26.765 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8408999999999999e-05 2024-09-12T00:05:26.765 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.766 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.766 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.766 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849518+0000", 2024-09-12T00:05:26.766 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042813900000000002 2024-09-12T00:05:26.766 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.766 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.766 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:26.766 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849897+0000", 2024-09-12T00:05:26.766 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037936600000000001 2024-09-12T00:05:26.766 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.766 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.766 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.766 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.858549+0000", 2024-09-12T00:05:26.766 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086520820000000002 2024-09-12T00:05:26.767 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.767 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.767 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.767 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871522+0000", 2024-09-12T00:05:26.767 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012973182999999999 2024-09-12T00:05:26.767 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.767 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.767 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.767 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871633+0000", 2024-09-12T00:05:26.767 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011085 2024-09-12T00:05:26.767 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.767 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.767 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.767 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871717+0000", 2024-09-12T00:05:26.768 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.4407999999999996e-05 2024-09-12T00:05:26.768 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.768 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.768 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.768 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.768 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.768 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3050 3.b 3:d26f7141:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:26.768 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:26.768 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 5.7415388270000003, 2024-09-12T00:05:26.768 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022896481999999999, 2024-09-12T00:05:26.768 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.768 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.769 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.769 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.769 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.769 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.769 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3050 2024-09-12T00:05:26.769 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.769 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.769 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.769 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.769 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:26.769 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.770 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.770 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.770 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.770 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:26.770 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.770 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.770 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.770 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.770 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957117+0000", 2024-09-12T00:05:26.770 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7e-06 2024-09-12T00:05:26.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.771 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.771 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.771 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961673+0000", 2024-09-12T00:05:26.771 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045558059999999999 2024-09-12T00:05:26.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.771 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.771 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.771 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961698+0000", 2024-09-12T00:05:26.771 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5017000000000001e-05 2024-09-12T00:05:26.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.772 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.772 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.772 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961710+0000", 2024-09-12T00:05:26.772 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1963999999999999e-05 2024-09-12T00:05:26.772 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.772 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.772 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.772 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961785+0000", 2024-09-12T00:05:26.772 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5153000000000004e-05 2024-09-12T00:05:26.772 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.772 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.772 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.772 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961926+0000", 2024-09-12T00:05:26.772 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000141194 2024-09-12T00:05:26.773 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.773 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.773 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:26.773 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.962055+0000", 2024-09-12T00:05:26.773 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012882400000000001 2024-09-12T00:05:26.773 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.773 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.773 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.773 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.970716+0000", 2024-09-12T00:05:26.773 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086603610000000001 2024-09-12T00:05:26.773 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.773 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.773 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.774 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979700+0000", 2024-09-12T00:05:26.774 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.008984054 2024-09-12T00:05:26.774 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.774 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.774 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.774 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979884+0000", 2024-09-12T00:05:26.774 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184215 2024-09-12T00:05:26.774 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.774 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.774 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.774 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.980011+0000", 2024-09-12T00:05:26.774 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012719399999999999 2024-09-12T00:05:26.774 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.775 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.775 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.775 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.775 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.775 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3052 3.32 e75/23 3:4d6db9ea:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_91:head v 75'3, mlcod=62'1)", 2024-09-12T00:05:26.775 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.988152+0000", 2024-09-12T00:05:26.775 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 5.710501271, 2024-09-12T00:05:26.775 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019198494999999999, 2024-09-12T00:05:26.775 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.775 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.775 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.775 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.775 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.775 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.776 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.988152+0000", 2024-09-12T00:05:26.776 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.776 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.776 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.776 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.776 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.988152+0000", 2024-09-12T00:05:26.776 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.776 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.776 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.776 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.776 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.988155+0000", 2024-09-12T00:05:26.776 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.253e-06 2024-09-12T00:05:26.776 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.777 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.777 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.777 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993485+0000", 2024-09-12T00:05:26.777 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053298479999999999 2024-09-12T00:05:26.777 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.777 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.777 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.777 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993520+0000", 2024-09-12T00:05:26.777 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4393000000000001e-05 2024-09-12T00:05:26.777 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.777 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.777 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.777 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993538+0000", 2024-09-12T00:05:26.777 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8193e-05 2024-09-12T00:05:26.777 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.778 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.778 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.778 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993701+0000", 2024-09-12T00:05:26.778 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016265499999999999 2024-09-12T00:05:26.778 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.778 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.778 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.778 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993771+0000", 2024-09-12T00:05:26.778 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.0884999999999996e-05 2024-09-12T00:05:26.778 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.778 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.778 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.778 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007261+0000", 2024-09-12T00:05:26.778 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013489142000000001 2024-09-12T00:05:26.779 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.779 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.779 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.779 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007351+0000", 2024-09-12T00:05:26.779 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0125999999999997e-05 2024-09-12T00:05:26.779 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.779 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.779 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.779 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.779 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.779 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3065 3.b 3:d10bf58d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:26.779 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:26.779 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 5.5765912069999999, 2024-09-12T00:05:26.779 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021843261999999999, 2024-09-12T00:05:26.780 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.780 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.780 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.780 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.780 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.780 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.780 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3065 2024-09-12T00:05:26.780 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.780 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.780 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.780 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.780 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:26.780 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.780 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.780 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.781 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.781 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:26.781 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.781 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.781 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.781 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.781 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122067+0000", 2024-09-12T00:05:26.781 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4970000000000003e-06 2024-09-12T00:05:26.781 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.781 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.781 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.781 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126931+0000", 2024-09-12T00:05:26.781 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048641090000000001 2024-09-12T00:05:26.782 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.782 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.782 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.782 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126973+0000", 2024-09-12T00:05:26.782 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1678999999999999e-05 2024-09-12T00:05:26.782 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.782 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.782 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.782 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126999+0000", 2024-09-12T00:05:26.782 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6536000000000001e-05 2024-09-12T00:05:26.782 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.782 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.782 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.782 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127118+0000", 2024-09-12T00:05:26.783 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000119373 2024-09-12T00:05:26.783 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.783 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.783 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.783 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127289+0000", 2024-09-12T00:05:26.783 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017020199999999999 2024-09-12T00:05:26.783 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.783 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.783 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:26.783 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127437+0000", 2024-09-12T00:05:26.783 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148682 2024-09-12T00:05:26.784 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.784 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.784 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.784 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138539+0000", 2024-09-12T00:05:26.784 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011101418 2024-09-12T00:05:26.784 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.784 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.784 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.784 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143355+0000", 2024-09-12T00:05:26.784 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048161499999999999 2024-09-12T00:05:26.785 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.785 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.785 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.785 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143777+0000", 2024-09-12T00:05:26.785 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000421896 2024-09-12T00:05:26.785 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.785 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.785 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.785 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143905+0000", 2024-09-12T00:05:26.785 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012872 2024-09-12T00:05:26.785 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.786 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.786 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.786 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.786 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.786 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3066 3.21 3:8448517d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:26.786 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:26.786 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 5.566645125, 2024-09-12T00:05:26.786 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025911652, 2024-09-12T00:05:26.786 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.786 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.786 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.786 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.786 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.787 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.787 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3066 2024-09-12T00:05:26.787 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.787 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.787 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.787 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.787 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:26.787 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.787 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.787 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.787 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.787 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:26.787 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.787 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.788 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.788 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.788 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132011+0000", 2024-09-12T00:05:26.788 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8270000000000002e-06 2024-09-12T00:05:26.788 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.788 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.788 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.788 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137934+0000", 2024-09-12T00:05:26.788 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059226119999999998 2024-09-12T00:05:26.788 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.788 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.788 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.788 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137968+0000", 2024-09-12T00:05:26.788 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3933000000000002e-05 2024-09-12T00:05:26.789 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.789 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.789 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.789 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137985+0000", 2024-09-12T00:05:26.789 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7725999999999999e-05 2024-09-12T00:05:26.789 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.789 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.789 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.789 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138084+0000", 2024-09-12T00:05:26.789 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8450999999999996e-05 2024-09-12T00:05:26.789 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.789 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.789 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.789 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138285+0000", 2024-09-12T00:05:26.790 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000201411 2024-09-12T00:05:26.790 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.790 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.790 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:26.790 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138510+0000", 2024-09-12T00:05:26.790 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000224551 2024-09-12T00:05:26.790 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.790 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.791 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.791 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.146242+0000", 2024-09-12T00:05:26.791 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077317649999999998 2024-09-12T00:05:26.791 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.791 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.791 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.791 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157728+0000", 2024-09-12T00:05:26.791 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011486424 2024-09-12T00:05:26.792 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.792 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.792 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.792 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157833+0000", 2024-09-12T00:05:26.792 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105234 2024-09-12T00:05:26.792 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.792 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.792 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.792 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157920+0000", 2024-09-12T00:05:26.792 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6718000000000006e-05 2024-09-12T00:05:26.792 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.792 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.792 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.792 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.793 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.793 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3111 3.2e 3:7749b0e6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:26.793 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.741096+0000", 2024-09-12T00:05:26.793 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.9575575350000003, 2024-09-12T00:05:26.793 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019635658, 2024-09-12T00:05:26.793 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.793 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.793 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.793 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.793 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.793 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.793 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3111 2024-09-12T00:05:26.793 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.794 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.794 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.794 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.794 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.741096+0000", 2024-09-12T00:05:26.794 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.794 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.794 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.794 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.794 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.741096+0000", 2024-09-12T00:05:26.794 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.794 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.794 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.794 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.795 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.741099+0000", 2024-09-12T00:05:26.795 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0800000000000002e-06 2024-09-12T00:05:26.795 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.795 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.795 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.795 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745487+0000", 2024-09-12T00:05:26.795 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043876540000000004 2024-09-12T00:05:26.795 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.795 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.795 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.795 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745510+0000", 2024-09-12T00:05:26.796 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3099999999999999e-05 2024-09-12T00:05:26.796 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.796 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.796 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.796 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745521+0000", 2024-09-12T00:05:26.796 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0813e-05 2024-09-12T00:05:26.796 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.796 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.796 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.796 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745639+0000", 2024-09-12T00:05:26.797 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011862399999999999 2024-09-12T00:05:26.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.797 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.797 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.797 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745895+0000", 2024-09-12T00:05:26.797 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025625300000000001 2024-09-12T00:05:26.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.797 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.797 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:26.797 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.746140+0000", 2024-09-12T00:05:26.797 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000244467 2024-09-12T00:05:26.798 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.798 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.798 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.798 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755206+0000", 2024-09-12T00:05:26.798 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0090663250000000001 2024-09-12T00:05:26.798 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.798 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.798 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.798 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.760620+0000", 2024-09-12T00:05:26.798 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054141040000000003 2024-09-12T00:05:26.798 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.798 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.798 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.798 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.760673+0000", 2024-09-12T00:05:26.798 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2519999999999999e-05 2024-09-12T00:05:26.799 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.799 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.799 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.799 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.760732+0000", 2024-09-12T00:05:26.799 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8718000000000003e-05 2024-09-12T00:05:26.799 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.799 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.799 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.799 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.799 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.799 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3112 3.b 3:d1cf91a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:26.799 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:26.799 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.9479279979999999, 2024-09-12T00:05:26.799 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021203475999999999, 2024-09-12T00:05:26.800 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.800 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.800 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.800 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.800 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.800 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.800 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3112 2024-09-12T00:05:26.800 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.800 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.800 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.800 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.800 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:26.800 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.801 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.801 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.801 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:26.801 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.801 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.801 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.801 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750728+0000", 2024-09-12T00:05:26.801 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.165e-06 2024-09-12T00:05:26.801 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.801 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.802 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755063+0000", 2024-09-12T00:05:26.802 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043355379999999999 2024-09-12T00:05:26.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.802 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.802 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.802 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755103+0000", 2024-09-12T00:05:26.802 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9962000000000001e-05 2024-09-12T00:05:26.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.802 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.802 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.802 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755120+0000", 2024-09-12T00:05:26.802 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6793e-05 2024-09-12T00:05:26.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.802 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.803 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.803 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755299+0000", 2024-09-12T00:05:26.803 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017904499999999999 2024-09-12T00:05:26.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.803 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.803 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755758+0000", 2024-09-12T00:05:26.803 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000458815 2024-09-12T00:05:26.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.803 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:26.803 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.756304+0000", 2024-09-12T00:05:26.803 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000546183 2024-09-12T00:05:26.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.804 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.804 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.804 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771518+0000", 2024-09-12T00:05:26.804 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015214236000000001 2024-09-12T00:05:26.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.804 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.804 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.804 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771827+0000", 2024-09-12T00:05:26.804 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000309308 2024-09-12T00:05:26.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.804 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.804 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.804 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771874+0000", 2024-09-12T00:05:26.805 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6119999999999999e-05 2024-09-12T00:05:26.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.805 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.805 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771929+0000", 2024-09-12T00:05:26.805 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5310999999999999e-05 2024-09-12T00:05:26.805 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.805 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.805 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.805 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3115 3.2e 3:75803fec:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:26.805 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:26.806 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.9099569479999996, 2024-09-12T00:05:26.806 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020205041, 2024-09-12T00:05:26.806 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.806 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.806 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.806 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.806 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.806 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.806 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3115 2024-09-12T00:05:26.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.806 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.807 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.807 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:26.807 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.807 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.807 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:26.807 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.808 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.808 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788700+0000", 2024-09-12T00:05:26.808 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.614e-06 2024-09-12T00:05:26.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.808 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.808 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.808 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793576+0000", 2024-09-12T00:05:26.809 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048760920000000003 2024-09-12T00:05:26.809 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.809 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.809 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.809 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793610+0000", 2024-09-12T00:05:26.809 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4184999999999999e-05 2024-09-12T00:05:26.809 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.809 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.809 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.809 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793633+0000", 2024-09-12T00:05:26.809 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2551000000000001e-05 2024-09-12T00:05:26.809 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.809 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.809 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.810 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793750+0000", 2024-09-12T00:05:26.810 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117057 2024-09-12T00:05:26.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.810 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.810 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.810 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793975+0000", 2024-09-12T00:05:26.810 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022493099999999999 2024-09-12T00:05:26.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.810 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.810 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:26.810 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.794178+0000", 2024-09-12T00:05:26.810 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000202726 2024-09-12T00:05:26.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.810 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.811 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.811 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.803725+0000", 2024-09-12T00:05:26.811 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095470599999999996 2024-09-12T00:05:26.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.811 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.811 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.811 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808706+0000", 2024-09-12T00:05:26.811 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049814519999999999 2024-09-12T00:05:26.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.811 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.811 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.811 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808785+0000", 2024-09-12T00:05:26.811 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9160999999999996e-05 2024-09-12T00:05:26.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.811 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.812 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.812 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808902+0000", 2024-09-12T00:05:26.812 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000116212 2024-09-12T00:05:26.812 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.812 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.812 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.812 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.812 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.812 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3148 3.b 3:d076a555:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:26.812 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.214451+0000", 2024-09-12T00:05:26.812 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.484202335, 2024-09-12T00:05:26.812 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019531633999999999, 2024-09-12T00:05:26.812 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:26.812 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:26.813 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:26.813 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:26.813 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:26.813 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:26.813 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3148 2024-09-12T00:05:26.813 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.813 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:26.813 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.813 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:26.813 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.214451+0000", 2024-09-12T00:05:26.813 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.813 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.813 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.813 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:26.814 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.214451+0000", 2024-09-12T00:05:26.814 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:26.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.814 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.814 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:26.814 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.214454+0000", 2024-09-12T00:05:26.814 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.354e-06 2024-09-12T00:05:26.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.814 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.814 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:26.814 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219444+0000", 2024-09-12T00:05:26.814 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049897830000000002 2024-09-12T00:05:26.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.814 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.815 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:26.815 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219472+0000", 2024-09-12T00:05:26.815 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7421999999999999e-05 2024-09-12T00:05:26.815 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.815 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.815 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:26.815 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219486+0000", 2024-09-12T00:05:26.815 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4528999999999999e-05 2024-09-12T00:05:26.815 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.815 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.815 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:26.815 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219583+0000", 2024-09-12T00:05:26.815 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.6989000000000003e-05 2024-09-12T00:05:26.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.816 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.816 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:26.816 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219782+0000", 2024-09-12T00:05:26.816 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000198767 2024-09-12T00:05:26.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.816 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.816 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:26.816 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219999+0000", 2024-09-12T00:05:26.817 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000217068 2024-09-12T00:05:26.817 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.817 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.817 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:26.817 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.233084+0000", 2024-09-12T00:05:26.817 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013084910999999999 2024-09-12T00:05:26.817 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.817 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.817 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:26.817 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.233877+0000", 2024-09-12T00:05:26.818 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00079352600000000002 2024-09-12T00:05:26.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.818 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.818 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:26.818 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.233940+0000", 2024-09-12T00:05:26.818 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2774000000000006e-05 2024-09-12T00:05:26.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:26.818 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:26.818 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:26.818 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.233983+0000", 2024-09-12T00:05:26.818 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2511e-05 2024-09-12T00:05:26.818 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.818 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.818 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.819 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:26.819 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:26.819 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:26.819 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:05:26.820 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:26.820+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:26.821 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:05:26.921 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:26.924+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:26.942 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:26.942 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:26.942 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:05:26.942 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:26.961 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:05:26.970 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:26.970 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:26.987 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:26.987 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:27.004 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:27.005 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:27.021 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:27.021 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:27.022 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:27.024+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:27.042 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:27.042 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:27.062 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:27.062 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:27.083 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:27.083 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:27.088 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:27.088 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:27.103 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:05:27.106 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:27.106 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:27.125 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:27.124+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:27.222 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:27.222 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:27.224 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:27.224+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:27.236 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:05:27.325 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:27.324+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:27.358 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:27.359 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:27.373 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:05:27.426 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:27.424+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:27.496 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:27.497 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:27.509 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:05:27.527 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:27.524+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:27.583 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T00:05:27.629 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:27.624+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:27.635 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:27.635 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:27.649 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:05:27.729 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:27.728+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:27.803 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:27.804 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:27.817 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:05:27.830 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:27.828+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:27.931 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:27.932+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:27.944 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:27.945 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:27.959 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:05:28.049 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:28.052+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:28.133 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:28.132+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:28.137 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:28.137 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:28.151 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:05:28.233 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:28.232+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:28.321 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:28.322 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:28.334 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:28.332+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:28.336 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:05:28.435 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:28.436+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:28.470 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:28.470 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:28.485 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:05:28.577 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:28.580+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:28.637 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:28.636+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:28.661 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:28.661 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:28.676 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:05:28.738 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:28.740+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:28.808 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:28.808 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:28.822 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:05:28.839 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:28.840+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:28.940 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:28.940+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:28.943 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:28.943 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:28.958 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:05:29.041 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:29.036+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:29.075 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:29.075 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:29.090 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:05:29.125 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:05:29.169 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:29.172+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:29.243 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:29.240+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:29.258 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:29.258 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:29.273 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:05:29.285 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:29.286 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:29.302 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:29.302 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:29.321 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:29.321 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:29.338 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:29.338 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:29.344 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:29.344+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:29.359 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:29.360 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:29.378 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:29.378 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:29.398 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:29.398 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:29.421 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:29.422 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:29.439 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:29.439 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:29.439 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:29.440 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:29.440 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:29.446 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:29.440+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:29.454 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:05:29.547 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:29.548+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:29.607 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T00:05:29.622 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:29.622 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:29.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:29.622 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:29.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.622 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2694 3.3d 3:bd0bdafc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:29.623 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:29.623 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 42.075217060999996, 2024-09-12T00:05:29.623 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.026139741000000001, 2024-09-12T00:05:29.623 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:29.623 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:29.623 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:29.623 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:29.623 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:29.623 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:29.623 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2694 2024-09-12T00:05:29.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.623 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:29.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:29.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:29.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:29.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:29.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:29.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545532+0000", 2024-09-12T00:05:29.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8199999999999998e-06 2024-09-12T00:05:29.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:29.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551454+0000", 2024-09-12T00:05:29.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059222340000000002 2024-09-12T00:05:29.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:29.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551485+0000", 2024-09-12T00:05:29.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0173999999999999e-05 2024-09-12T00:05:29.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:29.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551504+0000", 2024-09-12T00:05:29.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9726000000000001e-05 2024-09-12T00:05:29.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:29.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551708+0000", 2024-09-12T00:05:29.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020344100000000001 2024-09-12T00:05:29.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:29.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552087+0000", 2024-09-12T00:05:29.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000379327 2024-09-12T00:05:29.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:29.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552351+0000", 2024-09-12T00:05:29.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026349199999999999 2024-09-12T00:05:29.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:29.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.569375+0000", 2024-09-12T00:05:29.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017024432999999999 2024-09-12T00:05:29.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:29.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571222+0000", 2024-09-12T00:05:29.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00184688 2024-09-12T00:05:29.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.628 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:29.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571511+0000", 2024-09-12T00:05:29.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028897599999999998 2024-09-12T00:05:29.628 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.628 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.628 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:29.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571668+0000", 2024-09-12T00:05:29.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000157238 2024-09-12T00:05:29.628 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.628 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:29.628 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.629 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.629 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2698 3.3d 3:bcafb0f9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:29.629 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:29.629 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 42.030763358000002, 2024-09-12T00:05:29.629 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025133152999999998, 2024-09-12T00:05:29.629 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:29.629 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:29.629 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:29.629 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:29.630 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:29.630 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:29.630 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2698 2024-09-12T00:05:29.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.630 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:29.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.630 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:29.630 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:29.630 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.630 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:29.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:29.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.631 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.631 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:29.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589986+0000", 2024-09-12T00:05:29.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5999999999999998e-06 2024-09-12T00:05:29.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.631 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.631 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:29.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594109+0000", 2024-09-12T00:05:29.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041230770000000002 2024-09-12T00:05:29.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.632 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:29.632 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594146+0000", 2024-09-12T00:05:29.632 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7722000000000002e-05 2024-09-12T00:05:29.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.632 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:29.632 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594167+0000", 2024-09-12T00:05:29.632 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0100999999999999e-05 2024-09-12T00:05:29.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.632 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:29.632 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594297+0000", 2024-09-12T00:05:29.632 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013051600000000001 2024-09-12T00:05:29.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.633 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:29.633 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594570+0000", 2024-09-12T00:05:29.633 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000272837 2024-09-12T00:05:29.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.633 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:29.633 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594846+0000", 2024-09-12T00:05:29.633 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027622399999999999 2024-09-12T00:05:29.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.633 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:29.633 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.606026+0000", 2024-09-12T00:05:29.634 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011179947000000001 2024-09-12T00:05:29.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.634 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:29.634 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.614827+0000", 2024-09-12T00:05:29.634 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0088013259999999999 2024-09-12T00:05:29.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.634 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:29.634 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.614988+0000", 2024-09-12T00:05:29.634 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016018799999999999 2024-09-12T00:05:29.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.634 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:29.635 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.615115+0000", 2024-09-12T00:05:29.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000127615 2024-09-12T00:05:29.635 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.635 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:29.635 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.635 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.635 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2712 3.3e 3:7d3d0242:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:29.635 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:29.635 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 41.893863080999999, 2024-09-12T00:05:29.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022816941, 2024-09-12T00:05:29.635 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:29.635 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:29.635 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:29.636 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:29.636 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:29.636 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:29.636 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2712 2024-09-12T00:05:29.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.636 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:29.637 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.637 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:29.637 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:29.637 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.637 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.637 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.638 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:29.638 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:29.638 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.638 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.638 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.638 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:29.638 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726886+0000", 2024-09-12T00:05:29.638 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5329999999999999e-06 2024-09-12T00:05:29.638 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.639 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.639 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:29.639 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730802+0000", 2024-09-12T00:05:29.639 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039158700000000001 2024-09-12T00:05:29.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.639 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.639 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:29.639 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730839+0000", 2024-09-12T00:05:29.639 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6857999999999998e-05 2024-09-12T00:05:29.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.640 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.640 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:29.640 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730856+0000", 2024-09-12T00:05:29.640 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7371999999999999e-05 2024-09-12T00:05:29.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.640 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.640 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:29.641 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731026+0000", 2024-09-12T00:05:29.641 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017011000000000001 2024-09-12T00:05:29.641 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.641 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.641 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:29.641 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731444+0000", 2024-09-12T00:05:29.642 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041766500000000001 2024-09-12T00:05:29.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.642 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.642 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:29.642 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731860+0000", 2024-09-12T00:05:29.642 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041618500000000001 2024-09-12T00:05:29.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.643 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.643 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:29.643 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.743012+0000", 2024-09-12T00:05:29.643 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011152123 2024-09-12T00:05:29.643 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.643 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.643 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:29.643 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749386+0000", 2024-09-12T00:05:29.643 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0063743130000000004 2024-09-12T00:05:29.643 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.644 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.644 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:29.644 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749562+0000", 2024-09-12T00:05:29.644 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017590300000000001 2024-09-12T00:05:29.644 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.644 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.644 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:29.644 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749699+0000", 2024-09-12T00:05:29.644 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000137009 2024-09-12T00:05:29.644 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.645 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:29.645 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.645 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.645 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.645 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2715 3.18 3:19a9b410:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:29.645 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:29.645 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 41.864486790999997, 2024-09-12T00:05:29.645 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022391956000000001, 2024-09-12T00:05:29.645 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:29.646 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:29.646 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:29.646 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:29.646 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:29.646 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:29.646 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2715 2024-09-12T00:05:29.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.646 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:29.646 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.646 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:29.646 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:29.647 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.647 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.647 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:29.647 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:29.647 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.647 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.647 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:29.647 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756262+0000", 2024-09-12T00:05:29.647 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9629999999999998e-06 2024-09-12T00:05:29.648 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.648 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.648 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:29.648 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760936+0000", 2024-09-12T00:05:29.648 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046745750000000003 2024-09-12T00:05:29.648 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.648 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.648 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:29.649 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760968+0000", 2024-09-12T00:05:29.649 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1470999999999997e-05 2024-09-12T00:05:29.649 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.649 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.649 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:29.649 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760985+0000", 2024-09-12T00:05:29.649 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7771999999999999e-05 2024-09-12T00:05:29.649 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.649 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.650 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:29.650 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761154+0000", 2024-09-12T00:05:29.650 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016875399999999999 2024-09-12T00:05:29.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.650 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.650 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:29.650 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761571+0000", 2024-09-12T00:05:29.650 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000417231 2024-09-12T00:05:29.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.651 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.651 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:29.651 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761996+0000", 2024-09-12T00:05:29.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042500200000000001 2024-09-12T00:05:29.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.651 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.651 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:29.651 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777182+0000", 2024-09-12T00:05:29.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015185664999999999 2024-09-12T00:05:29.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.652 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.652 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:29.652 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778484+0000", 2024-09-12T00:05:29.652 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00130225 2024-09-12T00:05:29.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.652 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.652 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:29.652 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778575+0000", 2024-09-12T00:05:29.652 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0258000000000002e-05 2024-09-12T00:05:29.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.653 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.653 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:29.653 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778651+0000", 2024-09-12T00:05:29.653 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6014999999999996e-05 2024-09-12T00:05:29.653 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.653 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:29.653 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.654 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.654 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2729 3.0 3:01c0e0c9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:29.654 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:29.654 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 41.723605974999998, 2024-09-12T00:05:29.654 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025173068, 2024-09-12T00:05:29.654 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:29.654 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:29.654 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:29.655 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:29.655 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:29.655 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:29.655 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2729 2024-09-12T00:05:29.655 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.655 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:29.655 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.656 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:29.656 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:29.656 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.656 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.656 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.656 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:29.656 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:29.657 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.657 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.657 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.657 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:29.657 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897143+0000", 2024-09-12T00:05:29.657 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6600000000000001e-06 2024-09-12T00:05:29.657 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.658 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.658 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:29.658 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901595+0000", 2024-09-12T00:05:29.658 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044514680000000001 2024-09-12T00:05:29.658 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.659 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:29.659 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901629+0000", 2024-09-12T00:05:29.659 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4864999999999999e-05 2024-09-12T00:05:29.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.659 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:29.659 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901647+0000", 2024-09-12T00:05:29.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7699000000000001e-05 2024-09-12T00:05:29.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.660 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:29.660 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901780+0000", 2024-09-12T00:05:29.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013271499999999999 2024-09-12T00:05:29.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.660 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:29.660 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902010+0000", 2024-09-12T00:05:29.661 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022977300000000001 2024-09-12T00:05:29.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.661 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.661 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:29.661 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902222+0000", 2024-09-12T00:05:29.661 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021262399999999999 2024-09-12T00:05:29.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:29.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912402+0000", 2024-09-12T00:05:29.662 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010180203000000001 2024-09-12T00:05:29.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:29.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.921990+0000", 2024-09-12T00:05:29.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095871900000000006 2024-09-12T00:05:29.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.663 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:29.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.922166+0000", 2024-09-12T00:05:29.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017591899999999999 2024-09-12T00:05:29.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.663 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:29.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.922313+0000", 2024-09-12T00:05:29.664 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000146952 2024-09-12T00:05:29.664 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.664 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:29.664 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.664 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.664 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2732 3.1f 3:f85b64cb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:29.665 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:29.665 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 41.692160186999999, 2024-09-12T00:05:29.665 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022644154, 2024-09-12T00:05:29.665 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:29.665 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:29.665 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:29.665 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:29.665 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:29.666 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:29.666 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2732 2024-09-12T00:05:29.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.666 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:29.666 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.666 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:29.666 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:29.666 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.666 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:29.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:29.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:29.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928589+0000", 2024-09-12T00:05:29.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1230000000000002e-06 2024-09-12T00:05:29.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:29.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932650+0000", 2024-09-12T00:05:29.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040611049999999997 2024-09-12T00:05:29.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.668 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:29.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932692+0000", 2024-09-12T00:05:29.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1677000000000001e-05 2024-09-12T00:05:29.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.669 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.669 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:29.669 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932711+0000", 2024-09-12T00:05:29.669 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8749e-05 2024-09-12T00:05:29.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.669 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.669 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:29.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932834+0000", 2024-09-12T00:05:29.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012278300000000001 2024-09-12T00:05:29.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:29.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.933095+0000", 2024-09-12T00:05:29.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026151100000000002 2024-09-12T00:05:29.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:29.671 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.933385+0000", 2024-09-12T00:05:29.671 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028993900000000002 2024-09-12T00:05:29.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.671 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:29.671 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.950988+0000", 2024-09-12T00:05:29.671 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017603119 2024-09-12T00:05:29.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.671 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:29.671 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951018+0000", 2024-09-12T00:05:29.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9343999999999999e-05 2024-09-12T00:05:29.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.672 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.672 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:29.672 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951109+0000", 2024-09-12T00:05:29.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1157999999999997e-05 2024-09-12T00:05:29.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.672 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.672 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:29.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951229+0000", 2024-09-12T00:05:29.673 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120646 2024-09-12T00:05:29.673 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.673 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:29.673 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.673 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2747 3.17 3:eaa4528d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:29.673 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:29.673 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 41.531823701999997, 2024-09-12T00:05:29.674 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025552734000000001, 2024-09-12T00:05:29.674 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:29.674 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:29.674 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:29.674 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:29.674 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:29.674 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:29.675 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2747 2024-09-12T00:05:29.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.675 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:29.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.675 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:29.675 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:29.675 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.676 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:29.676 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:29.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.676 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.676 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:29.676 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088925+0000", 2024-09-12T00:05:29.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7759999999999999e-06 2024-09-12T00:05:29.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.676 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:29.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093002+0000", 2024-09-12T00:05:29.677 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004076405 2024-09-12T00:05:29.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:29.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093040+0000", 2024-09-12T00:05:29.677 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8093999999999998e-05 2024-09-12T00:05:29.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.678 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.678 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:29.678 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093059+0000", 2024-09-12T00:05:29.678 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8736000000000002e-05 2024-09-12T00:05:29.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.678 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.678 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:29.678 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093230+0000", 2024-09-12T00:05:29.678 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000170853 2024-09-12T00:05:29.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.679 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:29.679 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093627+0000", 2024-09-12T00:05:29.679 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039781400000000002 2024-09-12T00:05:29.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.679 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:29.680 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.094044+0000", 2024-09-12T00:05:29.680 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000416205 2024-09-12T00:05:29.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.680 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.680 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:29.680 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.103528+0000", 2024-09-12T00:05:29.680 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0094841549999999993 2024-09-12T00:05:29.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.681 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.681 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:29.681 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112299+0000", 2024-09-12T00:05:29.681 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0087711590000000006 2024-09-12T00:05:29.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.681 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.681 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:29.681 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112397+0000", 2024-09-12T00:05:29.682 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8095000000000002e-05 2024-09-12T00:05:29.682 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.682 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.682 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:29.682 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.114474+0000", 2024-09-12T00:05:29.682 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020774420000000001 2024-09-12T00:05:29.682 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.682 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:29.682 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.683 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.683 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.683 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2962 3.18 3:1b55431a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:29.683 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:19.985385+0000", 2024-09-12T00:05:29.683 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 9.6353604110000006, 2024-09-12T00:05:29.683 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024097998999999998, 2024-09-12T00:05:29.683 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:29.683 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:29.683 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:29.683 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:29.684 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:29.684 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:29.684 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2962 2024-09-12T00:05:29.684 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.684 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:29.684 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.684 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:29.685 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.985385+0000", 2024-09-12T00:05:29.685 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.685 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.685 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:29.685 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.985385+0000", 2024-09-12T00:05:29.685 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.686 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.686 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:29.686 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.985388+0000", 2024-09-12T00:05:29.686 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8899999999999999e-06 2024-09-12T00:05:29.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.686 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.687 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:29.687 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990021+0000", 2024-09-12T00:05:29.687 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046326850000000001 2024-09-12T00:05:29.687 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.687 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.687 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:29.687 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990049+0000", 2024-09-12T00:05:29.688 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8007000000000001e-05 2024-09-12T00:05:29.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.688 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.688 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:29.688 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990064+0000", 2024-09-12T00:05:29.688 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4918e-05 2024-09-12T00:05:29.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.689 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:29.689 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990182+0000", 2024-09-12T00:05:29.689 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118958 2024-09-12T00:05:29.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.689 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:29.689 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990449+0000", 2024-09-12T00:05:29.690 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026634899999999998 2024-09-12T00:05:29.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.690 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.690 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:29.690 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990677+0000", 2024-09-12T00:05:29.690 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022768800000000001 2024-09-12T00:05:29.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.691 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.691 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:29.691 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.007621+0000", 2024-09-12T00:05:29.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016944866999999999 2024-09-12T00:05:29.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.692 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.692 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:29.692 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.009365+0000", 2024-09-12T00:05:29.692 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0017433399999999999 2024-09-12T00:05:29.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.692 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.693 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:29.693 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.009430+0000", 2024-09-12T00:05:29.693 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4813000000000004e-05 2024-09-12T00:05:29.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.693 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.693 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:29.693 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.009483+0000", 2024-09-12T00:05:29.694 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3483999999999998e-05 2024-09-12T00:05:29.694 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.694 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:29.694 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.694 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.694 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2995 3.29 3:96b1390d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:29.694 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.340290+0000", 2024-09-12T00:05:29.695 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 9.2804552699999991, 2024-09-12T00:05:29.695 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022765251, 2024-09-12T00:05:29.695 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:29.695 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:29.695 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:29.695 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:29.695 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:29.695 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:29.695 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2995 2024-09-12T00:05:29.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.696 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:29.696 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.696 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:29.696 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.340290+0000", 2024-09-12T00:05:29.696 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.696 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.696 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:29.696 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.340290+0000", 2024-09-12T00:05:29.697 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.697 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.697 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:29.697 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.340293+0000", 2024-09-12T00:05:29.697 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2200000000000001e-06 2024-09-12T00:05:29.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.697 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.697 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:29.698 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.346557+0000", 2024-09-12T00:05:29.698 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0062637070000000003 2024-09-12T00:05:29.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.698 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.698 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:29.698 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.346595+0000", 2024-09-12T00:05:29.698 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7672000000000001e-05 2024-09-12T00:05:29.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.698 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.699 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:29.699 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.346620+0000", 2024-09-12T00:05:29.699 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4769999999999998e-05 2024-09-12T00:05:29.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.699 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.699 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:29.699 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.346757+0000", 2024-09-12T00:05:29.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000137319 2024-09-12T00:05:29.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.700 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:29.700 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.347013+0000", 2024-09-12T00:05:29.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025612299999999997 2024-09-12T00:05:29.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:29.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.347237+0000", 2024-09-12T00:05:29.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000224348 2024-09-12T00:05:29.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:29.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.357526+0000", 2024-09-12T00:05:29.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010288693 2024-09-12T00:05:29.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:29.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.362902+0000", 2024-09-12T00:05:29.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053764659999999999 2024-09-12T00:05:29.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:29.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.362988+0000", 2024-09-12T00:05:29.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.5086000000000005e-05 2024-09-12T00:05:29.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.704 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.704 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:29.704 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.363055+0000", 2024-09-12T00:05:29.705 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.7847000000000003e-05 2024-09-12T00:05:29.705 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.705 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:29.705 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.705 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3017 3.1e 3:792e6842:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:29.705 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.605222+0000", 2024-09-12T00:05:29.706 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 9.0155230480000004, 2024-09-12T00:05:29.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021662359999999999, 2024-09-12T00:05:29.706 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:29.706 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:29.706 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:29.706 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:29.706 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:29.707 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:29.707 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3017 2024-09-12T00:05:29.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.707 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:29.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:29.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.605222+0000", 2024-09-12T00:05:29.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.708 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.708 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:29.708 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.605222+0000", 2024-09-12T00:05:29.708 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.708 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.708 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:29.708 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.605227+0000", 2024-09-12T00:05:29.708 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3100000000000002e-06 2024-09-12T00:05:29.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.709 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.709 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:29.709 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.610360+0000", 2024-09-12T00:05:29.709 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0051331609999999998 2024-09-12T00:05:29.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.709 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.709 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:29.709 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.610400+0000", 2024-09-12T00:05:29.709 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9795000000000001e-05 2024-09-12T00:05:29.710 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.710 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.710 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:29.710 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.610418+0000", 2024-09-12T00:05:29.710 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8539e-05 2024-09-12T00:05:29.710 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.710 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.710 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:29.710 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.610552+0000", 2024-09-12T00:05:29.711 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013348400000000001 2024-09-12T00:05:29.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.711 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.711 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:29.711 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.610799+0000", 2024-09-12T00:05:29.711 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024735600000000001 2024-09-12T00:05:29.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:29.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611118+0000", 2024-09-12T00:05:29.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000318676 2024-09-12T00:05:29.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.713 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.713 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:29.713 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.620061+0000", 2024-09-12T00:05:29.713 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0089429920000000003 2024-09-12T00:05:29.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.713 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.713 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:29.714 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.626735+0000", 2024-09-12T00:05:29.714 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006674803 2024-09-12T00:05:29.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.714 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.714 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:29.714 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.626826+0000", 2024-09-12T00:05:29.714 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0532000000000007e-05 2024-09-12T00:05:29.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.715 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.715 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:29.715 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.626885+0000", 2024-09-12T00:05:29.715 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8712000000000003e-05 2024-09-12T00:05:29.715 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.716 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:29.716 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.716 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.716 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.716 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3033 3.1e 3:79681e1a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:29.716 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.771222+0000", 2024-09-12T00:05:29.716 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.8495229430000002, 2024-09-12T00:05:29.716 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.033700292, 2024-09-12T00:05:29.716 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:29.717 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:29.717 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:29.717 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:29.717 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:29.717 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:29.717 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3033 2024-09-12T00:05:29.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.718 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:29.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:29.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.771222+0000", 2024-09-12T00:05:29.718 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:29.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.771222+0000", 2024-09-12T00:05:29.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.719 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:29.719 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.771225+0000", 2024-09-12T00:05:29.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.74e-06 2024-09-12T00:05:29.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.719 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:29.720 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.775948+0000", 2024-09-12T00:05:29.720 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047228419999999997 2024-09-12T00:05:29.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.720 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.720 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:29.720 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.775971+0000", 2024-09-12T00:05:29.720 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2634999999999999e-05 2024-09-12T00:05:29.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.720 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.720 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:29.721 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.775981+0000", 2024-09-12T00:05:29.721 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8579999999999995e-06 2024-09-12T00:05:29.721 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.721 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.721 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:29.721 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.776126+0000", 2024-09-12T00:05:29.722 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014540500000000001 2024-09-12T00:05:29.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.722 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.722 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:29.722 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.776391+0000", 2024-09-12T00:05:29.722 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026489699999999999 2024-09-12T00:05:29.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.722 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.723 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:29.723 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.776613+0000", 2024-09-12T00:05:29.723 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022235700000000001 2024-09-12T00:05:29.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.723 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:29.724 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.783586+0000", 2024-09-12T00:05:29.724 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006972705 2024-09-12T00:05:29.724 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.724 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.724 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:29.725 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.804641+0000", 2024-09-12T00:05:29.725 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021055470999999999 2024-09-12T00:05:29.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.725 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.725 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:29.725 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.804798+0000", 2024-09-12T00:05:29.725 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015695600000000001 2024-09-12T00:05:29.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.726 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.726 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:29.726 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.804923+0000", 2024-09-12T00:05:29.726 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012442599999999999 2024-09-12T00:05:29.726 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.726 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:29.726 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.726 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.727 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.727 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3036 3.1e 3:7aa0a48a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:29.727 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.802567+0000", 2024-09-12T00:05:29.727 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.8181788329999993, 2024-09-12T00:05:29.727 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022998985, 2024-09-12T00:05:29.727 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:29.727 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:29.727 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:29.727 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:29.728 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:29.728 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:29.728 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3036 2024-09-12T00:05:29.728 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.728 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:29.728 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.728 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:29.728 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.802567+0000", 2024-09-12T00:05:29.728 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.729 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.729 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:29.729 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.802567+0000", 2024-09-12T00:05:29.729 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.729 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.729 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:29.729 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.802570+0000", 2024-09-12T00:05:29.730 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3100000000000001e-06 2024-09-12T00:05:29.730 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.730 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.730 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:29.730 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.807884+0000", 2024-09-12T00:05:29.730 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053139809999999997 2024-09-12T00:05:29.730 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.730 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.731 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:29.731 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.807917+0000", 2024-09-12T00:05:29.731 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3334999999999998e-05 2024-09-12T00:05:29.731 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.731 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.731 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:29.731 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.807934+0000", 2024-09-12T00:05:29.731 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6543000000000001e-05 2024-09-12T00:05:29.731 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.731 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.732 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:29.732 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.808082+0000", 2024-09-12T00:05:29.732 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148639 2024-09-12T00:05:29.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.732 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.732 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:29.732 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.808332+0000", 2024-09-12T00:05:29.732 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024954699999999997 2024-09-12T00:05:29.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.732 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.733 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:29.733 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.808560+0000", 2024-09-12T00:05:29.733 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000228314 2024-09-12T00:05:29.733 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.733 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.733 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:29.733 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.817415+0000", 2024-09-12T00:05:29.733 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0088550780000000006 2024-09-12T00:05:29.733 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.733 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.734 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:29.734 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.825488+0000", 2024-09-12T00:05:29.734 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.008072638 2024-09-12T00:05:29.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.734 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.734 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:29.734 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.825531+0000", 2024-09-12T00:05:29.734 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3272000000000002e-05 2024-09-12T00:05:29.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.734 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.735 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:29.735 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.825566+0000", 2024-09-12T00:05:29.735 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4328000000000001e-05 2024-09-12T00:05:29.735 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.735 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:29.735 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.735 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.735 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.735 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3048 3.29 3:9595c6a5:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:29.735 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.934655+0000", 2024-09-12T00:05:29.736 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.6860907760000003, 2024-09-12T00:05:29.736 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.031642133000000003, 2024-09-12T00:05:29.736 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:29.736 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:29.736 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:29.736 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:29.736 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:29.736 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:29.736 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3048 2024-09-12T00:05:29.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.737 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:29.737 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.737 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:29.737 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.934655+0000", 2024-09-12T00:05:29.737 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.737 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.737 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.737 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:29.737 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.934655+0000", 2024-09-12T00:05:29.737 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.737 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.738 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.738 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:29.738 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.934658+0000", 2024-09-12T00:05:29.738 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4970000000000001e-06 2024-09-12T00:05:29.738 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.738 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.738 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:29.738 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.940147+0000", 2024-09-12T00:05:29.738 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054891940000000002 2024-09-12T00:05:29.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.739 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.739 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:29.739 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.940185+0000", 2024-09-12T00:05:29.739 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8056000000000003e-05 2024-09-12T00:05:29.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.739 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.739 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:29.739 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.940207+0000", 2024-09-12T00:05:29.740 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2069000000000002e-05 2024-09-12T00:05:29.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.740 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.740 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:29.740 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.940392+0000", 2024-09-12T00:05:29.740 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018462200000000001 2024-09-12T00:05:29.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.740 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.740 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:29.741 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.940795+0000", 2024-09-12T00:05:29.741 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040330599999999998 2024-09-12T00:05:29.741 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.741 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.741 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:29.741 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.941226+0000", 2024-09-12T00:05:29.741 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00043093899999999997 2024-09-12T00:05:29.741 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.741 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.742 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:29.742 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.950900+0000", 2024-09-12T00:05:29.742 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0096740950000000006 2024-09-12T00:05:29.742 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.742 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.742 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:29.742 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.966201+0000", 2024-09-12T00:05:29.742 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015301069 2024-09-12T00:05:29.742 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.742 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.743 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:29.743 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.966254+0000", 2024-09-12T00:05:29.743 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2825000000000003e-05 2024-09-12T00:05:29.743 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.743 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.743 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:29.743 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.966297+0000", 2024-09-12T00:05:29.743 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2460999999999999e-05 2024-09-12T00:05:29.743 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.743 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:29.744 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.744 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.744 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.744 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3070 3.29 3:96d4e2a7:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:29.744 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.178172+0000", 2024-09-12T00:05:29.744 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.4425736899999997, 2024-09-12T00:05:29.744 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022157735000000001, 2024-09-12T00:05:29.744 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:29.744 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:29.744 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:29.745 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:29.745 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:29.745 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:29.745 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3070 2024-09-12T00:05:29.745 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.745 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:29.745 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.745 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:29.745 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.178172+0000", 2024-09-12T00:05:29.746 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.746 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.746 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.746 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:29.746 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.178172+0000", 2024-09-12T00:05:29.746 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.746 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.746 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.746 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:29.746 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.178175+0000", 2024-09-12T00:05:29.748 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1e-06 2024-09-12T00:05:29.748 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.748 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.749 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:29.749 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.182708+0000", 2024-09-12T00:05:29.749 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045331640000000001 2024-09-12T00:05:29.749 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.749 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.749 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:29.749 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.182732+0000", 2024-09-12T00:05:29.749 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4034999999999999e-05 2024-09-12T00:05:29.750 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.750 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.750 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:29.750 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.182744+0000", 2024-09-12T00:05:29.750 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1892999999999999e-05 2024-09-12T00:05:29.750 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.750 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.751 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:29.751 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.182898+0000", 2024-09-12T00:05:29.751 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015410200000000001 2024-09-12T00:05:29.751 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.751 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.751 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:29.751 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.183288+0000", 2024-09-12T00:05:29.751 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00038976700000000001 2024-09-12T00:05:29.752 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.752 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.752 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:29.752 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.183703+0000", 2024-09-12T00:05:29.752 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041542199999999998 2024-09-12T00:05:29.752 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.752 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.753 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:29.753 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.195712+0000", 2024-09-12T00:05:29.753 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012008705 2024-09-12T00:05:29.753 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.753 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.753 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:29.753 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.200106+0000", 2024-09-12T00:05:29.753 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043939000000000001 2024-09-12T00:05:29.753 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.754 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.754 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:29.754 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.200212+0000", 2024-09-12T00:05:29.754 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010597700000000001 2024-09-12T00:05:29.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.754 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.754 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:29.754 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.200329+0000", 2024-09-12T00:05:29.755 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011767 2024-09-12T00:05:29.755 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.755 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:29.755 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.755 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.755 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.755 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3093 3.1e 3:7a820553:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:29.755 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.517971+0000", 2024-09-12T00:05:29.756 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.1027747320000003, 2024-09-12T00:05:29.756 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022817258999999999, 2024-09-12T00:05:29.756 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:29.756 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:29.756 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:29.756 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:29.756 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:29.757 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:29.757 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3093 2024-09-12T00:05:29.757 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.757 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:29.757 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.757 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:29.757 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.517971+0000", 2024-09-12T00:05:29.758 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.758 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.758 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.758 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:29.758 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.517971+0000", 2024-09-12T00:05:29.758 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.758 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.758 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.759 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:29.759 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.517974+0000", 2024-09-12T00:05:29.759 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.05e-06 2024-09-12T00:05:29.759 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.759 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.759 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:29.759 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.522902+0000", 2024-09-12T00:05:29.760 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049284039999999999 2024-09-12T00:05:29.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.760 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.760 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:29.760 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.522937+0000", 2024-09-12T00:05:29.760 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4968999999999997e-05 2024-09-12T00:05:29.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.760 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.761 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:29.761 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.522953+0000", 2024-09-12T00:05:29.761 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6186999999999999e-05 2024-09-12T00:05:29.761 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.761 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.761 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:29.761 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.523066+0000", 2024-09-12T00:05:29.761 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000112506 2024-09-12T00:05:29.762 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.762 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.762 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:29.762 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.523296+0000", 2024-09-12T00:05:29.762 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000229903 2024-09-12T00:05:29.762 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.762 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.762 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:29.762 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.523530+0000", 2024-09-12T00:05:29.762 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023455700000000001 2024-09-12T00:05:29.763 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.763 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.763 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:29.763 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.534622+0000", 2024-09-12T00:05:29.763 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011092039999999999 2024-09-12T00:05:29.763 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.763 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.763 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:29.763 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540615+0000", 2024-09-12T00:05:29.764 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059929190000000002 2024-09-12T00:05:29.764 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.764 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.764 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:29.764 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540710+0000", 2024-09-12T00:05:29.764 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5239000000000001e-05 2024-09-12T00:05:29.764 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.765 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.765 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:29.765 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540788+0000", 2024-09-12T00:05:29.765 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7484999999999994e-05 2024-09-12T00:05:29.765 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.765 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:29.765 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.765 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.765 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.766 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3099 3.18 3:182e7247:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:29.766 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.611202+0000", 2024-09-12T00:05:29.766 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.0095434940000008, 2024-09-12T00:05:29.766 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.023647292, 2024-09-12T00:05:29.766 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:29.766 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:29.766 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:29.767 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:29.767 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:29.767 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:29.767 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3099 2024-09-12T00:05:29.767 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.767 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:29.767 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.767 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:29.768 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.611202+0000", 2024-09-12T00:05:29.768 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.768 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.768 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.768 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:29.768 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.611202+0000", 2024-09-12T00:05:29.768 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.768 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.768 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.769 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:29.769 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.611218+0000", 2024-09-12T00:05:29.769 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5959000000000001e-05 2024-09-12T00:05:29.769 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.769 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.769 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:29.769 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.615976+0000", 2024-09-12T00:05:29.769 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047581259999999997 2024-09-12T00:05:29.769 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.770 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.770 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:29.770 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.616010+0000", 2024-09-12T00:05:29.770 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3515e-05 2024-09-12T00:05:29.770 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.770 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.770 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:29.771 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.616034+0000", 2024-09-12T00:05:29.771 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4956e-05 2024-09-12T00:05:29.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.771 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.771 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:29.771 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.616134+0000", 2024-09-12T00:05:29.771 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9114e-05 2024-09-12T00:05:29.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.771 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.772 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op must wait for map", 2024-09-12T00:05:29.772 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.616140+0000", 2024-09-12T00:05:29.772 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4110000000000001e-06 2024-09-12T00:05:29.772 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.772 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.772 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:29.772 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.619890+0000", 2024-09-12T00:05:29.772 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037501169999999999 2024-09-12T00:05:29.773 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.773 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.773 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:29.773 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.620108+0000", 2024-09-12T00:05:29.773 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021770399999999999 2024-09-12T00:05:29.773 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.773 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.773 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:29.773 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.620327+0000", 2024-09-12T00:05:29.774 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021896799999999999 2024-09-12T00:05:29.774 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.774 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.774 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:29.774 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.633688+0000", 2024-09-12T00:05:29.774 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013361642 2024-09-12T00:05:29.774 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.774 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.774 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:29.775 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.634683+0000", 2024-09-12T00:05:29.775 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000994745 2024-09-12T00:05:29.775 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.775 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.775 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:29.775 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.634779+0000", 2024-09-12T00:05:29.775 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.6059999999999998e-05 2024-09-12T00:05:29.775 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.776 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.776 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:29.776 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.634849+0000", 2024-09-12T00:05:29.776 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9974999999999993e-05 2024-09-12T00:05:29.776 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.776 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:29.776 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.777 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.777 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.777 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3119 3.31 3:8fd3d951:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:29.777 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.840627+0000", 2024-09-12T00:05:29.777 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 7.7801179979999997, 2024-09-12T00:05:29.777 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022334611000000001, 2024-09-12T00:05:29.777 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:29.777 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:29.777 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:29.778 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:29.778 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:29.778 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:29.778 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3119 2024-09-12T00:05:29.778 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.778 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:29.778 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.778 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:29.778 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.840627+0000", 2024-09-12T00:05:29.778 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.779 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.779 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.779 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:29.779 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.840627+0000", 2024-09-12T00:05:29.779 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.779 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.779 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.779 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:29.779 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.840659+0000", 2024-09-12T00:05:29.779 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1534e-05 2024-09-12T00:05:29.780 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.780 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.780 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:29.780 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.844903+0000", 2024-09-12T00:05:29.780 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042441659999999997 2024-09-12T00:05:29.780 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.780 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.780 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:29.781 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.844932+0000", 2024-09-12T00:05:29.781 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8605000000000001e-05 2024-09-12T00:05:29.781 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.781 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.781 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:29.781 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.844948+0000", 2024-09-12T00:05:29.781 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5914e-05 2024-09-12T00:05:29.781 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.781 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.782 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:29.782 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.845021+0000", 2024-09-12T00:05:29.782 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.339e-05 2024-09-12T00:05:29.782 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.782 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.782 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:29.782 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.845141+0000", 2024-09-12T00:05:29.782 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000119821 2024-09-12T00:05:29.782 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.782 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.783 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:29.783 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.845242+0000", 2024-09-12T00:05:29.783 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000101545 2024-09-12T00:05:29.783 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.783 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.783 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:29.783 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.852177+0000", 2024-09-12T00:05:29.783 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0069342809999999996 2024-09-12T00:05:29.784 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.784 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.784 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:29.784 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.862873+0000", 2024-09-12T00:05:29.784 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010696359000000001 2024-09-12T00:05:29.784 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.784 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.785 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:29.785 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.862921+0000", 2024-09-12T00:05:29.785 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7793000000000001e-05 2024-09-12T00:05:29.785 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.785 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.785 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:29.785 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.862962+0000", 2024-09-12T00:05:29.785 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1202999999999998e-05 2024-09-12T00:05:29.785 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.785 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:29.786 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.786 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.786 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.786 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3123 3.3d 3:bd29fd76:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:29.786 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.893071+0000", 2024-09-12T00:05:29.786 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 7.7276748629999998, 2024-09-12T00:05:29.786 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022412392999999999, 2024-09-12T00:05:29.786 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:29.786 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:29.787 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:29.787 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:29.787 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:29.787 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:29.787 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3123 2024-09-12T00:05:29.787 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.787 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:29.787 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.787 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:29.787 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.893071+0000", 2024-09-12T00:05:29.788 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.788 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.788 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.788 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:29.788 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.893071+0000", 2024-09-12T00:05:29.788 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.788 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.789 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.789 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:29.789 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.893073+0000", 2024-09-12T00:05:29.789 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3479999999999998e-06 2024-09-12T00:05:29.789 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.789 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.789 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:29.789 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.897186+0000", 2024-09-12T00:05:29.789 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004112709 2024-09-12T00:05:29.789 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.790 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.790 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:29.790 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.897210+0000", 2024-09-12T00:05:29.790 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4763999999999999e-05 2024-09-12T00:05:29.790 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.790 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.790 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:29.790 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.897220+0000", 2024-09-12T00:05:29.790 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3810000000000005e-06 2024-09-12T00:05:29.791 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.791 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.791 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:29.791 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.897340+0000", 2024-09-12T00:05:29.791 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012034199999999999 2024-09-12T00:05:29.791 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.791 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.791 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:29.791 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.897604+0000", 2024-09-12T00:05:29.791 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026359300000000001 2024-09-12T00:05:29.792 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.792 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.792 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:29.792 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.897868+0000", 2024-09-12T00:05:29.792 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026388300000000002 2024-09-12T00:05:29.792 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.792 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.792 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:29.792 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.913985+0000", 2024-09-12T00:05:29.792 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016117359000000001 2024-09-12T00:05:29.793 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.793 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.793 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:29.793 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915189+0000", 2024-09-12T00:05:29.793 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012040250000000001 2024-09-12T00:05:29.793 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.793 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.793 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:29.793 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915349+0000", 2024-09-12T00:05:29.793 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015957999999999999 2024-09-12T00:05:29.793 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.794 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.794 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:29.794 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915483+0000", 2024-09-12T00:05:29.794 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013440899999999999 2024-09-12T00:05:29.794 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.794 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:29.794 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.794 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.794 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.794 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3133 3.10 e76/23 3:0bd95b9d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_172:head v 76'8, mlcod=63'6)", 2024-09-12T00:05:29.795 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.030942+0000", 2024-09-12T00:05:29.795 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 7.5898032129999997, 2024-09-12T00:05:29.795 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024435973999999999, 2024-09-12T00:05:29.795 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:29.795 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:29.795 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:29.795 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:29.795 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.795 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:29.795 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.030942+0000", 2024-09-12T00:05:29.795 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.795 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.796 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.796 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:29.796 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.030942+0000", 2024-09-12T00:05:29.796 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.796 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.796 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.796 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:29.796 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.030950+0000", 2024-09-12T00:05:29.796 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0499999999999992e-06 2024-09-12T00:05:29.796 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.796 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.796 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:29.796 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039165+0000", 2024-09-12T00:05:29.796 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082151329999999995 2024-09-12T00:05:29.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.797 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.797 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:29.797 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039194+0000", 2024-09-12T00:05:29.797 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8425999999999999e-05 2024-09-12T00:05:29.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.797 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.797 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:29.797 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039210+0000", 2024-09-12T00:05:29.797 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5886e-05 2024-09-12T00:05:29.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.797 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.797 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:29.798 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039366+0000", 2024-09-12T00:05:29.798 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015638300000000001 2024-09-12T00:05:29.798 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.798 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.798 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:29.798 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039410+0000", 2024-09-12T00:05:29.798 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3958999999999997e-05 2024-09-12T00:05:29.798 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.798 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.798 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:29.798 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.055263+0000", 2024-09-12T00:05:29.798 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015852926 2024-09-12T00:05:29.798 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.798 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.798 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:29.799 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.055378+0000", 2024-09-12T00:05:29.799 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011521100000000001 2024-09-12T00:05:29.799 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.799 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:29.799 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.799 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.799 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.799 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3147 3.3e 3:7c719451:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:29.799 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.204783+0000", 2024-09-12T00:05:29.799 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 7.4159620349999997, 2024-09-12T00:05:29.799 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028014297000000001, 2024-09-12T00:05:29.799 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:29.799 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:29.800 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:29.800 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:29.800 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:29.800 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:29.800 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3147 2024-09-12T00:05:29.800 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.800 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:29.800 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.800 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:29.800 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.204783+0000", 2024-09-12T00:05:29.800 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.801 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.801 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:29.801 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.204783+0000", 2024-09-12T00:05:29.801 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:29.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.802 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.802 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:29.802 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.204787+0000", 2024-09-12T00:05:29.802 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0759999999999996e-06 2024-09-12T00:05:29.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.802 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.803 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:29.803 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.210868+0000", 2024-09-12T00:05:29.803 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0060804530000000004 2024-09-12T00:05:29.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.803 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:29.803 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.210894+0000", 2024-09-12T00:05:29.803 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6571999999999999e-05 2024-09-12T00:05:29.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.804 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:29.804 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.210907+0000", 2024-09-12T00:05:29.804 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2437e-05 2024-09-12T00:05:29.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.805 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:29.805 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.211064+0000", 2024-09-12T00:05:29.805 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015706800000000001 2024-09-12T00:05:29.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.805 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:29.805 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.211461+0000", 2024-09-12T00:05:29.805 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039665300000000001 2024-09-12T00:05:29.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.806 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:29.806 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.211880+0000", 2024-09-12T00:05:29.806 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000419503 2024-09-12T00:05:29.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.806 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.806 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:29.806 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.226312+0000", 2024-09-12T00:05:29.806 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014432228 2024-09-12T00:05:29.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.807 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:29.807 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.232496+0000", 2024-09-12T00:05:29.807 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061839579999999998 2024-09-12T00:05:29.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.807 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:29.807 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.232677+0000", 2024-09-12T00:05:29.808 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000181132 2024-09-12T00:05:29.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:29.808 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:29.808 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:29.808 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.232798+0000", 2024-09-12T00:05:29.808 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120217 2024-09-12T00:05:29.808 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.808 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:29.808 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.808 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:29.809 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:29.809 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:29.810 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:05:29.811 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:29.808+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:29.911 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:29.912+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:29.989 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:29.990 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:29.990 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:29.990 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:30.006 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:05:30.056 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:30.056+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:30.113 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:30.108+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:30.127 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:30.127 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:30.127 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:30.127 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:30.127 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:30.141 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:05:30.215 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:30.216+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:30.310 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:30.311 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:30.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:30.311 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:30.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.311 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1646 3.25 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:05:30.311 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:30.311 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 57.231968092999999, 2024-09-12T00:05:30.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030091884999999999, 2024-09-12T00:05:30.311 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.311 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.311 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.311 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:30.311 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:30.312 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:30.312 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1646 2024-09-12T00:05:30.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.312 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.312 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:30.312 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:30.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.313 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077113+0000", 2024-09-12T00:05:30.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0186e-05 2024-09-12T00:05:30.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.313 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.314 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084821+0000", 2024-09-12T00:05:30.314 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077083450000000001 2024-09-12T00:05:30.314 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.314 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.314 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.314 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084857+0000", 2024-09-12T00:05:30.314 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6245000000000003e-05 2024-09-12T00:05:30.314 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.314 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.314 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.314 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084900+0000", 2024-09-12T00:05:30.314 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2369e-05 2024-09-12T00:05:30.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.315 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.315 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.315 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085058+0000", 2024-09-12T00:05:30.316 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015858199999999999 2024-09-12T00:05:30.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.316 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.316 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085307+0000", 2024-09-12T00:05:30.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024867999999999998 2024-09-12T00:05:30.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.317 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.317 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:30.317 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086107+0000", 2024-09-12T00:05:30.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00080040099999999996 2024-09-12T00:05:30.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.318 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.318 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:30.318 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.100477+0000", 2024-09-12T00:05:30.318 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014369508 2024-09-12T00:05:30.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.319 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.319 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:30.319 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107016+0000", 2024-09-12T00:05:30.319 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006538894 2024-09-12T00:05:30.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.319 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.319 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.319 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107121+0000", 2024-09-12T00:05:30.320 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105284 2024-09-12T00:05:30.320 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.320 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.320 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.320 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107194+0000", 2024-09-12T00:05:30.320 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3391000000000003e-05 2024-09-12T00:05:30.320 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.321 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.321 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.321 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.321 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1917 3.1 3:829295ac:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.4_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:05:30.321 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:30.322 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 55.143884612999997, 2024-09-12T00:05:30.322 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021401453000000001, 2024-09-12T00:05:30.322 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.322 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.322 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.322 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:30.323 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:30.323 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:30.323 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1917 2024-09-12T00:05:30.323 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.324 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.324 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.324 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.324 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:30.324 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.325 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.325 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.325 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:30.325 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.325 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.326 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.326 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165188+0000", 2024-09-12T00:05:30.326 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5409999999999999e-06 2024-09-12T00:05:30.326 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.326 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.326 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.327 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169353+0000", 2024-09-12T00:05:30.327 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00416446 2024-09-12T00:05:30.327 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.327 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.327 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.328 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169380+0000", 2024-09-12T00:05:30.328 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6919000000000001e-05 2024-09-12T00:05:30.328 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.328 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.328 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.328 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169392+0000", 2024-09-12T00:05:30.328 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1967000000000001e-05 2024-09-12T00:05:30.329 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.329 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.329 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.329 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169519+0000", 2024-09-12T00:05:30.329 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012686199999999999 2024-09-12T00:05:30.329 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.330 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.330 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.330 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169789+0000", 2024-09-12T00:05:30.330 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027062700000000001 2024-09-12T00:05:30.330 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.330 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.331 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:30.331 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.170614+0000", 2024-09-12T00:05:30.331 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00082475799999999998 2024-09-12T00:05:30.331 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.331 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.331 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:30.331 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.183665+0000", 2024-09-12T00:05:30.331 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013051269000000001 2024-09-12T00:05:30.331 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.332 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.332 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:30.332 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186367+0000", 2024-09-12T00:05:30.332 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002701789 2024-09-12T00:05:30.332 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.332 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.332 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.332 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186485+0000", 2024-09-12T00:05:30.332 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011763400000000001 2024-09-12T00:05:30.332 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.332 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.332 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.333 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186587+0000", 2024-09-12T00:05:30.333 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010262700000000001 2024-09-12T00:05:30.333 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.333 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.333 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.333 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.333 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.333 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2718 3.4 3:20fe36bb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:30.333 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:30.334 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 42.523489935000001, 2024-09-12T00:05:30.334 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027867928, 2024-09-12T00:05:30.334 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.334 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.334 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.334 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:30.334 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:30.334 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:30.334 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2718 2024-09-12T00:05:30.334 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.334 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.334 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.334 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.335 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:30.335 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.335 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.335 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.335 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:30.335 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.335 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.335 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.336 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785584+0000", 2024-09-12T00:05:30.336 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.056e-06 2024-09-12T00:05:30.336 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.336 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.336 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.336 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792023+0000", 2024-09-12T00:05:30.336 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064398069999999996 2024-09-12T00:05:30.336 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.336 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.336 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.336 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792058+0000", 2024-09-12T00:05:30.336 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5018000000000003e-05 2024-09-12T00:05:30.337 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.337 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.337 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.337 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792078+0000", 2024-09-12T00:05:30.337 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9862000000000001e-05 2024-09-12T00:05:30.337 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.337 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.338 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.338 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792248+0000", 2024-09-12T00:05:30.338 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017006399999999999 2024-09-12T00:05:30.338 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.338 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.338 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.338 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792660+0000", 2024-09-12T00:05:30.338 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041189500000000001 2024-09-12T00:05:30.338 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.338 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.338 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:30.338 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793081+0000", 2024-09-12T00:05:30.338 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000420395 2024-09-12T00:05:30.338 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.339 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.339 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:30.339 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808422+0000", 2024-09-12T00:05:30.339 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015341626000000001 2024-09-12T00:05:30.339 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.339 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.339 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:30.339 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813192+0000", 2024-09-12T00:05:30.339 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047701799999999997 2024-09-12T00:05:30.339 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.339 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.339 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.340 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813339+0000", 2024-09-12T00:05:30.340 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014643800000000001 2024-09-12T00:05:30.340 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.340 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.340 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.340 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813449+0000", 2024-09-12T00:05:30.340 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010958700000000001 2024-09-12T00:05:30.340 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.340 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.340 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.341 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.341 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.341 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2719 3.1 3:83b62cc7:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:30.341 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:30.341 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 42.514982498000002, 2024-09-12T00:05:30.341 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021687128999999999, 2024-09-12T00:05:30.341 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.341 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.341 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.341 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:30.341 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:30.341 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:30.341 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2719 2024-09-12T00:05:30.342 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.342 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.342 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.342 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.342 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:30.342 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.343 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.343 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.343 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.343 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:30.343 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.343 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.343 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.343 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.343 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794091+0000", 2024-09-12T00:05:30.343 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0630000000000002e-06 2024-09-12T00:05:30.343 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.344 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.344 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.344 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800194+0000", 2024-09-12T00:05:30.344 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061025089999999999 2024-09-12T00:05:30.344 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.344 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.344 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.344 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800234+0000", 2024-09-12T00:05:30.344 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0114999999999998e-05 2024-09-12T00:05:30.344 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.345 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.345 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.345 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800255+0000", 2024-09-12T00:05:30.345 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1548000000000001e-05 2024-09-12T00:05:30.345 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.345 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.345 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.345 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800400+0000", 2024-09-12T00:05:30.345 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014438499999999999 2024-09-12T00:05:30.345 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.345 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.345 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.345 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800654+0000", 2024-09-12T00:05:30.346 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025430500000000003 2024-09-12T00:05:30.346 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.346 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.346 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:30.346 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800908+0000", 2024-09-12T00:05:30.346 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025422800000000001 2024-09-12T00:05:30.346 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.346 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.346 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:30.347 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.814197+0000", 2024-09-12T00:05:30.347 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013289216 2024-09-12T00:05:30.347 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.347 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.347 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:30.347 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815578+0000", 2024-09-12T00:05:30.347 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00138079 2024-09-12T00:05:30.347 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.347 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.347 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.347 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815704+0000", 2024-09-12T00:05:30.348 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012551500000000001 2024-09-12T00:05:30.348 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.348 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.348 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.348 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815775+0000", 2024-09-12T00:05:30.348 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1454999999999999e-05 2024-09-12T00:05:30.348 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.348 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.349 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.349 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.349 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.349 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2736 3.25 3:a750a681:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:30.349 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:30.349 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 42.333717573000001, 2024-09-12T00:05:30.349 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025701234999999999, 2024-09-12T00:05:30.349 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.349 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.349 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.349 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:30.350 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:30.350 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:30.350 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2736 2024-09-12T00:05:30.350 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.350 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.350 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.350 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.350 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:30.350 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.350 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.350 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.350 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.350 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:30.350 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.351 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.351 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.351 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.351 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975357+0000", 2024-09-12T00:05:30.351 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9389999999999999e-06 2024-09-12T00:05:30.351 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.351 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.351 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.351 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979365+0000", 2024-09-12T00:05:30.351 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040076679999999998 2024-09-12T00:05:30.351 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.352 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.352 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.352 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979402+0000", 2024-09-12T00:05:30.352 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7557e-05 2024-09-12T00:05:30.352 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.352 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.352 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.352 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979419+0000", 2024-09-12T00:05:30.352 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7203000000000001e-05 2024-09-12T00:05:30.352 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.352 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.352 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.353 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979543+0000", 2024-09-12T00:05:30.353 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000123423 2024-09-12T00:05:30.353 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.353 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.353 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.353 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979784+0000", 2024-09-12T00:05:30.353 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024097800000000001 2024-09-12T00:05:30.353 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.353 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.353 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:30.353 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980013+0000", 2024-09-12T00:05:30.353 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022881999999999999 2024-09-12T00:05:30.354 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.354 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.354 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:30.354 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.999860+0000", 2024-09-12T00:05:30.354 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019847908000000001 2024-09-12T00:05:30.354 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.355 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.355 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:30.355 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000741+0000", 2024-09-12T00:05:30.355 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00088041499999999995 2024-09-12T00:05:30.355 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.355 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.355 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.355 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000915+0000", 2024-09-12T00:05:30.355 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017460300000000001 2024-09-12T00:05:30.355 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.355 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.355 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.355 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.001054+0000", 2024-09-12T00:05:30.356 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013872099999999999 2024-09-12T00:05:30.356 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.356 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.356 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.356 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.356 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2737 3.25 3:a794c975:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:30.356 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:30.356 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 42.323704767000002, 2024-09-12T00:05:30.356 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022562862999999999, 2024-09-12T00:05:30.356 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.356 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.356 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.357 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:30.357 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:30.357 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:30.357 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2737 2024-09-12T00:05:30.357 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.357 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.357 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.357 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.357 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:30.357 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.357 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.358 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.358 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.358 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:30.358 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.358 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.358 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.358 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.358 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985368+0000", 2024-09-12T00:05:30.358 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.323e-06 2024-09-12T00:05:30.358 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.358 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.358 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.358 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990209+0000", 2024-09-12T00:05:30.359 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004840446 2024-09-12T00:05:30.359 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.359 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.359 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.359 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990255+0000", 2024-09-12T00:05:30.359 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6526999999999997e-05 2024-09-12T00:05:30.359 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.359 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.359 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.359 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990283+0000", 2024-09-12T00:05:30.359 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7631e-05 2024-09-12T00:05:30.359 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.359 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.360 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.360 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990445+0000", 2024-09-12T00:05:30.360 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016238400000000001 2024-09-12T00:05:30.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.360 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.360 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.360 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990732+0000", 2024-09-12T00:05:30.360 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028698299999999999 2024-09-12T00:05:30.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.360 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.360 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:30.360 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.991001+0000", 2024-09-12T00:05:30.361 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026869099999999999 2024-09-12T00:05:30.361 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.361 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.361 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:30.361 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007077+0000", 2024-09-12T00:05:30.361 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016076686999999999 2024-09-12T00:05:30.361 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.361 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.361 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:30.361 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007761+0000", 2024-09-12T00:05:30.361 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00068366399999999995 2024-09-12T00:05:30.361 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.365 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.365 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.365 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007860+0000", 2024-09-12T00:05:30.365 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8513999999999999e-05 2024-09-12T00:05:30.365 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.366 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.366 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.366 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007929+0000", 2024-09-12T00:05:30.366 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9012999999999998e-05 2024-09-12T00:05:30.366 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.366 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.366 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.366 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.366 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.366 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2751 3.4 3:20d2ffb1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:30.366 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.134356+0000", 2024-09-12T00:05:30.366 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 42.174714983999998, 2024-09-12T00:05:30.366 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020400522000000001, 2024-09-12T00:05:30.367 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.367 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.367 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.367 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:30.367 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:30.367 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:30.367 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2751 2024-09-12T00:05:30.367 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.367 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.367 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.367 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.367 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.134356+0000", 2024-09-12T00:05:30.367 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.368 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.368 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.368 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.368 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.134356+0000", 2024-09-12T00:05:30.368 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.368 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.368 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.368 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.368 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.134359+0000", 2024-09-12T00:05:30.368 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9900000000000002e-06 2024-09-12T00:05:30.368 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.368 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.368 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.369 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138490+0000", 2024-09-12T00:05:30.369 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041315609999999997 2024-09-12T00:05:30.369 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.369 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.369 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.369 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138524+0000", 2024-09-12T00:05:30.369 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3868000000000002e-05 2024-09-12T00:05:30.369 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.369 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.369 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.369 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138544+0000", 2024-09-12T00:05:30.369 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9539e-05 2024-09-12T00:05:30.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.370 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.370 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.370 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138697+0000", 2024-09-12T00:05:30.370 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015332400000000001 2024-09-12T00:05:30.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.370 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.370 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.370 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138931+0000", 2024-09-12T00:05:30.370 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023418700000000001 2024-09-12T00:05:30.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.370 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.371 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:30.371 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.139162+0000", 2024-09-12T00:05:30.371 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000230943 2024-09-12T00:05:30.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.371 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.371 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:30.371 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.149454+0000", 2024-09-12T00:05:30.371 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010291560999999999 2024-09-12T00:05:30.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.371 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.371 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:30.371 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.153905+0000", 2024-09-12T00:05:30.371 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004451666 2024-09-12T00:05:30.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.372 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.372 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.372 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154405+0000", 2024-09-12T00:05:30.372 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00049978100000000003 2024-09-12T00:05:30.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.372 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.372 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.372 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154756+0000", 2024-09-12T00:05:30.372 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000351102 2024-09-12T00:05:30.372 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.372 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.373 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.373 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.373 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2755 3.25 3:a666dbcf:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:30.373 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.181692+0000", 2024-09-12T00:05:30.373 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 42.127378569000001, 2024-09-12T00:05:30.373 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020464659, 2024-09-12T00:05:30.373 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.373 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.373 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.373 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:30.373 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:30.373 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:30.374 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2755 2024-09-12T00:05:30.374 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.374 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.374 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.374 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.374 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.181692+0000", 2024-09-12T00:05:30.374 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.374 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.374 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.374 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.374 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.181692+0000", 2024-09-12T00:05:30.374 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.374 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.375 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.375 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.375 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.181695+0000", 2024-09-12T00:05:30.375 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0800000000000002e-06 2024-09-12T00:05:30.375 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.375 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.375 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.375 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185668+0000", 2024-09-12T00:05:30.375 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039727970000000001 2024-09-12T00:05:30.375 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.375 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.375 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.375 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185699+0000", 2024-09-12T00:05:30.376 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1424999999999998e-05 2024-09-12T00:05:30.376 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.376 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.376 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.376 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185722+0000", 2024-09-12T00:05:30.376 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2972e-05 2024-09-12T00:05:30.376 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.376 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.376 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.376 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185860+0000", 2024-09-12T00:05:30.376 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000138016 2024-09-12T00:05:30.376 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.376 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.377 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.377 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.186096+0000", 2024-09-12T00:05:30.377 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023611899999999999 2024-09-12T00:05:30.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.377 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.377 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:30.377 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.186318+0000", 2024-09-12T00:05:30.377 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000221177 2024-09-12T00:05:30.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.377 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.377 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:30.377 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.199301+0000", 2024-09-12T00:05:30.377 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012983949999999999 2024-09-12T00:05:30.378 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.378 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.378 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:30.378 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.201991+0000", 2024-09-12T00:05:30.378 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026896889999999999 2024-09-12T00:05:30.378 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.378 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.378 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.378 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.202083+0000", 2024-09-12T00:05:30.378 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1598e-05 2024-09-12T00:05:30.378 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.378 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.378 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.379 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.202157+0000", 2024-09-12T00:05:30.379 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3836000000000003e-05 2024-09-12T00:05:30.379 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.379 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.379 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.379 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.379 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.379 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2962 3.18 e75/23 3:1b55431a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_1:head v 75'6, mlcod=63'4)", 2024-09-12T00:05:30.379 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:19.990870+0000", 2024-09-12T00:05:30.379 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.318200582999999, 2024-09-12T00:05:30.379 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018164309999999999, 2024-09-12T00:05:30.379 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.379 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.379 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.380 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.380 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.380 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.380 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990870+0000", 2024-09-12T00:05:30.380 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.380 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.380 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.380 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990870+0000", 2024-09-12T00:05:30.380 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.380 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.381 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.381 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990873+0000", 2024-09-12T00:05:30.381 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3799999999999998e-06 2024-09-12T00:05:30.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.381 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.381 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.381 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995189+0000", 2024-09-12T00:05:30.381 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004315859 2024-09-12T00:05:30.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.381 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.381 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.382 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995232+0000", 2024-09-12T00:05:30.382 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2636000000000003e-05 2024-09-12T00:05:30.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.382 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.382 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.382 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995249+0000", 2024-09-12T00:05:30.382 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7563000000000001e-05 2024-09-12T00:05:30.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.382 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.382 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.382 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995357+0000", 2024-09-12T00:05:30.382 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010737 2024-09-12T00:05:30.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.383 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.383 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.383 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995386+0000", 2024-09-12T00:05:30.383 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8895999999999999e-05 2024-09-12T00:05:30.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.383 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.383 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.383 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.008964+0000", 2024-09-12T00:05:30.383 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013578209000000001 2024-09-12T00:05:30.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.383 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.383 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.384 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.009034+0000", 2024-09-12T00:05:30.384 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.0396999999999997e-05 2024-09-12T00:05:30.384 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.384 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.384 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.384 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.384 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.384 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2964 3.24 3:26c83ec0:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:30.384 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:30.384 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.303655771000001, 2024-09-12T00:05:30.384 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028979713000000001, 2024-09-12T00:05:30.384 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.385 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.385 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.385 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:30.385 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:30.385 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:30.385 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2964 2024-09-12T00:05:30.385 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.385 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.385 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.385 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.385 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:30.385 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.386 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.386 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.386 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.386 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:30.386 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.386 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.386 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.386 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.386 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005417+0000", 2024-09-12T00:05:30.386 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2450000000000001e-06 2024-09-12T00:05:30.386 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.386 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.387 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.387 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010885+0000", 2024-09-12T00:05:30.387 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054684809999999999 2024-09-12T00:05:30.387 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.387 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.387 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.387 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010901+0000", 2024-09-12T00:05:30.387 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5097e-05 2024-09-12T00:05:30.387 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.387 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.387 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.387 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010908+0000", 2024-09-12T00:05:30.388 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7419999999999997e-06 2024-09-12T00:05:30.388 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.388 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.388 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.388 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010968+0000", 2024-09-12T00:05:30.388 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.9837000000000003e-05 2024-09-12T00:05:30.388 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.388 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.388 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.388 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011082+0000", 2024-09-12T00:05:30.389 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011357399999999999 2024-09-12T00:05:30.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.389 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.389 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:30.389 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011174+0000", 2024-09-12T00:05:30.389 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2703999999999999e-05 2024-09-12T00:05:30.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.389 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.389 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:30.389 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.021639+0000", 2024-09-12T00:05:30.390 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010464641 2024-09-12T00:05:30.390 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.390 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.390 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:30.390 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034210+0000", 2024-09-12T00:05:30.390 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012570463 2024-09-12T00:05:30.390 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.390 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.390 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.390 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034300+0000", 2024-09-12T00:05:30.390 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0691000000000003e-05 2024-09-12T00:05:30.391 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.391 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.391 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.391 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034394+0000", 2024-09-12T00:05:30.391 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4238000000000001e-05 2024-09-12T00:05:30.391 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.391 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.391 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.391 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.391 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.391 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2968 3.25 3:a7d7195d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:30.391 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.046591+0000", 2024-09-12T00:05:30.391 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.262479667999999, 2024-09-12T00:05:30.392 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019137155999999999, 2024-09-12T00:05:30.392 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.392 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.392 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.392 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:30.392 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:30.392 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:30.392 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2968 2024-09-12T00:05:30.392 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.392 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.392 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.392 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.393 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.046591+0000", 2024-09-12T00:05:30.393 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.393 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.393 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.393 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.393 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.046591+0000", 2024-09-12T00:05:30.393 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.393 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.393 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.393 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.393 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.046594+0000", 2024-09-12T00:05:30.393 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0759999999999999e-06 2024-09-12T00:05:30.393 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.394 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.394 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.394 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.050723+0000", 2024-09-12T00:05:30.394 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041287700000000004 2024-09-12T00:05:30.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.394 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.394 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.394 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.050749+0000", 2024-09-12T00:05:30.394 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5958000000000001e-05 2024-09-12T00:05:30.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.394 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.394 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.394 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.050760+0000", 2024-09-12T00:05:30.395 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1367e-05 2024-09-12T00:05:30.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.395 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.395 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.395 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.050855+0000", 2024-09-12T00:05:30.395 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5043999999999993e-05 2024-09-12T00:05:30.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.395 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.395 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.395 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.051009+0000", 2024-09-12T00:05:30.396 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015416799999999999 2024-09-12T00:05:30.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.396 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.396 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:30.396 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.051169+0000", 2024-09-12T00:05:30.396 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000159858 2024-09-12T00:05:30.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.396 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.396 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:30.396 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.057181+0000", 2024-09-12T00:05:30.397 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006011438 2024-09-12T00:05:30.397 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.397 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.397 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:30.397 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.065613+0000", 2024-09-12T00:05:30.397 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0084321569999999992 2024-09-12T00:05:30.397 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.397 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.397 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.397 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.065670+0000", 2024-09-12T00:05:30.398 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7089000000000002e-05 2024-09-12T00:05:30.398 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.398 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.398 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.398 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.065728+0000", 2024-09-12T00:05:30.398 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8230999999999999e-05 2024-09-12T00:05:30.398 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.398 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.398 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.398 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.398 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.399 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3052 3.32 3:4d6db9ea:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:30.399 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:30.399 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 9.3294091449999996, 2024-09-12T00:05:30.399 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028091277000000001, 2024-09-12T00:05:30.399 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.399 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.399 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.399 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:30.399 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:30.400 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:30.400 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3052 2024-09-12T00:05:30.400 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.400 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.400 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.400 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.400 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:30.400 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.400 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.400 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.400 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.401 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:30.401 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.401 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.401 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.401 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979664+0000", 2024-09-12T00:05:30.401 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:05:30.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.401 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.401 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.401 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986918+0000", 2024-09-12T00:05:30.401 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0072537110000000004 2024-09-12T00:05:30.402 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.402 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.402 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.402 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986956+0000", 2024-09-12T00:05:30.402 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8111999999999997e-05 2024-09-12T00:05:30.402 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.402 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.402 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.402 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986975+0000", 2024-09-12T00:05:30.402 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9245999999999998e-05 2024-09-12T00:05:30.402 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.402 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.403 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.403 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987159+0000", 2024-09-12T00:05:30.403 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000183828 2024-09-12T00:05:30.403 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.403 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.403 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.403 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987552+0000", 2024-09-12T00:05:30.403 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039349699999999998 2024-09-12T00:05:30.403 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.403 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.403 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:30.403 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987943+0000", 2024-09-12T00:05:30.404 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000390579 2024-09-12T00:05:30.404 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.404 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.404 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:30.404 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.999384+0000", 2024-09-12T00:05:30.404 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011441563 2024-09-12T00:05:30.404 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.404 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.404 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:30.404 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007634+0000", 2024-09-12T00:05:30.404 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082496240000000005 2024-09-12T00:05:30.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.405 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.405 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.405 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007699+0000", 2024-09-12T00:05:30.405 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5089e-05 2024-09-12T00:05:30.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.405 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.406 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.406 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007753+0000", 2024-09-12T00:05:30.406 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3588000000000003e-05 2024-09-12T00:05:30.406 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.406 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.406 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.406 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.406 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3064 3.4 3:209c6609:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:30.406 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:30.406 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 9.1970938669999995, 2024-09-12T00:05:30.407 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024628305999999999, 2024-09-12T00:05:30.407 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.407 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.407 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.407 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:30.407 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:30.407 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:30.407 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3064 2024-09-12T00:05:30.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.407 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.407 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.407 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.408 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:30.408 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.408 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.408 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.408 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:30.408 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.408 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.408 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.408 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111980+0000", 2024-09-12T00:05:30.408 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.005e-06 2024-09-12T00:05:30.409 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.409 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.409 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.409 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116464+0000", 2024-09-12T00:05:30.409 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044839210000000001 2024-09-12T00:05:30.409 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.409 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.409 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.409 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116490+0000", 2024-09-12T00:05:30.410 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6690999999999999e-05 2024-09-12T00:05:30.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.410 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.410 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.410 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116504+0000", 2024-09-12T00:05:30.410 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4109e-05 2024-09-12T00:05:30.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.410 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.410 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.411 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116639+0000", 2024-09-12T00:05:30.411 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013427 2024-09-12T00:05:30.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.411 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.411 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.411 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116931+0000", 2024-09-12T00:05:30.411 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000292603 2024-09-12T00:05:30.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.411 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.411 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:30.411 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.117174+0000", 2024-09-12T00:05:30.411 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024240700000000001 2024-09-12T00:05:30.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.412 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.412 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:30.412 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126449+0000", 2024-09-12T00:05:30.412 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0092748699999999993 2024-09-12T00:05:30.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.412 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.412 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:30.412 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136438+0000", 2024-09-12T00:05:30.412 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099898539999999994 2024-09-12T00:05:30.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.413 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.413 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.413 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136532+0000", 2024-09-12T00:05:30.413 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3898000000000001e-05 2024-09-12T00:05:30.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.413 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.413 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.413 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136605+0000", 2024-09-12T00:05:30.413 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2677999999999998e-05 2024-09-12T00:05:30.413 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.413 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.413 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.414 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.414 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.414 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3094 3.33 3:cfcc7f7f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:30.414 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.540440+0000", 2024-09-12T00:05:30.414 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.7686307439999993, 2024-09-12T00:05:30.414 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021132270000000002, 2024-09-12T00:05:30.414 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.414 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.414 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.414 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:30.414 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:30.414 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:30.414 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3094 2024-09-12T00:05:30.414 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.415 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.415 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.415 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.415 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540440+0000", 2024-09-12T00:05:30.415 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.415 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.415 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.415 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540440+0000", 2024-09-12T00:05:30.415 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.415 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.415 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.416 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540442+0000", 2024-09-12T00:05:30.416 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9599999999999999e-06 2024-09-12T00:05:30.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.416 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.416 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.416 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545099+0000", 2024-09-12T00:05:30.416 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046570359999999998 2024-09-12T00:05:30.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.416 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.416 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.416 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545122+0000", 2024-09-12T00:05:30.416 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3485999999999998e-05 2024-09-12T00:05:30.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.417 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.417 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.417 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545135+0000", 2024-09-12T00:05:30.417 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3073e-05 2024-09-12T00:05:30.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.417 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.417 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.417 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545252+0000", 2024-09-12T00:05:30.417 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011621299999999999 2024-09-12T00:05:30.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.417 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.417 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.417 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545450+0000", 2024-09-12T00:05:30.418 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000198474 2024-09-12T00:05:30.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.418 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.418 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:30.418 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545580+0000", 2024-09-12T00:05:30.418 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013033899999999999 2024-09-12T00:05:30.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.418 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.418 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:30.418 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.552356+0000", 2024-09-12T00:05:30.418 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0067756240000000001 2024-09-12T00:05:30.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.418 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.419 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:30.419 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.560831+0000", 2024-09-12T00:05:30.419 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0084745440000000005 2024-09-12T00:05:30.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.419 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.419 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.419 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.561038+0000", 2024-09-12T00:05:30.419 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000207565 2024-09-12T00:05:30.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.419 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.419 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.419 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.561572+0000", 2024-09-12T00:05:30.419 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00053395600000000004 2024-09-12T00:05:30.419 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.420 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.420 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.420 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.420 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.420 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3097 3.33 3:cc1991a3:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:30.420 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.588213+0000", 2024-09-12T00:05:30.420 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.7208579559999997, 2024-09-12T00:05:30.420 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021968250000000002, 2024-09-12T00:05:30.421 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.421 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.421 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.421 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:30.421 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:30.421 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:30.421 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3097 2024-09-12T00:05:30.421 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.422 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.422 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.422 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.422 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.588213+0000", 2024-09-12T00:05:30.422 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.422 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.422 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.422 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.422 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.588213+0000", 2024-09-12T00:05:30.422 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.422 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.423 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.423 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.588215+0000", 2024-09-12T00:05:30.423 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7049999999999999e-06 2024-09-12T00:05:30.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.423 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.423 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592148+0000", 2024-09-12T00:05:30.423 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039329639999999997 2024-09-12T00:05:30.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.424 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.424 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592173+0000", 2024-09-12T00:05:30.424 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4596999999999998e-05 2024-09-12T00:05:30.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.424 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.424 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.424 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592188+0000", 2024-09-12T00:05:30.424 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4994000000000001e-05 2024-09-12T00:05:30.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.424 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.424 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.424 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592372+0000", 2024-09-12T00:05:30.425 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018397899999999999 2024-09-12T00:05:30.425 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.425 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.425 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.425 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592639+0000", 2024-09-12T00:05:30.425 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026700299999999998 2024-09-12T00:05:30.425 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.425 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.425 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:30.425 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592916+0000", 2024-09-12T00:05:30.425 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027759300000000002 2024-09-12T00:05:30.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.426 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.426 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:30.426 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.602239+0000", 2024-09-12T00:05:30.426 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0093227550000000003 2024-09-12T00:05:30.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.426 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.426 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:30.426 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.609997+0000", 2024-09-12T00:05:30.426 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077576390000000002 2024-09-12T00:05:30.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.426 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.426 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.426 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.610109+0000", 2024-09-12T00:05:30.427 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000111753 2024-09-12T00:05:30.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.427 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.427 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.427 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.610181+0000", 2024-09-12T00:05:30.427 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2268000000000007e-05 2024-09-12T00:05:30.427 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.427 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.427 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.427 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.427 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3107 3.25 3:a6170c4d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:30.428 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.700176+0000", 2024-09-12T00:05:30.428 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.6088946370000006, 2024-09-12T00:05:30.428 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018099869000000001, 2024-09-12T00:05:30.428 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.428 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.428 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.428 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:30.428 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:30.428 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:30.428 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3107 2024-09-12T00:05:30.428 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.428 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.428 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.429 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.429 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.700176+0000", 2024-09-12T00:05:30.429 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.429 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.429 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.429 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.700176+0000", 2024-09-12T00:05:30.429 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.429 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.430 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.430 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.700179+0000", 2024-09-12T00:05:30.430 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8760000000000001e-06 2024-09-12T00:05:30.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.430 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.430 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.430 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704197+0000", 2024-09-12T00:05:30.430 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040179689999999997 2024-09-12T00:05:30.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.430 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.430 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.430 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704226+0000", 2024-09-12T00:05:30.430 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8943000000000001e-05 2024-09-12T00:05:30.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.431 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.431 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.431 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704238+0000", 2024-09-12T00:05:30.431 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1911e-05 2024-09-12T00:05:30.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.431 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.431 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.431 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704344+0000", 2024-09-12T00:05:30.431 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000106259 2024-09-12T00:05:30.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.432 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.432 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.432 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704582+0000", 2024-09-12T00:05:30.432 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000238371 2024-09-12T00:05:30.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.432 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.432 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:30.432 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704823+0000", 2024-09-12T00:05:30.432 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000240304 2024-09-12T00:05:30.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.433 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.433 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:30.433 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.716320+0000", 2024-09-12T00:05:30.433 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011497965000000001 2024-09-12T00:05:30.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.433 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.433 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:30.433 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.718165+0000", 2024-09-12T00:05:30.433 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00184453 2024-09-12T00:05:30.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.433 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.433 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.433 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.718238+0000", 2024-09-12T00:05:30.434 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2847000000000002e-05 2024-09-12T00:05:30.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.434 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.434 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.434 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.718276+0000", 2024-09-12T00:05:30.434 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7894e-05 2024-09-12T00:05:30.434 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.434 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.434 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.434 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.434 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3125 3.12 3:495b0235:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:30.435 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:30.435 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.3932998619999992, 2024-09-12T00:05:30.435 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030616648999999999, 2024-09-12T00:05:30.435 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.435 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.435 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.435 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:30.435 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:30.435 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:30.435 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3125 2024-09-12T00:05:30.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.435 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.436 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.436 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.436 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:30.436 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.436 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.436 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.436 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.436 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:30.436 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.436 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.436 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.436 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.437 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915773+0000", 2024-09-12T00:05:30.437 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2800000000000002e-06 2024-09-12T00:05:30.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.437 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.437 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.437 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919856+0000", 2024-09-12T00:05:30.437 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004082713 2024-09-12T00:05:30.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.437 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.437 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.437 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919879+0000", 2024-09-12T00:05:30.438 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3782e-05 2024-09-12T00:05:30.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.438 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.438 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.438 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919891+0000", 2024-09-12T00:05:30.438 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1440000000000001e-05 2024-09-12T00:05:30.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.438 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.438 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.438 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920037+0000", 2024-09-12T00:05:30.439 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014562700000000001 2024-09-12T00:05:30.439 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.439 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.439 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.439 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920280+0000", 2024-09-12T00:05:30.439 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000243274 2024-09-12T00:05:30.439 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.439 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.439 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:30.439 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920527+0000", 2024-09-12T00:05:30.439 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024692699999999998 2024-09-12T00:05:30.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.440 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.440 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:30.440 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.932485+0000", 2024-09-12T00:05:30.440 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011957857000000001 2024-09-12T00:05:30.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.440 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.440 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:30.440 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946197+0000", 2024-09-12T00:05:30.440 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013712436999999999 2024-09-12T00:05:30.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.441 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.441 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.441 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946305+0000", 2024-09-12T00:05:30.441 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000107914 2024-09-12T00:05:30.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.441 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.441 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.441 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946387+0000", 2024-09-12T00:05:30.441 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2398000000000006e-05 2024-09-12T00:05:30.441 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.441 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.441 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.442 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.442 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3127 3.24 3:2477ff85:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:30.442 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.943043+0000", 2024-09-12T00:05:30.442 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.3660273529999998, 2024-09-12T00:05:30.442 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020914724999999999, 2024-09-12T00:05:30.442 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.442 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.442 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.442 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:30.442 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:30.442 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:30.442 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3127 2024-09-12T00:05:30.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.443 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.443 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.443 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.443 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.943043+0000", 2024-09-12T00:05:30.443 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.443 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.443 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.443 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.943043+0000", 2024-09-12T00:05:30.443 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.443 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.444 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.444 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.943046+0000", 2024-09-12T00:05:30.444 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3069999999999998e-06 2024-09-12T00:05:30.444 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.444 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.444 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.444 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947004+0000", 2024-09-12T00:05:30.444 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039575360000000002 2024-09-12T00:05:30.444 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.444 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.444 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.445 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947022+0000", 2024-09-12T00:05:30.445 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7847e-05 2024-09-12T00:05:30.445 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.445 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.445 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.445 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947030+0000", 2024-09-12T00:05:30.445 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.5399999999999996e-06 2024-09-12T00:05:30.445 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.445 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.445 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.446 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947087+0000", 2024-09-12T00:05:30.446 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6496999999999998e-05 2024-09-12T00:05:30.446 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.446 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.446 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.446 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947251+0000", 2024-09-12T00:05:30.446 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016407499999999999 2024-09-12T00:05:30.446 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.446 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.446 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:30.446 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947422+0000", 2024-09-12T00:05:30.447 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017108 2024-09-12T00:05:30.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.447 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.447 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:30.447 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.953910+0000", 2024-09-12T00:05:30.447 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064883980000000003 2024-09-12T00:05:30.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.447 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.447 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:30.447 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.963872+0000", 2024-09-12T00:05:30.447 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099617839999999996 2024-09-12T00:05:30.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.448 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.448 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.963918+0000", 2024-09-12T00:05:30.448 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5692999999999998e-05 2024-09-12T00:05:30.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.448 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.448 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.963958+0000", 2024-09-12T00:05:30.448 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9968000000000001e-05 2024-09-12T00:05:30.448 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.449 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.449 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.449 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.449 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.449 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3132 3.4 3:216a5295:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:30.449 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.015391+0000", 2024-09-12T00:05:30.449 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.2936796570000002, 2024-09-12T00:05:30.449 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022006318, 2024-09-12T00:05:30.449 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.449 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.449 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.449 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:30.450 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:30.450 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:30.450 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3132 2024-09-12T00:05:30.450 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.450 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.450 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.450 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.450 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.015391+0000", 2024-09-12T00:05:30.450 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.450 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.450 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.451 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.451 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.015391+0000", 2024-09-12T00:05:30.451 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.451 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.451 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.451 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.015394+0000", 2024-09-12T00:05:30.451 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6260000000000001e-06 2024-09-12T00:05:30.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.451 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.451 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.452 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.019828+0000", 2024-09-12T00:05:30.452 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044333109999999997 2024-09-12T00:05:30.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.452 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.452 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.452 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.019859+0000", 2024-09-12T00:05:30.452 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1575999999999997e-05 2024-09-12T00:05:30.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.452 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.452 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.452 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.019875+0000", 2024-09-12T00:05:30.452 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5875999999999998e-05 2024-09-12T00:05:30.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.453 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.453 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.453 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.020009+0000", 2024-09-12T00:05:30.453 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133953 2024-09-12T00:05:30.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.453 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.453 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.453 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.020264+0000", 2024-09-12T00:05:30.453 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025509000000000003 2024-09-12T00:05:30.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.453 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.453 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:30.454 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.020504+0000", 2024-09-12T00:05:30.454 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000240184 2024-09-12T00:05:30.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.454 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.454 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:30.454 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.031616+0000", 2024-09-12T00:05:30.454 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011111843 2024-09-12T00:05:30.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.454 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.455 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:30.455 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.037072+0000", 2024-09-12T00:05:30.455 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054553400000000004 2024-09-12T00:05:30.455 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.455 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.455 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.455 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.037271+0000", 2024-09-12T00:05:30.455 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000199199 2024-09-12T00:05:30.455 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.455 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.455 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.455 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.037397+0000", 2024-09-12T00:05:30.455 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012632 2024-09-12T00:05:30.456 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.456 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.456 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.456 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.456 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.456 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3134 3.24 3:2525a955:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:30.456 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:30.456 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.2692231320000005, 2024-09-12T00:05:30.456 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025606806999999999, 2024-09-12T00:05:30.456 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.456 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.456 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.456 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:30.457 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:30.457 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:30.457 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3134 2024-09-12T00:05:30.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.457 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.457 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.457 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.457 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:30.457 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.457 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.457 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.457 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:30.457 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.458 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.458 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.458 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039850+0000", 2024-09-12T00:05:30.458 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9780000000000001e-06 2024-09-12T00:05:30.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.458 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.458 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.458 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045256+0000", 2024-09-12T00:05:30.458 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054058129999999998 2024-09-12T00:05:30.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.458 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.458 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.459 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045284+0000", 2024-09-12T00:05:30.459 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8065e-05 2024-09-12T00:05:30.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.459 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.459 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045297+0000", 2024-09-12T00:05:30.459 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2788e-05 2024-09-12T00:05:30.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.459 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.459 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045378+0000", 2024-09-12T00:05:30.459 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1079000000000001e-05 2024-09-12T00:05:30.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.460 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.460 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045530+0000", 2024-09-12T00:05:30.460 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015206099999999999 2024-09-12T00:05:30.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.460 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:30.460 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045655+0000", 2024-09-12T00:05:30.460 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012525899999999999 2024-09-12T00:05:30.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.460 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:30.460 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.054817+0000", 2024-09-12T00:05:30.460 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0091611049999999992 2024-09-12T00:05:30.461 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.461 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.461 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:30.461 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065354+0000", 2024-09-12T00:05:30.461 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010537625 2024-09-12T00:05:30.461 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.461 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.461 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.461 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065410+0000", 2024-09-12T00:05:30.461 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6141999999999999e-05 2024-09-12T00:05:30.461 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.461 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.461 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.461 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065454+0000", 2024-09-12T00:05:30.462 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3891999999999999e-05 2024-09-12T00:05:30.462 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.462 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.462 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.462 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.462 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.462 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:30.463 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:05:30.464 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:30.464+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:30.565 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:30.564+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:30.608 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T00:05:30.636 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:30.636 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:30.636 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:30.636 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:30.650 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:05:30.695 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:30.696+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:30.768 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:30.768+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:30.819 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:30.820 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:30.820 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:30.820 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:30.820 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:30.834 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:05:30.869 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:30.868+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:30.964 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:30.964 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:30.964 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:30.964 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:30.964 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.964 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:1646 3.25 e58/23 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head v 58'1, mlcod=0'0)", 2024-09-12T00:05:30.964 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:30.964 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 57.875150101999999, 2024-09-12T00:05:30.964 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020301987000000001, 2024-09-12T00:05:30.965 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.965 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.965 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.965 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.965 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.965 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.965 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:30.965 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.965 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.965 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.965 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.965 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:30.966 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.966 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.966 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.966 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086308+0000", 2024-09-12T00:05:30.966 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.95e-06 2024-09-12T00:05:30.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.966 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.966 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.966 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091174+0000", 2024-09-12T00:05:30.966 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048660559999999997 2024-09-12T00:05:30.967 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.967 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.967 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.967 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091218+0000", 2024-09-12T00:05:30.967 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4678999999999997e-05 2024-09-12T00:05:30.967 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.967 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.967 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.967 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091238+0000", 2024-09-12T00:05:30.967 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9839000000000001e-05 2024-09-12T00:05:30.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.968 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.968 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.968 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091396+0000", 2024-09-12T00:05:30.968 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000157396 2024-09-12T00:05:30.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.968 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.968 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.968 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091451+0000", 2024-09-12T00:05:30.968 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5547999999999997e-05 2024-09-12T00:05:30.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.969 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.969 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.969 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106474+0000", 2024-09-12T00:05:30.969 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015023287 2024-09-12T00:05:30.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.969 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.969 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.969 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106608+0000", 2024-09-12T00:05:30.970 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133232 2024-09-12T00:05:30.970 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.970 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.970 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.970 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.970 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2667 3.8 e63/23 3:1177e826:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_162:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:30.970 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.378028+0000", 2024-09-12T00:05:30.970 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 43.583428228999999, 2024-09-12T00:05:30.970 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018606185000000001, 2024-09-12T00:05:30.971 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.971 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.971 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.971 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.971 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.971 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.971 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.378028+0000", 2024-09-12T00:05:30.971 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.971 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.971 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.972 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.378028+0000", 2024-09-12T00:05:30.972 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.972 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.972 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.972 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.972 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.378031+0000", 2024-09-12T00:05:30.972 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9330000000000001e-06 2024-09-12T00:05:30.972 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.972 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.972 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.972 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383422+0000", 2024-09-12T00:05:30.973 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005391163 2024-09-12T00:05:30.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.973 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.973 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383455+0000", 2024-09-12T00:05:30.973 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3640999999999999e-05 2024-09-12T00:05:30.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.973 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.973 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383472+0000", 2024-09-12T00:05:30.973 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7005999999999999e-05 2024-09-12T00:05:30.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.974 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.974 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383626+0000", 2024-09-12T00:05:30.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015317 2024-09-12T00:05:30.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.974 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.974 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383691+0000", 2024-09-12T00:05:30.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5740000000000004e-05 2024-09-12T00:05:30.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.975 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.975 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396505+0000", 2024-09-12T00:05:30.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012813702999999999 2024-09-12T00:05:30.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.975 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.975 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396634+0000", 2024-09-12T00:05:30.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012882900000000001 2024-09-12T00:05:30.975 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.976 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.976 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.976 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.976 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2723 3.21 3:86535907:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:30.976 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:30.976 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 43.129302635000002, 2024-09-12T00:05:30.976 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021210407000000001, 2024-09-12T00:05:30.976 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.976 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.976 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.977 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:30.977 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:30.977 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:30.977 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2723 2024-09-12T00:05:30.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.977 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.977 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.977 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:30.977 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.978 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.978 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:30.978 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.978 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.978 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832157+0000", 2024-09-12T00:05:30.978 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3270000000000001e-06 2024-09-12T00:05:30.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.979 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.979 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837403+0000", 2024-09-12T00:05:30.979 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005246784 2024-09-12T00:05:30.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.979 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.979 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.979 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837439+0000", 2024-09-12T00:05:30.979 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5848e-05 2024-09-12T00:05:30.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.979 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.979 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.980 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837459+0000", 2024-09-12T00:05:30.980 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9585e-05 2024-09-12T00:05:30.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.980 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.980 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837574+0000", 2024-09-12T00:05:30.980 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000114917 2024-09-12T00:05:30.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.980 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.981 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837803+0000", 2024-09-12T00:05:30.981 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022967699999999999 2024-09-12T00:05:30.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.981 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:30.981 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838174+0000", 2024-09-12T00:05:30.981 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037083899999999998 2024-09-12T00:05:30.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.981 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:30.982 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848447+0000", 2024-09-12T00:05:30.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010272439 2024-09-12T00:05:30.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.982 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:30.982 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853191+0000", 2024-09-12T00:05:30.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047441109999999996 2024-09-12T00:05:30.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.982 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.982 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853292+0000", 2024-09-12T00:05:30.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000101474 2024-09-12T00:05:30.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.983 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.983 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.983 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853364+0000", 2024-09-12T00:05:30.983 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1406e-05 2024-09-12T00:05:30.983 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.983 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.983 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.983 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.983 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2729 3.0 e63/23 3:01c0e0c9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_214:head v 63'6, mlcod=63'4)", 2024-09-12T00:05:30.983 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.902446+0000", 2024-09-12T00:05:30.983 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 43.059010291, 2024-09-12T00:05:30.984 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019099029, 2024-09-12T00:05:30.984 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.984 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.984 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.984 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.984 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.984 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.984 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902446+0000", 2024-09-12T00:05:30.984 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.984 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.984 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.984 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902446+0000", 2024-09-12T00:05:30.985 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.985 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.985 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902448+0000", 2024-09-12T00:05:30.985 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.503e-06 2024-09-12T00:05:30.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.985 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.985 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906706+0000", 2024-09-12T00:05:30.985 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042580500000000002 2024-09-12T00:05:30.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.985 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.986 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906743+0000", 2024-09-12T00:05:30.986 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6637999999999997e-05 2024-09-12T00:05:30.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.986 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.986 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906760+0000", 2024-09-12T00:05:30.986 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6779e-05 2024-09-12T00:05:30.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.986 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.986 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906891+0000", 2024-09-12T00:05:30.986 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013193499999999999 2024-09-12T00:05:30.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.987 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.987 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906932+0000", 2024-09-12T00:05:30.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0980999999999999e-05 2024-09-12T00:05:30.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.987 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.987 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.921375+0000", 2024-09-12T00:05:30.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014442119999999999 2024-09-12T00:05:30.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.987 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.987 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.921545+0000", 2024-09-12T00:05:30.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017002299999999999 2024-09-12T00:05:30.988 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.988 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.988 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.988 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2736 3.25 e63/23 3:a750a681:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_221:head v 63'5, mlcod=62'3)", 2024-09-12T00:05:30.988 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.980248+0000", 2024-09-12T00:05:30.988 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 42.981207765000001, 2024-09-12T00:05:30.988 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020132552000000001, 2024-09-12T00:05:30.988 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.988 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.988 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.989 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.989 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.989 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980248+0000", 2024-09-12T00:05:30.989 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.989 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.989 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980248+0000", 2024-09-12T00:05:30.989 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.989 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.989 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980251+0000", 2024-09-12T00:05:30.989 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7329999999999999e-06 2024-09-12T00:05:30.990 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.990 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.990 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.990 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.982917+0000", 2024-09-12T00:05:30.990 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026662679999999998 2024-09-12T00:05:30.990 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.990 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.990 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.990 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.982960+0000", 2024-09-12T00:05:30.990 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3000999999999997e-05 2024-09-12T00:05:30.990 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.990 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.990 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.990 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.982985+0000", 2024-09-12T00:05:30.991 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5092e-05 2024-09-12T00:05:30.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.991 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.991 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.991 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.983163+0000", 2024-09-12T00:05:30.991 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000177942 2024-09-12T00:05:30.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.991 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.991 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.991 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.983221+0000", 2024-09-12T00:05:30.991 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7476999999999999e-05 2024-09-12T00:05:30.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.991 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.991 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.992 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000301+0000", 2024-09-12T00:05:30.992 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017080503 2024-09-12T00:05:30.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.992 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.992 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.992 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000381+0000", 2024-09-12T00:05:30.992 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9536000000000006e-05 2024-09-12T00:05:30.992 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.992 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.992 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.992 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.992 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2756 3.21 3:849c909c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_241:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:30.993 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.197450+0000", 2024-09-12T00:05:30.993 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 42.764005480999998, 2024-09-12T00:05:30.993 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020201090000000001, 2024-09-12T00:05:30.993 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.993 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:30.993 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:30.993 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:30.993 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:30.993 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:30.993 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2756 2024-09-12T00:05:30.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.994 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:30.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.994 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:30.994 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.197450+0000", 2024-09-12T00:05:30.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.994 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:30.994 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.197450+0000", 2024-09-12T00:05:30.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:30.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.994 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:30.994 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.197455+0000", 2024-09-12T00:05:30.995 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4070000000000003e-06 2024-09-12T00:05:30.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.995 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.995 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:30.995 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.202967+0000", 2024-09-12T00:05:30.995 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0055122299999999999 2024-09-12T00:05:30.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.995 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.995 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:30.995 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203001+0000", 2024-09-12T00:05:30.995 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3685e-05 2024-09-12T00:05:30.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.996 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:30.996 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203017+0000", 2024-09-12T00:05:30.996 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6622000000000001e-05 2024-09-12T00:05:30.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.996 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:30.996 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203134+0000", 2024-09-12T00:05:30.996 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117166 2024-09-12T00:05:30.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.997 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:30.997 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203389+0000", 2024-09-12T00:05:30.997 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025456200000000001 2024-09-12T00:05:30.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.997 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.997 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:30.997 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203625+0000", 2024-09-12T00:05:30.997 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000235856 2024-09-12T00:05:30.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.997 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.997 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:30.997 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.212670+0000", 2024-09-12T00:05:30.997 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0090446639999999991 2024-09-12T00:05:30.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.998 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.998 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:30.998 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.217469+0000", 2024-09-12T00:05:30.998 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047998559999999999 2024-09-12T00:05:30.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.998 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.998 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:30.998 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.217569+0000", 2024-09-12T00:05:30.998 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9753999999999994e-05 2024-09-12T00:05:30.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.998 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.998 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:30.999 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.217651+0000", 2024-09-12T00:05:30.999 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2287999999999995e-05 2024-09-12T00:05:30.999 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.999 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:30.999 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:30.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:30.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:30.999 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2969 3.b 3:d2cd1e23:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:30.999 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.057390+0000", 2024-09-12T00:05:30.999 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.904065861999999, 2024-09-12T00:05:30.999 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019453666000000001, 2024-09-12T00:05:30.999 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:30.999 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:31.000 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.000 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:31.000 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:31.000 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.000 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2969 2024-09-12T00:05:31.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.000 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:31.000 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.000 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:31.000 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.057390+0000", 2024-09-12T00:05:31.000 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.000 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.000 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:31.001 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.057390+0000", 2024-09-12T00:05:31.001 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.001 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.001 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.001 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:31.001 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.057393+0000", 2024-09-12T00:05:31.001 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8430000000000001e-06 2024-09-12T00:05:31.001 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.001 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.001 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:31.001 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062108+0000", 2024-09-12T00:05:31.002 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047149640000000003 2024-09-12T00:05:31.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.002 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.002 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:31.002 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062130+0000", 2024-09-12T00:05:31.002 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.23e-05 2024-09-12T00:05:31.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.002 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.002 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.002 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062141+0000", 2024-09-12T00:05:31.002 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.111e-05 2024-09-12T00:05:31.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.003 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:31.003 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062222+0000", 2024-09-12T00:05:31.003 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0486000000000002e-05 2024-09-12T00:05:31.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.003 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:31.003 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062364+0000", 2024-09-12T00:05:31.003 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014189500000000001 2024-09-12T00:05:31.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.004 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:31.004 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062496+0000", 2024-09-12T00:05:31.004 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000132182 2024-09-12T00:05:31.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.004 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.004 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.076301+0000", 2024-09-12T00:05:31.004 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013805128 2024-09-12T00:05:31.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:31.005 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.076652+0000", 2024-09-12T00:05:31.005 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00035156899999999998 2024-09-12T00:05:31.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.005 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:31.005 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.076734+0000", 2024-09-12T00:05:31.005 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1161000000000004e-05 2024-09-12T00:05:31.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.005 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:31.006 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.076844+0000", 2024-09-12T00:05:31.006 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110028 2024-09-12T00:05:31.006 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.006 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:31.006 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.006 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2971 3.2e 3:76f45d45:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:31.006 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:31.006 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.885588298, 2024-09-12T00:05:31.007 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022571213, 2024-09-12T00:05:31.007 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:31.007 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:31.007 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.007 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:31.007 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:31.007 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.007 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2971 2024-09-12T00:05:31.007 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.007 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:31.007 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.007 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:31.008 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:31.008 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.008 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.008 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.008 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:31.008 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:31.008 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.008 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.008 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.008 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:31.009 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075871+0000", 2024-09-12T00:05:31.009 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.467e-06 2024-09-12T00:05:31.009 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.009 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.009 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:31.009 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080307+0000", 2024-09-12T00:05:31.009 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044356359999999997 2024-09-12T00:05:31.009 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.009 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.009 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:31.009 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080346+0000", 2024-09-12T00:05:31.010 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9267999999999997e-05 2024-09-12T00:05:31.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.010 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.010 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.010 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080368+0000", 2024-09-12T00:05:31.010 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2603e-05 2024-09-12T00:05:31.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.010 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.010 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:31.010 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080489+0000", 2024-09-12T00:05:31.011 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0001209 2024-09-12T00:05:31.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.011 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.011 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:31.011 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080830+0000", 2024-09-12T00:05:31.011 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00034099 2024-09-12T00:05:31.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.011 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.011 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:31.011 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.081119+0000", 2024-09-12T00:05:31.011 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028860300000000001 2024-09-12T00:05:31.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.012 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:31.012 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.093241+0000", 2024-09-12T00:05:31.012 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012121609 2024-09-12T00:05:31.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.012 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.012 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098277+0000", 2024-09-12T00:05:31.012 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0050359710000000002 2024-09-12T00:05:31.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.013 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:31.013 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098366+0000", 2024-09-12T00:05:31.013 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9052000000000001e-05 2024-09-12T00:05:31.013 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.013 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.013 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:31.013 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098439+0000", 2024-09-12T00:05:31.013 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3114000000000005e-05 2024-09-12T00:05:31.013 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.013 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:31.014 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.014 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.014 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.014 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2996 3.21 3:872b1c12:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:31.014 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:31.014 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.610963561, 2024-09-12T00:05:31.014 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027562314000000001, 2024-09-12T00:05:31.014 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:31.014 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:31.014 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.014 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:31.015 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:31.015 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.015 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2996 2024-09-12T00:05:31.015 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.015 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:31.015 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.015 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:31.015 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:31.015 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.015 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.015 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.016 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:31.016 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:31.016 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.016 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.016 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.016 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:31.016 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350496+0000", 2024-09-12T00:05:31.016 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9160000000000003e-06 2024-09-12T00:05:31.016 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.016 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.016 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:31.016 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355187+0000", 2024-09-12T00:05:31.016 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046904989999999999 2024-09-12T00:05:31.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.017 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.017 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:31.017 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355223+0000", 2024-09-12T00:05:31.017 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6125999999999999e-05 2024-09-12T00:05:31.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.017 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.017 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.017 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355241+0000", 2024-09-12T00:05:31.017 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8686e-05 2024-09-12T00:05:31.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.017 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.017 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:31.018 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355373+0000", 2024-09-12T00:05:31.018 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013129299999999999 2024-09-12T00:05:31.018 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.018 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.018 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:31.018 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355619+0000", 2024-09-12T00:05:31.018 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024662700000000002 2024-09-12T00:05:31.018 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.018 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.018 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:31.018 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355855+0000", 2024-09-12T00:05:31.018 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023604299999999999 2024-09-12T00:05:31.018 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.019 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.019 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:31.019 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.367983+0000", 2024-09-12T00:05:31.019 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012127104999999999 2024-09-12T00:05:31.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.019 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.019 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.019 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377884+0000", 2024-09-12T00:05:31.019 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099013680000000007 2024-09-12T00:05:31.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.019 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.019 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:31.019 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377974+0000", 2024-09-12T00:05:31.019 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9932999999999994e-05 2024-09-12T00:05:31.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.020 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.020 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:31.020 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.378055+0000", 2024-09-12T00:05:31.020 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0717999999999995e-05 2024-09-12T00:05:31.020 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.020 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:31.020 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.020 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.020 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3016 3.21 3:876e25ab:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:31.020 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.592959+0000", 2024-09-12T00:05:31.020 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.368497125999999, 2024-09-12T00:05:31.021 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018852352999999999, 2024-09-12T00:05:31.021 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:31.021 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:31.021 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.021 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:31.021 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:31.021 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.021 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3016 2024-09-12T00:05:31.021 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.021 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:31.021 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.021 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:31.021 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.592959+0000", 2024-09-12T00:05:31.021 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.022 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.022 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:31.022 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.592959+0000", 2024-09-12T00:05:31.022 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.022 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.022 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:31.022 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.592961+0000", 2024-09-12T00:05:31.022 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7939999999999998e-06 2024-09-12T00:05:31.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.023 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:31.023 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.597664+0000", 2024-09-12T00:05:31.023 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047023550000000001 2024-09-12T00:05:31.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.023 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:31.023 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.597702+0000", 2024-09-12T00:05:31.023 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8235000000000002e-05 2024-09-12T00:05:31.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.023 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.023 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.597721+0000", 2024-09-12T00:05:31.023 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8442999999999999e-05 2024-09-12T00:05:31.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.024 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.024 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:31.024 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.597853+0000", 2024-09-12T00:05:31.024 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013213299999999999 2024-09-12T00:05:31.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.024 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.024 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:31.024 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.598128+0000", 2024-09-12T00:05:31.025 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000275347 2024-09-12T00:05:31.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.025 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:31.025 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.598362+0000", 2024-09-12T00:05:31.025 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023358999999999999 2024-09-12T00:05:31.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.025 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.025 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611029+0000", 2024-09-12T00:05:31.025 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012667487999999999 2024-09-12T00:05:31.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.026 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.026 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:31.026 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611437+0000", 2024-09-12T00:05:31.026 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000407518 2024-09-12T00:05:31.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.026 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.026 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:31.026 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611629+0000", 2024-09-12T00:05:31.026 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00019254799999999999 2024-09-12T00:05:31.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.026 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.027 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:31.027 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611811+0000", 2024-09-12T00:05:31.027 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018190200000000001 2024-09-12T00:05:31.027 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.027 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:31.027 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.027 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.027 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3030 3.2e 3:740afe3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:31.027 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:31.027 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.221633403, 2024-09-12T00:05:31.027 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.033756331000000001, 2024-09-12T00:05:31.028 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:31.028 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:31.028 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.028 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:31.028 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:31.028 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.028 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3030 2024-09-12T00:05:31.028 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.028 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:31.028 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.028 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:31.029 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:31.029 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.029 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.029 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.029 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:31.029 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:31.029 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.029 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.029 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.029 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:31.029 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739825+0000", 2024-09-12T00:05:31.029 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7920000000000001e-06 2024-09-12T00:05:31.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.030 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:31.030 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744217+0000", 2024-09-12T00:05:31.030 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043922529999999996 2024-09-12T00:05:31.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.030 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:31.030 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744243+0000", 2024-09-12T00:05:31.030 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5253e-05 2024-09-12T00:05:31.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.031 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744254+0000", 2024-09-12T00:05:31.031 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1430999999999999e-05 2024-09-12T00:05:31.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.031 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.031 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:31.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744325+0000", 2024-09-12T00:05:31.031 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1340999999999993e-05 2024-09-12T00:05:31.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.031 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.031 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:31.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744461+0000", 2024-09-12T00:05:31.032 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013531700000000001 2024-09-12T00:05:31.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.032 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:31.032 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744574+0000", 2024-09-12T00:05:31.032 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113513 2024-09-12T00:05:31.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.032 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:31.032 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.752813+0000", 2024-09-12T00:05:31.032 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082384750000000003 2024-09-12T00:05:31.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.033 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.033 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.033 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773444+0000", 2024-09-12T00:05:31.033 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020630773000000002 2024-09-12T00:05:31.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.033 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.033 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:31.033 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773510+0000", 2024-09-12T00:05:31.033 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6711000000000006e-05 2024-09-12T00:05:31.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.034 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.034 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:31.034 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773579+0000", 2024-09-12T00:05:31.034 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8472000000000004e-05 2024-09-12T00:05:31.034 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.034 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:31.034 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.034 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.034 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.034 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3039 3.2e 3:74587332:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:31.034 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:31.035 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.125953474999999, 2024-09-12T00:05:31.035 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.036215114, 2024-09-12T00:05:31.035 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:31.035 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:31.035 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.035 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:31.035 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:31.035 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.035 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3039 2024-09-12T00:05:31.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.035 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:31.035 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.036 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:31.036 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:31.036 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.036 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.036 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:31.036 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:31.036 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.036 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.036 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:31.037 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835507+0000", 2024-09-12T00:05:31.037 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6e-06 2024-09-12T00:05:31.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.037 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.037 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:31.037 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848930+0000", 2024-09-12T00:05:31.037 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013423242 2024-09-12T00:05:31.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.037 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.037 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:31.037 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848969+0000", 2024-09-12T00:05:31.038 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9270000000000002e-05 2024-09-12T00:05:31.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.038 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.038 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.038 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848991+0000", 2024-09-12T00:05:31.038 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1565000000000001e-05 2024-09-12T00:05:31.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.038 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.038 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:31.038 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849089+0000", 2024-09-12T00:05:31.038 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8408999999999999e-05 2024-09-12T00:05:31.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.039 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:31.039 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849518+0000", 2024-09-12T00:05:31.039 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042813900000000002 2024-09-12T00:05:31.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.039 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:31.039 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849897+0000", 2024-09-12T00:05:31.039 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037936600000000001 2024-09-12T00:05:31.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.040 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:31.040 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.858549+0000", 2024-09-12T00:05:31.040 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086520820000000002 2024-09-12T00:05:31.040 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.040 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.040 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.040 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871522+0000", 2024-09-12T00:05:31.040 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012973182999999999 2024-09-12T00:05:31.040 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.040 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.040 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:31.041 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871633+0000", 2024-09-12T00:05:31.041 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011085 2024-09-12T00:05:31.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.041 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.041 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:31.041 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871717+0000", 2024-09-12T00:05:31.041 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.4407999999999996e-05 2024-09-12T00:05:31.041 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.041 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:31.041 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.041 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.042 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3050 3.b 3:d26f7141:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:31.042 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:31.042 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 10.004341219000001, 2024-09-12T00:05:31.042 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022896481999999999, 2024-09-12T00:05:31.042 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:31.042 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:31.042 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.042 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:31.042 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:31.042 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.042 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3050 2024-09-12T00:05:31.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.043 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:31.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.043 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:31.043 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:31.043 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.043 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.043 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:31.043 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:31.043 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.043 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.043 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:31.043 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957117+0000", 2024-09-12T00:05:31.044 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7e-06 2024-09-12T00:05:31.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.044 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.044 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:31.044 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961673+0000", 2024-09-12T00:05:31.044 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045558059999999999 2024-09-12T00:05:31.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.044 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.044 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:31.044 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961698+0000", 2024-09-12T00:05:31.044 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5017000000000001e-05 2024-09-12T00:05:31.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.044 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.044 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.045 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961710+0000", 2024-09-12T00:05:31.045 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1963999999999999e-05 2024-09-12T00:05:31.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.045 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.045 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:31.045 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961785+0000", 2024-09-12T00:05:31.045 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5153000000000004e-05 2024-09-12T00:05:31.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.045 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.045 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:31.045 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961926+0000", 2024-09-12T00:05:31.045 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000141194 2024-09-12T00:05:31.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.045 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.046 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:31.046 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.962055+0000", 2024-09-12T00:05:31.046 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012882400000000001 2024-09-12T00:05:31.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.046 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:31.046 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.970716+0000", 2024-09-12T00:05:31.046 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086603610000000001 2024-09-12T00:05:31.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.046 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.046 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979700+0000", 2024-09-12T00:05:31.046 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.008984054 2024-09-12T00:05:31.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.047 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:31.047 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979884+0000", 2024-09-12T00:05:31.047 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184215 2024-09-12T00:05:31.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.047 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:31.047 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.980011+0000", 2024-09-12T00:05:31.047 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012719399999999999 2024-09-12T00:05:31.047 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.047 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:31.047 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.048 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.048 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3052 3.32 e75/23 3:4d6db9ea:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_91:head v 75'3, mlcod=62'1)", 2024-09-12T00:05:31.048 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.988152+0000", 2024-09-12T00:05:31.048 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 9.9733036629999994, 2024-09-12T00:05:31.048 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019198494999999999, 2024-09-12T00:05:31.048 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:31.048 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:31.048 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.048 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:31.048 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.048 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:31.048 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.988152+0000", 2024-09-12T00:05:31.048 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.049 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.049 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:31.049 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.988152+0000", 2024-09-12T00:05:31.049 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.049 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.049 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:31.049 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.988155+0000", 2024-09-12T00:05:31.049 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.253e-06 2024-09-12T00:05:31.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.049 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.049 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:31.049 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993485+0000", 2024-09-12T00:05:31.050 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053298479999999999 2024-09-12T00:05:31.050 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.050 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.050 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:31.050 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993520+0000", 2024-09-12T00:05:31.050 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4393000000000001e-05 2024-09-12T00:05:31.050 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.050 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.050 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.050 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993538+0000", 2024-09-12T00:05:31.050 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8193e-05 2024-09-12T00:05:31.050 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.050 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.050 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:31.051 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993701+0000", 2024-09-12T00:05:31.051 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016265499999999999 2024-09-12T00:05:31.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.051 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:31.051 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993771+0000", 2024-09-12T00:05:31.051 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.0884999999999996e-05 2024-09-12T00:05:31.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.051 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:31.051 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007261+0000", 2024-09-12T00:05:31.051 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013489142000000001 2024-09-12T00:05:31.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.052 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.052 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:31.052 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007351+0000", 2024-09-12T00:05:31.052 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0125999999999997e-05 2024-09-12T00:05:31.052 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.052 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:31.052 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.052 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.052 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3065 3.b 3:d10bf58d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:31.052 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:31.052 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 9.8393935989999992, 2024-09-12T00:05:31.053 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021843261999999999, 2024-09-12T00:05:31.053 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:31.053 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:31.053 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.053 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:31.053 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:31.053 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.053 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3065 2024-09-12T00:05:31.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.053 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:31.053 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.053 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:31.054 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:31.054 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.054 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.054 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:31.054 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:31.054 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.054 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.054 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:31.054 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122067+0000", 2024-09-12T00:05:31.054 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4970000000000003e-06 2024-09-12T00:05:31.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.055 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:31.055 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126931+0000", 2024-09-12T00:05:31.055 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048641090000000001 2024-09-12T00:05:31.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.055 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:31.055 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126973+0000", 2024-09-12T00:05:31.055 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1678999999999999e-05 2024-09-12T00:05:31.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.056 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.056 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126999+0000", 2024-09-12T00:05:31.056 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6536000000000001e-05 2024-09-12T00:05:31.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.056 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.056 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:31.056 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127118+0000", 2024-09-12T00:05:31.056 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000119373 2024-09-12T00:05:31.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.056 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.056 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:31.056 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127289+0000", 2024-09-12T00:05:31.057 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017020199999999999 2024-09-12T00:05:31.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.057 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:31.057 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127437+0000", 2024-09-12T00:05:31.057 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148682 2024-09-12T00:05:31.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.057 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:31.057 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138539+0000", 2024-09-12T00:05:31.057 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011101418 2024-09-12T00:05:31.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.058 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.058 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143355+0000", 2024-09-12T00:05:31.058 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048161499999999999 2024-09-12T00:05:31.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.058 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.058 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:31.058 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143777+0000", 2024-09-12T00:05:31.058 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000421896 2024-09-12T00:05:31.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.058 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.058 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:31.058 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143905+0000", 2024-09-12T00:05:31.058 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012872 2024-09-12T00:05:31.058 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.059 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:31.059 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.059 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.059 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3066 3.21 3:8448517d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:31.059 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:31.059 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 9.8294475170000002, 2024-09-12T00:05:31.059 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025911652, 2024-09-12T00:05:31.059 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:31.059 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:31.059 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.059 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:31.059 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:31.060 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.060 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3066 2024-09-12T00:05:31.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.060 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:31.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:31.060 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:31.060 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:31.060 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:31.061 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.061 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.061 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.061 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:31.061 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132011+0000", 2024-09-12T00:05:31.061 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8270000000000002e-06 2024-09-12T00:05:31.061 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.061 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.061 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:31.061 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137934+0000", 2024-09-12T00:05:31.061 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059226119999999998 2024-09-12T00:05:31.062 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.062 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.062 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:31.062 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137968+0000", 2024-09-12T00:05:31.062 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3933000000000002e-05 2024-09-12T00:05:31.062 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.062 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.062 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.062 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137985+0000", 2024-09-12T00:05:31.062 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7725999999999999e-05 2024-09-12T00:05:31.062 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.062 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.063 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:31.063 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138084+0000", 2024-09-12T00:05:31.063 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8450999999999996e-05 2024-09-12T00:05:31.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.063 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.063 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:31.063 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138285+0000", 2024-09-12T00:05:31.063 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000201411 2024-09-12T00:05:31.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.063 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.063 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:31.064 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138510+0000", 2024-09-12T00:05:31.064 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000224551 2024-09-12T00:05:31.064 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.064 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.064 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:31.064 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.146242+0000", 2024-09-12T00:05:31.064 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077317649999999998 2024-09-12T00:05:31.064 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.064 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.064 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.064 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157728+0000", 2024-09-12T00:05:31.064 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011486424 2024-09-12T00:05:31.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.065 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.065 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:31.065 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157833+0000", 2024-09-12T00:05:31.065 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105234 2024-09-12T00:05:31.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.065 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.065 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:31.065 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157920+0000", 2024-09-12T00:05:31.065 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6718000000000006e-05 2024-09-12T00:05:31.065 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.066 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:31.066 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.066 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.066 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.066 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3111 3.2e 3:7749b0e6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:31.066 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.741096+0000", 2024-09-12T00:05:31.066 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 9.2203599270000005, 2024-09-12T00:05:31.066 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019635658, 2024-09-12T00:05:31.066 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:31.066 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:31.066 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.067 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:31.067 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:31.067 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.067 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3111 2024-09-12T00:05:31.067 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.067 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:31.067 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.067 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:31.067 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.741096+0000", 2024-09-12T00:05:31.067 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.067 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.068 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.068 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:31.068 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.741096+0000", 2024-09-12T00:05:31.068 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.068 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.068 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.068 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:31.068 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.741099+0000", 2024-09-12T00:05:31.068 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0800000000000002e-06 2024-09-12T00:05:31.068 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.068 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.069 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:31.069 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745487+0000", 2024-09-12T00:05:31.069 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043876540000000004 2024-09-12T00:05:31.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.069 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.069 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:31.069 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745510+0000", 2024-09-12T00:05:31.069 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3099999999999999e-05 2024-09-12T00:05:31.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.069 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.069 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.070 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745521+0000", 2024-09-12T00:05:31.070 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0813e-05 2024-09-12T00:05:31.070 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.070 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.070 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:31.070 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745639+0000", 2024-09-12T00:05:31.070 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011862399999999999 2024-09-12T00:05:31.070 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.070 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.070 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:31.070 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745895+0000", 2024-09-12T00:05:31.070 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025625300000000001 2024-09-12T00:05:31.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.071 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.071 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:31.071 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.746140+0000", 2024-09-12T00:05:31.071 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000244467 2024-09-12T00:05:31.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.071 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.071 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:31.071 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755206+0000", 2024-09-12T00:05:31.071 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0090663250000000001 2024-09-12T00:05:31.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.071 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.072 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.072 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.760620+0000", 2024-09-12T00:05:31.072 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054141040000000003 2024-09-12T00:05:31.072 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.072 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.072 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:31.072 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.760673+0000", 2024-09-12T00:05:31.072 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2519999999999999e-05 2024-09-12T00:05:31.072 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.072 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.072 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:31.073 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.760732+0000", 2024-09-12T00:05:31.073 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8718000000000003e-05 2024-09-12T00:05:31.073 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.073 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:31.073 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.073 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.073 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.073 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3112 3.b 3:d1cf91a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:31.073 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:31.073 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 9.2107303900000002, 2024-09-12T00:05:31.073 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021203475999999999, 2024-09-12T00:05:31.073 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:31.073 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:31.073 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.074 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:31.074 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:31.074 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.074 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3112 2024-09-12T00:05:31.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.074 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:31.074 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.074 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:31.074 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:31.074 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.074 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.074 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:31.074 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:31.075 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.075 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.075 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.075 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:31.075 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750728+0000", 2024-09-12T00:05:31.075 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.165e-06 2024-09-12T00:05:31.075 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.075 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.075 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:31.075 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755063+0000", 2024-09-12T00:05:31.075 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043355379999999999 2024-09-12T00:05:31.075 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.075 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.076 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:31.076 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755103+0000", 2024-09-12T00:05:31.076 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9962000000000001e-05 2024-09-12T00:05:31.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.076 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.076 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.076 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755120+0000", 2024-09-12T00:05:31.076 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6793e-05 2024-09-12T00:05:31.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.076 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.076 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:31.076 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755299+0000", 2024-09-12T00:05:31.076 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017904499999999999 2024-09-12T00:05:31.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.077 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.077 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:31.077 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755758+0000", 2024-09-12T00:05:31.077 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000458815 2024-09-12T00:05:31.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.077 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.077 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:31.077 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.756304+0000", 2024-09-12T00:05:31.077 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000546183 2024-09-12T00:05:31.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.077 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.077 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.077 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771518+0000", 2024-09-12T00:05:31.077 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015214236000000001 2024-09-12T00:05:31.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.078 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.078 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:31.078 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771827+0000", 2024-09-12T00:05:31.078 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000309308 2024-09-12T00:05:31.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.078 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.078 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:31.078 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771874+0000", 2024-09-12T00:05:31.078 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6119999999999999e-05 2024-09-12T00:05:31.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.078 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.078 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:31.079 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771929+0000", 2024-09-12T00:05:31.079 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5310999999999999e-05 2024-09-12T00:05:31.079 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.079 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:31.079 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.079 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.079 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.079 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3115 3.2e 3:75803fec:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:31.079 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:31.079 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 9.1727593400000007, 2024-09-12T00:05:31.079 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020205041, 2024-09-12T00:05:31.079 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:31.079 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:31.079 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.080 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:31.080 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:31.080 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.080 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3115 2024-09-12T00:05:31.080 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.080 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:31.080 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.080 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:31.080 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:31.080 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.080 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.080 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.081 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:31.081 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:31.081 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.081 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.081 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.081 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:31.081 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788700+0000", 2024-09-12T00:05:31.081 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.614e-06 2024-09-12T00:05:31.081 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.081 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.081 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:31.081 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793576+0000", 2024-09-12T00:05:31.082 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048760920000000003 2024-09-12T00:05:31.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.082 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.082 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:31.082 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793610+0000", 2024-09-12T00:05:31.082 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4184999999999999e-05 2024-09-12T00:05:31.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.082 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.082 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.082 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793633+0000", 2024-09-12T00:05:31.082 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2551000000000001e-05 2024-09-12T00:05:31.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.083 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.083 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:31.083 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793750+0000", 2024-09-12T00:05:31.083 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117057 2024-09-12T00:05:31.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.083 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.083 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:31.083 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793975+0000", 2024-09-12T00:05:31.083 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022493099999999999 2024-09-12T00:05:31.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.083 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.084 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:31.084 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.794178+0000", 2024-09-12T00:05:31.084 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000202726 2024-09-12T00:05:31.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.084 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.084 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:31.084 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.803725+0000", 2024-09-12T00:05:31.084 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095470599999999996 2024-09-12T00:05:31.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.084 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.084 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.084 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808706+0000", 2024-09-12T00:05:31.085 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049814519999999999 2024-09-12T00:05:31.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.085 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.085 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:31.085 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808785+0000", 2024-09-12T00:05:31.085 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9160999999999996e-05 2024-09-12T00:05:31.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.085 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.085 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:31.085 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808902+0000", 2024-09-12T00:05:31.085 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000116212 2024-09-12T00:05:31.086 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.086 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:31.086 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.086 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.086 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3148 3.b 3:d076a555:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:31.086 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.214451+0000", 2024-09-12T00:05:31.086 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.7470047270000002, 2024-09-12T00:05:31.086 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019531633999999999, 2024-09-12T00:05:31.086 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:31.086 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:31.086 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.087 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:31.087 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:31.087 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.087 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3148 2024-09-12T00:05:31.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.087 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:31.087 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.087 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:31.087 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.214451+0000", 2024-09-12T00:05:31.087 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.087 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.088 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:31.088 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.214451+0000", 2024-09-12T00:05:31.088 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:31.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.088 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.088 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:31.088 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.214454+0000", 2024-09-12T00:05:31.088 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.354e-06 2024-09-12T00:05:31.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.088 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.088 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:31.089 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219444+0000", 2024-09-12T00:05:31.089 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049897830000000002 2024-09-12T00:05:31.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.089 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.089 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:31.089 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219472+0000", 2024-09-12T00:05:31.089 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7421999999999999e-05 2024-09-12T00:05:31.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.089 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.089 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.089 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219486+0000", 2024-09-12T00:05:31.090 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4528999999999999e-05 2024-09-12T00:05:31.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.090 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.090 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:31.090 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219583+0000", 2024-09-12T00:05:31.090 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.6989000000000003e-05 2024-09-12T00:05:31.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.090 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.090 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:31.090 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219782+0000", 2024-09-12T00:05:31.090 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000198767 2024-09-12T00:05:31.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.091 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.091 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:31.091 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219999+0000", 2024-09-12T00:05:31.091 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000217068 2024-09-12T00:05:31.091 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.091 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.091 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:31.091 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.233084+0000", 2024-09-12T00:05:31.091 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013084910999999999 2024-09-12T00:05:31.091 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.091 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.091 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.092 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.233877+0000", 2024-09-12T00:05:31.092 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00079352600000000002 2024-09-12T00:05:31.092 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.092 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.092 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:31.092 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.233940+0000", 2024-09-12T00:05:31.092 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2774000000000006e-05 2024-09-12T00:05:31.092 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:31.092 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:31.092 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:31.092 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.233983+0000", 2024-09-12T00:05:31.093 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2511e-05 2024-09-12T00:05:31.093 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.093 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:31.093 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.093 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:31.093 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:31.093 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:31.095 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:05:31.096 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:31.096+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:31.196 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:31.196+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:31.232 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:31.232 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:31.232 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:05:31.232 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:31.247 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:05:31.297 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:31.296+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:31.377 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:31.377 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:31.377 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:05:31.377 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:05:31.378 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:31.393 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:05:31.398 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:31.400+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:31.442 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:05:31.499 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:31.500+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:31.526 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:31.526 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:05:31.526 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:05:31.527 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:05:31.527 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.527 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:05:31.527 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:05:31.527 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 120.1953826, 2024-09-12T00:05:31.527 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.027441031000000001, 2024-09-12T00:05:31.528 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:31.528 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:31.528 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.528 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:31.528 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:31.528 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.529 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:05:31.529 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.529 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:31.529 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.529 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:31.529 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:05:31.529 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.529 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.529 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.529 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:31.529 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:05:31.529 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.530 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.530 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.530 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:31.530 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330357+0000", 2024-09-12T00:05:31.530 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2339999999999996e-06 2024-09-12T00:05:31.530 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.530 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.531 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:31.531 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330381+0000", 2024-09-12T00:05:31.531 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4626000000000001e-05 2024-09-12T00:05:31.531 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.531 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.531 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:31.532 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330417+0000", 2024-09-12T00:05:31.532 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5886000000000002e-05 2024-09-12T00:05:31.532 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.532 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.532 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.532 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330442+0000", 2024-09-12T00:05:31.533 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4522999999999999e-05 2024-09-12T00:05:31.533 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.533 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.533 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:31.533 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335485+0000", 2024-09-12T00:05:31.533 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050432589999999996 2024-09-12T00:05:31.534 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.534 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.534 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:05:31.534 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335507+0000", 2024-09-12T00:05:31.534 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2013000000000001e-05 2024-09-12T00:05:31.534 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.535 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.535 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:31.535 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.351747+0000", 2024-09-12T00:05:31.535 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016240451999999999 2024-09-12T00:05:31.535 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.535 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.536 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:31.536 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352062+0000", 2024-09-12T00:05:31.536 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031433399999999999 2024-09-12T00:05:31.536 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.536 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.536 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:31.537 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352378+0000", 2024-09-12T00:05:31.537 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031586400000000001 2024-09-12T00:05:31.537 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.537 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.537 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:31.537 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.355074+0000", 2024-09-12T00:05:31.538 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026962919999999999 2024-09-12T00:05:31.538 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.538 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.538 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.538 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357537+0000", 2024-09-12T00:05:31.538 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024634689999999998 2024-09-12T00:05:31.539 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.539 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.539 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:31.539 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357680+0000", 2024-09-12T00:05:31.539 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014314899999999999 2024-09-12T00:05:31.539 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.540 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.540 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:31.540 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357793+0000", 2024-09-12T00:05:31.541 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011293 2024-09-12T00:05:31.541 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.541 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:31.541 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.541 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.541 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.542 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2670 3.15 3:aae67b25:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:31.542 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.402430+0000", 2024-09-12T00:05:31.542 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 44.123305365999997, 2024-09-12T00:05:31.542 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020468187999999998, 2024-09-12T00:05:31.542 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:31.542 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:31.543 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.543 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:31.543 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:31.543 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.543 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2670 2024-09-12T00:05:31.543 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.544 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:31.544 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.544 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:31.545 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.402430+0000", 2024-09-12T00:05:31.545 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.545 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.545 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.545 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:31.545 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.402430+0000", 2024-09-12T00:05:31.546 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.546 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.546 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.546 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:31.546 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.402434+0000", 2024-09-12T00:05:31.546 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3730000000000003e-06 2024-09-12T00:05:31.547 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.547 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.547 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:31.547 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405033+0000", 2024-09-12T00:05:31.547 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025991080000000001 2024-09-12T00:05:31.547 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.548 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.548 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:31.548 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405068+0000", 2024-09-12T00:05:31.548 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4832999999999997e-05 2024-09-12T00:05:31.548 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.548 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.549 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.549 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405080+0000", 2024-09-12T00:05:31.549 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2344000000000001e-05 2024-09-12T00:05:31.549 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.549 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.549 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:31.550 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405150+0000", 2024-09-12T00:05:31.550 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9391e-05 2024-09-12T00:05:31.550 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.550 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.550 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:31.551 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405287+0000", 2024-09-12T00:05:31.551 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013720299999999999 2024-09-12T00:05:31.551 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.552 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.552 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:31.552 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405411+0000", 2024-09-12T00:05:31.552 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000123891 2024-09-12T00:05:31.552 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.553 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.553 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:31.553 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.414520+0000", 2024-09-12T00:05:31.553 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091092599999999992 2024-09-12T00:05:31.553 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.553 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.554 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.554 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.422744+0000", 2024-09-12T00:05:31.554 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0082241620000000001 2024-09-12T00:05:31.554 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.554 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.554 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:31.555 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.422841+0000", 2024-09-12T00:05:31.555 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6525000000000002e-05 2024-09-12T00:05:31.555 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.555 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.555 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:31.555 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.422898+0000", 2024-09-12T00:05:31.556 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7098000000000001e-05 2024-09-12T00:05:31.556 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.556 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:31.556 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.556 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.557 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.557 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2713 3.c 3:3354c844:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:31.557 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.736236+0000", 2024-09-12T00:05:31.557 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 43.789499175000003, 2024-09-12T00:05:31.557 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020199746000000001, 2024-09-12T00:05:31.557 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:31.558 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:31.558 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.558 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:31.558 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:31.558 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.559 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2713 2024-09-12T00:05:31.559 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.559 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:31.559 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.559 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:31.559 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.736236+0000", 2024-09-12T00:05:31.560 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.560 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.560 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.560 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:31.560 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.736236+0000", 2024-09-12T00:05:31.560 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.561 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.561 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.561 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:31.561 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.736239+0000", 2024-09-12T00:05:31.562 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5599999999999998e-06 2024-09-12T00:05:31.562 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.562 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.562 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:31.562 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.737498+0000", 2024-09-12T00:05:31.563 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001258807 2024-09-12T00:05:31.563 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.563 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.563 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:31.563 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.737522+0000", 2024-09-12T00:05:31.563 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.408e-05 2024-09-12T00:05:31.564 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.564 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.564 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.564 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.737532+0000", 2024-09-12T00:05:31.565 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8519999999999999e-06 2024-09-12T00:05:31.565 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.565 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.565 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:31.566 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.737594+0000", 2024-09-12T00:05:31.566 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1437000000000001e-05 2024-09-12T00:05:31.566 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.566 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.567 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:31.567 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.737712+0000", 2024-09-12T00:05:31.567 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000118641 2024-09-12T00:05:31.567 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.567 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.567 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:31.568 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.737807+0000", 2024-09-12T00:05:31.568 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.4710000000000006e-05 2024-09-12T00:05:31.568 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.568 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.568 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:31.569 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.742626+0000", 2024-09-12T00:05:31.569 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004818719 2024-09-12T00:05:31.569 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.569 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.569 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.569 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.756272+0000", 2024-09-12T00:05:31.570 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013646574 2024-09-12T00:05:31.570 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.570 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.570 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:31.570 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.756357+0000", 2024-09-12T00:05:31.570 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4964999999999997e-05 2024-09-12T00:05:31.571 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.571 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.571 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:31.571 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.756436+0000", 2024-09-12T00:05:31.572 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8400999999999997e-05 2024-09-12T00:05:31.572 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.572 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:31.572 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.572 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.573 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.573 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2727 3.39 3:9c63b475:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:31.573 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.875651+0000", 2024-09-12T00:05:31.573 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 43.650083569000003, 2024-09-12T00:05:31.573 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019038132999999999, 2024-09-12T00:05:31.573 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:31.574 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:31.574 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.574 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:31.574 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:31.574 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.574 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2727 2024-09-12T00:05:31.575 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.575 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:31.575 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.575 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:31.575 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.875651+0000", 2024-09-12T00:05:31.575 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.576 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.576 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.576 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:31.577 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.875651+0000", 2024-09-12T00:05:31.577 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.577 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.577 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.578 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:31.578 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.875655+0000", 2024-09-12T00:05:31.578 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4699999999999998e-06 2024-09-12T00:05:31.578 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.578 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.579 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:31.579 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.877353+0000", 2024-09-12T00:05:31.579 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0016979740000000001 2024-09-12T00:05:31.579 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.579 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.580 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:31.580 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.877385+0000", 2024-09-12T00:05:31.580 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2561000000000002e-05 2024-09-12T00:05:31.580 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.580 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.580 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.580 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.877400+0000", 2024-09-12T00:05:31.580 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.505e-05 2024-09-12T00:05:31.580 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.580 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.580 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:31.580 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.877503+0000", 2024-09-12T00:05:31.580 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010297399999999999 2024-09-12T00:05:31.580 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.581 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.581 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:31.581 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.877647+0000", 2024-09-12T00:05:31.581 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000143268 2024-09-12T00:05:31.581 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.581 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.581 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:31.581 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.877798+0000", 2024-09-12T00:05:31.581 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015086799999999999 2024-09-12T00:05:31.581 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.581 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.581 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:31.581 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.884567+0000", 2024-09-12T00:05:31.581 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0067690629999999996 2024-09-12T00:05:31.581 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.582 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.582 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.582 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.894563+0000", 2024-09-12T00:05:31.582 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0099959269999999999 2024-09-12T00:05:31.582 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.582 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.582 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:31.582 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.894632+0000", 2024-09-12T00:05:31.582 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9067999999999997e-05 2024-09-12T00:05:31.583 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.583 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.583 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:31.583 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.894690+0000", 2024-09-12T00:05:31.583 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.791e-05 2024-09-12T00:05:31.583 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.583 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:31.583 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.583 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.583 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.583 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2731 3.c 3:33671167:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:31.583 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.917498+0000", 2024-09-12T00:05:31.584 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 43.608236957000003, 2024-09-12T00:05:31.584 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020741915, 2024-09-12T00:05:31.584 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:31.584 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:31.584 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.584 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:31.584 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:31.584 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.584 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2731 2024-09-12T00:05:31.584 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.584 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:31.584 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.584 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:31.585 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.917498+0000", 2024-09-12T00:05:31.585 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.585 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.585 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.585 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:31.585 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.917498+0000", 2024-09-12T00:05:31.585 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.585 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.585 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.585 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:31.585 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.917502+0000", 2024-09-12T00:05:31.585 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4860000000000002e-06 2024-09-12T00:05:31.585 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.585 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.585 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:31.586 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919071+0000", 2024-09-12T00:05:31.586 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015695380000000001 2024-09-12T00:05:31.586 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.586 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.586 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:31.586 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919100+0000", 2024-09-12T00:05:31.586 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8822e-05 2024-09-12T00:05:31.586 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.586 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.586 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.586 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919110+0000", 2024-09-12T00:05:31.586 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0287e-05 2024-09-12T00:05:31.586 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.587 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.587 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:31.587 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919179+0000", 2024-09-12T00:05:31.587 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8926999999999999e-05 2024-09-12T00:05:31.587 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.587 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.587 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:31.587 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919338+0000", 2024-09-12T00:05:31.587 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015856299999999999 2024-09-12T00:05:31.587 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.587 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.587 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:31.587 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919462+0000", 2024-09-12T00:05:31.587 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012430399999999999 2024-09-12T00:05:31.588 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.588 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.588 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:31.588 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.923903+0000", 2024-09-12T00:05:31.588 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0044412660000000001 2024-09-12T00:05:31.588 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.588 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.588 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.588 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.938087+0000", 2024-09-12T00:05:31.588 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014183398999999999 2024-09-12T00:05:31.588 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.588 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.588 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:31.588 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.938180+0000", 2024-09-12T00:05:31.589 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3318000000000003e-05 2024-09-12T00:05:31.589 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.589 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.590 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:31.590 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.938240+0000", 2024-09-12T00:05:31.590 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0004999999999999e-05 2024-09-12T00:05:31.592 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.592 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:31.592 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.592 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.592 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.592 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2734 3.c 3:303f9e0a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:31.592 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.952166+0000", 2024-09-12T00:05:31.593 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 43.573568606999999, 2024-09-12T00:05:31.593 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018433805000000001, 2024-09-12T00:05:31.593 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:31.593 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:31.593 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.593 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:31.593 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:31.593 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.593 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2734 2024-09-12T00:05:31.593 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.593 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:31.593 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.593 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:31.593 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.952166+0000", 2024-09-12T00:05:31.594 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.594 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.594 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.594 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:31.594 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.952166+0000", 2024-09-12T00:05:31.594 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.594 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.594 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.594 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:31.594 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.952170+0000", 2024-09-12T00:05:31.594 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3330000000000001e-06 2024-09-12T00:05:31.594 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.594 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.594 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:31.594 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.953647+0000", 2024-09-12T00:05:31.595 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0014772889999999999 2024-09-12T00:05:31.595 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.595 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.595 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:31.595 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.953675+0000", 2024-09-12T00:05:31.595 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8133e-05 2024-09-12T00:05:31.595 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.595 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.595 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.595 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.953690+0000", 2024-09-12T00:05:31.595 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4671000000000001e-05 2024-09-12T00:05:31.595 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.595 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.595 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:31.596 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.953789+0000", 2024-09-12T00:05:31.596 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.9044999999999998e-05 2024-09-12T00:05:31.596 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.596 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.596 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:31.596 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.953923+0000", 2024-09-12T00:05:31.596 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013453099999999999 2024-09-12T00:05:31.596 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.596 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.596 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:31.596 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.954083+0000", 2024-09-12T00:05:31.596 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000160051 2024-09-12T00:05:31.596 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.596 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.597 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:31.597 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.961055+0000", 2024-09-12T00:05:31.597 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.006971288 2024-09-12T00:05:31.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.597 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.597 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.597 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.970486+0000", 2024-09-12T00:05:31.597 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0094313799999999996 2024-09-12T00:05:31.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.597 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.597 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:31.597 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.970547+0000", 2024-09-12T00:05:31.597 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1396999999999995e-05 2024-09-12T00:05:31.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.597 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.598 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:31.598 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.970600+0000", 2024-09-12T00:05:31.598 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2686999999999999e-05 2024-09-12T00:05:31.598 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.598 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:31.598 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.598 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.598 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2748 3.3b 3:df6d92a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:31.598 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:05:31.598 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 43.426894740000002, 2024-09-12T00:05:31.598 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.023574735999999999, 2024-09-12T00:05:31.598 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:31.598 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:31.599 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.599 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:31.599 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:31.599 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.599 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2748 2024-09-12T00:05:31.599 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.599 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:31.599 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.599 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:31.599 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:05:31.599 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.599 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.599 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.599 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:31.599 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:05:31.600 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.600 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:31.600 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098844+0000", 2024-09-12T00:05:31.600 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1570000000000002e-06 2024-09-12T00:05:31.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.600 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:31.600 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100354+0000", 2024-09-12T00:05:31.600 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001509544 2024-09-12T00:05:31.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.600 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:31.601 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100383+0000", 2024-09-12T00:05:31.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9386e-05 2024-09-12T00:05:31.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.601 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.601 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100399+0000", 2024-09-12T00:05:31.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5883999999999999e-05 2024-09-12T00:05:31.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.601 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:31.601 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100507+0000", 2024-09-12T00:05:31.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010822 2024-09-12T00:05:31.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.601 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:31.602 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100704+0000", 2024-09-12T00:05:31.602 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019658499999999999 2024-09-12T00:05:31.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.602 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.602 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:31.602 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100901+0000", 2024-09-12T00:05:31.602 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000196505 2024-09-12T00:05:31.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.602 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.603 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:31.603 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112178+0000", 2024-09-12T00:05:31.603 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011277718000000001 2024-09-12T00:05:31.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.603 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.603 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.603 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122285+0000", 2024-09-12T00:05:31.603 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010106327 2024-09-12T00:05:31.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.603 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.604 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:31.604 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122358+0000", 2024-09-12T00:05:31.604 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3640999999999995e-05 2024-09-12T00:05:31.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.604 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.604 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:31.604 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122415+0000", 2024-09-12T00:05:31.604 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6768999999999998e-05 2024-09-12T00:05:31.604 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.604 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:31.604 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.605 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.605 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2964 3.24 e75/23 3:26c83ec0:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_3:head v 75'6, mlcod=63'4)", 2024-09-12T00:05:31.605 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:05:31.605 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 11.513473719, 2024-09-12T00:05:31.605 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022426814, 2024-09-12T00:05:31.605 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:31.605 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:31.605 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.605 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:31.605 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.605 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:31.605 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:05:31.606 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.606 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.606 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:31.606 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:05:31.606 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.606 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.606 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:31.606 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012263+0000", 2024-09-12T00:05:31.606 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.091e-06 2024-09-12T00:05:31.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.607 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.607 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:31.607 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018390+0000", 2024-09-12T00:05:31.607 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061264600000000002 2024-09-12T00:05:31.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.607 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.607 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:31.607 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018419+0000", 2024-09-12T00:05:31.607 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8979000000000002e-05 2024-09-12T00:05:31.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.607 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.608 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.608 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018434+0000", 2024-09-12T00:05:31.608 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4781e-05 2024-09-12T00:05:31.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.608 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:31.608 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018528+0000", 2024-09-12T00:05:31.608 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.4333000000000006e-05 2024-09-12T00:05:31.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.608 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:31.609 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018559+0000", 2024-09-12T00:05:31.609 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1557999999999998e-05 2024-09-12T00:05:31.609 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.609 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.609 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:31.609 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.034615+0000", 2024-09-12T00:05:31.609 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016055834000000001 2024-09-12T00:05:31.609 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.609 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.609 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:31.609 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.034688+0000", 2024-09-12T00:05:31.609 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2778e-05 2024-09-12T00:05:31.610 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.610 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:31.610 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.610 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.610 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.610 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2965 3.e e75/23 3:70fff61e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_4:head v 75'5, mlcod=63'3)", 2024-09-12T00:05:31.610 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:05:31.610 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 11.505963498, 2024-09-12T00:05:31.610 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021839210000000001, 2024-09-12T00:05:31.610 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:31.610 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:31.610 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.611 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:31.611 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.611 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:31.611 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:05:31.611 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.611 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.611 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:31.611 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:05:31.611 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.611 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.612 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:31.612 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019773+0000", 2024-09-12T00:05:31.612 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4839999999999999e-06 2024-09-12T00:05:31.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.612 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.612 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:31.612 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021570+0000", 2024-09-12T00:05:31.612 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017965570000000001 2024-09-12T00:05:31.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.612 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.612 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:31.612 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021587+0000", 2024-09-12T00:05:31.613 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7938e-05 2024-09-12T00:05:31.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.613 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.613 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.613 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021598+0000", 2024-09-12T00:05:31.613 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0553e-05 2024-09-12T00:05:31.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.613 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.613 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:31.613 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021676+0000", 2024-09-12T00:05:31.613 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8034000000000005e-05 2024-09-12T00:05:31.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.614 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:31.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021706+0000", 2024-09-12T00:05:31.614 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9915000000000001e-05 2024-09-12T00:05:31.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.614 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:31.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.041519+0000", 2024-09-12T00:05:31.614 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019813171000000001 2024-09-12T00:05:31.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.614 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:31.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.041611+0000", 2024-09-12T00:05:31.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1558000000000007e-05 2024-09-12T00:05:31.615 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.615 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:31.615 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.615 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3004 3.36 3:6cc4f27f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:31.615 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:05:31.615 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 11.087564301, 2024-09-12T00:05:31.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.042951743000000001, 2024-09-12T00:05:31.615 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:31.615 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:31.616 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.616 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:31.616 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:31.616 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.616 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3004 2024-09-12T00:05:31.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.616 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:31.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.616 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:31.616 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:05:31.616 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.617 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:31.617 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:05:31.617 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.617 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:31.617 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438175+0000", 2024-09-12T00:05:31.617 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1640000000000003e-06 2024-09-12T00:05:31.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.617 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:31.618 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439732+0000", 2024-09-12T00:05:31.618 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015574510000000001 2024-09-12T00:05:31.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.618 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:31.618 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439758+0000", 2024-09-12T00:05:31.618 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6074000000000001e-05 2024-09-12T00:05:31.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.618 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.618 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439768+0000", 2024-09-12T00:05:31.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8770000000000005e-06 2024-09-12T00:05:31.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:31.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439874+0000", 2024-09-12T00:05:31.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105583 2024-09-12T00:05:31.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:31.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.440078+0000", 2024-09-12T00:05:31.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020388200000000001 2024-09-12T00:05:31.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:31.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.440251+0000", 2024-09-12T00:05:31.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017339100000000001 2024-09-12T00:05:31.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:31.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.459982+0000", 2024-09-12T00:05:31.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01973099 2024-09-12T00:05:31.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.480958+0000", 2024-09-12T00:05:31.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020975730000000001 2024-09-12T00:05:31.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.621 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:31.621 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481034+0000", 2024-09-12T00:05:31.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6224999999999996e-05 2024-09-12T00:05:31.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.621 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:31.621 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481122+0000", 2024-09-12T00:05:31.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8375999999999995e-05 2024-09-12T00:05:31.621 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.622 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:31.622 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.622 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.622 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3005 3.35 3:ae3b5a36:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:31.622 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:05:31.622 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 11.078310617, 2024-09-12T00:05:31.622 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.028828275, 2024-09-12T00:05:31.622 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:31.622 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:31.622 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.622 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:31.623 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:31.623 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.623 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3005 2024-09-12T00:05:31.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.623 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:31.623 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.623 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:31.623 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:05:31.623 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.623 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.623 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:31.623 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:05:31.624 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.624 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:31.624 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447427+0000", 2024-09-12T00:05:31.624 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.864e-06 2024-09-12T00:05:31.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.624 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:31.624 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449003+0000", 2024-09-12T00:05:31.624 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001575405 2024-09-12T00:05:31.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:31.625 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449030+0000", 2024-09-12T00:05:31.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7189999999999999e-05 2024-09-12T00:05:31.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.625 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449042+0000", 2024-09-12T00:05:31.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2038999999999999e-05 2024-09-12T00:05:31.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:31.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449111+0000", 2024-09-12T00:05:31.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9521000000000001e-05 2024-09-12T00:05:31.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:31.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449218+0000", 2024-09-12T00:05:31.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010675600000000001 2024-09-12T00:05:31.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:31.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449330+0000", 2024-09-12T00:05:31.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000111809 2024-09-12T00:05:31.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.469844+0000", 2024-09-12T00:05:31.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020514277000000001 2024-09-12T00:05:31.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.628 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:31.628 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.475983+0000", 2024-09-12T00:05:31.628 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061392540000000002 2024-09-12T00:05:31.628 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.628 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.628 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:31.628 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.476113+0000", 2024-09-12T00:05:31.628 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000129713 2024-09-12T00:05:31.628 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.628 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.628 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:31.628 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.476253+0000", 2024-09-12T00:05:31.629 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013944700000000001 2024-09-12T00:05:31.629 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.629 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:31.629 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.629 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.629 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3006 3.3 3:c183ca95:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:31.629 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:05:31.629 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 11.068784045999999, 2024-09-12T00:05:31.629 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.024661756, 2024-09-12T00:05:31.629 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:31.630 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:31.630 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.630 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:31.630 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:31.630 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.630 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3006 2024-09-12T00:05:31.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.630 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:31.630 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:31.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:05:31.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:31.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:05:31.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:31.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456954+0000", 2024-09-12T00:05:31.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7070000000000001e-06 2024-09-12T00:05:31.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:31.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458684+0000", 2024-09-12T00:05:31.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017305479999999999 2024-09-12T00:05:31.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:31.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458709+0000", 2024-09-12T00:05:31.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4780999999999999e-05 2024-09-12T00:05:31.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458719+0000", 2024-09-12T00:05:31.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0202e-05 2024-09-12T00:05:31.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:31.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458800+0000", 2024-09-12T00:05:31.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0893e-05 2024-09-12T00:05:31.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:31.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458990+0000", 2024-09-12T00:05:31.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018986400000000001 2024-09-12T00:05:31.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.634 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:31.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.459171+0000", 2024-09-12T00:05:31.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018135499999999999 2024-09-12T00:05:31.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.634 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.478356+0000", 2024-09-12T00:05:31.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019185153 2024-09-12T00:05:31.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.635 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:31.635 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481411+0000", 2024-09-12T00:05:31.635 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030546190000000002 2024-09-12T00:05:31.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.635 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:31.635 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481511+0000", 2024-09-12T00:05:31.635 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.9763e-05 2024-09-12T00:05:31.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.636 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:31.636 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481613+0000", 2024-09-12T00:05:31.636 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101871 2024-09-12T00:05:31.636 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.636 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:31.636 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.636 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.636 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.636 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3019 3.15 3:abb9a608:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:31.636 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.624749+0000", 2024-09-12T00:05:31.636 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.900986431, 2024-09-12T00:05:31.636 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018588891, 2024-09-12T00:05:31.637 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:31.637 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:31.637 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.637 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:31.637 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:31.637 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.637 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3019 2024-09-12T00:05:31.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.637 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:31.637 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.637 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:31.637 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.624749+0000", 2024-09-12T00:05:31.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.638 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:31.638 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.624749+0000", 2024-09-12T00:05:31.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.638 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:31.638 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.624752+0000", 2024-09-12T00:05:31.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4000000000000001e-06 2024-09-12T00:05:31.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:31.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.626087+0000", 2024-09-12T00:05:31.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0013353900000000001 2024-09-12T00:05:31.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:31.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.626122+0000", 2024-09-12T00:05:31.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4904999999999999e-05 2024-09-12T00:05:31.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.626138+0000", 2024-09-12T00:05:31.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5659999999999999e-05 2024-09-12T00:05:31.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:31.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.626215+0000", 2024-09-12T00:05:31.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7528999999999996e-05 2024-09-12T00:05:31.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:31.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.626354+0000", 2024-09-12T00:05:31.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013848899999999999 2024-09-12T00:05:31.641 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.641 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.641 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:31.641 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.626457+0000", 2024-09-12T00:05:31.641 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102921 2024-09-12T00:05:31.641 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.641 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.641 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:31.641 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.631059+0000", 2024-09-12T00:05:31.641 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046025679999999996 2024-09-12T00:05:31.641 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.641 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.642 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.642 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.643254+0000", 2024-09-12T00:05:31.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012194534999999999 2024-09-12T00:05:31.642 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.642 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.642 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:31.642 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.643299+0000", 2024-09-12T00:05:31.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5255e-05 2024-09-12T00:05:31.642 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.642 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.642 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:31.642 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.643337+0000", 2024-09-12T00:05:31.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8238999999999998e-05 2024-09-12T00:05:31.643 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.643 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:31.643 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.643 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.643 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3034 3.2a e75/23 3:57bb186b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_73:head v 75'4, mlcod=63'2)", 2024-09-12T00:05:31.643 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.785462+0000", 2024-09-12T00:05:31.643 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.740273383, 2024-09-12T00:05:31.643 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01923536, 2024-09-12T00:05:31.643 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:31.643 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:31.643 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.644 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:31.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.644 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:31.644 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.785462+0000", 2024-09-12T00:05:31.644 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.644 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:31.644 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.785462+0000", 2024-09-12T00:05:31.644 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.645 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:31.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.785463+0000", 2024-09-12T00:05:31.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8989999999999999e-06 2024-09-12T00:05:31.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.645 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:31.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.788048+0000", 2024-09-12T00:05:31.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025844959999999999 2024-09-12T00:05:31.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.645 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:31.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.788074+0000", 2024-09-12T00:05:31.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6393e-05 2024-09-12T00:05:31.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.646 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.646 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.788087+0000", 2024-09-12T00:05:31.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2261e-05 2024-09-12T00:05:31.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.646 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:31.646 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.788194+0000", 2024-09-12T00:05:31.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000107599 2024-09-12T00:05:31.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:31.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.788220+0000", 2024-09-12T00:05:31.647 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5374000000000001e-05 2024-09-12T00:05:31.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:31.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.804625+0000", 2024-09-12T00:05:31.647 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016405349 2024-09-12T00:05:31.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:31.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.804697+0000", 2024-09-12T00:05:31.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1989000000000005e-05 2024-09-12T00:05:31.648 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.648 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:31.648 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.648 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.648 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3037 3.39 3:9eefb4c1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:31.648 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:05:31.648 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.710516639, 2024-09-12T00:05:31.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020855543000000001, 2024-09-12T00:05:31.648 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:31.648 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:31.649 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.649 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:31.649 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:31.649 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.649 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3037 2024-09-12T00:05:31.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.649 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:31.649 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.649 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:31.649 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:05:31.649 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.650 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:31.650 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:05:31.650 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.650 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:31.650 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815221+0000", 2024-09-12T00:05:31.650 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1540000000000002e-06 2024-09-12T00:05:31.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:31.651 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817594+0000", 2024-09-12T00:05:31.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023728880000000001 2024-09-12T00:05:31.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.651 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:31.651 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817618+0000", 2024-09-12T00:05:31.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3635e-05 2024-09-12T00:05:31.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.651 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817633+0000", 2024-09-12T00:05:31.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4559000000000001e-05 2024-09-12T00:05:31.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.652 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:31.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817734+0000", 2024-09-12T00:05:31.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101729 2024-09-12T00:05:31.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.652 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:31.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817939+0000", 2024-09-12T00:05:31.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020489299999999999 2024-09-12T00:05:31.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:31.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.818113+0000", 2024-09-12T00:05:31.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000173413 2024-09-12T00:05:31.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:31.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.825676+0000", 2024-09-12T00:05:31.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075635260000000001 2024-09-12T00:05:31.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.654 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.835921+0000", 2024-09-12T00:05:31.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010244932999999999 2024-09-12T00:05:31.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:31.654 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.836006+0000", 2024-09-12T00:05:31.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5427999999999996e-05 2024-09-12T00:05:31.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:31.654 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.836074+0000", 2024-09-12T00:05:31.655 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7385000000000006e-05 2024-09-12T00:05:31.655 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.655 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:31.655 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.655 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.655 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3096 3.2f e76/23 3:f7c63ea3:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_135:head v 76'5, mlcod=75'3)", 2024-09-12T00:05:31.655 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:21.579016+0000", 2024-09-12T00:05:31.655 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.9467191970000002, 2024-09-12T00:05:31.655 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019041222999999999, 2024-09-12T00:05:31.655 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:31.655 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:31.656 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.656 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:31.656 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.656 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:31.656 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.579016+0000", 2024-09-12T00:05:31.656 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.656 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.656 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:31.656 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.579016+0000", 2024-09-12T00:05:31.656 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.657 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:31.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.579016+0000", 2024-09-12T00:05:31.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7100000000000001e-07 2024-09-12T00:05:31.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.657 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:31.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.585629+0000", 2024-09-12T00:05:31.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066123520000000002 2024-09-12T00:05:31.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:31.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.585651+0000", 2024-09-12T00:05:31.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1953000000000001e-05 2024-09-12T00:05:31.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.585661+0000", 2024-09-12T00:05:31.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0057e-05 2024-09-12T00:05:31.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:31.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.585748+0000", 2024-09-12T00:05:31.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7225999999999995e-05 2024-09-12T00:05:31.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:31.659 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.585778+0000", 2024-09-12T00:05:31.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9818000000000001e-05 2024-09-12T00:05:31.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:31.659 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.597995+0000", 2024-09-12T00:05:31.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01221673 2024-09-12T00:05:31.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.660 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.660 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:31.660 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.598057+0000", 2024-09-12T00:05:31.660 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2415999999999993e-05 2024-09-12T00:05:31.660 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.660 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:31.660 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.660 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.660 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3102 3.1b e76/23 3:db06e448:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_141:head v 76'9, mlcod=63'7)", 2024-09-12T00:05:31.660 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:21.652983+0000", 2024-09-12T00:05:31.660 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.8727515140000008, 2024-09-12T00:05:31.661 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019025626, 2024-09-12T00:05:31.661 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:31.661 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:31.661 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.661 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:31.661 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.661 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:31.661 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.652983+0000", 2024-09-12T00:05:31.661 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.661 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.661 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:31.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.652983+0000", 2024-09-12T00:05:31.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:31.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.652984+0000", 2024-09-12T00:05:31.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6300000000000004e-07 2024-09-12T00:05:31.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:31.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.659663+0000", 2024-09-12T00:05:31.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066788200000000002 2024-09-12T00:05:31.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:31.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.659693+0000", 2024-09-12T00:05:31.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9453000000000001e-05 2024-09-12T00:05:31.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.659705+0000", 2024-09-12T00:05:31.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2055000000000001e-05 2024-09-12T00:05:31.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:31.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.659787+0000", 2024-09-12T00:05:31.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2429000000000006e-05 2024-09-12T00:05:31.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:31.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.659816+0000", 2024-09-12T00:05:31.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8704000000000002e-05 2024-09-12T00:05:31.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:31.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.671902+0000", 2024-09-12T00:05:31.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012085871999999999 2024-09-12T00:05:31.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.665 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:31.665 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.672009+0000", 2024-09-12T00:05:31.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010743000000000001 2024-09-12T00:05:31.665 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.665 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:31.665 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.665 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3128 3.c 3:30aa9812:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:31.666 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:21.954348+0000", 2024-09-12T00:05:31.666 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.5713865689999995, 2024-09-12T00:05:31.666 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020268630999999999, 2024-09-12T00:05:31.666 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:31.666 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:31.666 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.666 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:31.666 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:31.666 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.666 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3128 2024-09-12T00:05:31.666 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.666 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:31.667 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.667 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:31.667 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.954348+0000", 2024-09-12T00:05:31.667 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.667 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.667 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:31.667 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.954348+0000", 2024-09-12T00:05:31.667 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.667 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.667 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:31.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.954351+0000", 2024-09-12T00:05:31.668 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:05:31.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.668 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:31.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.956451+0000", 2024-09-12T00:05:31.668 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021003150000000002 2024-09-12T00:05:31.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.668 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:31.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.956508+0000", 2024-09-12T00:05:31.668 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6379999999999999e-05 2024-09-12T00:05:31.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.956527+0000", 2024-09-12T00:05:31.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9945e-05 2024-09-12T00:05:31.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:31.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.956631+0000", 2024-09-12T00:05:31.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103664 2024-09-12T00:05:31.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:31.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.956890+0000", 2024-09-12T00:05:31.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00025909499999999999 2024-09-12T00:05:31.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:31.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.957167+0000", 2024-09-12T00:05:31.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000277113 2024-09-12T00:05:31.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:31.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.968705+0000", 2024-09-12T00:05:31.671 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011538049999999999 2024-09-12T00:05:31.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.671 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.671 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.974534+0000", 2024-09-12T00:05:31.671 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058281499999999998 2024-09-12T00:05:31.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.671 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:31.671 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.974580+0000", 2024-09-12T00:05:31.671 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6649e-05 2024-09-12T00:05:31.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.672 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.672 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:31.672 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.974617+0000", 2024-09-12T00:05:31.672 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6829999999999998e-05 2024-09-12T00:05:31.672 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.672 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:31.672 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.672 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.672 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.672 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3134 3.24 e76/23 3:2525a955:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_173:head v 76'8, mlcod=75'6)", 2024-09-12T00:05:31.672 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:22.046783+0000", 2024-09-12T00:05:31.672 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.4789519720000008, 2024-09-12T00:05:31.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018988463000000001, 2024-09-12T00:05:31.673 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:31.673 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:31.673 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.673 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:31.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.673 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:31.673 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.046783+0000", 2024-09-12T00:05:31.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.673 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:31.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.046783+0000", 2024-09-12T00:05:31.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.674 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:31.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.046786+0000", 2024-09-12T00:05:31.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5450000000000002e-06 2024-09-12T00:05:31.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.674 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:31.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.051145+0000", 2024-09-12T00:05:31.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0043596260000000001 2024-09-12T00:05:31.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:31.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.051178+0000", 2024-09-12T00:05:31.675 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2765000000000002e-05 2024-09-12T00:05:31.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.051193+0000", 2024-09-12T00:05:31.675 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4884e-05 2024-09-12T00:05:31.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:31.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.051273+0000", 2024-09-12T00:05:31.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0360999999999999e-05 2024-09-12T00:05:31.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:31.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.051296+0000", 2024-09-12T00:05:31.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2531000000000002e-05 2024-09-12T00:05:31.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:31.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.065696+0000", 2024-09-12T00:05:31.677 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014399792999999999 2024-09-12T00:05:31.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.677 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.677 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:31.677 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.065771+0000", 2024-09-12T00:05:31.677 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5957999999999993e-05 2024-09-12T00:05:31.677 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.677 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:31.677 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.677 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.678 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3142 3.c 3:33689984:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:31.678 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:22.143966+0000", 2024-09-12T00:05:31.678 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.3817689529999999, 2024-09-12T00:05:31.678 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018503077999999999, 2024-09-12T00:05:31.678 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:31.678 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:31.678 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:31.678 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:31.678 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:31.678 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:31.678 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3142 2024-09-12T00:05:31.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.679 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:31.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:31.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.143966+0000", 2024-09-12T00:05:31.679 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:31.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.143966+0000", 2024-09-12T00:05:31.679 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:31.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:31.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.143969+0000", 2024-09-12T00:05:31.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.666e-06 2024-09-12T00:05:31.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:31.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.146392+0000", 2024-09-12T00:05:31.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024235620000000002 2024-09-12T00:05:31.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:31.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.146427+0000", 2024-09-12T00:05:31.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5238999999999999e-05 2024-09-12T00:05:31.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.681 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:31.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.146445+0000", 2024-09-12T00:05:31.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7499999999999998e-05 2024-09-12T00:05:31.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.681 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:31.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.146539+0000", 2024-09-12T00:05:31.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3752999999999995e-05 2024-09-12T00:05:31.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:31.682 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.146667+0000", 2024-09-12T00:05:31.682 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000128613 2024-09-12T00:05:31.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:31.682 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.146772+0000", 2024-09-12T00:05:31.682 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104452 2024-09-12T00:05:31.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:31.682 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.156499+0000", 2024-09-12T00:05:31.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0097269929999999998 2024-09-12T00:05:31.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.683 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.683 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:31.683 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.162385+0000", 2024-09-12T00:05:31.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058857780000000004 2024-09-12T00:05:31.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.683 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.683 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:31.683 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.162429+0000", 2024-09-12T00:05:31.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4592000000000003e-05 2024-09-12T00:05:31.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:31.684 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:31.684 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:31.684 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.162469+0000", 2024-09-12T00:05:31.684 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9929999999999999e-05 2024-09-12T00:05:31.684 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.684 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:31.684 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.684 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:31.684 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:31.684 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:31.686 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:05:31.686 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:31.687 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:31.687 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:31.687 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:31.688 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:31.688 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:31.688 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:31.688 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:31.689 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:31.689 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:31.689 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:31.690 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:31.690 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:31.688+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:31.702 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:31.702 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:31.725 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:31.725 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:31.787 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:31.788+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:31.836 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:31.836 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:31.851 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:05:31.897 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:31.900+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:31.979 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:31.979 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:31.988 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:31.988+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:31.994 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:05:32.089 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:32.092+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:32.166 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:32.166 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:32.180 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:05:32.190 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:32.188+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:32.290 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:32.292+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:32.352 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:32.352 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:32.366 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:05:32.410 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:32.412+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:32.493 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:32.492+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:32.540 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:32.540 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:32.555 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:05:32.601 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:32.604+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:32.634 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T00:05:32.685 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:32.685 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:32.694 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:32.696+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:32.701 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:05:32.795 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:32.796+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:32.825 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:32.825 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:32.840 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:05:32.929 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:32.932+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:32.997 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:32.996+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:33.007 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:33.008 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:33.022 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:05:33.109 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:33.112+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:33.197 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:33.197 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:33.199 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:33.200+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:33.212 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:05:33.300 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:33.300+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:33.345 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:33.345 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:33.360 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:05:33.406 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:33.408+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:33.481 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:33.481 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:33.495 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:05:33.539 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:33.540+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:33.602 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:33.600+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:33.605 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T00:05:33.665 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:33.666 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:33.680 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:05:33.722 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:33.724+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:33.746 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:05:33.804 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:33.804+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:33.847 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:33.847 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:33.862 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:05:33.903 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:33.904 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:33.905 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:33.904+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:33.920 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:33.920 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:33.937 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:33.937 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:33.955 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:33.955 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:33.976 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:33.976 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:33.979 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:33.980 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:33.994 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:05:33.997 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:33.997 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:34.015 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:34.016 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:34.034 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:34.034 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:34.044 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:34.044+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:34.107 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:34.108+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:34.117 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:34.117 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:34.117 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:34.117 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:34.118 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.118 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2694 3.3d 3:bd0bdafc:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:34.118 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:34.118 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 46.572093672999998, 2024-09-12T00:05:34.118 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.026139741000000001, 2024-09-12T00:05:34.118 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.118 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.118 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.118 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.118 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.118 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.118 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2694 2024-09-12T00:05:34.118 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.118 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.119 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.119 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.119 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:34.119 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.119 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.119 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.119 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545528+0000", 2024-09-12T00:05:34.119 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.119 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.119 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.119 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.545532+0000", 2024-09-12T00:05:34.120 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8199999999999998e-06 2024-09-12T00:05:34.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.120 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.120 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.120 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551454+0000", 2024-09-12T00:05:34.120 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059222340000000002 2024-09-12T00:05:34.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.120 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.120 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.120 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551485+0000", 2024-09-12T00:05:34.120 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0173999999999999e-05 2024-09-12T00:05:34.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.120 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.120 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.121 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551504+0000", 2024-09-12T00:05:34.121 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9726000000000001e-05 2024-09-12T00:05:34.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.121 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.121 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.121 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.551708+0000", 2024-09-12T00:05:34.121 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020344100000000001 2024-09-12T00:05:34.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.121 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.121 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.121 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552087+0000", 2024-09-12T00:05:34.121 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000379327 2024-09-12T00:05:34.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.121 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.122 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:34.122 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.552351+0000", 2024-09-12T00:05:34.122 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026349199999999999 2024-09-12T00:05:34.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.122 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.122 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.122 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.569375+0000", 2024-09-12T00:05:34.122 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017024432999999999 2024-09-12T00:05:34.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.122 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.122 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.122 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571222+0000", 2024-09-12T00:05:34.122 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00184688 2024-09-12T00:05:34.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.123 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.123 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571511+0000", 2024-09-12T00:05:34.123 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028897599999999998 2024-09-12T00:05:34.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.123 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.123 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.571668+0000", 2024-09-12T00:05:34.123 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000157238 2024-09-12T00:05:34.123 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.123 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.123 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.124 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.124 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2698 3.3d 3:bcafb0f9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:34.124 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:34.124 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 46.527639970000003, 2024-09-12T00:05:34.124 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025133152999999998, 2024-09-12T00:05:34.124 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.124 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.124 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.124 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.124 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.124 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.124 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2698 2024-09-12T00:05:34.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.125 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.125 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.125 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.125 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:34.125 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.125 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.125 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.125 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589982+0000", 2024-09-12T00:05:34.125 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.125 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.125 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.125 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.589986+0000", 2024-09-12T00:05:34.126 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5999999999999998e-06 2024-09-12T00:05:34.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.126 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.126 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.126 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594109+0000", 2024-09-12T00:05:34.126 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041230770000000002 2024-09-12T00:05:34.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.126 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.126 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.126 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594146+0000", 2024-09-12T00:05:34.126 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7722000000000002e-05 2024-09-12T00:05:34.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.126 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.126 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.126 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594167+0000", 2024-09-12T00:05:34.127 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0100999999999999e-05 2024-09-12T00:05:34.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.127 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.127 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.127 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594297+0000", 2024-09-12T00:05:34.127 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013051600000000001 2024-09-12T00:05:34.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.127 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.127 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.127 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594570+0000", 2024-09-12T00:05:34.127 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000272837 2024-09-12T00:05:34.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.127 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.127 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:34.128 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.594846+0000", 2024-09-12T00:05:34.128 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027622399999999999 2024-09-12T00:05:34.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.128 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.128 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.128 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.606026+0000", 2024-09-12T00:05:34.128 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011179947000000001 2024-09-12T00:05:34.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.128 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.128 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.128 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.614827+0000", 2024-09-12T00:05:34.128 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0088013259999999999 2024-09-12T00:05:34.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.128 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.129 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.129 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.614988+0000", 2024-09-12T00:05:34.129 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016018799999999999 2024-09-12T00:05:34.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.129 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.129 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.129 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.615115+0000", 2024-09-12T00:05:34.129 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000127615 2024-09-12T00:05:34.129 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.129 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.129 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.130 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.130 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2712 3.3e 3:7d3d0242:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:34.130 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:34.130 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 46.390739693, 2024-09-12T00:05:34.130 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022816941, 2024-09-12T00:05:34.130 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.130 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.130 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.130 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.130 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.130 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.130 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2712 2024-09-12T00:05:34.130 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.131 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.131 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.131 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.131 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:34.131 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.131 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.131 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.131 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726882+0000", 2024-09-12T00:05:34.131 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.131 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.131 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.132 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.726886+0000", 2024-09-12T00:05:34.132 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5329999999999999e-06 2024-09-12T00:05:34.132 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.132 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.132 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.132 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730802+0000", 2024-09-12T00:05:34.132 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039158700000000001 2024-09-12T00:05:34.132 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.132 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.133 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.133 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730839+0000", 2024-09-12T00:05:34.133 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6857999999999998e-05 2024-09-12T00:05:34.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.133 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.133 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.133 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.730856+0000", 2024-09-12T00:05:34.133 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7371999999999999e-05 2024-09-12T00:05:34.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.133 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.133 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.133 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731026+0000", 2024-09-12T00:05:34.133 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017011000000000001 2024-09-12T00:05:34.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.134 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.134 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.134 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731444+0000", 2024-09-12T00:05:34.134 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041766500000000001 2024-09-12T00:05:34.134 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.134 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.134 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:34.134 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.731860+0000", 2024-09-12T00:05:34.134 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041618500000000001 2024-09-12T00:05:34.134 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.134 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.134 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.134 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.743012+0000", 2024-09-12T00:05:34.134 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011152123 2024-09-12T00:05:34.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.135 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.135 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.135 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749386+0000", 2024-09-12T00:05:34.135 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0063743130000000004 2024-09-12T00:05:34.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.135 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.135 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.135 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749562+0000", 2024-09-12T00:05:34.135 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017590300000000001 2024-09-12T00:05:34.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.135 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.135 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.136 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.749699+0000", 2024-09-12T00:05:34.136 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000137009 2024-09-12T00:05:34.136 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.136 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.136 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.136 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.136 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.136 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2715 3.18 3:19a9b410:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:34.136 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:34.136 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 46.361363402999999, 2024-09-12T00:05:34.136 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022391956000000001, 2024-09-12T00:05:34.136 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.136 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.136 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.137 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.137 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.137 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.137 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2715 2024-09-12T00:05:34.137 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.137 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.137 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.137 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.137 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:34.137 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.137 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.137 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.138 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.138 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756259+0000", 2024-09-12T00:05:34.138 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.138 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.138 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.138 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.756262+0000", 2024-09-12T00:05:34.138 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9629999999999998e-06 2024-09-12T00:05:34.139 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.139 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.139 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.139 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760936+0000", 2024-09-12T00:05:34.139 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046745750000000003 2024-09-12T00:05:34.139 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.139 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.139 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.139 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760968+0000", 2024-09-12T00:05:34.139 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1470999999999997e-05 2024-09-12T00:05:34.139 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.140 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.140 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.140 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.760985+0000", 2024-09-12T00:05:34.140 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7771999999999999e-05 2024-09-12T00:05:34.140 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.140 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.140 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.141 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761154+0000", 2024-09-12T00:05:34.141 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016875399999999999 2024-09-12T00:05:34.141 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.141 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.141 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.141 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761571+0000", 2024-09-12T00:05:34.141 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000417231 2024-09-12T00:05:34.141 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.141 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.141 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:34.141 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.761996+0000", 2024-09-12T00:05:34.142 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042500200000000001 2024-09-12T00:05:34.142 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.142 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.142 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.142 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.777182+0000", 2024-09-12T00:05:34.142 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015185664999999999 2024-09-12T00:05:34.142 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.142 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.142 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.142 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778484+0000", 2024-09-12T00:05:34.142 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00130225 2024-09-12T00:05:34.142 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.142 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.142 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.143 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778575+0000", 2024-09-12T00:05:34.143 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0258000000000002e-05 2024-09-12T00:05:34.143 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.143 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.143 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.143 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.778651+0000", 2024-09-12T00:05:34.143 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6014999999999996e-05 2024-09-12T00:05:34.143 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.143 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.143 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.143 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.143 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.143 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2729 3.0 3:01c0e0c9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:34.143 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:34.144 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 46.220482586999999, 2024-09-12T00:05:34.144 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025173068, 2024-09-12T00:05:34.144 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.144 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.144 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.144 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.144 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.144 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.144 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2729 2024-09-12T00:05:34.144 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.144 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.144 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.144 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.144 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:34.145 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.145 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.145 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.145 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.145 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897139+0000", 2024-09-12T00:05:34.145 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.145 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.145 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.145 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.145 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.897143+0000", 2024-09-12T00:05:34.145 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6600000000000001e-06 2024-09-12T00:05:34.145 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.145 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.145 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.146 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901595+0000", 2024-09-12T00:05:34.146 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044514680000000001 2024-09-12T00:05:34.146 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.146 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.146 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.146 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901629+0000", 2024-09-12T00:05:34.146 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4864999999999999e-05 2024-09-12T00:05:34.146 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.146 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.146 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.146 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901647+0000", 2024-09-12T00:05:34.146 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7699000000000001e-05 2024-09-12T00:05:34.147 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.147 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.147 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.147 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.901780+0000", 2024-09-12T00:05:34.147 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013271499999999999 2024-09-12T00:05:34.147 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.147 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.147 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.147 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902010+0000", 2024-09-12T00:05:34.147 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022977300000000001 2024-09-12T00:05:34.147 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.147 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.147 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:34.148 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902222+0000", 2024-09-12T00:05:34.148 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021262399999999999 2024-09-12T00:05:34.148 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.148 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.148 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.148 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.912402+0000", 2024-09-12T00:05:34.148 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010180203000000001 2024-09-12T00:05:34.148 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.148 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.148 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.148 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.921990+0000", 2024-09-12T00:05:34.148 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095871900000000006 2024-09-12T00:05:34.148 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.149 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.149 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.149 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.922166+0000", 2024-09-12T00:05:34.149 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017591899999999999 2024-09-12T00:05:34.149 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.149 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.149 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.149 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.922313+0000", 2024-09-12T00:05:34.149 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000146952 2024-09-12T00:05:34.149 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.149 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.149 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.149 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.149 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.150 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2732 3.1f 3:f85b64cb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:34.150 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:34.150 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 46.189036799, 2024-09-12T00:05:34.150 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022644154, 2024-09-12T00:05:34.150 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.150 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.150 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.150 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.150 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.150 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.150 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2732 2024-09-12T00:05:34.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.150 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.150 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.151 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.151 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:34.151 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.151 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.151 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.151 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.151 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928585+0000", 2024-09-12T00:05:34.151 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.151 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.151 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.151 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.151 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.928589+0000", 2024-09-12T00:05:34.151 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1230000000000002e-06 2024-09-12T00:05:34.151 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.152 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.152 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.152 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932650+0000", 2024-09-12T00:05:34.152 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040611049999999997 2024-09-12T00:05:34.152 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.152 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.152 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.152 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932692+0000", 2024-09-12T00:05:34.152 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1677000000000001e-05 2024-09-12T00:05:34.153 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.153 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.153 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.153 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932711+0000", 2024-09-12T00:05:34.154 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8749e-05 2024-09-12T00:05:34.154 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.154 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.154 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.154 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.932834+0000", 2024-09-12T00:05:34.154 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012278300000000001 2024-09-12T00:05:34.154 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.154 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.154 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.154 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.933095+0000", 2024-09-12T00:05:34.154 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026151100000000002 2024-09-12T00:05:34.154 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.155 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.155 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:34.155 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.933385+0000", 2024-09-12T00:05:34.155 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028993900000000002 2024-09-12T00:05:34.155 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.155 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.155 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.155 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.950988+0000", 2024-09-12T00:05:34.155 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017603119 2024-09-12T00:05:34.155 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.155 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.155 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.155 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951018+0000", 2024-09-12T00:05:34.155 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9343999999999999e-05 2024-09-12T00:05:34.156 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.156 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.156 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.156 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951109+0000", 2024-09-12T00:05:34.156 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1157999999999997e-05 2024-09-12T00:05:34.156 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.156 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.156 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.156 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.951229+0000", 2024-09-12T00:05:34.156 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120646 2024-09-12T00:05:34.156 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.156 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.156 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.157 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.157 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.157 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2747 3.17 3:eaa4528d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:34.157 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:34.157 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 46.028700313999998, 2024-09-12T00:05:34.157 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025552734000000001, 2024-09-12T00:05:34.157 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.157 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.157 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.157 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.157 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.157 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.157 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2747 2024-09-12T00:05:34.157 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.158 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.158 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.158 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.158 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:34.158 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.158 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.158 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.158 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.158 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088922+0000", 2024-09-12T00:05:34.158 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.158 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.158 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.158 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.159 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.088925+0000", 2024-09-12T00:05:34.159 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7759999999999999e-06 2024-09-12T00:05:34.159 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.159 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.159 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.159 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093002+0000", 2024-09-12T00:05:34.159 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004076405 2024-09-12T00:05:34.159 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.159 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.159 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.159 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093040+0000", 2024-09-12T00:05:34.159 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8093999999999998e-05 2024-09-12T00:05:34.159 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.160 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.160 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.160 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093059+0000", 2024-09-12T00:05:34.160 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8736000000000002e-05 2024-09-12T00:05:34.160 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.160 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.160 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.160 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093230+0000", 2024-09-12T00:05:34.160 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000170853 2024-09-12T00:05:34.160 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.160 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.160 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.160 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.093627+0000", 2024-09-12T00:05:34.161 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039781400000000002 2024-09-12T00:05:34.161 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.161 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.161 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:34.161 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.094044+0000", 2024-09-12T00:05:34.161 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000416205 2024-09-12T00:05:34.161 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.161 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.161 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.161 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.103528+0000", 2024-09-12T00:05:34.161 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0094841549999999993 2024-09-12T00:05:34.161 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.161 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.161 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.162 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112299+0000", 2024-09-12T00:05:34.162 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0087711590000000006 2024-09-12T00:05:34.162 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.162 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.162 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.162 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.112397+0000", 2024-09-12T00:05:34.162 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8095000000000002e-05 2024-09-12T00:05:34.162 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.162 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.162 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.162 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.114474+0000", 2024-09-12T00:05:34.162 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020774420000000001 2024-09-12T00:05:34.162 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.163 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.163 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.163 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.163 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.163 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2962 3.18 3:1b55431a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:34.163 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:19.985385+0000", 2024-09-12T00:05:34.163 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.132237023, 2024-09-12T00:05:34.163 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024097998999999998, 2024-09-12T00:05:34.163 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.163 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.163 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.163 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.163 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.163 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.164 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2962 2024-09-12T00:05:34.164 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.164 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.164 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.164 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.164 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.985385+0000", 2024-09-12T00:05:34.164 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.164 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.164 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.164 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.164 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.985385+0000", 2024-09-12T00:05:34.164 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.164 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.165 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.165 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.165 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.985388+0000", 2024-09-12T00:05:34.165 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8899999999999999e-06 2024-09-12T00:05:34.165 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.165 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.165 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.165 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990021+0000", 2024-09-12T00:05:34.165 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046326850000000001 2024-09-12T00:05:34.165 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.165 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.165 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.165 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990049+0000", 2024-09-12T00:05:34.166 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8007000000000001e-05 2024-09-12T00:05:34.166 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.166 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.166 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.166 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990064+0000", 2024-09-12T00:05:34.166 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4918e-05 2024-09-12T00:05:34.166 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.166 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.166 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.166 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990182+0000", 2024-09-12T00:05:34.166 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000118958 2024-09-12T00:05:34.166 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.166 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.166 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.167 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990449+0000", 2024-09-12T00:05:34.167 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026634899999999998 2024-09-12T00:05:34.167 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.167 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.167 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:34.167 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990677+0000", 2024-09-12T00:05:34.167 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022768800000000001 2024-09-12T00:05:34.167 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.167 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.167 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.167 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.007621+0000", 2024-09-12T00:05:34.167 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016944866999999999 2024-09-12T00:05:34.167 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.168 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.168 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.168 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.009365+0000", 2024-09-12T00:05:34.168 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0017433399999999999 2024-09-12T00:05:34.168 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.168 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.168 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.168 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.009430+0000", 2024-09-12T00:05:34.168 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4813000000000004e-05 2024-09-12T00:05:34.168 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.168 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.168 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.168 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.009483+0000", 2024-09-12T00:05:34.168 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3483999999999998e-05 2024-09-12T00:05:34.169 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.169 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.169 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.169 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.169 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.169 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2995 3.29 3:96b1390d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:34.169 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.340290+0000", 2024-09-12T00:05:34.169 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 13.777331882, 2024-09-12T00:05:34.169 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022765251, 2024-09-12T00:05:34.169 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.169 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.169 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.169 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.169 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.170 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.170 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2995 2024-09-12T00:05:34.170 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.170 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.170 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.170 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.170 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.340290+0000", 2024-09-12T00:05:34.170 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.170 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.170 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.170 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.171 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.340290+0000", 2024-09-12T00:05:34.171 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.171 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.171 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.171 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.171 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.340293+0000", 2024-09-12T00:05:34.171 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2200000000000001e-06 2024-09-12T00:05:34.171 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.171 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.171 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.171 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.346557+0000", 2024-09-12T00:05:34.171 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0062637070000000003 2024-09-12T00:05:34.171 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.171 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.171 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.172 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.346595+0000", 2024-09-12T00:05:34.172 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7672000000000001e-05 2024-09-12T00:05:34.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.172 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.172 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.172 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.346620+0000", 2024-09-12T00:05:34.172 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4769999999999998e-05 2024-09-12T00:05:34.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.172 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.172 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.172 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.346757+0000", 2024-09-12T00:05:34.172 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000137319 2024-09-12T00:05:34.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.173 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.173 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.173 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.347013+0000", 2024-09-12T00:05:34.173 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025612299999999997 2024-09-12T00:05:34.173 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.173 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.173 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:34.173 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.347237+0000", 2024-09-12T00:05:34.173 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000224348 2024-09-12T00:05:34.173 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.173 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.173 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.173 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.357526+0000", 2024-09-12T00:05:34.173 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010288693 2024-09-12T00:05:34.174 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.174 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.174 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.174 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.362902+0000", 2024-09-12T00:05:34.174 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053764659999999999 2024-09-12T00:05:34.174 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.174 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.174 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.174 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.362988+0000", 2024-09-12T00:05:34.174 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.5086000000000005e-05 2024-09-12T00:05:34.174 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.174 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.174 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.174 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.363055+0000", 2024-09-12T00:05:34.175 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.7847000000000003e-05 2024-09-12T00:05:34.175 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.175 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.175 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.175 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.175 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.175 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3017 3.1e 3:792e6842:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:34.175 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.605222+0000", 2024-09-12T00:05:34.175 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 13.51239966, 2024-09-12T00:05:34.175 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021662359999999999, 2024-09-12T00:05:34.175 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.175 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.175 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.176 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.176 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.176 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.176 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3017 2024-09-12T00:05:34.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.176 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.176 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.176 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.176 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.605222+0000", 2024-09-12T00:05:34.176 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.176 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.176 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.177 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.605222+0000", 2024-09-12T00:05:34.177 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.177 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.177 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.177 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.177 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.605227+0000", 2024-09-12T00:05:34.177 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3100000000000002e-06 2024-09-12T00:05:34.177 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.177 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.178 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.178 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.610360+0000", 2024-09-12T00:05:34.178 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0051331609999999998 2024-09-12T00:05:34.178 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.178 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.178 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.178 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.610400+0000", 2024-09-12T00:05:34.178 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9795000000000001e-05 2024-09-12T00:05:34.178 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.178 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.178 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.178 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.610418+0000", 2024-09-12T00:05:34.178 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8539e-05 2024-09-12T00:05:34.179 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.179 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.179 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.179 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.610552+0000", 2024-09-12T00:05:34.179 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013348400000000001 2024-09-12T00:05:34.179 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.179 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.179 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.179 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.610799+0000", 2024-09-12T00:05:34.179 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024735600000000001 2024-09-12T00:05:34.179 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.179 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.179 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:34.180 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611118+0000", 2024-09-12T00:05:34.180 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000318676 2024-09-12T00:05:34.180 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.180 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.180 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.180 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.620061+0000", 2024-09-12T00:05:34.180 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0089429920000000003 2024-09-12T00:05:34.180 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.180 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.180 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.180 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.626735+0000", 2024-09-12T00:05:34.180 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006674803 2024-09-12T00:05:34.180 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.180 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.181 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.181 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.626826+0000", 2024-09-12T00:05:34.181 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0532000000000007e-05 2024-09-12T00:05:34.181 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.181 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.181 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.181 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.626885+0000", 2024-09-12T00:05:34.181 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8712000000000003e-05 2024-09-12T00:05:34.181 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.181 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.181 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.181 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.181 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.182 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3033 3.1e 3:79681e1a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:34.182 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.771222+0000", 2024-09-12T00:05:34.182 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 13.346399555, 2024-09-12T00:05:34.182 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.033700292, 2024-09-12T00:05:34.182 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.182 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.182 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.182 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.182 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.182 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.182 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3033 2024-09-12T00:05:34.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.183 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.183 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.183 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.183 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.771222+0000", 2024-09-12T00:05:34.183 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.183 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.183 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.183 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.771222+0000", 2024-09-12T00:05:34.183 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.183 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.184 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.184 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.771225+0000", 2024-09-12T00:05:34.184 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.74e-06 2024-09-12T00:05:34.184 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.184 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.184 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.184 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.775948+0000", 2024-09-12T00:05:34.184 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047228419999999997 2024-09-12T00:05:34.184 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.184 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.184 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.184 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.775971+0000", 2024-09-12T00:05:34.184 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2634999999999999e-05 2024-09-12T00:05:34.185 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.185 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.185 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.185 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.775981+0000", 2024-09-12T00:05:34.185 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8579999999999995e-06 2024-09-12T00:05:34.185 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.185 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.185 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.185 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.776126+0000", 2024-09-12T00:05:34.185 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014540500000000001 2024-09-12T00:05:34.185 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.185 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.185 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.186 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.776391+0000", 2024-09-12T00:05:34.186 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026489699999999999 2024-09-12T00:05:34.186 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.186 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.186 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:34.186 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.776613+0000", 2024-09-12T00:05:34.186 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022235700000000001 2024-09-12T00:05:34.186 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.186 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.186 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.186 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.783586+0000", 2024-09-12T00:05:34.186 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006972705 2024-09-12T00:05:34.186 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.186 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.186 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.187 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.804641+0000", 2024-09-12T00:05:34.187 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021055470999999999 2024-09-12T00:05:34.187 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.187 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.187 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.187 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.804798+0000", 2024-09-12T00:05:34.187 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015695600000000001 2024-09-12T00:05:34.187 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.187 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.187 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.187 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.804923+0000", 2024-09-12T00:05:34.187 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012442599999999999 2024-09-12T00:05:34.188 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.188 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.188 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.188 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.188 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.188 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3036 3.1e 3:7aa0a48a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:34.188 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.802567+0000", 2024-09-12T00:05:34.188 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 13.315055445, 2024-09-12T00:05:34.188 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022998985, 2024-09-12T00:05:34.188 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.188 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.188 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.188 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.189 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.189 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.189 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3036 2024-09-12T00:05:34.189 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.189 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.189 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.189 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.189 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.802567+0000", 2024-09-12T00:05:34.189 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.189 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.189 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.189 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.189 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.802567+0000", 2024-09-12T00:05:34.189 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.190 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.190 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.190 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.802570+0000", 2024-09-12T00:05:34.190 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3100000000000001e-06 2024-09-12T00:05:34.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.190 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.190 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.190 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.807884+0000", 2024-09-12T00:05:34.190 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053139809999999997 2024-09-12T00:05:34.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.190 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.190 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.190 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.807917+0000", 2024-09-12T00:05:34.191 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3334999999999998e-05 2024-09-12T00:05:34.191 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.191 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.191 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.191 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.807934+0000", 2024-09-12T00:05:34.191 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6543000000000001e-05 2024-09-12T00:05:34.191 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.191 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.191 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.191 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.808082+0000", 2024-09-12T00:05:34.191 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148639 2024-09-12T00:05:34.191 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.191 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.191 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.192 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.808332+0000", 2024-09-12T00:05:34.192 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024954699999999997 2024-09-12T00:05:34.192 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.192 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.192 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:34.192 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.808560+0000", 2024-09-12T00:05:34.192 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000228314 2024-09-12T00:05:34.192 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.192 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.192 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.192 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.817415+0000", 2024-09-12T00:05:34.192 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0088550780000000006 2024-09-12T00:05:34.192 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.192 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.192 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.193 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.825488+0000", 2024-09-12T00:05:34.193 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.008072638 2024-09-12T00:05:34.193 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.193 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.193 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.193 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.825531+0000", 2024-09-12T00:05:34.193 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3272000000000002e-05 2024-09-12T00:05:34.193 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.193 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.193 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.193 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.825566+0000", 2024-09-12T00:05:34.193 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4328000000000001e-05 2024-09-12T00:05:34.193 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.193 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.194 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.194 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.194 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.194 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3048 3.29 3:9595c6a5:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:34.194 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.934655+0000", 2024-09-12T00:05:34.194 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 13.182967388, 2024-09-12T00:05:34.194 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.031642133000000003, 2024-09-12T00:05:34.194 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.194 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.194 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.194 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.194 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.194 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.194 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3048 2024-09-12T00:05:34.194 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.195 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.195 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.195 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.195 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.934655+0000", 2024-09-12T00:05:34.195 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.195 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.195 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.195 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.195 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.934655+0000", 2024-09-12T00:05:34.195 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.195 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.195 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.195 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.195 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.934658+0000", 2024-09-12T00:05:34.196 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4970000000000001e-06 2024-09-12T00:05:34.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.196 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.196 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.196 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.940147+0000", 2024-09-12T00:05:34.196 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054891940000000002 2024-09-12T00:05:34.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.196 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.196 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.196 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.940185+0000", 2024-09-12T00:05:34.196 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8056000000000003e-05 2024-09-12T00:05:34.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.196 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.196 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.197 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.940207+0000", 2024-09-12T00:05:34.197 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2069000000000002e-05 2024-09-12T00:05:34.197 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.197 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.197 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.197 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.940392+0000", 2024-09-12T00:05:34.197 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018462200000000001 2024-09-12T00:05:34.197 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.197 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.197 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.197 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.940795+0000", 2024-09-12T00:05:34.197 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040330599999999998 2024-09-12T00:05:34.197 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.197 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.198 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:34.198 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.941226+0000", 2024-09-12T00:05:34.198 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00043093899999999997 2024-09-12T00:05:34.198 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.198 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.198 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.198 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.950900+0000", 2024-09-12T00:05:34.198 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0096740950000000006 2024-09-12T00:05:34.198 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.198 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.198 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.198 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.966201+0000", 2024-09-12T00:05:34.198 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015301069 2024-09-12T00:05:34.198 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.198 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.199 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.199 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.966254+0000", 2024-09-12T00:05:34.199 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2825000000000003e-05 2024-09-12T00:05:34.199 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.199 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.199 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.199 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.966297+0000", 2024-09-12T00:05:34.199 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2460999999999999e-05 2024-09-12T00:05:34.199 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.199 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.199 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.199 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.199 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.199 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3070 3.29 3:96d4e2a7:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:34.200 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.178172+0000", 2024-09-12T00:05:34.200 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.939450302000001, 2024-09-12T00:05:34.200 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022157735000000001, 2024-09-12T00:05:34.200 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.200 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.200 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.200 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.200 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.200 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.200 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3070 2024-09-12T00:05:34.200 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.200 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.200 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.200 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.201 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.178172+0000", 2024-09-12T00:05:34.201 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.201 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.201 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.201 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.201 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.178172+0000", 2024-09-12T00:05:34.201 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.201 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.201 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.201 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.201 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.178175+0000", 2024-09-12T00:05:34.201 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1e-06 2024-09-12T00:05:34.201 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.201 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.201 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.202 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.182708+0000", 2024-09-12T00:05:34.202 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045331640000000001 2024-09-12T00:05:34.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.202 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.202 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.202 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.182732+0000", 2024-09-12T00:05:34.202 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4034999999999999e-05 2024-09-12T00:05:34.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.202 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.202 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.202 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.182744+0000", 2024-09-12T00:05:34.202 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1892999999999999e-05 2024-09-12T00:05:34.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.202 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.203 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.203 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.182898+0000", 2024-09-12T00:05:34.203 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015410200000000001 2024-09-12T00:05:34.203 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.203 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.203 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.203 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.183288+0000", 2024-09-12T00:05:34.203 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00038976700000000001 2024-09-12T00:05:34.203 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.203 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.203 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:34.203 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.183703+0000", 2024-09-12T00:05:34.203 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041542199999999998 2024-09-12T00:05:34.203 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.204 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.204 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.204 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.195712+0000", 2024-09-12T00:05:34.204 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012008705 2024-09-12T00:05:34.204 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.204 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.204 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.204 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.200106+0000", 2024-09-12T00:05:34.204 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043939000000000001 2024-09-12T00:05:34.204 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.204 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.204 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.204 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.200212+0000", 2024-09-12T00:05:34.204 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010597700000000001 2024-09-12T00:05:34.205 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.205 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.205 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.205 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.200329+0000", 2024-09-12T00:05:34.205 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011767 2024-09-12T00:05:34.205 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.205 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.205 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.205 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.205 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.205 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3093 3.1e 3:7a820553:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:34.205 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.517971+0000", 2024-09-12T00:05:34.205 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.599651344, 2024-09-12T00:05:34.205 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022817258999999999, 2024-09-12T00:05:34.206 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.206 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.206 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.206 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.206 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.206 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.206 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3093 2024-09-12T00:05:34.206 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.206 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.206 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.206 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.206 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.517971+0000", 2024-09-12T00:05:34.206 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.206 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.207 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.207 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.207 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.517971+0000", 2024-09-12T00:05:34.207 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.207 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.207 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.207 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.207 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.517974+0000", 2024-09-12T00:05:34.207 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.05e-06 2024-09-12T00:05:34.207 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.207 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.207 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.207 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.522902+0000", 2024-09-12T00:05:34.207 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049284039999999999 2024-09-12T00:05:34.208 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.208 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.208 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.208 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.522937+0000", 2024-09-12T00:05:34.208 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4968999999999997e-05 2024-09-12T00:05:34.208 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.208 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.208 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.208 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.522953+0000", 2024-09-12T00:05:34.208 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6186999999999999e-05 2024-09-12T00:05:34.208 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.208 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.208 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.208 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.523066+0000", 2024-09-12T00:05:34.209 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000112506 2024-09-12T00:05:34.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.209 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.209 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.209 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.523296+0000", 2024-09-12T00:05:34.209 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000229903 2024-09-12T00:05:34.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.209 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.209 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:34.209 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.523530+0000", 2024-09-12T00:05:34.209 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023455700000000001 2024-09-12T00:05:34.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.209 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.210 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.210 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.534622+0000", 2024-09-12T00:05:34.210 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011092039999999999 2024-09-12T00:05:34.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.210 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.210 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.210 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540615+0000", 2024-09-12T00:05:34.210 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059929190000000002 2024-09-12T00:05:34.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.210 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.210 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.210 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540710+0000", 2024-09-12T00:05:34.210 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5239000000000001e-05 2024-09-12T00:05:34.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.211 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.211 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.211 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540788+0000", 2024-09-12T00:05:34.211 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7484999999999994e-05 2024-09-12T00:05:34.211 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.211 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.211 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.211 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.211 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.211 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3099 3.18 3:182e7247:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:34.211 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.611202+0000", 2024-09-12T00:05:34.211 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.506420106, 2024-09-12T00:05:34.211 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.023647292, 2024-09-12T00:05:34.212 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.212 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.212 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.212 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.212 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.212 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.212 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3099 2024-09-12T00:05:34.212 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.212 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.212 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.212 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.212 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.611202+0000", 2024-09-12T00:05:34.212 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.212 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.212 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.213 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.213 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.611202+0000", 2024-09-12T00:05:34.213 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.213 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.213 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.213 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.611218+0000", 2024-09-12T00:05:34.213 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5959000000000001e-05 2024-09-12T00:05:34.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.213 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.213 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.213 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.615976+0000", 2024-09-12T00:05:34.213 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047581259999999997 2024-09-12T00:05:34.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.213 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.214 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.214 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.616010+0000", 2024-09-12T00:05:34.214 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3515e-05 2024-09-12T00:05:34.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.214 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.214 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.214 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.616034+0000", 2024-09-12T00:05:34.214 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4956e-05 2024-09-12T00:05:34.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.214 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.214 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.214 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.616134+0000", 2024-09-12T00:05:34.214 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9114e-05 2024-09-12T00:05:34.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.215 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.215 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op must wait for map", 2024-09-12T00:05:34.215 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.616140+0000", 2024-09-12T00:05:34.215 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4110000000000001e-06 2024-09-12T00:05:34.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.215 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.215 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.215 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.619890+0000", 2024-09-12T00:05:34.215 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037501169999999999 2024-09-12T00:05:34.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.215 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.215 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.215 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.620108+0000", 2024-09-12T00:05:34.215 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021770399999999999 2024-09-12T00:05:34.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.216 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.216 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:34.216 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.620327+0000", 2024-09-12T00:05:34.216 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021896799999999999 2024-09-12T00:05:34.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.216 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.216 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.216 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.633688+0000", 2024-09-12T00:05:34.216 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013361642 2024-09-12T00:05:34.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.216 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.216 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.216 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.634683+0000", 2024-09-12T00:05:34.217 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000994745 2024-09-12T00:05:34.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.217 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.217 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.217 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.634779+0000", 2024-09-12T00:05:34.217 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.6059999999999998e-05 2024-09-12T00:05:34.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.217 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.217 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.217 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.634849+0000", 2024-09-12T00:05:34.217 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9974999999999993e-05 2024-09-12T00:05:34.217 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.217 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.218 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.218 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.218 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.218 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3119 3.31 3:8fd3d951:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:34.218 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.840627+0000", 2024-09-12T00:05:34.218 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.276994609999999, 2024-09-12T00:05:34.218 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022334611000000001, 2024-09-12T00:05:34.218 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.218 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.218 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.218 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.218 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.218 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.218 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3119 2024-09-12T00:05:34.218 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.219 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.219 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.219 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.219 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.840627+0000", 2024-09-12T00:05:34.219 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.219 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.219 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.219 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.840627+0000", 2024-09-12T00:05:34.219 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.219 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.219 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.220 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.840659+0000", 2024-09-12T00:05:34.220 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1534e-05 2024-09-12T00:05:34.220 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.220 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.220 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.220 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.844903+0000", 2024-09-12T00:05:34.220 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042441659999999997 2024-09-12T00:05:34.220 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.220 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.220 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.220 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.844932+0000", 2024-09-12T00:05:34.220 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8605000000000001e-05 2024-09-12T00:05:34.220 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.220 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.221 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.221 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.844948+0000", 2024-09-12T00:05:34.221 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5914e-05 2024-09-12T00:05:34.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.221 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.221 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.221 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.845021+0000", 2024-09-12T00:05:34.221 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.339e-05 2024-09-12T00:05:34.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.221 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.221 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.221 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.845141+0000", 2024-09-12T00:05:34.221 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000119821 2024-09-12T00:05:34.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.222 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.222 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:34.222 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.845242+0000", 2024-09-12T00:05:34.222 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000101545 2024-09-12T00:05:34.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.222 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.222 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.222 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.852177+0000", 2024-09-12T00:05:34.222 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0069342809999999996 2024-09-12T00:05:34.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.222 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.222 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.223 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.862873+0000", 2024-09-12T00:05:34.223 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010696359000000001 2024-09-12T00:05:34.223 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.223 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.223 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.223 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.862921+0000", 2024-09-12T00:05:34.223 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.7793000000000001e-05 2024-09-12T00:05:34.223 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.223 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.223 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.223 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.862962+0000", 2024-09-12T00:05:34.223 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1202999999999998e-05 2024-09-12T00:05:34.223 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.224 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.224 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.224 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.224 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3123 3.3d 3:bd29fd76:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:34.224 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.893071+0000", 2024-09-12T00:05:34.224 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.224551475, 2024-09-12T00:05:34.224 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022412392999999999, 2024-09-12T00:05:34.224 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.224 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.224 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.224 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.224 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.225 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.225 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3123 2024-09-12T00:05:34.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.225 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.225 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.225 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.225 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.893071+0000", 2024-09-12T00:05:34.225 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.225 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.225 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.225 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.893071+0000", 2024-09-12T00:05:34.225 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.226 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.226 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.226 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.893073+0000", 2024-09-12T00:05:34.226 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3479999999999998e-06 2024-09-12T00:05:34.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.226 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.226 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.226 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.897186+0000", 2024-09-12T00:05:34.226 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004112709 2024-09-12T00:05:34.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.226 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.226 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.226 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.897210+0000", 2024-09-12T00:05:34.227 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4763999999999999e-05 2024-09-12T00:05:34.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.227 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.227 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.227 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.897220+0000", 2024-09-12T00:05:34.227 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3810000000000005e-06 2024-09-12T00:05:34.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.227 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.227 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.227 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.897340+0000", 2024-09-12T00:05:34.227 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012034199999999999 2024-09-12T00:05:34.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.227 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.227 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.228 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.897604+0000", 2024-09-12T00:05:34.228 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026359300000000001 2024-09-12T00:05:34.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.228 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.228 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:34.228 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.897868+0000", 2024-09-12T00:05:34.228 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026388300000000002 2024-09-12T00:05:34.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.228 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.228 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.228 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.913985+0000", 2024-09-12T00:05:34.228 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016117359000000001 2024-09-12T00:05:34.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.228 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.229 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.229 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915189+0000", 2024-09-12T00:05:34.229 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0012040250000000001 2024-09-12T00:05:34.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.229 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.229 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.229 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915349+0000", 2024-09-12T00:05:34.229 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015957999999999999 2024-09-12T00:05:34.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.229 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.229 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.229 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915483+0000", 2024-09-12T00:05:34.229 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013440899999999999 2024-09-12T00:05:34.229 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.230 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.230 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.230 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.230 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3133 3.10 e76/23 3:0bd95b9d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_172:head v 76'8, mlcod=63'6)", 2024-09-12T00:05:34.230 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.030942+0000", 2024-09-12T00:05:34.230 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.086679824999999, 2024-09-12T00:05:34.230 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024435973999999999, 2024-09-12T00:05:34.230 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.230 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.230 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.230 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.230 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.230 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.231 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.030942+0000", 2024-09-12T00:05:34.231 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.231 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.030942+0000", 2024-09-12T00:05:34.231 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.231 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.030950+0000", 2024-09-12T00:05:34.231 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0499999999999992e-06 2024-09-12T00:05:34.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.232 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039165+0000", 2024-09-12T00:05:34.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082151329999999995 2024-09-12T00:05:34.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.232 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039194+0000", 2024-09-12T00:05:34.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8425999999999999e-05 2024-09-12T00:05:34.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.232 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039210+0000", 2024-09-12T00:05:34.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5886e-05 2024-09-12T00:05:34.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.233 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.233 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.233 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039366+0000", 2024-09-12T00:05:34.233 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015638300000000001 2024-09-12T00:05:34.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.233 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.233 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.233 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039410+0000", 2024-09-12T00:05:34.233 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3958999999999997e-05 2024-09-12T00:05:34.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.233 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.233 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.233 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.055263+0000", 2024-09-12T00:05:34.234 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015852926 2024-09-12T00:05:34.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.234 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.234 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.234 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.055378+0000", 2024-09-12T00:05:34.234 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011521100000000001 2024-09-12T00:05:34.234 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.234 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.234 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.234 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.234 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3147 3.3e 3:7c719451:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:34.234 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.204783+0000", 2024-09-12T00:05:34.234 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.912838646999999, 2024-09-12T00:05:34.234 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028014297000000001, 2024-09-12T00:05:34.235 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.235 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.235 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.235 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.235 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.235 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.235 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3147 2024-09-12T00:05:34.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.235 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.235 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.235 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.235 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.204783+0000", 2024-09-12T00:05:34.235 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.236 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.236 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.236 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.204783+0000", 2024-09-12T00:05:34.236 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.236 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.236 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.236 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.204787+0000", 2024-09-12T00:05:34.236 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0759999999999996e-06 2024-09-12T00:05:34.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.236 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.236 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.237 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.210868+0000", 2024-09-12T00:05:34.237 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0060804530000000004 2024-09-12T00:05:34.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.237 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.237 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.237 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.210894+0000", 2024-09-12T00:05:34.237 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6571999999999999e-05 2024-09-12T00:05:34.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.237 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.237 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.237 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.210907+0000", 2024-09-12T00:05:34.237 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2437e-05 2024-09-12T00:05:34.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.238 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.238 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.238 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.211064+0000", 2024-09-12T00:05:34.238 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015706800000000001 2024-09-12T00:05:34.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.238 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.238 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.238 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.211461+0000", 2024-09-12T00:05:34.238 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039665300000000001 2024-09-12T00:05:34.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.238 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.238 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:34.239 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.211880+0000", 2024-09-12T00:05:34.239 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000419503 2024-09-12T00:05:34.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.239 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.239 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.226312+0000", 2024-09-12T00:05:34.239 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014432228 2024-09-12T00:05:34.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.239 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.239 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.232496+0000", 2024-09-12T00:05:34.239 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061839579999999998 2024-09-12T00:05:34.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.240 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.240 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.240 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.232677+0000", 2024-09-12T00:05:34.240 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000181132 2024-09-12T00:05:34.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.240 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.240 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.240 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.232798+0000", 2024-09-12T00:05:34.240 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120217 2024-09-12T00:05:34.240 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.240 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.240 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.241 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.241 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.241 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:34.242 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:05:34.243 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:34.244+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:34.343 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:34.344+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:34.417 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:34.417 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:34.417 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:34.417 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:34.432 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:05:34.444 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:34.444+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:34.545 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:34.544+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:34.553 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:34.553 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:34.553 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:34.553 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:34.553 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:34.567 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:05:34.646 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:34.648+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:34.691 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:34.691 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:34.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:34.691 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:34.691 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.691 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1646 3.25 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:05:34.691 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:34.691 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 61.612428246, 2024-09-12T00:05:34.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030091884999999999, 2024-09-12T00:05:34.691 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.692 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.692 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.692 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.692 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.692 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.692 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1646 2024-09-12T00:05:34.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.692 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.692 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.692 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.692 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:34.692 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.692 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.692 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.693 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:34.693 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.693 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.693 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.693 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077113+0000", 2024-09-12T00:05:34.693 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0186e-05 2024-09-12T00:05:34.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.693 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.693 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.693 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084821+0000", 2024-09-12T00:05:34.693 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077083450000000001 2024-09-12T00:05:34.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.694 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.694 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.694 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084857+0000", 2024-09-12T00:05:34.694 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6245000000000003e-05 2024-09-12T00:05:34.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.694 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.694 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.694 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084900+0000", 2024-09-12T00:05:34.694 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2369e-05 2024-09-12T00:05:34.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.695 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.695 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085058+0000", 2024-09-12T00:05:34.695 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015858199999999999 2024-09-12T00:05:34.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.695 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.695 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085307+0000", 2024-09-12T00:05:34.695 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024867999999999998 2024-09-12T00:05:34.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.695 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:34.695 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086107+0000", 2024-09-12T00:05:34.696 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00080040099999999996 2024-09-12T00:05:34.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.696 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.696 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.696 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.100477+0000", 2024-09-12T00:05:34.696 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014369508 2024-09-12T00:05:34.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.696 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.696 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.696 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107016+0000", 2024-09-12T00:05:34.696 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006538894 2024-09-12T00:05:34.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.696 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.697 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.697 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107121+0000", 2024-09-12T00:05:34.697 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105284 2024-09-12T00:05:34.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.697 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.697 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.697 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107194+0000", 2024-09-12T00:05:34.697 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3391000000000003e-05 2024-09-12T00:05:34.697 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.697 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.697 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.698 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.698 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1917 3.1 3:829295ac:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.4_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:05:34.698 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:34.698 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 59.524344765999999, 2024-09-12T00:05:34.698 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021401453000000001, 2024-09-12T00:05:34.698 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.698 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.698 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.698 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.698 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.698 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.698 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1917 2024-09-12T00:05:34.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.698 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.699 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.699 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.699 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:34.699 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.699 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.699 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.699 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:34.699 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.699 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.699 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.699 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165188+0000", 2024-09-12T00:05:34.699 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5409999999999999e-06 2024-09-12T00:05:34.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.700 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.700 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169353+0000", 2024-09-12T00:05:34.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00416446 2024-09-12T00:05:34.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.700 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.700 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169380+0000", 2024-09-12T00:05:34.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6919000000000001e-05 2024-09-12T00:05:34.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169392+0000", 2024-09-12T00:05:34.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1967000000000001e-05 2024-09-12T00:05:34.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169519+0000", 2024-09-12T00:05:34.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012686199999999999 2024-09-12T00:05:34.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169789+0000", 2024-09-12T00:05:34.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027062700000000001 2024-09-12T00:05:34.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:34.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.170614+0000", 2024-09-12T00:05:34.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00082475799999999998 2024-09-12T00:05:34.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.183665+0000", 2024-09-12T00:05:34.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013051269000000001 2024-09-12T00:05:34.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.702 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.702 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186367+0000", 2024-09-12T00:05:34.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002701789 2024-09-12T00:05:34.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186485+0000", 2024-09-12T00:05:34.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011763400000000001 2024-09-12T00:05:34.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186587+0000", 2024-09-12T00:05:34.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010262700000000001 2024-09-12T00:05:34.703 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.703 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.703 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.704 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2718 3.4 3:20fe36bb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:34.704 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:34.704 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 46.903950088000002, 2024-09-12T00:05:34.704 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027867928, 2024-09-12T00:05:34.704 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.704 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.704 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.704 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.704 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.704 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.704 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2718 2024-09-12T00:05:34.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.705 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.705 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.705 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:34.705 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.705 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.705 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:34.705 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.705 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.706 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785584+0000", 2024-09-12T00:05:34.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.056e-06 2024-09-12T00:05:34.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.706 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.706 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792023+0000", 2024-09-12T00:05:34.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064398069999999996 2024-09-12T00:05:34.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.706 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.706 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792058+0000", 2024-09-12T00:05:34.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5018000000000003e-05 2024-09-12T00:05:34.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.706 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792078+0000", 2024-09-12T00:05:34.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9862000000000001e-05 2024-09-12T00:05:34.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792248+0000", 2024-09-12T00:05:34.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017006399999999999 2024-09-12T00:05:34.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792660+0000", 2024-09-12T00:05:34.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041189500000000001 2024-09-12T00:05:34.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.708 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.708 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:34.708 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793081+0000", 2024-09-12T00:05:34.708 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000420395 2024-09-12T00:05:34.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.708 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.708 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.708 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808422+0000", 2024-09-12T00:05:34.708 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015341626000000001 2024-09-12T00:05:34.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.708 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.708 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.708 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813192+0000", 2024-09-12T00:05:34.708 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047701799999999997 2024-09-12T00:05:34.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.709 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.709 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.709 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813339+0000", 2024-09-12T00:05:34.709 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014643800000000001 2024-09-12T00:05:34.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.709 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.709 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.709 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813449+0000", 2024-09-12T00:05:34.709 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010958700000000001 2024-09-12T00:05:34.709 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.709 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.709 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.710 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.710 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.710 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2719 3.1 3:83b62cc7:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:34.710 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:34.710 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 46.895442651000003, 2024-09-12T00:05:34.710 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021687128999999999, 2024-09-12T00:05:34.710 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.710 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.710 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.710 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.710 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.710 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.710 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2719 2024-09-12T00:05:34.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.711 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.711 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.711 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.711 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:34.711 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.711 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.711 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.711 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:34.711 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.711 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.711 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794091+0000", 2024-09-12T00:05:34.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0630000000000002e-06 2024-09-12T00:05:34.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800194+0000", 2024-09-12T00:05:34.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061025089999999999 2024-09-12T00:05:34.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800234+0000", 2024-09-12T00:05:34.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0114999999999998e-05 2024-09-12T00:05:34.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.713 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.713 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800255+0000", 2024-09-12T00:05:34.713 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1548000000000001e-05 2024-09-12T00:05:34.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.713 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.713 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.713 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800400+0000", 2024-09-12T00:05:34.713 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014438499999999999 2024-09-12T00:05:34.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.713 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.713 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.713 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800654+0000", 2024-09-12T00:05:34.713 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025430500000000003 2024-09-12T00:05:34.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.714 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.714 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:34.714 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800908+0000", 2024-09-12T00:05:34.714 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025422800000000001 2024-09-12T00:05:34.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.714 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.714 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.714 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.814197+0000", 2024-09-12T00:05:34.714 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013289216 2024-09-12T00:05:34.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.714 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.714 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.714 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815578+0000", 2024-09-12T00:05:34.714 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00138079 2024-09-12T00:05:34.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.715 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.715 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.715 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815704+0000", 2024-09-12T00:05:34.715 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012551500000000001 2024-09-12T00:05:34.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.715 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.715 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.715 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815775+0000", 2024-09-12T00:05:34.715 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1454999999999999e-05 2024-09-12T00:05:34.715 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.715 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.715 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.716 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.716 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.716 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2736 3.25 3:a750a681:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:34.716 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:34.716 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 46.714177726000003, 2024-09-12T00:05:34.716 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025701234999999999, 2024-09-12T00:05:34.716 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.716 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.716 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.716 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.716 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.716 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.717 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2736 2024-09-12T00:05:34.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.717 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.717 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.717 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.717 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:34.717 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.717 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.717 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.717 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:34.717 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.717 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.717 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975357+0000", 2024-09-12T00:05:34.718 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9389999999999999e-06 2024-09-12T00:05:34.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979365+0000", 2024-09-12T00:05:34.718 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040076679999999998 2024-09-12T00:05:34.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979402+0000", 2024-09-12T00:05:34.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7557e-05 2024-09-12T00:05:34.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.719 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.719 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979419+0000", 2024-09-12T00:05:34.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7203000000000001e-05 2024-09-12T00:05:34.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.719 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.719 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979543+0000", 2024-09-12T00:05:34.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000123423 2024-09-12T00:05:34.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.719 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.720 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979784+0000", 2024-09-12T00:05:34.720 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024097800000000001 2024-09-12T00:05:34.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.720 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.720 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:34.720 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980013+0000", 2024-09-12T00:05:34.720 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022881999999999999 2024-09-12T00:05:34.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.720 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.720 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.720 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.999860+0000", 2024-09-12T00:05:34.720 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019847908000000001 2024-09-12T00:05:34.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.721 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.721 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.721 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000741+0000", 2024-09-12T00:05:34.721 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00088041499999999995 2024-09-12T00:05:34.721 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.721 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.721 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.721 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000915+0000", 2024-09-12T00:05:34.721 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017460300000000001 2024-09-12T00:05:34.721 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.721 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.721 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.721 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.001054+0000", 2024-09-12T00:05:34.721 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013872099999999999 2024-09-12T00:05:34.721 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.722 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.722 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.722 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.722 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2737 3.25 3:a794c975:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:34.722 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:34.722 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 46.704164919999997, 2024-09-12T00:05:34.722 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022562862999999999, 2024-09-12T00:05:34.722 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.722 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.722 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.722 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.722 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.722 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.723 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2737 2024-09-12T00:05:34.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.723 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.723 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.723 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:34.723 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.723 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.723 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:34.723 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.724 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.724 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985368+0000", 2024-09-12T00:05:34.724 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.323e-06 2024-09-12T00:05:34.724 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.724 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.724 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.724 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990209+0000", 2024-09-12T00:05:34.724 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004840446 2024-09-12T00:05:34.724 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.724 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.724 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.725 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990255+0000", 2024-09-12T00:05:34.725 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6526999999999997e-05 2024-09-12T00:05:34.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.725 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.725 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.725 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990283+0000", 2024-09-12T00:05:34.725 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7631e-05 2024-09-12T00:05:34.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.725 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.725 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.725 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990445+0000", 2024-09-12T00:05:34.725 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016238400000000001 2024-09-12T00:05:34.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.725 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.726 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.726 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990732+0000", 2024-09-12T00:05:34.726 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028698299999999999 2024-09-12T00:05:34.726 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.726 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.726 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:34.726 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.991001+0000", 2024-09-12T00:05:34.726 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026869099999999999 2024-09-12T00:05:34.726 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.726 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.726 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.726 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007077+0000", 2024-09-12T00:05:34.726 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016076686999999999 2024-09-12T00:05:34.726 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.727 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.727 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.727 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007761+0000", 2024-09-12T00:05:34.727 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00068366399999999995 2024-09-12T00:05:34.727 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.727 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.727 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.727 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007860+0000", 2024-09-12T00:05:34.727 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8513999999999999e-05 2024-09-12T00:05:34.727 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.727 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.727 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.727 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007929+0000", 2024-09-12T00:05:34.727 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9012999999999998e-05 2024-09-12T00:05:34.728 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.728 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.728 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.728 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.728 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.728 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2751 3.4 3:20d2ffb1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:34.728 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.134356+0000", 2024-09-12T00:05:34.728 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 46.555175136999999, 2024-09-12T00:05:34.728 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020400522000000001, 2024-09-12T00:05:34.728 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.728 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.728 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.728 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.729 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.729 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.729 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2751 2024-09-12T00:05:34.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.729 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.729 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.729 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.729 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.134356+0000", 2024-09-12T00:05:34.729 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.729 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.729 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.729 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.134356+0000", 2024-09-12T00:05:34.729 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.730 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.730 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.730 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.730 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.134359+0000", 2024-09-12T00:05:34.730 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9900000000000002e-06 2024-09-12T00:05:34.730 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.730 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.730 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.730 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138490+0000", 2024-09-12T00:05:34.730 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041315609999999997 2024-09-12T00:05:34.730 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.730 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.731 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.731 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138524+0000", 2024-09-12T00:05:34.731 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3868000000000002e-05 2024-09-12T00:05:34.731 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.731 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.731 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.731 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138544+0000", 2024-09-12T00:05:34.731 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9539e-05 2024-09-12T00:05:34.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.732 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.732 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.732 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138697+0000", 2024-09-12T00:05:34.732 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015332400000000001 2024-09-12T00:05:34.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.732 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.732 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.732 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138931+0000", 2024-09-12T00:05:34.732 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023418700000000001 2024-09-12T00:05:34.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.732 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.732 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:34.733 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.139162+0000", 2024-09-12T00:05:34.733 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000230943 2024-09-12T00:05:34.733 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.733 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.733 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.733 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.149454+0000", 2024-09-12T00:05:34.733 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010291560999999999 2024-09-12T00:05:34.733 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.733 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.733 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.733 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.153905+0000", 2024-09-12T00:05:34.733 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004451666 2024-09-12T00:05:34.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.734 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.734 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.734 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154405+0000", 2024-09-12T00:05:34.734 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00049978100000000003 2024-09-12T00:05:34.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.734 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.734 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.734 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154756+0000", 2024-09-12T00:05:34.735 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000351102 2024-09-12T00:05:34.735 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.735 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.735 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.735 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.735 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.735 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2755 3.25 3:a666dbcf:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:34.735 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.181692+0000", 2024-09-12T00:05:34.735 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 46.507838722000002, 2024-09-12T00:05:34.735 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020464659, 2024-09-12T00:05:34.735 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.735 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.735 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.736 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.736 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.736 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.736 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2755 2024-09-12T00:05:34.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.736 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.736 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.736 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.736 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.181692+0000", 2024-09-12T00:05:34.736 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.737 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.737 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.737 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.737 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.181692+0000", 2024-09-12T00:05:34.737 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.737 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.737 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.737 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.737 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.181695+0000", 2024-09-12T00:05:34.737 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0800000000000002e-06 2024-09-12T00:05:34.737 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.737 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.738 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.738 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185668+0000", 2024-09-12T00:05:34.738 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039727970000000001 2024-09-12T00:05:34.738 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.738 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.738 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.738 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185699+0000", 2024-09-12T00:05:34.738 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1424999999999998e-05 2024-09-12T00:05:34.738 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.738 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.738 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.738 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185722+0000", 2024-09-12T00:05:34.738 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2972e-05 2024-09-12T00:05:34.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.739 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.739 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.739 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185860+0000", 2024-09-12T00:05:34.739 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000138016 2024-09-12T00:05:34.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.739 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.739 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.739 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.186096+0000", 2024-09-12T00:05:34.739 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023611899999999999 2024-09-12T00:05:34.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.739 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.739 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:34.739 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.186318+0000", 2024-09-12T00:05:34.740 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000221177 2024-09-12T00:05:34.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.740 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.740 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.740 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.199301+0000", 2024-09-12T00:05:34.740 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012983949999999999 2024-09-12T00:05:34.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.740 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.740 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.740 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.201991+0000", 2024-09-12T00:05:34.741 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026896889999999999 2024-09-12T00:05:34.741 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.741 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.741 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.741 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.202083+0000", 2024-09-12T00:05:34.741 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1598e-05 2024-09-12T00:05:34.741 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.741 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.741 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.741 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.202157+0000", 2024-09-12T00:05:34.741 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3836000000000003e-05 2024-09-12T00:05:34.741 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.741 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.742 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.742 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.742 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.742 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2962 3.18 e75/23 3:1b55431a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_1:head v 75'6, mlcod=63'4)", 2024-09-12T00:05:34.742 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:19.990870+0000", 2024-09-12T00:05:34.742 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.698660736000001, 2024-09-12T00:05:34.742 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018164309999999999, 2024-09-12T00:05:34.742 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.742 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.742 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.742 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.742 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.742 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.742 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990870+0000", 2024-09-12T00:05:34.743 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.743 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.743 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.743 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.743 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990870+0000", 2024-09-12T00:05:34.743 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.743 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.743 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.743 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.743 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990873+0000", 2024-09-12T00:05:34.744 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3799999999999998e-06 2024-09-12T00:05:34.744 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.744 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.744 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.744 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995189+0000", 2024-09-12T00:05:34.744 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004315859 2024-09-12T00:05:34.744 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.744 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.744 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.744 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995232+0000", 2024-09-12T00:05:34.744 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2636000000000003e-05 2024-09-12T00:05:34.744 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.745 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.745 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.745 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995249+0000", 2024-09-12T00:05:34.745 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7563000000000001e-05 2024-09-12T00:05:34.745 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.745 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.745 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.745 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995357+0000", 2024-09-12T00:05:34.745 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010737 2024-09-12T00:05:34.745 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.745 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.745 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.745 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995386+0000", 2024-09-12T00:05:34.745 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8895999999999999e-05 2024-09-12T00:05:34.746 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.746 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.746 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.746 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.008964+0000", 2024-09-12T00:05:34.746 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013578209000000001 2024-09-12T00:05:34.746 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.746 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.746 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.746 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.009034+0000", 2024-09-12T00:05:34.746 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.0396999999999997e-05 2024-09-12T00:05:34.746 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.747 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.747 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.747 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.747 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.747 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2964 3.24 3:26c83ec0:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:34.747 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:34.747 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.684115924, 2024-09-12T00:05:34.747 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028979713000000001, 2024-09-12T00:05:34.747 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.747 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.747 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.747 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.747 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.747 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.748 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2964 2024-09-12T00:05:34.748 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.748 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.748 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.748 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.748 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:34.748 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.748 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.748 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.748 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.748 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:34.748 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.748 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.748 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.749 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.749 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005417+0000", 2024-09-12T00:05:34.749 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2450000000000001e-06 2024-09-12T00:05:34.749 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.749 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.749 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.749 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010885+0000", 2024-09-12T00:05:34.749 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054684809999999999 2024-09-12T00:05:34.749 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.749 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.749 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.749 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010901+0000", 2024-09-12T00:05:34.749 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5097e-05 2024-09-12T00:05:34.750 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.750 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.750 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.750 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010908+0000", 2024-09-12T00:05:34.750 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7419999999999997e-06 2024-09-12T00:05:34.750 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.750 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.750 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.750 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010968+0000", 2024-09-12T00:05:34.750 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.9837000000000003e-05 2024-09-12T00:05:34.750 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.750 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.750 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.750 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011082+0000", 2024-09-12T00:05:34.751 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011357399999999999 2024-09-12T00:05:34.751 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.751 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.751 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:34.751 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011174+0000", 2024-09-12T00:05:34.751 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2703999999999999e-05 2024-09-12T00:05:34.751 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.751 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.751 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.751 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.021639+0000", 2024-09-12T00:05:34.751 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010464641 2024-09-12T00:05:34.751 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.751 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.751 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.752 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034210+0000", 2024-09-12T00:05:34.752 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012570463 2024-09-12T00:05:34.752 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.752 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.752 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.752 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034300+0000", 2024-09-12T00:05:34.752 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0691000000000003e-05 2024-09-12T00:05:34.752 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.752 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.752 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.752 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034394+0000", 2024-09-12T00:05:34.752 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4238000000000001e-05 2024-09-12T00:05:34.752 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.753 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.753 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.753 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.753 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.753 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2968 3.25 3:a7d7195d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:34.753 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.046591+0000", 2024-09-12T00:05:34.753 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.642939821000001, 2024-09-12T00:05:34.753 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019137155999999999, 2024-09-12T00:05:34.753 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.753 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.753 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.753 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.753 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.753 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.754 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2968 2024-09-12T00:05:34.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.754 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.754 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.754 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.754 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.046591+0000", 2024-09-12T00:05:34.754 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.754 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.754 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.754 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.046591+0000", 2024-09-12T00:05:34.754 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.754 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.755 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.755 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.046594+0000", 2024-09-12T00:05:34.755 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0759999999999999e-06 2024-09-12T00:05:34.755 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.755 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.755 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.755 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.050723+0000", 2024-09-12T00:05:34.755 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041287700000000004 2024-09-12T00:05:34.755 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.755 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.755 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.755 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.050749+0000", 2024-09-12T00:05:34.755 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5958000000000001e-05 2024-09-12T00:05:34.755 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.756 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.756 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.756 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.050760+0000", 2024-09-12T00:05:34.756 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1367e-05 2024-09-12T00:05:34.756 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.756 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.756 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.756 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.050855+0000", 2024-09-12T00:05:34.756 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5043999999999993e-05 2024-09-12T00:05:34.756 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.756 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.756 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.756 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.051009+0000", 2024-09-12T00:05:34.757 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015416799999999999 2024-09-12T00:05:34.757 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.757 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.757 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:34.757 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.051169+0000", 2024-09-12T00:05:34.757 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000159858 2024-09-12T00:05:34.757 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.757 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.757 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.757 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.057181+0000", 2024-09-12T00:05:34.757 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006011438 2024-09-12T00:05:34.757 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.757 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.757 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.758 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.065613+0000", 2024-09-12T00:05:34.758 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0084321569999999992 2024-09-12T00:05:34.758 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.758 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.758 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.758 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.065670+0000", 2024-09-12T00:05:34.758 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7089000000000002e-05 2024-09-12T00:05:34.758 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.758 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.758 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.758 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.065728+0000", 2024-09-12T00:05:34.758 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8230999999999999e-05 2024-09-12T00:05:34.758 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.759 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.759 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.759 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.759 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.759 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3052 3.32 3:4d6db9ea:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:34.759 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:34.759 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 13.709869297999999, 2024-09-12T00:05:34.759 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028091277000000001, 2024-09-12T00:05:34.759 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.759 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.759 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.759 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.759 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.760 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.760 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3052 2024-09-12T00:05:34.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.760 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.760 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.760 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.760 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:34.760 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.760 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.760 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.760 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:34.760 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.761 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.761 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.761 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.761 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979664+0000", 2024-09-12T00:05:34.761 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:05:34.761 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.761 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.761 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.761 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986918+0000", 2024-09-12T00:05:34.761 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0072537110000000004 2024-09-12T00:05:34.761 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.761 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.761 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.762 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986956+0000", 2024-09-12T00:05:34.762 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8111999999999997e-05 2024-09-12T00:05:34.762 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.762 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.762 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.762 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986975+0000", 2024-09-12T00:05:34.762 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9245999999999998e-05 2024-09-12T00:05:34.762 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.762 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.762 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.762 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987159+0000", 2024-09-12T00:05:34.762 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000183828 2024-09-12T00:05:34.762 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.762 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.763 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.763 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987552+0000", 2024-09-12T00:05:34.763 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039349699999999998 2024-09-12T00:05:34.763 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.763 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.763 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:34.763 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987943+0000", 2024-09-12T00:05:34.763 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000390579 2024-09-12T00:05:34.763 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.763 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.763 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.763 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.999384+0000", 2024-09-12T00:05:34.763 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011441563 2024-09-12T00:05:34.763 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.763 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.764 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.764 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007634+0000", 2024-09-12T00:05:34.764 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082496240000000005 2024-09-12T00:05:34.764 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.764 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.764 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.764 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007699+0000", 2024-09-12T00:05:34.764 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5089e-05 2024-09-12T00:05:34.764 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.764 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.764 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.764 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007753+0000", 2024-09-12T00:05:34.764 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3588000000000003e-05 2024-09-12T00:05:34.764 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.765 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.765 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.765 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.765 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.765 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3064 3.4 3:209c6609:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:34.765 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:34.765 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 13.577554020000001, 2024-09-12T00:05:34.765 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024628305999999999, 2024-09-12T00:05:34.765 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.765 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.765 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.765 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.765 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.766 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.766 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3064 2024-09-12T00:05:34.766 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.766 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.766 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.766 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.766 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:34.766 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.766 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.766 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.766 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.766 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:34.766 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.767 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.767 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.767 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.768 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111980+0000", 2024-09-12T00:05:34.768 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.005e-06 2024-09-12T00:05:34.768 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.768 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.768 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.768 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116464+0000", 2024-09-12T00:05:34.768 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044839210000000001 2024-09-12T00:05:34.768 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.768 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.768 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.768 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116490+0000", 2024-09-12T00:05:34.768 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6690999999999999e-05 2024-09-12T00:05:34.769 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.769 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.769 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.769 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116504+0000", 2024-09-12T00:05:34.769 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4109e-05 2024-09-12T00:05:34.769 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.769 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.769 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.769 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116639+0000", 2024-09-12T00:05:34.769 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013427 2024-09-12T00:05:34.769 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.769 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.770 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.770 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116931+0000", 2024-09-12T00:05:34.770 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000292603 2024-09-12T00:05:34.770 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.770 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.770 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:34.770 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.117174+0000", 2024-09-12T00:05:34.770 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024240700000000001 2024-09-12T00:05:34.770 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.770 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.770 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.770 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126449+0000", 2024-09-12T00:05:34.770 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0092748699999999993 2024-09-12T00:05:34.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.771 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.771 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.771 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136438+0000", 2024-09-12T00:05:34.771 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099898539999999994 2024-09-12T00:05:34.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.771 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.771 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.771 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136532+0000", 2024-09-12T00:05:34.771 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3898000000000001e-05 2024-09-12T00:05:34.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.772 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.772 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.772 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136605+0000", 2024-09-12T00:05:34.772 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2677999999999998e-05 2024-09-12T00:05:34.772 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.772 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.772 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.772 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.772 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.772 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3094 3.33 3:cfcc7f7f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:34.772 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.540440+0000", 2024-09-12T00:05:34.772 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 13.149090897000001, 2024-09-12T00:05:34.772 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021132270000000002, 2024-09-12T00:05:34.773 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.773 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.773 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.773 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.773 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.773 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.773 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3094 2024-09-12T00:05:34.773 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.773 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.773 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.773 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.773 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540440+0000", 2024-09-12T00:05:34.773 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.774 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.774 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.774 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.774 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540440+0000", 2024-09-12T00:05:34.774 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.774 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.774 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.774 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.774 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540442+0000", 2024-09-12T00:05:34.774 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9599999999999999e-06 2024-09-12T00:05:34.774 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.774 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.775 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.775 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545099+0000", 2024-09-12T00:05:34.775 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046570359999999998 2024-09-12T00:05:34.776 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.776 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.776 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.776 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545122+0000", 2024-09-12T00:05:34.776 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3485999999999998e-05 2024-09-12T00:05:34.776 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.776 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.776 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.776 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545135+0000", 2024-09-12T00:05:34.776 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3073e-05 2024-09-12T00:05:34.776 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.776 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.776 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.777 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545252+0000", 2024-09-12T00:05:34.777 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011621299999999999 2024-09-12T00:05:34.777 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.777 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.777 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.777 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545450+0000", 2024-09-12T00:05:34.777 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000198474 2024-09-12T00:05:34.777 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.777 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.777 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:34.777 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545580+0000", 2024-09-12T00:05:34.777 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013033899999999999 2024-09-12T00:05:34.778 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.778 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.778 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.778 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.552356+0000", 2024-09-12T00:05:34.778 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0067756240000000001 2024-09-12T00:05:34.778 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.778 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.778 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.778 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.560831+0000", 2024-09-12T00:05:34.778 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0084745440000000005 2024-09-12T00:05:34.778 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.778 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.778 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.779 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.561038+0000", 2024-09-12T00:05:34.779 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000207565 2024-09-12T00:05:34.779 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.779 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.779 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.779 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.561572+0000", 2024-09-12T00:05:34.779 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00053395600000000004 2024-09-12T00:05:34.779 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.779 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.779 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.779 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.779 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.779 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3097 3.33 3:cc1991a3:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:34.780 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.588213+0000", 2024-09-12T00:05:34.780 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 13.101318108999999, 2024-09-12T00:05:34.780 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021968250000000002, 2024-09-12T00:05:34.780 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.780 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.780 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.780 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.780 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.780 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.781 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3097 2024-09-12T00:05:34.781 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.781 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.781 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.781 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.781 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.588213+0000", 2024-09-12T00:05:34.781 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.781 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.781 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.781 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.781 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.588213+0000", 2024-09-12T00:05:34.781 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.782 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.782 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.782 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.782 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.588215+0000", 2024-09-12T00:05:34.782 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7049999999999999e-06 2024-09-12T00:05:34.782 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.782 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.782 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.782 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592148+0000", 2024-09-12T00:05:34.782 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039329639999999997 2024-09-12T00:05:34.782 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.782 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.782 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.783 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592173+0000", 2024-09-12T00:05:34.783 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4596999999999998e-05 2024-09-12T00:05:34.783 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.783 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.783 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.783 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592188+0000", 2024-09-12T00:05:34.783 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4994000000000001e-05 2024-09-12T00:05:34.783 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.783 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.783 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.783 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592372+0000", 2024-09-12T00:05:34.783 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018397899999999999 2024-09-12T00:05:34.783 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.784 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.784 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.784 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592639+0000", 2024-09-12T00:05:34.784 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026700299999999998 2024-09-12T00:05:34.784 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.784 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.784 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:34.784 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592916+0000", 2024-09-12T00:05:34.784 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027759300000000002 2024-09-12T00:05:34.784 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.784 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.784 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.785 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.602239+0000", 2024-09-12T00:05:34.785 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0093227550000000003 2024-09-12T00:05:34.785 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.785 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.785 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.785 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.609997+0000", 2024-09-12T00:05:34.785 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077576390000000002 2024-09-12T00:05:34.785 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.785 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.785 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.786 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.610109+0000", 2024-09-12T00:05:34.786 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000111753 2024-09-12T00:05:34.786 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.786 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.786 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.786 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.610181+0000", 2024-09-12T00:05:34.786 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2268000000000007e-05 2024-09-12T00:05:34.786 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.786 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.786 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.786 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.786 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.786 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3107 3.25 3:a6170c4d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:34.787 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.700176+0000", 2024-09-12T00:05:34.787 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.98935479, 2024-09-12T00:05:34.787 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018099869000000001, 2024-09-12T00:05:34.787 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.787 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.787 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.787 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.787 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.787 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.787 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3107 2024-09-12T00:05:34.787 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.787 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.787 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.788 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.788 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.700176+0000", 2024-09-12T00:05:34.788 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.788 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.788 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.788 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.788 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.700176+0000", 2024-09-12T00:05:34.788 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.788 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.788 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.788 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.788 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.700179+0000", 2024-09-12T00:05:34.788 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8760000000000001e-06 2024-09-12T00:05:34.788 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.789 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.789 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.789 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704197+0000", 2024-09-12T00:05:34.789 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040179689999999997 2024-09-12T00:05:34.789 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.789 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.789 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.789 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704226+0000", 2024-09-12T00:05:34.789 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8943000000000001e-05 2024-09-12T00:05:34.789 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.789 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.789 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.789 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704238+0000", 2024-09-12T00:05:34.790 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1911e-05 2024-09-12T00:05:34.790 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.790 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.790 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.790 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704344+0000", 2024-09-12T00:05:34.790 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000106259 2024-09-12T00:05:34.790 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.790 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.790 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.790 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704582+0000", 2024-09-12T00:05:34.790 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000238371 2024-09-12T00:05:34.790 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.791 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.791 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:34.791 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704823+0000", 2024-09-12T00:05:34.791 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000240304 2024-09-12T00:05:34.791 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.791 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.791 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.791 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.716320+0000", 2024-09-12T00:05:34.791 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011497965000000001 2024-09-12T00:05:34.791 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.791 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.791 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.791 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.718165+0000", 2024-09-12T00:05:34.791 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00184453 2024-09-12T00:05:34.792 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.792 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.792 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.792 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.718238+0000", 2024-09-12T00:05:34.792 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2847000000000002e-05 2024-09-12T00:05:34.792 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.792 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.792 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.792 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.718276+0000", 2024-09-12T00:05:34.792 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7894e-05 2024-09-12T00:05:34.792 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.793 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.793 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.793 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.793 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.793 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3125 3.12 3:495b0235:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:34.793 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:34.793 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.773760015000001, 2024-09-12T00:05:34.793 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030616648999999999, 2024-09-12T00:05:34.793 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.793 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.793 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.793 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.794 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.794 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.794 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3125 2024-09-12T00:05:34.794 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.794 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.794 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.794 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.794 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:34.794 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.794 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.794 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.794 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.794 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:34.795 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.795 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.795 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.795 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.795 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915773+0000", 2024-09-12T00:05:34.795 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2800000000000002e-06 2024-09-12T00:05:34.795 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.795 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.795 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.795 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919856+0000", 2024-09-12T00:05:34.795 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004082713 2024-09-12T00:05:34.795 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.796 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.796 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.796 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919879+0000", 2024-09-12T00:05:34.796 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3782e-05 2024-09-12T00:05:34.796 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.796 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.796 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.796 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919891+0000", 2024-09-12T00:05:34.796 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1440000000000001e-05 2024-09-12T00:05:34.796 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.796 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.796 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.796 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920037+0000", 2024-09-12T00:05:34.797 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014562700000000001 2024-09-12T00:05:34.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.797 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.797 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.797 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920280+0000", 2024-09-12T00:05:34.797 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000243274 2024-09-12T00:05:34.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.797 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.797 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:34.797 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920527+0000", 2024-09-12T00:05:34.797 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024692699999999998 2024-09-12T00:05:34.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.797 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.798 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.798 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.932485+0000", 2024-09-12T00:05:34.798 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011957857000000001 2024-09-12T00:05:34.798 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.798 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.798 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.798 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946197+0000", 2024-09-12T00:05:34.798 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013712436999999999 2024-09-12T00:05:34.798 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.798 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.798 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.798 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946305+0000", 2024-09-12T00:05:34.799 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000107914 2024-09-12T00:05:34.799 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.799 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.799 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.799 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946387+0000", 2024-09-12T00:05:34.799 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2398000000000006e-05 2024-09-12T00:05:34.799 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.799 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.799 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.799 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.799 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.800 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3127 3.24 3:2477ff85:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:34.800 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.943043+0000", 2024-09-12T00:05:34.800 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.746487505999999, 2024-09-12T00:05:34.800 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020914724999999999, 2024-09-12T00:05:34.800 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.800 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.800 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.800 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.800 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.800 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.800 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3127 2024-09-12T00:05:34.800 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.800 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.801 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.801 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.943043+0000", 2024-09-12T00:05:34.801 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.801 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.801 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.801 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.943043+0000", 2024-09-12T00:05:34.801 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.801 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.801 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.802 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.943046+0000", 2024-09-12T00:05:34.802 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3069999999999998e-06 2024-09-12T00:05:34.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.802 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.802 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.802 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947004+0000", 2024-09-12T00:05:34.802 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039575360000000002 2024-09-12T00:05:34.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.802 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.802 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.802 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947022+0000", 2024-09-12T00:05:34.802 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7847e-05 2024-09-12T00:05:34.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.803 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.803 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947030+0000", 2024-09-12T00:05:34.803 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.5399999999999996e-06 2024-09-12T00:05:34.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.803 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.803 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947087+0000", 2024-09-12T00:05:34.803 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6496999999999998e-05 2024-09-12T00:05:34.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.803 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.804 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947251+0000", 2024-09-12T00:05:34.804 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016407499999999999 2024-09-12T00:05:34.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.804 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.804 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:34.804 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947422+0000", 2024-09-12T00:05:34.804 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017108 2024-09-12T00:05:34.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.804 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.804 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.804 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.953910+0000", 2024-09-12T00:05:34.804 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064883980000000003 2024-09-12T00:05:34.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.805 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.805 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.963872+0000", 2024-09-12T00:05:34.805 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099617839999999996 2024-09-12T00:05:34.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.805 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.805 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.963918+0000", 2024-09-12T00:05:34.805 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5692999999999998e-05 2024-09-12T00:05:34.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.805 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.806 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.963958+0000", 2024-09-12T00:05:34.806 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9968000000000001e-05 2024-09-12T00:05:34.806 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.806 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.806 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.806 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.806 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3132 3.4 3:216a5295:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:34.806 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.015391+0000", 2024-09-12T00:05:34.806 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.67413981, 2024-09-12T00:05:34.806 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022006318, 2024-09-12T00:05:34.806 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.806 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.807 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.807 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.807 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.807 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.807 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3132 2024-09-12T00:05:34.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.807 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.807 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.807 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.015391+0000", 2024-09-12T00:05:34.807 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.808 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.808 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.015391+0000", 2024-09-12T00:05:34.808 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.808 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.808 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.808 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.015394+0000", 2024-09-12T00:05:34.808 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6260000000000001e-06 2024-09-12T00:05:34.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.808 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.808 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.808 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.019828+0000", 2024-09-12T00:05:34.808 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044333109999999997 2024-09-12T00:05:34.809 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.809 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.809 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.809 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.019859+0000", 2024-09-12T00:05:34.809 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1575999999999997e-05 2024-09-12T00:05:34.809 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.809 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.809 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.809 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.019875+0000", 2024-09-12T00:05:34.809 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5875999999999998e-05 2024-09-12T00:05:34.809 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.809 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.809 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.809 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.020009+0000", 2024-09-12T00:05:34.810 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133953 2024-09-12T00:05:34.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.810 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.810 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.810 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.020264+0000", 2024-09-12T00:05:34.810 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025509000000000003 2024-09-12T00:05:34.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.810 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.810 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:34.810 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.020504+0000", 2024-09-12T00:05:34.810 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000240184 2024-09-12T00:05:34.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.810 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.811 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.811 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.031616+0000", 2024-09-12T00:05:34.811 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011111843 2024-09-12T00:05:34.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.811 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.811 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.811 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.037072+0000", 2024-09-12T00:05:34.811 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054553400000000004 2024-09-12T00:05:34.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.811 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.811 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.811 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.037271+0000", 2024-09-12T00:05:34.811 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000199199 2024-09-12T00:05:34.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.812 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.812 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.812 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.037397+0000", 2024-09-12T00:05:34.812 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012632 2024-09-12T00:05:34.812 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.812 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.812 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.812 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.812 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.812 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3134 3.24 3:2525a955:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:34.812 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:34.812 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.649683285, 2024-09-12T00:05:34.813 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025606806999999999, 2024-09-12T00:05:34.813 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:34.813 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:34.813 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:34.813 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:34.813 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:34.813 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:34.813 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3134 2024-09-12T00:05:34.813 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.813 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:34.813 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.813 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:34.813 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:34.813 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.814 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.814 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:34.814 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:34.814 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:34.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.814 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.814 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:34.814 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039850+0000", 2024-09-12T00:05:34.814 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9780000000000001e-06 2024-09-12T00:05:34.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.814 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.814 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:34.815 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045256+0000", 2024-09-12T00:05:34.815 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054058129999999998 2024-09-12T00:05:34.815 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.815 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.815 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:34.815 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045284+0000", 2024-09-12T00:05:34.815 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8065e-05 2024-09-12T00:05:34.815 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.815 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.815 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:34.815 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045297+0000", 2024-09-12T00:05:34.815 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2788e-05 2024-09-12T00:05:34.815 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.816 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.816 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:34.816 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045378+0000", 2024-09-12T00:05:34.816 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1079000000000001e-05 2024-09-12T00:05:34.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.816 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.816 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:34.816 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045530+0000", 2024-09-12T00:05:34.816 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015206099999999999 2024-09-12T00:05:34.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.816 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.816 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:34.816 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045655+0000", 2024-09-12T00:05:34.817 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012525899999999999 2024-09-12T00:05:34.817 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.817 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.817 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:34.817 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.054817+0000", 2024-09-12T00:05:34.817 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0091611049999999992 2024-09-12T00:05:34.817 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.817 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.817 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:34.817 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065354+0000", 2024-09-12T00:05:34.817 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010537625 2024-09-12T00:05:34.817 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.817 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.817 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:34.818 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065410+0000", 2024-09-12T00:05:34.818 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6141999999999999e-05 2024-09-12T00:05:34.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:34.818 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:34.818 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:34.818 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065454+0000", 2024-09-12T00:05:34.818 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3891999999999999e-05 2024-09-12T00:05:34.818 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.818 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.818 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.819 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:34.819 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:34.819 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:34.820 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:05:34.821 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:34.820+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:34.920 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:34.920+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:34.993 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:34.994 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:34.994 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:34.994 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:35.008 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:05:35.051 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:35.052+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:35.122 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:35.124+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:35.175 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:35.175 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:35.175 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:35.175 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:35.175 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:35.189 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:05:35.223 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:35.224+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:35.325 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:35.324+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:35.353 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:35.353 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:35.353 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:35.353 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:1646 3.25 e58/23 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head v 58'1, mlcod=0'0)", 2024-09-12T00:05:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 62.265686725000002, 2024-09-12T00:05:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020301987000000001, 2024-09-12T00:05:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086308+0000", 2024-09-12T00:05:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.95e-06 2024-09-12T00:05:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091174+0000", 2024-09-12T00:05:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048660559999999997 2024-09-12T00:05:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091218+0000", 2024-09-12T00:05:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4678999999999997e-05 2024-09-12T00:05:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091238+0000", 2024-09-12T00:05:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9839000000000001e-05 2024-09-12T00:05:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091396+0000", 2024-09-12T00:05:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000157396 2024-09-12T00:05:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091451+0000", 2024-09-12T00:05:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5547999999999997e-05 2024-09-12T00:05:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106474+0000", 2024-09-12T00:05:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015023287 2024-09-12T00:05:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106608+0000", 2024-09-12T00:05:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133232 2024-09-12T00:05:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2667 3.8 e63/23 3:1177e826:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_162:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.378028+0000", 2024-09-12T00:05:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 47.973964852000002, 2024-09-12T00:05:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018606185000000001, 2024-09-12T00:05:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.378028+0000", 2024-09-12T00:05:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.378028+0000", 2024-09-12T00:05:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.378031+0000", 2024-09-12T00:05:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9330000000000001e-06 2024-09-12T00:05:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383422+0000", 2024-09-12T00:05:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005391163 2024-09-12T00:05:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383455+0000", 2024-09-12T00:05:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3640999999999999e-05 2024-09-12T00:05:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383472+0000", 2024-09-12T00:05:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7005999999999999e-05 2024-09-12T00:05:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383626+0000", 2024-09-12T00:05:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015317 2024-09-12T00:05:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383691+0000", 2024-09-12T00:05:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5740000000000004e-05 2024-09-12T00:05:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396505+0000", 2024-09-12T00:05:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012813702999999999 2024-09-12T00:05:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396634+0000", 2024-09-12T00:05:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012882900000000001 2024-09-12T00:05:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2723 3.21 3:86535907:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 47.519839257999998, 2024-09-12T00:05:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021210407000000001, 2024-09-12T00:05:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2723 2024-09-12T00:05:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832157+0000", 2024-09-12T00:05:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3270000000000001e-06 2024-09-12T00:05:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837403+0000", 2024-09-12T00:05:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005246784 2024-09-12T00:05:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837439+0000", 2024-09-12T00:05:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5848e-05 2024-09-12T00:05:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837459+0000", 2024-09-12T00:05:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9585e-05 2024-09-12T00:05:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837574+0000", 2024-09-12T00:05:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000114917 2024-09-12T00:05:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837803+0000", 2024-09-12T00:05:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022967699999999999 2024-09-12T00:05:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838174+0000", 2024-09-12T00:05:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037083899999999998 2024-09-12T00:05:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848447+0000", 2024-09-12T00:05:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010272439 2024-09-12T00:05:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853191+0000", 2024-09-12T00:05:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047441109999999996 2024-09-12T00:05:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853292+0000", 2024-09-12T00:05:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000101474 2024-09-12T00:05:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853364+0000", 2024-09-12T00:05:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1406e-05 2024-09-12T00:05:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2729 3.0 e63/23 3:01c0e0c9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_214:head v 63'6, mlcod=63'4)", 2024-09-12T00:05:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.902446+0000", 2024-09-12T00:05:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 47.449546914000003, 2024-09-12T00:05:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019099029, 2024-09-12T00:05:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902446+0000", 2024-09-12T00:05:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902446+0000", 2024-09-12T00:05:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902448+0000", 2024-09-12T00:05:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.503e-06 2024-09-12T00:05:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906706+0000", 2024-09-12T00:05:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042580500000000002 2024-09-12T00:05:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906743+0000", 2024-09-12T00:05:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6637999999999997e-05 2024-09-12T00:05:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906760+0000", 2024-09-12T00:05:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6779e-05 2024-09-12T00:05:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906891+0000", 2024-09-12T00:05:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013193499999999999 2024-09-12T00:05:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906932+0000", 2024-09-12T00:05:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0980999999999999e-05 2024-09-12T00:05:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.921375+0000", 2024-09-12T00:05:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014442119999999999 2024-09-12T00:05:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.921545+0000", 2024-09-12T00:05:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017002299999999999 2024-09-12T00:05:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2736 3.25 e63/23 3:a750a681:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_221:head v 63'5, mlcod=62'3)", 2024-09-12T00:05:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.980248+0000", 2024-09-12T00:05:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 47.371744388000003, 2024-09-12T00:05:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020132552000000001, 2024-09-12T00:05:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980248+0000", 2024-09-12T00:05:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980248+0000", 2024-09-12T00:05:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980251+0000", 2024-09-12T00:05:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7329999999999999e-06 2024-09-12T00:05:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.982917+0000", 2024-09-12T00:05:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026662679999999998 2024-09-12T00:05:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.982960+0000", 2024-09-12T00:05:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3000999999999997e-05 2024-09-12T00:05:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.982985+0000", 2024-09-12T00:05:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5092e-05 2024-09-12T00:05:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.983163+0000", 2024-09-12T00:05:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000177942 2024-09-12T00:05:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.983221+0000", 2024-09-12T00:05:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7476999999999999e-05 2024-09-12T00:05:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000301+0000", 2024-09-12T00:05:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017080503 2024-09-12T00:05:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000381+0000", 2024-09-12T00:05:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9536000000000006e-05 2024-09-12T00:05:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2756 3.21 3:849c909c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_241:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.197450+0000", 2024-09-12T00:05:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 47.154542104000001, 2024-09-12T00:05:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020201090000000001, 2024-09-12T00:05:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2756 2024-09-12T00:05:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.197450+0000", 2024-09-12T00:05:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.197450+0000", 2024-09-12T00:05:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.197455+0000", 2024-09-12T00:05:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4070000000000003e-06 2024-09-12T00:05:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.202967+0000", 2024-09-12T00:05:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0055122299999999999 2024-09-12T00:05:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203001+0000", 2024-09-12T00:05:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3685e-05 2024-09-12T00:05:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203017+0000", 2024-09-12T00:05:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6622000000000001e-05 2024-09-12T00:05:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203134+0000", 2024-09-12T00:05:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117166 2024-09-12T00:05:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203389+0000", 2024-09-12T00:05:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025456200000000001 2024-09-12T00:05:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203625+0000", 2024-09-12T00:05:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000235856 2024-09-12T00:05:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.212670+0000", 2024-09-12T00:05:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0090446639999999991 2024-09-12T00:05:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.217469+0000", 2024-09-12T00:05:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047998559999999999 2024-09-12T00:05:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.217569+0000", 2024-09-12T00:05:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9753999999999994e-05 2024-09-12T00:05:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.217651+0000", 2024-09-12T00:05:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2287999999999995e-05 2024-09-12T00:05:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2969 3.b 3:d2cd1e23:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.057390+0000", 2024-09-12T00:05:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.294602485, 2024-09-12T00:05:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019453666000000001, 2024-09-12T00:05:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2969 2024-09-12T00:05:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.057390+0000", 2024-09-12T00:05:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.057390+0000", 2024-09-12T00:05:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.057393+0000", 2024-09-12T00:05:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8430000000000001e-06 2024-09-12T00:05:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062108+0000", 2024-09-12T00:05:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047149640000000003 2024-09-12T00:05:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062130+0000", 2024-09-12T00:05:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.23e-05 2024-09-12T00:05:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062141+0000", 2024-09-12T00:05:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.111e-05 2024-09-12T00:05:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062222+0000", 2024-09-12T00:05:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0486000000000002e-05 2024-09-12T00:05:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062364+0000", 2024-09-12T00:05:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014189500000000001 2024-09-12T00:05:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062496+0000", 2024-09-12T00:05:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000132182 2024-09-12T00:05:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.076301+0000", 2024-09-12T00:05:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013805128 2024-09-12T00:05:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.076652+0000", 2024-09-12T00:05:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00035156899999999998 2024-09-12T00:05:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.076734+0000", 2024-09-12T00:05:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1161000000000004e-05 2024-09-12T00:05:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.076844+0000", 2024-09-12T00:05:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110028 2024-09-12T00:05:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2971 3.2e 3:76f45d45:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.276124920999999, 2024-09-12T00:05:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022571213, 2024-09-12T00:05:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2971 2024-09-12T00:05:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075871+0000", 2024-09-12T00:05:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.467e-06 2024-09-12T00:05:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080307+0000", 2024-09-12T00:05:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044356359999999997 2024-09-12T00:05:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080346+0000", 2024-09-12T00:05:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9267999999999997e-05 2024-09-12T00:05:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080368+0000", 2024-09-12T00:05:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2603e-05 2024-09-12T00:05:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080489+0000", 2024-09-12T00:05:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0001209 2024-09-12T00:05:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080830+0000", 2024-09-12T00:05:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00034099 2024-09-12T00:05:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.081119+0000", 2024-09-12T00:05:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028860300000000001 2024-09-12T00:05:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.093241+0000", 2024-09-12T00:05:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012121609 2024-09-12T00:05:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098277+0000", 2024-09-12T00:05:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0050359710000000002 2024-09-12T00:05:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098366+0000", 2024-09-12T00:05:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9052000000000001e-05 2024-09-12T00:05:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098439+0000", 2024-09-12T00:05:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3114000000000005e-05 2024-09-12T00:05:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2996 3.21 3:872b1c12:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 15.001500183999999, 2024-09-12T00:05:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027562314000000001, 2024-09-12T00:05:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2996 2024-09-12T00:05:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350496+0000", 2024-09-12T00:05:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9160000000000003e-06 2024-09-12T00:05:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355187+0000", 2024-09-12T00:05:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046904989999999999 2024-09-12T00:05:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355223+0000", 2024-09-12T00:05:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6125999999999999e-05 2024-09-12T00:05:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355241+0000", 2024-09-12T00:05:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8686e-05 2024-09-12T00:05:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355373+0000", 2024-09-12T00:05:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013129299999999999 2024-09-12T00:05:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355619+0000", 2024-09-12T00:05:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024662700000000002 2024-09-12T00:05:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355855+0000", 2024-09-12T00:05:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023604299999999999 2024-09-12T00:05:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.367983+0000", 2024-09-12T00:05:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012127104999999999 2024-09-12T00:05:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377884+0000", 2024-09-12T00:05:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099013680000000007 2024-09-12T00:05:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377974+0000", 2024-09-12T00:05:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9932999999999994e-05 2024-09-12T00:05:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.378055+0000", 2024-09-12T00:05:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0717999999999995e-05 2024-09-12T00:05:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3016 3.21 3:876e25ab:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.592959+0000", 2024-09-12T00:05:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.759033749, 2024-09-12T00:05:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018852352999999999, 2024-09-12T00:05:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3016 2024-09-12T00:05:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.592959+0000", 2024-09-12T00:05:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.592959+0000", 2024-09-12T00:05:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.592961+0000", 2024-09-12T00:05:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7939999999999998e-06 2024-09-12T00:05:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.597664+0000", 2024-09-12T00:05:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047023550000000001 2024-09-12T00:05:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.597702+0000", 2024-09-12T00:05:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8235000000000002e-05 2024-09-12T00:05:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.597721+0000", 2024-09-12T00:05:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8442999999999999e-05 2024-09-12T00:05:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.597853+0000", 2024-09-12T00:05:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013213299999999999 2024-09-12T00:05:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.598128+0000", 2024-09-12T00:05:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000275347 2024-09-12T00:05:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.598362+0000", 2024-09-12T00:05:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023358999999999999 2024-09-12T00:05:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611029+0000", 2024-09-12T00:05:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012667487999999999 2024-09-12T00:05:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611437+0000", 2024-09-12T00:05:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000407518 2024-09-12T00:05:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611629+0000", 2024-09-12T00:05:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00019254799999999999 2024-09-12T00:05:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611811+0000", 2024-09-12T00:05:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018190200000000001 2024-09-12T00:05:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3030 3.2e 3:740afe3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.612170025999999, 2024-09-12T00:05:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.033756331000000001, 2024-09-12T00:05:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3030 2024-09-12T00:05:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739825+0000", 2024-09-12T00:05:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7920000000000001e-06 2024-09-12T00:05:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744217+0000", 2024-09-12T00:05:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043922529999999996 2024-09-12T00:05:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744243+0000", 2024-09-12T00:05:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5253e-05 2024-09-12T00:05:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744254+0000", 2024-09-12T00:05:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1430999999999999e-05 2024-09-12T00:05:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744325+0000", 2024-09-12T00:05:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1340999999999993e-05 2024-09-12T00:05:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744461+0000", 2024-09-12T00:05:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013531700000000001 2024-09-12T00:05:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744574+0000", 2024-09-12T00:05:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113513 2024-09-12T00:05:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.752813+0000", 2024-09-12T00:05:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082384750000000003 2024-09-12T00:05:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773444+0000", 2024-09-12T00:05:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020630773000000002 2024-09-12T00:05:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773510+0000", 2024-09-12T00:05:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6711000000000006e-05 2024-09-12T00:05:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773579+0000", 2024-09-12T00:05:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8472000000000004e-05 2024-09-12T00:05:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3039 3.2e 3:74587332:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.516490098, 2024-09-12T00:05:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.036215114, 2024-09-12T00:05:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3039 2024-09-12T00:05:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835507+0000", 2024-09-12T00:05:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6e-06 2024-09-12T00:05:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848930+0000", 2024-09-12T00:05:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013423242 2024-09-12T00:05:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848969+0000", 2024-09-12T00:05:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9270000000000002e-05 2024-09-12T00:05:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848991+0000", 2024-09-12T00:05:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1565000000000001e-05 2024-09-12T00:05:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849089+0000", 2024-09-12T00:05:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8408999999999999e-05 2024-09-12T00:05:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849518+0000", 2024-09-12T00:05:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042813900000000002 2024-09-12T00:05:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849897+0000", 2024-09-12T00:05:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037936600000000001 2024-09-12T00:05:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.858549+0000", 2024-09-12T00:05:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086520820000000002 2024-09-12T00:05:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871522+0000", 2024-09-12T00:05:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012973182999999999 2024-09-12T00:05:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871633+0000", 2024-09-12T00:05:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011085 2024-09-12T00:05:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871717+0000", 2024-09-12T00:05:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.4407999999999996e-05 2024-09-12T00:05:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3050 3.b 3:d26f7141:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.394877842, 2024-09-12T00:05:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022896481999999999, 2024-09-12T00:05:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3050 2024-09-12T00:05:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957117+0000", 2024-09-12T00:05:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7e-06 2024-09-12T00:05:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961673+0000", 2024-09-12T00:05:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045558059999999999 2024-09-12T00:05:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961698+0000", 2024-09-12T00:05:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5017000000000001e-05 2024-09-12T00:05:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961710+0000", 2024-09-12T00:05:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1963999999999999e-05 2024-09-12T00:05:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961785+0000", 2024-09-12T00:05:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5153000000000004e-05 2024-09-12T00:05:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961926+0000", 2024-09-12T00:05:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000141194 2024-09-12T00:05:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.962055+0000", 2024-09-12T00:05:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012882400000000001 2024-09-12T00:05:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.970716+0000", 2024-09-12T00:05:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086603610000000001 2024-09-12T00:05:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979700+0000", 2024-09-12T00:05:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.008984054 2024-09-12T00:05:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979884+0000", 2024-09-12T00:05:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184215 2024-09-12T00:05:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.980011+0000", 2024-09-12T00:05:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012719399999999999 2024-09-12T00:05:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3052 3.32 e75/23 3:4d6db9ea:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_91:head v 75'3, mlcod=62'1)", 2024-09-12T00:05:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.988152+0000", 2024-09-12T00:05:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.363840286, 2024-09-12T00:05:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019198494999999999, 2024-09-12T00:05:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.988152+0000", 2024-09-12T00:05:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.988152+0000", 2024-09-12T00:05:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.988155+0000", 2024-09-12T00:05:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.253e-06 2024-09-12T00:05:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993485+0000", 2024-09-12T00:05:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053298479999999999 2024-09-12T00:05:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993520+0000", 2024-09-12T00:05:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4393000000000001e-05 2024-09-12T00:05:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993538+0000", 2024-09-12T00:05:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8193e-05 2024-09-12T00:05:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993701+0000", 2024-09-12T00:05:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016265499999999999 2024-09-12T00:05:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993771+0000", 2024-09-12T00:05:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.0884999999999996e-05 2024-09-12T00:05:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007261+0000", 2024-09-12T00:05:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013489142000000001 2024-09-12T00:05:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007351+0000", 2024-09-12T00:05:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0125999999999997e-05 2024-09-12T00:05:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3065 3.b 3:d10bf58d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.229930222, 2024-09-12T00:05:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021843261999999999, 2024-09-12T00:05:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3065 2024-09-12T00:05:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122067+0000", 2024-09-12T00:05:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4970000000000003e-06 2024-09-12T00:05:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126931+0000", 2024-09-12T00:05:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048641090000000001 2024-09-12T00:05:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.435 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:35.435 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126973+0000", 2024-09-12T00:05:35.435 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1678999999999999e-05 2024-09-12T00:05:35.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.435 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.435 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.435 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126999+0000", 2024-09-12T00:05:35.435 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6536000000000001e-05 2024-09-12T00:05:35.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.435 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.435 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:35.435 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127118+0000", 2024-09-12T00:05:35.435 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000119373 2024-09-12T00:05:35.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.436 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.436 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:35.436 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127289+0000", 2024-09-12T00:05:35.436 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017020199999999999 2024-09-12T00:05:35.436 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.436 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.436 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:35.436 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127437+0000", 2024-09-12T00:05:35.436 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148682 2024-09-12T00:05:35.436 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.436 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.436 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:35.436 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138539+0000", 2024-09-12T00:05:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011101418 2024-09-12T00:05:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143355+0000", 2024-09-12T00:05:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048161499999999999 2024-09-12T00:05:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143777+0000", 2024-09-12T00:05:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000421896 2024-09-12T00:05:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143905+0000", 2024-09-12T00:05:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012872 2024-09-12T00:05:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3066 3.21 3:8448517d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.219984139999999, 2024-09-12T00:05:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025911652, 2024-09-12T00:05:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3066 2024-09-12T00:05:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132011+0000", 2024-09-12T00:05:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8270000000000002e-06 2024-09-12T00:05:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137934+0000", 2024-09-12T00:05:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059226119999999998 2024-09-12T00:05:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137968+0000", 2024-09-12T00:05:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3933000000000002e-05 2024-09-12T00:05:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137985+0000", 2024-09-12T00:05:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7725999999999999e-05 2024-09-12T00:05:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138084+0000", 2024-09-12T00:05:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8450999999999996e-05 2024-09-12T00:05:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138285+0000", 2024-09-12T00:05:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000201411 2024-09-12T00:05:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138510+0000", 2024-09-12T00:05:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000224551 2024-09-12T00:05:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.146242+0000", 2024-09-12T00:05:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077317649999999998 2024-09-12T00:05:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157728+0000", 2024-09-12T00:05:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011486424 2024-09-12T00:05:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157833+0000", 2024-09-12T00:05:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105234 2024-09-12T00:05:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157920+0000", 2024-09-12T00:05:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6718000000000006e-05 2024-09-12T00:05:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3111 3.2e 3:7749b0e6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.741096+0000", 2024-09-12T00:05:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 13.61089655, 2024-09-12T00:05:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019635658, 2024-09-12T00:05:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3111 2024-09-12T00:05:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.741096+0000", 2024-09-12T00:05:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.741096+0000", 2024-09-12T00:05:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.741099+0000", 2024-09-12T00:05:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0800000000000002e-06 2024-09-12T00:05:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745487+0000", 2024-09-12T00:05:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043876540000000004 2024-09-12T00:05:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745510+0000", 2024-09-12T00:05:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3099999999999999e-05 2024-09-12T00:05:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745521+0000", 2024-09-12T00:05:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0813e-05 2024-09-12T00:05:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745639+0000", 2024-09-12T00:05:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011862399999999999 2024-09-12T00:05:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745895+0000", 2024-09-12T00:05:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025625300000000001 2024-09-12T00:05:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.746140+0000", 2024-09-12T00:05:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000244467 2024-09-12T00:05:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755206+0000", 2024-09-12T00:05:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0090663250000000001 2024-09-12T00:05:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.760620+0000", 2024-09-12T00:05:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054141040000000003 2024-09-12T00:05:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.760673+0000", 2024-09-12T00:05:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2519999999999999e-05 2024-09-12T00:05:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.760732+0000", 2024-09-12T00:05:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8718000000000003e-05 2024-09-12T00:05:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3112 3.b 3:d1cf91a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 13.601267012999999, 2024-09-12T00:05:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021203475999999999, 2024-09-12T00:05:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3112 2024-09-12T00:05:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750728+0000", 2024-09-12T00:05:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.165e-06 2024-09-12T00:05:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755063+0000", 2024-09-12T00:05:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043355379999999999 2024-09-12T00:05:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755103+0000", 2024-09-12T00:05:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9962000000000001e-05 2024-09-12T00:05:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755120+0000", 2024-09-12T00:05:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6793e-05 2024-09-12T00:05:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755299+0000", 2024-09-12T00:05:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017904499999999999 2024-09-12T00:05:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755758+0000", 2024-09-12T00:05:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000458815 2024-09-12T00:05:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.756304+0000", 2024-09-12T00:05:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000546183 2024-09-12T00:05:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771518+0000", 2024-09-12T00:05:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015214236000000001 2024-09-12T00:05:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771827+0000", 2024-09-12T00:05:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000309308 2024-09-12T00:05:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771874+0000", 2024-09-12T00:05:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6119999999999999e-05 2024-09-12T00:05:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771929+0000", 2024-09-12T00:05:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5310999999999999e-05 2024-09-12T00:05:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3115 3.2e 3:75803fec:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 13.563295963, 2024-09-12T00:05:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020205041, 2024-09-12T00:05:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3115 2024-09-12T00:05:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788700+0000", 2024-09-12T00:05:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.614e-06 2024-09-12T00:05:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793576+0000", 2024-09-12T00:05:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048760920000000003 2024-09-12T00:05:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793610+0000", 2024-09-12T00:05:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4184999999999999e-05 2024-09-12T00:05:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793633+0000", 2024-09-12T00:05:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2551000000000001e-05 2024-09-12T00:05:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793750+0000", 2024-09-12T00:05:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117057 2024-09-12T00:05:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793975+0000", 2024-09-12T00:05:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022493099999999999 2024-09-12T00:05:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.794178+0000", 2024-09-12T00:05:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000202726 2024-09-12T00:05:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.803725+0000", 2024-09-12T00:05:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095470599999999996 2024-09-12T00:05:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808706+0000", 2024-09-12T00:05:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049814519999999999 2024-09-12T00:05:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808785+0000", 2024-09-12T00:05:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9160999999999996e-05 2024-09-12T00:05:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808902+0000", 2024-09-12T00:05:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000116212 2024-09-12T00:05:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3148 3.b 3:d076a555:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.214451+0000", 2024-09-12T00:05:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 13.137541349999999, 2024-09-12T00:05:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019531633999999999, 2024-09-12T00:05:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3148 2024-09-12T00:05:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.214451+0000", 2024-09-12T00:05:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.214451+0000", 2024-09-12T00:05:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.214454+0000", 2024-09-12T00:05:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.354e-06 2024-09-12T00:05:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219444+0000", 2024-09-12T00:05:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049897830000000002 2024-09-12T00:05:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219472+0000", 2024-09-12T00:05:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7421999999999999e-05 2024-09-12T00:05:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219486+0000", 2024-09-12T00:05:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4528999999999999e-05 2024-09-12T00:05:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219583+0000", 2024-09-12T00:05:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.6989000000000003e-05 2024-09-12T00:05:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219782+0000", 2024-09-12T00:05:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000198767 2024-09-12T00:05:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219999+0000", 2024-09-12T00:05:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000217068 2024-09-12T00:05:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.233084+0000", 2024-09-12T00:05:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013084910999999999 2024-09-12T00:05:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.233877+0000", 2024-09-12T00:05:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00079352600000000002 2024-09-12T00:05:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.233940+0000", 2024-09-12T00:05:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2774000000000006e-05 2024-09-12T00:05:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.233983+0000", 2024-09-12T00:05:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2511e-05 2024-09-12T00:05:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:35.468 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:35.470 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:05:35.472 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:35.468+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:35.571 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:35.572+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:35.607 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:35.607 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:35.608 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:05:35.608 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:35.622 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:05:35.633 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:05:35.672 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:35.672+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:35.773 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:35.772+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:35.787 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:35.787 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:35.787 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:05:35.787 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:05:35.787 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:35.805 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:05:35.874 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:35.872+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:35.975 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:35.976+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:35.979 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:35.979 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:05:35.979 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:05:35.979 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:05:35.979 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.980 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:05:35.980 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:05:35.980 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 124.647550817, 2024-09-12T00:05:35.980 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.027441031000000001, 2024-09-12T00:05:35.980 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:35.980 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:35.980 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.980 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:35.980 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:35.980 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:35.980 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:05:35.981 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.981 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:35.981 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.981 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:35.981 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:05:35.981 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:35.981 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.981 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.981 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:35.981 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:05:35.981 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:35.981 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.981 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.982 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:35.982 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330357+0000", 2024-09-12T00:05:35.982 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2339999999999996e-06 2024-09-12T00:05:35.982 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.982 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.982 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:35.982 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330381+0000", 2024-09-12T00:05:35.982 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4626000000000001e-05 2024-09-12T00:05:35.982 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.982 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.982 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:35.982 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330417+0000", 2024-09-12T00:05:35.982 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5886000000000002e-05 2024-09-12T00:05:35.983 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.983 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.983 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.983 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330442+0000", 2024-09-12T00:05:35.983 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4522999999999999e-05 2024-09-12T00:05:35.983 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.983 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.983 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:35.983 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335485+0000", 2024-09-12T00:05:35.983 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050432589999999996 2024-09-12T00:05:35.983 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.983 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.983 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:05:35.983 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335507+0000", 2024-09-12T00:05:35.984 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2013000000000001e-05 2024-09-12T00:05:35.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.984 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.984 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:35.984 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.351747+0000", 2024-09-12T00:05:35.984 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016240451999999999 2024-09-12T00:05:35.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.984 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.985 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:35.985 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352062+0000", 2024-09-12T00:05:35.985 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031433399999999999 2024-09-12T00:05:35.985 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.985 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.985 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:35.985 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352378+0000", 2024-09-12T00:05:35.985 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031586400000000001 2024-09-12T00:05:35.985 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.985 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.985 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:35.985 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.355074+0000", 2024-09-12T00:05:35.985 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026962919999999999 2024-09-12T00:05:35.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.986 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.986 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:35.986 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357537+0000", 2024-09-12T00:05:35.986 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024634689999999998 2024-09-12T00:05:35.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.986 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.986 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:35.986 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357680+0000", 2024-09-12T00:05:35.986 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014314899999999999 2024-09-12T00:05:35.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.986 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.986 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:35.986 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357793+0000", 2024-09-12T00:05:35.987 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011293 2024-09-12T00:05:35.987 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:35.987 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:35.987 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:35.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.987 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.987 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2670 3.15 3:aae67b25:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:35.987 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.402430+0000", 2024-09-12T00:05:35.987 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.575473582999997, 2024-09-12T00:05:35.987 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020468187999999998, 2024-09-12T00:05:35.987 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:35.987 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:35.987 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.987 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:35.988 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:35.988 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:35.988 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2670 2024-09-12T00:05:35.988 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.988 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:35.988 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.988 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:35.988 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.402430+0000", 2024-09-12T00:05:35.988 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:35.988 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.988 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.988 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:35.989 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.402430+0000", 2024-09-12T00:05:35.989 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:35.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.989 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.989 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:35.989 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.402434+0000", 2024-09-12T00:05:35.989 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3730000000000003e-06 2024-09-12T00:05:35.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.989 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.989 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:35.989 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405033+0000", 2024-09-12T00:05:35.990 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025991080000000001 2024-09-12T00:05:35.990 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.990 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.990 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:35.990 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405068+0000", 2024-09-12T00:05:35.990 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4832999999999997e-05 2024-09-12T00:05:35.990 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.990 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.990 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.990 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405080+0000", 2024-09-12T00:05:35.990 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2344000000000001e-05 2024-09-12T00:05:35.990 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.990 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.990 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:35.991 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405150+0000", 2024-09-12T00:05:35.991 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9391e-05 2024-09-12T00:05:35.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.991 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.991 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:35.991 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405287+0000", 2024-09-12T00:05:35.991 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013720299999999999 2024-09-12T00:05:35.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.991 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.991 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:35.991 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405411+0000", 2024-09-12T00:05:35.991 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000123891 2024-09-12T00:05:35.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.991 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.992 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:35.992 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.414520+0000", 2024-09-12T00:05:35.992 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091092599999999992 2024-09-12T00:05:35.992 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.992 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.992 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:35.992 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.422744+0000", 2024-09-12T00:05:35.992 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0082241620000000001 2024-09-12T00:05:35.992 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.992 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.992 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:35.992 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.422841+0000", 2024-09-12T00:05:35.992 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6525000000000002e-05 2024-09-12T00:05:35.993 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.993 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.993 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:35.993 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.422898+0000", 2024-09-12T00:05:35.993 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7098000000000001e-05 2024-09-12T00:05:35.993 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:35.993 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:35.993 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:35.993 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.993 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.993 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2713 3.c 3:3354c844:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:35.993 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.736236+0000", 2024-09-12T00:05:35.993 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.241667391999997, 2024-09-12T00:05:35.994 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020199746000000001, 2024-09-12T00:05:35.994 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:35.994 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:35.994 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:35.994 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:35.994 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:35.994 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:35.994 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2713 2024-09-12T00:05:35.994 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.994 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:35.994 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.994 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:35.994 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.736236+0000", 2024-09-12T00:05:35.995 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:35.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.995 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.995 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:35.995 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.736236+0000", 2024-09-12T00:05:35.995 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:35.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.995 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.995 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:35.995 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.736239+0000", 2024-09-12T00:05:35.995 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5599999999999998e-06 2024-09-12T00:05:35.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.995 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.995 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:35.996 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.737498+0000", 2024-09-12T00:05:35.996 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001258807 2024-09-12T00:05:35.996 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.996 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.996 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:35.996 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.737522+0000", 2024-09-12T00:05:35.996 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.408e-05 2024-09-12T00:05:35.996 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.996 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.996 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:35.996 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.737532+0000", 2024-09-12T00:05:35.996 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8519999999999999e-06 2024-09-12T00:05:35.996 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.997 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.997 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:35.997 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.737594+0000", 2024-09-12T00:05:35.997 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1437000000000001e-05 2024-09-12T00:05:35.997 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.997 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.997 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:35.997 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.737712+0000", 2024-09-12T00:05:35.997 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000118641 2024-09-12T00:05:35.997 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.997 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.997 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:35.998 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.737807+0000", 2024-09-12T00:05:35.998 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.4710000000000006e-05 2024-09-12T00:05:35.998 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.998 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.998 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:35.998 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.742626+0000", 2024-09-12T00:05:35.998 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004818719 2024-09-12T00:05:35.998 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.998 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.998 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:35.998 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.756272+0000", 2024-09-12T00:05:35.998 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013646574 2024-09-12T00:05:35.998 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.999 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.999 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:35.999 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.756357+0000", 2024-09-12T00:05:35.999 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4964999999999997e-05 2024-09-12T00:05:35.999 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:35.999 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:35.999 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:35.999 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.756436+0000", 2024-09-12T00:05:35.999 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8400999999999997e-05 2024-09-12T00:05:35.999 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:35.999 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:35.999 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:35.999 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.000 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.000 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2727 3.39 3:9c63b475:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:36.000 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.875651+0000", 2024-09-12T00:05:36.000 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.102251785999997, 2024-09-12T00:05:36.000 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019038132999999999, 2024-09-12T00:05:36.000 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:36.000 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:36.000 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:36.000 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:36.000 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:36.000 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:36.000 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2727 2024-09-12T00:05:36.000 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.000 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:36.001 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.001 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:36.001 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.875651+0000", 2024-09-12T00:05:36.001 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.001 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.001 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.001 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:36.001 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.875651+0000", 2024-09-12T00:05:36.001 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.001 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.001 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.001 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:36.001 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.875655+0000", 2024-09-12T00:05:36.002 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4699999999999998e-06 2024-09-12T00:05:36.002 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.002 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.002 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:36.002 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.877353+0000", 2024-09-12T00:05:36.002 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0016979740000000001 2024-09-12T00:05:36.002 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.002 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.002 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:36.002 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.877385+0000", 2024-09-12T00:05:36.002 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2561000000000002e-05 2024-09-12T00:05:36.002 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.002 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.002 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:36.002 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.877400+0000", 2024-09-12T00:05:36.003 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.505e-05 2024-09-12T00:05:36.003 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.003 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.003 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:36.003 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.877503+0000", 2024-09-12T00:05:36.003 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010297399999999999 2024-09-12T00:05:36.003 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.003 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.003 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:36.003 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.877647+0000", 2024-09-12T00:05:36.003 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000143268 2024-09-12T00:05:36.003 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.003 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.003 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:36.003 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.877798+0000", 2024-09-12T00:05:36.004 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015086799999999999 2024-09-12T00:05:36.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.004 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.004 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:36.004 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.884567+0000", 2024-09-12T00:05:36.004 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0067690629999999996 2024-09-12T00:05:36.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.004 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.004 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:36.004 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.894563+0000", 2024-09-12T00:05:36.004 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0099959269999999999 2024-09-12T00:05:36.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.004 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.005 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:36.005 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.894632+0000", 2024-09-12T00:05:36.005 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9067999999999997e-05 2024-09-12T00:05:36.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.005 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.005 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:36.005 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.894690+0000", 2024-09-12T00:05:36.005 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.791e-05 2024-09-12T00:05:36.005 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.005 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:36.005 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.005 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.005 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2731 3.c 3:33671167:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:36.006 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.917498+0000", 2024-09-12T00:05:36.006 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.060405174000003, 2024-09-12T00:05:36.006 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020741915, 2024-09-12T00:05:36.006 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:36.006 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:36.006 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:36.006 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:36.006 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:36.006 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:36.006 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2731 2024-09-12T00:05:36.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.006 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:36.006 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.006 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:36.007 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.917498+0000", 2024-09-12T00:05:36.007 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.007 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.007 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:36.007 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.917498+0000", 2024-09-12T00:05:36.007 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.007 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.008 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:36.008 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.917502+0000", 2024-09-12T00:05:36.008 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4860000000000002e-06 2024-09-12T00:05:36.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.008 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.008 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:36.008 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919071+0000", 2024-09-12T00:05:36.008 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015695380000000001 2024-09-12T00:05:36.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.008 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.008 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:36.008 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919100+0000", 2024-09-12T00:05:36.008 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8822e-05 2024-09-12T00:05:36.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.009 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.009 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:36.009 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919110+0000", 2024-09-12T00:05:36.009 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0287e-05 2024-09-12T00:05:36.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.009 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.009 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:36.009 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919179+0000", 2024-09-12T00:05:36.009 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8926999999999999e-05 2024-09-12T00:05:36.010 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.010 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.010 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:36.010 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919338+0000", 2024-09-12T00:05:36.010 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015856299999999999 2024-09-12T00:05:36.010 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.010 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.010 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:36.010 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919462+0000", 2024-09-12T00:05:36.010 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012430399999999999 2024-09-12T00:05:36.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.011 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.011 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:36.011 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.923903+0000", 2024-09-12T00:05:36.011 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0044412660000000001 2024-09-12T00:05:36.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.011 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.011 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:36.011 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.938087+0000", 2024-09-12T00:05:36.011 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014183398999999999 2024-09-12T00:05:36.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.011 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.011 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:36.012 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.938180+0000", 2024-09-12T00:05:36.012 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3318000000000003e-05 2024-09-12T00:05:36.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.012 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.012 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:36.012 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.938240+0000", 2024-09-12T00:05:36.012 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0004999999999999e-05 2024-09-12T00:05:36.012 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.012 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:36.012 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.012 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.012 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2734 3.c 3:303f9e0a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:36.013 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.952166+0000", 2024-09-12T00:05:36.013 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.025736823999999, 2024-09-12T00:05:36.013 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018433805000000001, 2024-09-12T00:05:36.013 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:36.013 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:36.013 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:36.013 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:36.013 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:36.013 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:36.013 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2734 2024-09-12T00:05:36.013 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.013 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:36.014 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.014 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:36.014 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.952166+0000", 2024-09-12T00:05:36.014 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.014 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.014 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.014 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:36.014 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.952166+0000", 2024-09-12T00:05:36.014 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.014 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.014 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.014 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:36.014 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.952170+0000", 2024-09-12T00:05:36.014 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3330000000000001e-06 2024-09-12T00:05:36.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.015 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.015 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:36.015 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.953647+0000", 2024-09-12T00:05:36.015 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0014772889999999999 2024-09-12T00:05:36.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.015 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.015 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:36.015 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.953675+0000", 2024-09-12T00:05:36.015 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8133e-05 2024-09-12T00:05:36.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.015 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.016 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:36.016 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.953690+0000", 2024-09-12T00:05:36.016 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4671000000000001e-05 2024-09-12T00:05:36.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.016 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.016 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:36.016 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.953789+0000", 2024-09-12T00:05:36.016 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.9044999999999998e-05 2024-09-12T00:05:36.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.016 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.016 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:36.016 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.953923+0000", 2024-09-12T00:05:36.016 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013453099999999999 2024-09-12T00:05:36.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.017 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.017 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:36.017 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.954083+0000", 2024-09-12T00:05:36.017 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000160051 2024-09-12T00:05:36.017 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.017 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.017 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:36.017 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.961055+0000", 2024-09-12T00:05:36.017 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.006971288 2024-09-12T00:05:36.017 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.017 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.017 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:36.017 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.970486+0000", 2024-09-12T00:05:36.018 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0094313799999999996 2024-09-12T00:05:36.018 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.018 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.018 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:36.018 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.970547+0000", 2024-09-12T00:05:36.018 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1396999999999995e-05 2024-09-12T00:05:36.018 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.018 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.018 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:36.018 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.970600+0000", 2024-09-12T00:05:36.018 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2686999999999999e-05 2024-09-12T00:05:36.018 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.018 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:36.019 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.019 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.019 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.019 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2748 3.3b 3:df6d92a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:36.019 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:05:36.019 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 47.879062957000002, 2024-09-12T00:05:36.019 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.023574735999999999, 2024-09-12T00:05:36.019 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:36.019 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:36.019 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:36.019 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:36.019 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:36.019 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:36.019 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2748 2024-09-12T00:05:36.020 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.020 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:36.020 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.020 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:36.020 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:05:36.020 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.020 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.020 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.020 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:36.020 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:05:36.020 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.020 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.020 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.020 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:36.021 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098844+0000", 2024-09-12T00:05:36.021 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1570000000000002e-06 2024-09-12T00:05:36.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.021 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.021 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:36.021 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100354+0000", 2024-09-12T00:05:36.021 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001509544 2024-09-12T00:05:36.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.021 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.021 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:36.021 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100383+0000", 2024-09-12T00:05:36.021 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9386e-05 2024-09-12T00:05:36.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.021 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.022 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:36.022 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100399+0000", 2024-09-12T00:05:36.022 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5883999999999999e-05 2024-09-12T00:05:36.022 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.022 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.022 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:36.022 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100507+0000", 2024-09-12T00:05:36.022 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010822 2024-09-12T00:05:36.022 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.022 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.022 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:36.022 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100704+0000", 2024-09-12T00:05:36.022 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019658499999999999 2024-09-12T00:05:36.022 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.023 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.023 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:36.023 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100901+0000", 2024-09-12T00:05:36.023 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000196505 2024-09-12T00:05:36.023 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.023 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.023 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:36.023 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112178+0000", 2024-09-12T00:05:36.023 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011277718000000001 2024-09-12T00:05:36.023 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.023 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.023 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:36.023 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122285+0000", 2024-09-12T00:05:36.024 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010106327 2024-09-12T00:05:36.024 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.024 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.024 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:36.024 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122358+0000", 2024-09-12T00:05:36.024 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3640999999999995e-05 2024-09-12T00:05:36.024 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.024 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.024 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:36.024 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122415+0000", 2024-09-12T00:05:36.024 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6768999999999998e-05 2024-09-12T00:05:36.024 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.025 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:36.025 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.025 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.025 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.025 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2964 3.24 e75/23 3:26c83ec0:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_3:head v 75'6, mlcod=63'4)", 2024-09-12T00:05:36.025 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:05:36.025 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 15.965641936000001, 2024-09-12T00:05:36.025 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022426814, 2024-09-12T00:05:36.025 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:36.025 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:36.025 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:36.025 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:36.025 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.026 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:36.026 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:05:36.026 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.026 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.026 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:36.026 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:05:36.026 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.026 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.026 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:36.026 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012263+0000", 2024-09-12T00:05:36.027 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.091e-06 2024-09-12T00:05:36.027 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.027 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.027 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:36.027 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018390+0000", 2024-09-12T00:05:36.027 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061264600000000002 2024-09-12T00:05:36.027 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.027 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.027 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:36.027 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018419+0000", 2024-09-12T00:05:36.027 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8979000000000002e-05 2024-09-12T00:05:36.027 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.027 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.028 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:36.028 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018434+0000", 2024-09-12T00:05:36.028 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4781e-05 2024-09-12T00:05:36.028 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.028 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.028 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:36.028 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018528+0000", 2024-09-12T00:05:36.028 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.4333000000000006e-05 2024-09-12T00:05:36.028 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.028 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.028 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:36.028 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018559+0000", 2024-09-12T00:05:36.029 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1557999999999998e-05 2024-09-12T00:05:36.029 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.029 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.029 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:36.029 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.034615+0000", 2024-09-12T00:05:36.029 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016055834000000001 2024-09-12T00:05:36.029 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.029 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.029 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:36.029 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.034688+0000", 2024-09-12T00:05:36.029 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2778e-05 2024-09-12T00:05:36.029 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.030 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:36.030 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.030 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.030 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.030 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2965 3.e e75/23 3:70fff61e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_4:head v 75'5, mlcod=63'3)", 2024-09-12T00:05:36.030 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:05:36.030 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 15.958131715, 2024-09-12T00:05:36.030 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021839210000000001, 2024-09-12T00:05:36.030 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:36.030 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:36.030 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:36.030 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:36.030 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.031 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:36.031 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:05:36.031 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.031 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.031 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.031 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:36.031 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:05:36.031 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.031 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.031 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.031 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:36.031 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019773+0000", 2024-09-12T00:05:36.032 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4839999999999999e-06 2024-09-12T00:05:36.032 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.032 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.032 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:36.032 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021570+0000", 2024-09-12T00:05:36.032 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017965570000000001 2024-09-12T00:05:36.032 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.032 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.032 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:36.032 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021587+0000", 2024-09-12T00:05:36.032 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7938e-05 2024-09-12T00:05:36.032 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.032 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.032 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:36.033 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021598+0000", 2024-09-12T00:05:36.033 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0553e-05 2024-09-12T00:05:36.033 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.033 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.033 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:36.033 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021676+0000", 2024-09-12T00:05:36.033 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8034000000000005e-05 2024-09-12T00:05:36.033 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.033 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.033 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:36.033 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021706+0000", 2024-09-12T00:05:36.033 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9915000000000001e-05 2024-09-12T00:05:36.033 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.033 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.034 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:36.034 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.041519+0000", 2024-09-12T00:05:36.034 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019813171000000001 2024-09-12T00:05:36.034 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.034 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.034 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:36.034 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.041611+0000", 2024-09-12T00:05:36.034 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1558000000000007e-05 2024-09-12T00:05:36.034 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.034 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:36.034 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.034 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.034 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.034 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3004 3.36 3:6cc4f27f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:36.035 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:05:36.035 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 15.539732517999999, 2024-09-12T00:05:36.035 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.042951743000000001, 2024-09-12T00:05:36.035 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:36.035 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:36.035 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:36.035 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:36.035 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:36.035 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:36.035 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3004 2024-09-12T00:05:36.035 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.035 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:36.035 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.035 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:36.036 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:05:36.036 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.036 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.036 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.036 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:36.036 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:05:36.036 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.036 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.036 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.036 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:36.036 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438175+0000", 2024-09-12T00:05:36.036 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1640000000000003e-06 2024-09-12T00:05:36.036 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.036 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.037 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:36.037 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439732+0000", 2024-09-12T00:05:36.037 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015574510000000001 2024-09-12T00:05:36.037 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.037 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.037 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:36.037 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439758+0000", 2024-09-12T00:05:36.037 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6074000000000001e-05 2024-09-12T00:05:36.037 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.037 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.037 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:36.037 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439768+0000", 2024-09-12T00:05:36.037 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8770000000000005e-06 2024-09-12T00:05:36.037 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.038 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.038 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:36.038 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439874+0000", 2024-09-12T00:05:36.038 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105583 2024-09-12T00:05:36.038 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.038 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.038 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:36.038 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.440078+0000", 2024-09-12T00:05:36.038 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020388200000000001 2024-09-12T00:05:36.038 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.038 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.038 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:36.038 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.440251+0000", 2024-09-12T00:05:36.038 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017339100000000001 2024-09-12T00:05:36.039 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.039 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.039 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:36.039 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.459982+0000", 2024-09-12T00:05:36.039 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01973099 2024-09-12T00:05:36.039 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.039 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.039 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:36.039 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.480958+0000", 2024-09-12T00:05:36.039 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020975730000000001 2024-09-12T00:05:36.039 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.039 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.039 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:36.040 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481034+0000", 2024-09-12T00:05:36.040 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6224999999999996e-05 2024-09-12T00:05:36.040 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.040 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.040 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:36.040 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481122+0000", 2024-09-12T00:05:36.040 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8375999999999995e-05 2024-09-12T00:05:36.040 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.040 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:36.040 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.040 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.040 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.040 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3005 3.35 3:ae3b5a36:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:36.041 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:05:36.041 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 15.530478834, 2024-09-12T00:05:36.041 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.028828275, 2024-09-12T00:05:36.041 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:36.041 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:36.041 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:36.041 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:36.041 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:36.041 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:36.041 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3005 2024-09-12T00:05:36.041 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.041 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:36.041 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.042 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:36.042 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:05:36.042 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.042 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.042 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.042 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:36.042 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:05:36.042 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.042 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.042 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.042 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:36.042 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447427+0000", 2024-09-12T00:05:36.042 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.864e-06 2024-09-12T00:05:36.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.043 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.043 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:36.043 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449003+0000", 2024-09-12T00:05:36.043 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001575405 2024-09-12T00:05:36.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.043 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.043 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:36.043 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449030+0000", 2024-09-12T00:05:36.043 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7189999999999999e-05 2024-09-12T00:05:36.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.043 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.043 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:36.043 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449042+0000", 2024-09-12T00:05:36.044 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2038999999999999e-05 2024-09-12T00:05:36.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.044 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.044 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:36.044 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449111+0000", 2024-09-12T00:05:36.044 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9521000000000001e-05 2024-09-12T00:05:36.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.044 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.044 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:36.044 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449218+0000", 2024-09-12T00:05:36.044 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010675600000000001 2024-09-12T00:05:36.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.044 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.045 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:36.045 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449330+0000", 2024-09-12T00:05:36.045 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000111809 2024-09-12T00:05:36.045 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.045 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.045 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:36.045 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.469844+0000", 2024-09-12T00:05:36.045 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020514277000000001 2024-09-12T00:05:36.045 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.045 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.045 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:36.045 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.475983+0000", 2024-09-12T00:05:36.045 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061392540000000002 2024-09-12T00:05:36.046 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.046 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.046 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:36.046 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.476113+0000", 2024-09-12T00:05:36.046 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000129713 2024-09-12T00:05:36.046 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.046 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.046 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:36.046 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.476253+0000", 2024-09-12T00:05:36.046 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013944700000000001 2024-09-12T00:05:36.046 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.046 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:36.046 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.046 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.047 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.047 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3006 3.3 3:c183ca95:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:36.047 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:05:36.047 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 15.520952263, 2024-09-12T00:05:36.047 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.024661756, 2024-09-12T00:05:36.047 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:36.047 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:36.047 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:36.047 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:36.047 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:36.047 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:36.047 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3006 2024-09-12T00:05:36.047 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.048 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:36.048 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.048 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:36.048 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:05:36.048 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.048 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.048 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:36.048 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:05:36.048 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.048 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.048 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:36.049 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456954+0000", 2024-09-12T00:05:36.049 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7070000000000001e-06 2024-09-12T00:05:36.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.049 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.049 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:36.049 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458684+0000", 2024-09-12T00:05:36.049 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017305479999999999 2024-09-12T00:05:36.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.049 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.049 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:36.049 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458709+0000", 2024-09-12T00:05:36.049 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4780999999999999e-05 2024-09-12T00:05:36.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.049 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.050 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:36.050 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458719+0000", 2024-09-12T00:05:36.050 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0202e-05 2024-09-12T00:05:36.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.050 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.050 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:36.050 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458800+0000", 2024-09-12T00:05:36.050 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0893e-05 2024-09-12T00:05:36.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.050 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.050 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:36.050 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458990+0000", 2024-09-12T00:05:36.050 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018986400000000001 2024-09-12T00:05:36.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.051 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.051 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:36.051 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.459171+0000", 2024-09-12T00:05:36.051 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018135499999999999 2024-09-12T00:05:36.051 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.051 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.051 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:36.051 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.478356+0000", 2024-09-12T00:05:36.051 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019185153 2024-09-12T00:05:36.051 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.051 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.051 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:36.051 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481411+0000", 2024-09-12T00:05:36.052 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030546190000000002 2024-09-12T00:05:36.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.052 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.052 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:36.052 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481511+0000", 2024-09-12T00:05:36.052 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.9763e-05 2024-09-12T00:05:36.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.052 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.052 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:36.052 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481613+0000", 2024-09-12T00:05:36.052 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101871 2024-09-12T00:05:36.052 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.052 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:36.052 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.053 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.053 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.053 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3019 3.15 3:abb9a608:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:36.053 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.624749+0000", 2024-09-12T00:05:36.053 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 15.353154648, 2024-09-12T00:05:36.053 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018588891, 2024-09-12T00:05:36.053 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:36.053 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:36.053 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:36.053 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:36.053 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:36.053 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:36.053 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3019 2024-09-12T00:05:36.054 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.054 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:36.054 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.054 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:36.054 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.624749+0000", 2024-09-12T00:05:36.054 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.054 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.054 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.054 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:36.054 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.624749+0000", 2024-09-12T00:05:36.054 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.054 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.054 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.054 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:36.055 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.624752+0000", 2024-09-12T00:05:36.055 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4000000000000001e-06 2024-09-12T00:05:36.055 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.055 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.055 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:36.055 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.626087+0000", 2024-09-12T00:05:36.055 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0013353900000000001 2024-09-12T00:05:36.055 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.055 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.055 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:36.055 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.626122+0000", 2024-09-12T00:05:36.055 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4904999999999999e-05 2024-09-12T00:05:36.055 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.055 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.056 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:36.056 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.626138+0000", 2024-09-12T00:05:36.056 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5659999999999999e-05 2024-09-12T00:05:36.056 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.056 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.056 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:36.056 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.626215+0000", 2024-09-12T00:05:36.056 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7528999999999996e-05 2024-09-12T00:05:36.056 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.056 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.056 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:36.056 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.626354+0000", 2024-09-12T00:05:36.056 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013848899999999999 2024-09-12T00:05:36.057 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.057 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.057 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:36.057 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.626457+0000", 2024-09-12T00:05:36.057 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102921 2024-09-12T00:05:36.057 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.057 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.057 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:36.057 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.631059+0000", 2024-09-12T00:05:36.057 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046025679999999996 2024-09-12T00:05:36.057 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.057 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.057 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:36.057 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.643254+0000", 2024-09-12T00:05:36.058 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012194534999999999 2024-09-12T00:05:36.058 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.058 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.058 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:36.058 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.643299+0000", 2024-09-12T00:05:36.058 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5255e-05 2024-09-12T00:05:36.058 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.058 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.058 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:36.058 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.643337+0000", 2024-09-12T00:05:36.058 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8238999999999998e-05 2024-09-12T00:05:36.058 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.058 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:36.059 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.059 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.059 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.059 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3034 3.2a e75/23 3:57bb186b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_73:head v 75'4, mlcod=63'2)", 2024-09-12T00:05:36.059 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.785462+0000", 2024-09-12T00:05:36.059 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 15.1924416, 2024-09-12T00:05:36.059 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01923536, 2024-09-12T00:05:36.059 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:36.059 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:36.059 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:36.059 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:36.059 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.059 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:36.059 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.785462+0000", 2024-09-12T00:05:36.060 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.060 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.060 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.060 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:36.060 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.785462+0000", 2024-09-12T00:05:36.060 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.060 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.060 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.060 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:36.060 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.785463+0000", 2024-09-12T00:05:36.060 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8989999999999999e-06 2024-09-12T00:05:36.060 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.060 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.060 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:36.061 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.788048+0000", 2024-09-12T00:05:36.061 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025844959999999999 2024-09-12T00:05:36.061 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.061 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.061 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:36.061 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.788074+0000", 2024-09-12T00:05:36.061 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6393e-05 2024-09-12T00:05:36.061 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.061 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.061 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:36.061 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.788087+0000", 2024-09-12T00:05:36.061 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2261e-05 2024-09-12T00:05:36.061 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.062 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.062 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:36.062 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.788194+0000", 2024-09-12T00:05:36.062 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000107599 2024-09-12T00:05:36.062 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.062 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.062 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:36.062 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.788220+0000", 2024-09-12T00:05:36.062 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5374000000000001e-05 2024-09-12T00:05:36.062 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.062 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.062 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:36.062 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.804625+0000", 2024-09-12T00:05:36.062 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016405349 2024-09-12T00:05:36.062 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.063 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.063 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:36.063 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.804697+0000", 2024-09-12T00:05:36.063 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1989000000000005e-05 2024-09-12T00:05:36.063 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.063 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:36.063 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.063 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.063 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.063 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3037 3.39 3:9eefb4c1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:36.063 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:05:36.063 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 15.162684856, 2024-09-12T00:05:36.063 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020855543000000001, 2024-09-12T00:05:36.064 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:36.064 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:36.064 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:36.064 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:36.064 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:36.064 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:36.064 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3037 2024-09-12T00:05:36.064 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.064 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:36.064 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.064 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:36.064 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:05:36.064 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.064 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.064 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.065 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:36.065 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:05:36.065 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.065 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.065 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.065 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:36.065 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815221+0000", 2024-09-12T00:05:36.065 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1540000000000002e-06 2024-09-12T00:05:36.065 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.065 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.065 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:36.065 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817594+0000", 2024-09-12T00:05:36.065 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023728880000000001 2024-09-12T00:05:36.065 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.066 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.066 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:36.066 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817618+0000", 2024-09-12T00:05:36.066 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3635e-05 2024-09-12T00:05:36.066 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.066 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.066 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:36.066 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817633+0000", 2024-09-12T00:05:36.066 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4559000000000001e-05 2024-09-12T00:05:36.066 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.066 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.066 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:36.066 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817734+0000", 2024-09-12T00:05:36.066 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101729 2024-09-12T00:05:36.067 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.067 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.067 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:36.067 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817939+0000", 2024-09-12T00:05:36.067 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020489299999999999 2024-09-12T00:05:36.067 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.067 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.067 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:36.067 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.818113+0000", 2024-09-12T00:05:36.067 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000173413 2024-09-12T00:05:36.067 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.067 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.067 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:36.067 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.825676+0000", 2024-09-12T00:05:36.068 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075635260000000001 2024-09-12T00:05:36.068 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.068 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.068 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:36.068 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.835921+0000", 2024-09-12T00:05:36.068 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010244932999999999 2024-09-12T00:05:36.068 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.068 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.068 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:36.068 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.836006+0000", 2024-09-12T00:05:36.068 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5427999999999996e-05 2024-09-12T00:05:36.068 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.068 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.069 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:36.069 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.836074+0000", 2024-09-12T00:05:36.069 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7385000000000006e-05 2024-09-12T00:05:36.069 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.069 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:36.069 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.069 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.069 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.069 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3096 3.2f e76/23 3:f7c63ea3:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_135:head v 76'5, mlcod=75'3)", 2024-09-12T00:05:36.069 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:21.579016+0000", 2024-09-12T00:05:36.069 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.398887414000001, 2024-09-12T00:05:36.069 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019041222999999999, 2024-09-12T00:05:36.069 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:36.069 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:36.070 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:36.070 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:36.070 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.070 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:36.070 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.579016+0000", 2024-09-12T00:05:36.070 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.070 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.070 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.070 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:36.070 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.579016+0000", 2024-09-12T00:05:36.070 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.070 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.070 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.071 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:36.071 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.579016+0000", 2024-09-12T00:05:36.071 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7100000000000001e-07 2024-09-12T00:05:36.071 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.071 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.071 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:36.071 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.585629+0000", 2024-09-12T00:05:36.071 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066123520000000002 2024-09-12T00:05:36.071 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.071 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.071 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:36.071 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.585651+0000", 2024-09-12T00:05:36.071 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1953000000000001e-05 2024-09-12T00:05:36.071 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.072 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.072 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:36.072 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.585661+0000", 2024-09-12T00:05:36.072 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0057e-05 2024-09-12T00:05:36.072 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.072 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.072 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:36.072 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.585748+0000", 2024-09-12T00:05:36.072 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7225999999999995e-05 2024-09-12T00:05:36.072 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.072 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.072 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:36.072 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.585778+0000", 2024-09-12T00:05:36.073 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9818000000000001e-05 2024-09-12T00:05:36.073 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.073 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.073 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:36.073 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.597995+0000", 2024-09-12T00:05:36.073 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01221673 2024-09-12T00:05:36.073 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.073 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.073 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:36.073 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.598057+0000", 2024-09-12T00:05:36.073 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2415999999999993e-05 2024-09-12T00:05:36.073 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.073 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:36.073 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.074 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.074 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.074 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3102 3.1b e76/23 3:db06e448:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_141:head v 76'9, mlcod=63'7)", 2024-09-12T00:05:36.074 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:21.652983+0000", 2024-09-12T00:05:36.074 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.324919731, 2024-09-12T00:05:36.074 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019025626, 2024-09-12T00:05:36.074 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:36.074 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:36.074 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:36.074 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:36.074 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.074 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:36.074 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.652983+0000", 2024-09-12T00:05:36.074 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.075 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.075 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.075 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:36.075 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.652983+0000", 2024-09-12T00:05:36.075 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.075 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.075 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.075 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:36.075 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.652984+0000", 2024-09-12T00:05:36.075 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6300000000000004e-07 2024-09-12T00:05:36.075 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.075 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.075 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:36.076 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.659663+0000", 2024-09-12T00:05:36.076 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066788200000000002 2024-09-12T00:05:36.076 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.076 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.076 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:36.076 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.659693+0000", 2024-09-12T00:05:36.076 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9453000000000001e-05 2024-09-12T00:05:36.076 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.076 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.076 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:36.076 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.659705+0000", 2024-09-12T00:05:36.076 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2055000000000001e-05 2024-09-12T00:05:36.076 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.076 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.077 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:36.077 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.659787+0000", 2024-09-12T00:05:36.077 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2429000000000006e-05 2024-09-12T00:05:36.077 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.077 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.077 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:36.077 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.659816+0000", 2024-09-12T00:05:36.077 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8704000000000002e-05 2024-09-12T00:05:36.077 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.077 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.077 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:36.077 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.671902+0000", 2024-09-12T00:05:36.077 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012085871999999999 2024-09-12T00:05:36.077 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.078 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.078 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:36.078 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.672009+0000", 2024-09-12T00:05:36.078 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010743000000000001 2024-09-12T00:05:36.078 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.078 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:36.078 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.078 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.078 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.078 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3128 3.c 3:30aa9812:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:36.078 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:21.954348+0000", 2024-09-12T00:05:36.078 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.023554786, 2024-09-12T00:05:36.078 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020268630999999999, 2024-09-12T00:05:36.079 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:36.079 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:36.079 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:36.079 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:36.079 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:36.079 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:36.079 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3128 2024-09-12T00:05:36.079 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.079 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:36.079 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.079 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:36.079 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.954348+0000", 2024-09-12T00:05:36.080 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.080 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.080 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.080 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:36.080 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.954348+0000", 2024-09-12T00:05:36.080 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.080 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.080 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.080 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:36.080 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.954351+0000", 2024-09-12T00:05:36.080 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:05:36.080 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.080 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.081 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:36.081 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.956451+0000", 2024-09-12T00:05:36.081 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021003150000000002 2024-09-12T00:05:36.081 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.081 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.081 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:36.081 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.956508+0000", 2024-09-12T00:05:36.081 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6379999999999999e-05 2024-09-12T00:05:36.081 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.081 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.081 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:36.081 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.956527+0000", 2024-09-12T00:05:36.081 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9945e-05 2024-09-12T00:05:36.082 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.082 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.082 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:36.082 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.956631+0000", 2024-09-12T00:05:36.082 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103664 2024-09-12T00:05:36.082 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.082 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.082 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:36.082 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.956890+0000", 2024-09-12T00:05:36.082 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00025909499999999999 2024-09-12T00:05:36.082 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.082 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.082 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:36.082 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.957167+0000", 2024-09-12T00:05:36.083 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000277113 2024-09-12T00:05:36.083 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.083 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.083 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:36.083 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.968705+0000", 2024-09-12T00:05:36.083 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011538049999999999 2024-09-12T00:05:36.083 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.083 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.083 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:36.083 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.974534+0000", 2024-09-12T00:05:36.083 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058281499999999998 2024-09-12T00:05:36.083 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.083 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.084 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:36.084 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.974580+0000", 2024-09-12T00:05:36.084 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6649e-05 2024-09-12T00:05:36.084 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.084 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.084 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:36.084 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.974617+0000", 2024-09-12T00:05:36.084 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6829999999999998e-05 2024-09-12T00:05:36.084 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.084 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:36.084 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.084 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.084 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.085 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3134 3.24 e76/23 3:2525a955:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_173:head v 76'8, mlcod=75'6)", 2024-09-12T00:05:36.085 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:22.046783+0000", 2024-09-12T00:05:36.085 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.931120189, 2024-09-12T00:05:36.085 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018988463000000001, 2024-09-12T00:05:36.085 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:36.085 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:36.085 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:36.085 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:36.085 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.085 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:36.085 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.046783+0000", 2024-09-12T00:05:36.085 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.086 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.086 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.086 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:36.086 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.046783+0000", 2024-09-12T00:05:36.086 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.086 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.086 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.086 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:36.086 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.046786+0000", 2024-09-12T00:05:36.086 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5450000000000002e-06 2024-09-12T00:05:36.086 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.086 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.086 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:36.086 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.051145+0000", 2024-09-12T00:05:36.087 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0043596260000000001 2024-09-12T00:05:36.087 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.087 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.087 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:36.087 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.051178+0000", 2024-09-12T00:05:36.087 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2765000000000002e-05 2024-09-12T00:05:36.087 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.087 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.087 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:36.087 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.051193+0000", 2024-09-12T00:05:36.087 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4884e-05 2024-09-12T00:05:36.087 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.087 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.088 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:36.088 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.051273+0000", 2024-09-12T00:05:36.088 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0360999999999999e-05 2024-09-12T00:05:36.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.088 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.088 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:36.088 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.051296+0000", 2024-09-12T00:05:36.088 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2531000000000002e-05 2024-09-12T00:05:36.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.088 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.088 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:36.088 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.065696+0000", 2024-09-12T00:05:36.088 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014399792999999999 2024-09-12T00:05:36.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.089 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.089 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:36.089 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.065771+0000", 2024-09-12T00:05:36.089 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5957999999999993e-05 2024-09-12T00:05:36.089 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.089 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:36.089 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.089 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.089 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3142 3.c 3:33689984:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:36.089 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:22.143966+0000", 2024-09-12T00:05:36.090 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.83393717, 2024-09-12T00:05:36.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018503077999999999, 2024-09-12T00:05:36.090 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:36.090 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:36.090 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:36.090 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:36.090 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:36.090 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:36.090 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3142 2024-09-12T00:05:36.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.090 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:36.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:36.091 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.143966+0000", 2024-09-12T00:05:36.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.091 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:36.091 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.143966+0000", 2024-09-12T00:05:36.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:36.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.091 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:36.091 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.143969+0000", 2024-09-12T00:05:36.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.666e-06 2024-09-12T00:05:36.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.092 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:36.092 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.146392+0000", 2024-09-12T00:05:36.092 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024235620000000002 2024-09-12T00:05:36.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.092 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.092 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:36.092 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.146427+0000", 2024-09-12T00:05:36.092 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5238999999999999e-05 2024-09-12T00:05:36.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.092 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.092 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:36.092 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.146445+0000", 2024-09-12T00:05:36.092 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7499999999999998e-05 2024-09-12T00:05:36.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.093 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.093 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:36.093 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.146539+0000", 2024-09-12T00:05:36.093 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3752999999999995e-05 2024-09-12T00:05:36.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.093 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.093 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:36.093 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.146667+0000", 2024-09-12T00:05:36.093 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000128613 2024-09-12T00:05:36.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.093 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.093 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:36.093 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.146772+0000", 2024-09-12T00:05:36.094 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104452 2024-09-12T00:05:36.094 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.094 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.094 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:36.094 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.156499+0000", 2024-09-12T00:05:36.094 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0097269929999999998 2024-09-12T00:05:36.094 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.094 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.094 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:36.094 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.162385+0000", 2024-09-12T00:05:36.094 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058857780000000004 2024-09-12T00:05:36.094 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.094 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.095 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:36.095 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.162429+0000", 2024-09-12T00:05:36.095 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4592000000000003e-05 2024-09-12T00:05:36.095 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:36.095 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:36.095 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:36.095 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.162469+0000", 2024-09-12T00:05:36.095 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9929999999999999e-05 2024-09-12T00:05:36.095 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.095 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:36.095 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.095 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:36.095 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:36.095 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:36.096 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:05:36.098 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:05:36.098 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:36.096+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:36.118 INFO:tasks.workunit.client.0.smithi019.stderr:200+0 records in 2024-09-12T00:05:36.118 INFO:tasks.workunit.client.0.smithi019.stderr:200+0 records out 2024-09-12T00:05:36.118 INFO:tasks.workunit.client.0.smithi019.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 12.665 s, 166 MB/s 2024-09-12T00:05:36.198 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:36.200+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:36.254 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:36.255 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:36.255 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:05:36.255 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:36.271 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:05:36.276 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:36.276 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:36.299 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:36.300+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:36.301 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:36.301 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:36.320 INFO:tasks.workunit.client.0.smithi019.stdout:Bucket Created: buck_2024_08_12_00_05_36 2024-09-12T00:05:36.335 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:36.336 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:36.361 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:36.361 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:36.386 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:36.386 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:36.400 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:36.400+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:36.409 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:36.409 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:36.410 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:36.410 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:36.424 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:05:36.433 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:36.433 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:36.455 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:36.455 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:36.488 INFO:tasks.workunit.client.0.smithi019.stdout:quota set for the bucket: buck_2024_08_12_00_05_36 2024-09-12T00:05:36.501 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:36.500+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:36.551 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:36.551 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:36.567 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:05:36.609 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:36.612+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:36.643 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T00:05:36.702 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:36.704+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:36.725 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:36.725 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:36.739 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:05:36.803 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:36.804+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:36.868 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:36.868 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:36.883 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:05:36.904 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:36.904+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:36.998 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:36.999 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:37.004 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:37.004+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:37.011 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:05:37.105 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:37.104+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:37.186 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:37.187 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:37.201 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:05:37.206 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:37.204+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:37.306 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:37.308+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:37.375 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:37.375 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:37.389 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:05:37.408 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:37.408+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:37.509 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:37.508+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:37.517 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:37.517 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:37.532 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:05:37.610 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:37.612+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:37.664 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:37.664 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:37.679 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:05:37.722 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:37.724+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:37.806 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:37.806 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:37.811 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:37.812+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:37.820 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:05:37.912 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:37.912+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:37.984 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:37.984 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:37.998 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:05:38.042 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:38.044+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:38.114 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:38.116+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:38.167 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:38.168 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:38.182 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:05:38.231 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:38.232+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:38.300 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:38.300 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:38.314 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:05:38.317 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:38.316+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:38.417 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:38.416+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:38.474 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:05:38.483 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:38.484 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:38.500 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:05:38.543 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:38.544+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:38.618 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:38.620+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:38.621 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:38.621 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:38.638 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:38.638 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:38.655 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:38.655 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:38.661 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:38.661 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:38.665 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:05:38.671 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:38.671 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:38.676 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:05:38.692 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:38.692 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:38.711 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:38.711 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:38.722 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:38.724+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:38.730 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:38.731 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:38.749 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:38.749 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:38.808 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:38.808 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:38.808 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:38.808 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:38.809 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:38.820 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:38.820+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:38.822 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:05:38.921 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:38.920+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:38.993 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:38.993 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:38.993 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:38.994 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:38.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:38.994 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1646 3.25 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:05:38.994 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:38.994 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 65.916207607999993, 2024-09-12T00:05:38.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030091884999999999, 2024-09-12T00:05:38.994 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:38.994 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:38.994 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:38.994 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:38.994 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:38.994 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:38.994 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1646 2024-09-12T00:05:38.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:38.995 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:38.995 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:38.995 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:38.995 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:38.995 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:38.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:38.995 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:38.995 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:38.995 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:38.995 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:38.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:38.995 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:38.995 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:38.996 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077113+0000", 2024-09-12T00:05:38.996 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0186e-05 2024-09-12T00:05:38.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:38.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:38.996 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:38.996 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084821+0000", 2024-09-12T00:05:38.996 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077083450000000001 2024-09-12T00:05:38.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:38.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:38.996 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:38.996 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084857+0000", 2024-09-12T00:05:38.996 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6245000000000003e-05 2024-09-12T00:05:38.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:38.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:38.997 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:38.997 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084900+0000", 2024-09-12T00:05:38.997 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2369e-05 2024-09-12T00:05:38.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:38.997 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:38.997 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:38.997 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085058+0000", 2024-09-12T00:05:38.997 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015858199999999999 2024-09-12T00:05:38.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:38.997 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:38.997 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:38.997 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085307+0000", 2024-09-12T00:05:38.997 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024867999999999998 2024-09-12T00:05:38.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:38.998 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:38.998 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:38.998 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086107+0000", 2024-09-12T00:05:38.998 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00080040099999999996 2024-09-12T00:05:38.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:38.998 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:38.998 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:38.998 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.100477+0000", 2024-09-12T00:05:38.998 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014369508 2024-09-12T00:05:38.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:38.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:38.999 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:38.999 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107016+0000", 2024-09-12T00:05:38.999 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006538894 2024-09-12T00:05:38.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:38.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:38.999 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:38.999 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107121+0000", 2024-09-12T00:05:38.999 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105284 2024-09-12T00:05:38.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.000 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.000 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.000 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107194+0000", 2024-09-12T00:05:39.000 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3391000000000003e-05 2024-09-12T00:05:39.000 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.000 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.000 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.000 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.000 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1917 3.1 3:829295ac:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.4_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:05:39.000 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:39.000 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 63.828124127999999, 2024-09-12T00:05:39.001 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021401453000000001, 2024-09-12T00:05:39.001 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.001 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.001 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.001 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.001 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.001 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.001 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1917 2024-09-12T00:05:39.001 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.001 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.001 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.001 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.002 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:39.002 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.002 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.002 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.002 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:39.002 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.002 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.002 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.002 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165188+0000", 2024-09-12T00:05:39.002 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5409999999999999e-06 2024-09-12T00:05:39.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.003 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.003 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169353+0000", 2024-09-12T00:05:39.003 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00416446 2024-09-12T00:05:39.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.003 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.003 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169380+0000", 2024-09-12T00:05:39.003 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6919000000000001e-05 2024-09-12T00:05:39.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.004 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.004 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169392+0000", 2024-09-12T00:05:39.004 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1967000000000001e-05 2024-09-12T00:05:39.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.004 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.004 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169519+0000", 2024-09-12T00:05:39.004 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012686199999999999 2024-09-12T00:05:39.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.005 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.005 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169789+0000", 2024-09-12T00:05:39.005 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027062700000000001 2024-09-12T00:05:39.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.005 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:39.005 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.170614+0000", 2024-09-12T00:05:39.005 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00082475799999999998 2024-09-12T00:05:39.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.006 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.006 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.183665+0000", 2024-09-12T00:05:39.006 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013051269000000001 2024-09-12T00:05:39.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.006 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.006 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186367+0000", 2024-09-12T00:05:39.006 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002701789 2024-09-12T00:05:39.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.007 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.007 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186485+0000", 2024-09-12T00:05:39.007 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011763400000000001 2024-09-12T00:05:39.007 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.007 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.007 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.007 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186587+0000", 2024-09-12T00:05:39.008 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010262700000000001 2024-09-12T00:05:39.008 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.008 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.008 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.008 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.008 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.008 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2718 3.4 3:20fe36bb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:39.008 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:39.008 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 51.207729450000002, 2024-09-12T00:05:39.008 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027867928, 2024-09-12T00:05:39.008 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.009 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.009 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.009 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.009 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.009 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.009 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2718 2024-09-12T00:05:39.009 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.009 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.009 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.009 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.009 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:39.009 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.010 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.010 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.010 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:39.010 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.010 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.010 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.010 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785584+0000", 2024-09-12T00:05:39.010 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.056e-06 2024-09-12T00:05:39.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.010 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.010 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.010 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792023+0000", 2024-09-12T00:05:39.011 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064398069999999996 2024-09-12T00:05:39.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.011 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.011 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.011 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792058+0000", 2024-09-12T00:05:39.011 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5018000000000003e-05 2024-09-12T00:05:39.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.011 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.011 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.011 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792078+0000", 2024-09-12T00:05:39.011 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9862000000000001e-05 2024-09-12T00:05:39.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.012 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.012 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792248+0000", 2024-09-12T00:05:39.012 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017006399999999999 2024-09-12T00:05:39.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.012 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.012 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792660+0000", 2024-09-12T00:05:39.012 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041189500000000001 2024-09-12T00:05:39.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.012 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:39.012 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793081+0000", 2024-09-12T00:05:39.012 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000420395 2024-09-12T00:05:39.013 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.013 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.013 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.013 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808422+0000", 2024-09-12T00:05:39.013 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015341626000000001 2024-09-12T00:05:39.013 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.013 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.013 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.013 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813192+0000", 2024-09-12T00:05:39.013 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047701799999999997 2024-09-12T00:05:39.013 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.013 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.013 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.013 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813339+0000", 2024-09-12T00:05:39.013 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014643800000000001 2024-09-12T00:05:39.014 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.014 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.014 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.014 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813449+0000", 2024-09-12T00:05:39.014 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010958700000000001 2024-09-12T00:05:39.014 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.014 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.014 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.014 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.014 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.015 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2719 3.1 3:83b62cc7:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:39.015 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:39.015 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 51.199222013000004, 2024-09-12T00:05:39.015 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021687128999999999, 2024-09-12T00:05:39.015 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.015 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.015 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.015 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.015 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.015 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.015 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2719 2024-09-12T00:05:39.015 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.016 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.016 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.016 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.016 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:39.016 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.016 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.016 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.016 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.016 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:39.016 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.016 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.017 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.017 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.017 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794091+0000", 2024-09-12T00:05:39.017 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0630000000000002e-06 2024-09-12T00:05:39.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.017 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.017 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.017 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800194+0000", 2024-09-12T00:05:39.017 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061025089999999999 2024-09-12T00:05:39.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.017 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.017 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.018 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800234+0000", 2024-09-12T00:05:39.018 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0114999999999998e-05 2024-09-12T00:05:39.018 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.018 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.018 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.018 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800255+0000", 2024-09-12T00:05:39.018 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1548000000000001e-05 2024-09-12T00:05:39.018 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.018 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.018 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.018 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800400+0000", 2024-09-12T00:05:39.018 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014438499999999999 2024-09-12T00:05:39.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.019 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.019 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.019 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800654+0000", 2024-09-12T00:05:39.019 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025430500000000003 2024-09-12T00:05:39.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.019 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.019 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:39.019 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800908+0000", 2024-09-12T00:05:39.019 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025422800000000001 2024-09-12T00:05:39.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.019 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.019 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.020 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.814197+0000", 2024-09-12T00:05:39.020 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013289216 2024-09-12T00:05:39.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.020 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.020 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.020 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815578+0000", 2024-09-12T00:05:39.020 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00138079 2024-09-12T00:05:39.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.020 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.020 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.020 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815704+0000", 2024-09-12T00:05:39.020 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012551500000000001 2024-09-12T00:05:39.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.020 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.021 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.021 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815775+0000", 2024-09-12T00:05:39.021 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1454999999999999e-05 2024-09-12T00:05:39.021 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.021 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.021 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.021 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.021 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.021 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2736 3.25 3:a750a681:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:39.021 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:39.021 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 51.017957088000003, 2024-09-12T00:05:39.021 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025701234999999999, 2024-09-12T00:05:39.021 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.021 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.021 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.022 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.022 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.022 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.022 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2736 2024-09-12T00:05:39.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.022 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.022 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.022 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.022 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:39.022 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.022 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.022 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.022 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:39.023 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.023 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.023 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975357+0000", 2024-09-12T00:05:39.023 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9389999999999999e-06 2024-09-12T00:05:39.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.023 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.023 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979365+0000", 2024-09-12T00:05:39.023 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040076679999999998 2024-09-12T00:05:39.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.024 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.024 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.024 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979402+0000", 2024-09-12T00:05:39.024 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7557e-05 2024-09-12T00:05:39.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.024 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.024 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.024 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979419+0000", 2024-09-12T00:05:39.024 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7203000000000001e-05 2024-09-12T00:05:39.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.024 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.024 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.024 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979543+0000", 2024-09-12T00:05:39.025 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000123423 2024-09-12T00:05:39.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.025 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.025 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979784+0000", 2024-09-12T00:05:39.025 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024097800000000001 2024-09-12T00:05:39.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.025 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:39.025 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980013+0000", 2024-09-12T00:05:39.025 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022881999999999999 2024-09-12T00:05:39.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.026 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.026 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.999860+0000", 2024-09-12T00:05:39.026 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019847908000000001 2024-09-12T00:05:39.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.026 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.026 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.026 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000741+0000", 2024-09-12T00:05:39.026 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00088041499999999995 2024-09-12T00:05:39.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.026 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.026 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.026 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000915+0000", 2024-09-12T00:05:39.026 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017460300000000001 2024-09-12T00:05:39.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.027 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.027 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.027 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.001054+0000", 2024-09-12T00:05:39.027 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013872099999999999 2024-09-12T00:05:39.027 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.027 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.027 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.027 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.027 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2737 3.25 3:a794c975:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:39.027 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:39.027 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 51.007944281999997, 2024-09-12T00:05:39.028 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022562862999999999, 2024-09-12T00:05:39.028 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.028 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.028 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.028 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.028 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.028 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.028 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2737 2024-09-12T00:05:39.028 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.028 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.028 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.028 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.028 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:39.029 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.029 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.029 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.029 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.029 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:39.029 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.029 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.029 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.029 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.029 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985368+0000", 2024-09-12T00:05:39.029 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.323e-06 2024-09-12T00:05:39.029 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.030 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.030 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990209+0000", 2024-09-12T00:05:39.030 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004840446 2024-09-12T00:05:39.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.030 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.030 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990255+0000", 2024-09-12T00:05:39.030 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6526999999999997e-05 2024-09-12T00:05:39.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.030 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.030 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990283+0000", 2024-09-12T00:05:39.030 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7631e-05 2024-09-12T00:05:39.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.031 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.031 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990445+0000", 2024-09-12T00:05:39.031 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016238400000000001 2024-09-12T00:05:39.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.031 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.031 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990732+0000", 2024-09-12T00:05:39.031 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028698299999999999 2024-09-12T00:05:39.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.031 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.031 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:39.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.991001+0000", 2024-09-12T00:05:39.031 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026869099999999999 2024-09-12T00:05:39.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.032 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.032 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007077+0000", 2024-09-12T00:05:39.032 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016076686999999999 2024-09-12T00:05:39.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.032 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.032 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007761+0000", 2024-09-12T00:05:39.032 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00068366399999999995 2024-09-12T00:05:39.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.033 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.033 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007860+0000", 2024-09-12T00:05:39.033 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8513999999999999e-05 2024-09-12T00:05:39.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.033 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.033 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.033 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007929+0000", 2024-09-12T00:05:39.033 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9012999999999998e-05 2024-09-12T00:05:39.033 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.033 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.033 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.034 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.034 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2751 3.4 3:20d2ffb1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:39.034 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.134356+0000", 2024-09-12T00:05:39.034 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 50.858954498999999, 2024-09-12T00:05:39.034 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020400522000000001, 2024-09-12T00:05:39.034 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.034 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.034 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.034 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.034 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.034 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.034 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2751 2024-09-12T00:05:39.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.035 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.035 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.035 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.035 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.134356+0000", 2024-09-12T00:05:39.035 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.035 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.035 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.035 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.134356+0000", 2024-09-12T00:05:39.035 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.036 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.036 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.036 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.134359+0000", 2024-09-12T00:05:39.036 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9900000000000002e-06 2024-09-12T00:05:39.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.036 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.036 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.036 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138490+0000", 2024-09-12T00:05:39.036 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041315609999999997 2024-09-12T00:05:39.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.036 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.036 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.037 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138524+0000", 2024-09-12T00:05:39.037 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3868000000000002e-05 2024-09-12T00:05:39.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.037 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.037 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.037 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138544+0000", 2024-09-12T00:05:39.037 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9539e-05 2024-09-12T00:05:39.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.037 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.037 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.037 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138697+0000", 2024-09-12T00:05:39.038 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015332400000000001 2024-09-12T00:05:39.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.038 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.038 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.038 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.138931+0000", 2024-09-12T00:05:39.038 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023418700000000001 2024-09-12T00:05:39.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.038 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.038 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:39.038 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.139162+0000", 2024-09-12T00:05:39.038 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000230943 2024-09-12T00:05:39.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.039 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.039 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.149454+0000", 2024-09-12T00:05:39.039 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010291560999999999 2024-09-12T00:05:39.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.039 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.039 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.153905+0000", 2024-09-12T00:05:39.039 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004451666 2024-09-12T00:05:39.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.040 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.040 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154405+0000", 2024-09-12T00:05:39.040 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00049978100000000003 2024-09-12T00:05:39.040 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.040 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.040 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.040 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.154756+0000", 2024-09-12T00:05:39.040 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000351102 2024-09-12T00:05:39.040 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.040 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.040 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.041 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.041 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2755 3.25 3:a666dbcf:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:39.041 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.181692+0000", 2024-09-12T00:05:39.041 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 50.811618084000003, 2024-09-12T00:05:39.041 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020464659, 2024-09-12T00:05:39.041 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.041 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.041 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.041 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.041 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.042 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.042 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2755 2024-09-12T00:05:39.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.042 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.042 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.042 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.042 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.181692+0000", 2024-09-12T00:05:39.042 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.042 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.042 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.043 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.181692+0000", 2024-09-12T00:05:39.043 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.043 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.043 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.043 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.181695+0000", 2024-09-12T00:05:39.043 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0800000000000002e-06 2024-09-12T00:05:39.043 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.043 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.043 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185668+0000", 2024-09-12T00:05:39.043 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039727970000000001 2024-09-12T00:05:39.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.044 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.044 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.044 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185699+0000", 2024-09-12T00:05:39.044 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1424999999999998e-05 2024-09-12T00:05:39.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.044 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.044 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.044 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185722+0000", 2024-09-12T00:05:39.044 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2972e-05 2024-09-12T00:05:39.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.045 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.045 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.045 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.185860+0000", 2024-09-12T00:05:39.045 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000138016 2024-09-12T00:05:39.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.045 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.045 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.045 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.186096+0000", 2024-09-12T00:05:39.045 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023611899999999999 2024-09-12T00:05:39.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.045 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.045 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:39.046 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.186318+0000", 2024-09-12T00:05:39.046 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000221177 2024-09-12T00:05:39.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.046 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.046 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.199301+0000", 2024-09-12T00:05:39.046 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012983949999999999 2024-09-12T00:05:39.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.046 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.046 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.201991+0000", 2024-09-12T00:05:39.046 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026896889999999999 2024-09-12T00:05:39.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.047 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.047 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.202083+0000", 2024-09-12T00:05:39.047 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1598e-05 2024-09-12T00:05:39.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.047 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.047 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.202157+0000", 2024-09-12T00:05:39.047 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3836000000000003e-05 2024-09-12T00:05:39.047 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.047 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.048 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.048 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.048 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.048 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2962 3.18 e75/23 3:1b55431a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_1:head v 75'6, mlcod=63'4)", 2024-09-12T00:05:39.048 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:19.990870+0000", 2024-09-12T00:05:39.048 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.002440098000001, 2024-09-12T00:05:39.048 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018164309999999999, 2024-09-12T00:05:39.048 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.048 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.048 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.048 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.048 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.048 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.049 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990870+0000", 2024-09-12T00:05:39.049 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.049 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.049 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.049 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990870+0000", 2024-09-12T00:05:39.049 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.049 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.049 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.049 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.990873+0000", 2024-09-12T00:05:39.049 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3799999999999998e-06 2024-09-12T00:05:39.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.049 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.050 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.050 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995189+0000", 2024-09-12T00:05:39.050 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004315859 2024-09-12T00:05:39.050 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.050 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.050 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.050 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995232+0000", 2024-09-12T00:05:39.050 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2636000000000003e-05 2024-09-12T00:05:39.050 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.050 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.050 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.050 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995249+0000", 2024-09-12T00:05:39.050 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7563000000000001e-05 2024-09-12T00:05:39.050 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.051 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.051 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995357+0000", 2024-09-12T00:05:39.051 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010737 2024-09-12T00:05:39.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.051 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.051 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:19.995386+0000", 2024-09-12T00:05:39.051 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8895999999999999e-05 2024-09-12T00:05:39.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.051 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.051 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.008964+0000", 2024-09-12T00:05:39.051 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013578209000000001 2024-09-12T00:05:39.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.052 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.052 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.052 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.009034+0000", 2024-09-12T00:05:39.052 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.0396999999999997e-05 2024-09-12T00:05:39.052 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.052 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.052 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.052 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.052 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2964 3.24 3:26c83ec0:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:39.052 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:39.052 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 18.987895286000001, 2024-09-12T00:05:39.052 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028979713000000001, 2024-09-12T00:05:39.052 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.053 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.053 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.053 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.053 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.053 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.053 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2964 2024-09-12T00:05:39.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.053 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.053 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.053 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.053 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:39.053 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.054 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.054 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.054 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:39.054 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.054 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.054 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.054 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005417+0000", 2024-09-12T00:05:39.054 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2450000000000001e-06 2024-09-12T00:05:39.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.054 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.054 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.054 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010885+0000", 2024-09-12T00:05:39.054 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054684809999999999 2024-09-12T00:05:39.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.055 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.055 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010901+0000", 2024-09-12T00:05:39.055 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5097e-05 2024-09-12T00:05:39.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.055 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.055 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010908+0000", 2024-09-12T00:05:39.055 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7419999999999997e-06 2024-09-12T00:05:39.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.055 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.055 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010968+0000", 2024-09-12T00:05:39.055 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.9837000000000003e-05 2024-09-12T00:05:39.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.056 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.056 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.056 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011082+0000", 2024-09-12T00:05:39.056 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011357399999999999 2024-09-12T00:05:39.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.056 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.056 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:39.056 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011174+0000", 2024-09-12T00:05:39.056 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2703999999999999e-05 2024-09-12T00:05:39.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.056 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.056 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.056 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.021639+0000", 2024-09-12T00:05:39.057 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010464641 2024-09-12T00:05:39.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.057 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.057 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034210+0000", 2024-09-12T00:05:39.057 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012570463 2024-09-12T00:05:39.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.057 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.057 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034300+0000", 2024-09-12T00:05:39.057 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0691000000000003e-05 2024-09-12T00:05:39.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.057 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.057 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034394+0000", 2024-09-12T00:05:39.058 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4238000000000001e-05 2024-09-12T00:05:39.058 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.058 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.058 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.058 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.058 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2968 3.25 3:a7d7195d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:39.058 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.046591+0000", 2024-09-12T00:05:39.058 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 18.946719182999999, 2024-09-12T00:05:39.058 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019137155999999999, 2024-09-12T00:05:39.058 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.058 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.059 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.059 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.059 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.059 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.059 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2968 2024-09-12T00:05:39.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.059 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.059 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.059 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.059 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.046591+0000", 2024-09-12T00:05:39.059 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.060 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.046591+0000", 2024-09-12T00:05:39.060 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.060 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.046594+0000", 2024-09-12T00:05:39.060 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0759999999999999e-06 2024-09-12T00:05:39.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.061 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.050723+0000", 2024-09-12T00:05:39.061 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041287700000000004 2024-09-12T00:05:39.061 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.061 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.061 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.061 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.050749+0000", 2024-09-12T00:05:39.061 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5958000000000001e-05 2024-09-12T00:05:39.061 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.061 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.061 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.061 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.050760+0000", 2024-09-12T00:05:39.061 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1367e-05 2024-09-12T00:05:39.062 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.062 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.062 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.062 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.050855+0000", 2024-09-12T00:05:39.062 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5043999999999993e-05 2024-09-12T00:05:39.062 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.062 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.062 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.062 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.051009+0000", 2024-09-12T00:05:39.062 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015416799999999999 2024-09-12T00:05:39.062 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.062 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.063 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:39.063 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.051169+0000", 2024-09-12T00:05:39.063 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000159858 2024-09-12T00:05:39.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.063 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.063 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.063 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.057181+0000", 2024-09-12T00:05:39.063 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006011438 2024-09-12T00:05:39.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.063 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.063 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.063 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.065613+0000", 2024-09-12T00:05:39.064 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0084321569999999992 2024-09-12T00:05:39.064 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.064 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.064 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.064 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.065670+0000", 2024-09-12T00:05:39.064 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7089000000000002e-05 2024-09-12T00:05:39.064 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.064 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.064 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.064 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.065728+0000", 2024-09-12T00:05:39.064 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8230999999999999e-05 2024-09-12T00:05:39.065 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.065 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.065 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.065 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.065 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3052 3.32 3:4d6db9ea:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:39.065 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:39.065 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 18.013648660000001, 2024-09-12T00:05:39.065 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028091277000000001, 2024-09-12T00:05:39.065 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.065 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.065 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.066 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.066 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.066 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.066 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3052 2024-09-12T00:05:39.066 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.066 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.066 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.066 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.066 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:39.066 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.066 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.066 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.067 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.067 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:39.067 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.067 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.067 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.067 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.067 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979664+0000", 2024-09-12T00:05:39.067 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:05:39.067 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.067 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.067 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.067 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986918+0000", 2024-09-12T00:05:39.068 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0072537110000000004 2024-09-12T00:05:39.068 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.068 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.068 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.068 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986956+0000", 2024-09-12T00:05:39.068 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8111999999999997e-05 2024-09-12T00:05:39.068 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.068 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.068 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.068 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986975+0000", 2024-09-12T00:05:39.068 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9245999999999998e-05 2024-09-12T00:05:39.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.069 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.069 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.069 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987159+0000", 2024-09-12T00:05:39.069 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000183828 2024-09-12T00:05:39.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.069 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.069 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.069 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987552+0000", 2024-09-12T00:05:39.069 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039349699999999998 2024-09-12T00:05:39.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.069 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.070 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:39.070 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987943+0000", 2024-09-12T00:05:39.070 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000390579 2024-09-12T00:05:39.070 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.070 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.070 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.070 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.999384+0000", 2024-09-12T00:05:39.070 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011441563 2024-09-12T00:05:39.070 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.070 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.070 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.071 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007634+0000", 2024-09-12T00:05:39.071 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082496240000000005 2024-09-12T00:05:39.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.071 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.071 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.071 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007699+0000", 2024-09-12T00:05:39.071 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5089e-05 2024-09-12T00:05:39.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.071 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.071 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.071 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007753+0000", 2024-09-12T00:05:39.071 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3588000000000003e-05 2024-09-12T00:05:39.071 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.071 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.072 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.072 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.072 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.072 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3064 3.4 3:209c6609:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:39.072 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:39.072 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.881333382000001, 2024-09-12T00:05:39.072 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024628305999999999, 2024-09-12T00:05:39.072 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.072 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.072 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.072 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.073 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.073 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.073 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3064 2024-09-12T00:05:39.073 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.073 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.073 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.073 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.073 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:39.073 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.073 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.073 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.074 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.074 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:39.074 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.074 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.074 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.074 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111980+0000", 2024-09-12T00:05:39.074 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.005e-06 2024-09-12T00:05:39.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.074 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.074 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.074 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116464+0000", 2024-09-12T00:05:39.075 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044839210000000001 2024-09-12T00:05:39.075 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.075 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.075 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.075 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116490+0000", 2024-09-12T00:05:39.075 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6690999999999999e-05 2024-09-12T00:05:39.075 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.075 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.075 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.075 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116504+0000", 2024-09-12T00:05:39.075 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4109e-05 2024-09-12T00:05:39.075 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.076 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.076 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.076 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116639+0000", 2024-09-12T00:05:39.076 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013427 2024-09-12T00:05:39.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.076 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.076 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.076 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116931+0000", 2024-09-12T00:05:39.076 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000292603 2024-09-12T00:05:39.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.076 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.076 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:39.076 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.117174+0000", 2024-09-12T00:05:39.077 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024240700000000001 2024-09-12T00:05:39.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.077 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.077 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.077 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126449+0000", 2024-09-12T00:05:39.077 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0092748699999999993 2024-09-12T00:05:39.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.077 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.077 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.077 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136438+0000", 2024-09-12T00:05:39.077 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099898539999999994 2024-09-12T00:05:39.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.077 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.077 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.078 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136532+0000", 2024-09-12T00:05:39.078 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3898000000000001e-05 2024-09-12T00:05:39.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.078 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.078 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.078 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136605+0000", 2024-09-12T00:05:39.078 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2677999999999998e-05 2024-09-12T00:05:39.078 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.078 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.078 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.078 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.078 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3094 3.33 3:cfcc7f7f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:39.078 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.540440+0000", 2024-09-12T00:05:39.078 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.452870259000001, 2024-09-12T00:05:39.079 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021132270000000002, 2024-09-12T00:05:39.079 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.079 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.079 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.079 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.079 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.079 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.079 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3094 2024-09-12T00:05:39.079 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.079 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.079 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.079 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.079 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540440+0000", 2024-09-12T00:05:39.079 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.080 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.080 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.080 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.080 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540440+0000", 2024-09-12T00:05:39.080 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.080 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.080 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.080 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.080 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540442+0000", 2024-09-12T00:05:39.080 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9599999999999999e-06 2024-09-12T00:05:39.080 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.080 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.080 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.080 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545099+0000", 2024-09-12T00:05:39.081 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046570359999999998 2024-09-12T00:05:39.081 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.081 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.081 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.081 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545122+0000", 2024-09-12T00:05:39.081 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3485999999999998e-05 2024-09-12T00:05:39.081 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.081 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.081 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.081 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545135+0000", 2024-09-12T00:05:39.081 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3073e-05 2024-09-12T00:05:39.081 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.081 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.081 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.082 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545252+0000", 2024-09-12T00:05:39.082 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011621299999999999 2024-09-12T00:05:39.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.082 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.082 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.082 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545450+0000", 2024-09-12T00:05:39.082 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000198474 2024-09-12T00:05:39.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.082 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.082 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:39.082 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545580+0000", 2024-09-12T00:05:39.082 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013033899999999999 2024-09-12T00:05:39.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.082 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.082 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.083 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.552356+0000", 2024-09-12T00:05:39.083 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0067756240000000001 2024-09-12T00:05:39.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.083 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.083 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.083 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.560831+0000", 2024-09-12T00:05:39.083 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0084745440000000005 2024-09-12T00:05:39.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.083 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.083 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.083 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.561038+0000", 2024-09-12T00:05:39.083 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000207565 2024-09-12T00:05:39.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.083 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.084 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.084 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.561572+0000", 2024-09-12T00:05:39.084 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00053395600000000004 2024-09-12T00:05:39.084 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.084 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.084 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.084 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.084 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3097 3.33 3:cc1991a3:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:39.084 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.588213+0000", 2024-09-12T00:05:39.084 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.405097471000001, 2024-09-12T00:05:39.084 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021968250000000002, 2024-09-12T00:05:39.084 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.084 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.085 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.085 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.085 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.085 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.085 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3097 2024-09-12T00:05:39.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.085 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.085 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.085 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.085 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.588213+0000", 2024-09-12T00:05:39.085 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.085 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.085 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.086 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.588213+0000", 2024-09-12T00:05:39.086 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.086 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.086 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.086 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.588215+0000", 2024-09-12T00:05:39.086 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7049999999999999e-06 2024-09-12T00:05:39.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.086 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.086 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.086 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592148+0000", 2024-09-12T00:05:39.086 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039329639999999997 2024-09-12T00:05:39.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.086 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.086 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.087 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592173+0000", 2024-09-12T00:05:39.087 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4596999999999998e-05 2024-09-12T00:05:39.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.087 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.087 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.087 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592188+0000", 2024-09-12T00:05:39.087 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4994000000000001e-05 2024-09-12T00:05:39.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.087 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.087 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.087 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592372+0000", 2024-09-12T00:05:39.087 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018397899999999999 2024-09-12T00:05:39.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.087 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.088 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.088 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592639+0000", 2024-09-12T00:05:39.088 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026700299999999998 2024-09-12T00:05:39.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.088 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.088 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:39.088 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592916+0000", 2024-09-12T00:05:39.088 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027759300000000002 2024-09-12T00:05:39.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.088 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.088 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.088 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.602239+0000", 2024-09-12T00:05:39.089 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0093227550000000003 2024-09-12T00:05:39.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.089 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.089 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.089 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.609997+0000", 2024-09-12T00:05:39.089 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077576390000000002 2024-09-12T00:05:39.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.089 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.089 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.089 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.610109+0000", 2024-09-12T00:05:39.089 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000111753 2024-09-12T00:05:39.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.090 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.090 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.090 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.610181+0000", 2024-09-12T00:05:39.090 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2268000000000007e-05 2024-09-12T00:05:39.090 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.090 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.090 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.091 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.091 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3107 3.25 3:a6170c4d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:39.091 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.700176+0000", 2024-09-12T00:05:39.091 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.293134152, 2024-09-12T00:05:39.091 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018099869000000001, 2024-09-12T00:05:39.091 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.091 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.091 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.091 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.091 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.091 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.092 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3107 2024-09-12T00:05:39.092 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.092 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.092 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.092 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.092 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.700176+0000", 2024-09-12T00:05:39.092 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.092 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.092 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.092 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.092 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.700176+0000", 2024-09-12T00:05:39.092 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.093 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.093 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.093 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.093 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.700179+0000", 2024-09-12T00:05:39.093 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8760000000000001e-06 2024-09-12T00:05:39.093 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.093 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.093 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.093 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704197+0000", 2024-09-12T00:05:39.093 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040179689999999997 2024-09-12T00:05:39.093 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.093 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.094 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.094 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704226+0000", 2024-09-12T00:05:39.094 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8943000000000001e-05 2024-09-12T00:05:39.094 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.094 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.094 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.094 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704238+0000", 2024-09-12T00:05:39.094 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1911e-05 2024-09-12T00:05:39.094 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.094 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.094 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.094 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704344+0000", 2024-09-12T00:05:39.095 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000106259 2024-09-12T00:05:39.095 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.095 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.095 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.095 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704582+0000", 2024-09-12T00:05:39.095 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000238371 2024-09-12T00:05:39.095 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.095 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.095 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:39.095 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.704823+0000", 2024-09-12T00:05:39.095 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000240304 2024-09-12T00:05:39.095 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.096 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.096 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.096 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.716320+0000", 2024-09-12T00:05:39.096 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011497965000000001 2024-09-12T00:05:39.096 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.096 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.096 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.096 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.718165+0000", 2024-09-12T00:05:39.096 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00184453 2024-09-12T00:05:39.096 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.096 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.096 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.096 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.718238+0000", 2024-09-12T00:05:39.097 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2847000000000002e-05 2024-09-12T00:05:39.097 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.097 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.097 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.097 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.718276+0000", 2024-09-12T00:05:39.097 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7894e-05 2024-09-12T00:05:39.097 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.097 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.097 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.097 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.097 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.098 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3125 3.12 3:495b0235:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:39.098 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:39.098 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.077539377000001, 2024-09-12T00:05:39.098 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030616648999999999, 2024-09-12T00:05:39.098 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.098 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.098 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.098 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.098 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.098 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.098 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3125 2024-09-12T00:05:39.098 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.099 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.099 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.099 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.099 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:39.099 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.099 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.099 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.099 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:39.099 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.099 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.100 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.100 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915773+0000", 2024-09-12T00:05:39.100 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2800000000000002e-06 2024-09-12T00:05:39.100 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.100 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.100 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.100 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919856+0000", 2024-09-12T00:05:39.100 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004082713 2024-09-12T00:05:39.100 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.100 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.100 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.100 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919879+0000", 2024-09-12T00:05:39.101 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3782e-05 2024-09-12T00:05:39.101 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.101 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.101 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.101 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919891+0000", 2024-09-12T00:05:39.101 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1440000000000001e-05 2024-09-12T00:05:39.101 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.101 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.101 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.101 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920037+0000", 2024-09-12T00:05:39.101 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014562700000000001 2024-09-12T00:05:39.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.102 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.102 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.102 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920280+0000", 2024-09-12T00:05:39.102 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000243274 2024-09-12T00:05:39.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.102 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.102 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:39.102 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920527+0000", 2024-09-12T00:05:39.103 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024692699999999998 2024-09-12T00:05:39.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.103 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.103 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.103 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.932485+0000", 2024-09-12T00:05:39.103 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011957857000000001 2024-09-12T00:05:39.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.103 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.103 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.103 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946197+0000", 2024-09-12T00:05:39.103 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013712436999999999 2024-09-12T00:05:39.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.104 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.104 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.104 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946305+0000", 2024-09-12T00:05:39.104 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000107914 2024-09-12T00:05:39.104 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.104 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.104 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.104 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946387+0000", 2024-09-12T00:05:39.104 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2398000000000006e-05 2024-09-12T00:05:39.104 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.104 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.104 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.105 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.105 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.105 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3127 3.24 3:2477ff85:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:39.105 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.943043+0000", 2024-09-12T00:05:39.105 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.050266868000001, 2024-09-12T00:05:39.105 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020914724999999999, 2024-09-12T00:05:39.105 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.105 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.105 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.105 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.105 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.105 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.106 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3127 2024-09-12T00:05:39.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.106 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.106 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.106 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.106 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.943043+0000", 2024-09-12T00:05:39.106 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.106 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.106 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.106 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.943043+0000", 2024-09-12T00:05:39.106 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.106 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.106 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.107 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.943046+0000", 2024-09-12T00:05:39.107 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3069999999999998e-06 2024-09-12T00:05:39.107 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.107 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.107 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.107 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947004+0000", 2024-09-12T00:05:39.107 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039575360000000002 2024-09-12T00:05:39.107 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.107 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.107 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.107 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947022+0000", 2024-09-12T00:05:39.107 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7847e-05 2024-09-12T00:05:39.107 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.107 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.108 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.108 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947030+0000", 2024-09-12T00:05:39.108 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.5399999999999996e-06 2024-09-12T00:05:39.108 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.108 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.108 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.108 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947087+0000", 2024-09-12T00:05:39.108 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6496999999999998e-05 2024-09-12T00:05:39.108 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.108 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.108 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.108 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947251+0000", 2024-09-12T00:05:39.108 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016407499999999999 2024-09-12T00:05:39.109 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.109 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.109 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:39.109 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947422+0000", 2024-09-12T00:05:39.109 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017108 2024-09-12T00:05:39.109 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.109 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.109 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.109 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.953910+0000", 2024-09-12T00:05:39.109 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064883980000000003 2024-09-12T00:05:39.109 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.109 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.109 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.109 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.963872+0000", 2024-09-12T00:05:39.110 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099617839999999996 2024-09-12T00:05:39.110 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.110 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.110 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.110 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.963918+0000", 2024-09-12T00:05:39.110 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5692999999999998e-05 2024-09-12T00:05:39.110 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.110 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.110 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.110 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.963958+0000", 2024-09-12T00:05:39.110 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9968000000000001e-05 2024-09-12T00:05:39.110 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.110 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.110 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.111 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.111 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.111 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3132 3.4 3:216a5295:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:39.111 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.015391+0000", 2024-09-12T00:05:39.111 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.977919172, 2024-09-12T00:05:39.111 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022006318, 2024-09-12T00:05:39.111 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.111 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.111 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.111 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.111 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.111 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.111 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3132 2024-09-12T00:05:39.111 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.111 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.112 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.112 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.112 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.015391+0000", 2024-09-12T00:05:39.112 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.112 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.112 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.112 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.015391+0000", 2024-09-12T00:05:39.112 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.112 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.112 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.112 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.015394+0000", 2024-09-12T00:05:39.112 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6260000000000001e-06 2024-09-12T00:05:39.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.113 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.113 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.113 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.019828+0000", 2024-09-12T00:05:39.113 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044333109999999997 2024-09-12T00:05:39.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.113 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.113 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.113 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.019859+0000", 2024-09-12T00:05:39.113 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1575999999999997e-05 2024-09-12T00:05:39.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.113 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.113 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.113 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.019875+0000", 2024-09-12T00:05:39.113 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5875999999999998e-05 2024-09-12T00:05:39.114 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.114 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.114 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.114 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.020009+0000", 2024-09-12T00:05:39.114 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133953 2024-09-12T00:05:39.114 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.114 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.114 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.114 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.020264+0000", 2024-09-12T00:05:39.114 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025509000000000003 2024-09-12T00:05:39.114 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.114 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.114 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:39.114 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.020504+0000", 2024-09-12T00:05:39.115 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000240184 2024-09-12T00:05:39.115 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.115 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.115 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.115 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.031616+0000", 2024-09-12T00:05:39.115 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011111843 2024-09-12T00:05:39.115 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.115 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.115 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.115 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.037072+0000", 2024-09-12T00:05:39.115 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054553400000000004 2024-09-12T00:05:39.115 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.116 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.116 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.116 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.037271+0000", 2024-09-12T00:05:39.116 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000199199 2024-09-12T00:05:39.116 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.116 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.116 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.116 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.037397+0000", 2024-09-12T00:05:39.116 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012632 2024-09-12T00:05:39.116 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.116 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.116 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.117 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.117 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3134 3.24 3:2525a955:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:39.117 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:39.117 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.953462646999998, 2024-09-12T00:05:39.117 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025606806999999999, 2024-09-12T00:05:39.117 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.117 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.117 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.117 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.117 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.117 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.118 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3134 2024-09-12T00:05:39.118 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.118 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.118 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.118 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.118 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:39.118 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.118 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.118 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.118 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.118 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:39.118 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.119 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.119 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.119 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039850+0000", 2024-09-12T00:05:39.119 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9780000000000001e-06 2024-09-12T00:05:39.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.119 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.119 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.119 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045256+0000", 2024-09-12T00:05:39.119 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054058129999999998 2024-09-12T00:05:39.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.119 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.120 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.120 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045284+0000", 2024-09-12T00:05:39.120 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8065e-05 2024-09-12T00:05:39.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.120 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.120 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.120 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045297+0000", 2024-09-12T00:05:39.120 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2788e-05 2024-09-12T00:05:39.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.120 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.120 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.120 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045378+0000", 2024-09-12T00:05:39.120 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1079000000000001e-05 2024-09-12T00:05:39.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.121 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.121 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.121 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045530+0000", 2024-09-12T00:05:39.121 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015206099999999999 2024-09-12T00:05:39.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.121 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.121 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:39.121 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045655+0000", 2024-09-12T00:05:39.121 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012525899999999999 2024-09-12T00:05:39.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.122 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.122 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.122 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.054817+0000", 2024-09-12T00:05:39.122 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0091611049999999992 2024-09-12T00:05:39.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.122 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.122 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.122 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065354+0000", 2024-09-12T00:05:39.122 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010537625 2024-09-12T00:05:39.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.122 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.122 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.123 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065410+0000", 2024-09-12T00:05:39.123 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6141999999999999e-05 2024-09-12T00:05:39.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.123 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.123 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065454+0000", 2024-09-12T00:05:39.123 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3891999999999999e-05 2024-09-12T00:05:39.123 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.123 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.123 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.123 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.123 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.123 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:39.125 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:05:39.126 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:39.124+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:39.225 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:39.224+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:39.293 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:39.294 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:39.294 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:39.294 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:39.308 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:05:39.326 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:39.328+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:39.427 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:39.428+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:39.474 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:39.474 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:39.474 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:39.474 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:39.474 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:39.490 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:05:39.530 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:39.532+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:39.630 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:39.632+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:39.655 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T00:05:39.658 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:39.659 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:39.659 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:39.659 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:39.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.659 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:1646 3.25 e58/23 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head v 58'1, mlcod=0'0)", 2024-09-12T00:05:39.659 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:39.659 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 66.571173372999993, 2024-09-12T00:05:39.659 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020301987000000001, 2024-09-12T00:05:39.659 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.659 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.659 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.659 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.660 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.660 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:39.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.660 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.660 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:39.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.661 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.661 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086308+0000", 2024-09-12T00:05:39.661 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.95e-06 2024-09-12T00:05:39.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.661 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.661 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.661 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091174+0000", 2024-09-12T00:05:39.661 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048660559999999997 2024-09-12T00:05:39.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.661 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.661 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.661 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091218+0000", 2024-09-12T00:05:39.661 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4678999999999997e-05 2024-09-12T00:05:39.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091238+0000", 2024-09-12T00:05:39.662 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9839000000000001e-05 2024-09-12T00:05:39.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091396+0000", 2024-09-12T00:05:39.662 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000157396 2024-09-12T00:05:39.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091451+0000", 2024-09-12T00:05:39.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5547999999999997e-05 2024-09-12T00:05:39.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.663 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106474+0000", 2024-09-12T00:05:39.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015023287 2024-09-12T00:05:39.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.663 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106608+0000", 2024-09-12T00:05:39.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133232 2024-09-12T00:05:39.663 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.664 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.664 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.664 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.664 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2667 3.8 e63/23 3:1177e826:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_162:head v 63'5, mlcod=63'3)", 2024-09-12T00:05:39.664 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.378028+0000", 2024-09-12T00:05:39.664 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 52.2794515, 2024-09-12T00:05:39.664 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018606185000000001, 2024-09-12T00:05:39.664 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.664 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.665 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.665 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.665 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.665 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.665 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.378028+0000", 2024-09-12T00:05:39.665 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.665 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.665 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.665 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.378028+0000", 2024-09-12T00:05:39.665 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.665 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.666 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.666 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.378031+0000", 2024-09-12T00:05:39.666 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9330000000000001e-06 2024-09-12T00:05:39.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.666 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.666 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.666 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383422+0000", 2024-09-12T00:05:39.666 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005391163 2024-09-12T00:05:39.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.666 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.666 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.666 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383455+0000", 2024-09-12T00:05:39.666 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3640999999999999e-05 2024-09-12T00:05:39.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383472+0000", 2024-09-12T00:05:39.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7005999999999999e-05 2024-09-12T00:05:39.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383626+0000", 2024-09-12T00:05:39.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015317 2024-09-12T00:05:39.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.383691+0000", 2024-09-12T00:05:39.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5740000000000004e-05 2024-09-12T00:05:39.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.668 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396505+0000", 2024-09-12T00:05:39.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012813702999999999 2024-09-12T00:05:39.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.668 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.396634+0000", 2024-09-12T00:05:39.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012882900000000001 2024-09-12T00:05:39.668 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.668 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.668 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.669 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.669 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2723 3.21 3:86535907:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:39.669 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:39.669 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 51.825325906000003, 2024-09-12T00:05:39.669 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021210407000000001, 2024-09-12T00:05:39.669 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.669 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.669 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.669 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.669 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.669 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.669 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2723 2024-09-12T00:05:39.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.670 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:39.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:39.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832157+0000", 2024-09-12T00:05:39.671 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3270000000000001e-06 2024-09-12T00:05:39.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.671 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.671 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837403+0000", 2024-09-12T00:05:39.671 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005246784 2024-09-12T00:05:39.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.671 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.671 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837439+0000", 2024-09-12T00:05:39.671 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5848e-05 2024-09-12T00:05:39.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.672 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.672 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.672 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837459+0000", 2024-09-12T00:05:39.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9585e-05 2024-09-12T00:05:39.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.672 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.672 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.672 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837574+0000", 2024-09-12T00:05:39.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000114917 2024-09-12T00:05:39.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.672 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837803+0000", 2024-09-12T00:05:39.673 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022967699999999999 2024-09-12T00:05:39.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:39.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838174+0000", 2024-09-12T00:05:39.673 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037083899999999998 2024-09-12T00:05:39.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848447+0000", 2024-09-12T00:05:39.673 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010272439 2024-09-12T00:05:39.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.674 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.674 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.674 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853191+0000", 2024-09-12T00:05:39.674 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047441109999999996 2024-09-12T00:05:39.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.674 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.674 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.674 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853292+0000", 2024-09-12T00:05:39.674 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000101474 2024-09-12T00:05:39.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.674 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.674 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.674 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853364+0000", 2024-09-12T00:05:39.674 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1406e-05 2024-09-12T00:05:39.675 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.675 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.675 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.675 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2729 3.0 e63/23 3:01c0e0c9:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_214:head v 63'6, mlcod=63'4)", 2024-09-12T00:05:39.675 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.902446+0000", 2024-09-12T00:05:39.675 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 51.755033562000001, 2024-09-12T00:05:39.675 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019099029, 2024-09-12T00:05:39.675 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.675 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.675 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.675 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.676 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.676 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902446+0000", 2024-09-12T00:05:39.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.676 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.676 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.676 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902446+0000", 2024-09-12T00:05:39.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.676 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.676 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.676 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.902448+0000", 2024-09-12T00:05:39.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.503e-06 2024-09-12T00:05:39.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906706+0000", 2024-09-12T00:05:39.677 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042580500000000002 2024-09-12T00:05:39.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906743+0000", 2024-09-12T00:05:39.677 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6637999999999997e-05 2024-09-12T00:05:39.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906760+0000", 2024-09-12T00:05:39.678 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6779e-05 2024-09-12T00:05:39.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.678 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.678 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.678 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906891+0000", 2024-09-12T00:05:39.678 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013193499999999999 2024-09-12T00:05:39.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.678 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.678 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.678 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.906932+0000", 2024-09-12T00:05:39.678 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0980999999999999e-05 2024-09-12T00:05:39.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.678 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.678 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.679 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.921375+0000", 2024-09-12T00:05:39.679 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014442119999999999 2024-09-12T00:05:39.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.679 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.679 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.921545+0000", 2024-09-12T00:05:39.679 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017002299999999999 2024-09-12T00:05:39.679 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.679 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.679 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.679 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2736 3.25 e63/23 3:a750a681:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_221:head v 63'5, mlcod=62'3)", 2024-09-12T00:05:39.679 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.980248+0000", 2024-09-12T00:05:39.680 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 51.677231036000002, 2024-09-12T00:05:39.680 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020132552000000001, 2024-09-12T00:05:39.680 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.680 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.680 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.680 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.680 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.680 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.680 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980248+0000", 2024-09-12T00:05:39.680 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.680 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.680 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.681 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980248+0000", 2024-09-12T00:05:39.681 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.681 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.681 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.681 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980251+0000", 2024-09-12T00:05:39.681 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7329999999999999e-06 2024-09-12T00:05:39.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.681 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.681 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.681 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.982917+0000", 2024-09-12T00:05:39.681 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026662679999999998 2024-09-12T00:05:39.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.681 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.682 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.682 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.982960+0000", 2024-09-12T00:05:39.682 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3000999999999997e-05 2024-09-12T00:05:39.682 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.682 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.682 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.682 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.982985+0000", 2024-09-12T00:05:39.682 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5092e-05 2024-09-12T00:05:39.682 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.682 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.682 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.682 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.983163+0000", 2024-09-12T00:05:39.682 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000177942 2024-09-12T00:05:39.682 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.683 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.683 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.683 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.983221+0000", 2024-09-12T00:05:39.683 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7476999999999999e-05 2024-09-12T00:05:39.683 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.683 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.683 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.683 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000301+0000", 2024-09-12T00:05:39.683 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017080503 2024-09-12T00:05:39.683 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.683 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.683 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.683 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000381+0000", 2024-09-12T00:05:39.683 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9536000000000006e-05 2024-09-12T00:05:39.684 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.684 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.684 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.684 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.684 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.684 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2756 3.21 3:849c909c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_241:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:39.684 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.197450+0000", 2024-09-12T00:05:39.684 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 51.460028751999999, 2024-09-12T00:05:39.684 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020201090000000001, 2024-09-12T00:05:39.684 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.684 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.684 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.684 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.684 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.685 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.685 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2756 2024-09-12T00:05:39.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.685 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.685 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.685 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.685 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.197450+0000", 2024-09-12T00:05:39.685 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.685 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.685 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.685 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.197450+0000", 2024-09-12T00:05:39.686 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.686 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.686 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.686 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.197455+0000", 2024-09-12T00:05:39.686 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4070000000000003e-06 2024-09-12T00:05:39.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.686 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.686 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.686 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.202967+0000", 2024-09-12T00:05:39.686 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0055122299999999999 2024-09-12T00:05:39.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.686 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.686 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.687 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203001+0000", 2024-09-12T00:05:39.687 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3685e-05 2024-09-12T00:05:39.687 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.687 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.687 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.687 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203017+0000", 2024-09-12T00:05:39.687 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6622000000000001e-05 2024-09-12T00:05:39.687 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.687 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.687 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.687 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203134+0000", 2024-09-12T00:05:39.687 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117166 2024-09-12T00:05:39.687 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.687 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.688 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.688 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203389+0000", 2024-09-12T00:05:39.688 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025456200000000001 2024-09-12T00:05:39.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.688 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.688 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:39.688 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203625+0000", 2024-09-12T00:05:39.688 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000235856 2024-09-12T00:05:39.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.688 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.688 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.688 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.212670+0000", 2024-09-12T00:05:39.688 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0090446639999999991 2024-09-12T00:05:39.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.689 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.689 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.217469+0000", 2024-09-12T00:05:39.689 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047998559999999999 2024-09-12T00:05:39.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.689 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.689 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.217569+0000", 2024-09-12T00:05:39.689 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9753999999999994e-05 2024-09-12T00:05:39.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.689 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.689 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.217651+0000", 2024-09-12T00:05:39.689 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2287999999999995e-05 2024-09-12T00:05:39.690 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.690 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.690 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.690 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.690 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2969 3.b 3:d2cd1e23:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:39.690 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.057390+0000", 2024-09-12T00:05:39.690 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.600089133000001, 2024-09-12T00:05:39.690 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019453666000000001, 2024-09-12T00:05:39.690 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.690 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.690 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.690 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.690 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.691 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.691 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2969 2024-09-12T00:05:39.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.691 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.691 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.691 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.691 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.057390+0000", 2024-09-12T00:05:39.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.691 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.691 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.691 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.057390+0000", 2024-09-12T00:05:39.691 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.692 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.692 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.692 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.057393+0000", 2024-09-12T00:05:39.692 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8430000000000001e-06 2024-09-12T00:05:39.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.692 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.692 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.692 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062108+0000", 2024-09-12T00:05:39.692 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047149640000000003 2024-09-12T00:05:39.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.692 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.692 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.693 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062130+0000", 2024-09-12T00:05:39.693 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.23e-05 2024-09-12T00:05:39.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.693 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.693 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.693 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062141+0000", 2024-09-12T00:05:39.693 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.111e-05 2024-09-12T00:05:39.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.693 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.693 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.693 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062222+0000", 2024-09-12T00:05:39.693 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0486000000000002e-05 2024-09-12T00:05:39.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.694 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.694 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.694 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062364+0000", 2024-09-12T00:05:39.694 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014189500000000001 2024-09-12T00:05:39.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.694 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.694 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:39.694 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.062496+0000", 2024-09-12T00:05:39.694 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000132182 2024-09-12T00:05:39.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.694 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.694 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.694 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.076301+0000", 2024-09-12T00:05:39.694 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013805128 2024-09-12T00:05:39.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.695 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.695 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.076652+0000", 2024-09-12T00:05:39.695 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00035156899999999998 2024-09-12T00:05:39.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.695 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.695 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.076734+0000", 2024-09-12T00:05:39.695 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1161000000000004e-05 2024-09-12T00:05:39.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.695 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.695 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.695 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.076844+0000", 2024-09-12T00:05:39.695 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000110028 2024-09-12T00:05:39.695 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.696 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.696 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.696 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.696 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2971 3.2e 3:76f45d45:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:39.696 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:39.696 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.581611569, 2024-09-12T00:05:39.696 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022571213, 2024-09-12T00:05:39.696 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.696 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.696 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.696 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.696 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.696 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.697 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2971 2024-09-12T00:05:39.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.697 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.697 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.697 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.697 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:39.697 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.697 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.697 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.697 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:39.697 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.698 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.698 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.698 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075871+0000", 2024-09-12T00:05:39.698 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.467e-06 2024-09-12T00:05:39.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.698 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.698 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.698 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080307+0000", 2024-09-12T00:05:39.698 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044356359999999997 2024-09-12T00:05:39.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.698 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.698 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.698 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080346+0000", 2024-09-12T00:05:39.698 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9267999999999997e-05 2024-09-12T00:05:39.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.699 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.699 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.699 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080368+0000", 2024-09-12T00:05:39.699 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2603e-05 2024-09-12T00:05:39.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.699 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.699 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.699 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080489+0000", 2024-09-12T00:05:39.699 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0001209 2024-09-12T00:05:39.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.699 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.699 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.699 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080830+0000", 2024-09-12T00:05:39.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00034099 2024-09-12T00:05:39.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.700 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:39.700 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.081119+0000", 2024-09-12T00:05:39.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028860300000000001 2024-09-12T00:05:39.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.700 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.700 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.093241+0000", 2024-09-12T00:05:39.700 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012121609 2024-09-12T00:05:39.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.700 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.700 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098277+0000", 2024-09-12T00:05:39.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0050359710000000002 2024-09-12T00:05:39.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098366+0000", 2024-09-12T00:05:39.701 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9052000000000001e-05 2024-09-12T00:05:39.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.701 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.701 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.701 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098439+0000", 2024-09-12T00:05:39.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3114000000000005e-05 2024-09-12T00:05:39.702 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.702 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.702 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.702 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.702 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2996 3.21 3:872b1c12:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:39.702 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:39.702 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.306986832, 2024-09-12T00:05:39.702 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027562314000000001, 2024-09-12T00:05:39.702 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.702 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.703 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.703 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.703 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.703 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.703 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2996 2024-09-12T00:05:39.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.703 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.703 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.703 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.703 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:39.703 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.704 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.704 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.704 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:39.704 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.704 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.704 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.704 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350496+0000", 2024-09-12T00:05:39.704 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9160000000000003e-06 2024-09-12T00:05:39.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.704 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.704 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.704 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355187+0000", 2024-09-12T00:05:39.705 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046904989999999999 2024-09-12T00:05:39.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.705 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.705 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355223+0000", 2024-09-12T00:05:39.705 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6125999999999999e-05 2024-09-12T00:05:39.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.705 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.705 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355241+0000", 2024-09-12T00:05:39.705 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8686e-05 2024-09-12T00:05:39.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.705 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.706 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355373+0000", 2024-09-12T00:05:39.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013129299999999999 2024-09-12T00:05:39.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.706 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.706 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355619+0000", 2024-09-12T00:05:39.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024662700000000002 2024-09-12T00:05:39.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.706 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.706 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:39.706 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355855+0000", 2024-09-12T00:05:39.706 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023604299999999999 2024-09-12T00:05:39.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.367983+0000", 2024-09-12T00:05:39.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012127104999999999 2024-09-12T00:05:39.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377884+0000", 2024-09-12T00:05:39.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099013680000000007 2024-09-12T00:05:39.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.707 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.707 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.707 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377974+0000", 2024-09-12T00:05:39.707 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9932999999999994e-05 2024-09-12T00:05:39.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.708 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.708 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.708 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.378055+0000", 2024-09-12T00:05:39.708 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0717999999999995e-05 2024-09-12T00:05:39.708 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.708 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.708 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.708 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.708 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3016 3.21 3:876e25ab:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:39.708 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.592959+0000", 2024-09-12T00:05:39.708 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.064520396999999, 2024-09-12T00:05:39.709 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018852352999999999, 2024-09-12T00:05:39.709 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.709 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.709 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.709 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.709 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.709 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.709 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3016 2024-09-12T00:05:39.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.709 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.709 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.709 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.709 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.592959+0000", 2024-09-12T00:05:39.709 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.710 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.710 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.710 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.592959+0000", 2024-09-12T00:05:39.710 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.710 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.710 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.710 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.710 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.592961+0000", 2024-09-12T00:05:39.710 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7939999999999998e-06 2024-09-12T00:05:39.710 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.710 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.710 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.710 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.597664+0000", 2024-09-12T00:05:39.710 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047023550000000001 2024-09-12T00:05:39.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.711 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.711 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.711 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.597702+0000", 2024-09-12T00:05:39.711 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8235000000000002e-05 2024-09-12T00:05:39.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.711 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.711 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.711 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.597721+0000", 2024-09-12T00:05:39.711 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8442999999999999e-05 2024-09-12T00:05:39.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.711 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.711 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.711 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.597853+0000", 2024-09-12T00:05:39.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013213299999999999 2024-09-12T00:05:39.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.598128+0000", 2024-09-12T00:05:39.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000275347 2024-09-12T00:05:39.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:39.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.598362+0000", 2024-09-12T00:05:39.712 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023358999999999999 2024-09-12T00:05:39.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.712 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.712 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.712 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611029+0000", 2024-09-12T00:05:39.713 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012667487999999999 2024-09-12T00:05:39.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.713 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.713 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.713 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611437+0000", 2024-09-12T00:05:39.713 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000407518 2024-09-12T00:05:39.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.713 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.713 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.713 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611629+0000", 2024-09-12T00:05:39.713 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00019254799999999999 2024-09-12T00:05:39.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.713 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.714 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.714 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.611811+0000", 2024-09-12T00:05:39.714 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018190200000000001 2024-09-12T00:05:39.714 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.714 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.714 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.714 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.714 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3030 3.2e 3:740afe3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:39.714 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:39.714 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 18.917656674, 2024-09-12T00:05:39.714 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.033756331000000001, 2024-09-12T00:05:39.714 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.715 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.715 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.715 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.715 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.715 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.715 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3030 2024-09-12T00:05:39.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.715 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.715 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.715 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.715 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:39.715 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.716 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.716 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.716 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:39.716 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.716 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.716 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.716 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.716 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739825+0000", 2024-09-12T00:05:39.716 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7920000000000001e-06 2024-09-12T00:05:39.716 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.716 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.716 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.717 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744217+0000", 2024-09-12T00:05:39.717 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043922529999999996 2024-09-12T00:05:39.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.717 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.717 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.717 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744243+0000", 2024-09-12T00:05:39.717 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5253e-05 2024-09-12T00:05:39.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.717 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.717 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.717 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744254+0000", 2024-09-12T00:05:39.718 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1430999999999999e-05 2024-09-12T00:05:39.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744325+0000", 2024-09-12T00:05:39.718 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1340999999999993e-05 2024-09-12T00:05:39.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.718 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744461+0000", 2024-09-12T00:05:39.718 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013531700000000001 2024-09-12T00:05:39.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.718 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.718 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:39.719 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744574+0000", 2024-09-12T00:05:39.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113513 2024-09-12T00:05:39.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.719 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.719 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.752813+0000", 2024-09-12T00:05:39.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082384750000000003 2024-09-12T00:05:39.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.719 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.719 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773444+0000", 2024-09-12T00:05:39.719 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020630773000000002 2024-09-12T00:05:39.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.719 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.720 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.720 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773510+0000", 2024-09-12T00:05:39.720 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6711000000000006e-05 2024-09-12T00:05:39.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.720 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.720 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.720 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773579+0000", 2024-09-12T00:05:39.720 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8472000000000004e-05 2024-09-12T00:05:39.720 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.720 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.720 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.720 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.721 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3039 3.2e 3:74587332:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:39.721 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:39.721 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 18.821976746000001, 2024-09-12T00:05:39.721 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.036215114, 2024-09-12T00:05:39.721 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.721 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.721 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.721 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.721 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.721 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.721 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3039 2024-09-12T00:05:39.721 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.721 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.721 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.722 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.722 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:39.722 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.722 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.722 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.722 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:39.722 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.722 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.722 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.722 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835507+0000", 2024-09-12T00:05:39.722 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6e-06 2024-09-12T00:05:39.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.722 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.723 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.723 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848930+0000", 2024-09-12T00:05:39.723 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013423242 2024-09-12T00:05:39.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.723 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.723 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848969+0000", 2024-09-12T00:05:39.723 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9270000000000002e-05 2024-09-12T00:05:39.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.723 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.723 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848991+0000", 2024-09-12T00:05:39.723 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1565000000000001e-05 2024-09-12T00:05:39.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.724 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.724 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.724 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849089+0000", 2024-09-12T00:05:39.724 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8408999999999999e-05 2024-09-12T00:05:39.724 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.724 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.724 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.724 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849518+0000", 2024-09-12T00:05:39.724 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042813900000000002 2024-09-12T00:05:39.724 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.724 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.724 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:39.724 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849897+0000", 2024-09-12T00:05:39.724 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037936600000000001 2024-09-12T00:05:39.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.725 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.725 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.725 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.858549+0000", 2024-09-12T00:05:39.725 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086520820000000002 2024-09-12T00:05:39.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.725 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.725 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.725 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871522+0000", 2024-09-12T00:05:39.725 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012973182999999999 2024-09-12T00:05:39.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.725 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.725 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.725 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871633+0000", 2024-09-12T00:05:39.726 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011085 2024-09-12T00:05:39.726 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.726 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.726 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.726 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871717+0000", 2024-09-12T00:05:39.726 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.4407999999999996e-05 2024-09-12T00:05:39.726 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.726 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.726 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.726 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.726 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.726 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3050 3.b 3:d26f7141:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:39.726 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:39.726 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 18.700364489999998, 2024-09-12T00:05:39.727 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022896481999999999, 2024-09-12T00:05:39.727 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.727 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.728 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.728 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.728 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.728 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.728 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3050 2024-09-12T00:05:39.728 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.728 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.728 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.728 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.728 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:39.728 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.728 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.728 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.729 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.729 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:39.729 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.729 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.729 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.729 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957117+0000", 2024-09-12T00:05:39.729 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7e-06 2024-09-12T00:05:39.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.729 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.729 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.729 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961673+0000", 2024-09-12T00:05:39.729 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045558059999999999 2024-09-12T00:05:39.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.730 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.730 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.730 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961698+0000", 2024-09-12T00:05:39.730 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5017000000000001e-05 2024-09-12T00:05:39.730 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.730 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.730 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.730 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961710+0000", 2024-09-12T00:05:39.730 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1963999999999999e-05 2024-09-12T00:05:39.730 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.730 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.730 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.730 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961785+0000", 2024-09-12T00:05:39.730 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5153000000000004e-05 2024-09-12T00:05:39.731 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.731 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.731 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.731 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961926+0000", 2024-09-12T00:05:39.731 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000141194 2024-09-12T00:05:39.731 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.731 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.731 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:39.731 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.962055+0000", 2024-09-12T00:05:39.731 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012882400000000001 2024-09-12T00:05:39.731 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.731 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.731 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.731 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.970716+0000", 2024-09-12T00:05:39.732 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086603610000000001 2024-09-12T00:05:39.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.732 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.732 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.732 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979700+0000", 2024-09-12T00:05:39.732 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.008984054 2024-09-12T00:05:39.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.732 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.732 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.732 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979884+0000", 2024-09-12T00:05:39.732 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184215 2024-09-12T00:05:39.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.732 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.732 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.733 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.980011+0000", 2024-09-12T00:05:39.733 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012719399999999999 2024-09-12T00:05:39.733 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.733 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.733 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.733 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.733 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.733 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3052 3.32 e75/23 3:4d6db9ea:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_91:head v 75'3, mlcod=62'1)", 2024-09-12T00:05:39.733 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.988152+0000", 2024-09-12T00:05:39.733 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 18.669326934000001, 2024-09-12T00:05:39.733 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019198494999999999, 2024-09-12T00:05:39.733 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.733 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.733 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.734 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.734 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.734 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.734 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.988152+0000", 2024-09-12T00:05:39.734 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.734 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.734 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.734 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.988152+0000", 2024-09-12T00:05:39.734 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.734 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.734 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.734 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.988155+0000", 2024-09-12T00:05:39.735 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.253e-06 2024-09-12T00:05:39.735 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.735 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.735 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.735 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993485+0000", 2024-09-12T00:05:39.735 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053298479999999999 2024-09-12T00:05:39.735 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.735 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.735 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.735 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993520+0000", 2024-09-12T00:05:39.735 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4393000000000001e-05 2024-09-12T00:05:39.735 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.735 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.735 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.736 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993538+0000", 2024-09-12T00:05:39.736 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8193e-05 2024-09-12T00:05:39.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.736 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.736 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.736 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993701+0000", 2024-09-12T00:05:39.736 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016265499999999999 2024-09-12T00:05:39.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.736 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.736 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.736 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.993771+0000", 2024-09-12T00:05:39.736 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.0884999999999996e-05 2024-09-12T00:05:39.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.736 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.737 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.737 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007261+0000", 2024-09-12T00:05:39.737 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013489142000000001 2024-09-12T00:05:39.737 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.737 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.737 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.737 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007351+0000", 2024-09-12T00:05:39.737 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0125999999999997e-05 2024-09-12T00:05:39.737 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.737 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.737 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.737 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.737 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.737 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3065 3.b 3:d10bf58d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:39.738 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:39.738 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 18.535416869999999, 2024-09-12T00:05:39.738 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021843261999999999, 2024-09-12T00:05:39.738 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.738 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.738 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.738 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.738 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.738 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.738 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3065 2024-09-12T00:05:39.738 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.738 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.738 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.739 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.739 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:39.739 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.739 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.739 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.739 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:39.739 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.739 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.739 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.739 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122067+0000", 2024-09-12T00:05:39.739 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4970000000000003e-06 2024-09-12T00:05:39.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.739 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.740 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.740 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126931+0000", 2024-09-12T00:05:39.740 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048641090000000001 2024-09-12T00:05:39.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.740 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.740 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.740 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126973+0000", 2024-09-12T00:05:39.740 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1678999999999999e-05 2024-09-12T00:05:39.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.740 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.740 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.740 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126999+0000", 2024-09-12T00:05:39.740 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6536000000000001e-05 2024-09-12T00:05:39.741 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.741 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.741 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.741 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127118+0000", 2024-09-12T00:05:39.741 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000119373 2024-09-12T00:05:39.741 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.741 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.741 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.741 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127289+0000", 2024-09-12T00:05:39.741 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017020199999999999 2024-09-12T00:05:39.741 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.741 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.741 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:39.741 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127437+0000", 2024-09-12T00:05:39.742 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148682 2024-09-12T00:05:39.742 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.742 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.742 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.742 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138539+0000", 2024-09-12T00:05:39.742 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011101418 2024-09-12T00:05:39.742 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.742 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.742 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.742 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143355+0000", 2024-09-12T00:05:39.742 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048161499999999999 2024-09-12T00:05:39.742 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.742 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.743 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.743 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143777+0000", 2024-09-12T00:05:39.743 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000421896 2024-09-12T00:05:39.743 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.743 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.743 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.743 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143905+0000", 2024-09-12T00:05:39.743 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012872 2024-09-12T00:05:39.743 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.743 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.743 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.743 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.743 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.744 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3066 3.21 3:8448517d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:39.744 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:39.744 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 18.525470788, 2024-09-12T00:05:39.744 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025911652, 2024-09-12T00:05:39.744 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.744 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.744 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.744 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.744 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.744 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.744 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3066 2024-09-12T00:05:39.744 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.744 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.745 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.745 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.745 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:39.745 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.745 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.745 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.745 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.745 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:39.745 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.745 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.745 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.745 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.745 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132011+0000", 2024-09-12T00:05:39.745 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8270000000000002e-06 2024-09-12T00:05:39.746 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.746 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.746 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.746 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137934+0000", 2024-09-12T00:05:39.746 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059226119999999998 2024-09-12T00:05:39.746 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.746 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.746 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.746 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137968+0000", 2024-09-12T00:05:39.746 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3933000000000002e-05 2024-09-12T00:05:39.746 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.746 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.746 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.747 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137985+0000", 2024-09-12T00:05:39.747 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7725999999999999e-05 2024-09-12T00:05:39.747 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.747 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.747 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.747 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138084+0000", 2024-09-12T00:05:39.747 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8450999999999996e-05 2024-09-12T00:05:39.747 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.747 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.747 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.747 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138285+0000", 2024-09-12T00:05:39.747 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000201411 2024-09-12T00:05:39.747 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.747 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.747 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:39.748 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138510+0000", 2024-09-12T00:05:39.748 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000224551 2024-09-12T00:05:39.748 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.748 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.748 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.748 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.146242+0000", 2024-09-12T00:05:39.748 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077317649999999998 2024-09-12T00:05:39.748 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.748 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.749 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.749 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157728+0000", 2024-09-12T00:05:39.749 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011486424 2024-09-12T00:05:39.749 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.749 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.749 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.749 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157833+0000", 2024-09-12T00:05:39.750 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105234 2024-09-12T00:05:39.750 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.750 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.750 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.750 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157920+0000", 2024-09-12T00:05:39.750 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6718000000000006e-05 2024-09-12T00:05:39.750 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.750 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.750 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.750 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.750 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.750 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3111 3.2e 3:7749b0e6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:39.750 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.741096+0000", 2024-09-12T00:05:39.750 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.916383197999998, 2024-09-12T00:05:39.750 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019635658, 2024-09-12T00:05:39.751 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.751 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.751 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.751 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.751 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.751 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.751 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3111 2024-09-12T00:05:39.751 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.751 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.751 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.751 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.751 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.741096+0000", 2024-09-12T00:05:39.751 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.751 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.752 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.752 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.752 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.741096+0000", 2024-09-12T00:05:39.752 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.752 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.752 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.752 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.752 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.741099+0000", 2024-09-12T00:05:39.752 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0800000000000002e-06 2024-09-12T00:05:39.752 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.752 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.752 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.752 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745487+0000", 2024-09-12T00:05:39.752 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043876540000000004 2024-09-12T00:05:39.753 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.753 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.753 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.753 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745510+0000", 2024-09-12T00:05:39.753 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3099999999999999e-05 2024-09-12T00:05:39.753 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.753 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.753 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.753 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745521+0000", 2024-09-12T00:05:39.753 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0813e-05 2024-09-12T00:05:39.753 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.753 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.753 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.753 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745639+0000", 2024-09-12T00:05:39.753 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011862399999999999 2024-09-12T00:05:39.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.754 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.754 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.754 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745895+0000", 2024-09-12T00:05:39.754 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025625300000000001 2024-09-12T00:05:39.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.754 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.754 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:39.754 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.746140+0000", 2024-09-12T00:05:39.754 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000244467 2024-09-12T00:05:39.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.754 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.754 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.754 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755206+0000", 2024-09-12T00:05:39.755 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0090663250000000001 2024-09-12T00:05:39.755 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.755 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.755 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.755 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.760620+0000", 2024-09-12T00:05:39.755 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054141040000000003 2024-09-12T00:05:39.755 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.755 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.755 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.755 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.760673+0000", 2024-09-12T00:05:39.755 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2519999999999999e-05 2024-09-12T00:05:39.755 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.755 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.755 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.755 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.760732+0000", 2024-09-12T00:05:39.756 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8718000000000003e-05 2024-09-12T00:05:39.756 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.756 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.756 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.756 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.756 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.756 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3112 3.b 3:d1cf91a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:39.756 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:39.756 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.906753661, 2024-09-12T00:05:39.756 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021203475999999999, 2024-09-12T00:05:39.756 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.756 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.756 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.756 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.757 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.757 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.757 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3112 2024-09-12T00:05:39.757 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.757 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.757 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.757 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.757 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:39.757 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.757 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.757 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.757 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.757 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:39.757 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.758 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.758 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.758 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.758 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750728+0000", 2024-09-12T00:05:39.758 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.165e-06 2024-09-12T00:05:39.758 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.758 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.758 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.758 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755063+0000", 2024-09-12T00:05:39.758 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043355379999999999 2024-09-12T00:05:39.758 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.758 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.758 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.758 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755103+0000", 2024-09-12T00:05:39.758 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9962000000000001e-05 2024-09-12T00:05:39.759 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.759 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.759 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.759 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755120+0000", 2024-09-12T00:05:39.759 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6793e-05 2024-09-12T00:05:39.759 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.759 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.759 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.759 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755299+0000", 2024-09-12T00:05:39.759 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017904499999999999 2024-09-12T00:05:39.759 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.759 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.759 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.759 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755758+0000", 2024-09-12T00:05:39.760 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000458815 2024-09-12T00:05:39.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.760 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.760 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:39.760 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.756304+0000", 2024-09-12T00:05:39.760 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000546183 2024-09-12T00:05:39.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.760 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.760 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.760 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771518+0000", 2024-09-12T00:05:39.760 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015214236000000001 2024-09-12T00:05:39.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.760 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.760 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.761 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771827+0000", 2024-09-12T00:05:39.761 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000309308 2024-09-12T00:05:39.761 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.761 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.761 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.761 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771874+0000", 2024-09-12T00:05:39.761 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6119999999999999e-05 2024-09-12T00:05:39.761 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.761 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.761 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.761 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771929+0000", 2024-09-12T00:05:39.761 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5310999999999999e-05 2024-09-12T00:05:39.761 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.761 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.762 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.762 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.762 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.762 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3115 3.2e 3:75803fec:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:39.762 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:39.762 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.868782611, 2024-09-12T00:05:39.762 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020205041, 2024-09-12T00:05:39.762 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.762 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.762 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.762 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.762 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.762 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.762 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3115 2024-09-12T00:05:39.762 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.763 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.763 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.763 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.763 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:39.763 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.763 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.763 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.763 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.763 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:39.763 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.763 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.763 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.763 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.763 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788700+0000", 2024-09-12T00:05:39.764 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.614e-06 2024-09-12T00:05:39.764 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.764 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.764 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.764 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793576+0000", 2024-09-12T00:05:39.764 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048760920000000003 2024-09-12T00:05:39.764 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.764 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.764 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.764 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793610+0000", 2024-09-12T00:05:39.764 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4184999999999999e-05 2024-09-12T00:05:39.764 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.764 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.764 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.764 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793633+0000", 2024-09-12T00:05:39.765 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2551000000000001e-05 2024-09-12T00:05:39.765 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.765 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.765 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.765 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793750+0000", 2024-09-12T00:05:39.765 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117057 2024-09-12T00:05:39.765 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.765 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.765 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.765 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793975+0000", 2024-09-12T00:05:39.765 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022493099999999999 2024-09-12T00:05:39.765 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.765 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.765 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:39.766 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.794178+0000", 2024-09-12T00:05:39.766 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000202726 2024-09-12T00:05:39.766 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.766 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.766 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.766 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.803725+0000", 2024-09-12T00:05:39.766 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095470599999999996 2024-09-12T00:05:39.766 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.766 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.766 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.766 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808706+0000", 2024-09-12T00:05:39.766 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049814519999999999 2024-09-12T00:05:39.766 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.766 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.766 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.767 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808785+0000", 2024-09-12T00:05:39.767 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9160999999999996e-05 2024-09-12T00:05:39.767 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.767 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.767 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.767 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808902+0000", 2024-09-12T00:05:39.767 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000116212 2024-09-12T00:05:39.767 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.767 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.767 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.767 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.767 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.767 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3148 3.b 3:d076a555:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:39.767 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.214451+0000", 2024-09-12T00:05:39.767 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.443027998000002, 2024-09-12T00:05:39.768 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019531633999999999, 2024-09-12T00:05:39.768 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:39.768 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:39.768 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:39.768 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:39.768 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:39.768 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:39.768 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3148 2024-09-12T00:05:39.768 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.768 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:39.768 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.768 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:39.768 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.214451+0000", 2024-09-12T00:05:39.768 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.769 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.769 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.769 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:39.769 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.214451+0000", 2024-09-12T00:05:39.769 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:39.769 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.769 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.769 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:39.769 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.214454+0000", 2024-09-12T00:05:39.769 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.354e-06 2024-09-12T00:05:39.769 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.769 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.769 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:39.769 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219444+0000", 2024-09-12T00:05:39.770 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049897830000000002 2024-09-12T00:05:39.770 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.770 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.770 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:39.770 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219472+0000", 2024-09-12T00:05:39.770 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7421999999999999e-05 2024-09-12T00:05:39.770 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.770 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.770 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:39.770 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219486+0000", 2024-09-12T00:05:39.770 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4528999999999999e-05 2024-09-12T00:05:39.770 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.770 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.770 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:39.770 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219583+0000", 2024-09-12T00:05:39.771 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.6989000000000003e-05 2024-09-12T00:05:39.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.771 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.771 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:39.771 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219782+0000", 2024-09-12T00:05:39.771 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000198767 2024-09-12T00:05:39.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.771 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.771 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:39.771 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.219999+0000", 2024-09-12T00:05:39.771 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000217068 2024-09-12T00:05:39.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.771 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.771 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:39.772 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.233084+0000", 2024-09-12T00:05:39.772 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013084910999999999 2024-09-12T00:05:39.772 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.772 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.772 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:39.772 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.233877+0000", 2024-09-12T00:05:39.772 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00079352600000000002 2024-09-12T00:05:39.772 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.772 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.772 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:39.772 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.233940+0000", 2024-09-12T00:05:39.772 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.2774000000000006e-05 2024-09-12T00:05:39.772 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:39.772 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:39.772 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:39.773 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.233983+0000", 2024-09-12T00:05:39.773 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2511e-05 2024-09-12T00:05:39.773 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.773 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.773 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.773 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:39.773 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:39.773 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:39.775 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:39.776+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:39.775 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:05:39.876 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:39.876+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:39.941 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:39.941 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:39.941 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:05:39.941 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:39.954 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:05:39.976 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:39.976+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:40.077 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:40.080+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:40.125 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:40.125 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:40.125 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:05:40.125 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:05:40.125 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:40.138 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:05:40.181 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:40.184+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:40.279 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:40.280+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:40.314 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:40.315 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:05:40.315 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:05:40.315 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:05:40.315 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.315 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:05:40.315 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:05:40.315 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 128.983785974, 2024-09-12T00:05:40.315 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.027441031000000001, 2024-09-12T00:05:40.315 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:40.315 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:40.315 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:40.315 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:40.315 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:40.316 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:40.316 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:05:40.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.316 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:40.316 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.316 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:40.316 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:05:40.316 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.316 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.316 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:40.316 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:05:40.316 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.317 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.317 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.317 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:40.317 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330357+0000", 2024-09-12T00:05:40.317 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2339999999999996e-06 2024-09-12T00:05:40.317 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.317 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.317 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:40.317 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330381+0000", 2024-09-12T00:05:40.317 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4626000000000001e-05 2024-09-12T00:05:40.317 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.317 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.317 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:40.317 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330417+0000", 2024-09-12T00:05:40.318 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5886000000000002e-05 2024-09-12T00:05:40.318 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.318 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.318 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:40.318 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330442+0000", 2024-09-12T00:05:40.318 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4522999999999999e-05 2024-09-12T00:05:40.318 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.318 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.318 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:40.318 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335485+0000", 2024-09-12T00:05:40.318 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050432589999999996 2024-09-12T00:05:40.318 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.318 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.318 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:05:40.319 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335507+0000", 2024-09-12T00:05:40.319 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2013000000000001e-05 2024-09-12T00:05:40.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.319 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.319 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:40.319 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.351747+0000", 2024-09-12T00:05:40.319 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016240451999999999 2024-09-12T00:05:40.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.319 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.319 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:40.319 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352062+0000", 2024-09-12T00:05:40.319 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031433399999999999 2024-09-12T00:05:40.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.320 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.320 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:40.320 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352378+0000", 2024-09-12T00:05:40.320 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031586400000000001 2024-09-12T00:05:40.320 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.320 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.320 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:40.320 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.355074+0000", 2024-09-12T00:05:40.320 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026962919999999999 2024-09-12T00:05:40.320 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.320 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.320 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:40.320 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357537+0000", 2024-09-12T00:05:40.321 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024634689999999998 2024-09-12T00:05:40.321 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.321 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.321 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:40.321 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357680+0000", 2024-09-12T00:05:40.321 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014314899999999999 2024-09-12T00:05:40.321 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.321 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.321 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:40.321 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357793+0000", 2024-09-12T00:05:40.321 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011293 2024-09-12T00:05:40.321 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.321 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:40.321 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.322 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.322 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.322 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2670 3.15 3:aae67b25:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:40.322 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.402430+0000", 2024-09-12T00:05:40.322 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 52.911708740000002, 2024-09-12T00:05:40.322 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020468187999999998, 2024-09-12T00:05:40.322 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:40.322 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:40.322 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:40.322 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:40.322 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:40.322 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:40.322 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2670 2024-09-12T00:05:40.323 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.323 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:40.323 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.323 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:40.323 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.402430+0000", 2024-09-12T00:05:40.323 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.323 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.323 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.323 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:40.323 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.402430+0000", 2024-09-12T00:05:40.323 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.323 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.323 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.323 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:40.324 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.402434+0000", 2024-09-12T00:05:40.324 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3730000000000003e-06 2024-09-12T00:05:40.324 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.324 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.324 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:40.324 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405033+0000", 2024-09-12T00:05:40.324 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025991080000000001 2024-09-12T00:05:40.324 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.324 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.324 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:40.324 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405068+0000", 2024-09-12T00:05:40.324 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4832999999999997e-05 2024-09-12T00:05:40.324 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.324 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.325 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:40.325 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405080+0000", 2024-09-12T00:05:40.325 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2344000000000001e-05 2024-09-12T00:05:40.325 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.325 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.325 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:40.325 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405150+0000", 2024-09-12T00:05:40.325 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9391e-05 2024-09-12T00:05:40.325 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.325 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.325 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:40.325 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405287+0000", 2024-09-12T00:05:40.325 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013720299999999999 2024-09-12T00:05:40.325 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.325 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.326 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:40.326 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405411+0000", 2024-09-12T00:05:40.326 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000123891 2024-09-12T00:05:40.326 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.326 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.326 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:40.326 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.414520+0000", 2024-09-12T00:05:40.326 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091092599999999992 2024-09-12T00:05:40.326 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.326 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.326 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:40.326 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.422744+0000", 2024-09-12T00:05:40.326 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0082241620000000001 2024-09-12T00:05:40.326 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.327 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.327 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:40.327 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.422841+0000", 2024-09-12T00:05:40.327 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6525000000000002e-05 2024-09-12T00:05:40.327 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.327 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.327 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:40.327 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.422898+0000", 2024-09-12T00:05:40.327 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7098000000000001e-05 2024-09-12T00:05:40.327 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.327 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:40.327 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.327 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.327 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.327 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2713 3.c 3:3354c844:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:40.328 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.736236+0000", 2024-09-12T00:05:40.328 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 52.577902549000001, 2024-09-12T00:05:40.328 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020199746000000001, 2024-09-12T00:05:40.328 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:40.328 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:40.328 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:40.328 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:40.328 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:40.328 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:40.328 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2713 2024-09-12T00:05:40.328 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.328 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:40.328 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.329 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:40.329 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.736236+0000", 2024-09-12T00:05:40.329 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.329 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.329 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.329 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:40.329 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.736236+0000", 2024-09-12T00:05:40.329 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.329 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.329 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.329 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:40.329 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.736239+0000", 2024-09-12T00:05:40.329 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5599999999999998e-06 2024-09-12T00:05:40.329 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.330 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.330 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:40.330 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.737498+0000", 2024-09-12T00:05:40.330 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001258807 2024-09-12T00:05:40.330 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.330 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.330 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:40.330 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.737522+0000", 2024-09-12T00:05:40.330 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.408e-05 2024-09-12T00:05:40.330 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.330 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.330 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:40.330 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.737532+0000", 2024-09-12T00:05:40.330 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8519999999999999e-06 2024-09-12T00:05:40.330 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.331 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.331 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:40.331 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.737594+0000", 2024-09-12T00:05:40.331 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1437000000000001e-05 2024-09-12T00:05:40.331 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.331 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.331 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:40.331 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.737712+0000", 2024-09-12T00:05:40.331 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000118641 2024-09-12T00:05:40.331 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.331 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.331 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:40.331 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.737807+0000", 2024-09-12T00:05:40.331 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.4710000000000006e-05 2024-09-12T00:05:40.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.332 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.332 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:40.332 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.742626+0000", 2024-09-12T00:05:40.332 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.004818719 2024-09-12T00:05:40.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.332 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.332 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:40.332 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.756272+0000", 2024-09-12T00:05:40.332 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013646574 2024-09-12T00:05:40.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.332 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.332 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:40.332 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.756357+0000", 2024-09-12T00:05:40.333 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.4964999999999997e-05 2024-09-12T00:05:40.333 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.333 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.333 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:40.333 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.756436+0000", 2024-09-12T00:05:40.333 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8400999999999997e-05 2024-09-12T00:05:40.333 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.333 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:40.333 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.333 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.333 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.333 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2727 3.39 3:9c63b475:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:40.333 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.875651+0000", 2024-09-12T00:05:40.333 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 52.438486943000001, 2024-09-12T00:05:40.334 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019038132999999999, 2024-09-12T00:05:40.334 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:40.334 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:40.334 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:40.334 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:40.334 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:40.334 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:40.334 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2727 2024-09-12T00:05:40.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.334 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:40.334 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.334 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:40.334 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.875651+0000", 2024-09-12T00:05:40.335 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.335 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.335 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:40.335 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.875651+0000", 2024-09-12T00:05:40.335 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.335 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.335 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:40.335 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.875655+0000", 2024-09-12T00:05:40.335 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4699999999999998e-06 2024-09-12T00:05:40.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.336 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.336 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:40.336 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.877353+0000", 2024-09-12T00:05:40.336 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0016979740000000001 2024-09-12T00:05:40.336 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.336 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.336 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:40.336 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.877385+0000", 2024-09-12T00:05:40.336 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2561000000000002e-05 2024-09-12T00:05:40.336 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.336 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.336 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:40.336 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.877400+0000", 2024-09-12T00:05:40.336 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.505e-05 2024-09-12T00:05:40.337 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.337 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.337 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:40.337 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.877503+0000", 2024-09-12T00:05:40.337 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010297399999999999 2024-09-12T00:05:40.337 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.337 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.337 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:40.337 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.877647+0000", 2024-09-12T00:05:40.337 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000143268 2024-09-12T00:05:40.337 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.337 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.337 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:40.337 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.877798+0000", 2024-09-12T00:05:40.337 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015086799999999999 2024-09-12T00:05:40.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.338 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.338 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:40.338 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.884567+0000", 2024-09-12T00:05:40.338 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0067690629999999996 2024-09-12T00:05:40.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.338 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.338 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:40.338 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.894563+0000", 2024-09-12T00:05:40.338 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0099959269999999999 2024-09-12T00:05:40.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.338 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.338 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:40.338 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.894632+0000", 2024-09-12T00:05:40.338 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9067999999999997e-05 2024-09-12T00:05:40.339 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.339 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.339 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:40.339 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.894690+0000", 2024-09-12T00:05:40.339 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.791e-05 2024-09-12T00:05:40.339 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.339 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:40.339 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.339 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.339 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.339 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2731 3.c 3:33671167:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:40.339 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.917498+0000", 2024-09-12T00:05:40.339 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 52.396640331, 2024-09-12T00:05:40.339 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020741915, 2024-09-12T00:05:40.340 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:40.340 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:40.340 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:40.340 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:40.340 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:40.340 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:40.340 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2731 2024-09-12T00:05:40.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.340 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:40.340 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.340 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:40.340 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.917498+0000", 2024-09-12T00:05:40.340 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.341 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.341 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:40.341 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.917498+0000", 2024-09-12T00:05:40.341 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.341 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.341 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:40.341 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.917502+0000", 2024-09-12T00:05:40.341 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4860000000000002e-06 2024-09-12T00:05:40.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.341 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.341 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:40.341 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919071+0000", 2024-09-12T00:05:40.341 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015695380000000001 2024-09-12T00:05:40.342 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.342 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.342 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:40.342 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919100+0000", 2024-09-12T00:05:40.342 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8822e-05 2024-09-12T00:05:40.342 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.342 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.342 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:40.342 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919110+0000", 2024-09-12T00:05:40.342 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0287e-05 2024-09-12T00:05:40.342 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.342 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.342 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:40.342 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919179+0000", 2024-09-12T00:05:40.343 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8926999999999999e-05 2024-09-12T00:05:40.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.343 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.343 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:40.343 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919338+0000", 2024-09-12T00:05:40.343 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015856299999999999 2024-09-12T00:05:40.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.343 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.343 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:40.343 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919462+0000", 2024-09-12T00:05:40.344 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012430399999999999 2024-09-12T00:05:40.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.344 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.344 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:40.344 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.923903+0000", 2024-09-12T00:05:40.344 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0044412660000000001 2024-09-12T00:05:40.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.344 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.344 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:40.344 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.938087+0000", 2024-09-12T00:05:40.344 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014183398999999999 2024-09-12T00:05:40.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.344 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.344 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:40.345 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.938180+0000", 2024-09-12T00:05:40.345 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3318000000000003e-05 2024-09-12T00:05:40.345 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.345 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.345 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:40.345 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.938240+0000", 2024-09-12T00:05:40.345 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0004999999999999e-05 2024-09-12T00:05:40.345 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.345 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:40.345 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.346 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.346 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2734 3.c 3:303f9e0a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:40.346 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.952166+0000", 2024-09-12T00:05:40.346 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 52.361971981000003, 2024-09-12T00:05:40.346 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018433805000000001, 2024-09-12T00:05:40.346 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:40.346 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:40.346 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:40.346 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:40.346 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:40.346 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:40.346 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2734 2024-09-12T00:05:40.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.346 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:40.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.347 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:40.347 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.952166+0000", 2024-09-12T00:05:40.347 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.347 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.347 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:40.347 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.952166+0000", 2024-09-12T00:05:40.347 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.347 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.347 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:40.347 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.952170+0000", 2024-09-12T00:05:40.347 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3330000000000001e-06 2024-09-12T00:05:40.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.348 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.348 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:40.348 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.953647+0000", 2024-09-12T00:05:40.348 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0014772889999999999 2024-09-12T00:05:40.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.348 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.348 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:40.348 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.953675+0000", 2024-09-12T00:05:40.348 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8133e-05 2024-09-12T00:05:40.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.348 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.348 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:40.348 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.953690+0000", 2024-09-12T00:05:40.349 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4671000000000001e-05 2024-09-12T00:05:40.349 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.349 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.349 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:40.349 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.953789+0000", 2024-09-12T00:05:40.349 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.9044999999999998e-05 2024-09-12T00:05:40.349 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.349 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.349 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:40.349 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.953923+0000", 2024-09-12T00:05:40.349 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013453099999999999 2024-09-12T00:05:40.349 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.349 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.349 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:40.349 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.954083+0000", 2024-09-12T00:05:40.350 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000160051 2024-09-12T00:05:40.350 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.350 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.350 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:40.350 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.961055+0000", 2024-09-12T00:05:40.350 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.006971288 2024-09-12T00:05:40.350 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.350 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.350 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:40.350 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.970486+0000", 2024-09-12T00:05:40.350 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0094313799999999996 2024-09-12T00:05:40.350 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.350 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.350 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:40.351 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.970547+0000", 2024-09-12T00:05:40.351 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.1396999999999995e-05 2024-09-12T00:05:40.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.351 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.351 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:40.351 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.970600+0000", 2024-09-12T00:05:40.351 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2686999999999999e-05 2024-09-12T00:05:40.351 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.351 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:40.351 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.352 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.352 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2748 3.3b 3:df6d92a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:40.352 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:05:40.352 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 52.215298113999999, 2024-09-12T00:05:40.352 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.023574735999999999, 2024-09-12T00:05:40.352 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:40.352 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:40.352 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:40.352 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:40.352 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:40.352 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:40.352 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2748 2024-09-12T00:05:40.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.353 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:40.353 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.353 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:40.353 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:05:40.353 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.353 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.353 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:40.353 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:05:40.353 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.353 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.353 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:40.354 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098844+0000", 2024-09-12T00:05:40.354 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1570000000000002e-06 2024-09-12T00:05:40.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.354 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.354 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:40.354 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100354+0000", 2024-09-12T00:05:40.354 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001509544 2024-09-12T00:05:40.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.354 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.354 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:40.354 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100383+0000", 2024-09-12T00:05:40.354 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9386e-05 2024-09-12T00:05:40.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.354 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.355 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:40.355 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100399+0000", 2024-09-12T00:05:40.355 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5883999999999999e-05 2024-09-12T00:05:40.355 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.355 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.355 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:40.355 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100507+0000", 2024-09-12T00:05:40.355 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010822 2024-09-12T00:05:40.355 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.355 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.355 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:40.355 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100704+0000", 2024-09-12T00:05:40.355 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019658499999999999 2024-09-12T00:05:40.355 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.356 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.356 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:40.356 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100901+0000", 2024-09-12T00:05:40.356 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000196505 2024-09-12T00:05:40.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.356 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.356 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:40.356 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112178+0000", 2024-09-12T00:05:40.356 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011277718000000001 2024-09-12T00:05:40.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.356 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.356 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:40.356 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122285+0000", 2024-09-12T00:05:40.357 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010106327 2024-09-12T00:05:40.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.357 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.357 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:40.357 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122358+0000", 2024-09-12T00:05:40.357 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3640999999999995e-05 2024-09-12T00:05:40.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.357 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.357 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:40.357 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122415+0000", 2024-09-12T00:05:40.357 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6768999999999998e-05 2024-09-12T00:05:40.357 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.357 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:40.357 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.358 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.358 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.358 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2964 3.24 e75/23 3:26c83ec0:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_3:head v 75'6, mlcod=63'4)", 2024-09-12T00:05:40.358 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:05:40.358 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 20.301877093000002, 2024-09-12T00:05:40.358 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022426814, 2024-09-12T00:05:40.358 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:40.358 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:40.358 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:40.358 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:40.358 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.358 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:40.358 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:05:40.358 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:40.359 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:05:40.359 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:40.359 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012263+0000", 2024-09-12T00:05:40.359 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.091e-06 2024-09-12T00:05:40.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:40.359 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018390+0000", 2024-09-12T00:05:40.360 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061264600000000002 2024-09-12T00:05:40.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.360 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.360 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:40.360 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018419+0000", 2024-09-12T00:05:40.360 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8979000000000002e-05 2024-09-12T00:05:40.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.360 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.360 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:40.360 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018434+0000", 2024-09-12T00:05:40.360 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4781e-05 2024-09-12T00:05:40.361 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.361 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.361 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:40.361 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018528+0000", 2024-09-12T00:05:40.361 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.4333000000000006e-05 2024-09-12T00:05:40.361 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.361 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.361 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:40.361 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018559+0000", 2024-09-12T00:05:40.361 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1557999999999998e-05 2024-09-12T00:05:40.361 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.361 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.361 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:40.361 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.034615+0000", 2024-09-12T00:05:40.361 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016055834000000001 2024-09-12T00:05:40.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.362 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.362 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:40.362 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.034688+0000", 2024-09-12T00:05:40.362 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2778e-05 2024-09-12T00:05:40.362 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.362 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:40.362 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.362 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.362 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2965 3.e e75/23 3:70fff61e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_4:head v 75'5, mlcod=63'3)", 2024-09-12T00:05:40.362 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:05:40.362 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 20.294366872000001, 2024-09-12T00:05:40.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021839210000000001, 2024-09-12T00:05:40.363 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:40.363 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:40.363 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:40.363 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:40.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.363 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:40.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:05:40.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.363 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:40.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:05:40.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:40.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019773+0000", 2024-09-12T00:05:40.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4839999999999999e-06 2024-09-12T00:05:40.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:40.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021570+0000", 2024-09-12T00:05:40.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017965570000000001 2024-09-12T00:05:40.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:40.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021587+0000", 2024-09-12T00:05:40.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7938e-05 2024-09-12T00:05:40.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.365 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:40.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021598+0000", 2024-09-12T00:05:40.365 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0553e-05 2024-09-12T00:05:40.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.365 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:40.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021676+0000", 2024-09-12T00:05:40.365 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8034000000000005e-05 2024-09-12T00:05:40.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.365 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:40.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021706+0000", 2024-09-12T00:05:40.366 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9915000000000001e-05 2024-09-12T00:05:40.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.366 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.366 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:40.366 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.041519+0000", 2024-09-12T00:05:40.366 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019813171000000001 2024-09-12T00:05:40.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.366 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.366 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:40.366 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.041611+0000", 2024-09-12T00:05:40.366 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1558000000000007e-05 2024-09-12T00:05:40.366 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.366 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:40.366 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.367 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.367 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3004 3.36 3:6cc4f27f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:40.367 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:05:40.367 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 19.875967674999998, 2024-09-12T00:05:40.367 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.042951743000000001, 2024-09-12T00:05:40.367 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:40.367 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:40.367 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:40.367 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:40.367 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:40.367 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:40.367 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3004 2024-09-12T00:05:40.367 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.367 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:40.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.368 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:40.368 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:05:40.368 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.368 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:40.368 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:05:40.368 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.368 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:40.368 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438175+0000", 2024-09-12T00:05:40.368 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1640000000000003e-06 2024-09-12T00:05:40.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:40.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439732+0000", 2024-09-12T00:05:40.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015574510000000001 2024-09-12T00:05:40.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:40.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439758+0000", 2024-09-12T00:05:40.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6074000000000001e-05 2024-09-12T00:05:40.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:40.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439768+0000", 2024-09-12T00:05:40.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8770000000000005e-06 2024-09-12T00:05:40.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:40.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439874+0000", 2024-09-12T00:05:40.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105583 2024-09-12T00:05:40.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:40.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.440078+0000", 2024-09-12T00:05:40.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020388200000000001 2024-09-12T00:05:40.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:40.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.440251+0000", 2024-09-12T00:05:40.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017339100000000001 2024-09-12T00:05:40.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.371 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:40.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.459982+0000", 2024-09-12T00:05:40.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01973099 2024-09-12T00:05:40.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.371 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:40.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.480958+0000", 2024-09-12T00:05:40.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020975730000000001 2024-09-12T00:05:40.372 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.372 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.372 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:40.372 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481034+0000", 2024-09-12T00:05:40.372 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6224999999999996e-05 2024-09-12T00:05:40.372 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.372 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.372 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:40.372 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481122+0000", 2024-09-12T00:05:40.372 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8375999999999995e-05 2024-09-12T00:05:40.372 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.372 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:40.372 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.372 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.373 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.373 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3005 3.35 3:ae3b5a36:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:40.373 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:05:40.373 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 19.866713991000001, 2024-09-12T00:05:40.373 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.028828275, 2024-09-12T00:05:40.373 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:40.373 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:40.373 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:40.373 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:40.373 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:40.373 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:40.373 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3005 2024-09-12T00:05:40.373 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.374 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:40.374 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.374 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:40.374 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:05:40.374 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.374 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.374 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:40.374 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:05:40.374 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.374 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.374 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:40.374 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447427+0000", 2024-09-12T00:05:40.375 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.864e-06 2024-09-12T00:05:40.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.375 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:40.375 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449003+0000", 2024-09-12T00:05:40.375 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001575405 2024-09-12T00:05:40.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.375 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:40.375 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449030+0000", 2024-09-12T00:05:40.375 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7189999999999999e-05 2024-09-12T00:05:40.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.375 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:40.376 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449042+0000", 2024-09-12T00:05:40.376 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2038999999999999e-05 2024-09-12T00:05:40.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.376 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.376 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:40.376 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449111+0000", 2024-09-12T00:05:40.376 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9521000000000001e-05 2024-09-12T00:05:40.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.376 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.376 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:40.376 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449218+0000", 2024-09-12T00:05:40.376 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010675600000000001 2024-09-12T00:05:40.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.377 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:40.377 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449330+0000", 2024-09-12T00:05:40.377 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000111809 2024-09-12T00:05:40.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.377 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:40.377 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.469844+0000", 2024-09-12T00:05:40.377 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020514277000000001 2024-09-12T00:05:40.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.377 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:40.377 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.475983+0000", 2024-09-12T00:05:40.377 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061392540000000002 2024-09-12T00:05:40.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.378 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.378 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:40.378 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.476113+0000", 2024-09-12T00:05:40.378 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000129713 2024-09-12T00:05:40.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.378 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.378 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:40.378 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.476253+0000", 2024-09-12T00:05:40.378 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013944700000000001 2024-09-12T00:05:40.378 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.378 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:40.378 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.379 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.379 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3006 3.3 3:c183ca95:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:40.379 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:05:40.379 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 19.857187419999999, 2024-09-12T00:05:40.379 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.024661756, 2024-09-12T00:05:40.379 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:40.379 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:40.379 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:40.379 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:40.379 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:40.379 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:40.379 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3006 2024-09-12T00:05:40.379 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.379 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:40.379 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.380 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:40.380 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:05:40.380 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.380 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.380 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:40.380 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:05:40.380 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.380 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.380 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:40.380 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456954+0000", 2024-09-12T00:05:40.380 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7070000000000001e-06 2024-09-12T00:05:40.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.381 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.381 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:40.381 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458684+0000", 2024-09-12T00:05:40.381 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017305479999999999 2024-09-12T00:05:40.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.381 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.381 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:40.381 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458709+0000", 2024-09-12T00:05:40.381 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4780999999999999e-05 2024-09-12T00:05:40.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.381 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.381 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:40.381 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458719+0000", 2024-09-12T00:05:40.381 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0202e-05 2024-09-12T00:05:40.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.382 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.382 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:40.382 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458800+0000", 2024-09-12T00:05:40.382 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0893e-05 2024-09-12T00:05:40.382 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.382 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.382 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:40.382 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458990+0000", 2024-09-12T00:05:40.382 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018986400000000001 2024-09-12T00:05:40.382 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.382 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.382 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:40.382 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.459171+0000", 2024-09-12T00:05:40.382 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018135499999999999 2024-09-12T00:05:40.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.383 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.383 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:40.383 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.478356+0000", 2024-09-12T00:05:40.383 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019185153 2024-09-12T00:05:40.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.383 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.383 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:40.383 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481411+0000", 2024-09-12T00:05:40.383 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030546190000000002 2024-09-12T00:05:40.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.383 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.383 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:40.383 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481511+0000", 2024-09-12T00:05:40.384 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.9763e-05 2024-09-12T00:05:40.384 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.384 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.384 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:40.384 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481613+0000", 2024-09-12T00:05:40.384 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101871 2024-09-12T00:05:40.384 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.384 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:40.384 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.384 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.384 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.384 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3019 3.15 3:abb9a608:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:40.384 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.624749+0000", 2024-09-12T00:05:40.385 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 19.689389805000001, 2024-09-12T00:05:40.385 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018588891, 2024-09-12T00:05:40.385 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:40.385 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:40.385 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:40.385 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:40.385 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:40.385 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:40.385 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3019 2024-09-12T00:05:40.385 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.385 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:40.385 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.385 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:40.385 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.624749+0000", 2024-09-12T00:05:40.385 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.386 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.386 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:40.386 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.624749+0000", 2024-09-12T00:05:40.386 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.386 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.386 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:40.386 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.624752+0000", 2024-09-12T00:05:40.386 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4000000000000001e-06 2024-09-12T00:05:40.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.386 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.386 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:40.386 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.626087+0000", 2024-09-12T00:05:40.387 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0013353900000000001 2024-09-12T00:05:40.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.387 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:40.387 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.626122+0000", 2024-09-12T00:05:40.387 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4904999999999999e-05 2024-09-12T00:05:40.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.387 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:40.387 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.626138+0000", 2024-09-12T00:05:40.387 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5659999999999999e-05 2024-09-12T00:05:40.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.387 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:40.387 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.626215+0000", 2024-09-12T00:05:40.388 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7528999999999996e-05 2024-09-12T00:05:40.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.388 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.388 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:40.388 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.626354+0000", 2024-09-12T00:05:40.388 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013848899999999999 2024-09-12T00:05:40.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.388 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.388 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:40.388 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.626457+0000", 2024-09-12T00:05:40.388 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000102921 2024-09-12T00:05:40.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.388 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.389 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:40.389 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.631059+0000", 2024-09-12T00:05:40.389 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046025679999999996 2024-09-12T00:05:40.389 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.389 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.389 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:40.389 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.643254+0000", 2024-09-12T00:05:40.389 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012194534999999999 2024-09-12T00:05:40.389 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.389 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.389 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:40.389 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.643299+0000", 2024-09-12T00:05:40.389 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5255e-05 2024-09-12T00:05:40.389 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.390 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.390 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:40.390 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.643337+0000", 2024-09-12T00:05:40.390 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8238999999999998e-05 2024-09-12T00:05:40.390 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.390 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:40.390 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.390 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.390 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.390 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3034 3.2a e75/23 3:57bb186b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_73:head v 75'4, mlcod=63'2)", 2024-09-12T00:05:40.390 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.785462+0000", 2024-09-12T00:05:40.390 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 19.528676756999999, 2024-09-12T00:05:40.392 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01923536, 2024-09-12T00:05:40.392 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:40.392 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:40.392 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:40.392 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:40.392 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:40.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.785462+0000", 2024-09-12T00:05:40.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.393 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:40.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.785462+0000", 2024-09-12T00:05:40.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.393 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:40.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.785463+0000", 2024-09-12T00:05:40.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8989999999999999e-06 2024-09-12T00:05:40.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.394 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:40.394 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.788048+0000", 2024-09-12T00:05:40.394 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025844959999999999 2024-09-12T00:05:40.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.394 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.394 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:40.394 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.788074+0000", 2024-09-12T00:05:40.394 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6393e-05 2024-09-12T00:05:40.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.394 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.394 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:40.394 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.788087+0000", 2024-09-12T00:05:40.394 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2261e-05 2024-09-12T00:05:40.395 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.395 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.395 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:40.395 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.788194+0000", 2024-09-12T00:05:40.395 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000107599 2024-09-12T00:05:40.395 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.395 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.395 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:40.395 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.788220+0000", 2024-09-12T00:05:40.395 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5374000000000001e-05 2024-09-12T00:05:40.395 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.395 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.395 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:40.395 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.804625+0000", 2024-09-12T00:05:40.395 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016405349 2024-09-12T00:05:40.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.396 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.396 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:40.396 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.804697+0000", 2024-09-12T00:05:40.396 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1989000000000005e-05 2024-09-12T00:05:40.396 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.396 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:40.396 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.396 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.396 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3037 3.39 3:9eefb4c1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:40.396 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:05:40.396 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 19.498920012999999, 2024-09-12T00:05:40.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020855543000000001, 2024-09-12T00:05:40.397 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:40.397 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:40.397 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:40.397 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:40.397 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:40.397 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:40.397 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3037 2024-09-12T00:05:40.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.397 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:40.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.397 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:40.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:05:40.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.398 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:40.398 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:05:40.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.398 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:40.398 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815221+0000", 2024-09-12T00:05:40.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1540000000000002e-06 2024-09-12T00:05:40.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:40.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817594+0000", 2024-09-12T00:05:40.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023728880000000001 2024-09-12T00:05:40.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:40.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817618+0000", 2024-09-12T00:05:40.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3635e-05 2024-09-12T00:05:40.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:40.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817633+0000", 2024-09-12T00:05:40.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4559000000000001e-05 2024-09-12T00:05:40.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.400 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:40.400 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817734+0000", 2024-09-12T00:05:40.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101729 2024-09-12T00:05:40.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.400 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:40.400 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817939+0000", 2024-09-12T00:05:40.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020489299999999999 2024-09-12T00:05:40.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.400 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:40.400 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.818113+0000", 2024-09-12T00:05:40.401 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000173413 2024-09-12T00:05:40.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.401 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:40.401 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.825676+0000", 2024-09-12T00:05:40.401 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075635260000000001 2024-09-12T00:05:40.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.401 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:40.401 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.835921+0000", 2024-09-12T00:05:40.401 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010244932999999999 2024-09-12T00:05:40.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.401 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:40.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.836006+0000", 2024-09-12T00:05:40.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5427999999999996e-05 2024-09-12T00:05:40.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.402 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:40.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.836074+0000", 2024-09-12T00:05:40.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7385000000000006e-05 2024-09-12T00:05:40.402 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.402 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:40.402 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.402 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3096 3.2f e76/23 3:f7c63ea3:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_135:head v 76'5, mlcod=75'3)", 2024-09-12T00:05:40.402 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:21.579016+0000", 2024-09-12T00:05:40.402 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.735122571000002, 2024-09-12T00:05:40.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019041222999999999, 2024-09-12T00:05:40.403 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:40.403 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:40.403 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:40.403 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:40.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.403 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:40.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.579016+0000", 2024-09-12T00:05:40.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.403 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:40.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.579016+0000", 2024-09-12T00:05:40.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:40.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.579016+0000", 2024-09-12T00:05:40.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7100000000000001e-07 2024-09-12T00:05:40.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:40.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.585629+0000", 2024-09-12T00:05:40.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066123520000000002 2024-09-12T00:05:40.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:40.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.585651+0000", 2024-09-12T00:05:40.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1953000000000001e-05 2024-09-12T00:05:40.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:40.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.585661+0000", 2024-09-12T00:05:40.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0057e-05 2024-09-12T00:05:40.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:40.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.585748+0000", 2024-09-12T00:05:40.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7225999999999995e-05 2024-09-12T00:05:40.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:40.406 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.585778+0000", 2024-09-12T00:05:40.406 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9818000000000001e-05 2024-09-12T00:05:40.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.406 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:40.406 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.597995+0000", 2024-09-12T00:05:40.406 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01221673 2024-09-12T00:05:40.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.406 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.406 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:40.406 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.598057+0000", 2024-09-12T00:05:40.406 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2415999999999993e-05 2024-09-12T00:05:40.406 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.406 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:40.407 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.407 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3102 3.1b e76/23 3:db06e448:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_141:head v 76'9, mlcod=63'7)", 2024-09-12T00:05:40.407 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:21.652983+0000", 2024-09-12T00:05:40.407 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.661154887999999, 2024-09-12T00:05:40.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019025626, 2024-09-12T00:05:40.407 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:40.407 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:40.407 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:40.407 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:40.407 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.407 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:40.407 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.652983+0000", 2024-09-12T00:05:40.407 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.408 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:40.408 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.652983+0000", 2024-09-12T00:05:40.408 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.408 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:40.408 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.652984+0000", 2024-09-12T00:05:40.408 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6300000000000004e-07 2024-09-12T00:05:40.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.408 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.408 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:40.408 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.659663+0000", 2024-09-12T00:05:40.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066788200000000002 2024-09-12T00:05:40.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:40.409 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.659693+0000", 2024-09-12T00:05:40.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9453000000000001e-05 2024-09-12T00:05:40.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:40.409 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.659705+0000", 2024-09-12T00:05:40.409 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2055000000000001e-05 2024-09-12T00:05:40.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.409 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.409 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:40.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.659787+0000", 2024-09-12T00:05:40.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2429000000000006e-05 2024-09-12T00:05:40.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:40.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.659816+0000", 2024-09-12T00:05:40.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8704000000000002e-05 2024-09-12T00:05:40.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:40.410 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.671902+0000", 2024-09-12T00:05:40.410 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012085871999999999 2024-09-12T00:05:40.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.410 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.410 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:40.411 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.672009+0000", 2024-09-12T00:05:40.411 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010743000000000001 2024-09-12T00:05:40.411 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.411 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:40.411 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.411 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.411 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3128 3.c 3:30aa9812:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:40.411 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:21.954348+0000", 2024-09-12T00:05:40.411 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.359789942999999, 2024-09-12T00:05:40.411 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020268630999999999, 2024-09-12T00:05:40.411 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:40.411 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:40.412 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:40.412 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:40.412 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:40.412 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:40.412 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3128 2024-09-12T00:05:40.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.412 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:40.412 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.412 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:40.412 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.954348+0000", 2024-09-12T00:05:40.412 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.412 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:40.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.954348+0000", 2024-09-12T00:05:40.413 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.413 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:40.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.954351+0000", 2024-09-12T00:05:40.413 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:05:40.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.413 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.413 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:40.413 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.956451+0000", 2024-09-12T00:05:40.413 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021003150000000002 2024-09-12T00:05:40.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.414 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:40.414 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.956508+0000", 2024-09-12T00:05:40.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6379999999999999e-05 2024-09-12T00:05:40.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.414 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:40.414 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.956527+0000", 2024-09-12T00:05:40.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9945e-05 2024-09-12T00:05:40.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.414 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.414 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:40.414 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.956631+0000", 2024-09-12T00:05:40.414 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000103664 2024-09-12T00:05:40.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:40.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.956890+0000", 2024-09-12T00:05:40.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00025909499999999999 2024-09-12T00:05:40.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:40.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.957167+0000", 2024-09-12T00:05:40.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000277113 2024-09-12T00:05:40.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.415 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:40.415 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.968705+0000", 2024-09-12T00:05:40.415 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011538049999999999 2024-09-12T00:05:40.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:40.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.974534+0000", 2024-09-12T00:05:40.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058281499999999998 2024-09-12T00:05:40.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:40.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.974580+0000", 2024-09-12T00:05:40.416 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.6649e-05 2024-09-12T00:05:40.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.416 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.416 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:40.416 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:21.974617+0000", 2024-09-12T00:05:40.417 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6829999999999998e-05 2024-09-12T00:05:40.417 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.417 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:40.417 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.417 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3134 3.24 e76/23 3:2525a955:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_173:head v 76'8, mlcod=75'6)", 2024-09-12T00:05:40.417 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:22.046783+0000", 2024-09-12T00:05:40.417 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.267355345999999, 2024-09-12T00:05:40.417 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018988463000000001, 2024-09-12T00:05:40.417 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:40.417 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:40.417 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:40.417 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:40.417 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.418 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:40.418 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.046783+0000", 2024-09-12T00:05:40.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.418 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.418 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:40.418 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.046783+0000", 2024-09-12T00:05:40.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.418 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.418 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:40.418 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.046786+0000", 2024-09-12T00:05:40.418 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5450000000000002e-06 2024-09-12T00:05:40.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.419 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.419 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:40.419 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.051145+0000", 2024-09-12T00:05:40.419 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0043596260000000001 2024-09-12T00:05:40.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.419 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.419 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:40.419 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.051178+0000", 2024-09-12T00:05:40.419 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2765000000000002e-05 2024-09-12T00:05:40.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.419 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.419 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:40.419 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.051193+0000", 2024-09-12T00:05:40.419 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4884e-05 2024-09-12T00:05:40.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.420 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.420 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:40.420 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.051273+0000", 2024-09-12T00:05:40.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0360999999999999e-05 2024-09-12T00:05:40.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.420 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.420 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:40.420 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.051296+0000", 2024-09-12T00:05:40.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2531000000000002e-05 2024-09-12T00:05:40.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.420 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.420 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:40.420 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.065696+0000", 2024-09-12T00:05:40.420 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014399792999999999 2024-09-12T00:05:40.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.421 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:40.421 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.065771+0000", 2024-09-12T00:05:40.421 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5957999999999993e-05 2024-09-12T00:05:40.421 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.421 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:40.421 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.421 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.422 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3142 3.c 3:33689984:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:40.422 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:22.143966+0000", 2024-09-12T00:05:40.422 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.170172327, 2024-09-12T00:05:40.422 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018503077999999999, 2024-09-12T00:05:40.422 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:40.422 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:40.422 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:40.422 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:40.422 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:40.422 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:40.422 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3142 2024-09-12T00:05:40.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.422 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:40.422 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:40.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.143966+0000", 2024-09-12T00:05:40.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:40.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.143966+0000", 2024-09-12T00:05:40.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:40.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.423 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:40.423 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.143969+0000", 2024-09-12T00:05:40.423 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.666e-06 2024-09-12T00:05:40.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:40.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.146392+0000", 2024-09-12T00:05:40.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024235620000000002 2024-09-12T00:05:40.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:40.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.146427+0000", 2024-09-12T00:05:40.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5238999999999999e-05 2024-09-12T00:05:40.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.424 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:40.424 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.146445+0000", 2024-09-12T00:05:40.424 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7499999999999998e-05 2024-09-12T00:05:40.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.425 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:40.425 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.146539+0000", 2024-09-12T00:05:40.425 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3752999999999995e-05 2024-09-12T00:05:40.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.425 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:40.425 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.146667+0000", 2024-09-12T00:05:40.425 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000128613 2024-09-12T00:05:40.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.425 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:40.425 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.146772+0000", 2024-09-12T00:05:40.425 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000104452 2024-09-12T00:05:40.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.426 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.426 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:40.426 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.156499+0000", 2024-09-12T00:05:40.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0097269929999999998 2024-09-12T00:05:40.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.426 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.426 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:40.426 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.162385+0000", 2024-09-12T00:05:40.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058857780000000004 2024-09-12T00:05:40.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.426 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.426 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:40.426 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.162429+0000", 2024-09-12T00:05:40.426 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4592000000000003e-05 2024-09-12T00:05:40.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:40.427 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:40.427 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:40.427 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.162469+0000", 2024-09-12T00:05:40.427 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.9929999999999999e-05 2024-09-12T00:05:40.427 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.427 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:40.427 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.427 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:40.427 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:40.427 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:40.429 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:05:40.429 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:40.428+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:40.529 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:40.528+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:40.592 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:40.592 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:40.593 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:05:40.593 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:40.607 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:05:40.653 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:40.656+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:40.731 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:40.732+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:40.754 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:40.754 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:40.755 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:05:40.755 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:05:40.755 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:40.766 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:05:40.774 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:05:40.833 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:40.832+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:40.937 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:40.940+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:40.945 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:40.946 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:40.971 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:40.972 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:40.973 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:40.973 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:40.995 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:05:41.005 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:41.006 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:41.031 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:41.031 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:41.034 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:41.036+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:41.059 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:41.060 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:41.089 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:41.089 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:41.114 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:41.114 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:41.135 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:41.136+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:41.138 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:41.138 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:41.177 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:41.177 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:41.200 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:05:41.241 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:41.244+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:41.337 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:41.336+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:41.386 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:41.386 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:41.410 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:05:41.453 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:41.456+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:41.540 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:41.540+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:41.603 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:41.603 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:41.624 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:05:41.641 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:41.640+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:41.742 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:41.744+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:41.776 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T00:05:41.816 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:41.816 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:41.837 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:05:41.843 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:41.844+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:41.944 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:41.944+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:42.045 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:42.048+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:42.050 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:42.050 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:42.072 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:05:42.147 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:42.148+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:42.248 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:42.248+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:42.266 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:42.266 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:42.285 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:05:42.349 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:42.348+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:42.444 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:42.444 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:42.450 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:42.452+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:42.469 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:05:42.552 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:42.552+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:42.652 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:42.652 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:42.653 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:42.652+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:42.671 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:05:42.677 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T00:05:42.754 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:42.756+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:42.820 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:42.820 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:42.845 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:05:42.854 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:42.856+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:42.955 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:42.956+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:42.977 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:42.978 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:42.995 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:05:43.086 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:43.088+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:43.157 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:43.160+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:43.164 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:05:43.165 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:43.165 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:43.182 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:05:43.261 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:43.260+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:43.343 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:43.344 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:43.362 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:43.364+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:43.367 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:43.367 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:43.369 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:43.369 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:43.386 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:05:43.389 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:43.389 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:43.408 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:43.408 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:43.431 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:43.431 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:43.455 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:43.455 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:43.474 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:43.476+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:43.480 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:43.506 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:43.506 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:43.565 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:43.564+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:43.567 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:43.567 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:43.567 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:43.567 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:43.586 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:05:43.665 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:43.668+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:43.766 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:43.768+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:43.779 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:43.779 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:43.779 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:43.779 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:43.779 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:43.801 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:05:43.868 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:43.868+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:43.941 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:43.941 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:43.941 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:43.941 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:43.942 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.942 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1646 3.25 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:05:43.942 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:43.942 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 70.862318053999999, 2024-09-12T00:05:43.942 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030091884999999999, 2024-09-12T00:05:43.942 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:43.942 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:43.942 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:43.942 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:43.942 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:43.942 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:43.942 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1646 2024-09-12T00:05:43.942 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.942 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:43.943 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.943 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:43.943 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:43.943 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:43.943 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.943 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.943 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:43.943 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:43.943 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:43.943 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.943 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.943 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:43.943 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077113+0000", 2024-09-12T00:05:43.943 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0186e-05 2024-09-12T00:05:43.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.944 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.944 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:43.944 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084821+0000", 2024-09-12T00:05:43.944 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077083450000000001 2024-09-12T00:05:43.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.944 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.944 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:43.944 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084857+0000", 2024-09-12T00:05:43.944 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6245000000000003e-05 2024-09-12T00:05:43.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.944 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.944 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:43.945 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084900+0000", 2024-09-12T00:05:43.945 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2369e-05 2024-09-12T00:05:43.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.945 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:43.945 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085058+0000", 2024-09-12T00:05:43.945 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015858199999999999 2024-09-12T00:05:43.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.945 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:43.945 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085307+0000", 2024-09-12T00:05:43.946 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024867999999999998 2024-09-12T00:05:43.946 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.946 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.946 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:43.946 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086107+0000", 2024-09-12T00:05:43.946 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00080040099999999996 2024-09-12T00:05:43.946 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.946 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.946 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:43.946 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.100477+0000", 2024-09-12T00:05:43.946 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014369508 2024-09-12T00:05:43.946 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.946 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.946 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:43.947 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107016+0000", 2024-09-12T00:05:43.947 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006538894 2024-09-12T00:05:43.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.947 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.947 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:43.947 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107121+0000", 2024-09-12T00:05:43.947 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105284 2024-09-12T00:05:43.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.947 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.947 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:43.947 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107194+0000", 2024-09-12T00:05:43.947 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3391000000000003e-05 2024-09-12T00:05:43.947 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:43.947 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:43.948 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:43.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.948 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1917 3.1 3:829295ac:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.4_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:05:43.948 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:43.948 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 68.774234574000005, 2024-09-12T00:05:43.948 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021401453000000001, 2024-09-12T00:05:43.948 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:43.948 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:43.948 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:43.948 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:43.948 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:43.948 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:43.948 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1917 2024-09-12T00:05:43.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.949 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:43.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.949 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:43.949 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:43.949 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:43.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.949 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:43.949 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165186+0000", 2024-09-12T00:05:43.949 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:43.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.949 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:43.950 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.165188+0000", 2024-09-12T00:05:43.950 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5409999999999999e-06 2024-09-12T00:05:43.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.950 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.950 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:43.950 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169353+0000", 2024-09-12T00:05:43.950 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00416446 2024-09-12T00:05:43.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.950 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.950 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:43.950 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169380+0000", 2024-09-12T00:05:43.951 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6919000000000001e-05 2024-09-12T00:05:43.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.951 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.951 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:43.951 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169392+0000", 2024-09-12T00:05:43.951 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1967000000000001e-05 2024-09-12T00:05:43.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.951 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.951 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:43.951 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169519+0000", 2024-09-12T00:05:43.951 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012686199999999999 2024-09-12T00:05:43.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.952 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.952 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:43.952 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.169789+0000", 2024-09-12T00:05:43.952 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027062700000000001 2024-09-12T00:05:43.952 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.952 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.952 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:43.952 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.170614+0000", 2024-09-12T00:05:43.952 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00082475799999999998 2024-09-12T00:05:43.952 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.952 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.952 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:43.952 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.183665+0000", 2024-09-12T00:05:43.953 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013051269000000001 2024-09-12T00:05:43.953 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.953 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.953 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:43.953 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186367+0000", 2024-09-12T00:05:43.953 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002701789 2024-09-12T00:05:43.953 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.953 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.953 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:43.953 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186485+0000", 2024-09-12T00:05:43.953 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011763400000000001 2024-09-12T00:05:43.953 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.953 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.953 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:43.954 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:35.186587+0000", 2024-09-12T00:05:43.954 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010262700000000001 2024-09-12T00:05:43.954 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:43.954 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:43.954 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:43.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.954 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.954 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2718 3.4 3:20fe36bb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:43.954 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:43.954 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 56.153839896000001, 2024-09-12T00:05:43.954 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027867928, 2024-09-12T00:05:43.954 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:43.954 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:43.955 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:43.955 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:43.955 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:43.955 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:43.955 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2718 2024-09-12T00:05:43.955 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.955 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:43.955 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.955 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:43.955 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:43.956 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:43.956 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.956 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.956 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:43.956 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:43.956 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:43.956 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.956 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.956 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:43.956 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785584+0000", 2024-09-12T00:05:43.956 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.056e-06 2024-09-12T00:05:43.956 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.957 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.957 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:43.957 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792023+0000", 2024-09-12T00:05:43.957 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064398069999999996 2024-09-12T00:05:43.957 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.957 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.957 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:43.957 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792058+0000", 2024-09-12T00:05:43.957 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5018000000000003e-05 2024-09-12T00:05:43.957 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.957 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.957 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:43.957 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792078+0000", 2024-09-12T00:05:43.958 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9862000000000001e-05 2024-09-12T00:05:43.958 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.958 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.958 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:43.958 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792248+0000", 2024-09-12T00:05:43.958 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017006399999999999 2024-09-12T00:05:43.958 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.958 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.958 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:43.958 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792660+0000", 2024-09-12T00:05:43.958 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041189500000000001 2024-09-12T00:05:43.958 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.958 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.958 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:43.959 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793081+0000", 2024-09-12T00:05:43.959 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000420395 2024-09-12T00:05:43.959 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.959 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.959 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:43.959 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808422+0000", 2024-09-12T00:05:43.959 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015341626000000001 2024-09-12T00:05:43.959 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.959 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.959 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:43.959 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813192+0000", 2024-09-12T00:05:43.959 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047701799999999997 2024-09-12T00:05:43.959 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.960 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.960 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:43.960 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813339+0000", 2024-09-12T00:05:43.960 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014643800000000001 2024-09-12T00:05:43.960 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.960 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.960 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:43.960 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813449+0000", 2024-09-12T00:05:43.960 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010958700000000001 2024-09-12T00:05:43.960 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:43.960 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:43.960 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:43.960 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.961 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.961 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2719 3.1 3:83b62cc7:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:43.961 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:43.961 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 56.145332459000002, 2024-09-12T00:05:43.961 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021687128999999999, 2024-09-12T00:05:43.961 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:43.961 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:43.961 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:43.961 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:43.961 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:43.962 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:43.962 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2719 2024-09-12T00:05:43.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.962 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:43.962 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.962 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:43.962 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:43.962 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:43.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.962 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.962 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:43.962 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794088+0000", 2024-09-12T00:05:43.962 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:43.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.963 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.963 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:43.963 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.794091+0000", 2024-09-12T00:05:43.963 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0630000000000002e-06 2024-09-12T00:05:43.963 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.963 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.963 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:43.963 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800194+0000", 2024-09-12T00:05:43.963 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061025089999999999 2024-09-12T00:05:43.963 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.963 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.963 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:43.963 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800234+0000", 2024-09-12T00:05:43.963 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0114999999999998e-05 2024-09-12T00:05:43.964 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.964 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.964 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:43.964 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800255+0000", 2024-09-12T00:05:43.964 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1548000000000001e-05 2024-09-12T00:05:43.964 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.964 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.964 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:43.964 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800400+0000", 2024-09-12T00:05:43.964 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014438499999999999 2024-09-12T00:05:43.964 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.964 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.964 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:43.964 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800654+0000", 2024-09-12T00:05:43.965 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025430500000000003 2024-09-12T00:05:43.965 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.965 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.965 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:43.965 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.800908+0000", 2024-09-12T00:05:43.965 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025422800000000001 2024-09-12T00:05:43.965 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.965 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.965 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:43.965 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.814197+0000", 2024-09-12T00:05:43.965 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013289216 2024-09-12T00:05:43.965 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.965 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.965 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:43.966 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815578+0000", 2024-09-12T00:05:43.966 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00138079 2024-09-12T00:05:43.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.966 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.966 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:43.966 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815704+0000", 2024-09-12T00:05:43.966 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012551500000000001 2024-09-12T00:05:43.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.966 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.966 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:43.966 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.815775+0000", 2024-09-12T00:05:43.966 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1454999999999999e-05 2024-09-12T00:05:43.966 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:43.966 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:43.967 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:43.967 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.967 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.967 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2736 3.25 3:a750a681:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:43.967 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:43.967 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 55.964067534000002, 2024-09-12T00:05:43.967 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025701234999999999, 2024-09-12T00:05:43.967 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:43.967 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:43.967 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:43.967 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:43.967 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:43.967 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:43.967 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2736 2024-09-12T00:05:43.967 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.968 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:43.968 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.968 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:43.968 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:43.968 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:43.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.968 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.968 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:43.968 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:43.968 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:43.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.968 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.968 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:43.969 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975357+0000", 2024-09-12T00:05:43.969 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9389999999999999e-06 2024-09-12T00:05:43.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.969 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.969 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:43.969 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979365+0000", 2024-09-12T00:05:43.969 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040076679999999998 2024-09-12T00:05:43.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.969 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.969 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:43.969 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979402+0000", 2024-09-12T00:05:43.970 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7557e-05 2024-09-12T00:05:43.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.970 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.970 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:43.970 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979419+0000", 2024-09-12T00:05:43.970 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7203000000000001e-05 2024-09-12T00:05:43.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.970 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.970 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:43.970 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979543+0000", 2024-09-12T00:05:43.970 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000123423 2024-09-12T00:05:43.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.970 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.971 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:43.971 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979784+0000", 2024-09-12T00:05:43.971 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024097800000000001 2024-09-12T00:05:43.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.971 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.971 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:43.971 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980013+0000", 2024-09-12T00:05:43.971 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022881999999999999 2024-09-12T00:05:43.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.971 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.971 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:43.972 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.999860+0000", 2024-09-12T00:05:43.972 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019847908000000001 2024-09-12T00:05:43.972 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.972 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.972 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:43.972 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000741+0000", 2024-09-12T00:05:43.972 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00088041499999999995 2024-09-12T00:05:43.972 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.972 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.972 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:43.972 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000915+0000", 2024-09-12T00:05:43.972 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017460300000000001 2024-09-12T00:05:43.972 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.973 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:43.973 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.001054+0000", 2024-09-12T00:05:43.973 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013872099999999999 2024-09-12T00:05:43.973 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:43.973 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:43.973 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:43.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.973 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2737 3.25 3:a794c975:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:43.973 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:43.973 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 55.954054728000003, 2024-09-12T00:05:43.973 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022562862999999999, 2024-09-12T00:05:43.973 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:43.974 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:43.974 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:43.974 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:43.974 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:43.974 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:43.974 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2737 2024-09-12T00:05:43.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.974 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:43.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.974 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:43.974 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:43.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:43.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.975 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:43.975 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985366+0000", 2024-09-12T00:05:43.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:43.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.975 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:43.975 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.985368+0000", 2024-09-12T00:05:43.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.323e-06 2024-09-12T00:05:43.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.975 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:43.975 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990209+0000", 2024-09-12T00:05:43.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004840446 2024-09-12T00:05:43.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.976 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.976 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:43.976 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990255+0000", 2024-09-12T00:05:43.976 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6526999999999997e-05 2024-09-12T00:05:43.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.976 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.976 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:43.976 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990283+0000", 2024-09-12T00:05:43.976 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7631e-05 2024-09-12T00:05:43.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.976 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.976 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:43.977 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990445+0000", 2024-09-12T00:05:43.977 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016238400000000001 2024-09-12T00:05:43.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.977 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:43.977 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.990732+0000", 2024-09-12T00:05:43.977 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028698299999999999 2024-09-12T00:05:43.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.977 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:43.977 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.991001+0000", 2024-09-12T00:05:43.977 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026869099999999999 2024-09-12T00:05:43.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.978 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:43.978 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007077+0000", 2024-09-12T00:05:43.978 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.016076686999999999 2024-09-12T00:05:43.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.978 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:43.978 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007761+0000", 2024-09-12T00:05:43.978 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00068366399999999995 2024-09-12T00:05:43.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.978 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:43.978 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007860+0000", 2024-09-12T00:05:43.978 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8513999999999999e-05 2024-09-12T00:05:43.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.979 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:43.979 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.007929+0000", 2024-09-12T00:05:43.979 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.9012999999999998e-05 2024-09-12T00:05:43.979 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:43.979 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:43.979 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:43.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.979 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.979 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2964 3.24 3:26c83ec0:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:43.979 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:43.979 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 23.934005731999999, 2024-09-12T00:05:43.979 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028979713000000001, 2024-09-12T00:05:43.979 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:43.980 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:43.980 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:43.980 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:43.980 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:43.980 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:43.980 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2964 2024-09-12T00:05:43.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.980 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:43.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.980 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:43.980 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:43.980 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:43.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.981 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:43.981 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:43.981 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:43.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.981 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:43.981 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005417+0000", 2024-09-12T00:05:43.981 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2450000000000001e-06 2024-09-12T00:05:43.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.981 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:43.981 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010885+0000", 2024-09-12T00:05:43.981 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054684809999999999 2024-09-12T00:05:43.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.982 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:43.982 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010901+0000", 2024-09-12T00:05:43.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5097e-05 2024-09-12T00:05:43.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.982 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:43.982 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010908+0000", 2024-09-12T00:05:43.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7419999999999997e-06 2024-09-12T00:05:43.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.982 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:43.982 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010968+0000", 2024-09-12T00:05:43.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.9837000000000003e-05 2024-09-12T00:05:43.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.983 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.983 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:43.983 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011082+0000", 2024-09-12T00:05:43.983 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011357399999999999 2024-09-12T00:05:43.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.983 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.983 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:43.983 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011174+0000", 2024-09-12T00:05:43.983 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2703999999999999e-05 2024-09-12T00:05:43.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.983 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.984 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:43.984 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.021639+0000", 2024-09-12T00:05:43.984 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010464641 2024-09-12T00:05:43.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.984 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.984 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:43.984 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034210+0000", 2024-09-12T00:05:43.984 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012570463 2024-09-12T00:05:43.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.984 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.984 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:43.984 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034300+0000", 2024-09-12T00:05:43.984 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0691000000000003e-05 2024-09-12T00:05:43.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.985 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:43.985 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034394+0000", 2024-09-12T00:05:43.985 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4238000000000001e-05 2024-09-12T00:05:43.985 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:43.985 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:43.985 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:43.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.985 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3052 3.32 3:4d6db9ea:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:43.985 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:43.985 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 22.959759106, 2024-09-12T00:05:43.986 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028091277000000001, 2024-09-12T00:05:43.986 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:43.986 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:43.986 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:43.986 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:43.986 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:43.986 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:43.986 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3052 2024-09-12T00:05:43.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.986 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:43.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.986 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:43.986 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:43.986 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:43.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.987 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:43.987 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:43.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:43.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.987 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:43.987 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979664+0000", 2024-09-12T00:05:43.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:05:43.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.987 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:43.987 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986918+0000", 2024-09-12T00:05:43.988 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0072537110000000004 2024-09-12T00:05:43.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.988 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:43.988 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986956+0000", 2024-09-12T00:05:43.988 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8111999999999997e-05 2024-09-12T00:05:43.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.988 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:43.988 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986975+0000", 2024-09-12T00:05:43.988 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9245999999999998e-05 2024-09-12T00:05:43.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.988 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:43.989 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987159+0000", 2024-09-12T00:05:43.989 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000183828 2024-09-12T00:05:43.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.989 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:43.989 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987552+0000", 2024-09-12T00:05:43.989 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039349699999999998 2024-09-12T00:05:43.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.989 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:43.989 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987943+0000", 2024-09-12T00:05:43.989 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000390579 2024-09-12T00:05:43.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.990 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:43.990 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.999384+0000", 2024-09-12T00:05:43.990 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011441563 2024-09-12T00:05:43.990 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.990 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.990 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:43.990 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007634+0000", 2024-09-12T00:05:43.990 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082496240000000005 2024-09-12T00:05:43.990 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.990 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.990 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:43.990 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007699+0000", 2024-09-12T00:05:43.990 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5089e-05 2024-09-12T00:05:43.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.991 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.991 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:43.991 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007753+0000", 2024-09-12T00:05:43.991 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3588000000000003e-05 2024-09-12T00:05:43.991 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:43.991 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:43.991 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:43.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.991 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.991 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3064 3.4 3:209c6609:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:43.991 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:43.991 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 22.827443828, 2024-09-12T00:05:43.992 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024628305999999999, 2024-09-12T00:05:43.992 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:43.992 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:43.992 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:43.992 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:43.992 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:43.992 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:43.992 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3064 2024-09-12T00:05:43.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.992 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:43.992 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.992 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:43.992 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:43.993 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:43.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.993 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:43.993 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:43.993 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:43.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.993 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:43.993 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111980+0000", 2024-09-12T00:05:43.993 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.005e-06 2024-09-12T00:05:43.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.993 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:43.994 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116464+0000", 2024-09-12T00:05:43.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044839210000000001 2024-09-12T00:05:43.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.994 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:43.994 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116490+0000", 2024-09-12T00:05:43.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6690999999999999e-05 2024-09-12T00:05:43.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.994 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:43.994 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116504+0000", 2024-09-12T00:05:43.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4109e-05 2024-09-12T00:05:43.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.995 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:43.995 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116639+0000", 2024-09-12T00:05:43.995 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013427 2024-09-12T00:05:43.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.995 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.995 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:43.995 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116931+0000", 2024-09-12T00:05:43.995 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000292603 2024-09-12T00:05:43.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.995 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.995 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:43.995 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.117174+0000", 2024-09-12T00:05:43.995 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024240700000000001 2024-09-12T00:05:43.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.996 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:43.996 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126449+0000", 2024-09-12T00:05:43.996 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0092748699999999993 2024-09-12T00:05:43.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.996 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:43.996 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136438+0000", 2024-09-12T00:05:43.996 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099898539999999994 2024-09-12T00:05:43.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.996 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:43.996 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136532+0000", 2024-09-12T00:05:43.996 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3898000000000001e-05 2024-09-12T00:05:43.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.997 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.997 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:43.997 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136605+0000", 2024-09-12T00:05:43.997 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2677999999999998e-05 2024-09-12T00:05:43.997 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:43.997 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:43.997 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:43.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.997 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.997 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3094 3.33 3:cfcc7f7f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:43.997 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.540440+0000", 2024-09-12T00:05:43.997 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 22.398980705, 2024-09-12T00:05:43.997 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021132270000000002, 2024-09-12T00:05:43.998 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:43.998 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:43.998 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:43.998 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:43.998 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:43.998 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:43.998 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3094 2024-09-12T00:05:43.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.998 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:43.998 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.998 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:43.998 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540440+0000", 2024-09-12T00:05:43.998 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:43.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.999 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:43.999 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540440+0000", 2024-09-12T00:05:43.999 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:43.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.999 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:43.999 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.540442+0000", 2024-09-12T00:05:43.999 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9599999999999999e-06 2024-09-12T00:05:43.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:43.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:43.999 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:43.999 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545099+0000", 2024-09-12T00:05:43.999 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046570359999999998 2024-09-12T00:05:43.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.000 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.000 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.000 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545122+0000", 2024-09-12T00:05:44.000 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3485999999999998e-05 2024-09-12T00:05:44.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.000 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.000 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.000 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545135+0000", 2024-09-12T00:05:44.000 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3073e-05 2024-09-12T00:05:44.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.000 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.000 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.001 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545252+0000", 2024-09-12T00:05:44.001 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011621299999999999 2024-09-12T00:05:44.001 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.001 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.001 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.001 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545450+0000", 2024-09-12T00:05:44.001 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000198474 2024-09-12T00:05:44.001 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.001 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.001 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:44.001 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.545580+0000", 2024-09-12T00:05:44.001 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013033899999999999 2024-09-12T00:05:44.001 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.001 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.002 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.002 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.552356+0000", 2024-09-12T00:05:44.002 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0067756240000000001 2024-09-12T00:05:44.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.002 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.002 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.002 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.560831+0000", 2024-09-12T00:05:44.002 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0084745440000000005 2024-09-12T00:05:44.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.002 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.002 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.002 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.561038+0000", 2024-09-12T00:05:44.002 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000207565 2024-09-12T00:05:44.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.003 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.003 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.561572+0000", 2024-09-12T00:05:44.003 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00053395600000000004 2024-09-12T00:05:44.003 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.003 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.003 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.003 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3097 3.33 3:cc1991a3:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:44.003 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.588213+0000", 2024-09-12T00:05:44.003 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 22.351207917, 2024-09-12T00:05:44.003 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021968250000000002, 2024-09-12T00:05:44.004 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.004 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.004 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.004 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.004 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.004 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.004 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3097 2024-09-12T00:05:44.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.004 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.004 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.004 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.588213+0000", 2024-09-12T00:05:44.004 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.005 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.588213+0000", 2024-09-12T00:05:44.005 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.005 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.005 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.588215+0000", 2024-09-12T00:05:44.005 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7049999999999999e-06 2024-09-12T00:05:44.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.005 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.005 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592148+0000", 2024-09-12T00:05:44.005 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039329639999999997 2024-09-12T00:05:44.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.006 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.006 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592173+0000", 2024-09-12T00:05:44.006 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4596999999999998e-05 2024-09-12T00:05:44.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.006 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.006 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592188+0000", 2024-09-12T00:05:44.006 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4994000000000001e-05 2024-09-12T00:05:44.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.006 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.007 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592372+0000", 2024-09-12T00:05:44.007 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018397899999999999 2024-09-12T00:05:44.007 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.007 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.007 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.007 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592639+0000", 2024-09-12T00:05:44.007 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026700299999999998 2024-09-12T00:05:44.007 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.007 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.007 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:44.007 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.592916+0000", 2024-09-12T00:05:44.007 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027759300000000002 2024-09-12T00:05:44.007 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.007 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.008 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.008 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.602239+0000", 2024-09-12T00:05:44.008 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0093227550000000003 2024-09-12T00:05:44.008 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.008 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.008 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.008 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.609997+0000", 2024-09-12T00:05:44.008 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077576390000000002 2024-09-12T00:05:44.008 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.008 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.008 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.008 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.610109+0000", 2024-09-12T00:05:44.008 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000111753 2024-09-12T00:05:44.008 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.009 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.009 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.009 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.610181+0000", 2024-09-12T00:05:44.009 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2268000000000007e-05 2024-09-12T00:05:44.009 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.009 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.009 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.009 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.009 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.009 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3125 3.12 3:495b0235:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:44.009 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:44.009 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 22.023649823, 2024-09-12T00:05:44.009 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030616648999999999, 2024-09-12T00:05:44.009 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.010 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.010 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.010 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.010 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.010 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.010 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3125 2024-09-12T00:05:44.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.010 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.010 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.011 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.011 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:44.011 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.011 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.011 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.011 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:44.011 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.011 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.011 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.011 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915773+0000", 2024-09-12T00:05:44.011 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2800000000000002e-06 2024-09-12T00:05:44.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.012 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.012 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919856+0000", 2024-09-12T00:05:44.012 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004082713 2024-09-12T00:05:44.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.012 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.012 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919879+0000", 2024-09-12T00:05:44.012 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3782e-05 2024-09-12T00:05:44.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.012 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.012 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919891+0000", 2024-09-12T00:05:44.013 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1440000000000001e-05 2024-09-12T00:05:44.013 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.013 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.013 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.013 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920037+0000", 2024-09-12T00:05:44.013 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014562700000000001 2024-09-12T00:05:44.013 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.013 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.013 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.013 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920280+0000", 2024-09-12T00:05:44.013 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000243274 2024-09-12T00:05:44.013 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.013 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.014 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:44.014 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920527+0000", 2024-09-12T00:05:44.014 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024692699999999998 2024-09-12T00:05:44.014 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.014 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.014 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.014 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.932485+0000", 2024-09-12T00:05:44.014 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011957857000000001 2024-09-12T00:05:44.014 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.014 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.014 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.014 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946197+0000", 2024-09-12T00:05:44.014 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013712436999999999 2024-09-12T00:05:44.014 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.015 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.015 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.015 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946305+0000", 2024-09-12T00:05:44.015 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000107914 2024-09-12T00:05:44.015 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.015 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.015 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.015 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946387+0000", 2024-09-12T00:05:44.015 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2398000000000006e-05 2024-09-12T00:05:44.015 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.015 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.015 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.015 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.015 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.016 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3127 3.24 3:2477ff85:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:44.016 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.943043+0000", 2024-09-12T00:05:44.016 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 21.996377314, 2024-09-12T00:05:44.016 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020914724999999999, 2024-09-12T00:05:44.016 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.016 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.016 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.016 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.016 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.016 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.016 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3127 2024-09-12T00:05:44.016 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.016 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.017 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.017 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.017 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.943043+0000", 2024-09-12T00:05:44.017 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.017 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.017 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.017 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.943043+0000", 2024-09-12T00:05:44.017 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.017 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.017 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.017 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.943046+0000", 2024-09-12T00:05:44.018 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3069999999999998e-06 2024-09-12T00:05:44.018 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.018 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.018 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.018 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947004+0000", 2024-09-12T00:05:44.018 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039575360000000002 2024-09-12T00:05:44.018 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.018 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.018 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.018 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947022+0000", 2024-09-12T00:05:44.018 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7847e-05 2024-09-12T00:05:44.018 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.018 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.018 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.019 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947030+0000", 2024-09-12T00:05:44.019 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.5399999999999996e-06 2024-09-12T00:05:44.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.019 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.019 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.019 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947087+0000", 2024-09-12T00:05:44.019 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6496999999999998e-05 2024-09-12T00:05:44.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.019 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.019 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.019 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947251+0000", 2024-09-12T00:05:44.019 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016407499999999999 2024-09-12T00:05:44.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.020 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.020 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:44.020 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.947422+0000", 2024-09-12T00:05:44.020 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017108 2024-09-12T00:05:44.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.020 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.020 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.020 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.953910+0000", 2024-09-12T00:05:44.020 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064883980000000003 2024-09-12T00:05:44.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.020 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.020 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.020 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.963872+0000", 2024-09-12T00:05:44.021 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099617839999999996 2024-09-12T00:05:44.021 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.021 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.021 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.021 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.963918+0000", 2024-09-12T00:05:44.021 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5692999999999998e-05 2024-09-12T00:05:44.021 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.021 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.021 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.021 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.963958+0000", 2024-09-12T00:05:44.021 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9968000000000001e-05 2024-09-12T00:05:44.021 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.021 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.022 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.022 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.022 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3132 3.4 3:216a5295:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:44.022 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.015391+0000", 2024-09-12T00:05:44.022 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 21.924029617999999, 2024-09-12T00:05:44.022 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022006318, 2024-09-12T00:05:44.022 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.022 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.022 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.022 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.022 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.022 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.022 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3132 2024-09-12T00:05:44.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.023 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.023 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.023 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.015391+0000", 2024-09-12T00:05:44.023 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.023 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.023 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.015391+0000", 2024-09-12T00:05:44.023 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.023 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.024 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.015394+0000", 2024-09-12T00:05:44.024 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6260000000000001e-06 2024-09-12T00:05:44.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.024 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.024 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.024 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.019828+0000", 2024-09-12T00:05:44.024 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044333109999999997 2024-09-12T00:05:44.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.024 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.024 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.024 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.019859+0000", 2024-09-12T00:05:44.024 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1575999999999997e-05 2024-09-12T00:05:44.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.025 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.025 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.019875+0000", 2024-09-12T00:05:44.025 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5875999999999998e-05 2024-09-12T00:05:44.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.025 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.025 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.020009+0000", 2024-09-12T00:05:44.025 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133953 2024-09-12T00:05:44.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.025 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.025 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.020264+0000", 2024-09-12T00:05:44.026 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025509000000000003 2024-09-12T00:05:44.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.026 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.026 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:44.026 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.020504+0000", 2024-09-12T00:05:44.026 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000240184 2024-09-12T00:05:44.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.026 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.026 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.026 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.031616+0000", 2024-09-12T00:05:44.026 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011111843 2024-09-12T00:05:44.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.026 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.026 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.027 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.037072+0000", 2024-09-12T00:05:44.027 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054553400000000004 2024-09-12T00:05:44.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.027 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.027 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.027 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.037271+0000", 2024-09-12T00:05:44.027 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000199199 2024-09-12T00:05:44.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.027 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.027 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.027 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.037397+0000", 2024-09-12T00:05:44.027 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012632 2024-09-12T00:05:44.027 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.028 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.028 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.028 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.028 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.028 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3134 3.24 3:2525a955:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:44.028 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:44.028 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 21.899573093000001, 2024-09-12T00:05:44.028 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025606806999999999, 2024-09-12T00:05:44.028 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.028 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.028 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.028 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.028 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.028 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.029 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3134 2024-09-12T00:05:44.029 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.029 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.029 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.029 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.029 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:44.029 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.029 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.029 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.029 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.029 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:44.029 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.029 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.029 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.030 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.030 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039850+0000", 2024-09-12T00:05:44.030 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9780000000000001e-06 2024-09-12T00:05:44.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.030 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.030 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045256+0000", 2024-09-12T00:05:44.030 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054058129999999998 2024-09-12T00:05:44.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.030 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.030 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045284+0000", 2024-09-12T00:05:44.030 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8065e-05 2024-09-12T00:05:44.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.031 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.031 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045297+0000", 2024-09-12T00:05:44.031 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2788e-05 2024-09-12T00:05:44.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.031 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.031 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045378+0000", 2024-09-12T00:05:44.031 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1079000000000001e-05 2024-09-12T00:05:44.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.031 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.031 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045530+0000", 2024-09-12T00:05:44.031 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015206099999999999 2024-09-12T00:05:44.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.032 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:44.032 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045655+0000", 2024-09-12T00:05:44.032 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012525899999999999 2024-09-12T00:05:44.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.032 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.032 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.054817+0000", 2024-09-12T00:05:44.032 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0091611049999999992 2024-09-12T00:05:44.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.032 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.032 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065354+0000", 2024-09-12T00:05:44.032 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010537625 2024-09-12T00:05:44.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.033 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.033 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.033 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065410+0000", 2024-09-12T00:05:44.033 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6141999999999999e-05 2024-09-12T00:05:44.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.033 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.033 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.033 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065454+0000", 2024-09-12T00:05:44.033 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3891999999999999e-05 2024-09-12T00:05:44.033 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.033 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.033 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.034 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.034 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3375 3.15 e82/23 3:ab335e39:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_2:head v 82'7, mlcod=76'5)", 2024-09-12T00:05:44.034 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.648382+0000", 2024-09-12T00:05:44.034 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.2910386570000001, 2024-09-12T00:05:44.034 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.023352797000000002, 2024-09-12T00:05:44.034 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.034 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.034 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.034 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.034 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.034 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.034 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.648382+0000", 2024-09-12T00:05:44.034 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.034 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.035 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.035 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.035 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.648382+0000", 2024-09-12T00:05:44.035 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.035 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.035 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.035 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.648382+0000", 2024-09-12T00:05:44.035 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1699999999999998e-07 2024-09-12T00:05:44.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.035 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.035 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.035 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.655436+0000", 2024-09-12T00:05:44.035 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0070534860000000003 2024-09-12T00:05:44.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.036 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.036 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.036 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.655474+0000", 2024-09-12T00:05:44.036 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7799000000000002e-05 2024-09-12T00:05:44.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.036 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.036 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.036 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.655492+0000", 2024-09-12T00:05:44.036 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8073000000000001e-05 2024-09-12T00:05:44.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.036 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.036 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.036 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.655629+0000", 2024-09-12T00:05:44.036 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000137651 2024-09-12T00:05:44.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.037 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.037 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.037 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.655668+0000", 2024-09-12T00:05:44.037 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8893000000000002e-05 2024-09-12T00:05:44.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.037 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.037 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.037 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.671634+0000", 2024-09-12T00:05:44.037 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.01596622 2024-09-12T00:05:44.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.037 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.037 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.037 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.671735+0000", 2024-09-12T00:05:44.038 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000100158 2024-09-12T00:05:44.038 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.038 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.038 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.038 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.038 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3386 3.1 3:8071dd26:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:44.038 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.767011+0000", 2024-09-12T00:05:44.038 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.172409976, 2024-09-12T00:05:44.038 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.031756300000000001, 2024-09-12T00:05:44.038 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.038 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.038 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.038 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.039 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.039 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.039 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3386 2024-09-12T00:05:44.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.039 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.039 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.039 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.767011+0000", 2024-09-12T00:05:44.039 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.039 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.039 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.767011+0000", 2024-09-12T00:05:44.039 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.040 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.040 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.040 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.040 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.767014+0000", 2024-09-12T00:05:44.040 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0429999999999999e-06 2024-09-12T00:05:44.040 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.040 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.040 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.040 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775360+0000", 2024-09-12T00:05:44.040 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0083463740000000002 2024-09-12T00:05:44.040 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.040 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.040 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.041 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775398+0000", 2024-09-12T00:05:44.041 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8376e-05 2024-09-12T00:05:44.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.041 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.041 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.041 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775415+0000", 2024-09-12T00:05:44.041 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6563e-05 2024-09-12T00:05:44.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.041 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.041 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.041 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775556+0000", 2024-09-12T00:05:44.041 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000140865 2024-09-12T00:05:44.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.041 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.041 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.042 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775819+0000", 2024-09-12T00:05:44.042 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000262842 2024-09-12T00:05:44.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.042 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.042 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:44.042 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.776048+0000", 2024-09-12T00:05:44.042 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000229399 2024-09-12T00:05:44.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.042 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.042 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.042 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.791048+0000", 2024-09-12T00:05:44.042 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015000503 2024-09-12T00:05:44.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.042 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.043 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.043 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.798597+0000", 2024-09-12T00:05:44.043 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0075482409999999998 2024-09-12T00:05:44.043 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.043 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.043 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.798690+0000", 2024-09-12T00:05:44.043 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3769000000000003e-05 2024-09-12T00:05:44.043 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.043 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.043 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.798767+0000", 2024-09-12T00:05:44.043 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6324999999999999e-05 2024-09-12T00:05:44.043 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.044 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.044 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.044 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.044 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3397 3.4 3:220517e3:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:44.044 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.890276+0000", 2024-09-12T00:05:44.044 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.0491449689999999, 2024-09-12T00:05:44.044 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.02507564, 2024-09-12T00:05:44.044 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.044 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.044 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.044 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.045 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.045 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.045 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3397 2024-09-12T00:05:44.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.045 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.045 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.045 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.045 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.890276+0000", 2024-09-12T00:05:44.045 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.045 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.045 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.045 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.890276+0000", 2024-09-12T00:05:44.045 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.046 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.046 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.890281+0000", 2024-09-12T00:05:44.046 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.366e-06 2024-09-12T00:05:44.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.046 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.046 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.894729+0000", 2024-09-12T00:05:44.046 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044483320000000002 2024-09-12T00:05:44.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.046 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.047 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.894782+0000", 2024-09-12T00:05:44.047 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2445999999999999e-05 2024-09-12T00:05:44.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.047 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.047 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.894810+0000", 2024-09-12T00:05:44.047 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8126000000000001e-05 2024-09-12T00:05:44.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.047 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.047 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.894961+0000", 2024-09-12T00:05:44.047 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015165999999999999 2024-09-12T00:05:44.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.047 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.048 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.895228+0000", 2024-09-12T00:05:44.048 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026675599999999999 2024-09-12T00:05:44.048 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.048 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.048 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:44.048 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.895478+0000", 2024-09-12T00:05:44.048 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025020199999999999 2024-09-12T00:05:44.048 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.048 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.048 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.048 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.913919+0000", 2024-09-12T00:05:44.048 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018440096999999999 2024-09-12T00:05:44.048 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.049 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.049 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.049 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.915109+0000", 2024-09-12T00:05:44.049 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0011908660000000001 2024-09-12T00:05:44.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.049 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.049 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.049 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.915239+0000", 2024-09-12T00:05:44.049 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012928399999999999 2024-09-12T00:05:44.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.049 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.049 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.049 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.915351+0000", 2024-09-12T00:05:44.049 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011250499999999999 2024-09-12T00:05:44.050 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.050 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.050 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.050 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.050 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.050 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3398 3.12 3:4888914b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:44.050 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.904027+0000", 2024-09-12T00:05:44.050 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.0353933770000001, 2024-09-12T00:05:44.050 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.029408179999999999, 2024-09-12T00:05:44.050 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.050 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.050 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.050 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.051 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.051 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.051 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3398 2024-09-12T00:05:44.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.051 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.051 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.051 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.904027+0000", 2024-09-12T00:05:44.051 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.051 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.051 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.904027+0000", 2024-09-12T00:05:44.051 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.052 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.052 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.052 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.904030+0000", 2024-09-12T00:05:44.052 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0529999999999998e-06 2024-09-12T00:05:44.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.052 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.052 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.052 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.910958+0000", 2024-09-12T00:05:44.052 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0069274849999999997 2024-09-12T00:05:44.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.052 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.052 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.053 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.910989+0000", 2024-09-12T00:05:44.053 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1752999999999999e-05 2024-09-12T00:05:44.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.053 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.053 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.053 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911006+0000", 2024-09-12T00:05:44.053 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6463000000000001e-05 2024-09-12T00:05:44.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.053 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.053 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.053 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911171+0000", 2024-09-12T00:05:44.053 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016481699999999999 2024-09-12T00:05:44.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.053 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.054 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.054 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911417+0000", 2024-09-12T00:05:44.054 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024629600000000001 2024-09-12T00:05:44.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.054 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.054 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:44.054 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911646+0000", 2024-09-12T00:05:44.054 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022906599999999999 2024-09-12T00:05:44.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.054 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.054 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.054 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.932777+0000", 2024-09-12T00:05:44.054 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021130906000000001 2024-09-12T00:05:44.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.055 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.055 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.933094+0000", 2024-09-12T00:05:44.055 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000317127 2024-09-12T00:05:44.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.055 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.055 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.933277+0000", 2024-09-12T00:05:44.055 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018257000000000001 2024-09-12T00:05:44.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.055 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.055 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.933435+0000", 2024-09-12T00:05:44.055 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015864399999999999 2024-09-12T00:05:44.056 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.056 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.056 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.056 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.056 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3401 3.20 e82/23 3:06d9612a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_28:head v 82'11, mlcod=76'9)", 2024-09-12T00:05:44.056 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.936564+0000", 2024-09-12T00:05:44.056 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.0028566149999998, 2024-09-12T00:05:44.056 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.026227489999999999, 2024-09-12T00:05:44.056 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.057 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.057 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.057 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.057 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.057 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.936564+0000", 2024-09-12T00:05:44.057 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.057 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.057 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.936564+0000", 2024-09-12T00:05:44.057 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.057 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.058 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.936571+0000", 2024-09-12T00:05:44.058 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5959999999999998e-06 2024-09-12T00:05:44.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.058 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.058 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.058 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941597+0000", 2024-09-12T00:05:44.058 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0050253720000000002 2024-09-12T00:05:44.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.058 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.058 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.058 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941625+0000", 2024-09-12T00:05:44.058 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8564999999999998e-05 2024-09-12T00:05:44.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.058 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.059 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.059 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941640+0000", 2024-09-12T00:05:44.059 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4837e-05 2024-09-12T00:05:44.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.059 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.059 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.059 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941776+0000", 2024-09-12T00:05:44.059 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013623500000000001 2024-09-12T00:05:44.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.059 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.059 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.059 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941822+0000", 2024-09-12T00:05:44.059 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5513000000000003e-05 2024-09-12T00:05:44.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.060 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.962694+0000", 2024-09-12T00:05:44.060 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020871516999999999 2024-09-12T00:05:44.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.060 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.962791+0000", 2024-09-12T00:05:44.060 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7855000000000004e-05 2024-09-12T00:05:44.060 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.060 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.060 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.060 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.060 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.061 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:44.062 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:05:44.062 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:44.064+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:44.163 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:44.164+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:44.199 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:44.199 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:44.199 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:44.199 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:44.216 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:05:44.263 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:44.264+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:44.348 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:44.348 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:44.348 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:44.348 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:44.349 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:44.364 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:44.364+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:44.367 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:05:44.465 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:44.464+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:44.548 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:44.548 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:44.548 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:44.548 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:44.549 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.549 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:1646 3.25 e58/23 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head v 58'1, mlcod=0'0)", 2024-09-12T00:05:44.549 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:44.549 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 71.460599450000004, 2024-09-12T00:05:44.549 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020301987000000001, 2024-09-12T00:05:44.549 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.549 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.549 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.549 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.550 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.550 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.550 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:44.550 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.550 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.550 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.550 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.550 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:44.550 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.550 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.550 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.550 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.550 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086308+0000", 2024-09-12T00:05:44.550 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.95e-06 2024-09-12T00:05:44.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.551 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.551 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091174+0000", 2024-09-12T00:05:44.551 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048660559999999997 2024-09-12T00:05:44.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.551 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.551 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091218+0000", 2024-09-12T00:05:44.551 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4678999999999997e-05 2024-09-12T00:05:44.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.551 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.551 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091238+0000", 2024-09-12T00:05:44.552 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9839000000000001e-05 2024-09-12T00:05:44.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.552 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.552 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091396+0000", 2024-09-12T00:05:44.552 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000157396 2024-09-12T00:05:44.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.552 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.552 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091451+0000", 2024-09-12T00:05:44.552 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5547999999999997e-05 2024-09-12T00:05:44.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.553 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.553 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106474+0000", 2024-09-12T00:05:44.553 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015023287 2024-09-12T00:05:44.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.553 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.553 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106608+0000", 2024-09-12T00:05:44.553 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133232 2024-09-12T00:05:44.553 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.553 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.554 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.554 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.554 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2723 3.21 3:86535907:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:44.554 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:44.554 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 56.714751982999999, 2024-09-12T00:05:44.555 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021210407000000001, 2024-09-12T00:05:44.555 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.555 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.555 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.555 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.556 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.556 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.556 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2723 2024-09-12T00:05:44.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.556 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.556 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.556 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.556 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:44.556 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.557 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.557 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:44.557 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.557 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.557 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832157+0000", 2024-09-12T00:05:44.557 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3270000000000001e-06 2024-09-12T00:05:44.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.557 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.558 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837403+0000", 2024-09-12T00:05:44.558 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005246784 2024-09-12T00:05:44.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.558 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.558 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.558 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837439+0000", 2024-09-12T00:05:44.558 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5848e-05 2024-09-12T00:05:44.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.558 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.558 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.558 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837459+0000", 2024-09-12T00:05:44.558 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9585e-05 2024-09-12T00:05:44.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.559 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.559 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.559 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837574+0000", 2024-09-12T00:05:44.559 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000114917 2024-09-12T00:05:44.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.559 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.559 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.559 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837803+0000", 2024-09-12T00:05:44.559 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022967699999999999 2024-09-12T00:05:44.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.559 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.559 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:44.560 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838174+0000", 2024-09-12T00:05:44.560 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037083899999999998 2024-09-12T00:05:44.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.560 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.560 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.560 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848447+0000", 2024-09-12T00:05:44.560 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010272439 2024-09-12T00:05:44.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.561 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.561 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.561 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853191+0000", 2024-09-12T00:05:44.561 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047441109999999996 2024-09-12T00:05:44.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.561 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.561 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.561 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853292+0000", 2024-09-12T00:05:44.561 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000101474 2024-09-12T00:05:44.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.561 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.561 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.562 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853364+0000", 2024-09-12T00:05:44.562 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1406e-05 2024-09-12T00:05:44.562 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.562 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.562 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.562 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:2736 3.25 e63/23 3:a750a681:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_221:head v 63'5, mlcod=62'3)", 2024-09-12T00:05:44.562 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.980248+0000", 2024-09-12T00:05:44.563 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 56.566657112999998, 2024-09-12T00:05:44.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020132552000000001, 2024-09-12T00:05:44.563 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.563 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.563 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.563 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.563 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.563 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.563 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980248+0000", 2024-09-12T00:05:44.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.564 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.564 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980248+0000", 2024-09-12T00:05:44.564 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.564 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.564 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980251+0000", 2024-09-12T00:05:44.564 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7329999999999999e-06 2024-09-12T00:05:44.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.565 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.565 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.982917+0000", 2024-09-12T00:05:44.565 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0026662679999999998 2024-09-12T00:05:44.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.565 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.565 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.565 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.982960+0000", 2024-09-12T00:05:44.565 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3000999999999997e-05 2024-09-12T00:05:44.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.566 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.566 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.982985+0000", 2024-09-12T00:05:44.566 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5092e-05 2024-09-12T00:05:44.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.566 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.566 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.983163+0000", 2024-09-12T00:05:44.566 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000177942 2024-09-12T00:05:44.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.567 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.567 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.567 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.983221+0000", 2024-09-12T00:05:44.567 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.7476999999999999e-05 2024-09-12T00:05:44.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.567 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.567 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.567 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000301+0000", 2024-09-12T00:05:44.567 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017080503 2024-09-12T00:05:44.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.568 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.568 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000381+0000", 2024-09-12T00:05:44.568 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9536000000000006e-05 2024-09-12T00:05:44.568 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.568 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.568 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.568 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2756 3.21 3:849c909c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_241:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:44.569 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:48.197450+0000", 2024-09-12T00:05:44.569 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 56.349454829000003, 2024-09-12T00:05:44.569 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020201090000000001, 2024-09-12T00:05:44.569 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.569 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.569 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.569 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.569 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.570 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.570 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2756 2024-09-12T00:05:44.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.570 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.570 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.197450+0000", 2024-09-12T00:05:44.570 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.570 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.197450+0000", 2024-09-12T00:05:44.570 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.571 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.197455+0000", 2024-09-12T00:05:44.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4070000000000003e-06 2024-09-12T00:05:44.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.571 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.202967+0000", 2024-09-12T00:05:44.572 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0055122299999999999 2024-09-12T00:05:44.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.572 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.572 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.572 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203001+0000", 2024-09-12T00:05:44.572 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3685e-05 2024-09-12T00:05:44.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.572 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.572 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.572 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203017+0000", 2024-09-12T00:05:44.572 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6622000000000001e-05 2024-09-12T00:05:44.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.573 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.573 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203134+0000", 2024-09-12T00:05:44.573 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117166 2024-09-12T00:05:44.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.573 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.573 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203389+0000", 2024-09-12T00:05:44.573 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025456200000000001 2024-09-12T00:05:44.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.574 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:44.574 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.203625+0000", 2024-09-12T00:05:44.574 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000235856 2024-09-12T00:05:44.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.574 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.574 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.212670+0000", 2024-09-12T00:05:44.574 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0090446639999999991 2024-09-12T00:05:44.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.574 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.574 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.217469+0000", 2024-09-12T00:05:44.575 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047998559999999999 2024-09-12T00:05:44.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.575 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.575 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.575 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.217569+0000", 2024-09-12T00:05:44.575 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9753999999999994e-05 2024-09-12T00:05:44.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.575 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.575 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.575 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.217651+0000", 2024-09-12T00:05:44.575 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2287999999999995e-05 2024-09-12T00:05:44.575 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.576 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.576 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.576 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2971 3.2e 3:76f45d45:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:44.576 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:44.576 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.471037645999999, 2024-09-12T00:05:44.576 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022571213, 2024-09-12T00:05:44.576 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.576 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.576 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.577 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.577 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.577 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.577 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2971 2024-09-12T00:05:44.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.577 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.577 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.577 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.578 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:44.578 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.578 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.578 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:44.578 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.579 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.579 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075871+0000", 2024-09-12T00:05:44.579 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.467e-06 2024-09-12T00:05:44.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.579 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.579 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.579 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080307+0000", 2024-09-12T00:05:44.579 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044356359999999997 2024-09-12T00:05:44.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.579 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.580 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.580 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080346+0000", 2024-09-12T00:05:44.580 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9267999999999997e-05 2024-09-12T00:05:44.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.580 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.580 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.580 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080368+0000", 2024-09-12T00:05:44.580 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2603e-05 2024-09-12T00:05:44.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.581 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.581 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.581 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080489+0000", 2024-09-12T00:05:44.581 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0001209 2024-09-12T00:05:44.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.581 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.581 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.581 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080830+0000", 2024-09-12T00:05:44.581 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00034099 2024-09-12T00:05:44.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.582 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:44.582 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.081119+0000", 2024-09-12T00:05:44.582 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028860300000000001 2024-09-12T00:05:44.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.582 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.582 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.093241+0000", 2024-09-12T00:05:44.582 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012121609 2024-09-12T00:05:44.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.582 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098277+0000", 2024-09-12T00:05:44.583 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0050359710000000002 2024-09-12T00:05:44.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.583 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.583 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098366+0000", 2024-09-12T00:05:44.583 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9052000000000001e-05 2024-09-12T00:05:44.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.583 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.583 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098439+0000", 2024-09-12T00:05:44.584 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3114000000000005e-05 2024-09-12T00:05:44.584 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.584 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.584 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.584 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.584 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2996 3.21 3:872b1c12:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:44.584 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:44.584 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 24.196412908999999, 2024-09-12T00:05:44.585 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027562314000000001, 2024-09-12T00:05:44.585 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.585 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.585 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.585 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.585 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.585 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.585 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2996 2024-09-12T00:05:44.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.585 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.585 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.586 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.586 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:44.586 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.586 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.586 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.586 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.586 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:44.586 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.586 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.586 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.586 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.587 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350496+0000", 2024-09-12T00:05:44.587 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9160000000000003e-06 2024-09-12T00:05:44.587 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.587 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.587 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.587 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355187+0000", 2024-09-12T00:05:44.587 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046904989999999999 2024-09-12T00:05:44.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.588 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.588 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.588 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355223+0000", 2024-09-12T00:05:44.588 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6125999999999999e-05 2024-09-12T00:05:44.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.588 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.588 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.588 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355241+0000", 2024-09-12T00:05:44.588 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8686e-05 2024-09-12T00:05:44.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.589 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.589 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.589 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355373+0000", 2024-09-12T00:05:44.589 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013129299999999999 2024-09-12T00:05:44.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.589 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.589 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.589 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355619+0000", 2024-09-12T00:05:44.589 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024662700000000002 2024-09-12T00:05:44.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.590 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.590 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:44.590 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355855+0000", 2024-09-12T00:05:44.590 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023604299999999999 2024-09-12T00:05:44.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.590 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.590 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.590 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.367983+0000", 2024-09-12T00:05:44.590 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012127104999999999 2024-09-12T00:05:44.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.591 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.591 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377884+0000", 2024-09-12T00:05:44.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099013680000000007 2024-09-12T00:05:44.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.591 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.591 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377974+0000", 2024-09-12T00:05:44.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9932999999999994e-05 2024-09-12T00:05:44.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.592 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.592 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.378055+0000", 2024-09-12T00:05:44.592 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0717999999999995e-05 2024-09-12T00:05:44.592 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.592 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.592 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.592 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.592 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3030 3.2e 3:740afe3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:44.592 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:44.593 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 23.807082750999999, 2024-09-12T00:05:44.593 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.033756331000000001, 2024-09-12T00:05:44.593 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.593 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.593 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.593 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.593 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.593 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.593 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3030 2024-09-12T00:05:44.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.593 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.594 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.594 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:44.594 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.594 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.594 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.594 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:44.594 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.594 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.594 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.594 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739825+0000", 2024-09-12T00:05:44.594 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7920000000000001e-06 2024-09-12T00:05:44.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.595 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.595 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744217+0000", 2024-09-12T00:05:44.595 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043922529999999996 2024-09-12T00:05:44.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.595 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.595 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744243+0000", 2024-09-12T00:05:44.595 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5253e-05 2024-09-12T00:05:44.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.595 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.595 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744254+0000", 2024-09-12T00:05:44.596 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1430999999999999e-05 2024-09-12T00:05:44.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.596 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.596 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.596 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744325+0000", 2024-09-12T00:05:44.596 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1340999999999993e-05 2024-09-12T00:05:44.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.596 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.596 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.596 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744461+0000", 2024-09-12T00:05:44.596 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013531700000000001 2024-09-12T00:05:44.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.596 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.597 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:44.597 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744574+0000", 2024-09-12T00:05:44.597 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113513 2024-09-12T00:05:44.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.597 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.597 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.597 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.752813+0000", 2024-09-12T00:05:44.597 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082384750000000003 2024-09-12T00:05:44.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.598 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.598 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.598 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773444+0000", 2024-09-12T00:05:44.598 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020630773000000002 2024-09-12T00:05:44.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.598 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.598 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.598 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773510+0000", 2024-09-12T00:05:44.598 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6711000000000006e-05 2024-09-12T00:05:44.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.598 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.598 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.599 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773579+0000", 2024-09-12T00:05:44.599 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8472000000000004e-05 2024-09-12T00:05:44.599 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.599 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.599 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.599 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.599 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3039 3.2e 3:74587332:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:44.599 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:44.599 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 23.711402823, 2024-09-12T00:05:44.599 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.036215114, 2024-09-12T00:05:44.599 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.599 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.599 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.600 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.600 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.600 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.600 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3039 2024-09-12T00:05:44.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.600 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.600 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.600 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.600 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:44.600 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.601 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.601 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.601 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:44.601 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.601 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.601 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.601 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835507+0000", 2024-09-12T00:05:44.601 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6e-06 2024-09-12T00:05:44.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.601 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.602 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.602 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848930+0000", 2024-09-12T00:05:44.602 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013423242 2024-09-12T00:05:44.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.602 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.602 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.602 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848969+0000", 2024-09-12T00:05:44.602 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9270000000000002e-05 2024-09-12T00:05:44.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.603 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.603 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.603 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848991+0000", 2024-09-12T00:05:44.603 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1565000000000001e-05 2024-09-12T00:05:44.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.603 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.603 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.603 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849089+0000", 2024-09-12T00:05:44.603 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8408999999999999e-05 2024-09-12T00:05:44.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849518+0000", 2024-09-12T00:05:44.604 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042813900000000002 2024-09-12T00:05:44.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:44.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849897+0000", 2024-09-12T00:05:44.604 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037936600000000001 2024-09-12T00:05:44.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.858549+0000", 2024-09-12T00:05:44.605 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086520820000000002 2024-09-12T00:05:44.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871522+0000", 2024-09-12T00:05:44.605 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012973182999999999 2024-09-12T00:05:44.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871633+0000", 2024-09-12T00:05:44.606 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011085 2024-09-12T00:05:44.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.606 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.606 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.606 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871717+0000", 2024-09-12T00:05:44.606 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.4407999999999996e-05 2024-09-12T00:05:44.606 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.606 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.606 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.606 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.607 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3050 3.b 3:d26f7141:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:44.607 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:44.607 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 23.589790567000001, 2024-09-12T00:05:44.607 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022896481999999999, 2024-09-12T00:05:44.607 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.607 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.607 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.607 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.607 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.607 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.607 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3050 2024-09-12T00:05:44.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.607 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.608 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.608 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.608 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:44.608 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.608 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.608 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.608 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:44.608 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.608 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.608 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.609 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957117+0000", 2024-09-12T00:05:44.609 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7e-06 2024-09-12T00:05:44.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.609 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.609 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.609 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961673+0000", 2024-09-12T00:05:44.609 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045558059999999999 2024-09-12T00:05:44.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.609 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.609 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.609 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961698+0000", 2024-09-12T00:05:44.609 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5017000000000001e-05 2024-09-12T00:05:44.610 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.610 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.610 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.610 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961710+0000", 2024-09-12T00:05:44.610 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1963999999999999e-05 2024-09-12T00:05:44.610 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.610 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.610 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.610 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961785+0000", 2024-09-12T00:05:44.610 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5153000000000004e-05 2024-09-12T00:05:44.610 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.610 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.610 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.610 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961926+0000", 2024-09-12T00:05:44.610 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000141194 2024-09-12T00:05:44.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.611 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.611 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:44.611 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.962055+0000", 2024-09-12T00:05:44.611 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012882400000000001 2024-09-12T00:05:44.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.611 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.611 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.611 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.970716+0000", 2024-09-12T00:05:44.611 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086603610000000001 2024-09-12T00:05:44.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.612 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.612 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979700+0000", 2024-09-12T00:05:44.612 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.008984054 2024-09-12T00:05:44.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.612 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.612 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979884+0000", 2024-09-12T00:05:44.612 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184215 2024-09-12T00:05:44.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.612 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.613 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.980011+0000", 2024-09-12T00:05:44.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012719399999999999 2024-09-12T00:05:44.613 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.613 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.613 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.613 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3065 3.b 3:d10bf58d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:44.613 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:44.613 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 23.424842946999998, 2024-09-12T00:05:44.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021843261999999999, 2024-09-12T00:05:44.613 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.614 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.614 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.614 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.614 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.614 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.614 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3065 2024-09-12T00:05:44.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.614 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.614 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.614 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:44.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:44.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122067+0000", 2024-09-12T00:05:44.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4970000000000003e-06 2024-09-12T00:05:44.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126931+0000", 2024-09-12T00:05:44.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048641090000000001 2024-09-12T00:05:44.616 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.616 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.616 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.616 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126973+0000", 2024-09-12T00:05:44.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1678999999999999e-05 2024-09-12T00:05:44.616 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.616 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.616 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.616 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126999+0000", 2024-09-12T00:05:44.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6536000000000001e-05 2024-09-12T00:05:44.616 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.616 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.616 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.617 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127118+0000", 2024-09-12T00:05:44.617 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000119373 2024-09-12T00:05:44.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.617 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127289+0000", 2024-09-12T00:05:44.617 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017020199999999999 2024-09-12T00:05:44.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:44.617 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127437+0000", 2024-09-12T00:05:44.617 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148682 2024-09-12T00:05:44.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.618 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138539+0000", 2024-09-12T00:05:44.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011101418 2024-09-12T00:05:44.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.618 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143355+0000", 2024-09-12T00:05:44.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048161499999999999 2024-09-12T00:05:44.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.618 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.619 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143777+0000", 2024-09-12T00:05:44.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000421896 2024-09-12T00:05:44.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.619 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.619 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143905+0000", 2024-09-12T00:05:44.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012872 2024-09-12T00:05:44.619 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.619 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.619 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.619 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3066 3.21 3:8448517d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:44.620 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:44.620 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 23.414896864999999, 2024-09-12T00:05:44.620 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025911652, 2024-09-12T00:05:44.620 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.620 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.620 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.620 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.620 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.620 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.620 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3066 2024-09-12T00:05:44.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.620 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.621 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:44.621 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.621 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:44.621 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.621 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132011+0000", 2024-09-12T00:05:44.621 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8270000000000002e-06 2024-09-12T00:05:44.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.622 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.622 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137934+0000", 2024-09-12T00:05:44.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059226119999999998 2024-09-12T00:05:44.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.622 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.622 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137968+0000", 2024-09-12T00:05:44.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3933000000000002e-05 2024-09-12T00:05:44.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.622 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.623 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137985+0000", 2024-09-12T00:05:44.623 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7725999999999999e-05 2024-09-12T00:05:44.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.623 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.623 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138084+0000", 2024-09-12T00:05:44.623 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8450999999999996e-05 2024-09-12T00:05:44.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.623 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.623 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138285+0000", 2024-09-12T00:05:44.623 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000201411 2024-09-12T00:05:44.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:44.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138510+0000", 2024-09-12T00:05:44.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000224551 2024-09-12T00:05:44.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.146242+0000", 2024-09-12T00:05:44.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077317649999999998 2024-09-12T00:05:44.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157728+0000", 2024-09-12T00:05:44.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011486424 2024-09-12T00:05:44.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157833+0000", 2024-09-12T00:05:44.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105234 2024-09-12T00:05:44.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157920+0000", 2024-09-12T00:05:44.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6718000000000006e-05 2024-09-12T00:05:44.625 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.625 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.625 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.626 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3111 3.2e 3:7749b0e6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:44.626 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.741096+0000", 2024-09-12T00:05:44.626 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 22.805809275000001, 2024-09-12T00:05:44.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019635658, 2024-09-12T00:05:44.626 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.626 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.626 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.626 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.626 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.626 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.626 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3111 2024-09-12T00:05:44.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.627 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.741096+0000", 2024-09-12T00:05:44.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.741096+0000", 2024-09-12T00:05:44.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.741099+0000", 2024-09-12T00:05:44.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0800000000000002e-06 2024-09-12T00:05:44.628 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.628 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.628 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745487+0000", 2024-09-12T00:05:44.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043876540000000004 2024-09-12T00:05:44.628 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.628 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.628 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745510+0000", 2024-09-12T00:05:44.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3099999999999999e-05 2024-09-12T00:05:44.628 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.628 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.629 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.629 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745521+0000", 2024-09-12T00:05:44.629 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0813e-05 2024-09-12T00:05:44.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.629 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.629 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.629 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745639+0000", 2024-09-12T00:05:44.629 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011862399999999999 2024-09-12T00:05:44.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.629 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.629 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.629 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.745895+0000", 2024-09-12T00:05:44.629 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025625300000000001 2024-09-12T00:05:44.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.630 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:44.630 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.746140+0000", 2024-09-12T00:05:44.630 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000244467 2024-09-12T00:05:44.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.630 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.630 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755206+0000", 2024-09-12T00:05:44.630 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0090663250000000001 2024-09-12T00:05:44.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.630 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.630 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.760620+0000", 2024-09-12T00:05:44.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054141040000000003 2024-09-12T00:05:44.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.631 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.631 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.760673+0000", 2024-09-12T00:05:44.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2519999999999999e-05 2024-09-12T00:05:44.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.631 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.631 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.760732+0000", 2024-09-12T00:05:44.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8718000000000003e-05 2024-09-12T00:05:44.631 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.631 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.632 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.632 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3112 3.b 3:d1cf91a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:44.632 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:44.632 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 22.796179737999999, 2024-09-12T00:05:44.632 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021203475999999999, 2024-09-12T00:05:44.632 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.632 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.632 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.632 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.632 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.633 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.633 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3112 2024-09-12T00:05:44.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.633 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.633 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.633 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:44.633 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.633 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.633 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:44.633 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.634 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.634 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750728+0000", 2024-09-12T00:05:44.634 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.165e-06 2024-09-12T00:05:44.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.634 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.634 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755063+0000", 2024-09-12T00:05:44.634 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043355379999999999 2024-09-12T00:05:44.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.634 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.635 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755103+0000", 2024-09-12T00:05:44.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9962000000000001e-05 2024-09-12T00:05:44.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.635 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.635 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.635 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755120+0000", 2024-09-12T00:05:44.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6793e-05 2024-09-12T00:05:44.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.635 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.635 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.635 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755299+0000", 2024-09-12T00:05:44.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017904499999999999 2024-09-12T00:05:44.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.635 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.636 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.636 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755758+0000", 2024-09-12T00:05:44.636 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000458815 2024-09-12T00:05:44.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.636 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.636 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:44.636 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.756304+0000", 2024-09-12T00:05:44.636 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000546183 2024-09-12T00:05:44.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.636 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.636 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.637 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771518+0000", 2024-09-12T00:05:44.637 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015214236000000001 2024-09-12T00:05:44.637 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.637 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.637 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.637 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771827+0000", 2024-09-12T00:05:44.637 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000309308 2024-09-12T00:05:44.637 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.637 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.637 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.637 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771874+0000", 2024-09-12T00:05:44.637 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6119999999999999e-05 2024-09-12T00:05:44.637 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.638 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.638 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.638 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771929+0000", 2024-09-12T00:05:44.638 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5310999999999999e-05 2024-09-12T00:05:44.638 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.638 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.638 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.638 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.638 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.638 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3115 3.2e 3:75803fec:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:44.638 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:44.638 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 22.758208688, 2024-09-12T00:05:44.638 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020205041, 2024-09-12T00:05:44.639 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.639 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.639 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.639 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.639 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.639 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.639 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3115 2024-09-12T00:05:44.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.639 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.639 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.639 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.639 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:44.639 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.640 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.640 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.640 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:44.640 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.640 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.640 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.640 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788700+0000", 2024-09-12T00:05:44.640 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.614e-06 2024-09-12T00:05:44.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.640 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.640 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.640 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793576+0000", 2024-09-12T00:05:44.641 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048760920000000003 2024-09-12T00:05:44.641 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.641 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.641 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.641 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793610+0000", 2024-09-12T00:05:44.641 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4184999999999999e-05 2024-09-12T00:05:44.641 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.641 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.641 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.641 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793633+0000", 2024-09-12T00:05:44.641 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2551000000000001e-05 2024-09-12T00:05:44.641 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.641 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.641 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.642 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793750+0000", 2024-09-12T00:05:44.642 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117057 2024-09-12T00:05:44.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.642 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.642 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.642 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793975+0000", 2024-09-12T00:05:44.642 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022493099999999999 2024-09-12T00:05:44.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.642 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.642 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:44.642 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.794178+0000", 2024-09-12T00:05:44.642 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000202726 2024-09-12T00:05:44.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.643 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.643 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.643 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.803725+0000", 2024-09-12T00:05:44.643 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095470599999999996 2024-09-12T00:05:44.643 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.643 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.643 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.643 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808706+0000", 2024-09-12T00:05:44.643 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049814519999999999 2024-09-12T00:05:44.643 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.643 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.643 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.643 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808785+0000", 2024-09-12T00:05:44.643 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9160999999999996e-05 2024-09-12T00:05:44.644 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.644 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.644 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.644 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808902+0000", 2024-09-12T00:05:44.644 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000116212 2024-09-12T00:05:44.644 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.644 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.644 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.644 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.644 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.644 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3380 3.23 e82/23 3:c6c9ccf8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_7:head v 82'5, mlcod=76'3)", 2024-09-12T00:05:44.644 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:05:44.644 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.84038367, 2024-09-12T00:05:44.645 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.029708818000000001, 2024-09-12T00:05:44.645 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.645 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.645 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.645 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.645 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.645 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.645 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:05:44.645 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.645 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.645 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.645 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.645 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:05:44.646 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.646 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.646 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.646 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:05:44.646 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1600000000000001e-07 2024-09-12T00:05:44.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.646 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.646 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.646 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.710842+0000", 2024-09-12T00:05:44.646 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043204510000000003 2024-09-12T00:05:44.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.646 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.647 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.647 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.710875+0000", 2024-09-12T00:05:44.647 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2702e-05 2024-09-12T00:05:44.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.647 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.647 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.647 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.710895+0000", 2024-09-12T00:05:44.647 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0094000000000001e-05 2024-09-12T00:05:44.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.647 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.647 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.647 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.711063+0000", 2024-09-12T00:05:44.647 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000167517 2024-09-12T00:05:44.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.648 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.648 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.648 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.711127+0000", 2024-09-12T00:05:44.648 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4004999999999995e-05 2024-09-12T00:05:44.648 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.648 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.648 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.648 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.736095+0000", 2024-09-12T00:05:44.648 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024968008999999999 2024-09-12T00:05:44.648 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.648 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.648 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.648 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.736230+0000", 2024-09-12T00:05:44.649 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013552400000000001 2024-09-12T00:05:44.649 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.649 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.649 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.649 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.649 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.649 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3409 3.b 3:d39a1970:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:44.649 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:41.028923+0000", 2024-09-12T00:05:44.649 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.5179826529999998, 2024-09-12T00:05:44.649 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030518363999999999, 2024-09-12T00:05:44.649 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.649 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.649 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.649 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.650 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.650 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.650 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3409 2024-09-12T00:05:44.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.650 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.650 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.650 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.650 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.028923+0000", 2024-09-12T00:05:44.650 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.650 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.650 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.651 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.028923+0000", 2024-09-12T00:05:44.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.651 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.651 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.651 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.028926+0000", 2024-09-12T00:05:44.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1e-06 2024-09-12T00:05:44.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.651 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.651 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.651 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038010+0000", 2024-09-12T00:05:44.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0090839110000000001 2024-09-12T00:05:44.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.651 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.652 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.652 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038042+0000", 2024-09-12T00:05:44.652 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2425999999999998e-05 2024-09-12T00:05:44.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.652 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.652 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.652 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038060+0000", 2024-09-12T00:05:44.652 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8219e-05 2024-09-12T00:05:44.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.652 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.652 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.652 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038205+0000", 2024-09-12T00:05:44.652 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014503500000000001 2024-09-12T00:05:44.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.653 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.653 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.653 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038498+0000", 2024-09-12T00:05:44.653 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00029289499999999999 2024-09-12T00:05:44.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.653 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.653 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:44.653 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038752+0000", 2024-09-12T00:05:44.653 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025434500000000001 2024-09-12T00:05:44.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.653 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.653 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.654 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.058529+0000", 2024-09-12T00:05:44.654 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019776275999999999 2024-09-12T00:05:44.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.654 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.654 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.654 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.059147+0000", 2024-09-12T00:05:44.654 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00061837199999999995 2024-09-12T00:05:44.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.654 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.654 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.654 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.059328+0000", 2024-09-12T00:05:44.654 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018048399999999999 2024-09-12T00:05:44.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.654 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.655 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.655 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.059441+0000", 2024-09-12T00:05:44.655 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011330100000000001 2024-09-12T00:05:44.655 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.655 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.655 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.655 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.655 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.655 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3665 3.21 3:85e29f15:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_282:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:44.655 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:43.757083+0000", 2024-09-12T00:05:44.655 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.78982193899999997, 2024-09-12T00:05:44.656 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021222119000000001, 2024-09-12T00:05:44.656 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.656 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.656 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.656 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.656 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.656 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.656 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3665 2024-09-12T00:05:44.656 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.656 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.657 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.657 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.657 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.757083+0000", 2024-09-12T00:05:44.657 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.657 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.657 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.657 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.657 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.757083+0000", 2024-09-12T00:05:44.657 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.657 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.657 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.757087+0000", 2024-09-12T00:05:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2370000000000003e-06 2024-09-12T00:05:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763296+0000", 2024-09-12T00:05:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0062089240000000002 2024-09-12T00:05:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763337+0000", 2024-09-12T00:05:44.658 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1032999999999998e-05 2024-09-12T00:05:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763356+0000", 2024-09-12T00:05:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8292999999999999e-05 2024-09-12T00:05:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763485+0000", 2024-09-12T00:05:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012931499999999999 2024-09-12T00:05:44.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763704+0000", 2024-09-12T00:05:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021922399999999999 2024-09-12T00:05:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763888+0000", 2024-09-12T00:05:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184146 2024-09-12T00:05:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.660 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.772359+0000", 2024-09-12T00:05:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0084704089999999999 2024-09-12T00:05:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.778004+0000", 2024-09-12T00:05:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0056452619999999998 2024-09-12T00:05:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.778173+0000", 2024-09-12T00:05:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016846299999999999 2024-09-12T00:05:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.661 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.778305+0000", 2024-09-12T00:05:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013281299999999999 2024-09-12T00:05:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3675 3.2e 3:7642114f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_292:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:43.891319+0000", 2024-09-12T00:05:44.662 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.65558643999999999, 2024-09-12T00:05:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019922160000000001, 2024-09-12T00:05:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3675 2024-09-12T00:05:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.891319+0000", 2024-09-12T00:05:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.891319+0000", 2024-09-12T00:05:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.891321+0000", 2024-09-12T00:05:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.548e-06 2024-09-12T00:05:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.664 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.896089+0000", 2024-09-12T00:05:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047678599999999996 2024-09-12T00:05:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.896130+0000", 2024-09-12T00:05:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.0735999999999998e-05 2024-09-12T00:05:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.665 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.896149+0000", 2024-09-12T00:05:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8963000000000001e-05 2024-09-12T00:05:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.896263+0000", 2024-09-12T00:05:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000114419 2024-09-12T00:05:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.896465+0000", 2024-09-12T00:05:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000201535 2024-09-12T00:05:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.666 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.896652+0000", 2024-09-12T00:05:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000187469 2024-09-12T00:05:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.906215+0000", 2024-09-12T00:05:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095631399999999995 2024-09-12T00:05:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.911114+0000", 2024-09-12T00:05:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048990930000000002 2024-09-12T00:05:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.911186+0000", 2024-09-12T00:05:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1452000000000006e-05 2024-09-12T00:05:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.911241+0000", 2024-09-12T00:05:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.4945000000000003e-05 2024-09-12T00:05:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3693 3.b 3:d220e626:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_310:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.243959+0000", 2024-09-12T00:05:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.302945933, 2024-09-12T00:05:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019680745999999999, 2024-09-12T00:05:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3693 2024-09-12T00:05:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.243959+0000", 2024-09-12T00:05:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.243959+0000", 2024-09-12T00:05:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.243962+0000", 2024-09-12T00:05:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7360000000000001e-06 2024-09-12T00:05:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.248035+0000", 2024-09-12T00:05:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004073134 2024-09-12T00:05:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.248062+0000", 2024-09-12T00:05:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6869e-05 2024-09-12T00:05:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.671 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.248074+0000", 2024-09-12T00:05:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2023e-05 2024-09-12T00:05:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.248153+0000", 2024-09-12T00:05:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.8534000000000004e-05 2024-09-12T00:05:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.248298+0000", 2024-09-12T00:05:44.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014510900000000001 2024-09-12T00:05:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.248427+0000", 2024-09-12T00:05:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012962999999999999 2024-09-12T00:05:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.261641+0000", 2024-09-12T00:05:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013213384 2024-09-12T00:05:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.263464+0000", 2024-09-12T00:05:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0018229139999999999 2024-09-12T00:05:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.263544+0000", 2024-09-12T00:05:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0181999999999999e-05 2024-09-12T00:05:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.263640+0000", 2024-09-12T00:05:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.6230999999999994e-05 2024-09-12T00:05:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.674 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3696 3.21 3:872f3075:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_313:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.301332+0000", 2024-09-12T00:05:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.24557346899999999, 2024-09-12T00:05:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024918241000000001, 2024-09-12T00:05:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:44.675 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3696 2024-09-12T00:05:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.301332+0000", 2024-09-12T00:05:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.301332+0000", 2024-09-12T00:05:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:44.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.301335+0000", 2024-09-12T00:05:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9679999999999998e-06 2024-09-12T00:05:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.305984+0000", 2024-09-12T00:05:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046492249999999999 2024-09-12T00:05:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:44.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306009+0000", 2024-09-12T00:05:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5252000000000001e-05 2024-09-12T00:05:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306023+0000", 2024-09-12T00:05:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3903000000000001e-05 2024-09-12T00:05:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306193+0000", 2024-09-12T00:05:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017032500000000001 2024-09-12T00:05:44.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306594+0000", 2024-09-12T00:05:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040111600000000003 2024-09-12T00:05:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.307002+0000", 2024-09-12T00:05:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040796000000000002 2024-09-12T00:05:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.319319+0000", 2024-09-12T00:05:44.679 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012317033 2024-09-12T00:05:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.325949+0000", 2024-09-12T00:05:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0066298110000000002 2024-09-12T00:05:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.326123+0000", 2024-09-12T00:05:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017416999999999999 2024-09-12T00:05:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:44.680 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:44.681 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.326250+0000", 2024-09-12T00:05:44.681 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012647799999999999 2024-09-12T00:05:44.681 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.681 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.681 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.681 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:44.681 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:44.681 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:44.682 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:44.684+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:44.683 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:05:44.704 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T00:05:44.783 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:44.784+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:44.847 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:44.847 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:44.847 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:05:44.847 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:44.880 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:05:44.925 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:44.928+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:44.985 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:44.984+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:45.046 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:45.047 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:45.047 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:05:45.047 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:05:45.047 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:45.077 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:05:45.121 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:45.124+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:45.187 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:45.188+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:45.283 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:45.283 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:05:45.283 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:05:45.284 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:05:45.284 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.284 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:05:45.284 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:05:45.284 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 133.95237112800001, 2024-09-12T00:05:45.284 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.027441031000000001, 2024-09-12T00:05:45.284 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:45.285 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:45.285 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:45.285 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:45.285 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:45.285 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:45.285 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:05:45.285 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.285 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:45.286 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.286 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:45.286 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:05:45.286 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.286 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.286 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.286 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:45.286 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:05:45.287 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.287 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.287 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.287 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:45.287 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330357+0000", 2024-09-12T00:05:45.287 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2339999999999996e-06 2024-09-12T00:05:45.287 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.288 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.288 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:45.288 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330381+0000", 2024-09-12T00:05:45.288 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4626000000000001e-05 2024-09-12T00:05:45.288 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.288 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.288 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:45.288 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330417+0000", 2024-09-12T00:05:45.289 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5886000000000002e-05 2024-09-12T00:05:45.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.289 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.289 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:45.289 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330442+0000", 2024-09-12T00:05:45.289 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4522999999999999e-05 2024-09-12T00:05:45.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.289 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.290 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:45.290 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335485+0000", 2024-09-12T00:05:45.290 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050432589999999996 2024-09-12T00:05:45.290 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.290 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.290 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:05:45.290 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335507+0000", 2024-09-12T00:05:45.290 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2013000000000001e-05 2024-09-12T00:05:45.290 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.291 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.291 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:45.291 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.351747+0000", 2024-09-12T00:05:45.291 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016240451999999999 2024-09-12T00:05:45.291 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.291 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.291 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:45.292 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352062+0000", 2024-09-12T00:05:45.292 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031433399999999999 2024-09-12T00:05:45.292 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.292 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.292 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:45.293 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352378+0000", 2024-09-12T00:05:45.293 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031586400000000001 2024-09-12T00:05:45.293 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.293 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.293 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:45.293 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.355074+0000", 2024-09-12T00:05:45.293 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026962919999999999 2024-09-12T00:05:45.293 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.293 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.294 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:45.294 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357537+0000", 2024-09-12T00:05:45.294 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024634689999999998 2024-09-12T00:05:45.294 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.294 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.294 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:45.295 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357680+0000", 2024-09-12T00:05:45.295 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014314899999999999 2024-09-12T00:05:45.295 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.295 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.295 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:45.295 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357793+0000", 2024-09-12T00:05:45.295 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011293 2024-09-12T00:05:45.296 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.296 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:45.296 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.296 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.296 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.296 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2670 3.15 3:aae67b25:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:45.296 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.402430+0000", 2024-09-12T00:05:45.296 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 57.880293893999998, 2024-09-12T00:05:45.296 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020468187999999998, 2024-09-12T00:05:45.296 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:45.296 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:45.297 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:45.297 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:45.297 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:45.297 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:45.297 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2670 2024-09-12T00:05:45.297 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.297 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:45.297 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.297 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:45.297 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.402430+0000", 2024-09-12T00:05:45.297 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.298 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.298 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:45.298 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.402430+0000", 2024-09-12T00:05:45.298 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.298 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.298 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:45.298 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.402434+0000", 2024-09-12T00:05:45.298 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3730000000000003e-06 2024-09-12T00:05:45.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.298 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.298 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:45.298 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405033+0000", 2024-09-12T00:05:45.298 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025991080000000001 2024-09-12T00:05:45.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.299 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.299 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:45.299 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405068+0000", 2024-09-12T00:05:45.299 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4832999999999997e-05 2024-09-12T00:05:45.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.299 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.299 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:45.299 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405080+0000", 2024-09-12T00:05:45.299 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2344000000000001e-05 2024-09-12T00:05:45.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.299 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.299 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:45.299 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405150+0000", 2024-09-12T00:05:45.299 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9391e-05 2024-09-12T00:05:45.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.300 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.300 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:45.300 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405287+0000", 2024-09-12T00:05:45.300 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013720299999999999 2024-09-12T00:05:45.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.300 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.300 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:45.300 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.405411+0000", 2024-09-12T00:05:45.300 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000123891 2024-09-12T00:05:45.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.300 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.300 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:45.301 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.414520+0000", 2024-09-12T00:05:45.301 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091092599999999992 2024-09-12T00:05:45.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.301 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.301 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:45.301 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.422744+0000", 2024-09-12T00:05:45.301 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0082241620000000001 2024-09-12T00:05:45.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.301 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.301 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:45.301 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.422841+0000", 2024-09-12T00:05:45.301 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6525000000000002e-05 2024-09-12T00:05:45.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.301 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.422898+0000", 2024-09-12T00:05:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7098000000000001e-05 2024-09-12T00:05:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2731 3.c 3:33671167:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:47.917498+0000", 2024-09-12T00:05:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 57.365225485000003, 2024-09-12T00:05:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020741915, 2024-09-12T00:05:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2731 2024-09-12T00:05:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.917498+0000", 2024-09-12T00:05:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:45.304 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.917498+0000", 2024-09-12T00:05:45.304 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.304 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.304 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.304 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:45.304 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.917502+0000", 2024-09-12T00:05:45.304 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4860000000000002e-06 2024-09-12T00:05:45.304 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.304 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.304 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:45.304 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919071+0000", 2024-09-12T00:05:45.304 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015695380000000001 2024-09-12T00:05:45.304 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.304 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.305 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:45.305 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919100+0000", 2024-09-12T00:05:45.305 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8822e-05 2024-09-12T00:05:45.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.305 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.305 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:45.305 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919110+0000", 2024-09-12T00:05:45.305 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0287e-05 2024-09-12T00:05:45.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.305 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.305 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:45.305 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919179+0000", 2024-09-12T00:05:45.305 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8926999999999999e-05 2024-09-12T00:05:45.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.306 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.306 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:45.306 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919338+0000", 2024-09-12T00:05:45.306 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015856299999999999 2024-09-12T00:05:45.306 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.306 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.306 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:45.306 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.919462+0000", 2024-09-12T00:05:45.306 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012430399999999999 2024-09-12T00:05:45.306 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.306 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.306 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:45.306 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.923903+0000", 2024-09-12T00:05:45.307 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0044412660000000001 2024-09-12T00:05:45.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.307 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.307 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:45.307 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.938087+0000", 2024-09-12T00:05:45.307 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014183398999999999 2024-09-12T00:05:45.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.307 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.307 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:45.307 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.938180+0000", 2024-09-12T00:05:45.307 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3318000000000003e-05 2024-09-12T00:05:45.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.307 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.307 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:45.307 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:47.938240+0000", 2024-09-12T00:05:45.308 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0004999999999999e-05 2024-09-12T00:05:45.308 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.308 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:45.308 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.308 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.308 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.308 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2748 3.3b 3:df6d92a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:45.308 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:05:45.308 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 57.183883268000002, 2024-09-12T00:05:45.308 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.023574735999999999, 2024-09-12T00:05:45.308 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:45.308 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:45.308 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:45.309 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:45.309 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:45.309 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:45.309 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2748 2024-09-12T00:05:45.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.309 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:45.309 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.309 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:45.309 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:05:45.309 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.309 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.309 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:45.309 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:05:45.310 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.310 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.310 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:45.310 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098844+0000", 2024-09-12T00:05:45.310 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1570000000000002e-06 2024-09-12T00:05:45.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.310 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.310 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:45.310 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100354+0000", 2024-09-12T00:05:45.310 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001509544 2024-09-12T00:05:45.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.312 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.313 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:45.313 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100383+0000", 2024-09-12T00:05:45.313 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9386e-05 2024-09-12T00:05:45.313 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.313 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.313 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:45.313 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100399+0000", 2024-09-12T00:05:45.313 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5883999999999999e-05 2024-09-12T00:05:45.313 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.313 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.313 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:45.313 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100507+0000", 2024-09-12T00:05:45.313 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010822 2024-09-12T00:05:45.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.314 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.314 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:45.314 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100704+0000", 2024-09-12T00:05:45.314 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019658499999999999 2024-09-12T00:05:45.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.314 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.314 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:45.314 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100901+0000", 2024-09-12T00:05:45.314 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000196505 2024-09-12T00:05:45.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.314 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.314 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:45.315 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112178+0000", 2024-09-12T00:05:45.315 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011277718000000001 2024-09-12T00:05:45.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.315 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.315 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:45.315 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122285+0000", 2024-09-12T00:05:45.315 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010106327 2024-09-12T00:05:45.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.315 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.315 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:45.315 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122358+0000", 2024-09-12T00:05:45.315 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3640999999999995e-05 2024-09-12T00:05:45.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.316 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.316 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:45.316 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122415+0000", 2024-09-12T00:05:45.316 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6768999999999998e-05 2024-09-12T00:05:45.316 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.316 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:45.316 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.316 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.316 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2964 3.24 e75/23 3:26c83ec0:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_3:head v 75'6, mlcod=63'4)", 2024-09-12T00:05:45.316 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:05:45.316 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 25.270462247000001, 2024-09-12T00:05:45.316 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022426814, 2024-09-12T00:05:45.317 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:45.317 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:45.317 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:45.317 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:45.317 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.317 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:45.317 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:05:45.317 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.317 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.317 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.317 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:45.317 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:05:45.317 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.317 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.318 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.318 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:45.318 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012263+0000", 2024-09-12T00:05:45.318 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.091e-06 2024-09-12T00:05:45.318 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.318 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.318 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:45.318 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018390+0000", 2024-09-12T00:05:45.318 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061264600000000002 2024-09-12T00:05:45.318 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.318 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.318 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:45.318 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018419+0000", 2024-09-12T00:05:45.318 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8979000000000002e-05 2024-09-12T00:05:45.318 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.319 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.319 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:45.319 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018434+0000", 2024-09-12T00:05:45.319 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4781e-05 2024-09-12T00:05:45.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.319 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.319 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:45.319 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018528+0000", 2024-09-12T00:05:45.319 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.4333000000000006e-05 2024-09-12T00:05:45.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.319 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.319 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:45.319 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018559+0000", 2024-09-12T00:05:45.320 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1557999999999998e-05 2024-09-12T00:05:45.320 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.320 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.320 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:45.320 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.034615+0000", 2024-09-12T00:05:45.320 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016055834000000001 2024-09-12T00:05:45.320 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.320 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.320 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:45.320 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.034688+0000", 2024-09-12T00:05:45.320 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2778e-05 2024-09-12T00:05:45.320 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.320 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:45.320 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.321 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.321 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.321 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2965 3.e e75/23 3:70fff61e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_4:head v 75'5, mlcod=63'3)", 2024-09-12T00:05:45.321 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:05:45.321 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 25.262952026000001, 2024-09-12T00:05:45.321 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021839210000000001, 2024-09-12T00:05:45.321 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:45.321 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:45.321 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:45.321 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:45.321 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.321 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:45.321 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:05:45.322 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.322 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.322 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.322 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:45.322 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:05:45.322 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.322 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.322 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.322 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:45.322 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019773+0000", 2024-09-12T00:05:45.322 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4839999999999999e-06 2024-09-12T00:05:45.322 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.322 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.322 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:45.323 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021570+0000", 2024-09-12T00:05:45.323 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017965570000000001 2024-09-12T00:05:45.323 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.323 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.323 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:45.323 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021587+0000", 2024-09-12T00:05:45.323 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7938e-05 2024-09-12T00:05:45.323 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.323 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.323 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:45.323 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021598+0000", 2024-09-12T00:05:45.323 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0553e-05 2024-09-12T00:05:45.323 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.324 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.324 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:45.324 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021676+0000", 2024-09-12T00:05:45.324 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8034000000000005e-05 2024-09-12T00:05:45.324 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.324 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.324 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:45.324 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021706+0000", 2024-09-12T00:05:45.324 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9915000000000001e-05 2024-09-12T00:05:45.324 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.324 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.324 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:45.324 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.041519+0000", 2024-09-12T00:05:45.324 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019813171000000001 2024-09-12T00:05:45.325 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.325 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.325 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:45.325 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.041611+0000", 2024-09-12T00:05:45.325 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1558000000000007e-05 2024-09-12T00:05:45.325 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.325 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:45.325 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.325 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.325 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.325 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3004 3.36 3:6cc4f27f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:45.325 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:05:45.325 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 24.844552829000001, 2024-09-12T00:05:45.325 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.042951743000000001, 2024-09-12T00:05:45.326 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:45.326 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:45.326 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:45.326 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:45.326 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:45.326 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:45.326 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3004 2024-09-12T00:05:45.326 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.326 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:45.326 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.326 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:45.326 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:05:45.326 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.326 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.327 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.327 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:45.327 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:05:45.327 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.327 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.327 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.327 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:45.327 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438175+0000", 2024-09-12T00:05:45.327 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1640000000000003e-06 2024-09-12T00:05:45.327 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.327 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.327 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:45.327 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439732+0000", 2024-09-12T00:05:45.327 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015574510000000001 2024-09-12T00:05:45.328 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.328 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.328 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:45.328 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439758+0000", 2024-09-12T00:05:45.328 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6074000000000001e-05 2024-09-12T00:05:45.328 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.328 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.328 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:45.328 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439768+0000", 2024-09-12T00:05:45.328 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8770000000000005e-06 2024-09-12T00:05:45.328 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.328 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.328 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:45.329 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439874+0000", 2024-09-12T00:05:45.329 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105583 2024-09-12T00:05:45.329 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.329 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.329 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:45.329 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.440078+0000", 2024-09-12T00:05:45.329 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020388200000000001 2024-09-12T00:05:45.329 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.329 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.329 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:45.329 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.440251+0000", 2024-09-12T00:05:45.329 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017339100000000001 2024-09-12T00:05:45.329 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.329 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.330 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:45.330 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.459982+0000", 2024-09-12T00:05:45.330 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01973099 2024-09-12T00:05:45.330 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.330 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.330 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:45.330 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.480958+0000", 2024-09-12T00:05:45.330 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020975730000000001 2024-09-12T00:05:45.330 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.330 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.330 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:45.330 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481034+0000", 2024-09-12T00:05:45.330 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6224999999999996e-05 2024-09-12T00:05:45.330 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.330 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.331 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:45.331 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481122+0000", 2024-09-12T00:05:45.331 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8375999999999995e-05 2024-09-12T00:05:45.331 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.331 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:45.331 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.331 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.331 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.331 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3005 3.35 3:ae3b5a36:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:45.331 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:05:45.331 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 24.835299145, 2024-09-12T00:05:45.331 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.028828275, 2024-09-12T00:05:45.331 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:45.332 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:45.332 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:45.332 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:45.332 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:45.332 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:45.332 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3005 2024-09-12T00:05:45.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.332 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:45.332 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.332 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:45.332 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:05:45.332 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.333 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.333 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:45.333 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:05:45.333 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.333 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.333 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.333 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:45.333 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447427+0000", 2024-09-12T00:05:45.333 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.864e-06 2024-09-12T00:05:45.333 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.333 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.333 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:45.333 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449003+0000", 2024-09-12T00:05:45.334 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001575405 2024-09-12T00:05:45.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.334 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.334 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:45.334 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449030+0000", 2024-09-12T00:05:45.334 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7189999999999999e-05 2024-09-12T00:05:45.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.334 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.334 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:45.334 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449042+0000", 2024-09-12T00:05:45.334 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2038999999999999e-05 2024-09-12T00:05:45.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.334 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.334 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:45.335 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449111+0000", 2024-09-12T00:05:45.335 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9521000000000001e-05 2024-09-12T00:05:45.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.335 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.335 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:45.335 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449218+0000", 2024-09-12T00:05:45.335 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010675600000000001 2024-09-12T00:05:45.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.335 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.335 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:45.335 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449330+0000", 2024-09-12T00:05:45.335 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000111809 2024-09-12T00:05:45.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.335 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.336 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:45.336 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.469844+0000", 2024-09-12T00:05:45.336 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020514277000000001 2024-09-12T00:05:45.336 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.336 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.336 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:45.336 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.475983+0000", 2024-09-12T00:05:45.336 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061392540000000002 2024-09-12T00:05:45.336 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.336 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.336 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:45.336 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.476113+0000", 2024-09-12T00:05:45.337 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000129713 2024-09-12T00:05:45.337 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.337 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.337 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:45.337 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.476253+0000", 2024-09-12T00:05:45.337 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013944700000000001 2024-09-12T00:05:45.337 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.337 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:45.337 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.337 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.337 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.337 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3006 3.3 3:c183ca95:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:45.338 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:05:45.338 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 24.825772573999998, 2024-09-12T00:05:45.338 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.024661756, 2024-09-12T00:05:45.338 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:45.338 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:45.338 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:45.338 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:45.338 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:45.338 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:45.338 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3006 2024-09-12T00:05:45.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.338 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:45.338 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.339 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:45.339 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:05:45.339 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.339 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.339 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.339 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:45.339 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:05:45.339 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.339 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.339 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.339 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:45.339 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456954+0000", 2024-09-12T00:05:45.339 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7070000000000001e-06 2024-09-12T00:05:45.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.340 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.340 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:45.340 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458684+0000", 2024-09-12T00:05:45.340 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017305479999999999 2024-09-12T00:05:45.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.340 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.340 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:45.340 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458709+0000", 2024-09-12T00:05:45.340 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4780999999999999e-05 2024-09-12T00:05:45.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.340 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.340 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:45.341 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458719+0000", 2024-09-12T00:05:45.341 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0202e-05 2024-09-12T00:05:45.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.341 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.341 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:45.341 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458800+0000", 2024-09-12T00:05:45.341 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0893e-05 2024-09-12T00:05:45.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.341 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.341 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:45.341 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458990+0000", 2024-09-12T00:05:45.341 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018986400000000001 2024-09-12T00:05:45.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.342 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.342 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:45.342 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.459171+0000", 2024-09-12T00:05:45.342 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018135499999999999 2024-09-12T00:05:45.342 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.342 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.342 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:45.342 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.478356+0000", 2024-09-12T00:05:45.342 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019185153 2024-09-12T00:05:45.342 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.342 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.342 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:45.342 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481411+0000", 2024-09-12T00:05:45.342 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030546190000000002 2024-09-12T00:05:45.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.343 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.343 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:45.343 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481511+0000", 2024-09-12T00:05:45.343 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.9763e-05 2024-09-12T00:05:45.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.343 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.343 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:45.343 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481613+0000", 2024-09-12T00:05:45.343 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101871 2024-09-12T00:05:45.343 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.343 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:45.343 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.344 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.344 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3037 3.39 3:9eefb4c1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:45.344 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:05:45.344 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 24.467505166999999, 2024-09-12T00:05:45.344 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020855543000000001, 2024-09-12T00:05:45.344 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:45.344 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:45.344 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:45.344 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:45.344 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:45.344 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:45.344 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3037 2024-09-12T00:05:45.345 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.345 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:45.345 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.345 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:45.345 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:05:45.345 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.345 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.345 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.345 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:45.345 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:05:45.345 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.345 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.345 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.346 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:45.346 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815221+0000", 2024-09-12T00:05:45.346 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1540000000000002e-06 2024-09-12T00:05:45.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.346 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.346 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:45.346 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817594+0000", 2024-09-12T00:05:45.346 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023728880000000001 2024-09-12T00:05:45.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.346 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.346 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:45.346 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817618+0000", 2024-09-12T00:05:45.346 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3635e-05 2024-09-12T00:05:45.347 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.347 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:45.347 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817633+0000", 2024-09-12T00:05:45.347 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4559000000000001e-05 2024-09-12T00:05:45.347 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.347 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:45.347 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817734+0000", 2024-09-12T00:05:45.347 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101729 2024-09-12T00:05:45.347 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.347 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:45.347 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817939+0000", 2024-09-12T00:05:45.348 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020489299999999999 2024-09-12T00:05:45.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.348 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.348 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:45.348 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.818113+0000", 2024-09-12T00:05:45.348 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000173413 2024-09-12T00:05:45.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.348 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.348 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:45.348 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.825676+0000", 2024-09-12T00:05:45.348 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075635260000000001 2024-09-12T00:05:45.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.348 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.348 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:45.349 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.835921+0000", 2024-09-12T00:05:45.349 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010244932999999999 2024-09-12T00:05:45.349 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.349 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.349 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:45.349 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.836006+0000", 2024-09-12T00:05:45.349 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5427999999999996e-05 2024-09-12T00:05:45.349 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.349 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.349 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:45.349 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.836074+0000", 2024-09-12T00:05:45.349 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7385000000000006e-05 2024-09-12T00:05:45.349 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.349 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:45.350 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.350 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.350 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.350 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3375 3.15 3:ab335e39:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:45.350 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.646143+0000", 2024-09-12T00:05:45.350 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.6365807239999999, 2024-09-12T00:05:45.350 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026933417000000001, 2024-09-12T00:05:45.350 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:45.350 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:45.350 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:45.350 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:45.350 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:45.350 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:45.350 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3375 2024-09-12T00:05:45.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.351 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:45.351 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.351 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:45.351 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.646143+0000", 2024-09-12T00:05:45.351 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.351 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.351 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:45.351 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.646143+0000", 2024-09-12T00:05:45.351 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.351 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.351 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:45.352 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.646146+0000", 2024-09-12T00:05:45.352 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.19e-06 2024-09-12T00:05:45.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.352 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.352 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:45.352 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648608+0000", 2024-09-12T00:05:45.352 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024615470000000001 2024-09-12T00:05:45.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.352 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.352 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:45.352 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648640+0000", 2024-09-12T00:05:45.352 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2342999999999998e-05 2024-09-12T00:05:45.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.352 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.353 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:45.353 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648655+0000", 2024-09-12T00:05:45.353 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5034e-05 2024-09-12T00:05:45.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.353 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.353 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:45.353 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648746+0000", 2024-09-12T00:05:45.353 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1529999999999999e-05 2024-09-12T00:05:45.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.353 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.353 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:45.353 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648938+0000", 2024-09-12T00:05:45.353 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191819 2024-09-12T00:05:45.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.353 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.354 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:45.354 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.649102+0000", 2024-09-12T00:05:45.354 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000164103 2024-09-12T00:05:45.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.354 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.354 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:45.354 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.658869+0000", 2024-09-12T00:05:45.354 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0097663530000000002 2024-09-12T00:05:45.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.354 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.355 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:45.355 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.672958+0000", 2024-09-12T00:05:45.355 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014089295 2024-09-12T00:05:45.355 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.355 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.355 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:45.355 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.673024+0000", 2024-09-12T00:05:45.355 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5834999999999996e-05 2024-09-12T00:05:45.355 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.355 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.355 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:45.355 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.673076+0000", 2024-09-12T00:05:45.355 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2367999999999997e-05 2024-09-12T00:05:45.355 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.356 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:45.356 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.356 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.356 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3392 3.1b e82/23 3:d9b2c983:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_19:head v 82'11, mlcod=76'9)", 2024-09-12T00:05:45.356 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.841020+0000", 2024-09-12T00:05:45.356 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.4417036530000003, 2024-09-12T00:05:45.356 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022540108999999999, 2024-09-12T00:05:45.356 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:45.357 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:45.357 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:45.357 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:45.357 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.357 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:45.357 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.841020+0000", 2024-09-12T00:05:45.357 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.357 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.357 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:45.357 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.841020+0000", 2024-09-12T00:05:45.357 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.357 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.358 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:45.358 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.841022+0000", 2024-09-12T00:05:45.358 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4339999999999999e-06 2024-09-12T00:05:45.358 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.358 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.358 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:45.358 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847015+0000", 2024-09-12T00:05:45.358 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.005993104 2024-09-12T00:05:45.358 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.358 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.358 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:45.358 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847030+0000", 2024-09-12T00:05:45.358 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4595e-05 2024-09-12T00:05:45.358 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:45.359 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847041+0000", 2024-09-12T00:05:45.359 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1124000000000001e-05 2024-09-12T00:05:45.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:45.359 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847334+0000", 2024-09-12T00:05:45.359 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000292854 2024-09-12T00:05:45.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.359 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.359 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:45.359 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847371+0000", 2024-09-12T00:05:45.359 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7336000000000003e-05 2024-09-12T00:05:45.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.360 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.360 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:45.360 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.863502+0000", 2024-09-12T00:05:45.360 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016130314999999999 2024-09-12T00:05:45.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.360 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.360 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:45.360 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.863560+0000", 2024-09-12T00:05:45.360 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8347000000000002e-05 2024-09-12T00:05:45.360 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.360 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:45.360 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.360 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.361 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3399 3.c 3:33260d65:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:45.361 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.912770+0000", 2024-09-12T00:05:45.361 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.369953508, 2024-09-12T00:05:45.361 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021761494999999999, 2024-09-12T00:05:45.361 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:45.361 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:45.361 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:45.361 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:45.361 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:45.361 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:45.361 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3399 2024-09-12T00:05:45.361 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.361 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:45.361 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.362 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:45.362 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.912770+0000", 2024-09-12T00:05:45.362 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.362 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.362 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:45.362 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.912770+0000", 2024-09-12T00:05:45.362 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.362 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.362 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:45.362 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.912773+0000", 2024-09-12T00:05:45.362 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.252e-06 2024-09-12T00:05:45.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.363 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:45.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915156+0000", 2024-09-12T00:05:45.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023823109999999998 2024-09-12T00:05:45.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.363 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:45.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915244+0000", 2024-09-12T00:05:45.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8926999999999997e-05 2024-09-12T00:05:45.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.363 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:45.363 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915265+0000", 2024-09-12T00:05:45.363 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0613999999999999e-05 2024-09-12T00:05:45.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:45.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915361+0000", 2024-09-12T00:05:45.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5542000000000001e-05 2024-09-12T00:05:45.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:45.364 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915538+0000", 2024-09-12T00:05:45.364 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017762400000000001 2024-09-12T00:05:45.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.364 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:45.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915710+0000", 2024-09-12T00:05:45.365 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017170900000000001 2024-09-12T00:05:45.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.365 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:45.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.933564+0000", 2024-09-12T00:05:45.365 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017854080000000001 2024-09-12T00:05:45.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.365 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:45.365 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.934450+0000", 2024-09-12T00:05:45.365 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00088595700000000004 2024-09-12T00:05:45.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.366 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:45.366 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.934490+0000", 2024-09-12T00:05:45.366 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0110000000000001e-05 2024-09-12T00:05:45.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.366 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.366 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:45.366 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.934531+0000", 2024-09-12T00:05:45.366 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1369000000000003e-05 2024-09-12T00:05:45.366 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.366 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:45.366 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.366 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.366 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3678 3.15 3:a83db90f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_295:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:45.367 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:43.938089+0000", 2024-09-12T00:05:45.367 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.3446343760000001, 2024-09-12T00:05:45.367 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021578831999999999, 2024-09-12T00:05:45.367 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:45.367 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:45.367 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:45.367 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:45.367 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:45.367 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:45.367 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3678 2024-09-12T00:05:45.367 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.367 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:45.367 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.367 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:45.367 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.938089+0000", 2024-09-12T00:05:45.368 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.368 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:45.368 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.938089+0000", 2024-09-12T00:05:45.368 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.368 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:45.368 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.938094+0000", 2024-09-12T00:05:45.368 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0719999999999999e-06 2024-09-12T00:05:45.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.368 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.368 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:45.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940370+0000", 2024-09-12T00:05:45.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022759159999999998 2024-09-12T00:05:45.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:45.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940401+0000", 2024-09-12T00:05:45.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1226999999999998e-05 2024-09-12T00:05:45.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.369 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:45.369 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940417+0000", 2024-09-12T00:05:45.369 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5603e-05 2024-09-12T00:05:45.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.369 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:45.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940499+0000", 2024-09-12T00:05:45.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1568000000000002e-05 2024-09-12T00:05:45.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:45.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940703+0000", 2024-09-12T00:05:45.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000203995 2024-09-12T00:05:45.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.370 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.370 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:45.370 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940947+0000", 2024-09-12T00:05:45.370 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024444799999999997 2024-09-12T00:05:45.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.371 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:45.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.950088+0000", 2024-09-12T00:05:45.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091408710000000001 2024-09-12T00:05:45.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.371 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:45.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.959534+0000", 2024-09-12T00:05:45.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0094463979999999999 2024-09-12T00:05:45.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.371 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.371 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:45.371 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.959594+0000", 2024-09-12T00:05:45.371 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0145000000000001e-05 2024-09-12T00:05:45.372 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.372 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.372 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:45.372 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.959668+0000", 2024-09-12T00:05:45.372 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3589000000000003e-05 2024-09-12T00:05:45.372 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.372 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:45.372 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.372 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.372 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.372 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3685 3.3b 3:dffb8895:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_302:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:45.372 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.063162+0000", 2024-09-12T00:05:45.372 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.2195614960000001, 2024-09-12T00:05:45.372 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020833300999999999, 2024-09-12T00:05:45.372 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:45.373 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:45.373 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:45.373 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:45.373 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:45.373 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:45.373 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3685 2024-09-12T00:05:45.373 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.373 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:45.373 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.373 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:45.373 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.063162+0000", 2024-09-12T00:05:45.373 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.373 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.373 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.374 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:45.374 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.063162+0000", 2024-09-12T00:05:45.374 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.374 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.374 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:45.374 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.063166+0000", 2024-09-12T00:05:45.374 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1840000000000001e-06 2024-09-12T00:05:45.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.374 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.374 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:45.374 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.066026+0000", 2024-09-12T00:05:45.374 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0028601519999999999 2024-09-12T00:05:45.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.375 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:45.375 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.066067+0000", 2024-09-12T00:05:45.375 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0620000000000001e-05 2024-09-12T00:05:45.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.375 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:45.375 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.066093+0000", 2024-09-12T00:05:45.375 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5812999999999998e-05 2024-09-12T00:05:45.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.375 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.375 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:45.376 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.066262+0000", 2024-09-12T00:05:45.376 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000169166 2024-09-12T00:05:45.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.376 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.376 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:45.376 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.066535+0000", 2024-09-12T00:05:45.376 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00027303499999999998 2024-09-12T00:05:45.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.376 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.376 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:45.376 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.066799+0000", 2024-09-12T00:05:45.376 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00026402700000000001 2024-09-12T00:05:45.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.377 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:45.377 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.080792+0000", 2024-09-12T00:05:45.377 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013992698 2024-09-12T00:05:45.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.377 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:45.377 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.083705+0000", 2024-09-12T00:05:45.377 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029128969999999998 2024-09-12T00:05:45.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.377 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.377 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:45.377 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.083871+0000", 2024-09-12T00:05:45.377 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016683299999999999 2024-09-12T00:05:45.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.378 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.378 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:45.378 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.083995+0000", 2024-09-12T00:05:45.378 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000123876 2024-09-12T00:05:45.378 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.378 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:45.378 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.378 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.378 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3711 3.c 3:31bc51b2:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_328:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:45.379 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.647001+0000", 2024-09-12T00:05:45.379 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.63572222300000003, 2024-09-12T00:05:45.379 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021286705, 2024-09-12T00:05:45.379 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:45.379 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:45.379 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:45.379 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:45.379 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:45.379 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:45.379 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3711 2024-09-12T00:05:45.379 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.379 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:45.380 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.380 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:45.380 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.647001+0000", 2024-09-12T00:05:45.380 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.380 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.380 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:45.380 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.647001+0000", 2024-09-12T00:05:45.380 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.380 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.380 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:45.380 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.647006+0000", 2024-09-12T00:05:45.380 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1900000000000003e-06 2024-09-12T00:05:45.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.381 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.381 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:45.381 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.651810+0000", 2024-09-12T00:05:45.381 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048032159999999999 2024-09-12T00:05:45.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.381 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.381 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:45.381 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.651857+0000", 2024-09-12T00:05:45.381 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7416000000000001e-05 2024-09-12T00:05:45.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.381 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.381 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:45.381 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.651876+0000", 2024-09-12T00:05:45.381 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9066999999999999e-05 2024-09-12T00:05:45.382 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.382 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.382 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:45.382 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.652058+0000", 2024-09-12T00:05:45.382 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018199500000000001 2024-09-12T00:05:45.382 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.382 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.382 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:45.382 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.652476+0000", 2024-09-12T00:05:45.382 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00041738000000000002 2024-09-12T00:05:45.382 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.382 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.382 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:45.382 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.652917+0000", 2024-09-12T00:05:45.383 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00044171899999999998 2024-09-12T00:05:45.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.383 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.383 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:45.383 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.667867+0000", 2024-09-12T00:05:45.383 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014949558 2024-09-12T00:05:45.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.383 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.383 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:45.383 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.668181+0000", 2024-09-12T00:05:45.383 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000313777 2024-09-12T00:05:45.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.383 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.383 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:45.383 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.668241+0000", 2024-09-12T00:05:45.384 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0047999999999998e-05 2024-09-12T00:05:45.384 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.384 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.384 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:45.384 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.668288+0000", 2024-09-12T00:05:45.384 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7339000000000002e-05 2024-09-12T00:05:45.384 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.384 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:45.384 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.384 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.384 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.384 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3726 3.33 e83/23 3:cd6e0a10:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_343:head v 83'15, mlcod=83'13)", 2024-09-12T00:05:45.384 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.871373+0000", 2024-09-12T00:05:45.384 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.41135068400000002, 2024-09-12T00:05:45.385 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021131233999999999, 2024-09-12T00:05:45.385 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:45.385 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:45.385 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:45.385 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:45.385 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.385 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:45.385 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.871373+0000", 2024-09-12T00:05:45.385 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.385 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.385 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.385 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:45.385 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.871373+0000", 2024-09-12T00:05:45.385 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.386 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.386 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:45.386 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.871374+0000", 2024-09-12T00:05:45.386 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.505e-06 2024-09-12T00:05:45.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.386 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.386 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:45.386 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875356+0000", 2024-09-12T00:05:45.386 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039812060000000002 2024-09-12T00:05:45.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.386 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.386 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:45.386 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875381+0000", 2024-09-12T00:05:45.386 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5259999999999999e-05 2024-09-12T00:05:45.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.387 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:45.387 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875392+0000", 2024-09-12T00:05:45.387 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1211e-05 2024-09-12T00:05:45.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.387 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:45.387 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875472+0000", 2024-09-12T00:05:45.387 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9505999999999994e-05 2024-09-12T00:05:45.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.387 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:45.387 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875490+0000", 2024-09-12T00:05:45.388 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8819000000000001e-05 2024-09-12T00:05:45.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.388 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.388 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:45.388 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.892428+0000", 2024-09-12T00:05:45.388 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016937885 2024-09-12T00:05:45.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.388 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.388 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:45.388 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.892504+0000", 2024-09-12T00:05:45.388 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5841999999999997e-05 2024-09-12T00:05:45.388 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.388 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:45.388 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.389 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.389 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.389 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3727 3.35 3:ad6b6c99:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_344:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:45.389 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.876261+0000", 2024-09-12T00:05:45.389 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.40646286700000001, 2024-09-12T00:05:45.389 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.029109105, 2024-09-12T00:05:45.389 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:45.389 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:45.389 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:45.389 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:45.389 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:45.389 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:45.389 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3727 2024-09-12T00:05:45.389 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.390 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:45.390 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.390 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:45.390 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.876261+0000", 2024-09-12T00:05:45.390 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.390 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.390 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.390 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:45.390 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.876261+0000", 2024-09-12T00:05:45.390 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.390 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.390 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.390 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:45.390 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.876264+0000", 2024-09-12T00:05:45.390 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.388e-06 2024-09-12T00:05:45.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.391 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.391 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:45.391 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878449+0000", 2024-09-12T00:05:45.391 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021847360000000001 2024-09-12T00:05:45.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.391 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.391 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:45.391 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878470+0000", 2024-09-12T00:05:45.391 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0792e-05 2024-09-12T00:05:45.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.391 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.391 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:45.391 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878481+0000", 2024-09-12T00:05:45.392 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1421e-05 2024-09-12T00:05:45.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.392 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:45.392 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878572+0000", 2024-09-12T00:05:45.392 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0882000000000002e-05 2024-09-12T00:05:45.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.392 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:45.392 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878763+0000", 2024-09-12T00:05:45.392 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191218 2024-09-12T00:05:45.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.392 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.392 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:45.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878938+0000", 2024-09-12T00:05:45.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017507300000000001 2024-09-12T00:05:45.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.393 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:45.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.900618+0000", 2024-09-12T00:05:45.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021679706 2024-09-12T00:05:45.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.393 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:45.393 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.905243+0000", 2024-09-12T00:05:45.393 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046246869999999997 2024-09-12T00:05:45.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.394 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:45.394 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.905314+0000", 2024-09-12T00:05:45.394 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1797000000000004e-05 2024-09-12T00:05:45.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.394 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.394 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:45.394 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.905370+0000", 2024-09-12T00:05:45.394 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5405000000000002e-05 2024-09-12T00:05:45.394 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.394 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:45.394 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.394 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.394 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3735 3.3f 3:fd0f007c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_352:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:45.394 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.971621+0000", 2024-09-12T00:05:45.395 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.31110204000000002, 2024-09-12T00:05:45.395 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021631419999999998, 2024-09-12T00:05:45.395 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:45.395 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:45.395 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:45.395 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:45.395 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:45.395 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:45.395 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3735 2024-09-12T00:05:45.395 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.395 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:45.395 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.395 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:45.395 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.971621+0000", 2024-09-12T00:05:45.396 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.396 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.396 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:45.396 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.971621+0000", 2024-09-12T00:05:45.396 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.396 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.396 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:45.396 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.971626+0000", 2024-09-12T00:05:45.396 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.313e-06 2024-09-12T00:05:45.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.396 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.396 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:45.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973760+0000", 2024-09-12T00:05:45.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021346780000000001 2024-09-12T00:05:45.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.397 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:45.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973788+0000", 2024-09-12T00:05:45.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7327000000000001e-05 2024-09-12T00:05:45.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.397 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:45.397 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973799+0000", 2024-09-12T00:05:45.397 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1379999999999999e-05 2024-09-12T00:05:45.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.397 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.398 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:45.398 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973904+0000", 2024-09-12T00:05:45.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105071 2024-09-12T00:05:45.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.398 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:45.398 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.974119+0000", 2024-09-12T00:05:45.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021477399999999999 2024-09-12T00:05:45.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.398 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:45.398 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.974313+0000", 2024-09-12T00:05:45.398 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019439300000000001 2024-09-12T00:05:45.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:45.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.985849+0000", 2024-09-12T00:05:45.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011535915000000001 2024-09-12T00:05:45.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:45.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.993125+0000", 2024-09-12T00:05:45.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0072761299999999996 2024-09-12T00:05:45.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.399 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:45.399 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.993201+0000", 2024-09-12T00:05:45.399 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5098000000000005e-05 2024-09-12T00:05:45.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.400 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:45.400 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.993253+0000", 2024-09-12T00:05:45.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2340999999999999e-05 2024-09-12T00:05:45.400 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.400 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:45.400 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.400 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.400 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3756 3.15 3:aa8e955f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_373:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:45.400 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.207558+0000", 2024-09-12T00:05:45.400 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.075165223000000003, 2024-09-12T00:05:45.400 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021266769000000001, 2024-09-12T00:05:45.400 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:45.401 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:45.401 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:45.401 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:45.401 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:45.401 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:45.401 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3756 2024-09-12T00:05:45.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.401 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:45.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.401 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:45.401 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.207558+0000", 2024-09-12T00:05:45.401 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.401 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.402 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:45.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.207558+0000", 2024-09-12T00:05:45.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:45.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.402 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:45.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.207561+0000", 2024-09-12T00:05:45.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9450000000000002e-06 2024-09-12T00:05:45.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.402 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.402 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:45.402 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209465+0000", 2024-09-12T00:05:45.402 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019040089999999999 2024-09-12T00:05:45.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.403 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:45.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209493+0000", 2024-09-12T00:05:45.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7645999999999999e-05 2024-09-12T00:05:45.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.403 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:45.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209507+0000", 2024-09-12T00:05:45.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4333e-05 2024-09-12T00:05:45.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.403 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.403 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:45.403 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209609+0000", 2024-09-12T00:05:45.403 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101543 2024-09-12T00:05:45.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:45.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209822+0000", 2024-09-12T00:05:45.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021320000000000001 2024-09-12T00:05:45.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:45.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.210009+0000", 2024-09-12T00:05:45.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000187228 2024-09-12T00:05:45.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.404 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:45.404 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.219744+0000", 2024-09-12T00:05:45.404 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0097345079999999994 2024-09-12T00:05:45.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:45.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.228686+0000", 2024-09-12T00:05:45.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0089426200000000001 2024-09-12T00:05:45.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:45.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.228768+0000", 2024-09-12T00:05:45.405 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2112000000000003e-05 2024-09-12T00:05:45.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:45.405 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:45.405 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:45.405 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.228825+0000", 2024-09-12T00:05:45.406 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6625000000000001e-05 2024-09-12T00:05:45.406 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.406 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:45.406 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.406 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:45.406 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:45.406 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:45.407 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:05:45.408 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:45.408+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:45.508 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:45.508+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:45.534 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:05:45.609 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:45.612+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:45.610 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:45.610 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:45.610 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:05:45.610 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:45.627 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:05:45.687 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T00:05:45.710 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:45.712+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:45.733 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:45.734 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:45.762 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:45.762 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:45.786 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:45.786 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:45.806 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:45.806 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:45.812 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:45.812+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:45.832 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:45.832 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:45.860 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:45.860 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:45.884 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:45.884 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:45.885 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:45.885 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:45.912 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:45.912+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:45.914 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:05:45.916 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:45.916 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:46.014 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:46.012+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:46.069 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:46.070 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:46.093 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:05:46.137 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:46.140+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:46.216 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:46.216+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:46.235 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:46.236 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:46.258 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:05:46.317 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:46.316+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:46.418 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:46.420+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:46.445 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:46.445 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:46.466 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:05:46.519 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:46.520+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:46.620 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:46.620+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:46.641 INFO:tasks.workunit.client.0.smithi019.stdout:quota disabled for the bucket: buck_2024_08_12_00_05_36 2024-09-12T00:05:46.642 INFO:tasks.workunit.client.0.smithi019.stdout:adding file to bucket: 2Gb. 2024-09-12T00:05:46.642 INFO:tasks.workunit.client.0.smithi019.stdout:upload file successful 2024-09-12T00:05:46.642 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:05:46.642 INFO:tasks.workunit.client.0.smithi019.stdout:Test case: PASSED - bucket quota size doesnt take effect when quota is disabled 2024-09-12T00:05:46.642 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:05:46.655 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:46.655 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:46.669 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:05:46.721 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:46.720+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:46.784 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:46.785 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:46.798 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:05:46.822 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:46.820+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:46.916 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:46.916 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:46.923 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:46.924+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:46.929 INFO:tasks.workunit.client.0.smithi019.stdout:user qa_user deleted 2024-09-12T00:05:46.929 INFO:tasks.workunit.client.0.smithi019.stdout:bucket delete succeeded 2024-09-12T00:05:46.932 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:05:47.024 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:47.024+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:47.046 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:47.047 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:47.062 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:05:47.126 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:47.124+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:47.191 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:47.191 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:47.205 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:05:47.227 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:47.228+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:47.329 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:47.328+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:47.372 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:47.372 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:47.387 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:05:47.430 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:47.432+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:47.531 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:47.532+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:47.553 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:47.553 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:47.568 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:05:47.632 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:47.632+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:47.733 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:47.732+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:47.735 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:47.735 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:47.735 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:05:47.750 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:05:47.838 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:47.840+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:47.916 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:47.916 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:47.931 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:05:47.942 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:05:47.975 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:47.976+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:48.036 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:48.036+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:48.077 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:48.078 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:48.094 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:48.094 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:48.099 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:48.099 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:48.112 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:48.113 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:48.114 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:05:48.132 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:48.132 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:48.132 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T00:05:48.152 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:48.152 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:48.154 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:48.156+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:48.177 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:48.177 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:48.192 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:48.210 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:48.211 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:48.274 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:48.274 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:48.274 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:48.274 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:48.277 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:48.280+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:48.288 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:05:48.338 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:48.340+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:48.408 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:48.408 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:48.421 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:05:48.470 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:48.472+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:48.540 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:48.540+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:48.550 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:48.550 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:48.550 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:48.550 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:48.550 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1646 3.25 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:05:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 75.471688912000005, 2024-09-12T00:05:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030091884999999999, 2024-09-12T00:05:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1646 2024-09-12T00:05:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077113+0000", 2024-09-12T00:05:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0186e-05 2024-09-12T00:05:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084821+0000", 2024-09-12T00:05:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077083450000000001 2024-09-12T00:05:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084857+0000", 2024-09-12T00:05:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6245000000000003e-05 2024-09-12T00:05:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084900+0000", 2024-09-12T00:05:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2369e-05 2024-09-12T00:05:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085058+0000", 2024-09-12T00:05:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015858199999999999 2024-09-12T00:05:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085307+0000", 2024-09-12T00:05:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024867999999999998 2024-09-12T00:05:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086107+0000", 2024-09-12T00:05:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00080040099999999996 2024-09-12T00:05:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.100477+0000", 2024-09-12T00:05:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014369508 2024-09-12T00:05:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107016+0000", 2024-09-12T00:05:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006538894 2024-09-12T00:05:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107121+0000", 2024-09-12T00:05:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105284 2024-09-12T00:05:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107194+0000", 2024-09-12T00:05:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3391000000000003e-05 2024-09-12T00:05:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2718 3.4 3:20fe36bb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 60.763210753999999, 2024-09-12T00:05:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027867928, 2024-09-12T00:05:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2718 2024-09-12T00:05:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785584+0000", 2024-09-12T00:05:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.056e-06 2024-09-12T00:05:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792023+0000", 2024-09-12T00:05:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064398069999999996 2024-09-12T00:05:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792058+0000", 2024-09-12T00:05:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5018000000000003e-05 2024-09-12T00:05:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792078+0000", 2024-09-12T00:05:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9862000000000001e-05 2024-09-12T00:05:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792248+0000", 2024-09-12T00:05:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017006399999999999 2024-09-12T00:05:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792660+0000", 2024-09-12T00:05:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041189500000000001 2024-09-12T00:05:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793081+0000", 2024-09-12T00:05:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000420395 2024-09-12T00:05:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808422+0000", 2024-09-12T00:05:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015341626000000001 2024-09-12T00:05:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813192+0000", 2024-09-12T00:05:48.562 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047701799999999997 2024-09-12T00:05:48.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.562 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:48.562 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813339+0000", 2024-09-12T00:05:48.562 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014643800000000001 2024-09-12T00:05:48.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.562 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:48.562 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813449+0000", 2024-09-12T00:05:48.562 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010958700000000001 2024-09-12T00:05:48.562 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.562 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2736 3.25 3:a750a681:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 60.573438392, 2024-09-12T00:05:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025701234999999999, 2024-09-12T00:05:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2736 2024-09-12T00:05:48.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.564 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:48.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.564 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:48.564 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:48.564 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.564 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:48.564 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:48.564 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975357+0000", 2024-09-12T00:05:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9389999999999999e-06 2024-09-12T00:05:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979365+0000", 2024-09-12T00:05:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040076679999999998 2024-09-12T00:05:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979402+0000", 2024-09-12T00:05:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7557e-05 2024-09-12T00:05:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.566 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:48.566 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979419+0000", 2024-09-12T00:05:48.566 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7203000000000001e-05 2024-09-12T00:05:48.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.566 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:48.566 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979543+0000", 2024-09-12T00:05:48.566 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000123423 2024-09-12T00:05:48.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.566 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:48.566 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979784+0000", 2024-09-12T00:05:48.566 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024097800000000001 2024-09-12T00:05:48.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.567 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.567 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:48.567 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980013+0000", 2024-09-12T00:05:48.567 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022881999999999999 2024-09-12T00:05:48.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.567 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.567 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:48.567 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.999860+0000", 2024-09-12T00:05:48.567 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019847908000000001 2024-09-12T00:05:48.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.567 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.567 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:48.568 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000741+0000", 2024-09-12T00:05:48.568 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00088041499999999995 2024-09-12T00:05:48.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.568 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:48.568 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000915+0000", 2024-09-12T00:05:48.568 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017460300000000001 2024-09-12T00:05:48.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.568 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:48.568 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.001054+0000", 2024-09-12T00:05:48.568 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013872099999999999 2024-09-12T00:05:48.568 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.569 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:48.569 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.569 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.569 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2964 3.24 3:26c83ec0:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:48.569 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:48.569 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.543376590000001, 2024-09-12T00:05:48.569 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028979713000000001, 2024-09-12T00:05:48.569 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:48.569 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:48.569 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:48.569 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:48.569 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:48.569 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2964 2024-09-12T00:05:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.571 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:48.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005417+0000", 2024-09-12T00:05:48.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2450000000000001e-06 2024-09-12T00:05:48.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.571 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:48.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010885+0000", 2024-09-12T00:05:48.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054684809999999999 2024-09-12T00:05:48.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.571 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:48.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010901+0000", 2024-09-12T00:05:48.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5097e-05 2024-09-12T00:05:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010908+0000", 2024-09-12T00:05:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7419999999999997e-06 2024-09-12T00:05:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010968+0000", 2024-09-12T00:05:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.9837000000000003e-05 2024-09-12T00:05:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011082+0000", 2024-09-12T00:05:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011357399999999999 2024-09-12T00:05:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011174+0000", 2024-09-12T00:05:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2703999999999999e-05 2024-09-12T00:05:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.021639+0000", 2024-09-12T00:05:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010464641 2024-09-12T00:05:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.574 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:48.574 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034210+0000", 2024-09-12T00:05:48.574 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012570463 2024-09-12T00:05:48.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.574 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:48.574 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034300+0000", 2024-09-12T00:05:48.574 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0691000000000003e-05 2024-09-12T00:05:48.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.574 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:48.574 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034394+0000", 2024-09-12T00:05:48.574 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4238000000000001e-05 2024-09-12T00:05:48.574 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3052 3.32 3:4d6db9ea:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 27.569129963999998, 2024-09-12T00:05:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028091277000000001, 2024-09-12T00:05:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3052 2024-09-12T00:05:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979664+0000", 2024-09-12T00:05:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:05:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986918+0000", 2024-09-12T00:05:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0072537110000000004 2024-09-12T00:05:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986956+0000", 2024-09-12T00:05:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8111999999999997e-05 2024-09-12T00:05:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986975+0000", 2024-09-12T00:05:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9245999999999998e-05 2024-09-12T00:05:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:48.579 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987159+0000", 2024-09-12T00:05:48.579 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000183828 2024-09-12T00:05:48.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.579 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.579 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:48.579 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987552+0000", 2024-09-12T00:05:48.579 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039349699999999998 2024-09-12T00:05:48.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987943+0000", 2024-09-12T00:05:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000390579 2024-09-12T00:05:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.999384+0000", 2024-09-12T00:05:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011441563 2024-09-12T00:05:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007634+0000", 2024-09-12T00:05:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082496240000000005 2024-09-12T00:05:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007699+0000", 2024-09-12T00:05:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5089e-05 2024-09-12T00:05:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007753+0000", 2024-09-12T00:05:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3588000000000003e-05 2024-09-12T00:05:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3064 3.4 3:209c6609:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 27.436814686000002, 2024-09-12T00:05:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024628305999999999, 2024-09-12T00:05:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3064 2024-09-12T00:05:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111980+0000", 2024-09-12T00:05:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.005e-06 2024-09-12T00:05:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116464+0000", 2024-09-12T00:05:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044839210000000001 2024-09-12T00:05:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116490+0000", 2024-09-12T00:05:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6690999999999999e-05 2024-09-12T00:05:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:48.585 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116504+0000", 2024-09-12T00:05:48.585 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4109e-05 2024-09-12T00:05:48.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116639+0000", 2024-09-12T00:05:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013427 2024-09-12T00:05:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116931+0000", 2024-09-12T00:05:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000292603 2024-09-12T00:05:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.117174+0000", 2024-09-12T00:05:48.590 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024240700000000001 2024-09-12T00:05:48.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.590 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.590 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:48.590 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126449+0000", 2024-09-12T00:05:48.590 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0092748699999999993 2024-09-12T00:05:48.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.590 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.590 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136438+0000", 2024-09-12T00:05:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099898539999999994 2024-09-12T00:05:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136532+0000", 2024-09-12T00:05:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3898000000000001e-05 2024-09-12T00:05:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136605+0000", 2024-09-12T00:05:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2677999999999998e-05 2024-09-12T00:05:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3125 3.12 3:495b0235:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 26.633020681000001, 2024-09-12T00:05:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030616648999999999, 2024-09-12T00:05:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3125 2024-09-12T00:05:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915773+0000", 2024-09-12T00:05:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2800000000000002e-06 2024-09-12T00:05:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919856+0000", 2024-09-12T00:05:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004082713 2024-09-12T00:05:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919879+0000", 2024-09-12T00:05:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3782e-05 2024-09-12T00:05:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919891+0000", 2024-09-12T00:05:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1440000000000001e-05 2024-09-12T00:05:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920037+0000", 2024-09-12T00:05:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014562700000000001 2024-09-12T00:05:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920280+0000", 2024-09-12T00:05:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000243274 2024-09-12T00:05:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920527+0000", 2024-09-12T00:05:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024692699999999998 2024-09-12T00:05:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.932485+0000", 2024-09-12T00:05:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011957857000000001 2024-09-12T00:05:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946197+0000", 2024-09-12T00:05:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013712436999999999 2024-09-12T00:05:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946305+0000", 2024-09-12T00:05:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000107914 2024-09-12T00:05:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946387+0000", 2024-09-12T00:05:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2398000000000006e-05 2024-09-12T00:05:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3134 3.24 3:2525a955:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 26.508943950999999, 2024-09-12T00:05:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025606806999999999, 2024-09-12T00:05:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3134 2024-09-12T00:05:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039850+0000", 2024-09-12T00:05:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9780000000000001e-06 2024-09-12T00:05:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045256+0000", 2024-09-12T00:05:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054058129999999998 2024-09-12T00:05:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045284+0000", 2024-09-12T00:05:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8065e-05 2024-09-12T00:05:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.602 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.602 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:48.602 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045297+0000", 2024-09-12T00:05:48.602 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2788e-05 2024-09-12T00:05:48.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.602 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.602 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:48.602 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045378+0000", 2024-09-12T00:05:48.602 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1079000000000001e-05 2024-09-12T00:05:48.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.602 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045530+0000", 2024-09-12T00:05:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015206099999999999 2024-09-12T00:05:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045655+0000", 2024-09-12T00:05:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012525899999999999 2024-09-12T00:05:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.054817+0000", 2024-09-12T00:05:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0091611049999999992 2024-09-12T00:05:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065354+0000", 2024-09-12T00:05:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010537625 2024-09-12T00:05:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065410+0000", 2024-09-12T00:05:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6141999999999999e-05 2024-09-12T00:05:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065454+0000", 2024-09-12T00:05:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3891999999999999e-05 2024-09-12T00:05:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.606 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3386 3.1 3:8071dd26:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:48.606 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.767011+0000", 2024-09-12T00:05:48.606 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 7.7817808340000001, 2024-09-12T00:05:48.606 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.031756300000000001, 2024-09-12T00:05:48.606 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:48.606 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:48.606 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:48.606 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:48.606 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:48.606 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3386 2024-09-12T00:05:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.767011+0000", 2024-09-12T00:05:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.767011+0000", 2024-09-12T00:05:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.767014+0000", 2024-09-12T00:05:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0429999999999999e-06 2024-09-12T00:05:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775360+0000", 2024-09-12T00:05:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0083463740000000002 2024-09-12T00:05:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775398+0000", 2024-09-12T00:05:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8376e-05 2024-09-12T00:05:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775415+0000", 2024-09-12T00:05:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6563e-05 2024-09-12T00:05:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775556+0000", 2024-09-12T00:05:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000140865 2024-09-12T00:05:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775819+0000", 2024-09-12T00:05:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000262842 2024-09-12T00:05:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.776048+0000", 2024-09-12T00:05:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000229399 2024-09-12T00:05:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.791048+0000", 2024-09-12T00:05:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015000503 2024-09-12T00:05:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.798597+0000", 2024-09-12T00:05:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0075482409999999998 2024-09-12T00:05:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.798690+0000", 2024-09-12T00:05:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3769000000000003e-05 2024-09-12T00:05:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.798767+0000", 2024-09-12T00:05:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6324999999999999e-05 2024-09-12T00:05:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3397 3.4 3:220517e3:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.890276+0000", 2024-09-12T00:05:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 7.6585158270000004, 2024-09-12T00:05:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.02507564, 2024-09-12T00:05:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3397 2024-09-12T00:05:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.890276+0000", 2024-09-12T00:05:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.890276+0000", 2024-09-12T00:05:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.890281+0000", 2024-09-12T00:05:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.366e-06 2024-09-12T00:05:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.894729+0000", 2024-09-12T00:05:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044483320000000002 2024-09-12T00:05:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.894782+0000", 2024-09-12T00:05:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2445999999999999e-05 2024-09-12T00:05:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.616 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:48.616 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.894810+0000", 2024-09-12T00:05:48.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8126000000000001e-05 2024-09-12T00:05:48.616 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.616 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.616 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:48.616 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.894961+0000", 2024-09-12T00:05:48.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015165999999999999 2024-09-12T00:05:48.616 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.616 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.616 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:48.616 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.895228+0000", 2024-09-12T00:05:48.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026675599999999999 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.895478+0000", 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025020199999999999 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.913919+0000", 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018440096999999999 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.915109+0000", 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0011908660000000001 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.915239+0000", 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012928399999999999 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.915351+0000", 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011250499999999999 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3398 3.12 3:4888914b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.904027+0000", 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 7.6447642350000002, 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.029408179999999999, 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3398 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.904027+0000", 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.904027+0000", 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.904030+0000", 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0529999999999998e-06 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.910958+0000", 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0069274849999999997 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.910989+0000", 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1752999999999999e-05 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911006+0000", 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6463000000000001e-05 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911171+0000", 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016481699999999999 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911417+0000", 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024629600000000001 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911646+0000", 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022906599999999999 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.932777+0000", 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021130906000000001 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.933094+0000", 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000317127 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:48.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.933277+0000", 2024-09-12T00:05:48.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018257000000000001 2024-09-12T00:05:48.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:48.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.933435+0000", 2024-09-12T00:05:48.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015864399999999999 2024-09-12T00:05:48.624 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3401 3.20 e82/23 3:06d9612a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_28:head v 82'11, mlcod=76'9)", 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.936564+0000", 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 7.6122274729999999, 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.026227489999999999, 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.936564+0000", 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.936564+0000", 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.936571+0000", 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5959999999999998e-06 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:48.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941597+0000", 2024-09-12T00:05:48.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0050253720000000002 2024-09-12T00:05:48.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:48.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941625+0000", 2024-09-12T00:05:48.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8564999999999998e-05 2024-09-12T00:05:48.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:48.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941640+0000", 2024-09-12T00:05:48.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4837e-05 2024-09-12T00:05:48.628 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.628 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.628 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:48.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941776+0000", 2024-09-12T00:05:48.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013623500000000001 2024-09-12T00:05:48.628 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.628 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.628 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941822+0000", 2024-09-12T00:05:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5513000000000003e-05 2024-09-12T00:05:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.962694+0000", 2024-09-12T00:05:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020871516999999999 2024-09-12T00:05:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.962791+0000", 2024-09-12T00:05:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7855000000000004e-05 2024-09-12T00:05:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3670 3.5 e83/23 3:a3029b32:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_287:head v 83'13, mlcod=83'11)", 2024-09-12T00:05:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:43.823062+0000", 2024-09-12T00:05:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.7257295179999996, 2024-09-12T00:05:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028976041000000001, 2024-09-12T00:05:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.823062+0000", 2024-09-12T00:05:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.823062+0000", 2024-09-12T00:05:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.823068+0000", 2024-09-12T00:05:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6250000000000001e-06 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.826863+0000", 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037945880000000002 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.826885+0000", 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1515e-05 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.826894+0000", 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4040000000000001e-06 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.827014+0000", 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120238 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.827056+0000", 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2129000000000003e-05 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.851882+0000", 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024825538000000001 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.852038+0000", 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015600400000000001 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3681 3.12 3:481fb92d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_298:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:43.987522+0000", 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.5612689150000003, 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.029063802999999999, 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3681 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.987522+0000", 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.987522+0000", 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.987527+0000", 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5730000000000001e-06 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.992931+0000", 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054043950000000002 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.992974+0000", 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2542e-05 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.992999+0000", 2024-09-12T00:05:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5113000000000002e-05 2024-09-12T00:05:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.993146+0000", 2024-09-12T00:05:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014703900000000001 2024-09-12T00:05:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.993270+0000", 2024-09-12T00:05:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012376100000000001 2024-09-12T00:05:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.993433+0000", 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016290900000000001 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.003341+0000", 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099082289999999993 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.016476+0000", 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013134616999999999 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.016528+0000", 2024-09-12T00:05:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2410000000000001e-05 2024-09-12T00:05:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.016586+0000", 2024-09-12T00:05:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8214999999999997e-05 2024-09-12T00:05:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3714 3.32 3:4e60a7f6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_331:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.707821+0000", 2024-09-12T00:05:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.8409699420000001, 2024-09-12T00:05:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025583348999999998, 2024-09-12T00:05:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3714 2024-09-12T00:05:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.707821+0000", 2024-09-12T00:05:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.707821+0000", 2024-09-12T00:05:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.707867+0000", 2024-09-12T00:05:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5429000000000002e-05 2024-09-12T00:05:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715020+0000", 2024-09-12T00:05:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0071533580000000003 2024-09-12T00:05:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715058+0000", 2024-09-12T00:05:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7823e-05 2024-09-12T00:05:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715075+0000", 2024-09-12T00:05:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7122999999999999e-05 2024-09-12T00:05:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715275+0000", 2024-09-12T00:05:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020033 2024-09-12T00:05:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715526+0000", 2024-09-12T00:05:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025033500000000002 2024-09-12T00:05:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715760+0000", 2024-09-12T00:05:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023411600000000001 2024-09-12T00:05:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.731072+0000", 2024-09-12T00:05:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015311671000000001 2024-09-12T00:05:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.733084+0000", 2024-09-12T00:05:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020124299999999999 2024-09-12T00:05:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.733257+0000", 2024-09-12T00:05:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017338400000000001 2024-09-12T00:05:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.733405+0000", 2024-09-12T00:05:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014735 2024-09-12T00:05:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3726 3.33 3:cd6e0a10:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_343:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.865044+0000", 2024-09-12T00:05:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.6837469490000001, 2024-09-12T00:05:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027130072000000002, 2024-09-12T00:05:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3726 2024-09-12T00:05:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.865044+0000", 2024-09-12T00:05:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.865044+0000", 2024-09-12T00:05:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.865048+0000", 2024-09-12T00:05:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1669999999999999e-06 2024-09-12T00:05:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869155+0000", 2024-09-12T00:05:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041073020000000002 2024-09-12T00:05:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869190+0000", 2024-09-12T00:05:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5113000000000001e-05 2024-09-12T00:05:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869207+0000", 2024-09-12T00:05:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6943e-05 2024-09-12T00:05:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869388+0000", 2024-09-12T00:05:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018116000000000001 2024-09-12T00:05:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869776+0000", 2024-09-12T00:05:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00038828099999999998 2024-09-12T00:05:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.870191+0000", 2024-09-12T00:05:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041471599999999998 2024-09-12T00:05:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.881480+0000", 2024-09-12T00:05:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0112887 2024-09-12T00:05:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.891979+0000", 2024-09-12T00:05:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010499377000000001 2024-09-12T00:05:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.892068+0000", 2024-09-12T00:05:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8374000000000005e-05 2024-09-12T00:05:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.892174+0000", 2024-09-12T00:05:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000106939 2024-09-12T00:05:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3732 3.25 3:a4e42410:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_349:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.935722+0000", 2024-09-12T00:05:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.6130690049999998, 2024-09-12T00:05:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025382307, 2024-09-12T00:05:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3732 2024-09-12T00:05:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.935722+0000", 2024-09-12T00:05:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.935722+0000", 2024-09-12T00:05:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.935725+0000", 2024-09-12T00:05:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.943e-06 2024-09-12T00:05:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.940989+0000", 2024-09-12T00:05:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052639799999999997 2024-09-12T00:05:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.941045+0000", 2024-09-12T00:05:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6159000000000002e-05 2024-09-12T00:05:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.941064+0000", 2024-09-12T00:05:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8085999999999999e-05 2024-09-12T00:05:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.941195+0000", 2024-09-12T00:05:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000131125 2024-09-12T00:05:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.941435+0000", 2024-09-12T00:05:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024035899999999999 2024-09-12T00:05:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.941654+0000", 2024-09-12T00:05:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021882999999999999 2024-09-12T00:05:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.955258+0000", 2024-09-12T00:05:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013604171 2024-09-12T00:05:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.960941+0000", 2024-09-12T00:05:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0056832899999999997 2024-09-12T00:05:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.961030+0000", 2024-09-12T00:05:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8595000000000001e-05 2024-09-12T00:05:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.961105+0000", 2024-09-12T00:05:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4769000000000002e-05 2024-09-12T00:05:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3750 3.4 3:205ed86b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_367:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.141436+0000", 2024-09-12T00:05:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.4073550240000001, 2024-09-12T00:05:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025245500000000001, 2024-09-12T00:05:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3750 2024-09-12T00:05:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.141436+0000", 2024-09-12T00:05:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.141436+0000", 2024-09-12T00:05:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.141440+0000", 2024-09-12T00:05:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5939999999999998e-06 2024-09-12T00:05:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.145505+0000", 2024-09-12T00:05:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040646160000000001 2024-09-12T00:05:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.145541+0000", 2024-09-12T00:05:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6508999999999999e-05 2024-09-12T00:05:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.145559+0000", 2024-09-12T00:05:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7853e-05 2024-09-12T00:05:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.145724+0000", 2024-09-12T00:05:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016462099999999999 2024-09-12T00:05:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.146114+0000", 2024-09-12T00:05:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039085699999999999 2024-09-12T00:05:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.146533+0000", 2024-09-12T00:05:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041889 2024-09-12T00:05:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.165996+0000", 2024-09-12T00:05:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019462461 2024-09-12T00:05:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.166514+0000", 2024-09-12T00:05:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00051867799999999996 2024-09-12T00:05:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.166614+0000", 2024-09-12T00:05:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9538999999999997e-05 2024-09-12T00:05:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.166682+0000", 2024-09-12T00:05:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.7881999999999998e-05 2024-09-12T00:05:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3768 3.25 3:a5893d4d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_385:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.338740+0000", 2024-09-12T00:05:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.2100510629999999, 2024-09-12T00:05:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025891451999999999, 2024-09-12T00:05:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3768 2024-09-12T00:05:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.338740+0000", 2024-09-12T00:05:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.338740+0000", 2024-09-12T00:05:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.338744+0000", 2024-09-12T00:05:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1470000000000003e-06 2024-09-12T00:05:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343258+0000", 2024-09-12T00:05:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045136880000000001 2024-09-12T00:05:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343292+0000", 2024-09-12T00:05:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3893000000000002e-05 2024-09-12T00:05:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343337+0000", 2024-09-12T00:05:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4699e-05 2024-09-12T00:05:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343453+0000", 2024-09-12T00:05:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000116272 2024-09-12T00:05:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343770+0000", 2024-09-12T00:05:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00031750799999999998 2024-09-12T00:05:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343992+0000", 2024-09-12T00:05:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000221986 2024-09-12T00:05:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.355234+0000", 2024-09-12T00:05:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011241637000000001 2024-09-12T00:05:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.364420+0000", 2024-09-12T00:05:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0091854320000000003 2024-09-12T00:05:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.364514+0000", 2024-09-12T00:05:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4492000000000003e-05 2024-09-12T00:05:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.364632+0000", 2024-09-12T00:05:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117698 2024-09-12T00:05:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3791 3.4 3:2186e625:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_408:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.609529+0000", 2024-09-12T00:05:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 2.9392622610000001, 2024-09-12T00:05:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.031252178999999998, 2024-09-12T00:05:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3791 2024-09-12T00:05:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.609529+0000", 2024-09-12T00:05:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.609529+0000", 2024-09-12T00:05:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.609532+0000", 2024-09-12T00:05:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3230000000000002e-06 2024-09-12T00:05:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.613514+0000", 2024-09-12T00:05:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039820439999999997 2024-09-12T00:05:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.613550+0000", 2024-09-12T00:05:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5821999999999997e-05 2024-09-12T00:05:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.613568+0000", 2024-09-12T00:05:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7363e-05 2024-09-12T00:05:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.613738+0000", 2024-09-12T00:05:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017081400000000001 2024-09-12T00:05:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.614134+0000", 2024-09-12T00:05:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000395454 2024-09-12T00:05:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.614529+0000", 2024-09-12T00:05:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039467300000000001 2024-09-12T00:05:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.632368+0000", 2024-09-12T00:05:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017839482 2024-09-12T00:05:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.640584+0000", 2024-09-12T00:05:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082160700000000007 2024-09-12T00:05:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.640694+0000", 2024-09-12T00:05:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109782 2024-09-12T00:05:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.640781+0000", 2024-09-12T00:05:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7352e-05 2024-09-12T00:05:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:48.678 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.678 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:48.678 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:48.678 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:48.680 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:05:48.680 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:48.680+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:48.781 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:48.780+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:48.856 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:48.856 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:48.856 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:48.856 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:48.870 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:05:48.914 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:48.916+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:48.983 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:48.984+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:49.039 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:49.039 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:49.039 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:49.039 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:49.039 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:49.053 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:05:49.083 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:49.084+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:49.184 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:49.184+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:49.221 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:49.221 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:49.221 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:49.221 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:49.221 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.222 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:1646 3.25 e58/23 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head v 58'1, mlcod=0'0)", 2024-09-12T00:05:49.222 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:49.222 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 76.133288264000001, 2024-09-12T00:05:49.222 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020301987000000001, 2024-09-12T00:05:49.222 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:49.222 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:49.222 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.222 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:49.222 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.222 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:49.222 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:49.223 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.223 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.223 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.223 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:49.223 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:49.223 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.223 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.223 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.223 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:49.223 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086308+0000", 2024-09-12T00:05:49.223 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.95e-06 2024-09-12T00:05:49.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.224 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.224 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:49.224 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091174+0000", 2024-09-12T00:05:49.224 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048660559999999997 2024-09-12T00:05:49.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.224 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.224 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:49.224 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091218+0000", 2024-09-12T00:05:49.225 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4678999999999997e-05 2024-09-12T00:05:49.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.225 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.225 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.225 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091238+0000", 2024-09-12T00:05:49.225 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9839000000000001e-05 2024-09-12T00:05:49.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.225 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.225 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:49.225 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091396+0000", 2024-09-12T00:05:49.225 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000157396 2024-09-12T00:05:49.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.225 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.226 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:49.226 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091451+0000", 2024-09-12T00:05:49.226 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5547999999999997e-05 2024-09-12T00:05:49.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.226 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.226 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:49.226 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106474+0000", 2024-09-12T00:05:49.226 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015023287 2024-09-12T00:05:49.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.226 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.226 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:49.226 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106608+0000", 2024-09-12T00:05:49.227 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133232 2024-09-12T00:05:49.227 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.227 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:49.227 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.227 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.227 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2723 3.21 3:86535907:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:49.227 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:49.227 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 61.387440796999996, 2024-09-12T00:05:49.227 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021210407000000001, 2024-09-12T00:05:49.228 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:49.228 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:49.228 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.228 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:49.228 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:49.228 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.228 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2723 2024-09-12T00:05:49.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.228 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:49.228 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.228 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:49.229 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:49.229 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.230 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.230 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:49.230 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:49.230 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.230 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.230 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:49.230 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832157+0000", 2024-09-12T00:05:49.230 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3270000000000001e-06 2024-09-12T00:05:49.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.230 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.230 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:49.230 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837403+0000", 2024-09-12T00:05:49.230 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005246784 2024-09-12T00:05:49.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:49.231 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837439+0000", 2024-09-12T00:05:49.231 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5848e-05 2024-09-12T00:05:49.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.231 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837459+0000", 2024-09-12T00:05:49.231 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9585e-05 2024-09-12T00:05:49.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.231 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.231 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:49.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837574+0000", 2024-09-12T00:05:49.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000114917 2024-09-12T00:05:49.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.232 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:49.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837803+0000", 2024-09-12T00:05:49.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022967699999999999 2024-09-12T00:05:49.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.232 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.232 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:49.232 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838174+0000", 2024-09-12T00:05:49.232 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037083899999999998 2024-09-12T00:05:49.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.233 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.233 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:49.233 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848447+0000", 2024-09-12T00:05:49.233 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010272439 2024-09-12T00:05:49.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.233 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.233 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.233 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853191+0000", 2024-09-12T00:05:49.233 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047441109999999996 2024-09-12T00:05:49.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.233 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.233 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:49.233 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853292+0000", 2024-09-12T00:05:49.234 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000101474 2024-09-12T00:05:49.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.234 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.234 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:49.234 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853364+0000", 2024-09-12T00:05:49.234 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1406e-05 2024-09-12T00:05:49.234 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.234 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:49.234 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.234 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.234 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2971 3.2e 3:76f45d45:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:49.235 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:49.235 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 29.14372646, 2024-09-12T00:05:49.235 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022571213, 2024-09-12T00:05:49.235 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:49.235 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:49.235 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.235 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:49.235 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:49.235 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.235 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2971 2024-09-12T00:05:49.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.235 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:49.236 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.236 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:49.236 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:49.236 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.236 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.236 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:49.236 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:49.236 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.236 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.237 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:49.237 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075871+0000", 2024-09-12T00:05:49.237 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.467e-06 2024-09-12T00:05:49.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.237 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.237 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:49.237 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080307+0000", 2024-09-12T00:05:49.237 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044356359999999997 2024-09-12T00:05:49.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.237 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.237 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:49.238 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080346+0000", 2024-09-12T00:05:49.238 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9267999999999997e-05 2024-09-12T00:05:49.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.238 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.238 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.238 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080368+0000", 2024-09-12T00:05:49.238 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2603e-05 2024-09-12T00:05:49.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.238 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.238 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:49.238 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080489+0000", 2024-09-12T00:05:49.239 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0001209 2024-09-12T00:05:49.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.239 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:49.239 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080830+0000", 2024-09-12T00:05:49.239 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00034099 2024-09-12T00:05:49.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.239 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:49.239 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.081119+0000", 2024-09-12T00:05:49.239 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028860300000000001 2024-09-12T00:05:49.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.240 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.240 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:49.240 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.093241+0000", 2024-09-12T00:05:49.240 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012121609 2024-09-12T00:05:49.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.240 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.240 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.240 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098277+0000", 2024-09-12T00:05:49.240 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0050359710000000002 2024-09-12T00:05:49.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.241 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.241 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:49.241 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098366+0000", 2024-09-12T00:05:49.241 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9052000000000001e-05 2024-09-12T00:05:49.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.241 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.241 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:49.241 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098439+0000", 2024-09-12T00:05:49.241 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3114000000000005e-05 2024-09-12T00:05:49.241 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.242 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:49.242 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.242 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.242 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.242 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2996 3.21 3:872b1c12:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:49.242 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:49.242 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.869101723, 2024-09-12T00:05:49.242 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027562314000000001, 2024-09-12T00:05:49.242 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:49.242 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:49.242 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.243 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:49.243 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:49.243 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.243 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2996 2024-09-12T00:05:49.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.243 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:49.243 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.243 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:49.243 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:49.243 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.244 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.244 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:49.244 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:49.244 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.244 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.244 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:49.244 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350496+0000", 2024-09-12T00:05:49.244 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9160000000000003e-06 2024-09-12T00:05:49.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.244 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.245 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:49.245 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355187+0000", 2024-09-12T00:05:49.245 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046904989999999999 2024-09-12T00:05:49.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.245 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.245 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:49.245 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355223+0000", 2024-09-12T00:05:49.245 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6125999999999999e-05 2024-09-12T00:05:49.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.245 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.245 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.245 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355241+0000", 2024-09-12T00:05:49.245 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8686e-05 2024-09-12T00:05:49.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.245 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.246 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:49.246 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355373+0000", 2024-09-12T00:05:49.246 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013129299999999999 2024-09-12T00:05:49.246 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.246 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.246 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:49.246 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355619+0000", 2024-09-12T00:05:49.246 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024662700000000002 2024-09-12T00:05:49.246 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.246 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.246 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:49.246 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355855+0000", 2024-09-12T00:05:49.246 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023604299999999999 2024-09-12T00:05:49.246 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.247 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.247 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:49.247 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.367983+0000", 2024-09-12T00:05:49.247 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012127104999999999 2024-09-12T00:05:49.247 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.247 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.247 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.247 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377884+0000", 2024-09-12T00:05:49.247 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099013680000000007 2024-09-12T00:05:49.247 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.247 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.247 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:49.247 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377974+0000", 2024-09-12T00:05:49.247 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9932999999999994e-05 2024-09-12T00:05:49.247 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.248 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.248 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:49.248 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.378055+0000", 2024-09-12T00:05:49.248 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0717999999999995e-05 2024-09-12T00:05:49.248 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.248 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:49.248 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.248 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.248 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.248 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3030 3.2e 3:740afe3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:49.248 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:49.248 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.479771565, 2024-09-12T00:05:49.249 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.033756331000000001, 2024-09-12T00:05:49.249 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:49.249 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:49.249 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.249 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:49.249 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:49.249 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.249 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3030 2024-09-12T00:05:49.249 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.249 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:49.249 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.250 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:49.250 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:49.250 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.250 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.250 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.250 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:49.250 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:49.250 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.250 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.250 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.250 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:49.251 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739825+0000", 2024-09-12T00:05:49.251 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7920000000000001e-06 2024-09-12T00:05:49.251 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.251 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.251 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:49.251 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744217+0000", 2024-09-12T00:05:49.251 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043922529999999996 2024-09-12T00:05:49.251 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.251 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.251 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:49.251 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744243+0000", 2024-09-12T00:05:49.251 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5253e-05 2024-09-12T00:05:49.252 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.252 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.252 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.252 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744254+0000", 2024-09-12T00:05:49.252 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1430999999999999e-05 2024-09-12T00:05:49.252 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.252 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.252 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:49.252 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744325+0000", 2024-09-12T00:05:49.252 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1340999999999993e-05 2024-09-12T00:05:49.252 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.253 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.253 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:49.253 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744461+0000", 2024-09-12T00:05:49.253 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013531700000000001 2024-09-12T00:05:49.253 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.253 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.253 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:49.253 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744574+0000", 2024-09-12T00:05:49.253 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113513 2024-09-12T00:05:49.253 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.253 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.253 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:49.253 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.752813+0000", 2024-09-12T00:05:49.254 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082384750000000003 2024-09-12T00:05:49.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.254 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.254 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.254 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773444+0000", 2024-09-12T00:05:49.254 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020630773000000002 2024-09-12T00:05:49.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.254 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.254 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:49.254 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773510+0000", 2024-09-12T00:05:49.254 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6711000000000006e-05 2024-09-12T00:05:49.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.254 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.255 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:49.255 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773579+0000", 2024-09-12T00:05:49.255 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8472000000000004e-05 2024-09-12T00:05:49.255 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.255 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:49.255 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.255 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.255 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.255 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3039 3.2e 3:74587332:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:49.255 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:49.255 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.384091637000001, 2024-09-12T00:05:49.255 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.036215114, 2024-09-12T00:05:49.255 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:49.256 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:49.256 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.256 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:49.256 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:49.256 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.256 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3039 2024-09-12T00:05:49.256 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.256 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:49.256 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.256 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:49.256 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:49.256 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.256 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.256 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.256 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:49.257 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:49.257 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.257 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.257 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:49.257 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835507+0000", 2024-09-12T00:05:49.257 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6e-06 2024-09-12T00:05:49.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.257 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.257 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:49.257 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848930+0000", 2024-09-12T00:05:49.257 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013423242 2024-09-12T00:05:49.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.258 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.258 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:49.258 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848969+0000", 2024-09-12T00:05:49.258 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9270000000000002e-05 2024-09-12T00:05:49.258 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.258 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.258 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.258 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848991+0000", 2024-09-12T00:05:49.258 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1565000000000001e-05 2024-09-12T00:05:49.258 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.258 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.258 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:49.258 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849089+0000", 2024-09-12T00:05:49.258 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8408999999999999e-05 2024-09-12T00:05:49.259 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.259 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.259 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:49.259 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849518+0000", 2024-09-12T00:05:49.259 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042813900000000002 2024-09-12T00:05:49.259 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.259 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.259 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:49.259 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849897+0000", 2024-09-12T00:05:49.259 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037936600000000001 2024-09-12T00:05:49.259 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.259 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.259 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:49.259 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.858549+0000", 2024-09-12T00:05:49.259 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086520820000000002 2024-09-12T00:05:49.260 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.260 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.260 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.260 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871522+0000", 2024-09-12T00:05:49.260 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012973182999999999 2024-09-12T00:05:49.260 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.260 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.260 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:49.260 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871633+0000", 2024-09-12T00:05:49.260 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011085 2024-09-12T00:05:49.260 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.260 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.260 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:49.261 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871717+0000", 2024-09-12T00:05:49.261 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.4407999999999996e-05 2024-09-12T00:05:49.261 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.261 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:49.261 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.261 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.261 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.261 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3050 3.b 3:d26f7141:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:49.261 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:49.261 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.262479380999999, 2024-09-12T00:05:49.261 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022896481999999999, 2024-09-12T00:05:49.261 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:49.261 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:49.261 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.262 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:49.262 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:49.262 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.262 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3050 2024-09-12T00:05:49.262 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.262 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:49.262 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.262 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:49.262 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:49.262 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.262 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.262 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.262 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:49.262 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:49.262 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.263 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.263 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.263 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:49.263 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957117+0000", 2024-09-12T00:05:49.263 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7e-06 2024-09-12T00:05:49.263 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.263 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.263 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:49.263 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961673+0000", 2024-09-12T00:05:49.263 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045558059999999999 2024-09-12T00:05:49.263 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.263 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.263 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:49.263 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961698+0000", 2024-09-12T00:05:49.264 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5017000000000001e-05 2024-09-12T00:05:49.264 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.264 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.264 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.264 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961710+0000", 2024-09-12T00:05:49.264 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1963999999999999e-05 2024-09-12T00:05:49.264 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.264 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.264 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:49.264 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961785+0000", 2024-09-12T00:05:49.264 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5153000000000004e-05 2024-09-12T00:05:49.264 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.264 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.264 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:49.265 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961926+0000", 2024-09-12T00:05:49.265 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000141194 2024-09-12T00:05:49.265 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.265 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.265 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:49.265 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.962055+0000", 2024-09-12T00:05:49.265 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012882400000000001 2024-09-12T00:05:49.265 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.265 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.265 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:49.265 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.970716+0000", 2024-09-12T00:05:49.265 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086603610000000001 2024-09-12T00:05:49.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.266 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.266 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.266 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979700+0000", 2024-09-12T00:05:49.266 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.008984054 2024-09-12T00:05:49.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.266 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.266 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:49.266 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979884+0000", 2024-09-12T00:05:49.266 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184215 2024-09-12T00:05:49.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.267 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.267 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:49.267 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.980011+0000", 2024-09-12T00:05:49.267 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012719399999999999 2024-09-12T00:05:49.267 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.267 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:49.267 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.267 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.267 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3065 3.b 3:d10bf58d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:49.267 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:49.267 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.097531760999999, 2024-09-12T00:05:49.267 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021843261999999999, 2024-09-12T00:05:49.268 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:49.268 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:49.268 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.268 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:49.268 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:49.268 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.268 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3065 2024-09-12T00:05:49.268 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.268 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:49.268 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.268 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:49.269 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:49.269 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.269 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.269 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.269 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:49.269 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:49.269 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.269 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.269 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.269 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:49.269 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122067+0000", 2024-09-12T00:05:49.270 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4970000000000003e-06 2024-09-12T00:05:49.270 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.270 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.270 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:49.270 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126931+0000", 2024-09-12T00:05:49.270 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048641090000000001 2024-09-12T00:05:49.270 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.270 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.270 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:49.270 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126973+0000", 2024-09-12T00:05:49.270 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1678999999999999e-05 2024-09-12T00:05:49.270 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.271 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.271 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.271 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126999+0000", 2024-09-12T00:05:49.271 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6536000000000001e-05 2024-09-12T00:05:49.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.271 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.271 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:49.271 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127118+0000", 2024-09-12T00:05:49.271 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000119373 2024-09-12T00:05:49.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.271 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.272 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:49.272 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127289+0000", 2024-09-12T00:05:49.272 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017020199999999999 2024-09-12T00:05:49.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.272 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.272 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:49.272 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127437+0000", 2024-09-12T00:05:49.272 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148682 2024-09-12T00:05:49.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.272 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.272 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:49.272 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138539+0000", 2024-09-12T00:05:49.273 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011101418 2024-09-12T00:05:49.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.273 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.273 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.273 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143355+0000", 2024-09-12T00:05:49.273 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048161499999999999 2024-09-12T00:05:49.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.273 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.273 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:49.273 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143777+0000", 2024-09-12T00:05:49.273 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000421896 2024-09-12T00:05:49.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.274 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.274 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:49.274 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143905+0000", 2024-09-12T00:05:49.274 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012872 2024-09-12T00:05:49.274 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.274 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:49.274 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.274 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.274 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3066 3.21 3:8448517d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:49.274 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:49.275 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.087585679, 2024-09-12T00:05:49.275 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025911652, 2024-09-12T00:05:49.275 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:49.275 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:49.275 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.275 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:49.275 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:49.275 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.275 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3066 2024-09-12T00:05:49.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.275 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:49.275 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.276 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:49.276 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:49.276 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.276 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.276 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:49.276 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:49.276 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.276 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.276 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:49.277 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132011+0000", 2024-09-12T00:05:49.277 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8270000000000002e-06 2024-09-12T00:05:49.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.277 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.277 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:49.277 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137934+0000", 2024-09-12T00:05:49.277 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059226119999999998 2024-09-12T00:05:49.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.277 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.277 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:49.277 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137968+0000", 2024-09-12T00:05:49.278 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3933000000000002e-05 2024-09-12T00:05:49.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.278 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.278 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.278 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137985+0000", 2024-09-12T00:05:49.278 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7725999999999999e-05 2024-09-12T00:05:49.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.278 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.278 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:49.278 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138084+0000", 2024-09-12T00:05:49.278 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8450999999999996e-05 2024-09-12T00:05:49.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.279 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.279 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:49.279 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138285+0000", 2024-09-12T00:05:49.279 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000201411 2024-09-12T00:05:49.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.279 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.279 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:49.279 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138510+0000", 2024-09-12T00:05:49.279 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000224551 2024-09-12T00:05:49.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.279 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.279 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:49.280 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.146242+0000", 2024-09-12T00:05:49.280 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077317649999999998 2024-09-12T00:05:49.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.280 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.280 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.280 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157728+0000", 2024-09-12T00:05:49.280 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011486424 2024-09-12T00:05:49.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.280 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.280 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:49.281 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157833+0000", 2024-09-12T00:05:49.281 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105234 2024-09-12T00:05:49.281 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.281 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.281 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:49.281 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157920+0000", 2024-09-12T00:05:49.281 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6718000000000006e-05 2024-09-12T00:05:49.281 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.281 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:49.282 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.282 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.282 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.282 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3112 3.b 3:d1cf91a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:49.282 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:49.282 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 27.468868552, 2024-09-12T00:05:49.282 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021203475999999999, 2024-09-12T00:05:49.282 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:49.282 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:49.282 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.282 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:49.282 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:49.283 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.283 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3112 2024-09-12T00:05:49.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.283 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:49.283 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.283 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:49.283 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:49.284 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.284 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.284 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.284 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:49.284 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:49.284 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.284 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.284 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.284 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:49.284 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750728+0000", 2024-09-12T00:05:49.284 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.165e-06 2024-09-12T00:05:49.284 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.285 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.285 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:49.285 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755063+0000", 2024-09-12T00:05:49.285 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043355379999999999 2024-09-12T00:05:49.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.285 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.285 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:49.285 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755103+0000", 2024-09-12T00:05:49.285 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9962000000000001e-05 2024-09-12T00:05:49.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.285 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.285 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.285 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755120+0000", 2024-09-12T00:05:49.285 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6793e-05 2024-09-12T00:05:49.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.286 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.286 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:49.286 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755299+0000", 2024-09-12T00:05:49.286 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017904499999999999 2024-09-12T00:05:49.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.286 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.286 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:49.286 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755758+0000", 2024-09-12T00:05:49.286 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000458815 2024-09-12T00:05:49.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.286 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.286 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:49.287 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.756304+0000", 2024-09-12T00:05:49.287 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000546183 2024-09-12T00:05:49.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.287 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.287 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.287 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771518+0000", 2024-09-12T00:05:49.287 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015214236000000001 2024-09-12T00:05:49.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.287 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.287 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:49.287 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771827+0000", 2024-09-12T00:05:49.287 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000309308 2024-09-12T00:05:49.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.287 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.288 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:49.288 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771874+0000", 2024-09-12T00:05:49.288 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6119999999999999e-05 2024-09-12T00:05:49.288 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.288 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.288 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:49.288 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771929+0000", 2024-09-12T00:05:49.288 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5310999999999999e-05 2024-09-12T00:05:49.288 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.288 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:49.288 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.288 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.288 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.289 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3115 3.2e 3:75803fec:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:49.289 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:49.289 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 27.430897502000001, 2024-09-12T00:05:49.289 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020205041, 2024-09-12T00:05:49.289 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:49.289 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:49.289 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.289 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:49.289 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:49.289 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.289 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3115 2024-09-12T00:05:49.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.289 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:49.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.290 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:49.290 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:49.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.290 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.290 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:49.290 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:49.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.290 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.290 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:49.290 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788700+0000", 2024-09-12T00:05:49.290 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.614e-06 2024-09-12T00:05:49.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.291 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.291 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:49.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793576+0000", 2024-09-12T00:05:49.291 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048760920000000003 2024-09-12T00:05:49.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.291 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.291 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:49.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793610+0000", 2024-09-12T00:05:49.291 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4184999999999999e-05 2024-09-12T00:05:49.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.291 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.291 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.291 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793633+0000", 2024-09-12T00:05:49.291 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2551000000000001e-05 2024-09-12T00:05:49.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.292 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.292 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:49.292 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793750+0000", 2024-09-12T00:05:49.292 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117057 2024-09-12T00:05:49.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.292 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.292 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:49.292 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793975+0000", 2024-09-12T00:05:49.292 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022493099999999999 2024-09-12T00:05:49.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.293 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.293 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:49.293 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.794178+0000", 2024-09-12T00:05:49.293 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000202726 2024-09-12T00:05:49.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.293 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.293 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:49.293 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.803725+0000", 2024-09-12T00:05:49.293 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095470599999999996 2024-09-12T00:05:49.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.293 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.293 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.294 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808706+0000", 2024-09-12T00:05:49.294 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049814519999999999 2024-09-12T00:05:49.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.294 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.294 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:49.294 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808785+0000", 2024-09-12T00:05:49.294 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9160999999999996e-05 2024-09-12T00:05:49.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.294 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.294 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:49.294 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808902+0000", 2024-09-12T00:05:49.295 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000116212 2024-09-12T00:05:49.295 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.295 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:49.295 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.295 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.295 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3380 3.23 e82/23 3:c6c9ccf8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_7:head v 82'5, mlcod=76'3)", 2024-09-12T00:05:49.295 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:05:49.295 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.5130724840000003, 2024-09-12T00:05:49.295 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.029708818000000001, 2024-09-12T00:05:49.295 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:49.295 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:49.296 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.296 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:49.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:49.296 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:05:49.296 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.296 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.296 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:49.296 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:05:49.296 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.297 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.297 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:49.297 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:05:49.297 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1600000000000001e-07 2024-09-12T00:05:49.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.297 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.297 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:49.297 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.710842+0000", 2024-09-12T00:05:49.297 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043204510000000003 2024-09-12T00:05:49.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.298 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.298 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:49.298 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.710875+0000", 2024-09-12T00:05:49.298 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2702e-05 2024-09-12T00:05:49.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.298 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.298 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.298 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.710895+0000", 2024-09-12T00:05:49.298 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0094000000000001e-05 2024-09-12T00:05:49.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.298 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:49.299 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.711063+0000", 2024-09-12T00:05:49.299 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000167517 2024-09-12T00:05:49.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:49.299 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.711127+0000", 2024-09-12T00:05:49.299 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4004999999999995e-05 2024-09-12T00:05:49.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.299 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:49.300 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.736095+0000", 2024-09-12T00:05:49.300 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024968008999999999 2024-09-12T00:05:49.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.300 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.300 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:49.300 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.736230+0000", 2024-09-12T00:05:49.300 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013552400000000001 2024-09-12T00:05:49.300 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.300 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:49.300 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.301 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3409 3.b 3:d39a1970:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:49.301 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:41.028923+0000", 2024-09-12T00:05:49.301 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.1906714669999996, 2024-09-12T00:05:49.301 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030518363999999999, 2024-09-12T00:05:49.301 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:49.301 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:49.301 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.301 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:49.301 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:49.301 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.302 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3409 2024-09-12T00:05:49.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.302 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:49.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.302 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:49.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.028923+0000", 2024-09-12T00:05:49.302 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.302 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:49.302 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.028923+0000", 2024-09-12T00:05:49.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:49.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.028926+0000", 2024-09-12T00:05:49.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1e-06 2024-09-12T00:05:49.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.303 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.303 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:49.303 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038010+0000", 2024-09-12T00:05:49.303 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0090839110000000001 2024-09-12T00:05:49.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.304 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.304 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:49.304 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038042+0000", 2024-09-12T00:05:49.304 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2425999999999998e-05 2024-09-12T00:05:49.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.304 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.304 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.304 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038060+0000", 2024-09-12T00:05:49.304 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8219e-05 2024-09-12T00:05:49.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.304 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.305 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:49.305 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038205+0000", 2024-09-12T00:05:49.305 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014503500000000001 2024-09-12T00:05:49.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.305 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.305 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:49.305 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038498+0000", 2024-09-12T00:05:49.305 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00029289499999999999 2024-09-12T00:05:49.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.305 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.305 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:49.305 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038752+0000", 2024-09-12T00:05:49.305 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025434500000000001 2024-09-12T00:05:49.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.306 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:49.306 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.058529+0000", 2024-09-12T00:05:49.306 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019776275999999999 2024-09-12T00:05:49.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.306 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.306 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.059147+0000", 2024-09-12T00:05:49.306 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00061837199999999995 2024-09-12T00:05:49.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.306 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:49.307 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.059328+0000", 2024-09-12T00:05:49.307 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018048399999999999 2024-09-12T00:05:49.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.307 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.307 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:49.307 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.059441+0000", 2024-09-12T00:05:49.307 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011330100000000001 2024-09-12T00:05:49.307 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.307 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:49.307 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.307 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.308 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3665 3.21 3:85e29f15:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_282:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:49.308 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:43.757083+0000", 2024-09-12T00:05:49.308 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 5.4625107530000001, 2024-09-12T00:05:49.308 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021222119000000001, 2024-09-12T00:05:49.308 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:49.308 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:49.308 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.308 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:49.308 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:49.308 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.309 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3665 2024-09-12T00:05:49.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.309 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:49.309 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.309 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:49.309 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.757083+0000", 2024-09-12T00:05:49.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.309 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.309 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:49.309 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.757083+0000", 2024-09-12T00:05:49.309 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.310 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.310 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:49.310 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.757087+0000", 2024-09-12T00:05:49.310 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2370000000000003e-06 2024-09-12T00:05:49.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.310 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.310 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:49.310 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763296+0000", 2024-09-12T00:05:49.310 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0062089240000000002 2024-09-12T00:05:49.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.310 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.310 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:49.311 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763337+0000", 2024-09-12T00:05:49.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1032999999999998e-05 2024-09-12T00:05:49.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.311 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.311 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763356+0000", 2024-09-12T00:05:49.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8292999999999999e-05 2024-09-12T00:05:49.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.311 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:49.311 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763485+0000", 2024-09-12T00:05:49.311 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012931499999999999 2024-09-12T00:05:49.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:49.312 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763704+0000", 2024-09-12T00:05:49.312 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021922399999999999 2024-09-12T00:05:49.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:49.312 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763888+0000", 2024-09-12T00:05:49.312 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184146 2024-09-12T00:05:49.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:49.312 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.772359+0000", 2024-09-12T00:05:49.312 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0084704089999999999 2024-09-12T00:05:49.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.312 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.312 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.778004+0000", 2024-09-12T00:05:49.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0056452619999999998 2024-09-12T00:05:49.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.313 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:49.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.778173+0000", 2024-09-12T00:05:49.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016846299999999999 2024-09-12T00:05:49.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.313 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.313 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:49.313 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.778305+0000", 2024-09-12T00:05:49.313 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013281299999999999 2024-09-12T00:05:49.313 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.313 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:49.314 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.314 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.314 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.314 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3696 3.21 3:872f3075:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_313:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:49.314 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.301332+0000", 2024-09-12T00:05:49.314 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.9182622829999998, 2024-09-12T00:05:49.314 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024918241000000001, 2024-09-12T00:05:49.314 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:49.314 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:49.314 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.314 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:49.314 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:49.314 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.314 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3696 2024-09-12T00:05:49.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.315 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:49.315 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.315 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:49.315 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.301332+0000", 2024-09-12T00:05:49.315 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.315 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.315 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:49.315 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.301332+0000", 2024-09-12T00:05:49.315 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.315 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.315 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:49.315 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.301335+0000", 2024-09-12T00:05:49.316 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9679999999999998e-06 2024-09-12T00:05:49.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.316 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.316 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:49.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.305984+0000", 2024-09-12T00:05:49.316 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046492249999999999 2024-09-12T00:05:49.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.316 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.316 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:49.316 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306009+0000", 2024-09-12T00:05:49.316 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5252000000000001e-05 2024-09-12T00:05:49.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.316 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.317 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.317 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306023+0000", 2024-09-12T00:05:49.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3903000000000001e-05 2024-09-12T00:05:49.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.317 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.317 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:49.317 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306193+0000", 2024-09-12T00:05:49.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017032500000000001 2024-09-12T00:05:49.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.317 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.317 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:49.317 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306594+0000", 2024-09-12T00:05:49.317 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040111600000000003 2024-09-12T00:05:49.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.318 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.318 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:49.318 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.307002+0000", 2024-09-12T00:05:49.318 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040796000000000002 2024-09-12T00:05:49.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.318 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.318 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:49.318 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.319319+0000", 2024-09-12T00:05:49.318 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012317033 2024-09-12T00:05:49.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.318 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.318 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.318 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.325949+0000", 2024-09-12T00:05:49.318 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0066298110000000002 2024-09-12T00:05:49.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.319 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.319 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:49.319 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.326123+0000", 2024-09-12T00:05:49.319 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017416999999999999 2024-09-12T00:05:49.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.319 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.319 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:49.319 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.326250+0000", 2024-09-12T00:05:49.319 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012647799999999999 2024-09-12T00:05:49.319 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.319 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:49.319 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.320 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.320 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3737 3.b 3:d32629e2:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_354:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:49.320 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.993654+0000", 2024-09-12T00:05:49.320 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.2259399630000001, 2024-09-12T00:05:49.320 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022195105999999999, 2024-09-12T00:05:49.320 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:49.320 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:49.320 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.320 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:49.320 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:49.320 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.320 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3737 2024-09-12T00:05:49.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.321 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:49.321 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.321 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:49.321 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.993654+0000", 2024-09-12T00:05:49.321 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.321 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.321 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:49.321 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.993654+0000", 2024-09-12T00:05:49.321 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.321 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.321 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:49.322 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.993657+0000", 2024-09-12T00:05:49.322 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2600000000000001e-06 2024-09-12T00:05:49.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.322 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.322 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:49.322 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.997886+0000", 2024-09-12T00:05:49.322 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004228646 2024-09-12T00:05:49.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.322 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.322 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:49.322 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.997924+0000", 2024-09-12T00:05:49.322 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7632999999999997e-05 2024-09-12T00:05:49.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.322 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.323 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.323 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.997942+0000", 2024-09-12T00:05:49.323 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8352999999999999e-05 2024-09-12T00:05:49.323 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.323 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.323 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:49.323 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.998101+0000", 2024-09-12T00:05:49.323 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015922500000000001 2024-09-12T00:05:49.323 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.323 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.323 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:49.323 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.998375+0000", 2024-09-12T00:05:49.323 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027389500000000002 2024-09-12T00:05:49.324 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.324 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.324 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:49.324 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.998611+0000", 2024-09-12T00:05:49.324 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023559199999999999 2024-09-12T00:05:49.324 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.324 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.324 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:49.324 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009636+0000", 2024-09-12T00:05:49.324 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011025188 2024-09-12T00:05:49.324 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.325 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.325 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.325 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.015538+0000", 2024-09-12T00:05:49.325 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059023590000000003 2024-09-12T00:05:49.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.325 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.325 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:49.325 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.015717+0000", 2024-09-12T00:05:49.325 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017847699999999999 2024-09-12T00:05:49.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.325 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.325 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:49.325 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.015849+0000", 2024-09-12T00:05:49.326 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000132478 2024-09-12T00:05:49.326 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.326 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:49.326 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.326 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.326 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.326 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3738 3.2e 3:74a476b8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_355:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:49.326 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.005209+0000", 2024-09-12T00:05:49.326 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.2143844880000003, 2024-09-12T00:05:49.326 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022771276999999999, 2024-09-12T00:05:49.326 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:49.326 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:49.327 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.327 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:49.327 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:49.327 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.327 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3738 2024-09-12T00:05:49.327 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.327 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:49.327 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.327 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:49.327 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.005209+0000", 2024-09-12T00:05:49.327 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.328 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.328 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.328 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:49.328 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.005209+0000", 2024-09-12T00:05:49.328 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.328 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.328 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.328 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:49.328 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.005213+0000", 2024-09-12T00:05:49.328 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4170000000000001e-06 2024-09-12T00:05:49.328 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.329 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.329 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:49.329 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009471+0000", 2024-09-12T00:05:49.329 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042583400000000002 2024-09-12T00:05:49.329 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.329 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.329 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:49.329 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009506+0000", 2024-09-12T00:05:49.329 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4625999999999997e-05 2024-09-12T00:05:49.329 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.329 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.330 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.330 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009524+0000", 2024-09-12T00:05:49.330 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7745999999999999e-05 2024-09-12T00:05:49.330 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.330 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.330 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:49.330 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009649+0000", 2024-09-12T00:05:49.330 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000124948 2024-09-12T00:05:49.330 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.330 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.330 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:49.331 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009889+0000", 2024-09-12T00:05:49.331 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024013999999999999 2024-09-12T00:05:49.331 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.331 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.331 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:49.331 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.010104+0000", 2024-09-12T00:05:49.331 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021549199999999999 2024-09-12T00:05:49.331 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.331 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.331 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:49.331 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.022243+0000", 2024-09-12T00:05:49.331 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012138793 2024-09-12T00:05:49.331 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.332 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.332 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.332 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.027764+0000", 2024-09-12T00:05:49.332 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0055207820000000001 2024-09-12T00:05:49.332 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.332 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.332 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:49.332 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.027859+0000", 2024-09-12T00:05:49.332 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5441999999999999e-05 2024-09-12T00:05:49.332 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.332 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.333 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:49.333 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.027981+0000", 2024-09-12T00:05:49.333 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000121551 2024-09-12T00:05:49.333 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.333 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:49.333 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.333 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.333 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.333 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3758 3.2e 3:7790af15:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_375:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:49.333 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.228203+0000", 2024-09-12T00:05:49.333 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.9913906720000001, 2024-09-12T00:05:49.333 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.032647253000000001, 2024-09-12T00:05:49.334 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:49.334 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:49.334 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.334 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:49.334 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:49.334 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.334 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3758 2024-09-12T00:05:49.334 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.334 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:49.334 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.334 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:49.334 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.228203+0000", 2024-09-12T00:05:49.335 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.335 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.335 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:49.335 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.228203+0000", 2024-09-12T00:05:49.335 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.335 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.335 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:49.335 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.228208+0000", 2024-09-12T00:05:49.335 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3900000000000003e-06 2024-09-12T00:05:49.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.336 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.336 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:49.336 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239226+0000", 2024-09-12T00:05:49.336 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011018155 2024-09-12T00:05:49.336 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.336 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.336 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:49.336 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239265+0000", 2024-09-12T00:05:49.336 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9419000000000003e-05 2024-09-12T00:05:49.336 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.336 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.336 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.337 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239291+0000", 2024-09-12T00:05:49.337 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6173000000000002e-05 2024-09-12T00:05:49.337 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.337 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.337 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:49.337 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239430+0000", 2024-09-12T00:05:49.337 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000138071 2024-09-12T00:05:49.337 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.337 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.337 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:49.337 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239676+0000", 2024-09-12T00:05:49.337 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024695899999999999 2024-09-12T00:05:49.338 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.338 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.338 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:49.338 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239895+0000", 2024-09-12T00:05:49.338 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021808999999999999 2024-09-12T00:05:49.338 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.338 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.338 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:49.338 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.255130+0000", 2024-09-12T00:05:49.338 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015235907999999999 2024-09-12T00:05:49.338 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.338 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.339 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.339 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.260520+0000", 2024-09-12T00:05:49.339 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053894340000000002 2024-09-12T00:05:49.339 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.339 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.339 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:49.339 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.260700+0000", 2024-09-12T00:05:49.339 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018017099999999999 2024-09-12T00:05:49.339 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.339 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.339 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:49.339 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.260851+0000", 2024-09-12T00:05:49.339 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000150483 2024-09-12T00:05:49.340 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.340 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:49.340 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.340 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.340 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.340 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3760 3.b 3:d2eb500d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_377:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:49.340 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.251207+0000", 2024-09-12T00:05:49.340 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.9683870150000002, 2024-09-12T00:05:49.340 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022210074, 2024-09-12T00:05:49.340 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:49.340 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:49.340 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.341 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:49.341 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:49.341 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.341 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3760 2024-09-12T00:05:49.341 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.341 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:49.341 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.341 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:49.341 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.251207+0000", 2024-09-12T00:05:49.341 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.341 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.341 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.342 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:49.342 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.251207+0000", 2024-09-12T00:05:49.342 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.342 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.342 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.342 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:49.342 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.251210+0000", 2024-09-12T00:05:49.342 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1130000000000001e-06 2024-09-12T00:05:49.342 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.342 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.342 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:49.342 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.256588+0000", 2024-09-12T00:05:49.342 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005378201 2024-09-12T00:05:49.342 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.342 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.343 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:49.343 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.256622+0000", 2024-09-12T00:05:49.343 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3246e-05 2024-09-12T00:05:49.343 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.343 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.343 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.343 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.256642+0000", 2024-09-12T00:05:49.343 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0786000000000001e-05 2024-09-12T00:05:49.343 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.343 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.343 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:49.343 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.256767+0000", 2024-09-12T00:05:49.343 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012475799999999999 2024-09-12T00:05:49.343 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.343 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.344 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:49.344 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.257047+0000", 2024-09-12T00:05:49.344 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028016199999999998 2024-09-12T00:05:49.344 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.344 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.344 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:49.345 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.257276+0000", 2024-09-12T00:05:49.345 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022880900000000001 2024-09-12T00:05:49.345 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.345 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.345 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:49.345 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.272093+0000", 2024-09-12T00:05:49.345 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014816757999999999 2024-09-12T00:05:49.345 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.345 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.345 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.345 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.273101+0000", 2024-09-12T00:05:49.346 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0010080340000000001 2024-09-12T00:05:49.346 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.346 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.346 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:49.346 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.273283+0000", 2024-09-12T00:05:49.346 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000181993 2024-09-12T00:05:49.346 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.346 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.346 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:49.346 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.273417+0000", 2024-09-12T00:05:49.346 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013421400000000001 2024-09-12T00:05:49.346 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.346 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:49.346 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.346 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.347 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.347 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3793 3.21 3:8684dc70:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_410:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:49.347 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.629422+0000", 2024-09-12T00:05:49.347 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.5901720830000001, 2024-09-12T00:05:49.347 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027123878000000001, 2024-09-12T00:05:49.347 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:49.347 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:49.347 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.347 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:49.347 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:49.347 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.347 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3793 2024-09-12T00:05:49.347 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.347 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:49.348 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.348 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:49.348 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.629422+0000", 2024-09-12T00:05:49.348 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.348 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.348 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.348 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:49.348 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.629422+0000", 2024-09-12T00:05:49.348 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:49.348 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.348 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.348 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:49.348 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.629426+0000", 2024-09-12T00:05:49.349 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7129999999999999e-06 2024-09-12T00:05:49.349 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.349 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.349 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:49.349 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635537+0000", 2024-09-12T00:05:49.349 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061111220000000001 2024-09-12T00:05:49.349 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.349 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.349 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:49.349 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635578+0000", 2024-09-12T00:05:49.349 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1730000000000002e-05 2024-09-12T00:05:49.349 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.349 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.349 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.350 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635605+0000", 2024-09-12T00:05:49.350 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6792999999999999e-05 2024-09-12T00:05:49.350 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.350 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.350 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:49.350 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635747+0000", 2024-09-12T00:05:49.350 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014160999999999999 2024-09-12T00:05:49.350 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.350 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.350 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:49.350 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635998+0000", 2024-09-12T00:05:49.350 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025098600000000003 2024-09-12T00:05:49.350 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.350 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.350 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:49.351 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.636254+0000", 2024-09-12T00:05:49.351 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025597 2024-09-12T00:05:49.351 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.351 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.351 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:49.351 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.653522+0000", 2024-09-12T00:05:49.351 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017268229999999999 2024-09-12T00:05:49.351 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.351 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.351 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.351 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.656375+0000", 2024-09-12T00:05:49.351 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0028530930000000001 2024-09-12T00:05:49.351 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.351 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.351 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:49.352 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.656471+0000", 2024-09-12T00:05:49.352 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5904999999999997e-05 2024-09-12T00:05:49.352 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:49.352 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:49.352 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:49.352 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.656546+0000", 2024-09-12T00:05:49.352 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4726000000000002e-05 2024-09-12T00:05:49.352 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.352 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:49.352 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.352 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:49.352 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:49.352 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:49.354 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:05:49.354 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:49.356+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:49.455 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:49.456+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:49.490 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:49.491 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:49.491 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:05:49.491 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:49.505 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:05:49.593 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:49.596+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:49.656 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:49.656+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:49.677 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:49.677 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:49.677 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:05:49.677 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:05:49.677 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:49.692 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:05:49.777 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:49.780+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:49.858 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:49.860+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:49.870 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:49.870 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:05:49.871 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:05:49.871 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:05:49.871 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.871 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:05:49.871 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:05:49.871 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 138.53981307500001, 2024-09-12T00:05:49.871 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.027441031000000001, 2024-09-12T00:05:49.871 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:49.871 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:49.871 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.871 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:49.871 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:49.871 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.872 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:05:49.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.872 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:49.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.872 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:49.872 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:05:49.872 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.872 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:49.872 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:05:49.872 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.873 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:49.873 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330357+0000", 2024-09-12T00:05:49.873 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2339999999999996e-06 2024-09-12T00:05:49.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.873 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.873 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:49.873 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330381+0000", 2024-09-12T00:05:49.873 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4626000000000001e-05 2024-09-12T00:05:49.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.873 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.873 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:49.873 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330417+0000", 2024-09-12T00:05:49.873 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5886000000000002e-05 2024-09-12T00:05:49.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.874 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.874 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.874 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330442+0000", 2024-09-12T00:05:49.874 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4522999999999999e-05 2024-09-12T00:05:49.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.874 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.874 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:49.874 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335485+0000", 2024-09-12T00:05:49.874 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050432589999999996 2024-09-12T00:05:49.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.874 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.874 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:05:49.874 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335507+0000", 2024-09-12T00:05:49.874 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2013000000000001e-05 2024-09-12T00:05:49.875 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.875 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.875 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:49.875 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.351747+0000", 2024-09-12T00:05:49.875 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016240451999999999 2024-09-12T00:05:49.875 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.875 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.875 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:49.875 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352062+0000", 2024-09-12T00:05:49.875 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031433399999999999 2024-09-12T00:05:49.875 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.876 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:49.876 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352378+0000", 2024-09-12T00:05:49.876 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031586400000000001 2024-09-12T00:05:49.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.876 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:49.876 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.355074+0000", 2024-09-12T00:05:49.876 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026962919999999999 2024-09-12T00:05:49.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.876 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.877 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357537+0000", 2024-09-12T00:05:49.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024634689999999998 2024-09-12T00:05:49.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.877 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.877 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:49.877 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357680+0000", 2024-09-12T00:05:49.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014314899999999999 2024-09-12T00:05:49.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.877 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.878 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:49.878 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357793+0000", 2024-09-12T00:05:49.878 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011293 2024-09-12T00:05:49.878 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.878 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:49.878 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.878 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.878 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.878 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2748 3.3b 3:df6d92a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:49.878 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:05:49.878 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 61.771325214999997, 2024-09-12T00:05:49.879 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.023574735999999999, 2024-09-12T00:05:49.879 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:49.879 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:49.879 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.879 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:49.879 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:49.879 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.879 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2748 2024-09-12T00:05:49.879 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.879 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:49.879 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.879 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:49.880 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:05:49.880 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.880 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.880 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.880 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:49.880 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:05:49.880 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.880 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.880 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.880 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:49.880 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098844+0000", 2024-09-12T00:05:49.880 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1570000000000002e-06 2024-09-12T00:05:49.881 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.881 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.881 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:49.881 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100354+0000", 2024-09-12T00:05:49.881 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001509544 2024-09-12T00:05:49.881 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.881 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.881 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:49.881 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100383+0000", 2024-09-12T00:05:49.881 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9386e-05 2024-09-12T00:05:49.881 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.881 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.881 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.881 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100399+0000", 2024-09-12T00:05:49.882 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5883999999999999e-05 2024-09-12T00:05:49.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.882 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.882 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:49.882 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100507+0000", 2024-09-12T00:05:49.882 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010822 2024-09-12T00:05:49.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.882 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.882 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:49.882 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100704+0000", 2024-09-12T00:05:49.882 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019658499999999999 2024-09-12T00:05:49.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.882 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.883 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:49.883 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100901+0000", 2024-09-12T00:05:49.883 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000196505 2024-09-12T00:05:49.883 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.884 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.884 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:49.884 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112178+0000", 2024-09-12T00:05:49.884 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011277718000000001 2024-09-12T00:05:49.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.884 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.884 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.884 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122285+0000", 2024-09-12T00:05:49.884 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010106327 2024-09-12T00:05:49.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.884 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.884 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:49.885 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122358+0000", 2024-09-12T00:05:49.885 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3640999999999995e-05 2024-09-12T00:05:49.885 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.885 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.885 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:49.885 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122415+0000", 2024-09-12T00:05:49.885 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6768999999999998e-05 2024-09-12T00:05:49.885 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.885 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:49.885 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.885 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.886 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.886 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2964 3.24 e75/23 3:26c83ec0:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_3:head v 75'6, mlcod=63'4)", 2024-09-12T00:05:49.886 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:05:49.886 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 29.857904194, 2024-09-12T00:05:49.886 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022426814, 2024-09-12T00:05:49.886 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:49.886 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:49.886 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.886 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:49.886 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.886 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:49.887 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:05:49.887 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.887 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.887 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.887 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:49.887 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:05:49.887 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.887 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.887 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.887 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:49.887 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012263+0000", 2024-09-12T00:05:49.888 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.091e-06 2024-09-12T00:05:49.888 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.888 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.888 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:49.888 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018390+0000", 2024-09-12T00:05:49.888 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061264600000000002 2024-09-12T00:05:49.888 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.888 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.888 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:49.888 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018419+0000", 2024-09-12T00:05:49.889 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8979000000000002e-05 2024-09-12T00:05:49.889 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.889 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.889 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.889 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018434+0000", 2024-09-12T00:05:49.889 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4781e-05 2024-09-12T00:05:49.889 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.889 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.889 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:49.889 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018528+0000", 2024-09-12T00:05:49.889 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.4333000000000006e-05 2024-09-12T00:05:49.890 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.890 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.890 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:49.890 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018559+0000", 2024-09-12T00:05:49.890 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1557999999999998e-05 2024-09-12T00:05:49.890 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.890 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.890 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:49.890 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.034615+0000", 2024-09-12T00:05:49.890 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016055834000000001 2024-09-12T00:05:49.890 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.890 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.891 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:49.891 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.034688+0000", 2024-09-12T00:05:49.891 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2778e-05 2024-09-12T00:05:49.891 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.891 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:49.891 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.891 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.891 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.891 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2965 3.e e75/23 3:70fff61e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_4:head v 75'5, mlcod=63'3)", 2024-09-12T00:05:49.891 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:05:49.891 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 29.850393972999999, 2024-09-12T00:05:49.891 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021839210000000001, 2024-09-12T00:05:49.892 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:49.892 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:49.892 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.892 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:49.892 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.892 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:49.892 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:05:49.892 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.892 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.892 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.893 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:49.893 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:05:49.893 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.893 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.893 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.893 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:49.893 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019773+0000", 2024-09-12T00:05:49.893 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4839999999999999e-06 2024-09-12T00:05:49.893 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.893 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.893 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:49.893 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021570+0000", 2024-09-12T00:05:49.894 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017965570000000001 2024-09-12T00:05:49.894 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.894 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.894 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:49.894 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021587+0000", 2024-09-12T00:05:49.894 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7938e-05 2024-09-12T00:05:49.894 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.894 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.894 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.894 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021598+0000", 2024-09-12T00:05:49.894 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0553e-05 2024-09-12T00:05:49.894 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.894 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.895 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:49.895 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021676+0000", 2024-09-12T00:05:49.895 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8034000000000005e-05 2024-09-12T00:05:49.895 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.895 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.895 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:49.895 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021706+0000", 2024-09-12T00:05:49.895 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9915000000000001e-05 2024-09-12T00:05:49.895 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.895 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.895 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:49.895 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.041519+0000", 2024-09-12T00:05:49.895 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019813171000000001 2024-09-12T00:05:49.895 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.896 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.896 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:49.896 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.041611+0000", 2024-09-12T00:05:49.896 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1558000000000007e-05 2024-09-12T00:05:49.896 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.896 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:49.896 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.896 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.896 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.896 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3004 3.36 3:6cc4f27f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:49.896 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:05:49.896 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 29.431994776, 2024-09-12T00:05:49.896 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.042951743000000001, 2024-09-12T00:05:49.896 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:49.897 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:49.897 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.897 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:49.897 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:49.897 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.897 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3004 2024-09-12T00:05:49.897 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.897 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:49.897 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.897 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:49.897 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:05:49.897 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.897 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.897 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.897 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:49.898 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:05:49.898 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.898 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.898 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.898 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:49.898 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438175+0000", 2024-09-12T00:05:49.898 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1640000000000003e-06 2024-09-12T00:05:49.898 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.898 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.898 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:49.898 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439732+0000", 2024-09-12T00:05:49.898 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015574510000000001 2024-09-12T00:05:49.898 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.898 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.899 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:49.899 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439758+0000", 2024-09-12T00:05:49.899 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6074000000000001e-05 2024-09-12T00:05:49.899 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.899 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.899 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.899 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439768+0000", 2024-09-12T00:05:49.899 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8770000000000005e-06 2024-09-12T00:05:49.899 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.899 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.899 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:49.900 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439874+0000", 2024-09-12T00:05:49.900 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105583 2024-09-12T00:05:49.900 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.900 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.900 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:49.900 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.440078+0000", 2024-09-12T00:05:49.900 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020388200000000001 2024-09-12T00:05:49.900 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.900 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.900 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:49.900 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.440251+0000", 2024-09-12T00:05:49.900 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017339100000000001 2024-09-12T00:05:49.900 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.901 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.901 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:49.901 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.459982+0000", 2024-09-12T00:05:49.901 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01973099 2024-09-12T00:05:49.901 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.901 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.901 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.901 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.480958+0000", 2024-09-12T00:05:49.901 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020975730000000001 2024-09-12T00:05:49.901 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.901 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.901 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:49.901 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481034+0000", 2024-09-12T00:05:49.901 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6224999999999996e-05 2024-09-12T00:05:49.902 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.902 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.902 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:49.902 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481122+0000", 2024-09-12T00:05:49.902 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8375999999999995e-05 2024-09-12T00:05:49.902 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.902 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:49.902 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.902 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.902 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.902 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3005 3.35 3:ae3b5a36:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:49.902 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:05:49.902 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 29.422741091999999, 2024-09-12T00:05:49.902 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.028828275, 2024-09-12T00:05:49.903 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:49.903 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:49.903 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.903 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:49.903 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:49.903 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.903 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3005 2024-09-12T00:05:49.903 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.903 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:49.903 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.903 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:49.903 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:05:49.903 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.904 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.904 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.904 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:49.904 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:05:49.904 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.904 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.904 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.904 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:49.904 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447427+0000", 2024-09-12T00:05:49.904 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.864e-06 2024-09-12T00:05:49.904 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.904 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.904 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:49.905 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449003+0000", 2024-09-12T00:05:49.905 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001575405 2024-09-12T00:05:49.905 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.905 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.905 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:49.905 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449030+0000", 2024-09-12T00:05:49.905 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7189999999999999e-05 2024-09-12T00:05:49.905 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.905 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.905 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.905 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449042+0000", 2024-09-12T00:05:49.905 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2038999999999999e-05 2024-09-12T00:05:49.906 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.906 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.906 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:49.906 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449111+0000", 2024-09-12T00:05:49.906 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9521000000000001e-05 2024-09-12T00:05:49.906 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.906 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.906 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:49.906 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449218+0000", 2024-09-12T00:05:49.906 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010675600000000001 2024-09-12T00:05:49.906 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.906 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.907 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:49.907 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449330+0000", 2024-09-12T00:05:49.907 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000111809 2024-09-12T00:05:49.907 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.907 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.907 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.907 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.469844+0000", 2024-09-12T00:05:49.907 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020514277000000001 2024-09-12T00:05:49.907 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.907 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.907 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:49.908 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.475983+0000", 2024-09-12T00:05:49.908 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061392540000000002 2024-09-12T00:05:49.908 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.908 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.908 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:49.908 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.476113+0000", 2024-09-12T00:05:49.908 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000129713 2024-09-12T00:05:49.908 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.908 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.908 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:49.908 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.476253+0000", 2024-09-12T00:05:49.908 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013944700000000001 2024-09-12T00:05:49.909 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.909 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:49.909 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.909 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.909 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.909 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3006 3.3 3:c183ca95:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:49.909 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:05:49.909 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 29.413214521, 2024-09-12T00:05:49.909 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.024661756, 2024-09-12T00:05:49.909 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:49.909 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:49.910 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.910 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:49.910 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:49.910 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.910 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3006 2024-09-12T00:05:49.910 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.910 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:49.910 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.910 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:49.910 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:05:49.910 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.911 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.911 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.911 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:49.911 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:05:49.911 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.911 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.911 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.911 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:49.911 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456954+0000", 2024-09-12T00:05:49.911 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7070000000000001e-06 2024-09-12T00:05:49.911 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.911 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.912 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:49.912 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458684+0000", 2024-09-12T00:05:49.912 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017305479999999999 2024-09-12T00:05:49.912 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.912 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.912 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:49.912 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458709+0000", 2024-09-12T00:05:49.912 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4780999999999999e-05 2024-09-12T00:05:49.912 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.912 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.912 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.913 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458719+0000", 2024-09-12T00:05:49.913 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0202e-05 2024-09-12T00:05:49.913 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.913 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.913 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:49.913 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458800+0000", 2024-09-12T00:05:49.913 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0893e-05 2024-09-12T00:05:49.913 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.913 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.913 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:49.913 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458990+0000", 2024-09-12T00:05:49.914 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018986400000000001 2024-09-12T00:05:49.914 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.914 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.914 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:49.914 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.459171+0000", 2024-09-12T00:05:49.914 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018135499999999999 2024-09-12T00:05:49.914 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.914 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.914 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.914 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.478356+0000", 2024-09-12T00:05:49.914 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019185153 2024-09-12T00:05:49.914 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.914 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.915 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:49.915 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481411+0000", 2024-09-12T00:05:49.915 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030546190000000002 2024-09-12T00:05:49.915 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.915 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.915 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:49.915 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481511+0000", 2024-09-12T00:05:49.915 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.9763e-05 2024-09-12T00:05:49.915 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.915 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.915 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:49.916 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481613+0000", 2024-09-12T00:05:49.916 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101871 2024-09-12T00:05:49.916 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.916 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:49.916 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.916 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.916 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.916 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3037 3.39 3:9eefb4c1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:49.916 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:05:49.916 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 29.054947114000001, 2024-09-12T00:05:49.916 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020855543000000001, 2024-09-12T00:05:49.916 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:49.917 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:49.917 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.917 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:49.917 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:49.917 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.917 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3037 2024-09-12T00:05:49.917 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.917 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:49.917 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.917 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:49.917 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:05:49.917 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.918 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.918 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.918 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:49.918 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:05:49.918 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.918 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.918 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.918 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:49.918 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815221+0000", 2024-09-12T00:05:49.918 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1540000000000002e-06 2024-09-12T00:05:49.918 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.919 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.919 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:49.919 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817594+0000", 2024-09-12T00:05:49.919 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023728880000000001 2024-09-12T00:05:49.919 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.919 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.919 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:49.919 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817618+0000", 2024-09-12T00:05:49.919 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3635e-05 2024-09-12T00:05:49.919 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.919 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.919 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.920 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817633+0000", 2024-09-12T00:05:49.920 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4559000000000001e-05 2024-09-12T00:05:49.920 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.920 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.920 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:49.920 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817734+0000", 2024-09-12T00:05:49.920 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101729 2024-09-12T00:05:49.920 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.920 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.920 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:49.920 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817939+0000", 2024-09-12T00:05:49.920 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020489299999999999 2024-09-12T00:05:49.921 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.921 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.921 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:49.921 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.818113+0000", 2024-09-12T00:05:49.921 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000173413 2024-09-12T00:05:49.921 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.921 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.921 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:49.921 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.825676+0000", 2024-09-12T00:05:49.921 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075635260000000001 2024-09-12T00:05:49.921 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.921 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.922 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.922 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.835921+0000", 2024-09-12T00:05:49.922 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010244932999999999 2024-09-12T00:05:49.922 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.922 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.922 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:49.922 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.836006+0000", 2024-09-12T00:05:49.922 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5427999999999996e-05 2024-09-12T00:05:49.922 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.922 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.922 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:49.922 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.836074+0000", 2024-09-12T00:05:49.922 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7385000000000006e-05 2024-09-12T00:05:49.922 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.923 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:49.923 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.923 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.923 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.923 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3375 3.15 3:ab335e39:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:49.923 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.646143+0000", 2024-09-12T00:05:49.923 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.2240226710000002, 2024-09-12T00:05:49.923 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026933417000000001, 2024-09-12T00:05:49.923 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:49.923 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:49.923 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.923 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:49.923 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:49.923 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.924 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3375 2024-09-12T00:05:49.924 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.924 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:49.924 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.924 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:49.924 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.646143+0000", 2024-09-12T00:05:49.924 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.924 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.924 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.924 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:49.924 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.646143+0000", 2024-09-12T00:05:49.924 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.924 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.924 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.925 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:49.925 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.646146+0000", 2024-09-12T00:05:49.925 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.19e-06 2024-09-12T00:05:49.925 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.925 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.925 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:49.925 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648608+0000", 2024-09-12T00:05:49.925 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024615470000000001 2024-09-12T00:05:49.925 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.925 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.925 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:49.925 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648640+0000", 2024-09-12T00:05:49.925 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2342999999999998e-05 2024-09-12T00:05:49.925 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.925 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.926 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.926 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648655+0000", 2024-09-12T00:05:49.926 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5034e-05 2024-09-12T00:05:49.926 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.926 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.926 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:49.926 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648746+0000", 2024-09-12T00:05:49.926 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1529999999999999e-05 2024-09-12T00:05:49.926 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.926 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.926 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:49.926 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648938+0000", 2024-09-12T00:05:49.926 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191819 2024-09-12T00:05:49.926 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.927 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.927 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:49.927 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.649102+0000", 2024-09-12T00:05:49.927 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000164103 2024-09-12T00:05:49.927 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.927 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.927 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:49.927 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.658869+0000", 2024-09-12T00:05:49.927 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0097663530000000002 2024-09-12T00:05:49.927 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.927 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.927 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.927 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.672958+0000", 2024-09-12T00:05:49.927 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014089295 2024-09-12T00:05:49.927 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.928 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.928 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:49.928 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.673024+0000", 2024-09-12T00:05:49.928 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5834999999999996e-05 2024-09-12T00:05:49.928 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.928 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.928 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:49.928 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.673076+0000", 2024-09-12T00:05:49.928 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2367999999999997e-05 2024-09-12T00:05:49.928 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.928 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:49.928 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.928 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.928 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.929 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3392 3.1b e82/23 3:d9b2c983:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_19:head v 82'11, mlcod=76'9)", 2024-09-12T00:05:49.929 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.841020+0000", 2024-09-12T00:05:49.929 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.0291455999999997, 2024-09-12T00:05:49.929 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022540108999999999, 2024-09-12T00:05:49.929 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:49.929 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:49.929 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.929 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:49.929 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.929 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:49.929 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.841020+0000", 2024-09-12T00:05:49.929 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.929 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.929 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.930 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:49.930 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.841020+0000", 2024-09-12T00:05:49.930 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.930 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.930 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.930 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:49.930 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.841022+0000", 2024-09-12T00:05:49.930 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4339999999999999e-06 2024-09-12T00:05:49.930 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.930 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.930 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:49.930 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847015+0000", 2024-09-12T00:05:49.930 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.005993104 2024-09-12T00:05:49.930 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.931 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.931 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:49.931 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847030+0000", 2024-09-12T00:05:49.931 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4595e-05 2024-09-12T00:05:49.931 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.931 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.931 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.931 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847041+0000", 2024-09-12T00:05:49.931 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1124000000000001e-05 2024-09-12T00:05:49.931 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.931 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.932 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:49.932 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847334+0000", 2024-09-12T00:05:49.932 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000292854 2024-09-12T00:05:49.932 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.932 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.932 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:49.932 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847371+0000", 2024-09-12T00:05:49.932 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7336000000000003e-05 2024-09-12T00:05:49.932 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.932 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.932 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:49.933 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.863502+0000", 2024-09-12T00:05:49.933 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016130314999999999 2024-09-12T00:05:49.933 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.933 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.933 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:49.933 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.863560+0000", 2024-09-12T00:05:49.933 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8347000000000002e-05 2024-09-12T00:05:49.933 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.933 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:49.933 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.933 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.933 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.933 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3399 3.c 3:33260d65:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:49.934 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.912770+0000", 2024-09-12T00:05:49.934 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 8.9573954550000003, 2024-09-12T00:05:49.934 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021761494999999999, 2024-09-12T00:05:49.934 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:49.934 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:49.934 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.934 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:49.934 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:49.934 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.934 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3399 2024-09-12T00:05:49.934 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.935 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:49.935 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.935 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:49.935 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.912770+0000", 2024-09-12T00:05:49.935 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.935 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.935 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.935 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:49.935 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.912770+0000", 2024-09-12T00:05:49.935 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.935 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.935 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.936 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:49.936 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.912773+0000", 2024-09-12T00:05:49.936 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.252e-06 2024-09-12T00:05:49.936 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.936 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.936 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:49.936 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915156+0000", 2024-09-12T00:05:49.936 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023823109999999998 2024-09-12T00:05:49.936 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.936 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.936 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:49.937 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915244+0000", 2024-09-12T00:05:49.937 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8926999999999997e-05 2024-09-12T00:05:49.937 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.937 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.937 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.937 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915265+0000", 2024-09-12T00:05:49.937 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0613999999999999e-05 2024-09-12T00:05:49.937 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.937 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.937 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:49.937 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915361+0000", 2024-09-12T00:05:49.937 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5542000000000001e-05 2024-09-12T00:05:49.938 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.938 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.938 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:49.938 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915538+0000", 2024-09-12T00:05:49.938 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017762400000000001 2024-09-12T00:05:49.938 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.938 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.938 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:49.938 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915710+0000", 2024-09-12T00:05:49.938 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017170900000000001 2024-09-12T00:05:49.938 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.939 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.939 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:49.939 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.933564+0000", 2024-09-12T00:05:49.939 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017854080000000001 2024-09-12T00:05:49.939 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.939 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.939 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.939 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.934450+0000", 2024-09-12T00:05:49.939 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00088595700000000004 2024-09-12T00:05:49.939 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.939 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.940 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:49.940 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.934490+0000", 2024-09-12T00:05:49.940 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0110000000000001e-05 2024-09-12T00:05:49.940 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.940 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.940 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:49.940 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.934531+0000", 2024-09-12T00:05:49.940 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1369000000000003e-05 2024-09-12T00:05:49.940 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.940 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:49.940 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.940 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.941 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.941 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3678 3.15 3:a83db90f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_295:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:49.941 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:43.938089+0000", 2024-09-12T00:05:49.941 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.9320763230000004, 2024-09-12T00:05:49.941 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021578831999999999, 2024-09-12T00:05:49.941 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:49.941 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:49.941 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.941 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:49.941 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:49.941 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.941 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3678 2024-09-12T00:05:49.941 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.941 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:49.942 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.942 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:49.942 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.938089+0000", 2024-09-12T00:05:49.942 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.942 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.942 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:49.942 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.938089+0000", 2024-09-12T00:05:49.942 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.942 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.943 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:49.943 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.938094+0000", 2024-09-12T00:05:49.943 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0719999999999999e-06 2024-09-12T00:05:49.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.943 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.943 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:49.943 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940370+0000", 2024-09-12T00:05:49.943 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022759159999999998 2024-09-12T00:05:49.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.943 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.943 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:49.943 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940401+0000", 2024-09-12T00:05:49.944 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1226999999999998e-05 2024-09-12T00:05:49.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.944 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.944 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.944 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940417+0000", 2024-09-12T00:05:49.944 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5603e-05 2024-09-12T00:05:49.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.944 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.944 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:49.944 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940499+0000", 2024-09-12T00:05:49.944 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1568000000000002e-05 2024-09-12T00:05:49.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.945 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.945 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:49.945 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940703+0000", 2024-09-12T00:05:49.945 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000203995 2024-09-12T00:05:49.945 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.945 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.945 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:49.945 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940947+0000", 2024-09-12T00:05:49.945 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024444799999999997 2024-09-12T00:05:49.945 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.945 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.945 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:49.945 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.950088+0000", 2024-09-12T00:05:49.946 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091408710000000001 2024-09-12T00:05:49.946 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.946 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.946 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.946 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.959534+0000", 2024-09-12T00:05:49.946 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0094463979999999999 2024-09-12T00:05:49.946 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.946 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.946 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:49.946 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.959594+0000", 2024-09-12T00:05:49.946 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0145000000000001e-05 2024-09-12T00:05:49.946 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.947 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.947 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:49.947 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.959668+0000", 2024-09-12T00:05:49.947 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3589000000000003e-05 2024-09-12T00:05:49.947 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.947 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:49.947 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.947 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.948 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.948 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3711 3.c 3:31bc51b2:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_328:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:49.948 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.647001+0000", 2024-09-12T00:05:49.948 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 5.2231641700000004, 2024-09-12T00:05:49.948 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021286705, 2024-09-12T00:05:49.948 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:49.948 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:49.948 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.948 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:49.948 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:49.948 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.949 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3711 2024-09-12T00:05:49.949 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.949 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:49.949 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.949 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:49.949 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.647001+0000", 2024-09-12T00:05:49.949 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.949 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.949 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.949 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:49.949 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.647001+0000", 2024-09-12T00:05:49.949 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.950 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.950 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.950 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:49.950 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.647006+0000", 2024-09-12T00:05:49.950 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1900000000000003e-06 2024-09-12T00:05:49.950 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.950 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.950 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:49.950 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.651810+0000", 2024-09-12T00:05:49.950 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048032159999999999 2024-09-12T00:05:49.950 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.950 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.950 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:49.950 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.651857+0000", 2024-09-12T00:05:49.951 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7416000000000001e-05 2024-09-12T00:05:49.951 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.951 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.951 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.951 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.651876+0000", 2024-09-12T00:05:49.951 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9066999999999999e-05 2024-09-12T00:05:49.951 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.951 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.951 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:49.951 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.652058+0000", 2024-09-12T00:05:49.951 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018199500000000001 2024-09-12T00:05:49.951 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.951 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.951 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:49.951 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.652476+0000", 2024-09-12T00:05:49.952 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00041738000000000002 2024-09-12T00:05:49.952 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.952 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.952 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:49.952 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.652917+0000", 2024-09-12T00:05:49.952 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00044171899999999998 2024-09-12T00:05:49.952 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.952 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.952 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:49.952 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.667867+0000", 2024-09-12T00:05:49.952 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014949558 2024-09-12T00:05:49.952 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.952 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.953 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.953 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.668181+0000", 2024-09-12T00:05:49.953 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000313777 2024-09-12T00:05:49.953 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.953 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.953 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:49.953 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.668241+0000", 2024-09-12T00:05:49.953 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0047999999999998e-05 2024-09-12T00:05:49.953 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.953 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.953 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:49.953 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.668288+0000", 2024-09-12T00:05:49.953 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7339000000000002e-05 2024-09-12T00:05:49.953 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.954 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:49.954 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.954 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.954 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.954 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3726 3.33 e83/23 3:cd6e0a10:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_343:head v 83'15, mlcod=83'13)", 2024-09-12T00:05:49.954 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.871373+0000", 2024-09-12T00:05:49.954 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.9987926309999997, 2024-09-12T00:05:49.954 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021131233999999999, 2024-09-12T00:05:49.954 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:49.954 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:49.954 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.954 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:49.954 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.954 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:49.954 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.871373+0000", 2024-09-12T00:05:49.955 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.955 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.955 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.955 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:49.955 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.871373+0000", 2024-09-12T00:05:49.955 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.955 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.955 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.955 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:49.955 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.871374+0000", 2024-09-12T00:05:49.955 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.505e-06 2024-09-12T00:05:49.955 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.955 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.955 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:49.956 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875356+0000", 2024-09-12T00:05:49.956 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039812060000000002 2024-09-12T00:05:49.956 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.956 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.956 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:49.956 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875381+0000", 2024-09-12T00:05:49.956 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5259999999999999e-05 2024-09-12T00:05:49.956 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.956 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.956 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.956 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875392+0000", 2024-09-12T00:05:49.956 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1211e-05 2024-09-12T00:05:49.956 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.956 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.957 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:49.957 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875472+0000", 2024-09-12T00:05:49.957 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9505999999999994e-05 2024-09-12T00:05:49.957 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.957 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.957 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:49.957 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875490+0000", 2024-09-12T00:05:49.957 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8819000000000001e-05 2024-09-12T00:05:49.957 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.957 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.957 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:49.957 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.892428+0000", 2024-09-12T00:05:49.957 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016937885 2024-09-12T00:05:49.957 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.958 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.958 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:49.958 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.892504+0000", 2024-09-12T00:05:49.958 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5841999999999997e-05 2024-09-12T00:05:49.958 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.958 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:49.958 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.958 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.958 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.958 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3727 3.35 3:ad6b6c99:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_344:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:49.958 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.876261+0000", 2024-09-12T00:05:49.958 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.9939048140000004, 2024-09-12T00:05:49.958 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.029109105, 2024-09-12T00:05:49.958 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:49.958 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:49.959 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.959 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:49.959 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:49.959 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.959 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3727 2024-09-12T00:05:49.959 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.959 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:49.959 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.959 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:49.959 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.876261+0000", 2024-09-12T00:05:49.959 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.959 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.959 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.959 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:49.960 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.876261+0000", 2024-09-12T00:05:49.960 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.960 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.960 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.960 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:49.960 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.876264+0000", 2024-09-12T00:05:49.960 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.388e-06 2024-09-12T00:05:49.960 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.960 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.960 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:49.960 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878449+0000", 2024-09-12T00:05:49.960 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021847360000000001 2024-09-12T00:05:49.960 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.961 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.961 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:49.961 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878470+0000", 2024-09-12T00:05:49.961 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0792e-05 2024-09-12T00:05:49.961 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.961 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.961 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.961 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878481+0000", 2024-09-12T00:05:49.961 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1421e-05 2024-09-12T00:05:49.961 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.962 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.962 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:49.962 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878572+0000", 2024-09-12T00:05:49.962 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0882000000000002e-05 2024-09-12T00:05:49.962 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.962 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.962 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:49.962 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878763+0000", 2024-09-12T00:05:49.962 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191218 2024-09-12T00:05:49.962 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.962 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.962 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:49.963 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878938+0000", 2024-09-12T00:05:49.963 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017507300000000001 2024-09-12T00:05:49.963 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.963 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.963 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:49.963 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.900618+0000", 2024-09-12T00:05:49.963 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021679706 2024-09-12T00:05:49.963 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.963 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.963 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.963 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.905243+0000", 2024-09-12T00:05:49.964 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046246869999999997 2024-09-12T00:05:49.964 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.964 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.964 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:49.964 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.905314+0000", 2024-09-12T00:05:49.964 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1797000000000004e-05 2024-09-12T00:05:49.964 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.964 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.964 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:49.964 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.905370+0000", 2024-09-12T00:05:49.964 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5405000000000002e-05 2024-09-12T00:05:49.964 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.965 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:49.965 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.965 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.965 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.965 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3735 3.3f 3:fd0f007c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_352:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:49.965 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.971621+0000", 2024-09-12T00:05:49.965 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.898543987, 2024-09-12T00:05:49.965 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021631419999999998, 2024-09-12T00:05:49.965 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:49.965 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:49.965 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.966 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:49.966 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:49.966 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.966 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3735 2024-09-12T00:05:49.966 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.966 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:49.966 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.966 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:49.966 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.971621+0000", 2024-09-12T00:05:49.966 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.966 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.966 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.967 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:49.967 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.971621+0000", 2024-09-12T00:05:49.967 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.967 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.967 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.967 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:49.967 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.971626+0000", 2024-09-12T00:05:49.967 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.313e-06 2024-09-12T00:05:49.967 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.967 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.967 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:49.967 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973760+0000", 2024-09-12T00:05:49.968 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021346780000000001 2024-09-12T00:05:49.968 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.968 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.968 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:49.968 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973788+0000", 2024-09-12T00:05:49.968 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7327000000000001e-05 2024-09-12T00:05:49.968 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.968 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.968 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.968 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973799+0000", 2024-09-12T00:05:49.968 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1379999999999999e-05 2024-09-12T00:05:49.968 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.969 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.969 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:49.969 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973904+0000", 2024-09-12T00:05:49.969 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105071 2024-09-12T00:05:49.969 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.969 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.969 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:49.969 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.974119+0000", 2024-09-12T00:05:49.969 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021477399999999999 2024-09-12T00:05:49.969 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.970 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.970 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:49.970 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.974313+0000", 2024-09-12T00:05:49.970 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019439300000000001 2024-09-12T00:05:49.970 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.970 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.970 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:49.970 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.985849+0000", 2024-09-12T00:05:49.970 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011535915000000001 2024-09-12T00:05:49.970 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.970 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.970 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.971 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.993125+0000", 2024-09-12T00:05:49.971 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0072761299999999996 2024-09-12T00:05:49.971 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.971 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.971 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:49.971 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.993201+0000", 2024-09-12T00:05:49.971 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5098000000000005e-05 2024-09-12T00:05:49.971 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.971 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.971 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:49.971 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.993253+0000", 2024-09-12T00:05:49.971 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2340999999999999e-05 2024-09-12T00:05:49.972 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.972 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:49.972 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.972 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.972 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.972 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3756 3.15 3:aa8e955f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_373:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:49.972 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.207558+0000", 2024-09-12T00:05:49.972 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.6626071700000002, 2024-09-12T00:05:49.972 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021266769000000001, 2024-09-12T00:05:49.972 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:49.972 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:49.973 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.973 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:49.973 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:49.973 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.973 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3756 2024-09-12T00:05:49.973 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.973 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:49.973 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.973 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:49.973 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.207558+0000", 2024-09-12T00:05:49.973 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.973 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.973 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.974 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:49.974 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.207558+0000", 2024-09-12T00:05:49.974 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.974 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.974 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.974 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:49.974 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.207561+0000", 2024-09-12T00:05:49.974 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9450000000000002e-06 2024-09-12T00:05:49.974 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.974 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.974 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:49.974 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209465+0000", 2024-09-12T00:05:49.975 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019040089999999999 2024-09-12T00:05:49.975 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.975 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.975 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:49.975 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209493+0000", 2024-09-12T00:05:49.975 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7645999999999999e-05 2024-09-12T00:05:49.975 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.975 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.975 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.975 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209507+0000", 2024-09-12T00:05:49.975 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4333e-05 2024-09-12T00:05:49.976 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.976 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.976 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:49.976 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209609+0000", 2024-09-12T00:05:49.976 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101543 2024-09-12T00:05:49.976 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.976 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.976 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:49.976 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209822+0000", 2024-09-12T00:05:49.976 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021320000000000001 2024-09-12T00:05:49.976 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.976 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.977 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:49.977 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.210009+0000", 2024-09-12T00:05:49.977 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000187228 2024-09-12T00:05:49.977 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.977 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.977 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:49.977 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.219744+0000", 2024-09-12T00:05:49.977 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0097345079999999994 2024-09-12T00:05:49.977 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.977 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.977 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.977 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.228686+0000", 2024-09-12T00:05:49.978 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0089426200000000001 2024-09-12T00:05:49.978 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.978 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.978 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:49.978 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.228768+0000", 2024-09-12T00:05:49.978 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2112000000000003e-05 2024-09-12T00:05:49.978 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.978 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.978 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:49.978 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.228825+0000", 2024-09-12T00:05:49.978 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6625000000000001e-05 2024-09-12T00:05:49.978 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.978 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:49.979 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.979 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.979 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.979 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3778 3.c 3:33bb2076:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_395:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:49.979 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.451174+0000", 2024-09-12T00:05:49.979 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.4189909949999997, 2024-09-12T00:05:49.979 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021109749000000001, 2024-09-12T00:05:49.979 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:49.979 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:49.979 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.979 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:49.979 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:49.979 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.979 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3778 2024-09-12T00:05:49.979 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.980 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:49.980 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.980 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:49.980 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.451174+0000", 2024-09-12T00:05:49.980 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.980 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.980 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.980 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:49.980 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.451174+0000", 2024-09-12T00:05:49.980 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.980 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.980 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.980 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:49.980 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.451178+0000", 2024-09-12T00:05:49.981 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6289999999999999e-06 2024-09-12T00:05:49.981 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.981 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.981 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:49.981 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.453638+0000", 2024-09-12T00:05:49.981 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024596470000000001 2024-09-12T00:05:49.981 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.981 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.981 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:49.981 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.453658+0000", 2024-09-12T00:05:49.981 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0713e-05 2024-09-12T00:05:49.981 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.981 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.981 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.982 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.453673+0000", 2024-09-12T00:05:49.982 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4174e-05 2024-09-12T00:05:49.982 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.982 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.982 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:49.982 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.453804+0000", 2024-09-12T00:05:49.982 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013095000000000001 2024-09-12T00:05:49.982 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.982 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.982 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:49.982 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.454022+0000", 2024-09-12T00:05:49.982 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021806899999999999 2024-09-12T00:05:49.982 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.982 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.982 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:49.983 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.454175+0000", 2024-09-12T00:05:49.983 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015374099999999999 2024-09-12T00:05:49.983 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.983 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.983 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:49.983 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.462290+0000", 2024-09-12T00:05:49.983 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0081144359999999992 2024-09-12T00:05:49.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.984 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.984 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.984 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.472165+0000", 2024-09-12T00:05:49.984 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0098751140000000008 2024-09-12T00:05:49.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.984 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.984 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:49.984 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.472235+0000", 2024-09-12T00:05:49.984 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9793000000000001e-05 2024-09-12T00:05:49.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.984 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.985 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:49.985 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.472284+0000", 2024-09-12T00:05:49.985 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9483e-05 2024-09-12T00:05:49.985 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.985 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:49.985 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.985 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.985 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.985 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3785 3.15 3:ab478e86:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_402:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:49.985 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.539840+0000", 2024-09-12T00:05:49.985 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.3303256599999997, 2024-09-12T00:05:49.985 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.023091957999999999, 2024-09-12T00:05:49.985 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:49.985 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:49.986 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.986 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:49.986 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:49.986 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.986 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3785 2024-09-12T00:05:49.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.986 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:49.986 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.986 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:49.986 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.539840+0000", 2024-09-12T00:05:49.986 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.986 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.986 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:49.986 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.539840+0000", 2024-09-12T00:05:49.987 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.987 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.987 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:49.987 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.539843+0000", 2024-09-12T00:05:49.987 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4410000000000002e-06 2024-09-12T00:05:49.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.987 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.987 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:49.987 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541660+0000", 2024-09-12T00:05:49.987 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0018169239999999999 2024-09-12T00:05:49.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.987 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.988 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:49.988 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541704+0000", 2024-09-12T00:05:49.988 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4072000000000001e-05 2024-09-12T00:05:49.988 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.988 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.988 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.988 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541726+0000", 2024-09-12T00:05:49.988 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1875e-05 2024-09-12T00:05:49.988 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.988 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.988 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:49.988 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541825+0000", 2024-09-12T00:05:49.989 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8500999999999998e-05 2024-09-12T00:05:49.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.989 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.989 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:49.989 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541997+0000", 2024-09-12T00:05:49.989 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000172781 2024-09-12T00:05:49.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.989 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.989 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:49.989 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.542177+0000", 2024-09-12T00:05:49.989 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018009699999999999 2024-09-12T00:05:49.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.989 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.990 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.990 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.558969+0000", 2024-09-12T00:05:49.990 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016791805999999999 2024-09-12T00:05:49.990 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.990 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.990 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:49.990 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.562789+0000", 2024-09-12T00:05:49.990 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003819308 2024-09-12T00:05:49.990 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.990 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.990 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:49.991 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.562869+0000", 2024-09-12T00:05:49.991 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0550999999999995e-05 2024-09-12T00:05:49.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.991 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.991 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:49.991 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.562932+0000", 2024-09-12T00:05:49.991 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2601999999999995e-05 2024-09-12T00:05:49.991 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.991 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:49.991 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.991 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.992 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3798 3.35 3:ac2a574a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_415:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:49.992 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.681661+0000", 2024-09-12T00:05:49.992 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 4.1885044889999996, 2024-09-12T00:05:49.992 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.029133148000000001, 2024-09-12T00:05:49.992 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:49.992 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:49.992 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:49.992 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:49.992 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:49.992 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:49.992 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3798 2024-09-12T00:05:49.993 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.993 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:49.993 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.993 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:49.993 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.681661+0000", 2024-09-12T00:05:49.993 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.993 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.993 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.993 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:49.993 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.681661+0000", 2024-09-12T00:05:49.993 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:49.993 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.994 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.994 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:49.994 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.681665+0000", 2024-09-12T00:05:49.994 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.591e-06 2024-09-12T00:05:49.994 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.994 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.994 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:49.994 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683576+0000", 2024-09-12T00:05:49.994 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019111 2024-09-12T00:05:49.994 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.994 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.995 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:49.995 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683608+0000", 2024-09-12T00:05:49.995 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.269e-05 2024-09-12T00:05:49.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.995 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.995 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:49.995 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683623+0000", 2024-09-12T00:05:49.995 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4501000000000001e-05 2024-09-12T00:05:49.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.995 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.995 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:49.995 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683714+0000", 2024-09-12T00:05:49.996 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0666000000000002e-05 2024-09-12T00:05:49.996 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.996 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.996 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:49.996 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683913+0000", 2024-09-12T00:05:49.996 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000199037 2024-09-12T00:05:49.996 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.996 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.996 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:49.996 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.684084+0000", 2024-09-12T00:05:49.996 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017164700000000001 2024-09-12T00:05:49.996 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.997 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.997 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:49.997 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.697732+0000", 2024-09-12T00:05:49.997 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013647670000000001 2024-09-12T00:05:49.997 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.997 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.997 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:49.997 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.710663+0000", 2024-09-12T00:05:49.997 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012931265000000001 2024-09-12T00:05:49.997 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.997 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.997 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:49.998 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.710737+0000", 2024-09-12T00:05:49.998 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4181e-05 2024-09-12T00:05:49.998 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:49.998 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:49.998 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:49.998 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.710794+0000", 2024-09-12T00:05:49.998 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6799999999999998e-05 2024-09-12T00:05:49.998 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.998 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:49.998 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.998 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:49.998 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:49.998 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:50.000 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:05:50.001 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:50.000+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:50.101 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:50.100+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:50.164 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:05:50.174 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:50.174 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:50.174 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:05:50.174 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:50.190 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:05:50.231 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:05:50.234 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:50.236+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:50.303 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:50.304+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:50.354 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:50.354 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:50.354 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:05:50.355 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:05:50.355 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:50.371 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:05:50.395 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:50.395 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:50.403 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:50.404+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:50.415 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:50.415 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:50.436 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:50.437 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:50.455 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:50.455 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:50.476 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:50.476 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:50.493 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:50.493 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:50.497 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:50.505 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:50.504+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:50.507 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:05:50.518 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:50.519 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:50.540 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:50.540 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:50.605 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:50.604+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:50.638 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:50.638 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:50.652 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:05:50.707 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:50.708+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:50.765 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:50.766 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:50.778 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:05:50.821 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:50.824+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:50.904 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:50.904 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:50.908 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:50.908+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:50.918 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:05:51.009 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:51.012+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:51.089 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:51.089 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:51.104 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:05:51.146 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:51.148+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:51.211 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:51.212+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:51.275 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:51.276 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:51.290 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:05:51.333 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:51.336+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:51.412 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:51.412+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:51.419 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:51.419 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:51.436 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T00:05:51.437 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:05:51.513 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:51.512+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:51.570 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:51.570 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:51.585 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:05:51.626 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:51.628+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:51.714 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:51.716+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:51.748 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:51.749 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:51.763 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:05:51.816 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:51.816+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:51.890 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:51.890 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:51.904 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:05:51.917 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:51.916+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:52.018 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:52.020+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:52.070 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:52.070 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:52.084 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:05:52.126 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:52.128+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:52.221 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:52.220+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:52.248 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:52.248 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:52.262 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:05:52.321 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:52.320+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:52.378 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:52.379 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:52.393 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:05:52.434 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:52.436+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:52.523 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:52.524+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:52.557 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:52.557 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:52.558 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:05:52.571 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:05:52.624 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:52.624+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:52.714 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:52.715 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:52.725 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:52.724+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:52.731 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:52.732 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:52.737 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:52.738 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:52.748 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:52.749 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:52.752 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:05:52.765 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:52.766 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:52.783 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:52.784 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:52.803 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:52.803 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:52.822 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:52.823 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:52.826 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:52.824+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:52.840 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:52.840 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:52.883 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:52.883 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:52.883 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:52.884 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:52.884 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.884 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1646 3.25 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:05:52.885 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:52.885 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 79.802017473000006, 2024-09-12T00:05:52.885 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030091884999999999, 2024-09-12T00:05:52.885 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:52.885 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:52.885 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:52.885 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:52.885 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:52.885 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:52.885 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1646 2024-09-12T00:05:52.885 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.885 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:52.885 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.886 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:52.886 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:52.886 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.886 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.886 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.886 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:52.886 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:52.886 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.886 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.886 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.886 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:52.886 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077113+0000", 2024-09-12T00:05:52.886 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0186e-05 2024-09-12T00:05:52.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.887 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.887 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:52.887 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084821+0000", 2024-09-12T00:05:52.887 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077083450000000001 2024-09-12T00:05:52.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.887 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.887 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:52.887 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084857+0000", 2024-09-12T00:05:52.887 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6245000000000003e-05 2024-09-12T00:05:52.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.887 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.887 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:52.888 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084900+0000", 2024-09-12T00:05:52.888 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2369e-05 2024-09-12T00:05:52.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.888 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:52.888 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085058+0000", 2024-09-12T00:05:52.888 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015858199999999999 2024-09-12T00:05:52.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.888 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:52.888 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085307+0000", 2024-09-12T00:05:52.888 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024867999999999998 2024-09-12T00:05:52.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.889 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.889 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:52.889 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086107+0000", 2024-09-12T00:05:52.889 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00080040099999999996 2024-09-12T00:05:52.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.889 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.889 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:52.889 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.100477+0000", 2024-09-12T00:05:52.889 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014369508 2024-09-12T00:05:52.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.889 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.889 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:52.889 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107016+0000", 2024-09-12T00:05:52.890 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006538894 2024-09-12T00:05:52.890 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.890 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.890 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:52.890 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107121+0000", 2024-09-12T00:05:52.890 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105284 2024-09-12T00:05:52.890 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.890 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.890 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:52.891 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107194+0000", 2024-09-12T00:05:52.891 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3391000000000003e-05 2024-09-12T00:05:52.891 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.891 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:52.891 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.891 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.891 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.891 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2718 3.4 3:20fe36bb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:52.891 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:52.891 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 65.093539315000001, 2024-09-12T00:05:52.891 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027867928, 2024-09-12T00:05:52.891 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:52.891 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:52.891 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:52.892 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:52.892 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:52.892 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:52.892 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2718 2024-09-12T00:05:52.892 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.892 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:52.892 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.892 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:52.892 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:52.892 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.892 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.892 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.892 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:52.893 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:52.893 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.893 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.893 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.893 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:52.893 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785584+0000", 2024-09-12T00:05:52.893 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.056e-06 2024-09-12T00:05:52.893 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.893 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.893 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:52.893 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792023+0000", 2024-09-12T00:05:52.894 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064398069999999996 2024-09-12T00:05:52.894 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.894 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.894 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:52.894 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792058+0000", 2024-09-12T00:05:52.895 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5018000000000003e-05 2024-09-12T00:05:52.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.895 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.895 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:52.895 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792078+0000", 2024-09-12T00:05:52.895 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9862000000000001e-05 2024-09-12T00:05:52.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.895 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.895 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:52.895 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792248+0000", 2024-09-12T00:05:52.895 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017006399999999999 2024-09-12T00:05:52.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.895 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.896 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:52.896 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792660+0000", 2024-09-12T00:05:52.896 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041189500000000001 2024-09-12T00:05:52.896 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.896 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.896 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:52.896 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793081+0000", 2024-09-12T00:05:52.896 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000420395 2024-09-12T00:05:52.896 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.896 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.896 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:52.896 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808422+0000", 2024-09-12T00:05:52.896 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015341626000000001 2024-09-12T00:05:52.896 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.897 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.897 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:52.897 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813192+0000", 2024-09-12T00:05:52.897 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047701799999999997 2024-09-12T00:05:52.897 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.897 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.897 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:52.897 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813339+0000", 2024-09-12T00:05:52.897 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014643800000000001 2024-09-12T00:05:52.897 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.897 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.897 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:52.897 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813449+0000", 2024-09-12T00:05:52.898 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010958700000000001 2024-09-12T00:05:52.898 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.898 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:52.898 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.898 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.898 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.898 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2736 3.25 3:a750a681:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:52.898 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:52.898 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 64.903766953000002, 2024-09-12T00:05:52.898 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025701234999999999, 2024-09-12T00:05:52.898 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:52.898 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:52.898 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:52.898 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:52.899 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:52.899 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:52.899 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2736 2024-09-12T00:05:52.899 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.899 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:52.899 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.899 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:52.899 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:52.899 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.899 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.899 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.899 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:52.899 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:52.900 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.900 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.900 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:52.900 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975357+0000", 2024-09-12T00:05:52.900 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9389999999999999e-06 2024-09-12T00:05:52.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.900 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.900 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:52.900 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979365+0000", 2024-09-12T00:05:52.900 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040076679999999998 2024-09-12T00:05:52.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.900 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.900 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:52.901 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979402+0000", 2024-09-12T00:05:52.901 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7557e-05 2024-09-12T00:05:52.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.901 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:52.901 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979419+0000", 2024-09-12T00:05:52.901 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7203000000000001e-05 2024-09-12T00:05:52.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.901 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:52.901 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979543+0000", 2024-09-12T00:05:52.901 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000123423 2024-09-12T00:05:52.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.902 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:52.902 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979784+0000", 2024-09-12T00:05:52.902 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024097800000000001 2024-09-12T00:05:52.902 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.902 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.902 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:52.902 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980013+0000", 2024-09-12T00:05:52.902 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022881999999999999 2024-09-12T00:05:52.902 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.902 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.902 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:52.902 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.999860+0000", 2024-09-12T00:05:52.902 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019847908000000001 2024-09-12T00:05:52.902 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.903 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.903 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:52.903 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000741+0000", 2024-09-12T00:05:52.903 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00088041499999999995 2024-09-12T00:05:52.903 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.903 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.903 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:52.903 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000915+0000", 2024-09-12T00:05:52.903 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017460300000000001 2024-09-12T00:05:52.903 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.903 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.903 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:52.903 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.001054+0000", 2024-09-12T00:05:52.903 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013872099999999999 2024-09-12T00:05:52.904 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.904 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:52.904 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.904 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.904 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.904 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2964 3.24 3:26c83ec0:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:52.904 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:52.904 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.873705151000003, 2024-09-12T00:05:52.904 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028979713000000001, 2024-09-12T00:05:52.904 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:52.904 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:52.904 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:52.905 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:52.905 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:52.905 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:52.905 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2964 2024-09-12T00:05:52.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.905 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:52.905 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.905 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:52.905 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:52.905 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.906 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.906 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:52.906 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:52.906 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.906 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.906 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:52.906 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005417+0000", 2024-09-12T00:05:52.906 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2450000000000001e-06 2024-09-12T00:05:52.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.906 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.906 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:52.906 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010885+0000", 2024-09-12T00:05:52.907 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054684809999999999 2024-09-12T00:05:52.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.907 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.907 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:52.907 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010901+0000", 2024-09-12T00:05:52.907 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5097e-05 2024-09-12T00:05:52.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.907 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.907 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:52.907 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010908+0000", 2024-09-12T00:05:52.907 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7419999999999997e-06 2024-09-12T00:05:52.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.907 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.907 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:52.908 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010968+0000", 2024-09-12T00:05:52.908 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.9837000000000003e-05 2024-09-12T00:05:52.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.908 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.908 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:52.908 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011082+0000", 2024-09-12T00:05:52.908 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011357399999999999 2024-09-12T00:05:52.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.908 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.908 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:52.908 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011174+0000", 2024-09-12T00:05:52.908 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2703999999999999e-05 2024-09-12T00:05:52.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.909 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.909 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:52.909 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.021639+0000", 2024-09-12T00:05:52.909 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010464641 2024-09-12T00:05:52.909 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.909 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.909 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:52.909 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034210+0000", 2024-09-12T00:05:52.909 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012570463 2024-09-12T00:05:52.909 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.909 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.909 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:52.909 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034300+0000", 2024-09-12T00:05:52.909 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0691000000000003e-05 2024-09-12T00:05:52.910 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.910 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.910 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:52.910 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034394+0000", 2024-09-12T00:05:52.910 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4238000000000001e-05 2024-09-12T00:05:52.910 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.910 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:52.910 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.910 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.910 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.910 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3052 3.32 3:4d6db9ea:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:52.910 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:52.910 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 31.899458525, 2024-09-12T00:05:52.910 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028091277000000001, 2024-09-12T00:05:52.911 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:52.911 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:52.911 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:52.911 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:52.911 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:52.911 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:52.911 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3052 2024-09-12T00:05:52.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.911 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:52.911 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.911 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:52.911 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:52.911 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.912 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.912 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:52.912 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:52.912 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.912 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.912 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.912 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:52.912 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979664+0000", 2024-09-12T00:05:52.912 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:05:52.912 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.912 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.912 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:52.912 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986918+0000", 2024-09-12T00:05:52.913 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0072537110000000004 2024-09-12T00:05:52.913 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.913 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.913 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:52.913 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986956+0000", 2024-09-12T00:05:52.913 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8111999999999997e-05 2024-09-12T00:05:52.913 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.913 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.913 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:52.913 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986975+0000", 2024-09-12T00:05:52.913 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9245999999999998e-05 2024-09-12T00:05:52.913 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.913 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.914 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:52.914 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987159+0000", 2024-09-12T00:05:52.914 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000183828 2024-09-12T00:05:52.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.914 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.914 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:52.914 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987552+0000", 2024-09-12T00:05:52.914 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039349699999999998 2024-09-12T00:05:52.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.914 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.914 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:52.914 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987943+0000", 2024-09-12T00:05:52.914 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000390579 2024-09-12T00:05:52.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.915 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.915 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:52.915 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.999384+0000", 2024-09-12T00:05:52.915 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011441563 2024-09-12T00:05:52.915 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.915 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.915 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:52.915 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007634+0000", 2024-09-12T00:05:52.915 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082496240000000005 2024-09-12T00:05:52.916 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.916 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.916 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:52.916 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007699+0000", 2024-09-12T00:05:52.916 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5089e-05 2024-09-12T00:05:52.916 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.916 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.916 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:52.916 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007753+0000", 2024-09-12T00:05:52.916 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3588000000000003e-05 2024-09-12T00:05:52.916 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.916 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:52.916 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.917 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.917 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.917 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3064 3.4 3:209c6609:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:52.917 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:52.917 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 31.767143247, 2024-09-12T00:05:52.917 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024628305999999999, 2024-09-12T00:05:52.917 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:52.917 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:52.917 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:52.917 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:52.917 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:52.917 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:52.918 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3064 2024-09-12T00:05:52.918 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.918 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:52.918 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.918 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:52.918 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:52.918 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.918 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.918 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.918 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:52.918 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:52.918 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.918 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.919 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.919 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:52.919 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111980+0000", 2024-09-12T00:05:52.919 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.005e-06 2024-09-12T00:05:52.919 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.919 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.919 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:52.919 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116464+0000", 2024-09-12T00:05:52.919 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044839210000000001 2024-09-12T00:05:52.920 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.920 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.920 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:52.920 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116490+0000", 2024-09-12T00:05:52.920 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6690999999999999e-05 2024-09-12T00:05:52.920 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.920 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.920 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:52.920 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116504+0000", 2024-09-12T00:05:52.920 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4109e-05 2024-09-12T00:05:52.921 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.921 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.921 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:52.921 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116639+0000", 2024-09-12T00:05:52.921 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013427 2024-09-12T00:05:52.921 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.921 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.921 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:52.921 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116931+0000", 2024-09-12T00:05:52.921 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000292603 2024-09-12T00:05:52.921 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.922 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.922 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:52.922 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.117174+0000", 2024-09-12T00:05:52.922 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024240700000000001 2024-09-12T00:05:52.922 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.922 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.922 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:52.922 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126449+0000", 2024-09-12T00:05:52.922 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0092748699999999993 2024-09-12T00:05:52.922 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.922 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.922 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:52.922 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136438+0000", 2024-09-12T00:05:52.922 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099898539999999994 2024-09-12T00:05:52.923 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.923 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.923 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:52.923 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136532+0000", 2024-09-12T00:05:52.923 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3898000000000001e-05 2024-09-12T00:05:52.923 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.923 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.923 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:52.923 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136605+0000", 2024-09-12T00:05:52.923 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2677999999999998e-05 2024-09-12T00:05:52.923 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.923 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:52.923 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.924 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.924 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.924 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3125 3.12 3:495b0235:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:52.924 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:52.924 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 30.963349242, 2024-09-12T00:05:52.924 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030616648999999999, 2024-09-12T00:05:52.924 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:52.924 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:52.924 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:52.924 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:52.924 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:52.924 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:52.925 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3125 2024-09-12T00:05:52.925 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.925 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:52.925 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.925 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:52.925 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:52.925 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.925 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.926 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.926 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:52.926 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:52.926 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.926 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.926 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.926 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:52.926 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915773+0000", 2024-09-12T00:05:52.926 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2800000000000002e-06 2024-09-12T00:05:52.926 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.926 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.926 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:52.926 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919856+0000", 2024-09-12T00:05:52.927 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004082713 2024-09-12T00:05:52.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.927 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.927 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:52.927 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919879+0000", 2024-09-12T00:05:52.927 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3782e-05 2024-09-12T00:05:52.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.927 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.927 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:52.927 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919891+0000", 2024-09-12T00:05:52.927 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1440000000000001e-05 2024-09-12T00:05:52.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.927 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.928 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:52.928 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920037+0000", 2024-09-12T00:05:52.928 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014562700000000001 2024-09-12T00:05:52.928 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.928 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.928 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:52.928 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920280+0000", 2024-09-12T00:05:52.928 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000243274 2024-09-12T00:05:52.928 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.928 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.928 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:52.928 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920527+0000", 2024-09-12T00:05:52.928 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024692699999999998 2024-09-12T00:05:52.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.929 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.929 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:52.929 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.932485+0000", 2024-09-12T00:05:52.929 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011957857000000001 2024-09-12T00:05:52.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.929 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.929 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:52.929 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946197+0000", 2024-09-12T00:05:52.929 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013712436999999999 2024-09-12T00:05:52.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.929 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.929 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:52.930 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946305+0000", 2024-09-12T00:05:52.930 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000107914 2024-09-12T00:05:52.930 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.930 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.930 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:52.930 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946387+0000", 2024-09-12T00:05:52.930 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2398000000000006e-05 2024-09-12T00:05:52.930 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.930 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:52.930 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.930 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.930 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.930 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3134 3.24 3:2525a955:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:52.930 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:52.931 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 30.839272512000001, 2024-09-12T00:05:52.931 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025606806999999999, 2024-09-12T00:05:52.931 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:52.931 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:52.931 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:52.931 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:52.931 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:52.931 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:52.931 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3134 2024-09-12T00:05:52.931 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.931 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:52.931 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.931 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:52.932 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:52.932 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.932 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.932 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.932 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:52.932 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:52.932 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.932 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.932 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.932 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:52.932 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039850+0000", 2024-09-12T00:05:52.932 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9780000000000001e-06 2024-09-12T00:05:52.932 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.933 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.933 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:52.933 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045256+0000", 2024-09-12T00:05:52.933 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054058129999999998 2024-09-12T00:05:52.933 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.933 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.933 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:52.933 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045284+0000", 2024-09-12T00:05:52.933 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8065e-05 2024-09-12T00:05:52.933 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.933 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.933 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:52.933 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045297+0000", 2024-09-12T00:05:52.934 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2788e-05 2024-09-12T00:05:52.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.934 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.934 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:52.934 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045378+0000", 2024-09-12T00:05:52.934 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1079000000000001e-05 2024-09-12T00:05:52.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.934 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.934 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:52.934 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045530+0000", 2024-09-12T00:05:52.934 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015206099999999999 2024-09-12T00:05:52.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.934 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.935 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:52.935 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045655+0000", 2024-09-12T00:05:52.935 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012525899999999999 2024-09-12T00:05:52.935 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.935 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.935 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:52.935 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.054817+0000", 2024-09-12T00:05:52.935 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0091611049999999992 2024-09-12T00:05:52.935 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.935 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.935 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:52.936 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065354+0000", 2024-09-12T00:05:52.936 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010537625 2024-09-12T00:05:52.936 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.936 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.936 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:52.936 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065410+0000", 2024-09-12T00:05:52.936 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6141999999999999e-05 2024-09-12T00:05:52.936 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.936 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.936 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:52.936 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065454+0000", 2024-09-12T00:05:52.936 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3891999999999999e-05 2024-09-12T00:05:52.937 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.937 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:52.937 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.937 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.937 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.937 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3386 3.1 3:8071dd26:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:52.937 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.767011+0000", 2024-09-12T00:05:52.937 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.112109394999999, 2024-09-12T00:05:52.937 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.031756300000000001, 2024-09-12T00:05:52.937 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:52.937 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:52.937 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:52.937 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:52.938 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:52.938 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:52.938 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3386 2024-09-12T00:05:52.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.938 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:52.938 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.938 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:52.938 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.767011+0000", 2024-09-12T00:05:52.938 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.938 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.938 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:52.938 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.767011+0000", 2024-09-12T00:05:52.938 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.939 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.939 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.939 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:52.939 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.767014+0000", 2024-09-12T00:05:52.939 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0429999999999999e-06 2024-09-12T00:05:52.939 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.939 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.939 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:52.939 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775360+0000", 2024-09-12T00:05:52.939 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0083463740000000002 2024-09-12T00:05:52.939 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.939 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.939 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:52.940 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775398+0000", 2024-09-12T00:05:52.940 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8376e-05 2024-09-12T00:05:52.940 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.940 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.940 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:52.940 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775415+0000", 2024-09-12T00:05:52.940 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6563e-05 2024-09-12T00:05:52.940 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.940 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.940 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:52.940 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775556+0000", 2024-09-12T00:05:52.940 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000140865 2024-09-12T00:05:52.940 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.940 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.941 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:52.941 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775819+0000", 2024-09-12T00:05:52.941 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000262842 2024-09-12T00:05:52.941 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.941 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.941 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:52.941 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.776048+0000", 2024-09-12T00:05:52.941 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000229399 2024-09-12T00:05:52.941 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.941 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.941 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:52.941 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.791048+0000", 2024-09-12T00:05:52.941 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015000503 2024-09-12T00:05:52.941 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.942 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.942 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:52.942 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.798597+0000", 2024-09-12T00:05:52.942 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0075482409999999998 2024-09-12T00:05:52.942 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.942 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.942 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:52.942 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.798690+0000", 2024-09-12T00:05:52.942 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3769000000000003e-05 2024-09-12T00:05:52.942 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.942 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.942 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:52.942 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.798767+0000", 2024-09-12T00:05:52.942 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6324999999999999e-05 2024-09-12T00:05:52.943 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.943 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:52.943 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.943 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.943 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.943 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3397 3.4 3:220517e3:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:52.943 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.890276+0000", 2024-09-12T00:05:52.943 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.988844388, 2024-09-12T00:05:52.943 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.02507564, 2024-09-12T00:05:52.943 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:52.943 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:52.943 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:52.943 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:52.944 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:52.944 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:52.944 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3397 2024-09-12T00:05:52.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.944 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:52.944 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.944 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:52.944 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.890276+0000", 2024-09-12T00:05:52.944 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.944 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.944 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:52.944 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.890276+0000", 2024-09-12T00:05:52.945 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.945 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:52.945 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.890281+0000", 2024-09-12T00:05:52.945 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.366e-06 2024-09-12T00:05:52.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.945 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:52.945 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.894729+0000", 2024-09-12T00:05:52.945 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044483320000000002 2024-09-12T00:05:52.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.945 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:52.946 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.894782+0000", 2024-09-12T00:05:52.946 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2445999999999999e-05 2024-09-12T00:05:52.946 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.946 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.946 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:52.946 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.894810+0000", 2024-09-12T00:05:52.946 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8126000000000001e-05 2024-09-12T00:05:52.946 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.946 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.946 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:52.947 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.894961+0000", 2024-09-12T00:05:52.947 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015165999999999999 2024-09-12T00:05:52.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.947 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.947 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:52.947 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.895228+0000", 2024-09-12T00:05:52.947 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026675599999999999 2024-09-12T00:05:52.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.947 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.947 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:52.947 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.895478+0000", 2024-09-12T00:05:52.947 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025020199999999999 2024-09-12T00:05:52.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.948 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:52.948 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.913919+0000", 2024-09-12T00:05:52.948 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018440096999999999 2024-09-12T00:05:52.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.948 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:52.948 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.915109+0000", 2024-09-12T00:05:52.948 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0011908660000000001 2024-09-12T00:05:52.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.948 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:52.948 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.915239+0000", 2024-09-12T00:05:52.949 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012928399999999999 2024-09-12T00:05:52.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.949 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:52.949 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.915351+0000", 2024-09-12T00:05:52.949 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011250499999999999 2024-09-12T00:05:52.949 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.949 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:52.949 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.949 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3398 3.12 3:4888914b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:52.949 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.904027+0000", 2024-09-12T00:05:52.950 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.975092796, 2024-09-12T00:05:52.950 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.029408179999999999, 2024-09-12T00:05:52.950 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:52.950 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:52.950 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:52.950 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:52.950 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:52.950 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:52.950 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3398 2024-09-12T00:05:52.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.950 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:52.950 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.950 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:52.951 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.904027+0000", 2024-09-12T00:05:52.951 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.951 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.951 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:52.951 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.904027+0000", 2024-09-12T00:05:52.951 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.951 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.951 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:52.951 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.904030+0000", 2024-09-12T00:05:52.951 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0529999999999998e-06 2024-09-12T00:05:52.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.951 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.952 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:52.952 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.910958+0000", 2024-09-12T00:05:52.952 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0069274849999999997 2024-09-12T00:05:52.952 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.952 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.952 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:52.952 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.910989+0000", 2024-09-12T00:05:52.952 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1752999999999999e-05 2024-09-12T00:05:52.952 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.952 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.952 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:52.952 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911006+0000", 2024-09-12T00:05:52.952 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6463000000000001e-05 2024-09-12T00:05:52.953 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.953 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.953 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:52.953 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911171+0000", 2024-09-12T00:05:52.953 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016481699999999999 2024-09-12T00:05:52.953 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.953 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.953 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:52.953 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911417+0000", 2024-09-12T00:05:52.953 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024629600000000001 2024-09-12T00:05:52.953 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.953 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.953 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:52.953 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911646+0000", 2024-09-12T00:05:52.953 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022906599999999999 2024-09-12T00:05:52.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.954 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.954 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:52.954 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.932777+0000", 2024-09-12T00:05:52.954 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021130906000000001 2024-09-12T00:05:52.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.954 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.954 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:52.954 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.933094+0000", 2024-09-12T00:05:52.954 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000317127 2024-09-12T00:05:52.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.954 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.954 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:52.955 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.933277+0000", 2024-09-12T00:05:52.955 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018257000000000001 2024-09-12T00:05:52.955 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.955 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.955 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:52.955 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.933435+0000", 2024-09-12T00:05:52.955 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015864399999999999 2024-09-12T00:05:52.955 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.955 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:52.955 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.955 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.955 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.955 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3401 3.20 e82/23 3:06d9612a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_28:head v 82'11, mlcod=76'9)", 2024-09-12T00:05:52.955 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.936564+0000", 2024-09-12T00:05:52.956 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 11.942556034000001, 2024-09-12T00:05:52.956 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.026227489999999999, 2024-09-12T00:05:52.956 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:52.956 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:52.956 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:52.956 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:52.956 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.956 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:52.956 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.936564+0000", 2024-09-12T00:05:52.956 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.957 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.957 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.957 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:52.957 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.936564+0000", 2024-09-12T00:05:52.957 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.957 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.957 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.957 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:52.957 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.936571+0000", 2024-09-12T00:05:52.957 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5959999999999998e-06 2024-09-12T00:05:52.957 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.957 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.957 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:52.958 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941597+0000", 2024-09-12T00:05:52.958 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0050253720000000002 2024-09-12T00:05:52.958 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.958 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.958 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:52.958 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941625+0000", 2024-09-12T00:05:52.958 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8564999999999998e-05 2024-09-12T00:05:52.958 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.958 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.958 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:52.958 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941640+0000", 2024-09-12T00:05:52.958 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4837e-05 2024-09-12T00:05:52.958 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.958 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.959 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:52.959 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941776+0000", 2024-09-12T00:05:52.959 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013623500000000001 2024-09-12T00:05:52.959 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.959 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.959 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:52.959 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941822+0000", 2024-09-12T00:05:52.959 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5513000000000003e-05 2024-09-12T00:05:52.959 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.959 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.959 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:52.959 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.962694+0000", 2024-09-12T00:05:52.959 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020871516999999999 2024-09-12T00:05:52.959 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.960 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.960 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:52.960 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.962791+0000", 2024-09-12T00:05:52.960 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7855000000000004e-05 2024-09-12T00:05:52.960 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.960 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:52.960 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.960 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.960 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.960 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3670 3.5 e83/23 3:a3029b32:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_287:head v 83'13, mlcod=83'11)", 2024-09-12T00:05:52.960 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:43.823062+0000", 2024-09-12T00:05:52.960 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 9.0560580789999996, 2024-09-12T00:05:52.960 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028976041000000001, 2024-09-12T00:05:52.961 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:52.961 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:52.961 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:52.961 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:52.961 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.961 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:52.961 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.823062+0000", 2024-09-12T00:05:52.961 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.961 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.961 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.961 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:52.961 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.823062+0000", 2024-09-12T00:05:52.961 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.961 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.962 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.962 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:52.962 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.823068+0000", 2024-09-12T00:05:52.962 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6250000000000001e-06 2024-09-12T00:05:52.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.962 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.962 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:52.962 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.826863+0000", 2024-09-12T00:05:52.962 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037945880000000002 2024-09-12T00:05:52.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.962 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.962 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:52.962 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.826885+0000", 2024-09-12T00:05:52.962 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1515e-05 2024-09-12T00:05:52.963 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.963 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.963 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:52.963 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.826894+0000", 2024-09-12T00:05:52.963 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4040000000000001e-06 2024-09-12T00:05:52.963 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.963 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.963 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:52.963 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.827014+0000", 2024-09-12T00:05:52.963 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120238 2024-09-12T00:05:52.963 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.963 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.963 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:52.963 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.827056+0000", 2024-09-12T00:05:52.964 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2129000000000003e-05 2024-09-12T00:05:52.964 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.964 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.964 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:52.964 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.851882+0000", 2024-09-12T00:05:52.964 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024825538000000001 2024-09-12T00:05:52.964 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.964 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.964 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:52.964 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.852038+0000", 2024-09-12T00:05:52.964 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015600400000000001 2024-09-12T00:05:52.964 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.964 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3681 3.12 3:481fb92d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_298:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:43.987522+0000", 2024-09-12T00:05:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.8915974759999994, 2024-09-12T00:05:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.029063802999999999, 2024-09-12T00:05:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3681 2024-09-12T00:05:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.966 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:52.966 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.966 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:52.966 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.987522+0000", 2024-09-12T00:05:52.966 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.966 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.966 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:52.966 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.987522+0000", 2024-09-12T00:05:52.966 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.967 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.967 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.967 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:52.967 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.987527+0000", 2024-09-12T00:05:52.967 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5730000000000001e-06 2024-09-12T00:05:52.967 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.967 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.967 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:52.967 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.992931+0000", 2024-09-12T00:05:52.967 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054043950000000002 2024-09-12T00:05:52.967 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.967 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.967 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:52.968 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.992974+0000", 2024-09-12T00:05:52.968 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2542e-05 2024-09-12T00:05:52.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.968 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.968 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:52.968 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.992999+0000", 2024-09-12T00:05:52.968 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5113000000000002e-05 2024-09-12T00:05:52.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.968 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.968 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:52.968 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.993146+0000", 2024-09-12T00:05:52.968 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014703900000000001 2024-09-12T00:05:52.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.968 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.993270+0000", 2024-09-12T00:05:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012376100000000001 2024-09-12T00:05:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.993433+0000", 2024-09-12T00:05:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016290900000000001 2024-09-12T00:05:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.003341+0000", 2024-09-12T00:05:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099082289999999993 2024-09-12T00:05:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.970 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.970 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:52.970 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.016476+0000", 2024-09-12T00:05:52.970 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013134616999999999 2024-09-12T00:05:52.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.970 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.970 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:52.970 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.016528+0000", 2024-09-12T00:05:52.970 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2410000000000001e-05 2024-09-12T00:05:52.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.970 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.970 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:52.970 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.016586+0000", 2024-09-12T00:05:52.971 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8214999999999997e-05 2024-09-12T00:05:52.971 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.971 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:52.971 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.971 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.971 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3714 3.32 3:4e60a7f6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_331:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:52.971 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.707821+0000", 2024-09-12T00:05:52.971 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.1712985029999992, 2024-09-12T00:05:52.971 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025583348999999998, 2024-09-12T00:05:52.971 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:52.971 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:52.971 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:52.972 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:52.972 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:52.972 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:52.972 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3714 2024-09-12T00:05:52.972 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.972 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:52.972 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.972 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:52.972 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.707821+0000", 2024-09-12T00:05:52.972 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.972 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.972 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.972 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:52.973 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.707821+0000", 2024-09-12T00:05:52.973 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.973 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:52.973 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.707867+0000", 2024-09-12T00:05:52.973 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5429000000000002e-05 2024-09-12T00:05:52.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.973 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:52.973 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715020+0000", 2024-09-12T00:05:52.973 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0071533580000000003 2024-09-12T00:05:52.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.974 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:52.974 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715058+0000", 2024-09-12T00:05:52.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7823e-05 2024-09-12T00:05:52.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.974 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:52.974 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715075+0000", 2024-09-12T00:05:52.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7122999999999999e-05 2024-09-12T00:05:52.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.974 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:52.974 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715275+0000", 2024-09-12T00:05:52.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020033 2024-09-12T00:05:52.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.975 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:52.975 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715526+0000", 2024-09-12T00:05:52.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025033500000000002 2024-09-12T00:05:52.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.975 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:52.975 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715760+0000", 2024-09-12T00:05:52.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023411600000000001 2024-09-12T00:05:52.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.975 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:52.975 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.731072+0000", 2024-09-12T00:05:52.976 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015311671000000001 2024-09-12T00:05:52.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.976 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.976 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:52.976 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.733084+0000", 2024-09-12T00:05:52.976 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020124299999999999 2024-09-12T00:05:52.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.976 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.976 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:52.976 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.733257+0000", 2024-09-12T00:05:52.976 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017338400000000001 2024-09-12T00:05:52.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.977 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:52.977 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.733405+0000", 2024-09-12T00:05:52.977 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014735 2024-09-12T00:05:52.977 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.977 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:52.977 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.977 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3726 3.33 3:cd6e0a10:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_343:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:52.977 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.865044+0000", 2024-09-12T00:05:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.0140755099999996, 2024-09-12T00:05:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027130072000000002, 2024-09-12T00:05:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3726 2024-09-12T00:05:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.865044+0000", 2024-09-12T00:05:52.979 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.979 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.979 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:52.979 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.865044+0000", 2024-09-12T00:05:52.979 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.979 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.979 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:52.979 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.865048+0000", 2024-09-12T00:05:52.979 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1669999999999999e-06 2024-09-12T00:05:52.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.979 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.979 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:52.980 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869155+0000", 2024-09-12T00:05:52.980 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041073020000000002 2024-09-12T00:05:52.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.980 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:52.980 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869190+0000", 2024-09-12T00:05:52.980 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5113000000000001e-05 2024-09-12T00:05:52.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.980 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:52.980 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869207+0000", 2024-09-12T00:05:52.980 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6943e-05 2024-09-12T00:05:52.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.981 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:52.981 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869388+0000", 2024-09-12T00:05:52.981 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018116000000000001 2024-09-12T00:05:52.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.981 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:52.981 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869776+0000", 2024-09-12T00:05:52.981 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00038828099999999998 2024-09-12T00:05:52.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.981 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:52.981 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.870191+0000", 2024-09-12T00:05:52.981 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041471599999999998 2024-09-12T00:05:52.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.982 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:52.982 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.881480+0000", 2024-09-12T00:05:52.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0112887 2024-09-12T00:05:52.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.982 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:52.982 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.891979+0000", 2024-09-12T00:05:52.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010499377000000001 2024-09-12T00:05:52.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.982 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:52.982 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.892068+0000", 2024-09-12T00:05:52.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8374000000000005e-05 2024-09-12T00:05:52.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.983 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.983 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:52.983 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.892174+0000", 2024-09-12T00:05:52.983 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000106939 2024-09-12T00:05:52.983 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.983 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:52.983 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.983 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.983 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3732 3.25 3:a4e42410:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_349:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:52.983 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.935722+0000", 2024-09-12T00:05:52.983 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 7.9433975659999998, 2024-09-12T00:05:52.983 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025382307, 2024-09-12T00:05:52.984 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:52.984 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:52.984 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:52.984 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:52.984 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:52.984 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:52.984 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3732 2024-09-12T00:05:52.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.984 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:52.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.985 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:52.985 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.935722+0000", 2024-09-12T00:05:52.985 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.985 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:52.985 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.935722+0000", 2024-09-12T00:05:52.985 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.985 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:52.985 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.935725+0000", 2024-09-12T00:05:52.985 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.943e-06 2024-09-12T00:05:52.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.986 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:52.986 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.940989+0000", 2024-09-12T00:05:52.986 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052639799999999997 2024-09-12T00:05:52.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.986 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:52.986 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.941045+0000", 2024-09-12T00:05:52.986 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6159000000000002e-05 2024-09-12T00:05:52.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.986 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:52.987 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.941064+0000", 2024-09-12T00:05:52.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8085999999999999e-05 2024-09-12T00:05:52.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.987 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:52.987 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.941195+0000", 2024-09-12T00:05:52.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000131125 2024-09-12T00:05:52.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.988 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:52.988 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.941435+0000", 2024-09-12T00:05:52.988 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024035899999999999 2024-09-12T00:05:52.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.988 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:52.988 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.941654+0000", 2024-09-12T00:05:52.988 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021882999999999999 2024-09-12T00:05:52.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.988 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:52.988 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.955258+0000", 2024-09-12T00:05:52.988 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013604171 2024-09-12T00:05:52.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.989 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:52.989 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.960941+0000", 2024-09-12T00:05:52.989 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0056832899999999997 2024-09-12T00:05:52.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.989 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:52.989 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.961030+0000", 2024-09-12T00:05:52.989 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8595000000000001e-05 2024-09-12T00:05:52.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.989 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:52.989 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.961105+0000", 2024-09-12T00:05:52.990 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4769000000000002e-05 2024-09-12T00:05:52.990 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.990 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:52.990 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.990 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.990 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.990 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3750 3.4 3:205ed86b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_367:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:52.990 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.141436+0000", 2024-09-12T00:05:52.990 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 7.7376835850000001, 2024-09-12T00:05:52.990 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025245500000000001, 2024-09-12T00:05:52.990 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:52.990 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:52.990 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:52.990 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:52.990 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:52.991 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:52.991 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3750 2024-09-12T00:05:52.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.991 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:52.991 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.991 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:52.991 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.141436+0000", 2024-09-12T00:05:52.991 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.991 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.991 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:52.991 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.141436+0000", 2024-09-12T00:05:52.991 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.992 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.992 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:52.992 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.141440+0000", 2024-09-12T00:05:52.992 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5939999999999998e-06 2024-09-12T00:05:52.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.992 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.992 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:52.992 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.145505+0000", 2024-09-12T00:05:52.992 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040646160000000001 2024-09-12T00:05:52.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.992 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.992 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:52.992 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.145541+0000", 2024-09-12T00:05:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6508999999999999e-05 2024-09-12T00:05:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.145559+0000", 2024-09-12T00:05:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7853e-05 2024-09-12T00:05:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.145724+0000", 2024-09-12T00:05:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016462099999999999 2024-09-12T00:05:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.146114+0000", 2024-09-12T00:05:52.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039085699999999999 2024-09-12T00:05:52.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.994 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:52.994 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.146533+0000", 2024-09-12T00:05:52.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041889 2024-09-12T00:05:52.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.994 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:52.995 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.165996+0000", 2024-09-12T00:05:52.995 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019462461 2024-09-12T00:05:52.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.995 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.995 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:52.995 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.166514+0000", 2024-09-12T00:05:52.995 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00051867799999999996 2024-09-12T00:05:52.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.995 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.995 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:52.995 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.166614+0000", 2024-09-12T00:05:52.995 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9538999999999997e-05 2024-09-12T00:05:52.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.995 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.995 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:52.996 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.166682+0000", 2024-09-12T00:05:52.996 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.7881999999999998e-05 2024-09-12T00:05:52.996 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.996 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:52.996 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:52.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.996 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3768 3.25 3:a5893d4d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_385:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:52.996 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.338740+0000", 2024-09-12T00:05:52.996 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 7.5403796239999998, 2024-09-12T00:05:52.996 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025891451999999999, 2024-09-12T00:05:52.996 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:52.996 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:52.997 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:52.997 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:52.997 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:52.997 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:52.997 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3768 2024-09-12T00:05:52.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.997 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:52.997 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.997 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:52.997 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.338740+0000", 2024-09-12T00:05:52.997 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.997 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.998 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:52.998 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.338740+0000", 2024-09-12T00:05:52.998 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:52.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.998 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.998 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:52.998 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.338744+0000", 2024-09-12T00:05:52.998 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1470000000000003e-06 2024-09-12T00:05:52.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.998 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.998 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:52.998 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343258+0000", 2024-09-12T00:05:52.998 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045136880000000001 2024-09-12T00:05:52.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.999 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:52.999 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343292+0000", 2024-09-12T00:05:52.999 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3893000000000002e-05 2024-09-12T00:05:52.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.999 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:52.999 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343337+0000", 2024-09-12T00:05:52.999 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4699e-05 2024-09-12T00:05:52.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:52.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:52.999 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:52.999 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343453+0000", 2024-09-12T00:05:52.999 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000116272 2024-09-12T00:05:53.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.000 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.000 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.000 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343770+0000", 2024-09-12T00:05:53.000 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00031750799999999998 2024-09-12T00:05:53.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.000 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.000 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:53.000 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343992+0000", 2024-09-12T00:05:53.000 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000221986 2024-09-12T00:05:53.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.000 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.000 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:53.000 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.355234+0000", 2024-09-12T00:05:53.001 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011241637000000001 2024-09-12T00:05:53.001 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.001 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.001 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:53.001 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.364420+0000", 2024-09-12T00:05:53.001 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0091854320000000003 2024-09-12T00:05:53.001 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.001 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.001 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.001 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.364514+0000", 2024-09-12T00:05:53.001 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4492000000000003e-05 2024-09-12T00:05:53.001 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.001 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.001 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.002 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.364632+0000", 2024-09-12T00:05:53.002 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117698 2024-09-12T00:05:53.002 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.002 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.002 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.002 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.002 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3791 3.4 3:2186e625:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_408:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:53.002 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.609529+0000", 2024-09-12T00:05:53.002 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 7.2695908219999996, 2024-09-12T00:05:53.002 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.031252178999999998, 2024-09-12T00:05:53.002 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:53.002 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:53.003 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:53.003 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:53.003 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:53.003 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:53.003 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3791 2024-09-12T00:05:53.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.003 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:53.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.003 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:53.003 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.609529+0000", 2024-09-12T00:05:53.003 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.003 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:53.004 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.609529+0000", 2024-09-12T00:05:53.004 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.004 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:53.004 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.609532+0000", 2024-09-12T00:05:53.004 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3230000000000002e-06 2024-09-12T00:05:53.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.004 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:53.004 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.613514+0000", 2024-09-12T00:05:53.004 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039820439999999997 2024-09-12T00:05:53.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:53.005 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.613550+0000", 2024-09-12T00:05:53.005 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5821999999999997e-05 2024-09-12T00:05:53.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.005 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:53.005 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.613568+0000", 2024-09-12T00:05:53.005 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7363e-05 2024-09-12T00:05:53.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.005 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:53.005 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.613738+0000", 2024-09-12T00:05:53.005 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017081400000000001 2024-09-12T00:05:53.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.006 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.006 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.614134+0000", 2024-09-12T00:05:53.006 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000395454 2024-09-12T00:05:53.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.006 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:53.006 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.614529+0000", 2024-09-12T00:05:53.006 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039467300000000001 2024-09-12T00:05:53.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.006 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:53.006 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.632368+0000", 2024-09-12T00:05:53.006 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017839482 2024-09-12T00:05:53.007 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.007 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.007 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:53.007 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.640584+0000", 2024-09-12T00:05:53.007 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082160700000000007 2024-09-12T00:05:53.007 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.007 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.007 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.007 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.640694+0000", 2024-09-12T00:05:53.007 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109782 2024-09-12T00:05:53.007 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.007 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.007 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.008 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.640781+0000", 2024-09-12T00:05:53.008 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7352e-05 2024-09-12T00:05:53.008 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.008 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.008 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.008 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.008 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.008 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:53.009 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:05:53.010 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:53.012+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:53.111 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:53.112+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:53.177 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:53.177 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:53.177 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:53.177 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:53.192 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:05:53.212 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:53.212+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:53.313 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:53.312+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:53.362 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:53.362 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:53.362 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:53.362 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:53.362 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:53.376 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:05:53.414 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:53.416+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:53.457 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T00:05:53.501 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:53.501 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:53.502 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:53.502 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:53.502 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.502 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:1646 3.25 e58/23 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head v 58'1, mlcod=0'0)", 2024-09-12T00:05:53.502 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:53.502 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 80.413955294000004, 2024-09-12T00:05:53.502 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020301987000000001, 2024-09-12T00:05:53.502 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:53.502 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:53.502 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:53.502 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:53.502 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.503 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:53.503 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:53.503 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.503 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.503 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:53.503 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:53.503 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.503 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.503 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:53.503 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086308+0000", 2024-09-12T00:05:53.503 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.95e-06 2024-09-12T00:05:53.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.504 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.504 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:53.504 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091174+0000", 2024-09-12T00:05:53.504 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048660559999999997 2024-09-12T00:05:53.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.504 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.504 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:53.504 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091218+0000", 2024-09-12T00:05:53.504 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4678999999999997e-05 2024-09-12T00:05:53.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.504 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.505 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:53.505 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091238+0000", 2024-09-12T00:05:53.505 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9839000000000001e-05 2024-09-12T00:05:53.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.505 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.505 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:53.505 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091396+0000", 2024-09-12T00:05:53.505 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000157396 2024-09-12T00:05:53.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.505 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.505 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.506 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091451+0000", 2024-09-12T00:05:53.506 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5547999999999997e-05 2024-09-12T00:05:53.506 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.506 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.506 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.506 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106474+0000", 2024-09-12T00:05:53.506 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015023287 2024-09-12T00:05:53.506 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.506 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.506 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.506 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106608+0000", 2024-09-12T00:05:53.506 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133232 2024-09-12T00:05:53.506 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.506 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.507 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.507 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.507 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2723 3.21 3:86535907:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:53.507 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:53.507 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 65.668107827, 2024-09-12T00:05:53.508 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021210407000000001, 2024-09-12T00:05:53.508 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:53.508 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:53.508 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:53.508 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:53.508 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:53.508 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:53.509 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2723 2024-09-12T00:05:53.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.509 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:53.509 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.509 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:53.509 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:53.509 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.509 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.509 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:53.509 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:53.509 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.510 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.510 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:53.510 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832157+0000", 2024-09-12T00:05:53.510 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3270000000000001e-06 2024-09-12T00:05:53.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.510 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.510 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:53.510 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837403+0000", 2024-09-12T00:05:53.510 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005246784 2024-09-12T00:05:53.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.510 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.510 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:53.510 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837439+0000", 2024-09-12T00:05:53.510 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5848e-05 2024-09-12T00:05:53.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.511 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.511 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:53.511 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837459+0000", 2024-09-12T00:05:53.511 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9585e-05 2024-09-12T00:05:53.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.511 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.511 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:53.511 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837574+0000", 2024-09-12T00:05:53.511 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000114917 2024-09-12T00:05:53.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.511 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.511 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.512 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837803+0000", 2024-09-12T00:05:53.512 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022967699999999999 2024-09-12T00:05:53.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.512 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:53.512 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838174+0000", 2024-09-12T00:05:53.512 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037083899999999998 2024-09-12T00:05:53.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.512 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:53.512 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848447+0000", 2024-09-12T00:05:53.512 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010272439 2024-09-12T00:05:53.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.513 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.513 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:53.513 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853191+0000", 2024-09-12T00:05:53.513 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047441109999999996 2024-09-12T00:05:53.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.513 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.513 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.513 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853292+0000", 2024-09-12T00:05:53.513 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000101474 2024-09-12T00:05:53.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.514 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.514 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.514 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853364+0000", 2024-09-12T00:05:53.514 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1406e-05 2024-09-12T00:05:53.514 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.514 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.514 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.514 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.514 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2971 3.2e 3:76f45d45:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:53.515 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:53.515 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.42439349, 2024-09-12T00:05:53.515 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022571213, 2024-09-12T00:05:53.515 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:53.515 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:53.515 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:53.515 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:53.515 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:53.515 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:53.515 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2971 2024-09-12T00:05:53.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.515 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:53.515 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.516 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:53.516 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:53.516 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.516 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.516 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:53.516 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:53.516 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.516 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.516 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:53.516 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075871+0000", 2024-09-12T00:05:53.516 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.467e-06 2024-09-12T00:05:53.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.517 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:53.517 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080307+0000", 2024-09-12T00:05:53.517 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044356359999999997 2024-09-12T00:05:53.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.517 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:53.517 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080346+0000", 2024-09-12T00:05:53.517 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9267999999999997e-05 2024-09-12T00:05:53.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.517 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:53.518 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080368+0000", 2024-09-12T00:05:53.518 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2603e-05 2024-09-12T00:05:53.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.518 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.518 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:53.518 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080489+0000", 2024-09-12T00:05:53.518 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0001209 2024-09-12T00:05:53.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.518 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.518 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.518 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080830+0000", 2024-09-12T00:05:53.518 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00034099 2024-09-12T00:05:53.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.519 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.519 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:53.519 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.081119+0000", 2024-09-12T00:05:53.519 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028860300000000001 2024-09-12T00:05:53.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.519 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.519 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:53.519 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.093241+0000", 2024-09-12T00:05:53.519 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012121609 2024-09-12T00:05:53.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.519 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.519 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:53.519 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098277+0000", 2024-09-12T00:05:53.519 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0050359710000000002 2024-09-12T00:05:53.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.520 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.520 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098366+0000", 2024-09-12T00:05:53.520 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9052000000000001e-05 2024-09-12T00:05:53.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.520 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.520 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098439+0000", 2024-09-12T00:05:53.520 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3114000000000005e-05 2024-09-12T00:05:53.520 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.521 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.521 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.521 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.521 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2996 3.21 3:872b1c12:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:53.521 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:53.521 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 33.149768752999996, 2024-09-12T00:05:53.521 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027562314000000001, 2024-09-12T00:05:53.521 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:53.521 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:53.521 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:53.521 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:53.521 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:53.521 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:53.522 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2996 2024-09-12T00:05:53.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.522 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:53.522 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.522 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:53.522 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:53.522 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.522 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.522 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:53.522 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:53.522 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.522 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.523 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:53.523 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350496+0000", 2024-09-12T00:05:53.523 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9160000000000003e-06 2024-09-12T00:05:53.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.523 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:53.523 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355187+0000", 2024-09-12T00:05:53.523 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046904989999999999 2024-09-12T00:05:53.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.523 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:53.523 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355223+0000", 2024-09-12T00:05:53.523 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6125999999999999e-05 2024-09-12T00:05:53.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.524 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.524 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:53.524 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355241+0000", 2024-09-12T00:05:53.524 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8686e-05 2024-09-12T00:05:53.524 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.524 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.524 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:53.524 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355373+0000", 2024-09-12T00:05:53.524 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013129299999999999 2024-09-12T00:05:53.525 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.525 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.525 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.525 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355619+0000", 2024-09-12T00:05:53.525 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024662700000000002 2024-09-12T00:05:53.525 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.525 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.525 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:53.525 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355855+0000", 2024-09-12T00:05:53.525 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023604299999999999 2024-09-12T00:05:53.525 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.525 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.525 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:53.526 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.367983+0000", 2024-09-12T00:05:53.526 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012127104999999999 2024-09-12T00:05:53.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.526 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.526 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:53.526 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377884+0000", 2024-09-12T00:05:53.526 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099013680000000007 2024-09-12T00:05:53.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.526 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.526 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.526 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377974+0000", 2024-09-12T00:05:53.527 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9932999999999994e-05 2024-09-12T00:05:53.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.527 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.527 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.527 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.378055+0000", 2024-09-12T00:05:53.527 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0717999999999995e-05 2024-09-12T00:05:53.527 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.527 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.527 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.527 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.527 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3030 3.2e 3:740afe3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:53.527 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:53.527 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.760438594999997, 2024-09-12T00:05:53.528 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.033756331000000001, 2024-09-12T00:05:53.528 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:53.528 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:53.528 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:53.528 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:53.528 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:53.528 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:53.528 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3030 2024-09-12T00:05:53.528 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.528 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:53.528 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.528 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:53.528 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:53.529 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.529 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.529 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:53.529 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:53.529 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.529 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.529 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:53.529 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739825+0000", 2024-09-12T00:05:53.529 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7920000000000001e-06 2024-09-12T00:05:53.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.529 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.529 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:53.530 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744217+0000", 2024-09-12T00:05:53.530 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043922529999999996 2024-09-12T00:05:53.530 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.530 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.530 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:53.530 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744243+0000", 2024-09-12T00:05:53.530 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5253e-05 2024-09-12T00:05:53.530 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.530 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.530 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:53.530 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744254+0000", 2024-09-12T00:05:53.530 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1430999999999999e-05 2024-09-12T00:05:53.530 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.531 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.531 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:53.531 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744325+0000", 2024-09-12T00:05:53.531 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1340999999999993e-05 2024-09-12T00:05:53.531 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.531 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.531 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.531 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744461+0000", 2024-09-12T00:05:53.531 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013531700000000001 2024-09-12T00:05:53.531 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.531 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.531 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:53.531 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744574+0000", 2024-09-12T00:05:53.532 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113513 2024-09-12T00:05:53.532 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.532 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.532 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:53.532 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.752813+0000", 2024-09-12T00:05:53.532 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082384750000000003 2024-09-12T00:05:53.532 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.532 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.532 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:53.532 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773444+0000", 2024-09-12T00:05:53.532 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020630773000000002 2024-09-12T00:05:53.532 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.532 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.533 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.533 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773510+0000", 2024-09-12T00:05:53.533 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6711000000000006e-05 2024-09-12T00:05:53.533 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.533 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.533 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.533 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773579+0000", 2024-09-12T00:05:53.533 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8472000000000004e-05 2024-09-12T00:05:53.533 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.534 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.534 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.534 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.534 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.534 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3039 3.2e 3:74587332:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:53.534 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:53.535 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.664758667000001, 2024-09-12T00:05:53.535 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.036215114, 2024-09-12T00:05:53.535 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:53.535 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:53.535 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:53.535 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:53.535 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:53.535 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:53.535 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3039 2024-09-12T00:05:53.535 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.535 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:53.535 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.536 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:53.536 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:53.536 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.536 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.536 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.536 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:53.536 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:53.536 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.536 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.536 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.536 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:53.536 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835507+0000", 2024-09-12T00:05:53.536 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6e-06 2024-09-12T00:05:53.537 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.537 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.537 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:53.537 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848930+0000", 2024-09-12T00:05:53.537 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013423242 2024-09-12T00:05:53.537 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.537 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.537 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:53.537 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848969+0000", 2024-09-12T00:05:53.537 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9270000000000002e-05 2024-09-12T00:05:53.537 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.537 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.537 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:53.538 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848991+0000", 2024-09-12T00:05:53.538 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1565000000000001e-05 2024-09-12T00:05:53.538 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.538 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.538 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:53.538 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849089+0000", 2024-09-12T00:05:53.538 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8408999999999999e-05 2024-09-12T00:05:53.538 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.538 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.538 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.538 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849518+0000", 2024-09-12T00:05:53.538 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042813900000000002 2024-09-12T00:05:53.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.539 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.539 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:53.539 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849897+0000", 2024-09-12T00:05:53.539 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037936600000000001 2024-09-12T00:05:53.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.539 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.540 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:53.540 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.858549+0000", 2024-09-12T00:05:53.540 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086520820000000002 2024-09-12T00:05:53.540 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.540 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.540 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:53.540 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871522+0000", 2024-09-12T00:05:53.541 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012973182999999999 2024-09-12T00:05:53.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.541 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.541 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.541 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871633+0000", 2024-09-12T00:05:53.541 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011085 2024-09-12T00:05:53.542 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.542 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.542 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.542 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871717+0000", 2024-09-12T00:05:53.542 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.4407999999999996e-05 2024-09-12T00:05:53.542 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.543 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.543 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.543 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.543 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3050 3.b 3:d26f7141:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:53.543 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:53.543 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.543146411000002, 2024-09-12T00:05:53.544 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022896481999999999, 2024-09-12T00:05:53.544 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:53.544 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:53.544 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:53.544 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:53.544 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:53.545 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:53.545 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3050 2024-09-12T00:05:53.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.545 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:53.545 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.545 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:53.546 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:53.546 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.546 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.546 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:53.546 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:53.547 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.547 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.547 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:53.548 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957117+0000", 2024-09-12T00:05:53.548 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7e-06 2024-09-12T00:05:53.548 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.548 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.548 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:53.549 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961673+0000", 2024-09-12T00:05:53.549 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045558059999999999 2024-09-12T00:05:53.549 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.549 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.549 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:53.549 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961698+0000", 2024-09-12T00:05:53.550 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5017000000000001e-05 2024-09-12T00:05:53.550 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.550 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.550 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:53.550 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961710+0000", 2024-09-12T00:05:53.551 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1963999999999999e-05 2024-09-12T00:05:53.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.551 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:53.551 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961785+0000", 2024-09-12T00:05:53.551 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5153000000000004e-05 2024-09-12T00:05:53.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.552 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.552 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961926+0000", 2024-09-12T00:05:53.552 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000141194 2024-09-12T00:05:53.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.553 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:53.553 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.962055+0000", 2024-09-12T00:05:53.553 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012882400000000001 2024-09-12T00:05:53.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.554 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:53.554 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.970716+0000", 2024-09-12T00:05:53.554 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086603610000000001 2024-09-12T00:05:53.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.554 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.555 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:53.555 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979700+0000", 2024-09-12T00:05:53.555 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.008984054 2024-09-12T00:05:53.555 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.555 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.555 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.556 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979884+0000", 2024-09-12T00:05:53.556 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184215 2024-09-12T00:05:53.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.556 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.556 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.556 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.980011+0000", 2024-09-12T00:05:53.556 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012719399999999999 2024-09-12T00:05:53.557 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.557 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.557 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.557 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3065 3.b 3:d10bf58d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:53.558 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:53.558 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.378198791000003, 2024-09-12T00:05:53.558 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021843261999999999, 2024-09-12T00:05:53.558 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:53.558 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:53.558 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:53.559 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:53.559 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:53.559 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:53.559 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3065 2024-09-12T00:05:53.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.559 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:53.559 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.559 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:53.559 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:53.559 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.560 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.560 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:53.560 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:53.560 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.560 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.560 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:53.560 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122067+0000", 2024-09-12T00:05:53.560 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4970000000000003e-06 2024-09-12T00:05:53.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.560 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.561 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:53.561 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126931+0000", 2024-09-12T00:05:53.561 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048641090000000001 2024-09-12T00:05:53.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.561 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.561 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:53.561 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126973+0000", 2024-09-12T00:05:53.561 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1678999999999999e-05 2024-09-12T00:05:53.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.561 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.561 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:53.561 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126999+0000", 2024-09-12T00:05:53.561 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6536000000000001e-05 2024-09-12T00:05:53.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.562 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:53.562 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127118+0000", 2024-09-12T00:05:53.562 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000119373 2024-09-12T00:05:53.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.562 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.562 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127289+0000", 2024-09-12T00:05:53.562 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017020199999999999 2024-09-12T00:05:53.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.562 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:53.563 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127437+0000", 2024-09-12T00:05:53.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148682 2024-09-12T00:05:53.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.563 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.563 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:53.563 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138539+0000", 2024-09-12T00:05:53.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011101418 2024-09-12T00:05:53.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.563 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.563 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:53.563 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143355+0000", 2024-09-12T00:05:53.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048161499999999999 2024-09-12T00:05:53.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.564 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.564 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143777+0000", 2024-09-12T00:05:53.564 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000421896 2024-09-12T00:05:53.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.564 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.564 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143905+0000", 2024-09-12T00:05:53.564 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012872 2024-09-12T00:05:53.564 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.564 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.565 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.565 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.565 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3066 3.21 3:8448517d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:53.565 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:53.565 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 32.368252708999997, 2024-09-12T00:05:53.565 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025911652, 2024-09-12T00:05:53.565 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:53.565 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:53.566 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:53.566 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:53.566 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:53.566 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:53.566 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3066 2024-09-12T00:05:53.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.566 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:53.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.566 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:53.566 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:53.567 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.567 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.567 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:53.567 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:53.567 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.567 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.567 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:53.567 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132011+0000", 2024-09-12T00:05:53.567 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8270000000000002e-06 2024-09-12T00:05:53.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.568 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:53.568 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137934+0000", 2024-09-12T00:05:53.568 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059226119999999998 2024-09-12T00:05:53.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.568 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:53.568 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137968+0000", 2024-09-12T00:05:53.568 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3933000000000002e-05 2024-09-12T00:05:53.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.568 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:53.569 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137985+0000", 2024-09-12T00:05:53.569 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7725999999999999e-05 2024-09-12T00:05:53.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.569 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.569 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:53.569 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138084+0000", 2024-09-12T00:05:53.569 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8450999999999996e-05 2024-09-12T00:05:53.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.569 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.569 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.569 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138285+0000", 2024-09-12T00:05:53.569 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000201411 2024-09-12T00:05:53.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:53.570 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138510+0000", 2024-09-12T00:05:53.570 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000224551 2024-09-12T00:05:53.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:53.570 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.146242+0000", 2024-09-12T00:05:53.570 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077317649999999998 2024-09-12T00:05:53.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:53.570 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157728+0000", 2024-09-12T00:05:53.570 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011486424 2024-09-12T00:05:53.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.571 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157833+0000", 2024-09-12T00:05:53.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105234 2024-09-12T00:05:53.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.571 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157920+0000", 2024-09-12T00:05:53.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6718000000000006e-05 2024-09-12T00:05:53.571 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.572 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.572 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.572 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.572 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3112 3.b 3:d1cf91a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:53.572 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:53.572 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 31.749535582, 2024-09-12T00:05:53.572 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021203475999999999, 2024-09-12T00:05:53.572 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:53.572 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:53.572 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:53.573 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:53.573 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:53.573 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:53.573 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3112 2024-09-12T00:05:53.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.573 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:53.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.573 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:53.573 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:53.574 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.574 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:53.574 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:53.574 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.574 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:53.574 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750728+0000", 2024-09-12T00:05:53.575 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.165e-06 2024-09-12T00:05:53.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.575 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.575 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:53.575 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755063+0000", 2024-09-12T00:05:53.575 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043355379999999999 2024-09-12T00:05:53.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.575 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.575 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:53.575 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755103+0000", 2024-09-12T00:05:53.576 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9962000000000001e-05 2024-09-12T00:05:53.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.576 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:53.576 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755120+0000", 2024-09-12T00:05:53.576 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6793e-05 2024-09-12T00:05:53.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.576 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:53.577 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755299+0000", 2024-09-12T00:05:53.577 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017904499999999999 2024-09-12T00:05:53.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.577 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.577 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.577 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755758+0000", 2024-09-12T00:05:53.577 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000458815 2024-09-12T00:05:53.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.577 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.577 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:53.577 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.756304+0000", 2024-09-12T00:05:53.577 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000546183 2024-09-12T00:05:53.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.578 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:53.578 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771518+0000", 2024-09-12T00:05:53.578 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015214236000000001 2024-09-12T00:05:53.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.578 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:53.578 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771827+0000", 2024-09-12T00:05:53.578 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000309308 2024-09-12T00:05:53.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.579 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.579 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771874+0000", 2024-09-12T00:05:53.579 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6119999999999999e-05 2024-09-12T00:05:53.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.579 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.579 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.579 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771929+0000", 2024-09-12T00:05:53.579 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5310999999999999e-05 2024-09-12T00:05:53.579 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.579 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.579 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.579 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.580 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3115 3.2e 3:75803fec:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:53.580 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:53.580 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 31.711564532000001, 2024-09-12T00:05:53.580 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020205041, 2024-09-12T00:05:53.580 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:53.580 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:53.580 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:53.580 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:53.580 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:53.580 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:53.580 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3115 2024-09-12T00:05:53.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.580 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:53.581 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.581 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:53.581 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:53.581 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.581 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.581 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:53.581 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:53.581 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.581 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.581 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:53.582 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788700+0000", 2024-09-12T00:05:53.582 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.614e-06 2024-09-12T00:05:53.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.582 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:53.582 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793576+0000", 2024-09-12T00:05:53.582 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048760920000000003 2024-09-12T00:05:53.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.582 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:53.582 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793610+0000", 2024-09-12T00:05:53.582 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4184999999999999e-05 2024-09-12T00:05:53.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.583 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:53.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793633+0000", 2024-09-12T00:05:53.583 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2551000000000001e-05 2024-09-12T00:05:53.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.583 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.583 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:53.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793750+0000", 2024-09-12T00:05:53.583 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117057 2024-09-12T00:05:53.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.583 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.583 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793975+0000", 2024-09-12T00:05:53.583 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022493099999999999 2024-09-12T00:05:53.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.584 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.584 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:53.584 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.794178+0000", 2024-09-12T00:05:53.584 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000202726 2024-09-12T00:05:53.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.584 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.584 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:53.584 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.803725+0000", 2024-09-12T00:05:53.584 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095470599999999996 2024-09-12T00:05:53.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.585 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.585 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:53.585 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808706+0000", 2024-09-12T00:05:53.585 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049814519999999999 2024-09-12T00:05:53.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.585 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.585 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.585 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808785+0000", 2024-09-12T00:05:53.585 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9160999999999996e-05 2024-09-12T00:05:53.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.586 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.586 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.586 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808902+0000", 2024-09-12T00:05:53.586 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000116212 2024-09-12T00:05:53.586 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.586 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.586 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.586 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.587 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.587 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3380 3.23 e82/23 3:c6c9ccf8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_7:head v 82'5, mlcod=76'3)", 2024-09-12T00:05:53.587 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:05:53.587 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.793739514, 2024-09-12T00:05:53.587 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.029708818000000001, 2024-09-12T00:05:53.587 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:53.588 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:53.588 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:53.588 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:53.588 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.588 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:53.588 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:05:53.588 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.588 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.588 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:53.588 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:05:53.588 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.589 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.589 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:53.589 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:05:53.589 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1600000000000001e-07 2024-09-12T00:05:53.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.589 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.589 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:53.589 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.710842+0000", 2024-09-12T00:05:53.589 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043204510000000003 2024-09-12T00:05:53.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.589 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.589 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:53.589 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.710875+0000", 2024-09-12T00:05:53.590 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2702e-05 2024-09-12T00:05:53.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.590 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.590 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:53.590 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.710895+0000", 2024-09-12T00:05:53.590 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0094000000000001e-05 2024-09-12T00:05:53.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.590 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.590 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:53.590 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.711063+0000", 2024-09-12T00:05:53.590 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000167517 2024-09-12T00:05:53.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.590 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.590 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.590 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.711127+0000", 2024-09-12T00:05:53.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4004999999999995e-05 2024-09-12T00:05:53.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.591 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.591 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.736095+0000", 2024-09-12T00:05:53.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024968008999999999 2024-09-12T00:05:53.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.591 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.591 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.736230+0000", 2024-09-12T00:05:53.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013552400000000001 2024-09-12T00:05:53.591 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.591 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.591 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.592 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.592 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3409 3.b 3:d39a1970:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:53.592 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:41.028923+0000", 2024-09-12T00:05:53.592 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.471338497, 2024-09-12T00:05:53.592 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030518363999999999, 2024-09-12T00:05:53.592 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:53.592 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:53.592 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:53.592 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:53.592 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:53.592 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:53.592 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3409 2024-09-12T00:05:53.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.593 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:53.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.593 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:53.593 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.028923+0000", 2024-09-12T00:05:53.593 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.593 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:53.593 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.028923+0000", 2024-09-12T00:05:53.593 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.593 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:53.593 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.028926+0000", 2024-09-12T00:05:53.594 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1e-06 2024-09-12T00:05:53.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.594 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.594 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:53.594 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038010+0000", 2024-09-12T00:05:53.594 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0090839110000000001 2024-09-12T00:05:53.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.594 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.594 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:53.594 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038042+0000", 2024-09-12T00:05:53.594 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2425999999999998e-05 2024-09-12T00:05:53.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.594 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.595 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:53.595 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038060+0000", 2024-09-12T00:05:53.595 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8219e-05 2024-09-12T00:05:53.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.595 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:53.595 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038205+0000", 2024-09-12T00:05:53.595 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014503500000000001 2024-09-12T00:05:53.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.595 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.595 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038498+0000", 2024-09-12T00:05:53.595 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00029289499999999999 2024-09-12T00:05:53.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.596 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.596 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:53.596 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038752+0000", 2024-09-12T00:05:53.596 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025434500000000001 2024-09-12T00:05:53.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.596 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.596 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:53.596 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.058529+0000", 2024-09-12T00:05:53.596 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019776275999999999 2024-09-12T00:05:53.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.596 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.597 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:53.597 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.059147+0000", 2024-09-12T00:05:53.597 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00061837199999999995 2024-09-12T00:05:53.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.597 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.597 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.597 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.059328+0000", 2024-09-12T00:05:53.597 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018048399999999999 2024-09-12T00:05:53.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.597 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.598 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.598 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.059441+0000", 2024-09-12T00:05:53.598 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011330100000000001 2024-09-12T00:05:53.598 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.598 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.598 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.598 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.599 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3665 3.21 3:85e29f15:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_282:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:53.599 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:43.757083+0000", 2024-09-12T00:05:53.599 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 9.7431777830000001, 2024-09-12T00:05:53.599 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021222119000000001, 2024-09-12T00:05:53.599 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:53.599 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:53.599 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:53.600 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:53.600 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:53.600 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:53.600 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3665 2024-09-12T00:05:53.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.600 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:53.601 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.601 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:53.601 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.757083+0000", 2024-09-12T00:05:53.601 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.601 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.601 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:53.601 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.757083+0000", 2024-09-12T00:05:53.602 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.602 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.602 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:53.602 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.757087+0000", 2024-09-12T00:05:53.602 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2370000000000003e-06 2024-09-12T00:05:53.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.603 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.603 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:53.603 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763296+0000", 2024-09-12T00:05:53.603 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0062089240000000002 2024-09-12T00:05:53.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.603 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.603 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:53.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763337+0000", 2024-09-12T00:05:53.604 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1032999999999998e-05 2024-09-12T00:05:53.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:53.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763356+0000", 2024-09-12T00:05:53.604 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8292999999999999e-05 2024-09-12T00:05:53.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:53.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763485+0000", 2024-09-12T00:05:53.605 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012931499999999999 2024-09-12T00:05:53.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.606 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763704+0000", 2024-09-12T00:05:53.606 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021922399999999999 2024-09-12T00:05:53.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.606 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.606 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:53.606 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763888+0000", 2024-09-12T00:05:53.606 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184146 2024-09-12T00:05:53.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.607 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.607 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:53.607 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.772359+0000", 2024-09-12T00:05:53.607 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0084704089999999999 2024-09-12T00:05:53.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.607 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.607 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:53.607 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.778004+0000", 2024-09-12T00:05:53.608 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0056452619999999998 2024-09-12T00:05:53.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.608 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.608 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.608 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.778173+0000", 2024-09-12T00:05:53.608 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016846299999999999 2024-09-12T00:05:53.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.608 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.609 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.609 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.778305+0000", 2024-09-12T00:05:53.609 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013281299999999999 2024-09-12T00:05:53.609 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.609 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.609 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.610 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.610 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3696 3.21 3:872f3075:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_313:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:53.610 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.301332+0000", 2024-09-12T00:05:53.610 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 9.1989293130000007, 2024-09-12T00:05:53.610 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024918241000000001, 2024-09-12T00:05:53.610 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:53.610 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:53.611 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:53.611 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:53.611 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:53.611 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:53.611 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3696 2024-09-12T00:05:53.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.612 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:53.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.612 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:53.612 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.301332+0000", 2024-09-12T00:05:53.612 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.613 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:53.613 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.301332+0000", 2024-09-12T00:05:53.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.613 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:53.614 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.301335+0000", 2024-09-12T00:05:53.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9679999999999998e-06 2024-09-12T00:05:53.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.614 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:53.614 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.305984+0000", 2024-09-12T00:05:53.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046492249999999999 2024-09-12T00:05:53.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:53.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306009+0000", 2024-09-12T00:05:53.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5252000000000001e-05 2024-09-12T00:05:53.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:53.616 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306023+0000", 2024-09-12T00:05:53.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3903000000000001e-05 2024-09-12T00:05:53.616 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.616 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.616 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:53.616 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306193+0000", 2024-09-12T00:05:53.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017032500000000001 2024-09-12T00:05:53.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.617 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306594+0000", 2024-09-12T00:05:53.617 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040111600000000003 2024-09-12T00:05:53.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:53.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.307002+0000", 2024-09-12T00:05:53.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040796000000000002 2024-09-12T00:05:53.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.618 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:53.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.319319+0000", 2024-09-12T00:05:53.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012317033 2024-09-12T00:05:53.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.619 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:53.619 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.325949+0000", 2024-09-12T00:05:53.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0066298110000000002 2024-09-12T00:05:53.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.619 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.620 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.326123+0000", 2024-09-12T00:05:53.620 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017416999999999999 2024-09-12T00:05:53.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.620 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.620 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.326250+0000", 2024-09-12T00:05:53.620 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012647799999999999 2024-09-12T00:05:53.621 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.621 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.621 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.621 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3737 3.b 3:d32629e2:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_354:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:53.621 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.993654+0000", 2024-09-12T00:05:53.621 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.5066069930000001, 2024-09-12T00:05:53.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022195105999999999, 2024-09-12T00:05:53.622 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:53.622 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:53.622 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:53.622 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:53.622 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:53.622 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:53.622 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3737 2024-09-12T00:05:53.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.623 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:53.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.623 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:53.623 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.993654+0000", 2024-09-12T00:05:53.623 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:53.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.993654+0000", 2024-09-12T00:05:53.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:53.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.993657+0000", 2024-09-12T00:05:53.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2600000000000001e-06 2024-09-12T00:05:53.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:53.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.997886+0000", 2024-09-12T00:05:53.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004228646 2024-09-12T00:05:53.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:53.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.997924+0000", 2024-09-12T00:05:53.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7632999999999997e-05 2024-09-12T00:05:53.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:53.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.997942+0000", 2024-09-12T00:05:53.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8352999999999999e-05 2024-09-12T00:05:53.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:53.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.998101+0000", 2024-09-12T00:05:53.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015922500000000001 2024-09-12T00:05:53.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.998375+0000", 2024-09-12T00:05:53.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027389500000000002 2024-09-12T00:05:53.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:53.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.998611+0000", 2024-09-12T00:05:53.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023559199999999999 2024-09-12T00:05:53.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:53.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009636+0000", 2024-09-12T00:05:53.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011025188 2024-09-12T00:05:53.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.628 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.628 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:53.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.015538+0000", 2024-09-12T00:05:53.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059023590000000003 2024-09-12T00:05:53.628 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.628 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.628 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.015717+0000", 2024-09-12T00:05:53.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017847699999999999 2024-09-12T00:05:53.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.629 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.629 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.629 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.015849+0000", 2024-09-12T00:05:53.629 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000132478 2024-09-12T00:05:53.629 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.629 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.629 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.629 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.629 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3738 3.2e 3:74a476b8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_355:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:53.629 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.005209+0000", 2024-09-12T00:05:53.630 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.4950515180000004, 2024-09-12T00:05:53.630 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022771276999999999, 2024-09-12T00:05:53.630 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:53.630 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:53.630 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:53.630 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:53.630 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:53.630 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:53.630 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3738 2024-09-12T00:05:53.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.630 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:53.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.631 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:53.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.005209+0000", 2024-09-12T00:05:53.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.631 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.631 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:53.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.005209+0000", 2024-09-12T00:05:53.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.631 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.631 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:53.631 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.005213+0000", 2024-09-12T00:05:53.631 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4170000000000001e-06 2024-09-12T00:05:53.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009471+0000", 2024-09-12T00:05:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042583400000000002 2024-09-12T00:05:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009506+0000", 2024-09-12T00:05:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4625999999999997e-05 2024-09-12T00:05:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009524+0000", 2024-09-12T00:05:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7745999999999999e-05 2024-09-12T00:05:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009649+0000", 2024-09-12T00:05:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000124948 2024-09-12T00:05:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009889+0000", 2024-09-12T00:05:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024013999999999999 2024-09-12T00:05:53.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.634 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:53.634 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.010104+0000", 2024-09-12T00:05:53.634 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021549199999999999 2024-09-12T00:05:53.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.634 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:53.634 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.022243+0000", 2024-09-12T00:05:53.634 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012138793 2024-09-12T00:05:53.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.634 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.634 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:53.635 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.027764+0000", 2024-09-12T00:05:53.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0055207820000000001 2024-09-12T00:05:53.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.635 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.635 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.635 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.027859+0000", 2024-09-12T00:05:53.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5441999999999999e-05 2024-09-12T00:05:53.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.635 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.635 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.635 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.027981+0000", 2024-09-12T00:05:53.635 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000121551 2024-09-12T00:05:53.635 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.636 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.636 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.636 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.636 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3758 3.2e 3:7790af15:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_375:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:53.636 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.228203+0000", 2024-09-12T00:05:53.636 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.2720577019999997, 2024-09-12T00:05:53.636 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.032647253000000001, 2024-09-12T00:05:53.636 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:53.636 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:53.636 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:53.636 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:53.636 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:53.636 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:53.637 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3758 2024-09-12T00:05:53.637 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.637 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:53.637 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.637 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:53.637 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.228203+0000", 2024-09-12T00:05:53.637 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.637 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.637 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.637 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:53.637 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.228203+0000", 2024-09-12T00:05:53.637 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.638 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.638 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.638 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:53.638 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.228208+0000", 2024-09-12T00:05:53.638 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3900000000000003e-06 2024-09-12T00:05:53.638 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.638 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.638 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:53.638 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239226+0000", 2024-09-12T00:05:53.638 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011018155 2024-09-12T00:05:53.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.639 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.639 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:53.639 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239265+0000", 2024-09-12T00:05:53.639 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9419000000000003e-05 2024-09-12T00:05:53.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.639 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.639 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:53.639 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239291+0000", 2024-09-12T00:05:53.639 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6173000000000002e-05 2024-09-12T00:05:53.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.639 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.639 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:53.640 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239430+0000", 2024-09-12T00:05:53.640 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000138071 2024-09-12T00:05:53.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.640 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.640 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.640 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239676+0000", 2024-09-12T00:05:53.640 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024695899999999999 2024-09-12T00:05:53.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.640 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.640 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:53.640 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239895+0000", 2024-09-12T00:05:53.640 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021808999999999999 2024-09-12T00:05:53.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.641 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.641 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:53.641 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.255130+0000", 2024-09-12T00:05:53.641 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015235907999999999 2024-09-12T00:05:53.641 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.641 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.641 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:53.641 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.260520+0000", 2024-09-12T00:05:53.641 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053894340000000002 2024-09-12T00:05:53.641 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.641 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.641 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.641 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.260700+0000", 2024-09-12T00:05:53.642 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018017099999999999 2024-09-12T00:05:53.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.642 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.642 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.642 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.260851+0000", 2024-09-12T00:05:53.642 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000150483 2024-09-12T00:05:53.642 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.642 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.642 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.642 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.642 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3760 3.b 3:d2eb500d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_377:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:53.642 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.251207+0000", 2024-09-12T00:05:53.643 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 8.2490540449999994, 2024-09-12T00:05:53.643 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022210074, 2024-09-12T00:05:53.643 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:53.643 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:53.643 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:53.643 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:53.643 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:53.643 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:53.643 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3760 2024-09-12T00:05:53.643 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.643 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:53.643 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.643 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:53.643 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.251207+0000", 2024-09-12T00:05:53.644 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.644 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.644 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.644 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:53.644 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.251207+0000", 2024-09-12T00:05:53.644 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.644 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.644 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.644 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:53.644 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.251210+0000", 2024-09-12T00:05:53.644 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1130000000000001e-06 2024-09-12T00:05:53.644 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.644 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.645 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:53.645 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.256588+0000", 2024-09-12T00:05:53.645 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005378201 2024-09-12T00:05:53.645 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.645 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.645 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:53.645 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.256622+0000", 2024-09-12T00:05:53.645 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3246e-05 2024-09-12T00:05:53.645 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.645 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.645 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:53.645 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.256642+0000", 2024-09-12T00:05:53.645 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0786000000000001e-05 2024-09-12T00:05:53.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.646 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.646 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:53.646 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.256767+0000", 2024-09-12T00:05:53.646 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012475799999999999 2024-09-12T00:05:53.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.646 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.646 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.646 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.257047+0000", 2024-09-12T00:05:53.646 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028016199999999998 2024-09-12T00:05:53.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.646 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.646 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:53.646 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.257276+0000", 2024-09-12T00:05:53.647 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022880900000000001 2024-09-12T00:05:53.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.647 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.647 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:53.647 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.272093+0000", 2024-09-12T00:05:53.647 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014816757999999999 2024-09-12T00:05:53.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.647 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.647 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:53.647 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.273101+0000", 2024-09-12T00:05:53.647 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0010080340000000001 2024-09-12T00:05:53.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.647 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.648 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.648 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.273283+0000", 2024-09-12T00:05:53.648 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000181993 2024-09-12T00:05:53.648 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.648 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.648 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.648 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.273417+0000", 2024-09-12T00:05:53.648 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013421400000000001 2024-09-12T00:05:53.648 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.648 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.649 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.649 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.649 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.649 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3793 3.21 3:8684dc70:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_410:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:53.649 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.629422+0000", 2024-09-12T00:05:53.649 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 7.8708391129999997, 2024-09-12T00:05:53.649 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027123878000000001, 2024-09-12T00:05:53.649 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:53.649 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:53.649 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:53.649 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:53.650 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:53.650 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:53.650 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3793 2024-09-12T00:05:53.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.650 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:53.650 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.650 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:53.650 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.629422+0000", 2024-09-12T00:05:53.650 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.650 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.650 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:53.650 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.629422+0000", 2024-09-12T00:05:53.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:53.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.651 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.651 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:53.651 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.629426+0000", 2024-09-12T00:05:53.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7129999999999999e-06 2024-09-12T00:05:53.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.651 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.651 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:53.651 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635537+0000", 2024-09-12T00:05:53.651 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061111220000000001 2024-09-12T00:05:53.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.651 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.651 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:53.652 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635578+0000", 2024-09-12T00:05:53.652 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1730000000000002e-05 2024-09-12T00:05:53.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.652 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.652 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:53.652 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635605+0000", 2024-09-12T00:05:53.652 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6792999999999999e-05 2024-09-12T00:05:53.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.652 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.652 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:53.652 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635747+0000", 2024-09-12T00:05:53.652 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014160999999999999 2024-09-12T00:05:53.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.652 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.653 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:53.653 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635998+0000", 2024-09-12T00:05:53.653 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025098600000000003 2024-09-12T00:05:53.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.653 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.653 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:53.653 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.636254+0000", 2024-09-12T00:05:53.653 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025597 2024-09-12T00:05:53.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.653 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.653 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:53.653 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.653522+0000", 2024-09-12T00:05:53.653 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017268229999999999 2024-09-12T00:05:53.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.654 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.654 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:53.654 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.656375+0000", 2024-09-12T00:05:53.654 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0028530930000000001 2024-09-12T00:05:53.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.654 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.654 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:53.654 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.656471+0000", 2024-09-12T00:05:53.654 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5904999999999997e-05 2024-09-12T00:05:53.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:53.654 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:53.654 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:53.654 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.656546+0000", 2024-09-12T00:05:53.655 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4726000000000002e-05 2024-09-12T00:05:53.655 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.655 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.655 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.655 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:53.655 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:53.655 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:53.655 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T00:05:53.656 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T00:05:53.656 INFO:tasks.thrashosds.thrasher:Removing osd 3, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T00:05:53.656 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 3 2024-09-12T00:05:53.657 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:53.656+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:53.658 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:05:53.758 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:53.760+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:53.781 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:53.781 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:53.781 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:05:53.781 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:53.798 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:05:53.889 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:53.892+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:53.960 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:53.960 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:53.960 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:05:53.961 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:05:53.961 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:53.961 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:53.960+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:53.974 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:05:53.991 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T00:05:53.992+0000 7f75f4819640 -1 mon.a@0(leader).osd e86 definitely_dead 0 2024-09-12T00:05:54.062 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:54.064+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:54.123 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:54.123 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:05:54.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:05:54.123 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:05:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:05:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:05:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 142.79234003600001, 2024-09-12T00:05:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.027441031000000001, 2024-09-12T00:05:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:05:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:05:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:05:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330357+0000", 2024-09-12T00:05:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2339999999999996e-06 2024-09-12T00:05:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330381+0000", 2024-09-12T00:05:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4626000000000001e-05 2024-09-12T00:05:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330417+0000", 2024-09-12T00:05:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5886000000000002e-05 2024-09-12T00:05:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330442+0000", 2024-09-12T00:05:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4522999999999999e-05 2024-09-12T00:05:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335485+0000", 2024-09-12T00:05:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050432589999999996 2024-09-12T00:05:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:05:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335507+0000", 2024-09-12T00:05:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2013000000000001e-05 2024-09-12T00:05:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.351747+0000", 2024-09-12T00:05:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016240451999999999 2024-09-12T00:05:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352062+0000", 2024-09-12T00:05:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031433399999999999 2024-09-12T00:05:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352378+0000", 2024-09-12T00:05:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031586400000000001 2024-09-12T00:05:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.355074+0000", 2024-09-12T00:05:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026962919999999999 2024-09-12T00:05:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357537+0000", 2024-09-12T00:05:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024634689999999998 2024-09-12T00:05:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357680+0000", 2024-09-12T00:05:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014314899999999999 2024-09-12T00:05:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357793+0000", 2024-09-12T00:05:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011293 2024-09-12T00:05:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2748 3.3b 3:df6d92a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:05:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 66.023852176000005, 2024-09-12T00:05:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.023574735999999999, 2024-09-12T00:05:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2748 2024-09-12T00:05:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:05:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:05:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098844+0000", 2024-09-12T00:05:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1570000000000002e-06 2024-09-12T00:05:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100354+0000", 2024-09-12T00:05:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001509544 2024-09-12T00:05:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100383+0000", 2024-09-12T00:05:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9386e-05 2024-09-12T00:05:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100399+0000", 2024-09-12T00:05:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5883999999999999e-05 2024-09-12T00:05:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100507+0000", 2024-09-12T00:05:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010822 2024-09-12T00:05:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100704+0000", 2024-09-12T00:05:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019658499999999999 2024-09-12T00:05:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100901+0000", 2024-09-12T00:05:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000196505 2024-09-12T00:05:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112178+0000", 2024-09-12T00:05:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011277718000000001 2024-09-12T00:05:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122285+0000", 2024-09-12T00:05:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010106327 2024-09-12T00:05:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122358+0000", 2024-09-12T00:05:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3640999999999995e-05 2024-09-12T00:05:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122415+0000", 2024-09-12T00:05:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6768999999999998e-05 2024-09-12T00:05:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2964 3.24 e75/23 3:26c83ec0:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_3:head v 75'6, mlcod=63'4)", 2024-09-12T00:05:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:05:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 34.110431155000001, 2024-09-12T00:05:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022426814, 2024-09-12T00:05:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:05:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:05:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012263+0000", 2024-09-12T00:05:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.091e-06 2024-09-12T00:05:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018390+0000", 2024-09-12T00:05:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061264600000000002 2024-09-12T00:05:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018419+0000", 2024-09-12T00:05:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8979000000000002e-05 2024-09-12T00:05:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018434+0000", 2024-09-12T00:05:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4781e-05 2024-09-12T00:05:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018528+0000", 2024-09-12T00:05:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.4333000000000006e-05 2024-09-12T00:05:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018559+0000", 2024-09-12T00:05:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1557999999999998e-05 2024-09-12T00:05:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.034615+0000", 2024-09-12T00:05:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016055834000000001 2024-09-12T00:05:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.034688+0000", 2024-09-12T00:05:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2778e-05 2024-09-12T00:05:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2965 3.e e75/23 3:70fff61e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_4:head v 75'5, mlcod=63'3)", 2024-09-12T00:05:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:05:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 34.102920933999997, 2024-09-12T00:05:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021839210000000001, 2024-09-12T00:05:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:05:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:05:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019773+0000", 2024-09-12T00:05:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4839999999999999e-06 2024-09-12T00:05:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021570+0000", 2024-09-12T00:05:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017965570000000001 2024-09-12T00:05:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021587+0000", 2024-09-12T00:05:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7938e-05 2024-09-12T00:05:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021598+0000", 2024-09-12T00:05:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0553e-05 2024-09-12T00:05:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021676+0000", 2024-09-12T00:05:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8034000000000005e-05 2024-09-12T00:05:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021706+0000", 2024-09-12T00:05:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9915000000000001e-05 2024-09-12T00:05:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.041519+0000", 2024-09-12T00:05:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019813171000000001 2024-09-12T00:05:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.041611+0000", 2024-09-12T00:05:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1558000000000007e-05 2024-09-12T00:05:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3004 3.36 3:6cc4f27f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:05:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 33.684521736999997, 2024-09-12T00:05:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.042951743000000001, 2024-09-12T00:05:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3004 2024-09-12T00:05:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:05:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.147 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.147 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:05:54.147 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.147 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.147 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438175+0000", 2024-09-12T00:05:54.147 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1640000000000003e-06 2024-09-12T00:05:54.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.147 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.147 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439732+0000", 2024-09-12T00:05:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015574510000000001 2024-09-12T00:05:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439758+0000", 2024-09-12T00:05:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6074000000000001e-05 2024-09-12T00:05:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439768+0000", 2024-09-12T00:05:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8770000000000005e-06 2024-09-12T00:05:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439874+0000", 2024-09-12T00:05:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105583 2024-09-12T00:05:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.440078+0000", 2024-09-12T00:05:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020388200000000001 2024-09-12T00:05:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.440251+0000", 2024-09-12T00:05:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017339100000000001 2024-09-12T00:05:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.459982+0000", 2024-09-12T00:05:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01973099 2024-09-12T00:05:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.480958+0000", 2024-09-12T00:05:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020975730000000001 2024-09-12T00:05:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481034+0000", 2024-09-12T00:05:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6224999999999996e-05 2024-09-12T00:05:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481122+0000", 2024-09-12T00:05:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8375999999999995e-05 2024-09-12T00:05:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3005 3.35 3:ae3b5a36:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:05:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 33.675268053000003, 2024-09-12T00:05:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.028828275, 2024-09-12T00:05:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3005 2024-09-12T00:05:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:05:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:05:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447427+0000", 2024-09-12T00:05:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.864e-06 2024-09-12T00:05:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449003+0000", 2024-09-12T00:05:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001575405 2024-09-12T00:05:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449030+0000", 2024-09-12T00:05:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7189999999999999e-05 2024-09-12T00:05:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449042+0000", 2024-09-12T00:05:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2038999999999999e-05 2024-09-12T00:05:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449111+0000", 2024-09-12T00:05:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9521000000000001e-05 2024-09-12T00:05:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449218+0000", 2024-09-12T00:05:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010675600000000001 2024-09-12T00:05:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449330+0000", 2024-09-12T00:05:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000111809 2024-09-12T00:05:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.469844+0000", 2024-09-12T00:05:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020514277000000001 2024-09-12T00:05:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.475983+0000", 2024-09-12T00:05:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061392540000000002 2024-09-12T00:05:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.476113+0000", 2024-09-12T00:05:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000129713 2024-09-12T00:05:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.476253+0000", 2024-09-12T00:05:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013944700000000001 2024-09-12T00:05:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3006 3.3 3:c183ca95:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:05:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 33.665741482000001, 2024-09-12T00:05:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.024661756, 2024-09-12T00:05:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3006 2024-09-12T00:05:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:05:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:05:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456954+0000", 2024-09-12T00:05:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7070000000000001e-06 2024-09-12T00:05:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458684+0000", 2024-09-12T00:05:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017305479999999999 2024-09-12T00:05:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458709+0000", 2024-09-12T00:05:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4780999999999999e-05 2024-09-12T00:05:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458719+0000", 2024-09-12T00:05:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0202e-05 2024-09-12T00:05:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458800+0000", 2024-09-12T00:05:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0893e-05 2024-09-12T00:05:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458990+0000", 2024-09-12T00:05:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018986400000000001 2024-09-12T00:05:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.459171+0000", 2024-09-12T00:05:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018135499999999999 2024-09-12T00:05:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.478356+0000", 2024-09-12T00:05:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019185153 2024-09-12T00:05:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481411+0000", 2024-09-12T00:05:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030546190000000002 2024-09-12T00:05:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481511+0000", 2024-09-12T00:05:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.9763e-05 2024-09-12T00:05:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481613+0000", 2024-09-12T00:05:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101871 2024-09-12T00:05:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3037 3.39 3:9eefb4c1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:05:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 33.307474075000002, 2024-09-12T00:05:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020855543000000001, 2024-09-12T00:05:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3037 2024-09-12T00:05:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:05:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:05:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815221+0000", 2024-09-12T00:05:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1540000000000002e-06 2024-09-12T00:05:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817594+0000", 2024-09-12T00:05:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023728880000000001 2024-09-12T00:05:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817618+0000", 2024-09-12T00:05:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3635e-05 2024-09-12T00:05:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817633+0000", 2024-09-12T00:05:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4559000000000001e-05 2024-09-12T00:05:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817734+0000", 2024-09-12T00:05:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101729 2024-09-12T00:05:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817939+0000", 2024-09-12T00:05:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020489299999999999 2024-09-12T00:05:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.818113+0000", 2024-09-12T00:05:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000173413 2024-09-12T00:05:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.825676+0000", 2024-09-12T00:05:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075635260000000001 2024-09-12T00:05:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.835921+0000", 2024-09-12T00:05:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010244932999999999 2024-09-12T00:05:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.836006+0000", 2024-09-12T00:05:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5427999999999996e-05 2024-09-12T00:05:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.836074+0000", 2024-09-12T00:05:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7385000000000006e-05 2024-09-12T00:05:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3375 3.15 3:ab335e39:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.646143+0000", 2024-09-12T00:05:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.476549631999999, 2024-09-12T00:05:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026933417000000001, 2024-09-12T00:05:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3375 2024-09-12T00:05:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.646143+0000", 2024-09-12T00:05:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.646143+0000", 2024-09-12T00:05:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.646146+0000", 2024-09-12T00:05:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.19e-06 2024-09-12T00:05:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648608+0000", 2024-09-12T00:05:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024615470000000001 2024-09-12T00:05:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648640+0000", 2024-09-12T00:05:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2342999999999998e-05 2024-09-12T00:05:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648655+0000", 2024-09-12T00:05:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5034e-05 2024-09-12T00:05:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648746+0000", 2024-09-12T00:05:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1529999999999999e-05 2024-09-12T00:05:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648938+0000", 2024-09-12T00:05:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191819 2024-09-12T00:05:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.649102+0000", 2024-09-12T00:05:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000164103 2024-09-12T00:05:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.658869+0000", 2024-09-12T00:05:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0097663530000000002 2024-09-12T00:05:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.672958+0000", 2024-09-12T00:05:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014089295 2024-09-12T00:05:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.673024+0000", 2024-09-12T00:05:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5834999999999996e-05 2024-09-12T00:05:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.673076+0000", 2024-09-12T00:05:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2367999999999997e-05 2024-09-12T00:05:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3392 3.1b e82/23 3:d9b2c983:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_19:head v 82'11, mlcod=76'9)", 2024-09-12T00:05:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.841020+0000", 2024-09-12T00:05:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.281672561000001, 2024-09-12T00:05:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022540108999999999, 2024-09-12T00:05:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.841020+0000", 2024-09-12T00:05:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.841020+0000", 2024-09-12T00:05:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.841022+0000", 2024-09-12T00:05:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4339999999999999e-06 2024-09-12T00:05:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847015+0000", 2024-09-12T00:05:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.005993104 2024-09-12T00:05:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847030+0000", 2024-09-12T00:05:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4595e-05 2024-09-12T00:05:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847041+0000", 2024-09-12T00:05:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1124000000000001e-05 2024-09-12T00:05:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847334+0000", 2024-09-12T00:05:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000292854 2024-09-12T00:05:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847371+0000", 2024-09-12T00:05:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7336000000000003e-05 2024-09-12T00:05:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.863502+0000", 2024-09-12T00:05:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016130314999999999 2024-09-12T00:05:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.863560+0000", 2024-09-12T00:05:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8347000000000002e-05 2024-09-12T00:05:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3399 3.c 3:33260d65:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.912770+0000", 2024-09-12T00:05:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.209922416, 2024-09-12T00:05:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021761494999999999, 2024-09-12T00:05:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3399 2024-09-12T00:05:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.912770+0000", 2024-09-12T00:05:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.912770+0000", 2024-09-12T00:05:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.912773+0000", 2024-09-12T00:05:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.252e-06 2024-09-12T00:05:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915156+0000", 2024-09-12T00:05:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023823109999999998 2024-09-12T00:05:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915244+0000", 2024-09-12T00:05:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8926999999999997e-05 2024-09-12T00:05:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915265+0000", 2024-09-12T00:05:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0613999999999999e-05 2024-09-12T00:05:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915361+0000", 2024-09-12T00:05:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5542000000000001e-05 2024-09-12T00:05:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915538+0000", 2024-09-12T00:05:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017762400000000001 2024-09-12T00:05:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915710+0000", 2024-09-12T00:05:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017170900000000001 2024-09-12T00:05:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.933564+0000", 2024-09-12T00:05:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017854080000000001 2024-09-12T00:05:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.934450+0000", 2024-09-12T00:05:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00088595700000000004 2024-09-12T00:05:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.934490+0000", 2024-09-12T00:05:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0110000000000001e-05 2024-09-12T00:05:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.934531+0000", 2024-09-12T00:05:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1369000000000003e-05 2024-09-12T00:05:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3678 3.15 3:a83db90f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_295:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:43.938089+0000", 2024-09-12T00:05:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.184603284, 2024-09-12T00:05:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021578831999999999, 2024-09-12T00:05:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3678 2024-09-12T00:05:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.938089+0000", 2024-09-12T00:05:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.938089+0000", 2024-09-12T00:05:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.938094+0000", 2024-09-12T00:05:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0719999999999999e-06 2024-09-12T00:05:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940370+0000", 2024-09-12T00:05:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022759159999999998 2024-09-12T00:05:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940401+0000", 2024-09-12T00:05:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1226999999999998e-05 2024-09-12T00:05:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940417+0000", 2024-09-12T00:05:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5603e-05 2024-09-12T00:05:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940499+0000", 2024-09-12T00:05:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1568000000000002e-05 2024-09-12T00:05:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940703+0000", 2024-09-12T00:05:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000203995 2024-09-12T00:05:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940947+0000", 2024-09-12T00:05:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024444799999999997 2024-09-12T00:05:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.950088+0000", 2024-09-12T00:05:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091408710000000001 2024-09-12T00:05:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.959534+0000", 2024-09-12T00:05:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0094463979999999999 2024-09-12T00:05:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.959594+0000", 2024-09-12T00:05:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0145000000000001e-05 2024-09-12T00:05:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.959668+0000", 2024-09-12T00:05:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3589000000000003e-05 2024-09-12T00:05:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3711 3.c 3:31bc51b2:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_328:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.647001+0000", 2024-09-12T00:05:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.4756911309999996, 2024-09-12T00:05:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021286705, 2024-09-12T00:05:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3711 2024-09-12T00:05:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.647001+0000", 2024-09-12T00:05:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.647001+0000", 2024-09-12T00:05:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.647006+0000", 2024-09-12T00:05:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1900000000000003e-06 2024-09-12T00:05:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.651810+0000", 2024-09-12T00:05:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048032159999999999 2024-09-12T00:05:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.651857+0000", 2024-09-12T00:05:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7416000000000001e-05 2024-09-12T00:05:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.651876+0000", 2024-09-12T00:05:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9066999999999999e-05 2024-09-12T00:05:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.652058+0000", 2024-09-12T00:05:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018199500000000001 2024-09-12T00:05:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.652476+0000", 2024-09-12T00:05:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00041738000000000002 2024-09-12T00:05:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.652917+0000", 2024-09-12T00:05:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00044171899999999998 2024-09-12T00:05:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.667867+0000", 2024-09-12T00:05:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014949558 2024-09-12T00:05:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.668181+0000", 2024-09-12T00:05:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000313777 2024-09-12T00:05:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.668241+0000", 2024-09-12T00:05:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0047999999999998e-05 2024-09-12T00:05:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.668288+0000", 2024-09-12T00:05:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7339000000000002e-05 2024-09-12T00:05:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3726 3.33 e83/23 3:cd6e0a10:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_343:head v 83'15, mlcod=83'13)", 2024-09-12T00:05:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.871373+0000", 2024-09-12T00:05:54.197 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.2513195919999998, 2024-09-12T00:05:54.197 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021131233999999999, 2024-09-12T00:05:54.197 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.197 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.197 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.197 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.197 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.871373+0000", 2024-09-12T00:05:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.871373+0000", 2024-09-12T00:05:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.199 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.871374+0000", 2024-09-12T00:05:54.199 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.505e-06 2024-09-12T00:05:54.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.199 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.199 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.199 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875356+0000", 2024-09-12T00:05:54.199 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039812060000000002 2024-09-12T00:05:54.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.200 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.200 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.200 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875381+0000", 2024-09-12T00:05:54.200 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5259999999999999e-05 2024-09-12T00:05:54.200 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.200 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.200 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875392+0000", 2024-09-12T00:05:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1211e-05 2024-09-12T00:05:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875472+0000", 2024-09-12T00:05:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9505999999999994e-05 2024-09-12T00:05:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875490+0000", 2024-09-12T00:05:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8819000000000001e-05 2024-09-12T00:05:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.892428+0000", 2024-09-12T00:05:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016937885 2024-09-12T00:05:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.892504+0000", 2024-09-12T00:05:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5841999999999997e-05 2024-09-12T00:05:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3727 3.35 3:ad6b6c99:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_344:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.876261+0000", 2024-09-12T00:05:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.2464317749999996, 2024-09-12T00:05:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.029109105, 2024-09-12T00:05:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3727 2024-09-12T00:05:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.876261+0000", 2024-09-12T00:05:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.876261+0000", 2024-09-12T00:05:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.876264+0000", 2024-09-12T00:05:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.388e-06 2024-09-12T00:05:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878449+0000", 2024-09-12T00:05:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021847360000000001 2024-09-12T00:05:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878470+0000", 2024-09-12T00:05:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0792e-05 2024-09-12T00:05:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878481+0000", 2024-09-12T00:05:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1421e-05 2024-09-12T00:05:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878572+0000", 2024-09-12T00:05:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0882000000000002e-05 2024-09-12T00:05:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878763+0000", 2024-09-12T00:05:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191218 2024-09-12T00:05:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878938+0000", 2024-09-12T00:05:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017507300000000001 2024-09-12T00:05:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.900618+0000", 2024-09-12T00:05:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021679706 2024-09-12T00:05:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.905243+0000", 2024-09-12T00:05:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046246869999999997 2024-09-12T00:05:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.905314+0000", 2024-09-12T00:05:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1797000000000004e-05 2024-09-12T00:05:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.905370+0000", 2024-09-12T00:05:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5405000000000002e-05 2024-09-12T00:05:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3735 3.3f 3:fd0f007c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_352:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.971621+0000", 2024-09-12T00:05:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.1510709479999992, 2024-09-12T00:05:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021631419999999998, 2024-09-12T00:05:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3735 2024-09-12T00:05:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.971621+0000", 2024-09-12T00:05:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.971621+0000", 2024-09-12T00:05:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.971626+0000", 2024-09-12T00:05:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.313e-06 2024-09-12T00:05:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973760+0000", 2024-09-12T00:05:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021346780000000001 2024-09-12T00:05:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973788+0000", 2024-09-12T00:05:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7327000000000001e-05 2024-09-12T00:05:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973799+0000", 2024-09-12T00:05:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1379999999999999e-05 2024-09-12T00:05:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973904+0000", 2024-09-12T00:05:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105071 2024-09-12T00:05:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.974119+0000", 2024-09-12T00:05:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021477399999999999 2024-09-12T00:05:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.974313+0000", 2024-09-12T00:05:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019439300000000001 2024-09-12T00:05:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.985849+0000", 2024-09-12T00:05:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011535915000000001 2024-09-12T00:05:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.993125+0000", 2024-09-12T00:05:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0072761299999999996 2024-09-12T00:05:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.993201+0000", 2024-09-12T00:05:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5098000000000005e-05 2024-09-12T00:05:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.993253+0000", 2024-09-12T00:05:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2340999999999999e-05 2024-09-12T00:05:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3756 3.15 3:aa8e955f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_373:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.207558+0000", 2024-09-12T00:05:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 8.9151341310000003, 2024-09-12T00:05:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021266769000000001, 2024-09-12T00:05:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3756 2024-09-12T00:05:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.207558+0000", 2024-09-12T00:05:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.207558+0000", 2024-09-12T00:05:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.207561+0000", 2024-09-12T00:05:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9450000000000002e-06 2024-09-12T00:05:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209465+0000", 2024-09-12T00:05:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019040089999999999 2024-09-12T00:05:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209493+0000", 2024-09-12T00:05:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7645999999999999e-05 2024-09-12T00:05:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209507+0000", 2024-09-12T00:05:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4333e-05 2024-09-12T00:05:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209609+0000", 2024-09-12T00:05:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101543 2024-09-12T00:05:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209822+0000", 2024-09-12T00:05:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021320000000000001 2024-09-12T00:05:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.210009+0000", 2024-09-12T00:05:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000187228 2024-09-12T00:05:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.219744+0000", 2024-09-12T00:05:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0097345079999999994 2024-09-12T00:05:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.228686+0000", 2024-09-12T00:05:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0089426200000000001 2024-09-12T00:05:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.228768+0000", 2024-09-12T00:05:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2112000000000003e-05 2024-09-12T00:05:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.228825+0000", 2024-09-12T00:05:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6625000000000001e-05 2024-09-12T00:05:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3778 3.c 3:33bb2076:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_395:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.451174+0000", 2024-09-12T00:05:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 8.6715179560000006, 2024-09-12T00:05:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021109749000000001, 2024-09-12T00:05:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3778 2024-09-12T00:05:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.451174+0000", 2024-09-12T00:05:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.451174+0000", 2024-09-12T00:05:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.451178+0000", 2024-09-12T00:05:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6289999999999999e-06 2024-09-12T00:05:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.453638+0000", 2024-09-12T00:05:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024596470000000001 2024-09-12T00:05:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.453658+0000", 2024-09-12T00:05:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0713e-05 2024-09-12T00:05:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.453673+0000", 2024-09-12T00:05:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4174e-05 2024-09-12T00:05:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.453804+0000", 2024-09-12T00:05:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013095000000000001 2024-09-12T00:05:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.454022+0000", 2024-09-12T00:05:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021806899999999999 2024-09-12T00:05:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.454175+0000", 2024-09-12T00:05:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015374099999999999 2024-09-12T00:05:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.462290+0000", 2024-09-12T00:05:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0081144359999999992 2024-09-12T00:05:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.472165+0000", 2024-09-12T00:05:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0098751140000000008 2024-09-12T00:05:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.472235+0000", 2024-09-12T00:05:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9793000000000001e-05 2024-09-12T00:05:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.472284+0000", 2024-09-12T00:05:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9483e-05 2024-09-12T00:05:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3785 3.15 3:ab478e86:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_402:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.539840+0000", 2024-09-12T00:05:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 8.5828526210000007, 2024-09-12T00:05:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.023091957999999999, 2024-09-12T00:05:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3785 2024-09-12T00:05:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.539840+0000", 2024-09-12T00:05:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.539840+0000", 2024-09-12T00:05:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.539843+0000", 2024-09-12T00:05:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4410000000000002e-06 2024-09-12T00:05:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541660+0000", 2024-09-12T00:05:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0018169239999999999 2024-09-12T00:05:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541704+0000", 2024-09-12T00:05:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4072000000000001e-05 2024-09-12T00:05:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541726+0000", 2024-09-12T00:05:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1875e-05 2024-09-12T00:05:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541825+0000", 2024-09-12T00:05:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8500999999999998e-05 2024-09-12T00:05:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541997+0000", 2024-09-12T00:05:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000172781 2024-09-12T00:05:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.542177+0000", 2024-09-12T00:05:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018009699999999999 2024-09-12T00:05:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.558969+0000", 2024-09-12T00:05:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016791805999999999 2024-09-12T00:05:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.562789+0000", 2024-09-12T00:05:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003819308 2024-09-12T00:05:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.562869+0000", 2024-09-12T00:05:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0550999999999995e-05 2024-09-12T00:05:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.562932+0000", 2024-09-12T00:05:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2601999999999995e-05 2024-09-12T00:05:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3798 3.35 3:ac2a574a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_415:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.681661+0000", 2024-09-12T00:05:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 8.4410314500000005, 2024-09-12T00:05:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.029133148000000001, 2024-09-12T00:05:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3798 2024-09-12T00:05:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.681661+0000", 2024-09-12T00:05:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.681661+0000", 2024-09-12T00:05:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.681665+0000", 2024-09-12T00:05:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.591e-06 2024-09-12T00:05:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683576+0000", 2024-09-12T00:05:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019111 2024-09-12T00:05:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683608+0000", 2024-09-12T00:05:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.269e-05 2024-09-12T00:05:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683623+0000", 2024-09-12T00:05:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4501000000000001e-05 2024-09-12T00:05:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683714+0000", 2024-09-12T00:05:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0666000000000002e-05 2024-09-12T00:05:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683913+0000", 2024-09-12T00:05:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000199037 2024-09-12T00:05:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.684084+0000", 2024-09-12T00:05:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017164700000000001 2024-09-12T00:05:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.697732+0000", 2024-09-12T00:05:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013647670000000001 2024-09-12T00:05:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.710663+0000", 2024-09-12T00:05:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012931265000000001 2024-09-12T00:05:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.710737+0000", 2024-09-12T00:05:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4181e-05 2024-09-12T00:05:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.238 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.710794+0000", 2024-09-12T00:05:54.238 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6799999999999998e-05 2024-09-12T00:05:54.238 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.238 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.238 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.238 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.238 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.238 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:54.239 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:05:54.240 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:54.240+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:54.341 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:54.340+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:54.418 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:54.418 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:54.418 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:05:54.418 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:54.433 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:05:54.445 INFO:teuthology.orchestra.run.smithi019.stderr:marked out osd.3. 2024-09-12T00:05:54.445 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:54.448+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:54.455 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T00:05:54.544 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:54.544+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:54.579 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:54.579 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:54.579 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:05:54.579 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:05:54.579 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:54.592 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:05:54.645 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:54.644+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:54.747 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:54.748+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:54.766 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:05:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:05:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:05:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:05:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:05:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 163.27200968400001, 2024-09-12T00:05:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.278479906, 2024-09-12T00:05:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:05:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:05:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:05:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:05:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:05:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493422+0000", 2024-09-12T00:05:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.807e-06 2024-09-12T00:05:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493435+0000", 2024-09-12T00:05:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.375e-05 2024-09-12T00:05:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493457+0000", 2024-09-12T00:05:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2166000000000001e-05 2024-09-12T00:05:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493475+0000", 2024-09-12T00:05:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7184e-05 2024-09-12T00:05:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493617+0000", 2024-09-12T00:05:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014274200000000001 2024-09-12T00:05:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:05:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493632+0000", 2024-09-12T00:05:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4293e-05 2024-09-12T00:05:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.768657+0000", 2024-09-12T00:05:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.27502575400000001 2024-09-12T00:05:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769042+0000", 2024-09-12T00:05:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00038463700000000001 2024-09-12T00:05:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769430+0000", 2024-09-12T00:05:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000388014 2024-09-12T00:05:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.770784+0000", 2024-09-12T00:05:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00135402 2024-09-12T00:05:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771735+0000", 2024-09-12T00:05:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00095068599999999996 2024-09-12T00:05:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771828+0000", 2024-09-12T00:05:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3468999999999996e-05 2024-09-12T00:05:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771899+0000", 2024-09-12T00:05:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0383999999999996e-05 2024-09-12T00:05:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:05:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:05:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 162.84344628400001, 2024-09-12T00:05:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021018614000000001, 2024-09-12T00:05:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:05:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:05:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 50 2024-09-12T00:05:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:05:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:05:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921983+0000", 2024-09-12T00:05:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4499999999999996e-07 2024-09-12T00:05:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922071+0000", 2024-09-12T00:05:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8010000000000006e-05 2024-09-12T00:05:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922084+0000", 2024-09-12T00:05:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3275000000000001e-05 2024-09-12T00:05:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922093+0000", 2024-09-12T00:05:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0580000000000004e-06 2024-09-12T00:05:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936515+0000", 2024-09-12T00:05:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014421270999999999 2024-09-12T00:05:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936677+0000", 2024-09-12T00:05:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162003 2024-09-12T00:05:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936908+0000", 2024-09-12T00:05:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023115700000000001 2024-09-12T00:05:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939985+0000", 2024-09-12T00:05:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030773879999999999 2024-09-12T00:05:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942623+0000", 2024-09-12T00:05:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026377929999999998 2024-09-12T00:05:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942818+0000", 2024-09-12T00:05:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019556200000000001 2024-09-12T00:05:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943001+0000", 2024-09-12T00:05:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018235199999999999 2024-09-12T00:05:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:05:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:05:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 162.843311892, 2024-09-12T00:05:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021092493, 2024-09-12T00:05:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:05:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:05:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 51 2024-09-12T00:05:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:05:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:05:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922118+0000", 2024-09-12T00:05:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0389999999999999e-06 2024-09-12T00:05:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922124+0000", 2024-09-12T00:05:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5409999999999997e-06 2024-09-12T00:05:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922136+0000", 2024-09-12T00:05:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.205e-05 2024-09-12T00:05:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922147+0000", 2024-09-12T00:05:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0451e-05 2024-09-12T00:05:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938000+0000", 2024-09-12T00:05:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015853682000000001 2024-09-12T00:05:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938142+0000", 2024-09-12T00:05:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014148899999999999 2024-09-12T00:05:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938362+0000", 2024-09-12T00:05:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022034800000000001 2024-09-12T00:05:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940330+0000", 2024-09-12T00:05:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001967459 2024-09-12T00:05:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943064+0000", 2024-09-12T00:05:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027346219999999999 2024-09-12T00:05:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943152+0000", 2024-09-12T00:05:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7563000000000002e-05 2024-09-12T00:05:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943209+0000", 2024-09-12T00:05:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7249e-05 2024-09-12T00:05:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:05:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:05:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 162.843262399, 2024-09-12T00:05:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021175616000000001, 2024-09-12T00:05:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:05:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:05:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 52 2024-09-12T00:05:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:05:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:05:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922167+0000", 2024-09-12T00:05:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3300000000000001e-07 2024-09-12T00:05:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922174+0000", 2024-09-12T00:05:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7070000000000003e-06 2024-09-12T00:05:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922184+0000", 2024-09-12T00:05:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682e-05 2024-09-12T00:05:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922195+0000", 2024-09-12T00:05:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0489000000000001e-05 2024-09-12T00:05:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939166+0000", 2024-09-12T00:05:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016971245999999999 2024-09-12T00:05:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939243+0000", 2024-09-12T00:05:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7201999999999997e-05 2024-09-12T00:05:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939381+0000", 2024-09-12T00:05:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013770699999999999 2024-09-12T00:05:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940923+0000", 2024-09-12T00:05:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001542302 2024-09-12T00:05:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943221+0000", 2024-09-12T00:05:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022979720000000001 2024-09-12T00:05:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943295+0000", 2024-09-12T00:05:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3317000000000003e-05 2024-09-12T00:05:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943342+0000", 2024-09-12T00:05:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7159e-05 2024-09-12T00:05:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:05:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:05:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 162.593989779, 2024-09-12T00:05:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020263554, 2024-09-12T00:05:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:05:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:05:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 71 2024-09-12T00:05:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:05:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:05:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:05:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5000000000000002e-07 2024-09-12T00:05:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171454+0000", 2024-09-12T00:05:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5046e-05 2024-09-12T00:05:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171471+0000", 2024-09-12T00:05:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6923999999999999e-05 2024-09-12T00:05:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171487+0000", 2024-09-12T00:05:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5823000000000001e-05 2024-09-12T00:05:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180765+0000", 2024-09-12T00:05:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0092774399999999996 2024-09-12T00:05:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180900+0000", 2024-09-12T00:05:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013556700000000001 2024-09-12T00:05:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181108+0000", 2024-09-12T00:05:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020727899999999999 2024-09-12T00:05:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184725+0000", 2024-09-12T00:05:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036171340000000001 2024-09-12T00:05:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191413+0000", 2024-09-12T00:05:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066881830000000003 2024-09-12T00:05:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191540+0000", 2024-09-12T00:05:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000126823 2024-09-12T00:05:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191702+0000", 2024-09-12T00:05:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162585 2024-09-12T00:05:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:05:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:05:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 162.593911203, 2024-09-12T00:05:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020448573000000001, 2024-09-12T00:05:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:05:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:05:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 72 2024-09-12T00:05:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:05:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:05:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171518+0000", 2024-09-12T00:05:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0440000000000001e-06 2024-09-12T00:05:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171647+0000", 2024-09-12T00:05:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012912899999999999 2024-09-12T00:05:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171664+0000", 2024-09-12T00:05:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6079999999999999e-05 2024-09-12T00:05:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171675+0000", 2024-09-12T00:05:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1223000000000001e-05 2024-09-12T00:05:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182000+0000", 2024-09-12T00:05:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010324949 2024-09-12T00:05:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182178+0000", 2024-09-12T00:05:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017808799999999999 2024-09-12T00:05:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182402+0000", 2024-09-12T00:05:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022381199999999999 2024-09-12T00:05:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190935+0000", 2024-09-12T00:05:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085331560000000001 2024-09-12T00:05:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191728+0000", 2024-09-12T00:05:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079325700000000001 2024-09-12T00:05:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191864+0000", 2024-09-12T00:05:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013606299999999999 2024-09-12T00:05:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191966+0000", 2024-09-12T00:05:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101772 2024-09-12T00:05:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:05:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:05:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 162.593728008, 2024-09-12T00:05:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020675235, 2024-09-12T00:05:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:05:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:05:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 73 2024-09-12T00:05:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:05:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:05:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171701+0000", 2024-09-12T00:05:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0999999999999997e-07 2024-09-12T00:05:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171709+0000", 2024-09-12T00:05:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2540000000000003e-06 2024-09-12T00:05:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171724+0000", 2024-09-12T00:05:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5569e-05 2024-09-12T00:05:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171734+0000", 2024-09-12T00:05:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6139999999999998e-06 2024-09-12T00:05:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183774+0000", 2024-09-12T00:05:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012040444000000001 2024-09-12T00:05:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183896+0000", 2024-09-12T00:05:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012204199999999999 2024-09-12T00:05:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184084+0000", 2024-09-12T00:05:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018792599999999999 2024-09-12T00:05:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191984+0000", 2024-09-12T00:05:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079003790000000008 2024-09-12T00:05:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192093+0000", 2024-09-12T00:05:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000108942 2024-09-12T00:05:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192250+0000", 2024-09-12T00:05:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015637600000000001 2024-09-12T00:05:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192376+0000", 2024-09-12T00:05:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012587899999999999 2024-09-12T00:05:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:05:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:05:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 162.59367979800001, 2024-09-12T00:05:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021088828, 2024-09-12T00:05:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:05:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:05:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 74 2024-09-12T00:05:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:05:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:05:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:05:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1699999999999997e-07 2024-09-12T00:05:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171758+0000", 2024-09-12T00:05:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0860000000000008e-06 2024-09-12T00:05:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171774+0000", 2024-09-12T00:05:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:05:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171788+0000", 2024-09-12T00:05:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4793999999999999e-05 2024-09-12T00:05:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184842+0000", 2024-09-12T00:05:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013053607 2024-09-12T00:05:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185130+0000", 2024-09-12T00:05:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00028779199999999998 2024-09-12T00:05:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185378+0000", 2024-09-12T00:05:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024780100000000002 2024-09-12T00:05:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192513+0000", 2024-09-12T00:05:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071350770000000001 2024-09-12T00:05:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192690+0000", 2024-09-12T00:05:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000176892 2024-09-12T00:05:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192769+0000", 2024-09-12T00:05:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9466000000000001e-05 2024-09-12T00:05:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192837+0000", 2024-09-12T00:05:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8466000000000005e-05 2024-09-12T00:05:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:05:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:05:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 162.59362722099999, 2024-09-12T00:05:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.02121994, 2024-09-12T00:05:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:05:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:05:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 75 2024-09-12T00:05:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:05:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:05:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171802+0000", 2024-09-12T00:05:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5000000000000002e-07 2024-09-12T00:05:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171954+0000", 2024-09-12T00:05:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015215500000000001 2024-09-12T00:05:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171966+0000", 2024-09-12T00:05:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1548e-05 2024-09-12T00:05:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171970+0000", 2024-09-12T00:05:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8729999999999998e-06 2024-09-12T00:05:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186552+0000", 2024-09-12T00:05:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014581775 2024-09-12T00:05:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186702+0000", 2024-09-12T00:05:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014946 2024-09-12T00:05:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186897+0000", 2024-09-12T00:05:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000195071 2024-09-12T00:05:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192666+0000", 2024-09-12T00:05:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057693470000000002 2024-09-12T00:05:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192857+0000", 2024-09-12T00:05:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191149 2024-09-12T00:05:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192967+0000", 2024-09-12T00:05:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110202 2024-09-12T00:05:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193021+0000", 2024-09-12T00:05:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3709999999999999e-05 2024-09-12T00:05:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:05:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:05:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 162.59344792600001, 2024-09-12T00:05:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026297425999999999, 2024-09-12T00:05:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:05:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:05:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 76 2024-09-12T00:05:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:05:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:05:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:05:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9399999999999995e-07 2024-09-12T00:05:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171987+0000", 2024-09-12T00:05:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5230000000000003e-06 2024-09-12T00:05:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172005+0000", 2024-09-12T00:05:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8788e-05 2024-09-12T00:05:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172010+0000", 2024-09-12T00:05:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7570000000000004e-06 2024-09-12T00:05:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193104+0000", 2024-09-12T00:05:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021094112000000002 2024-09-12T00:05:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193334+0000", 2024-09-12T00:05:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000229855 2024-09-12T00:05:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193697+0000", 2024-09-12T00:05:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00036272399999999998 2024-09-12T00:05:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.195602+0000", 2024-09-12T00:05:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019049620000000001 2024-09-12T00:05:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198123+0000", 2024-09-12T00:05:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025216520000000001 2024-09-12T00:05:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198213+0000", 2024-09-12T00:05:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0008999999999998e-05 2024-09-12T00:05:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198278+0000", 2024-09-12T00:05:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4549999999999997e-05 2024-09-12T00:05:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2996 3.21 e75/23 3:872b1c12:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_35:head v 75'4, mlcod=63'2)", 2024-09-12T00:05:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.357371+0000", 2024-09-12T00:05:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 34.408057505999999, 2024-09-12T00:05:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021201353999999999, 2024-09-12T00:05:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.357371+0000", 2024-09-12T00:05:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.357371+0000", 2024-09-12T00:05:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.357372+0000", 2024-09-12T00:05:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.424e-06 2024-09-12T00:05:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.364586+0000", 2024-09-12T00:05:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0072140609999999999 2024-09-12T00:05:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.364611+0000", 2024-09-12T00:05:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4593e-05 2024-09-12T00:05:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.364625+0000", 2024-09-12T00:05:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3974999999999999e-05 2024-09-12T00:05:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.364718+0000", 2024-09-12T00:05:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2899000000000006e-05 2024-09-12T00:05:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.364748+0000", 2024-09-12T00:05:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9629999999999999e-05 2024-09-12T00:05:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.378470+0000", 2024-09-12T00:05:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013722323999999999 2024-09-12T00:05:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.378572+0000", 2024-09-12T00:05:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010244800000000001 2024-09-12T00:05:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3031 3.1c 3:3b901b6c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.749824+0000", 2024-09-12T00:05:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 34.015604076000002, 2024-09-12T00:05:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025171115000000001, 2024-09-12T00:05:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3031 2024-09-12T00:05:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.749824+0000", 2024-09-12T00:05:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.749824+0000", 2024-09-12T00:05:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.749828+0000", 2024-09-12T00:05:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.839e-06 2024-09-12T00:05:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.751966+0000", 2024-09-12T00:05:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021378360000000002 2024-09-12T00:05:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.751995+0000", 2024-09-12T00:05:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8631000000000001e-05 2024-09-12T00:05:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.752010+0000", 2024-09-12T00:05:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4899000000000001e-05 2024-09-12T00:05:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.752090+0000", 2024-09-12T00:05:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0352000000000006e-05 2024-09-12T00:05:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.752237+0000", 2024-09-12T00:05:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014683400000000001 2024-09-12T00:05:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.752389+0000", 2024-09-12T00:05:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015245699999999999 2024-09-12T00:05:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.769694+0000", 2024-09-12T00:05:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017305259 2024-09-12T00:05:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.774831+0000", 2024-09-12T00:05:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0051360360000000001 2024-09-12T00:05:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.774895+0000", 2024-09-12T00:05:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4454000000000003e-05 2024-09-12T00:05:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.774995+0000", 2024-09-12T00:05:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100518 2024-09-12T00:05:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3034 3.2a 3:57bb186b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.782449+0000", 2024-09-12T00:05:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 33.982979735000001, 2024-09-12T00:05:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022965039999999999, 2024-09-12T00:05:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3034 2024-09-12T00:05:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.782449+0000", 2024-09-12T00:05:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.782449+0000", 2024-09-12T00:05:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.782452+0000", 2024-09-12T00:05:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3670000000000001e-06 2024-09-12T00:05:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.784814+0000", 2024-09-12T00:05:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023623030000000001 2024-09-12T00:05:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.784849+0000", 2024-09-12T00:05:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4245999999999997e-05 2024-09-12T00:05:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.784875+0000", 2024-09-12T00:05:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6455999999999999e-05 2024-09-12T00:05:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.784972+0000", 2024-09-12T00:05:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7316000000000001e-05 2024-09-12T00:05:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.785154+0000", 2024-09-12T00:05:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018166499999999999 2024-09-12T00:05:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.785320+0000", 2024-09-12T00:05:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016586500000000001 2024-09-12T00:05:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.804742+0000", 2024-09-12T00:05:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019421600000000001 2024-09-12T00:05:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.805237+0000", 2024-09-12T00:05:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00049526400000000003 2024-09-12T00:05:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.805336+0000", 2024-09-12T00:05:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8912000000000004e-05 2024-09-12T00:05:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.805414+0000", 2024-09-12T00:05:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8046000000000005e-05 2024-09-12T00:05:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3133 3.10 3:0bd95b9d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:22.028646+0000", 2024-09-12T00:05:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 32.736782380000001, 2024-09-12T00:05:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.028771254, 2024-09-12T00:05:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3133 2024-09-12T00:05:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.028646+0000", 2024-09-12T00:05:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.028646+0000", 2024-09-12T00:05:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.028650+0000", 2024-09-12T00:05:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8850000000000001e-06 2024-09-12T00:05:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.030628+0000", 2024-09-12T00:05:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019778450000000002 2024-09-12T00:05:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.030658+0000", 2024-09-12T00:05:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0275999999999999e-05 2024-09-12T00:05:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.030670+0000", 2024-09-12T00:05:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2218000000000001e-05 2024-09-12T00:05:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.030764+0000", 2024-09-12T00:05:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3953e-05 2024-09-12T00:05:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.030996+0000", 2024-09-12T00:05:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023209500000000001 2024-09-12T00:05:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.031190+0000", 2024-09-12T00:05:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019345699999999999 2024-09-12T00:05:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.036754+0000", 2024-09-12T00:05:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055638980000000003 2024-09-12T00:05:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.057277+0000", 2024-09-12T00:05:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020523604000000001 2024-09-12T00:05:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.057358+0000", 2024-09-12T00:05:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1143999999999994e-05 2024-09-12T00:05:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.057417+0000", 2024-09-12T00:05:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8879000000000003e-05 2024-09-12T00:05:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3374 3.10 3:089db4d6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.636005+0000", 2024-09-12T00:05:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.129423724, 2024-09-12T00:05:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025433803000000001, 2024-09-12T00:05:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3374 2024-09-12T00:05:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.636005+0000", 2024-09-12T00:05:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.636005+0000", 2024-09-12T00:05:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.636009+0000", 2024-09-12T00:05:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2250000000000002e-06 2024-09-12T00:05:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639097+0000", 2024-09-12T00:05:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030881020000000001 2024-09-12T00:05:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639124+0000", 2024-09-12T00:05:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7390999999999999e-05 2024-09-12T00:05:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639138+0000", 2024-09-12T00:05:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3155e-05 2024-09-12T00:05:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639221+0000", 2024-09-12T00:05:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2996000000000003e-05 2024-09-12T00:05:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639390+0000", 2024-09-12T00:05:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016898999999999999 2024-09-12T00:05:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639547+0000", 2024-09-12T00:05:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000157374 2024-09-12T00:05:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.651089+0000", 2024-09-12T00:05:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011542124000000001 2024-09-12T00:05:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.661319+0000", 2024-09-12T00:05:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010229538999999999 2024-09-12T00:05:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.661387+0000", 2024-09-12T00:05:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8663000000000003e-05 2024-09-12T00:05:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.661439+0000", 2024-09-12T00:05:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1243999999999999e-05 2024-09-12T00:05:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3712 3.1c 3:3a424314:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_329:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.670012+0000", 2024-09-12T00:05:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 10.09541656, 2024-09-12T00:05:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.024941801999999999, 2024-09-12T00:05:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3712 2024-09-12T00:05:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.670012+0000", 2024-09-12T00:05:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.670012+0000", 2024-09-12T00:05:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.670016+0000", 2024-09-12T00:05:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2169999999999996e-06 2024-09-12T00:05:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.672951+0000", 2024-09-12T00:05:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029345159999999999 2024-09-12T00:05:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.672998+0000", 2024-09-12T00:05:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7605999999999998e-05 2024-09-12T00:05:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.673019+0000", 2024-09-12T00:05:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0843e-05 2024-09-12T00:05:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.673187+0000", 2024-09-12T00:05:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016786899999999999 2024-09-12T00:05:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.673628+0000", 2024-09-12T00:05:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00044081600000000002 2024-09-12T00:05:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.674047+0000", 2024-09-12T00:05:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00041917300000000001 2024-09-12T00:05:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.685347+0000", 2024-09-12T00:05:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011300464 2024-09-12T00:05:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.694777+0000", 2024-09-12T00:05:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0094296550000000003 2024-09-12T00:05:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.694876+0000", 2024-09-12T00:05:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8488999999999998e-05 2024-09-12T00:05:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.694954+0000", 2024-09-12T00:05:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8153999999999997e-05 2024-09-12T00:05:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3722 3.1a 3:5af5b5cf:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_339:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.814831+0000", 2024-09-12T00:05:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.9505969880000009, 2024-09-12T00:05:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021631714, 2024-09-12T00:05:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3722 2024-09-12T00:05:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.814831+0000", 2024-09-12T00:05:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.814831+0000", 2024-09-12T00:05:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.814836+0000", 2024-09-12T00:05:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3409999999999996e-06 2024-09-12T00:05:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.816751+0000", 2024-09-12T00:05:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001915564 2024-09-12T00:05:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.816790+0000", 2024-09-12T00:05:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8355000000000001e-05 2024-09-12T00:05:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.816807+0000", 2024-09-12T00:05:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7703999999999999e-05 2024-09-12T00:05:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.816940+0000", 2024-09-12T00:05:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013292600000000001 2024-09-12T00:05:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.817155+0000", 2024-09-12T00:05:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021460699999999999 2024-09-12T00:05:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.817330+0000", 2024-09-12T00:05:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017552600000000001 2024-09-12T00:05:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.827842+0000", 2024-09-12T00:05:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010511533999999999 2024-09-12T00:05:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.836260+0000", 2024-09-12T00:05:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0084178399999999994 2024-09-12T00:05:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.836347+0000", 2024-09-12T00:05:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6637000000000004e-05 2024-09-12T00:05:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.836463+0000", 2024-09-12T00:05:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011668 2024-09-12T00:05:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3780 3.19 e83/23 3:9a0a1200:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_397:head v 83'18, mlcod=83'16)", 2024-09-12T00:05:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.485629+0000", 2024-09-12T00:05:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.2797998889999995, 2024-09-12T00:05:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020596468, 2024-09-12T00:05:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.485629+0000", 2024-09-12T00:05:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.485629+0000", 2024-09-12T00:05:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.485631+0000", 2024-09-12T00:05:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9019999999999999e-06 2024-09-12T00:05:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.491531+0000", 2024-09-12T00:05:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058997870000000001 2024-09-12T00:05:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.491569+0000", 2024-09-12T00:05:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7432999999999999e-05 2024-09-12T00:05:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.491585+0000", 2024-09-12T00:05:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6651e-05 2024-09-12T00:05:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.491687+0000", 2024-09-12T00:05:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101366 2024-09-12T00:05:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.491718+0000", 2024-09-12T00:05:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1031000000000002e-05 2024-09-12T00:05:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.506043+0000", 2024-09-12T00:05:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014325311 2024-09-12T00:05:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.506225+0000", 2024-09-12T00:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018198699999999999 2024-09-12T00:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3783 3.1c 3:38213e46:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_400:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.514915+0000", 2024-09-12T00:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.2505132260000007, 2024-09-12T00:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021806478000000001, 2024-09-12T00:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3783 2024-09-12T00:05:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.514915+0000", 2024-09-12T00:05:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.514915+0000", 2024-09-12T00:05:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.514920+0000", 2024-09-12T00:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7480000000000001e-06 2024-09-12T00:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517111+0000", 2024-09-12T00:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021913890000000002 2024-09-12T00:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517157+0000", 2024-09-12T00:05:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5754000000000003e-05 2024-09-12T00:05:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517177+0000", 2024-09-12T00:05:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0197999999999999e-05 2024-09-12T00:05:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517294+0000", 2024-09-12T00:05:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000117156 2024-09-12T00:05:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517503+0000", 2024-09-12T00:05:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020805500000000001 2024-09-12T00:05:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517714+0000", 2024-09-12T00:05:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021131399999999999 2024-09-12T00:05:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.535744+0000", 2024-09-12T00:05:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018029677000000001 2024-09-12T00:05:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.536543+0000", 2024-09-12T00:05:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079940499999999999 2024-09-12T00:05:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.536642+0000", 2024-09-12T00:05:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.9440999999999999e-05 2024-09-12T00:05:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.536722+0000", 2024-09-12T00:05:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9340999999999998e-05 2024-09-12T00:05:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3786 3.37 3:ece0bced:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_403:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.550483+0000", 2024-09-12T00:05:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 9.2149458979999999, 2024-09-12T00:05:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022719506, 2024-09-12T00:05:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3786 2024-09-12T00:05:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.550483+0000", 2024-09-12T00:05:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.550483+0000", 2024-09-12T00:05:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:54.881 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.550486+0000", 2024-09-12T00:05:54.881 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4070000000000002e-06 2024-09-12T00:05:54.881 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.881 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.881 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:54.881 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.552644+0000", 2024-09-12T00:05:54.881 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021584629999999998 2024-09-12T00:05:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.552676+0000", 2024-09-12T00:05:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1662000000000003e-05 2024-09-12T00:05:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.552691+0000", 2024-09-12T00:05:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4780000000000001e-05 2024-09-12T00:05:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.552788+0000", 2024-09-12T00:05:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7034999999999995e-05 2024-09-12T00:05:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.553009+0000", 2024-09-12T00:05:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000220991 2024-09-12T00:05:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.553191+0000", 2024-09-12T00:05:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000182349 2024-09-12T00:05:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.573055+0000", 2024-09-12T00:05:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019863553999999999 2024-09-12T00:05:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.573071+0000", 2024-09-12T00:05:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6178e-05 2024-09-12T00:05:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.573144+0000", 2024-09-12T00:05:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3362000000000007e-05 2024-09-12T00:05:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:54.885 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.573202+0000", 2024-09-12T00:05:54.885 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7725e-05 2024-09-12T00:05:54.885 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.885 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.885 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.885 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:54.885 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:54.885 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:54.886 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:05:54.887 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:05:54.887 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:54.888+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:54.987 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:54.988+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:55.061 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:55.061 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:55.061 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:05:55.061 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:55.076 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:05:55.094 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:55.094 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:55.095 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:55.096+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:55.111 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:55.111 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:55.128 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:55.128 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:55.145 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:55.145 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:55.166 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:55.166 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:55.188 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:55.189 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:55.189 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:55.188+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:55.209 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:55.209 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:55.210 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:55.210 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:55.225 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:05:55.230 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:55.231 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:55.293 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:55.296+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:55.398 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:55.398 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:55.398 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:55.392+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:55.420 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:05:55.492 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:55.492+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:55.593 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:55.592+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:55.620 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:55.620 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:55.641 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:05:55.693 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:55.692+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:55.793 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:55.796+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:55.842 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:55.843 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:55.865 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:05:55.894 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:55.896+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:55.995 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:55.996+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:56.066 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:56.067 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:56.087 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:05:56.134 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:56.136+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:56.197 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:56.196+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:56.217 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:56.217 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:56.232 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:05:56.298 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:56.300+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:56.399 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:56.400+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:56.408 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:56.408 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:56.427 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:05:56.498 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T00:05:56.499 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:56.500+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:56.600 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:56.600+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:56.624 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:56.624 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:56.647 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:05:56.701 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:56.700+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:56.799 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:56.799 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:56.802 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:56.804+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:56.820 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:05:56.906 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:56.908+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:57.004 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:57.004+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:57.011 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:57.011 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:57.031 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:05:57.105 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:57.104+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:57.206 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:57.204+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:57.214 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:57.215 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:57.232 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:05:57.249 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:05:57.318 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:57.320+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:57.340 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T00:05:57.409 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:57.412+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:57.421 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:57.421 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:57.439 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:05:57.445 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:57.445 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:57.465 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:57.465 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:57.481 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:57.482 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:57.498 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:57.498 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:57.510 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:57.512+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:57.516 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:57.516 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:57.534 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:57.534 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:57.554 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:57.554 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:57.577 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:57.611 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:57.612+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:57.621 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:57.621 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:57.621 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:57.622 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:57.622 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:57.639 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:05:57.730 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:57.732+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:57.813 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:57.816+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:57.832 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:57.832 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:57.832 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:57.832 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:57.833 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.833 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1646 3.25 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:05:57.833 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:57.833 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 84.754684569000005, 2024-09-12T00:05:57.833 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030091884999999999, 2024-09-12T00:05:57.833 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:57.834 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:57.834 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:57.834 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:57.834 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:57.834 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:57.834 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1646 2024-09-12T00:05:57.834 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.835 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:57.835 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.835 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:57.835 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:57.835 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.836 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.836 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:57.836 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:05:57.836 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.836 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.836 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.836 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:57.837 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077113+0000", 2024-09-12T00:05:57.837 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0186e-05 2024-09-12T00:05:57.837 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.838 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.838 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:57.838 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084821+0000", 2024-09-12T00:05:57.838 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077083450000000001 2024-09-12T00:05:57.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.838 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.838 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:57.838 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084857+0000", 2024-09-12T00:05:57.838 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6245000000000003e-05 2024-09-12T00:05:57.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.838 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.838 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:57.839 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084900+0000", 2024-09-12T00:05:57.839 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2369e-05 2024-09-12T00:05:57.839 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.839 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.839 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:57.839 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085058+0000", 2024-09-12T00:05:57.839 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015858199999999999 2024-09-12T00:05:57.839 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.839 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.840 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:57.840 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085307+0000", 2024-09-12T00:05:57.840 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024867999999999998 2024-09-12T00:05:57.840 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.840 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.840 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:57.840 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086107+0000", 2024-09-12T00:05:57.840 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00080040099999999996 2024-09-12T00:05:57.841 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.841 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.841 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:57.841 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.100477+0000", 2024-09-12T00:05:57.841 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014369508 2024-09-12T00:05:57.841 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.841 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.841 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:57.842 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107016+0000", 2024-09-12T00:05:57.842 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006538894 2024-09-12T00:05:57.842 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.842 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.842 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:57.842 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107121+0000", 2024-09-12T00:05:57.842 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105284 2024-09-12T00:05:57.842 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.843 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.843 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:57.843 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107194+0000", 2024-09-12T00:05:57.843 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3391000000000003e-05 2024-09-12T00:05:57.843 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.843 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:57.843 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.843 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.844 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.844 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2718 3.4 3:20fe36bb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:57.844 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:57.844 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 70.046206411, 2024-09-12T00:05:57.844 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027867928, 2024-09-12T00:05:57.844 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:57.844 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:57.844 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:57.845 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:57.845 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:57.845 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:57.845 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2718 2024-09-12T00:05:57.845 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.845 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:57.845 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.845 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:57.846 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:57.846 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.846 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.846 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:57.846 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:05:57.846 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.847 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.847 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:57.847 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785584+0000", 2024-09-12T00:05:57.847 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.056e-06 2024-09-12T00:05:57.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.847 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.847 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:57.847 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792023+0000", 2024-09-12T00:05:57.847 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064398069999999996 2024-09-12T00:05:57.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.848 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.848 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:57.848 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792058+0000", 2024-09-12T00:05:57.848 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5018000000000003e-05 2024-09-12T00:05:57.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.848 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.848 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:57.849 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792078+0000", 2024-09-12T00:05:57.849 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9862000000000001e-05 2024-09-12T00:05:57.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.849 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.849 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:57.849 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792248+0000", 2024-09-12T00:05:57.849 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017006399999999999 2024-09-12T00:05:57.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.850 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.850 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:57.850 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792660+0000", 2024-09-12T00:05:57.850 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041189500000000001 2024-09-12T00:05:57.850 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.850 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.850 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:57.850 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793081+0000", 2024-09-12T00:05:57.850 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000420395 2024-09-12T00:05:57.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.851 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.851 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:57.851 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808422+0000", 2024-09-12T00:05:57.851 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015341626000000001 2024-09-12T00:05:57.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.851 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.851 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:57.852 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813192+0000", 2024-09-12T00:05:57.852 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047701799999999997 2024-09-12T00:05:57.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.852 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.852 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:57.852 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813339+0000", 2024-09-12T00:05:57.852 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014643800000000001 2024-09-12T00:05:57.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.852 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.853 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:57.853 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813449+0000", 2024-09-12T00:05:57.853 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010958700000000001 2024-09-12T00:05:57.853 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.853 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:57.853 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.853 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.854 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2736 3.25 3:a750a681:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:57.854 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:57.854 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 69.856434049000001, 2024-09-12T00:05:57.854 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025701234999999999, 2024-09-12T00:05:57.854 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:57.854 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:57.854 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:57.854 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:57.854 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:57.854 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:57.854 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2736 2024-09-12T00:05:57.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.855 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:57.855 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.855 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:57.855 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:57.855 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.855 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.855 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:57.855 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:05:57.855 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.855 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.855 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:57.856 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975357+0000", 2024-09-12T00:05:57.856 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9389999999999999e-06 2024-09-12T00:05:57.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.856 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.856 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:57.856 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979365+0000", 2024-09-12T00:05:57.856 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040076679999999998 2024-09-12T00:05:57.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.856 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.856 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:57.856 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979402+0000", 2024-09-12T00:05:57.856 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7557e-05 2024-09-12T00:05:57.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.857 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.857 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:57.857 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979419+0000", 2024-09-12T00:05:57.857 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7203000000000001e-05 2024-09-12T00:05:57.857 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.857 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.857 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:57.857 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979543+0000", 2024-09-12T00:05:57.857 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000123423 2024-09-12T00:05:57.857 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.857 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.857 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:57.857 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979784+0000", 2024-09-12T00:05:57.858 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024097800000000001 2024-09-12T00:05:57.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.858 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.858 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:57.858 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980013+0000", 2024-09-12T00:05:57.858 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022881999999999999 2024-09-12T00:05:57.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.858 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.858 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:57.858 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.999860+0000", 2024-09-12T00:05:57.858 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019847908000000001 2024-09-12T00:05:57.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.858 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.859 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:57.859 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000741+0000", 2024-09-12T00:05:57.859 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00088041499999999995 2024-09-12T00:05:57.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.859 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.859 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:57.859 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000915+0000", 2024-09-12T00:05:57.859 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017460300000000001 2024-09-12T00:05:57.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.859 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.859 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:57.859 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.001054+0000", 2024-09-12T00:05:57.859 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013872099999999999 2024-09-12T00:05:57.859 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.859 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:57.860 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.860 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.860 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.860 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2964 3.24 3:26c83ec0:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:57.860 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:57.860 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 37.826372247000002, 2024-09-12T00:05:57.860 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028979713000000001, 2024-09-12T00:05:57.860 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:57.860 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:57.860 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:57.860 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:57.860 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:57.860 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:57.861 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2964 2024-09-12T00:05:57.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.861 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:57.861 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.861 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:57.861 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:57.861 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.861 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.861 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:57.861 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:05:57.861 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.862 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.862 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:57.862 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005417+0000", 2024-09-12T00:05:57.862 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2450000000000001e-06 2024-09-12T00:05:57.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.862 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.862 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:57.862 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010885+0000", 2024-09-12T00:05:57.862 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054684809999999999 2024-09-12T00:05:57.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.862 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.862 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:57.862 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010901+0000", 2024-09-12T00:05:57.863 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5097e-05 2024-09-12T00:05:57.863 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.863 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.863 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:57.863 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010908+0000", 2024-09-12T00:05:57.863 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7419999999999997e-06 2024-09-12T00:05:57.863 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.863 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.863 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:57.863 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010968+0000", 2024-09-12T00:05:57.863 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.9837000000000003e-05 2024-09-12T00:05:57.863 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.863 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.863 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:57.864 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011082+0000", 2024-09-12T00:05:57.864 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011357399999999999 2024-09-12T00:05:57.864 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.864 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.864 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:57.864 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011174+0000", 2024-09-12T00:05:57.864 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2703999999999999e-05 2024-09-12T00:05:57.864 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.864 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.864 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:57.864 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.021639+0000", 2024-09-12T00:05:57.864 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010464641 2024-09-12T00:05:57.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.865 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.865 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:57.865 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034210+0000", 2024-09-12T00:05:57.865 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012570463 2024-09-12T00:05:57.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.865 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.865 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:57.865 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034300+0000", 2024-09-12T00:05:57.865 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0691000000000003e-05 2024-09-12T00:05:57.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.865 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.865 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:57.866 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034394+0000", 2024-09-12T00:05:57.866 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4238000000000001e-05 2024-09-12T00:05:57.866 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.866 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:57.866 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.866 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.866 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3052 3.32 3:4d6db9ea:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:57.866 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:57.866 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 36.852125620999999, 2024-09-12T00:05:57.867 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028091277000000001, 2024-09-12T00:05:57.867 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:57.867 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:57.867 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:57.867 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:57.867 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:57.867 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:57.867 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3052 2024-09-12T00:05:57.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.867 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:57.867 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.867 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:57.868 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:57.868 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.868 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.868 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:57.868 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:05:57.868 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.868 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.868 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:57.868 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979664+0000", 2024-09-12T00:05:57.869 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:05:57.869 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.869 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.869 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:57.869 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986918+0000", 2024-09-12T00:05:57.869 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0072537110000000004 2024-09-12T00:05:57.869 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.869 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.869 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:57.869 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986956+0000", 2024-09-12T00:05:57.869 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8111999999999997e-05 2024-09-12T00:05:57.869 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.870 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.870 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:57.870 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986975+0000", 2024-09-12T00:05:57.870 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9245999999999998e-05 2024-09-12T00:05:57.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.870 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.870 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:57.870 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987159+0000", 2024-09-12T00:05:57.870 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000183828 2024-09-12T00:05:57.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.870 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.870 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:57.870 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987552+0000", 2024-09-12T00:05:57.870 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039349699999999998 2024-09-12T00:05:57.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.871 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.871 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:57.871 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987943+0000", 2024-09-12T00:05:57.871 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000390579 2024-09-12T00:05:57.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.871 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.871 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:57.871 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.999384+0000", 2024-09-12T00:05:57.871 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011441563 2024-09-12T00:05:57.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.871 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.871 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:57.871 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007634+0000", 2024-09-12T00:05:57.872 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082496240000000005 2024-09-12T00:05:57.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.872 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.872 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:57.872 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007699+0000", 2024-09-12T00:05:57.872 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5089e-05 2024-09-12T00:05:57.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.872 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.872 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:57.873 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007753+0000", 2024-09-12T00:05:57.873 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3588000000000003e-05 2024-09-12T00:05:57.873 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.873 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:57.873 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.873 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.873 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.873 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3064 3.4 3:209c6609:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:57.873 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:57.873 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 36.719810342999999, 2024-09-12T00:05:57.873 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024628305999999999, 2024-09-12T00:05:57.873 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:57.874 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:57.874 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:57.874 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:57.874 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:57.874 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:57.874 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3064 2024-09-12T00:05:57.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.874 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:57.875 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.875 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:57.875 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:57.875 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.875 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.875 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:57.875 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:05:57.875 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.875 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.875 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:57.875 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111980+0000", 2024-09-12T00:05:57.876 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.005e-06 2024-09-12T00:05:57.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.876 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.876 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:57.876 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116464+0000", 2024-09-12T00:05:57.876 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044839210000000001 2024-09-12T00:05:57.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.876 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.876 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:57.876 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116490+0000", 2024-09-12T00:05:57.876 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6690999999999999e-05 2024-09-12T00:05:57.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.876 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.877 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:57.877 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116504+0000", 2024-09-12T00:05:57.877 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4109e-05 2024-09-12T00:05:57.877 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.877 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.877 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:57.877 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116639+0000", 2024-09-12T00:05:57.877 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013427 2024-09-12T00:05:57.877 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.877 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.877 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:57.877 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116931+0000", 2024-09-12T00:05:57.877 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000292603 2024-09-12T00:05:57.878 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.878 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.878 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:57.878 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.117174+0000", 2024-09-12T00:05:57.878 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024240700000000001 2024-09-12T00:05:57.878 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.878 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.878 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:57.878 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126449+0000", 2024-09-12T00:05:57.878 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0092748699999999993 2024-09-12T00:05:57.878 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.878 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.878 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:57.878 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136438+0000", 2024-09-12T00:05:57.879 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099898539999999994 2024-09-12T00:05:57.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.879 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.879 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:57.879 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136532+0000", 2024-09-12T00:05:57.879 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3898000000000001e-05 2024-09-12T00:05:57.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.879 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.879 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:57.879 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136605+0000", 2024-09-12T00:05:57.879 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2677999999999998e-05 2024-09-12T00:05:57.879 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.879 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:57.880 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.880 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.880 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.880 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3125 3.12 3:495b0235:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:57.880 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:57.880 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 35.916016337999999, 2024-09-12T00:05:57.880 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030616648999999999, 2024-09-12T00:05:57.880 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:57.880 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:57.880 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:57.880 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:57.880 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:57.881 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:57.881 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3125 2024-09-12T00:05:57.881 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.881 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:57.881 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.881 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:57.881 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:57.881 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.881 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.881 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.881 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:57.881 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:05:57.881 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.882 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.882 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.882 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:57.882 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915773+0000", 2024-09-12T00:05:57.882 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2800000000000002e-06 2024-09-12T00:05:57.882 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.882 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.882 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:57.882 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919856+0000", 2024-09-12T00:05:57.882 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004082713 2024-09-12T00:05:57.882 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.882 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.882 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:57.882 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919879+0000", 2024-09-12T00:05:57.883 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3782e-05 2024-09-12T00:05:57.883 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.883 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.883 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:57.883 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919891+0000", 2024-09-12T00:05:57.883 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1440000000000001e-05 2024-09-12T00:05:57.883 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.883 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.883 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:57.883 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920037+0000", 2024-09-12T00:05:57.883 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014562700000000001 2024-09-12T00:05:57.883 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.883 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.883 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:57.883 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920280+0000", 2024-09-12T00:05:57.884 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000243274 2024-09-12T00:05:57.884 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.884 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.884 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:57.884 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920527+0000", 2024-09-12T00:05:57.884 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024692699999999998 2024-09-12T00:05:57.884 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.884 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.884 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:57.884 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.932485+0000", 2024-09-12T00:05:57.884 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011957857000000001 2024-09-12T00:05:57.885 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.885 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.885 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:57.885 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946197+0000", 2024-09-12T00:05:57.885 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013712436999999999 2024-09-12T00:05:57.885 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.885 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.885 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:57.885 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946305+0000", 2024-09-12T00:05:57.885 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000107914 2024-09-12T00:05:57.886 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.886 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.886 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:57.886 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946387+0000", 2024-09-12T00:05:57.886 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2398000000000006e-05 2024-09-12T00:05:57.886 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.886 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:57.886 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.886 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.886 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.886 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3134 3.24 3:2525a955:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:57.886 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:57.887 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 35.791939608, 2024-09-12T00:05:57.887 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025606806999999999, 2024-09-12T00:05:57.887 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:57.887 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:57.887 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:57.887 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:57.887 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:57.887 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:57.887 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3134 2024-09-12T00:05:57.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.887 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:57.887 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.887 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:57.887 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:57.888 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.888 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:57.888 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:05:57.888 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.888 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:57.888 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039850+0000", 2024-09-12T00:05:57.888 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9780000000000001e-06 2024-09-12T00:05:57.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.889 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:57.889 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045256+0000", 2024-09-12T00:05:57.889 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054058129999999998 2024-09-12T00:05:57.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.889 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.889 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:57.889 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045284+0000", 2024-09-12T00:05:57.889 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8065e-05 2024-09-12T00:05:57.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.889 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.889 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:57.889 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045297+0000", 2024-09-12T00:05:57.889 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2788e-05 2024-09-12T00:05:57.890 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.890 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.890 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:57.890 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045378+0000", 2024-09-12T00:05:57.890 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1079000000000001e-05 2024-09-12T00:05:57.890 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.890 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.890 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:57.890 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045530+0000", 2024-09-12T00:05:57.890 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015206099999999999 2024-09-12T00:05:57.890 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.890 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.890 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:57.890 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045655+0000", 2024-09-12T00:05:57.891 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012525899999999999 2024-09-12T00:05:57.891 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.891 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.891 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:57.891 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.054817+0000", 2024-09-12T00:05:57.891 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0091611049999999992 2024-09-12T00:05:57.891 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.891 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.891 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:57.891 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065354+0000", 2024-09-12T00:05:57.891 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010537625 2024-09-12T00:05:57.891 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.891 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.892 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:57.892 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065410+0000", 2024-09-12T00:05:57.892 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6141999999999999e-05 2024-09-12T00:05:57.892 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.892 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.892 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:57.892 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065454+0000", 2024-09-12T00:05:57.892 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3891999999999999e-05 2024-09-12T00:05:57.892 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.892 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:57.892 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.892 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.892 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.892 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3386 3.1 3:8071dd26:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:57.893 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.767011+0000", 2024-09-12T00:05:57.893 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.064776491, 2024-09-12T00:05:57.893 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.031756300000000001, 2024-09-12T00:05:57.893 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:57.893 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:57.893 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:57.893 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:57.893 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:57.893 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:57.893 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3386 2024-09-12T00:05:57.893 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.893 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:57.893 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.893 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:57.894 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.767011+0000", 2024-09-12T00:05:57.894 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.894 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.894 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.894 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:57.894 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.767011+0000", 2024-09-12T00:05:57.894 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.894 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.894 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.894 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:57.894 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.767014+0000", 2024-09-12T00:05:57.894 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0429999999999999e-06 2024-09-12T00:05:57.894 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.894 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.895 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:57.895 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775360+0000", 2024-09-12T00:05:57.895 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0083463740000000002 2024-09-12T00:05:57.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.895 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.895 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:57.895 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775398+0000", 2024-09-12T00:05:57.895 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8376e-05 2024-09-12T00:05:57.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.895 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.895 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:57.896 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775415+0000", 2024-09-12T00:05:57.896 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6563e-05 2024-09-12T00:05:57.896 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.896 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.896 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:57.896 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775556+0000", 2024-09-12T00:05:57.896 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000140865 2024-09-12T00:05:57.896 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.896 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.896 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:57.896 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775819+0000", 2024-09-12T00:05:57.897 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000262842 2024-09-12T00:05:57.897 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.897 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.897 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:57.897 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.776048+0000", 2024-09-12T00:05:57.897 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000229399 2024-09-12T00:05:57.897 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.897 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.897 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:57.897 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.791048+0000", 2024-09-12T00:05:57.897 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015000503 2024-09-12T00:05:57.897 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.898 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.898 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:57.898 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.798597+0000", 2024-09-12T00:05:57.898 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0075482409999999998 2024-09-12T00:05:57.898 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.898 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.898 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:57.898 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.798690+0000", 2024-09-12T00:05:57.898 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3769000000000003e-05 2024-09-12T00:05:57.898 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.898 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.898 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:57.898 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.798767+0000", 2024-09-12T00:05:57.898 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6324999999999999e-05 2024-09-12T00:05:57.899 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.899 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:57.899 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.899 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.899 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.899 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3397 3.4 3:220517e3:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:57.899 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.890276+0000", 2024-09-12T00:05:57.899 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.941511483999999, 2024-09-12T00:05:57.899 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.02507564, 2024-09-12T00:05:57.899 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:57.899 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:57.899 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:57.899 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:57.899 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:57.900 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:57.900 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3397 2024-09-12T00:05:57.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.900 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:57.900 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.900 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:57.900 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.890276+0000", 2024-09-12T00:05:57.900 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.900 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.900 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:57.900 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.890276+0000", 2024-09-12T00:05:57.900 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.901 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:57.901 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.890281+0000", 2024-09-12T00:05:57.901 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.366e-06 2024-09-12T00:05:57.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.901 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:57.901 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.894729+0000", 2024-09-12T00:05:57.901 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044483320000000002 2024-09-12T00:05:57.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.901 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:57.901 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.894782+0000", 2024-09-12T00:05:57.902 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2445999999999999e-05 2024-09-12T00:05:57.902 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.902 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.902 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:57.902 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.894810+0000", 2024-09-12T00:05:57.902 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8126000000000001e-05 2024-09-12T00:05:57.902 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.902 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.902 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:57.903 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.894961+0000", 2024-09-12T00:05:57.903 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015165999999999999 2024-09-12T00:05:57.903 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.903 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.903 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:57.903 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.895228+0000", 2024-09-12T00:05:57.903 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026675599999999999 2024-09-12T00:05:57.903 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.904 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.904 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:57.904 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.895478+0000", 2024-09-12T00:05:57.904 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025020199999999999 2024-09-12T00:05:57.904 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.904 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.904 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:57.904 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.913919+0000", 2024-09-12T00:05:57.904 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018440096999999999 2024-09-12T00:05:57.904 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.904 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.905 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:57.905 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.915109+0000", 2024-09-12T00:05:57.905 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0011908660000000001 2024-09-12T00:05:57.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.905 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.905 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:57.905 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.915239+0000", 2024-09-12T00:05:57.905 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012928399999999999 2024-09-12T00:05:57.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.905 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.906 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:57.906 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.915351+0000", 2024-09-12T00:05:57.906 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011250499999999999 2024-09-12T00:05:57.906 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.906 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:57.906 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.906 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.906 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3398 3.12 3:4888914b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:57.906 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.904027+0000", 2024-09-12T00:05:57.906 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.927759892000001, 2024-09-12T00:05:57.906 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.029408179999999999, 2024-09-12T00:05:57.906 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:57.907 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:57.907 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:57.907 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:57.907 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:57.907 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:57.907 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3398 2024-09-12T00:05:57.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.907 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:57.907 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.907 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:57.907 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.904027+0000", 2024-09-12T00:05:57.907 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.907 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.908 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:57.908 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.904027+0000", 2024-09-12T00:05:57.908 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.908 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.908 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:57.908 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.904030+0000", 2024-09-12T00:05:57.908 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0529999999999998e-06 2024-09-12T00:05:57.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.908 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.908 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:57.908 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.910958+0000", 2024-09-12T00:05:57.908 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0069274849999999997 2024-09-12T00:05:57.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.909 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.909 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:57.909 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.910989+0000", 2024-09-12T00:05:57.909 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1752999999999999e-05 2024-09-12T00:05:57.909 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.909 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.909 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:57.909 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911006+0000", 2024-09-12T00:05:57.909 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6463000000000001e-05 2024-09-12T00:05:57.909 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.909 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.909 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:57.909 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911171+0000", 2024-09-12T00:05:57.910 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016481699999999999 2024-09-12T00:05:57.910 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.910 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.910 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:57.910 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911417+0000", 2024-09-12T00:05:57.910 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024629600000000001 2024-09-12T00:05:57.910 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.910 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.910 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:57.910 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911646+0000", 2024-09-12T00:05:57.910 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022906599999999999 2024-09-12T00:05:57.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.911 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.911 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:57.911 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.932777+0000", 2024-09-12T00:05:57.911 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021130906000000001 2024-09-12T00:05:57.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.911 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.911 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:57.911 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.933094+0000", 2024-09-12T00:05:57.911 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000317127 2024-09-12T00:05:57.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.911 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.911 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:57.912 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.933277+0000", 2024-09-12T00:05:57.912 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018257000000000001 2024-09-12T00:05:57.912 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.912 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.912 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:57.912 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.933435+0000", 2024-09-12T00:05:57.912 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015864399999999999 2024-09-12T00:05:57.912 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.912 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:57.912 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.912 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.913 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.913 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3401 3.20 e82/23 3:06d9612a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_28:head v 82'11, mlcod=76'9)", 2024-09-12T00:05:57.913 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.936564+0000", 2024-09-12T00:05:57.913 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.895223130000002, 2024-09-12T00:05:57.913 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.026227489999999999, 2024-09-12T00:05:57.913 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:57.913 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:57.913 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:57.914 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:57.914 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.914 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:57.914 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.936564+0000", 2024-09-12T00:05:57.914 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.914 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.914 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:57.914 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.936564+0000", 2024-09-12T00:05:57.914 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.915 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.915 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:57.915 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.936571+0000", 2024-09-12T00:05:57.915 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5959999999999998e-06 2024-09-12T00:05:57.915 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.915 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.916 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:57.916 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941597+0000", 2024-09-12T00:05:57.916 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0050253720000000002 2024-09-12T00:05:57.916 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.916 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.916 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:57.917 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941625+0000", 2024-09-12T00:05:57.917 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8564999999999998e-05 2024-09-12T00:05:57.917 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.917 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.917 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:57.917 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941640+0000", 2024-09-12T00:05:57.918 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4837e-05 2024-09-12T00:05:57.918 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.918 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.918 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:57.918 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941776+0000", 2024-09-12T00:05:57.919 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013623500000000001 2024-09-12T00:05:57.919 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.919 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.919 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:57.919 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941822+0000", 2024-09-12T00:05:57.920 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5513000000000003e-05 2024-09-12T00:05:57.920 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.920 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.920 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:57.920 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.962694+0000", 2024-09-12T00:05:57.920 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020871516999999999 2024-09-12T00:05:57.921 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.921 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.921 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:57.921 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.962791+0000", 2024-09-12T00:05:57.921 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7855000000000004e-05 2024-09-12T00:05:57.922 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.922 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:57.922 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.922 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.922 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.922 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3670 3.5 e83/23 3:a3029b32:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_287:head v 83'13, mlcod=83'11)", 2024-09-12T00:05:57.923 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:43.823062+0000", 2024-09-12T00:05:57.923 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.008725175, 2024-09-12T00:05:57.923 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028976041000000001, 2024-09-12T00:05:57.923 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:57.923 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:57.923 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:57.924 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:57.924 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.924 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:57.924 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.823062+0000", 2024-09-12T00:05:57.924 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.924 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.925 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.925 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:57.925 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.823062+0000", 2024-09-12T00:05:57.925 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.925 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.925 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.926 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:57.926 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.823068+0000", 2024-09-12T00:05:57.926 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6250000000000001e-06 2024-09-12T00:05:57.926 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.927 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.927 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:57.927 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.826863+0000", 2024-09-12T00:05:57.927 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037945880000000002 2024-09-12T00:05:57.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.927 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.928 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:57.928 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.826885+0000", 2024-09-12T00:05:57.928 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1515e-05 2024-09-12T00:05:57.928 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.928 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.928 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:57.929 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.826894+0000", 2024-09-12T00:05:57.929 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4040000000000001e-06 2024-09-12T00:05:57.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.929 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.929 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:57.929 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.827014+0000", 2024-09-12T00:05:57.930 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120238 2024-09-12T00:05:57.930 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.930 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.930 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:57.931 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.827056+0000", 2024-09-12T00:05:57.931 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2129000000000003e-05 2024-09-12T00:05:57.931 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.931 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.931 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:57.931 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.851882+0000", 2024-09-12T00:05:57.932 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024825538000000001 2024-09-12T00:05:57.932 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.932 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.932 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:57.932 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.852038+0000", 2024-09-12T00:05:57.932 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015600400000000001 2024-09-12T00:05:57.933 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.933 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:57.933 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.934 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.934 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3681 3.12 3:481fb92d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_298:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:57.935 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:43.987522+0000", 2024-09-12T00:05:57.935 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 13.844264572, 2024-09-12T00:05:57.935 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.029063802999999999, 2024-09-12T00:05:57.935 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:57.935 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:57.936 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:57.936 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:57.936 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:57.936 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:57.937 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3681 2024-09-12T00:05:57.937 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.937 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:57.937 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.937 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:57.937 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.987522+0000", 2024-09-12T00:05:57.938 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.938 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.938 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:57.938 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.987522+0000", 2024-09-12T00:05:57.938 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.939 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.939 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.939 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:57.939 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.987527+0000", 2024-09-12T00:05:57.939 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5730000000000001e-06 2024-09-12T00:05:57.939 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.940 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.940 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:57.940 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.992931+0000", 2024-09-12T00:05:57.940 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054043950000000002 2024-09-12T00:05:57.940 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.940 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.941 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:57.941 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.992974+0000", 2024-09-12T00:05:57.941 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2542e-05 2024-09-12T00:05:57.941 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.941 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.941 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:57.941 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.992999+0000", 2024-09-12T00:05:57.942 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5113000000000002e-05 2024-09-12T00:05:57.942 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.942 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.942 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:57.942 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.993146+0000", 2024-09-12T00:05:57.942 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014703900000000001 2024-09-12T00:05:57.943 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.943 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.943 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:57.943 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.993270+0000", 2024-09-12T00:05:57.943 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012376100000000001 2024-09-12T00:05:57.943 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.943 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.943 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:57.943 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.993433+0000", 2024-09-12T00:05:57.943 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016290900000000001 2024-09-12T00:05:57.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.944 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.944 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:57.944 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.003341+0000", 2024-09-12T00:05:57.944 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099082289999999993 2024-09-12T00:05:57.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.944 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.944 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:57.944 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.016476+0000", 2024-09-12T00:05:57.944 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013134616999999999 2024-09-12T00:05:57.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.944 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.945 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:57.945 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.016528+0000", 2024-09-12T00:05:57.945 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2410000000000001e-05 2024-09-12T00:05:57.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.945 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:57.945 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.016586+0000", 2024-09-12T00:05:57.945 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8214999999999997e-05 2024-09-12T00:05:57.945 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.945 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:57.945 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.946 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3714 3.32 3:4e60a7f6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_331:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:57.946 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.707821+0000", 2024-09-12T00:05:57.946 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 13.123965599, 2024-09-12T00:05:57.946 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025583348999999998, 2024-09-12T00:05:57.946 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:57.946 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:57.946 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:57.946 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:57.946 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:57.946 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:57.946 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3714 2024-09-12T00:05:57.946 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.946 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:57.947 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.947 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:57.947 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.707821+0000", 2024-09-12T00:05:57.947 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.947 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.947 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:57.947 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.707821+0000", 2024-09-12T00:05:57.947 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.948 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:57.948 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.707867+0000", 2024-09-12T00:05:57.948 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5429000000000002e-05 2024-09-12T00:05:57.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.948 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:57.948 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715020+0000", 2024-09-12T00:05:57.948 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0071533580000000003 2024-09-12T00:05:57.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.948 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:57.948 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715058+0000", 2024-09-12T00:05:57.949 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7823e-05 2024-09-12T00:05:57.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.949 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:57.949 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715075+0000", 2024-09-12T00:05:57.949 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7122999999999999e-05 2024-09-12T00:05:57.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.949 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:57.949 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715275+0000", 2024-09-12T00:05:57.949 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020033 2024-09-12T00:05:57.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.950 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.950 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:57.950 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715526+0000", 2024-09-12T00:05:57.950 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025033500000000002 2024-09-12T00:05:57.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.950 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.950 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:57.950 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715760+0000", 2024-09-12T00:05:57.950 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023411600000000001 2024-09-12T00:05:57.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.951 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.951 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:57.951 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.731072+0000", 2024-09-12T00:05:57.951 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015311671000000001 2024-09-12T00:05:57.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.951 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.951 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:57.951 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.733084+0000", 2024-09-12T00:05:57.951 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020124299999999999 2024-09-12T00:05:57.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.951 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.951 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:57.951 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.733257+0000", 2024-09-12T00:05:57.952 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017338400000000001 2024-09-12T00:05:57.952 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.952 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.952 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:57.952 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.733405+0000", 2024-09-12T00:05:57.952 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014735 2024-09-12T00:05:57.952 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.952 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:57.952 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.952 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.952 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.952 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3726 3.33 3:cd6e0a10:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_343:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:57.952 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.865044+0000", 2024-09-12T00:05:57.952 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.966742606, 2024-09-12T00:05:57.953 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027130072000000002, 2024-09-12T00:05:57.953 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:57.953 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:57.953 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:57.953 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:57.953 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:57.953 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:57.953 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3726 2024-09-12T00:05:57.953 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.953 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:57.953 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.953 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:57.953 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.865044+0000", 2024-09-12T00:05:57.953 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.954 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.954 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:57.954 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.865044+0000", 2024-09-12T00:05:57.954 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.954 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.954 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:57.954 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.865048+0000", 2024-09-12T00:05:57.954 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1669999999999999e-06 2024-09-12T00:05:57.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.955 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.955 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:57.955 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869155+0000", 2024-09-12T00:05:57.955 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041073020000000002 2024-09-12T00:05:57.955 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.955 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.955 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:57.955 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869190+0000", 2024-09-12T00:05:57.955 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5113000000000001e-05 2024-09-12T00:05:57.955 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.955 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.956 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:57.956 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869207+0000", 2024-09-12T00:05:57.956 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6943e-05 2024-09-12T00:05:57.956 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.956 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.956 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:57.956 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869388+0000", 2024-09-12T00:05:57.956 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018116000000000001 2024-09-12T00:05:57.956 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.956 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.957 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:57.957 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869776+0000", 2024-09-12T00:05:57.957 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00038828099999999998 2024-09-12T00:05:57.957 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.957 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.957 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:57.957 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.870191+0000", 2024-09-12T00:05:57.957 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041471599999999998 2024-09-12T00:05:57.957 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.957 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.958 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:57.958 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.881480+0000", 2024-09-12T00:05:57.958 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0112887 2024-09-12T00:05:57.958 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.958 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.958 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:57.958 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.891979+0000", 2024-09-12T00:05:57.958 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010499377000000001 2024-09-12T00:05:57.958 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.958 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.959 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:57.959 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.892068+0000", 2024-09-12T00:05:57.959 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8374000000000005e-05 2024-09-12T00:05:57.959 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.959 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.959 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:57.959 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.892174+0000", 2024-09-12T00:05:57.959 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000106939 2024-09-12T00:05:57.959 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.959 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:57.959 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.960 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.960 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.960 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3732 3.25 3:a4e42410:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_349:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:57.960 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.935722+0000", 2024-09-12T00:05:57.960 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.896064662000001, 2024-09-12T00:05:57.960 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025382307, 2024-09-12T00:05:57.960 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:57.960 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:57.960 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:57.960 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:57.960 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:57.960 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:57.960 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3732 2024-09-12T00:05:57.961 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.961 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:57.961 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.961 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:57.961 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.935722+0000", 2024-09-12T00:05:57.961 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.961 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.961 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.961 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:57.961 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.935722+0000", 2024-09-12T00:05:57.961 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.961 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.961 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.962 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:57.962 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.935725+0000", 2024-09-12T00:05:57.962 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.943e-06 2024-09-12T00:05:57.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.962 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.962 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:57.962 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.940989+0000", 2024-09-12T00:05:57.962 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052639799999999997 2024-09-12T00:05:57.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.962 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.963 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:57.963 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.941045+0000", 2024-09-12T00:05:57.963 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6159000000000002e-05 2024-09-12T00:05:57.963 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.963 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.963 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:57.963 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.941064+0000", 2024-09-12T00:05:57.963 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8085999999999999e-05 2024-09-12T00:05:57.963 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.963 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.963 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:57.963 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.941195+0000", 2024-09-12T00:05:57.963 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000131125 2024-09-12T00:05:57.964 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.964 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.964 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:57.964 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.941435+0000", 2024-09-12T00:05:57.964 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024035899999999999 2024-09-12T00:05:57.964 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.964 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.964 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:57.964 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.941654+0000", 2024-09-12T00:05:57.964 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021882999999999999 2024-09-12T00:05:57.964 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.964 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.964 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:57.965 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.955258+0000", 2024-09-12T00:05:57.965 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013604171 2024-09-12T00:05:57.965 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.965 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.965 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:57.965 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.960941+0000", 2024-09-12T00:05:57.965 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0056832899999999997 2024-09-12T00:05:57.965 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.965 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.965 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:57.966 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.961030+0000", 2024-09-12T00:05:57.966 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8595000000000001e-05 2024-09-12T00:05:57.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.966 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.966 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:57.966 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.961105+0000", 2024-09-12T00:05:57.966 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4769000000000002e-05 2024-09-12T00:05:57.966 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.966 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:57.967 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.967 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.967 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.967 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3750 3.4 3:205ed86b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_367:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:57.967 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.141436+0000", 2024-09-12T00:05:57.967 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.690350681, 2024-09-12T00:05:57.967 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025245500000000001, 2024-09-12T00:05:57.967 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:57.967 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:57.967 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:57.967 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:57.968 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:57.968 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:57.968 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3750 2024-09-12T00:05:57.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.968 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:57.968 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.969 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:57.969 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.141436+0000", 2024-09-12T00:05:57.969 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.969 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.969 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:57.969 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.141436+0000", 2024-09-12T00:05:57.969 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.969 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.969 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:57.969 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.141440+0000", 2024-09-12T00:05:57.969 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5939999999999998e-06 2024-09-12T00:05:57.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.970 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.970 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:57.970 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.145505+0000", 2024-09-12T00:05:57.970 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040646160000000001 2024-09-12T00:05:57.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.970 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.970 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:57.970 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.145541+0000", 2024-09-12T00:05:57.971 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6508999999999999e-05 2024-09-12T00:05:57.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.971 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.971 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:57.971 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.145559+0000", 2024-09-12T00:05:57.971 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7853e-05 2024-09-12T00:05:57.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.971 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.971 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:57.971 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.145724+0000", 2024-09-12T00:05:57.971 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016462099999999999 2024-09-12T00:05:57.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.972 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.972 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:57.972 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.146114+0000", 2024-09-12T00:05:57.972 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039085699999999999 2024-09-12T00:05:57.972 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.972 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.972 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:57.972 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.146533+0000", 2024-09-12T00:05:57.972 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041889 2024-09-12T00:05:57.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.973 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:57.973 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.165996+0000", 2024-09-12T00:05:57.973 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019462461 2024-09-12T00:05:57.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.973 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:57.973 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.166514+0000", 2024-09-12T00:05:57.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00051867799999999996 2024-09-12T00:05:57.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.974 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:57.974 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.166614+0000", 2024-09-12T00:05:57.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9538999999999997e-05 2024-09-12T00:05:57.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.974 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:57.974 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.166682+0000", 2024-09-12T00:05:57.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.7881999999999998e-05 2024-09-12T00:05:57.974 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.974 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:57.974 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.975 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3768 3.25 3:a5893d4d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_385:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:57.975 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.338740+0000", 2024-09-12T00:05:57.975 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.493046720000001, 2024-09-12T00:05:57.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025891451999999999, 2024-09-12T00:05:57.975 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:57.975 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:57.976 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:57.976 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:57.976 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:57.976 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:57.977 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3768 2024-09-12T00:05:57.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.977 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:57.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.977 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:57.977 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.338740+0000", 2024-09-12T00:05:57.977 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.978 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:57.978 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.338740+0000", 2024-09-12T00:05:57.978 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.979 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.979 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:57.979 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.338744+0000", 2024-09-12T00:05:57.979 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1470000000000003e-06 2024-09-12T00:05:57.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.979 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.980 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:57.980 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343258+0000", 2024-09-12T00:05:57.980 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045136880000000001 2024-09-12T00:05:57.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.980 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:57.981 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343292+0000", 2024-09-12T00:05:57.981 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3893000000000002e-05 2024-09-12T00:05:57.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.982 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:57.982 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343337+0000", 2024-09-12T00:05:57.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4699e-05 2024-09-12T00:05:57.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.982 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:57.983 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343453+0000", 2024-09-12T00:05:57.983 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000116272 2024-09-12T00:05:57.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.983 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.983 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:57.984 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343770+0000", 2024-09-12T00:05:57.984 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00031750799999999998 2024-09-12T00:05:57.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.984 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.984 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:57.985 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343992+0000", 2024-09-12T00:05:57.985 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000221986 2024-09-12T00:05:57.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.985 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:57.986 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.355234+0000", 2024-09-12T00:05:57.986 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011241637000000001 2024-09-12T00:05:57.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.986 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:57.986 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.364420+0000", 2024-09-12T00:05:57.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0091854320000000003 2024-09-12T00:05:57.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.987 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:57.987 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.364514+0000", 2024-09-12T00:05:57.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4492000000000003e-05 2024-09-12T00:05:57.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.988 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:57.988 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.364632+0000", 2024-09-12T00:05:57.988 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117698 2024-09-12T00:05:57.988 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.989 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:57.989 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:57.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.989 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3791 3.4 3:2186e625:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_408:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:57.989 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.609529+0000", 2024-09-12T00:05:57.990 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.222257918, 2024-09-12T00:05:57.990 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.031252178999999998, 2024-09-12T00:05:57.990 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:57.990 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:57.990 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:57.990 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:57.991 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:57.991 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:57.991 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3791 2024-09-12T00:05:57.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.991 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:57.991 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.991 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:57.991 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.609529+0000", 2024-09-12T00:05:57.992 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.992 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.992 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:57.992 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.609529+0000", 2024-09-12T00:05:57.993 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:57.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.993 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:57.993 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.609532+0000", 2024-09-12T00:05:57.993 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3230000000000002e-06 2024-09-12T00:05:57.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.993 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:57.993 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.613514+0000", 2024-09-12T00:05:57.993 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039820439999999997 2024-09-12T00:05:57.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.994 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:57.994 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.613550+0000", 2024-09-12T00:05:57.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5821999999999997e-05 2024-09-12T00:05:57.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.994 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:57.994 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.613568+0000", 2024-09-12T00:05:57.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7363e-05 2024-09-12T00:05:57.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.994 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:57.994 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.613738+0000", 2024-09-12T00:05:57.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017081400000000001 2024-09-12T00:05:57.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.995 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.995 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:57.995 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.614134+0000", 2024-09-12T00:05:57.995 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000395454 2024-09-12T00:05:57.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.995 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.995 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:57.995 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.614529+0000", 2024-09-12T00:05:57.995 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039467300000000001 2024-09-12T00:05:57.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.995 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.995 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:57.995 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.632368+0000", 2024-09-12T00:05:57.996 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017839482 2024-09-12T00:05:57.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.996 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:57.996 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.640584+0000", 2024-09-12T00:05:57.996 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082160700000000007 2024-09-12T00:05:57.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.996 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:57.996 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.640694+0000", 2024-09-12T00:05:57.996 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109782 2024-09-12T00:05:57.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:57.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:57.997 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:58.000 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.640781+0000", 2024-09-12T00:05:58.001 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7352e-05 2024-09-12T00:05:58.001 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.001 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.001 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.001 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.001 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.001 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:58.003 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:05:58.003 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:58.004+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:58.103 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:58.104+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:58.176 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:58.176 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:58.176 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:05:58.176 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:58.190 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:05:58.235 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:58.236+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:58.306 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:05:58.308+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:05:58.367 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:58.367 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:05:58.368 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:05:58.368 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:05:58.368 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:58.382 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:05:58.407 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:58.408+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:58.508 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:05:58.508 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:05:58.508 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:05:58.508 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:05:58.508 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.508 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:1646 3.25 e58/23 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head v 58'1, mlcod=0'0)", 2024-09-12T00:05:58.508 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:58.509 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 85.419831838999997, 2024-09-12T00:05:58.509 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020301987000000001, 2024-09-12T00:05:58.509 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:58.509 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:58.509 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:58.509 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:58.509 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.509 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:58.509 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:58.509 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.509 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.509 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:58.510 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:05:58.510 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.510 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.510 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:58.510 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086308+0000", 2024-09-12T00:05:58.510 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.95e-06 2024-09-12T00:05:58.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.510 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.510 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:58.510 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091174+0000", 2024-09-12T00:05:58.510 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048660559999999997 2024-09-12T00:05:58.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.511 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.511 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:58.511 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091218+0000", 2024-09-12T00:05:58.511 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4678999999999997e-05 2024-09-12T00:05:58.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.511 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.511 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:58.511 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091238+0000", 2024-09-12T00:05:58.511 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9839000000000001e-05 2024-09-12T00:05:58.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.511 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.511 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:58.511 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091396+0000", 2024-09-12T00:05:58.512 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000157396 2024-09-12T00:05:58.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.512 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:58.512 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091451+0000", 2024-09-12T00:05:58.512 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5547999999999997e-05 2024-09-12T00:05:58.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.512 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:58.512 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106474+0000", 2024-09-12T00:05:58.512 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015023287 2024-09-12T00:05:58.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.513 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:58.513 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106608+0000", 2024-09-12T00:05:58.513 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133232 2024-09-12T00:05:58.513 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.513 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.513 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.513 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.513 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2723 3.21 3:86535907:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:58.513 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:58.513 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 70.673984372000007, 2024-09-12T00:05:58.513 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021210407000000001, 2024-09-12T00:05:58.514 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:58.514 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:58.514 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:58.514 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:58.514 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:58.514 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:58.514 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2723 2024-09-12T00:05:58.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.514 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:58.514 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.514 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:58.514 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:58.514 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.515 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.515 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:58.515 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:05:58.515 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.515 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.515 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:58.515 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832157+0000", 2024-09-12T00:05:58.515 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3270000000000001e-06 2024-09-12T00:05:58.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.516 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.516 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:58.516 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837403+0000", 2024-09-12T00:05:58.516 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005246784 2024-09-12T00:05:58.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.516 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.516 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:58.516 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837439+0000", 2024-09-12T00:05:58.516 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5848e-05 2024-09-12T00:05:58.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.516 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.516 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:58.516 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837459+0000", 2024-09-12T00:05:58.517 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9585e-05 2024-09-12T00:05:58.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.517 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:58.517 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837574+0000", 2024-09-12T00:05:58.517 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000114917 2024-09-12T00:05:58.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.517 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:58.517 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837803+0000", 2024-09-12T00:05:58.517 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022967699999999999 2024-09-12T00:05:58.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.517 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:58.518 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838174+0000", 2024-09-12T00:05:58.518 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037083899999999998 2024-09-12T00:05:58.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.518 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.518 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:58.518 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848447+0000", 2024-09-12T00:05:58.518 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010272439 2024-09-12T00:05:58.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.518 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.518 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:58.518 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853191+0000", 2024-09-12T00:05:58.518 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047441109999999996 2024-09-12T00:05:58.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.518 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.519 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:58.519 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853292+0000", 2024-09-12T00:05:58.519 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000101474 2024-09-12T00:05:58.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.519 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.519 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:58.519 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853364+0000", 2024-09-12T00:05:58.519 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1406e-05 2024-09-12T00:05:58.519 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.519 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.519 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.519 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.519 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2971 3.2e 3:76f45d45:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:58.520 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:58.520 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 38.430270034999999, 2024-09-12T00:05:58.520 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022571213, 2024-09-12T00:05:58.520 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:58.520 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:58.520 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:58.520 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:58.520 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:58.520 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:58.520 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2971 2024-09-12T00:05:58.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.520 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:58.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.520 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:58.521 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:58.521 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.521 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.521 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:58.521 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:05:58.521 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.521 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.521 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:58.521 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075871+0000", 2024-09-12T00:05:58.521 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.467e-06 2024-09-12T00:05:58.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.521 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.522 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:58.522 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080307+0000", 2024-09-12T00:05:58.522 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044356359999999997 2024-09-12T00:05:58.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.522 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.522 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:58.522 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080346+0000", 2024-09-12T00:05:58.522 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9267999999999997e-05 2024-09-12T00:05:58.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.522 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.522 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:58.522 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080368+0000", 2024-09-12T00:05:58.522 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2603e-05 2024-09-12T00:05:58.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.523 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:58.523 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080489+0000", 2024-09-12T00:05:58.523 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0001209 2024-09-12T00:05:58.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.523 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:58.523 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080830+0000", 2024-09-12T00:05:58.523 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00034099 2024-09-12T00:05:58.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.523 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:58.523 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.081119+0000", 2024-09-12T00:05:58.524 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028860300000000001 2024-09-12T00:05:58.524 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.524 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.524 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:58.524 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.093241+0000", 2024-09-12T00:05:58.524 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012121609 2024-09-12T00:05:58.524 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.524 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.524 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:58.524 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098277+0000", 2024-09-12T00:05:58.524 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0050359710000000002 2024-09-12T00:05:58.524 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.524 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.525 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:58.525 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098366+0000", 2024-09-12T00:05:58.525 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9052000000000001e-05 2024-09-12T00:05:58.525 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.525 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.525 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:58.525 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098439+0000", 2024-09-12T00:05:58.525 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3114000000000005e-05 2024-09-12T00:05:58.525 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.525 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.525 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.525 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.525 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.525 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2996 3.21 3:872b1c12:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:58.526 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:58.526 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 38.155645298000003, 2024-09-12T00:05:58.526 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027562314000000001, 2024-09-12T00:05:58.526 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:58.526 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:58.526 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:58.526 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:58.526 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:58.526 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:58.526 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2996 2024-09-12T00:05:58.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.526 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:58.526 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.526 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:58.527 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:58.527 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.527 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.527 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:58.527 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:05:58.527 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.527 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.527 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:58.527 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350496+0000", 2024-09-12T00:05:58.527 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9160000000000003e-06 2024-09-12T00:05:58.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.528 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.528 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:58.528 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355187+0000", 2024-09-12T00:05:58.528 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046904989999999999 2024-09-12T00:05:58.528 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.528 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.528 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:58.528 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355223+0000", 2024-09-12T00:05:58.528 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6125999999999999e-05 2024-09-12T00:05:58.528 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.528 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.528 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:58.528 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355241+0000", 2024-09-12T00:05:58.529 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8686e-05 2024-09-12T00:05:58.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.529 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.529 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:58.529 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355373+0000", 2024-09-12T00:05:58.529 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013129299999999999 2024-09-12T00:05:58.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.529 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.529 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:58.529 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355619+0000", 2024-09-12T00:05:58.529 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024662700000000002 2024-09-12T00:05:58.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.529 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.529 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355855+0000", 2024-09-12T00:05:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023604299999999999 2024-09-12T00:05:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.367983+0000", 2024-09-12T00:05:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012127104999999999 2024-09-12T00:05:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377884+0000", 2024-09-12T00:05:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099013680000000007 2024-09-12T00:05:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.531 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:58.531 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377974+0000", 2024-09-12T00:05:58.531 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9932999999999994e-05 2024-09-12T00:05:58.531 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.531 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.531 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:58.531 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.378055+0000", 2024-09-12T00:05:58.531 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0717999999999995e-05 2024-09-12T00:05:58.531 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.531 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.531 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.531 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.531 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.531 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3030 3.2e 3:740afe3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:58.532 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:58.532 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 37.766315140000003, 2024-09-12T00:05:58.532 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.033756331000000001, 2024-09-12T00:05:58.532 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:58.532 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:58.532 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:58.532 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:58.532 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:58.532 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:58.532 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3030 2024-09-12T00:05:58.532 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.532 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:58.532 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.533 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:58.533 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:58.533 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.533 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.533 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.533 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:58.533 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:05:58.533 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.533 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.533 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.533 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:58.533 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739825+0000", 2024-09-12T00:05:58.533 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7920000000000001e-06 2024-09-12T00:05:58.533 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.533 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.534 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:58.534 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744217+0000", 2024-09-12T00:05:58.534 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043922529999999996 2024-09-12T00:05:58.534 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.534 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.534 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:58.534 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744243+0000", 2024-09-12T00:05:58.534 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5253e-05 2024-09-12T00:05:58.534 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.534 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.534 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:58.534 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744254+0000", 2024-09-12T00:05:58.534 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1430999999999999e-05 2024-09-12T00:05:58.534 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.535 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.535 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:58.535 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744325+0000", 2024-09-12T00:05:58.535 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1340999999999993e-05 2024-09-12T00:05:58.535 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.535 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.535 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:58.535 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744461+0000", 2024-09-12T00:05:58.535 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013531700000000001 2024-09-12T00:05:58.535 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.536 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.536 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:58.536 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744574+0000", 2024-09-12T00:05:58.536 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113513 2024-09-12T00:05:58.536 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.536 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.536 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:58.536 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.752813+0000", 2024-09-12T00:05:58.536 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082384750000000003 2024-09-12T00:05:58.536 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.536 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.536 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:58.536 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773444+0000", 2024-09-12T00:05:58.537 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020630773000000002 2024-09-12T00:05:58.537 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.537 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.537 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:58.537 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773510+0000", 2024-09-12T00:05:58.537 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6711000000000006e-05 2024-09-12T00:05:58.537 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.537 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.537 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:58.537 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773579+0000", 2024-09-12T00:05:58.537 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8472000000000004e-05 2024-09-12T00:05:58.537 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.537 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.538 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.538 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.538 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.538 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3039 3.2e 3:74587332:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:58.538 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:58.538 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 37.670635212000001, 2024-09-12T00:05:58.538 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.036215114, 2024-09-12T00:05:58.538 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:58.538 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:58.538 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:58.538 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:58.538 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:58.538 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:58.538 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3039 2024-09-12T00:05:58.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.539 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:58.539 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.539 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:58.539 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:58.539 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.539 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.539 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:58.539 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:05:58.539 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.539 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.539 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:58.540 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835507+0000", 2024-09-12T00:05:58.540 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6e-06 2024-09-12T00:05:58.540 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.540 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.540 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:58.540 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848930+0000", 2024-09-12T00:05:58.540 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013423242 2024-09-12T00:05:58.540 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.540 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.540 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:58.540 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848969+0000", 2024-09-12T00:05:58.540 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9270000000000002e-05 2024-09-12T00:05:58.540 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.540 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.541 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:58.541 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848991+0000", 2024-09-12T00:05:58.541 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1565000000000001e-05 2024-09-12T00:05:58.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.541 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.541 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:58.541 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849089+0000", 2024-09-12T00:05:58.541 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8408999999999999e-05 2024-09-12T00:05:58.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.541 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.541 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:58.541 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849518+0000", 2024-09-12T00:05:58.541 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042813900000000002 2024-09-12T00:05:58.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.542 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.542 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:58.542 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849897+0000", 2024-09-12T00:05:58.542 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037936600000000001 2024-09-12T00:05:58.542 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.542 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.542 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:58.542 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.858549+0000", 2024-09-12T00:05:58.542 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086520820000000002 2024-09-12T00:05:58.542 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.542 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.542 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:58.542 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871522+0000", 2024-09-12T00:05:58.542 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012973182999999999 2024-09-12T00:05:58.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.543 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.543 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:58.543 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871633+0000", 2024-09-12T00:05:58.543 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011085 2024-09-12T00:05:58.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.543 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.543 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:58.543 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871717+0000", 2024-09-12T00:05:58.543 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.4407999999999996e-05 2024-09-12T00:05:58.543 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.543 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.543 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.544 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.544 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3050 3.b 3:d26f7141:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:58.544 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:58.544 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 37.549022956000002, 2024-09-12T00:05:58.544 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022896481999999999, 2024-09-12T00:05:58.544 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:58.544 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:58.544 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:58.544 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:58.544 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:58.544 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:58.544 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3050 2024-09-12T00:05:58.544 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.544 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:58.545 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.545 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:58.545 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:58.545 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.545 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.545 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:58.545 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:05:58.545 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.545 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.545 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:58.545 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957117+0000", 2024-09-12T00:05:58.545 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7e-06 2024-09-12T00:05:58.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.546 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.546 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:58.546 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961673+0000", 2024-09-12T00:05:58.546 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045558059999999999 2024-09-12T00:05:58.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.546 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.546 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:58.546 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961698+0000", 2024-09-12T00:05:58.546 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5017000000000001e-05 2024-09-12T00:05:58.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.546 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.546 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:58.546 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961710+0000", 2024-09-12T00:05:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1963999999999999e-05 2024-09-12T00:05:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961785+0000", 2024-09-12T00:05:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5153000000000004e-05 2024-09-12T00:05:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961926+0000", 2024-09-12T00:05:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000141194 2024-09-12T00:05:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:58.548 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.962055+0000", 2024-09-12T00:05:58.548 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012882400000000001 2024-09-12T00:05:58.548 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.548 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.548 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:58.548 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.970716+0000", 2024-09-12T00:05:58.548 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086603610000000001 2024-09-12T00:05:58.548 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.548 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.548 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:58.548 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979700+0000", 2024-09-12T00:05:58.548 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.008984054 2024-09-12T00:05:58.548 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979884+0000", 2024-09-12T00:05:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184215 2024-09-12T00:05:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.980011+0000", 2024-09-12T00:05:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012719399999999999 2024-09-12T00:05:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3065 3.b 3:d10bf58d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 37.384075336000002, 2024-09-12T00:05:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021843261999999999, 2024-09-12T00:05:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3065 2024-09-12T00:05:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:05:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122067+0000", 2024-09-12T00:05:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4970000000000003e-06 2024-09-12T00:05:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126931+0000", 2024-09-12T00:05:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048641090000000001 2024-09-12T00:05:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126973+0000", 2024-09-12T00:05:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1678999999999999e-05 2024-09-12T00:05:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126999+0000", 2024-09-12T00:05:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6536000000000001e-05 2024-09-12T00:05:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127118+0000", 2024-09-12T00:05:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000119373 2024-09-12T00:05:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127289+0000", 2024-09-12T00:05:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017020199999999999 2024-09-12T00:05:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127437+0000", 2024-09-12T00:05:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148682 2024-09-12T00:05:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138539+0000", 2024-09-12T00:05:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011101418 2024-09-12T00:05:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143355+0000", 2024-09-12T00:05:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048161499999999999 2024-09-12T00:05:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143777+0000", 2024-09-12T00:05:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000421896 2024-09-12T00:05:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143905+0000", 2024-09-12T00:05:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012872 2024-09-12T00:05:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3066 3.21 3:8448517d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:58.556 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:58.556 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 37.374129254000003, 2024-09-12T00:05:58.556 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025911652, 2024-09-12T00:05:58.556 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:58.556 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:58.556 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:58.556 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:58.556 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:58.556 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:58.556 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3066 2024-09-12T00:05:58.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.556 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:58.556 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.556 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:05:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132011+0000", 2024-09-12T00:05:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8270000000000002e-06 2024-09-12T00:05:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137934+0000", 2024-09-12T00:05:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059226119999999998 2024-09-12T00:05:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137968+0000", 2024-09-12T00:05:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3933000000000002e-05 2024-09-12T00:05:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137985+0000", 2024-09-12T00:05:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7725999999999999e-05 2024-09-12T00:05:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.559 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.559 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:58.559 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138084+0000", 2024-09-12T00:05:58.559 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8450999999999996e-05 2024-09-12T00:05:58.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.559 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.559 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:58.559 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138285+0000", 2024-09-12T00:05:58.559 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000201411 2024-09-12T00:05:58.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.559 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.559 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:58.559 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138510+0000", 2024-09-12T00:05:58.559 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000224551 2024-09-12T00:05:58.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.560 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.560 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:58.560 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.146242+0000", 2024-09-12T00:05:58.560 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077317649999999998 2024-09-12T00:05:58.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.560 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.560 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:58.560 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157728+0000", 2024-09-12T00:05:58.560 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011486424 2024-09-12T00:05:58.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.560 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.560 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:58.560 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157833+0000", 2024-09-12T00:05:58.561 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105234 2024-09-12T00:05:58.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.561 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.561 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:58.561 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157920+0000", 2024-09-12T00:05:58.561 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6718000000000006e-05 2024-09-12T00:05:58.561 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.561 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.561 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.561 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.561 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3112 3.b 3:d1cf91a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:58.561 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:58.561 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 36.755412127, 2024-09-12T00:05:58.562 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021203475999999999, 2024-09-12T00:05:58.562 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:58.562 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:58.562 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:58.562 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:58.562 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:58.562 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:58.562 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3112 2024-09-12T00:05:58.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.562 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:58.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.562 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:58.562 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:58.562 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.563 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.563 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:58.563 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:05:58.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.563 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.563 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:58.563 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750728+0000", 2024-09-12T00:05:58.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.165e-06 2024-09-12T00:05:58.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.563 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.563 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:58.563 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755063+0000", 2024-09-12T00:05:58.563 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043355379999999999 2024-09-12T00:05:58.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.564 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:58.564 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755103+0000", 2024-09-12T00:05:58.564 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9962000000000001e-05 2024-09-12T00:05:58.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.564 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:58.564 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755120+0000", 2024-09-12T00:05:58.564 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6793e-05 2024-09-12T00:05:58.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.564 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:58.564 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755299+0000", 2024-09-12T00:05:58.565 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017904499999999999 2024-09-12T00:05:58.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.565 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.565 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:58.565 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755758+0000", 2024-09-12T00:05:58.565 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000458815 2024-09-12T00:05:58.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.565 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.565 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:58.565 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.756304+0000", 2024-09-12T00:05:58.565 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000546183 2024-09-12T00:05:58.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.565 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.565 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:58.566 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771518+0000", 2024-09-12T00:05:58.566 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015214236000000001 2024-09-12T00:05:58.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.566 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:58.566 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771827+0000", 2024-09-12T00:05:58.566 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000309308 2024-09-12T00:05:58.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.566 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:58.566 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771874+0000", 2024-09-12T00:05:58.566 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6119999999999999e-05 2024-09-12T00:05:58.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.567 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:58.567 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771929+0000", 2024-09-12T00:05:58.567 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5310999999999999e-05 2024-09-12T00:05:58.567 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.567 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.567 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.567 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.567 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3115 3.2e 3:75803fec:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:58.567 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:58.567 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 36.717441076999997, 2024-09-12T00:05:58.567 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020205041, 2024-09-12T00:05:58.567 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:58.567 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:58.568 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:58.568 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:58.568 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:58.568 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:58.568 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3115 2024-09-12T00:05:58.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.568 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:58.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.568 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:58.568 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:58.568 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.569 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:58.569 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:05:58.569 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.569 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.569 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:58.569 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788700+0000", 2024-09-12T00:05:58.569 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.614e-06 2024-09-12T00:05:58.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.569 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.569 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:58.569 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793576+0000", 2024-09-12T00:05:58.570 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048760920000000003 2024-09-12T00:05:58.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:58.570 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793610+0000", 2024-09-12T00:05:58.570 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4184999999999999e-05 2024-09-12T00:05:58.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:58.570 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793633+0000", 2024-09-12T00:05:58.570 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2551000000000001e-05 2024-09-12T00:05:58.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.570 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:58.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793750+0000", 2024-09-12T00:05:58.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117057 2024-09-12T00:05:58.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.571 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:58.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793975+0000", 2024-09-12T00:05:58.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022493099999999999 2024-09-12T00:05:58.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.571 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:58.571 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.794178+0000", 2024-09-12T00:05:58.571 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000202726 2024-09-12T00:05:58.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.572 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:58.572 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.803725+0000", 2024-09-12T00:05:58.572 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095470599999999996 2024-09-12T00:05:58.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.572 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.572 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:58.572 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808706+0000", 2024-09-12T00:05:58.572 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049814519999999999 2024-09-12T00:05:58.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.572 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.572 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:58.572 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808785+0000", 2024-09-12T00:05:58.572 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9160999999999996e-05 2024-09-12T00:05:58.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.573 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:58.573 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808902+0000", 2024-09-12T00:05:58.573 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000116212 2024-09-12T00:05:58.573 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.573 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.573 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.573 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3380 3.23 e82/23 3:c6c9ccf8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_7:head v 82'5, mlcod=76'3)", 2024-09-12T00:05:58.573 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:05:58.573 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.799616059000002, 2024-09-12T00:05:58.573 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.029708818000000001, 2024-09-12T00:05:58.573 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:58.574 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:58.574 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:58.574 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:58.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.574 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:58.574 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:05:58.574 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.574 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:58.574 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:05:58.574 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.575 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:58.575 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:05:58.575 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1600000000000001e-07 2024-09-12T00:05:58.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.575 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.575 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:58.575 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.710842+0000", 2024-09-12T00:05:58.575 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043204510000000003 2024-09-12T00:05:58.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.575 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.575 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:58.575 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.710875+0000", 2024-09-12T00:05:58.575 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2702e-05 2024-09-12T00:05:58.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.576 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:58.576 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.710895+0000", 2024-09-12T00:05:58.576 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0094000000000001e-05 2024-09-12T00:05:58.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.576 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:58.576 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.711063+0000", 2024-09-12T00:05:58.576 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000167517 2024-09-12T00:05:58.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.576 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:58.576 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.711127+0000", 2024-09-12T00:05:58.576 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4004999999999995e-05 2024-09-12T00:05:58.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.577 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.577 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:58.577 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.736095+0000", 2024-09-12T00:05:58.577 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024968008999999999 2024-09-12T00:05:58.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.577 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.577 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:58.577 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.736230+0000", 2024-09-12T00:05:58.577 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013552400000000001 2024-09-12T00:05:58.577 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.577 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.577 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.578 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3409 3.b 3:d39a1970:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:58.578 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:41.028923+0000", 2024-09-12T00:05:58.578 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.477215042000001, 2024-09-12T00:05:58.578 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030518363999999999, 2024-09-12T00:05:58.578 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:58.578 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:58.578 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:58.578 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:58.578 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:58.578 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:58.578 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3409 2024-09-12T00:05:58.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.578 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:58.579 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.579 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:58.579 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.028923+0000", 2024-09-12T00:05:58.579 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.579 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.579 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:58.579 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.028923+0000", 2024-09-12T00:05:58.579 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.579 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.579 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:58.579 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.028926+0000", 2024-09-12T00:05:58.579 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1e-06 2024-09-12T00:05:58.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.580 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.580 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:58.580 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038010+0000", 2024-09-12T00:05:58.580 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0090839110000000001 2024-09-12T00:05:58.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.580 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.580 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:58.580 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038042+0000", 2024-09-12T00:05:58.580 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2425999999999998e-05 2024-09-12T00:05:58.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.580 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.580 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:58.580 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038060+0000", 2024-09-12T00:05:58.581 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8219e-05 2024-09-12T00:05:58.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.581 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.581 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:58.581 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038205+0000", 2024-09-12T00:05:58.581 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014503500000000001 2024-09-12T00:05:58.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.581 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.581 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:58.581 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038498+0000", 2024-09-12T00:05:58.581 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00029289499999999999 2024-09-12T00:05:58.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.581 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.582 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:58.582 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038752+0000", 2024-09-12T00:05:58.582 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025434500000000001 2024-09-12T00:05:58.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.582 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:58.582 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.058529+0000", 2024-09-12T00:05:58.582 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019776275999999999 2024-09-12T00:05:58.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.582 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:58.582 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.059147+0000", 2024-09-12T00:05:58.582 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00061837199999999995 2024-09-12T00:05:58.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.583 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.583 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:58.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.059328+0000", 2024-09-12T00:05:58.583 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018048399999999999 2024-09-12T00:05:58.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.583 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.583 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:58.583 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.059441+0000", 2024-09-12T00:05:58.583 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011330100000000001 2024-09-12T00:05:58.583 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.583 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.583 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.583 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.583 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3665 3.21 3:85e29f15:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_282:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:58.584 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:43.757083+0000", 2024-09-12T00:05:58.584 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.749054328, 2024-09-12T00:05:58.584 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021222119000000001, 2024-09-12T00:05:58.584 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:58.584 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:58.584 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:58.584 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:58.584 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:58.584 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:58.584 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3665 2024-09-12T00:05:58.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.584 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:58.584 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.585 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:58.585 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.757083+0000", 2024-09-12T00:05:58.585 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.585 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.585 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:58.585 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.757083+0000", 2024-09-12T00:05:58.585 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.585 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.585 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:58.585 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.757087+0000", 2024-09-12T00:05:58.585 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2370000000000003e-06 2024-09-12T00:05:58.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.586 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.586 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:58.586 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763296+0000", 2024-09-12T00:05:58.586 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0062089240000000002 2024-09-12T00:05:58.586 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.586 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.586 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:58.586 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763337+0000", 2024-09-12T00:05:58.586 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1032999999999998e-05 2024-09-12T00:05:58.586 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.586 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.586 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:58.586 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763356+0000", 2024-09-12T00:05:58.586 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8292999999999999e-05 2024-09-12T00:05:58.586 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.587 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.587 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:58.587 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763485+0000", 2024-09-12T00:05:58.587 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012931499999999999 2024-09-12T00:05:58.587 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.587 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.587 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:58.587 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763704+0000", 2024-09-12T00:05:58.587 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021922399999999999 2024-09-12T00:05:58.587 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.587 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.587 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:58.587 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763888+0000", 2024-09-12T00:05:58.587 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184146 2024-09-12T00:05:58.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.588 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.588 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:58.588 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.772359+0000", 2024-09-12T00:05:58.588 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0084704089999999999 2024-09-12T00:05:58.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.588 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.588 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:58.588 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.778004+0000", 2024-09-12T00:05:58.588 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0056452619999999998 2024-09-12T00:05:58.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.588 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.588 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:58.588 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.778173+0000", 2024-09-12T00:05:58.589 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016846299999999999 2024-09-12T00:05:58.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.589 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.589 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:58.589 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.778305+0000", 2024-09-12T00:05:58.589 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013281299999999999 2024-09-12T00:05:58.589 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.589 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.589 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.589 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.589 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3696 3.21 3:872f3075:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_313:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:58.589 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.301332+0000", 2024-09-12T00:05:58.589 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 14.204805858, 2024-09-12T00:05:58.590 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024918241000000001, 2024-09-12T00:05:58.590 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:58.590 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:58.590 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:58.590 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:58.590 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:58.590 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:58.590 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3696 2024-09-12T00:05:58.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.590 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:58.590 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.590 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:58.590 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.301332+0000", 2024-09-12T00:05:58.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.591 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:58.591 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.301332+0000", 2024-09-12T00:05:58.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.591 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:58.591 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.301335+0000", 2024-09-12T00:05:58.591 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9679999999999998e-06 2024-09-12T00:05:58.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.591 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:58.592 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.305984+0000", 2024-09-12T00:05:58.592 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046492249999999999 2024-09-12T00:05:58.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.592 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.592 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:58.592 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306009+0000", 2024-09-12T00:05:58.592 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5252000000000001e-05 2024-09-12T00:05:58.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.592 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.592 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:58.592 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306023+0000", 2024-09-12T00:05:58.592 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3903000000000001e-05 2024-09-12T00:05:58.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.592 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.593 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:58.593 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306193+0000", 2024-09-12T00:05:58.593 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017032500000000001 2024-09-12T00:05:58.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.593 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:58.593 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306594+0000", 2024-09-12T00:05:58.593 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040111600000000003 2024-09-12T00:05:58.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.593 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:58.593 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.307002+0000", 2024-09-12T00:05:58.593 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040796000000000002 2024-09-12T00:05:58.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.594 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.594 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:58.594 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.319319+0000", 2024-09-12T00:05:58.594 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012317033 2024-09-12T00:05:58.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.594 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.594 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:58.594 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.325949+0000", 2024-09-12T00:05:58.594 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0066298110000000002 2024-09-12T00:05:58.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.594 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.594 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:58.594 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.326123+0000", 2024-09-12T00:05:58.595 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017416999999999999 2024-09-12T00:05:58.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.595 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:58.595 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.326250+0000", 2024-09-12T00:05:58.595 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012647799999999999 2024-09-12T00:05:58.595 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.595 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.595 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.595 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3737 3.b 3:d32629e2:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_354:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:58.595 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.993654+0000", 2024-09-12T00:05:58.595 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 13.512483538, 2024-09-12T00:05:58.596 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022195105999999999, 2024-09-12T00:05:58.596 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:58.596 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:58.596 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:58.596 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:58.596 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:58.596 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:58.596 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3737 2024-09-12T00:05:58.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.596 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:58.596 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.596 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:58.596 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.993654+0000", 2024-09-12T00:05:58.597 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.597 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.597 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:58.597 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.993654+0000", 2024-09-12T00:05:58.597 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.597 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.597 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:58.597 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.993657+0000", 2024-09-12T00:05:58.597 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2600000000000001e-06 2024-09-12T00:05:58.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.597 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.598 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:58.598 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.997886+0000", 2024-09-12T00:05:58.598 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004228646 2024-09-12T00:05:58.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.598 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.598 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:58.598 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.997924+0000", 2024-09-12T00:05:58.598 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7632999999999997e-05 2024-09-12T00:05:58.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.598 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.598 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:58.598 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.997942+0000", 2024-09-12T00:05:58.598 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8352999999999999e-05 2024-09-12T00:05:58.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.599 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.599 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:58.599 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.998101+0000", 2024-09-12T00:05:58.599 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015922500000000001 2024-09-12T00:05:58.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.599 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.599 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:58.599 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.998375+0000", 2024-09-12T00:05:58.599 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027389500000000002 2024-09-12T00:05:58.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.599 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.599 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:58.599 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.998611+0000", 2024-09-12T00:05:58.599 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023559199999999999 2024-09-12T00:05:58.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.600 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.600 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:58.600 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009636+0000", 2024-09-12T00:05:58.600 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011025188 2024-09-12T00:05:58.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.600 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.600 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:58.600 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.015538+0000", 2024-09-12T00:05:58.600 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059023590000000003 2024-09-12T00:05:58.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.600 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.600 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:58.601 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.015717+0000", 2024-09-12T00:05:58.601 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017847699999999999 2024-09-12T00:05:58.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.601 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.601 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:58.601 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.015849+0000", 2024-09-12T00:05:58.601 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000132478 2024-09-12T00:05:58.601 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.601 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.601 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.601 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.601 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3738 3.2e 3:74a476b8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_355:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:58.601 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.005209+0000", 2024-09-12T00:05:58.602 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 13.500928063, 2024-09-12T00:05:58.602 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022771276999999999, 2024-09-12T00:05:58.602 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:58.602 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:58.602 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:58.602 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:58.602 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:58.602 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:58.602 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3738 2024-09-12T00:05:58.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.602 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:58.602 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.602 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:58.602 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.005209+0000", 2024-09-12T00:05:58.603 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.603 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.603 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:58.603 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.005209+0000", 2024-09-12T00:05:58.603 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.603 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.603 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:58.603 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.005213+0000", 2024-09-12T00:05:58.603 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4170000000000001e-06 2024-09-12T00:05:58.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.603 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:58.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009471+0000", 2024-09-12T00:05:58.604 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042583400000000002 2024-09-12T00:05:58.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:58.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009506+0000", 2024-09-12T00:05:58.604 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4625999999999997e-05 2024-09-12T00:05:58.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.604 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:58.604 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009524+0000", 2024-09-12T00:05:58.604 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7745999999999999e-05 2024-09-12T00:05:58.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:58.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009649+0000", 2024-09-12T00:05:58.605 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000124948 2024-09-12T00:05:58.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:58.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009889+0000", 2024-09-12T00:05:58.605 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024013999999999999 2024-09-12T00:05:58.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.605 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:58.605 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.010104+0000", 2024-09-12T00:05:58.606 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021549199999999999 2024-09-12T00:05:58.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.606 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.606 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:58.606 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.022243+0000", 2024-09-12T00:05:58.606 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012138793 2024-09-12T00:05:58.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.606 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.606 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:58.606 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.027764+0000", 2024-09-12T00:05:58.606 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0055207820000000001 2024-09-12T00:05:58.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.606 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.606 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:58.607 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.027859+0000", 2024-09-12T00:05:58.607 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5441999999999999e-05 2024-09-12T00:05:58.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.607 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.607 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:58.607 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.027981+0000", 2024-09-12T00:05:58.607 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000121551 2024-09-12T00:05:58.607 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.607 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.607 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.607 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.607 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3758 3.2e 3:7790af15:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_375:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:58.607 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.228203+0000", 2024-09-12T00:05:58.608 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 13.277934246999999, 2024-09-12T00:05:58.608 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.032647253000000001, 2024-09-12T00:05:58.608 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:58.608 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:58.608 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:58.608 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:58.608 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:58.608 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:58.608 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3758 2024-09-12T00:05:58.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.608 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:58.608 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.608 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:58.609 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.228203+0000", 2024-09-12T00:05:58.609 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.609 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.609 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:58.609 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.228203+0000", 2024-09-12T00:05:58.609 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.609 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.609 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:58.609 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.228208+0000", 2024-09-12T00:05:58.609 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3900000000000003e-06 2024-09-12T00:05:58.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.609 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.610 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:58.610 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239226+0000", 2024-09-12T00:05:58.610 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011018155 2024-09-12T00:05:58.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.612 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:58.612 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239265+0000", 2024-09-12T00:05:58.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9419000000000003e-05 2024-09-12T00:05:58.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.613 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:58.613 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239291+0000", 2024-09-12T00:05:58.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6173000000000002e-05 2024-09-12T00:05:58.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.613 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:58.613 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239430+0000", 2024-09-12T00:05:58.613 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000138071 2024-09-12T00:05:58.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.614 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:58.614 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239676+0000", 2024-09-12T00:05:58.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024695899999999999 2024-09-12T00:05:58.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.614 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:58.614 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239895+0000", 2024-09-12T00:05:58.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021808999999999999 2024-09-12T00:05:58.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.614 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:58.614 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.255130+0000", 2024-09-12T00:05:58.614 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015235907999999999 2024-09-12T00:05:58.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:58.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.260520+0000", 2024-09-12T00:05:58.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053894340000000002 2024-09-12T00:05:58.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:58.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.260700+0000", 2024-09-12T00:05:58.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018017099999999999 2024-09-12T00:05:58.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.615 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:58.615 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.260851+0000", 2024-09-12T00:05:58.615 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000150483 2024-09-12T00:05:58.616 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.616 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.616 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.616 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.616 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.616 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3760 3.b 3:d2eb500d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_377:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:58.616 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.251207+0000", 2024-09-12T00:05:58.616 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 13.254930590000001, 2024-09-12T00:05:58.616 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022210074, 2024-09-12T00:05:58.616 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:58.616 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:58.616 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:58.616 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:58.617 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:58.617 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:58.617 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3760 2024-09-12T00:05:58.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.617 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:58.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:58.617 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.251207+0000", 2024-09-12T00:05:58.617 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.617 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:58.617 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.251207+0000", 2024-09-12T00:05:58.617 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.618 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:58.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.251210+0000", 2024-09-12T00:05:58.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1130000000000001e-06 2024-09-12T00:05:58.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.618 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:58.618 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.256588+0000", 2024-09-12T00:05:58.618 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005378201 2024-09-12T00:05:58.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.618 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:58.619 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.256622+0000", 2024-09-12T00:05:58.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3246e-05 2024-09-12T00:05:58.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.619 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:58.619 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.256642+0000", 2024-09-12T00:05:58.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0786000000000001e-05 2024-09-12T00:05:58.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.619 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:58.619 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.256767+0000", 2024-09-12T00:05:58.619 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012475799999999999 2024-09-12T00:05:58.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.620 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:58.620 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.257047+0000", 2024-09-12T00:05:58.620 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028016199999999998 2024-09-12T00:05:58.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.620 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:58.620 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.257276+0000", 2024-09-12T00:05:58.620 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022880900000000001 2024-09-12T00:05:58.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.620 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:58.620 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.272093+0000", 2024-09-12T00:05:58.620 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014816757999999999 2024-09-12T00:05:58.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.621 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:58.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.273101+0000", 2024-09-12T00:05:58.621 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0010080340000000001 2024-09-12T00:05:58.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.621 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:58.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.273283+0000", 2024-09-12T00:05:58.621 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000181993 2024-09-12T00:05:58.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.621 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:58.621 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.273417+0000", 2024-09-12T00:05:58.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013421400000000001 2024-09-12T00:05:58.622 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.622 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.622 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.622 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3793 3.21 3:8684dc70:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_410:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:58.622 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.629422+0000", 2024-09-12T00:05:58.622 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 12.876715658, 2024-09-12T00:05:58.622 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027123878000000001, 2024-09-12T00:05:58.622 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:05:58.622 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:05:58.622 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:58.622 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:05:58.623 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:05:58.623 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:58.623 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3793 2024-09-12T00:05:58.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.623 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:05:58.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.623 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:05:58.623 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.629422+0000", 2024-09-12T00:05:58.623 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.623 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:05:58.623 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.629422+0000", 2024-09-12T00:05:58.623 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:05:58.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:05:58.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.629426+0000", 2024-09-12T00:05:58.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7129999999999999e-06 2024-09-12T00:05:58.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:05:58.624 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635537+0000", 2024-09-12T00:05:58.624 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061111220000000001 2024-09-12T00:05:58.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.624 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:05:58.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635578+0000", 2024-09-12T00:05:58.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1730000000000002e-05 2024-09-12T00:05:58.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:05:58.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635605+0000", 2024-09-12T00:05:58.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6792999999999999e-05 2024-09-12T00:05:58.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.625 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:05:58.625 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635747+0000", 2024-09-12T00:05:58.625 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014160999999999999 2024-09-12T00:05:58.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:05:58.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635998+0000", 2024-09-12T00:05:58.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025098600000000003 2024-09-12T00:05:58.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:05:58.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.636254+0000", 2024-09-12T00:05:58.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025597 2024-09-12T00:05:58.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.626 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.626 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:05:58.626 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.653522+0000", 2024-09-12T00:05:58.626 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017268229999999999 2024-09-12T00:05:58.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:58.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.656375+0000", 2024-09-12T00:05:58.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0028530930000000001 2024-09-12T00:05:58.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:05:58.627 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.656471+0000", 2024-09-12T00:05:58.627 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5904999999999997e-05 2024-09-12T00:05:58.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:05:58.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:05:58.627 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:05:58.628 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.656546+0000", 2024-09-12T00:05:58.628 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4726000000000002e-05 2024-09-12T00:05:58.628 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.628 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.628 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.628 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:05:58.628 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:05:58.628 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:05:58.628 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:58.508+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:58.629 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:05:58.631 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:58.632+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:58.732 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:05:58.732+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:05:58.764 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:58.765 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:58.765 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:05:58.765 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:58.779 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:05:58.832 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:58.832+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:58.934 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:58.932+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:58.946 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:58.946 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:58.946 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:05:58.946 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:05:58.946 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:58.960 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:05:59.034 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:59.036+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:59.086 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:59.086 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:05:59.086 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:05:59.086 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:05:59.086 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.086 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:05:59.087 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:05:59.087 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 147.75477311099999, 2024-09-12T00:05:59.087 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.027441031000000001, 2024-09-12T00:05:59.087 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.087 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.087 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.087 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.087 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.087 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.087 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:05:59.087 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.087 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.087 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.088 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.088 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:05:59.088 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.088 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.088 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.088 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:05:59.088 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.088 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.088 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.088 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330357+0000", 2024-09-12T00:05:59.088 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2339999999999996e-06 2024-09-12T00:05:59.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.089 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.089 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.089 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330381+0000", 2024-09-12T00:05:59.089 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4626000000000001e-05 2024-09-12T00:05:59.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.089 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.089 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.089 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330417+0000", 2024-09-12T00:05:59.089 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5886000000000002e-05 2024-09-12T00:05:59.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.089 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.089 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.089 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330442+0000", 2024-09-12T00:05:59.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4522999999999999e-05 2024-09-12T00:05:59.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.090 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335485+0000", 2024-09-12T00:05:59.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050432589999999996 2024-09-12T00:05:59.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:05:59.090 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335507+0000", 2024-09-12T00:05:59.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2013000000000001e-05 2024-09-12T00:05:59.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.091 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.351747+0000", 2024-09-12T00:05:59.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016240451999999999 2024-09-12T00:05:59.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.091 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.091 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352062+0000", 2024-09-12T00:05:59.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031433399999999999 2024-09-12T00:05:59.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.091 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:59.091 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352378+0000", 2024-09-12T00:05:59.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031586400000000001 2024-09-12T00:05:59.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.092 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.092 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.355074+0000", 2024-09-12T00:05:59.092 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026962919999999999 2024-09-12T00:05:59.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.092 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.092 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.092 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357537+0000", 2024-09-12T00:05:59.092 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024634689999999998 2024-09-12T00:05:59.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.092 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.092 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.092 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357680+0000", 2024-09-12T00:05:59.092 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014314899999999999 2024-09-12T00:05:59.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.093 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.093 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.093 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357793+0000", 2024-09-12T00:05:59.093 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011293 2024-09-12T00:05:59.093 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.093 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.093 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.093 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.093 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2748 3.3b 3:df6d92a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:05:59.093 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:05:59.093 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 70.986285250999998, 2024-09-12T00:05:59.093 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.023574735999999999, 2024-09-12T00:05:59.094 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.094 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.094 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.094 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.094 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.094 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.094 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2748 2024-09-12T00:05:59.094 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.094 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.094 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.094 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.094 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:05:59.094 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.094 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.094 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.095 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.095 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:05:59.095 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.095 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.095 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.095 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.095 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098844+0000", 2024-09-12T00:05:59.095 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1570000000000002e-06 2024-09-12T00:05:59.095 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.095 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.095 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.095 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100354+0000", 2024-09-12T00:05:59.095 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001509544 2024-09-12T00:05:59.095 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.096 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.096 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.096 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100383+0000", 2024-09-12T00:05:59.096 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9386e-05 2024-09-12T00:05:59.096 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.096 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.096 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.096 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100399+0000", 2024-09-12T00:05:59.096 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5883999999999999e-05 2024-09-12T00:05:59.096 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.096 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.096 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.096 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100507+0000", 2024-09-12T00:05:59.097 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010822 2024-09-12T00:05:59.097 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.097 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.097 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.097 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100704+0000", 2024-09-12T00:05:59.097 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019658499999999999 2024-09-12T00:05:59.097 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.097 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.097 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:59.097 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100901+0000", 2024-09-12T00:05:59.097 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000196505 2024-09-12T00:05:59.097 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.097 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.097 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.098 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112178+0000", 2024-09-12T00:05:59.098 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011277718000000001 2024-09-12T00:05:59.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.098 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.098 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.098 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122285+0000", 2024-09-12T00:05:59.098 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010106327 2024-09-12T00:05:59.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.098 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.098 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.098 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122358+0000", 2024-09-12T00:05:59.098 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3640999999999995e-05 2024-09-12T00:05:59.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.098 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.099 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.099 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122415+0000", 2024-09-12T00:05:59.099 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6768999999999998e-05 2024-09-12T00:05:59.099 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.099 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.099 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.099 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.099 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.099 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2964 3.24 e75/23 3:26c83ec0:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_3:head v 75'6, mlcod=63'4)", 2024-09-12T00:05:59.099 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:05:59.099 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 39.07286423, 2024-09-12T00:05:59.099 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022426814, 2024-09-12T00:05:59.099 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.099 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.099 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.100 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.100 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.100 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.100 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:05:59.100 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.100 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.100 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.100 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.100 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:05:59.100 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.100 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.100 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.101 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.101 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012263+0000", 2024-09-12T00:05:59.101 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.091e-06 2024-09-12T00:05:59.101 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.101 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.101 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.101 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018390+0000", 2024-09-12T00:05:59.101 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061264600000000002 2024-09-12T00:05:59.101 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.101 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.101 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.101 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018419+0000", 2024-09-12T00:05:59.101 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8979000000000002e-05 2024-09-12T00:05:59.101 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.102 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.102 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.102 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018434+0000", 2024-09-12T00:05:59.102 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4781e-05 2024-09-12T00:05:59.102 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.102 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.102 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.102 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018528+0000", 2024-09-12T00:05:59.102 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.4333000000000006e-05 2024-09-12T00:05:59.102 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.102 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.102 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.102 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018559+0000", 2024-09-12T00:05:59.102 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1557999999999998e-05 2024-09-12T00:05:59.103 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.103 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.103 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.103 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.034615+0000", 2024-09-12T00:05:59.103 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016055834000000001 2024-09-12T00:05:59.103 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.103 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.103 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.103 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.034688+0000", 2024-09-12T00:05:59.103 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2778e-05 2024-09-12T00:05:59.103 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.103 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.103 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.103 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.104 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.104 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2965 3.e e75/23 3:70fff61e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_4:head v 75'5, mlcod=63'3)", 2024-09-12T00:05:59.104 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:05:59.104 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 39.065354009000004, 2024-09-12T00:05:59.104 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021839210000000001, 2024-09-12T00:05:59.104 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.104 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.104 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.104 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.104 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.104 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.104 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:05:59.104 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.104 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.105 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.105 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.105 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:05:59.105 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.105 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.105 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.105 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.105 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019773+0000", 2024-09-12T00:05:59.105 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4839999999999999e-06 2024-09-12T00:05:59.105 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.105 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.105 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.105 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021570+0000", 2024-09-12T00:05:59.106 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017965570000000001 2024-09-12T00:05:59.106 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.106 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.106 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.106 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021587+0000", 2024-09-12T00:05:59.106 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7938e-05 2024-09-12T00:05:59.106 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.106 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.106 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.106 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021598+0000", 2024-09-12T00:05:59.106 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0553e-05 2024-09-12T00:05:59.106 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.106 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.106 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.107 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021676+0000", 2024-09-12T00:05:59.107 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8034000000000005e-05 2024-09-12T00:05:59.107 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.107 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.107 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.107 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021706+0000", 2024-09-12T00:05:59.107 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9915000000000001e-05 2024-09-12T00:05:59.107 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.107 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.107 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.107 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.041519+0000", 2024-09-12T00:05:59.107 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019813171000000001 2024-09-12T00:05:59.107 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.107 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.107 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.108 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.041611+0000", 2024-09-12T00:05:59.108 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1558000000000007e-05 2024-09-12T00:05:59.108 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.108 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.108 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.108 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.108 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3004 3.36 3:6cc4f27f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:59.108 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:05:59.108 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 38.646954811999997, 2024-09-12T00:05:59.108 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.042951743000000001, 2024-09-12T00:05:59.108 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.108 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.109 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.109 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.109 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.109 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.109 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3004 2024-09-12T00:05:59.109 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.109 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.109 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.109 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.109 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:05:59.109 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.109 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.109 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.109 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.110 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:05:59.110 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.110 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.110 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.110 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.110 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438175+0000", 2024-09-12T00:05:59.110 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1640000000000003e-06 2024-09-12T00:05:59.110 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.110 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.110 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.110 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439732+0000", 2024-09-12T00:05:59.110 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015574510000000001 2024-09-12T00:05:59.110 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.110 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.111 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.111 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439758+0000", 2024-09-12T00:05:59.111 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6074000000000001e-05 2024-09-12T00:05:59.111 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.111 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.111 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.111 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439768+0000", 2024-09-12T00:05:59.111 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8770000000000005e-06 2024-09-12T00:05:59.111 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.111 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.111 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.111 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439874+0000", 2024-09-12T00:05:59.111 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105583 2024-09-12T00:05:59.111 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.112 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.112 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.112 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.440078+0000", 2024-09-12T00:05:59.112 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020388200000000001 2024-09-12T00:05:59.112 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.112 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.112 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:59.112 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.440251+0000", 2024-09-12T00:05:59.112 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017339100000000001 2024-09-12T00:05:59.112 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.112 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.112 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.112 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.459982+0000", 2024-09-12T00:05:59.113 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01973099 2024-09-12T00:05:59.113 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.113 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.113 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.113 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.480958+0000", 2024-09-12T00:05:59.113 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020975730000000001 2024-09-12T00:05:59.113 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.113 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.113 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.113 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481034+0000", 2024-09-12T00:05:59.113 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6224999999999996e-05 2024-09-12T00:05:59.113 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.113 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.113 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.113 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481122+0000", 2024-09-12T00:05:59.114 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8375999999999995e-05 2024-09-12T00:05:59.114 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.114 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.114 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.114 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.114 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.114 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3005 3.35 3:ae3b5a36:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:59.114 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:05:59.114 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 38.637701128000003, 2024-09-12T00:05:59.114 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.028828275, 2024-09-12T00:05:59.114 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.114 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.114 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.115 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.115 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.115 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.115 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3005 2024-09-12T00:05:59.115 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.115 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.115 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.115 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.115 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:05:59.115 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.115 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.115 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.115 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.115 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:05:59.116 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.116 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.116 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.116 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.116 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447427+0000", 2024-09-12T00:05:59.116 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.864e-06 2024-09-12T00:05:59.116 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.116 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.116 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.116 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449003+0000", 2024-09-12T00:05:59.116 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001575405 2024-09-12T00:05:59.116 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.116 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.116 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.117 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449030+0000", 2024-09-12T00:05:59.117 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7189999999999999e-05 2024-09-12T00:05:59.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.117 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.117 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.117 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449042+0000", 2024-09-12T00:05:59.117 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2038999999999999e-05 2024-09-12T00:05:59.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.117 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.117 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.117 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449111+0000", 2024-09-12T00:05:59.117 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9521000000000001e-05 2024-09-12T00:05:59.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.117 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.118 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.118 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449218+0000", 2024-09-12T00:05:59.118 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010675600000000001 2024-09-12T00:05:59.118 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.118 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.118 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:59.118 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449330+0000", 2024-09-12T00:05:59.118 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000111809 2024-09-12T00:05:59.118 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.118 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.118 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.118 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.469844+0000", 2024-09-12T00:05:59.118 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020514277000000001 2024-09-12T00:05:59.119 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.119 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.119 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.119 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.475983+0000", 2024-09-12T00:05:59.119 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061392540000000002 2024-09-12T00:05:59.119 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.119 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.119 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.119 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.476113+0000", 2024-09-12T00:05:59.119 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000129713 2024-09-12T00:05:59.119 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.120 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.120 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.120 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.476253+0000", 2024-09-12T00:05:59.120 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013944700000000001 2024-09-12T00:05:59.120 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.120 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.120 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.120 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.120 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.120 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3006 3.3 3:c183ca95:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:59.120 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:05:59.120 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 38.628174557000001, 2024-09-12T00:05:59.120 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.024661756, 2024-09-12T00:05:59.121 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.121 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.121 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.121 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.121 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.121 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.121 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3006 2024-09-12T00:05:59.121 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.121 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.121 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.121 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.121 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:05:59.121 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.122 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.122 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.122 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.122 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:05:59.122 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.122 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.122 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.122 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.122 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456954+0000", 2024-09-12T00:05:59.122 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7070000000000001e-06 2024-09-12T00:05:59.122 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.122 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.122 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.122 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458684+0000", 2024-09-12T00:05:59.122 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017305479999999999 2024-09-12T00:05:59.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.123 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.123 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.123 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458709+0000", 2024-09-12T00:05:59.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4780999999999999e-05 2024-09-12T00:05:59.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.123 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.123 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.123 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458719+0000", 2024-09-12T00:05:59.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0202e-05 2024-09-12T00:05:59.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.123 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.123 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.123 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458800+0000", 2024-09-12T00:05:59.124 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0893e-05 2024-09-12T00:05:59.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.124 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.124 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458990+0000", 2024-09-12T00:05:59.124 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018986400000000001 2024-09-12T00:05:59.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.124 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:05:59.124 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.459171+0000", 2024-09-12T00:05:59.124 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018135499999999999 2024-09-12T00:05:59.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.124 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.125 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.478356+0000", 2024-09-12T00:05:59.125 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019185153 2024-09-12T00:05:59.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.125 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.125 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.125 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481411+0000", 2024-09-12T00:05:59.125 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030546190000000002 2024-09-12T00:05:59.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.125 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.125 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.125 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481511+0000", 2024-09-12T00:05:59.125 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.9763e-05 2024-09-12T00:05:59.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.126 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.126 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.126 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481613+0000", 2024-09-12T00:05:59.126 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101871 2024-09-12T00:05:59.126 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.126 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.126 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.126 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.126 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.126 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3037 3.39 3:9eefb4c1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:59.126 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:05:59.126 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 38.269907150000002, 2024-09-12T00:05:59.126 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020855543000000001, 2024-09-12T00:05:59.126 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.127 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.127 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.127 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.127 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.127 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.127 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3037 2024-09-12T00:05:59.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.127 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.127 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.127 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.127 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:05:59.127 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.127 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.128 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.128 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:05:59.128 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.128 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.128 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.128 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815221+0000", 2024-09-12T00:05:59.128 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1540000000000002e-06 2024-09-12T00:05:59.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.128 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.128 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.128 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817594+0000", 2024-09-12T00:05:59.128 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023728880000000001 2024-09-12T00:05:59.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.129 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.129 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817618+0000", 2024-09-12T00:05:59.129 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3635e-05 2024-09-12T00:05:59.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.129 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.129 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817633+0000", 2024-09-12T00:05:59.129 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4559000000000001e-05 2024-09-12T00:05:59.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.129 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.129 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817734+0000", 2024-09-12T00:05:59.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101729 2024-09-12T00:05:59.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817939+0000", 2024-09-12T00:05:59.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020489299999999999 2024-09-12T00:05:59.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:05:59.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.818113+0000", 2024-09-12T00:05:59.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000173413 2024-09-12T00:05:59.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.825676+0000", 2024-09-12T00:05:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075635260000000001 2024-09-12T00:05:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.835921+0000", 2024-09-12T00:05:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010244932999999999 2024-09-12T00:05:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.836006+0000", 2024-09-12T00:05:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5427999999999996e-05 2024-09-12T00:05:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.836074+0000", 2024-09-12T00:05:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7385000000000006e-05 2024-09-12T00:05:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3375 3.15 3:ab335e39:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.646143+0000", 2024-09-12T00:05:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.438982707000001, 2024-09-12T00:05:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026933417000000001, 2024-09-12T00:05:59.133 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.133 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.133 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.133 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.133 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.133 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.133 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3375 2024-09-12T00:05:59.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.133 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.133 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.133 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.133 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.646143+0000", 2024-09-12T00:05:59.133 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.134 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.134 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.134 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.646143+0000", 2024-09-12T00:05:59.134 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.134 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.134 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.134 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.646146+0000", 2024-09-12T00:05:59.134 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.19e-06 2024-09-12T00:05:59.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.134 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.134 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.134 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648608+0000", 2024-09-12T00:05:59.134 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024615470000000001 2024-09-12T00:05:59.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.135 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.135 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.135 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648640+0000", 2024-09-12T00:05:59.135 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2342999999999998e-05 2024-09-12T00:05:59.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.135 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.135 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.135 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648655+0000", 2024-09-12T00:05:59.135 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5034e-05 2024-09-12T00:05:59.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.135 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.135 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.135 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648746+0000", 2024-09-12T00:05:59.135 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1529999999999999e-05 2024-09-12T00:05:59.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.136 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.136 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.136 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648938+0000", 2024-09-12T00:05:59.136 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191819 2024-09-12T00:05:59.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.136 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.136 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:59.136 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.649102+0000", 2024-09-12T00:05:59.136 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000164103 2024-09-12T00:05:59.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.136 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.136 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.137 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.658869+0000", 2024-09-12T00:05:59.137 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0097663530000000002 2024-09-12T00:05:59.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.137 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.137 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.137 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.672958+0000", 2024-09-12T00:05:59.137 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014089295 2024-09-12T00:05:59.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.137 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.137 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.137 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.673024+0000", 2024-09-12T00:05:59.137 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5834999999999996e-05 2024-09-12T00:05:59.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.138 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.138 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.138 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.673076+0000", 2024-09-12T00:05:59.138 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2367999999999997e-05 2024-09-12T00:05:59.138 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.138 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.138 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.138 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.139 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3392 3.1b e82/23 3:d9b2c983:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_19:head v 82'11, mlcod=76'9)", 2024-09-12T00:05:59.139 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.841020+0000", 2024-09-12T00:05:59.139 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.244105636, 2024-09-12T00:05:59.139 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022540108999999999, 2024-09-12T00:05:59.139 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.139 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.139 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.139 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.139 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.139 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.139 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.841020+0000", 2024-09-12T00:05:59.139 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.139 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.139 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.140 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.140 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.841020+0000", 2024-09-12T00:05:59.140 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.140 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.140 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.140 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.841022+0000", 2024-09-12T00:05:59.140 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4339999999999999e-06 2024-09-12T00:05:59.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.140 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.140 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.140 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847015+0000", 2024-09-12T00:05:59.140 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.005993104 2024-09-12T00:05:59.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.141 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.141 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.141 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847030+0000", 2024-09-12T00:05:59.141 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4595e-05 2024-09-12T00:05:59.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.141 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.141 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.141 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847041+0000", 2024-09-12T00:05:59.141 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1124000000000001e-05 2024-09-12T00:05:59.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.141 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.141 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.141 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847334+0000", 2024-09-12T00:05:59.141 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000292854 2024-09-12T00:05:59.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847371+0000", 2024-09-12T00:05:59.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7336000000000003e-05 2024-09-12T00:05:59.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.863502+0000", 2024-09-12T00:05:59.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016130314999999999 2024-09-12T00:05:59.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.863560+0000", 2024-09-12T00:05:59.143 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8347000000000002e-05 2024-09-12T00:05:59.143 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.143 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.143 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.143 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.143 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3399 3.c 3:33260d65:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:59.143 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.912770+0000", 2024-09-12T00:05:59.143 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.172355491000001, 2024-09-12T00:05:59.143 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021761494999999999, 2024-09-12T00:05:59.143 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.143 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.143 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.143 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.144 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.144 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.144 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3399 2024-09-12T00:05:59.144 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.144 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.144 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.144 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.144 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.912770+0000", 2024-09-12T00:05:59.144 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.144 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.144 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.144 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.144 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.912770+0000", 2024-09-12T00:05:59.144 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.145 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.145 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.145 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.912773+0000", 2024-09-12T00:05:59.145 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.252e-06 2024-09-12T00:05:59.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.145 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.145 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.145 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915156+0000", 2024-09-12T00:05:59.145 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023823109999999998 2024-09-12T00:05:59.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.145 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.145 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.145 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915244+0000", 2024-09-12T00:05:59.146 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8926999999999997e-05 2024-09-12T00:05:59.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.146 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.146 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.146 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915265+0000", 2024-09-12T00:05:59.146 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0613999999999999e-05 2024-09-12T00:05:59.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.146 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.146 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.146 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915361+0000", 2024-09-12T00:05:59.146 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5542000000000001e-05 2024-09-12T00:05:59.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.146 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.146 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.146 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915538+0000", 2024-09-12T00:05:59.146 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017762400000000001 2024-09-12T00:05:59.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.147 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:59.147 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915710+0000", 2024-09-12T00:05:59.147 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017170900000000001 2024-09-12T00:05:59.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.147 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.147 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.933564+0000", 2024-09-12T00:05:59.147 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017854080000000001 2024-09-12T00:05:59.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.147 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.147 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.934450+0000", 2024-09-12T00:05:59.148 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00088595700000000004 2024-09-12T00:05:59.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.148 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.148 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.148 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.934490+0000", 2024-09-12T00:05:59.148 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0110000000000001e-05 2024-09-12T00:05:59.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.148 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.148 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.148 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.934531+0000", 2024-09-12T00:05:59.148 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1369000000000003e-05 2024-09-12T00:05:59.148 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.148 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.148 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.149 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.149 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3678 3.15 3:a83db90f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_295:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:59.149 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:43.938089+0000", 2024-09-12T00:05:59.149 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 15.147036358999999, 2024-09-12T00:05:59.149 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021578831999999999, 2024-09-12T00:05:59.149 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.149 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.149 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.149 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.149 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.149 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.149 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3678 2024-09-12T00:05:59.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.150 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.150 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.150 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.150 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.938089+0000", 2024-09-12T00:05:59.150 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.150 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.150 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.150 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.938089+0000", 2024-09-12T00:05:59.150 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.150 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.150 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.150 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.938094+0000", 2024-09-12T00:05:59.151 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0719999999999999e-06 2024-09-12T00:05:59.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.151 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.151 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940370+0000", 2024-09-12T00:05:59.151 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022759159999999998 2024-09-12T00:05:59.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.151 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.151 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940401+0000", 2024-09-12T00:05:59.151 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1226999999999998e-05 2024-09-12T00:05:59.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.151 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.152 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940417+0000", 2024-09-12T00:05:59.152 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5603e-05 2024-09-12T00:05:59.152 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.152 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.152 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.152 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940499+0000", 2024-09-12T00:05:59.152 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1568000000000002e-05 2024-09-12T00:05:59.152 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.152 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.152 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.152 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940703+0000", 2024-09-12T00:05:59.152 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000203995 2024-09-12T00:05:59.152 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.152 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.153 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:59.153 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940947+0000", 2024-09-12T00:05:59.153 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024444799999999997 2024-09-12T00:05:59.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.153 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.153 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.153 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.950088+0000", 2024-09-12T00:05:59.153 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091408710000000001 2024-09-12T00:05:59.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.153 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.153 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.153 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.959534+0000", 2024-09-12T00:05:59.153 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0094463979999999999 2024-09-12T00:05:59.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.959594+0000", 2024-09-12T00:05:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0145000000000001e-05 2024-09-12T00:05:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.959668+0000", 2024-09-12T00:05:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3589000000000003e-05 2024-09-12T00:05:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.155 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3711 3.c 3:31bc51b2:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_328:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:59.155 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.647001+0000", 2024-09-12T00:05:59.155 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.438124205999999, 2024-09-12T00:05:59.155 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021286705, 2024-09-12T00:05:59.155 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.155 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.155 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.155 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.155 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.155 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.155 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3711 2024-09-12T00:05:59.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.156 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.156 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.156 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.156 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.647001+0000", 2024-09-12T00:05:59.156 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.156 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.156 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.156 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.156 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.647001+0000", 2024-09-12T00:05:59.156 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.156 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.156 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.156 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.156 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.647006+0000", 2024-09-12T00:05:59.157 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1900000000000003e-06 2024-09-12T00:05:59.157 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.157 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.157 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.157 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.651810+0000", 2024-09-12T00:05:59.157 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048032159999999999 2024-09-12T00:05:59.157 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.157 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.157 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.157 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.651857+0000", 2024-09-12T00:05:59.157 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7416000000000001e-05 2024-09-12T00:05:59.157 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.157 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.158 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.158 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.651876+0000", 2024-09-12T00:05:59.158 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9066999999999999e-05 2024-09-12T00:05:59.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.158 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.158 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.158 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.652058+0000", 2024-09-12T00:05:59.158 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018199500000000001 2024-09-12T00:05:59.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.158 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.158 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.158 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.652476+0000", 2024-09-12T00:05:59.158 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00041738000000000002 2024-09-12T00:05:59.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.159 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:59.159 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.652917+0000", 2024-09-12T00:05:59.159 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00044171899999999998 2024-09-12T00:05:59.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.159 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.159 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.667867+0000", 2024-09-12T00:05:59.159 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014949558 2024-09-12T00:05:59.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.159 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.159 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.668181+0000", 2024-09-12T00:05:59.159 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000313777 2024-09-12T00:05:59.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.160 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.160 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.160 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.668241+0000", 2024-09-12T00:05:59.160 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0047999999999998e-05 2024-09-12T00:05:59.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.160 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.160 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.160 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.668288+0000", 2024-09-12T00:05:59.160 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7339000000000002e-05 2024-09-12T00:05:59.160 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.160 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.160 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.161 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.161 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3726 3.33 e83/23 3:cd6e0a10:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_343:head v 83'15, mlcod=83'13)", 2024-09-12T00:05:59.161 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.871373+0000", 2024-09-12T00:05:59.161 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.213752667, 2024-09-12T00:05:59.161 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021131233999999999, 2024-09-12T00:05:59.161 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.161 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.161 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.161 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.161 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.161 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.161 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.871373+0000", 2024-09-12T00:05:59.161 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.161 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.162 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.162 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.162 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.871373+0000", 2024-09-12T00:05:59.162 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.162 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.162 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.162 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.162 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.871374+0000", 2024-09-12T00:05:59.162 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.505e-06 2024-09-12T00:05:59.162 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.162 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.162 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.162 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875356+0000", 2024-09-12T00:05:59.162 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039812060000000002 2024-09-12T00:05:59.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.163 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.163 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.163 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875381+0000", 2024-09-12T00:05:59.163 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5259999999999999e-05 2024-09-12T00:05:59.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.163 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.163 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.163 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875392+0000", 2024-09-12T00:05:59.163 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1211e-05 2024-09-12T00:05:59.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.163 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.163 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.163 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875472+0000", 2024-09-12T00:05:59.164 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9505999999999994e-05 2024-09-12T00:05:59.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.164 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.164 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875490+0000", 2024-09-12T00:05:59.164 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8819000000000001e-05 2024-09-12T00:05:59.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.164 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.164 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.892428+0000", 2024-09-12T00:05:59.164 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016937885 2024-09-12T00:05:59.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.164 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.165 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.892504+0000", 2024-09-12T00:05:59.165 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5841999999999997e-05 2024-09-12T00:05:59.165 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.165 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.165 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.165 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.165 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3727 3.35 3:ad6b6c99:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_344:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:59.165 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.876261+0000", 2024-09-12T00:05:59.165 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.208864849999999, 2024-09-12T00:05:59.165 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.029109105, 2024-09-12T00:05:59.165 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.165 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.166 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.166 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.166 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.166 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.166 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3727 2024-09-12T00:05:59.166 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.166 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.166 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.166 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.166 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.876261+0000", 2024-09-12T00:05:59.166 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.166 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.166 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.166 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.167 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.876261+0000", 2024-09-12T00:05:59.167 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.167 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.167 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.167 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.167 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.876264+0000", 2024-09-12T00:05:59.167 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.388e-06 2024-09-12T00:05:59.167 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.167 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.167 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.167 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878449+0000", 2024-09-12T00:05:59.167 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021847360000000001 2024-09-12T00:05:59.167 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.168 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.168 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.168 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878470+0000", 2024-09-12T00:05:59.168 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0792e-05 2024-09-12T00:05:59.168 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.168 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.168 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.168 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878481+0000", 2024-09-12T00:05:59.168 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1421e-05 2024-09-12T00:05:59.168 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.168 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.168 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.168 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878572+0000", 2024-09-12T00:05:59.169 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0882000000000002e-05 2024-09-12T00:05:59.169 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.169 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.169 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.169 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878763+0000", 2024-09-12T00:05:59.169 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191218 2024-09-12T00:05:59.169 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.169 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.169 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:59.169 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878938+0000", 2024-09-12T00:05:59.169 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017507300000000001 2024-09-12T00:05:59.169 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.169 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.170 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.170 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.900618+0000", 2024-09-12T00:05:59.170 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021679706 2024-09-12T00:05:59.170 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.170 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.170 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.170 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.905243+0000", 2024-09-12T00:05:59.170 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046246869999999997 2024-09-12T00:05:59.170 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.170 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.170 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.170 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.905314+0000", 2024-09-12T00:05:59.170 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1797000000000004e-05 2024-09-12T00:05:59.171 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.171 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.171 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.171 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.905370+0000", 2024-09-12T00:05:59.171 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5405000000000002e-05 2024-09-12T00:05:59.171 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.171 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.171 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.171 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.171 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.171 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3735 3.3f 3:fd0f007c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_352:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:59.171 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.971621+0000", 2024-09-12T00:05:59.171 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.113504023000001, 2024-09-12T00:05:59.171 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021631419999999998, 2024-09-12T00:05:59.172 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.172 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.172 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.172 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.172 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.172 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.172 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3735 2024-09-12T00:05:59.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.172 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.172 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.172 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.172 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.971621+0000", 2024-09-12T00:05:59.172 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.173 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.173 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.173 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.971621+0000", 2024-09-12T00:05:59.173 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.173 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.173 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.173 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.173 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.971626+0000", 2024-09-12T00:05:59.173 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.313e-06 2024-09-12T00:05:59.173 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.173 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.173 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.173 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973760+0000", 2024-09-12T00:05:59.173 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021346780000000001 2024-09-12T00:05:59.174 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.174 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.174 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.174 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973788+0000", 2024-09-12T00:05:59.174 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7327000000000001e-05 2024-09-12T00:05:59.174 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.174 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.174 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.174 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973799+0000", 2024-09-12T00:05:59.174 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1379999999999999e-05 2024-09-12T00:05:59.174 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.174 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.174 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.175 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973904+0000", 2024-09-12T00:05:59.175 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105071 2024-09-12T00:05:59.175 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.175 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.175 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.175 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.974119+0000", 2024-09-12T00:05:59.175 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021477399999999999 2024-09-12T00:05:59.175 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.175 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.175 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:59.175 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.974313+0000", 2024-09-12T00:05:59.175 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019439300000000001 2024-09-12T00:05:59.175 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.175 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.176 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.176 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.985849+0000", 2024-09-12T00:05:59.176 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011535915000000001 2024-09-12T00:05:59.176 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.176 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.176 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.176 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.993125+0000", 2024-09-12T00:05:59.176 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0072761299999999996 2024-09-12T00:05:59.176 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.176 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.176 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.176 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.993201+0000", 2024-09-12T00:05:59.176 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5098000000000005e-05 2024-09-12T00:05:59.176 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.177 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.177 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.177 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.993253+0000", 2024-09-12T00:05:59.177 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2340999999999999e-05 2024-09-12T00:05:59.177 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.177 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.177 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.177 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.177 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.177 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3756 3.15 3:aa8e955f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_373:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:59.177 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.207558+0000", 2024-09-12T00:05:59.177 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.877567206, 2024-09-12T00:05:59.177 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021266769000000001, 2024-09-12T00:05:59.177 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.177 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.178 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.178 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.178 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.178 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.178 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3756 2024-09-12T00:05:59.178 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.178 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.178 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.178 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.179 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.207558+0000", 2024-09-12T00:05:59.179 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.179 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.179 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.179 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.179 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.207558+0000", 2024-09-12T00:05:59.179 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.179 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.179 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.179 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.179 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.207561+0000", 2024-09-12T00:05:59.179 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9450000000000002e-06 2024-09-12T00:05:59.179 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.179 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.180 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.180 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209465+0000", 2024-09-12T00:05:59.180 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019040089999999999 2024-09-12T00:05:59.180 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.180 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.180 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.180 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209493+0000", 2024-09-12T00:05:59.180 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7645999999999999e-05 2024-09-12T00:05:59.180 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.180 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.180 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.180 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209507+0000", 2024-09-12T00:05:59.180 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4333e-05 2024-09-12T00:05:59.180 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.181 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.181 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.181 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209609+0000", 2024-09-12T00:05:59.181 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101543 2024-09-12T00:05:59.181 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.181 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.181 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.181 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209822+0000", 2024-09-12T00:05:59.181 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021320000000000001 2024-09-12T00:05:59.181 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.181 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.181 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:59.181 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.210009+0000", 2024-09-12T00:05:59.182 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000187228 2024-09-12T00:05:59.182 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.182 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.182 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.182 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.219744+0000", 2024-09-12T00:05:59.182 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0097345079999999994 2024-09-12T00:05:59.182 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.182 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.182 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.182 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.228686+0000", 2024-09-12T00:05:59.182 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0089426200000000001 2024-09-12T00:05:59.182 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.182 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.182 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.183 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.228768+0000", 2024-09-12T00:05:59.183 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2112000000000003e-05 2024-09-12T00:05:59.183 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.183 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.183 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.183 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.228825+0000", 2024-09-12T00:05:59.183 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6625000000000001e-05 2024-09-12T00:05:59.183 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.183 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.183 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.183 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.183 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.183 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3778 3.c 3:33bb2076:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_395:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:59.184 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.451174+0000", 2024-09-12T00:05:59.184 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.633951031, 2024-09-12T00:05:59.184 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021109749000000001, 2024-09-12T00:05:59.184 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.184 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.184 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.184 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.184 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.184 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.184 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3778 2024-09-12T00:05:59.184 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.184 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.184 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.184 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.185 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.451174+0000", 2024-09-12T00:05:59.185 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.185 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.185 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.185 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.185 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.451174+0000", 2024-09-12T00:05:59.185 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.185 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.185 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.185 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.185 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.451178+0000", 2024-09-12T00:05:59.185 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6289999999999999e-06 2024-09-12T00:05:59.185 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.185 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.186 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.186 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.453638+0000", 2024-09-12T00:05:59.186 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024596470000000001 2024-09-12T00:05:59.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.186 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.186 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.186 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.453658+0000", 2024-09-12T00:05:59.186 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0713e-05 2024-09-12T00:05:59.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.186 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.186 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.186 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.453673+0000", 2024-09-12T00:05:59.186 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4174e-05 2024-09-12T00:05:59.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.187 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.187 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.187 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.453804+0000", 2024-09-12T00:05:59.187 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013095000000000001 2024-09-12T00:05:59.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.187 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.187 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.187 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.454022+0000", 2024-09-12T00:05:59.187 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021806899999999999 2024-09-12T00:05:59.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.187 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.187 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:05:59.187 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.454175+0000", 2024-09-12T00:05:59.187 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015374099999999999 2024-09-12T00:05:59.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.188 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.188 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.462290+0000", 2024-09-12T00:05:59.188 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0081144359999999992 2024-09-12T00:05:59.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.188 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.188 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.472165+0000", 2024-09-12T00:05:59.188 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0098751140000000008 2024-09-12T00:05:59.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.188 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.188 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.472235+0000", 2024-09-12T00:05:59.189 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9793000000000001e-05 2024-09-12T00:05:59.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.189 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.189 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.189 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.472284+0000", 2024-09-12T00:05:59.189 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9483e-05 2024-09-12T00:05:59.189 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.189 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.189 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.189 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.189 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3785 3.15 3:ab478e86:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_402:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:59.189 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.539840+0000", 2024-09-12T00:05:59.189 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.545285696000001, 2024-09-12T00:05:59.190 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.023091957999999999, 2024-09-12T00:05:59.190 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.190 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.190 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.190 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.190 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.190 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.190 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3785 2024-09-12T00:05:59.190 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.190 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.190 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.190 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.190 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.539840+0000", 2024-09-12T00:05:59.190 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.191 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.191 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.191 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.539840+0000", 2024-09-12T00:05:59.191 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.191 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.191 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.191 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.539843+0000", 2024-09-12T00:05:59.191 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4410000000000002e-06 2024-09-12T00:05:59.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.191 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.191 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.191 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541660+0000", 2024-09-12T00:05:59.192 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0018169239999999999 2024-09-12T00:05:59.192 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.192 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.192 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.192 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541704+0000", 2024-09-12T00:05:59.192 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4072000000000001e-05 2024-09-12T00:05:59.192 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.192 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.192 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.192 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541726+0000", 2024-09-12T00:05:59.192 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1875e-05 2024-09-12T00:05:59.192 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.192 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.192 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.193 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541825+0000", 2024-09-12T00:05:59.193 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8500999999999998e-05 2024-09-12T00:05:59.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.193 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.193 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.193 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541997+0000", 2024-09-12T00:05:59.193 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000172781 2024-09-12T00:05:59.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.193 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.193 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:05:59.193 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.542177+0000", 2024-09-12T00:05:59.193 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018009699999999999 2024-09-12T00:05:59.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.193 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.194 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.194 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.558969+0000", 2024-09-12T00:05:59.194 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016791805999999999 2024-09-12T00:05:59.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.194 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.194 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.194 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.562789+0000", 2024-09-12T00:05:59.194 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003819308 2024-09-12T00:05:59.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.194 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.194 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.194 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.562869+0000", 2024-09-12T00:05:59.194 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0550999999999995e-05 2024-09-12T00:05:59.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.194 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.195 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.195 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.562932+0000", 2024-09-12T00:05:59.195 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2601999999999995e-05 2024-09-12T00:05:59.195 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.195 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.195 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.195 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.195 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3798 3.35 3:ac2a574a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_415:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:59.195 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.681661+0000", 2024-09-12T00:05:59.195 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 13.403464525, 2024-09-12T00:05:59.195 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.029133148000000001, 2024-09-12T00:05:59.195 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.195 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.196 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.196 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.196 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.196 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.196 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3798 2024-09-12T00:05:59.196 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.196 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.196 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.196 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.196 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.681661+0000", 2024-09-12T00:05:59.196 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.196 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.196 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.196 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.197 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.681661+0000", 2024-09-12T00:05:59.197 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.197 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.197 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.197 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.197 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.681665+0000", 2024-09-12T00:05:59.197 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.591e-06 2024-09-12T00:05:59.197 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.197 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.197 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.197 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683576+0000", 2024-09-12T00:05:59.197 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019111 2024-09-12T00:05:59.197 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.197 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.198 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.198 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683608+0000", 2024-09-12T00:05:59.198 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.269e-05 2024-09-12T00:05:59.198 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.198 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.198 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.198 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683623+0000", 2024-09-12T00:05:59.198 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4501000000000001e-05 2024-09-12T00:05:59.198 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.198 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.198 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.198 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683714+0000", 2024-09-12T00:05:59.198 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0666000000000002e-05 2024-09-12T00:05:59.198 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.198 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.199 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.199 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683913+0000", 2024-09-12T00:05:59.199 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000199037 2024-09-12T00:05:59.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.199 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.199 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:59.199 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.684084+0000", 2024-09-12T00:05:59.199 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017164700000000001 2024-09-12T00:05:59.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.199 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.199 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.199 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.697732+0000", 2024-09-12T00:05:59.199 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013647670000000001 2024-09-12T00:05:59.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.200 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.200 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.200 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.710663+0000", 2024-09-12T00:05:59.200 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012931265000000001 2024-09-12T00:05:59.200 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.200 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.200 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.200 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.710737+0000", 2024-09-12T00:05:59.200 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4181e-05 2024-09-12T00:05:59.200 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.200 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.200 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.200 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.710794+0000", 2024-09-12T00:05:59.200 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6799999999999998e-05 2024-09-12T00:05:59.201 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.201 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.201 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.201 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.201 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.201 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:59.202 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:05:59.203 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:05:59.204+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:05:59.304 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:59.304+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:59.377 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:05:59.390 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:59.390 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:59.390 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:05:59.391 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:59.405 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:05:59.406 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:05:59.404+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:05:59.506 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:59.508+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:59.575 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:59.575 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:05:59.575 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:05:59.575 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:05:59.575 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:59.590 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:05:59.598 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:05:59.607 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:05:59.608+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:05:59.708 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:05:59.708+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:05:59.725 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:05:59.725 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:05:59.725 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:05:59.725 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:05:59.725 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.725 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:05:59.725 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:05:59.725 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 168.23192426200001, 2024-09-12T00:05:59.725 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.278479906, 2024-09-12T00:05:59.725 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.725 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.725 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.726 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.726 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:05:59.726 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:05:59.726 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:05:59.726 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.726 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.726 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:05:59.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:05:59.727 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.727 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.727 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493422+0000", 2024-09-12T00:05:59.728 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.807e-06 2024-09-12T00:05:59.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.728 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.728 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493435+0000", 2024-09-12T00:05:59.728 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.375e-05 2024-09-12T00:05:59.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.728 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.728 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493457+0000", 2024-09-12T00:05:59.728 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2166000000000001e-05 2024-09-12T00:05:59.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.728 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.729 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493475+0000", 2024-09-12T00:05:59.729 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7184e-05 2024-09-12T00:05:59.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.729 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.729 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.729 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493617+0000", 2024-09-12T00:05:59.729 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014274200000000001 2024-09-12T00:05:59.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.729 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.729 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:05:59.729 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493632+0000", 2024-09-12T00:05:59.729 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4293e-05 2024-09-12T00:05:59.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.729 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.730 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.730 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.768657+0000", 2024-09-12T00:05:59.730 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.27502575400000001 2024-09-12T00:05:59.730 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.730 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.730 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.730 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769042+0000", 2024-09-12T00:05:59.730 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00038463700000000001 2024-09-12T00:05:59.730 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.730 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.730 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:59.730 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769430+0000", 2024-09-12T00:05:59.730 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000388014 2024-09-12T00:05:59.730 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.731 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.731 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.731 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.770784+0000", 2024-09-12T00:05:59.731 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00135402 2024-09-12T00:05:59.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.731 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.731 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.731 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771735+0000", 2024-09-12T00:05:59.731 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00095068599999999996 2024-09-12T00:05:59.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.731 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.731 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.731 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771828+0000", 2024-09-12T00:05:59.731 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3468999999999996e-05 2024-09-12T00:05:59.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.732 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.732 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771899+0000", 2024-09-12T00:05:59.732 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0383999999999996e-05 2024-09-12T00:05:59.732 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.732 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.732 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.732 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:05:59.732 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:05:59.732 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 167.80336086200001, 2024-09-12T00:05:59.732 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021018614000000001, 2024-09-12T00:05:59.733 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.733 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.733 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.733 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.733 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:05:59.733 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:05:59.733 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 50 2024-09-12T00:05:59.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.733 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.734 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.734 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:05:59.734 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.734 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.734 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.734 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:05:59.734 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.734 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.734 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.734 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921983+0000", 2024-09-12T00:05:59.734 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4499999999999996e-07 2024-09-12T00:05:59.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.734 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922071+0000", 2024-09-12T00:05:59.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8010000000000006e-05 2024-09-12T00:05:59.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922084+0000", 2024-09-12T00:05:59.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3275000000000001e-05 2024-09-12T00:05:59.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.735 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.735 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922093+0000", 2024-09-12T00:05:59.735 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0580000000000004e-06 2024-09-12T00:05:59.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.736 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.736 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936515+0000", 2024-09-12T00:05:59.736 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014421270999999999 2024-09-12T00:05:59.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.736 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.736 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936677+0000", 2024-09-12T00:05:59.736 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162003 2024-09-12T00:05:59.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.736 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:59.736 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936908+0000", 2024-09-12T00:05:59.736 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023115700000000001 2024-09-12T00:05:59.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.737 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.737 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939985+0000", 2024-09-12T00:05:59.737 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030773879999999999 2024-09-12T00:05:59.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.737 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.737 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.737 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942623+0000", 2024-09-12T00:05:59.737 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026377929999999998 2024-09-12T00:05:59.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.738 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942818+0000", 2024-09-12T00:05:59.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019556200000000001 2024-09-12T00:05:59.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.738 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.738 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943001+0000", 2024-09-12T00:05:59.738 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018235199999999999 2024-09-12T00:05:59.738 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.738 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.738 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.738 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.738 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:05:59.739 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:05:59.739 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 167.80322647, 2024-09-12T00:05:59.739 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021092493, 2024-09-12T00:05:59.739 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.739 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.739 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.739 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.739 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:05:59.739 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:05:59.739 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 51 2024-09-12T00:05:59.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.739 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.740 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.740 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:05:59.740 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.740 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.740 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.740 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.740 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:05:59.740 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.740 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922118+0000", 2024-09-12T00:05:59.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0389999999999999e-06 2024-09-12T00:05:59.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.741 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.741 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.741 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922124+0000", 2024-09-12T00:05:59.741 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5409999999999997e-06 2024-09-12T00:05:59.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922136+0000", 2024-09-12T00:05:59.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.205e-05 2024-09-12T00:05:59.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922147+0000", 2024-09-12T00:05:59.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0451e-05 2024-09-12T00:05:59.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.742 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.742 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.742 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938000+0000", 2024-09-12T00:05:59.742 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015853682000000001 2024-09-12T00:05:59.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.743 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.743 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938142+0000", 2024-09-12T00:05:59.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014148899999999999 2024-09-12T00:05:59.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.743 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:59.743 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938362+0000", 2024-09-12T00:05:59.743 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022034800000000001 2024-09-12T00:05:59.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.743 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.744 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940330+0000", 2024-09-12T00:05:59.744 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001967459 2024-09-12T00:05:59.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.744 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.744 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943064+0000", 2024-09-12T00:05:59.744 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027346219999999999 2024-09-12T00:05:59.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.744 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.744 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943152+0000", 2024-09-12T00:05:59.744 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7563000000000002e-05 2024-09-12T00:05:59.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.744 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.745 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.745 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943209+0000", 2024-09-12T00:05:59.745 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7249e-05 2024-09-12T00:05:59.745 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.745 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.745 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.745 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.745 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.745 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:05:59.745 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:05:59.745 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 167.80317697699999, 2024-09-12T00:05:59.745 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021175616000000001, 2024-09-12T00:05:59.745 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.745 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.746 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.746 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.746 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:05:59.746 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:05:59.746 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 52 2024-09-12T00:05:59.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.746 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.746 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.746 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.746 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:05:59.746 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.746 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.746 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.746 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:05:59.747 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922167+0000", 2024-09-12T00:05:59.747 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3300000000000001e-07 2024-09-12T00:05:59.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.747 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922174+0000", 2024-09-12T00:05:59.747 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7070000000000003e-06 2024-09-12T00:05:59.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.747 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.747 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.748 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922184+0000", 2024-09-12T00:05:59.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682e-05 2024-09-12T00:05:59.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.748 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922195+0000", 2024-09-12T00:05:59.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0489000000000001e-05 2024-09-12T00:05:59.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.748 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939166+0000", 2024-09-12T00:05:59.748 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016971245999999999 2024-09-12T00:05:59.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.748 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.748 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.749 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939243+0000", 2024-09-12T00:05:59.749 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7201999999999997e-05 2024-09-12T00:05:59.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.749 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.749 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:59.749 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939381+0000", 2024-09-12T00:05:59.749 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013770699999999999 2024-09-12T00:05:59.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.749 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.749 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.749 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940923+0000", 2024-09-12T00:05:59.749 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001542302 2024-09-12T00:05:59.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.749 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.750 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.750 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943221+0000", 2024-09-12T00:05:59.750 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022979720000000001 2024-09-12T00:05:59.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.750 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.750 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943295+0000", 2024-09-12T00:05:59.750 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3317000000000003e-05 2024-09-12T00:05:59.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.750 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.750 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943342+0000", 2024-09-12T00:05:59.750 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7159e-05 2024-09-12T00:05:59.750 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.750 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.751 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.751 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.751 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.751 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:05:59.751 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:05:59.751 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 167.55390435699999, 2024-09-12T00:05:59.751 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020263554, 2024-09-12T00:05:59.751 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.751 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.751 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.751 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.751 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:05:59.751 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:05:59.751 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 71 2024-09-12T00:05:59.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.752 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.752 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.752 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.752 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:05:59.752 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.752 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.752 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.752 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:05:59.752 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.752 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.752 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:05:59.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5000000000000002e-07 2024-09-12T00:05:59.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171454+0000", 2024-09-12T00:05:59.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5046e-05 2024-09-12T00:05:59.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.753 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.753 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171471+0000", 2024-09-12T00:05:59.753 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6923999999999999e-05 2024-09-12T00:05:59.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.754 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171487+0000", 2024-09-12T00:05:59.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5823000000000001e-05 2024-09-12T00:05:59.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.754 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180765+0000", 2024-09-12T00:05:59.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0092774399999999996 2024-09-12T00:05:59.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.754 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.754 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.754 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180900+0000", 2024-09-12T00:05:59.754 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013556700000000001 2024-09-12T00:05:59.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.755 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.755 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:59.755 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181108+0000", 2024-09-12T00:05:59.755 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020727899999999999 2024-09-12T00:05:59.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.755 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.755 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.755 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184725+0000", 2024-09-12T00:05:59.755 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036171340000000001 2024-09-12T00:05:59.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.755 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.755 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.755 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191413+0000", 2024-09-12T00:05:59.755 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066881830000000003 2024-09-12T00:05:59.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.756 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.756 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.756 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191540+0000", 2024-09-12T00:05:59.756 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000126823 2024-09-12T00:05:59.756 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.756 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.756 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.756 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191702+0000", 2024-09-12T00:05:59.756 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162585 2024-09-12T00:05:59.756 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.756 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.756 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.756 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.756 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.757 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:05:59.757 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:05:59.757 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 167.553825781, 2024-09-12T00:05:59.757 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020448573000000001, 2024-09-12T00:05:59.757 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.757 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.757 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.757 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.757 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:05:59.757 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:05:59.757 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 72 2024-09-12T00:05:59.757 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.757 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.757 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.757 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.758 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:05:59.758 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.758 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.758 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.758 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:05:59.758 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.758 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.758 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.758 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171518+0000", 2024-09-12T00:05:59.758 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0440000000000001e-06 2024-09-12T00:05:59.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.758 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.759 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.759 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171647+0000", 2024-09-12T00:05:59.759 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012912899999999999 2024-09-12T00:05:59.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.759 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.759 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.759 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171664+0000", 2024-09-12T00:05:59.759 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6079999999999999e-05 2024-09-12T00:05:59.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.759 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.759 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.759 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171675+0000", 2024-09-12T00:05:59.759 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1223000000000001e-05 2024-09-12T00:05:59.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.759 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.760 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.760 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182000+0000", 2024-09-12T00:05:59.760 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010324949 2024-09-12T00:05:59.760 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.760 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.760 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.760 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182178+0000", 2024-09-12T00:05:59.760 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017808799999999999 2024-09-12T00:05:59.760 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.760 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.760 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:59.760 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182402+0000", 2024-09-12T00:05:59.760 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022381199999999999 2024-09-12T00:05:59.760 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.760 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.761 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.761 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190935+0000", 2024-09-12T00:05:59.761 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085331560000000001 2024-09-12T00:05:59.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.761 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.761 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.761 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191728+0000", 2024-09-12T00:05:59.761 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079325700000000001 2024-09-12T00:05:59.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.761 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.761 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.761 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191864+0000", 2024-09-12T00:05:59.761 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013606299999999999 2024-09-12T00:05:59.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.761 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.762 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.762 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191966+0000", 2024-09-12T00:05:59.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101772 2024-09-12T00:05:59.762 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.762 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.762 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.762 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.762 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:05:59.762 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:05:59.762 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 167.553642586, 2024-09-12T00:05:59.762 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020675235, 2024-09-12T00:05:59.762 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.762 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.763 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.763 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.763 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:05:59.763 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:05:59.763 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 73 2024-09-12T00:05:59.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.763 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.763 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.763 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:05:59.763 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.763 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.763 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.763 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:05:59.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.764 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171701+0000", 2024-09-12T00:05:59.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0999999999999997e-07 2024-09-12T00:05:59.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.764 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.764 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171709+0000", 2024-09-12T00:05:59.764 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2540000000000003e-06 2024-09-12T00:05:59.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.764 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.764 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171724+0000", 2024-09-12T00:05:59.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5569e-05 2024-09-12T00:05:59.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.765 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171734+0000", 2024-09-12T00:05:59.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6139999999999998e-06 2024-09-12T00:05:59.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.765 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.765 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183774+0000", 2024-09-12T00:05:59.765 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012040444000000001 2024-09-12T00:05:59.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.766 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.766 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183896+0000", 2024-09-12T00:05:59.766 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012204199999999999 2024-09-12T00:05:59.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.766 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:59.766 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184084+0000", 2024-09-12T00:05:59.766 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018792599999999999 2024-09-12T00:05:59.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.766 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.766 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191984+0000", 2024-09-12T00:05:59.766 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079003790000000008 2024-09-12T00:05:59.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.767 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.767 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192093+0000", 2024-09-12T00:05:59.767 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000108942 2024-09-12T00:05:59.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.767 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.767 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.767 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192250+0000", 2024-09-12T00:05:59.767 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015637600000000001 2024-09-12T00:05:59.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.768 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.768 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192376+0000", 2024-09-12T00:05:59.768 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012587899999999999 2024-09-12T00:05:59.768 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.768 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.768 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.768 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:05:59.768 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:05:59.768 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 167.55359437600001, 2024-09-12T00:05:59.769 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021088828, 2024-09-12T00:05:59.769 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.769 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.769 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.769 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.769 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:05:59.769 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:05:59.769 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 74 2024-09-12T00:05:59.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.769 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.769 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.769 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.769 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:05:59.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.770 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:05:59.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.770 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:05:59.770 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1699999999999997e-07 2024-09-12T00:05:59.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.770 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.770 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.771 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171758+0000", 2024-09-12T00:05:59.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0860000000000008e-06 2024-09-12T00:05:59.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.771 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.771 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171774+0000", 2024-09-12T00:05:59.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:05:59.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.771 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.771 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171788+0000", 2024-09-12T00:05:59.771 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4793999999999999e-05 2024-09-12T00:05:59.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.771 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.772 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.772 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184842+0000", 2024-09-12T00:05:59.772 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013053607 2024-09-12T00:05:59.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.772 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.772 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.772 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185130+0000", 2024-09-12T00:05:59.772 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00028779199999999998 2024-09-12T00:05:59.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.772 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.772 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:59.772 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185378+0000", 2024-09-12T00:05:59.772 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024780100000000002 2024-09-12T00:05:59.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.773 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192513+0000", 2024-09-12T00:05:59.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071350770000000001 2024-09-12T00:05:59.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.773 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192690+0000", 2024-09-12T00:05:59.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000176892 2024-09-12T00:05:59.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.773 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.773 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.773 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192769+0000", 2024-09-12T00:05:59.773 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9466000000000001e-05 2024-09-12T00:05:59.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.774 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.774 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192837+0000", 2024-09-12T00:05:59.774 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8466000000000005e-05 2024-09-12T00:05:59.774 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.774 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.774 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.774 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:05:59.774 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:05:59.774 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 167.55354179899999, 2024-09-12T00:05:59.774 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.02121994, 2024-09-12T00:05:59.774 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.775 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.775 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.775 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.775 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:05:59.775 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:05:59.775 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 75 2024-09-12T00:05:59.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.775 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.775 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.775 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.775 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:05:59.775 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.775 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.775 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:05:59.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171802+0000", 2024-09-12T00:05:59.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5000000000000002e-07 2024-09-12T00:05:59.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.776 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.776 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171954+0000", 2024-09-12T00:05:59.776 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015215500000000001 2024-09-12T00:05:59.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171966+0000", 2024-09-12T00:05:59.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1548e-05 2024-09-12T00:05:59.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171970+0000", 2024-09-12T00:05:59.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8729999999999998e-06 2024-09-12T00:05:59.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.777 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.777 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186552+0000", 2024-09-12T00:05:59.777 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014581775 2024-09-12T00:05:59.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.778 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.778 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186702+0000", 2024-09-12T00:05:59.778 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014946 2024-09-12T00:05:59.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.778 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:59.778 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186897+0000", 2024-09-12T00:05:59.778 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000195071 2024-09-12T00:05:59.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.778 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.778 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192666+0000", 2024-09-12T00:05:59.778 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057693470000000002 2024-09-12T00:05:59.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192857+0000", 2024-09-12T00:05:59.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191149 2024-09-12T00:05:59.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192967+0000", 2024-09-12T00:05:59.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110202 2024-09-12T00:05:59.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.779 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.779 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193021+0000", 2024-09-12T00:05:59.779 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3709999999999999e-05 2024-09-12T00:05:59.780 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.780 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.780 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.780 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:05:59.780 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:05:59.780 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 167.55336250400001, 2024-09-12T00:05:59.780 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026297425999999999, 2024-09-12T00:05:59.780 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.780 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.780 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.781 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.781 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:05:59.781 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:05:59.781 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 76 2024-09-12T00:05:59.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.781 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.781 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:05:59.781 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.781 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.781 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.781 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:05:59.782 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.782 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.782 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:05:59.782 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9399999999999995e-07 2024-09-12T00:05:59.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.782 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.782 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171987+0000", 2024-09-12T00:05:59.782 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5230000000000003e-06 2024-09-12T00:05:59.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.782 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172005+0000", 2024-09-12T00:05:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8788e-05 2024-09-12T00:05:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172010+0000", 2024-09-12T00:05:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7570000000000004e-06 2024-09-12T00:05:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193104+0000", 2024-09-12T00:05:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021094112000000002 2024-09-12T00:05:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193334+0000", 2024-09-12T00:05:59.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000229855 2024-09-12T00:05:59.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:59.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193697+0000", 2024-09-12T00:05:59.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00036272399999999998 2024-09-12T00:05:59.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.784 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.784 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.195602+0000", 2024-09-12T00:05:59.784 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019049620000000001 2024-09-12T00:05:59.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198123+0000", 2024-09-12T00:05:59.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025216520000000001 2024-09-12T00:05:59.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.785 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198213+0000", 2024-09-12T00:05:59.785 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0008999999999998e-05 2024-09-12T00:05:59.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.785 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.786 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198278+0000", 2024-09-12T00:05:59.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4549999999999997e-05 2024-09-12T00:05:59.786 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.786 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.786 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.786 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2996 3.21 e75/23 3:872b1c12:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_35:head v 75'4, mlcod=63'2)", 2024-09-12T00:05:59.786 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.357371+0000", 2024-09-12T00:05:59.786 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 39.367972084000002, 2024-09-12T00:05:59.786 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021201353999999999, 2024-09-12T00:05:59.786 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.786 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.786 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.787 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.787 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.787 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.787 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.357371+0000", 2024-09-12T00:05:59.787 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.787 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.787 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.787 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.357371+0000", 2024-09-12T00:05:59.787 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.787 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.787 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.787 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.357372+0000", 2024-09-12T00:05:59.788 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.424e-06 2024-09-12T00:05:59.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.788 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.788 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.364586+0000", 2024-09-12T00:05:59.788 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0072140609999999999 2024-09-12T00:05:59.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.788 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.788 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.364611+0000", 2024-09-12T00:05:59.788 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4593e-05 2024-09-12T00:05:59.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.788 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.788 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.789 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.364625+0000", 2024-09-12T00:05:59.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3974999999999999e-05 2024-09-12T00:05:59.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.789 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.364718+0000", 2024-09-12T00:05:59.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2899000000000006e-05 2024-09-12T00:05:59.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.789 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.364748+0000", 2024-09-12T00:05:59.789 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9629999999999999e-05 2024-09-12T00:05:59.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.789 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.378470+0000", 2024-09-12T00:05:59.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013722323999999999 2024-09-12T00:05:59.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.790 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.790 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.378572+0000", 2024-09-12T00:05:59.790 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010244800000000001 2024-09-12T00:05:59.790 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.790 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.790 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.790 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3031 3.1c 3:3b901b6c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:59.790 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.749824+0000", 2024-09-12T00:05:59.791 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 38.975518653999998, 2024-09-12T00:05:59.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025171115000000001, 2024-09-12T00:05:59.791 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.791 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.791 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.791 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.791 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.791 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.791 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3031 2024-09-12T00:05:59.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.791 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.791 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.791 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.749824+0000", 2024-09-12T00:05:59.791 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.749824+0000", 2024-09-12T00:05:59.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.749828+0000", 2024-09-12T00:05:59.792 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.839e-06 2024-09-12T00:05:59.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.792 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.792 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.751966+0000", 2024-09-12T00:05:59.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021378360000000002 2024-09-12T00:05:59.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.793 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.793 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.793 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.751995+0000", 2024-09-12T00:05:59.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8631000000000001e-05 2024-09-12T00:05:59.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.793 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.793 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.793 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.752010+0000", 2024-09-12T00:05:59.793 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4899000000000001e-05 2024-09-12T00:05:59.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.793 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.793 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.793 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.752090+0000", 2024-09-12T00:05:59.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0352000000000006e-05 2024-09-12T00:05:59.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.794 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.752237+0000", 2024-09-12T00:05:59.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014683400000000001 2024-09-12T00:05:59.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:59.794 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.752389+0000", 2024-09-12T00:05:59.794 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015245699999999999 2024-09-12T00:05:59.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.794 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.769694+0000", 2024-09-12T00:05:59.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017305259 2024-09-12T00:05:59.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.774831+0000", 2024-09-12T00:05:59.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0051360360000000001 2024-09-12T00:05:59.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.795 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.774895+0000", 2024-09-12T00:05:59.795 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4454000000000003e-05 2024-09-12T00:05:59.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.795 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.796 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.774995+0000", 2024-09-12T00:05:59.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100518 2024-09-12T00:05:59.796 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.796 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.796 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.796 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3034 3.2a 3:57bb186b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:05:59.796 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.782449+0000", 2024-09-12T00:05:59.796 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 38.942894312999996, 2024-09-12T00:05:59.796 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022965039999999999, 2024-09-12T00:05:59.796 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.796 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.796 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.797 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.797 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.797 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.797 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3034 2024-09-12T00:05:59.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.797 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.782449+0000", 2024-09-12T00:05:59.797 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.797 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.797 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.782449+0000", 2024-09-12T00:05:59.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.798 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.782452+0000", 2024-09-12T00:05:59.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3670000000000001e-06 2024-09-12T00:05:59.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.798 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.784814+0000", 2024-09-12T00:05:59.798 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023623030000000001 2024-09-12T00:05:59.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.798 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.798 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.784849+0000", 2024-09-12T00:05:59.799 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4245999999999997e-05 2024-09-12T00:05:59.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.799 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.799 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.784875+0000", 2024-09-12T00:05:59.799 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6455999999999999e-05 2024-09-12T00:05:59.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.799 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.799 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.784972+0000", 2024-09-12T00:05:59.799 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7316000000000001e-05 2024-09-12T00:05:59.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.799 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.785154+0000", 2024-09-12T00:05:59.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018166499999999999 2024-09-12T00:05:59.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:59.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.785320+0000", 2024-09-12T00:05:59.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016586500000000001 2024-09-12T00:05:59.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.800 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.800 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.804742+0000", 2024-09-12T00:05:59.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019421600000000001 2024-09-12T00:05:59.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.805237+0000", 2024-09-12T00:05:59.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00049526400000000003 2024-09-12T00:05:59.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.805336+0000", 2024-09-12T00:05:59.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8912000000000004e-05 2024-09-12T00:05:59.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.805414+0000", 2024-09-12T00:05:59.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8046000000000005e-05 2024-09-12T00:05:59.801 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.802 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.802 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.802 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3133 3.10 3:0bd95b9d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:05:59.802 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:22.028646+0000", 2024-09-12T00:05:59.802 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 37.696696957999997, 2024-09-12T00:05:59.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.028771254, 2024-09-12T00:05:59.802 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.802 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.802 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.802 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.802 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.802 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.802 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3133 2024-09-12T00:05:59.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.803 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.803 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.028646+0000", 2024-09-12T00:05:59.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.803 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.028646+0000", 2024-09-12T00:05:59.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.803 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.028650+0000", 2024-09-12T00:05:59.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8850000000000001e-06 2024-09-12T00:05:59.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.030628+0000", 2024-09-12T00:05:59.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019778450000000002 2024-09-12T00:05:59.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.030658+0000", 2024-09-12T00:05:59.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0275999999999999e-05 2024-09-12T00:05:59.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.805 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.030670+0000", 2024-09-12T00:05:59.805 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2218000000000001e-05 2024-09-12T00:05:59.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.805 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.805 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.805 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.030764+0000", 2024-09-12T00:05:59.805 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3953e-05 2024-09-12T00:05:59.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.805 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.805 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.805 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.030996+0000", 2024-09-12T00:05:59.805 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023209500000000001 2024-09-12T00:05:59.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.805 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:59.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.031190+0000", 2024-09-12T00:05:59.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019345699999999999 2024-09-12T00:05:59.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.036754+0000", 2024-09-12T00:05:59.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055638980000000003 2024-09-12T00:05:59.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.057277+0000", 2024-09-12T00:05:59.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020523604000000001 2024-09-12T00:05:59.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.057358+0000", 2024-09-12T00:05:59.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1143999999999994e-05 2024-09-12T00:05:59.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.807 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.807 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.057417+0000", 2024-09-12T00:05:59.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8879000000000003e-05 2024-09-12T00:05:59.807 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.807 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.807 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.808 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3374 3.10 3:089db4d6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:05:59.808 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.636005+0000", 2024-09-12T00:05:59.808 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 19.089338302000002, 2024-09-12T00:05:59.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025433803000000001, 2024-09-12T00:05:59.808 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.808 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.808 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.808 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.808 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.808 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.808 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3374 2024-09-12T00:05:59.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.808 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.809 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.809 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.636005+0000", 2024-09-12T00:05:59.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.809 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.809 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.809 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.636005+0000", 2024-09-12T00:05:59.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.809 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.809 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.809 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.636009+0000", 2024-09-12T00:05:59.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2250000000000002e-06 2024-09-12T00:05:59.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.810 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.810 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639097+0000", 2024-09-12T00:05:59.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030881020000000001 2024-09-12T00:05:59.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.810 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.810 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639124+0000", 2024-09-12T00:05:59.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7390999999999999e-05 2024-09-12T00:05:59.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.810 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.810 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639138+0000", 2024-09-12T00:05:59.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3155e-05 2024-09-12T00:05:59.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.811 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.811 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639221+0000", 2024-09-12T00:05:59.811 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2996000000000003e-05 2024-09-12T00:05:59.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.811 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.811 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639390+0000", 2024-09-12T00:05:59.811 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016898999999999999 2024-09-12T00:05:59.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.811 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:59.811 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639547+0000", 2024-09-12T00:05:59.811 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000157374 2024-09-12T00:05:59.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.651089+0000", 2024-09-12T00:05:59.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011542124000000001 2024-09-12T00:05:59.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.661319+0000", 2024-09-12T00:05:59.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010229538999999999 2024-09-12T00:05:59.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.661387+0000", 2024-09-12T00:05:59.813 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8663000000000003e-05 2024-09-12T00:05:59.813 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.813 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.813 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.813 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.661439+0000", 2024-09-12T00:05:59.813 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1243999999999999e-05 2024-09-12T00:05:59.813 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.813 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.813 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.813 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.813 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.813 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3712 3.1c 3:3a424314:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_329:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:59.813 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.670012+0000", 2024-09-12T00:05:59.813 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 15.055331138, 2024-09-12T00:05:59.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.024941801999999999, 2024-09-12T00:05:59.814 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.814 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.814 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.814 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.814 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.814 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.814 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3712 2024-09-12T00:05:59.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.814 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.670012+0000", 2024-09-12T00:05:59.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.670012+0000", 2024-09-12T00:05:59.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.670016+0000", 2024-09-12T00:05:59.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2169999999999996e-06 2024-09-12T00:05:59.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.672951+0000", 2024-09-12T00:05:59.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029345159999999999 2024-09-12T00:05:59.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.816 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.816 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.816 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.672998+0000", 2024-09-12T00:05:59.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7605999999999998e-05 2024-09-12T00:05:59.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.816 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.816 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.816 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.673019+0000", 2024-09-12T00:05:59.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0843e-05 2024-09-12T00:05:59.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.816 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.816 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.816 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.673187+0000", 2024-09-12T00:05:59.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016786899999999999 2024-09-12T00:05:59.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.817 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.817 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.817 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.673628+0000", 2024-09-12T00:05:59.817 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00044081600000000002 2024-09-12T00:05:59.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.817 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.817 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:59.817 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.674047+0000", 2024-09-12T00:05:59.817 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00041917300000000001 2024-09-12T00:05:59.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.817 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.817 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.817 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.685347+0000", 2024-09-12T00:05:59.817 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011300464 2024-09-12T00:05:59.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.818 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.818 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.694777+0000", 2024-09-12T00:05:59.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0094296550000000003 2024-09-12T00:05:59.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.818 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.818 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.694876+0000", 2024-09-12T00:05:59.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8488999999999998e-05 2024-09-12T00:05:59.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.818 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.818 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.694954+0000", 2024-09-12T00:05:59.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8153999999999997e-05 2024-09-12T00:05:59.819 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.819 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.819 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.819 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3722 3.1a 3:5af5b5cf:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_339:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:59.819 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.814831+0000", 2024-09-12T00:05:59.819 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.910511566, 2024-09-12T00:05:59.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021631714, 2024-09-12T00:05:59.819 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.819 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.819 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.819 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.819 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.820 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.820 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3722 2024-09-12T00:05:59.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.820 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.820 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.814831+0000", 2024-09-12T00:05:59.820 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.820 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.814831+0000", 2024-09-12T00:05:59.820 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.814836+0000", 2024-09-12T00:05:59.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3409999999999996e-06 2024-09-12T00:05:59.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.816751+0000", 2024-09-12T00:05:59.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001915564 2024-09-12T00:05:59.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.822 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.822 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.816790+0000", 2024-09-12T00:05:59.822 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8355000000000001e-05 2024-09-12T00:05:59.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.822 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.822 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.816807+0000", 2024-09-12T00:05:59.822 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7703999999999999e-05 2024-09-12T00:05:59.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.822 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.822 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.816940+0000", 2024-09-12T00:05:59.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013292600000000001 2024-09-12T00:05:59.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.817155+0000", 2024-09-12T00:05:59.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021460699999999999 2024-09-12T00:05:59.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:05:59.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.817330+0000", 2024-09-12T00:05:59.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017552600000000001 2024-09-12T00:05:59.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.824 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.827842+0000", 2024-09-12T00:05:59.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010511533999999999 2024-09-12T00:05:59.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.824 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.824 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.836260+0000", 2024-09-12T00:05:59.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0084178399999999994 2024-09-12T00:05:59.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.824 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.824 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.836347+0000", 2024-09-12T00:05:59.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6637000000000004e-05 2024-09-12T00:05:59.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.825 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.825 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.836463+0000", 2024-09-12T00:05:59.825 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011668 2024-09-12T00:05:59.825 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.825 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.825 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.825 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.825 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.825 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3780 3.19 e83/23 3:9a0a1200:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_397:head v 83'18, mlcod=83'16)", 2024-09-12T00:05:59.825 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.485629+0000", 2024-09-12T00:05:59.825 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.239714467000001, 2024-09-12T00:05:59.825 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020596468, 2024-09-12T00:05:59.825 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.825 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.825 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.826 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.826 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.485629+0000", 2024-09-12T00:05:59.826 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.826 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.485629+0000", 2024-09-12T00:05:59.826 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.826 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.485631+0000", 2024-09-12T00:05:59.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9019999999999999e-06 2024-09-12T00:05:59.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.491531+0000", 2024-09-12T00:05:59.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058997870000000001 2024-09-12T00:05:59.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.491569+0000", 2024-09-12T00:05:59.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7432999999999999e-05 2024-09-12T00:05:59.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.491585+0000", 2024-09-12T00:05:59.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6651e-05 2024-09-12T00:05:59.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.491687+0000", 2024-09-12T00:05:59.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101366 2024-09-12T00:05:59.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.491718+0000", 2024-09-12T00:05:59.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1031000000000002e-05 2024-09-12T00:05:59.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.506043+0000", 2024-09-12T00:05:59.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014325311 2024-09-12T00:05:59.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.506225+0000", 2024-09-12T00:05:59.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018198699999999999 2024-09-12T00:05:59.829 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.829 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.829 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.829 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3783 3.1c 3:38213e46:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_400:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:59.829 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.514915+0000", 2024-09-12T00:05:59.829 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.210427804, 2024-09-12T00:05:59.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021806478000000001, 2024-09-12T00:05:59.830 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.830 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.830 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.830 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.830 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.830 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.830 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3783 2024-09-12T00:05:59.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.830 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.514915+0000", 2024-09-12T00:05:59.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.514915+0000", 2024-09-12T00:05:59.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.514920+0000", 2024-09-12T00:05:59.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7480000000000001e-06 2024-09-12T00:05:59.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.831 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517111+0000", 2024-09-12T00:05:59.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021913890000000002 2024-09-12T00:05:59.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.832 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.832 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517157+0000", 2024-09-12T00:05:59.832 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5754000000000003e-05 2024-09-12T00:05:59.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.832 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.832 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517177+0000", 2024-09-12T00:05:59.832 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0197999999999999e-05 2024-09-12T00:05:59.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.832 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.832 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517294+0000", 2024-09-12T00:05:59.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000117156 2024-09-12T00:05:59.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.833 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517503+0000", 2024-09-12T00:05:59.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020805500000000001 2024-09-12T00:05:59.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:05:59.833 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517714+0000", 2024-09-12T00:05:59.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021131399999999999 2024-09-12T00:05:59.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.535744+0000", 2024-09-12T00:05:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018029677000000001 2024-09-12T00:05:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.536543+0000", 2024-09-12T00:05:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079940499999999999 2024-09-12T00:05:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.536642+0000", 2024-09-12T00:05:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.9440999999999999e-05 2024-09-12T00:05:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.536722+0000", 2024-09-12T00:05:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9340999999999998e-05 2024-09-12T00:05:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3786 3.37 3:ece0bced:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_403:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:05:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.550483+0000", 2024-09-12T00:05:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 14.174860475999999, 2024-09-12T00:05:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022719506, 2024-09-12T00:05:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:05:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:05:59.835 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:05:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:05:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:05:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:05:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3786 2024-09-12T00:05:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:05:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:05:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.550483+0000", 2024-09-12T00:05:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:05:59.836 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.550483+0000", 2024-09-12T00:05:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:05:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:05:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.550486+0000", 2024-09-12T00:05:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4070000000000002e-06 2024-09-12T00:05:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:05:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.552644+0000", 2024-09-12T00:05:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021584629999999998 2024-09-12T00:05:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:05:59.837 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.552676+0000", 2024-09-12T00:05:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1662000000000003e-05 2024-09-12T00:05:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:05:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.552691+0000", 2024-09-12T00:05:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4780000000000001e-05 2024-09-12T00:05:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:05:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.552788+0000", 2024-09-12T00:05:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7034999999999995e-05 2024-09-12T00:05:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:05:59.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.553009+0000", 2024-09-12T00:05:59.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000220991 2024-09-12T00:05:59.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.841 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.841 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:05:59.841 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.553191+0000", 2024-09-12T00:05:59.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000182349 2024-09-12T00:05:59.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:05:59.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.573055+0000", 2024-09-12T00:05:59.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019863553999999999 2024-09-12T00:05:59.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:05:59.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.573071+0000", 2024-09-12T00:05:59.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6178e-05 2024-09-12T00:05:59.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:05:59.843 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.573144+0000", 2024-09-12T00:05:59.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3362000000000007e-05 2024-09-12T00:05:59.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:05:59.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:05:59.843 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:05:59.843 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.573202+0000", 2024-09-12T00:05:59.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7725e-05 2024-09-12T00:05:59.843 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.843 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.843 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.843 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:05:59.843 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:05:59.843 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:05:59.845 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:05:59.845 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:05:59.846 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:05:59.846 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:05:59.847 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:05:59.847 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:05:59.847 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:05:59.847 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:05:59.848 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:05:59.848 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:05:59.848 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:05:59.849 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:05:59.844+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:05:59.870 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:05:59.870 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:05:59.891 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:05:59.891 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:05:59.913 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:05:59.913 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:05:59.946 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:05:59.948+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:05:59.967 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:05:59.967 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:05:59.983 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:06:00.047 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:06:00.048+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:06:00.148 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:06:00.148+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:06:00.151 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:00.151 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:00.166 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:06:00.176 INFO:tasks.workunit.client.0.smithi019.stderr:200+0 records in 2024-09-12T00:06:00.176 INFO:tasks.workunit.client.0.smithi019.stderr:200+0 records out 2024-09-12T00:06:00.176 INFO:tasks.workunit.client.0.smithi019.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 13.0315 s, 161 MB/s 2024-09-12T00:06:00.249 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:06:00.248+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:06:00.299 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:00.300 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:00.315 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:06:00.357 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:06:00.360+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:06:00.362 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T00:06:00.371 INFO:tasks.workunit.client.0.smithi019.stdout:Bucket Created: buck_2024_08_12_00_06_00 2024-09-12T00:06:00.450 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:06:00.452+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:06:00.487 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:00.487 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:00.503 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:06:00.552 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:06:00.552+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:06:00.652 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:06:00.652+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:06:00.673 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:00.673 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:00.689 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:06:00.739 INFO:tasks.workunit.client.0.smithi019.stdout:bucket quota max size set for the given user: buck_2024_08_12_00_06_00 2024-09-12T00:06:00.753 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:06:00.752+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:06:00.854 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:06:00.856+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:06:00.857 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:00.857 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:00.872 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:06:00.955 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:06:00.956+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:06:01.002 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:01.002 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:01.016 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:06:01.056 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:06:01.056+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:06:01.157 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:06:01.156+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:06:01.181 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:01.181 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:01.195 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:06:01.286 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:06:01.288+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:06:01.358 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:06:01.360+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:06:01.362 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:01.362 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:01.377 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:06:01.462 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:06:01.464+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:06:01.543 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:01.543 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:01.557 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:06:01.560 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:06:01.560+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:06:01.661 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:06:01.664+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:06:01.720 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:01.720 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:01.734 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:06:01.762 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:06:01.764+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:06:01.853 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:01.853 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:01.863 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:06:01.864+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:06:01.868 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:06:01.932 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:06:01.964 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:06:01.964+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:06:02.033 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:02.033 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:02.047 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:06:02.069 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:06:02.070 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:06:02.086 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:06:02.086 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:06:02.094 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:06:02.092+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:06:02.104 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:06:02.104 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:06:02.121 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:06:02.121 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:06:02.140 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:06:02.140 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:06:02.161 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:06:02.161 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:06:02.165 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:06:02.164+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:06:02.182 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:06:02.182 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:06:02.203 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:06:02.203 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:06:02.218 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:06:02.219 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:06:02.219 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:06:02.219 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:06:02.219 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:06:02.233 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:06:02.267 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:06:02.267+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:06:02.368 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:06:02.367+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:06:02.390 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:06:02.402 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:06:02.403 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:06:02.403 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:06:02.403 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:06:02.403 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.403 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1646 3.25 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:06:02.403 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:06:02.403 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 89.324440761000005, 2024-09-12T00:06:02.403 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030091884999999999, 2024-09-12T00:06:02.403 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.403 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.403 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.403 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.404 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.404 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.404 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1646 2024-09-12T00:06:02.404 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.404 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.404 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.404 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.404 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:06:02.404 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.404 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.404 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.404 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.404 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:06:02.405 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.405 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.405 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.405 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077113+0000", 2024-09-12T00:06:02.405 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0186e-05 2024-09-12T00:06:02.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.405 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.405 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.405 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084821+0000", 2024-09-12T00:06:02.405 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077083450000000001 2024-09-12T00:06:02.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.405 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.405 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.406 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084857+0000", 2024-09-12T00:06:02.406 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6245000000000003e-05 2024-09-12T00:06:02.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.406 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.406 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.406 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084900+0000", 2024-09-12T00:06:02.406 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2369e-05 2024-09-12T00:06:02.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.406 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.406 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.406 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085058+0000", 2024-09-12T00:06:02.406 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015858199999999999 2024-09-12T00:06:02.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.406 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.407 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.407 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085307+0000", 2024-09-12T00:06:02.407 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024867999999999998 2024-09-12T00:06:02.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.407 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.407 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:06:02.407 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086107+0000", 2024-09-12T00:06:02.407 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00080040099999999996 2024-09-12T00:06:02.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.407 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.407 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:02.407 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.100477+0000", 2024-09-12T00:06:02.407 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014369508 2024-09-12T00:06:02.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.408 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.408 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:02.408 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107016+0000", 2024-09-12T00:06:02.408 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006538894 2024-09-12T00:06:02.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.408 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.408 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.408 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107121+0000", 2024-09-12T00:06:02.408 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105284 2024-09-12T00:06:02.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.408 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.408 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.408 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107194+0000", 2024-09-12T00:06:02.408 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3391000000000003e-05 2024-09-12T00:06:02.409 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.409 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.409 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.409 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.409 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.409 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2718 3.4 3:20fe36bb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:06:02.409 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:06:02.409 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 74.615962603, 2024-09-12T00:06:02.409 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027867928, 2024-09-12T00:06:02.409 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.409 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.409 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.409 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.410 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.410 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.410 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2718 2024-09-12T00:06:02.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.410 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.410 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.410 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.410 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:06:02.410 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.410 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.410 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.410 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:06:02.410 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.411 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.411 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.411 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785584+0000", 2024-09-12T00:06:02.411 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.056e-06 2024-09-12T00:06:02.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.411 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.411 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.411 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792023+0000", 2024-09-12T00:06:02.411 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064398069999999996 2024-09-12T00:06:02.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.411 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.411 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.411 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792058+0000", 2024-09-12T00:06:02.411 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5018000000000003e-05 2024-09-12T00:06:02.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.412 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.412 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.412 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792078+0000", 2024-09-12T00:06:02.412 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9862000000000001e-05 2024-09-12T00:06:02.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.412 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.412 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.412 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792248+0000", 2024-09-12T00:06:02.412 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017006399999999999 2024-09-12T00:06:02.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.412 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.412 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.412 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792660+0000", 2024-09-12T00:06:02.413 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041189500000000001 2024-09-12T00:06:02.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.413 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.413 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:02.413 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793081+0000", 2024-09-12T00:06:02.413 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000420395 2024-09-12T00:06:02.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.413 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.413 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:02.413 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808422+0000", 2024-09-12T00:06:02.413 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015341626000000001 2024-09-12T00:06:02.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.413 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.413 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:02.414 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813192+0000", 2024-09-12T00:06:02.414 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047701799999999997 2024-09-12T00:06:02.414 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.414 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.414 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.414 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813339+0000", 2024-09-12T00:06:02.414 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014643800000000001 2024-09-12T00:06:02.414 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.414 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.414 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.414 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813449+0000", 2024-09-12T00:06:02.414 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010958700000000001 2024-09-12T00:06:02.414 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.414 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.415 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.415 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.415 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2736 3.25 3:a750a681:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:06:02.415 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:06:02.415 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 74.426190241, 2024-09-12T00:06:02.415 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025701234999999999, 2024-09-12T00:06:02.415 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.415 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.415 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.415 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.415 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.415 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.416 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2736 2024-09-12T00:06:02.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.416 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.416 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.416 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.416 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:06:02.416 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.416 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.416 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.416 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:06:02.416 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.417 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.417 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.417 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975357+0000", 2024-09-12T00:06:02.417 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9389999999999999e-06 2024-09-12T00:06:02.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.417 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.417 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.417 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979365+0000", 2024-09-12T00:06:02.417 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040076679999999998 2024-09-12T00:06:02.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.417 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.417 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.417 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979402+0000", 2024-09-12T00:06:02.417 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7557e-05 2024-09-12T00:06:02.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.418 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.418 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.418 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979419+0000", 2024-09-12T00:06:02.418 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7203000000000001e-05 2024-09-12T00:06:02.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.418 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.418 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.418 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979543+0000", 2024-09-12T00:06:02.418 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000123423 2024-09-12T00:06:02.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.418 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.418 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.418 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979784+0000", 2024-09-12T00:06:02.419 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024097800000000001 2024-09-12T00:06:02.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.419 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.419 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:06:02.419 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980013+0000", 2024-09-12T00:06:02.419 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022881999999999999 2024-09-12T00:06:02.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.419 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.419 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:02.419 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.999860+0000", 2024-09-12T00:06:02.419 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019847908000000001 2024-09-12T00:06:02.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.419 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.419 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:02.420 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000741+0000", 2024-09-12T00:06:02.420 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00088041499999999995 2024-09-12T00:06:02.420 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.420 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.420 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.420 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000915+0000", 2024-09-12T00:06:02.420 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017460300000000001 2024-09-12T00:06:02.420 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.420 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.420 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.420 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.001054+0000", 2024-09-12T00:06:02.420 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013872099999999999 2024-09-12T00:06:02.420 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.421 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.421 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.421 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.421 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.421 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2964 3.24 3:26c83ec0:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:02.421 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:06:02.421 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 42.396128439000002, 2024-09-12T00:06:02.421 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028979713000000001, 2024-09-12T00:06:02.421 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.421 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.421 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.421 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.421 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.421 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.422 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2964 2024-09-12T00:06:02.422 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.422 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.422 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.422 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.422 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:06:02.422 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.422 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.422 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.422 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.422 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:06:02.422 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.422 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.422 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.423 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.423 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005417+0000", 2024-09-12T00:06:02.423 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2450000000000001e-06 2024-09-12T00:06:02.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.423 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.423 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010885+0000", 2024-09-12T00:06:02.423 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054684809999999999 2024-09-12T00:06:02.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.423 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.423 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010901+0000", 2024-09-12T00:06:02.423 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5097e-05 2024-09-12T00:06:02.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.424 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.424 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010908+0000", 2024-09-12T00:06:02.424 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7419999999999997e-06 2024-09-12T00:06:02.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.424 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.424 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.424 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010968+0000", 2024-09-12T00:06:02.424 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.9837000000000003e-05 2024-09-12T00:06:02.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.424 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.424 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.424 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011082+0000", 2024-09-12T00:06:02.424 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011357399999999999 2024-09-12T00:06:02.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.425 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.425 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:06:02.425 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011174+0000", 2024-09-12T00:06:02.425 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2703999999999999e-05 2024-09-12T00:06:02.425 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.425 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.425 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:02.425 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.021639+0000", 2024-09-12T00:06:02.425 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010464641 2024-09-12T00:06:02.425 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.425 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.425 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:02.425 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034210+0000", 2024-09-12T00:06:02.425 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012570463 2024-09-12T00:06:02.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.426 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.426 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.426 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034300+0000", 2024-09-12T00:06:02.426 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0691000000000003e-05 2024-09-12T00:06:02.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.426 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.426 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.426 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034394+0000", 2024-09-12T00:06:02.426 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4238000000000001e-05 2024-09-12T00:06:02.426 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.426 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.426 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.427 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.427 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3052 3.32 3:4d6db9ea:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:02.427 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:06:02.427 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 41.421881812999999, 2024-09-12T00:06:02.427 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028091277000000001, 2024-09-12T00:06:02.427 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.427 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.427 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.427 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.427 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.427 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.427 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3052 2024-09-12T00:06:02.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.427 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.428 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.428 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.428 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:06:02.428 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.428 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.428 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.428 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.428 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:06:02.428 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.428 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.428 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.428 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.428 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979664+0000", 2024-09-12T00:06:02.428 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:06:02.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.429 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.429 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.429 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986918+0000", 2024-09-12T00:06:02.429 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0072537110000000004 2024-09-12T00:06:02.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.429 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.429 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.429 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986956+0000", 2024-09-12T00:06:02.429 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8111999999999997e-05 2024-09-12T00:06:02.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.429 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.429 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.430 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986975+0000", 2024-09-12T00:06:02.430 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9245999999999998e-05 2024-09-12T00:06:02.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.430 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.430 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.430 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987159+0000", 2024-09-12T00:06:02.430 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000183828 2024-09-12T00:06:02.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.430 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.430 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.430 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987552+0000", 2024-09-12T00:06:02.430 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039349699999999998 2024-09-12T00:06:02.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.430 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.431 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:06:02.431 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987943+0000", 2024-09-12T00:06:02.431 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000390579 2024-09-12T00:06:02.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.431 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.431 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:02.431 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.999384+0000", 2024-09-12T00:06:02.431 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011441563 2024-09-12T00:06:02.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.431 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.431 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:02.431 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007634+0000", 2024-09-12T00:06:02.431 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082496240000000005 2024-09-12T00:06:02.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.432 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.432 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.432 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007699+0000", 2024-09-12T00:06:02.432 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5089e-05 2024-09-12T00:06:02.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.432 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.432 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.432 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007753+0000", 2024-09-12T00:06:02.432 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3588000000000003e-05 2024-09-12T00:06:02.432 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.432 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.432 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.432 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.433 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3064 3.4 3:209c6609:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:02.433 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:06:02.433 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 41.289566534999999, 2024-09-12T00:06:02.433 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024628305999999999, 2024-09-12T00:06:02.433 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.433 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.433 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.433 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.433 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.434 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.434 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3064 2024-09-12T00:06:02.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.434 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.434 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.434 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.434 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:06:02.434 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.434 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.434 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.434 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111977+0000", 2024-09-12T00:06:02.434 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.435 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.435 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.435 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.111980+0000", 2024-09-12T00:06:02.435 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.005e-06 2024-09-12T00:06:02.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.435 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.435 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.435 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116464+0000", 2024-09-12T00:06:02.435 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044839210000000001 2024-09-12T00:06:02.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.435 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.435 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.435 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116490+0000", 2024-09-12T00:06:02.435 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6690999999999999e-05 2024-09-12T00:06:02.436 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.436 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.436 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.436 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116504+0000", 2024-09-12T00:06:02.436 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4109e-05 2024-09-12T00:06:02.436 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.436 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.436 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.436 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116639+0000", 2024-09-12T00:06:02.436 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013427 2024-09-12T00:06:02.436 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.436 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.436 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.437 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.116931+0000", 2024-09-12T00:06:02.437 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000292603 2024-09-12T00:06:02.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.437 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.437 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:02.437 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.117174+0000", 2024-09-12T00:06:02.437 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024240700000000001 2024-09-12T00:06:02.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.437 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.437 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:02.437 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126449+0000", 2024-09-12T00:06:02.438 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0092748699999999993 2024-09-12T00:06:02.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.438 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.438 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:02.438 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136438+0000", 2024-09-12T00:06:02.438 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099898539999999994 2024-09-12T00:06:02.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.438 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.438 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.438 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136532+0000", 2024-09-12T00:06:02.438 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3898000000000001e-05 2024-09-12T00:06:02.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.438 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.438 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.439 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.136605+0000", 2024-09-12T00:06:02.439 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.2677999999999998e-05 2024-09-12T00:06:02.439 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.439 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.439 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.439 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.439 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.439 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3125 3.12 3:495b0235:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:06:02.439 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:06:02.439 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 40.485772529999998, 2024-09-12T00:06:02.439 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030616648999999999, 2024-09-12T00:06:02.439 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.439 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.439 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.440 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.440 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.440 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.440 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3125 2024-09-12T00:06:02.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.440 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.440 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.440 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.440 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:06:02.440 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.440 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.440 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.440 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:06:02.441 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.441 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.441 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.441 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915773+0000", 2024-09-12T00:06:02.441 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2800000000000002e-06 2024-09-12T00:06:02.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.441 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.441 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.441 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919856+0000", 2024-09-12T00:06:02.441 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004082713 2024-09-12T00:06:02.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.441 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.441 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.442 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919879+0000", 2024-09-12T00:06:02.442 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3782e-05 2024-09-12T00:06:02.442 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.442 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.442 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.442 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919891+0000", 2024-09-12T00:06:02.442 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1440000000000001e-05 2024-09-12T00:06:02.442 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.442 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.442 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.442 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920037+0000", 2024-09-12T00:06:02.442 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014562700000000001 2024-09-12T00:06:02.442 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.442 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.442 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.443 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920280+0000", 2024-09-12T00:06:02.443 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000243274 2024-09-12T00:06:02.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.443 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.443 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:06:02.443 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920527+0000", 2024-09-12T00:06:02.443 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024692699999999998 2024-09-12T00:06:02.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.443 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.443 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:02.443 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.932485+0000", 2024-09-12T00:06:02.443 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011957857000000001 2024-09-12T00:06:02.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.444 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.444 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:02.444 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946197+0000", 2024-09-12T00:06:02.444 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013712436999999999 2024-09-12T00:06:02.444 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.444 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.444 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.444 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946305+0000", 2024-09-12T00:06:02.444 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000107914 2024-09-12T00:06:02.444 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.444 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.444 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.444 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946387+0000", 2024-09-12T00:06:02.444 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2398000000000006e-05 2024-09-12T00:06:02.445 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.445 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.445 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.445 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.445 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.445 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3134 3.24 3:2525a955:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:06:02.445 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:06:02.445 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 40.3616958, 2024-09-12T00:06:02.445 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025606806999999999, 2024-09-12T00:06:02.445 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.445 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.445 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.445 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.445 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.446 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.446 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3134 2024-09-12T00:06:02.446 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.446 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.446 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.446 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.446 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:06:02.446 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.446 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.446 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.446 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.446 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039847+0000", 2024-09-12T00:06:02.446 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.447 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.447 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.447 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.039850+0000", 2024-09-12T00:06:02.447 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9780000000000001e-06 2024-09-12T00:06:02.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.447 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.447 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.447 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045256+0000", 2024-09-12T00:06:02.447 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054058129999999998 2024-09-12T00:06:02.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.447 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.447 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.447 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045284+0000", 2024-09-12T00:06:02.448 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8065e-05 2024-09-12T00:06:02.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.448 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.448 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045297+0000", 2024-09-12T00:06:02.448 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2788e-05 2024-09-12T00:06:02.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.448 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.448 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045378+0000", 2024-09-12T00:06:02.448 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.1079000000000001e-05 2024-09-12T00:06:02.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.448 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.449 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045530+0000", 2024-09-12T00:06:02.449 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015206099999999999 2024-09-12T00:06:02.449 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.449 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.449 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:06:02.449 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.045655+0000", 2024-09-12T00:06:02.449 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012525899999999999 2024-09-12T00:06:02.449 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.449 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.449 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:02.449 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.054817+0000", 2024-09-12T00:06:02.449 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0091611049999999992 2024-09-12T00:06:02.449 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.449 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.450 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:02.450 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065354+0000", 2024-09-12T00:06:02.450 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010537625 2024-09-12T00:06:02.450 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.450 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.450 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.450 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065410+0000", 2024-09-12T00:06:02.450 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6141999999999999e-05 2024-09-12T00:06:02.450 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.450 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.450 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.450 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:22.065454+0000", 2024-09-12T00:06:02.450 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3891999999999999e-05 2024-09-12T00:06:02.450 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.451 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.451 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.451 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.451 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3386 3.1 3:8071dd26:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:06:02.451 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.767011+0000", 2024-09-12T00:06:02.451 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 21.634532683, 2024-09-12T00:06:02.451 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.031756300000000001, 2024-09-12T00:06:02.451 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.451 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.451 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.451 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.451 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.451 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.452 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3386 2024-09-12T00:06:02.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.452 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.452 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.452 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.452 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.767011+0000", 2024-09-12T00:06:02.452 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.452 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.452 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.452 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.767011+0000", 2024-09-12T00:06:02.452 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.452 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.452 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.453 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.767014+0000", 2024-09-12T00:06:02.453 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0429999999999999e-06 2024-09-12T00:06:02.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.453 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.453 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.453 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775360+0000", 2024-09-12T00:06:02.453 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0083463740000000002 2024-09-12T00:06:02.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.453 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.453 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.453 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775398+0000", 2024-09-12T00:06:02.453 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8376e-05 2024-09-12T00:06:02.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.453 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.454 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.454 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775415+0000", 2024-09-12T00:06:02.454 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6563e-05 2024-09-12T00:06:02.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.454 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.454 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.454 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775556+0000", 2024-09-12T00:06:02.454 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000140865 2024-09-12T00:06:02.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.454 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.454 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.454 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775819+0000", 2024-09-12T00:06:02.454 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000262842 2024-09-12T00:06:02.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.455 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.455 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:02.455 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.776048+0000", 2024-09-12T00:06:02.455 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000229399 2024-09-12T00:06:02.455 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.455 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.455 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:02.455 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.791048+0000", 2024-09-12T00:06:02.455 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015000503 2024-09-12T00:06:02.455 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.455 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.455 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:02.455 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.798597+0000", 2024-09-12T00:06:02.455 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0075482409999999998 2024-09-12T00:06:02.456 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.456 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.456 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.456 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.798690+0000", 2024-09-12T00:06:02.456 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3769000000000003e-05 2024-09-12T00:06:02.456 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.456 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.456 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.456 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.798767+0000", 2024-09-12T00:06:02.456 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6324999999999999e-05 2024-09-12T00:06:02.457 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.457 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.457 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.457 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.457 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3397 3.4 3:220517e3:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:06:02.457 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.890276+0000", 2024-09-12T00:06:02.457 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 21.511267675999999, 2024-09-12T00:06:02.457 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.02507564, 2024-09-12T00:06:02.457 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.457 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.457 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.457 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.458 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.458 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.458 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3397 2024-09-12T00:06:02.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.458 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.458 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.458 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.458 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.890276+0000", 2024-09-12T00:06:02.458 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.458 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.458 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.458 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.890276+0000", 2024-09-12T00:06:02.458 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.459 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.459 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.890281+0000", 2024-09-12T00:06:02.459 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.366e-06 2024-09-12T00:06:02.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.459 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.459 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.894729+0000", 2024-09-12T00:06:02.459 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044483320000000002 2024-09-12T00:06:02.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.459 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.459 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.894782+0000", 2024-09-12T00:06:02.460 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2445999999999999e-05 2024-09-12T00:06:02.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.460 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.460 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.894810+0000", 2024-09-12T00:06:02.460 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8126000000000001e-05 2024-09-12T00:06:02.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.460 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.460 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.894961+0000", 2024-09-12T00:06:02.460 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015165999999999999 2024-09-12T00:06:02.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.460 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.461 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.895228+0000", 2024-09-12T00:06:02.461 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00026675599999999999 2024-09-12T00:06:02.461 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.461 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.461 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:02.461 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.895478+0000", 2024-09-12T00:06:02.461 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025020199999999999 2024-09-12T00:06:02.461 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.461 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.461 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:02.461 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.913919+0000", 2024-09-12T00:06:02.461 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.018440096999999999 2024-09-12T00:06:02.461 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.461 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.462 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:02.462 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.915109+0000", 2024-09-12T00:06:02.462 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0011908660000000001 2024-09-12T00:06:02.462 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.462 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.462 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.462 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.915239+0000", 2024-09-12T00:06:02.462 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012928399999999999 2024-09-12T00:06:02.462 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.462 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.462 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.462 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.915351+0000", 2024-09-12T00:06:02.462 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011250499999999999 2024-09-12T00:06:02.462 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.463 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.463 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.463 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.463 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.463 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3398 3.12 3:4888914b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:06:02.463 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.904027+0000", 2024-09-12T00:06:02.463 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 21.497516084000001, 2024-09-12T00:06:02.463 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.029408179999999999, 2024-09-12T00:06:02.463 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.463 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.463 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.463 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.463 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.463 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.464 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3398 2024-09-12T00:06:02.464 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.464 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.464 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.464 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.464 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.904027+0000", 2024-09-12T00:06:02.464 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.464 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.464 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.464 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.464 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.904027+0000", 2024-09-12T00:06:02.464 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.464 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.464 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.465 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.465 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.904030+0000", 2024-09-12T00:06:02.465 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0529999999999998e-06 2024-09-12T00:06:02.465 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.465 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.465 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.465 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.910958+0000", 2024-09-12T00:06:02.465 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0069274849999999997 2024-09-12T00:06:02.465 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.465 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.465 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.465 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.910989+0000", 2024-09-12T00:06:02.465 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1752999999999999e-05 2024-09-12T00:06:02.465 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.466 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.466 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.466 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911006+0000", 2024-09-12T00:06:02.466 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6463000000000001e-05 2024-09-12T00:06:02.466 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.466 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.466 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.466 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911171+0000", 2024-09-12T00:06:02.466 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016481699999999999 2024-09-12T00:06:02.466 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.466 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.466 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.466 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911417+0000", 2024-09-12T00:06:02.466 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024629600000000001 2024-09-12T00:06:02.467 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.467 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.467 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:06:02.467 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911646+0000", 2024-09-12T00:06:02.467 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022906599999999999 2024-09-12T00:06:02.467 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.467 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.467 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:02.467 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.932777+0000", 2024-09-12T00:06:02.467 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021130906000000001 2024-09-12T00:06:02.467 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.467 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.467 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:02.467 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.933094+0000", 2024-09-12T00:06:02.467 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000317127 2024-09-12T00:06:02.468 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.468 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.468 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.468 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.933277+0000", 2024-09-12T00:06:02.468 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018257000000000001 2024-09-12T00:06:02.468 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.468 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.468 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.468 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.933435+0000", 2024-09-12T00:06:02.468 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015864399999999999 2024-09-12T00:06:02.468 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.468 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.468 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.468 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.469 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.469 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3401 3.20 e82/23 3:06d9612a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_28:head v 82'11, mlcod=76'9)", 2024-09-12T00:06:02.469 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.936564+0000", 2024-09-12T00:06:02.469 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 21.464979322000001, 2024-09-12T00:06:02.469 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.026227489999999999, 2024-09-12T00:06:02.469 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.469 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.469 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.469 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.469 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.469 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.469 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.936564+0000", 2024-09-12T00:06:02.469 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.469 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.470 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.470 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.470 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.936564+0000", 2024-09-12T00:06:02.470 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.470 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.470 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.470 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.470 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.936571+0000", 2024-09-12T00:06:02.470 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5959999999999998e-06 2024-09-12T00:06:02.470 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.470 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.470 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.470 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941597+0000", 2024-09-12T00:06:02.471 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0050253720000000002 2024-09-12T00:06:02.471 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.471 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.471 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.471 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941625+0000", 2024-09-12T00:06:02.471 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8564999999999998e-05 2024-09-12T00:06:02.471 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.471 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.471 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.471 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941640+0000", 2024-09-12T00:06:02.471 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4837e-05 2024-09-12T00:06:02.471 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.471 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.471 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.472 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941776+0000", 2024-09-12T00:06:02.472 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013623500000000001 2024-09-12T00:06:02.472 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.472 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.472 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.472 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941822+0000", 2024-09-12T00:06:02.472 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5513000000000003e-05 2024-09-12T00:06:02.472 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.472 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.472 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.472 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.962694+0000", 2024-09-12T00:06:02.472 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020871516999999999 2024-09-12T00:06:02.472 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.473 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.473 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.473 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.962791+0000", 2024-09-12T00:06:02.473 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7855000000000004e-05 2024-09-12T00:06:02.473 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.473 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.473 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.473 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.473 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.473 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3670 3.5 e83/23 3:a3029b32:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_287:head v 83'13, mlcod=83'11)", 2024-09-12T00:06:02.473 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:43.823062+0000", 2024-09-12T00:06:02.473 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 18.578481366999998, 2024-09-12T00:06:02.473 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028976041000000001, 2024-09-12T00:06:02.474 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.474 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.474 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.474 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.474 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.474 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.474 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.823062+0000", 2024-09-12T00:06:02.474 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.474 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.474 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.474 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.474 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.823062+0000", 2024-09-12T00:06:02.474 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.474 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.475 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.475 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.475 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.823068+0000", 2024-09-12T00:06:02.475 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6250000000000001e-06 2024-09-12T00:06:02.475 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.475 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.475 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.475 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.826863+0000", 2024-09-12T00:06:02.475 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037945880000000002 2024-09-12T00:06:02.475 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.475 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.475 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.475 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.826885+0000", 2024-09-12T00:06:02.475 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1515e-05 2024-09-12T00:06:02.476 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.476 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.476 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.476 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.826894+0000", 2024-09-12T00:06:02.476 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4040000000000001e-06 2024-09-12T00:06:02.476 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.476 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.476 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.476 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.827014+0000", 2024-09-12T00:06:02.476 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120238 2024-09-12T00:06:02.476 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.476 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.476 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.476 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.827056+0000", 2024-09-12T00:06:02.477 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2129000000000003e-05 2024-09-12T00:06:02.477 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.477 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.477 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.477 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.851882+0000", 2024-09-12T00:06:02.477 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024825538000000001 2024-09-12T00:06:02.477 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.477 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.477 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.477 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.852038+0000", 2024-09-12T00:06:02.477 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015600400000000001 2024-09-12T00:06:02.477 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.477 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.477 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.477 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.478 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.478 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3681 3.12 3:481fb92d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_298:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:02.478 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:43.987522+0000", 2024-09-12T00:06:02.478 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 18.414020764, 2024-09-12T00:06:02.478 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.029063802999999999, 2024-09-12T00:06:02.478 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.478 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.478 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.478 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.478 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.478 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.478 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3681 2024-09-12T00:06:02.478 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.478 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.479 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.479 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.479 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.987522+0000", 2024-09-12T00:06:02.479 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.479 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.479 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.479 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.479 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.987522+0000", 2024-09-12T00:06:02.479 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.479 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.479 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.479 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.479 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.987527+0000", 2024-09-12T00:06:02.479 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5730000000000001e-06 2024-09-12T00:06:02.480 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.480 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.480 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.480 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.992931+0000", 2024-09-12T00:06:02.480 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054043950000000002 2024-09-12T00:06:02.480 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.480 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.480 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.480 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.992974+0000", 2024-09-12T00:06:02.480 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2542e-05 2024-09-12T00:06:02.480 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.480 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.480 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.480 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.992999+0000", 2024-09-12T00:06:02.481 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5113000000000002e-05 2024-09-12T00:06:02.481 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.481 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.481 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.481 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.993146+0000", 2024-09-12T00:06:02.481 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014703900000000001 2024-09-12T00:06:02.481 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.481 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.481 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.481 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.993270+0000", 2024-09-12T00:06:02.481 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012376100000000001 2024-09-12T00:06:02.481 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.481 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.481 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:06:02.481 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.993433+0000", 2024-09-12T00:06:02.482 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016290900000000001 2024-09-12T00:06:02.482 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.482 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.482 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:02.482 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.003341+0000", 2024-09-12T00:06:02.482 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099082289999999993 2024-09-12T00:06:02.482 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.482 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.482 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:02.482 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.016476+0000", 2024-09-12T00:06:02.482 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013134616999999999 2024-09-12T00:06:02.482 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.482 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.482 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.483 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.016528+0000", 2024-09-12T00:06:02.483 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2410000000000001e-05 2024-09-12T00:06:02.483 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.483 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.483 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.483 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.016586+0000", 2024-09-12T00:06:02.483 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8214999999999997e-05 2024-09-12T00:06:02.483 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.483 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.483 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.483 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.483 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.483 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3714 3.32 3:4e60a7f6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_331:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:02.483 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.707821+0000", 2024-09-12T00:06:02.484 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.693721791000002, 2024-09-12T00:06:02.484 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025583348999999998, 2024-09-12T00:06:02.484 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.484 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.484 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.484 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.484 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.484 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.484 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3714 2024-09-12T00:06:02.484 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.484 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.484 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.484 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.485 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.707821+0000", 2024-09-12T00:06:02.485 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.485 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.485 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.485 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.485 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.707821+0000", 2024-09-12T00:06:02.485 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.485 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.485 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.485 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.485 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.707867+0000", 2024-09-12T00:06:02.485 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5429000000000002e-05 2024-09-12T00:06:02.485 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.485 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.486 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.486 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715020+0000", 2024-09-12T00:06:02.486 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0071533580000000003 2024-09-12T00:06:02.486 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.486 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.486 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.486 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715058+0000", 2024-09-12T00:06:02.486 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7823e-05 2024-09-12T00:06:02.486 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.486 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.486 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.486 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715075+0000", 2024-09-12T00:06:02.486 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7122999999999999e-05 2024-09-12T00:06:02.486 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.486 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.487 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.487 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715275+0000", 2024-09-12T00:06:02.487 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00020033 2024-09-12T00:06:02.487 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.487 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.487 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.487 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715526+0000", 2024-09-12T00:06:02.487 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025033500000000002 2024-09-12T00:06:02.487 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.487 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.487 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:06:02.487 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.715760+0000", 2024-09-12T00:06:02.487 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023411600000000001 2024-09-12T00:06:02.487 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.488 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.488 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:02.488 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.731072+0000", 2024-09-12T00:06:02.488 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015311671000000001 2024-09-12T00:06:02.488 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.488 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.488 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:02.488 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.733084+0000", 2024-09-12T00:06:02.488 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0020124299999999999 2024-09-12T00:06:02.488 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.488 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.488 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.488 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.733257+0000", 2024-09-12T00:06:02.489 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017338400000000001 2024-09-12T00:06:02.489 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.489 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.489 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.489 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.733405+0000", 2024-09-12T00:06:02.489 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014735 2024-09-12T00:06:02.489 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.489 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.489 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.489 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.489 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.489 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3726 3.33 3:cd6e0a10:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_343:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:02.489 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.865044+0000", 2024-09-12T00:06:02.489 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.536498798, 2024-09-12T00:06:02.490 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027130072000000002, 2024-09-12T00:06:02.490 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.490 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.490 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.490 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.490 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.490 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.490 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3726 2024-09-12T00:06:02.490 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.490 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.490 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.490 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.490 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.865044+0000", 2024-09-12T00:06:02.490 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.490 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.491 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.491 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.491 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.865044+0000", 2024-09-12T00:06:02.491 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.491 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.491 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.491 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.865048+0000", 2024-09-12T00:06:02.491 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1669999999999999e-06 2024-09-12T00:06:02.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.491 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.491 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.491 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869155+0000", 2024-09-12T00:06:02.491 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041073020000000002 2024-09-12T00:06:02.492 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.492 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.492 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.492 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869190+0000", 2024-09-12T00:06:02.492 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5113000000000001e-05 2024-09-12T00:06:02.492 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.492 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.492 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.492 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869207+0000", 2024-09-12T00:06:02.492 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6943e-05 2024-09-12T00:06:02.492 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.492 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.492 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.492 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869388+0000", 2024-09-12T00:06:02.493 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018116000000000001 2024-09-12T00:06:02.493 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.493 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.493 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.493 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869776+0000", 2024-09-12T00:06:02.493 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00038828099999999998 2024-09-12T00:06:02.493 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.493 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.493 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:06:02.493 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.870191+0000", 2024-09-12T00:06:02.493 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041471599999999998 2024-09-12T00:06:02.493 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.493 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.493 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:02.493 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.881480+0000", 2024-09-12T00:06:02.494 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0112887 2024-09-12T00:06:02.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.494 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.494 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:02.494 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.891979+0000", 2024-09-12T00:06:02.494 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010499377000000001 2024-09-12T00:06:02.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.494 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.494 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.494 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.892068+0000", 2024-09-12T00:06:02.494 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8374000000000005e-05 2024-09-12T00:06:02.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.494 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.494 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.495 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.892174+0000", 2024-09-12T00:06:02.495 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000106939 2024-09-12T00:06:02.495 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.495 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.495 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.495 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.495 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3732 3.25 3:a4e42410:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_349:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:02.495 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.935722+0000", 2024-09-12T00:06:02.495 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.465820854, 2024-09-12T00:06:02.495 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025382307, 2024-09-12T00:06:02.495 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.495 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.495 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.495 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.496 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.496 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.496 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3732 2024-09-12T00:06:02.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.496 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.496 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.496 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.496 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.935722+0000", 2024-09-12T00:06:02.496 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.496 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.496 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.496 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.935722+0000", 2024-09-12T00:06:02.496 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.497 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.497 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.497 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.501 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.935725+0000", 2024-09-12T00:06:02.501 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.943e-06 2024-09-12T00:06:02.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.501 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.501 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.501 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.940989+0000", 2024-09-12T00:06:02.501 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0052639799999999997 2024-09-12T00:06:02.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.501 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.501 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.501 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.941045+0000", 2024-09-12T00:06:02.501 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.6159000000000002e-05 2024-09-12T00:06:02.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.502 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.502 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.502 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.941064+0000", 2024-09-12T00:06:02.502 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8085999999999999e-05 2024-09-12T00:06:02.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.502 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.502 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.502 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.941195+0000", 2024-09-12T00:06:02.502 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000131125 2024-09-12T00:06:02.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.502 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.502 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.502 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.941435+0000", 2024-09-12T00:06:02.502 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024035899999999999 2024-09-12T00:06:02.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.503 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.503 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:06:02.503 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.941654+0000", 2024-09-12T00:06:02.503 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021882999999999999 2024-09-12T00:06:02.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.503 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.503 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:02.503 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.955258+0000", 2024-09-12T00:06:02.503 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013604171 2024-09-12T00:06:02.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.503 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.503 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:02.503 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.960941+0000", 2024-09-12T00:06:02.504 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0056832899999999997 2024-09-12T00:06:02.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.504 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.504 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.504 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.961030+0000", 2024-09-12T00:06:02.504 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8595000000000001e-05 2024-09-12T00:06:02.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.504 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.504 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.504 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.961105+0000", 2024-09-12T00:06:02.504 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4769000000000002e-05 2024-09-12T00:06:02.504 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.504 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.504 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.505 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.505 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3750 3.4 3:205ed86b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_367:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:02.505 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.141436+0000", 2024-09-12T00:06:02.505 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.260106873000002, 2024-09-12T00:06:02.505 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025245500000000001, 2024-09-12T00:06:02.505 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.505 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.505 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.505 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.505 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.505 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.505 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3750 2024-09-12T00:06:02.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.506 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.506 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.506 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.506 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.141436+0000", 2024-09-12T00:06:02.506 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.506 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.506 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.506 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.506 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.141436+0000", 2024-09-12T00:06:02.506 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.506 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.506 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.506 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.507 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.141440+0000", 2024-09-12T00:06:02.507 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5939999999999998e-06 2024-09-12T00:06:02.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.507 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.507 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.507 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.145505+0000", 2024-09-12T00:06:02.507 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040646160000000001 2024-09-12T00:06:02.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.507 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.507 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.507 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.145541+0000", 2024-09-12T00:06:02.507 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6508999999999999e-05 2024-09-12T00:06:02.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.507 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.507 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.508 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.145559+0000", 2024-09-12T00:06:02.508 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7853e-05 2024-09-12T00:06:02.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.508 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.508 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.508 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.145724+0000", 2024-09-12T00:06:02.508 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016462099999999999 2024-09-12T00:06:02.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.508 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.508 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.508 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.146114+0000", 2024-09-12T00:06:02.508 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039085699999999999 2024-09-12T00:06:02.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.508 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.509 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:02.509 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.146533+0000", 2024-09-12T00:06:02.509 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041889 2024-09-12T00:06:02.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.509 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.509 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:02.509 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.165996+0000", 2024-09-12T00:06:02.509 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019462461 2024-09-12T00:06:02.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.509 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.509 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:02.509 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.166514+0000", 2024-09-12T00:06:02.509 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00051867799999999996 2024-09-12T00:06:02.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.510 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.510 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.510 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.166614+0000", 2024-09-12T00:06:02.510 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.9538999999999997e-05 2024-09-12T00:06:02.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.510 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.510 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.510 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.166682+0000", 2024-09-12T00:06:02.510 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.7881999999999998e-05 2024-09-12T00:06:02.510 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.510 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.510 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.510 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.510 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3768 3.25 3:a5893d4d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_385:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:02.511 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.338740+0000", 2024-09-12T00:06:02.511 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.062802911999999, 2024-09-12T00:06:02.511 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025891451999999999, 2024-09-12T00:06:02.511 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.511 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.511 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.511 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.511 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.511 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.511 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3768 2024-09-12T00:06:02.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.511 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.511 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.511 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.512 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.338740+0000", 2024-09-12T00:06:02.512 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.512 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.512 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.338740+0000", 2024-09-12T00:06:02.512 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.512 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.512 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.338744+0000", 2024-09-12T00:06:02.512 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1470000000000003e-06 2024-09-12T00:06:02.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.513 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.513 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343258+0000", 2024-09-12T00:06:02.513 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045136880000000001 2024-09-12T00:06:02.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.513 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.513 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.513 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343292+0000", 2024-09-12T00:06:02.513 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3893000000000002e-05 2024-09-12T00:06:02.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.513 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.513 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.513 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343337+0000", 2024-09-12T00:06:02.513 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4699e-05 2024-09-12T00:06:02.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.513 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.514 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.514 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343453+0000", 2024-09-12T00:06:02.514 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000116272 2024-09-12T00:06:02.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.514 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.514 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.514 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343770+0000", 2024-09-12T00:06:02.514 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00031750799999999998 2024-09-12T00:06:02.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.514 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.514 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:06:02.514 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343992+0000", 2024-09-12T00:06:02.514 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000221986 2024-09-12T00:06:02.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.515 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.515 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:02.515 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.355234+0000", 2024-09-12T00:06:02.515 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011241637000000001 2024-09-12T00:06:02.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.515 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.515 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:02.515 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.364420+0000", 2024-09-12T00:06:02.515 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0091854320000000003 2024-09-12T00:06:02.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.515 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.515 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.515 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.364514+0000", 2024-09-12T00:06:02.516 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4492000000000003e-05 2024-09-12T00:06:02.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.516 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.516 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.516 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.364632+0000", 2024-09-12T00:06:02.516 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117698 2024-09-12T00:06:02.516 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.516 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.516 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.516 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.516 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3791 3.4 3:2186e625:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_408:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:02.516 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.609529+0000", 2024-09-12T00:06:02.516 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 16.79201411, 2024-09-12T00:06:02.517 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.031252178999999998, 2024-09-12T00:06:02.517 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.517 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.517 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.517 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.517 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.517 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.517 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3791 2024-09-12T00:06:02.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.517 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.517 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.517 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.609529+0000", 2024-09-12T00:06:02.517 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.518 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.518 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.518 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.609529+0000", 2024-09-12T00:06:02.518 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.518 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.518 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.518 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.609532+0000", 2024-09-12T00:06:02.518 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3230000000000002e-06 2024-09-12T00:06:02.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.518 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.518 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.518 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.613514+0000", 2024-09-12T00:06:02.518 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039820439999999997 2024-09-12T00:06:02.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.519 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.519 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.519 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.613550+0000", 2024-09-12T00:06:02.519 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5821999999999997e-05 2024-09-12T00:06:02.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.519 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.519 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.519 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.613568+0000", 2024-09-12T00:06:02.519 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7363e-05 2024-09-12T00:06:02.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.519 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.519 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.519 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.613738+0000", 2024-09-12T00:06:02.519 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017081400000000001 2024-09-12T00:06:02.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.520 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.520 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.614134+0000", 2024-09-12T00:06:02.520 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000395454 2024-09-12T00:06:02.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.520 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:02.520 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.614529+0000", 2024-09-12T00:06:02.520 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039467300000000001 2024-09-12T00:06:02.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.520 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:02.520 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.632368+0000", 2024-09-12T00:06:02.521 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017839482 2024-09-12T00:06:02.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.521 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.521 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:02.521 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.640584+0000", 2024-09-12T00:06:02.521 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082160700000000007 2024-09-12T00:06:02.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.521 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.521 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.521 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.640694+0000", 2024-09-12T00:06:02.521 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109782 2024-09-12T00:06:02.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.521 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.521 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.522 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.640781+0000", 2024-09-12T00:06:02.522 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7352e-05 2024-09-12T00:06:02.522 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.522 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.522 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.522 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.522 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.522 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:06:02.524 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:06:02.524 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:06:02.524+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:06:02.624 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:06:02.623+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:06:02.696 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:06:02.697 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:06:02.697 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:06:02.697 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:06:02.711 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:06:02.725 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:06:02.723+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:06:02.826 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:06:02.827+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:06:02.832 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:06:02.832 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:06:02.833 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:06:02.833 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:06:02.833 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:06:02.846 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:06:02.926 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:06:02.928+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:06:02.972 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:06:02.972 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:06:02.972 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:06:02.972 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:06:02.972 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.972 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:1646 3.25 e58/23 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head v 58'1, mlcod=0'0)", 2024-09-12T00:06:02.972 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:06:02.972 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 89.884184175000001, 2024-09-12T00:06:02.973 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020301987000000001, 2024-09-12T00:06:02.973 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.973 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.973 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.973 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.973 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.973 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:06:02.973 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.973 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.973 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:06:02.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.974 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.974 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086308+0000", 2024-09-12T00:06:02.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.95e-06 2024-09-12T00:06:02.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.974 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.974 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091174+0000", 2024-09-12T00:06:02.974 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048660559999999997 2024-09-12T00:06:02.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.974 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.975 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091218+0000", 2024-09-12T00:06:02.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4678999999999997e-05 2024-09-12T00:06:02.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.975 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.975 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091238+0000", 2024-09-12T00:06:02.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9839000000000001e-05 2024-09-12T00:06:02.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.975 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.975 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091396+0000", 2024-09-12T00:06:02.975 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000157396 2024-09-12T00:06:02.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.976 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.976 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091451+0000", 2024-09-12T00:06:02.976 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5547999999999997e-05 2024-09-12T00:06:02.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.976 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.976 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.976 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106474+0000", 2024-09-12T00:06:02.976 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015023287 2024-09-12T00:06:02.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.976 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.976 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.976 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106608+0000", 2024-09-12T00:06:02.976 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133232 2024-09-12T00:06:02.977 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.977 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.977 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.977 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2723 3.21 3:86535907:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:06:02.977 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:06:02.977 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 75.138336707999997, 2024-09-12T00:06:02.977 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021210407000000001, 2024-09-12T00:06:02.977 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.977 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.977 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.977 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.978 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.978 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.978 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2723 2024-09-12T00:06:02.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.978 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.978 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.978 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:06:02.978 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.978 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.978 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:06:02.978 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.979 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.979 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.979 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832157+0000", 2024-09-12T00:06:02.979 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3270000000000001e-06 2024-09-12T00:06:02.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.979 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.979 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.979 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837403+0000", 2024-09-12T00:06:02.979 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005246784 2024-09-12T00:06:02.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.979 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.979 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.980 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837439+0000", 2024-09-12T00:06:02.980 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5848e-05 2024-09-12T00:06:02.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.980 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.980 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837459+0000", 2024-09-12T00:06:02.980 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9585e-05 2024-09-12T00:06:02.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.980 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.980 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837574+0000", 2024-09-12T00:06:02.980 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000114917 2024-09-12T00:06:02.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.981 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.981 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837803+0000", 2024-09-12T00:06:02.981 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022967699999999999 2024-09-12T00:06:02.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.981 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:06:02.981 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838174+0000", 2024-09-12T00:06:02.981 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037083899999999998 2024-09-12T00:06:02.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.981 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:02.981 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848447+0000", 2024-09-12T00:06:02.981 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010272439 2024-09-12T00:06:02.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.982 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:02.982 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853191+0000", 2024-09-12T00:06:02.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047441109999999996 2024-09-12T00:06:02.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.982 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.982 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853292+0000", 2024-09-12T00:06:02.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000101474 2024-09-12T00:06:02.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.982 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.982 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853364+0000", 2024-09-12T00:06:02.982 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1406e-05 2024-09-12T00:06:02.983 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.983 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.983 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.983 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.983 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2971 3.2e 3:76f45d45:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:02.983 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:06:02.983 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 42.894622370999997, 2024-09-12T00:06:02.983 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022571213, 2024-09-12T00:06:02.983 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.983 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.983 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.983 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.983 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.984 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.984 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2971 2024-09-12T00:06:02.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.984 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.984 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.984 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.984 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:06:02.984 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.984 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.984 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.984 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:06:02.984 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.985 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.985 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075871+0000", 2024-09-12T00:06:02.985 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.467e-06 2024-09-12T00:06:02.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.985 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.985 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080307+0000", 2024-09-12T00:06:02.985 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044356359999999997 2024-09-12T00:06:02.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.985 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.985 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080346+0000", 2024-09-12T00:06:02.986 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9267999999999997e-05 2024-09-12T00:06:02.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.986 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.986 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080368+0000", 2024-09-12T00:06:02.986 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2603e-05 2024-09-12T00:06:02.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.986 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.986 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080489+0000", 2024-09-12T00:06:02.986 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0001209 2024-09-12T00:06:02.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.986 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.987 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080830+0000", 2024-09-12T00:06:02.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00034099 2024-09-12T00:06:02.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.987 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:02.987 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.081119+0000", 2024-09-12T00:06:02.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028860300000000001 2024-09-12T00:06:02.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.987 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:02.987 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.093241+0000", 2024-09-12T00:06:02.987 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012121609 2024-09-12T00:06:02.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.988 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:02.988 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098277+0000", 2024-09-12T00:06:02.988 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0050359710000000002 2024-09-12T00:06:02.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.988 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.988 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098366+0000", 2024-09-12T00:06:02.988 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9052000000000001e-05 2024-09-12T00:06:02.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.988 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.988 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098439+0000", 2024-09-12T00:06:02.988 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3114000000000005e-05 2024-09-12T00:06:02.989 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.989 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.989 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.989 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2996 3.21 3:872b1c12:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:02.989 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:06:02.989 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 42.619997634000001, 2024-09-12T00:06:02.989 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027562314000000001, 2024-09-12T00:06:02.990 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.990 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.990 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.990 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.990 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.990 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.990 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2996 2024-09-12T00:06:02.990 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.990 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.990 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.990 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.990 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:06:02.990 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.991 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.991 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.991 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:06:02.991 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.991 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.991 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.991 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350496+0000", 2024-09-12T00:06:02.991 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9160000000000003e-06 2024-09-12T00:06:02.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.992 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.992 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.992 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355187+0000", 2024-09-12T00:06:02.992 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046904989999999999 2024-09-12T00:06:02.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.992 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.992 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.992 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355223+0000", 2024-09-12T00:06:02.992 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6125999999999999e-05 2024-09-12T00:06:02.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.992 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.992 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.992 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355241+0000", 2024-09-12T00:06:02.992 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8686e-05 2024-09-12T00:06:02.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.993 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.993 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355373+0000", 2024-09-12T00:06:02.993 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013129299999999999 2024-09-12T00:06:02.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.993 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.993 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355619+0000", 2024-09-12T00:06:02.993 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024662700000000002 2024-09-12T00:06:02.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.993 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:06:02.993 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355855+0000", 2024-09-12T00:06:02.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023604299999999999 2024-09-12T00:06:02.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.994 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:02.994 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.367983+0000", 2024-09-12T00:06:02.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012127104999999999 2024-09-12T00:06:02.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.994 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:02.994 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377884+0000", 2024-09-12T00:06:02.994 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099013680000000007 2024-09-12T00:06:02.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.995 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:02.995 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377974+0000", 2024-09-12T00:06:02.995 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9932999999999994e-05 2024-09-12T00:06:02.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.995 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.995 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:02.995 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.378055+0000", 2024-09-12T00:06:02.995 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0717999999999995e-05 2024-09-12T00:06:02.995 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.995 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:02.995 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:02.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.995 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.995 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3030 3.2e 3:740afe3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:02.996 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:06:02.996 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 42.230667476000001, 2024-09-12T00:06:02.996 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.033756331000000001, 2024-09-12T00:06:02.996 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:02.996 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:02.996 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:02.996 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:02.996 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:02.996 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:02.996 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3030 2024-09-12T00:06:02.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.996 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:02.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.997 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:02.997 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:06:02.997 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.997 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.997 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:02.997 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:06:02.997 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:02.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.997 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.997 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:02.997 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739825+0000", 2024-09-12T00:06:02.997 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7920000000000001e-06 2024-09-12T00:06:02.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.998 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.998 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:02.998 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744217+0000", 2024-09-12T00:06:02.998 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043922529999999996 2024-09-12T00:06:02.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.998 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.998 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:02.998 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744243+0000", 2024-09-12T00:06:02.998 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5253e-05 2024-09-12T00:06:02.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.998 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.998 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:02.998 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744254+0000", 2024-09-12T00:06:02.998 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1430999999999999e-05 2024-09-12T00:06:02.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.999 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:02.999 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744325+0000", 2024-09-12T00:06:02.999 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1340999999999993e-05 2024-09-12T00:06:02.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.999 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:02.999 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744461+0000", 2024-09-12T00:06:02.999 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013531700000000001 2024-09-12T00:06:02.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:02.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:02.999 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:02.999 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744574+0000", 2024-09-12T00:06:03.000 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113513 2024-09-12T00:06:03.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.000 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.000 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:03.000 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.752813+0000", 2024-09-12T00:06:03.000 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082384750000000003 2024-09-12T00:06:03.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.000 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.000 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.000 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773444+0000", 2024-09-12T00:06:03.000 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020630773000000002 2024-09-12T00:06:03.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.001 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.001 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:03.001 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773510+0000", 2024-09-12T00:06:03.001 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6711000000000006e-05 2024-09-12T00:06:03.001 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.001 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.001 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:03.001 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773579+0000", 2024-09-12T00:06:03.001 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8472000000000004e-05 2024-09-12T00:06:03.001 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.001 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:03.001 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.001 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.001 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.002 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3039 3.2e 3:74587332:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:03.002 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:06:03.002 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 42.134987547999998, 2024-09-12T00:06:03.002 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.036215114, 2024-09-12T00:06:03.002 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:03.002 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:03.002 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.002 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:03.002 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:03.002 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.002 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3039 2024-09-12T00:06:03.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.002 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:03.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.003 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:03.003 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:06:03.003 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.003 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:03.003 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:06:03.003 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.003 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:03.003 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835507+0000", 2024-09-12T00:06:03.003 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6e-06 2024-09-12T00:06:03.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.004 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:03.004 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848930+0000", 2024-09-12T00:06:03.004 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013423242 2024-09-12T00:06:03.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.004 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:03.004 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848969+0000", 2024-09-12T00:06:03.004 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9270000000000002e-05 2024-09-12T00:06:03.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.004 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.004 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848991+0000", 2024-09-12T00:06:03.005 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1565000000000001e-05 2024-09-12T00:06:03.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.005 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:03.005 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849089+0000", 2024-09-12T00:06:03.005 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8408999999999999e-05 2024-09-12T00:06:03.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.005 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:03.005 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849518+0000", 2024-09-12T00:06:03.005 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042813900000000002 2024-09-12T00:06:03.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.005 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.005 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:03.006 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849897+0000", 2024-09-12T00:06:03.006 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037936600000000001 2024-09-12T00:06:03.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.006 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:03.006 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.858549+0000", 2024-09-12T00:06:03.006 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086520820000000002 2024-09-12T00:06:03.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.006 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.006 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871522+0000", 2024-09-12T00:06:03.006 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012973182999999999 2024-09-12T00:06:03.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.007 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:03.007 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871633+0000", 2024-09-12T00:06:03.007 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011085 2024-09-12T00:06:03.007 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.007 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.007 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:03.007 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871717+0000", 2024-09-12T00:06:03.007 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.4407999999999996e-05 2024-09-12T00:06:03.007 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.007 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:03.007 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.007 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.007 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.007 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3050 3.b 3:d26f7141:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:03.008 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:06:03.008 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 42.013375291999999, 2024-09-12T00:06:03.008 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022896481999999999, 2024-09-12T00:06:03.008 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:03.008 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:03.008 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.008 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:03.008 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:03.008 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.008 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3050 2024-09-12T00:06:03.008 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.008 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:03.008 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.008 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:03.009 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:06:03.009 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.009 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.009 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.009 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:03.009 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:06:03.009 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.009 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.009 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.010 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:03.010 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957117+0000", 2024-09-12T00:06:03.010 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7e-06 2024-09-12T00:06:03.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.010 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.010 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:03.010 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961673+0000", 2024-09-12T00:06:03.010 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045558059999999999 2024-09-12T00:06:03.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.010 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.010 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:03.010 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961698+0000", 2024-09-12T00:06:03.010 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5017000000000001e-05 2024-09-12T00:06:03.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.011 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.011 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.011 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961710+0000", 2024-09-12T00:06:03.011 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1963999999999999e-05 2024-09-12T00:06:03.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.011 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.011 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:03.011 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961785+0000", 2024-09-12T00:06:03.011 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5153000000000004e-05 2024-09-12T00:06:03.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.011 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.011 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:03.011 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961926+0000", 2024-09-12T00:06:03.011 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000141194 2024-09-12T00:06:03.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.012 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:03.012 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.962055+0000", 2024-09-12T00:06:03.012 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012882400000000001 2024-09-12T00:06:03.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.012 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:03.012 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.970716+0000", 2024-09-12T00:06:03.012 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086603610000000001 2024-09-12T00:06:03.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.012 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.012 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979700+0000", 2024-09-12T00:06:03.013 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.008984054 2024-09-12T00:06:03.013 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.013 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.013 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:03.013 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979884+0000", 2024-09-12T00:06:03.013 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184215 2024-09-12T00:06:03.013 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.013 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.013 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:03.013 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.980011+0000", 2024-09-12T00:06:03.013 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012719399999999999 2024-09-12T00:06:03.013 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.013 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:03.013 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.014 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.014 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.014 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3065 3.b 3:d10bf58d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:03.014 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:06:03.014 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 41.848427672, 2024-09-12T00:06:03.014 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021843261999999999, 2024-09-12T00:06:03.014 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:03.014 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:03.014 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.014 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:03.014 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:03.014 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.014 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3065 2024-09-12T00:06:03.015 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.015 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:03.015 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.015 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:03.015 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:06:03.015 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.015 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.015 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.015 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:03.015 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:06:03.015 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.015 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.015 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.015 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:03.016 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122067+0000", 2024-09-12T00:06:03.016 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4970000000000003e-06 2024-09-12T00:06:03.016 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.016 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.016 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:03.016 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126931+0000", 2024-09-12T00:06:03.016 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048641090000000001 2024-09-12T00:06:03.016 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.016 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.016 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:03.016 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126973+0000", 2024-09-12T00:06:03.016 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1678999999999999e-05 2024-09-12T00:06:03.016 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.016 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.017 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.017 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126999+0000", 2024-09-12T00:06:03.017 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6536000000000001e-05 2024-09-12T00:06:03.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.017 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.017 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:03.017 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127118+0000", 2024-09-12T00:06:03.017 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000119373 2024-09-12T00:06:03.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.017 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.017 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:03.017 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127289+0000", 2024-09-12T00:06:03.017 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017020199999999999 2024-09-12T00:06:03.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.018 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.018 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:03.018 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127437+0000", 2024-09-12T00:06:03.018 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148682 2024-09-12T00:06:03.018 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.018 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.018 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:03.018 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138539+0000", 2024-09-12T00:06:03.018 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011101418 2024-09-12T00:06:03.018 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.018 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.018 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.018 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143355+0000", 2024-09-12T00:06:03.018 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048161499999999999 2024-09-12T00:06:03.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.019 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.019 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:03.019 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143777+0000", 2024-09-12T00:06:03.019 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000421896 2024-09-12T00:06:03.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.019 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.019 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:03.019 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143905+0000", 2024-09-12T00:06:03.019 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012872 2024-09-12T00:06:03.019 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.019 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:03.019 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.020 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.020 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3066 3.21 3:8448517d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:03.020 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:06:03.020 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 41.838481590000001, 2024-09-12T00:06:03.020 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025911652, 2024-09-12T00:06:03.020 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:03.020 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:03.020 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.020 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:03.020 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:03.020 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.020 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3066 2024-09-12T00:06:03.021 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.021 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:03.021 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.021 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:03.021 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:06:03.021 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.021 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.021 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.021 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:03.021 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:06:03.021 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.021 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.021 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.021 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:03.022 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132011+0000", 2024-09-12T00:06:03.022 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8270000000000002e-06 2024-09-12T00:06:03.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.022 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.022 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:03.022 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137934+0000", 2024-09-12T00:06:03.022 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059226119999999998 2024-09-12T00:06:03.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.022 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.022 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:03.022 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137968+0000", 2024-09-12T00:06:03.022 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3933000000000002e-05 2024-09-12T00:06:03.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.023 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.023 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137985+0000", 2024-09-12T00:06:03.023 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7725999999999999e-05 2024-09-12T00:06:03.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.023 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:03.023 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138084+0000", 2024-09-12T00:06:03.023 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8450999999999996e-05 2024-09-12T00:06:03.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.023 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:03.023 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138285+0000", 2024-09-12T00:06:03.023 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000201411 2024-09-12T00:06:03.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.024 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.024 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:06:03.024 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138510+0000", 2024-09-12T00:06:03.024 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000224551 2024-09-12T00:06:03.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.024 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.024 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:03.024 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.146242+0000", 2024-09-12T00:06:03.024 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077317649999999998 2024-09-12T00:06:03.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.024 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.024 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.024 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157728+0000", 2024-09-12T00:06:03.025 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011486424 2024-09-12T00:06:03.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.025 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:03.025 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157833+0000", 2024-09-12T00:06:03.025 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105234 2024-09-12T00:06:03.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.025 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:03.025 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157920+0000", 2024-09-12T00:06:03.025 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6718000000000006e-05 2024-09-12T00:06:03.025 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.025 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:03.025 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.026 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.026 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3112 3.b 3:d1cf91a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:06:03.026 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:06:03.026 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 41.219764462999997, 2024-09-12T00:06:03.026 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021203475999999999, 2024-09-12T00:06:03.026 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:03.026 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:03.026 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.026 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:03.026 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:03.026 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.026 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3112 2024-09-12T00:06:03.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.027 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:03.027 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.027 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:03.027 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:06:03.027 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.027 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.027 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:03.027 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:06:03.027 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.027 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.027 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:03.028 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750728+0000", 2024-09-12T00:06:03.028 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.165e-06 2024-09-12T00:06:03.028 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.028 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.028 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:03.028 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755063+0000", 2024-09-12T00:06:03.028 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043355379999999999 2024-09-12T00:06:03.028 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.028 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.028 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:03.028 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755103+0000", 2024-09-12T00:06:03.028 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9962000000000001e-05 2024-09-12T00:06:03.029 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.029 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.029 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.029 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755120+0000", 2024-09-12T00:06:03.029 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6793e-05 2024-09-12T00:06:03.029 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.029 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.029 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:03.029 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755299+0000", 2024-09-12T00:06:03.029 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017904499999999999 2024-09-12T00:06:03.029 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.029 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.029 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:03.030 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755758+0000", 2024-09-12T00:06:03.030 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000458815 2024-09-12T00:06:03.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.030 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:03.030 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.756304+0000", 2024-09-12T00:06:03.030 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000546183 2024-09-12T00:06:03.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.030 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.030 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771518+0000", 2024-09-12T00:06:03.030 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015214236000000001 2024-09-12T00:06:03.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.031 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:03.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771827+0000", 2024-09-12T00:06:03.031 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000309308 2024-09-12T00:06:03.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.031 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.031 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:03.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771874+0000", 2024-09-12T00:06:03.031 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6119999999999999e-05 2024-09-12T00:06:03.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.031 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.031 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:03.031 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771929+0000", 2024-09-12T00:06:03.031 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5310999999999999e-05 2024-09-12T00:06:03.032 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.032 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:03.032 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.032 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3115 3.2e 3:75803fec:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:06:03.032 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:06:03.032 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 41.181793413000001, 2024-09-12T00:06:03.032 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020205041, 2024-09-12T00:06:03.032 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:03.032 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:03.032 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.032 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:03.032 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:03.033 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.033 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3115 2024-09-12T00:06:03.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.033 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:03.033 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.033 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:03.033 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:06:03.033 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.033 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.033 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:03.033 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788696+0000", 2024-09-12T00:06:03.033 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.034 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.034 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:03.034 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.788700+0000", 2024-09-12T00:06:03.034 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.614e-06 2024-09-12T00:06:03.034 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.034 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.034 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:03.034 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793576+0000", 2024-09-12T00:06:03.034 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048760920000000003 2024-09-12T00:06:03.034 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.034 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.034 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:03.034 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793610+0000", 2024-09-12T00:06:03.034 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4184999999999999e-05 2024-09-12T00:06:03.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.035 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.035 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.035 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793633+0000", 2024-09-12T00:06:03.035 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2551000000000001e-05 2024-09-12T00:06:03.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.035 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.035 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:03.035 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793750+0000", 2024-09-12T00:06:03.035 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117057 2024-09-12T00:06:03.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.035 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.035 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:03.036 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.793975+0000", 2024-09-12T00:06:03.036 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022493099999999999 2024-09-12T00:06:03.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.036 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.036 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:03.036 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.794178+0000", 2024-09-12T00:06:03.036 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000202726 2024-09-12T00:06:03.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.036 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.036 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:03.036 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.803725+0000", 2024-09-12T00:06:03.036 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0095470599999999996 2024-09-12T00:06:03.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.037 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.037 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.037 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808706+0000", 2024-09-12T00:06:03.037 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0049814519999999999 2024-09-12T00:06:03.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.037 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.037 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:03.037 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808785+0000", 2024-09-12T00:06:03.037 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9160999999999996e-05 2024-09-12T00:06:03.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.038 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.038 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:03.038 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.808902+0000", 2024-09-12T00:06:03.038 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000116212 2024-09-12T00:06:03.038 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.038 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:03.038 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.038 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.038 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3380 3.23 e82/23 3:c6c9ccf8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_7:head v 82'5, mlcod=76'3)", 2024-09-12T00:06:03.039 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:06:03.039 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 22.263968394999999, 2024-09-12T00:06:03.039 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.029708818000000001, 2024-09-12T00:06:03.039 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:03.039 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:03.039 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.039 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:03.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.039 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:03.039 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:06:03.039 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.040 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.040 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.040 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:03.040 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:06:03.040 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.040 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.040 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.040 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:03.040 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:06:03.040 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1600000000000001e-07 2024-09-12T00:06:03.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.041 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.041 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:03.041 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.710842+0000", 2024-09-12T00:06:03.041 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043204510000000003 2024-09-12T00:06:03.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.041 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.041 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:03.041 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.710875+0000", 2024-09-12T00:06:03.041 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2702e-05 2024-09-12T00:06:03.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.042 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.042 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.042 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.710895+0000", 2024-09-12T00:06:03.042 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0094000000000001e-05 2024-09-12T00:06:03.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.042 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.042 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:03.042 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.711063+0000", 2024-09-12T00:06:03.042 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000167517 2024-09-12T00:06:03.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.043 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:03.043 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.711127+0000", 2024-09-12T00:06:03.043 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4004999999999995e-05 2024-09-12T00:06:03.043 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.043 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:03.043 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.736095+0000", 2024-09-12T00:06:03.043 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024968008999999999 2024-09-12T00:06:03.043 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.043 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:03.043 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.736230+0000", 2024-09-12T00:06:03.044 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013552400000000001 2024-09-12T00:06:03.044 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.044 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:03.044 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.044 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.044 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3409 3.b 3:d39a1970:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:06:03.044 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:41.028923+0000", 2024-09-12T00:06:03.044 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 21.941567377999998, 2024-09-12T00:06:03.044 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030518363999999999, 2024-09-12T00:06:03.044 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:03.044 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:03.044 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.045 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:03.045 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:03.045 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.045 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3409 2024-09-12T00:06:03.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.045 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:03.045 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.045 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:03.045 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.028923+0000", 2024-09-12T00:06:03.045 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.045 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.045 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:03.045 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.028923+0000", 2024-09-12T00:06:03.046 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.046 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:03.046 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.028926+0000", 2024-09-12T00:06:03.046 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1e-06 2024-09-12T00:06:03.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.046 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:03.046 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038010+0000", 2024-09-12T00:06:03.046 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0090839110000000001 2024-09-12T00:06:03.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.046 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:03.047 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038042+0000", 2024-09-12T00:06:03.047 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2425999999999998e-05 2024-09-12T00:06:03.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.047 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.047 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038060+0000", 2024-09-12T00:06:03.047 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8219e-05 2024-09-12T00:06:03.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.047 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:03.047 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038205+0000", 2024-09-12T00:06:03.047 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014503500000000001 2024-09-12T00:06:03.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.048 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:03.048 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038498+0000", 2024-09-12T00:06:03.048 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00029289499999999999 2024-09-12T00:06:03.048 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.048 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.048 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:03.048 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038752+0000", 2024-09-12T00:06:03.048 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025434500000000001 2024-09-12T00:06:03.048 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.048 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.048 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:03.048 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.058529+0000", 2024-09-12T00:06:03.048 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019776275999999999 2024-09-12T00:06:03.048 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.049 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.049 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.049 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.059147+0000", 2024-09-12T00:06:03.049 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00061837199999999995 2024-09-12T00:06:03.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.049 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.049 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:03.049 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.059328+0000", 2024-09-12T00:06:03.049 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018048399999999999 2024-09-12T00:06:03.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.049 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.049 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:03.049 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.059441+0000", 2024-09-12T00:06:03.049 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011330100000000001 2024-09-12T00:06:03.050 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.050 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:03.050 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.050 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.050 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.050 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3665 3.21 3:85e29f15:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_282:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:03.050 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:43.757083+0000", 2024-09-12T00:06:03.050 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 19.213406664000001, 2024-09-12T00:06:03.050 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021222119000000001, 2024-09-12T00:06:03.050 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:03.050 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:03.050 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.050 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:03.050 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:03.051 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.051 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3665 2024-09-12T00:06:03.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.051 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:03.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.051 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:03.051 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.757083+0000", 2024-09-12T00:06:03.051 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.051 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:03.051 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.757083+0000", 2024-09-12T00:06:03.051 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.052 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:03.052 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.757087+0000", 2024-09-12T00:06:03.052 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2370000000000003e-06 2024-09-12T00:06:03.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.052 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.052 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:03.052 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763296+0000", 2024-09-12T00:06:03.052 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0062089240000000002 2024-09-12T00:06:03.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.052 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.052 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:03.052 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763337+0000", 2024-09-12T00:06:03.052 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1032999999999998e-05 2024-09-12T00:06:03.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.053 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.053 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.053 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763356+0000", 2024-09-12T00:06:03.053 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8292999999999999e-05 2024-09-12T00:06:03.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.053 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.053 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:03.053 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763485+0000", 2024-09-12T00:06:03.053 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012931499999999999 2024-09-12T00:06:03.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.053 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.053 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:03.053 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763704+0000", 2024-09-12T00:06:03.053 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021922399999999999 2024-09-12T00:06:03.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.054 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.054 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:06:03.054 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763888+0000", 2024-09-12T00:06:03.054 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184146 2024-09-12T00:06:03.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.054 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.054 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:03.054 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.772359+0000", 2024-09-12T00:06:03.054 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0084704089999999999 2024-09-12T00:06:03.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.054 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.054 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.054 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.778004+0000", 2024-09-12T00:06:03.055 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0056452619999999998 2024-09-12T00:06:03.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.055 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:03.055 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.778173+0000", 2024-09-12T00:06:03.055 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016846299999999999 2024-09-12T00:06:03.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.055 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:03.055 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.778305+0000", 2024-09-12T00:06:03.055 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013281299999999999 2024-09-12T00:06:03.055 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.055 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:03.056 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.056 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.056 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3696 3.21 3:872f3075:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_313:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:03.056 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.301332+0000", 2024-09-12T00:06:03.056 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 18.669158194000001, 2024-09-12T00:06:03.056 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024918241000000001, 2024-09-12T00:06:03.056 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:03.056 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:03.056 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.056 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:03.056 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:03.056 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.057 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3696 2024-09-12T00:06:03.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.057 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:03.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.057 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:03.057 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.301332+0000", 2024-09-12T00:06:03.057 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.057 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:03.057 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.301332+0000", 2024-09-12T00:06:03.057 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.058 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:03.058 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.301335+0000", 2024-09-12T00:06:03.058 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9679999999999998e-06 2024-09-12T00:06:03.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.058 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.058 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:03.058 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.305984+0000", 2024-09-12T00:06:03.058 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046492249999999999 2024-09-12T00:06:03.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.058 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.058 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:03.058 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306009+0000", 2024-09-12T00:06:03.058 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5252000000000001e-05 2024-09-12T00:06:03.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.059 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.059 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.059 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306023+0000", 2024-09-12T00:06:03.059 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3903000000000001e-05 2024-09-12T00:06:03.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.059 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.059 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:03.059 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306193+0000", 2024-09-12T00:06:03.059 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017032500000000001 2024-09-12T00:06:03.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.059 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.059 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:03.059 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306594+0000", 2024-09-12T00:06:03.060 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040111600000000003 2024-09-12T00:06:03.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:06:03.060 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.307002+0000", 2024-09-12T00:06:03.060 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040796000000000002 2024-09-12T00:06:03.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.060 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:03.060 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.319319+0000", 2024-09-12T00:06:03.060 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012317033 2024-09-12T00:06:03.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.061 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.061 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.325949+0000", 2024-09-12T00:06:03.061 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0066298110000000002 2024-09-12T00:06:03.061 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.061 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.061 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:03.061 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.326123+0000", 2024-09-12T00:06:03.061 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017416999999999999 2024-09-12T00:06:03.061 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.061 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.061 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:03.061 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.326250+0000", 2024-09-12T00:06:03.061 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012647799999999999 2024-09-12T00:06:03.061 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.062 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:03.062 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.062 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.062 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.062 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3737 3.b 3:d32629e2:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_354:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:03.062 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.993654+0000", 2024-09-12T00:06:03.062 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.976835873999999, 2024-09-12T00:06:03.062 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022195105999999999, 2024-09-12T00:06:03.062 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:03.062 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:03.062 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.062 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:03.062 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:03.062 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.063 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3737 2024-09-12T00:06:03.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.063 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:03.063 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.063 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:03.063 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.993654+0000", 2024-09-12T00:06:03.063 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.063 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.063 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:03.063 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.993654+0000", 2024-09-12T00:06:03.063 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.063 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.064 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:03.064 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.993657+0000", 2024-09-12T00:06:03.064 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2600000000000001e-06 2024-09-12T00:06:03.064 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.064 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.064 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:03.064 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.997886+0000", 2024-09-12T00:06:03.064 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004228646 2024-09-12T00:06:03.064 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.064 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.064 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:03.064 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.997924+0000", 2024-09-12T00:06:03.064 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7632999999999997e-05 2024-09-12T00:06:03.064 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.065 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.065 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.065 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.997942+0000", 2024-09-12T00:06:03.065 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8352999999999999e-05 2024-09-12T00:06:03.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.065 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.065 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:03.065 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.998101+0000", 2024-09-12T00:06:03.065 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015922500000000001 2024-09-12T00:06:03.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.065 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.065 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:03.065 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.998375+0000", 2024-09-12T00:06:03.065 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027389500000000002 2024-09-12T00:06:03.066 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.066 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.066 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:03.066 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.998611+0000", 2024-09-12T00:06:03.066 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023559199999999999 2024-09-12T00:06:03.066 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.066 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.066 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:03.066 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009636+0000", 2024-09-12T00:06:03.066 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011025188 2024-09-12T00:06:03.066 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.066 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.066 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.066 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.015538+0000", 2024-09-12T00:06:03.067 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059023590000000003 2024-09-12T00:06:03.067 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.067 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.067 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:03.067 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.015717+0000", 2024-09-12T00:06:03.067 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017847699999999999 2024-09-12T00:06:03.067 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.067 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.067 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:03.067 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.015849+0000", 2024-09-12T00:06:03.067 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000132478 2024-09-12T00:06:03.067 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.067 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:03.067 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.068 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.068 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.068 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3738 3.2e 3:74a476b8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_355:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:03.068 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.005209+0000", 2024-09-12T00:06:03.068 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.965280399000001, 2024-09-12T00:06:03.068 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022771276999999999, 2024-09-12T00:06:03.068 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:03.068 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:03.068 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.068 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:03.068 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:03.068 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.068 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3738 2024-09-12T00:06:03.068 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.069 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:03.069 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.069 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:03.069 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.005209+0000", 2024-09-12T00:06:03.069 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.069 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.069 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:03.069 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.005209+0000", 2024-09-12T00:06:03.069 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.069 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.069 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:03.069 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.005213+0000", 2024-09-12T00:06:03.070 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4170000000000001e-06 2024-09-12T00:06:03.070 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.070 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.070 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:03.070 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009471+0000", 2024-09-12T00:06:03.070 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042583400000000002 2024-09-12T00:06:03.070 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.070 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.070 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:03.070 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009506+0000", 2024-09-12T00:06:03.070 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4625999999999997e-05 2024-09-12T00:06:03.070 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.070 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.070 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.071 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009524+0000", 2024-09-12T00:06:03.071 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7745999999999999e-05 2024-09-12T00:06:03.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.071 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.071 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:03.071 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009649+0000", 2024-09-12T00:06:03.071 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000124948 2024-09-12T00:06:03.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.071 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.071 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:03.071 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009889+0000", 2024-09-12T00:06:03.071 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024013999999999999 2024-09-12T00:06:03.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.072 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.072 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:03.072 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.010104+0000", 2024-09-12T00:06:03.072 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021549199999999999 2024-09-12T00:06:03.072 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.072 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.072 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:03.072 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.022243+0000", 2024-09-12T00:06:03.072 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012138793 2024-09-12T00:06:03.072 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.072 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.072 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.072 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.027764+0000", 2024-09-12T00:06:03.072 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0055207820000000001 2024-09-12T00:06:03.073 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.073 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.073 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:03.073 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.027859+0000", 2024-09-12T00:06:03.073 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5441999999999999e-05 2024-09-12T00:06:03.073 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.073 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.073 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:03.073 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.027981+0000", 2024-09-12T00:06:03.073 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000121551 2024-09-12T00:06:03.073 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.073 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:03.073 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.073 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.074 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.074 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3758 3.2e 3:7790af15:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_375:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:03.074 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.228203+0000", 2024-09-12T00:06:03.074 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.742286582999999, 2024-09-12T00:06:03.074 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.032647253000000001, 2024-09-12T00:06:03.074 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:03.074 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:03.074 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.074 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:03.074 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:03.074 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.074 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3758 2024-09-12T00:06:03.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.074 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:03.075 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.075 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:03.075 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.228203+0000", 2024-09-12T00:06:03.075 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.075 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.075 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.075 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:03.075 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.228203+0000", 2024-09-12T00:06:03.075 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.075 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.075 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.075 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:03.075 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.228208+0000", 2024-09-12T00:06:03.075 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3900000000000003e-06 2024-09-12T00:06:03.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.076 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.076 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:03.076 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239226+0000", 2024-09-12T00:06:03.076 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011018155 2024-09-12T00:06:03.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.076 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.076 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:03.076 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239265+0000", 2024-09-12T00:06:03.076 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9419000000000003e-05 2024-09-12T00:06:03.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.076 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.076 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.076 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239291+0000", 2024-09-12T00:06:03.077 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6173000000000002e-05 2024-09-12T00:06:03.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.077 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.077 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:03.077 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239430+0000", 2024-09-12T00:06:03.077 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000138071 2024-09-12T00:06:03.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.077 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.077 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:03.077 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239676+0000", 2024-09-12T00:06:03.077 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024695899999999999 2024-09-12T00:06:03.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.077 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.077 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:03.077 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239895+0000", 2024-09-12T00:06:03.078 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021808999999999999 2024-09-12T00:06:03.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.078 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.078 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:03.078 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.255130+0000", 2024-09-12T00:06:03.078 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015235907999999999 2024-09-12T00:06:03.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.078 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.078 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.078 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.260520+0000", 2024-09-12T00:06:03.078 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053894340000000002 2024-09-12T00:06:03.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.078 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.078 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:03.079 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.260700+0000", 2024-09-12T00:06:03.079 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018017099999999999 2024-09-12T00:06:03.079 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.079 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.079 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:03.079 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.260851+0000", 2024-09-12T00:06:03.079 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000150483 2024-09-12T00:06:03.079 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.079 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:03.079 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.079 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.079 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.079 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3760 3.b 3:d2eb500d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_377:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:03.079 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.251207+0000", 2024-09-12T00:06:03.080 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.719282925999998, 2024-09-12T00:06:03.080 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022210074, 2024-09-12T00:06:03.080 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:03.080 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:03.080 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.080 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:03.080 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:03.080 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.080 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3760 2024-09-12T00:06:03.080 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.080 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:03.080 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.080 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:03.080 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.251207+0000", 2024-09-12T00:06:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.251207+0000", 2024-09-12T00:06:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.251210+0000", 2024-09-12T00:06:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1130000000000001e-06 2024-09-12T00:06:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.256588+0000", 2024-09-12T00:06:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005378201 2024-09-12T00:06:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.256622+0000", 2024-09-12T00:06:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3246e-05 2024-09-12T00:06:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.256642+0000", 2024-09-12T00:06:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0786000000000001e-05 2024-09-12T00:06:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:03.083 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.256767+0000", 2024-09-12T00:06:03.083 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012475799999999999 2024-09-12T00:06:03.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.083 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.083 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:03.083 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.257047+0000", 2024-09-12T00:06:03.083 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028016199999999998 2024-09-12T00:06:03.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.083 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.083 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:03.083 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.257276+0000", 2024-09-12T00:06:03.083 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022880900000000001 2024-09-12T00:06:03.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.084 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.084 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:03.084 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.272093+0000", 2024-09-12T00:06:03.084 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014816757999999999 2024-09-12T00:06:03.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.084 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.084 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.084 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.273101+0000", 2024-09-12T00:06:03.084 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0010080340000000001 2024-09-12T00:06:03.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.084 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.084 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:03.084 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.273283+0000", 2024-09-12T00:06:03.085 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000181993 2024-09-12T00:06:03.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.085 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.085 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:03.085 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.273417+0000", 2024-09-12T00:06:03.085 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013421400000000001 2024-09-12T00:06:03.085 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.085 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:03.085 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.085 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.085 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3793 3.21 3:8684dc70:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_410:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:03.085 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.629422+0000", 2024-09-12T00:06:03.085 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 17.341067993999999, 2024-09-12T00:06:03.086 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027123878000000001, 2024-09-12T00:06:03.086 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:03.086 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:03.086 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.086 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:03.086 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:03.086 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.086 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3793 2024-09-12T00:06:03.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.086 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:03.086 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.086 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:03.086 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.629422+0000", 2024-09-12T00:06:03.087 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.087 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.087 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:03.087 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.629422+0000", 2024-09-12T00:06:03.087 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:03.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.087 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.087 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:03.087 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.629426+0000", 2024-09-12T00:06:03.087 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7129999999999999e-06 2024-09-12T00:06:03.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.087 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.087 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:03.087 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635537+0000", 2024-09-12T00:06:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061111220000000001 2024-09-12T00:06:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635578+0000", 2024-09-12T00:06:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1730000000000002e-05 2024-09-12T00:06:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635605+0000", 2024-09-12T00:06:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6792999999999999e-05 2024-09-12T00:06:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:03.089 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635747+0000", 2024-09-12T00:06:03.089 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014160999999999999 2024-09-12T00:06:03.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.089 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.089 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:03.089 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635998+0000", 2024-09-12T00:06:03.089 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025098600000000003 2024-09-12T00:06:03.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.089 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.089 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:06:03.089 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.636254+0000", 2024-09-12T00:06:03.089 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025597 2024-09-12T00:06:03.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.089 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.090 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:03.090 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.653522+0000", 2024-09-12T00:06:03.090 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017268229999999999 2024-09-12T00:06:03.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.090 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.090 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.090 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.656375+0000", 2024-09-12T00:06:03.090 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0028530930000000001 2024-09-12T00:06:03.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.090 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.090 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:03.090 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.656471+0000", 2024-09-12T00:06:03.090 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5904999999999997e-05 2024-09-12T00:06:03.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:03.090 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:03.091 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:03.091 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.656546+0000", 2024-09-12T00:06:03.091 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4726000000000002e-05 2024-09-12T00:06:03.091 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.091 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:03.091 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.091 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:03.091 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:03.091 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:06:03.093 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:06:03.092+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:06:03.093 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:06:03.194 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:06:03.195+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:06:03.225 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:06:03.226 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:06:03.226 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:06:03.226 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:06:03.239 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:06:03.295 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:06:03.296+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:06:03.388 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T00:06:03.397 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:06:03.396+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:06:03.406 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:06:03.406 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:06:03.406 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:06:03.406 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:06:03.406 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:06:03.420 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:06:03.497 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:06:03.496+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:06:03.582 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:06:03.582 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:06:03.582 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:06:03.582 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:06:03.582 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.582 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:06:03.582 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:06:03.583 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 152.25139791500001, 2024-09-12T00:06:03.583 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.027441031000000001, 2024-09-12T00:06:03.583 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:03.583 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:03.583 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.583 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:03.583 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:03.583 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.583 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:06:03.583 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.583 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:03.583 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.583 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:03.583 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:06:03.584 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.584 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.584 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.584 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:03.584 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:06:03.584 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.584 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.584 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.584 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:03.584 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330357+0000", 2024-09-12T00:06:03.584 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2339999999999996e-06 2024-09-12T00:06:03.584 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.584 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.585 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:03.585 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330381+0000", 2024-09-12T00:06:03.585 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4626000000000001e-05 2024-09-12T00:06:03.585 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.585 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.585 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:03.585 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330417+0000", 2024-09-12T00:06:03.585 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5886000000000002e-05 2024-09-12T00:06:03.585 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.585 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.585 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.585 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330442+0000", 2024-09-12T00:06:03.585 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4522999999999999e-05 2024-09-12T00:06:03.585 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.586 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.586 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:03.586 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335485+0000", 2024-09-12T00:06:03.586 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050432589999999996 2024-09-12T00:06:03.586 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.586 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.586 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:06:03.586 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335507+0000", 2024-09-12T00:06:03.586 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2013000000000001e-05 2024-09-12T00:06:03.586 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.586 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.586 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:03.586 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.351747+0000", 2024-09-12T00:06:03.586 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016240451999999999 2024-09-12T00:06:03.586 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.587 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.587 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:03.587 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352062+0000", 2024-09-12T00:06:03.587 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031433399999999999 2024-09-12T00:06:03.587 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.587 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.587 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:03.587 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352378+0000", 2024-09-12T00:06:03.587 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031586400000000001 2024-09-12T00:06:03.587 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.587 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.587 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:03.587 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.355074+0000", 2024-09-12T00:06:03.587 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026962919999999999 2024-09-12T00:06:03.588 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.588 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.588 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.588 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357537+0000", 2024-09-12T00:06:03.588 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024634689999999998 2024-09-12T00:06:03.588 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.588 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.588 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:03.588 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357680+0000", 2024-09-12T00:06:03.588 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014314899999999999 2024-09-12T00:06:03.588 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.588 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.588 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:03.588 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357793+0000", 2024-09-12T00:06:03.589 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011293 2024-09-12T00:06:03.589 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.589 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:03.589 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.589 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.589 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.589 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2748 3.3b 3:df6d92a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:06:03.589 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:06:03.589 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 75.482910055000005, 2024-09-12T00:06:03.589 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.023574735999999999, 2024-09-12T00:06:03.589 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:03.589 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:03.589 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.589 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:03.590 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:03.590 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.590 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2748 2024-09-12T00:06:03.590 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.590 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:03.590 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.590 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:03.590 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:06:03.590 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.590 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.590 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.590 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:03.590 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:06:03.590 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.591 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.591 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.591 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:03.591 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098844+0000", 2024-09-12T00:06:03.591 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1570000000000002e-06 2024-09-12T00:06:03.591 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.591 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.591 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:03.591 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100354+0000", 2024-09-12T00:06:03.591 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001509544 2024-09-12T00:06:03.591 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.591 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.591 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:03.591 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100383+0000", 2024-09-12T00:06:03.591 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9386e-05 2024-09-12T00:06:03.592 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.592 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.592 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.592 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100399+0000", 2024-09-12T00:06:03.592 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5883999999999999e-05 2024-09-12T00:06:03.592 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.592 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.592 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:03.592 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100507+0000", 2024-09-12T00:06:03.592 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010822 2024-09-12T00:06:03.592 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.592 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.592 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:03.592 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100704+0000", 2024-09-12T00:06:03.593 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019658499999999999 2024-09-12T00:06:03.593 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.593 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.593 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:03.593 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100901+0000", 2024-09-12T00:06:03.593 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000196505 2024-09-12T00:06:03.593 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.593 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.593 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:03.593 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112178+0000", 2024-09-12T00:06:03.593 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011277718000000001 2024-09-12T00:06:03.593 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.593 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.593 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.594 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122285+0000", 2024-09-12T00:06:03.594 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010106327 2024-09-12T00:06:03.594 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.594 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.594 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:03.594 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122358+0000", 2024-09-12T00:06:03.594 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3640999999999995e-05 2024-09-12T00:06:03.594 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.594 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.594 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:03.594 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122415+0000", 2024-09-12T00:06:03.594 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6768999999999998e-05 2024-09-12T00:06:03.594 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.594 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:03.595 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.595 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.595 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.595 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2964 3.24 e75/23 3:26c83ec0:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_3:head v 75'6, mlcod=63'4)", 2024-09-12T00:06:03.595 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:06:03.595 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 43.569489034, 2024-09-12T00:06:03.595 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022426814, 2024-09-12T00:06:03.595 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:03.595 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:03.595 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.595 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:03.595 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.595 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:03.595 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:06:03.596 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.596 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.596 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.596 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:03.596 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:06:03.596 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.596 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.596 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.596 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:03.596 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012263+0000", 2024-09-12T00:06:03.596 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.091e-06 2024-09-12T00:06:03.596 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.596 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.596 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:03.597 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018390+0000", 2024-09-12T00:06:03.597 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061264600000000002 2024-09-12T00:06:03.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.597 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.597 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:03.597 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018419+0000", 2024-09-12T00:06:03.597 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8979000000000002e-05 2024-09-12T00:06:03.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.597 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.597 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.597 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018434+0000", 2024-09-12T00:06:03.597 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4781e-05 2024-09-12T00:06:03.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.597 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.598 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:03.598 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018528+0000", 2024-09-12T00:06:03.598 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.4333000000000006e-05 2024-09-12T00:06:03.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.598 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.598 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:03.598 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018559+0000", 2024-09-12T00:06:03.598 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1557999999999998e-05 2024-09-12T00:06:03.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.598 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.598 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:03.598 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.034615+0000", 2024-09-12T00:06:03.598 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016055834000000001 2024-09-12T00:06:03.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.599 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.599 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:03.599 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.034688+0000", 2024-09-12T00:06:03.599 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2778e-05 2024-09-12T00:06:03.599 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.599 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:03.599 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.599 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.599 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.599 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2965 3.e e75/23 3:70fff61e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_4:head v 75'5, mlcod=63'3)", 2024-09-12T00:06:03.599 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:06:03.599 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 43.561978813000003, 2024-09-12T00:06:03.599 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021839210000000001, 2024-09-12T00:06:03.599 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:03.600 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:03.600 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.600 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:03.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.600 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:03.600 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:06:03.600 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.600 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:03.600 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:06:03.600 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.601 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:03.601 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019773+0000", 2024-09-12T00:06:03.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4839999999999999e-06 2024-09-12T00:06:03.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.601 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:03.601 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021570+0000", 2024-09-12T00:06:03.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017965570000000001 2024-09-12T00:06:03.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.601 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:03.601 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021587+0000", 2024-09-12T00:06:03.601 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7938e-05 2024-09-12T00:06:03.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.602 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.602 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.602 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021598+0000", 2024-09-12T00:06:03.602 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0553e-05 2024-09-12T00:06:03.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.602 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.602 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:03.602 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021676+0000", 2024-09-12T00:06:03.602 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8034000000000005e-05 2024-09-12T00:06:03.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.602 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.602 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:03.602 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021706+0000", 2024-09-12T00:06:03.602 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9915000000000001e-05 2024-09-12T00:06:03.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.603 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.603 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:03.603 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.041519+0000", 2024-09-12T00:06:03.603 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019813171000000001 2024-09-12T00:06:03.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.603 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.603 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:03.603 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.041611+0000", 2024-09-12T00:06:03.603 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1558000000000007e-05 2024-09-12T00:06:03.603 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.603 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:03.603 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.603 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.604 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3004 3.36 3:6cc4f27f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:03.604 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:06:03.604 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 43.143579615999997, 2024-09-12T00:06:03.604 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.042951743000000001, 2024-09-12T00:06:03.604 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:03.604 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:03.604 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.604 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:03.604 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:03.604 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.604 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3004 2024-09-12T00:06:03.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.604 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:03.604 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.604 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:03.605 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:06:03.605 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.605 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.605 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:03.605 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:06:03.605 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.605 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.605 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:03.605 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438175+0000", 2024-09-12T00:06:03.605 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1640000000000003e-06 2024-09-12T00:06:03.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.605 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.606 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:03.606 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439732+0000", 2024-09-12T00:06:03.606 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015574510000000001 2024-09-12T00:06:03.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.606 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.606 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:03.606 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439758+0000", 2024-09-12T00:06:03.606 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6074000000000001e-05 2024-09-12T00:06:03.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.606 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.606 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.606 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439768+0000", 2024-09-12T00:06:03.606 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8770000000000005e-06 2024-09-12T00:06:03.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.606 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.607 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:03.607 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439874+0000", 2024-09-12T00:06:03.607 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105583 2024-09-12T00:06:03.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.607 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.607 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:03.607 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.440078+0000", 2024-09-12T00:06:03.607 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020388200000000001 2024-09-12T00:06:03.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.607 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.607 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:03.607 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.440251+0000", 2024-09-12T00:06:03.607 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017339100000000001 2024-09-12T00:06:03.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.608 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:03.608 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.459982+0000", 2024-09-12T00:06:03.608 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01973099 2024-09-12T00:06:03.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.608 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.608 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.480958+0000", 2024-09-12T00:06:03.608 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020975730000000001 2024-09-12T00:06:03.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.608 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:03.608 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481034+0000", 2024-09-12T00:06:03.608 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6224999999999996e-05 2024-09-12T00:06:03.609 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.609 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.609 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:03.609 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481122+0000", 2024-09-12T00:06:03.609 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8375999999999995e-05 2024-09-12T00:06:03.609 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.609 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:03.609 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.609 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.609 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.609 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3005 3.35 3:ae3b5a36:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:03.609 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:06:03.609 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 43.134325932000003, 2024-09-12T00:06:03.610 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.028828275, 2024-09-12T00:06:03.610 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:03.610 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:03.610 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.610 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:03.610 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:03.610 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.610 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3005 2024-09-12T00:06:03.610 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.610 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:03.610 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.610 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:03.610 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:06:03.610 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.611 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.611 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:03.611 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:06:03.611 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.611 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.611 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:03.611 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447427+0000", 2024-09-12T00:06:03.611 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.864e-06 2024-09-12T00:06:03.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.611 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.611 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:03.611 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449003+0000", 2024-09-12T00:06:03.611 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001575405 2024-09-12T00:06:03.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.612 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.612 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:03.612 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449030+0000", 2024-09-12T00:06:03.612 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7189999999999999e-05 2024-09-12T00:06:03.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.612 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.612 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.612 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449042+0000", 2024-09-12T00:06:03.612 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2038999999999999e-05 2024-09-12T00:06:03.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.612 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.612 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:03.613 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449111+0000", 2024-09-12T00:06:03.613 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9521000000000001e-05 2024-09-12T00:06:03.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.613 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.613 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:03.613 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449218+0000", 2024-09-12T00:06:03.613 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010675600000000001 2024-09-12T00:06:03.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.613 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.613 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:06:03.613 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449330+0000", 2024-09-12T00:06:03.613 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000111809 2024-09-12T00:06:03.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.614 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.469844+0000", 2024-09-12T00:06:03.614 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020514277000000001 2024-09-12T00:06:03.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.614 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:03.614 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.475983+0000", 2024-09-12T00:06:03.614 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061392540000000002 2024-09-12T00:06:03.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:03.615 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.476113+0000", 2024-09-12T00:06:03.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000129713 2024-09-12T00:06:03.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.615 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:03.615 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.476253+0000", 2024-09-12T00:06:03.615 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013944700000000001 2024-09-12T00:06:03.615 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.615 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:03.615 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.616 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3006 3.3 3:c183ca95:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:03.616 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:06:03.616 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 43.124799361000001, 2024-09-12T00:06:03.616 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.024661756, 2024-09-12T00:06:03.616 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:03.616 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:03.616 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.616 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:03.616 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:03.616 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.616 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3006 2024-09-12T00:06:03.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.616 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:03.617 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:03.617 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:06:03.617 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.617 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:03.617 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:06:03.617 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.617 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.617 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:03.617 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456954+0000", 2024-09-12T00:06:03.617 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7070000000000001e-06 2024-09-12T00:06:03.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.618 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:03.618 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458684+0000", 2024-09-12T00:06:03.618 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017305479999999999 2024-09-12T00:06:03.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.618 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:03.618 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458709+0000", 2024-09-12T00:06:03.618 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4780999999999999e-05 2024-09-12T00:06:03.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.618 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.618 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458719+0000", 2024-09-12T00:06:03.618 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0202e-05 2024-09-12T00:06:03.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:03.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458800+0000", 2024-09-12T00:06:03.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0893e-05 2024-09-12T00:06:03.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:03.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458990+0000", 2024-09-12T00:06:03.619 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018986400000000001 2024-09-12T00:06:03.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.619 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:03.619 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.459171+0000", 2024-09-12T00:06:03.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018135499999999999 2024-09-12T00:06:03.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.478356+0000", 2024-09-12T00:06:03.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019185153 2024-09-12T00:06:03.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:03.620 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481411+0000", 2024-09-12T00:06:03.620 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030546190000000002 2024-09-12T00:06:03.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.620 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:03.621 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481511+0000", 2024-09-12T00:06:03.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.9763e-05 2024-09-12T00:06:03.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.621 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:03.621 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481613+0000", 2024-09-12T00:06:03.621 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101871 2024-09-12T00:06:03.621 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.621 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:03.621 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.621 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3037 3.39 3:9eefb4c1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:03.621 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:06:03.622 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 42.766531954000001, 2024-09-12T00:06:03.622 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020855543000000001, 2024-09-12T00:06:03.622 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:03.622 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:03.622 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.622 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:03.622 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:03.622 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.622 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3037 2024-09-12T00:06:03.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.622 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:03.622 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.622 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:03.623 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:06:03.623 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.623 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.623 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:03.623 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815218+0000", 2024-09-12T00:06:03.623 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.623 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.623 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:03.623 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.815221+0000", 2024-09-12T00:06:03.623 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1540000000000002e-06 2024-09-12T00:06:03.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.624 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:03.624 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817594+0000", 2024-09-12T00:06:03.624 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023728880000000001 2024-09-12T00:06:03.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.624 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:03.624 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817618+0000", 2024-09-12T00:06:03.624 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.3635e-05 2024-09-12T00:06:03.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.624 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.624 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817633+0000", 2024-09-12T00:06:03.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4559000000000001e-05 2024-09-12T00:06:03.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:03.625 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817734+0000", 2024-09-12T00:06:03.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101729 2024-09-12T00:06:03.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.625 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:03.625 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.817939+0000", 2024-09-12T00:06:03.625 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020489299999999999 2024-09-12T00:06:03.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 4", 2024-09-12T00:06:03.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.818113+0000", 2024-09-12T00:06:03.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000173413 2024-09-12T00:06:03.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:03.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.825676+0000", 2024-09-12T00:06:03.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0075635260000000001 2024-09-12T00:06:03.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.626 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.626 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.626 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.835921+0000", 2024-09-12T00:06:03.626 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010244932999999999 2024-09-12T00:06:03.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:03.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.836006+0000", 2024-09-12T00:06:03.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.5427999999999996e-05 2024-09-12T00:06:03.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.627 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:03.627 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.836074+0000", 2024-09-12T00:06:03.627 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7385000000000006e-05 2024-09-12T00:06:03.627 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.627 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:03.627 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.628 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.628 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.628 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3375 3.15 3:ab335e39:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:06:03.628 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.646143+0000", 2024-09-12T00:06:03.628 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 22.935607511000001, 2024-09-12T00:06:03.628 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026933417000000001, 2024-09-12T00:06:03.628 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:03.628 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:03.628 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.628 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:03.628 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:03.628 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.628 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3375 2024-09-12T00:06:03.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.629 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:03.629 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.629 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:03.629 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.646143+0000", 2024-09-12T00:06:03.629 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.629 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.629 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:03.629 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.646143+0000", 2024-09-12T00:06:03.629 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.629 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.629 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:03.629 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.646146+0000", 2024-09-12T00:06:03.630 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.19e-06 2024-09-12T00:06:03.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.630 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.630 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:03.630 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648608+0000", 2024-09-12T00:06:03.630 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024615470000000001 2024-09-12T00:06:03.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.630 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.630 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:03.630 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648640+0000", 2024-09-12T00:06:03.630 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2342999999999998e-05 2024-09-12T00:06:03.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.630 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.630 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648655+0000", 2024-09-12T00:06:03.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5034e-05 2024-09-12T00:06:03.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:03.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648746+0000", 2024-09-12T00:06:03.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1529999999999999e-05 2024-09-12T00:06:03.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.631 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:03.631 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648938+0000", 2024-09-12T00:06:03.631 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191819 2024-09-12T00:06:03.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.631 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:03.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.649102+0000", 2024-09-12T00:06:03.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000164103 2024-09-12T00:06:03.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:03.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.658869+0000", 2024-09-12T00:06:03.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0097663530000000002 2024-09-12T00:06:03.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.632 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.632 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.672958+0000", 2024-09-12T00:06:03.632 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014089295 2024-09-12T00:06:03.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:03.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.673024+0000", 2024-09-12T00:06:03.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5834999999999996e-05 2024-09-12T00:06:03.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.633 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:03.633 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.673076+0000", 2024-09-12T00:06:03.633 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2367999999999997e-05 2024-09-12T00:06:03.633 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.633 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:03.633 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.633 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.633 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3392 3.1b e82/23 3:d9b2c983:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_19:head v 82'11, mlcod=76'9)", 2024-09-12T00:06:03.634 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.841020+0000", 2024-09-12T00:06:03.634 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 22.74073044, 2024-09-12T00:06:03.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022540108999999999, 2024-09-12T00:06:03.634 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:03.634 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:03.634 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.634 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:03.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.634 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:03.634 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.841020+0000", 2024-09-12T00:06:03.634 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.634 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:03.635 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.841020+0000", 2024-09-12T00:06:03.635 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.635 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:03.635 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.841022+0000", 2024-09-12T00:06:03.635 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4339999999999999e-06 2024-09-12T00:06:03.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.635 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:03.635 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847015+0000", 2024-09-12T00:06:03.635 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.005993104 2024-09-12T00:06:03.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.635 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:03.636 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847030+0000", 2024-09-12T00:06:03.636 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4595e-05 2024-09-12T00:06:03.636 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.636 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.636 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.636 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847041+0000", 2024-09-12T00:06:03.636 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1124000000000001e-05 2024-09-12T00:06:03.636 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.636 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.636 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:03.636 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847334+0000", 2024-09-12T00:06:03.636 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000292854 2024-09-12T00:06:03.636 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.636 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.637 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:03.637 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847371+0000", 2024-09-12T00:06:03.637 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7336000000000003e-05 2024-09-12T00:06:03.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.637 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.637 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:03.637 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.863502+0000", 2024-09-12T00:06:03.637 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016130314999999999 2024-09-12T00:06:03.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.637 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.637 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:03.637 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.863560+0000", 2024-09-12T00:06:03.637 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8347000000000002e-05 2024-09-12T00:06:03.637 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.638 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:03.638 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.638 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.638 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3399 3.c 3:33260d65:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:06:03.638 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.912770+0000", 2024-09-12T00:06:03.638 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 22.668980295000001, 2024-09-12T00:06:03.638 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021761494999999999, 2024-09-12T00:06:03.638 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:03.638 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:03.638 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.638 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:03.638 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:03.638 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.639 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3399 2024-09-12T00:06:03.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.639 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:03.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:03.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.912770+0000", 2024-09-12T00:06:03.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.639 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:03.639 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.912770+0000", 2024-09-12T00:06:03.639 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.639 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:03.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.912773+0000", 2024-09-12T00:06:03.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.252e-06 2024-09-12T00:06:03.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:03.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915156+0000", 2024-09-12T00:06:03.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023823109999999998 2024-09-12T00:06:03.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.640 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.640 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:03.640 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915244+0000", 2024-09-12T00:06:03.640 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8926999999999997e-05 2024-09-12T00:06:03.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.641 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.641 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.641 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915265+0000", 2024-09-12T00:06:03.641 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0613999999999999e-05 2024-09-12T00:06:03.641 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.641 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.641 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:03.641 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915361+0000", 2024-09-12T00:06:03.641 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5542000000000001e-05 2024-09-12T00:06:03.641 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.641 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.641 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:03.641 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915538+0000", 2024-09-12T00:06:03.641 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017762400000000001 2024-09-12T00:06:03.642 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.642 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.642 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:06:03.642 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915710+0000", 2024-09-12T00:06:03.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017170900000000001 2024-09-12T00:06:03.642 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.642 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.642 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:03.642 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.933564+0000", 2024-09-12T00:06:03.642 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017854080000000001 2024-09-12T00:06:03.642 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.642 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.642 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.642 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.934450+0000", 2024-09-12T00:06:03.643 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00088595700000000004 2024-09-12T00:06:03.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.643 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.643 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:03.643 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.934490+0000", 2024-09-12T00:06:03.643 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0110000000000001e-05 2024-09-12T00:06:03.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.643 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.643 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:03.643 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.934531+0000", 2024-09-12T00:06:03.643 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1369000000000003e-05 2024-09-12T00:06:03.643 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.643 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:03.643 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.644 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.644 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3678 3.15 3:a83db90f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_295:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:03.644 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:43.938089+0000", 2024-09-12T00:06:03.644 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 19.643661163000001, 2024-09-12T00:06:03.644 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021578831999999999, 2024-09-12T00:06:03.644 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:03.644 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:03.644 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.644 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:03.644 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:03.644 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.644 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3678 2024-09-12T00:06:03.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.644 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:03.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.645 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:03.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.938089+0000", 2024-09-12T00:06:03.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.645 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:03.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.938089+0000", 2024-09-12T00:06:03.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.645 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.645 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:03.645 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.938094+0000", 2024-09-12T00:06:03.645 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0719999999999999e-06 2024-09-12T00:06:03.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.646 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:03.646 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940370+0000", 2024-09-12T00:06:03.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022759159999999998 2024-09-12T00:06:03.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.646 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:03.646 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940401+0000", 2024-09-12T00:06:03.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1226999999999998e-05 2024-09-12T00:06:03.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.646 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.646 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940417+0000", 2024-09-12T00:06:03.646 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5603e-05 2024-09-12T00:06:03.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:03.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940499+0000", 2024-09-12T00:06:03.647 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1568000000000002e-05 2024-09-12T00:06:03.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:03.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940703+0000", 2024-09-12T00:06:03.647 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000203995 2024-09-12T00:06:03.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.647 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.647 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:03.647 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940947+0000", 2024-09-12T00:06:03.647 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024444799999999997 2024-09-12T00:06:03.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.648 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.648 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:03.648 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.950088+0000", 2024-09-12T00:06:03.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091408710000000001 2024-09-12T00:06:03.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.648 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.648 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.648 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.959534+0000", 2024-09-12T00:06:03.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0094463979999999999 2024-09-12T00:06:03.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.648 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.648 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:03.648 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.959594+0000", 2024-09-12T00:06:03.648 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0145000000000001e-05 2024-09-12T00:06:03.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.649 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.649 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:03.649 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.959668+0000", 2024-09-12T00:06:03.649 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3589000000000003e-05 2024-09-12T00:06:03.649 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.649 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:03.649 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.649 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.649 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3711 3.c 3:31bc51b2:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_328:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:03.649 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.647001+0000", 2024-09-12T00:06:03.649 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.934749010000001, 2024-09-12T00:06:03.650 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021286705, 2024-09-12T00:06:03.650 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:03.650 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:03.650 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.650 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:03.650 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:03.650 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.650 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3711 2024-09-12T00:06:03.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.650 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:03.650 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.650 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:03.650 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.647001+0000", 2024-09-12T00:06:03.650 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.651 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:03.651 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.647001+0000", 2024-09-12T00:06:03.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.651 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:03.651 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.647006+0000", 2024-09-12T00:06:03.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1900000000000003e-06 2024-09-12T00:06:03.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.651 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.651 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:03.651 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.651810+0000", 2024-09-12T00:06:03.651 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048032159999999999 2024-09-12T00:06:03.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.652 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:03.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.651857+0000", 2024-09-12T00:06:03.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7416000000000001e-05 2024-09-12T00:06:03.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.652 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.651876+0000", 2024-09-12T00:06:03.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9066999999999999e-05 2024-09-12T00:06:03.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.652 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.652 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:03.652 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.652058+0000", 2024-09-12T00:06:03.652 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018199500000000001 2024-09-12T00:06:03.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:03.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.652476+0000", 2024-09-12T00:06:03.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00041738000000000002 2024-09-12T00:06:03.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:06:03.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.652917+0000", 2024-09-12T00:06:03.653 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00044171899999999998 2024-09-12T00:06:03.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.653 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.653 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:03.653 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.667867+0000", 2024-09-12T00:06:03.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014949558 2024-09-12T00:06:03.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.654 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.668181+0000", 2024-09-12T00:06:03.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000313777 2024-09-12T00:06:03.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:03.654 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.668241+0000", 2024-09-12T00:06:03.654 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0047999999999998e-05 2024-09-12T00:06:03.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.654 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:03.655 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.668288+0000", 2024-09-12T00:06:03.655 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7339000000000002e-05 2024-09-12T00:06:03.655 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.655 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:03.655 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.655 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.655 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3726 3.33 e83/23 3:cd6e0a10:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_343:head v 83'15, mlcod=83'13)", 2024-09-12T00:06:03.655 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.871373+0000", 2024-09-12T00:06:03.655 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.710377471000001, 2024-09-12T00:06:03.655 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021131233999999999, 2024-09-12T00:06:03.655 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:03.655 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:03.655 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.656 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:03.656 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.656 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:03.656 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.871373+0000", 2024-09-12T00:06:03.656 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.656 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.656 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:03.656 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.871373+0000", 2024-09-12T00:06:03.656 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.656 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.656 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:03.656 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.871374+0000", 2024-09-12T00:06:03.656 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.505e-06 2024-09-12T00:06:03.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.657 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:03.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875356+0000", 2024-09-12T00:06:03.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039812060000000002 2024-09-12T00:06:03.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.657 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:03.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875381+0000", 2024-09-12T00:06:03.657 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5259999999999999e-05 2024-09-12T00:06:03.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.657 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.657 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.657 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875392+0000", 2024-09-12T00:06:03.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1211e-05 2024-09-12T00:06:03.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:03.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875472+0000", 2024-09-12T00:06:03.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9505999999999994e-05 2024-09-12T00:06:03.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:03.658 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875490+0000", 2024-09-12T00:06:03.658 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8819000000000001e-05 2024-09-12T00:06:03.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.658 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:03.659 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.892428+0000", 2024-09-12T00:06:03.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016937885 2024-09-12T00:06:03.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.659 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:03.659 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.892504+0000", 2024-09-12T00:06:03.659 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5841999999999997e-05 2024-09-12T00:06:03.659 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.659 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:03.659 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.659 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.659 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3727 3.35 3:ad6b6c99:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_344:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:03.659 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.876261+0000", 2024-09-12T00:06:03.659 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.705489654000001, 2024-09-12T00:06:03.660 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.029109105, 2024-09-12T00:06:03.660 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:03.660 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:03.660 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.660 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:03.660 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:03.660 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.660 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3727 2024-09-12T00:06:03.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.660 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:03.660 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.660 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:03.660 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.876261+0000", 2024-09-12T00:06:03.660 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.661 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.661 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:03.661 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.876261+0000", 2024-09-12T00:06:03.661 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.661 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.661 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:03.661 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.876264+0000", 2024-09-12T00:06:03.661 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.388e-06 2024-09-12T00:06:03.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.661 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.661 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:03.661 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878449+0000", 2024-09-12T00:06:03.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021847360000000001 2024-09-12T00:06:03.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:03.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878470+0000", 2024-09-12T00:06:03.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0792e-05 2024-09-12T00:06:03.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878481+0000", 2024-09-12T00:06:03.662 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1421e-05 2024-09-12T00:06:03.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.662 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.662 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:03.662 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878572+0000", 2024-09-12T00:06:03.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0882000000000002e-05 2024-09-12T00:06:03.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:03.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878763+0000", 2024-09-12T00:06:03.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191218 2024-09-12T00:06:03.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:06:03.663 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878938+0000", 2024-09-12T00:06:03.663 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017507300000000001 2024-09-12T00:06:03.663 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.663 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.663 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:03.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.900618+0000", 2024-09-12T00:06:03.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021679706 2024-09-12T00:06:03.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.905243+0000", 2024-09-12T00:06:03.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046246869999999997 2024-09-12T00:06:03.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.664 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:03.664 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.905314+0000", 2024-09-12T00:06:03.664 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1797000000000004e-05 2024-09-12T00:06:03.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.664 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.665 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:03.665 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.905370+0000", 2024-09-12T00:06:03.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5405000000000002e-05 2024-09-12T00:06:03.665 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.665 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:03.665 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.665 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.665 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3735 3.3f 3:fd0f007c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_352:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:03.665 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.971621+0000", 2024-09-12T00:06:03.665 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.610128827, 2024-09-12T00:06:03.665 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021631419999999998, 2024-09-12T00:06:03.665 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:03.665 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:03.666 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.666 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:03.666 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:03.666 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.666 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3735 2024-09-12T00:06:03.666 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.666 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:03.666 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.666 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:03.666 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.971621+0000", 2024-09-12T00:06:03.666 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.666 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.666 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.666 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:03.666 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.971621+0000", 2024-09-12T00:06:03.667 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.667 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.667 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:03.667 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.971626+0000", 2024-09-12T00:06:03.667 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.313e-06 2024-09-12T00:06:03.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.667 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.667 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:03.667 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973760+0000", 2024-09-12T00:06:03.667 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021346780000000001 2024-09-12T00:06:03.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.667 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.668 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:03.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973788+0000", 2024-09-12T00:06:03.668 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7327000000000001e-05 2024-09-12T00:06:03.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.668 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973799+0000", 2024-09-12T00:06:03.668 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1379999999999999e-05 2024-09-12T00:06:03.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.668 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.668 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:03.668 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973904+0000", 2024-09-12T00:06:03.668 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105071 2024-09-12T00:06:03.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:03.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.974119+0000", 2024-09-12T00:06:03.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021477399999999999 2024-09-12T00:06:03.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:06:03.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.974313+0000", 2024-09-12T00:06:03.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019439300000000001 2024-09-12T00:06:03.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.669 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.669 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:03.669 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.985849+0000", 2024-09-12T00:06:03.669 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011535915000000001 2024-09-12T00:06:03.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.993125+0000", 2024-09-12T00:06:03.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0072761299999999996 2024-09-12T00:06:03.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:03.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.993201+0000", 2024-09-12T00:06:03.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5098000000000005e-05 2024-09-12T00:06:03.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.670 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:03.670 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.993253+0000", 2024-09-12T00:06:03.670 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2340999999999999e-05 2024-09-12T00:06:03.670 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.671 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:03.671 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.671 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3756 3.15 3:aa8e955f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_373:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:03.671 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.207558+0000", 2024-09-12T00:06:03.671 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.374192010000002, 2024-09-12T00:06:03.671 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021266769000000001, 2024-09-12T00:06:03.671 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:03.671 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:03.671 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.671 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:03.671 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:03.671 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.671 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3756 2024-09-12T00:06:03.672 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.672 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:03.672 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.672 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:03.672 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.207558+0000", 2024-09-12T00:06:03.672 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.672 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.672 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.672 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:03.672 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.207558+0000", 2024-09-12T00:06:03.672 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.672 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.672 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.672 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:03.673 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.207561+0000", 2024-09-12T00:06:03.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9450000000000002e-06 2024-09-12T00:06:03.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.673 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:03.673 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209465+0000", 2024-09-12T00:06:03.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019040089999999999 2024-09-12T00:06:03.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.673 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:03.673 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209493+0000", 2024-09-12T00:06:03.673 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7645999999999999e-05 2024-09-12T00:06:03.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.673 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.673 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209507+0000", 2024-09-12T00:06:03.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4333e-05 2024-09-12T00:06:03.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.674 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:03.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209609+0000", 2024-09-12T00:06:03.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101543 2024-09-12T00:06:03.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.674 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:03.674 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209822+0000", 2024-09-12T00:06:03.674 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021320000000000001 2024-09-12T00:06:03.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.674 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.674 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:03.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.210009+0000", 2024-09-12T00:06:03.675 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000187228 2024-09-12T00:06:03.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:03.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.219744+0000", 2024-09-12T00:06:03.675 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0097345079999999994 2024-09-12T00:06:03.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.675 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.675 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.228686+0000", 2024-09-12T00:06:03.675 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0089426200000000001 2024-09-12T00:06:03.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.675 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:03.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.228768+0000", 2024-09-12T00:06:03.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2112000000000003e-05 2024-09-12T00:06:03.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.676 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:03.676 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.228825+0000", 2024-09-12T00:06:03.676 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6625000000000001e-05 2024-09-12T00:06:03.676 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.676 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:03.676 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.676 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.677 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3778 3.c 3:33bb2076:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_395:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:03.677 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.451174+0000", 2024-09-12T00:06:03.677 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.130575834999998, 2024-09-12T00:06:03.677 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021109749000000001, 2024-09-12T00:06:03.677 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:03.677 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:03.677 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.677 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:03.677 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:03.677 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.677 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3778 2024-09-12T00:06:03.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.677 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:03.677 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.678 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:03.678 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.451174+0000", 2024-09-12T00:06:03.678 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.678 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.678 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:03.678 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.451174+0000", 2024-09-12T00:06:03.678 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.678 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.678 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:03.678 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.451178+0000", 2024-09-12T00:06:03.678 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6289999999999999e-06 2024-09-12T00:06:03.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.678 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:03.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.453638+0000", 2024-09-12T00:06:03.679 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024596470000000001 2024-09-12T00:06:03.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:03.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.453658+0000", 2024-09-12T00:06:03.679 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0713e-05 2024-09-12T00:06:03.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.679 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.679 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.679 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.453673+0000", 2024-09-12T00:06:03.679 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4174e-05 2024-09-12T00:06:03.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:03.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.453804+0000", 2024-09-12T00:06:03.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013095000000000001 2024-09-12T00:06:03.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:03.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.454022+0000", 2024-09-12T00:06:03.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021806899999999999 2024-09-12T00:06:03.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.680 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.680 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:06:03.680 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.454175+0000", 2024-09-12T00:06:03.680 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015374099999999999 2024-09-12T00:06:03.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.681 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:03.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.462290+0000", 2024-09-12T00:06:03.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0081144359999999992 2024-09-12T00:06:03.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.681 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.472165+0000", 2024-09-12T00:06:03.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0098751140000000008 2024-09-12T00:06:03.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.681 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.681 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:03.681 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.472235+0000", 2024-09-12T00:06:03.681 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9793000000000001e-05 2024-09-12T00:06:03.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.682 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:03.682 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.472284+0000", 2024-09-12T00:06:03.682 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9483e-05 2024-09-12T00:06:03.682 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.682 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:03.682 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.682 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.682 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3785 3.15 3:ab478e86:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_402:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:03.682 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.539840+0000", 2024-09-12T00:06:03.682 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.0419105, 2024-09-12T00:06:03.682 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.023091957999999999, 2024-09-12T00:06:03.682 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:03.683 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:03.683 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.683 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:03.683 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:03.683 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.683 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3785 2024-09-12T00:06:03.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.683 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:03.683 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.683 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:03.683 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.539840+0000", 2024-09-12T00:06:03.683 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.683 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.684 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:03.684 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.539840+0000", 2024-09-12T00:06:03.684 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.684 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.684 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:03.684 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.539843+0000", 2024-09-12T00:06:03.684 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4410000000000002e-06 2024-09-12T00:06:03.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.684 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.684 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:03.684 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541660+0000", 2024-09-12T00:06:03.684 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0018169239999999999 2024-09-12T00:06:03.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.685 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.685 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:03.685 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541704+0000", 2024-09-12T00:06:03.685 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4072000000000001e-05 2024-09-12T00:06:03.685 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.685 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.685 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.685 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541726+0000", 2024-09-12T00:06:03.685 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1875e-05 2024-09-12T00:06:03.685 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.685 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.685 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:03.685 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541825+0000", 2024-09-12T00:06:03.685 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8500999999999998e-05 2024-09-12T00:06:03.685 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.686 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.686 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:03.686 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541997+0000", 2024-09-12T00:06:03.686 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000172781 2024-09-12T00:06:03.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.686 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.686 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:03.686 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.542177+0000", 2024-09-12T00:06:03.686 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018009699999999999 2024-09-12T00:06:03.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.686 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.686 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.686 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.558969+0000", 2024-09-12T00:06:03.686 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016791805999999999 2024-09-12T00:06:03.687 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.687 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.687 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:03.687 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.562789+0000", 2024-09-12T00:06:03.687 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003819308 2024-09-12T00:06:03.687 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.687 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.687 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:03.687 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.562869+0000", 2024-09-12T00:06:03.687 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0550999999999995e-05 2024-09-12T00:06:03.687 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.687 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.687 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:03.687 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.562932+0000", 2024-09-12T00:06:03.688 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2601999999999995e-05 2024-09-12T00:06:03.688 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.688 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:03.688 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.688 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.688 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.688 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3798 3.35 3:ac2a574a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_415:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:03.688 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.681661+0000", 2024-09-12T00:06:03.688 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 17.900089329, 2024-09-12T00:06:03.688 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.029133148000000001, 2024-09-12T00:06:03.688 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:03.688 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:03.688 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:03.689 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:03.689 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:03.689 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:03.689 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3798 2024-09-12T00:06:03.689 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.689 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:03.689 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.689 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:03.689 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.681661+0000", 2024-09-12T00:06:03.689 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.689 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.689 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.689 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:03.689 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.681661+0000", 2024-09-12T00:06:03.690 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:03.690 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.690 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.690 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:03.690 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.681665+0000", 2024-09-12T00:06:03.690 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.591e-06 2024-09-12T00:06:03.690 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.690 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.690 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:03.690 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683576+0000", 2024-09-12T00:06:03.690 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019111 2024-09-12T00:06:03.690 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.690 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.690 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:03.691 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683608+0000", 2024-09-12T00:06:03.691 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.269e-05 2024-09-12T00:06:03.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.691 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.691 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:03.691 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683623+0000", 2024-09-12T00:06:03.691 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4501000000000001e-05 2024-09-12T00:06:03.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.691 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.691 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:03.691 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683714+0000", 2024-09-12T00:06:03.691 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0666000000000002e-05 2024-09-12T00:06:03.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.691 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.691 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:03.692 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683913+0000", 2024-09-12T00:06:03.692 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000199037 2024-09-12T00:06:03.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.692 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.692 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:06:03.692 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.684084+0000", 2024-09-12T00:06:03.692 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017164700000000001 2024-09-12T00:06:03.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.692 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.692 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:03.692 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.697732+0000", 2024-09-12T00:06:03.692 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013647670000000001 2024-09-12T00:06:03.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.692 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.692 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:03.693 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.710663+0000", 2024-09-12T00:06:03.693 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012931265000000001 2024-09-12T00:06:03.693 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.693 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.693 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:03.693 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.710737+0000", 2024-09-12T00:06:03.693 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4181e-05 2024-09-12T00:06:03.693 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:03.693 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:03.693 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:03.693 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.710794+0000", 2024-09-12T00:06:03.693 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6799999999999998e-05 2024-09-12T00:06:03.693 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.693 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:03.694 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.694 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:03.694 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:03.694 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:06:03.695 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:06:03.696 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:06:03.696+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:06:03.797 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:06:03.796+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:06:03.819 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:06:03.819 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:06:03.819 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:06:03.819 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:06:03.832 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:06:03.897 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:06:03.899+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:06:03.946 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:06:03.946 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:06:03.946 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:06:03.947 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:06:03.947 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:06:03.959 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:06:03.998 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:06:04.000+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:06:04.099 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:06:04.100+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:06:04.121 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:06:04.121 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:06:04.121 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:06:04.121 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:06:04.121 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.122 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:06:04.122 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:06:04.122 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 172.62721515300001, 2024-09-12T00:06:04.122 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.278479906, 2024-09-12T00:06:04.122 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:04.122 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:04.122 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:04.122 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:04.122 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:06:04.122 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:06:04.122 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:06:04.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.123 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:04.123 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.123 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:04.123 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:06:04.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.123 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.123 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:04.123 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:06:04.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.124 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:04.124 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493422+0000", 2024-09-12T00:06:04.124 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.807e-06 2024-09-12T00:06:04.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.124 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:04.124 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493435+0000", 2024-09-12T00:06:04.124 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.375e-05 2024-09-12T00:06:04.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.125 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:04.125 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493457+0000", 2024-09-12T00:06:04.125 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2166000000000001e-05 2024-09-12T00:06:04.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.125 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.125 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:04.125 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493475+0000", 2024-09-12T00:06:04.125 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7184e-05 2024-09-12T00:06:04.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.125 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.125 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:04.125 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493617+0000", 2024-09-12T00:06:04.125 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014274200000000001 2024-09-12T00:06:04.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.126 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.126 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:06:04.126 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493632+0000", 2024-09-12T00:06:04.126 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4293e-05 2024-09-12T00:06:04.126 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.126 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.126 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:04.126 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.768657+0000", 2024-09-12T00:06:04.126 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.27502575400000001 2024-09-12T00:06:04.126 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.126 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.126 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:04.126 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769042+0000", 2024-09-12T00:06:04.126 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00038463700000000001 2024-09-12T00:06:04.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.127 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.127 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:04.127 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769430+0000", 2024-09-12T00:06:04.127 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000388014 2024-09-12T00:06:04.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.127 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.127 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:04.127 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.770784+0000", 2024-09-12T00:06:04.127 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00135402 2024-09-12T00:06:04.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.127 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.127 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:04.127 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771735+0000", 2024-09-12T00:06:04.128 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00095068599999999996 2024-09-12T00:06:04.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.128 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.128 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:04.128 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771828+0000", 2024-09-12T00:06:04.128 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3468999999999996e-05 2024-09-12T00:06:04.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.128 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.128 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:04.128 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771899+0000", 2024-09-12T00:06:04.128 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0383999999999996e-05 2024-09-12T00:06:04.128 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.128 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:04.128 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.129 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:06:04.129 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:06:04.129 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 172.19865175300001, 2024-09-12T00:06:04.129 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021018614000000001, 2024-09-12T00:06:04.129 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:04.129 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:04.129 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:04.129 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:04.129 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:06:04.129 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:06:04.129 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 50 2024-09-12T00:06:04.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.129 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:04.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:04.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:06:04.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:04.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:06:04.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:04.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921983+0000", 2024-09-12T00:06:04.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4499999999999996e-07 2024-09-12T00:06:04.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.131 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.131 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:04.131 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922071+0000", 2024-09-12T00:06:04.131 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8010000000000006e-05 2024-09-12T00:06:04.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.131 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.131 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:04.131 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922084+0000", 2024-09-12T00:06:04.131 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3275000000000001e-05 2024-09-12T00:06:04.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.131 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.131 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:04.131 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922093+0000", 2024-09-12T00:06:04.131 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0580000000000004e-06 2024-09-12T00:06:04.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.132 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.132 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:04.132 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936515+0000", 2024-09-12T00:06:04.132 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014421270999999999 2024-09-12T00:06:04.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.132 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.132 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:04.132 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936677+0000", 2024-09-12T00:06:04.132 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162003 2024-09-12T00:06:04.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.132 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.132 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:04.132 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936908+0000", 2024-09-12T00:06:04.133 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023115700000000001 2024-09-12T00:06:04.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.133 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.133 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:04.133 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939985+0000", 2024-09-12T00:06:04.133 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030773879999999999 2024-09-12T00:06:04.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.133 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.133 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:04.137 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942623+0000", 2024-09-12T00:06:04.137 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026377929999999998 2024-09-12T00:06:04.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.137 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.137 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:04.137 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942818+0000", 2024-09-12T00:06:04.137 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019556200000000001 2024-09-12T00:06:04.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.138 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.138 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:04.138 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943001+0000", 2024-09-12T00:06:04.138 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018235199999999999 2024-09-12T00:06:04.138 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.138 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:04.138 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.138 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.138 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:06:04.138 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:06:04.138 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 172.198517361, 2024-09-12T00:06:04.138 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021092493, 2024-09-12T00:06:04.139 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:04.139 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:04.139 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:04.139 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:04.139 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:06:04.139 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:06:04.139 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 51 2024-09-12T00:06:04.139 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.139 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:04.139 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.139 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:04.139 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:06:04.140 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.140 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.140 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:04.140 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:06:04.140 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.140 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.140 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:04.140 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922118+0000", 2024-09-12T00:06:04.140 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0389999999999999e-06 2024-09-12T00:06:04.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.141 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.141 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:04.141 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922124+0000", 2024-09-12T00:06:04.141 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5409999999999997e-06 2024-09-12T00:06:04.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.141 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.141 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:04.141 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922136+0000", 2024-09-12T00:06:04.141 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.205e-05 2024-09-12T00:06:04.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.141 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.141 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:04.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922147+0000", 2024-09-12T00:06:04.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0451e-05 2024-09-12T00:06:04.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:04.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938000+0000", 2024-09-12T00:06:04.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015853682000000001 2024-09-12T00:06:04.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:04.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938142+0000", 2024-09-12T00:06:04.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014148899999999999 2024-09-12T00:06:04.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.143 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.143 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:04.143 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938362+0000", 2024-09-12T00:06:04.143 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022034800000000001 2024-09-12T00:06:04.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.143 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.143 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:04.143 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940330+0000", 2024-09-12T00:06:04.143 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001967459 2024-09-12T00:06:04.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.143 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.143 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:04.144 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943064+0000", 2024-09-12T00:06:04.144 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027346219999999999 2024-09-12T00:06:04.144 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.144 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.144 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:04.144 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943152+0000", 2024-09-12T00:06:04.144 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7563000000000002e-05 2024-09-12T00:06:04.144 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.144 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.144 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:04.144 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943209+0000", 2024-09-12T00:06:04.145 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7249e-05 2024-09-12T00:06:04.145 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.145 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:04.145 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.145 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.145 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:06:04.145 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:06:04.145 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 172.19846786799999, 2024-09-12T00:06:04.146 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021175616000000001, 2024-09-12T00:06:04.146 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:04.146 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:04.146 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:04.146 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:04.146 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:06:04.146 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:06:04.146 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 52 2024-09-12T00:06:04.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.146 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:04.146 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.146 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:04.147 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:06:04.147 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.147 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:04.147 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:06:04.147 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.147 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:04.147 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922167+0000", 2024-09-12T00:06:04.148 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3300000000000001e-07 2024-09-12T00:06:04.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.148 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.148 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:04.148 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922174+0000", 2024-09-12T00:06:04.148 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7070000000000003e-06 2024-09-12T00:06:04.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.148 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.148 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:04.148 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922184+0000", 2024-09-12T00:06:04.148 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682e-05 2024-09-12T00:06:04.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.149 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.149 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:04.149 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922195+0000", 2024-09-12T00:06:04.149 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0489000000000001e-05 2024-09-12T00:06:04.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.149 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.149 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:04.149 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939166+0000", 2024-09-12T00:06:04.149 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016971245999999999 2024-09-12T00:06:04.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.149 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.149 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:04.150 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939243+0000", 2024-09-12T00:06:04.150 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7201999999999997e-05 2024-09-12T00:06:04.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.150 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.150 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:04.150 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939381+0000", 2024-09-12T00:06:04.150 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013770699999999999 2024-09-12T00:06:04.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.150 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.150 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:04.150 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940923+0000", 2024-09-12T00:06:04.151 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001542302 2024-09-12T00:06:04.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.151 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:04.151 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943221+0000", 2024-09-12T00:06:04.151 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022979720000000001 2024-09-12T00:06:04.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.151 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:04.151 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943295+0000", 2024-09-12T00:06:04.151 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3317000000000003e-05 2024-09-12T00:06:04.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.152 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:04.152 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943342+0000", 2024-09-12T00:06:04.152 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7159e-05 2024-09-12T00:06:04.152 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.152 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:04.152 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.152 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.152 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.152 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:06:04.152 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:06:04.152 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 171.949195248, 2024-09-12T00:06:04.153 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020263554, 2024-09-12T00:06:04.153 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:04.153 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:04.153 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:04.153 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:04.153 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:06:04.153 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:06:04.153 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 71 2024-09-12T00:06:04.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.153 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:04.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.154 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:04.154 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:06:04.154 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.154 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:04.154 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:06:04.154 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.155 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.155 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:04.155 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171439+0000", 2024-09-12T00:06:04.155 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5000000000000002e-07 2024-09-12T00:06:04.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.155 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.155 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:04.155 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171454+0000", 2024-09-12T00:06:04.155 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5046e-05 2024-09-12T00:06:04.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.155 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.156 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:04.156 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171471+0000", 2024-09-12T00:06:04.156 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6923999999999999e-05 2024-09-12T00:06:04.156 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.156 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.156 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:04.156 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171487+0000", 2024-09-12T00:06:04.156 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5823000000000001e-05 2024-09-12T00:06:04.156 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.156 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.156 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:04.156 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180765+0000", 2024-09-12T00:06:04.157 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0092774399999999996 2024-09-12T00:06:04.157 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.157 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.157 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:04.157 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.180900+0000", 2024-09-12T00:06:04.157 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013556700000000001 2024-09-12T00:06:04.157 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.157 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.157 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:04.157 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.181108+0000", 2024-09-12T00:06:04.157 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020727899999999999 2024-09-12T00:06:04.157 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.157 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.157 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:04.158 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184725+0000", 2024-09-12T00:06:04.158 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0036171340000000001 2024-09-12T00:06:04.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.158 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.158 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:04.158 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191413+0000", 2024-09-12T00:06:04.158 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0066881830000000003 2024-09-12T00:06:04.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.158 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.158 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:04.158 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191540+0000", 2024-09-12T00:06:04.158 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000126823 2024-09-12T00:06:04.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.158 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.159 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:04.159 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191702+0000", 2024-09-12T00:06:04.159 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162585 2024-09-12T00:06:04.159 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.159 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:04.159 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.159 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:06:04.159 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:06:04.159 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 171.949116672, 2024-09-12T00:06:04.159 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020448573000000001, 2024-09-12T00:06:04.159 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:04.159 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:04.160 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:04.160 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:04.160 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:06:04.160 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:06:04.160 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 72 2024-09-12T00:06:04.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.160 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:04.160 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.160 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:04.160 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:06:04.160 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.160 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.160 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:04.161 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:06:04.161 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.161 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.161 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.161 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:04.161 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171518+0000", 2024-09-12T00:06:04.161 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0440000000000001e-06 2024-09-12T00:06:04.161 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.161 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.161 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:04.161 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171647+0000", 2024-09-12T00:06:04.161 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012912899999999999 2024-09-12T00:06:04.161 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.162 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.162 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:04.162 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171664+0000", 2024-09-12T00:06:04.163 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6079999999999999e-05 2024-09-12T00:06:04.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.163 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.163 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:04.163 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171675+0000", 2024-09-12T00:06:04.163 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1223000000000001e-05 2024-09-12T00:06:04.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.163 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.163 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:04.163 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182000+0000", 2024-09-12T00:06:04.163 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010324949 2024-09-12T00:06:04.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.164 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:04.164 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182178+0000", 2024-09-12T00:06:04.164 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017808799999999999 2024-09-12T00:06:04.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.164 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:04.164 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182402+0000", 2024-09-12T00:06:04.164 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022381199999999999 2024-09-12T00:06:04.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.165 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:04.165 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190935+0000", 2024-09-12T00:06:04.165 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085331560000000001 2024-09-12T00:06:04.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.165 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.165 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:04.165 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191728+0000", 2024-09-12T00:06:04.165 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079325700000000001 2024-09-12T00:06:04.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.165 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.165 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:04.165 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191864+0000", 2024-09-12T00:06:04.165 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013606299999999999 2024-09-12T00:06:04.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.166 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.166 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:04.166 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191966+0000", 2024-09-12T00:06:04.166 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101772 2024-09-12T00:06:04.166 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.166 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:04.166 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.166 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.166 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.166 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:06:04.166 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:06:04.166 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 171.948933477, 2024-09-12T00:06:04.166 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020675235, 2024-09-12T00:06:04.166 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:04.167 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:04.167 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:04.167 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:04.167 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:06:04.167 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:06:04.167 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 73 2024-09-12T00:06:04.167 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.167 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:04.167 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.167 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:04.167 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:06:04.167 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.167 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.167 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.168 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:04.168 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:06:04.168 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.168 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.168 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.168 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:04.168 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171701+0000", 2024-09-12T00:06:04.168 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0999999999999997e-07 2024-09-12T00:06:04.168 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.168 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.168 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:04.168 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171709+0000", 2024-09-12T00:06:04.169 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2540000000000003e-06 2024-09-12T00:06:04.169 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.169 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.169 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:04.169 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171724+0000", 2024-09-12T00:06:04.169 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5569e-05 2024-09-12T00:06:04.169 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.169 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.169 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:04.169 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171734+0000", 2024-09-12T00:06:04.169 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6139999999999998e-06 2024-09-12T00:06:04.169 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.169 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.170 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:04.170 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183774+0000", 2024-09-12T00:06:04.170 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012040444000000001 2024-09-12T00:06:04.170 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.170 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.170 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:04.170 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183896+0000", 2024-09-12T00:06:04.170 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012204199999999999 2024-09-12T00:06:04.170 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.170 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.170 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:04.170 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184084+0000", 2024-09-12T00:06:04.171 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018792599999999999 2024-09-12T00:06:04.171 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.171 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.171 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:04.171 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191984+0000", 2024-09-12T00:06:04.171 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079003790000000008 2024-09-12T00:06:04.171 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.171 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.171 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:04.171 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192093+0000", 2024-09-12T00:06:04.171 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000108942 2024-09-12T00:06:04.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.172 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.172 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:04.172 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192250+0000", 2024-09-12T00:06:04.172 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015637600000000001 2024-09-12T00:06:04.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.172 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.172 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:04.172 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192376+0000", 2024-09-12T00:06:04.172 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012587899999999999 2024-09-12T00:06:04.172 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.173 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:04.173 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.173 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.173 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.173 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:06:04.173 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:06:04.173 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 171.94888526700001, 2024-09-12T00:06:04.173 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021088828, 2024-09-12T00:06:04.173 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:04.173 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:04.173 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:04.173 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:04.174 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:06:04.174 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:06:04.174 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 74 2024-09-12T00:06:04.174 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.174 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:04.174 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.174 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:04.174 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:06:04.174 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.174 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.174 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.174 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:04.175 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:06:04.175 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.175 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.175 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.175 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:04.175 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:06:04.175 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1699999999999997e-07 2024-09-12T00:06:04.175 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.175 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.175 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:04.175 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171758+0000", 2024-09-12T00:06:04.175 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0860000000000008e-06 2024-09-12T00:06:04.175 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.176 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.176 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:04.176 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171774+0000", 2024-09-12T00:06:04.176 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:06:04.176 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.176 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.176 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:04.176 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171788+0000", 2024-09-12T00:06:04.176 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4793999999999999e-05 2024-09-12T00:06:04.176 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.176 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.177 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:04.177 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184842+0000", 2024-09-12T00:06:04.177 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013053607 2024-09-12T00:06:04.177 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.177 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.177 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:04.177 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185130+0000", 2024-09-12T00:06:04.177 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00028779199999999998 2024-09-12T00:06:04.177 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.177 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.177 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:04.178 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185378+0000", 2024-09-12T00:06:04.178 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024780100000000002 2024-09-12T00:06:04.178 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.178 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.178 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:04.178 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192513+0000", 2024-09-12T00:06:04.178 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071350770000000001 2024-09-12T00:06:04.178 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.178 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.178 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:04.178 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192690+0000", 2024-09-12T00:06:04.178 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000176892 2024-09-12T00:06:04.179 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.179 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.179 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:04.179 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192769+0000", 2024-09-12T00:06:04.179 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9466000000000001e-05 2024-09-12T00:06:04.179 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.179 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.180 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:04.180 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192837+0000", 2024-09-12T00:06:04.180 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8466000000000005e-05 2024-09-12T00:06:04.180 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.180 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:04.180 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.180 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.180 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.180 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:06:04.180 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:06:04.180 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 171.94883268999999, 2024-09-12T00:06:04.180 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.02121994, 2024-09-12T00:06:04.180 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:04.181 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:04.181 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:04.181 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:04.181 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:06:04.181 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:06:04.181 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 75 2024-09-12T00:06:04.181 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.181 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:04.181 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.181 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:04.181 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:06:04.181 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.181 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.181 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.182 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:04.182 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:06:04.182 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.182 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.182 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.182 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:04.182 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171802+0000", 2024-09-12T00:06:04.182 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5000000000000002e-07 2024-09-12T00:06:04.182 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.182 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.182 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:04.183 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171954+0000", 2024-09-12T00:06:04.183 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015215500000000001 2024-09-12T00:06:04.183 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.183 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.183 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:04.183 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171966+0000", 2024-09-12T00:06:04.183 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1548e-05 2024-09-12T00:06:04.183 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.183 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.183 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:04.183 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171970+0000", 2024-09-12T00:06:04.184 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8729999999999998e-06 2024-09-12T00:06:04.184 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.184 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.184 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:04.184 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186552+0000", 2024-09-12T00:06:04.184 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014581775 2024-09-12T00:06:04.184 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.184 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.184 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:04.184 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186702+0000", 2024-09-12T00:06:04.184 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014946 2024-09-12T00:06:04.184 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.185 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.185 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:04.185 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186897+0000", 2024-09-12T00:06:04.185 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000195071 2024-09-12T00:06:04.185 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.185 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.185 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:04.185 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192666+0000", 2024-09-12T00:06:04.185 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057693470000000002 2024-09-12T00:06:04.185 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.185 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.185 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192857+0000", 2024-09-12T00:06:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191149 2024-09-12T00:06:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192967+0000", 2024-09-12T00:06:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110202 2024-09-12T00:06:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193021+0000", 2024-09-12T00:06:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3709999999999999e-05 2024-09-12T00:06:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:04.187 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.187 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.187 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:06:04.187 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:06:04.187 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 171.94865339500001, 2024-09-12T00:06:04.187 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026297425999999999, 2024-09-12T00:06:04.187 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:04.187 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:04.187 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:04.187 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:04.187 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:06:04.187 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:06:04.187 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 76 2024-09-12T00:06:04.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.188 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:04.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.188 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:04.188 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:06:04.188 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.188 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:04.188 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:06:04.188 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.189 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:04.189 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:06:04.189 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9399999999999995e-07 2024-09-12T00:06:04.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.189 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.189 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:04.189 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171987+0000", 2024-09-12T00:06:04.189 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5230000000000003e-06 2024-09-12T00:06:04.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.189 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.189 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:04.189 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172005+0000", 2024-09-12T00:06:04.189 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8788e-05 2024-09-12T00:06:04.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.190 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.190 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:04.190 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172010+0000", 2024-09-12T00:06:04.190 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7570000000000004e-06 2024-09-12T00:06:04.190 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.190 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.190 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:04.190 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193104+0000", 2024-09-12T00:06:04.190 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021094112000000002 2024-09-12T00:06:04.190 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.190 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.191 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:04.191 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193334+0000", 2024-09-12T00:06:04.191 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000229855 2024-09-12T00:06:04.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.191 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.191 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:04.191 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193697+0000", 2024-09-12T00:06:04.191 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00036272399999999998 2024-09-12T00:06:04.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.191 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.191 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:04.191 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.195602+0000", 2024-09-12T00:06:04.191 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019049620000000001 2024-09-12T00:06:04.192 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.192 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.192 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:04.192 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198123+0000", 2024-09-12T00:06:04.192 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025216520000000001 2024-09-12T00:06:04.192 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.192 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.192 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:04.192 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198213+0000", 2024-09-12T00:06:04.192 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0008999999999998e-05 2024-09-12T00:06:04.192 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.192 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.192 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:04.192 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198278+0000", 2024-09-12T00:06:04.193 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4549999999999997e-05 2024-09-12T00:06:04.193 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.193 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:04.193 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.193 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.193 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2996 3.21 e75/23 3:872b1c12:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_35:head v 75'4, mlcod=63'2)", 2024-09-12T00:06:04.193 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.357371+0000", 2024-09-12T00:06:04.193 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 43.763262975000004, 2024-09-12T00:06:04.193 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021201353999999999, 2024-09-12T00:06:04.193 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:04.194 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:04.194 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:04.194 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:04.194 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.194 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:04.194 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.357371+0000", 2024-09-12T00:06:04.194 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.194 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.194 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:04.194 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.357371+0000", 2024-09-12T00:06:04.194 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.195 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.195 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:04.195 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.357372+0000", 2024-09-12T00:06:04.195 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.424e-06 2024-09-12T00:06:04.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.195 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.195 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:04.195 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.364586+0000", 2024-09-12T00:06:04.195 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0072140609999999999 2024-09-12T00:06:04.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.195 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.195 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:04.195 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.364611+0000", 2024-09-12T00:06:04.195 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4593e-05 2024-09-12T00:06:04.196 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.196 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.196 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:04.196 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.364625+0000", 2024-09-12T00:06:04.196 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3974999999999999e-05 2024-09-12T00:06:04.196 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.196 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.196 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:04.196 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.364718+0000", 2024-09-12T00:06:04.196 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2899000000000006e-05 2024-09-12T00:06:04.196 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.196 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.196 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:04.196 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.364748+0000", 2024-09-12T00:06:04.197 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9629999999999999e-05 2024-09-12T00:06:04.197 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.197 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.197 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:04.197 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.378470+0000", 2024-09-12T00:06:04.197 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013722323999999999 2024-09-12T00:06:04.197 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.197 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.197 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:04.197 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.378572+0000", 2024-09-12T00:06:04.197 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010244800000000001 2024-09-12T00:06:04.197 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.197 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:04.197 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.198 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.198 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.198 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3031 3.1c 3:3b901b6c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:04.198 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.749824+0000", 2024-09-12T00:06:04.198 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 43.370809545, 2024-09-12T00:06:04.198 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025171115000000001, 2024-09-12T00:06:04.198 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:04.198 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:04.198 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:04.198 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:04.198 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:04.198 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:04.198 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3031 2024-09-12T00:06:04.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.199 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:04.199 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.199 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:04.199 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.749824+0000", 2024-09-12T00:06:04.199 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.199 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.199 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:04.199 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.749824+0000", 2024-09-12T00:06:04.199 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.199 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.200 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:04.200 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.749828+0000", 2024-09-12T00:06:04.200 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.839e-06 2024-09-12T00:06:04.200 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.200 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.200 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:04.200 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.751966+0000", 2024-09-12T00:06:04.200 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021378360000000002 2024-09-12T00:06:04.201 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.201 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.201 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:04.201 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.751995+0000", 2024-09-12T00:06:04.201 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8631000000000001e-05 2024-09-12T00:06:04.201 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.201 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.201 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:04.201 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.752010+0000", 2024-09-12T00:06:04.201 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4899000000000001e-05 2024-09-12T00:06:04.201 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.202 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.202 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:04.202 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.752090+0000", 2024-09-12T00:06:04.202 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0352000000000006e-05 2024-09-12T00:06:04.202 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.202 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.202 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:04.202 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.752237+0000", 2024-09-12T00:06:04.202 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014683400000000001 2024-09-12T00:06:04.202 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.202 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.203 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:06:04.203 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.752389+0000", 2024-09-12T00:06:04.203 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015245699999999999 2024-09-12T00:06:04.203 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.203 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.203 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:04.203 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.769694+0000", 2024-09-12T00:06:04.203 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017305259 2024-09-12T00:06:04.203 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.203 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.203 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:04.203 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.774831+0000", 2024-09-12T00:06:04.204 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0051360360000000001 2024-09-12T00:06:04.204 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.204 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.204 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:04.204 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.774895+0000", 2024-09-12T00:06:04.204 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4454000000000003e-05 2024-09-12T00:06:04.204 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.204 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.204 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:04.204 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.774995+0000", 2024-09-12T00:06:04.204 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100518 2024-09-12T00:06:04.204 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.205 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:04.205 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.205 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.205 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3034 3.2a 3:57bb186b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:04.205 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.782449+0000", 2024-09-12T00:06:04.205 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 43.338185203999998, 2024-09-12T00:06:04.205 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022965039999999999, 2024-09-12T00:06:04.205 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:04.205 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:04.205 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:04.206 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:04.206 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:04.206 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:04.206 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3034 2024-09-12T00:06:04.206 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.206 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:04.206 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.206 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:04.206 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.782449+0000", 2024-09-12T00:06:04.206 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.206 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.206 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.207 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:04.207 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.782449+0000", 2024-09-12T00:06:04.207 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.207 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.207 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.207 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:04.207 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.782452+0000", 2024-09-12T00:06:04.207 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3670000000000001e-06 2024-09-12T00:06:04.207 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.207 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.207 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:04.207 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.784814+0000", 2024-09-12T00:06:04.208 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023623030000000001 2024-09-12T00:06:04.208 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.208 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.208 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:04.208 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.784849+0000", 2024-09-12T00:06:04.208 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4245999999999997e-05 2024-09-12T00:06:04.208 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.208 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.208 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:04.208 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.784875+0000", 2024-09-12T00:06:04.208 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6455999999999999e-05 2024-09-12T00:06:04.208 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.209 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.209 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:04.209 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.784972+0000", 2024-09-12T00:06:04.209 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7316000000000001e-05 2024-09-12T00:06:04.209 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.209 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.209 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:04.209 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.785154+0000", 2024-09-12T00:06:04.209 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018166499999999999 2024-09-12T00:06:04.209 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.209 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.209 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:06:04.210 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.785320+0000", 2024-09-12T00:06:04.210 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016586500000000001 2024-09-12T00:06:04.210 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.210 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.210 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:04.210 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.804742+0000", 2024-09-12T00:06:04.210 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019421600000000001 2024-09-12T00:06:04.210 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.210 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.210 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:04.210 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.805237+0000", 2024-09-12T00:06:04.211 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00049526400000000003 2024-09-12T00:06:04.211 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.211 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.211 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:04.211 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.805336+0000", 2024-09-12T00:06:04.211 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8912000000000004e-05 2024-09-12T00:06:04.211 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.211 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.211 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:04.211 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.805414+0000", 2024-09-12T00:06:04.211 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8046000000000005e-05 2024-09-12T00:06:04.211 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.212 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:04.212 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.212 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.212 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.212 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3133 3.10 3:0bd95b9d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:06:04.212 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:22.028646+0000", 2024-09-12T00:06:04.212 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 42.091987848999999, 2024-09-12T00:06:04.212 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.028771254, 2024-09-12T00:06:04.212 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:04.212 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:04.212 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:04.212 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:04.213 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:04.213 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:04.213 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3133 2024-09-12T00:06:04.213 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.213 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:04.213 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.213 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:04.213 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.028646+0000", 2024-09-12T00:06:04.213 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.213 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.213 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.213 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:04.214 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.028646+0000", 2024-09-12T00:06:04.214 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.214 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.214 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:04.214 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.028650+0000", 2024-09-12T00:06:04.214 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8850000000000001e-06 2024-09-12T00:06:04.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.214 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.214 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:04.214 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.030628+0000", 2024-09-12T00:06:04.214 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019778450000000002 2024-09-12T00:06:04.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.215 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.215 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:04.215 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.030658+0000", 2024-09-12T00:06:04.215 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0275999999999999e-05 2024-09-12T00:06:04.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.215 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.215 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:04.215 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.030670+0000", 2024-09-12T00:06:04.215 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2218000000000001e-05 2024-09-12T00:06:04.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.215 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.215 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:04.216 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.030764+0000", 2024-09-12T00:06:04.216 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3953e-05 2024-09-12T00:06:04.216 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.216 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.216 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:04.216 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.030996+0000", 2024-09-12T00:06:04.216 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023209500000000001 2024-09-12T00:06:04.216 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.216 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.216 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:04.216 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.031190+0000", 2024-09-12T00:06:04.216 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019345699999999999 2024-09-12T00:06:04.216 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.217 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.217 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:04.217 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.036754+0000", 2024-09-12T00:06:04.217 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055638980000000003 2024-09-12T00:06:04.217 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.217 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.217 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:04.217 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.057277+0000", 2024-09-12T00:06:04.217 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020523604000000001 2024-09-12T00:06:04.217 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.217 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.217 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:04.217 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.057358+0000", 2024-09-12T00:06:04.217 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1143999999999994e-05 2024-09-12T00:06:04.217 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.218 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.218 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:04.218 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.057417+0000", 2024-09-12T00:06:04.218 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8879000000000003e-05 2024-09-12T00:06:04.218 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.218 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:04.218 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.218 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.218 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.218 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3374 3.10 3:089db4d6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:06:04.218 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.636005+0000", 2024-09-12T00:06:04.218 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.484629193, 2024-09-12T00:06:04.218 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025433803000000001, 2024-09-12T00:06:04.218 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:04.219 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:04.219 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:04.219 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:04.219 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:04.219 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:04.219 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3374 2024-09-12T00:06:04.219 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.219 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:04.219 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.219 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:04.219 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.636005+0000", 2024-09-12T00:06:04.219 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.219 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.219 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.220 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:04.220 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.636005+0000", 2024-09-12T00:06:04.220 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.220 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.220 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:04.220 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.636009+0000", 2024-09-12T00:06:04.220 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2250000000000002e-06 2024-09-12T00:06:04.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.220 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.220 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:04.220 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639097+0000", 2024-09-12T00:06:04.220 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030881020000000001 2024-09-12T00:06:04.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.220 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.221 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:04.221 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639124+0000", 2024-09-12T00:06:04.221 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7390999999999999e-05 2024-09-12T00:06:04.221 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.221 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.221 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:04.221 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639138+0000", 2024-09-12T00:06:04.221 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3155e-05 2024-09-12T00:06:04.221 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.221 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.221 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:04.221 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639221+0000", 2024-09-12T00:06:04.221 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2996000000000003e-05 2024-09-12T00:06:04.222 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.222 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.222 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:04.222 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639390+0000", 2024-09-12T00:06:04.222 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016898999999999999 2024-09-12T00:06:04.222 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.222 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.222 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:04.222 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639547+0000", 2024-09-12T00:06:04.222 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000157374 2024-09-12T00:06:04.222 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.222 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.222 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:04.222 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.651089+0000", 2024-09-12T00:06:04.222 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011542124000000001 2024-09-12T00:06:04.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.223 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.223 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:04.223 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.661319+0000", 2024-09-12T00:06:04.223 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010229538999999999 2024-09-12T00:06:04.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.223 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.223 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:04.223 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.661387+0000", 2024-09-12T00:06:04.223 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8663000000000003e-05 2024-09-12T00:06:04.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.223 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.223 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:04.223 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.661439+0000", 2024-09-12T00:06:04.224 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1243999999999999e-05 2024-09-12T00:06:04.224 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.224 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:04.224 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.224 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.224 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.224 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3712 3.1c 3:3a424314:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_329:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:04.224 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.670012+0000", 2024-09-12T00:06:04.224 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 19.450622029000002, 2024-09-12T00:06:04.224 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.024941801999999999, 2024-09-12T00:06:04.224 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:04.224 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:04.224 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:04.224 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:04.224 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:04.225 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:04.225 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3712 2024-09-12T00:06:04.225 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.225 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:04.225 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.225 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:04.225 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.670012+0000", 2024-09-12T00:06:04.225 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.225 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.225 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.225 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:04.225 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.670012+0000", 2024-09-12T00:06:04.225 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.226 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.226 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.226 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:04.226 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.670016+0000", 2024-09-12T00:06:04.226 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2169999999999996e-06 2024-09-12T00:06:04.226 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.226 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.226 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:04.226 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.672951+0000", 2024-09-12T00:06:04.226 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029345159999999999 2024-09-12T00:06:04.226 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.226 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.227 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:04.227 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.672998+0000", 2024-09-12T00:06:04.227 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7605999999999998e-05 2024-09-12T00:06:04.227 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.227 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.227 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:04.227 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.673019+0000", 2024-09-12T00:06:04.227 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0843e-05 2024-09-12T00:06:04.227 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.227 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.227 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:04.227 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.673187+0000", 2024-09-12T00:06:04.227 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016786899999999999 2024-09-12T00:06:04.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.228 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.228 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:04.228 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.673628+0000", 2024-09-12T00:06:04.228 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00044081600000000002 2024-09-12T00:06:04.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.228 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.228 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:06:04.228 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.674047+0000", 2024-09-12T00:06:04.228 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00041917300000000001 2024-09-12T00:06:04.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.229 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.229 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:04.229 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.685347+0000", 2024-09-12T00:06:04.229 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011300464 2024-09-12T00:06:04.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.229 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.229 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:04.229 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.694777+0000", 2024-09-12T00:06:04.229 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0094296550000000003 2024-09-12T00:06:04.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.229 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.229 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:04.229 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.694876+0000", 2024-09-12T00:06:04.230 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8488999999999998e-05 2024-09-12T00:06:04.230 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.230 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.230 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:04.230 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.694954+0000", 2024-09-12T00:06:04.230 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8153999999999997e-05 2024-09-12T00:06:04.230 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.230 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:04.230 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.230 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.230 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.230 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3722 3.1a 3:5af5b5cf:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_339:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:04.231 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.814831+0000", 2024-09-12T00:06:04.231 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 19.305802456999999, 2024-09-12T00:06:04.231 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021631714, 2024-09-12T00:06:04.231 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:04.231 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:04.231 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:04.231 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:04.231 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:04.231 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:04.231 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3722 2024-09-12T00:06:04.231 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.232 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:04.232 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.232 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:04.232 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.814831+0000", 2024-09-12T00:06:04.232 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.232 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.232 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.232 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:04.232 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.814831+0000", 2024-09-12T00:06:04.232 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.232 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.233 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.233 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:04.233 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.814836+0000", 2024-09-12T00:06:04.233 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3409999999999996e-06 2024-09-12T00:06:04.233 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.233 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.233 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:04.233 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.816751+0000", 2024-09-12T00:06:04.233 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001915564 2024-09-12T00:06:04.233 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.233 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.234 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:04.234 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.816790+0000", 2024-09-12T00:06:04.234 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8355000000000001e-05 2024-09-12T00:06:04.234 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.234 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.234 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:04.234 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.816807+0000", 2024-09-12T00:06:04.234 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7703999999999999e-05 2024-09-12T00:06:04.234 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.234 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.234 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:04.234 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.816940+0000", 2024-09-12T00:06:04.235 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013292600000000001 2024-09-12T00:06:04.235 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.235 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.235 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:04.235 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.817155+0000", 2024-09-12T00:06:04.235 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021460699999999999 2024-09-12T00:06:04.235 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.235 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.235 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:04.235 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.817330+0000", 2024-09-12T00:06:04.235 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017552600000000001 2024-09-12T00:06:04.235 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.236 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.236 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:04.236 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.827842+0000", 2024-09-12T00:06:04.236 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010511533999999999 2024-09-12T00:06:04.236 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.236 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.236 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:04.236 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.836260+0000", 2024-09-12T00:06:04.236 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0084178399999999994 2024-09-12T00:06:04.236 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.236 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.236 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:04.237 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.836347+0000", 2024-09-12T00:06:04.237 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6637000000000004e-05 2024-09-12T00:06:04.237 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.237 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.237 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:04.237 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.836463+0000", 2024-09-12T00:06:04.237 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011668 2024-09-12T00:06:04.237 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.237 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:04.238 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.238 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.238 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.238 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3780 3.19 e83/23 3:9a0a1200:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_397:head v 83'18, mlcod=83'16)", 2024-09-12T00:06:04.238 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.485629+0000", 2024-09-12T00:06:04.238 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.635005358000001, 2024-09-12T00:06:04.238 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020596468, 2024-09-12T00:06:04.238 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:04.238 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:04.239 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:04.239 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:04.239 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.239 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:04.239 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.485629+0000", 2024-09-12T00:06:04.239 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.239 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.239 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.239 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:04.239 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.485629+0000", 2024-09-12T00:06:04.239 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.239 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.240 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.240 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:04.240 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.485631+0000", 2024-09-12T00:06:04.240 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9019999999999999e-06 2024-09-12T00:06:04.240 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.240 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.240 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:04.240 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.491531+0000", 2024-09-12T00:06:04.240 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058997870000000001 2024-09-12T00:06:04.240 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.240 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.240 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:04.240 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.491569+0000", 2024-09-12T00:06:04.241 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7432999999999999e-05 2024-09-12T00:06:04.241 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.241 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.241 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:04.241 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.491585+0000", 2024-09-12T00:06:04.241 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6651e-05 2024-09-12T00:06:04.241 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.241 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.241 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:04.241 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.491687+0000", 2024-09-12T00:06:04.241 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101366 2024-09-12T00:06:04.242 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.242 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.242 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:04.242 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.491718+0000", 2024-09-12T00:06:04.242 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1031000000000002e-05 2024-09-12T00:06:04.242 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.242 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.242 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:04.242 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.506043+0000", 2024-09-12T00:06:04.242 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014325311 2024-09-12T00:06:04.242 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.242 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.243 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:04.243 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.506225+0000", 2024-09-12T00:06:04.243 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018198699999999999 2024-09-12T00:06:04.243 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.243 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:04.243 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.243 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.243 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.243 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3783 3.1c 3:38213e46:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_400:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:04.243 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.514915+0000", 2024-09-12T00:06:04.243 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.605718695, 2024-09-12T00:06:04.243 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021806478000000001, 2024-09-12T00:06:04.243 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:04.243 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:04.244 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:04.244 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:04.244 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:04.244 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:04.244 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3783 2024-09-12T00:06:04.244 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.244 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:04.244 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.244 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:04.244 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.514915+0000", 2024-09-12T00:06:04.244 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.244 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.244 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.244 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:04.245 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.514915+0000", 2024-09-12T00:06:04.245 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.245 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.245 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.245 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:04.245 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.514920+0000", 2024-09-12T00:06:04.245 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7480000000000001e-06 2024-09-12T00:06:04.245 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.245 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.245 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:04.245 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517111+0000", 2024-09-12T00:06:04.245 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021913890000000002 2024-09-12T00:06:04.245 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.245 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.245 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:04.246 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517157+0000", 2024-09-12T00:06:04.246 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5754000000000003e-05 2024-09-12T00:06:04.246 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.246 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.246 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:04.246 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517177+0000", 2024-09-12T00:06:04.246 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0197999999999999e-05 2024-09-12T00:06:04.246 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.246 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.246 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:04.246 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517294+0000", 2024-09-12T00:06:04.246 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000117156 2024-09-12T00:06:04.246 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.247 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.247 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:04.247 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517503+0000", 2024-09-12T00:06:04.247 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020805500000000001 2024-09-12T00:06:04.247 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.247 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.247 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:06:04.247 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517714+0000", 2024-09-12T00:06:04.247 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021131399999999999 2024-09-12T00:06:04.247 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.247 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.247 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:04.247 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.535744+0000", 2024-09-12T00:06:04.247 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018029677000000001 2024-09-12T00:06:04.248 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.248 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.248 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:04.248 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.536543+0000", 2024-09-12T00:06:04.248 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079940499999999999 2024-09-12T00:06:04.248 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.248 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.248 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:04.248 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.536642+0000", 2024-09-12T00:06:04.248 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.9440999999999999e-05 2024-09-12T00:06:04.248 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.248 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.248 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:04.248 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.536722+0000", 2024-09-12T00:06:04.249 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9340999999999998e-05 2024-09-12T00:06:04.249 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.249 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:04.249 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.249 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.249 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.249 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3786 3.37 3:ece0bced:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_403:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:04.249 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.550483+0000", 2024-09-12T00:06:04.249 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 18.570151367000001, 2024-09-12T00:06:04.249 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022719506, 2024-09-12T00:06:04.249 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:04.249 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:04.249 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:04.249 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:04.250 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:04.250 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:04.250 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3786 2024-09-12T00:06:04.250 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.250 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:04.250 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.250 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:04.250 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.550483+0000", 2024-09-12T00:06:04.250 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.250 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.250 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.250 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:04.250 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.550483+0000", 2024-09-12T00:06:04.250 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:04.250 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.251 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.251 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:04.251 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.550486+0000", 2024-09-12T00:06:04.251 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4070000000000002e-06 2024-09-12T00:06:04.251 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.251 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.251 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:04.251 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.552644+0000", 2024-09-12T00:06:04.251 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021584629999999998 2024-09-12T00:06:04.251 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.251 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.251 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:04.251 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.552676+0000", 2024-09-12T00:06:04.251 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1662000000000003e-05 2024-09-12T00:06:04.252 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.252 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.252 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:04.252 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.552691+0000", 2024-09-12T00:06:04.252 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4780000000000001e-05 2024-09-12T00:06:04.252 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.252 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.252 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:04.252 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.552788+0000", 2024-09-12T00:06:04.252 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7034999999999995e-05 2024-09-12T00:06:04.252 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.252 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.252 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:04.252 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.553009+0000", 2024-09-12T00:06:04.252 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000220991 2024-09-12T00:06:04.253 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.253 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.253 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:06:04.253 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.553191+0000", 2024-09-12T00:06:04.253 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000182349 2024-09-12T00:06:04.253 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.253 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.253 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:04.253 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.573055+0000", 2024-09-12T00:06:04.253 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019863553999999999 2024-09-12T00:06:04.253 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.253 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.253 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:04.253 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.573071+0000", 2024-09-12T00:06:04.254 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6178e-05 2024-09-12T00:06:04.254 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.254 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.254 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:04.254 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.573144+0000", 2024-09-12T00:06:04.254 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3362000000000007e-05 2024-09-12T00:06:04.254 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:04.254 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:04.254 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:04.254 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.573202+0000", 2024-09-12T00:06:04.254 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7725e-05 2024-09-12T00:06:04.254 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.254 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:04.254 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.254 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:04.255 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:04.255 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:06:04.255 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:06:04.257 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:06:04.257 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:06:04.255+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:06:04.358 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:06:04.360+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:06:04.421 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:06:04.421 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:06:04.421 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:06:04.422 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:06:04.438 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:06:04.447 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:06:04.447 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:06:04.458 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:06:04.460+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:06:04.464 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:06:04.465 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:06:04.482 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:06:04.483 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:06:04.500 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:06:04.500 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:06:04.522 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:06:04.523 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:06:04.545 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:06:04.545 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:06:04.551 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:04.551 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:04.560 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:06:04.559+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:06:04.565 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:06:04.566 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:06:04.567 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:06:04.588 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:06:04.589 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:06:04.660 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:06:04.659+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:06:04.678 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:04.679 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:04.691 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:06:04.762 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:06:04.764+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:06:04.857 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:04.857 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:04.863 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:06:04.864+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:06:04.872 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:06:04.965 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:06:04.964+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:06:05.027 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:05.028 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:05.051 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:06:05.065 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:06:05.064+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:06:05.167 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:06:05.167+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:06:05.195 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:05.196 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:05.217 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:06:05.268 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:06:05.267+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:06:05.364 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:05.364 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:05.369 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:06:05.367+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:06:05.382 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:06:05.411 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T00:06:05.470 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:06:05.471+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:06:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:05.532 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:06:05.570 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:06:05.571+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:06:05.672 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:06:05.671+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:06:05.688 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:05.688 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:05.706 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:06:05.775 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:06:05.776+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:06:05.856 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:05.856 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:05.873 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:06:05.872+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:06:05.875 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:06:05.974 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:06:05.975+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:06:06.056 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:06.056 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:06.075 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:06:06.075 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:06:06.076+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:06:06.176 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:06:06.176+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:06:06.253 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:06.254 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:06.268 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:06:06.311 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:06:06.312+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:06:06.377 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:06:06.376+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:06:06.424 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T00:06:06.449 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:06.449 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:06.463 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:06:06.506 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:06:06.508+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:06:06.579 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:06:06.579+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:06:06.606 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:06:06.650 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:06.650 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:06.673 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:06:06.718 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:06:06.720+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:06:06.781 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:06:06.780+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:06:06.798 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:06:06.798 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:06:06.803 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:06.804 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:06.822 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:06:06.822 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:06:06.824 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:06:06.844 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:06:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:06:06.868 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:06:06.868 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:06:06.893 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:06:06.894 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:06:06.910 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:06:06.912+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:06:06.915 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:06:06.915 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:06:06.937 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:06:06.937 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:06:06.961 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:06:06.962 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:06:06.982 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:06:06.983+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:06:06.998 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:06:06.998 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:06:06.998 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:06:06.998 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:06:07.016 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:06:07.102 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:06:07.104+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:06:07.184 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:06:07.184+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:06:07.195 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:06:07.195 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:06:07.195 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:06:07.195 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:06:07.196 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:06:07.217 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:06:07.302 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:06:07.304+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:06:07.386 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:06:07.387+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:06:07.404 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:06:07.404 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:06:07.404 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:06:07.404 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:06:07.404 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.404 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:1646 3.25 e58/23 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head v 58'1, mlcod=0'0)", 2024-09-12T00:06:07.404 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:06:07.405 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 94.315782983000005, 2024-09-12T00:06:07.405 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020301987000000001, 2024-09-12T00:06:07.405 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:07.405 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:07.405 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:07.405 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:07.405 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.405 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:07.405 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:06:07.405 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.405 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.405 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:07.406 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086306+0000", 2024-09-12T00:06:07.406 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.406 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.406 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:07.406 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086308+0000", 2024-09-12T00:06:07.406 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.95e-06 2024-09-12T00:06:07.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.406 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.406 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:07.407 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091174+0000", 2024-09-12T00:06:07.407 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048660559999999997 2024-09-12T00:06:07.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.407 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.407 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:07.407 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091218+0000", 2024-09-12T00:06:07.407 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4678999999999997e-05 2024-09-12T00:06:07.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.407 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.408 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:07.408 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091238+0000", 2024-09-12T00:06:07.408 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9839000000000001e-05 2024-09-12T00:06:07.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.408 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.408 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:07.408 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091396+0000", 2024-09-12T00:06:07.409 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000157396 2024-09-12T00:06:07.409 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.409 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.409 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:07.409 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.091451+0000", 2024-09-12T00:06:07.410 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5547999999999997e-05 2024-09-12T00:06:07.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.410 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.410 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:07.410 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106474+0000", 2024-09-12T00:06:07.410 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015023287 2024-09-12T00:06:07.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.410 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.411 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:07.411 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.106608+0000", 2024-09-12T00:06:07.411 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000133232 2024-09-12T00:06:07.411 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.411 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:07.411 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.411 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.411 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2723 3.21 3:86535907:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:06:07.412 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:06:07.412 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 79.569935516000001, 2024-09-12T00:06:07.412 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021210407000000001, 2024-09-12T00:06:07.412 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:07.412 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:07.412 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:07.412 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:07.412 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:07.413 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:07.413 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2723 2024-09-12T00:06:07.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.413 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:07.413 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.413 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:07.413 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:06:07.413 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.414 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.414 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:07.414 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832153+0000", 2024-09-12T00:06:07.414 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.414 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.414 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.414 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:07.414 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.832157+0000", 2024-09-12T00:06:07.415 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3270000000000001e-06 2024-09-12T00:06:07.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.415 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.415 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:07.415 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837403+0000", 2024-09-12T00:06:07.415 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005246784 2024-09-12T00:06:07.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.415 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.415 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:07.416 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837439+0000", 2024-09-12T00:06:07.416 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5848e-05 2024-09-12T00:06:07.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.416 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.416 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:07.416 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837459+0000", 2024-09-12T00:06:07.416 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9585e-05 2024-09-12T00:06:07.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.417 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.417 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:07.417 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837574+0000", 2024-09-12T00:06:07.417 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000114917 2024-09-12T00:06:07.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.417 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.417 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:07.417 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.837803+0000", 2024-09-12T00:06:07.418 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022967699999999999 2024-09-12T00:06:07.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.418 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.418 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:06:07.418 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.838174+0000", 2024-09-12T00:06:07.418 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037083899999999998 2024-09-12T00:06:07.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.418 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.418 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:07.419 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.848447+0000", 2024-09-12T00:06:07.419 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010272439 2024-09-12T00:06:07.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.419 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.419 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:07.419 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853191+0000", 2024-09-12T00:06:07.419 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047441109999999996 2024-09-12T00:06:07.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.419 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.420 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:07.420 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853292+0000", 2024-09-12T00:06:07.420 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000101474 2024-09-12T00:06:07.420 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.420 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.420 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:07.420 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.853364+0000", 2024-09-12T00:06:07.420 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1406e-05 2024-09-12T00:06:07.420 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.421 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:07.421 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.421 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.421 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.421 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2971 3.2e 3:76f45d45:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:07.421 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:06:07.421 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 47.326221179000001, 2024-09-12T00:06:07.421 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022571213, 2024-09-12T00:06:07.422 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:07.422 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:07.422 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:07.422 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:07.422 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:07.422 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:07.422 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2971 2024-09-12T00:06:07.422 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.423 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:07.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.423 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:07.423 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:06:07.423 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.423 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:07.423 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075868+0000", 2024-09-12T00:06:07.423 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.423 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:07.424 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.075871+0000", 2024-09-12T00:06:07.424 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.467e-06 2024-09-12T00:06:07.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.424 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.424 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:07.424 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080307+0000", 2024-09-12T00:06:07.424 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044356359999999997 2024-09-12T00:06:07.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.424 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.424 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:07.424 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080346+0000", 2024-09-12T00:06:07.424 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9267999999999997e-05 2024-09-12T00:06:07.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.425 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.425 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:07.425 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080368+0000", 2024-09-12T00:06:07.425 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2603e-05 2024-09-12T00:06:07.425 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.425 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.425 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:07.425 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080489+0000", 2024-09-12T00:06:07.425 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0001209 2024-09-12T00:06:07.425 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.425 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.425 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:07.425 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.080830+0000", 2024-09-12T00:06:07.426 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00034099 2024-09-12T00:06:07.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.426 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.426 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:07.426 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.081119+0000", 2024-09-12T00:06:07.426 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028860300000000001 2024-09-12T00:06:07.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.426 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.426 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:07.426 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.093241+0000", 2024-09-12T00:06:07.426 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012121609 2024-09-12T00:06:07.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.426 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.426 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:07.427 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098277+0000", 2024-09-12T00:06:07.427 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0050359710000000002 2024-09-12T00:06:07.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.427 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.427 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:07.427 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098366+0000", 2024-09-12T00:06:07.427 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9052000000000001e-05 2024-09-12T00:06:07.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.427 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.427 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:07.427 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.098439+0000", 2024-09-12T00:06:07.427 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3114000000000005e-05 2024-09-12T00:06:07.427 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.427 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:07.428 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.428 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.428 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.428 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2996 3.21 3:872b1c12:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:07.428 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:06:07.428 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 47.051596441999997, 2024-09-12T00:06:07.428 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027562314000000001, 2024-09-12T00:06:07.428 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:07.428 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:07.428 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:07.428 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:07.428 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:07.428 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:07.429 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2996 2024-09-12T00:06:07.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.429 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:07.429 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.429 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:07.429 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:06:07.429 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.429 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.429 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:07.429 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:06:07.429 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.430 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.430 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:07.430 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350496+0000", 2024-09-12T00:06:07.430 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9160000000000003e-06 2024-09-12T00:06:07.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.430 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.430 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:07.430 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355187+0000", 2024-09-12T00:06:07.430 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046904989999999999 2024-09-12T00:06:07.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.430 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.430 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:07.430 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355223+0000", 2024-09-12T00:06:07.430 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6125999999999999e-05 2024-09-12T00:06:07.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.431 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.431 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:07.431 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355241+0000", 2024-09-12T00:06:07.431 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8686e-05 2024-09-12T00:06:07.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.431 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.431 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:07.431 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355373+0000", 2024-09-12T00:06:07.431 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013129299999999999 2024-09-12T00:06:07.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.431 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.431 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:07.432 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355619+0000", 2024-09-12T00:06:07.432 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024662700000000002 2024-09-12T00:06:07.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.432 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.432 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:06:07.432 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355855+0000", 2024-09-12T00:06:07.432 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023604299999999999 2024-09-12T00:06:07.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.432 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.432 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:07.432 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.367983+0000", 2024-09-12T00:06:07.432 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012127104999999999 2024-09-12T00:06:07.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.433 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.433 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:07.433 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377884+0000", 2024-09-12T00:06:07.433 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099013680000000007 2024-09-12T00:06:07.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.433 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.433 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:07.433 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377974+0000", 2024-09-12T00:06:07.433 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9932999999999994e-05 2024-09-12T00:06:07.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.433 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.433 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:07.433 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.378055+0000", 2024-09-12T00:06:07.434 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0717999999999995e-05 2024-09-12T00:06:07.434 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.434 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:07.434 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.434 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.434 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3030 3.2e 3:740afe3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:07.434 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:06:07.434 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 46.662266283999998, 2024-09-12T00:06:07.434 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.033756331000000001, 2024-09-12T00:06:07.434 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:07.434 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:07.434 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:07.434 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:07.434 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:07.435 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:07.435 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3030 2024-09-12T00:06:07.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.435 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:07.435 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.435 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:07.435 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:06:07.435 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.435 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.435 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:07.435 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:06:07.435 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.436 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.436 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:07.436 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739825+0000", 2024-09-12T00:06:07.436 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7920000000000001e-06 2024-09-12T00:06:07.436 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.436 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.436 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:07.436 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744217+0000", 2024-09-12T00:06:07.436 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043922529999999996 2024-09-12T00:06:07.436 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.436 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.436 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:07.436 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744243+0000", 2024-09-12T00:06:07.436 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5253e-05 2024-09-12T00:06:07.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.437 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.437 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:07.437 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744254+0000", 2024-09-12T00:06:07.437 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1430999999999999e-05 2024-09-12T00:06:07.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.437 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.437 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:07.437 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744325+0000", 2024-09-12T00:06:07.437 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1340999999999993e-05 2024-09-12T00:06:07.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.437 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.437 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:07.437 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744461+0000", 2024-09-12T00:06:07.438 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013531700000000001 2024-09-12T00:06:07.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.438 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.438 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:07.438 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744574+0000", 2024-09-12T00:06:07.438 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113513 2024-09-12T00:06:07.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.438 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.438 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:07.438 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.752813+0000", 2024-09-12T00:06:07.438 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082384750000000003 2024-09-12T00:06:07.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.438 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.438 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:07.439 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773444+0000", 2024-09-12T00:06:07.439 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020630773000000002 2024-09-12T00:06:07.439 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.439 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.439 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:07.439 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773510+0000", 2024-09-12T00:06:07.439 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6711000000000006e-05 2024-09-12T00:06:07.439 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.439 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.439 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:07.439 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773579+0000", 2024-09-12T00:06:07.439 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8472000000000004e-05 2024-09-12T00:06:07.440 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.440 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:07.440 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.440 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.440 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3039 3.2e 3:74587332:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:07.440 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:06:07.441 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 46.566586356000002, 2024-09-12T00:06:07.441 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.036215114, 2024-09-12T00:06:07.441 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:07.441 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:07.441 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:07.441 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:07.442 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:07.442 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:07.442 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3039 2024-09-12T00:06:07.442 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.442 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:07.442 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.443 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:07.443 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:06:07.443 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.443 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.443 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:07.444 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:06:07.444 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.444 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.444 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.444 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:07.445 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835507+0000", 2024-09-12T00:06:07.445 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6e-06 2024-09-12T00:06:07.445 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.445 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.445 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:07.445 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848930+0000", 2024-09-12T00:06:07.445 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013423242 2024-09-12T00:06:07.446 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.446 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.446 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:07.446 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848969+0000", 2024-09-12T00:06:07.446 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9270000000000002e-05 2024-09-12T00:06:07.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.447 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.447 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:07.447 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848991+0000", 2024-09-12T00:06:07.447 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1565000000000001e-05 2024-09-12T00:06:07.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.448 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:07.448 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849089+0000", 2024-09-12T00:06:07.448 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8408999999999999e-05 2024-09-12T00:06:07.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.448 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:07.449 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849518+0000", 2024-09-12T00:06:07.449 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042813900000000002 2024-09-12T00:06:07.449 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.449 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.449 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:07.449 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849897+0000", 2024-09-12T00:06:07.450 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037936600000000001 2024-09-12T00:06:07.450 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.450 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.450 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:07.450 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.858549+0000", 2024-09-12T00:06:07.451 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086520820000000002 2024-09-12T00:06:07.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.451 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.451 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:07.451 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871522+0000", 2024-09-12T00:06:07.451 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012973182999999999 2024-09-12T00:06:07.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.452 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.452 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:07.452 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871633+0000", 2024-09-12T00:06:07.452 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011085 2024-09-12T00:06:07.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.453 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.453 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:07.453 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871717+0000", 2024-09-12T00:06:07.453 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.4407999999999996e-05 2024-09-12T00:06:07.453 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.453 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:07.454 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.454 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.454 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3050 3.b 3:d26f7141:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:07.454 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:06:07.455 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 46.444974100000003, 2024-09-12T00:06:07.455 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022896481999999999, 2024-09-12T00:06:07.455 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:07.455 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:07.455 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:07.455 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:07.455 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:07.455 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:07.455 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3050 2024-09-12T00:06:07.456 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.456 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:07.456 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.456 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:07.456 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:06:07.456 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.456 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.456 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.457 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:07.457 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:06:07.457 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.457 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.457 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:07.457 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957117+0000", 2024-09-12T00:06:07.457 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7e-06 2024-09-12T00:06:07.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.458 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.458 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:07.458 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961673+0000", 2024-09-12T00:06:07.458 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045558059999999999 2024-09-12T00:06:07.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.458 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.458 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:07.459 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961698+0000", 2024-09-12T00:06:07.459 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5017000000000001e-05 2024-09-12T00:06:07.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.459 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:07.459 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961710+0000", 2024-09-12T00:06:07.459 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1963999999999999e-05 2024-09-12T00:06:07.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.460 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:07.460 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961785+0000", 2024-09-12T00:06:07.460 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5153000000000004e-05 2024-09-12T00:06:07.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.460 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:07.460 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961926+0000", 2024-09-12T00:06:07.460 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000141194 2024-09-12T00:06:07.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.461 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.461 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:07.461 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.962055+0000", 2024-09-12T00:06:07.461 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012882400000000001 2024-09-12T00:06:07.461 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.461 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.461 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:07.461 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.970716+0000", 2024-09-12T00:06:07.461 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086603610000000001 2024-09-12T00:06:07.461 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.461 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.461 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:07.461 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979700+0000", 2024-09-12T00:06:07.462 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.008984054 2024-09-12T00:06:07.462 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.462 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.462 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:07.462 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979884+0000", 2024-09-12T00:06:07.462 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184215 2024-09-12T00:06:07.462 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.462 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.462 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:07.462 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.980011+0000", 2024-09-12T00:06:07.462 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012719399999999999 2024-09-12T00:06:07.462 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.462 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:07.462 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.463 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.463 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.463 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3065 3.b 3:d10bf58d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:07.463 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:06:07.463 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 46.280026479999997, 2024-09-12T00:06:07.463 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021843261999999999, 2024-09-12T00:06:07.463 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:07.463 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:07.463 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:07.463 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:07.463 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:07.463 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:07.463 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3065 2024-09-12T00:06:07.463 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.464 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:07.464 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.464 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:07.464 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:06:07.464 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.464 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.464 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.464 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:07.464 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122062+0000", 2024-09-12T00:06:07.464 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.464 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.464 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.465 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:07.465 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.122067+0000", 2024-09-12T00:06:07.465 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4970000000000003e-06 2024-09-12T00:06:07.465 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.465 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.465 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:07.465 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126931+0000", 2024-09-12T00:06:07.465 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048641090000000001 2024-09-12T00:06:07.465 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.465 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.465 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:07.465 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126973+0000", 2024-09-12T00:06:07.465 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1678999999999999e-05 2024-09-12T00:06:07.466 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.466 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.466 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:07.466 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.126999+0000", 2024-09-12T00:06:07.466 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6536000000000001e-05 2024-09-12T00:06:07.466 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.466 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.466 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:07.466 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127118+0000", 2024-09-12T00:06:07.466 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000119373 2024-09-12T00:06:07.466 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.466 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.466 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:07.466 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127289+0000", 2024-09-12T00:06:07.466 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017020199999999999 2024-09-12T00:06:07.467 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.467 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.467 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:07.467 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.127437+0000", 2024-09-12T00:06:07.467 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000148682 2024-09-12T00:06:07.467 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.467 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.467 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:07.467 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138539+0000", 2024-09-12T00:06:07.467 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011101418 2024-09-12T00:06:07.467 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.467 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.467 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:07.468 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143355+0000", 2024-09-12T00:06:07.468 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048161499999999999 2024-09-12T00:06:07.468 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.468 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.468 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:07.468 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143777+0000", 2024-09-12T00:06:07.468 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000421896 2024-09-12T00:06:07.468 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.468 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.468 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:07.468 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.143905+0000", 2024-09-12T00:06:07.468 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012872 2024-09-12T00:06:07.468 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.468 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:07.469 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.469 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.469 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.469 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3066 3.21 3:8448517d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:07.469 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:06:07.469 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 46.270080397999998, 2024-09-12T00:06:07.469 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025911652, 2024-09-12T00:06:07.469 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:07.469 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:07.469 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:07.469 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:07.469 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:07.469 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:07.470 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3066 2024-09-12T00:06:07.470 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.470 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:07.470 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.470 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:07.470 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:06:07.470 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.470 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.470 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.470 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:07.470 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:06:07.470 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.470 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.470 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.470 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:07.471 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132011+0000", 2024-09-12T00:06:07.471 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8270000000000002e-06 2024-09-12T00:06:07.471 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.471 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.471 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:07.471 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137934+0000", 2024-09-12T00:06:07.471 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059226119999999998 2024-09-12T00:06:07.471 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.471 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.471 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:07.471 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137968+0000", 2024-09-12T00:06:07.471 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3933000000000002e-05 2024-09-12T00:06:07.471 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.471 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.472 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:07.472 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137985+0000", 2024-09-12T00:06:07.472 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7725999999999999e-05 2024-09-12T00:06:07.472 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.472 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.472 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:07.472 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138084+0000", 2024-09-12T00:06:07.472 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8450999999999996e-05 2024-09-12T00:06:07.472 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.472 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.472 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:07.472 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138285+0000", 2024-09-12T00:06:07.472 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000201411 2024-09-12T00:06:07.472 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.473 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.473 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:06:07.473 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138510+0000", 2024-09-12T00:06:07.473 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000224551 2024-09-12T00:06:07.473 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.473 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.473 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:07.473 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.146242+0000", 2024-09-12T00:06:07.473 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077317649999999998 2024-09-12T00:06:07.473 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.473 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.473 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:07.473 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157728+0000", 2024-09-12T00:06:07.473 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011486424 2024-09-12T00:06:07.474 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.474 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.474 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:07.474 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157833+0000", 2024-09-12T00:06:07.474 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105234 2024-09-12T00:06:07.474 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.474 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.474 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:07.474 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157920+0000", 2024-09-12T00:06:07.474 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6718000000000006e-05 2024-09-12T00:06:07.474 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.474 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:07.474 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.475 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.475 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.475 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3112 3.b 3:d1cf91a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:06:07.475 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:06:07.475 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 45.651363271000001, 2024-09-12T00:06:07.475 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021203475999999999, 2024-09-12T00:06:07.475 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:07.475 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:07.475 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:07.475 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:07.476 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:07.476 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:07.476 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3112 2024-09-12T00:06:07.476 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.476 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:07.476 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.476 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:07.476 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:06:07.476 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.476 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.477 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.477 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:07.477 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750725+0000", 2024-09-12T00:06:07.477 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.477 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.477 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.477 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:07.477 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.750728+0000", 2024-09-12T00:06:07.477 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.165e-06 2024-09-12T00:06:07.477 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.477 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.477 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:07.477 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755063+0000", 2024-09-12T00:06:07.478 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043355379999999999 2024-09-12T00:06:07.478 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.478 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.478 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:07.478 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755103+0000", 2024-09-12T00:06:07.478 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9962000000000001e-05 2024-09-12T00:06:07.478 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.478 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.478 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:07.478 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755120+0000", 2024-09-12T00:06:07.478 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6793e-05 2024-09-12T00:06:07.478 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.478 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.478 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:07.479 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755299+0000", 2024-09-12T00:06:07.479 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017904499999999999 2024-09-12T00:06:07.479 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.479 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.479 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:07.479 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.755758+0000", 2024-09-12T00:06:07.479 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000458815 2024-09-12T00:06:07.479 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.479 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.479 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:07.479 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.756304+0000", 2024-09-12T00:06:07.479 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000546183 2024-09-12T00:06:07.479 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.479 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.480 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:07.480 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771518+0000", 2024-09-12T00:06:07.480 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015214236000000001 2024-09-12T00:06:07.480 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.480 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.480 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:07.480 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771827+0000", 2024-09-12T00:06:07.480 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000309308 2024-09-12T00:06:07.480 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.480 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.480 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:07.480 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771874+0000", 2024-09-12T00:06:07.480 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6119999999999999e-05 2024-09-12T00:06:07.480 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.481 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.481 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:07.481 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.771929+0000", 2024-09-12T00:06:07.481 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.5310999999999999e-05 2024-09-12T00:06:07.481 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.481 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:07.481 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.481 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.481 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.481 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3380 3.23 e82/23 3:c6c9ccf8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_7:head v 82'5, mlcod=76'3)", 2024-09-12T00:06:07.481 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:06:07.481 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 26.695567203, 2024-09-12T00:06:07.481 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.029708818000000001, 2024-09-12T00:06:07.481 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:07.482 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:07.482 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:07.482 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:07.482 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.482 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:07.482 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:06:07.482 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.482 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.482 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.482 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:07.482 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:06:07.482 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.482 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.482 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.483 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:07.483 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:06:07.483 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1600000000000001e-07 2024-09-12T00:06:07.483 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.483 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.483 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:07.483 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.710842+0000", 2024-09-12T00:06:07.483 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043204510000000003 2024-09-12T00:06:07.483 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.483 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.483 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:07.483 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.710875+0000", 2024-09-12T00:06:07.483 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2702e-05 2024-09-12T00:06:07.483 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.484 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.484 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:07.484 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.710895+0000", 2024-09-12T00:06:07.484 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0094000000000001e-05 2024-09-12T00:06:07.484 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.484 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.484 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:07.484 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.711063+0000", 2024-09-12T00:06:07.484 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000167517 2024-09-12T00:06:07.484 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.484 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.484 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:07.484 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.711127+0000", 2024-09-12T00:06:07.485 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4004999999999995e-05 2024-09-12T00:06:07.485 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.485 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.485 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:07.485 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.736095+0000", 2024-09-12T00:06:07.485 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024968008999999999 2024-09-12T00:06:07.485 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.485 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.485 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:07.485 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.736230+0000", 2024-09-12T00:06:07.485 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013552400000000001 2024-09-12T00:06:07.485 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.485 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:07.485 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.486 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.486 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.486 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3409 3.b 3:d39a1970:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:06:07.486 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:41.028923+0000", 2024-09-12T00:06:07.486 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 26.373166185999999, 2024-09-12T00:06:07.486 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030518363999999999, 2024-09-12T00:06:07.486 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:07.486 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:07.486 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:07.486 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:07.486 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:07.486 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:07.486 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3409 2024-09-12T00:06:07.486 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.487 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:07.487 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.487 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:07.487 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.028923+0000", 2024-09-12T00:06:07.487 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.487 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.487 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.487 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:07.487 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.028923+0000", 2024-09-12T00:06:07.487 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.487 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.487 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.487 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:07.487 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.028926+0000", 2024-09-12T00:06:07.487 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1e-06 2024-09-12T00:06:07.488 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.488 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.488 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:07.488 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038010+0000", 2024-09-12T00:06:07.488 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0090839110000000001 2024-09-12T00:06:07.488 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.488 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.488 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:07.488 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038042+0000", 2024-09-12T00:06:07.488 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2425999999999998e-05 2024-09-12T00:06:07.488 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.488 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.488 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:07.489 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038060+0000", 2024-09-12T00:06:07.489 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8219e-05 2024-09-12T00:06:07.489 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.489 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.489 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:07.489 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038205+0000", 2024-09-12T00:06:07.489 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014503500000000001 2024-09-12T00:06:07.489 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.489 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.489 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:07.489 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038498+0000", 2024-09-12T00:06:07.489 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00029289499999999999 2024-09-12T00:06:07.489 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.489 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.490 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:07.490 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038752+0000", 2024-09-12T00:06:07.490 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025434500000000001 2024-09-12T00:06:07.490 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.490 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.490 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:07.490 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.058529+0000", 2024-09-12T00:06:07.490 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019776275999999999 2024-09-12T00:06:07.490 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.490 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.490 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:07.490 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.059147+0000", 2024-09-12T00:06:07.490 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00061837199999999995 2024-09-12T00:06:07.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.491 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.491 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:07.491 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.059328+0000", 2024-09-12T00:06:07.491 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018048399999999999 2024-09-12T00:06:07.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.491 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.491 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:07.491 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.059441+0000", 2024-09-12T00:06:07.491 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011330100000000001 2024-09-12T00:06:07.491 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.491 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:07.491 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.492 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.492 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3665 3.21 3:85e29f15:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_282:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:07.492 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:43.757083+0000", 2024-09-12T00:06:07.492 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 23.645005472000001, 2024-09-12T00:06:07.492 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021222119000000001, 2024-09-12T00:06:07.492 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:07.492 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:07.492 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:07.492 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:07.492 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:07.492 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:07.492 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3665 2024-09-12T00:06:07.492 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.493 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:07.493 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.493 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:07.493 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.757083+0000", 2024-09-12T00:06:07.493 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.493 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.493 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.493 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:07.493 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.757083+0000", 2024-09-12T00:06:07.493 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.493 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.493 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.493 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:07.494 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.757087+0000", 2024-09-12T00:06:07.494 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2370000000000003e-06 2024-09-12T00:06:07.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.494 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.494 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:07.494 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763296+0000", 2024-09-12T00:06:07.494 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0062089240000000002 2024-09-12T00:06:07.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.494 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.494 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:07.494 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763337+0000", 2024-09-12T00:06:07.494 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1032999999999998e-05 2024-09-12T00:06:07.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.494 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.495 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:07.495 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763356+0000", 2024-09-12T00:06:07.495 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8292999999999999e-05 2024-09-12T00:06:07.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.495 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.495 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:07.495 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763485+0000", 2024-09-12T00:06:07.495 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012931499999999999 2024-09-12T00:06:07.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.495 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.495 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:07.495 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763704+0000", 2024-09-12T00:06:07.495 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021922399999999999 2024-09-12T00:06:07.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.496 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.496 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:06:07.496 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.763888+0000", 2024-09-12T00:06:07.496 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184146 2024-09-12T00:06:07.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.496 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.496 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:07.496 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.772359+0000", 2024-09-12T00:06:07.496 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0084704089999999999 2024-09-12T00:06:07.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.496 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.496 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:07.496 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.778004+0000", 2024-09-12T00:06:07.497 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0056452619999999998 2024-09-12T00:06:07.497 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.497 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.497 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:07.497 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.778173+0000", 2024-09-12T00:06:07.497 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016846299999999999 2024-09-12T00:06:07.497 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.497 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.497 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:07.497 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.778305+0000", 2024-09-12T00:06:07.497 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013281299999999999 2024-09-12T00:06:07.497 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.497 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:07.497 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.498 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.498 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.498 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3696 3.21 3:872f3075:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_313:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:07.498 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.301332+0000", 2024-09-12T00:06:07.498 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 23.100757002000002, 2024-09-12T00:06:07.498 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024918241000000001, 2024-09-12T00:06:07.498 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:07.498 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:07.498 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:07.498 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:07.498 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:07.498 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:07.498 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3696 2024-09-12T00:06:07.498 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.499 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:07.499 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.499 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:07.499 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.301332+0000", 2024-09-12T00:06:07.499 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.499 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.499 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.499 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:07.499 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.301332+0000", 2024-09-12T00:06:07.499 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.499 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.499 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.499 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:07.499 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.301335+0000", 2024-09-12T00:06:07.500 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9679999999999998e-06 2024-09-12T00:06:07.500 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.500 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.500 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:07.500 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.305984+0000", 2024-09-12T00:06:07.500 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046492249999999999 2024-09-12T00:06:07.500 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.500 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.500 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:07.500 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306009+0000", 2024-09-12T00:06:07.500 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5252000000000001e-05 2024-09-12T00:06:07.500 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.500 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.500 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:07.501 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306023+0000", 2024-09-12T00:06:07.501 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3903000000000001e-05 2024-09-12T00:06:07.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.501 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.501 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:07.501 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306193+0000", 2024-09-12T00:06:07.501 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017032500000000001 2024-09-12T00:06:07.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.501 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.501 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:07.501 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306594+0000", 2024-09-12T00:06:07.502 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040111600000000003 2024-09-12T00:06:07.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.502 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.502 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:06:07.502 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.307002+0000", 2024-09-12T00:06:07.502 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040796000000000002 2024-09-12T00:06:07.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.502 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.502 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:07.502 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.319319+0000", 2024-09-12T00:06:07.502 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012317033 2024-09-12T00:06:07.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.502 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.502 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:07.502 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.325949+0000", 2024-09-12T00:06:07.503 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0066298110000000002 2024-09-12T00:06:07.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.503 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.503 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:07.503 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.326123+0000", 2024-09-12T00:06:07.503 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017416999999999999 2024-09-12T00:06:07.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.503 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.503 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:07.503 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.326250+0000", 2024-09-12T00:06:07.503 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012647799999999999 2024-09-12T00:06:07.503 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.503 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:07.503 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.504 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.504 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3737 3.b 3:d32629e2:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_354:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:07.504 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.993654+0000", 2024-09-12T00:06:07.504 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 22.408434681999999, 2024-09-12T00:06:07.504 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022195105999999999, 2024-09-12T00:06:07.504 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:07.504 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:07.504 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:07.504 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:07.504 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:07.504 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:07.504 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3737 2024-09-12T00:06:07.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.505 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:07.505 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.505 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:07.505 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.993654+0000", 2024-09-12T00:06:07.505 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.505 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.505 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:07.505 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.993654+0000", 2024-09-12T00:06:07.505 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.505 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.505 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:07.506 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.993657+0000", 2024-09-12T00:06:07.506 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2600000000000001e-06 2024-09-12T00:06:07.506 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.506 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.506 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:07.506 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.997886+0000", 2024-09-12T00:06:07.506 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004228646 2024-09-12T00:06:07.506 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.506 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.506 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:07.506 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.997924+0000", 2024-09-12T00:06:07.506 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7632999999999997e-05 2024-09-12T00:06:07.506 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.507 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.507 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:07.507 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.997942+0000", 2024-09-12T00:06:07.507 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8352999999999999e-05 2024-09-12T00:06:07.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.507 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.507 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:07.507 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.998101+0000", 2024-09-12T00:06:07.507 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015922500000000001 2024-09-12T00:06:07.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.507 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.507 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:07.507 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.998375+0000", 2024-09-12T00:06:07.508 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00027389500000000002 2024-09-12T00:06:07.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.508 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.508 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:07.508 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.998611+0000", 2024-09-12T00:06:07.508 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023559199999999999 2024-09-12T00:06:07.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.508 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.508 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:07.508 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009636+0000", 2024-09-12T00:06:07.508 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011025188 2024-09-12T00:06:07.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.508 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.509 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:07.509 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.015538+0000", 2024-09-12T00:06:07.509 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059023590000000003 2024-09-12T00:06:07.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.509 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.509 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:07.509 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.015717+0000", 2024-09-12T00:06:07.509 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017847699999999999 2024-09-12T00:06:07.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.509 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.509 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:07.510 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.015849+0000", 2024-09-12T00:06:07.510 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000132478 2024-09-12T00:06:07.510 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.510 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:07.510 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.510 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.510 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3738 3.2e 3:74a476b8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_355:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:07.510 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.005209+0000", 2024-09-12T00:06:07.510 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 22.396879207000001, 2024-09-12T00:06:07.510 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022771276999999999, 2024-09-12T00:06:07.510 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:07.510 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:07.511 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:07.511 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:07.511 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:07.511 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:07.511 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3738 2024-09-12T00:06:07.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.511 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:07.511 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.511 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:07.511 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.005209+0000", 2024-09-12T00:06:07.511 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.512 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:07.512 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.005209+0000", 2024-09-12T00:06:07.512 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.512 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:07.512 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.005213+0000", 2024-09-12T00:06:07.512 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4170000000000001e-06 2024-09-12T00:06:07.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.512 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:07.512 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009471+0000", 2024-09-12T00:06:07.513 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042583400000000002 2024-09-12T00:06:07.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.513 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.513 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:07.513 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009506+0000", 2024-09-12T00:06:07.513 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4625999999999997e-05 2024-09-12T00:06:07.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.513 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.513 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:07.513 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009524+0000", 2024-09-12T00:06:07.513 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7745999999999999e-05 2024-09-12T00:06:07.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.513 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.513 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:07.514 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009649+0000", 2024-09-12T00:06:07.514 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000124948 2024-09-12T00:06:07.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.514 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.514 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:07.514 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009889+0000", 2024-09-12T00:06:07.514 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024013999999999999 2024-09-12T00:06:07.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.514 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.514 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:07.514 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.010104+0000", 2024-09-12T00:06:07.514 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021549199999999999 2024-09-12T00:06:07.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.514 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.515 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:07.515 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.022243+0000", 2024-09-12T00:06:07.515 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012138793 2024-09-12T00:06:07.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.515 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.515 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:07.515 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.027764+0000", 2024-09-12T00:06:07.515 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0055207820000000001 2024-09-12T00:06:07.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.515 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.515 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:07.515 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.027859+0000", 2024-09-12T00:06:07.515 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5441999999999999e-05 2024-09-12T00:06:07.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.516 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.516 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:07.516 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.027981+0000", 2024-09-12T00:06:07.516 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000121551 2024-09-12T00:06:07.516 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.516 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:07.516 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.516 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.516 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3758 3.2e 3:7790af15:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_375:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:07.516 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.228203+0000", 2024-09-12T00:06:07.516 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 22.173885390999999, 2024-09-12T00:06:07.516 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.032647253000000001, 2024-09-12T00:06:07.516 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:07.517 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:07.517 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:07.517 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:07.517 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:07.517 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:07.517 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3758 2024-09-12T00:06:07.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.517 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:07.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.517 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:07.517 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.228203+0000", 2024-09-12T00:06:07.517 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.518 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:07.518 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.228203+0000", 2024-09-12T00:06:07.518 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.518 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.518 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:07.518 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.228208+0000", 2024-09-12T00:06:07.518 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3900000000000003e-06 2024-09-12T00:06:07.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.518 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.518 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:07.518 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239226+0000", 2024-09-12T00:06:07.518 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011018155 2024-09-12T00:06:07.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.519 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.519 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:07.519 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239265+0000", 2024-09-12T00:06:07.519 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9419000000000003e-05 2024-09-12T00:06:07.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.519 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.519 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:07.519 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239291+0000", 2024-09-12T00:06:07.519 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6173000000000002e-05 2024-09-12T00:06:07.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.519 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.519 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:07.519 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239430+0000", 2024-09-12T00:06:07.519 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000138071 2024-09-12T00:06:07.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.520 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:07.520 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239676+0000", 2024-09-12T00:06:07.520 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024695899999999999 2024-09-12T00:06:07.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.520 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:07.520 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239895+0000", 2024-09-12T00:06:07.520 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021808999999999999 2024-09-12T00:06:07.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.520 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:07.520 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.255130+0000", 2024-09-12T00:06:07.521 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015235907999999999 2024-09-12T00:06:07.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.521 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.521 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:07.521 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.260520+0000", 2024-09-12T00:06:07.521 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053894340000000002 2024-09-12T00:06:07.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.521 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.521 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:07.521 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.260700+0000", 2024-09-12T00:06:07.521 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018017099999999999 2024-09-12T00:06:07.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.521 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.521 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:07.522 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.260851+0000", 2024-09-12T00:06:07.522 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000150483 2024-09-12T00:06:07.522 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.522 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:07.522 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.522 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.522 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3760 3.b 3:d2eb500d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_377:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:07.522 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.251207+0000", 2024-09-12T00:06:07.522 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 22.150881733999999, 2024-09-12T00:06:07.522 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022210074, 2024-09-12T00:06:07.522 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:07.522 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:07.523 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:07.523 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:07.523 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:07.523 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:07.523 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3760 2024-09-12T00:06:07.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.523 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:07.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.523 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:07.523 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.251207+0000", 2024-09-12T00:06:07.523 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.523 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:07.524 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.251207+0000", 2024-09-12T00:06:07.524 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.524 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.524 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.524 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:07.524 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.251210+0000", 2024-09-12T00:06:07.524 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1130000000000001e-06 2024-09-12T00:06:07.524 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.524 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.524 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:07.524 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.256588+0000", 2024-09-12T00:06:07.524 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005378201 2024-09-12T00:06:07.524 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.525 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.525 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:07.525 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.256622+0000", 2024-09-12T00:06:07.525 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3246e-05 2024-09-12T00:06:07.525 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.525 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.525 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:07.525 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.256642+0000", 2024-09-12T00:06:07.525 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0786000000000001e-05 2024-09-12T00:06:07.525 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.525 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.525 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:07.525 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.256767+0000", 2024-09-12T00:06:07.525 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012475799999999999 2024-09-12T00:06:07.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.526 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.526 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:07.526 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.257047+0000", 2024-09-12T00:06:07.526 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00028016199999999998 2024-09-12T00:06:07.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.526 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.526 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:07.526 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.257276+0000", 2024-09-12T00:06:07.526 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022880900000000001 2024-09-12T00:06:07.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.526 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.526 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:07.526 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.272093+0000", 2024-09-12T00:06:07.526 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014816757999999999 2024-09-12T00:06:07.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.527 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.527 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:07.527 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.273101+0000", 2024-09-12T00:06:07.527 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0010080340000000001 2024-09-12T00:06:07.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.527 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.527 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:07.527 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.273283+0000", 2024-09-12T00:06:07.527 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000181993 2024-09-12T00:06:07.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.527 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.528 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:07.528 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.273417+0000", 2024-09-12T00:06:07.528 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013421400000000001 2024-09-12T00:06:07.528 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.528 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:07.528 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.528 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.528 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.528 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3793 3.21 3:8684dc70:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_410:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:07.528 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.629422+0000", 2024-09-12T00:06:07.528 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 21.772666802, 2024-09-12T00:06:07.528 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027123878000000001, 2024-09-12T00:06:07.529 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:07.529 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:07.529 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:07.529 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:07.529 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:07.529 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:07.529 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3793 2024-09-12T00:06:07.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.529 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:07.529 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.529 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:07.529 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.629422+0000", 2024-09-12T00:06:07.529 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.530 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.530 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:07.530 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.629422+0000", 2024-09-12T00:06:07.530 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.530 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.530 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.531 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:07.531 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.629426+0000", 2024-09-12T00:06:07.531 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7129999999999999e-06 2024-09-12T00:06:07.531 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.531 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.531 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:07.531 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635537+0000", 2024-09-12T00:06:07.532 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061111220000000001 2024-09-12T00:06:07.532 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.532 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.532 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:07.532 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635578+0000", 2024-09-12T00:06:07.532 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1730000000000002e-05 2024-09-12T00:06:07.532 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.533 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.533 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:07.533 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635605+0000", 2024-09-12T00:06:07.533 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6792999999999999e-05 2024-09-12T00:06:07.533 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.533 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.533 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:07.534 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635747+0000", 2024-09-12T00:06:07.534 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014160999999999999 2024-09-12T00:06:07.534 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.534 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.534 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:07.534 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635998+0000", 2024-09-12T00:06:07.534 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025098600000000003 2024-09-12T00:06:07.534 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.535 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.535 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:06:07.535 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.636254+0000", 2024-09-12T00:06:07.535 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025597 2024-09-12T00:06:07.535 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.535 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.535 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:07.536 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.653522+0000", 2024-09-12T00:06:07.536 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017268229999999999 2024-09-12T00:06:07.536 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.536 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.536 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:07.536 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.656375+0000", 2024-09-12T00:06:07.537 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0028530930000000001 2024-09-12T00:06:07.537 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.537 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.537 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:07.537 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.656471+0000", 2024-09-12T00:06:07.537 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5904999999999997e-05 2024-09-12T00:06:07.537 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.538 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.538 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:07.538 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.656546+0000", 2024-09-12T00:06:07.538 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4726000000000002e-05 2024-09-12T00:06:07.538 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.538 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:07.538 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.538 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.538 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.538 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:4226 3.13 3:ca054081:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.12__shadow_.h1uxKGkm-wWs7JNavkRQbjhJYN05a11_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-12T00:06:07.539 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:06:07.021581+0000", 2024-09-12T00:06:07.539 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 0.38050768400000001, 2024-09-12T00:06:07.539 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027223335000000001, 2024-09-12T00:06:07.539 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:07.539 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:07.539 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:07.539 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:07.539 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:07.539 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:07.539 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 4226 2024-09-12T00:06:07.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.540 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:07.540 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.540 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:07.540 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.021581+0000", 2024-09-12T00:06:07.540 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.540 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.540 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.540 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:07.540 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.021581+0000", 2024-09-12T00:06:07.540 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:07.540 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.540 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.540 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:07.541 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.021583+0000", 2024-09-12T00:06:07.541 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.108e-06 2024-09-12T00:06:07.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.541 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.541 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:07.541 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.025714+0000", 2024-09-12T00:06:07.541 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041308639999999997 2024-09-12T00:06:07.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.541 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.541 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:07.541 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.025733+0000", 2024-09-12T00:06:07.541 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8808999999999999e-05 2024-09-12T00:06:07.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.541 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.542 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:07.542 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.025746+0000", 2024-09-12T00:06:07.542 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2945999999999999e-05 2024-09-12T00:06:07.542 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.542 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.542 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:07.542 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.025823+0000", 2024-09-12T00:06:07.542 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7446000000000004e-05 2024-09-12T00:06:07.542 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.542 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.542 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:07.542 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.025939+0000", 2024-09-12T00:06:07.542 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000115932 2024-09-12T00:06:07.542 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.543 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.543 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:07.543 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.026042+0000", 2024-09-12T00:06:07.543 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000102439 2024-09-12T00:06:07.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.543 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.543 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:07.543 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.034584+0000", 2024-09-12T00:06:07.543 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0085426359999999993 2024-09-12T00:06:07.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.543 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.543 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:07.543 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.048716+0000", 2024-09-12T00:06:07.543 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014132141000000001 2024-09-12T00:06:07.544 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.544 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.544 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:07.544 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.048768+0000", 2024-09-12T00:06:07.544 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1542000000000002e-05 2024-09-12T00:06:07.544 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:07.544 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:07.544 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:07.544 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.048804+0000", 2024-09-12T00:06:07.544 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6471999999999999e-05 2024-09-12T00:06:07.544 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.544 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:07.544 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.544 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:07.545 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:07.545 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:06:07.546 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:06:07.547 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:06:07.547+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:06:07.647 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:06:07.648+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:06:07.693 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:06:07.693 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:06:07.693 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:06:07.693 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:06:07.714 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:06:07.748 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:06:07.748+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:06:07.849 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:06:07.848+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:06:07.873 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:06:07.873 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:06:07.873 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:06:07.874 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:06:07.874 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:06:07.893 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:06:07.950 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:06:07.948+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:06:08.051 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:06:08.052+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:06:08.058 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:06:08.058 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:06:08.058 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:06:08.059 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:06:08.059 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.059 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T00:06:08.059 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:06:08.059 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 156.72837913199999, 2024-09-12T00:06:08.059 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.027441031000000001, 2024-09-12T00:06:08.059 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.059 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.059 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.059 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.059 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.059 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.059 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 46 2024-09-12T00:06:08.060 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.060 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.060 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.060 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.060 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:06:08.060 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.061 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.061 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.061 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.061 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330352+0000", 2024-09-12T00:06:08.061 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.061 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.062 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.062 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.062 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330357+0000", 2024-09-12T00:06:08.062 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2339999999999996e-06 2024-09-12T00:06:08.062 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.062 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.063 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.063 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330381+0000", 2024-09-12T00:06:08.063 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4626000000000001e-05 2024-09-12T00:06:08.063 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.063 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.063 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.063 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330417+0000", 2024-09-12T00:06:08.064 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.5886000000000002e-05 2024-09-12T00:06:08.064 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.064 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.064 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.064 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.330442+0000", 2024-09-12T00:06:08.064 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4522999999999999e-05 2024-09-12T00:06:08.064 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.064 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.065 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.065 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335485+0000", 2024-09-12T00:06:08.065 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0050432589999999996 2024-09-12T00:06:08.065 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.065 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.065 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:06:08.065 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.335507+0000", 2024-09-12T00:06:08.066 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2013000000000001e-05 2024-09-12T00:06:08.066 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.066 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.066 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.066 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.351747+0000", 2024-09-12T00:06:08.066 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016240451999999999 2024-09-12T00:06:08.067 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.067 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.067 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.067 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352062+0000", 2024-09-12T00:06:08.067 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031433399999999999 2024-09-12T00:06:08.067 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.068 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.068 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:08.068 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.352378+0000", 2024-09-12T00:06:08.068 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00031586400000000001 2024-09-12T00:06:08.068 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.068 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.068 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.068 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.355074+0000", 2024-09-12T00:06:08.068 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026962919999999999 2024-09-12T00:06:08.069 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.069 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.069 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.069 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357537+0000", 2024-09-12T00:06:08.069 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024634689999999998 2024-09-12T00:06:08.069 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.069 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.069 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.069 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357680+0000", 2024-09-12T00:06:08.069 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014314899999999999 2024-09-12T00:06:08.069 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.069 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.069 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.069 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:31.357793+0000", 2024-09-12T00:06:08.070 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011293 2024-09-12T00:06:08.070 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.070 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.070 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.070 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.070 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.070 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:2748 3.3b 3:df6d92a6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:06:08.070 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:06:08.070 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 79.959891271999993, 2024-09-12T00:06:08.070 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.023574735999999999, 2024-09-12T00:06:08.070 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.070 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.070 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.070 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.071 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.071 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.071 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 2748 2024-09-12T00:06:08.071 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.071 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.071 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.071 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.071 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:06:08.071 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.071 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.071 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.071 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.071 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098840+0000", 2024-09-12T00:06:08.071 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.072 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.072 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.072 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.072 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.098844+0000", 2024-09-12T00:06:08.072 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1570000000000002e-06 2024-09-12T00:06:08.072 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.072 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.072 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.072 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100354+0000", 2024-09-12T00:06:08.072 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001509544 2024-09-12T00:06:08.072 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.072 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.072 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.072 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100383+0000", 2024-09-12T00:06:08.073 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9386e-05 2024-09-12T00:06:08.073 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.073 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.073 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.073 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100399+0000", 2024-09-12T00:06:08.073 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5883999999999999e-05 2024-09-12T00:06:08.073 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.073 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.073 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.073 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100507+0000", 2024-09-12T00:06:08.073 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010822 2024-09-12T00:06:08.073 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.073 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.073 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.074 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100704+0000", 2024-09-12T00:06:08.074 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019658499999999999 2024-09-12T00:06:08.074 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.074 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.074 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:08.074 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.100901+0000", 2024-09-12T00:06:08.074 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000196505 2024-09-12T00:06:08.074 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.074 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.074 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.074 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.112178+0000", 2024-09-12T00:06:08.074 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011277718000000001 2024-09-12T00:06:08.074 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.074 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.075 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.075 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122285+0000", 2024-09-12T00:06:08.075 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010106327 2024-09-12T00:06:08.075 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.075 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.075 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.075 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122358+0000", 2024-09-12T00:06:08.075 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3640999999999995e-05 2024-09-12T00:06:08.075 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.075 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.075 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.075 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:04:48.122415+0000", 2024-09-12T00:06:08.075 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6768999999999998e-05 2024-09-12T00:06:08.076 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.076 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.076 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.076 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.076 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.076 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2964 3.24 e75/23 3:26c83ec0:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_3:head v 75'6, mlcod=63'4)", 2024-09-12T00:06:08.076 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:06:08.076 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.046470251000002, 2024-09-12T00:06:08.076 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022426814, 2024-09-12T00:06:08.076 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.076 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.076 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.076 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.077 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.077 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.077 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:06:08.077 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.077 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.077 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.077 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.077 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012261+0000", 2024-09-12T00:06:08.077 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.077 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.077 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.078 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.078 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.012263+0000", 2024-09-12T00:06:08.078 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.091e-06 2024-09-12T00:06:08.078 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.078 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.078 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.078 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018390+0000", 2024-09-12T00:06:08.078 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061264600000000002 2024-09-12T00:06:08.078 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.078 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.078 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.078 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018419+0000", 2024-09-12T00:06:08.078 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8979000000000002e-05 2024-09-12T00:06:08.078 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.079 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.079 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.079 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018434+0000", 2024-09-12T00:06:08.079 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4781e-05 2024-09-12T00:06:08.079 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.079 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.079 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.079 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018528+0000", 2024-09-12T00:06:08.079 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.4333000000000006e-05 2024-09-12T00:06:08.079 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.079 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.079 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.079 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.018559+0000", 2024-09-12T00:06:08.080 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1557999999999998e-05 2024-09-12T00:06:08.080 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.080 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.080 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.080 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.034615+0000", 2024-09-12T00:06:08.080 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016055834000000001 2024-09-12T00:06:08.080 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.080 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.080 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.080 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.034688+0000", 2024-09-12T00:06:08.081 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2778e-05 2024-09-12T00:06:08.081 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.081 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.081 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.081 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.081 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.081 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2965 3.e e75/23 3:70fff61e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_4:head v 75'5, mlcod=63'3)", 2024-09-12T00:06:08.081 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:06:08.081 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.038960029999998, 2024-09-12T00:06:08.081 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021839210000000001, 2024-09-12T00:06:08.081 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.081 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.081 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.082 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.082 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.082 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.082 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:06:08.082 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.082 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.082 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.082 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.082 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019771+0000", 2024-09-12T00:06:08.082 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.082 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.082 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.082 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.082 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.019773+0000", 2024-09-12T00:06:08.083 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4839999999999999e-06 2024-09-12T00:06:08.083 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.083 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.083 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.083 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021570+0000", 2024-09-12T00:06:08.083 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017965570000000001 2024-09-12T00:06:08.083 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.083 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.083 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.083 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021587+0000", 2024-09-12T00:06:08.083 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7938e-05 2024-09-12T00:06:08.083 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.083 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.083 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.084 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021598+0000", 2024-09-12T00:06:08.084 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0553e-05 2024-09-12T00:06:08.084 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.084 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.084 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.084 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021676+0000", 2024-09-12T00:06:08.084 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8034000000000005e-05 2024-09-12T00:06:08.084 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.084 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.084 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.084 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.021706+0000", 2024-09-12T00:06:08.084 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9915000000000001e-05 2024-09-12T00:06:08.084 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.084 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.085 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.085 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.041519+0000", 2024-09-12T00:06:08.085 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019813171000000001 2024-09-12T00:06:08.085 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.085 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.085 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.085 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.041611+0000", 2024-09-12T00:06:08.085 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1558000000000007e-05 2024-09-12T00:06:08.085 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.085 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.085 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.085 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.085 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.085 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3004 3.36 3:6cc4f27f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:08.086 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:06:08.086 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 47.620560832999999, 2024-09-12T00:06:08.086 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.042951743000000001, 2024-09-12T00:06:08.086 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.086 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.086 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.086 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.086 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.086 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.086 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3004 2024-09-12T00:06:08.086 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.086 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.086 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.086 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.087 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:06:08.087 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.087 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.087 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.087 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.087 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438171+0000", 2024-09-12T00:06:08.087 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.087 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.087 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.087 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.087 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.438175+0000", 2024-09-12T00:06:08.087 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1640000000000003e-06 2024-09-12T00:06:08.087 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.087 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.087 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.088 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439732+0000", 2024-09-12T00:06:08.088 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0015574510000000001 2024-09-12T00:06:08.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.088 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.088 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.088 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439758+0000", 2024-09-12T00:06:08.088 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6074000000000001e-05 2024-09-12T00:06:08.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.088 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.088 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.088 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439768+0000", 2024-09-12T00:06:08.088 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8770000000000005e-06 2024-09-12T00:06:08.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.089 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.089 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.089 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.439874+0000", 2024-09-12T00:06:08.089 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105583 2024-09-12T00:06:08.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.089 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.089 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.089 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.440078+0000", 2024-09-12T00:06:08.089 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020388200000000001 2024-09-12T00:06:08.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.089 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.089 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:08.089 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.440251+0000", 2024-09-12T00:06:08.089 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017339100000000001 2024-09-12T00:06:08.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.090 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.459982+0000", 2024-09-12T00:06:08.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.01973099 2024-09-12T00:06:08.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.090 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.480958+0000", 2024-09-12T00:06:08.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020975730000000001 2024-09-12T00:06:08.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.090 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.090 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.090 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481034+0000", 2024-09-12T00:06:08.090 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.6224999999999996e-05 2024-09-12T00:06:08.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.091 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.091 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481122+0000", 2024-09-12T00:06:08.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8375999999999995e-05 2024-09-12T00:06:08.091 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.091 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.091 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.091 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.091 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3005 3.35 3:ae3b5a36:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:08.091 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:06:08.091 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 47.611307148999998, 2024-09-12T00:06:08.091 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.028828275, 2024-09-12T00:06:08.092 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.092 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.092 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.092 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.092 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.092 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.092 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3005 2024-09-12T00:06:08.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.092 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.092 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.092 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.092 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:06:08.092 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.093 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.093 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.093 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447424+0000", 2024-09-12T00:06:08.093 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.093 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.093 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.093 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.447427+0000", 2024-09-12T00:06:08.093 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.864e-06 2024-09-12T00:06:08.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.093 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.093 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.093 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449003+0000", 2024-09-12T00:06:08.094 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001575405 2024-09-12T00:06:08.094 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.094 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.094 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.094 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449030+0000", 2024-09-12T00:06:08.094 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7189999999999999e-05 2024-09-12T00:06:08.094 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.094 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.094 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.094 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449042+0000", 2024-09-12T00:06:08.094 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2038999999999999e-05 2024-09-12T00:06:08.094 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.094 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.094 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.095 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449111+0000", 2024-09-12T00:06:08.095 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.9521000000000001e-05 2024-09-12T00:06:08.095 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.095 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.095 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.095 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449218+0000", 2024-09-12T00:06:08.095 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010675600000000001 2024-09-12T00:06:08.095 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.095 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.095 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:06:08.095 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.449330+0000", 2024-09-12T00:06:08.095 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000111809 2024-09-12T00:06:08.095 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.095 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.096 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.096 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.469844+0000", 2024-09-12T00:06:08.096 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020514277000000001 2024-09-12T00:06:08.096 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.096 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.096 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.096 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.475983+0000", 2024-09-12T00:06:08.096 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0061392540000000002 2024-09-12T00:06:08.096 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.096 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.096 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.096 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.476113+0000", 2024-09-12T00:06:08.096 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000129713 2024-09-12T00:06:08.097 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.097 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.097 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.097 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.476253+0000", 2024-09-12T00:06:08.097 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013944700000000001 2024-09-12T00:06:08.097 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.097 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.097 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.097 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.097 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.097 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3006 3.3 3:c183ca95:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:08.097 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:06:08.097 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 47.601780578000003, 2024-09-12T00:06:08.097 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.024661756, 2024-09-12T00:06:08.098 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.098 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.098 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.098 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.098 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.098 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.098 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3006 2024-09-12T00:06:08.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.098 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.098 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.098 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.098 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:06:08.098 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.098 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.099 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.099 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456951+0000", 2024-09-12T00:06:08.099 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.099 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.099 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.099 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.099 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.456954+0000", 2024-09-12T00:06:08.099 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7070000000000001e-06 2024-09-12T00:06:08.099 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.099 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.099 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.099 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458684+0000", 2024-09-12T00:06:08.099 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017305479999999999 2024-09-12T00:06:08.099 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.100 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.100 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.100 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458709+0000", 2024-09-12T00:06:08.100 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4780999999999999e-05 2024-09-12T00:06:08.100 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.100 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.100 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.100 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458719+0000", 2024-09-12T00:06:08.100 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0202e-05 2024-09-12T00:06:08.100 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.100 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.100 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.100 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458800+0000", 2024-09-12T00:06:08.101 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0893e-05 2024-09-12T00:06:08.101 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.101 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.101 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.101 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.458990+0000", 2024-09-12T00:06:08.101 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018986400000000001 2024-09-12T00:06:08.101 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.101 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.101 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:08.101 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.459171+0000", 2024-09-12T00:06:08.101 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018135499999999999 2024-09-12T00:06:08.101 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.101 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.102 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.102 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.478356+0000", 2024-09-12T00:06:08.102 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019185153 2024-09-12T00:06:08.102 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.102 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.102 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.102 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481411+0000", 2024-09-12T00:06:08.102 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030546190000000002 2024-09-12T00:06:08.102 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.102 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.102 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.102 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481511+0000", 2024-09-12T00:06:08.102 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.9763e-05 2024-09-12T00:06:08.102 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.102 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.103 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.103 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.481613+0000", 2024-09-12T00:06:08.103 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101871 2024-09-12T00:06:08.103 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.103 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.103 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.103 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.103 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.103 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3375 3.15 3:ab335e39:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:06:08.103 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.646143+0000", 2024-09-12T00:06:08.103 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 27.412588727999999, 2024-09-12T00:06:08.103 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026933417000000001, 2024-09-12T00:06:08.103 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.103 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.104 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.104 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.104 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.104 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.104 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3375 2024-09-12T00:06:08.104 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.104 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.104 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.104 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.104 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.646143+0000", 2024-09-12T00:06:08.104 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.104 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.104 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.105 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.105 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.646143+0000", 2024-09-12T00:06:08.105 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.105 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.105 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.105 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.105 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.646146+0000", 2024-09-12T00:06:08.105 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.19e-06 2024-09-12T00:06:08.105 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.105 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.105 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.105 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648608+0000", 2024-09-12T00:06:08.105 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0024615470000000001 2024-09-12T00:06:08.105 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.106 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.106 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.106 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648640+0000", 2024-09-12T00:06:08.106 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.2342999999999998e-05 2024-09-12T00:06:08.106 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.106 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.106 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.106 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648655+0000", 2024-09-12T00:06:08.106 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5034e-05 2024-09-12T00:06:08.106 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.106 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.106 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.106 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648746+0000", 2024-09-12T00:06:08.106 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.1529999999999999e-05 2024-09-12T00:06:08.107 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.107 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.107 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.107 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.648938+0000", 2024-09-12T00:06:08.107 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191819 2024-09-12T00:06:08.107 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.107 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.107 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:08.107 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.649102+0000", 2024-09-12T00:06:08.107 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000164103 2024-09-12T00:06:08.107 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.107 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.107 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.107 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.658869+0000", 2024-09-12T00:06:08.108 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0097663530000000002 2024-09-12T00:06:08.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.108 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.108 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.108 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.672958+0000", 2024-09-12T00:06:08.108 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014089295 2024-09-12T00:06:08.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.108 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.108 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.108 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.673024+0000", 2024-09-12T00:06:08.108 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5834999999999996e-05 2024-09-12T00:06:08.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.108 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.109 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.109 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.673076+0000", 2024-09-12T00:06:08.109 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2367999999999997e-05 2024-09-12T00:06:08.109 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.109 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.109 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.109 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.109 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.109 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3392 3.1b e82/23 3:d9b2c983:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_19:head v 82'11, mlcod=76'9)", 2024-09-12T00:06:08.109 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.841020+0000", 2024-09-12T00:06:08.109 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 27.217711656999999, 2024-09-12T00:06:08.109 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022540108999999999, 2024-09-12T00:06:08.109 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.110 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.110 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.110 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.110 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.110 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.110 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.841020+0000", 2024-09-12T00:06:08.110 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.110 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.110 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.110 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.110 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.841020+0000", 2024-09-12T00:06:08.110 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.110 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.110 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.111 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.111 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.841022+0000", 2024-09-12T00:06:08.111 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4339999999999999e-06 2024-09-12T00:06:08.111 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.111 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.111 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.111 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847015+0000", 2024-09-12T00:06:08.111 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.005993104 2024-09-12T00:06:08.111 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.111 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.111 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.111 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847030+0000", 2024-09-12T00:06:08.112 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4595e-05 2024-09-12T00:06:08.112 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.112 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.112 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.112 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847041+0000", 2024-09-12T00:06:08.112 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1124000000000001e-05 2024-09-12T00:06:08.112 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.112 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.112 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.112 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847334+0000", 2024-09-12T00:06:08.112 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000292854 2024-09-12T00:06:08.112 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.112 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.113 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.113 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.847371+0000", 2024-09-12T00:06:08.113 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7336000000000003e-05 2024-09-12T00:06:08.113 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.113 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.113 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.113 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.863502+0000", 2024-09-12T00:06:08.113 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016130314999999999 2024-09-12T00:06:08.113 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.113 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.113 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.113 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.863560+0000", 2024-09-12T00:06:08.113 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8347000000000002e-05 2024-09-12T00:06:08.114 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.114 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.114 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.114 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.114 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.114 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3399 3.c 3:33260d65:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:06:08.114 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.912770+0000", 2024-09-12T00:06:08.114 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 27.145961512, 2024-09-12T00:06:08.114 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021761494999999999, 2024-09-12T00:06:08.114 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.114 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.114 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3399 2024-09-12T00:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.912770+0000", 2024-09-12T00:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.115 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.912770+0000", 2024-09-12T00:06:08.116 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.116 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.116 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.116 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.116 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.912773+0000", 2024-09-12T00:06:08.116 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.252e-06 2024-09-12T00:06:08.116 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.116 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.116 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.116 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915156+0000", 2024-09-12T00:06:08.116 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023823109999999998 2024-09-12T00:06:08.116 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.116 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.116 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.117 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915244+0000", 2024-09-12T00:06:08.117 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8926999999999997e-05 2024-09-12T00:06:08.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.117 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.117 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.117 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915265+0000", 2024-09-12T00:06:08.117 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0613999999999999e-05 2024-09-12T00:06:08.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.117 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.117 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.117 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915361+0000", 2024-09-12T00:06:08.117 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5542000000000001e-05 2024-09-12T00:06:08.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.117 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.118 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.118 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915538+0000", 2024-09-12T00:06:08.118 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017762400000000001 2024-09-12T00:06:08.118 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.118 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.118 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:06:08.118 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.915710+0000", 2024-09-12T00:06:08.119 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017170900000000001 2024-09-12T00:06:08.119 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.119 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.119 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.119 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.933564+0000", 2024-09-12T00:06:08.119 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017854080000000001 2024-09-12T00:06:08.119 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.119 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.119 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.119 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.934450+0000", 2024-09-12T00:06:08.120 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00088595700000000004 2024-09-12T00:06:08.120 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.120 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.120 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.120 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.934490+0000", 2024-09-12T00:06:08.120 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.0110000000000001e-05 2024-09-12T00:06:08.120 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.120 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.120 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.120 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.934531+0000", 2024-09-12T00:06:08.120 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.1369000000000003e-05 2024-09-12T00:06:08.120 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.120 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.121 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.121 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.121 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.121 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3678 3.15 3:a83db90f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_295:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:08.121 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:43.938089+0000", 2024-09-12T00:06:08.121 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 24.12064238, 2024-09-12T00:06:08.121 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021578831999999999, 2024-09-12T00:06:08.121 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.121 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.121 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.121 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.121 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.121 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.121 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3678 2024-09-12T00:06:08.122 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.122 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.122 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.122 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.122 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.938089+0000", 2024-09-12T00:06:08.122 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.122 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.122 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.122 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.122 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.938089+0000", 2024-09-12T00:06:08.122 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.122 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.122 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.122 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.123 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.938094+0000", 2024-09-12T00:06:08.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.0719999999999999e-06 2024-09-12T00:06:08.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.123 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.123 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.123 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940370+0000", 2024-09-12T00:06:08.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022759159999999998 2024-09-12T00:06:08.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.123 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.123 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.123 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940401+0000", 2024-09-12T00:06:08.123 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1226999999999998e-05 2024-09-12T00:06:08.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.123 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940417+0000", 2024-09-12T00:06:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5603e-05 2024-09-12T00:06:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940499+0000", 2024-09-12T00:06:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1568000000000002e-05 2024-09-12T00:06:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940703+0000", 2024-09-12T00:06:08.124 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000203995 2024-09-12T00:06:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.940947+0000", 2024-09-12T00:06:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024444799999999997 2024-09-12T00:06:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.125 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.950088+0000", 2024-09-12T00:06:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0091408710000000001 2024-09-12T00:06:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.959534+0000", 2024-09-12T00:06:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0094463979999999999 2024-09-12T00:06:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.959594+0000", 2024-09-12T00:06:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0145000000000001e-05 2024-09-12T00:06:08.126 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:43.959668+0000", 2024-09-12T00:06:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3589000000000003e-05 2024-09-12T00:06:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3711 3.c 3:31bc51b2:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_328:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.647001+0000", 2024-09-12T00:06:08.127 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.411730227, 2024-09-12T00:06:08.128 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021286705, 2024-09-12T00:06:08.128 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.128 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.128 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.128 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.128 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.128 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.128 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3711 2024-09-12T00:06:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.647001+0000", 2024-09-12T00:06:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.647001+0000", 2024-09-12T00:06:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.647006+0000", 2024-09-12T00:06:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1900000000000003e-06 2024-09-12T00:06:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.651810+0000", 2024-09-12T00:06:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0048032159999999999 2024-09-12T00:06:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.130 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.651857+0000", 2024-09-12T00:06:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7416000000000001e-05 2024-09-12T00:06:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.651876+0000", 2024-09-12T00:06:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.9066999999999999e-05 2024-09-12T00:06:08.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.652058+0000", 2024-09-12T00:06:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018199500000000001 2024-09-12T00:06:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.652476+0000", 2024-09-12T00:06:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00041738000000000002 2024-09-12T00:06:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.132 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 7", 2024-09-12T00:06:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.652917+0000", 2024-09-12T00:06:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00044171899999999998 2024-09-12T00:06:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.667867+0000", 2024-09-12T00:06:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014949558 2024-09-12T00:06:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.668181+0000", 2024-09-12T00:06:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000313777 2024-09-12T00:06:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.133 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.668241+0000", 2024-09-12T00:06:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.0047999999999998e-05 2024-09-12T00:06:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.668288+0000", 2024-09-12T00:06:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7339000000000002e-05 2024-09-12T00:06:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.134 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3726 3.33 e83/23 3:cd6e0a10:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_343:head v 83'15, mlcod=83'13)", 2024-09-12T00:06:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.871373+0000", 2024-09-12T00:06:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.187358688, 2024-09-12T00:06:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021131233999999999, 2024-09-12T00:06:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.871373+0000", 2024-09-12T00:06:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.871373+0000", 2024-09-12T00:06:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.871374+0000", 2024-09-12T00:06:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.505e-06 2024-09-12T00:06:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.136 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875356+0000", 2024-09-12T00:06:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0039812060000000002 2024-09-12T00:06:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875381+0000", 2024-09-12T00:06:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.5259999999999999e-05 2024-09-12T00:06:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875392+0000", 2024-09-12T00:06:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1211e-05 2024-09-12T00:06:08.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875472+0000", 2024-09-12T00:06:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9505999999999994e-05 2024-09-12T00:06:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.875490+0000", 2024-09-12T00:06:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8819000000000001e-05 2024-09-12T00:06:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.138 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.892428+0000", 2024-09-12T00:06:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016937885 2024-09-12T00:06:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.892504+0000", 2024-09-12T00:06:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5841999999999997e-05 2024-09-12T00:06:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3727 3.35 3:ad6b6c99:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_344:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.876261+0000", 2024-09-12T00:06:08.139 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.182470871, 2024-09-12T00:06:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.029109105, 2024-09-12T00:06:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3727 2024-09-12T00:06:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.140 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.876261+0000", 2024-09-12T00:06:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.876261+0000", 2024-09-12T00:06:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.876264+0000", 2024-09-12T00:06:08.141 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.388e-06 2024-09-12T00:06:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878449+0000", 2024-09-12T00:06:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021847360000000001 2024-09-12T00:06:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878470+0000", 2024-09-12T00:06:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0792e-05 2024-09-12T00:06:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878481+0000", 2024-09-12T00:06:08.142 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1421e-05 2024-09-12T00:06:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878572+0000", 2024-09-12T00:06:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0882000000000002e-05 2024-09-12T00:06:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878763+0000", 2024-09-12T00:06:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191218 2024-09-12T00:06:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:06:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.878938+0000", 2024-09-12T00:06:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017507300000000001 2024-09-12T00:06:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.900618+0000", 2024-09-12T00:06:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021679706 2024-09-12T00:06:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.905243+0000", 2024-09-12T00:06:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0046246869999999997 2024-09-12T00:06:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.905314+0000", 2024-09-12T00:06:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1797000000000004e-05 2024-09-12T00:06:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.905370+0000", 2024-09-12T00:06:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5405000000000002e-05 2024-09-12T00:06:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3735 3.3f 3:fd0f007c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_352:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.971621+0000", 2024-09-12T00:06:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.087110043999999, 2024-09-12T00:06:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021631419999999998, 2024-09-12T00:06:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3735 2024-09-12T00:06:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.971621+0000", 2024-09-12T00:06:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.971621+0000", 2024-09-12T00:06:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.971626+0000", 2024-09-12T00:06:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.313e-06 2024-09-12T00:06:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.147 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973760+0000", 2024-09-12T00:06:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021346780000000001 2024-09-12T00:06:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973788+0000", 2024-09-12T00:06:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7327000000000001e-05 2024-09-12T00:06:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973799+0000", 2024-09-12T00:06:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1379999999999999e-05 2024-09-12T00:06:08.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.973904+0000", 2024-09-12T00:06:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000105071 2024-09-12T00:06:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.974119+0000", 2024-09-12T00:06:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021477399999999999 2024-09-12T00:06:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.149 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:06:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.974313+0000", 2024-09-12T00:06:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019439300000000001 2024-09-12T00:06:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.985849+0000", 2024-09-12T00:06:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011535915000000001 2024-09-12T00:06:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.993125+0000", 2024-09-12T00:06:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0072761299999999996 2024-09-12T00:06:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.150 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.993201+0000", 2024-09-12T00:06:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.5098000000000005e-05 2024-09-12T00:06:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.993253+0000", 2024-09-12T00:06:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.2340999999999999e-05 2024-09-12T00:06:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3756 3.15 3:aa8e955f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_373:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.207558+0000", 2024-09-12T00:06:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 22.851173227, 2024-09-12T00:06:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021266769000000001, 2024-09-12T00:06:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3756 2024-09-12T00:06:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.152 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.207558+0000", 2024-09-12T00:06:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.207558+0000", 2024-09-12T00:06:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.207561+0000", 2024-09-12T00:06:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9450000000000002e-06 2024-09-12T00:06:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209465+0000", 2024-09-12T00:06:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019040089999999999 2024-09-12T00:06:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209493+0000", 2024-09-12T00:06:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7645999999999999e-05 2024-09-12T00:06:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209507+0000", 2024-09-12T00:06:08.154 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4333e-05 2024-09-12T00:06:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209609+0000", 2024-09-12T00:06:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101543 2024-09-12T00:06:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.209822+0000", 2024-09-12T00:06:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021320000000000001 2024-09-12T00:06:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.155 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.210009+0000", 2024-09-12T00:06:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000187228 2024-09-12T00:06:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.219744+0000", 2024-09-12T00:06:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0097345079999999994 2024-09-12T00:06:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.228686+0000", 2024-09-12T00:06:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0089426200000000001 2024-09-12T00:06:08.156 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.228768+0000", 2024-09-12T00:06:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2112000000000003e-05 2024-09-12T00:06:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.157 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.228825+0000", 2024-09-12T00:06:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6625000000000001e-05 2024-09-12T00:06:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3785 3.15 3:ab478e86:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_402:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.539840+0000", 2024-09-12T00:06:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 22.518891716999999, 2024-09-12T00:06:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.023091957999999999, 2024-09-12T00:06:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.158 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3785 2024-09-12T00:06:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.539840+0000", 2024-09-12T00:06:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.539840+0000", 2024-09-12T00:06:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.539843+0000", 2024-09-12T00:06:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4410000000000002e-06 2024-09-12T00:06:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541660+0000", 2024-09-12T00:06:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0018169239999999999 2024-09-12T00:06:08.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.161 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.161 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.161 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541704+0000", 2024-09-12T00:06:08.161 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.4072000000000001e-05 2024-09-12T00:06:08.161 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.161 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.161 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.162 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541726+0000", 2024-09-12T00:06:08.162 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.1875e-05 2024-09-12T00:06:08.162 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.162 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.162 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.162 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541825+0000", 2024-09-12T00:06:08.162 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8500999999999998e-05 2024-09-12T00:06:08.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.163 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.163 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.163 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.541997+0000", 2024-09-12T00:06:08.163 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000172781 2024-09-12T00:06:08.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.164 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:08.164 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.542177+0000", 2024-09-12T00:06:08.164 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018009699999999999 2024-09-12T00:06:08.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.164 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.165 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.165 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.558969+0000", 2024-09-12T00:06:08.165 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016791805999999999 2024-09-12T00:06:08.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.165 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.165 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.166 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.562789+0000", 2024-09-12T00:06:08.166 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.003819308 2024-09-12T00:06:08.166 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.166 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.166 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.166 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.562869+0000", 2024-09-12T00:06:08.166 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0550999999999995e-05 2024-09-12T00:06:08.167 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.167 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.167 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.167 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.562932+0000", 2024-09-12T00:06:08.167 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.2601999999999995e-05 2024-09-12T00:06:08.167 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.168 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.168 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.168 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.168 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.168 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3798 3.35 3:ac2a574a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_415:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:08.168 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.681661+0000", 2024-09-12T00:06:08.169 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 22.377070545999999, 2024-09-12T00:06:08.169 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.029133148000000001, 2024-09-12T00:06:08.169 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.169 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.169 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.169 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.170 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.170 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.170 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3798 2024-09-12T00:06:08.170 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.170 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.170 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.171 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.171 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.681661+0000", 2024-09-12T00:06:08.171 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.171 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.171 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.171 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.172 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.681661+0000", 2024-09-12T00:06:08.172 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.172 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.172 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.172 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.681665+0000", 2024-09-12T00:06:08.173 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.591e-06 2024-09-12T00:06:08.173 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.173 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.173 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.173 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683576+0000", 2024-09-12T00:06:08.173 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019111 2024-09-12T00:06:08.174 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.174 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.174 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.174 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683608+0000", 2024-09-12T00:06:08.174 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.269e-05 2024-09-12T00:06:08.174 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.175 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.175 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.175 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683623+0000", 2024-09-12T00:06:08.175 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4501000000000001e-05 2024-09-12T00:06:08.175 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.175 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.176 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.176 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683714+0000", 2024-09-12T00:06:08.176 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0666000000000002e-05 2024-09-12T00:06:08.176 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.176 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.176 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.177 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.683913+0000", 2024-09-12T00:06:08.177 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000199037 2024-09-12T00:06:08.177 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.177 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.177 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:06:08.177 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.684084+0000", 2024-09-12T00:06:08.177 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017164700000000001 2024-09-12T00:06:08.178 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.178 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.178 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.178 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.697732+0000", 2024-09-12T00:06:08.178 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013647670000000001 2024-09-12T00:06:08.178 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.178 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.179 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.179 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.710663+0000", 2024-09-12T00:06:08.179 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012931265000000001 2024-09-12T00:06:08.179 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.179 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.179 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.179 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.710737+0000", 2024-09-12T00:06:08.179 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4181e-05 2024-09-12T00:06:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.710794+0000", 2024-09-12T00:06:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6799999999999998e-05 2024-09-12T00:06:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.180 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:4293 3.38 e95/23 3:1fc55592:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.12__shadow_.h1uxKGkm-wWs7JNavkRQbjhJYN05a11_234:head v 95'22, mlcod=95'20)", 2024-09-12T00:06:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:06:07.726804+0000", 2024-09-12T00:06:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.33192782199999998, 2024-09-12T00:06:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026149286000000001, 2024-09-12T00:06:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.726804+0000", 2024-09-12T00:06:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.181 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.726804+0000", 2024-09-12T00:06:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.726806+0000", 2024-09-12T00:06:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8950000000000001e-06 2024-09-12T00:06:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.731548+0000", 2024-09-12T00:06:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0047420759999999996 2024-09-12T00:06:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.731585+0000", 2024-09-12T00:06:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7826e-05 2024-09-12T00:06:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.731603+0000", 2024-09-12T00:06:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7155000000000001e-05 2024-09-12T00:06:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.731713+0000", 2024-09-12T00:06:08.183 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110072 2024-09-12T00:06:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.731749+0000", 2024-09-12T00:06:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6424000000000002e-05 2024-09-12T00:06:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.752886+0000", 2024-09-12T00:06:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021137000999999999 2024-09-12T00:06:08.184 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.752953+0000", 2024-09-12T00:06:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.6836999999999997e-05 2024-09-12T00:06:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:4294 3.2f 3:f5a6c46e:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.12__shadow_.h1uxKGkm-wWs7JNavkRQbjhJYN05a11_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-12T00:06:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:06:07.731789+0000", 2024-09-12T00:06:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.32694210299999998, 2024-09-12T00:06:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021476579999999999, 2024-09-12T00:06:08.185 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 4294 2024-09-12T00:06:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.731789+0000", 2024-09-12T00:06:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.186 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.731789+0000", 2024-09-12T00:06:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.731792+0000", 2024-09-12T00:06:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6139999999999999e-06 2024-09-12T00:06:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.733542+0000", 2024-09-12T00:06:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0017501820000000001 2024-09-12T00:06:08.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.733570+0000", 2024-09-12T00:06:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7926e-05 2024-09-12T00:06:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.733585+0000", 2024-09-12T00:06:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5288999999999999e-05 2024-09-12T00:06:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.188 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.733681+0000", 2024-09-12T00:06:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.5847000000000006e-05 2024-09-12T00:06:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.733828+0000", 2024-09-12T00:06:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014709 2024-09-12T00:06:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.733951+0000", 2024-09-12T00:06:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012251699999999999 2024-09-12T00:06:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.189 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.749129+0000", 2024-09-12T00:06:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015178171000000001 2024-09-12T00:06:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.753168+0000", 2024-09-12T00:06:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0040387069999999999 2024-09-12T00:06:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.753210+0000", 2024-09-12T00:06:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2009999999999999e-05 2024-09-12T00:06:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.190 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.191 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.753266+0000", 2024-09-12T00:06:08.191 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.6227000000000002e-05 2024-09-12T00:06:08.191 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.191 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.191 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.191 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.191 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.191 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:06:08.192 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:06:08.193 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:06:08.192+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:06:08.293 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:06:08.295+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:06:08.350 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:06:08.351 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:06:08.351 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:06:08.351 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:06:08.373 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:06:08.417 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:06:08.419+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:06:08.460 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T00:06:08.495 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:06:08.496+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:06:08.582 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:06:08.582 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:06:08.582 INFO:teuthology.orchestra.run.smithi019.stdout: "complaint_time": 30, 2024-09-12T00:06:08.582 INFO:teuthology.orchestra.run.smithi019.stdout: "num_blocked_ops": 0 2024-09-12T00:06:08.582 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:06:08.599 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:06:08.595+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:06:08.607 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:06:08.697 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:06:08.696+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:06:08.798 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:06:08.799 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 20, 2024-09-12T00:06:08.799 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 600, 2024-09-12T00:06:08.799 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [ 2024-09-12T00:06:08.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.799 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:06:08.799 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:06:08.799 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 177.30494101100001, 2024-09-12T00:06:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.278479906, 2024-09-12T00:06:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:06:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:06:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 1 2024-09-12T00:06:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.800 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:06:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493419+0000", 2024-09-12T00:06:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.801 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493422+0000", 2024-09-12T00:06:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.807e-06 2024-09-12T00:06:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493435+0000", 2024-09-12T00:06:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.375e-05 2024-09-12T00:06:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493457+0000", 2024-09-12T00:06:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.2166000000000001e-05 2024-09-12T00:06:08.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493475+0000", 2024-09-12T00:06:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7184e-05 2024-09-12T00:06:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493617+0000", 2024-09-12T00:06:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014274200000000001 2024-09-12T00:06:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for peered", 2024-09-12T00:06:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.493632+0000", 2024-09-12T00:06:08.803 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4293e-05 2024-09-12T00:06:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.768657+0000", 2024-09-12T00:06:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.27502575400000001 2024-09-12T00:06:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769042+0000", 2024-09-12T00:06:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00038463700000000001 2024-09-12T00:06:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.804 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.769430+0000", 2024-09-12T00:06:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000388014 2024-09-12T00:06:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.770784+0000", 2024-09-12T00:06:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00135402 2024-09-12T00:06:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771735+0000", 2024-09-12T00:06:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00095068599999999996 2024-09-12T00:06:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.805 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771828+0000", 2024-09-12T00:06:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3468999999999996e-05 2024-09-12T00:06:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.771899+0000", 2024-09-12T00:06:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.0383999999999996e-05 2024-09-12T00:06:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.806 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:06:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:06:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 176.87637761100001, 2024-09-12T00:06:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021018614000000001, 2024-09-12T00:06:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:06:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:06:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 50 2024-09-12T00:06:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.807 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:06:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921982+0000", 2024-09-12T00:06:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.921983+0000", 2024-09-12T00:06:08.808 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.4499999999999996e-07 2024-09-12T00:06:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922071+0000", 2024-09-12T00:06:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.8010000000000006e-05 2024-09-12T00:06:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922084+0000", 2024-09-12T00:06:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3275000000000001e-05 2024-09-12T00:06:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.809 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922093+0000", 2024-09-12T00:06:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0580000000000004e-06 2024-09-12T00:06:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936515+0000", 2024-09-12T00:06:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014421270999999999 2024-09-12T00:06:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936677+0000", 2024-09-12T00:06:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000162003 2024-09-12T00:06:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.810 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.936908+0000", 2024-09-12T00:06:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023115700000000001 2024-09-12T00:06:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939985+0000", 2024-09-12T00:06:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030773879999999999 2024-09-12T00:06:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942623+0000", 2024-09-12T00:06:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0026377929999999998 2024-09-12T00:06:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.942818+0000", 2024-09-12T00:06:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019556200000000001 2024-09-12T00:06:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943001+0000", 2024-09-12T00:06:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018235199999999999 2024-09-12T00:06:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:06:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:06:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 176.876243219, 2024-09-12T00:06:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021092493, 2024-09-12T00:06:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:06:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:06:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 51 2024-09-12T00:06:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:06:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922117+0000", 2024-09-12T00:06:08.814 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922118+0000", 2024-09-12T00:06:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0389999999999999e-06 2024-09-12T00:06:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922124+0000", 2024-09-12T00:06:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5409999999999997e-06 2024-09-12T00:06:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.815 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922136+0000", 2024-09-12T00:06:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.205e-05 2024-09-12T00:06:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922147+0000", 2024-09-12T00:06:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0451e-05 2024-09-12T00:06:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938000+0000", 2024-09-12T00:06:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.015853682000000001 2024-09-12T00:06:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.816 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938142+0000", 2024-09-12T00:06:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014148899999999999 2024-09-12T00:06:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.938362+0000", 2024-09-12T00:06:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022034800000000001 2024-09-12T00:06:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940330+0000", 2024-09-12T00:06:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001967459 2024-09-12T00:06:08.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943064+0000", 2024-09-12T00:06:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0027346219999999999 2024-09-12T00:06:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943152+0000", 2024-09-12T00:06:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.7563000000000002e-05 2024-09-12T00:06:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.818 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943209+0000", 2024-09-12T00:06:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7249e-05 2024-09-12T00:06:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:06:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:06:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 176.876193726, 2024-09-12T00:06:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021175616000000001, 2024-09-12T00:06:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.819 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:06:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:06:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 52 2024-09-12T00:06:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:06:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.820 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922166+0000", 2024-09-12T00:06:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922167+0000", 2024-09-12T00:06:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.3300000000000001e-07 2024-09-12T00:06:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922174+0000", 2024-09-12T00:06:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.7070000000000003e-06 2024-09-12T00:06:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.821 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922184+0000", 2024-09-12T00:06:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0682e-05 2024-09-12T00:06:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.922195+0000", 2024-09-12T00:06:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0489000000000001e-05 2024-09-12T00:06:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939166+0000", 2024-09-12T00:06:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.016971245999999999 2024-09-12T00:06:08.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939243+0000", 2024-09-12T00:06:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.7201999999999997e-05 2024-09-12T00:06:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.939381+0000", 2024-09-12T00:06:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013770699999999999 2024-09-12T00:06:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.940923+0000", 2024-09-12T00:06:08.823 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001542302 2024-09-12T00:06:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943221+0000", 2024-09-12T00:06:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0022979720000000001 2024-09-12T00:06:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943295+0000", 2024-09-12T00:06:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3317000000000003e-05 2024-09-12T00:06:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.824 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:11.943342+0000", 2024-09-12T00:06:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7159e-05 2024-09-12T00:06:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:06:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:06:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 176.62684253, 2024-09-12T00:06:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020448573000000001, 2024-09-12T00:06:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.825 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:06:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:06:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 72 2024-09-12T00:06:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:06:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.826 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171517+0000", 2024-09-12T00:06:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171518+0000", 2024-09-12T00:06:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.0440000000000001e-06 2024-09-12T00:06:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171647+0000", 2024-09-12T00:06:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012912899999999999 2024-09-12T00:06:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.827 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171664+0000", 2024-09-12T00:06:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6079999999999999e-05 2024-09-12T00:06:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171675+0000", 2024-09-12T00:06:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1223000000000001e-05 2024-09-12T00:06:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182000+0000", 2024-09-12T00:06:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010324949 2024-09-12T00:06:08.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182178+0000", 2024-09-12T00:06:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017808799999999999 2024-09-12T00:06:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.182402+0000", 2024-09-12T00:06:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00022381199999999999 2024-09-12T00:06:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.190935+0000", 2024-09-12T00:06:08.829 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0085331560000000001 2024-09-12T00:06:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191728+0000", 2024-09-12T00:06:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079325700000000001 2024-09-12T00:06:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191864+0000", 2024-09-12T00:06:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013606299999999999 2024-09-12T00:06:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.830 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191966+0000", 2024-09-12T00:06:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101772 2024-09-12T00:06:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:06:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:06:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 176.626659335, 2024-09-12T00:06:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020675235, 2024-09-12T00:06:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.831 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:06:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:06:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 73 2024-09-12T00:06:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:06:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.832 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171700+0000", 2024-09-12T00:06:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171701+0000", 2024-09-12T00:06:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0999999999999997e-07 2024-09-12T00:06:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171709+0000", 2024-09-12T00:06:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.2540000000000003e-06 2024-09-12T00:06:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.833 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171724+0000", 2024-09-12T00:06:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5569e-05 2024-09-12T00:06:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171734+0000", 2024-09-12T00:06:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.6139999999999998e-06 2024-09-12T00:06:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183774+0000", 2024-09-12T00:06:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.012040444000000001 2024-09-12T00:06:08.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.183896+0000", 2024-09-12T00:06:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012204199999999999 2024-09-12T00:06:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184084+0000", 2024-09-12T00:06:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018792599999999999 2024-09-12T00:06:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.191984+0000", 2024-09-12T00:06:08.835 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0079003790000000008 2024-09-12T00:06:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192093+0000", 2024-09-12T00:06:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000108942 2024-09-12T00:06:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192250+0000", 2024-09-12T00:06:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015637600000000001 2024-09-12T00:06:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.837 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192376+0000", 2024-09-12T00:06:08.837 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012587899999999999 2024-09-12T00:06:08.837 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.837 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.837 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.837 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.837 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:06:08.837 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:06:08.837 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 176.62661112500001, 2024-09-12T00:06:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021088828, 2024-09-12T00:06:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:06:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:06:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 74 2024-09-12T00:06:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:06:08.838 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:06:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171749+0000", 2024-09-12T00:06:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.1699999999999997e-07 2024-09-12T00:06:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.839 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171758+0000", 2024-09-12T00:06:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0860000000000008e-06 2024-09-12T00:06:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171774+0000", 2024-09-12T00:06:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:06:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171788+0000", 2024-09-12T00:06:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4793999999999999e-05 2024-09-12T00:06:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.840 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.184842+0000", 2024-09-12T00:06:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013053607 2024-09-12T00:06:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185130+0000", 2024-09-12T00:06:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00028779199999999998 2024-09-12T00:06:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.185378+0000", 2024-09-12T00:06:08.841 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00024780100000000002 2024-09-12T00:06:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192513+0000", 2024-09-12T00:06:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0071350770000000001 2024-09-12T00:06:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192690+0000", 2024-09-12T00:06:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000176892 2024-09-12T00:06:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.842 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192769+0000", 2024-09-12T00:06:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9466000000000001e-05 2024-09-12T00:06:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192837+0000", 2024-09-12T00:06:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8466000000000005e-05 2024-09-12T00:06:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:06:08.843 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:06:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 176.62655854799999, 2024-09-12T00:06:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.02121994, 2024-09-12T00:06:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:06:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:06:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 75 2024-09-12T00:06:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.844 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:06:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171801+0000", 2024-09-12T00:06:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171802+0000", 2024-09-12T00:06:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.5000000000000002e-07 2024-09-12T00:06:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171954+0000", 2024-09-12T00:06:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015215500000000001 2024-09-12T00:06:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171966+0000", 2024-09-12T00:06:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.1548e-05 2024-09-12T00:06:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171970+0000", 2024-09-12T00:06:08.846 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.8729999999999998e-06 2024-09-12T00:06:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186552+0000", 2024-09-12T00:06:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014581775 2024-09-12T00:06:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.847 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186702+0000", 2024-09-12T00:06:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014946 2024-09-12T00:06:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.186897+0000", 2024-09-12T00:06:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000195071 2024-09-12T00:06:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192666+0000", 2024-09-12T00:06:08.848 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0057693470000000002 2024-09-12T00:06:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192857+0000", 2024-09-12T00:06:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000191149 2024-09-12T00:06:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.192967+0000", 2024-09-12T00:06:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000110202 2024-09-12T00:06:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193021+0000", 2024-09-12T00:06:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.3709999999999999e-05 2024-09-12T00:06:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4204.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T00:06:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:06:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 176.62637925300001, 2024-09-12T00:06:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.026297425999999999, 2024-09-12T00:06:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.850 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4204", 2024-09-12T00:06:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.135:0/1390486491", 2024-09-12T00:06:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 76 2024-09-12T00:06:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:06:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:06:08.851 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171981+0000", 2024-09-12T00:06:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.9399999999999995e-07 2024-09-12T00:06:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.171987+0000", 2024-09-12T00:06:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.5230000000000003e-06 2024-09-12T00:06:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172005+0000", 2024-09-12T00:06:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.8788e-05 2024-09-12T00:06:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.172010+0000", 2024-09-12T00:06:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7570000000000004e-06 2024-09-12T00:06:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193104+0000", 2024-09-12T00:06:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021094112000000002 2024-09-12T00:06:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.853 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193334+0000", 2024-09-12T00:06:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000229855 2024-09-12T00:06:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.193697+0000", 2024-09-12T00:06:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00036272399999999998 2024-09-12T00:06:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.195602+0000", 2024-09-12T00:06:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019049620000000001 2024-09-12T00:06:08.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198123+0000", 2024-09-12T00:06:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0025216520000000001 2024-09-12T00:06:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198213+0000", 2024-09-12T00:06:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.0008999999999998e-05 2024-09-12T00:06:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:03:12.198278+0000", 2024-09-12T00:06:08.855 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4549999999999997e-05 2024-09-12T00:06:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:2996 3.21 e75/23 3:872b1c12:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_35:head v 75'4, mlcod=63'2)", 2024-09-12T00:06:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.357371+0000", 2024-09-12T00:06:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.440988832999999, 2024-09-12T00:06:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021201353999999999, 2024-09-12T00:06:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.856 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.357371+0000", 2024-09-12T00:06:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.357371+0000", 2024-09-12T00:06:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.357372+0000", 2024-09-12T00:06:08.857 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.424e-06 2024-09-12T00:06:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.364586+0000", 2024-09-12T00:06:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0072140609999999999 2024-09-12T00:06:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.364611+0000", 2024-09-12T00:06:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.4593e-05 2024-09-12T00:06:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.858 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.859 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.364625+0000", 2024-09-12T00:06:08.859 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3974999999999999e-05 2024-09-12T00:06:08.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.859 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.859 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.364718+0000", 2024-09-12T00:06:08.859 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.2899000000000006e-05 2024-09-12T00:06:08.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.364748+0000", 2024-09-12T00:06:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9629999999999999e-05 2024-09-12T00:06:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.378470+0000", 2024-09-12T00:06:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.013722323999999999 2024-09-12T00:06:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.378572+0000", 2024-09-12T00:06:08.860 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00010244800000000001 2024-09-12T00:06:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3031 3.1c 3:3b901b6c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.749824+0000", 2024-09-12T00:06:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.048535403000002, 2024-09-12T00:06:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025171115000000001, 2024-09-12T00:06:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.861 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3031 2024-09-12T00:06:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.749824+0000", 2024-09-12T00:06:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.749824+0000", 2024-09-12T00:06:08.862 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.749828+0000", 2024-09-12T00:06:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.839e-06 2024-09-12T00:06:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.751966+0000", 2024-09-12T00:06:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021378360000000002 2024-09-12T00:06:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.863 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.751995+0000", 2024-09-12T00:06:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.8631000000000001e-05 2024-09-12T00:06:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.752010+0000", 2024-09-12T00:06:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4899000000000001e-05 2024-09-12T00:06:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.752090+0000", 2024-09-12T00:06:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0352000000000006e-05 2024-09-12T00:06:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.864 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.752237+0000", 2024-09-12T00:06:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00014683400000000001 2024-09-12T00:06:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:06:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.752389+0000", 2024-09-12T00:06:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00015245699999999999 2024-09-12T00:06:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.769694+0000", 2024-09-12T00:06:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.017305259 2024-09-12T00:06:08.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.774831+0000", 2024-09-12T00:06:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0051360360000000001 2024-09-12T00:06:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.774895+0000", 2024-09-12T00:06:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.4454000000000003e-05 2024-09-12T00:06:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.774995+0000", 2024-09-12T00:06:08.866 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000100518 2024-09-12T00:06:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3034 3.2a 3:57bb186b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:20.782449+0000", 2024-09-12T00:06:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 48.015911062000001, 2024-09-12T00:06:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022965039999999999, 2024-09-12T00:06:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.867 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3034 2024-09-12T00:06:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.782449+0000", 2024-09-12T00:06:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.782449+0000", 2024-09-12T00:06:08.868 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.782452+0000", 2024-09-12T00:06:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.3670000000000001e-06 2024-09-12T00:06:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.784814+0000", 2024-09-12T00:06:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0023623030000000001 2024-09-12T00:06:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.784849+0000", 2024-09-12T00:06:08.869 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4245999999999997e-05 2024-09-12T00:06:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.784875+0000", 2024-09-12T00:06:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.6455999999999999e-05 2024-09-12T00:06:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.784972+0000", 2024-09-12T00:06:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7316000000000001e-05 2024-09-12T00:06:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.870 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.785154+0000", 2024-09-12T00:06:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018166499999999999 2024-09-12T00:06:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:06:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.785320+0000", 2024-09-12T00:06:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016586500000000001 2024-09-12T00:06:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.804742+0000", 2024-09-12T00:06:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019421600000000001 2024-09-12T00:06:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.871 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.805237+0000", 2024-09-12T00:06:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00049526400000000003 2024-09-12T00:06:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.805336+0000", 2024-09-12T00:06:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8912000000000004e-05 2024-09-12T00:06:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:20.805414+0000", 2024-09-12T00:06:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8046000000000005e-05 2024-09-12T00:06:08.872 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3133 3.10 3:0bd95b9d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:06:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:22.028646+0000", 2024-09-12T00:06:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 46.769713707000001, 2024-09-12T00:06:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.028771254, 2024-09-12T00:06:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.873 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3133 2024-09-12T00:06:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.028646+0000", 2024-09-12T00:06:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.028646+0000", 2024-09-12T00:06:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.028650+0000", 2024-09-12T00:06:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8850000000000001e-06 2024-09-12T00:06:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.030628+0000", 2024-09-12T00:06:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0019778450000000002 2024-09-12T00:06:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.875 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.030658+0000", 2024-09-12T00:06:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.0275999999999999e-05 2024-09-12T00:06:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.030670+0000", 2024-09-12T00:06:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.2218000000000001e-05 2024-09-12T00:06:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.030764+0000", 2024-09-12T00:06:08.876 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.3953e-05 2024-09-12T00:06:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.030996+0000", 2024-09-12T00:06:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00023209500000000001 2024-09-12T00:06:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.031190+0000", 2024-09-12T00:06:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00019345699999999999 2024-09-12T00:06:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.877 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.036754+0000", 2024-09-12T00:06:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0055638980000000003 2024-09-12T00:06:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.057277+0000", 2024-09-12T00:06:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020523604000000001 2024-09-12T00:06:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.057358+0000", 2024-09-12T00:06:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.1143999999999994e-05 2024-09-12T00:06:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.878 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:22.057417+0000", 2024-09-12T00:06:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.8879000000000003e-05 2024-09-12T00:06:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3374 3.10 3:089db4d6:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:06:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:40.636005+0000", 2024-09-12T00:06:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 28.162355050999999, 2024-09-12T00:06:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.025433803000000001, 2024-09-12T00:06:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.879 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3374 2024-09-12T00:06:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.636005+0000", 2024-09-12T00:06:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.880 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.636005+0000", 2024-09-12T00:06:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.636009+0000", 2024-09-12T00:06:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2250000000000002e-06 2024-09-12T00:06:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639097+0000", 2024-09-12T00:06:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0030881020000000001 2024-09-12T00:06:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.881 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639124+0000", 2024-09-12T00:06:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.7390999999999999e-05 2024-09-12T00:06:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639138+0000", 2024-09-12T00:06:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.3155e-05 2024-09-12T00:06:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639221+0000", 2024-09-12T00:06:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.2996000000000003e-05 2024-09-12T00:06:08.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639390+0000", 2024-09-12T00:06:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016898999999999999 2024-09-12T00:06:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.639547+0000", 2024-09-12T00:06:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000157374 2024-09-12T00:06:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.651089+0000", 2024-09-12T00:06:08.883 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011542124000000001 2024-09-12T00:06:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.661319+0000", 2024-09-12T00:06:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010229538999999999 2024-09-12T00:06:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.661387+0000", 2024-09-12T00:06:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 6.8663000000000003e-05 2024-09-12T00:06:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.884 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:40.661439+0000", 2024-09-12T00:06:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.1243999999999999e-05 2024-09-12T00:06:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3712 3.1c 3:3a424314:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_329:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.670012+0000", 2024-09-12T00:06:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 24.128347887, 2024-09-12T00:06:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.024941801999999999, 2024-09-12T00:06:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.885 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3712 2024-09-12T00:06:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.670012+0000", 2024-09-12T00:06:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.886 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.670012+0000", 2024-09-12T00:06:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.670016+0000", 2024-09-12T00:06:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.2169999999999996e-06 2024-09-12T00:06:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.672951+0000", 2024-09-12T00:06:08.887 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0029345159999999999 2024-09-12T00:06:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.672998+0000", 2024-09-12T00:06:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7605999999999998e-05 2024-09-12T00:06:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.673019+0000", 2024-09-12T00:06:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0843e-05 2024-09-12T00:06:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.888 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.673187+0000", 2024-09-12T00:06:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00016786899999999999 2024-09-12T00:06:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.673628+0000", 2024-09-12T00:06:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00044081600000000002 2024-09-12T00:06:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:06:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.674047+0000", 2024-09-12T00:06:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00041917300000000001 2024-09-12T00:06:08.889 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.685347+0000", 2024-09-12T00:06:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.011300464 2024-09-12T00:06:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.694777+0000", 2024-09-12T00:06:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0094296550000000003 2024-09-12T00:06:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.694876+0000", 2024-09-12T00:06:08.890 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.8488999999999998e-05 2024-09-12T00:06:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.694954+0000", 2024-09-12T00:06:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.8153999999999997e-05 2024-09-12T00:06:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3722 3.1a 3:5af5b5cf:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_339:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:08.891 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:44.814831+0000", 2024-09-12T00:06:08.892 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.983528315000001, 2024-09-12T00:06:08.892 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021631714, 2024-09-12T00:06:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3722 2024-09-12T00:06:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.893 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.814831+0000", 2024-09-12T00:06:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.814831+0000", 2024-09-12T00:06:08.894 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.814836+0000", 2024-09-12T00:06:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3409999999999996e-06 2024-09-12T00:06:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.816751+0000", 2024-09-12T00:06:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.001915564 2024-09-12T00:06:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.895 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.816790+0000", 2024-09-12T00:06:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.8355000000000001e-05 2024-09-12T00:06:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.816807+0000", 2024-09-12T00:06:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.7703999999999999e-05 2024-09-12T00:06:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.816940+0000", 2024-09-12T00:06:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00013292600000000001 2024-09-12T00:06:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.896 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.817155+0000", 2024-09-12T00:06:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021460699999999999 2024-09-12T00:06:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.817330+0000", 2024-09-12T00:06:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00017552600000000001 2024-09-12T00:06:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.897 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.827842+0000", 2024-09-12T00:06:08.898 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010511533999999999 2024-09-12T00:06:08.898 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.898 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.898 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.898 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.836260+0000", 2024-09-12T00:06:08.898 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0084178399999999994 2024-09-12T00:06:08.898 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.836347+0000", 2024-09-12T00:06:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.6637000000000004e-05 2024-09-12T00:06:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:44.836463+0000", 2024-09-12T00:06:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011668 2024-09-12T00:06:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.899 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_repop(client.4379.0:3780 3.19 e83/23 3:9a0a1200:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_397:head v 83'18, mlcod=83'16)", 2024-09-12T00:06:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.485629+0000", 2024-09-12T00:06:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.312731216, 2024-09-12T00:06:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.020596468, 2024-09-12T00:06:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.485629+0000", 2024-09-12T00:06:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.900 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.485629+0000", 2024-09-12T00:06:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.485631+0000", 2024-09-12T00:06:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.9019999999999999e-06 2024-09-12T00:06:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.491531+0000", 2024-09-12T00:06:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0058997870000000001 2024-09-12T00:06:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.491569+0000", 2024-09-12T00:06:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.7432999999999999e-05 2024-09-12T00:06:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.902 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.491585+0000", 2024-09-12T00:06:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6651e-05 2024-09-12T00:06:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.491687+0000", 2024-09-12T00:06:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000101366 2024-09-12T00:06:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.491718+0000", 2024-09-12T00:06:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1031000000000002e-05 2024-09-12T00:06:08.903 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.506043+0000", 2024-09-12T00:06:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.014325311 2024-09-12T00:06:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.506225+0000", 2024-09-12T00:06:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00018198699999999999 2024-09-12T00:06:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.904 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3783 3.1c 3:38213e46:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_400:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.514915+0000", 2024-09-12T00:06:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.283444552999999, 2024-09-12T00:06:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.021806478000000001, 2024-09-12T00:06:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.905 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3783 2024-09-12T00:06:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.514915+0000", 2024-09-12T00:06:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.514915+0000", 2024-09-12T00:06:08.906 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.514920+0000", 2024-09-12T00:06:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.7480000000000001e-06 2024-09-12T00:06:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517111+0000", 2024-09-12T00:06:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021913890000000002 2024-09-12T00:06:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.907 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517157+0000", 2024-09-12T00:06:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.5754000000000003e-05 2024-09-12T00:06:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517177+0000", 2024-09-12T00:06:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 2.0197999999999999e-05 2024-09-12T00:06:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517294+0000", 2024-09-12T00:06:08.908 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000117156 2024-09-12T00:06:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517503+0000", 2024-09-12T00:06:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00020805500000000001 2024-09-12T00:06:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 0", 2024-09-12T00:06:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.517714+0000", 2024-09-12T00:06:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00021131399999999999 2024-09-12T00:06:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.909 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.535744+0000", 2024-09-12T00:06:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.018029677000000001 2024-09-12T00:06:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.536543+0000", 2024-09-12T00:06:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00079940499999999999 2024-09-12T00:06:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.536642+0000", 2024-09-12T00:06:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.9440999999999999e-05 2024-09-12T00:06:08.910 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.536722+0000", 2024-09-12T00:06:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.9340999999999998e-05 2024-09-12T00:06:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:3786 3.37 3:ece0bced:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_403:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:05:45.550483+0000", 2024-09-12T00:06:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 23.247877225, 2024-09-12T00:06:08.911 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022719506, 2024-09-12T00:06:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 3786 2024-09-12T00:06:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.550483+0000", 2024-09-12T00:06:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.912 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.550483+0000", 2024-09-12T00:06:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.550486+0000", 2024-09-12T00:06:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.4070000000000002e-06 2024-09-12T00:06:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.913 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.552644+0000", 2024-09-12T00:06:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0021584629999999998 2024-09-12T00:06:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.552676+0000", 2024-09-12T00:06:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.1662000000000003e-05 2024-09-12T00:06:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.552691+0000", 2024-09-12T00:06:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4780000000000001e-05 2024-09-12T00:06:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.914 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.552788+0000", 2024-09-12T00:06:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 9.7034999999999995e-05 2024-09-12T00:06:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.553009+0000", 2024-09-12T00:06:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000220991 2024-09-12T00:06:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 3", 2024-09-12T00:06:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.553191+0000", 2024-09-12T00:06:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.000182349 2024-09-12T00:06:08.915 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.573055+0000", 2024-09-12T00:06:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.019863553999999999 2024-09-12T00:06:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.573071+0000", 2024-09-12T00:06:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.6178e-05 2024-09-12T00:06:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.916 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.573144+0000", 2024-09-12T00:06:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 7.3362000000000007e-05 2024-09-12T00:06:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:05:45.573202+0000", 2024-09-12T00:06:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 5.7725e-05 2024-09-12T00:06:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: "description": "osd_op(client.4379.0:4281 3.37 3:eecd01ab:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.12__shadow_.h1uxKGkm-wWs7JNavkRQbjhJYN05a11_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-12T00:06:08.917 INFO:teuthology.orchestra.run.smithi019.stdout: "initiated_at": "2024-09-12T00:06:07.560557+0000", 2024-09-12T00:06:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 1.237802673, 2024-09-12T00:06:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.022253113000000001, 2024-09-12T00:06:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "continuous": false, 2024-09-12T00:06:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "type_data": { 2024-09-12T00:06:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "client_info": { 2024-09-12T00:06:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4379", 2024-09-12T00:06:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "tid": 4281 2024-09-12T00:06:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "events": [ 2024-09-12T00:06:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.918 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "initiated", 2024-09-12T00:06:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.560557+0000", 2024-09-12T00:06:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "header_read", 2024-09-12T00:06:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.560557+0000", 2024-09-12T00:06:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0 2024-09-12T00:06:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "throttled", 2024-09-12T00:06:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.560561+0000", 2024-09-12T00:06:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 3.6239999999999999e-06 2024-09-12T00:06:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.919 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "all_read", 2024-09-12T00:06:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.563103+0000", 2024-09-12T00:06:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.002542215 2024-09-12T00:06:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "dispatched", 2024-09-12T00:06:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.563146+0000", 2024-09-12T00:06:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 4.3158000000000003e-05 2024-09-12T00:06:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "queued_for_pg", 2024-09-12T00:06:08.920 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.563161+0000", 2024-09-12T00:06:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 1.4844000000000001e-05 2024-09-12T00:06:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "reached_pg", 2024-09-12T00:06:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.563273+0000", 2024-09-12T00:06:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00011158900000000001 2024-09-12T00:06:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "started", 2024-09-12T00:06:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.563526+0000", 2024-09-12T00:06:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00025345000000000001 2024-09-12T00:06:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.921 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.563797+0000", 2024-09-12T00:06:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00027079699999999998 2024-09-12T00:06:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "op_commit", 2024-09-12T00:06:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.571849+0000", 2024-09-12T00:06:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.0080526130000000001 2024-09-12T00:06:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.582605+0000", 2024-09-12T00:06:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.010756007999999999 2024-09-12T00:06:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.922 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "commit_sent", 2024-09-12T00:06:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.582730+0000", 2024-09-12T00:06:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 0.00012431899999999999 2024-09-12T00:06:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:06:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:06:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: "event": "done", 2024-09-12T00:06:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: "time": "2024-09-12T00:06:07.582810+0000", 2024-09-12T00:06:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: "duration": 8.0495999999999996e-05 2024-09-12T00:06:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:06:08.923 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T00:06:08.923 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:06:08.924 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:06:08.800+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:06:08.925 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:06:08.926 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:06:08.924+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:06:08.988 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:06:09.034 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:06:09.035+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:06:09.069 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:06:09.069 INFO:teuthology.orchestra.run.smithi019.stdout: "ops": [], 2024-09-12T00:06:09.069 INFO:teuthology.orchestra.run.smithi019.stdout: "num_ops": 0 2024-09-12T00:06:09.069 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:06:09.093 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:06:09.126 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:06:09.128+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:06:09.179 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:06:09.179 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:06:09.215 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:06:09.215 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:06:09.227 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:06:09.228+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:06:09.240 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:06:09.241 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:06:09.265 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:06:09.265 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:06:09.289 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:06:09.290 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:06:09.307 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:09.307 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:09.318 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:06:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:06:09.327 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:06:09.328+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:06:09.331 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:06:09.351 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:06:09.351 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:06:09.392 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:06:09.392 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:06:09.428 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:06:09.428+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:06:09.517 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T00:06:09.518 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:09.518 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:09.531 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:06:09.528+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:06:09.540 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:06:09.630 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:06:09.632+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:06:09.679 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:09.679 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:09.699 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:06:09.731 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:06:09.732+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:06:09.832 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:06:09.831+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:06:09.846 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:09.846 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:09.864 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:06:09.933 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:06:09.932+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:06:10.034 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:06:10.035+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:06:10.051 INFO:teuthology.orchestra.run.smithi019.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:10.052 INFO:teuthology.orchestra.run.smithi019.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:10.077 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:06:10.135 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:06:10.136+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:06:10.221 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:10.221 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:10.236 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:06:10.235+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:06:10.243 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:06:10.337 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:06:10.336+0000 7f390c2d6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26591) UID: 0 2024-09-12T00:06:10.417 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:10.417 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:10.437 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:06:10.438 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:06:10.439+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:06:10.540 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:06:10.539+0000 7faf4ed2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26417) UID: 0 2024-09-12T00:06:10.610 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:10.610 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:10.628 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:06:10.674 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:06:10.676+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:06:10.741 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:06:10.739+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:06:10.762 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:10.929 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:10.931 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:06:10.932 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:06:10.932+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:06:11.032 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:06:11.032+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:06:11.058 INFO:tasks.workunit.client.0.smithi019.stdout:quota disabled for the bucket: buck_2024_08_12_00_06_00 2024-09-12T00:06:11.058 INFO:tasks.workunit.client.0.smithi019.stdout:adding file to bucket: 2Gb. 2024-09-12T00:06:11.059 INFO:tasks.workunit.client.0.smithi019.stdout:upload file successful 2024-09-12T00:06:11.059 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:06:11.059 INFO:tasks.workunit.client.0.smithi019.stdout:Test case: PASSED - bucket quota size for a given user doesnt take effect when quota is disabled 2024-09-12T00:06:11.059 INFO:tasks.workunit.client.0.smithi019.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:06:11.106 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:11.106 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:11.121 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:06:11.132 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:06:11.131+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:06:11.233 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:06:11.232+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:06:11.298 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:11.298 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:11.314 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:06:11.324 INFO:tasks.workunit.client.0.smithi019.stdout:user qa_user deleted 2024-09-12T00:06:11.324 INFO:tasks.workunit.client.0.smithi019.stdout:bucket delete succeeded 2024-09-12T00:06:11.329 INFO:tasks.workunit.client.0.smithi019.stdout:OK 2024-09-12T00:06:11.330 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:06:11.330 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:06:11.375 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:06:11.375+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:06:11.389 INFO:tasks.workunit:Stopping ['rgw/s3_bucket_quota.pl'] on client.0... 2024-09-12T00:06:11.389 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:06:11.428 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:06:11.441 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:06:11.439+0000 7fe82cead640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-12T00:06:11.485 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:11.485 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:11.502 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:06:11.536 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:06:11.535+0000 7feb03721640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26413) UID: 0 2024-09-12T00:06:11.557 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:06:11.603 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T00:06:11.603 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:06:11.630 INFO:teuthology.orchestra.run.smithi135.stdout:ERROR: (22) Invalid argument 2024-09-12T00:06:11.630 INFO:teuthology.orchestra.run.smithi135.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:06:11.637 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T00:06:11.637 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:06:11.638 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:06:11.636+0000 7f3cd7d26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26584) UID: 0 2024-09-12T00:06:11.645 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:06:11.656 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T00:06:11.656 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:06:11.673 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3: {} 2024-09-12T00:06:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:06:11.693 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4: {} 2024-09-12T00:06:11.693 INFO:teuthology.orchestra.run.smithi019.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:06:11.716 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5: {} 2024-09-12T00:06:11.717 INFO:teuthology.orchestra.run.smithi019.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:06:11.735 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6: {} 2024-09-12T00:06:11.735 INFO:teuthology.orchestra.run.smithi019.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:06:11.738 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:06:11.739+0000 7f1c8c76f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26415) UID: 0 2024-09-12T00:06:11.753 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7: {} 2024-09-12T00:06:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:06:11.802 DEBUG:teuthology.parallel:result is None 2024-09-12T00:06:11.802 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:06:11.826 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:06:11.826 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:06:11.826 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:06:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:06:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:1646 3.25 3:a68106f1:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:06:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:06:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 98.747508573000005, 2024-09-12T00:06:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030091884999999999, 2024-09-12T00:06:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:11.827 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 1646 2024-09-12T00:06:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:06:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077102+0000", 2024-09-12T00:06:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.077113+0000", 2024-09-12T00:06:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.0186e-05 2024-09-12T00:06:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084821+0000", 2024-09-12T00:06:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077083450000000001 2024-09-12T00:06:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084857+0000", 2024-09-12T00:06:11.829 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6245000000000003e-05 2024-09-12T00:06:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.084900+0000", 2024-09-12T00:06:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2369e-05 2024-09-12T00:06:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085058+0000", 2024-09-12T00:06:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015858199999999999 2024-09-12T00:06:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.830 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.085307+0000", 2024-09-12T00:06:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024867999999999998 2024-09-12T00:06:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:06:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.086107+0000", 2024-09-12T00:06:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00080040099999999996 2024-09-12T00:06:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.100477+0000", 2024-09-12T00:06:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014369508 2024-09-12T00:06:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.831 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107016+0000", 2024-09-12T00:06:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.006538894 2024-09-12T00:06:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107121+0000", 2024-09-12T00:06:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105284 2024-09-12T00:06:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:33.107194+0000", 2024-09-12T00:06:11.832 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.3391000000000003e-05 2024-09-12T00:06:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2718 3.4 3:20fe36bb:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:06:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:06:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 84.039030414999999, 2024-09-12T00:06:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027867928, 2024-09-12T00:06:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:11.833 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2718 2024-09-12T00:06:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:06:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785581+0000", 2024-09-12T00:06:11.834 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.785584+0000", 2024-09-12T00:06:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.056e-06 2024-09-12T00:06:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792023+0000", 2024-09-12T00:06:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0064398069999999996 2024-09-12T00:06:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:11.835 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792058+0000", 2024-09-12T00:06:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5018000000000003e-05 2024-09-12T00:06:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792078+0000", 2024-09-12T00:06:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9862000000000001e-05 2024-09-12T00:06:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792248+0000", 2024-09-12T00:06:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017006399999999999 2024-09-12T00:06:11.836 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.792660+0000", 2024-09-12T00:06:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041189500000000001 2024-09-12T00:06:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.793081+0000", 2024-09-12T00:06:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000420395 2024-09-12T00:06:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:11.837 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.808422+0000", 2024-09-12T00:06:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015341626000000001 2024-09-12T00:06:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813192+0000", 2024-09-12T00:06:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0047701799999999997 2024-09-12T00:06:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813339+0000", 2024-09-12T00:06:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014643800000000001 2024-09-12T00:06:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.838 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.813449+0000", 2024-09-12T00:06:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010958700000000001 2024-09-12T00:06:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2736 3.25 3:a750a681:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.9__shadow_.F6hcGbrS3llT-OhTIWCLEDW4zIHPlxs_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:06:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:06:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 83.849258053, 2024-09-12T00:06:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025701234999999999, 2024-09-12T00:06:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:11.839 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2736 2024-09-12T00:06:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:06:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.840 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975353+0000", 2024-09-12T00:06:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.975357+0000", 2024-09-12T00:06:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9389999999999999e-06 2024-09-12T00:06:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:11.841 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979365+0000", 2024-09-12T00:06:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0040076679999999998 2024-09-12T00:06:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979402+0000", 2024-09-12T00:06:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7557e-05 2024-09-12T00:06:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979419+0000", 2024-09-12T00:06:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7203000000000001e-05 2024-09-12T00:06:11.842 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979543+0000", 2024-09-12T00:06:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000123423 2024-09-12T00:06:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.979784+0000", 2024-09-12T00:06:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024097800000000001 2024-09-12T00:06:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.843 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:06:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.980013+0000", 2024-09-12T00:06:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022881999999999999 2024-09-12T00:06:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:47.999860+0000", 2024-09-12T00:06:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019847908000000001 2024-09-12T00:06:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000741+0000", 2024-09-12T00:06:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00088041499999999995 2024-09-12T00:06:11.844 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.000915+0000", 2024-09-12T00:06:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017460300000000001 2024-09-12T00:06:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:04:48.001054+0000", 2024-09-12T00:06:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013872099999999999 2024-09-12T00:06:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.845 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.846 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.846 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2964 3.24 3:26c83ec0:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:11.846 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:06:11.846 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 51.819196251000001, 2024-09-12T00:06:11.846 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028979713000000001, 2024-09-12T00:06:11.846 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:11.846 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:11.846 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2964 2024-09-12T00:06:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:06:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.847 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005415+0000", 2024-09-12T00:06:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.005417+0000", 2024-09-12T00:06:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2450000000000001e-06 2024-09-12T00:06:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010885+0000", 2024-09-12T00:06:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054684809999999999 2024-09-12T00:06:11.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.849 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.849 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:11.849 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010901+0000", 2024-09-12T00:06:11.849 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.5097e-05 2024-09-12T00:06:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010908+0000", 2024-09-12T00:06:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7419999999999997e-06 2024-09-12T00:06:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.850 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.010968+0000", 2024-09-12T00:06:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.9837000000000003e-05 2024-09-12T00:06:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011082+0000", 2024-09-12T00:06:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011357399999999999 2024-09-12T00:06:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:06:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.011174+0000", 2024-09-12T00:06:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.2703999999999999e-05 2024-09-12T00:06:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.851 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.021639+0000", 2024-09-12T00:06:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010464641 2024-09-12T00:06:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034210+0000", 2024-09-12T00:06:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012570463 2024-09-12T00:06:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034300+0000", 2024-09-12T00:06:11.852 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.0691000000000003e-05 2024-09-12T00:06:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.034394+0000", 2024-09-12T00:06:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4238000000000001e-05 2024-09-12T00:06:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3052 3.32 3:4d6db9ea:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:06:11.853 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 50.844949624999998, 2024-09-12T00:06:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028091277000000001, 2024-09-12T00:06:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3052 2024-09-12T00:06:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:11.854 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:06:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979661+0000", 2024-09-12T00:06:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979664+0000", 2024-09-12T00:06:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:06:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.855 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986918+0000", 2024-09-12T00:06:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0072537110000000004 2024-09-12T00:06:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986956+0000", 2024-09-12T00:06:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8111999999999997e-05 2024-09-12T00:06:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.986975+0000", 2024-09-12T00:06:11.856 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.9245999999999998e-05 2024-09-12T00:06:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987159+0000", 2024-09-12T00:06:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000183828 2024-09-12T00:06:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987552+0000", 2024-09-12T00:06:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039349699999999998 2024-09-12T00:06:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:06:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.987943+0000", 2024-09-12T00:06:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000390579 2024-09-12T00:06:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.999384+0000", 2024-09-12T00:06:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011441563 2024-09-12T00:06:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007634+0000", 2024-09-12T00:06:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082496240000000005 2024-09-12T00:06:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.858 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007699+0000", 2024-09-12T00:06:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5089e-05 2024-09-12T00:06:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.007753+0000", 2024-09-12T00:06:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.3588000000000003e-05 2024-09-12T00:06:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3125 3.12 3:495b0235:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T00:06:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:06:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 49.908840341999998, 2024-09-12T00:06:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030616648999999999, 2024-09-12T00:06:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3125 2024-09-12T00:06:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:11.860 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:06:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915771+0000", 2024-09-12T00:06:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.915773+0000", 2024-09-12T00:06:11.861 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.2800000000000002e-06 2024-09-12T00:06:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919856+0000", 2024-09-12T00:06:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004082713 2024-09-12T00:06:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919879+0000", 2024-09-12T00:06:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3782e-05 2024-09-12T00:06:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:11.862 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.919891+0000", 2024-09-12T00:06:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1440000000000001e-05 2024-09-12T00:06:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920037+0000", 2024-09-12T00:06:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014562700000000001 2024-09-12T00:06:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920280+0000", 2024-09-12T00:06:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000243274 2024-09-12T00:06:11.863 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:06:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.920527+0000", 2024-09-12T00:06:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024692699999999998 2024-09-12T00:06:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.932485+0000", 2024-09-12T00:06:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011957857000000001 2024-09-12T00:06:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946197+0000", 2024-09-12T00:06:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013712436999999999 2024-09-12T00:06:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946305+0000", 2024-09-12T00:06:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000107914 2024-09-12T00:06:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.946387+0000", 2024-09-12T00:06:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.2398000000000006e-05 2024-09-12T00:06:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.865 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3386 3.1 3:8071dd26:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:06:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.767011+0000", 2024-09-12T00:06:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 31.057600494999999, 2024-09-12T00:06:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.031756300000000001, 2024-09-12T00:06:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:11.866 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3386 2024-09-12T00:06:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.767011+0000", 2024-09-12T00:06:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.767011+0000", 2024-09-12T00:06:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.867 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.767014+0000", 2024-09-12T00:06:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0429999999999999e-06 2024-09-12T00:06:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775360+0000", 2024-09-12T00:06:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0083463740000000002 2024-09-12T00:06:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775398+0000", 2024-09-12T00:06:11.868 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8376e-05 2024-09-12T00:06:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775415+0000", 2024-09-12T00:06:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6563e-05 2024-09-12T00:06:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775556+0000", 2024-09-12T00:06:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000140865 2024-09-12T00:06:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.869 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.775819+0000", 2024-09-12T00:06:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000262842 2024-09-12T00:06:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.776048+0000", 2024-09-12T00:06:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000229399 2024-09-12T00:06:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.791048+0000", 2024-09-12T00:06:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015000503 2024-09-12T00:06:11.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.798597+0000", 2024-09-12T00:06:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0075482409999999998 2024-09-12T00:06:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.798690+0000", 2024-09-12T00:06:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3769000000000003e-05 2024-09-12T00:06:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:11.871 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.798767+0000", 2024-09-12T00:06:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.6324999999999999e-05 2024-09-12T00:06:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3398 3.12 3:4888914b:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:06:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.904027+0000", 2024-09-12T00:06:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 30.920583896, 2024-09-12T00:06:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.029408179999999999, 2024-09-12T00:06:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:11.872 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3398 2024-09-12T00:06:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.904027+0000", 2024-09-12T00:06:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.873 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.904027+0000", 2024-09-12T00:06:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.904030+0000", 2024-09-12T00:06:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0529999999999998e-06 2024-09-12T00:06:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.910958+0000", 2024-09-12T00:06:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0069274849999999997 2024-09-12T00:06:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.910989+0000", 2024-09-12T00:06:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1752999999999999e-05 2024-09-12T00:06:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911006+0000", 2024-09-12T00:06:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6463000000000001e-05 2024-09-12T00:06:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:11.875 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911171+0000", 2024-09-12T00:06:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016481699999999999 2024-09-12T00:06:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911417+0000", 2024-09-12T00:06:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024629600000000001 2024-09-12T00:06:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:06:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.911646+0000", 2024-09-12T00:06:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022906599999999999 2024-09-12T00:06:11.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.932777+0000", 2024-09-12T00:06:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.021130906000000001 2024-09-12T00:06:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.933094+0000", 2024-09-12T00:06:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000317127 2024-09-12T00:06:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.933277+0000", 2024-09-12T00:06:11.877 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018257000000000001 2024-09-12T00:06:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.933435+0000", 2024-09-12T00:06:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015864399999999999 2024-09-12T00:06:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3401 3.20 e82/23 3:06d9612a:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_28:head v 82'11, mlcod=76'9)", 2024-09-12T00:06:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.936564+0000", 2024-09-12T00:06:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 30.888047134000001, 2024-09-12T00:06:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.026227489999999999, 2024-09-12T00:06:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.936564+0000", 2024-09-12T00:06:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.879 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.936564+0000", 2024-09-12T00:06:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.936571+0000", 2024-09-12T00:06:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5959999999999998e-06 2024-09-12T00:06:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941597+0000", 2024-09-12T00:06:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0050253720000000002 2024-09-12T00:06:11.880 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941625+0000", 2024-09-12T00:06:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8564999999999998e-05 2024-09-12T00:06:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941640+0000", 2024-09-12T00:06:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.4837e-05 2024-09-12T00:06:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:11.881 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941776+0000", 2024-09-12T00:06:11.882 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013623500000000001 2024-09-12T00:06:11.882 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.882 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.882 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:11.882 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.941822+0000", 2024-09-12T00:06:11.882 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5513000000000003e-05 2024-09-12T00:06:11.882 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.882 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.882 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:11.882 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.962694+0000", 2024-09-12T00:06:11.882 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020871516999999999 2024-09-12T00:06:11.882 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.882 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.962791+0000", 2024-09-12T00:06:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7855000000000004e-05 2024-09-12T00:06:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3670 3.5 e83/23 3:a3029b32:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_287:head v 83'13, mlcod=83'11)", 2024-09-12T00:06:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:43.823062+0000", 2024-09-12T00:06:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.001549179000001, 2024-09-12T00:06:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028976041000000001, 2024-09-12T00:06:11.883 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.823062+0000", 2024-09-12T00:06:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.823062+0000", 2024-09-12T00:06:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.884 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.885 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:11.886 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.823068+0000", 2024-09-12T00:06:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6250000000000001e-06 2024-09-12T00:06:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.826863+0000", 2024-09-12T00:06:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0037945880000000002 2024-09-12T00:06:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.826885+0000", 2024-09-12T00:06:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1515e-05 2024-09-12T00:06:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.887 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.826894+0000", 2024-09-12T00:06:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4040000000000001e-06 2024-09-12T00:06:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.827014+0000", 2024-09-12T00:06:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000120238 2024-09-12T00:06:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:11.888 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.827056+0000", 2024-09-12T00:06:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2129000000000003e-05 2024-09-12T00:06:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.851882+0000", 2024-09-12T00:06:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024825538000000001 2024-09-12T00:06:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.852038+0000", 2024-09-12T00:06:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00015600400000000001 2024-09-12T00:06:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:11.889 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3681 3.12 3:481fb92d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_298:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:43.987522+0000", 2024-09-12T00:06:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 27.837088575999999, 2024-09-12T00:06:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.029063802999999999, 2024-09-12T00:06:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:11.890 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3681 2024-09-12T00:06:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.987522+0000", 2024-09-12T00:06:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.987522+0000", 2024-09-12T00:06:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.891 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.987527+0000", 2024-09-12T00:06:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.5730000000000001e-06 2024-09-12T00:06:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.992931+0000", 2024-09-12T00:06:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0054043950000000002 2024-09-12T00:06:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.992974+0000", 2024-09-12T00:06:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.2542e-05 2024-09-12T00:06:11.892 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.992999+0000", 2024-09-12T00:06:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5113000000000002e-05 2024-09-12T00:06:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.993146+0000", 2024-09-12T00:06:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014703900000000001 2024-09-12T00:06:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:11.893 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.993270+0000", 2024-09-12T00:06:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012376100000000001 2024-09-12T00:06:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 3", 2024-09-12T00:06:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:43.993433+0000", 2024-09-12T00:06:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016290900000000001 2024-09-12T00:06:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.003341+0000", 2024-09-12T00:06:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099082289999999993 2024-09-12T00:06:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.016476+0000", 2024-09-12T00:06:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013134616999999999 2024-09-12T00:06:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.016528+0000", 2024-09-12T00:06:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2410000000000001e-05 2024-09-12T00:06:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.016586+0000", 2024-09-12T00:06:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.8214999999999997e-05 2024-09-12T00:06:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3726 3.33 3:cd6e0a10:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_343:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.865044+0000", 2024-09-12T00:06:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 26.95956661, 2024-09-12T00:06:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027130072000000002, 2024-09-12T00:06:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:11.896 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3726 2024-09-12T00:06:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.865044+0000", 2024-09-12T00:06:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.865044+0000", 2024-09-12T00:06:11.897 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.865048+0000", 2024-09-12T00:06:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1669999999999999e-06 2024-09-12T00:06:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869155+0000", 2024-09-12T00:06:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041073020000000002 2024-09-12T00:06:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:11.898 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869190+0000", 2024-09-12T00:06:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5113000000000001e-05 2024-09-12T00:06:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869207+0000", 2024-09-12T00:06:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6943e-05 2024-09-12T00:06:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869388+0000", 2024-09-12T00:06:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018116000000000001 2024-09-12T00:06:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.869776+0000", 2024-09-12T00:06:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00038828099999999998 2024-09-12T00:06:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 0", 2024-09-12T00:06:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.870191+0000", 2024-09-12T00:06:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00041471599999999998 2024-09-12T00:06:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.881480+0000", 2024-09-12T00:06:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0112887 2024-09-12T00:06:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.891979+0000", 2024-09-12T00:06:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.010499377000000001 2024-09-12T00:06:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.892068+0000", 2024-09-12T00:06:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.8374000000000005e-05 2024-09-12T00:06:11.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.892174+0000", 2024-09-12T00:06:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000106939 2024-09-12T00:06:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3768 3.25 3:a5893d4d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_385:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.338740+0000", 2024-09-12T00:06:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 26.485870724000002, 2024-09-12T00:06:11.902 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025891451999999999, 2024-09-12T00:06:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3768 2024-09-12T00:06:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.338740+0000", 2024-09-12T00:06:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.903 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.338740+0000", 2024-09-12T00:06:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.338744+0000", 2024-09-12T00:06:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1470000000000003e-06 2024-09-12T00:06:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:11.904 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343258+0000", 2024-09-12T00:06:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045136880000000001 2024-09-12T00:06:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343292+0000", 2024-09-12T00:06:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3893000000000002e-05 2024-09-12T00:06:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:11.905 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343337+0000", 2024-09-12T00:06:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.4699e-05 2024-09-12T00:06:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343453+0000", 2024-09-12T00:06:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000116272 2024-09-12T00:06:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343770+0000", 2024-09-12T00:06:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00031750799999999998 2024-09-12T00:06:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.906 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:06:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.343992+0000", 2024-09-12T00:06:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000221986 2024-09-12T00:06:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.355234+0000", 2024-09-12T00:06:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011241637000000001 2024-09-12T00:06:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.364420+0000", 2024-09-12T00:06:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0091854320000000003 2024-09-12T00:06:11.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.364514+0000", 2024-09-12T00:06:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.4492000000000003e-05 2024-09-12T00:06:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.364632+0000", 2024-09-12T00:06:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000117698 2024-09-12T00:06:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:11.908 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3791 3.4 3:2186e625:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_408:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.609529+0000", 2024-09-12T00:06:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 26.215081922, 2024-09-12T00:06:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.031252178999999998, 2024-09-12T00:06:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3791 2024-09-12T00:06:11.909 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.609529+0000", 2024-09-12T00:06:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.609529+0000", 2024-09-12T00:06:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.910 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.609532+0000", 2024-09-12T00:06:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3230000000000002e-06 2024-09-12T00:06:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.613514+0000", 2024-09-12T00:06:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039820439999999997 2024-09-12T00:06:11.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.613550+0000", 2024-09-12T00:06:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5821999999999997e-05 2024-09-12T00:06:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.613568+0000", 2024-09-12T00:06:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7363e-05 2024-09-12T00:06:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.912 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:11.913 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.613738+0000", 2024-09-12T00:06:11.913 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017081400000000001 2024-09-12T00:06:11.913 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.913 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.913 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:11.913 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.614134+0000", 2024-09-12T00:06:11.913 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000395454 2024-09-12T00:06:11.913 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.913 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.913 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 5", 2024-09-12T00:06:11.913 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.614529+0000", 2024-09-12T00:06:11.913 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039467300000000001 2024-09-12T00:06:11.913 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.913 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.914 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:11.914 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.632368+0000", 2024-09-12T00:06:11.914 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017839482 2024-09-12T00:06:11.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.914 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.914 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:11.914 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.640584+0000", 2024-09-12T00:06:11.914 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082160700000000007 2024-09-12T00:06:11.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.914 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.914 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:11.914 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.640694+0000", 2024-09-12T00:06:11.914 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109782 2024-09-12T00:06:11.915 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.915 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.915 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:11.915 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.640781+0000", 2024-09-12T00:06:11.915 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7352e-05 2024-09-12T00:06:11.915 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.915 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:11.915 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.915 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.915 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.915 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:4351 3.25 3:a6710fd4:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.12__shadow_.h1uxKGkm-wWs7JNavkRQbjhJYN05a11_292:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-12T00:06:11.915 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:06:08.372748+0000", 2024-09-12T00:06:11.915 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.451862808, 2024-09-12T00:06:11.915 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.035994960999999999, 2024-09-12T00:06:11.916 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:11.916 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:11.916 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:11.916 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:11.916 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:11.916 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:11.916 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 4351 2024-09-12T00:06:11.916 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.916 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:11.916 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.916 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:11.916 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.372748+0000", 2024-09-12T00:06:11.916 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.917 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.917 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.917 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:11.917 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.372748+0000", 2024-09-12T00:06:11.917 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.917 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.917 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.917 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:11.917 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.372752+0000", 2024-09-12T00:06:11.917 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4029999999999999e-06 2024-09-12T00:06:11.917 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.917 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.918 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:11.918 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.377190+0000", 2024-09-12T00:06:11.918 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0044383119999999998 2024-09-12T00:06:11.918 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.918 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.918 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:11.918 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.377233+0000", 2024-09-12T00:06:11.918 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3237e-05 2024-09-12T00:06:11.918 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.918 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.918 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:11.918 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.377260+0000", 2024-09-12T00:06:11.918 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6846e-05 2024-09-12T00:06:11.918 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.919 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.919 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:11.919 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.377440+0000", 2024-09-12T00:06:11.919 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017960200000000001 2024-09-12T00:06:11.919 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.919 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.919 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:11.919 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.377734+0000", 2024-09-12T00:06:11.919 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000294717 2024-09-12T00:06:11.919 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.919 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.919 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:06:11.919 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.377987+0000", 2024-09-12T00:06:11.920 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025234500000000001 2024-09-12T00:06:11.920 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.920 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.920 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:11.920 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.387774+0000", 2024-09-12T00:06:11.920 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0097873590000000007 2024-09-12T00:06:11.920 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.920 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.920 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:11.920 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.408555+0000", 2024-09-12T00:06:11.920 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020781218000000001 2024-09-12T00:06:11.920 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.920 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.921 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:11.921 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.408664+0000", 2024-09-12T00:06:11.921 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000109109 2024-09-12T00:06:11.921 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.921 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.921 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:11.921 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.408743+0000", 2024-09-12T00:06:11.921 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.8813000000000006e-05 2024-09-12T00:06:11.921 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.921 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:11.921 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.921 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.921 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.922 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:4353 3.25 3:a62fff30:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.12__shadow_.h1uxKGkm-wWs7JNavkRQbjhJYN05a11_294:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-12T00:06:11.922 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:06:08.392936+0000", 2024-09-12T00:06:11.922 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.4316754540000001, 2024-09-12T00:06:11.922 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025647709000000001, 2024-09-12T00:06:11.922 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:11.922 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:11.922 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:11.922 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:11.922 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:11.922 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:11.922 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 4353 2024-09-12T00:06:11.922 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.922 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:11.922 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.922 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:11.923 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.392936+0000", 2024-09-12T00:06:11.923 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.923 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.923 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.923 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:11.923 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.392936+0000", 2024-09-12T00:06:11.923 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.923 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.923 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.923 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:11.923 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.392939+0000", 2024-09-12T00:06:11.923 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7929999999999999e-06 2024-09-12T00:06:11.923 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.923 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.924 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:11.924 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.398453+0000", 2024-09-12T00:06:11.924 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.005513886 2024-09-12T00:06:11.924 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.924 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.924 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:11.924 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.398487+0000", 2024-09-12T00:06:11.924 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4189000000000001e-05 2024-09-12T00:06:11.924 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.924 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.924 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:11.924 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.398504+0000", 2024-09-12T00:06:11.925 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6765999999999998e-05 2024-09-12T00:06:11.925 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.925 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.925 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:11.925 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.398679+0000", 2024-09-12T00:06:11.925 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000174566 2024-09-12T00:06:11.925 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.925 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.925 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:11.925 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.399070+0000", 2024-09-12T00:06:11.925 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039161600000000001 2024-09-12T00:06:11.925 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.925 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.925 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:06:11.926 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.399533+0000", 2024-09-12T00:06:11.926 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00046215299999999998 2024-09-12T00:06:11.926 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.926 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.926 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:11.926 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.416746+0000", 2024-09-12T00:06:11.926 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017213974 2024-09-12T00:06:11.926 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.926 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.926 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:11.926 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.418386+0000", 2024-09-12T00:06:11.926 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0016395979999999999 2024-09-12T00:06:11.926 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.926 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.927 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:11.927 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.418479+0000", 2024-09-12T00:06:11.927 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.3293000000000003e-05 2024-09-12T00:06:11.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.927 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.927 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:11.927 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.418583+0000", 2024-09-12T00:06:11.927 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000103875 2024-09-12T00:06:11.927 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.927 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:11.927 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.927 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.928 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:4360 3.1 3:8079eb9f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.12__shadow_.h1uxKGkm-wWs7JNavkRQbjhJYN05a11_301:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-12T00:06:11.928 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:06:08.463919+0000", 2024-09-12T00:06:11.928 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.360691723, 2024-09-12T00:06:11.928 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.028017845, 2024-09-12T00:06:11.928 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:11.928 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:11.928 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:11.928 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:11.928 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:11.928 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:11.928 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 4360 2024-09-12T00:06:11.928 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.928 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:11.929 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.929 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:11.929 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.463919+0000", 2024-09-12T00:06:11.929 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.929 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.929 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:11.929 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.463919+0000", 2024-09-12T00:06:11.929 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.929 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.929 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:11.929 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.463922+0000", 2024-09-12T00:06:11.929 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0900000000000001e-06 2024-09-12T00:06:11.930 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.930 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.930 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:11.930 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.469064+0000", 2024-09-12T00:06:11.930 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0051417190000000003 2024-09-12T00:06:11.930 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.930 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.930 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:11.930 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.469104+0000", 2024-09-12T00:06:11.930 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.019e-05 2024-09-12T00:06:11.930 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.930 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.930 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:11.930 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.469122+0000", 2024-09-12T00:06:11.931 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7567e-05 2024-09-12T00:06:11.931 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.931 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.931 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:11.931 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.469250+0000", 2024-09-12T00:06:11.931 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012832499999999999 2024-09-12T00:06:11.931 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.931 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.931 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:11.931 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.469481+0000", 2024-09-12T00:06:11.931 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000231287 2024-09-12T00:06:11.931 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.931 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.932 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:11.932 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.469713+0000", 2024-09-12T00:06:11.932 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023182500000000001 2024-09-12T00:06:11.932 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.932 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.932 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:11.932 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.485404+0000", 2024-09-12T00:06:11.932 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015690487999999999 2024-09-12T00:06:11.932 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.932 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.932 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:11.932 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.491610+0000", 2024-09-12T00:06:11.933 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0062060199999999996 2024-09-12T00:06:11.933 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.933 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.933 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:11.933 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.491793+0000", 2024-09-12T00:06:11.933 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018295799999999999 2024-09-12T00:06:11.933 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.933 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.933 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:11.933 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.491937+0000", 2024-09-12T00:06:11.933 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014437599999999999 2024-09-12T00:06:11.933 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.933 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:11.933 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.934 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.934 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:4398 3.25 3:a7f2838c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.12__shadow_.h1uxKGkm-wWs7JNavkRQbjhJYN05a11_339:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-12T00:06:11.934 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:06:08.894273+0000", 2024-09-12T00:06:11.934 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 2.930337878, 2024-09-12T00:06:11.934 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030983977999999999, 2024-09-12T00:06:11.934 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:11.934 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:11.934 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:11.934 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:11.934 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:11.934 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:11.934 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 4398 2024-09-12T00:06:11.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.935 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:11.935 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.935 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:11.935 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.894273+0000", 2024-09-12T00:06:11.935 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.935 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.935 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.935 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:11.935 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.894273+0000", 2024-09-12T00:06:11.935 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.935 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.935 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.935 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:11.935 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.894325+0000", 2024-09-12T00:06:11.936 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.2009000000000003e-05 2024-09-12T00:06:11.936 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.936 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.936 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:11.936 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.899155+0000", 2024-09-12T00:06:11.936 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004830109 2024-09-12T00:06:11.936 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.936 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.936 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:11.936 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.899194+0000", 2024-09-12T00:06:11.936 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9113000000000003e-05 2024-09-12T00:06:11.936 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.936 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.937 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:11.937 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.899213+0000", 2024-09-12T00:06:11.937 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.836e-05 2024-09-12T00:06:11.937 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.937 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.937 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:11.937 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.899341+0000", 2024-09-12T00:06:11.937 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000128532 2024-09-12T00:06:11.937 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.937 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.937 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:11.937 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.899595+0000", 2024-09-12T00:06:11.937 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025352099999999999 2024-09-12T00:06:11.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.938 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.938 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:06:11.938 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.899818+0000", 2024-09-12T00:06:11.938 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022364499999999999 2024-09-12T00:06:11.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.938 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.938 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:11.938 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.912959+0000", 2024-09-12T00:06:11.938 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013140468000000001 2024-09-12T00:06:11.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.938 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.938 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:11.938 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.924982+0000", 2024-09-12T00:06:11.939 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012022692999999999 2024-09-12T00:06:11.939 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.939 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.939 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:11.939 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.925144+0000", 2024-09-12T00:06:11.939 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000162089 2024-09-12T00:06:11.939 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.939 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.939 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:11.939 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.925257+0000", 2024-09-12T00:06:11.939 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113439 2024-09-12T00:06:11.939 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.939 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:11.939 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.940 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.940 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.940 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:4410 3.12 3:49ffc973:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.12__shadow_.h1uxKGkm-wWs7JNavkRQbjhJYN05a11_351:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-12T00:06:11.940 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:06:09.018392+0000", 2024-09-12T00:06:11.940 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 2.8062193400000002, 2024-09-12T00:06:11.940 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.029386009000000001, 2024-09-12T00:06:11.940 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:11.940 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:11.940 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:11.940 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:11.940 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:11.940 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:11.940 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 4410 2024-09-12T00:06:11.940 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.941 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:11.941 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.941 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:11.941 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.018392+0000", 2024-09-12T00:06:11.941 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.941 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.941 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.941 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:11.941 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.018392+0000", 2024-09-12T00:06:11.941 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.941 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.941 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.941 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:11.942 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.018395+0000", 2024-09-12T00:06:11.942 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.8070000000000001e-06 2024-09-12T00:06:11.942 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.942 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.942 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:11.942 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.025712+0000", 2024-09-12T00:06:11.942 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0073164320000000003 2024-09-12T00:06:11.942 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.942 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.942 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:11.942 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.025742+0000", 2024-09-12T00:06:11.942 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0372999999999999e-05 2024-09-12T00:06:11.942 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.942 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.942 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:11.943 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.025761+0000", 2024-09-12T00:06:11.943 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8573999999999999e-05 2024-09-12T00:06:11.943 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.943 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.943 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:11.943 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.025938+0000", 2024-09-12T00:06:11.943 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017737800000000001 2024-09-12T00:06:11.943 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.943 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.943 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:11.943 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.026175+0000", 2024-09-12T00:06:11.943 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023689100000000001 2024-09-12T00:06:11.943 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.944 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.944 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:06:11.944 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.026393+0000", 2024-09-12T00:06:11.944 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021783100000000001 2024-09-12T00:06:11.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.944 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.944 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:11.944 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.045614+0000", 2024-09-12T00:06:11.944 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019221173000000001 2024-09-12T00:06:11.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.944 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.944 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:11.944 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.047415+0000", 2024-09-12T00:06:11.945 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0018013230000000001 2024-09-12T00:06:11.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.945 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:11.945 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.047604+0000", 2024-09-12T00:06:11.945 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018809400000000001 2024-09-12T00:06:11.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.945 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:11.945 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.047778+0000", 2024-09-12T00:06:11.945 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017413300000000001 2024-09-12T00:06:11.945 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.945 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:11.946 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.946 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.946 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.946 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:4423 3.25 3:a4974c65:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.12__shadow_.h1uxKGkm-wWs7JNavkRQbjhJYN05a11_364:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-12T00:06:11.946 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:06:09.159327+0000", 2024-09-12T00:06:11.946 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 2.6652840200000001, 2024-09-12T00:06:11.946 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.032540105999999999, 2024-09-12T00:06:11.946 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:11.946 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:11.946 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:11.946 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:11.946 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:11.946 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:11.946 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 4423 2024-09-12T00:06:11.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.947 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:11.947 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.947 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:11.947 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.159327+0000", 2024-09-12T00:06:11.947 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.947 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.947 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:11.947 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.159327+0000", 2024-09-12T00:06:11.947 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:11.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.947 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.948 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:11.948 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.159331+0000", 2024-09-12T00:06:11.948 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1500000000000001e-06 2024-09-12T00:06:11.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.948 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:11.948 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.164679+0000", 2024-09-12T00:06:11.948 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053481500000000003 2024-09-12T00:06:11.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.948 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:11.948 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.164719+0000", 2024-09-12T00:06:11.948 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9347000000000001e-05 2024-09-12T00:06:11.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.949 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:11.949 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.164736+0000", 2024-09-12T00:06:11.949 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7842999999999998e-05 2024-09-12T00:06:11.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.949 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:11.949 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.164913+0000", 2024-09-12T00:06:11.949 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017697500000000001 2024-09-12T00:06:11.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.949 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:11.949 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.165320+0000", 2024-09-12T00:06:11.950 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040684899999999998 2024-09-12T00:06:11.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.950 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.950 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 7", 2024-09-12T00:06:11.950 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.165719+0000", 2024-09-12T00:06:11.950 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00039873699999999997 2024-09-12T00:06:11.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.950 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.950 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:11.950 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.178312+0000", 2024-09-12T00:06:11.950 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012593089999999999 2024-09-12T00:06:11.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.950 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.950 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:11.951 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.191705+0000", 2024-09-12T00:06:11.951 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013392582 2024-09-12T00:06:11.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.951 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.951 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:11.951 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.191792+0000", 2024-09-12T00:06:11.951 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.7769999999999995e-05 2024-09-12T00:06:11.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:11.951 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:11.951 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:11.951 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.191867+0000", 2024-09-12T00:06:11.951 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4612999999999999e-05 2024-09-12T00:06:11.951 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.951 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:11.952 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.952 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:11.952 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:11.952 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:06:11.952 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:06:11.953 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:06:11.888+0000 7f929eb80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26589) UID: 0 2024-09-12T00:06:11.954 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:06:11.954 DEBUG:teuthology.orchestra.run.smithi019:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:06:11.999 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:06:12.000+0000 7faa90803640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26587) UID: 0 2024-09-12T00:06:12.009 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:06:12.010 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-12T00:06:12.131 INFO:tasks.thrashosds:joining thrashosds 2024-09-12T00:06:12.132 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:06:12.132 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:06:12.132 INFO:teuthology.orchestra.run.smithi135.stdout: "num_ops": 0 2024-09-12T00:06:12.133 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:06:12.133 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:06:12.301 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:06:12.302 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [], 2024-09-12T00:06:12.302 INFO:teuthology.orchestra.run.smithi135.stdout: "complaint_time": 30, 2024-09-12T00:06:12.302 INFO:teuthology.orchestra.run.smithi135.stdout: "num_blocked_ops": 0 2024-09-12T00:06:12.302 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:06:12.316 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:06:12.437 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-12T00:06:12.437 INFO:teuthology.orchestra.run.smithi135.stdout: "size": 20, 2024-09-12T00:06:12.437 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 600, 2024-09-12T00:06:12.437 INFO:teuthology.orchestra.run.smithi135.stdout: "ops": [ 2024-09-12T00:06:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:2996 3.21 3:872b1c12:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:06:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 52.085252787000002, 2024-09-12T00:06:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027562314000000001, 2024-09-12T00:06:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 2996 2024-09-12T00:06:12.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:06:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350492+0000", 2024-09-12T00:06:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:12.439 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.350496+0000", 2024-09-12T00:06:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9160000000000003e-06 2024-09-12T00:06:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355187+0000", 2024-09-12T00:06:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046904989999999999 2024-09-12T00:06:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355223+0000", 2024-09-12T00:06:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6125999999999999e-05 2024-09-12T00:06:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.440 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355241+0000", 2024-09-12T00:06:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8686e-05 2024-09-12T00:06:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355373+0000", 2024-09-12T00:06:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013129299999999999 2024-09-12T00:06:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355619+0000", 2024-09-12T00:06:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024662700000000002 2024-09-12T00:06:12.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:06:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.355855+0000", 2024-09-12T00:06:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023604299999999999 2024-09-12T00:06:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.367983+0000", 2024-09-12T00:06:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012127104999999999 2024-09-12T00:06:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:12.442 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377884+0000", 2024-09-12T00:06:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0099013680000000007 2024-09-12T00:06:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.377974+0000", 2024-09-12T00:06:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.9932999999999994e-05 2024-09-12T00:06:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.378055+0000", 2024-09-12T00:06:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.0717999999999995e-05 2024-09-12T00:06:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:12.443 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3030 3.2e 3:740afe3d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:06:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 51.695922629000002, 2024-09-12T00:06:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.033756331000000001, 2024-09-12T00:06:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3030 2024-09-12T00:06:12.444 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:06:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739822+0000", 2024-09-12T00:06:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.445 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.739825+0000", 2024-09-12T00:06:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7920000000000001e-06 2024-09-12T00:06:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744217+0000", 2024-09-12T00:06:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043922529999999996 2024-09-12T00:06:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744243+0000", 2024-09-12T00:06:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5253e-05 2024-09-12T00:06:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.446 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744254+0000", 2024-09-12T00:06:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1430999999999999e-05 2024-09-12T00:06:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744325+0000", 2024-09-12T00:06:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1340999999999993e-05 2024-09-12T00:06:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744461+0000", 2024-09-12T00:06:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013531700000000001 2024-09-12T00:06:12.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.744574+0000", 2024-09-12T00:06:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000113513 2024-09-12T00:06:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.752813+0000", 2024-09-12T00:06:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0082384750000000003 2024-09-12T00:06:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:12.448 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773444+0000", 2024-09-12T00:06:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020630773000000002 2024-09-12T00:06:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773510+0000", 2024-09-12T00:06:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.6711000000000006e-05 2024-09-12T00:06:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.773579+0000", 2024-09-12T00:06:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.8472000000000004e-05 2024-09-12T00:06:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:12.449 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3039 3.2e 3:74587332:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:06:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 51.600242700999999, 2024-09-12T00:06:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.036215114, 2024-09-12T00:06:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:12.450 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3039 2024-09-12T00:06:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:06:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835502+0000", 2024-09-12T00:06:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.451 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.835507+0000", 2024-09-12T00:06:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6e-06 2024-09-12T00:06:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848930+0000", 2024-09-12T00:06:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013423242 2024-09-12T00:06:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848969+0000", 2024-09-12T00:06:12.452 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9270000000000002e-05 2024-09-12T00:06:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.848991+0000", 2024-09-12T00:06:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.1565000000000001e-05 2024-09-12T00:06:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849089+0000", 2024-09-12T00:06:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8408999999999999e-05 2024-09-12T00:06:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:12.453 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849518+0000", 2024-09-12T00:06:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00042813900000000002 2024-09-12T00:06:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.849897+0000", 2024-09-12T00:06:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00037936600000000001 2024-09-12T00:06:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.858549+0000", 2024-09-12T00:06:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086520820000000002 2024-09-12T00:06:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.454 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871522+0000", 2024-09-12T00:06:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012973182999999999 2024-09-12T00:06:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871633+0000", 2024-09-12T00:06:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011085 2024-09-12T00:06:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.871717+0000", 2024-09-12T00:06:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.4407999999999996e-05 2024-09-12T00:06:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3050 3.b 3:d26f7141:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:06:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 51.478630445, 2024-09-12T00:06:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022896481999999999, 2024-09-12T00:06:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3050 2024-09-12T00:06:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:06:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957115+0000", 2024-09-12T00:06:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.457 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.957117+0000", 2024-09-12T00:06:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7e-06 2024-09-12T00:06:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961673+0000", 2024-09-12T00:06:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0045558059999999999 2024-09-12T00:06:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961698+0000", 2024-09-12T00:06:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5017000000000001e-05 2024-09-12T00:06:12.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961710+0000", 2024-09-12T00:06:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.1963999999999999e-05 2024-09-12T00:06:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961785+0000", 2024-09-12T00:06:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.5153000000000004e-05 2024-09-12T00:06:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.961926+0000", 2024-09-12T00:06:12.459 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000141194 2024-09-12T00:06:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.962055+0000", 2024-09-12T00:06:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012882400000000001 2024-09-12T00:06:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.970716+0000", 2024-09-12T00:06:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0086603610000000001 2024-09-12T00:06:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.460 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979700+0000", 2024-09-12T00:06:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.008984054 2024-09-12T00:06:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.979884+0000", 2024-09-12T00:06:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000184215 2024-09-12T00:06:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:20.980011+0000", 2024-09-12T00:06:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012719399999999999 2024-09-12T00:06:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.461 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3066 3.21 3:8448517d:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.10__shadow_.vK3SAzqjDJGOMWTK7dNV9iBv4m1fbb7_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T00:06:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:06:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 51.303736743000002, 2024-09-12T00:06:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025911652, 2024-09-12T00:06:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:12.462 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3066 2024-09-12T00:06:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:06:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132008+0000", 2024-09-12T00:06:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.132011+0000", 2024-09-12T00:06:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.8270000000000002e-06 2024-09-12T00:06:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137934+0000", 2024-09-12T00:06:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0059226119999999998 2024-09-12T00:06:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137968+0000", 2024-09-12T00:06:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.3933000000000002e-05 2024-09-12T00:06:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.137985+0000", 2024-09-12T00:06:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7725999999999999e-05 2024-09-12T00:06:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138084+0000", 2024-09-12T00:06:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.8450999999999996e-05 2024-09-12T00:06:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138285+0000", 2024-09-12T00:06:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000201411 2024-09-12T00:06:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:06:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.138510+0000", 2024-09-12T00:06:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000224551 2024-09-12T00:06:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.146242+0000", 2024-09-12T00:06:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0077317649999999998 2024-09-12T00:06:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.466 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157728+0000", 2024-09-12T00:06:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011486424 2024-09-12T00:06:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157833+0000", 2024-09-12T00:06:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105234 2024-09-12T00:06:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:21.157920+0000", 2024-09-12T00:06:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.6718000000000006e-05 2024-09-12T00:06:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.467 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:3380 3.23 e82/23 3:c6c9ccf8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_7:head v 82'5, mlcod=76'3)", 2024-09-12T00:06:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:06:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 31.729223548, 2024-09-12T00:06:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.029708818000000001, 2024-09-12T00:06:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:12.468 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:06:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:06:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.469 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.470 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:12.470 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.706522+0000", 2024-09-12T00:06:12.470 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1600000000000001e-07 2024-09-12T00:06:12.470 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.710842+0000", 2024-09-12T00:06:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043204510000000003 2024-09-12T00:06:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.710875+0000", 2024-09-12T00:06:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2702e-05 2024-09-12T00:06:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.471 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.710895+0000", 2024-09-12T00:06:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.0094000000000001e-05 2024-09-12T00:06:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.711063+0000", 2024-09-12T00:06:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000167517 2024-09-12T00:06:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.711127+0000", 2024-09-12T00:06:12.472 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.4004999999999995e-05 2024-09-12T00:06:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.736095+0000", 2024-09-12T00:06:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024968008999999999 2024-09-12T00:06:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:40.736230+0000", 2024-09-12T00:06:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013552400000000001 2024-09-12T00:06:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.473 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.474 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.474 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3409 3.b 3:d39a1970:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-12T00:06:12.474 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:41.028923+0000", 2024-09-12T00:06:12.474 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 31.406822531, 2024-09-12T00:06:12.474 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.030518363999999999, 2024-09-12T00:06:12.474 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:12.475 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:12.475 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:12.475 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:12.475 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:12.475 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:12.475 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3409 2024-09-12T00:06:12.475 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.475 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.028923+0000", 2024-09-12T00:06:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.028923+0000", 2024-09-12T00:06:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.028926+0000", 2024-09-12T00:06:12.476 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1e-06 2024-09-12T00:06:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038010+0000", 2024-09-12T00:06:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0090839110000000001 2024-09-12T00:06:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038042+0000", 2024-09-12T00:06:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.2425999999999998e-05 2024-09-12T00:06:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:12.477 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038060+0000", 2024-09-12T00:06:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8219e-05 2024-09-12T00:06:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038205+0000", 2024-09-12T00:06:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014503500000000001 2024-09-12T00:06:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038498+0000", 2024-09-12T00:06:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00029289499999999999 2024-09-12T00:06:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.478 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:12.479 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.038752+0000", 2024-09-12T00:06:12.479 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025434500000000001 2024-09-12T00:06:12.479 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.479 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.479 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:12.479 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.058529+0000", 2024-09-12T00:06:12.479 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.019776275999999999 2024-09-12T00:06:12.479 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.479 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.479 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:12.479 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.059147+0000", 2024-09-12T00:06:12.479 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00061837199999999995 2024-09-12T00:06:12.479 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.479 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.480 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:12.480 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.059328+0000", 2024-09-12T00:06:12.480 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018048399999999999 2024-09-12T00:06:12.480 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.480 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.480 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:12.480 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:41.059441+0000", 2024-09-12T00:06:12.480 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00011330100000000001 2024-09-12T00:06:12.480 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.480 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:12.480 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.480 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.480 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.481 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3696 3.21 3:872f3075:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_313:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:12.481 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:44.301332+0000", 2024-09-12T00:06:12.481 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 28.134413346999999, 2024-09-12T00:06:12.481 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024918241000000001, 2024-09-12T00:06:12.481 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:12.481 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:12.481 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:12.481 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:12.481 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:12.481 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:12.481 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3696 2024-09-12T00:06:12.481 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.481 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.301332+0000", 2024-09-12T00:06:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.301332+0000", 2024-09-12T00:06:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.301335+0000", 2024-09-12T00:06:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.9679999999999998e-06 2024-09-12T00:06:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.305984+0000", 2024-09-12T00:06:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0046492249999999999 2024-09-12T00:06:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306009+0000", 2024-09-12T00:06:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5252000000000001e-05 2024-09-12T00:06:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306023+0000", 2024-09-12T00:06:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.3903000000000001e-05 2024-09-12T00:06:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306193+0000", 2024-09-12T00:06:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017032500000000001 2024-09-12T00:06:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.306594+0000", 2024-09-12T00:06:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040111600000000003 2024-09-12T00:06:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:06:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.307002+0000", 2024-09-12T00:06:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00040796000000000002 2024-09-12T00:06:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.319319+0000", 2024-09-12T00:06:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012317033 2024-09-12T00:06:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.325949+0000", 2024-09-12T00:06:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0066298110000000002 2024-09-12T00:06:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.326123+0000", 2024-09-12T00:06:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017416999999999999 2024-09-12T00:06:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:44.326250+0000", 2024-09-12T00:06:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00012647799999999999 2024-09-12T00:06:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3738 3.2e 3:74a476b8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_355:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:12.487 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.005209+0000", 2024-09-12T00:06:12.487 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 27.430535551999998, 2024-09-12T00:06:12.487 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.022771276999999999, 2024-09-12T00:06:12.487 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:12.487 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:12.487 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:12.487 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:12.487 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:12.487 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:12.487 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3738 2024-09-12T00:06:12.487 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.487 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:12.487 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.488 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:12.488 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.005209+0000", 2024-09-12T00:06:12.488 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.488 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.488 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.488 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:12.488 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.005209+0000", 2024-09-12T00:06:12.488 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.488 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.488 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.488 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:12.488 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.005213+0000", 2024-09-12T00:06:12.488 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4170000000000001e-06 2024-09-12T00:06:12.489 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.489 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.489 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:12.489 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009471+0000", 2024-09-12T00:06:12.489 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042583400000000002 2024-09-12T00:06:12.489 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.489 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.489 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:12.489 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009506+0000", 2024-09-12T00:06:12.489 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.4625999999999997e-05 2024-09-12T00:06:12.489 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.489 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.489 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:12.489 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009524+0000", 2024-09-12T00:06:12.490 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7745999999999999e-05 2024-09-12T00:06:12.490 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.490 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.490 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:12.490 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009649+0000", 2024-09-12T00:06:12.490 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000124948 2024-09-12T00:06:12.490 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.490 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.490 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:12.490 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.009889+0000", 2024-09-12T00:06:12.490 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024013999999999999 2024-09-12T00:06:12.490 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.490 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.490 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:12.491 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.010104+0000", 2024-09-12T00:06:12.491 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021549199999999999 2024-09-12T00:06:12.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.491 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.491 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:12.491 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.022243+0000", 2024-09-12T00:06:12.491 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012138793 2024-09-12T00:06:12.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.491 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.491 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:12.491 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.027764+0000", 2024-09-12T00:06:12.491 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0055207820000000001 2024-09-12T00:06:12.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.492 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.492 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:12.492 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.027859+0000", 2024-09-12T00:06:12.492 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5441999999999999e-05 2024-09-12T00:06:12.492 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.492 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.492 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:12.492 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.027981+0000", 2024-09-12T00:06:12.492 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000121551 2024-09-12T00:06:12.492 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.492 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:12.492 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.492 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.492 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.493 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3758 3.2e 3:7790af15:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_375:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:12.493 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.228203+0000", 2024-09-12T00:06:12.493 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 27.207541736, 2024-09-12T00:06:12.493 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.032647253000000001, 2024-09-12T00:06:12.493 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:12.493 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:12.493 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:12.493 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:12.493 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:12.493 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:12.493 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3758 2024-09-12T00:06:12.493 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.493 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:12.493 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.494 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:12.494 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.228203+0000", 2024-09-12T00:06:12.494 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.494 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.494 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:12.494 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.228203+0000", 2024-09-12T00:06:12.494 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.495 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.495 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:12.495 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.228208+0000", 2024-09-12T00:06:12.495 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.3900000000000003e-06 2024-09-12T00:06:12.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.495 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.495 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:12.495 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239226+0000", 2024-09-12T00:06:12.495 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011018155 2024-09-12T00:06:12.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.495 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.495 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:12.495 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239265+0000", 2024-09-12T00:06:12.495 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9419000000000003e-05 2024-09-12T00:06:12.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.496 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.496 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:12.496 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239291+0000", 2024-09-12T00:06:12.496 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6173000000000002e-05 2024-09-12T00:06:12.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.496 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.496 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:12.496 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239430+0000", 2024-09-12T00:06:12.496 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000138071 2024-09-12T00:06:12.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.496 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.496 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:12.497 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239676+0000", 2024-09-12T00:06:12.497 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024695899999999999 2024-09-12T00:06:12.497 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.497 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.497 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:12.497 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.239895+0000", 2024-09-12T00:06:12.497 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00021808999999999999 2024-09-12T00:06:12.497 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.497 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.497 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:12.497 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.255130+0000", 2024-09-12T00:06:12.498 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015235907999999999 2024-09-12T00:06:12.498 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.498 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.498 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:12.498 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.260520+0000", 2024-09-12T00:06:12.498 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0053894340000000002 2024-09-12T00:06:12.498 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.498 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.498 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:12.498 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.260700+0000", 2024-09-12T00:06:12.498 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00018017099999999999 2024-09-12T00:06:12.498 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.499 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.499 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:12.499 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.260851+0000", 2024-09-12T00:06:12.499 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000150483 2024-09-12T00:06:12.499 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.499 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:12.499 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.499 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.499 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.499 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:3793 3.21 3:8684dc70:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.11__shadow_.sRFtKH-MVQ_MQS45qfDCGiQyv-QMTjP_410:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T00:06:12.499 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:05:45.629422+0000", 2024-09-12T00:06:12.499 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 26.806323147000001, 2024-09-12T00:06:12.499 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027123878000000001, 2024-09-12T00:06:12.499 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:12.500 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:12.500 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:12.500 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:12.500 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:12.500 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:12.500 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 3793 2024-09-12T00:06:12.500 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.500 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:12.500 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.500 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:12.500 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.629422+0000", 2024-09-12T00:06:12.500 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.500 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.501 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.501 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:12.501 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.629422+0000", 2024-09-12T00:06:12.501 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.501 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.501 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:12.501 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.629426+0000", 2024-09-12T00:06:12.501 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7129999999999999e-06 2024-09-12T00:06:12.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.501 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.501 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:12.501 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635537+0000", 2024-09-12T00:06:12.502 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0061111220000000001 2024-09-12T00:06:12.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.502 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.502 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:12.502 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635578+0000", 2024-09-12T00:06:12.502 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1730000000000002e-05 2024-09-12T00:06:12.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.502 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.502 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:12.502 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635605+0000", 2024-09-12T00:06:12.502 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6792999999999999e-05 2024-09-12T00:06:12.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635747+0000", 2024-09-12T00:06:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014160999999999999 2024-09-12T00:06:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.635998+0000", 2024-09-12T00:06:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025098600000000003 2024-09-12T00:06:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:06:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.636254+0000", 2024-09-12T00:06:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025597 2024-09-12T00:06:12.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.504 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.504 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:12.504 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.653522+0000", 2024-09-12T00:06:12.504 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.017268229999999999 2024-09-12T00:06:12.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.504 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.504 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:12.504 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.656375+0000", 2024-09-12T00:06:12.504 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0028530930000000001 2024-09-12T00:06:12.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.504 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.504 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:12.505 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.656471+0000", 2024-09-12T00:06:12.505 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.5904999999999997e-05 2024-09-12T00:06:12.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.505 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.505 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:12.505 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:05:45.656546+0000", 2024-09-12T00:06:12.505 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.4726000000000002e-05 2024-09-12T00:06:12.505 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.505 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:12.505 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.505 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.505 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:4226 3.13 3:ca054081:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.12__shadow_.h1uxKGkm-wWs7JNavkRQbjhJYN05a11_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-12T00:06:12.506 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:06:07.021581+0000", 2024-09-12T00:06:12.506 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 5.4141640290000002, 2024-09-12T00:06:12.506 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.027223335000000001, 2024-09-12T00:06:12.506 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:12.506 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:12.506 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:12.506 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:12.506 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:12.506 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:12.506 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 4226 2024-09-12T00:06:12.506 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.506 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:12.506 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.506 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.021581+0000", 2024-09-12T00:06:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.021581+0000", 2024-09-12T00:06:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.021583+0000", 2024-09-12T00:06:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.108e-06 2024-09-12T00:06:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.507 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.508 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:12.508 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.025714+0000", 2024-09-12T00:06:12.508 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0041308639999999997 2024-09-12T00:06:12.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.508 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.508 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:12.508 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.025733+0000", 2024-09-12T00:06:12.508 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8808999999999999e-05 2024-09-12T00:06:12.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.508 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.508 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:12.508 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.025746+0000", 2024-09-12T00:06:12.508 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.2945999999999999e-05 2024-09-12T00:06:12.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.509 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.509 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:12.509 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.025823+0000", 2024-09-12T00:06:12.509 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.7446000000000004e-05 2024-09-12T00:06:12.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.509 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.509 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:12.509 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.025939+0000", 2024-09-12T00:06:12.510 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000115932 2024-09-12T00:06:12.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.510 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.510 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:12.510 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.026042+0000", 2024-09-12T00:06:12.510 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000102439 2024-09-12T00:06:12.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.510 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.510 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:12.510 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.034584+0000", 2024-09-12T00:06:12.510 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0085426359999999993 2024-09-12T00:06:12.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.510 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.048716+0000", 2024-09-12T00:06:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.014132141000000001 2024-09-12T00:06:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.048768+0000", 2024-09-12T00:06:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.1542000000000002e-05 2024-09-12T00:06:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.048804+0000", 2024-09-12T00:06:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6471999999999999e-05 2024-09-12T00:06:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.512 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:12.512 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.512 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:4269 3.13 3:ca127f8f:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.12__shadow_.h1uxKGkm-wWs7JNavkRQbjhJYN05a11_220:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-12T00:06:12.512 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:06:07.529988+0000", 2024-09-12T00:06:12.512 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.9057569079999999, 2024-09-12T00:06:12.512 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.023225297999999998, 2024-09-12T00:06:12.512 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:12.512 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:12.512 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:12.512 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:12.512 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:12.513 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:12.513 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 4269 2024-09-12T00:06:12.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.513 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:12.513 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.513 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:12.513 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.529988+0000", 2024-09-12T00:06:12.513 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.513 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.513 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:12.513 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.529988+0000", 2024-09-12T00:06:12.513 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.514 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.514 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:12.514 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.529992+0000", 2024-09-12T00:06:12.514 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.7170000000000002e-06 2024-09-12T00:06:12.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.514 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.514 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:12.514 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.533973+0000", 2024-09-12T00:06:12.514 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0039807929999999998 2024-09-12T00:06:12.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.514 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.514 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:12.514 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.534003+0000", 2024-09-12T00:06:12.514 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.0645999999999998e-05 2024-09-12T00:06:12.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.515 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.515 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:12.515 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.534021+0000", 2024-09-12T00:06:12.515 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7387000000000001e-05 2024-09-12T00:06:12.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.515 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.515 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:12.515 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.534151+0000", 2024-09-12T00:06:12.515 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00013036499999999999 2024-09-12T00:06:12.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.515 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.534413+0000", 2024-09-12T00:06:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000261778 2024-09-12T00:06:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.534649+0000", 2024-09-12T00:06:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000236608 2024-09-12T00:06:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.547148+0000", 2024-09-12T00:06:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012498774000000001 2024-09-12T00:06:12.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.517 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:12.517 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.553024+0000", 2024-09-12T00:06:12.517 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0058762520000000002 2024-09-12T00:06:12.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.517 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:12.517 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.553130+0000", 2024-09-12T00:06:12.517 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000105376 2024-09-12T00:06:12.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.518 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.518 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:12.518 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:07.553213+0000", 2024-09-12T00:06:12.518 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 8.3602000000000004e-05 2024-09-12T00:06:12.518 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.518 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:12.518 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.518 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.518 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:4336 3.2e 3:76174162:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.12__shadow_.h1uxKGkm-wWs7JNavkRQbjhJYN05a11_277:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-12T00:06:12.518 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:06:08.205922+0000", 2024-09-12T00:06:12.518 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.2298233700000001, 2024-09-12T00:06:12.519 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024679514999999999, 2024-09-12T00:06:12.519 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:12.519 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:12.519 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:12.519 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:12.519 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:12.519 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:12.519 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 4336 2024-09-12T00:06:12.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.519 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:12.519 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.519 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:12.519 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.205922+0000", 2024-09-12T00:06:12.520 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.520 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:12.520 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.205922+0000", 2024-09-12T00:06:12.520 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.520 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:12.520 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.205926+0000", 2024-09-12T00:06:12.520 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.6999999999999999e-06 2024-09-12T00:06:12.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.521 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:12.521 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.214099+0000", 2024-09-12T00:06:12.521 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0081730199999999996 2024-09-12T00:06:12.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.521 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.521 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:12.521 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.214135+0000", 2024-09-12T00:06:12.521 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.5216999999999998e-05 2024-09-12T00:06:12.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.521 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.521 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:12.521 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.214152+0000", 2024-09-12T00:06:12.521 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7010000000000001e-05 2024-09-12T00:06:12.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.522 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.522 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:12.522 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.214284+0000", 2024-09-12T00:06:12.522 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000132132 2024-09-12T00:06:12.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.522 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.522 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:12.522 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.214533+0000", 2024-09-12T00:06:12.522 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000249497 2024-09-12T00:06:12.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.522 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.522 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:12.522 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.214763+0000", 2024-09-12T00:06:12.523 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022931500000000001 2024-09-12T00:06:12.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.523 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:12.523 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.227958+0000", 2024-09-12T00:06:12.523 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013195511 2024-09-12T00:06:12.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.523 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:12.523 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.230430+0000", 2024-09-12T00:06:12.523 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.002472208 2024-09-12T00:06:12.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.523 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:12.524 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.230530+0000", 2024-09-12T00:06:12.524 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010019899999999999 2024-09-12T00:06:12.524 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.524 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.524 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:12.524 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.230601+0000", 2024-09-12T00:06:12.524 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.0705999999999997e-05 2024-09-12T00:06:12.524 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.524 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:12.524 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.524 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.524 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.524 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:4340 3.21 3:87bb7066:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.12__shadow_.h1uxKGkm-wWs7JNavkRQbjhJYN05a11_281:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-12T00:06:12.524 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:06:08.250825+0000", 2024-09-12T00:06:12.525 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 4.1849204020000004, 2024-09-12T00:06:12.525 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.023177339000000002, 2024-09-12T00:06:12.525 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:12.525 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:12.525 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:12.525 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:12.525 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:12.525 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:12.525 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 4340 2024-09-12T00:06:12.525 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.525 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:12.525 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.525 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:12.526 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.250825+0000", 2024-09-12T00:06:12.526 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.526 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.526 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:12.526 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.250825+0000", 2024-09-12T00:06:12.526 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.526 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.526 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:12.526 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.250827+0000", 2024-09-12T00:06:12.526 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.7530000000000002e-06 2024-09-12T00:06:12.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.526 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.527 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:12.527 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.255697+0000", 2024-09-12T00:06:12.527 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.004869239 2024-09-12T00:06:12.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.527 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.527 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:12.527 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.255733+0000", 2024-09-12T00:06:12.527 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6109000000000003e-05 2024-09-12T00:06:12.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.527 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.527 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:12.527 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.255749+0000", 2024-09-12T00:06:12.527 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.6526999999999999e-05 2024-09-12T00:06:12.528 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.528 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.528 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:12.528 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.255912+0000", 2024-09-12T00:06:12.528 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016308499999999999 2024-09-12T00:06:12.528 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.528 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.528 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:12.528 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.256302+0000", 2024-09-12T00:06:12.528 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00038971299999999997 2024-09-12T00:06:12.528 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.528 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.529 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:06:12.529 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.256727+0000", 2024-09-12T00:06:12.529 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000424743 2024-09-12T00:06:12.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.529 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.529 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:12.529 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.269958+0000", 2024-09-12T00:06:12.529 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.013231237 2024-09-12T00:06:12.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.529 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.529 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:12.529 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.273828+0000", 2024-09-12T00:06:12.529 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0038696949999999998 2024-09-12T00:06:12.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.530 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.530 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:12.530 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.273931+0000", 2024-09-12T00:06:12.530 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00010310900000000001 2024-09-12T00:06:12.530 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.530 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.530 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:12.530 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.274002+0000", 2024-09-12T00:06:12.530 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.1129000000000003e-05 2024-09-12T00:06:12.530 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.530 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:12.530 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.530 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.530 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.531 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:4361 3.b 3:d3fe32a5:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.12__shadow_.h1uxKGkm-wWs7JNavkRQbjhJYN05a11_302:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-12T00:06:12.531 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:06:08.474195+0000", 2024-09-12T00:06:12.531 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.9615502330000001, 2024-09-12T00:06:12.531 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024077067000000001, 2024-09-12T00:06:12.531 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:12.531 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:12.531 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:12.531 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:12.531 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:12.531 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:12.531 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 4361 2024-09-12T00:06:12.531 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.531 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:12.532 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.532 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:12.532 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.474195+0000", 2024-09-12T00:06:12.532 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.532 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.532 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.532 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:12.532 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.474195+0000", 2024-09-12T00:06:12.532 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.532 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.532 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.532 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:12.532 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.474200+0000", 2024-09-12T00:06:12.532 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 5.023e-06 2024-09-12T00:06:12.533 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.533 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.533 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:12.533 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.478493+0000", 2024-09-12T00:06:12.533 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042932600000000001 2024-09-12T00:06:12.533 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.533 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.533 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:12.533 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.478530+0000", 2024-09-12T00:06:12.533 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.6807000000000002e-05 2024-09-12T00:06:12.533 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.533 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.533 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:12.533 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.478549+0000", 2024-09-12T00:06:12.534 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.8906000000000002e-05 2024-09-12T00:06:12.534 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.534 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.534 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:12.534 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.478692+0000", 2024-09-12T00:06:12.534 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000143685 2024-09-12T00:06:12.534 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.534 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.534 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:12.534 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.478951+0000", 2024-09-12T00:06:12.534 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00025850800000000001 2024-09-12T00:06:12.535 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.535 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.535 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 6", 2024-09-12T00:06:12.535 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.479198+0000", 2024-09-12T00:06:12.535 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024737099999999997 2024-09-12T00:06:12.535 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.535 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.535 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:12.535 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.492232+0000", 2024-09-12T00:06:12.535 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.01303402 2024-09-12T00:06:12.536 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.536 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.536 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:12.536 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.497995+0000", 2024-09-12T00:06:12.536 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0057627199999999998 2024-09-12T00:06:12.536 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.536 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.536 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:12.536 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.498174+0000", 2024-09-12T00:06:12.536 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00017894800000000001 2024-09-12T00:06:12.536 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.536 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.536 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:12.537 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.498272+0000", 2024-09-12T00:06:12.537 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.7819000000000007e-05 2024-09-12T00:06:12.537 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.537 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:12.537 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.537 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.537 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.537 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:4398 3.25 e95/23 3:a7f2838c:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.12__shadow_.h1uxKGkm-wWs7JNavkRQbjhJYN05a11_339:head v 95'24, mlcod=95'22)", 2024-09-12T00:06:12.537 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:06:08.900073+0000", 2024-09-12T00:06:12.537 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.5356715840000001, 2024-09-12T00:06:12.537 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.024400782999999999, 2024-09-12T00:06:12.537 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:12.537 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:12.538 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:12.538 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:12.538 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.538 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:12.538 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.900073+0000", 2024-09-12T00:06:12.538 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.538 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.538 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.538 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:12.538 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.900073+0000", 2024-09-12T00:06:12.538 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.538 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.538 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.538 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:12.539 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.900076+0000", 2024-09-12T00:06:12.539 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6469999999999998e-06 2024-09-12T00:06:12.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.539 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.539 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:12.539 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.903558+0000", 2024-09-12T00:06:12.539 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0034813940000000001 2024-09-12T00:06:12.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.539 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.539 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:12.539 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.903606+0000", 2024-09-12T00:06:12.539 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.8517000000000003e-05 2024-09-12T00:06:12.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.540 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.540 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:12.540 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.903632+0000", 2024-09-12T00:06:12.540 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.6026000000000001e-05 2024-09-12T00:06:12.540 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.540 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.540 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:12.540 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.903798+0000", 2024-09-12T00:06:12.540 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016586899999999999 2024-09-12T00:06:12.540 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.540 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.540 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:12.540 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.903861+0000", 2024-09-12T00:06:12.541 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3149000000000001e-05 2024-09-12T00:06:12.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.541 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.541 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:12.541 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.924307+0000", 2024-09-12T00:06:12.541 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020446182 2024-09-12T00:06:12.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.541 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.541 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:12.541 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:08.924474+0000", 2024-09-12T00:06:12.541 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000166999 2024-09-12T00:06:12.541 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.541 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:12.541 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.542 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.542 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.542 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:4418 3.21 3:87587e45:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.12__shadow_.h1uxKGkm-wWs7JNavkRQbjhJYN05a11_359:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-12T00:06:12.542 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:06:09.105000+0000", 2024-09-12T00:06:12.542 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.330745464, 2024-09-12T00:06:12.542 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025175884999999999, 2024-09-12T00:06:12.542 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:12.542 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:12.542 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:12.542 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:12.542 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:12.542 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:12.542 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 4418 2024-09-12T00:06:12.542 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.105000+0000", 2024-09-12T00:06:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.105000+0000", 2024-09-12T00:06:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.105003+0000", 2024-09-12T00:06:12.543 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1130000000000001e-06 2024-09-12T00:06:12.544 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.544 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.544 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:12.544 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.109846+0000", 2024-09-12T00:06:12.544 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0048434619999999998 2024-09-12T00:06:12.544 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.544 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.544 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:12.544 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.109886+0000", 2024-09-12T00:06:12.544 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9592999999999999e-05 2024-09-12T00:06:12.544 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.544 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.544 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.109911+0000", 2024-09-12T00:06:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5559e-05 2024-09-12T00:06:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.110078+0000", 2024-09-12T00:06:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016717300000000001 2024-09-12T00:06:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.110327+0000", 2024-09-12T00:06:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00024894700000000001 2024-09-12T00:06:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.545 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 1", 2024-09-12T00:06:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.110554+0000", 2024-09-12T00:06:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022672100000000001 2024-09-12T00:06:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.126059+0000", 2024-09-12T00:06:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.015504393999999999 2024-09-12T00:06:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.129833+0000", 2024-09-12T00:06:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.003774492 2024-09-12T00:06:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.546 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.547 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:12.547 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.130014+0000", 2024-09-12T00:06:12.547 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000180898 2024-09-12T00:06:12.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.547 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.547 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:12.547 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.130175+0000", 2024-09-12T00:06:12.547 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.000161533 2024-09-12T00:06:12.547 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.547 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:12.547 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.547 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.547 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_op(client.4379.0:4419 3.2e 3:74861ab8:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.12__shadow_.h1uxKGkm-wWs7JNavkRQbjhJYN05a11_360:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-12T00:06:12.548 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:06:09.113254+0000", 2024-09-12T00:06:12.548 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.3224908979999999, 2024-09-12T00:06:12.548 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.029525804999999999, 2024-09-12T00:06:12.548 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:12.548 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:12.548 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:12.548 INFO:teuthology.orchestra.run.smithi135.stdout: "client_info": { 2024-09-12T00:06:12.548 INFO:teuthology.orchestra.run.smithi135.stdout: "client": "client.4379", 2024-09-12T00:06:12.548 INFO:teuthology.orchestra.run.smithi135.stdout: "client_addr": "172.21.15.19:0/4141659319", 2024-09-12T00:06:12.548 INFO:teuthology.orchestra.run.smithi135.stdout: "tid": 4419 2024-09-12T00:06:12.548 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.548 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:12.548 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.113254+0000", 2024-09-12T00:06:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.113254+0000", 2024-09-12T00:06:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.113258+0000", 2024-09-12T00:06:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 4.1239999999999998e-06 2024-09-12T00:06:12.549 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.117630+0000", 2024-09-12T00:06:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0043715200000000003 2024-09-12T00:06:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.117670+0000", 2024-09-12T00:06:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.9706000000000002e-05 2024-09-12T00:06:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.117695+0000", 2024-09-12T00:06:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.5303000000000002e-05 2024-09-12T00:06:12.550 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.117839+0000", 2024-09-12T00:06:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00014378200000000001 2024-09-12T00:06:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.118075+0000", 2024-09-12T00:06:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00023676799999999999 2024-09-12T00:06:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "waiting for subops from 2", 2024-09-12T00:06:12.551 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.118300+0000", 2024-09-12T00:06:12.552 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00022496500000000001 2024-09-12T00:06:12.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.552 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "op_commit", 2024-09-12T00:06:12.552 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.130662+0000", 2024-09-12T00:06:12.552 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.012361855999999999 2024-09-12T00:06:12.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.552 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:06:12.552 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.142636+0000", 2024-09-12T00:06:12.552 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.011974283 2024-09-12T00:06:12.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.553 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:12.553 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.142716+0000", 2024-09-12T00:06:12.553 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 7.9566000000000004e-05 2024-09-12T00:06:12.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.553 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:12.553 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.142780+0000", 2024-09-12T00:06:12.553 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.3931999999999997e-05 2024-09-12T00:06:12.553 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.553 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:12.553 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.553 INFO:teuthology.orchestra.run.smithi135.stdout: "description": "osd_repop(client.4379.0:4423 3.25 e95/23 3:a4974c65:::b5f5ffaf-9714-49be-949c-d0c09eb80774.4379.12__shadow_.h1uxKGkm-wWs7JNavkRQbjhJYN05a11_364:head v 95'25, mlcod=95'23)", 2024-09-12T00:06:12.553 INFO:teuthology.orchestra.run.smithi135.stdout: "initiated_at": "2024-09-12T00:06:09.165965+0000", 2024-09-12T00:06:12.554 INFO:teuthology.orchestra.run.smithi135.stdout: "age": 3.269780484, 2024-09-12T00:06:12.554 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.025386532999999999, 2024-09-12T00:06:12.554 INFO:teuthology.orchestra.run.smithi135.stdout: "continuous": false, 2024-09-12T00:06:12.554 INFO:teuthology.orchestra.run.smithi135.stdout: "type_data": { 2024-09-12T00:06:12.554 INFO:teuthology.orchestra.run.smithi135.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:06:12.554 INFO:teuthology.orchestra.run.smithi135.stdout: "events": [ 2024-09-12T00:06:12.554 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.554 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "initiated", 2024-09-12T00:06:12.554 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.165965+0000", 2024-09-12T00:06:12.554 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.554 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.554 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "header_read", 2024-09-12T00:06:12.554 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.165965+0000", 2024-09-12T00:06:12.555 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0 2024-09-12T00:06:12.555 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.555 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.555 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "throttled", 2024-09-12T00:06:12.555 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.165967+0000", 2024-09-12T00:06:12.555 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 2.3719999999999999e-06 2024-09-12T00:06:12.555 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.555 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.555 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "all_read", 2024-09-12T00:06:12.555 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.170267+0000", 2024-09-12T00:06:12.555 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.0042995680000000001 2024-09-12T00:06:12.555 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.555 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.555 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "dispatched", 2024-09-12T00:06:12.555 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.170298+0000", 2024-09-12T00:06:12.556 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 3.1959999999999999e-05 2024-09-12T00:06:12.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.556 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.556 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "queued_for_pg", 2024-09-12T00:06:12.556 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.170316+0000", 2024-09-12T00:06:12.556 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 1.7306999999999999e-05 2024-09-12T00:06:12.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.556 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.556 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "reached_pg", 2024-09-12T00:06:12.556 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.170484+0000", 2024-09-12T00:06:12.556 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.00016774800000000001 2024-09-12T00:06:12.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.556 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.556 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "started", 2024-09-12T00:06:12.557 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.170550+0000", 2024-09-12T00:06:12.557 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 6.5993000000000003e-05 2024-09-12T00:06:12.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.557 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "commit_sent", 2024-09-12T00:06:12.557 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.191260+0000", 2024-09-12T00:06:12.557 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 0.020710236 2024-09-12T00:06:12.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-12T00:06:12.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-09-12T00:06:12.557 INFO:teuthology.orchestra.run.smithi135.stdout: "event": "done", 2024-09-12T00:06:12.557 INFO:teuthology.orchestra.run.smithi135.stdout: "time": "2024-09-12T00:06:09.191351+0000", 2024-09-12T00:06:12.557 INFO:teuthology.orchestra.run.smithi135.stdout: "duration": 9.1348999999999996e-05 2024-09-12T00:06:12.557 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.557 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:12.558 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.558 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-12T00:06:12.558 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-12T00:06:12.558 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-12T00:06:12.558 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T00:06:14.562 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:06:15.544 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T00:06:15.571 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:06:16.563 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T00:06:24.494 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-12T00:06:24.495 INFO:tasks.thrashosds.thrasher:Adding osd 3 2024-09-12T00:06:24.495 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 3 2024-09-12T00:06:24.830 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-09-12T00:06:24.831+0000 7f75f4819640 -1 mon.a@0(leader).osd e99 definitely_dead 0 2024-09-12T00:06:25.568 INFO:teuthology.orchestra.run.smithi019.stderr:marked in osd.3. 2024-09-12T00:06:25.605 INFO:tasks.thrashosds.thrasher:Added osd 3 2024-09-12T00:06:25.606 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-12T00:06:25.745 INFO:teuthology.orchestra.run.smithi019.stdout:mon.a: {} 2024-09-12T00:06:25.745 INFO:teuthology.orchestra.run.smithi019.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T00:06:25.758 INFO:teuthology.orchestra.run.smithi019.stdout:mon.b: {} 2024-09-12T00:06:25.759 INFO:teuthology.orchestra.run.smithi019.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T00:06:25.768 INFO:teuthology.orchestra.run.smithi019.stdout:mon.c: {} 2024-09-12T00:06:25.768 INFO:teuthology.orchestra.run.smithi019.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T00:06:25.785 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T00:06:26.606 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T00:06:26.655 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-12T00:06:27.596 INFO:teuthology.orchestra.run.smithi019.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-12T00:06:27.635 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T00:06:28.617 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T00:06:28.658 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-12T00:06:29.639 INFO:teuthology.orchestra.run.smithi019.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-12T00:06:29.674 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T00:06:30.669 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T00:06:30.700 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-12T00:06:31.683 INFO:teuthology.orchestra.run.smithi019.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-12T00:06:31.716 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-12T00:06:32.675 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.3 to 1 (10000) 2024-09-12T00:06:32.713 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-12T00:06:33.695 INFO:teuthology.orchestra.run.smithi019.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-12T00:06:33.725 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-12T00:06:34.705 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.4 to 1 (10000) 2024-09-12T00:06:34.731 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-12T00:06:35.724 INFO:teuthology.orchestra.run.smithi019.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-12T00:06:35.751 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-12T00:06:36.753 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.5 to 1 (10000) 2024-09-12T00:06:36.776 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-12T00:06:37.761 INFO:teuthology.orchestra.run.smithi019.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-12T00:06:37.791 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-12T00:06:38.785 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.6 to 1 (10000) 2024-09-12T00:06:38.809 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-12T00:06:39.776 INFO:teuthology.orchestra.run.smithi019.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-12T00:06:39.808 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-12T00:06:40.798 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.7 to 1 (10000) 2024-09-12T00:06:40.825 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-12T00:06:41.811 INFO:teuthology.orchestra.run.smithi019.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-12T00:06:41.871 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-12T00:06:41.871 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-12T00:06:41.871 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-12T00:06:41.872 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-12T00:06:41.872 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T00:06:41.872 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:06:42.190 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:06:42.191 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":116,"fsid":"e8cc2cf2-4ebe-41fb-ac6a-f09b6fd34589","created":"2024-09-12T00:02:55.594166+0000","modified":"2024-09-12T00:06:41.802141+0000","last_up_change":"2024-09-12T00:03:08.456127+0000","last_in_change":"2024-09-12T00:06:25.567588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:03:10.418576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:03:14.745863+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T00:03:22.360758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T00:03:23.944957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T00:03:25.559276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T00:03:27.471761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T00:03:29.369053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T00:03:31.499978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af1b1898-c45f-43f5-b9c5-26e491625211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6809","nonce":846638970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6811","nonce":846638970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6815","nonce":846638970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6813","nonce":846638970}]},"public_addr":"172.21.15.19:6809/846638970","cluster_addr":"172.21.15.19:6811/846638970","heartbeat_back_addr":"172.21.15.19:6815/846638970","heartbeat_front_addr":"172.21.15.19:6813/846638970","state":["exists","up"]},{"osd":1,"uuid":"fe1aa63d-8e57-4163-98a5-0131e1a60680","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6801","nonce":889703096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6803","nonce":889703096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6807","nonce":889703096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6805","nonce":889703096}]},"public_addr":"172.21.15.19:6801/889703096","cluster_addr":"172.21.15.19:6803/889703096","heartbeat_back_addr":"172.21.15.19:6807/889703096","heartbeat_front_addr":"172.21.15.19:6805/889703096","state":["exists","up"]},{"osd":2,"uuid":"1c97c435-1516-46e1-8fb9-fab9d7419774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6817","nonce":1847757189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6819","nonce":1847757189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6823","nonce":1847757189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6821","nonce":1847757189}]},"public_addr":"172.21.15.19:6817/1847757189","cluster_addr":"172.21.15.19:6819/1847757189","heartbeat_back_addr":"172.21.15.19:6823/1847757189","heartbeat_front_addr":"172.21.15.19:6821/1847757189","state":["exists","up"]},{"osd":3,"uuid":"30dc8f77-54f0-4e5a-8adc-3ef4b1c08f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6825","nonce":2630062148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6827","nonce":2630062148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6831","nonce":2630062148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6829","nonce":2630062148}]},"public_addr":"172.21.15.19:6825/2630062148","cluster_addr":"172.21.15.19:6827/2630062148","heartbeat_back_addr":"172.21.15.19:6831/2630062148","heartbeat_front_addr":"172.21.15.19:6829/2630062148","state":["exists","up"]},{"osd":4,"uuid":"0b4e8ec4-cb09-4c05-9ddb-fe1e664e8f03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6801","nonce":2966848021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6803","nonce":2966848021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6807","nonce":2966848021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6805","nonce":2966848021}]},"public_addr":"172.21.15.135:6801/2966848021","cluster_addr":"172.21.15.135:6803/2966848021","heartbeat_back_addr":"172.21.15.135:6807/2966848021","heartbeat_front_addr":"172.21.15.135:6805/2966848021","state":["exists","up"]},{"osd":5,"uuid":"44796deb-5225-490a-a526-e0be07036b8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6827","nonce":3933885245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6829","nonce":3933885245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6833","nonce":3933885245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6831","nonce":3933885245}]},"public_addr":"172.21.15.135:6827/3933885245","cluster_addr":"172.21.15.135:6829/3933885245","heartbeat_back_addr":"172.21.15.135:6833/3933885245","heartbeat_front_addr":"172.21.15.135:6831/3933885245","state":["exists","up"]},{"osd":6,"uuid":"cecfecf3-d6c7-44f3-9c08-259ae76571c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6817","nonce":951791611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6819","nonce":951791611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6823","nonce":951791611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6821","nonce":951791611}]},"public_addr":"172.21.15.135:6817/951791611","cluster_addr":"172.21.15.135:6819/951791611","heartbeat_back_addr":"172.21.15.135:6823/951791611","heartbeat_front_addr":"172.21.15.135:6821/951791611","state":["exists","up"]},{"osd":7,"uuid":"df0b245a-9a80-4038-8e00-4931eaee68c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6809","nonce":3316717279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6811","nonce":3316717279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6815","nonce":3316717279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6813","nonce":3316717279}]},"public_addr":"172.21.15.135:6809/3316717279","cluster_addr":"172.21.15.135:6811/3316717279","heartbeat_back_addr":"172.21.15.135:6815/3316717279","heartbeat_front_addr":"172.21.15.135:6813/3316717279","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:06.137315+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.222776+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.477878+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.530174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:04.779952+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.847174+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.445765+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.572805+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:06:42.210 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T00:06:42.210 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:06:42.514 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:06:42.514 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":116,"fsid":"e8cc2cf2-4ebe-41fb-ac6a-f09b6fd34589","created":"2024-09-12T00:02:55.594166+0000","modified":"2024-09-12T00:06:41.802141+0000","last_up_change":"2024-09-12T00:03:08.456127+0000","last_in_change":"2024-09-12T00:06:25.567588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:03:10.418576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:03:14.745863+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T00:03:22.360758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T00:03:23.944957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T00:03:25.559276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T00:03:27.471761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T00:03:29.369053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T00:03:31.499978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af1b1898-c45f-43f5-b9c5-26e491625211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6809","nonce":846638970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6811","nonce":846638970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6815","nonce":846638970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6813","nonce":846638970}]},"public_addr":"172.21.15.19:6809/846638970","cluster_addr":"172.21.15.19:6811/846638970","heartbeat_back_addr":"172.21.15.19:6815/846638970","heartbeat_front_addr":"172.21.15.19:6813/846638970","state":["exists","up"]},{"osd":1,"uuid":"fe1aa63d-8e57-4163-98a5-0131e1a60680","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6801","nonce":889703096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6803","nonce":889703096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6807","nonce":889703096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6805","nonce":889703096}]},"public_addr":"172.21.15.19:6801/889703096","cluster_addr":"172.21.15.19:6803/889703096","heartbeat_back_addr":"172.21.15.19:6807/889703096","heartbeat_front_addr":"172.21.15.19:6805/889703096","state":["exists","up"]},{"osd":2,"uuid":"1c97c435-1516-46e1-8fb9-fab9d7419774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6817","nonce":1847757189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6819","nonce":1847757189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6823","nonce":1847757189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6821","nonce":1847757189}]},"public_addr":"172.21.15.19:6817/1847757189","cluster_addr":"172.21.15.19:6819/1847757189","heartbeat_back_addr":"172.21.15.19:6823/1847757189","heartbeat_front_addr":"172.21.15.19:6821/1847757189","state":["exists","up"]},{"osd":3,"uuid":"30dc8f77-54f0-4e5a-8adc-3ef4b1c08f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6825","nonce":2630062148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6827","nonce":2630062148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6831","nonce":2630062148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6829","nonce":2630062148}]},"public_addr":"172.21.15.19:6825/2630062148","cluster_addr":"172.21.15.19:6827/2630062148","heartbeat_back_addr":"172.21.15.19:6831/2630062148","heartbeat_front_addr":"172.21.15.19:6829/2630062148","state":["exists","up"]},{"osd":4,"uuid":"0b4e8ec4-cb09-4c05-9ddb-fe1e664e8f03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6801","nonce":2966848021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6803","nonce":2966848021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6807","nonce":2966848021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6805","nonce":2966848021}]},"public_addr":"172.21.15.135:6801/2966848021","cluster_addr":"172.21.15.135:6803/2966848021","heartbeat_back_addr":"172.21.15.135:6807/2966848021","heartbeat_front_addr":"172.21.15.135:6805/2966848021","state":["exists","up"]},{"osd":5,"uuid":"44796deb-5225-490a-a526-e0be07036b8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6827","nonce":3933885245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6829","nonce":3933885245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6833","nonce":3933885245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6831","nonce":3933885245}]},"public_addr":"172.21.15.135:6827/3933885245","cluster_addr":"172.21.15.135:6829/3933885245","heartbeat_back_addr":"172.21.15.135:6833/3933885245","heartbeat_front_addr":"172.21.15.135:6831/3933885245","state":["exists","up"]},{"osd":6,"uuid":"cecfecf3-d6c7-44f3-9c08-259ae76571c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6817","nonce":951791611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6819","nonce":951791611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6823","nonce":951791611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6821","nonce":951791611}]},"public_addr":"172.21.15.135:6817/951791611","cluster_addr":"172.21.15.135:6819/951791611","heartbeat_back_addr":"172.21.15.135:6823/951791611","heartbeat_front_addr":"172.21.15.135:6821/951791611","state":["exists","up"]},{"osd":7,"uuid":"df0b245a-9a80-4038-8e00-4931eaee68c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6809","nonce":3316717279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6811","nonce":3316717279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6815","nonce":3316717279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6813","nonce":3316717279}]},"public_addr":"172.21.15.135:6809/3316717279","cluster_addr":"172.21.15.135:6811/3316717279","heartbeat_back_addr":"172.21.15.135:6815/3316717279","heartbeat_front_addr":"172.21.15.135:6813/3316717279","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:06.137315+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.222776+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.477878+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.530174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:04.779952+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.847174+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.445765+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.572805+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:06:42.533 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T00:06:42.533 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T00:06:42.534 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T00:06:42.534 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T00:06:42.535 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T00:06:42.535 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T00:06:42.535 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T00:06:42.536 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T00:06:42.811 INFO:teuthology.orchestra.run.smithi019.stdout:60129542191 2024-09-12T00:06:42.811 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:06:42.812 INFO:teuthology.orchestra.run.smithi019.stdout:60129542191 2024-09-12T00:06:42.813 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:06:42.822 INFO:teuthology.orchestra.run.smithi019.stdout:60129542190 2024-09-12T00:06:42.822 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:06:42.824 INFO:teuthology.orchestra.run.smithi019.stdout:60129542192 2024-09-12T00:06:42.824 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:06:42.828 INFO:teuthology.orchestra.run.smithi019.stdout:60129542191 2024-09-12T00:06:42.828 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:06:42.831 INFO:teuthology.orchestra.run.smithi019.stdout:60129542191 2024-09-12T00:06:42.831 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:06:42.833 INFO:teuthology.orchestra.run.smithi019.stdout:60129542191 2024-09-12T00:06:42.833 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:06:42.836 INFO:teuthology.orchestra.run.smithi019.stdout:60129542191 2024-09-12T00:06:42.837 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:06:43.337 INFO:teuthology.orchestra.run.smithi019.stdout:60129542190 2024-09-12T00:06:43.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542191 got 60129542190 for osd.6 2024-09-12T00:06:43.370 INFO:teuthology.orchestra.run.smithi019.stdout:60129542190 2024-09-12T00:06:43.376 INFO:teuthology.orchestra.run.smithi019.stdout:60129542191 2024-09-12T00:06:43.385 INFO:teuthology.orchestra.run.smithi019.stdout:60129542190 2024-09-12T00:06:43.395 INFO:teuthology.orchestra.run.smithi019.stdout:60129542189 2024-09-12T00:06:43.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542192 got 60129542191 for osd.2 2024-09-12T00:06:43.404 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542191 got 60129542190 for osd.3 2024-09-12T00:06:43.413 INFO:teuthology.orchestra.run.smithi019.stdout:60129542190 2024-09-12T00:06:43.418 INFO:teuthology.orchestra.run.smithi019.stdout:60129542190 2024-09-12T00:06:43.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542190 got 60129542189 for osd.0 2024-09-12T00:06:43.420 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542191 got 60129542190 for osd.7 2024-09-12T00:06:43.427 INFO:teuthology.orchestra.run.smithi019.stdout:60129542190 2024-09-12T00:06:43.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542191 got 60129542190 for osd.1 2024-09-12T00:06:43.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542191 got 60129542190 for osd.5 2024-09-12T00:06:43.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542191 got 60129542190 for osd.4 2024-09-12T00:06:44.364 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:06:44.399 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:06:44.405 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:06:44.420 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:06:44.420 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:06:44.439 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:06:44.445 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:06:44.447 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:06:44.871 INFO:teuthology.orchestra.run.smithi019.stdout:60129542192 2024-09-12T00:06:44.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542191 got 60129542192 for osd.6 2024-09-12T00:06:44.905 DEBUG:teuthology.parallel:result is None 2024-09-12T00:06:44.955 INFO:teuthology.orchestra.run.smithi019.stdout:60129542193 2024-09-12T00:06:44.970 INFO:teuthology.orchestra.run.smithi019.stdout:60129542192 2024-09-12T00:06:44.978 INFO:teuthology.orchestra.run.smithi019.stdout:60129542192 2024-09-12T00:06:44.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542192 got 60129542193 for osd.2 2024-09-12T00:06:44.984 DEBUG:teuthology.parallel:result is None 2024-09-12T00:06:44.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542191 got 60129542192 for osd.4 2024-09-12T00:06:44.992 DEBUG:teuthology.parallel:result is None 2024-09-12T00:06:45.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542191 got 60129542192 for osd.3 2024-09-12T00:06:45.006 INFO:teuthology.orchestra.run.smithi019.stdout:60129542192 2024-09-12T00:06:45.006 DEBUG:teuthology.parallel:result is None 2024-09-12T00:06:45.010 INFO:teuthology.orchestra.run.smithi019.stdout:60129542191 2024-09-12T00:06:45.012 INFO:teuthology.orchestra.run.smithi019.stdout:60129542192 2024-09-12T00:06:45.029 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542191 got 60129542192 for osd.1 2024-09-12T00:06:45.029 DEBUG:teuthology.parallel:result is None 2024-09-12T00:06:45.031 INFO:teuthology.orchestra.run.smithi019.stdout:60129542192 2024-09-12T00:06:45.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542190 got 60129542191 for osd.0 2024-09-12T00:06:45.033 DEBUG:teuthology.parallel:result is None 2024-09-12T00:06:45.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542191 got 60129542192 for osd.5 2024-09-12T00:06:45.040 DEBUG:teuthology.parallel:result is None 2024-09-12T00:06:45.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542191 got 60129542192 for osd.7 2024-09-12T00:06:45.050 DEBUG:teuthology.parallel:result is None 2024-09-12T00:06:45.050 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T00:06:45.050 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:06:45.416 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:06:45.424 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T00:06:45.431 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2024-09-12T00:06:44.462524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300819945,"num_objects":1736,"num_object_clones":0,"num_object_copies":3472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1736,"num_whiteouts":0,"num_read":3480,"num_read_kb":3139,"num_write":2967,"num_write_kb":6187128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":928,"num_bytes_recovered":3007433610,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4047,"ondisk_log_size":4047,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12591900,"kb_used_data":12317400,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":742382820,"statfs":{"total":773094113280,"available":760200007680,"internally_reserved":0,"allocated":12613017600,"data_stored":12607957006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":280874546},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.684531"},"pg_stats":[{"pgid":"3.3f","version":"95'16","reported_seq":286,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.817134+0000","last_change":"2024-09-12T00:06:27.539898+0000","last_active":"2024-09-12T00:06:41.817134+0000","last_peered":"2024-09-12T00:06:41.817134+0000","last_clean":"2024-09-12T00:06:41.817134+0000","last_became_active":"2024-09-12T00:06:26.678792+0000","last_became_peered":"2024-09-12T00:06:26.678792+0000","last_unstale":"2024-09-12T00:06:41.817134+0000","last_undegraded":"2024-09-12T00:06:41.817134+0000","last_fullsized":"2024-09-12T00:06:41.817134+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:23.434133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'2","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499351+0000","last_change":"2024-09-12T00:03:25.337244+0000","last_active":"2024-09-12T00:06:42.499351+0000","last_peered":"2024-09-12T00:06:42.499351+0000","last_clean":"2024-09-12T00:06:42.499351+0000","last_became_active":"2024-09-12T00:03:25.335964+0000","last_became_peered":"2024-09-12T00:03:25.335964+0000","last_unstale":"2024-09-12T00:06:42.499351+0000","last_undegraded":"2024-09-12T00:06:42.499351+0000","last_fullsized":"2024-09-12T00:06:42.499351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"96'24","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067343+0000","last_change":"2024-09-12T00:03:23.628328+0000","last_active":"2024-09-12T00:06:42.067343+0000","last_peered":"2024-09-12T00:06:42.067343+0000","last_clean":"2024-09-12T00:06:42.067343+0000","last_became_active":"2024-09-12T00:03:23.627630+0000","last_became_peered":"2024-09-12T00:03:23.627630+0000","last_unstale":"2024-09-12T00:06:42.067343+0000","last_undegraded":"2024-09-12T00:06:42.067343+0000","last_fullsized":"2024-09-12T00:06:42.067343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:00.573006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"76'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717726+0000","last_change":"2024-09-12T00:06:27.903337+0000","last_active":"2024-09-12T00:06:42.717726+0000","last_peered":"2024-09-12T00:06:42.717726+0000","last_clean":"2024-09-12T00:06:42.717726+0000","last_became_active":"2024-09-12T00:06:26.660419+0000","last_became_peered":"2024-09-12T00:06:26.660419+0000","last_unstale":"2024-09-12T00:06:42.717726+0000","last_undegraded":"2024-09-12T00:06:42.717726+0000","last_fullsized":"2024-09-12T00:06:42.717726+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:43.714019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"96'29","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066706+0000","last_change":"2024-09-12T00:03:23.626533+0000","last_active":"2024-09-12T00:06:42.066706+0000","last_peered":"2024-09-12T00:06:42.066706+0000","last_clean":"2024-09-12T00:06:42.066706+0000","last_became_active":"2024-09-12T00:03:23.625728+0000","last_became_peered":"2024-09-12T00:03:23.625728+0000","last_unstale":"2024-09-12T00:06:42.066706+0000","last_undegraded":"2024-09-12T00:06:42.066706+0000","last_fullsized":"2024-09-12T00:06:42.066706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:31.772442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"96'4","reported_seq":47,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721615+0000","last_change":"2024-09-12T00:06:32.442375+0000","last_active":"2024-09-12T00:06:42.721615+0000","last_peered":"2024-09-12T00:06:42.721615+0000","last_clean":"2024-09-12T00:06:42.721615+0000","last_became_active":"2024-09-12T00:06:26.677271+0000","last_became_peered":"2024-09-12T00:06:26.677271+0000","last_unstale":"2024-09-12T00:06:42.721615+0000","last_undegraded":"2024-09-12T00:06:42.721615+0000","last_fullsized":"2024-09-12T00:06:42.721615+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:34.385926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"96'22","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812538+0000","last_change":"2024-09-12T00:03:23.609828+0000","last_active":"2024-09-12T00:06:41.812538+0000","last_peered":"2024-09-12T00:06:41.812538+0000","last_clean":"2024-09-12T00:06:41.812538+0000","last_became_active":"2024-09-12T00:03:23.609326+0000","last_became_peered":"2024-09-12T00:03:23.609326+0000","last_unstale":"2024-09-12T00:06:41.812538+0000","last_undegraded":"2024-09-12T00:06:41.812538+0000","last_fullsized":"2024-09-12T00:06:41.812538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:25.491620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'8","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812256+0000","last_change":"2024-09-12T00:03:25.339518+0000","last_active":"2024-09-12T00:06:41.812256+0000","last_peered":"2024-09-12T00:06:41.812256+0000","last_clean":"2024-09-12T00:06:41.812256+0000","last_became_active":"2024-09-12T00:03:25.338805+0000","last_became_peered":"2024-09-12T00:03:25.338805+0000","last_unstale":"2024-09-12T00:06:41.812256+0000","last_undegraded":"2024-09-12T00:06:41.812256+0000","last_fullsized":"2024-09-12T00:06:41.812256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"96'26","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810071+0000","last_change":"2024-09-12T00:03:23.633978+0000","last_active":"2024-09-12T00:06:41.810071+0000","last_peered":"2024-09-12T00:06:41.810071+0000","last_clean":"2024-09-12T00:06:41.810071+0000","last_became_active":"2024-09-12T00:03:23.633580+0000","last_became_peered":"2024-09-12T00:03:23.633580+0000","last_unstale":"2024-09-12T00:06:41.810071+0000","last_undegraded":"2024-09-12T00:06:41.810071+0000","last_fullsized":"2024-09-12T00:06:41.810071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:01.872688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809540+0000","last_change":"2024-09-12T00:03:25.324424+0000","last_active":"2024-09-12T00:06:41.809540+0000","last_peered":"2024-09-12T00:06:41.809540+0000","last_clean":"2024-09-12T00:06:41.809540+0000","last_became_active":"2024-09-12T00:03:25.324138+0000","last_became_peered":"2024-09-12T00:03:25.324138+0000","last_unstale":"2024-09-12T00:06:41.809540+0000","last_undegraded":"2024-09-12T00:06:41.809540+0000","last_fullsized":"2024-09-12T00:06:41.809540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:09.954252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"96'21","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812953+0000","last_change":"2024-09-12T00:03:23.610136+0000","last_active":"2024-09-12T00:06:41.812953+0000","last_peered":"2024-09-12T00:06:41.812953+0000","last_clean":"2024-09-12T00:06:41.812953+0000","last_became_active":"2024-09-12T00:03:23.609509+0000","last_became_peered":"2024-09-12T00:03:23.609509+0000","last_unstale":"2024-09-12T00:06:41.812953+0000","last_undegraded":"2024-09-12T00:06:41.812953+0000","last_fullsized":"2024-09-12T00:06:41.812953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"96'12","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.817127+0000","last_change":"2024-09-12T00:03:25.355256+0000","last_active":"2024-09-12T00:06:41.817127+0000","last_peered":"2024-09-12T00:06:41.817127+0000","last_clean":"2024-09-12T00:06:41.817127+0000","last_became_active":"2024-09-12T00:03:25.355002+0000","last_became_peered":"2024-09-12T00:03:25.355002+0000","last_unstale":"2024-09-12T00:06:41.817127+0000","last_undegraded":"2024-09-12T00:06:41.817127+0000","last_fullsized":"2024-09-12T00:06:41.817127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:50.488869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"96'28","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813544+0000","last_change":"2024-09-12T00:03:23.606780+0000","last_active":"2024-09-12T00:06:41.813544+0000","last_peered":"2024-09-12T00:06:41.813544+0000","last_clean":"2024-09-12T00:06:41.813544+0000","last_became_active":"2024-09-12T00:03:23.606143+0000","last_became_peered":"2024-09-12T00:03:23.606143+0000","last_unstale":"2024-09-12T00:06:41.813544+0000","last_undegraded":"2024-09-12T00:06:41.813544+0000","last_fullsized":"2024-09-12T00:06:41.813544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:22.889982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813590+0000","last_change":"2024-09-12T00:03:25.330195+0000","last_active":"2024-09-12T00:06:41.813590+0000","last_peered":"2024-09-12T00:06:41.813590+0000","last_clean":"2024-09-12T00:06:41.813590+0000","last_became_active":"2024-09-12T00:03:25.329625+0000","last_became_peered":"2024-09-12T00:03:25.329625+0000","last_unstale":"2024-09-12T00:06:41.813590+0000","last_undegraded":"2024-09-12T00:06:41.813590+0000","last_fullsized":"2024-09-12T00:06:41.813590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"96'27","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064982+0000","last_change":"2024-09-12T00:03:23.626723+0000","last_active":"2024-09-12T00:06:42.064982+0000","last_peered":"2024-09-12T00:06:42.064982+0000","last_clean":"2024-09-12T00:06:42.064982+0000","last_became_active":"2024-09-12T00:03:23.626018+0000","last_became_peered":"2024-09-12T00:03:23.626018+0000","last_unstale":"2024-09-12T00:06:42.064982+0000","last_undegraded":"2024-09-12T00:06:42.064982+0000","last_fullsized":"2024-09-12T00:06:42.064982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"59'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067823+0000","last_change":"2024-09-12T00:03:25.352418+0000","last_active":"2024-09-12T00:06:42.067823+0000","last_peered":"2024-09-12T00:06:42.067823+0000","last_clean":"2024-09-12T00:06:42.067823+0000","last_became_active":"2024-09-12T00:03:25.347902+0000","last_became_peered":"2024-09-12T00:03:25.347902+0000","last_unstale":"2024-09-12T00:06:42.067823+0000","last_undegraded":"2024-09-12T00:06:42.067823+0000","last_fullsized":"2024-09-12T00:06:42.067823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:29.611790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"59'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719921+0000","last_change":"2024-09-12T00:06:27.342563+0000","last_active":"2024-09-12T00:06:42.719921+0000","last_peered":"2024-09-12T00:06:42.719921+0000","last_clean":"2024-09-12T00:06:42.719921+0000","last_became_active":"2024-09-12T00:06:26.653851+0000","last_became_peered":"2024-09-12T00:06:26.653851+0000","last_unstale":"2024-09-12T00:06:42.719921+0000","last_undegraded":"2024-09-12T00:06:42.719921+0000","last_fullsized":"2024-09-12T00:06:42.719921+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:14.109429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"95'17","reported_seq":285,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501969+0000","last_change":"2024-09-12T00:06:27.069520+0000","last_active":"2024-09-12T00:06:42.501969+0000","last_peered":"2024-09-12T00:06:42.501969+0000","last_clean":"2024-09-12T00:06:42.501969+0000","last_became_active":"2024-09-12T00:06:26.664959+0000","last_became_peered":"2024-09-12T00:06:26.664959+0000","last_unstale":"2024-09-12T00:06:42.501969+0000","last_undegraded":"2024-09-12T00:06:42.501969+0000","last_fullsized":"2024-09-12T00:06:42.501969+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:35.231503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813150+0000","last_change":"2024-09-12T00:03:25.334966+0000","last_active":"2024-09-12T00:06:41.813150+0000","last_peered":"2024-09-12T00:06:41.813150+0000","last_clean":"2024-09-12T00:06:41.813150+0000","last_became_active":"2024-09-12T00:03:25.334375+0000","last_became_peered":"2024-09-12T00:03:25.334375+0000","last_unstale":"2024-09-12T00:06:41.813150+0000","last_undegraded":"2024-09-12T00:06:41.813150+0000","last_fullsized":"2024-09-12T00:06:41.813150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:52.828056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"96'20","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816433+0000","last_change":"2024-09-12T00:03:23.614289+0000","last_active":"2024-09-12T00:06:41.816433+0000","last_peered":"2024-09-12T00:06:41.816433+0000","last_clean":"2024-09-12T00:06:41.816433+0000","last_became_active":"2024-09-12T00:03:23.614019+0000","last_became_peered":"2024-09-12T00:03:23.614019+0000","last_unstale":"2024-09-12T00:06:41.816433+0000","last_undegraded":"2024-09-12T00:06:41.816433+0000","last_fullsized":"2024-09-12T00:06:41.816433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:00.847027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"96'12","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500281+0000","last_change":"2024-09-12T00:03:25.357938+0000","last_active":"2024-09-12T00:06:42.500281+0000","last_peered":"2024-09-12T00:06:42.500281+0000","last_clean":"2024-09-12T00:06:42.500281+0000","last_became_active":"2024-09-12T00:03:25.357571+0000","last_became_peered":"2024-09-12T00:03:25.357571+0000","last_unstale":"2024-09-12T00:06:42.500281+0000","last_undegraded":"2024-09-12T00:06:42.500281+0000","last_fullsized":"2024-09-12T00:06:42.500281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:05.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"95'23","reported_seq":315,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816438+0000","last_change":"2024-09-12T00:06:28.845144+0000","last_active":"2024-09-12T00:06:41.816438+0000","last_peered":"2024-09-12T00:06:41.816438+0000","last_clean":"2024-09-12T00:06:41.816438+0000","last_became_active":"2024-09-12T00:06:26.682027+0000","last_became_peered":"2024-09-12T00:06:26.682027+0000","last_unstale":"2024-09-12T00:06:41.816438+0000","last_undegraded":"2024-09-12T00:06:41.816438+0000","last_fullsized":"2024-09-12T00:06:41.816438+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:24.330401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":167772160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'8","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721712+0000","last_change":"2024-09-12T00:03:25.345717+0000","last_active":"2024-09-12T00:06:42.721712+0000","last_peered":"2024-09-12T00:06:42.721712+0000","last_clean":"2024-09-12T00:06:42.721712+0000","last_became_active":"2024-09-12T00:03:25.344959+0000","last_became_peered":"2024-09-12T00:03:25.344959+0000","last_unstale":"2024-09-12T00:06:42.721712+0000","last_undegraded":"2024-09-12T00:06:42.721712+0000","last_fullsized":"2024-09-12T00:06:42.721712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"96'17","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815332+0000","last_change":"2024-09-12T00:03:23.602960+0000","last_active":"2024-09-12T00:06:41.815332+0000","last_peered":"2024-09-12T00:06:41.815332+0000","last_clean":"2024-09-12T00:06:41.815332+0000","last_became_active":"2024-09-12T00:03:23.602640+0000","last_became_peered":"2024-09-12T00:03:23.602640+0000","last_unstale":"2024-09-12T00:06:41.815332+0000","last_undegraded":"2024-09-12T00:06:41.815332+0000","last_fullsized":"2024-09-12T00:06:41.815332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"59'2","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066326+0000","last_change":"2024-09-12T00:06:28.300294+0000","last_active":"2024-09-12T00:06:42.066326+0000","last_peered":"2024-09-12T00:06:42.066326+0000","last_clean":"2024-09-12T00:06:42.066326+0000","last_became_active":"2024-09-12T00:06:26.665307+0000","last_became_peered":"2024-09-12T00:06:26.665307+0000","last_unstale":"2024-09-12T00:06:42.066326+0000","last_undegraded":"2024-09-12T00:06:42.066326+0000","last_fullsized":"2024-09-12T00:06:42.066326+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:18.349268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"96'23","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722623+0000","last_change":"2024-09-12T00:03:23.604732+0000","last_active":"2024-09-12T00:06:42.722623+0000","last_peered":"2024-09-12T00:06:42.722623+0000","last_clean":"2024-09-12T00:06:42.722623+0000","last_became_active":"2024-09-12T00:03:23.603932+0000","last_became_peered":"2024-09-12T00:03:23.603932+0000","last_unstale":"2024-09-12T00:06:42.722623+0000","last_undegraded":"2024-09-12T00:06:42.722623+0000","last_fullsized":"2024-09-12T00:06:42.722623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:14.913580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"76'4","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501143+0000","last_change":"2024-09-12T00:03:25.341332+0000","last_active":"2024-09-12T00:06:42.501143+0000","last_peered":"2024-09-12T00:06:42.501143+0000","last_clean":"2024-09-12T00:06:42.501143+0000","last_became_active":"2024-09-12T00:03:25.340828+0000","last_became_peered":"2024-09-12T00:03:25.340828+0000","last_unstale":"2024-09-12T00:06:42.501143+0000","last_undegraded":"2024-09-12T00:06:42.501143+0000","last_fullsized":"2024-09-12T00:06:42.501143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"95'18","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722863+0000","last_change":"2024-09-12T00:03:23.602687+0000","last_active":"2024-09-12T00:06:42.722863+0000","last_peered":"2024-09-12T00:06:42.722863+0000","last_clean":"2024-09-12T00:06:42.722863+0000","last_became_active":"2024-09-12T00:03:23.601892+0000","last_became_peered":"2024-09-12T00:03:23.601892+0000","last_unstale":"2024-09-12T00:06:42.722863+0000","last_undegraded":"2024-09-12T00:06:42.722863+0000","last_fullsized":"2024-09-12T00:06:42.722863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.808845+0000","last_change":"2024-09-12T00:03:33.354850+0000","last_active":"2024-09-12T00:06:41.808845+0000","last_peered":"2024-09-12T00:06:41.808845+0000","last_clean":"2024-09-12T00:06:41.808845+0000","last_became_active":"2024-09-12T00:03:33.351917+0000","last_became_peered":"2024-09-12T00:03:33.351917+0000","last_unstale":"2024-09-12T00:06:41.808845+0000","last_undegraded":"2024-09-12T00:06:41.808845+0000","last_fullsized":"2024-09-12T00:06:41.808845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:00.466863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"59'6","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721027+0000","last_change":"2024-09-12T00:03:25.323174+0000","last_active":"2024-09-12T00:06:42.721027+0000","last_peered":"2024-09-12T00:06:42.721027+0000","last_clean":"2024-09-12T00:06:42.721027+0000","last_became_active":"2024-09-12T00:03:25.322456+0000","last_became_peered":"2024-09-12T00:03:25.322456+0000","last_unstale":"2024-09-12T00:06:42.721027+0000","last_undegraded":"2024-09-12T00:06:42.721027+0000","last_fullsized":"2024-09-12T00:06:42.721027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"96'27","reported_seq":97,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721346+0000","last_change":"2024-09-12T00:06:27.333722+0000","last_active":"2024-09-12T00:06:42.721346+0000","last_peered":"2024-09-12T00:06:42.721346+0000","last_clean":"2024-09-12T00:06:42.721346+0000","last_became_active":"2024-09-12T00:06:26.648460+0000","last_became_peered":"2024-09-12T00:06:26.648460+0000","last_unstale":"2024-09-12T00:06:42.721346+0000","last_undegraded":"2024-09-12T00:06:42.721346+0000","last_fullsized":"2024-09-12T00:06:42.721346+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:17.751627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717693+0000","last_change":"2024-09-12T00:06:26.675813+0000","last_active":"2024-09-12T00:06:42.717693+0000","last_peered":"2024-09-12T00:06:42.717693+0000","last_clean":"2024-09-12T00:06:42.717693+0000","last_became_active":"2024-09-12T00:06:26.663654+0000","last_became_peered":"2024-09-12T00:06:26.663654+0000","last_unstale":"2024-09-12T00:06:42.717693+0000","last_undegraded":"2024-09-12T00:06:42.717693+0000","last_fullsized":"2024-09-12T00:06:42.717693+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:22.865255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"96'29","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812965+0000","last_change":"2024-09-12T00:03:29.347224+0000","last_active":"2024-09-12T00:06:41.812965+0000","last_peered":"2024-09-12T00:06:41.812965+0000","last_clean":"2024-09-12T00:06:41.812965+0000","last_became_active":"2024-09-12T00:03:29.346662+0000","last_became_peered":"2024-09-12T00:03:29.346662+0000","last_unstale":"2024-09-12T00:06:41.812965+0000","last_undegraded":"2024-09-12T00:06:41.812965+0000","last_fullsized":"2024-09-12T00:06:41.812965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:28.258932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501404+0000","last_change":"2024-09-12T00:03:31.337219+0000","last_active":"2024-09-12T00:06:42.501404+0000","last_peered":"2024-09-12T00:06:42.501404+0000","last_clean":"2024-09-12T00:06:42.501404+0000","last_became_active":"2024-09-12T00:03:31.336317+0000","last_became_peered":"2024-09-12T00:03:31.336317+0000","last_unstale":"2024-09-12T00:06:42.501404+0000","last_undegraded":"2024-09-12T00:06:42.501404+0000","last_fullsized":"2024-09-12T00:06:42.501404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:50.954053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"96'48","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499219+0000","last_change":"2024-09-12T00:03:33.376628+0000","last_active":"2024-09-12T00:06:42.499219+0000","last_peered":"2024-09-12T00:06:42.499219+0000","last_clean":"2024-09-12T00:06:42.499219+0000","last_became_active":"2024-09-12T00:03:33.375938+0000","last_became_peered":"2024-09-12T00:03:33.375938+0000","last_unstale":"2024-09-12T00:06:42.499219+0000","last_undegraded":"2024-09-12T00:06:42.499219+0000","last_fullsized":"2024-09-12T00:06:42.499219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:31.105042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"84'8","reported_seq":51,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717938+0000","last_change":"2024-09-12T00:06:32.981663+0000","last_active":"2024-09-12T00:06:42.717938+0000","last_peered":"2024-09-12T00:06:42.717938+0000","last_clean":"2024-09-12T00:06:42.717938+0000","last_became_active":"2024-09-12T00:06:26.679390+0000","last_became_peered":"2024-09-12T00:06:26.679390+0000","last_unstale":"2024-09-12T00:06:42.717938+0000","last_undegraded":"2024-09-12T00:06:42.717938+0000","last_fullsized":"2024-09-12T00:06:42.717938+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.655318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"96'14","reported_seq":267,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723059+0000","last_change":"2024-09-12T00:06:28.270104+0000","last_active":"2024-09-12T00:06:42.723059+0000","last_peered":"2024-09-12T00:06:42.723059+0000","last_clean":"2024-09-12T00:06:42.723059+0000","last_became_active":"2024-09-12T00:06:26.675473+0000","last_became_peered":"2024-09-12T00:06:26.675473+0000","last_unstale":"2024-09-12T00:06:42.723059+0000","last_undegraded":"2024-09-12T00:06:42.723059+0000","last_fullsized":"2024-09-12T00:06:42.723059+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:45.446239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812081+0000","last_change":"2024-09-12T00:03:27.336108+0000","last_active":"2024-09-12T00:06:41.812081+0000","last_peered":"2024-09-12T00:06:41.812081+0000","last_clean":"2024-09-12T00:06:41.812081+0000","last_became_active":"2024-09-12T00:03:27.335308+0000","last_became_peered":"2024-09-12T00:03:27.335308+0000","last_unstale":"2024-09-12T00:06:41.812081+0000","last_undegraded":"2024-09-12T00:06:41.812081+0000","last_fullsized":"2024-09-12T00:06:41.812081+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:39.812803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'12","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501517+0000","last_change":"2024-09-12T00:03:29.352496+0000","last_active":"2024-09-12T00:06:42.501517+0000","last_peered":"2024-09-12T00:06:42.501517+0000","last_clean":"2024-09-12T00:06:42.501517+0000","last_became_active":"2024-09-12T00:03:29.351783+0000","last_became_peered":"2024-09-12T00:03:29.351783+0000","last_unstale":"2024-09-12T00:06:42.501517+0000","last_undegraded":"2024-09-12T00:06:42.501517+0000","last_fullsized":"2024-09-12T00:06:42.501517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501338+0000","last_change":"2024-09-12T00:03:31.350279+0000","last_active":"2024-09-12T00:06:42.501338+0000","last_peered":"2024-09-12T00:06:42.501338+0000","last_clean":"2024-09-12T00:06:42.501338+0000","last_became_active":"2024-09-12T00:03:31.349244+0000","last_became_peered":"2024-09-12T00:03:31.349244+0000","last_unstale":"2024-09-12T00:06:42.501338+0000","last_undegraded":"2024-09-12T00:06:42.501338+0000","last_fullsized":"2024-09-12T00:06:42.501338+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.420974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719171+0000","last_change":"2024-09-12T00:03:33.382726+0000","last_active":"2024-09-12T00:06:42.719171+0000","last_peered":"2024-09-12T00:06:42.719171+0000","last_clean":"2024-09-12T00:06:42.719171+0000","last_became_active":"2024-09-12T00:03:33.381875+0000","last_became_peered":"2024-09-12T00:03:33.381875+0000","last_unstale":"2024-09-12T00:06:42.719171+0000","last_undegraded":"2024-09-12T00:06:42.719171+0000","last_fullsized":"2024-09-12T00:06:42.719171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"63'12","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066812+0000","last_change":"2024-09-12T00:03:25.357883+0000","last_active":"2024-09-12T00:06:42.066812+0000","last_peered":"2024-09-12T00:06:42.066812+0000","last_clean":"2024-09-12T00:06:42.066812+0000","last_became_active":"2024-09-12T00:03:25.355174+0000","last_became_peered":"2024-09-12T00:03:25.355174+0000","last_unstale":"2024-09-12T00:06:42.066812+0000","last_undegraded":"2024-09-12T00:06:42.066812+0000","last_fullsized":"2024-09-12T00:06:42.066812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:26.621650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"96'21","reported_seq":85,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721209+0000","last_change":"2024-09-12T00:06:29.505713+0000","last_active":"2024-09-12T00:06:42.721209+0000","last_peered":"2024-09-12T00:06:42.721209+0000","last_clean":"2024-09-12T00:06:42.721209+0000","last_became_active":"2024-09-12T00:06:26.670936+0000","last_became_peered":"2024-09-12T00:06:26.670936+0000","last_unstale":"2024-09-12T00:06:42.721209+0000","last_undegraded":"2024-09-12T00:06:42.721209+0000","last_fullsized":"2024-09-12T00:06:42.721209+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:12.048117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813428+0000","last_change":"2024-09-12T00:03:27.347098+0000","last_active":"2024-09-12T00:06:41.813428+0000","last_peered":"2024-09-12T00:06:41.813428+0000","last_clean":"2024-09-12T00:06:41.813428+0000","last_became_active":"2024-09-12T00:03:27.346346+0000","last_became_peered":"2024-09-12T00:03:27.346346+0000","last_unstale":"2024-09-12T00:06:41.813428+0000","last_undegraded":"2024-09-12T00:06:41.813428+0000","last_fullsized":"2024-09-12T00:06:41.813428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:56.250627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'22","reported_seq":265,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812213+0000","last_change":"2024-09-12T00:06:27.562833+0000","last_active":"2024-09-12T00:06:41.812213+0000","last_peered":"2024-09-12T00:06:41.812213+0000","last_clean":"2024-09-12T00:06:41.812213+0000","last_became_active":"2024-09-12T00:06:26.654182+0000","last_became_peered":"2024-09-12T00:06:26.654182+0000","last_unstale":"2024-09-12T00:06:41.812213+0000","last_undegraded":"2024-09-12T00:06:41.812213+0000","last_fullsized":"2024-09-12T00:06:41.812213+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:01.211483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"106'139","reported_seq":361,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.724446+0000","last_change":"2024-09-12T00:06:30.699178+0000","last_active":"2024-09-12T00:06:42.724446+0000","last_peered":"2024-09-12T00:06:42.724446+0000","last_clean":"2024-09-12T00:06:42.724446+0000","last_became_active":"2024-09-12T00:06:30.698465+0000","last_became_peered":"2024-09-12T00:06:30.698465+0000","last_unstale":"2024-09-12T00:06:42.724446+0000","last_undegraded":"2024-09-12T00:06:42.724446+0000","last_fullsized":"2024-09-12T00:06:42.724446+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:48.150663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810365+0000","last_change":"2024-09-12T00:03:33.378439+0000","last_active":"2024-09-12T00:06:41.810365+0000","last_peered":"2024-09-12T00:06:41.810365+0000","last_clean":"2024-09-12T00:06:41.810365+0000","last_became_active":"2024-09-12T00:03:33.374453+0000","last_became_peered":"2024-09-12T00:03:33.374453+0000","last_unstale":"2024-09-12T00:06:41.810365+0000","last_undegraded":"2024-09-12T00:06:41.810365+0000","last_fullsized":"2024-09-12T00:06:41.810365+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"58'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067326+0000","last_change":"2024-09-12T00:03:25.356433+0000","last_active":"2024-09-12T00:06:42.067326+0000","last_peered":"2024-09-12T00:06:42.067326+0000","last_clean":"2024-09-12T00:06:42.067326+0000","last_became_active":"2024-09-12T00:03:25.354803+0000","last_became_peered":"2024-09-12T00:03:25.354803+0000","last_unstale":"2024-09-12T00:06:42.067326+0000","last_undegraded":"2024-09-12T00:06:42.067326+0000","last_fullsized":"2024-09-12T00:06:42.067326+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:00.419686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"96'23","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499086+0000","last_change":"2024-09-12T00:03:23.630527+0000","last_active":"2024-09-12T00:06:42.499086+0000","last_peered":"2024-09-12T00:06:42.499086+0000","last_clean":"2024-09-12T00:06:42.499086+0000","last_became_active":"2024-09-12T00:03:23.630183+0000","last_became_peered":"2024-09-12T00:03:23.630183+0000","last_unstale":"2024-09-12T00:06:42.499086+0000","last_undegraded":"2024-09-12T00:06:42.499086+0000","last_fullsized":"2024-09-12T00:06:42.499086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94371840,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721999+0000","last_change":"2024-09-12T00:06:26.671315+0000","last_active":"2024-09-12T00:06:42.721999+0000","last_peered":"2024-09-12T00:06:42.721999+0000","last_clean":"2024-09-12T00:06:42.721999+0000","last_became_active":"2024-09-12T00:06:26.669946+0000","last_became_peered":"2024-09-12T00:06:26.669946+0000","last_unstale":"2024-09-12T00:06:42.721999+0000","last_undegraded":"2024-09-12T00:06:42.721999+0000","last_fullsized":"2024-09-12T00:06:42.721999+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:53.569121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"96'23","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812548+0000","last_change":"2024-09-12T00:03:29.339735+0000","last_active":"2024-09-12T00:06:41.812548+0000","last_peered":"2024-09-12T00:06:41.812548+0000","last_clean":"2024-09-12T00:06:41.812548+0000","last_became_active":"2024-09-12T00:03:29.338810+0000","last_became_peered":"2024-09-12T00:03:29.338810+0000","last_unstale":"2024-09-12T00:06:41.812548+0000","last_undegraded":"2024-09-12T00:06:41.812548+0000","last_fullsized":"2024-09-12T00:06:41.812548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"96'134","reported_seq":431,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066934+0000","last_change":"2024-09-12T00:03:31.364647+0000","last_active":"2024-09-12T00:06:42.066934+0000","last_peered":"2024-09-12T00:06:42.066934+0000","last_clean":"2024-09-12T00:06:42.066934+0000","last_became_active":"2024-09-12T00:03:31.353547+0000","last_became_peered":"2024-09-12T00:03:31.353547+0000","last_unstale":"2024-09-12T00:06:42.066934+0000","last_undegraded":"2024-09-12T00:06:42.066934+0000","last_fullsized":"2024-09-12T00:06:42.066934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:20.795870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"63'4","reported_seq":47,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717416+0000","last_change":"2024-09-12T00:06:27.339590+0000","last_active":"2024-09-12T00:06:42.717416+0000","last_peered":"2024-09-12T00:06:42.717416+0000","last_clean":"2024-09-12T00:06:42.717416+0000","last_became_active":"2024-09-12T00:06:26.651618+0000","last_became_peered":"2024-09-12T00:06:26.651618+0000","last_unstale":"2024-09-12T00:06:42.717416+0000","last_undegraded":"2024-09-12T00:06:42.717416+0000","last_fullsized":"2024-09-12T00:06:42.717416+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:58.850777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"96'29","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.817312+0000","last_change":"2024-09-12T00:03:23.602206+0000","last_active":"2024-09-12T00:06:41.817312+0000","last_peered":"2024-09-12T00:06:41.817312+0000","last_clean":"2024-09-12T00:06:41.817312+0000","last_became_active":"2024-09-12T00:03:23.601898+0000","last_became_peered":"2024-09-12T00:03:23.601898+0000","last_unstale":"2024-09-12T00:06:41.817312+0000","last_undegraded":"2024-09-12T00:06:41.817312+0000","last_fullsized":"2024-09-12T00:06:41.817312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:52.625795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499596+0000","last_change":"2024-09-12T00:03:27.331111+0000","last_active":"2024-09-12T00:06:42.499596+0000","last_peered":"2024-09-12T00:06:42.499596+0000","last_clean":"2024-09-12T00:06:42.499596+0000","last_became_active":"2024-09-12T00:03:27.329672+0000","last_became_peered":"2024-09-12T00:03:27.329672+0000","last_unstale":"2024-09-12T00:06:42.499596+0000","last_undegraded":"2024-09-12T00:06:42.499596+0000","last_fullsized":"2024-09-12T00:06:42.499596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"96'34","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814758+0000","last_change":"2024-09-12T00:03:29.335931+0000","last_active":"2024-09-12T00:06:41.814758+0000","last_peered":"2024-09-12T00:06:41.814758+0000","last_clean":"2024-09-12T00:06:41.814758+0000","last_became_active":"2024-09-12T00:03:29.335044+0000","last_became_peered":"2024-09-12T00:03:29.335044+0000","last_unstale":"2024-09-12T00:06:41.814758+0000","last_undegraded":"2024-09-12T00:06:41.814758+0000","last_fullsized":"2024-09-12T00:06:41.814758+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:57.131209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719379+0000","last_change":"2024-09-12T00:03:31.355001+0000","last_active":"2024-09-12T00:06:42.719379+0000","last_peered":"2024-09-12T00:06:42.719379+0000","last_clean":"2024-09-12T00:06:42.719379+0000","last_became_active":"2024-09-12T00:03:31.354160+0000","last_became_peered":"2024-09-12T00:03:31.354160+0000","last_unstale":"2024-09-12T00:06:42.719379+0000","last_undegraded":"2024-09-12T00:06:42.719379+0000","last_fullsized":"2024-09-12T00:06:42.719379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:29.868141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810884+0000","last_change":"2024-09-12T00:06:26.664709+0000","last_active":"2024-09-12T00:06:41.810884+0000","last_peered":"2024-09-12T00:06:41.810884+0000","last_clean":"2024-09-12T00:06:41.810884+0000","last_became_active":"2024-09-12T00:06:26.664401+0000","last_became_peered":"2024-09-12T00:06:26.664401+0000","last_unstale":"2024-09-12T00:06:41.810884+0000","last_undegraded":"2024-09-12T00:06:41.810884+0000","last_fullsized":"2024-09-12T00:06:41.810884+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:17.791780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'2","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499737+0000","last_change":"2024-09-12T00:03:25.357300+0000","last_active":"2024-09-12T00:06:42.499737+0000","last_peered":"2024-09-12T00:06:42.499737+0000","last_clean":"2024-09-12T00:06:42.499737+0000","last_became_active":"2024-09-12T00:03:25.356970+0000","last_became_peered":"2024-09-12T00:03:25.356970+0000","last_unstale":"2024-09-12T00:06:42.499737+0000","last_undegraded":"2024-09-12T00:06:42.499737+0000","last_fullsized":"2024-09-12T00:06:42.499737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:04.193738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"96'19","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814414+0000","last_change":"2024-09-12T00:03:23.609700+0000","last_active":"2024-09-12T00:06:41.814414+0000","last_peered":"2024-09-12T00:06:41.814414+0000","last_clean":"2024-09-12T00:06:41.814414+0000","last_became_active":"2024-09-12T00:03:23.609435+0000","last_became_peered":"2024-09-12T00:03:23.609435+0000","last_unstale":"2024-09-12T00:06:41.814414+0000","last_undegraded":"2024-09-12T00:06:41.814414+0000","last_fullsized":"2024-09-12T00:06:41.814414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720734+0000","last_change":"2024-09-12T00:03:27.339670+0000","last_active":"2024-09-12T00:06:42.720734+0000","last_peered":"2024-09-12T00:06:42.720734+0000","last_clean":"2024-09-12T00:06:42.720734+0000","last_became_active":"2024-09-12T00:03:27.338880+0000","last_became_peered":"2024-09-12T00:03:27.338880+0000","last_unstale":"2024-09-12T00:06:42.720734+0000","last_undegraded":"2024-09-12T00:06:42.720734+0000","last_fullsized":"2024-09-12T00:06:42.720734+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:35.068652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"96'25","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811038+0000","last_change":"2024-09-12T00:03:29.337666+0000","last_active":"2024-09-12T00:06:41.811038+0000","last_peered":"2024-09-12T00:06:41.811038+0000","last_clean":"2024-09-12T00:06:41.811038+0000","last_became_active":"2024-09-12T00:03:29.336957+0000","last_became_peered":"2024-09-12T00:03:29.336957+0000","last_unstale":"2024-09-12T00:06:41.811038+0000","last_undegraded":"2024-09-12T00:06:41.811038+0000","last_fullsized":"2024-09-12T00:06:41.811038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:58.417315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":21,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810940+0000","last_change":"2024-09-12T00:03:31.348590+0000","last_active":"2024-09-12T00:06:41.810940+0000","last_peered":"2024-09-12T00:06:41.810940+0000","last_clean":"2024-09-12T00:06:41.810940+0000","last_became_active":"2024-09-12T00:03:31.347736+0000","last_became_peered":"2024-09-12T00:03:31.347736+0000","last_unstale":"2024-09-12T00:06:41.810940+0000","last_undegraded":"2024-09-12T00:06:41.810940+0000","last_fullsized":"2024-09-12T00:06:41.810940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:04.962492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"59'8","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500524+0000","last_change":"2024-09-12T00:03:33.379699+0000","last_active":"2024-09-12T00:06:42.500524+0000","last_peered":"2024-09-12T00:06:42.500524+0000","last_clean":"2024-09-12T00:06:42.500524+0000","last_became_active":"2024-09-12T00:03:33.378945+0000","last_became_peered":"2024-09-12T00:03:33.378945+0000","last_unstale":"2024-09-12T00:06:42.500524+0000","last_undegraded":"2024-09-12T00:06:42.500524+0000","last_fullsized":"2024-09-12T00:06:42.500524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:23.270488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'6","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812122+0000","last_change":"2024-09-12T00:06:28.326850+0000","last_active":"2024-09-12T00:06:41.812122+0000","last_peered":"2024-09-12T00:06:41.812122+0000","last_clean":"2024-09-12T00:06:41.812122+0000","last_became_active":"2024-09-12T00:06:26.668131+0000","last_became_peered":"2024-09-12T00:06:26.668131+0000","last_unstale":"2024-09-12T00:06:41.812122+0000","last_undegraded":"2024-09-12T00:06:41.812122+0000","last_fullsized":"2024-09-12T00:06:41.812122+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:18.255160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"95'17","reported_seq":77,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717787+0000","last_change":"2024-09-12T00:06:33.441486+0000","last_active":"2024-09-12T00:06:42.717787+0000","last_peered":"2024-09-12T00:06:42.717787+0000","last_clean":"2024-09-12T00:06:42.717787+0000","last_became_active":"2024-09-12T00:06:26.679723+0000","last_became_peered":"2024-09-12T00:06:26.679723+0000","last_unstale":"2024-09-12T00:06:42.717787+0000","last_undegraded":"2024-09-12T00:06:42.717787+0000","last_fullsized":"2024-09-12T00:06:42.717787+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:59.722762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065103+0000","last_change":"2024-09-12T00:03:27.348080+0000","last_active":"2024-09-12T00:06:42.065103+0000","last_peered":"2024-09-12T00:06:42.065103+0000","last_clean":"2024-09-12T00:06:42.065103+0000","last_became_active":"2024-09-12T00:03:27.347288+0000","last_became_peered":"2024-09-12T00:03:27.347288+0000","last_unstale":"2024-09-12T00:06:42.065103+0000","last_undegraded":"2024-09-12T00:06:42.065103+0000","last_fullsized":"2024-09-12T00:06:42.065103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:37.033224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"96'37","reported_seq":61,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720107+0000","last_change":"2024-09-12T00:06:28.360303+0000","last_active":"2024-09-12T00:06:42.720107+0000","last_peered":"2024-09-12T00:06:42.720107+0000","last_clean":"2024-09-12T00:06:42.720107+0000","last_became_active":"2024-09-12T00:06:26.668791+0000","last_became_peered":"2024-09-12T00:06:26.668791+0000","last_unstale":"2024-09-12T00:06:42.720107+0000","last_undegraded":"2024-09-12T00:06:42.720107+0000","last_fullsized":"2024-09-12T00:06:42.720107+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:49.033011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120747,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":45,"num_read_kb":34,"num_write":30,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":116871,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"96'134","reported_seq":350,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064561+0000","last_change":"2024-09-12T00:03:31.354114+0000","last_active":"2024-09-12T00:06:42.064561+0000","last_peered":"2024-09-12T00:06:42.064561+0000","last_clean":"2024-09-12T00:06:42.064561+0000","last_became_active":"2024-09-12T00:03:31.353358+0000","last_became_peered":"2024-09-12T00:03:31.353358+0000","last_unstale":"2024-09-12T00:06:42.064561+0000","last_undegraded":"2024-09-12T00:06:42.064561+0000","last_fullsized":"2024-09-12T00:06:42.064561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:56.624718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719909+0000","last_change":"2024-09-12T00:03:33.383917+0000","last_active":"2024-09-12T00:06:42.719909+0000","last_peered":"2024-09-12T00:06:42.719909+0000","last_clean":"2024-09-12T00:06:42.719909+0000","last_became_active":"2024-09-12T00:03:33.383199+0000","last_became_peered":"2024-09-12T00:03:33.383199+0000","last_unstale":"2024-09-12T00:06:42.719909+0000","last_undegraded":"2024-09-12T00:06:42.719909+0000","last_fullsized":"2024-09-12T00:06:42.719909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:37.428182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"84'10","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065948+0000","last_change":"2024-09-12T00:03:25.356706+0000","last_active":"2024-09-12T00:06:42.065948+0000","last_peered":"2024-09-12T00:06:42.065948+0000","last_clean":"2024-09-12T00:06:42.065948+0000","last_became_active":"2024-09-12T00:03:25.354555+0000","last_became_peered":"2024-09-12T00:03:25.354555+0000","last_unstale":"2024-09-12T00:06:42.065948+0000","last_undegraded":"2024-09-12T00:06:42.065948+0000","last_fullsized":"2024-09-12T00:06:42.065948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:55.543336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"96'39","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815809+0000","last_change":"2024-09-12T00:03:23.612430+0000","last_active":"2024-09-12T00:06:41.815809+0000","last_peered":"2024-09-12T00:06:41.815809+0000","last_clean":"2024-09-12T00:06:41.815809+0000","last_became_active":"2024-09-12T00:03:23.612165+0000","last_became_peered":"2024-09-12T00:03:23.612165+0000","last_unstale":"2024-09-12T00:06:41.815809+0000","last_undegraded":"2024-09-12T00:06:41.815809+0000","last_fullsized":"2024-09-12T00:06:41.815809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:31.444343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":159744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722313+0000","last_change":"2024-09-12T00:03:27.329228+0000","last_active":"2024-09-12T00:06:42.722313+0000","last_peered":"2024-09-12T00:06:42.722313+0000","last_clean":"2024-09-12T00:06:42.722313+0000","last_became_active":"2024-09-12T00:03:27.328497+0000","last_became_peered":"2024-09-12T00:03:27.328497+0000","last_unstale":"2024-09-12T00:06:42.722313+0000","last_undegraded":"2024-09-12T00:06:42.722313+0000","last_fullsized":"2024-09-12T00:06:42.722313+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"96'42","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810133+0000","last_change":"2024-09-12T00:03:29.332778+0000","last_active":"2024-09-12T00:06:41.810133+0000","last_peered":"2024-09-12T00:06:41.810133+0000","last_clean":"2024-09-12T00:06:41.810133+0000","last_became_active":"2024-09-12T00:03:29.332010+0000","last_became_peered":"2024-09-12T00:03:29.332010+0000","last_unstale":"2024-09-12T00:06:41.810133+0000","last_undegraded":"2024-09-12T00:06:41.810133+0000","last_fullsized":"2024-09-12T00:06:41.810133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:13.563107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125399,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":47,"num_read_kb":36,"num_write":30,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065300+0000","last_change":"2024-09-12T00:03:31.354374+0000","last_active":"2024-09-12T00:06:42.065300+0000","last_peered":"2024-09-12T00:06:42.065300+0000","last_clean":"2024-09-12T00:06:42.065300+0000","last_became_active":"2024-09-12T00:03:31.353407+0000","last_became_peered":"2024-09-12T00:03:31.353407+0000","last_unstale":"2024-09-12T00:06:42.065300+0000","last_undegraded":"2024-09-12T00:06:42.065300+0000","last_fullsized":"2024-09-12T00:06:42.065300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:30.520217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"93'7","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723759+0000","last_change":"2024-09-12T00:03:33.385373+0000","last_active":"2024-09-12T00:06:42.723759+0000","last_peered":"2024-09-12T00:06:42.723759+0000","last_clean":"2024-09-12T00:06:42.723759+0000","last_became_active":"2024-09-12T00:03:33.384559+0000","last_became_peered":"2024-09-12T00:03:33.384559+0000","last_unstale":"2024-09-12T00:06:42.723759+0000","last_undegraded":"2024-09-12T00:06:42.723759+0000","last_fullsized":"2024-09-12T00:06:42.723759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:55.924174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815429+0000","last_change":"2024-09-12T00:03:25.326677+0000","last_active":"2024-09-12T00:06:41.815429+0000","last_peered":"2024-09-12T00:06:41.815429+0000","last_clean":"2024-09-12T00:06:41.815429+0000","last_became_active":"2024-09-12T00:03:25.325840+0000","last_became_peered":"2024-09-12T00:03:25.325840+0000","last_unstale":"2024-09-12T00:06:41.815429+0000","last_undegraded":"2024-09-12T00:06:41.815429+0000","last_fullsized":"2024-09-12T00:06:41.815429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:07.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"95'22","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720457+0000","last_change":"2024-09-12T00:03:23.616943+0000","last_active":"2024-09-12T00:06:42.720457+0000","last_peered":"2024-09-12T00:06:42.720457+0000","last_clean":"2024-09-12T00:06:42.720457+0000","last_became_active":"2024-09-12T00:03:23.616200+0000","last_became_peered":"2024-09-12T00:03:23.616200+0000","last_unstale":"2024-09-12T00:06:42.720457+0000","last_undegraded":"2024-09-12T00:06:42.720457+0000","last_fullsized":"2024-09-12T00:06:42.720457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722289+0000","last_change":"2024-09-12T00:03:27.330506+0000","last_active":"2024-09-12T00:06:42.722289+0000","last_peered":"2024-09-12T00:06:42.722289+0000","last_clean":"2024-09-12T00:06:42.722289+0000","last_became_active":"2024-09-12T00:03:27.329830+0000","last_became_peered":"2024-09-12T00:03:27.329830+0000","last_unstale":"2024-09-12T00:06:42.722289+0000","last_undegraded":"2024-09-12T00:06:42.722289+0000","last_fullsized":"2024-09-12T00:06:42.722289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:03.446090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"96'25","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501739+0000","last_change":"2024-09-12T00:03:29.343655+0000","last_active":"2024-09-12T00:06:42.501739+0000","last_peered":"2024-09-12T00:06:42.501739+0000","last_clean":"2024-09-12T00:06:42.501739+0000","last_became_active":"2024-09-12T00:03:29.343178+0000","last_became_peered":"2024-09-12T00:03:29.343178+0000","last_unstale":"2024-09-12T00:06:42.501739+0000","last_undegraded":"2024-09-12T00:06:42.501739+0000","last_fullsized":"2024-09-12T00:06:42.501739+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723516+0000","last_change":"2024-09-12T00:03:31.358077+0000","last_active":"2024-09-12T00:06:42.723516+0000","last_peered":"2024-09-12T00:06:42.723516+0000","last_clean":"2024-09-12T00:06:42.723516+0000","last_became_active":"2024-09-12T00:03:31.357272+0000","last_became_peered":"2024-09-12T00:03:31.357272+0000","last_unstale":"2024-09-12T00:06:42.723516+0000","last_undegraded":"2024-09-12T00:06:42.723516+0000","last_fullsized":"2024-09-12T00:06:42.723516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:37.991682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"76'4","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065822+0000","last_change":"2024-09-12T00:06:26.690241+0000","last_active":"2024-09-12T00:06:42.065822+0000","last_peered":"2024-09-12T00:06:42.065822+0000","last_clean":"2024-09-12T00:06:42.065822+0000","last_became_active":"2024-09-12T00:06:26.653908+0000","last_became_peered":"2024-09-12T00:06:26.653908+0000","last_unstale":"2024-09-12T00:06:42.065822+0000","last_undegraded":"2024-09-12T00:06:42.065822+0000","last_fullsized":"2024-09-12T00:06:42.065822+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:12.338436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"76'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721025+0000","last_change":"2024-09-12T00:06:32.433900+0000","last_active":"2024-09-12T00:06:42.721025+0000","last_peered":"2024-09-12T00:06:42.721025+0000","last_clean":"2024-09-12T00:06:42.721025+0000","last_became_active":"2024-09-12T00:06:26.675405+0000","last_became_peered":"2024-09-12T00:06:26.675405+0000","last_unstale":"2024-09-12T00:06:42.721025+0000","last_undegraded":"2024-09-12T00:06:42.721025+0000","last_fullsized":"2024-09-12T00:06:42.721025+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:53.098500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"96'21","reported_seq":85,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721420+0000","last_change":"2024-09-12T00:06:32.375501+0000","last_active":"2024-09-12T00:06:42.721420+0000","last_peered":"2024-09-12T00:06:42.721420+0000","last_clean":"2024-09-12T00:06:42.721420+0000","last_became_active":"2024-09-12T00:06:26.663178+0000","last_became_peered":"2024-09-12T00:06:26.663178+0000","last_unstale":"2024-09-12T00:06:42.721420+0000","last_undegraded":"2024-09-12T00:06:42.721420+0000","last_fullsized":"2024-09-12T00:06:42.721420+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:27.738037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":138412032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065958+0000","last_change":"2024-09-12T00:03:27.342295+0000","last_active":"2024-09-12T00:06:42.065958+0000","last_peered":"2024-09-12T00:06:42.065958+0000","last_clean":"2024-09-12T00:06:42.065958+0000","last_became_active":"2024-09-12T00:03:27.341619+0000","last_became_peered":"2024-09-12T00:03:27.341619+0000","last_unstale":"2024-09-12T00:06:42.065958+0000","last_undegraded":"2024-09-12T00:06:42.065958+0000","last_fullsized":"2024-09-12T00:06:42.065958+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:00.908798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"96'23","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066215+0000","last_change":"2024-09-12T00:03:29.336391+0000","last_active":"2024-09-12T00:06:42.066215+0000","last_peered":"2024-09-12T00:06:42.066215+0000","last_clean":"2024-09-12T00:06:42.066215+0000","last_became_active":"2024-09-12T00:03:29.335679+0000","last_became_peered":"2024-09-12T00:03:29.335679+0000","last_unstale":"2024-09-12T00:06:42.066215+0000","last_undegraded":"2024-09-12T00:06:42.066215+0000","last_fullsized":"2024-09-12T00:06:42.066215+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:58.540539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"96'134","reported_seq":395,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723048+0000","last_change":"2024-09-12T00:03:31.351170+0000","last_active":"2024-09-12T00:06:42.723048+0000","last_peered":"2024-09-12T00:06:42.723048+0000","last_clean":"2024-09-12T00:06:42.723048+0000","last_became_active":"2024-09-12T00:03:31.350264+0000","last_became_peered":"2024-09-12T00:03:31.350264+0000","last_unstale":"2024-09-12T00:06:42.723048+0000","last_undegraded":"2024-09-12T00:06:42.723048+0000","last_fullsized":"2024-09-12T00:06:42.723048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:51.368815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"59'3","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719548+0000","last_change":"2024-09-12T00:03:33.368236+0000","last_active":"2024-09-12T00:06:42.719548+0000","last_peered":"2024-09-12T00:06:42.719548+0000","last_clean":"2024-09-12T00:06:42.719548+0000","last_became_active":"2024-09-12T00:03:33.367424+0000","last_became_peered":"2024-09-12T00:03:33.367424+0000","last_unstale":"2024-09-12T00:06:42.719548+0000","last_undegraded":"2024-09-12T00:06:42.719548+0000","last_fullsized":"2024-09-12T00:06:42.719548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"76'6","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813109+0000","last_change":"2024-09-12T00:06:28.869705+0000","last_active":"2024-09-12T00:06:41.813109+0000","last_peered":"2024-09-12T00:06:41.813109+0000","last_clean":"2024-09-12T00:06:41.813109+0000","last_became_active":"2024-09-12T00:06:26.671547+0000","last_became_peered":"2024-09-12T00:06:26.671547+0000","last_unstale":"2024-09-12T00:06:41.813109+0000","last_undegraded":"2024-09-12T00:06:41.813109+0000","last_fullsized":"2024-09-12T00:06:41.813109+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:55.946290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"96'22","reported_seq":87,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721098+0000","last_change":"2024-09-12T00:06:27.817806+0000","last_active":"2024-09-12T00:06:42.721098+0000","last_peered":"2024-09-12T00:06:42.721098+0000","last_clean":"2024-09-12T00:06:42.721098+0000","last_became_active":"2024-09-12T00:06:26.654104+0000","last_became_peered":"2024-09-12T00:06:26.654104+0000","last_unstale":"2024-09-12T00:06:42.721098+0000","last_undegraded":"2024-09-12T00:06:42.721098+0000","last_fullsized":"2024-09-12T00:06:42.721098+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:30.461829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":368,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501711+0000","last_change":"2024-09-12T00:03:27.331569+0000","last_active":"2024-09-12T00:06:42.501711+0000","last_peered":"2024-09-12T00:06:42.501711+0000","last_clean":"2024-09-12T00:06:42.501711+0000","last_became_active":"2024-09-12T00:03:27.330909+0000","last_became_peered":"2024-09-12T00:03:27.330909+0000","last_unstale":"2024-09-12T00:06:42.501711+0000","last_undegraded":"2024-09-12T00:06:42.501711+0000","last_fullsized":"2024-09-12T00:06:42.501711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"59'11","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720583+0000","last_change":"2024-09-12T00:03:29.338880+0000","last_active":"2024-09-12T00:06:42.720583+0000","last_peered":"2024-09-12T00:06:42.720583+0000","last_clean":"2024-09-12T00:06:42.720583+0000","last_became_active":"2024-09-12T00:03:29.338110+0000","last_became_peered":"2024-09-12T00:03:29.338110+0000","last_unstale":"2024-09-12T00:06:42.720583+0000","last_undegraded":"2024-09-12T00:06:42.720583+0000","last_fullsized":"2024-09-12T00:06:42.720583+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.054460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"96'134","reported_seq":401,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501292+0000","last_change":"2024-09-12T00:03:31.339117+0000","last_active":"2024-09-12T00:06:42.501292+0000","last_peered":"2024-09-12T00:06:42.501292+0000","last_clean":"2024-09-12T00:06:42.501292+0000","last_became_active":"2024-09-12T00:03:31.338426+0000","last_became_peered":"2024-09-12T00:03:31.338426+0000","last_unstale":"2024-09-12T00:06:42.501292+0000","last_undegraded":"2024-09-12T00:06:42.501292+0000","last_fullsized":"2024-09-12T00:06:42.501292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:19.304169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811106+0000","last_change":"2024-09-12T00:03:33.385051+0000","last_active":"2024-09-12T00:06:41.811106+0000","last_peered":"2024-09-12T00:06:41.811106+0000","last_clean":"2024-09-12T00:06:41.811106+0000","last_became_active":"2024-09-12T00:03:33.380088+0000","last_became_peered":"2024-09-12T00:03:33.380088+0000","last_unstale":"2024-09-12T00:06:41.811106+0000","last_undegraded":"2024-09-12T00:06:41.811106+0000","last_fullsized":"2024-09-12T00:06:41.811106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:02.972871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.724550+0000","last_change":"2024-09-12T00:03:25.336113+0000","last_active":"2024-09-12T00:06:42.724550+0000","last_peered":"2024-09-12T00:06:42.724550+0000","last_clean":"2024-09-12T00:06:42.724550+0000","last_became_active":"2024-09-12T00:03:25.335449+0000","last_became_peered":"2024-09-12T00:03:25.335449+0000","last_unstale":"2024-09-12T00:06:42.724550+0000","last_undegraded":"2024-09-12T00:06:42.724550+0000","last_fullsized":"2024-09-12T00:06:42.724550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:34.277614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"96'24","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811100+0000","last_change":"2024-09-12T00:03:23.619285+0000","last_active":"2024-09-12T00:06:41.811100+0000","last_peered":"2024-09-12T00:06:41.811100+0000","last_clean":"2024-09-12T00:06:41.811100+0000","last_became_active":"2024-09-12T00:03:23.614187+0000","last_became_peered":"2024-09-12T00:03:23.614187+0000","last_unstale":"2024-09-12T00:06:41.811100+0000","last_undegraded":"2024-09-12T00:06:41.811100+0000","last_fullsized":"2024-09-12T00:06:41.811100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720307+0000","last_change":"2024-09-12T00:06:26.673924+0000","last_active":"2024-09-12T00:06:42.720307+0000","last_peered":"2024-09-12T00:06:42.720307+0000","last_clean":"2024-09-12T00:06:42.720307+0000","last_became_active":"2024-09-12T00:06:26.670945+0000","last_became_peered":"2024-09-12T00:06:26.670945+0000","last_unstale":"2024-09-12T00:06:42.720307+0000","last_undegraded":"2024-09-12T00:06:42.720307+0000","last_fullsized":"2024-09-12T00:06:42.720307+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:56.956200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"96'25","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500794+0000","last_change":"2024-09-12T00:03:29.345719+0000","last_active":"2024-09-12T00:06:42.500794+0000","last_peered":"2024-09-12T00:06:42.500794+0000","last_clean":"2024-09-12T00:06:42.500794+0000","last_became_active":"2024-09-12T00:03:29.345243+0000","last_became_peered":"2024-09-12T00:03:29.345243+0000","last_unstale":"2024-09-12T00:06:42.500794+0000","last_undegraded":"2024-09-12T00:06:42.500794+0000","last_fullsized":"2024-09-12T00:06:42.500794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:41.153263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812258+0000","last_change":"2024-09-12T00:03:31.360630+0000","last_active":"2024-09-12T00:06:41.812258+0000","last_peered":"2024-09-12T00:06:41.812258+0000","last_clean":"2024-09-12T00:06:41.812258+0000","last_became_active":"2024-09-12T00:03:31.359763+0000","last_became_peered":"2024-09-12T00:03:31.359763+0000","last_unstale":"2024-09-12T00:06:41.812258+0000","last_undegraded":"2024-09-12T00:06:41.812258+0000","last_fullsized":"2024-09-12T00:06:41.812258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"84'6","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719339+0000","last_change":"2024-09-12T00:03:33.372178+0000","last_active":"2024-09-12T00:06:42.719339+0000","last_peered":"2024-09-12T00:06:42.719339+0000","last_clean":"2024-09-12T00:06:42.719339+0000","last_became_active":"2024-09-12T00:03:33.370562+0000","last_became_peered":"2024-09-12T00:03:33.370562+0000","last_unstale":"2024-09-12T00:06:42.719339+0000","last_undegraded":"2024-09-12T00:06:42.719339+0000","last_fullsized":"2024-09-12T00:06:42.719339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:31.888153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'10","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720452+0000","last_change":"2024-09-12T00:06:32.425494+0000","last_active":"2024-09-12T00:06:42.720452+0000","last_peered":"2024-09-12T00:06:42.720452+0000","last_clean":"2024-09-12T00:06:42.720452+0000","last_became_active":"2024-09-12T00:06:26.674937+0000","last_became_peered":"2024-09-12T00:06:26.674937+0000","last_unstale":"2024-09-12T00:06:42.720452+0000","last_undegraded":"2024-09-12T00:06:42.720452+0000","last_fullsized":"2024-09-12T00:06:42.720452+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:09.992203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":300,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499047+0000","last_change":"2024-09-12T00:03:11.770141+0000","last_active":"2024-09-12T00:06:42.499047+0000","last_peered":"2024-09-12T00:06:42.499047+0000","last_clean":"2024-09-12T00:06:42.499047+0000","last_became_active":"2024-09-12T00:03:11.767988+0000","last_became_peered":"2024-09-12T00:03:11.767988+0000","last_unstale":"2024-09-12T00:06:42.499047+0000","last_undegraded":"2024-09-12T00:06:42.499047+0000","last_fullsized":"2024-09-12T00:06:42.499047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_clean_scrub_stamp":"2024-09-12T00:03:10.462069+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:26.289955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717386+0000","last_change":"2024-09-12T00:06:28.888645+0000","last_active":"2024-09-12T00:06:42.717386+0000","last_peered":"2024-09-12T00:06:42.717386+0000","last_clean":"2024-09-12T00:06:42.717386+0000","last_became_active":"2024-09-12T00:06:26.671587+0000","last_became_peered":"2024-09-12T00:06:26.671587+0000","last_unstale":"2024-09-12T00:06:42.717386+0000","last_undegraded":"2024-09-12T00:06:42.717386+0000","last_fullsized":"2024-09-12T00:06:42.717386+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:03.325846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"95'24","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811486+0000","last_change":"2024-09-12T00:03:23.621849+0000","last_active":"2024-09-12T00:06:41.811486+0000","last_peered":"2024-09-12T00:06:41.811486+0000","last_clean":"2024-09-12T00:06:41.811486+0000","last_became_active":"2024-09-12T00:03:23.621146+0000","last_became_peered":"2024-09-12T00:03:23.621146+0000","last_unstale":"2024-09-12T00:06:41.811486+0000","last_undegraded":"2024-09-12T00:06:41.811486+0000","last_fullsized":"2024-09-12T00:06:41.811486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:38.426691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809414+0000","last_change":"2024-09-12T00:03:27.316175+0000","last_active":"2024-09-12T00:06:41.809414+0000","last_peered":"2024-09-12T00:06:41.809414+0000","last_clean":"2024-09-12T00:06:41.809414+0000","last_became_active":"2024-09-12T00:03:27.315502+0000","last_became_peered":"2024-09-12T00:03:27.315502+0000","last_unstale":"2024-09-12T00:06:41.809414+0000","last_undegraded":"2024-09-12T00:06:41.809414+0000","last_fullsized":"2024-09-12T00:06:41.809414+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:21.448686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"96'44","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720067+0000","last_change":"2024-09-12T00:06:28.900645+0000","last_active":"2024-09-12T00:06:42.720067+0000","last_peered":"2024-09-12T00:06:42.720067+0000","last_clean":"2024-09-12T00:06:42.720067+0000","last_became_active":"2024-09-12T00:06:26.667623+0000","last_became_peered":"2024-09-12T00:06:26.667623+0000","last_unstale":"2024-09-12T00:06:42.720067+0000","last_undegraded":"2024-09-12T00:06:42.720067+0000","last_fullsized":"2024-09-12T00:06:42.720067+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:36.584753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":38,"num_read_kb":26,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066468+0000","last_change":"2024-09-12T00:03:31.361408+0000","last_active":"2024-09-12T00:06:42.066468+0000","last_peered":"2024-09-12T00:06:42.066468+0000","last_clean":"2024-09-12T00:06:42.066468+0000","last_became_active":"2024-09-12T00:03:31.360462+0000","last_became_peered":"2024-09-12T00:03:31.360462+0000","last_unstale":"2024-09-12T00:06:42.066468+0000","last_undegraded":"2024-09-12T00:06:42.066468+0000","last_fullsized":"2024-09-12T00:06:42.066468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:58.407571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"59'4","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812851+0000","last_change":"2024-09-12T00:03:33.388253+0000","last_active":"2024-09-12T00:06:41.812851+0000","last_peered":"2024-09-12T00:06:41.812851+0000","last_clean":"2024-09-12T00:06:41.812851+0000","last_became_active":"2024-09-12T00:03:33.387457+0000","last_became_peered":"2024-09-12T00:03:33.387457+0000","last_unstale":"2024-09-12T00:06:41.812851+0000","last_undegraded":"2024-09-12T00:06:41.812851+0000","last_fullsized":"2024-09-12T00:06:41.812851+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:46.021740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066818+0000","last_change":"2024-09-12T00:03:25.357970+0000","last_active":"2024-09-12T00:06:42.066818+0000","last_peered":"2024-09-12T00:06:42.066818+0000","last_clean":"2024-09-12T00:06:42.066818+0000","last_became_active":"2024-09-12T00:03:25.355306+0000","last_became_peered":"2024-09-12T00:03:25.355306+0000","last_unstale":"2024-09-12T00:06:42.066818+0000","last_undegraded":"2024-09-12T00:06:42.066818+0000","last_fullsized":"2024-09-12T00:06:42.066818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:17.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717548+0000","last_change":"2024-09-12T00:06:26.654149+0000","last_active":"2024-09-12T00:06:42.717548+0000","last_peered":"2024-09-12T00:06:42.717548+0000","last_clean":"2024-09-12T00:06:42.717548+0000","last_became_active":"2024-09-12T00:06:26.653574+0000","last_became_peered":"2024-09-12T00:06:26.653574+0000","last_unstale":"2024-09-12T00:06:42.717548+0000","last_undegraded":"2024-09-12T00:06:42.717548+0000","last_fullsized":"2024-09-12T00:06:42.717548+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:55.656413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"96'28","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720943+0000","last_change":"2024-09-12T00:03:23.622111+0000","last_active":"2024-09-12T00:06:42.720943+0000","last_peered":"2024-09-12T00:06:42.720943+0000","last_clean":"2024-09-12T00:06:42.720943+0000","last_became_active":"2024-09-12T00:03:23.621358+0000","last_became_peered":"2024-09-12T00:03:23.621358+0000","last_unstale":"2024-09-12T00:06:42.720943+0000","last_undegraded":"2024-09-12T00:06:42.720943+0000","last_fullsized":"2024-09-12T00:06:42.720943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:02.202230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722205+0000","last_change":"2024-09-12T00:06:26.659401+0000","last_active":"2024-09-12T00:06:42.722205+0000","last_peered":"2024-09-12T00:06:42.722205+0000","last_clean":"2024-09-12T00:06:42.722205+0000","last_became_active":"2024-09-12T00:06:26.657376+0000","last_became_peered":"2024-09-12T00:06:26.657376+0000","last_unstale":"2024-09-12T00:06:42.722205+0000","last_undegraded":"2024-09-12T00:06:42.722205+0000","last_fullsized":"2024-09-12T00:06:42.722205+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:27.337831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"96'141","reported_seq":429,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721183+0000","last_change":"2024-09-12T00:03:29.346819+0000","last_active":"2024-09-12T00:06:42.721183+0000","last_peered":"2024-09-12T00:06:42.721183+0000","last_clean":"2024-09-12T00:06:42.721183+0000","last_became_active":"2024-09-12T00:03:29.346101+0000","last_became_peered":"2024-09-12T00:03:29.346101+0000","last_unstale":"2024-09-12T00:06:42.721183+0000","last_undegraded":"2024-09-12T00:06:42.721183+0000","last_fullsized":"2024-09-12T00:06:42.721183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:27.268327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":183,"num_read_kb":167,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721121+0000","last_change":"2024-09-12T00:06:26.679841+0000","last_active":"2024-09-12T00:06:42.721121+0000","last_peered":"2024-09-12T00:06:42.721121+0000","last_clean":"2024-09-12T00:06:42.721121+0000","last_became_active":"2024-09-12T00:06:26.675966+0000","last_became_peered":"2024-09-12T00:06:26.675966+0000","last_unstale":"2024-09-12T00:06:42.721121+0000","last_undegraded":"2024-09-12T00:06:42.721121+0000","last_fullsized":"2024-09-12T00:06:42.721121+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:39.439184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064787+0000","last_change":"2024-09-12T00:03:33.386144+0000","last_active":"2024-09-12T00:06:42.064787+0000","last_peered":"2024-09-12T00:06:42.064787+0000","last_clean":"2024-09-12T00:06:42.064787+0000","last_became_active":"2024-09-12T00:03:33.384951+0000","last_became_peered":"2024-09-12T00:03:33.384951+0000","last_unstale":"2024-09-12T00:06:42.064787+0000","last_undegraded":"2024-09-12T00:06:42.064787+0000","last_fullsized":"2024-09-12T00:06:42.064787+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:49.807501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"59'2","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720659+0000","last_change":"2024-09-12T00:03:25.332801+0000","last_active":"2024-09-12T00:06:42.720659+0000","last_peered":"2024-09-12T00:06:42.720659+0000","last_clean":"2024-09-12T00:06:42.720659+0000","last_became_active":"2024-09-12T00:03:25.331652+0000","last_became_peered":"2024-09-12T00:03:25.331652+0000","last_unstale":"2024-09-12T00:06:42.720659+0000","last_undegraded":"2024-09-12T00:06:42.720659+0000","last_fullsized":"2024-09-12T00:06:42.720659+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718983+0000","last_change":"2024-09-12T00:03:18.892423+0000","last_active":"2024-09-12T00:06:42.718983+0000","last_peered":"2024-09-12T00:06:42.718983+0000","last_clean":"2024-09-12T00:06:42.718983+0000","last_became_active":"2024-09-12T00:03:16.559698+0000","last_became_peered":"2024-09-12T00:03:16.559698+0000","last_unstale":"2024-09-12T00:06:42.718983+0000","last_undegraded":"2024-09-12T00:06:42.718983+0000","last_fullsized":"2024-09-12T00:06:42.718983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:21.453461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082440599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"95'22","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064436+0000","last_change":"2024-09-12T00:03:23.633606+0000","last_active":"2024-09-12T00:06:42.064436+0000","last_peered":"2024-09-12T00:06:42.064436+0000","last_clean":"2024-09-12T00:06:42.064436+0000","last_became_active":"2024-09-12T00:03:23.632795+0000","last_became_peered":"2024-09-12T00:03:23.632795+0000","last_unstale":"2024-09-12T00:06:42.064436+0000","last_undegraded":"2024-09-12T00:06:42.064436+0000","last_fullsized":"2024-09-12T00:06:42.064436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:08.214455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90177536,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723278+0000","last_change":"2024-09-12T00:03:27.326932+0000","last_active":"2024-09-12T00:06:42.723278+0000","last_peered":"2024-09-12T00:06:42.723278+0000","last_clean":"2024-09-12T00:06:42.723278+0000","last_became_active":"2024-09-12T00:03:27.326173+0000","last_became_peered":"2024-09-12T00:03:27.326173+0000","last_unstale":"2024-09-12T00:06:42.723278+0000","last_undegraded":"2024-09-12T00:06:42.723278+0000","last_fullsized":"2024-09-12T00:06:42.723278+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:12.286539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"58'16","reported_seq":245,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815957+0000","last_change":"2024-09-12T00:03:29.338829+0000","last_active":"2024-09-12T00:06:41.815957+0000","last_peered":"2024-09-12T00:06:41.815957+0000","last_clean":"2024-09-12T00:06:41.815957+0000","last_became_active":"2024-09-12T00:03:29.337364+0000","last_became_peered":"2024-09-12T00:03:29.337364+0000","last_unstale":"2024-09-12T00:06:41.815957+0000","last_undegraded":"2024-09-12T00:06:41.815957+0000","last_fullsized":"2024-09-12T00:06:41.815957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:01.584359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812645+0000","last_change":"2024-09-12T00:06:26.655001+0000","last_active":"2024-09-12T00:06:41.812645+0000","last_peered":"2024-09-12T00:06:41.812645+0000","last_clean":"2024-09-12T00:06:41.812645+0000","last_became_active":"2024-09-12T00:06:26.654068+0000","last_became_peered":"2024-09-12T00:06:26.654068+0000","last_unstale":"2024-09-12T00:06:41.812645+0000","last_undegraded":"2024-09-12T00:06:41.812645+0000","last_fullsized":"2024-09-12T00:06:41.812645+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:50.133218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810544+0000","last_change":"2024-09-12T00:03:33.354171+0000","last_active":"2024-09-12T00:06:41.810544+0000","last_peered":"2024-09-12T00:06:41.810544+0000","last_clean":"2024-09-12T00:06:41.810544+0000","last_became_active":"2024-09-12T00:03:33.353460+0000","last_became_peered":"2024-09-12T00:03:33.353460+0000","last_unstale":"2024-09-12T00:06:41.810544+0000","last_undegraded":"2024-09-12T00:06:41.810544+0000","last_fullsized":"2024-09-12T00:06:41.810544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:34.356970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"84'8","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721257+0000","last_change":"2024-09-12T00:03:25.336320+0000","last_active":"2024-09-12T00:06:42.721257+0000","last_peered":"2024-09-12T00:06:42.721257+0000","last_clean":"2024-09-12T00:06:42.721257+0000","last_became_active":"2024-09-12T00:03:25.333449+0000","last_became_peered":"2024-09-12T00:03:25.333449+0000","last_unstale":"2024-09-12T00:06:42.721257+0000","last_undegraded":"2024-09-12T00:06:42.721257+0000","last_fullsized":"2024-09-12T00:06:42.721257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722390+0000","last_change":"2024-09-12T00:06:32.408232+0000","last_active":"2024-09-12T00:06:42.722390+0000","last_peered":"2024-09-12T00:06:42.722390+0000","last_clean":"2024-09-12T00:06:42.722390+0000","last_became_active":"2024-09-12T00:06:26.677047+0000","last_became_peered":"2024-09-12T00:06:26.677047+0000","last_unstale":"2024-09-12T00:06:42.722390+0000","last_undegraded":"2024-09-12T00:06:42.722390+0000","last_fullsized":"2024-09-12T00:06:42.722390+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:52.555478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"96'21","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810342+0000","last_change":"2024-09-12T00:03:23.611064+0000","last_active":"2024-09-12T00:06:41.810342+0000","last_peered":"2024-09-12T00:06:41.810342+0000","last_clean":"2024-09-12T00:06:41.810342+0000","last_became_active":"2024-09-12T00:03:23.610612+0000","last_became_peered":"2024-09-12T00:03:23.610612+0000","last_unstale":"2024-09-12T00:06:41.810342+0000","last_undegraded":"2024-09-12T00:06:41.810342+0000","last_fullsized":"2024-09-12T00:06:41.810342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:04.201688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722466+0000","last_change":"2024-09-12T00:03:27.339197+0000","last_active":"2024-09-12T00:06:42.722466+0000","last_peered":"2024-09-12T00:06:42.722466+0000","last_clean":"2024-09-12T00:06:42.722466+0000","last_became_active":"2024-09-12T00:03:27.338508+0000","last_became_peered":"2024-09-12T00:03:27.338508+0000","last_unstale":"2024-09-12T00:06:42.722466+0000","last_undegraded":"2024-09-12T00:06:42.722466+0000","last_fullsized":"2024-09-12T00:06:42.722466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:08.306289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066551+0000","last_change":"2024-09-12T00:06:28.890041+0000","last_active":"2024-09-12T00:06:42.066551+0000","last_peered":"2024-09-12T00:06:42.066551+0000","last_clean":"2024-09-12T00:06:42.066551+0000","last_became_active":"2024-09-12T00:06:26.682354+0000","last_became_peered":"2024-09-12T00:06:26.682354+0000","last_unstale":"2024-09-12T00:06:42.066551+0000","last_undegraded":"2024-09-12T00:06:42.066551+0000","last_fullsized":"2024-09-12T00:06:42.066551+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:42.484131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722102+0000","last_change":"2024-09-12T00:06:26.675142+0000","last_active":"2024-09-12T00:06:42.722102+0000","last_peered":"2024-09-12T00:06:42.722102+0000","last_clean":"2024-09-12T00:06:42.722102+0000","last_became_active":"2024-09-12T00:06:26.669787+0000","last_became_peered":"2024-09-12T00:06:26.669787+0000","last_unstale":"2024-09-12T00:06:42.722102+0000","last_undegraded":"2024-09-12T00:06:42.722102+0000","last_fullsized":"2024-09-12T00:06:42.722102+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:34.635508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"63'7","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500245+0000","last_change":"2024-09-12T00:03:33.367035+0000","last_active":"2024-09-12T00:06:42.500245+0000","last_peered":"2024-09-12T00:06:42.500245+0000","last_clean":"2024-09-12T00:06:42.500245+0000","last_became_active":"2024-09-12T00:03:33.366311+0000","last_became_peered":"2024-09-12T00:03:33.366311+0000","last_unstale":"2024-09-12T00:06:42.500245+0000","last_undegraded":"2024-09-12T00:06:42.500245+0000","last_fullsized":"2024-09-12T00:06:42.500245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"96'8","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722537+0000","last_change":"2024-09-12T00:06:28.313486+0000","last_active":"2024-09-12T00:06:42.722537+0000","last_peered":"2024-09-12T00:06:42.722537+0000","last_clean":"2024-09-12T00:06:42.722537+0000","last_became_active":"2024-09-12T00:06:26.675442+0000","last_became_peered":"2024-09-12T00:06:26.675442+0000","last_unstale":"2024-09-12T00:06:42.722537+0000","last_undegraded":"2024-09-12T00:06:42.722537+0000","last_fullsized":"2024-09-12T00:06:42.722537+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:37.245286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"96'19","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812844+0000","last_change":"2024-09-12T00:03:23.619024+0000","last_active":"2024-09-12T00:06:41.812844+0000","last_peered":"2024-09-12T00:06:41.812844+0000","last_clean":"2024-09-12T00:06:41.812844+0000","last_became_active":"2024-09-12T00:03:23.618716+0000","last_became_peered":"2024-09-12T00:03:23.618716+0000","last_unstale":"2024-09-12T00:06:41.812844+0000","last_undegraded":"2024-09-12T00:06:41.812844+0000","last_fullsized":"2024-09-12T00:06:41.812844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067307+0000","last_change":"2024-09-12T00:03:18.562010+0000","last_active":"2024-09-12T00:06:42.067307+0000","last_peered":"2024-09-12T00:06:42.067307+0000","last_clean":"2024-09-12T00:06:42.067307+0000","last_became_active":"2024-09-12T00:03:16.561218+0000","last_became_peered":"2024-09-12T00:03:16.561218+0000","last_unstale":"2024-09-12T00:06:42.067307+0000","last_undegraded":"2024-09-12T00:06:42.067307+0000","last_fullsized":"2024-09-12T00:06:42.067307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:43.089686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084170299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811828+0000","last_change":"2024-09-12T00:03:27.341079+0000","last_active":"2024-09-12T00:06:41.811828+0000","last_peered":"2024-09-12T00:06:41.811828+0000","last_clean":"2024-09-12T00:06:41.811828+0000","last_became_active":"2024-09-12T00:03:27.340391+0000","last_became_peered":"2024-09-12T00:03:27.340391+0000","last_unstale":"2024-09-12T00:06:41.811828+0000","last_undegraded":"2024-09-12T00:06:41.811828+0000","last_fullsized":"2024-09-12T00:06:41.811828+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:10.048469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"96'49","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718472+0000","last_change":"2024-09-12T00:03:29.346823+0000","last_active":"2024-09-12T00:06:42.718472+0000","last_peered":"2024-09-12T00:06:42.718472+0000","last_clean":"2024-09-12T00:06:42.718472+0000","last_became_active":"2024-09-12T00:03:29.346066+0000","last_became_peered":"2024-09-12T00:03:29.346066+0000","last_unstale":"2024-09-12T00:06:42.718472+0000","last_undegraded":"2024-09-12T00:06:42.718472+0000","last_fullsized":"2024-09-12T00:06:42.718472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:12.080794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124550,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":47,"num_write":38,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810366+0000","last_change":"2024-09-12T00:03:31.348574+0000","last_active":"2024-09-12T00:06:41.810366+0000","last_peered":"2024-09-12T00:06:41.810366+0000","last_clean":"2024-09-12T00:06:41.810366+0000","last_became_active":"2024-09-12T00:03:31.346511+0000","last_became_peered":"2024-09-12T00:03:31.346511+0000","last_unstale":"2024-09-12T00:06:41.810366+0000","last_undegraded":"2024-09-12T00:06:41.810366+0000","last_fullsized":"2024-09-12T00:06:41.810366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:14.061486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"59'7","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066233+0000","last_change":"2024-09-12T00:03:33.385232+0000","last_active":"2024-09-12T00:06:42.066233+0000","last_peered":"2024-09-12T00:06:42.066233+0000","last_clean":"2024-09-12T00:06:42.066233+0000","last_became_active":"2024-09-12T00:03:33.384457+0000","last_became_peered":"2024-09-12T00:03:33.384457+0000","last_unstale":"2024-09-12T00:06:42.066233+0000","last_undegraded":"2024-09-12T00:06:42.066233+0000","last_fullsized":"2024-09-12T00:06:42.066233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:34.615256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"76'4","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721962+0000","last_change":"2024-09-12T00:03:25.334767+0000","last_active":"2024-09-12T00:06:42.721962+0000","last_peered":"2024-09-12T00:06:42.721962+0000","last_clean":"2024-09-12T00:06:42.721962+0000","last_became_active":"2024-09-12T00:03:25.332814+0000","last_became_peered":"2024-09-12T00:03:25.332814+0000","last_unstale":"2024-09-12T00:06:42.721962+0000","last_undegraded":"2024-09-12T00:06:42.721962+0000","last_fullsized":"2024-09-12T00:06:42.721962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"95'27","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721814+0000","last_change":"2024-09-12T00:03:23.628752+0000","last_active":"2024-09-12T00:06:42.721814+0000","last_peered":"2024-09-12T00:06:42.721814+0000","last_clean":"2024-09-12T00:06:42.721814+0000","last_became_active":"2024-09-12T00:03:23.628128+0000","last_became_peered":"2024-09-12T00:03:23.628128+0000","last_unstale":"2024-09-12T00:06:42.721814+0000","last_undegraded":"2024-09-12T00:06:42.721814+0000","last_fullsized":"2024-09-12T00:06:42.721814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720543+0000","last_change":"2024-09-12T00:06:26.679199+0000","last_active":"2024-09-12T00:06:42.720543+0000","last_peered":"2024-09-12T00:06:42.720543+0000","last_clean":"2024-09-12T00:06:42.720543+0000","last_became_active":"2024-09-12T00:06:26.675309+0000","last_became_peered":"2024-09-12T00:06:26.675309+0000","last_unstale":"2024-09-12T00:06:42.720543+0000","last_undegraded":"2024-09-12T00:06:42.720543+0000","last_fullsized":"2024-09-12T00:06:42.720543+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:56.980194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814664+0000","last_change":"2024-09-12T00:03:27.316317+0000","last_active":"2024-09-12T00:06:41.814664+0000","last_peered":"2024-09-12T00:06:41.814664+0000","last_clean":"2024-09-12T00:06:41.814664+0000","last_became_active":"2024-09-12T00:03:27.315704+0000","last_became_peered":"2024-09-12T00:03:27.315704+0000","last_unstale":"2024-09-12T00:06:41.814664+0000","last_undegraded":"2024-09-12T00:06:41.814664+0000","last_fullsized":"2024-09-12T00:06:41.814664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:07.883485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'20","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720264+0000","last_change":"2024-09-12T00:06:26.708588+0000","last_active":"2024-09-12T00:06:42.720264+0000","last_peered":"2024-09-12T00:06:42.720264+0000","last_clean":"2024-09-12T00:06:42.720264+0000","last_became_active":"2024-09-12T00:06:26.661284+0000","last_became_peered":"2024-09-12T00:06:26.661284+0000","last_unstale":"2024-09-12T00:06:42.720264+0000","last_undegraded":"2024-09-12T00:06:42.720264+0000","last_fullsized":"2024-09-12T00:06:42.720264+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:19.418779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"96'134","reported_seq":353,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499929+0000","last_change":"2024-09-12T00:03:31.357011+0000","last_active":"2024-09-12T00:06:42.499929+0000","last_peered":"2024-09-12T00:06:42.499929+0000","last_clean":"2024-09-12T00:06:42.499929+0000","last_became_active":"2024-09-12T00:03:31.356108+0000","last_became_peered":"2024-09-12T00:03:31.356108+0000","last_unstale":"2024-09-12T00:06:42.499929+0000","last_undegraded":"2024-09-12T00:06:42.499929+0000","last_fullsized":"2024-09-12T00:06:42.499929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"58'2","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723235+0000","last_change":"2024-09-12T00:03:33.372465+0000","last_active":"2024-09-12T00:06:42.723235+0000","last_peered":"2024-09-12T00:06:42.723235+0000","last_clean":"2024-09-12T00:06:42.723235+0000","last_became_active":"2024-09-12T00:03:33.371214+0000","last_became_peered":"2024-09-12T00:03:33.371214+0000","last_unstale":"2024-09-12T00:06:42.723235+0000","last_undegraded":"2024-09-12T00:06:42.723235+0000","last_fullsized":"2024-09-12T00:06:42.723235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:40.880933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"84'8","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810903+0000","last_change":"2024-09-12T00:03:25.332405+0000","last_active":"2024-09-12T00:06:41.810903+0000","last_peered":"2024-09-12T00:06:41.810903+0000","last_clean":"2024-09-12T00:06:41.810903+0000","last_became_active":"2024-09-12T00:03:25.331250+0000","last_became_peered":"2024-09-12T00:03:25.331250+0000","last_unstale":"2024-09-12T00:06:41.810903+0000","last_undegraded":"2024-09-12T00:06:41.810903+0000","last_fullsized":"2024-09-12T00:06:41.810903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"96'23","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813862+0000","last_change":"2024-09-12T00:03:23.602222+0000","last_active":"2024-09-12T00:06:41.813862+0000","last_peered":"2024-09-12T00:06:41.813862+0000","last_clean":"2024-09-12T00:06:41.813862+0000","last_became_active":"2024-09-12T00:03:23.601481+0000","last_became_peered":"2024-09-12T00:03:23.601481+0000","last_unstale":"2024-09-12T00:06:41.813862+0000","last_undegraded":"2024-09-12T00:06:41.813862+0000","last_fullsized":"2024-09-12T00:06:41.813862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:56.636638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813711+0000","last_change":"2024-09-12T00:03:18.716648+0000","last_active":"2024-09-12T00:06:41.813711+0000","last_peered":"2024-09-12T00:06:41.813711+0000","last_clean":"2024-09-12T00:06:41.813711+0000","last_became_active":"2024-09-12T00:03:16.594609+0000","last_became_peered":"2024-09-12T00:03:16.594609+0000","last_unstale":"2024-09-12T00:06:41.813711+0000","last_undegraded":"2024-09-12T00:06:41.813711+0000","last_fullsized":"2024-09-12T00:06:41.813711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:34.635008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010254439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721880+0000","last_change":"2024-09-12T00:06:26.648329+0000","last_active":"2024-09-12T00:06:42.721880+0000","last_peered":"2024-09-12T00:06:42.721880+0000","last_clean":"2024-09-12T00:06:42.721880+0000","last_became_active":"2024-09-12T00:06:26.647055+0000","last_became_peered":"2024-09-12T00:06:26.647055+0000","last_unstale":"2024-09-12T00:06:42.721880+0000","last_undegraded":"2024-09-12T00:06:42.721880+0000","last_fullsized":"2024-09-12T00:06:42.721880+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:35.147693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"58'18","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720951+0000","last_change":"2024-09-12T00:06:30.110628+0000","last_active":"2024-09-12T00:06:42.720951+0000","last_peered":"2024-09-12T00:06:42.720951+0000","last_clean":"2024-09-12T00:06:42.720951+0000","last_became_active":"2024-09-12T00:06:26.662450+0000","last_became_peered":"2024-09-12T00:06:26.662450+0000","last_unstale":"2024-09-12T00:06:42.720951+0000","last_undegraded":"2024-09-12T00:06:42.720951+0000","last_fullsized":"2024-09-12T00:06:42.720951+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:10.820458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'134","reported_seq":350,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066242+0000","last_change":"2024-09-12T00:03:31.361616+0000","last_active":"2024-09-12T00:06:42.066242+0000","last_peered":"2024-09-12T00:06:42.066242+0000","last_clean":"2024-09-12T00:06:42.066242+0000","last_became_active":"2024-09-12T00:03:31.360518+0000","last_became_peered":"2024-09-12T00:03:31.360518+0000","last_unstale":"2024-09-12T00:06:42.066242+0000","last_undegraded":"2024-09-12T00:06:42.066242+0000","last_fullsized":"2024-09-12T00:06:42.066242+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:40.640537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065311+0000","last_change":"2024-09-12T00:03:33.378417+0000","last_active":"2024-09-12T00:06:42.065311+0000","last_peered":"2024-09-12T00:06:42.065311+0000","last_clean":"2024-09-12T00:06:42.065311+0000","last_became_active":"2024-09-12T00:03:33.377669+0000","last_became_peered":"2024-09-12T00:03:33.377669+0000","last_unstale":"2024-09-12T00:06:42.065311+0000","last_undegraded":"2024-09-12T00:06:42.065311+0000","last_fullsized":"2024-09-12T00:06:42.065311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:04.623906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811103+0000","last_change":"2024-09-12T00:06:26.714198+0000","last_active":"2024-09-12T00:06:41.811103+0000","last_peered":"2024-09-12T00:06:41.811103+0000","last_clean":"2024-09-12T00:06:41.811103+0000","last_became_active":"2024-09-12T00:06:26.662114+0000","last_became_peered":"2024-09-12T00:06:26.662114+0000","last_unstale":"2024-09-12T00:06:41.811103+0000","last_undegraded":"2024-09-12T00:06:41.811103+0000","last_fullsized":"2024-09-12T00:06:41.811103+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:41.029559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"96'24","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813511+0000","last_change":"2024-09-12T00:03:23.616319+0000","last_active":"2024-09-12T00:06:41.813511+0000","last_peered":"2024-09-12T00:06:41.813511+0000","last_clean":"2024-09-12T00:06:41.813511+0000","last_became_active":"2024-09-12T00:03:23.615158+0000","last_became_peered":"2024-09-12T00:03:23.615158+0000","last_unstale":"2024-09-12T00:06:41.813511+0000","last_undegraded":"2024-09-12T00:06:41.813511+0000","last_fullsized":"2024-09-12T00:06:41.813511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:15.677228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719839+0000","last_change":"2024-09-12T00:06:26.680801+0000","last_active":"2024-09-12T00:06:42.719839+0000","last_peered":"2024-09-12T00:06:42.719839+0000","last_clean":"2024-09-12T00:06:42.719839+0000","last_became_active":"2024-09-12T00:06:26.677544+0000","last_became_peered":"2024-09-12T00:06:26.677544+0000","last_unstale":"2024-09-12T00:06:42.719839+0000","last_undegraded":"2024-09-12T00:06:42.719839+0000","last_fullsized":"2024-09-12T00:06:42.719839+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:43.976666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810348+0000","last_change":"2024-09-12T00:03:27.337359+0000","last_active":"2024-09-12T00:06:41.810348+0000","last_peered":"2024-09-12T00:06:41.810348+0000","last_clean":"2024-09-12T00:06:41.810348+0000","last_became_active":"2024-09-12T00:03:27.336289+0000","last_became_peered":"2024-09-12T00:03:27.336289+0000","last_unstale":"2024-09-12T00:06:41.810348+0000","last_undegraded":"2024-09-12T00:06:41.810348+0000","last_fullsized":"2024-09-12T00:06:41.810348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:39.147272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"96'50","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809455+0000","last_change":"2024-09-12T00:03:29.344621+0000","last_active":"2024-09-12T00:06:41.809455+0000","last_peered":"2024-09-12T00:06:41.809455+0000","last_clean":"2024-09-12T00:06:41.809455+0000","last_became_active":"2024-09-12T00:03:29.343779+0000","last_became_peered":"2024-09-12T00:03:29.343779+0000","last_unstale":"2024-09-12T00:06:41.809455+0000","last_undegraded":"2024-09-12T00:06:41.809455+0000","last_fullsized":"2024-09-12T00:06:41.809455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:49.518432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811176+0000","last_change":"2024-09-12T00:03:31.335460+0000","last_active":"2024-09-12T00:06:41.811176+0000","last_peered":"2024-09-12T00:06:41.811176+0000","last_clean":"2024-09-12T00:06:41.811176+0000","last_became_active":"2024-09-12T00:03:31.334701+0000","last_became_peered":"2024-09-12T00:03:31.334701+0000","last_unstale":"2024-09-12T00:06:41.811176+0000","last_undegraded":"2024-09-12T00:06:41.811176+0000","last_fullsized":"2024-09-12T00:06:41.811176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:28.484366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"58'4","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812236+0000","last_change":"2024-09-12T00:03:33.386404+0000","last_active":"2024-09-12T00:06:41.812236+0000","last_peered":"2024-09-12T00:06:41.812236+0000","last_clean":"2024-09-12T00:06:41.812236+0000","last_became_active":"2024-09-12T00:03:33.385090+0000","last_became_peered":"2024-09-12T00:03:33.385090+0000","last_unstale":"2024-09-12T00:06:41.812236+0000","last_undegraded":"2024-09-12T00:06:41.812236+0000","last_fullsized":"2024-09-12T00:06:41.812236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"96'2","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813204+0000","last_change":"2024-09-12T00:03:33.361690+0000","last_active":"2024-09-12T00:06:41.813204+0000","last_peered":"2024-09-12T00:06:41.813204+0000","last_clean":"2024-09-12T00:06:41.813204+0000","last_became_active":"2024-09-12T00:03:33.360980+0000","last_became_peered":"2024-09-12T00:03:33.360980+0000","last_unstale":"2024-09-12T00:06:41.813204+0000","last_undegraded":"2024-09-12T00:06:41.813204+0000","last_fullsized":"2024-09-12T00:06:41.813204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:24.954577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"59'2","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813869+0000","last_change":"2024-09-12T00:06:28.274587+0000","last_active":"2024-09-12T00:06:41.813869+0000","last_peered":"2024-09-12T00:06:41.813869+0000","last_clean":"2024-09-12T00:06:41.813869+0000","last_became_active":"2024-09-12T00:06:26.664337+0000","last_became_peered":"2024-09-12T00:06:26.664337+0000","last_unstale":"2024-09-12T00:06:41.813869+0000","last_undegraded":"2024-09-12T00:06:41.813869+0000","last_fullsized":"2024-09-12T00:06:41.813869+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:00.552692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"95'30","reported_seq":103,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717433+0000","last_change":"2024-09-12T00:06:30.093257+0000","last_active":"2024-09-12T00:06:42.717433+0000","last_peered":"2024-09-12T00:06:42.717433+0000","last_clean":"2024-09-12T00:06:42.717433+0000","last_became_active":"2024-09-12T00:06:26.671623+0000","last_became_peered":"2024-09-12T00:06:26.671623+0000","last_unstale":"2024-09-12T00:06:42.717433+0000","last_undegraded":"2024-09-12T00:06:42.717433+0000","last_fullsized":"2024-09-12T00:06:42.717433+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:02.454592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":201326592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"28'2","reported_seq":367,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722728+0000","last_change":"2024-09-12T00:03:27.332281+0000","last_active":"2024-09-12T00:06:42.722728+0000","last_peered":"2024-09-12T00:06:42.722728+0000","last_clean":"2024-09-12T00:06:42.722728+0000","last_became_active":"2024-09-12T00:03:27.331527+0000","last_became_peered":"2024-09-12T00:03:27.331527+0000","last_unstale":"2024-09-12T00:06:42.722728+0000","last_undegraded":"2024-09-12T00:06:42.722728+0000","last_fullsized":"2024-09-12T00:06:42.722728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":266,"num_read_kb":266,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"96'25","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720005+0000","last_change":"2024-09-12T00:03:29.338655+0000","last_active":"2024-09-12T00:06:42.720005+0000","last_peered":"2024-09-12T00:06:42.720005+0000","last_clean":"2024-09-12T00:06:42.720005+0000","last_became_active":"2024-09-12T00:03:29.337905+0000","last_became_peered":"2024-09-12T00:03:29.337905+0000","last_unstale":"2024-09-12T00:06:42.720005+0000","last_undegraded":"2024-09-12T00:06:42.720005+0000","last_fullsized":"2024-09-12T00:06:42.720005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718441+0000","last_change":"2024-09-12T00:03:31.351716+0000","last_active":"2024-09-12T00:06:42.718441+0000","last_peered":"2024-09-12T00:06:42.718441+0000","last_clean":"2024-09-12T00:06:42.718441+0000","last_became_active":"2024-09-12T00:03:31.350917+0000","last_became_peered":"2024-09-12T00:03:31.350917+0000","last_unstale":"2024-09-12T00:06:42.718441+0000","last_undegraded":"2024-09-12T00:06:42.718441+0000","last_fullsized":"2024-09-12T00:06:42.718441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:45.880820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722942+0000","last_change":"2024-09-12T00:03:33.374233+0000","last_active":"2024-09-12T00:06:42.722942+0000","last_peered":"2024-09-12T00:06:42.722942+0000","last_clean":"2024-09-12T00:06:42.722942+0000","last_became_active":"2024-09-12T00:03:33.373466+0000","last_became_peered":"2024-09-12T00:03:33.373466+0000","last_unstale":"2024-09-12T00:06:42.722942+0000","last_undegraded":"2024-09-12T00:06:42.722942+0000","last_fullsized":"2024-09-12T00:06:42.722942+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:55.598892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"59'2","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811077+0000","last_change":"2024-09-12T00:06:28.295394+0000","last_active":"2024-09-12T00:06:41.811077+0000","last_peered":"2024-09-12T00:06:41.811077+0000","last_clean":"2024-09-12T00:06:41.811077+0000","last_became_active":"2024-09-12T00:06:26.664003+0000","last_became_peered":"2024-09-12T00:06:26.664003+0000","last_unstale":"2024-09-12T00:06:41.811077+0000","last_undegraded":"2024-09-12T00:06:41.811077+0000","last_fullsized":"2024-09-12T00:06:41.811077+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:22.616662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"95'23","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816608+0000","last_change":"2024-09-12T00:03:23.613274+0000","last_active":"2024-09-12T00:06:41.816608+0000","last_peered":"2024-09-12T00:06:41.816608+0000","last_clean":"2024-09-12T00:06:41.816608+0000","last_became_active":"2024-09-12T00:03:23.612941+0000","last_became_peered":"2024-09-12T00:03:23.612941+0000","last_unstale":"2024-09-12T00:06:41.816608+0000","last_undegraded":"2024-09-12T00:06:41.816608+0000","last_fullsized":"2024-09-12T00:06:41.816608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:56.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811543+0000","last_change":"2024-09-12T00:03:27.336144+0000","last_active":"2024-09-12T00:06:41.811543+0000","last_peered":"2024-09-12T00:06:41.811543+0000","last_clean":"2024-09-12T00:06:41.811543+0000","last_became_active":"2024-09-12T00:03:27.335372+0000","last_became_peered":"2024-09-12T00:03:27.335372+0000","last_unstale":"2024-09-12T00:06:41.811543+0000","last_undegraded":"2024-09-12T00:06:41.811543+0000","last_fullsized":"2024-09-12T00:06:41.811543+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:33.978665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"108'11","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809960+0000","last_change":"2024-09-12T00:03:29.332051+0000","last_active":"2024-09-12T00:06:41.809960+0000","last_peered":"2024-09-12T00:06:41.809960+0000","last_clean":"2024-09-12T00:06:41.809960+0000","last_became_active":"2024-09-12T00:03:29.331243+0000","last_became_peered":"2024-09-12T00:03:29.331243+0000","last_unstale":"2024-09-12T00:06:41.809960+0000","last_undegraded":"2024-09-12T00:06:41.809960+0000","last_fullsized":"2024-09-12T00:06:41.809960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:52.544770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810109+0000","last_change":"2024-09-12T00:03:31.347021+0000","last_active":"2024-09-12T00:06:41.810109+0000","last_peered":"2024-09-12T00:06:41.810109+0000","last_clean":"2024-09-12T00:06:41.810109+0000","last_became_active":"2024-09-12T00:03:31.344407+0000","last_became_peered":"2024-09-12T00:03:31.344407+0000","last_unstale":"2024-09-12T00:06:41.810109+0000","last_undegraded":"2024-09-12T00:06:41.810109+0000","last_fullsized":"2024-09-12T00:06:41.810109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:32.139742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"84'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719370+0000","last_change":"2024-09-12T00:03:33.370271+0000","last_active":"2024-09-12T00:06:42.719370+0000","last_peered":"2024-09-12T00:06:42.719370+0000","last_clean":"2024-09-12T00:06:42.719370+0000","last_became_active":"2024-09-12T00:03:33.369538+0000","last_became_peered":"2024-09-12T00:03:33.369538+0000","last_unstale":"2024-09-12T00:06:42.719370+0000","last_undegraded":"2024-09-12T00:06:42.719370+0000","last_fullsized":"2024-09-12T00:06:42.719370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"59'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810693+0000","last_change":"2024-09-12T00:03:25.341025+0000","last_active":"2024-09-12T00:06:41.810693+0000","last_peered":"2024-09-12T00:06:41.810693+0000","last_clean":"2024-09-12T00:06:41.810693+0000","last_became_active":"2024-09-12T00:03:25.340288+0000","last_became_peered":"2024-09-12T00:03:25.340288+0000","last_unstale":"2024-09-12T00:06:41.810693+0000","last_undegraded":"2024-09-12T00:06:41.810693+0000","last_fullsized":"2024-09-12T00:06:41.810693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"96'29","reported_seq":330,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814348+0000","last_change":"2024-09-12T00:06:30.098997+0000","last_active":"2024-09-12T00:06:41.814348+0000","last_peered":"2024-09-12T00:06:41.814348+0000","last_clean":"2024-09-12T00:06:41.814348+0000","last_became_active":"2024-09-12T00:06:26.672172+0000","last_became_peered":"2024-09-12T00:06:26.672172+0000","last_unstale":"2024-09-12T00:06:41.814348+0000","last_undegraded":"2024-09-12T00:06:41.814348+0000","last_fullsized":"2024-09-12T00:06:41.814348+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:32.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810614+0000","last_change":"2024-09-12T00:03:27.329869+0000","last_active":"2024-09-12T00:06:41.810614+0000","last_peered":"2024-09-12T00:06:41.810614+0000","last_clean":"2024-09-12T00:06:41.810614+0000","last_became_active":"2024-09-12T00:03:27.329077+0000","last_became_peered":"2024-09-12T00:03:27.329077+0000","last_unstale":"2024-09-12T00:06:41.810614+0000","last_undegraded":"2024-09-12T00:06:41.810614+0000","last_fullsized":"2024-09-12T00:06:41.810614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"96'19","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720203+0000","last_change":"2024-09-12T00:03:29.346878+0000","last_active":"2024-09-12T00:06:42.720203+0000","last_peered":"2024-09-12T00:06:42.720203+0000","last_clean":"2024-09-12T00:06:42.720203+0000","last_became_active":"2024-09-12T00:03:29.345990+0000","last_became_peered":"2024-09-12T00:03:29.345990+0000","last_unstale":"2024-09-12T00:06:42.720203+0000","last_undegraded":"2024-09-12T00:06:42.720203+0000","last_fullsized":"2024-09-12T00:06:42.720203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:06.398979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499961+0000","last_change":"2024-09-12T00:03:31.363658+0000","last_active":"2024-09-12T00:06:42.499961+0000","last_peered":"2024-09-12T00:06:42.499961+0000","last_clean":"2024-09-12T00:06:42.499961+0000","last_became_active":"2024-09-12T00:03:31.363080+0000","last_became_peered":"2024-09-12T00:03:31.363080+0000","last_unstale":"2024-09-12T00:06:42.499961+0000","last_undegraded":"2024-09-12T00:06:42.499961+0000","last_fullsized":"2024-09-12T00:06:42.499961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:05.901608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717550+0000","last_change":"2024-09-12T00:06:26.673691+0000","last_active":"2024-09-12T00:06:42.717550+0000","last_peered":"2024-09-12T00:06:42.717550+0000","last_clean":"2024-09-12T00:06:42.717550+0000","last_became_active":"2024-09-12T00:06:26.669877+0000","last_became_peered":"2024-09-12T00:06:26.669877+0000","last_unstale":"2024-09-12T00:06:42.717550+0000","last_undegraded":"2024-09-12T00:06:42.717550+0000","last_fullsized":"2024-09-12T00:06:42.717550+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:02.798560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"59'2","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718800+0000","last_change":"2024-09-12T00:06:26.687219+0000","last_active":"2024-09-12T00:06:42.718800+0000","last_peered":"2024-09-12T00:06:42.718800+0000","last_clean":"2024-09-12T00:06:42.718800+0000","last_became_active":"2024-09-12T00:06:26.655483+0000","last_became_peered":"2024-09-12T00:06:26.655483+0000","last_unstale":"2024-09-12T00:06:42.718800+0000","last_undegraded":"2024-09-12T00:06:42.718800+0000","last_fullsized":"2024-09-12T00:06:42.718800+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:21.199336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"96'22","reported_seq":299,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067870+0000","last_change":"2024-09-12T00:06:27.905793+0000","last_active":"2024-09-12T00:06:42.067870+0000","last_peered":"2024-09-12T00:06:42.067870+0000","last_clean":"2024-09-12T00:06:42.067870+0000","last_became_active":"2024-09-12T00:06:26.664617+0000","last_became_peered":"2024-09-12T00:06:26.664617+0000","last_unstale":"2024-09-12T00:06:42.067870+0000","last_undegraded":"2024-09-12T00:06:42.067870+0000","last_fullsized":"2024-09-12T00:06:42.067870+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:23.455040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":142606336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717842+0000","last_change":"2024-09-12T00:06:26.663673+0000","last_active":"2024-09-12T00:06:42.717842+0000","last_peered":"2024-09-12T00:06:42.717842+0000","last_clean":"2024-09-12T00:06:42.717842+0000","last_became_active":"2024-09-12T00:06:26.663351+0000","last_became_peered":"2024-09-12T00:06:26.663351+0000","last_unstale":"2024-09-12T00:06:42.717842+0000","last_undegraded":"2024-09-12T00:06:42.717842+0000","last_fullsized":"2024-09-12T00:06:42.717842+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:58.342457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"96'18","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814520+0000","last_change":"2024-09-12T00:03:29.346312+0000","last_active":"2024-09-12T00:06:41.814520+0000","last_peered":"2024-09-12T00:06:41.814520+0000","last_clean":"2024-09-12T00:06:41.814520+0000","last_became_active":"2024-09-12T00:03:29.345883+0000","last_became_peered":"2024-09-12T00:03:29.345883+0000","last_unstale":"2024-09-12T00:06:41.814520+0000","last_undegraded":"2024-09-12T00:06:41.814520+0000","last_fullsized":"2024-09-12T00:06:41.814520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:46.723370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719592+0000","last_change":"2024-09-12T00:03:31.358786+0000","last_active":"2024-09-12T00:06:42.719592+0000","last_peered":"2024-09-12T00:06:42.719592+0000","last_clean":"2024-09-12T00:06:42.719592+0000","last_became_active":"2024-09-12T00:03:31.358011+0000","last_became_peered":"2024-09-12T00:03:31.358011+0000","last_unstale":"2024-09-12T00:06:42.719592+0000","last_undegraded":"2024-09-12T00:06:42.719592+0000","last_fullsized":"2024-09-12T00:06:42.719592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:29.394163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"59'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720085+0000","last_change":"2024-09-12T00:06:28.364181+0000","last_active":"2024-09-12T00:06:42.720085+0000","last_peered":"2024-09-12T00:06:42.720085+0000","last_clean":"2024-09-12T00:06:42.720085+0000","last_became_active":"2024-09-12T00:06:26.667552+0000","last_became_peered":"2024-09-12T00:06:26.667552+0000","last_unstale":"2024-09-12T00:06:42.720085+0000","last_undegraded":"2024-09-12T00:06:42.720085+0000","last_fullsized":"2024-09-12T00:06:42.720085+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:19.435061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"96'23","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064267+0000","last_change":"2024-09-12T00:03:23.627584+0000","last_active":"2024-09-12T00:06:42.064267+0000","last_peered":"2024-09-12T00:06:42.064267+0000","last_clean":"2024-09-12T00:06:42.064267+0000","last_became_active":"2024-09-12T00:03:23.626026+0000","last_became_peered":"2024-09-12T00:03:23.626026+0000","last_unstale":"2024-09-12T00:06:42.064267+0000","last_undegraded":"2024-09-12T00:06:42.064267+0000","last_fullsized":"2024-09-12T00:06:42.064267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:38.192583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720246+0000","last_change":"2024-09-12T00:06:26.671971+0000","last_active":"2024-09-12T00:06:42.720246+0000","last_peered":"2024-09-12T00:06:42.720246+0000","last_clean":"2024-09-12T00:06:42.720246+0000","last_became_active":"2024-09-12T00:06:26.671427+0000","last_became_peered":"2024-09-12T00:06:26.671427+0000","last_unstale":"2024-09-12T00:06:42.720246+0000","last_undegraded":"2024-09-12T00:06:42.720246+0000","last_fullsized":"2024-09-12T00:06:42.720246+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:22.897492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"96'35","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720971+0000","last_change":"2024-09-12T00:03:29.340387+0000","last_active":"2024-09-12T00:06:42.720971+0000","last_peered":"2024-09-12T00:06:42.720971+0000","last_clean":"2024-09-12T00:06:42.720971+0000","last_became_active":"2024-09-12T00:03:29.339781+0000","last_became_peered":"2024-09-12T00:03:29.339781+0000","last_unstale":"2024-09-12T00:06:42.720971+0000","last_undegraded":"2024-09-12T00:06:42.720971+0000","last_fullsized":"2024-09-12T00:06:42.720971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:30.132716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811392+0000","last_change":"2024-09-12T00:03:31.350303+0000","last_active":"2024-09-12T00:06:41.811392+0000","last_peered":"2024-09-12T00:06:41.811392+0000","last_clean":"2024-09-12T00:06:41.811392+0000","last_became_active":"2024-09-12T00:03:31.349591+0000","last_became_peered":"2024-09-12T00:03:31.349591+0000","last_unstale":"2024-09-12T00:06:41.811392+0000","last_undegraded":"2024-09-12T00:06:41.811392+0000","last_fullsized":"2024-09-12T00:06:41.811392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:00.263644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"96'4","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065021+0000","last_change":"2024-09-12T00:03:33.385028+0000","last_active":"2024-09-12T00:06:42.065021+0000","last_peered":"2024-09-12T00:06:42.065021+0000","last_clean":"2024-09-12T00:06:42.065021+0000","last_became_active":"2024-09-12T00:03:33.384274+0000","last_became_peered":"2024-09-12T00:03:33.384274+0000","last_unstale":"2024-09-12T00:06:42.065021+0000","last_undegraded":"2024-09-12T00:06:42.065021+0000","last_fullsized":"2024-09-12T00:06:42.065021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:11.634604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"58'2","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813365+0000","last_change":"2024-09-12T00:03:25.329888+0000","last_active":"2024-09-12T00:06:41.813365+0000","last_peered":"2024-09-12T00:06:41.813365+0000","last_clean":"2024-09-12T00:06:41.813365+0000","last_became_active":"2024-09-12T00:03:25.329151+0000","last_became_peered":"2024-09-12T00:03:25.329151+0000","last_unstale":"2024-09-12T00:06:41.813365+0000","last_undegraded":"2024-09-12T00:06:41.813365+0000","last_fullsized":"2024-09-12T00:06:41.813365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:47.272383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"96'25","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811321+0000","last_change":"2024-09-12T00:03:23.600146+0000","last_active":"2024-09-12T00:06:41.811321+0000","last_peered":"2024-09-12T00:06:41.811321+0000","last_clean":"2024-09-12T00:06:41.811321+0000","last_became_active":"2024-09-12T00:03:23.598862+0000","last_became_peered":"2024-09-12T00:03:23.598862+0000","last_unstale":"2024-09-12T00:06:41.811321+0000","last_undegraded":"2024-09-12T00:06:41.811321+0000","last_fullsized":"2024-09-12T00:06:41.811321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:13.330852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813925+0000","last_change":"2024-09-12T00:03:27.341032+0000","last_active":"2024-09-12T00:06:41.813925+0000","last_peered":"2024-09-12T00:06:41.813925+0000","last_clean":"2024-09-12T00:06:41.813925+0000","last_became_active":"2024-09-12T00:03:27.340199+0000","last_became_peered":"2024-09-12T00:03:27.340199+0000","last_unstale":"2024-09-12T00:06:41.813925+0000","last_undegraded":"2024-09-12T00:06:41.813925+0000","last_fullsized":"2024-09-12T00:06:41.813925+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:23.673080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"96'24","reported_seq":57,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717487+0000","last_change":"2024-09-12T00:06:31.054703+0000","last_active":"2024-09-12T00:06:42.717487+0000","last_peered":"2024-09-12T00:06:42.717487+0000","last_clean":"2024-09-12T00:06:42.717487+0000","last_became_active":"2024-09-12T00:06:26.675513+0000","last_became_peered":"2024-09-12T00:06:26.675513+0000","last_unstale":"2024-09-12T00:06:42.717487+0000","last_undegraded":"2024-09-12T00:06:42.717487+0000","last_fullsized":"2024-09-12T00:06:42.717487+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:56.604086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065828+0000","last_change":"2024-09-12T00:06:26.678166+0000","last_active":"2024-09-12T00:06:42.065828+0000","last_peered":"2024-09-12T00:06:42.065828+0000","last_clean":"2024-09-12T00:06:42.065828+0000","last_became_active":"2024-09-12T00:06:26.677049+0000","last_became_peered":"2024-09-12T00:06:26.677049+0000","last_unstale":"2024-09-12T00:06:42.065828+0000","last_undegraded":"2024-09-12T00:06:42.065828+0000","last_fullsized":"2024-09-12T00:06:42.065828+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:26.729678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"59'3","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721092+0000","last_change":"2024-09-12T00:06:32.445889+0000","last_active":"2024-09-12T00:06:42.721092+0000","last_peered":"2024-09-12T00:06:42.721092+0000","last_clean":"2024-09-12T00:06:42.721092+0000","last_became_active":"2024-09-12T00:06:26.677859+0000","last_became_peered":"2024-09-12T00:06:26.677859+0000","last_unstale":"2024-09-12T00:06:42.721092+0000","last_undegraded":"2024-09-12T00:06:42.721092+0000","last_fullsized":"2024-09-12T00:06:42.721092+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:56.789846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"59'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722541+0000","last_change":"2024-09-12T00:03:25.360355+0000","last_active":"2024-09-12T00:06:42.722541+0000","last_peered":"2024-09-12T00:06:42.722541+0000","last_clean":"2024-09-12T00:06:42.722541+0000","last_became_active":"2024-09-12T00:03:25.359682+0000","last_became_peered":"2024-09-12T00:03:25.359682+0000","last_unstale":"2024-09-12T00:06:42.722541+0000","last_undegraded":"2024-09-12T00:06:42.722541+0000","last_fullsized":"2024-09-12T00:06:42.722541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:11.808081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"96'20","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500616+0000","last_change":"2024-09-12T00:03:23.621199+0000","last_active":"2024-09-12T00:06:42.500616+0000","last_peered":"2024-09-12T00:06:42.500616+0000","last_clean":"2024-09-12T00:06:42.500616+0000","last_became_active":"2024-09-12T00:03:23.620961+0000","last_became_peered":"2024-09-12T00:03:23.620961+0000","last_unstale":"2024-09-12T00:06:42.500616+0000","last_undegraded":"2024-09-12T00:06:42.500616+0000","last_fullsized":"2024-09-12T00:06:42.500616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811166+0000","last_change":"2024-09-12T00:03:27.336918+0000","last_active":"2024-09-12T00:06:41.811166+0000","last_peered":"2024-09-12T00:06:41.811166+0000","last_clean":"2024-09-12T00:06:41.811166+0000","last_became_active":"2024-09-12T00:03:27.336045+0000","last_became_peered":"2024-09-12T00:03:27.336045+0000","last_unstale":"2024-09-12T00:06:41.811166+0000","last_undegraded":"2024-09-12T00:06:41.811166+0000","last_fullsized":"2024-09-12T00:06:41.811166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"96'25","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720072+0000","last_change":"2024-09-12T00:03:29.338667+0000","last_active":"2024-09-12T00:06:42.720072+0000","last_peered":"2024-09-12T00:06:42.720072+0000","last_clean":"2024-09-12T00:06:42.720072+0000","last_became_active":"2024-09-12T00:03:29.338010+0000","last_became_peered":"2024-09-12T00:03:29.338010+0000","last_unstale":"2024-09-12T00:06:42.720072+0000","last_undegraded":"2024-09-12T00:06:42.720072+0000","last_fullsized":"2024-09-12T00:06:42.720072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:58.256619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722902+0000","last_change":"2024-09-12T00:03:31.352823+0000","last_active":"2024-09-12T00:06:42.722902+0000","last_peered":"2024-09-12T00:06:42.722902+0000","last_clean":"2024-09-12T00:06:42.722902+0000","last_became_active":"2024-09-12T00:03:31.352143+0000","last_became_peered":"2024-09-12T00:03:31.352143+0000","last_unstale":"2024-09-12T00:06:42.722902+0000","last_undegraded":"2024-09-12T00:06:42.722902+0000","last_fullsized":"2024-09-12T00:06:42.722902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:25.168692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"76'8","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721671+0000","last_change":"2024-09-12T00:06:27.901313+0000","last_active":"2024-09-12T00:06:42.721671+0000","last_peered":"2024-09-12T00:06:42.721671+0000","last_clean":"2024-09-12T00:06:42.721671+0000","last_became_active":"2024-09-12T00:06:26.658281+0000","last_became_peered":"2024-09-12T00:06:26.658281+0000","last_unstale":"2024-09-12T00:06:42.721671+0000","last_undegraded":"2024-09-12T00:06:42.721671+0000","last_fullsized":"2024-09-12T00:06:42.721671+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:54.959771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"58'2","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812806+0000","last_change":"2024-09-12T00:03:25.325094+0000","last_active":"2024-09-12T00:06:41.812806+0000","last_peered":"2024-09-12T00:06:41.812806+0000","last_clean":"2024-09-12T00:06:41.812806+0000","last_became_active":"2024-09-12T00:03:25.324315+0000","last_became_peered":"2024-09-12T00:03:25.324315+0000","last_unstale":"2024-09-12T00:06:41.812806+0000","last_undegraded":"2024-09-12T00:06:41.812806+0000","last_fullsized":"2024-09-12T00:06:41.812806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:18.727732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"96'27","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812410+0000","last_change":"2024-09-12T00:03:23.606163+0000","last_active":"2024-09-12T00:06:41.812410+0000","last_peered":"2024-09-12T00:06:41.812410+0000","last_clean":"2024-09-12T00:06:41.812410+0000","last_became_active":"2024-09-12T00:03:23.605402+0000","last_became_peered":"2024-09-12T00:03:23.605402+0000","last_unstale":"2024-09-12T00:06:41.812410+0000","last_undegraded":"2024-09-12T00:06:41.812410+0000","last_fullsized":"2024-09-12T00:06:41.812410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:02.432313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812917+0000","last_change":"2024-09-12T00:03:27.336716+0000","last_active":"2024-09-12T00:06:41.812917+0000","last_peered":"2024-09-12T00:06:41.812917+0000","last_clean":"2024-09-12T00:06:41.812917+0000","last_became_active":"2024-09-12T00:03:27.335658+0000","last_became_peered":"2024-09-12T00:03:27.335658+0000","last_unstale":"2024-09-12T00:06:41.812917+0000","last_undegraded":"2024-09-12T00:06:41.812917+0000","last_fullsized":"2024-09-12T00:06:41.812917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:47.355798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"35'16","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720503+0000","last_change":"2024-09-12T00:06:29.533440+0000","last_active":"2024-09-12T00:06:42.720503+0000","last_peered":"2024-09-12T00:06:42.720503+0000","last_clean":"2024-09-12T00:06:42.720503+0000","last_became_active":"2024-09-12T00:06:26.671893+0000","last_became_peered":"2024-09-12T00:06:26.671893+0000","last_unstale":"2024-09-12T00:06:42.720503+0000","last_undegraded":"2024-09-12T00:06:42.720503+0000","last_fullsized":"2024-09-12T00:06:42.720503+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:10.667822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"96'134","reported_seq":353,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816434+0000","last_change":"2024-09-12T00:03:31.351362+0000","last_active":"2024-09-12T00:06:41.816434+0000","last_peered":"2024-09-12T00:06:41.816434+0000","last_clean":"2024-09-12T00:06:41.816434+0000","last_became_active":"2024-09-12T00:03:31.350925+0000","last_became_peered":"2024-09-12T00:03:31.350925+0000","last_unstale":"2024-09-12T00:06:41.816434+0000","last_undegraded":"2024-09-12T00:06:41.816434+0000","last_fullsized":"2024-09-12T00:06:41.816434+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:03.147968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719766+0000","last_change":"2024-09-12T00:06:26.675599+0000","last_active":"2024-09-12T00:06:42.719766+0000","last_peered":"2024-09-12T00:06:42.719766+0000","last_clean":"2024-09-12T00:06:42.719766+0000","last_became_active":"2024-09-12T00:06:26.675234+0000","last_became_peered":"2024-09-12T00:06:26.675234+0000","last_unstale":"2024-09-12T00:06:42.719766+0000","last_undegraded":"2024-09-12T00:06:42.719766+0000","last_fullsized":"2024-09-12T00:06:42.719766+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:28.887412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"59'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812590+0000","last_change":"2024-09-12T00:03:25.357999+0000","last_active":"2024-09-12T00:06:41.812590+0000","last_peered":"2024-09-12T00:06:41.812590+0000","last_clean":"2024-09-12T00:06:41.812590+0000","last_became_active":"2024-09-12T00:03:25.357623+0000","last_became_peered":"2024-09-12T00:03:25.357623+0000","last_unstale":"2024-09-12T00:06:41.812590+0000","last_undegraded":"2024-09-12T00:06:41.812590+0000","last_fullsized":"2024-09-12T00:06:41.812590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"96'29","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500852+0000","last_change":"2024-09-12T00:03:23.605954+0000","last_active":"2024-09-12T00:06:42.500852+0000","last_peered":"2024-09-12T00:06:42.500852+0000","last_clean":"2024-09-12T00:06:42.500852+0000","last_became_active":"2024-09-12T00:03:23.604773+0000","last_became_peered":"2024-09-12T00:03:23.604773+0000","last_unstale":"2024-09-12T00:06:42.500852+0000","last_undegraded":"2024-09-12T00:06:42.500852+0000","last_fullsized":"2024-09-12T00:06:42.500852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500071+0000","last_change":"2024-09-12T00:03:27.346785+0000","last_active":"2024-09-12T00:06:42.500071+0000","last_peered":"2024-09-12T00:06:42.500071+0000","last_clean":"2024-09-12T00:06:42.500071+0000","last_became_active":"2024-09-12T00:03:27.346168+0000","last_became_peered":"2024-09-12T00:03:27.346168+0000","last_unstale":"2024-09-12T00:06:42.500071+0000","last_undegraded":"2024-09-12T00:06:42.500071+0000","last_fullsized":"2024-09-12T00:06:42.500071+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"96'49","reported_seq":267,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811988+0000","last_change":"2024-09-12T00:03:29.343942+0000","last_active":"2024-09-12T00:06:41.811988+0000","last_peered":"2024-09-12T00:06:41.811988+0000","last_clean":"2024-09-12T00:06:41.811988+0000","last_became_active":"2024-09-12T00:03:29.343238+0000","last_became_peered":"2024-09-12T00:03:29.343238+0000","last_unstale":"2024-09-12T00:06:41.811988+0000","last_undegraded":"2024-09-12T00:06:41.811988+0000","last_fullsized":"2024-09-12T00:06:41.811988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:30.949892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810193+0000","last_change":"2024-09-12T00:06:26.655176+0000","last_active":"2024-09-12T00:06:41.810193+0000","last_peered":"2024-09-12T00:06:41.810193+0000","last_clean":"2024-09-12T00:06:41.810193+0000","last_became_active":"2024-09-12T00:06:26.654187+0000","last_became_peered":"2024-09-12T00:06:26.654187+0000","last_unstale":"2024-09-12T00:06:41.810193+0000","last_undegraded":"2024-09-12T00:06:41.810193+0000","last_fullsized":"2024-09-12T00:06:41.810193+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:58.719162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501328+0000","last_change":"2024-09-12T00:03:33.363188+0000","last_active":"2024-09-12T00:06:42.501328+0000","last_peered":"2024-09-12T00:06:42.501328+0000","last_clean":"2024-09-12T00:06:42.501328+0000","last_became_active":"2024-09-12T00:03:33.360672+0000","last_became_peered":"2024-09-12T00:03:33.360672+0000","last_unstale":"2024-09-12T00:06:42.501328+0000","last_undegraded":"2024-09-12T00:06:42.501328+0000","last_fullsized":"2024-09-12T00:06:42.501328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:33.646117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"59'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811812+0000","last_change":"2024-09-12T00:03:25.336626+0000","last_active":"2024-09-12T00:06:41.811812+0000","last_peered":"2024-09-12T00:06:41.811812+0000","last_clean":"2024-09-12T00:06:41.811812+0000","last_became_active":"2024-09-12T00:03:25.336095+0000","last_became_peered":"2024-09-12T00:03:25.336095+0000","last_unstale":"2024-09-12T00:06:41.811812+0000","last_undegraded":"2024-09-12T00:06:41.811812+0000","last_fullsized":"2024-09-12T00:06:41.811812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"95'26","reported_seq":95,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720356+0000","last_change":"2024-09-12T00:06:32.976777+0000","last_active":"2024-09-12T00:06:42.720356+0000","last_peered":"2024-09-12T00:06:42.720356+0000","last_clean":"2024-09-12T00:06:42.720356+0000","last_became_active":"2024-09-12T00:06:26.678646+0000","last_became_peered":"2024-09-12T00:06:26.678646+0000","last_unstale":"2024-09-12T00:06:42.720356+0000","last_undegraded":"2024-09-12T00:06:42.720356+0000","last_fullsized":"2024-09-12T00:06:42.720356+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:02.624469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":192937984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812464+0000","last_change":"2024-09-12T00:03:27.326174+0000","last_active":"2024-09-12T00:06:41.812464+0000","last_peered":"2024-09-12T00:06:41.812464+0000","last_clean":"2024-09-12T00:06:41.812464+0000","last_became_active":"2024-09-12T00:03:27.325336+0000","last_became_peered":"2024-09-12T00:03:27.325336+0000","last_unstale":"2024-09-12T00:06:41.812464+0000","last_undegraded":"2024-09-12T00:06:41.812464+0000","last_fullsized":"2024-09-12T00:06:41.812464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:08.659813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"96'23","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810811+0000","last_change":"2024-09-12T00:03:29.335957+0000","last_active":"2024-09-12T00:06:41.810811+0000","last_peered":"2024-09-12T00:06:41.810811+0000","last_clean":"2024-09-12T00:06:41.810811+0000","last_became_active":"2024-09-12T00:03:29.335186+0000","last_became_peered":"2024-09-12T00:03:29.335186+0000","last_unstale":"2024-09-12T00:06:41.810811+0000","last_undegraded":"2024-09-12T00:06:41.810811+0000","last_fullsized":"2024-09-12T00:06:41.810811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:20.551758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721804+0000","last_change":"2024-09-12T00:06:26.671154+0000","last_active":"2024-09-12T00:06:42.721804+0000","last_peered":"2024-09-12T00:06:42.721804+0000","last_clean":"2024-09-12T00:06:42.721804+0000","last_became_active":"2024-09-12T00:06:26.667486+0000","last_became_peered":"2024-09-12T00:06:26.667486+0000","last_unstale":"2024-09-12T00:06:42.721804+0000","last_undegraded":"2024-09-12T00:06:42.721804+0000","last_fullsized":"2024-09-12T00:06:42.721804+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:31.291883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066037+0000","last_change":"2024-09-12T00:03:33.385037+0000","last_active":"2024-09-12T00:06:42.066037+0000","last_peered":"2024-09-12T00:06:42.066037+0000","last_clean":"2024-09-12T00:06:42.066037+0000","last_became_active":"2024-09-12T00:03:33.384379+0000","last_became_peered":"2024-09-12T00:03:33.384379+0000","last_unstale":"2024-09-12T00:06:42.066037+0000","last_undegraded":"2024-09-12T00:06:42.066037+0000","last_fullsized":"2024-09-12T00:06:42.066037+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:00.153475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"96'10","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718737+0000","last_change":"2024-09-12T00:03:25.339110+0000","last_active":"2024-09-12T00:06:42.718737+0000","last_peered":"2024-09-12T00:06:42.718737+0000","last_clean":"2024-09-12T00:06:42.718737+0000","last_became_active":"2024-09-12T00:03:25.338417+0000","last_became_peered":"2024-09-12T00:03:25.338417+0000","last_unstale":"2024-09-12T00:06:42.718737+0000","last_undegraded":"2024-09-12T00:06:42.718737+0000","last_fullsized":"2024-09-12T00:06:42.718737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:48.866021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"96'31","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067362+0000","last_change":"2024-09-12T00:03:23.625514+0000","last_active":"2024-09-12T00:06:42.067362+0000","last_peered":"2024-09-12T00:06:42.067362+0000","last_clean":"2024-09-12T00:06:42.067362+0000","last_became_active":"2024-09-12T00:03:23.621654+0000","last_became_peered":"2024-09-12T00:03:23.621654+0000","last_unstale":"2024-09-12T00:06:42.067362+0000","last_undegraded":"2024-09-12T00:06:42.067362+0000","last_fullsized":"2024-09-12T00:06:42.067362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:43.784497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500172+0000","last_change":"2024-09-12T00:03:27.330377+0000","last_active":"2024-09-12T00:06:42.500172+0000","last_peered":"2024-09-12T00:06:42.500172+0000","last_clean":"2024-09-12T00:06:42.500172+0000","last_became_active":"2024-09-12T00:03:27.329713+0000","last_became_peered":"2024-09-12T00:03:27.329713+0000","last_unstale":"2024-09-12T00:06:42.500172+0000","last_undegraded":"2024-09-12T00:06:42.500172+0000","last_fullsized":"2024-09-12T00:06:42.500172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"96'19","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721448+0000","last_change":"2024-09-12T00:03:29.337028+0000","last_active":"2024-09-12T00:06:42.721448+0000","last_peered":"2024-09-12T00:06:42.721448+0000","last_clean":"2024-09-12T00:06:42.721448+0000","last_became_active":"2024-09-12T00:03:29.335440+0000","last_became_peered":"2024-09-12T00:03:29.335440+0000","last_unstale":"2024-09-12T00:06:42.721448+0000","last_undegraded":"2024-09-12T00:06:42.721448+0000","last_fullsized":"2024-09-12T00:06:42.721448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:19.288395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721524+0000","last_change":"2024-09-12T00:06:26.674200+0000","last_active":"2024-09-12T00:06:42.721524+0000","last_peered":"2024-09-12T00:06:42.721524+0000","last_clean":"2024-09-12T00:06:42.721524+0000","last_became_active":"2024-09-12T00:06:26.660173+0000","last_became_peered":"2024-09-12T00:06:26.660173+0000","last_unstale":"2024-09-12T00:06:42.721524+0000","last_undegraded":"2024-09-12T00:06:42.721524+0000","last_fullsized":"2024-09-12T00:06:42.721524+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:56.674961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"58'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720918+0000","last_change":"2024-09-12T00:06:32.449370+0000","last_active":"2024-09-12T00:06:42.720918+0000","last_peered":"2024-09-12T00:06:42.720918+0000","last_clean":"2024-09-12T00:06:42.720918+0000","last_became_active":"2024-09-12T00:06:26.677210+0000","last_became_peered":"2024-09-12T00:06:26.677210+0000","last_unstale":"2024-09-12T00:06:42.720918+0000","last_undegraded":"2024-09-12T00:06:42.720918+0000","last_fullsized":"2024-09-12T00:06:42.720918+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:13.086869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"96'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810877+0000","last_change":"2024-09-12T00:03:25.337999+0000","last_active":"2024-09-12T00:06:41.810877+0000","last_peered":"2024-09-12T00:06:41.810877+0000","last_clean":"2024-09-12T00:06:41.810877+0000","last_became_active":"2024-09-12T00:03:25.337237+0000","last_became_peered":"2024-09-12T00:03:25.337237+0000","last_unstale":"2024-09-12T00:06:41.810877+0000","last_undegraded":"2024-09-12T00:06:41.810877+0000","last_fullsized":"2024-09-12T00:06:41.810877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"96'29","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067739+0000","last_change":"2024-09-12T00:03:23.631744+0000","last_active":"2024-09-12T00:06:42.067739+0000","last_peered":"2024-09-12T00:06:42.067739+0000","last_clean":"2024-09-12T00:06:42.067739+0000","last_became_active":"2024-09-12T00:03:23.630928+0000","last_became_peered":"2024-09-12T00:03:23.630928+0000","last_unstale":"2024-09-12T00:06:42.067739+0000","last_undegraded":"2024-09-12T00:06:42.067739+0000","last_fullsized":"2024-09-12T00:06:42.067739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:35.772832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810384+0000","last_change":"2024-09-12T00:06:26.683708+0000","last_active":"2024-09-12T00:06:41.810384+0000","last_peered":"2024-09-12T00:06:41.810384+0000","last_clean":"2024-09-12T00:06:41.810384+0000","last_became_active":"2024-09-12T00:06:26.651342+0000","last_became_peered":"2024-09-12T00:06:26.651342+0000","last_unstale":"2024-09-12T00:06:41.810384+0000","last_undegraded":"2024-09-12T00:06:41.810384+0000","last_fullsized":"2024-09-12T00:06:41.810384+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:06.251275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"96'29","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721214+0000","last_change":"2024-09-12T00:06:33.464772+0000","last_active":"2024-09-12T00:06:42.721214+0000","last_peered":"2024-09-12T00:06:42.721214+0000","last_clean":"2024-09-12T00:06:42.721214+0000","last_became_active":"2024-09-12T00:06:26.680856+0000","last_became_peered":"2024-09-12T00:06:26.680856+0000","last_unstale":"2024-09-12T00:06:42.721214+0000","last_undegraded":"2024-09-12T00:06:42.721214+0000","last_fullsized":"2024-09-12T00:06:42.721214+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:08.755659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":26,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811844+0000","last_change":"2024-09-12T00:03:31.355300+0000","last_active":"2024-09-12T00:06:41.811844+0000","last_peered":"2024-09-12T00:06:41.811844+0000","last_clean":"2024-09-12T00:06:41.811844+0000","last_became_active":"2024-09-12T00:03:31.354506+0000","last_became_peered":"2024-09-12T00:03:31.354506+0000","last_unstale":"2024-09-12T00:06:41.811844+0000","last_undegraded":"2024-09-12T00:06:41.811844+0000","last_fullsized":"2024-09-12T00:06:41.811844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:51.564710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"58'1","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815779+0000","last_change":"2024-09-12T00:03:33.384262+0000","last_active":"2024-09-12T00:06:41.815779+0000","last_peered":"2024-09-12T00:06:41.815779+0000","last_clean":"2024-09-12T00:06:41.815779+0000","last_became_active":"2024-09-12T00:03:33.383358+0000","last_became_peered":"2024-09-12T00:03:33.383358+0000","last_unstale":"2024-09-12T00:06:41.815779+0000","last_undegraded":"2024-09-12T00:06:41.815779+0000","last_fullsized":"2024-09-12T00:06:41.815779+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:45.060131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"84'4","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813832+0000","last_change":"2024-09-12T00:06:28.849788+0000","last_active":"2024-09-12T00:06:41.813832+0000","last_peered":"2024-09-12T00:06:41.813832+0000","last_clean":"2024-09-12T00:06:41.813832+0000","last_became_active":"2024-09-12T00:06:26.664077+0000","last_became_peered":"2024-09-12T00:06:26.664077+0000","last_unstale":"2024-09-12T00:06:41.813832+0000","last_undegraded":"2024-09-12T00:06:41.813832+0000","last_fullsized":"2024-09-12T00:06:41.813832+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:24.431791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"96'31","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811482+0000","last_change":"2024-09-12T00:03:23.617643+0000","last_active":"2024-09-12T00:06:41.811482+0000","last_peered":"2024-09-12T00:06:41.811482+0000","last_clean":"2024-09-12T00:06:41.811482+0000","last_became_active":"2024-09-12T00:03:23.617138+0000","last_became_peered":"2024-09-12T00:03:23.617138+0000","last_unstale":"2024-09-12T00:06:41.811482+0000","last_undegraded":"2024-09-12T00:06:41.811482+0000","last_fullsized":"2024-09-12T00:06:41.811482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127926272,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":124928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"59'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723414+0000","last_change":"2024-09-12T00:03:25.335650+0000","last_active":"2024-09-12T00:06:42.723414+0000","last_peered":"2024-09-12T00:06:42.723414+0000","last_clean":"2024-09-12T00:06:42.723414+0000","last_became_active":"2024-09-12T00:03:25.334965+0000","last_became_peered":"2024-09-12T00:03:25.334965+0000","last_unstale":"2024-09-12T00:06:42.723414+0000","last_undegraded":"2024-09-12T00:06:42.723414+0000","last_fullsized":"2024-09-12T00:06:42.723414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:13.501672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"96'26","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718679+0000","last_change":"2024-09-12T00:03:23.618651+0000","last_active":"2024-09-12T00:06:42.718679+0000","last_peered":"2024-09-12T00:06:42.718679+0000","last_clean":"2024-09-12T00:06:42.718679+0000","last_became_active":"2024-09-12T00:03:23.612542+0000","last_became_peered":"2024-09-12T00:03:23.612542+0000","last_unstale":"2024-09-12T00:06:42.718679+0000","last_undegraded":"2024-09-12T00:06:42.718679+0000","last_fullsized":"2024-09-12T00:06:42.718679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"96'4","reported_seq":47,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717901+0000","last_change":"2024-09-12T00:06:32.454921+0000","last_active":"2024-09-12T00:06:42.717901+0000","last_peered":"2024-09-12T00:06:42.717901+0000","last_clean":"2024-09-12T00:06:42.717901+0000","last_became_active":"2024-09-12T00:06:26.677698+0000","last_became_peered":"2024-09-12T00:06:26.677698+0000","last_unstale":"2024-09-12T00:06:42.717901+0000","last_undegraded":"2024-09-12T00:06:42.717901+0000","last_fullsized":"2024-09-12T00:06:42.717901+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:31.889100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"96'30","reported_seq":103,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721342+0000","last_change":"2024-09-12T00:06:30.842710+0000","last_active":"2024-09-12T00:06:42.721342+0000","last_peered":"2024-09-12T00:06:42.721342+0000","last_clean":"2024-09-12T00:06:42.721342+0000","last_became_active":"2024-09-12T00:06:26.666582+0000","last_became_peered":"2024-09-12T00:06:26.666582+0000","last_unstale":"2024-09-12T00:06:42.721342+0000","last_undegraded":"2024-09-12T00:06:42.721342+0000","last_fullsized":"2024-09-12T00:06:42.721342+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:15.209092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":201326592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"63'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066906+0000","last_change":"2024-09-12T00:03:25.354015+0000","last_active":"2024-09-12T00:06:42.066906+0000","last_peered":"2024-09-12T00:06:42.066906+0000","last_clean":"2024-09-12T00:06:42.066906+0000","last_became_active":"2024-09-12T00:03:25.352319+0000","last_became_peered":"2024-09-12T00:03:25.352319+0000","last_unstale":"2024-09-12T00:06:42.066906+0000","last_undegraded":"2024-09-12T00:06:42.066906+0000","last_fullsized":"2024-09-12T00:06:42.066906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:08.033834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"96'17","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066879+0000","last_change":"2024-09-12T00:03:23.633614+0000","last_active":"2024-09-12T00:06:42.066879+0000","last_peered":"2024-09-12T00:06:42.066879+0000","last_clean":"2024-09-12T00:06:42.066879+0000","last_became_active":"2024-09-12T00:03:23.632850+0000","last_became_peered":"2024-09-12T00:03:23.632850+0000","last_unstale":"2024-09-12T00:06:42.066879+0000","last_undegraded":"2024-09-12T00:06:42.066879+0000","last_fullsized":"2024-09-12T00:06:42.066879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065662+0000","last_change":"2024-09-12T00:03:25.357453+0000","last_active":"2024-09-12T00:06:42.065662+0000","last_peered":"2024-09-12T00:06:42.065662+0000","last_clean":"2024-09-12T00:06:42.065662+0000","last_became_active":"2024-09-12T00:03:25.353815+0000","last_became_peered":"2024-09-12T00:03:25.353815+0000","last_unstale":"2024-09-12T00:06:42.065662+0000","last_undegraded":"2024-09-12T00:06:42.065662+0000","last_fullsized":"2024-09-12T00:06:42.065662+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:27.562174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"96'22","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721565+0000","last_change":"2024-09-12T00:03:23.609055+0000","last_active":"2024-09-12T00:06:42.721565+0000","last_peered":"2024-09-12T00:06:42.721565+0000","last_clean":"2024-09-12T00:06:42.721565+0000","last_became_active":"2024-09-12T00:03:23.608101+0000","last_became_peered":"2024-09-12T00:03:23.608101+0000","last_unstale":"2024-09-12T00:06:42.721565+0000","last_undegraded":"2024-09-12T00:06:42.721565+0000","last_fullsized":"2024-09-12T00:06:42.721565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"96'10","reported_seq":268,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814861+0000","last_change":"2024-09-12T00:06:28.290549+0000","last_active":"2024-09-12T00:06:41.814861+0000","last_peered":"2024-09-12T00:06:41.814861+0000","last_clean":"2024-09-12T00:06:41.814861+0000","last_became_active":"2024-09-12T00:06:26.681882+0000","last_became_peered":"2024-09-12T00:06:26.681882+0000","last_unstale":"2024-09-12T00:06:41.814861+0000","last_undegraded":"2024-09-12T00:06:41.814861+0000","last_fullsized":"2024-09-12T00:06:41.814861+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:12.272800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"96'26","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721650+0000","last_change":"2024-09-12T00:03:23.616706+0000","last_active":"2024-09-12T00:06:42.721650+0000","last_peered":"2024-09-12T00:06:42.721650+0000","last_clean":"2024-09-12T00:06:42.721650+0000","last_became_active":"2024-09-12T00:03:23.615970+0000","last_became_peered":"2024-09-12T00:03:23.615970+0000","last_unstale":"2024-09-12T00:06:42.721650+0000","last_undegraded":"2024-09-12T00:06:42.721650+0000","last_fullsized":"2024-09-12T00:06:42.721650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"63'8","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720621+0000","last_change":"2024-09-12T00:03:25.343716+0000","last_active":"2024-09-12T00:06:42.720621+0000","last_peered":"2024-09-12T00:06:42.720621+0000","last_clean":"2024-09-12T00:06:42.720621+0000","last_became_active":"2024-09-12T00:03:25.342930+0000","last_became_peered":"2024-09-12T00:03:25.342930+0000","last_unstale":"2024-09-12T00:06:42.720621+0000","last_undegraded":"2024-09-12T00:06:42.720621+0000","last_fullsized":"2024-09-12T00:06:42.720621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"95'25","reported_seq":321,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814202+0000","last_change":"2024-09-12T00:06:29.602896+0000","last_active":"2024-09-12T00:06:41.814202+0000","last_peered":"2024-09-12T00:06:41.814202+0000","last_clean":"2024-09-12T00:06:41.814202+0000","last_became_active":"2024-09-12T00:06:26.672080+0000","last_became_peered":"2024-09-12T00:06:26.672080+0000","last_unstale":"2024-09-12T00:06:41.814202+0000","last_undegraded":"2024-09-12T00:06:41.814202+0000","last_fullsized":"2024-09-12T00:06:41.814202+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:47.695274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"96'10","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499716+0000","last_change":"2024-09-12T00:03:25.326620+0000","last_active":"2024-09-12T00:06:42.499716+0000","last_peered":"2024-09-12T00:06:42.499716+0000","last_clean":"2024-09-12T00:06:42.499716+0000","last_became_active":"2024-09-12T00:03:25.326262+0000","last_became_peered":"2024-09-12T00:03:25.326262+0000","last_unstale":"2024-09-12T00:06:42.499716+0000","last_undegraded":"2024-09-12T00:06:42.499716+0000","last_fullsized":"2024-09-12T00:06:42.499716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"96'16","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067549+0000","last_change":"2024-09-12T00:03:23.632200+0000","last_active":"2024-09-12T00:06:42.067549+0000","last_peered":"2024-09-12T00:06:42.067549+0000","last_clean":"2024-09-12T00:06:42.067549+0000","last_became_active":"2024-09-12T00:03:23.631510+0000","last_became_peered":"2024-09-12T00:03:23.631510+0000","last_unstale":"2024-09-12T00:06:42.067549+0000","last_undegraded":"2024-09-12T00:06:42.067549+0000","last_fullsized":"2024-09-12T00:06:42.067549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:07.177242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"58'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.724304+0000","last_change":"2024-09-12T00:03:25.342763+0000","last_active":"2024-09-12T00:06:42.724304+0000","last_peered":"2024-09-12T00:06:42.724304+0000","last_clean":"2024-09-12T00:06:42.724304+0000","last_became_active":"2024-09-12T00:03:25.337834+0000","last_became_peered":"2024-09-12T00:03:25.337834+0000","last_unstale":"2024-09-12T00:06:42.724304+0000","last_undegraded":"2024-09-12T00:06:42.724304+0000","last_fullsized":"2024-09-12T00:06:42.724304+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:35.920599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"95'16","reported_seq":75,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717915+0000","last_change":"2024-09-12T00:06:28.323950+0000","last_active":"2024-09-12T00:06:42.717915+0000","last_peered":"2024-09-12T00:06:42.717915+0000","last_clean":"2024-09-12T00:06:42.717915+0000","last_became_active":"2024-09-12T00:06:26.666889+0000","last_became_peered":"2024-09-12T00:06:26.666889+0000","last_unstale":"2024-09-12T00:06:42.717915+0000","last_undegraded":"2024-09-12T00:06:42.717915+0000","last_fullsized":"2024-09-12T00:06:42.717915+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:12.167901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816185+0000","last_change":"2024-09-12T00:03:25.339910+0000","last_active":"2024-09-12T00:06:41.816185+0000","last_peered":"2024-09-12T00:06:41.816185+0000","last_clean":"2024-09-12T00:06:41.816185+0000","last_became_active":"2024-09-12T00:03:25.336511+0000","last_became_peered":"2024-09-12T00:03:25.336511+0000","last_unstale":"2024-09-12T00:06:41.816185+0000","last_undegraded":"2024-09-12T00:06:41.816185+0000","last_fullsized":"2024-09-12T00:06:41.816185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:30.647474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"96'28","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065464+0000","last_change":"2024-09-12T00:03:23.626232+0000","last_active":"2024-09-12T00:06:42.065464+0000","last_peered":"2024-09-12T00:06:42.065464+0000","last_clean":"2024-09-12T00:06:42.065464+0000","last_became_active":"2024-09-12T00:03:23.621761+0000","last_became_peered":"2024-09-12T00:03:23.621761+0000","last_unstale":"2024-09-12T00:06:42.065464+0000","last_undegraded":"2024-09-12T00:06:42.065464+0000","last_fullsized":"2024-09-12T00:06:42.065464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:31.587668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"59'4","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066619+0000","last_change":"2024-09-12T00:06:28.859921+0000","last_active":"2024-09-12T00:06:42.066619+0000","last_peered":"2024-09-12T00:06:42.066619+0000","last_clean":"2024-09-12T00:06:42.066619+0000","last_became_active":"2024-09-12T00:06:26.677331+0000","last_became_peered":"2024-09-12T00:06:26.677331+0000","last_unstale":"2024-09-12T00:06:42.066619+0000","last_undegraded":"2024-09-12T00:06:42.066619+0000","last_fullsized":"2024-09-12T00:06:42.066619+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:05.062779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"96'24","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500399+0000","last_change":"2024-09-12T00:03:23.600956+0000","last_active":"2024-09-12T00:06:42.500399+0000","last_peered":"2024-09-12T00:06:42.500399+0000","last_clean":"2024-09-12T00:06:42.500399+0000","last_became_active":"2024-09-12T00:03:23.600673+0000","last_became_peered":"2024-09-12T00:03:23.600673+0000","last_unstale":"2024-09-12T00:06:42.500399+0000","last_undegraded":"2024-09-12T00:06:42.500399+0000","last_fullsized":"2024-09-12T00:06:42.500399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"96'6","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500670+0000","last_change":"2024-09-12T00:03:25.325088+0000","last_active":"2024-09-12T00:06:42.500670+0000","last_peered":"2024-09-12T00:06:42.500670+0000","last_clean":"2024-09-12T00:06:42.500670+0000","last_became_active":"2024-09-12T00:03:25.324597+0000","last_became_peered":"2024-09-12T00:03:25.324597+0000","last_unstale":"2024-09-12T00:06:42.500670+0000","last_undegraded":"2024-09-12T00:06:42.500670+0000","last_fullsized":"2024-09-12T00:06:42.500670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"95'19","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812155+0000","last_change":"2024-09-12T00:03:23.621791+0000","last_active":"2024-09-12T00:06:41.812155+0000","last_peered":"2024-09-12T00:06:41.812155+0000","last_clean":"2024-09-12T00:06:41.812155+0000","last_became_active":"2024-09-12T00:03:23.621063+0000","last_became_peered":"2024-09-12T00:03:23.621063+0000","last_unstale":"2024-09-12T00:06:41.812155+0000","last_undegraded":"2024-09-12T00:06:41.812155+0000","last_fullsized":"2024-09-12T00:06:41.812155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:33.234598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77594624,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":75776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500368+0000","last_change":"2024-09-12T00:03:25.357605+0000","last_active":"2024-09-12T00:06:42.500368+0000","last_peered":"2024-09-12T00:06:42.500368+0000","last_clean":"2024-09-12T00:06:42.500368+0000","last_became_active":"2024-09-12T00:03:25.357286+0000","last_became_peered":"2024-09-12T00:03:25.357286+0000","last_unstale":"2024-09-12T00:06:42.500368+0000","last_undegraded":"2024-09-12T00:06:42.500368+0000","last_fullsized":"2024-09-12T00:06:42.500368+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"96'21","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815686+0000","last_change":"2024-09-12T00:03:23.600931+0000","last_active":"2024-09-12T00:06:41.815686+0000","last_peered":"2024-09-12T00:06:41.815686+0000","last_clean":"2024-09-12T00:06:41.815686+0000","last_became_active":"2024-09-12T00:03:23.600591+0000","last_became_peered":"2024-09-12T00:03:23.600591+0000","last_unstale":"2024-09-12T00:06:41.815686+0000","last_undegraded":"2024-09-12T00:06:41.815686+0000","last_fullsized":"2024-09-12T00:06:41.815686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"84'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719420+0000","last_change":"2024-09-12T00:03:25.330869+0000","last_active":"2024-09-12T00:06:42.719420+0000","last_peered":"2024-09-12T00:06:42.719420+0000","last_clean":"2024-09-12T00:06:42.719420+0000","last_became_active":"2024-09-12T00:03:25.329742+0000","last_became_peered":"2024-09-12T00:03:25.329742+0000","last_unstale":"2024-09-12T00:06:42.719420+0000","last_undegraded":"2024-09-12T00:06:42.719420+0000","last_fullsized":"2024-09-12T00:06:42.719420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:01.365985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"95'32","reported_seq":105,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720260+0000","last_change":"2024-09-12T00:06:31.824748+0000","last_active":"2024-09-12T00:06:42.720260+0000","last_peered":"2024-09-12T00:06:42.720260+0000","last_clean":"2024-09-12T00:06:42.720260+0000","last_became_active":"2024-09-12T00:06:26.668022+0000","last_became_peered":"2024-09-12T00:06:26.668022+0000","last_unstale":"2024-09-12T00:06:42.720260+0000","last_undegraded":"2024-09-12T00:06:42.720260+0000","last_fullsized":"2024-09-12T00:06:42.720260+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:57.178468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":40,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":222298112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"59'4","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811470+0000","last_change":"2024-09-12T00:03:25.347570+0000","last_active":"2024-09-12T00:06:41.811470+0000","last_peered":"2024-09-12T00:06:41.811470+0000","last_clean":"2024-09-12T00:06:41.811470+0000","last_became_active":"2024-09-12T00:03:25.346874+0000","last_became_peered":"2024-09-12T00:03:25.346874+0000","last_unstale":"2024-09-12T00:06:41.811470+0000","last_undegraded":"2024-09-12T00:06:41.811470+0000","last_fullsized":"2024-09-12T00:06:41.811470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"96'23","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723730+0000","last_change":"2024-09-12T00:03:23.623417+0000","last_active":"2024-09-12T00:06:42.723730+0000","last_peered":"2024-09-12T00:06:42.723730+0000","last_clean":"2024-09-12T00:06:42.723730+0000","last_became_active":"2024-09-12T00:03:23.620261+0000","last_became_peered":"2024-09-12T00:03:23.620261+0000","last_unstale":"2024-09-12T00:06:42.723730+0000","last_undegraded":"2024-09-12T00:06:42.723730+0000","last_fullsized":"2024-09-12T00:06:42.723730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"63'8","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499989+0000","last_change":"2024-09-12T00:03:25.357492+0000","last_active":"2024-09-12T00:06:42.499989+0000","last_peered":"2024-09-12T00:06:42.499989+0000","last_clean":"2024-09-12T00:06:42.499989+0000","last_became_active":"2024-09-12T00:03:25.357186+0000","last_became_peered":"2024-09-12T00:03:25.357186+0000","last_unstale":"2024-09-12T00:06:42.499989+0000","last_undegraded":"2024-09-12T00:06:42.499989+0000","last_fullsized":"2024-09-12T00:06:42.499989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"96'26","reported_seq":95,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719726+0000","last_change":"2024-09-12T00:06:34.105256+0000","last_active":"2024-09-12T00:06:42.719726+0000","last_peered":"2024-09-12T00:06:42.719726+0000","last_clean":"2024-09-12T00:06:42.719726+0000","last_became_active":"2024-09-12T00:06:26.677360+0000","last_became_peered":"2024-09-12T00:06:26.677360+0000","last_unstale":"2024-09-12T00:06:42.719726+0000","last_undegraded":"2024-09-12T00:06:42.719726+0000","last_fullsized":"2024-09-12T00:06:42.719726+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:18.563619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":163577856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"96'27","reported_seq":97,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717277+0000","last_change":"2024-09-12T00:06:28.886144+0000","last_active":"2024-09-12T00:06:42.717277+0000","last_peered":"2024-09-12T00:06:42.717277+0000","last_clean":"2024-09-12T00:06:42.717277+0000","last_became_active":"2024-09-12T00:06:26.669830+0000","last_became_peered":"2024-09-12T00:06:26.669830+0000","last_unstale":"2024-09-12T00:06:42.717277+0000","last_undegraded":"2024-09-12T00:06:42.717277+0000","last_fullsized":"2024-09-12T00:06:42.717277+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:37.229011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":192937984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"84'6","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813636+0000","last_change":"2024-09-12T00:03:25.350116+0000","last_active":"2024-09-12T00:06:41.813636+0000","last_peered":"2024-09-12T00:06:41.813636+0000","last_clean":"2024-09-12T00:06:41.813636+0000","last_became_active":"2024-09-12T00:03:25.349281+0000","last_became_peered":"2024-09-12T00:03:25.349281+0000","last_unstale":"2024-09-12T00:06:41.813636+0000","last_undegraded":"2024-09-12T00:06:41.813636+0000","last_fullsized":"2024-09-12T00:06:41.813636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:33.350458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"96'20","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065234+0000","last_change":"2024-09-12T00:03:23.619574+0000","last_active":"2024-09-12T00:06:42.065234+0000","last_peered":"2024-09-12T00:06:42.065234+0000","last_clean":"2024-09-12T00:06:42.065234+0000","last_became_active":"2024-09-12T00:03:23.616154+0000","last_became_peered":"2024-09-12T00:03:23.616154+0000","last_unstale":"2024-09-12T00:06:42.065234+0000","last_undegraded":"2024-09-12T00:06:42.065234+0000","last_fullsized":"2024-09-12T00:06:42.065234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:46.335775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"58'2","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.502147+0000","last_change":"2024-09-12T00:03:25.345327+0000","last_active":"2024-09-12T00:06:42.502147+0000","last_peered":"2024-09-12T00:06:42.502147+0000","last_clean":"2024-09-12T00:06:42.502147+0000","last_became_active":"2024-09-12T00:03:25.344917+0000","last_became_peered":"2024-09-12T00:03:25.344917+0000","last_unstale":"2024-09-12T00:06:42.502147+0000","last_undegraded":"2024-09-12T00:06:42.502147+0000","last_fullsized":"2024-09-12T00:06:42.502147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":339,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1077,"ondisk_log_size":1077,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382934,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1135,"num_read_kb":865,"num_write":659,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":117531,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":951,"ondisk_log_size":951,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1444,"num_read_kb":1412,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1584,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":721,"num_bytes_recovered":3007315968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542192,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1112000,"kb_used_data":1080808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93259840,"statfs":{"total":96636764160,"available":95498076160,"internally_reserved":0,"allocated":1106747392,"data_stored":1106113870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542192,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1329084,"kb_used_data":1297892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93042756,"statfs":{"total":96636764160,"available":95275782144,"internally_reserved":0,"allocated":1329041408,"data_stored":1328412810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542192,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1794504,"kb_used_data":1759152,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92577336,"statfs":{"total":96636764160,"available":94799192064,"internally_reserved":0,"allocated":1801371648,"data_stored":1800744781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542192,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1329272,"kb_used_data":1293920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93042568,"statfs":{"total":96636764160,"available":95275589632,"internally_reserved":0,"allocated":1324974080,"data_stored":1324334685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542192,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1830964,"kb_used_data":1791448,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":92540876,"statfs":{"total":96636764160,"available":94761857024,"internally_reserved":0,"allocated":1834442752,"data_stored":1833824839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542193,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1806124,"kb_used_data":1774932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92565716,"statfs":{"total":96636764160,"available":94787293184,"internally_reserved":0,"allocated":1817530368,"data_stored":1816930588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542192,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1305184,"kb_used_data":1269832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93066656,"statfs":{"total":96636764160,"available":95300255744,"internally_reserved":0,"allocated":1300307968,"data_stored":1299644748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542191,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2084768,"kb_used_data":2049416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92287072,"statfs":{"total":96636764160,"available":94501961728,"internally_reserved":0,"allocated":2098601984,"data_stored":2097950685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2097152000,"data_stored":2097152000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1298137088,"data_stored":1298137088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1816133632,"data_stored":1816133632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1832910848,"data_stored":1832910848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1323302912,"data_stored":1323302912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1799356416,"data_stored":1799356416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1327497216,"data_stored":1327497216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1105199104,"data_stored":1105199104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":119156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":117311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":235112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":117531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":117713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:06:45.443 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:06:45.799 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:06:45.805 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T00:06:45.813 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2024-09-12T00:06:44.462524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300819945,"num_objects":1736,"num_object_clones":0,"num_object_copies":3472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1736,"num_whiteouts":0,"num_read":3480,"num_read_kb":3139,"num_write":2967,"num_write_kb":6187128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":928,"num_bytes_recovered":3007433610,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4047,"ondisk_log_size":4047,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12591900,"kb_used_data":12317400,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":742382820,"statfs":{"total":773094113280,"available":760200007680,"internally_reserved":0,"allocated":12613017600,"data_stored":12607957006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":280874546},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.684531"},"pg_stats":[{"pgid":"3.3f","version":"95'16","reported_seq":286,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.817134+0000","last_change":"2024-09-12T00:06:27.539898+0000","last_active":"2024-09-12T00:06:41.817134+0000","last_peered":"2024-09-12T00:06:41.817134+0000","last_clean":"2024-09-12T00:06:41.817134+0000","last_became_active":"2024-09-12T00:06:26.678792+0000","last_became_peered":"2024-09-12T00:06:26.678792+0000","last_unstale":"2024-09-12T00:06:41.817134+0000","last_undegraded":"2024-09-12T00:06:41.817134+0000","last_fullsized":"2024-09-12T00:06:41.817134+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:23.434133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'2","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499351+0000","last_change":"2024-09-12T00:03:25.337244+0000","last_active":"2024-09-12T00:06:42.499351+0000","last_peered":"2024-09-12T00:06:42.499351+0000","last_clean":"2024-09-12T00:06:42.499351+0000","last_became_active":"2024-09-12T00:03:25.335964+0000","last_became_peered":"2024-09-12T00:03:25.335964+0000","last_unstale":"2024-09-12T00:06:42.499351+0000","last_undegraded":"2024-09-12T00:06:42.499351+0000","last_fullsized":"2024-09-12T00:06:42.499351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"96'24","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067343+0000","last_change":"2024-09-12T00:03:23.628328+0000","last_active":"2024-09-12T00:06:42.067343+0000","last_peered":"2024-09-12T00:06:42.067343+0000","last_clean":"2024-09-12T00:06:42.067343+0000","last_became_active":"2024-09-12T00:03:23.627630+0000","last_became_peered":"2024-09-12T00:03:23.627630+0000","last_unstale":"2024-09-12T00:06:42.067343+0000","last_undegraded":"2024-09-12T00:06:42.067343+0000","last_fullsized":"2024-09-12T00:06:42.067343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:00.573006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"76'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717726+0000","last_change":"2024-09-12T00:06:27.903337+0000","last_active":"2024-09-12T00:06:42.717726+0000","last_peered":"2024-09-12T00:06:42.717726+0000","last_clean":"2024-09-12T00:06:42.717726+0000","last_became_active":"2024-09-12T00:06:26.660419+0000","last_became_peered":"2024-09-12T00:06:26.660419+0000","last_unstale":"2024-09-12T00:06:42.717726+0000","last_undegraded":"2024-09-12T00:06:42.717726+0000","last_fullsized":"2024-09-12T00:06:42.717726+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:43.714019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"96'29","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066706+0000","last_change":"2024-09-12T00:03:23.626533+0000","last_active":"2024-09-12T00:06:42.066706+0000","last_peered":"2024-09-12T00:06:42.066706+0000","last_clean":"2024-09-12T00:06:42.066706+0000","last_became_active":"2024-09-12T00:03:23.625728+0000","last_became_peered":"2024-09-12T00:03:23.625728+0000","last_unstale":"2024-09-12T00:06:42.066706+0000","last_undegraded":"2024-09-12T00:06:42.066706+0000","last_fullsized":"2024-09-12T00:06:42.066706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:31.772442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"96'4","reported_seq":47,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721615+0000","last_change":"2024-09-12T00:06:32.442375+0000","last_active":"2024-09-12T00:06:42.721615+0000","last_peered":"2024-09-12T00:06:42.721615+0000","last_clean":"2024-09-12T00:06:42.721615+0000","last_became_active":"2024-09-12T00:06:26.677271+0000","last_became_peered":"2024-09-12T00:06:26.677271+0000","last_unstale":"2024-09-12T00:06:42.721615+0000","last_undegraded":"2024-09-12T00:06:42.721615+0000","last_fullsized":"2024-09-12T00:06:42.721615+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:34.385926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"96'22","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812538+0000","last_change":"2024-09-12T00:03:23.609828+0000","last_active":"2024-09-12T00:06:41.812538+0000","last_peered":"2024-09-12T00:06:41.812538+0000","last_clean":"2024-09-12T00:06:41.812538+0000","last_became_active":"2024-09-12T00:03:23.609326+0000","last_became_peered":"2024-09-12T00:03:23.609326+0000","last_unstale":"2024-09-12T00:06:41.812538+0000","last_undegraded":"2024-09-12T00:06:41.812538+0000","last_fullsized":"2024-09-12T00:06:41.812538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:25.491620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'8","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812256+0000","last_change":"2024-09-12T00:03:25.339518+0000","last_active":"2024-09-12T00:06:41.812256+0000","last_peered":"2024-09-12T00:06:41.812256+0000","last_clean":"2024-09-12T00:06:41.812256+0000","last_became_active":"2024-09-12T00:03:25.338805+0000","last_became_peered":"2024-09-12T00:03:25.338805+0000","last_unstale":"2024-09-12T00:06:41.812256+0000","last_undegraded":"2024-09-12T00:06:41.812256+0000","last_fullsized":"2024-09-12T00:06:41.812256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"96'26","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810071+0000","last_change":"2024-09-12T00:03:23.633978+0000","last_active":"2024-09-12T00:06:41.810071+0000","last_peered":"2024-09-12T00:06:41.810071+0000","last_clean":"2024-09-12T00:06:41.810071+0000","last_became_active":"2024-09-12T00:03:23.633580+0000","last_became_peered":"2024-09-12T00:03:23.633580+0000","last_unstale":"2024-09-12T00:06:41.810071+0000","last_undegraded":"2024-09-12T00:06:41.810071+0000","last_fullsized":"2024-09-12T00:06:41.810071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:01.872688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809540+0000","last_change":"2024-09-12T00:03:25.324424+0000","last_active":"2024-09-12T00:06:41.809540+0000","last_peered":"2024-09-12T00:06:41.809540+0000","last_clean":"2024-09-12T00:06:41.809540+0000","last_became_active":"2024-09-12T00:03:25.324138+0000","last_became_peered":"2024-09-12T00:03:25.324138+0000","last_unstale":"2024-09-12T00:06:41.809540+0000","last_undegraded":"2024-09-12T00:06:41.809540+0000","last_fullsized":"2024-09-12T00:06:41.809540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:09.954252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"96'21","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812953+0000","last_change":"2024-09-12T00:03:23.610136+0000","last_active":"2024-09-12T00:06:41.812953+0000","last_peered":"2024-09-12T00:06:41.812953+0000","last_clean":"2024-09-12T00:06:41.812953+0000","last_became_active":"2024-09-12T00:03:23.609509+0000","last_became_peered":"2024-09-12T00:03:23.609509+0000","last_unstale":"2024-09-12T00:06:41.812953+0000","last_undegraded":"2024-09-12T00:06:41.812953+0000","last_fullsized":"2024-09-12T00:06:41.812953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"96'12","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.817127+0000","last_change":"2024-09-12T00:03:25.355256+0000","last_active":"2024-09-12T00:06:41.817127+0000","last_peered":"2024-09-12T00:06:41.817127+0000","last_clean":"2024-09-12T00:06:41.817127+0000","last_became_active":"2024-09-12T00:03:25.355002+0000","last_became_peered":"2024-09-12T00:03:25.355002+0000","last_unstale":"2024-09-12T00:06:41.817127+0000","last_undegraded":"2024-09-12T00:06:41.817127+0000","last_fullsized":"2024-09-12T00:06:41.817127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:50.488869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"96'28","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813544+0000","last_change":"2024-09-12T00:03:23.606780+0000","last_active":"2024-09-12T00:06:41.813544+0000","last_peered":"2024-09-12T00:06:41.813544+0000","last_clean":"2024-09-12T00:06:41.813544+0000","last_became_active":"2024-09-12T00:03:23.606143+0000","last_became_peered":"2024-09-12T00:03:23.606143+0000","last_unstale":"2024-09-12T00:06:41.813544+0000","last_undegraded":"2024-09-12T00:06:41.813544+0000","last_fullsized":"2024-09-12T00:06:41.813544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:22.889982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813590+0000","last_change":"2024-09-12T00:03:25.330195+0000","last_active":"2024-09-12T00:06:41.813590+0000","last_peered":"2024-09-12T00:06:41.813590+0000","last_clean":"2024-09-12T00:06:41.813590+0000","last_became_active":"2024-09-12T00:03:25.329625+0000","last_became_peered":"2024-09-12T00:03:25.329625+0000","last_unstale":"2024-09-12T00:06:41.813590+0000","last_undegraded":"2024-09-12T00:06:41.813590+0000","last_fullsized":"2024-09-12T00:06:41.813590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"96'27","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064982+0000","last_change":"2024-09-12T00:03:23.626723+0000","last_active":"2024-09-12T00:06:42.064982+0000","last_peered":"2024-09-12T00:06:42.064982+0000","last_clean":"2024-09-12T00:06:42.064982+0000","last_became_active":"2024-09-12T00:03:23.626018+0000","last_became_peered":"2024-09-12T00:03:23.626018+0000","last_unstale":"2024-09-12T00:06:42.064982+0000","last_undegraded":"2024-09-12T00:06:42.064982+0000","last_fullsized":"2024-09-12T00:06:42.064982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"59'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067823+0000","last_change":"2024-09-12T00:03:25.352418+0000","last_active":"2024-09-12T00:06:42.067823+0000","last_peered":"2024-09-12T00:06:42.067823+0000","last_clean":"2024-09-12T00:06:42.067823+0000","last_became_active":"2024-09-12T00:03:25.347902+0000","last_became_peered":"2024-09-12T00:03:25.347902+0000","last_unstale":"2024-09-12T00:06:42.067823+0000","last_undegraded":"2024-09-12T00:06:42.067823+0000","last_fullsized":"2024-09-12T00:06:42.067823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:29.611790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"59'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719921+0000","last_change":"2024-09-12T00:06:27.342563+0000","last_active":"2024-09-12T00:06:42.719921+0000","last_peered":"2024-09-12T00:06:42.719921+0000","last_clean":"2024-09-12T00:06:42.719921+0000","last_became_active":"2024-09-12T00:06:26.653851+0000","last_became_peered":"2024-09-12T00:06:26.653851+0000","last_unstale":"2024-09-12T00:06:42.719921+0000","last_undegraded":"2024-09-12T00:06:42.719921+0000","last_fullsized":"2024-09-12T00:06:42.719921+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:14.109429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"95'17","reported_seq":285,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501969+0000","last_change":"2024-09-12T00:06:27.069520+0000","last_active":"2024-09-12T00:06:42.501969+0000","last_peered":"2024-09-12T00:06:42.501969+0000","last_clean":"2024-09-12T00:06:42.501969+0000","last_became_active":"2024-09-12T00:06:26.664959+0000","last_became_peered":"2024-09-12T00:06:26.664959+0000","last_unstale":"2024-09-12T00:06:42.501969+0000","last_undegraded":"2024-09-12T00:06:42.501969+0000","last_fullsized":"2024-09-12T00:06:42.501969+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:35.231503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813150+0000","last_change":"2024-09-12T00:03:25.334966+0000","last_active":"2024-09-12T00:06:41.813150+0000","last_peered":"2024-09-12T00:06:41.813150+0000","last_clean":"2024-09-12T00:06:41.813150+0000","last_became_active":"2024-09-12T00:03:25.334375+0000","last_became_peered":"2024-09-12T00:03:25.334375+0000","last_unstale":"2024-09-12T00:06:41.813150+0000","last_undegraded":"2024-09-12T00:06:41.813150+0000","last_fullsized":"2024-09-12T00:06:41.813150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:52.828056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"96'20","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816433+0000","last_change":"2024-09-12T00:03:23.614289+0000","last_active":"2024-09-12T00:06:41.816433+0000","last_peered":"2024-09-12T00:06:41.816433+0000","last_clean":"2024-09-12T00:06:41.816433+0000","last_became_active":"2024-09-12T00:03:23.614019+0000","last_became_peered":"2024-09-12T00:03:23.614019+0000","last_unstale":"2024-09-12T00:06:41.816433+0000","last_undegraded":"2024-09-12T00:06:41.816433+0000","last_fullsized":"2024-09-12T00:06:41.816433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:00.847027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"96'12","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500281+0000","last_change":"2024-09-12T00:03:25.357938+0000","last_active":"2024-09-12T00:06:42.500281+0000","last_peered":"2024-09-12T00:06:42.500281+0000","last_clean":"2024-09-12T00:06:42.500281+0000","last_became_active":"2024-09-12T00:03:25.357571+0000","last_became_peered":"2024-09-12T00:03:25.357571+0000","last_unstale":"2024-09-12T00:06:42.500281+0000","last_undegraded":"2024-09-12T00:06:42.500281+0000","last_fullsized":"2024-09-12T00:06:42.500281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:05.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"95'23","reported_seq":315,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816438+0000","last_change":"2024-09-12T00:06:28.845144+0000","last_active":"2024-09-12T00:06:41.816438+0000","last_peered":"2024-09-12T00:06:41.816438+0000","last_clean":"2024-09-12T00:06:41.816438+0000","last_became_active":"2024-09-12T00:06:26.682027+0000","last_became_peered":"2024-09-12T00:06:26.682027+0000","last_unstale":"2024-09-12T00:06:41.816438+0000","last_undegraded":"2024-09-12T00:06:41.816438+0000","last_fullsized":"2024-09-12T00:06:41.816438+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:24.330401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":167772160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'8","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721712+0000","last_change":"2024-09-12T00:03:25.345717+0000","last_active":"2024-09-12T00:06:42.721712+0000","last_peered":"2024-09-12T00:06:42.721712+0000","last_clean":"2024-09-12T00:06:42.721712+0000","last_became_active":"2024-09-12T00:03:25.344959+0000","last_became_peered":"2024-09-12T00:03:25.344959+0000","last_unstale":"2024-09-12T00:06:42.721712+0000","last_undegraded":"2024-09-12T00:06:42.721712+0000","last_fullsized":"2024-09-12T00:06:42.721712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"96'17","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815332+0000","last_change":"2024-09-12T00:03:23.602960+0000","last_active":"2024-09-12T00:06:41.815332+0000","last_peered":"2024-09-12T00:06:41.815332+0000","last_clean":"2024-09-12T00:06:41.815332+0000","last_became_active":"2024-09-12T00:03:23.602640+0000","last_became_peered":"2024-09-12T00:03:23.602640+0000","last_unstale":"2024-09-12T00:06:41.815332+0000","last_undegraded":"2024-09-12T00:06:41.815332+0000","last_fullsized":"2024-09-12T00:06:41.815332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"59'2","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066326+0000","last_change":"2024-09-12T00:06:28.300294+0000","last_active":"2024-09-12T00:06:42.066326+0000","last_peered":"2024-09-12T00:06:42.066326+0000","last_clean":"2024-09-12T00:06:42.066326+0000","last_became_active":"2024-09-12T00:06:26.665307+0000","last_became_peered":"2024-09-12T00:06:26.665307+0000","last_unstale":"2024-09-12T00:06:42.066326+0000","last_undegraded":"2024-09-12T00:06:42.066326+0000","last_fullsized":"2024-09-12T00:06:42.066326+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:18.349268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"96'23","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722623+0000","last_change":"2024-09-12T00:03:23.604732+0000","last_active":"2024-09-12T00:06:42.722623+0000","last_peered":"2024-09-12T00:06:42.722623+0000","last_clean":"2024-09-12T00:06:42.722623+0000","last_became_active":"2024-09-12T00:03:23.603932+0000","last_became_peered":"2024-09-12T00:03:23.603932+0000","last_unstale":"2024-09-12T00:06:42.722623+0000","last_undegraded":"2024-09-12T00:06:42.722623+0000","last_fullsized":"2024-09-12T00:06:42.722623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:14.913580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"76'4","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501143+0000","last_change":"2024-09-12T00:03:25.341332+0000","last_active":"2024-09-12T00:06:42.501143+0000","last_peered":"2024-09-12T00:06:42.501143+0000","last_clean":"2024-09-12T00:06:42.501143+0000","last_became_active":"2024-09-12T00:03:25.340828+0000","last_became_peered":"2024-09-12T00:03:25.340828+0000","last_unstale":"2024-09-12T00:06:42.501143+0000","last_undegraded":"2024-09-12T00:06:42.501143+0000","last_fullsized":"2024-09-12T00:06:42.501143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"95'18","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722863+0000","last_change":"2024-09-12T00:03:23.602687+0000","last_active":"2024-09-12T00:06:42.722863+0000","last_peered":"2024-09-12T00:06:42.722863+0000","last_clean":"2024-09-12T00:06:42.722863+0000","last_became_active":"2024-09-12T00:03:23.601892+0000","last_became_peered":"2024-09-12T00:03:23.601892+0000","last_unstale":"2024-09-12T00:06:42.722863+0000","last_undegraded":"2024-09-12T00:06:42.722863+0000","last_fullsized":"2024-09-12T00:06:42.722863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.808845+0000","last_change":"2024-09-12T00:03:33.354850+0000","last_active":"2024-09-12T00:06:41.808845+0000","last_peered":"2024-09-12T00:06:41.808845+0000","last_clean":"2024-09-12T00:06:41.808845+0000","last_became_active":"2024-09-12T00:03:33.351917+0000","last_became_peered":"2024-09-12T00:03:33.351917+0000","last_unstale":"2024-09-12T00:06:41.808845+0000","last_undegraded":"2024-09-12T00:06:41.808845+0000","last_fullsized":"2024-09-12T00:06:41.808845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:00.466863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"59'6","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721027+0000","last_change":"2024-09-12T00:03:25.323174+0000","last_active":"2024-09-12T00:06:42.721027+0000","last_peered":"2024-09-12T00:06:42.721027+0000","last_clean":"2024-09-12T00:06:42.721027+0000","last_became_active":"2024-09-12T00:03:25.322456+0000","last_became_peered":"2024-09-12T00:03:25.322456+0000","last_unstale":"2024-09-12T00:06:42.721027+0000","last_undegraded":"2024-09-12T00:06:42.721027+0000","last_fullsized":"2024-09-12T00:06:42.721027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"96'27","reported_seq":97,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721346+0000","last_change":"2024-09-12T00:06:27.333722+0000","last_active":"2024-09-12T00:06:42.721346+0000","last_peered":"2024-09-12T00:06:42.721346+0000","last_clean":"2024-09-12T00:06:42.721346+0000","last_became_active":"2024-09-12T00:06:26.648460+0000","last_became_peered":"2024-09-12T00:06:26.648460+0000","last_unstale":"2024-09-12T00:06:42.721346+0000","last_undegraded":"2024-09-12T00:06:42.721346+0000","last_fullsized":"2024-09-12T00:06:42.721346+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:17.751627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717693+0000","last_change":"2024-09-12T00:06:26.675813+0000","last_active":"2024-09-12T00:06:42.717693+0000","last_peered":"2024-09-12T00:06:42.717693+0000","last_clean":"2024-09-12T00:06:42.717693+0000","last_became_active":"2024-09-12T00:06:26.663654+0000","last_became_peered":"2024-09-12T00:06:26.663654+0000","last_unstale":"2024-09-12T00:06:42.717693+0000","last_undegraded":"2024-09-12T00:06:42.717693+0000","last_fullsized":"2024-09-12T00:06:42.717693+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:22.865255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"96'29","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812965+0000","last_change":"2024-09-12T00:03:29.347224+0000","last_active":"2024-09-12T00:06:41.812965+0000","last_peered":"2024-09-12T00:06:41.812965+0000","last_clean":"2024-09-12T00:06:41.812965+0000","last_became_active":"2024-09-12T00:03:29.346662+0000","last_became_peered":"2024-09-12T00:03:29.346662+0000","last_unstale":"2024-09-12T00:06:41.812965+0000","last_undegraded":"2024-09-12T00:06:41.812965+0000","last_fullsized":"2024-09-12T00:06:41.812965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:28.258932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501404+0000","last_change":"2024-09-12T00:03:31.337219+0000","last_active":"2024-09-12T00:06:42.501404+0000","last_peered":"2024-09-12T00:06:42.501404+0000","last_clean":"2024-09-12T00:06:42.501404+0000","last_became_active":"2024-09-12T00:03:31.336317+0000","last_became_peered":"2024-09-12T00:03:31.336317+0000","last_unstale":"2024-09-12T00:06:42.501404+0000","last_undegraded":"2024-09-12T00:06:42.501404+0000","last_fullsized":"2024-09-12T00:06:42.501404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:50.954053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"96'48","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499219+0000","last_change":"2024-09-12T00:03:33.376628+0000","last_active":"2024-09-12T00:06:42.499219+0000","last_peered":"2024-09-12T00:06:42.499219+0000","last_clean":"2024-09-12T00:06:42.499219+0000","last_became_active":"2024-09-12T00:03:33.375938+0000","last_became_peered":"2024-09-12T00:03:33.375938+0000","last_unstale":"2024-09-12T00:06:42.499219+0000","last_undegraded":"2024-09-12T00:06:42.499219+0000","last_fullsized":"2024-09-12T00:06:42.499219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:31.105042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"84'8","reported_seq":51,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717938+0000","last_change":"2024-09-12T00:06:32.981663+0000","last_active":"2024-09-12T00:06:42.717938+0000","last_peered":"2024-09-12T00:06:42.717938+0000","last_clean":"2024-09-12T00:06:42.717938+0000","last_became_active":"2024-09-12T00:06:26.679390+0000","last_became_peered":"2024-09-12T00:06:26.679390+0000","last_unstale":"2024-09-12T00:06:42.717938+0000","last_undegraded":"2024-09-12T00:06:42.717938+0000","last_fullsized":"2024-09-12T00:06:42.717938+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.655318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"96'14","reported_seq":267,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723059+0000","last_change":"2024-09-12T00:06:28.270104+0000","last_active":"2024-09-12T00:06:42.723059+0000","last_peered":"2024-09-12T00:06:42.723059+0000","last_clean":"2024-09-12T00:06:42.723059+0000","last_became_active":"2024-09-12T00:06:26.675473+0000","last_became_peered":"2024-09-12T00:06:26.675473+0000","last_unstale":"2024-09-12T00:06:42.723059+0000","last_undegraded":"2024-09-12T00:06:42.723059+0000","last_fullsized":"2024-09-12T00:06:42.723059+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:45.446239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812081+0000","last_change":"2024-09-12T00:03:27.336108+0000","last_active":"2024-09-12T00:06:41.812081+0000","last_peered":"2024-09-12T00:06:41.812081+0000","last_clean":"2024-09-12T00:06:41.812081+0000","last_became_active":"2024-09-12T00:03:27.335308+0000","last_became_peered":"2024-09-12T00:03:27.335308+0000","last_unstale":"2024-09-12T00:06:41.812081+0000","last_undegraded":"2024-09-12T00:06:41.812081+0000","last_fullsized":"2024-09-12T00:06:41.812081+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:39.812803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'12","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501517+0000","last_change":"2024-09-12T00:03:29.352496+0000","last_active":"2024-09-12T00:06:42.501517+0000","last_peered":"2024-09-12T00:06:42.501517+0000","last_clean":"2024-09-12T00:06:42.501517+0000","last_became_active":"2024-09-12T00:03:29.351783+0000","last_became_peered":"2024-09-12T00:03:29.351783+0000","last_unstale":"2024-09-12T00:06:42.501517+0000","last_undegraded":"2024-09-12T00:06:42.501517+0000","last_fullsized":"2024-09-12T00:06:42.501517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501338+0000","last_change":"2024-09-12T00:03:31.350279+0000","last_active":"2024-09-12T00:06:42.501338+0000","last_peered":"2024-09-12T00:06:42.501338+0000","last_clean":"2024-09-12T00:06:42.501338+0000","last_became_active":"2024-09-12T00:03:31.349244+0000","last_became_peered":"2024-09-12T00:03:31.349244+0000","last_unstale":"2024-09-12T00:06:42.501338+0000","last_undegraded":"2024-09-12T00:06:42.501338+0000","last_fullsized":"2024-09-12T00:06:42.501338+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.420974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719171+0000","last_change":"2024-09-12T00:03:33.382726+0000","last_active":"2024-09-12T00:06:42.719171+0000","last_peered":"2024-09-12T00:06:42.719171+0000","last_clean":"2024-09-12T00:06:42.719171+0000","last_became_active":"2024-09-12T00:03:33.381875+0000","last_became_peered":"2024-09-12T00:03:33.381875+0000","last_unstale":"2024-09-12T00:06:42.719171+0000","last_undegraded":"2024-09-12T00:06:42.719171+0000","last_fullsized":"2024-09-12T00:06:42.719171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"63'12","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066812+0000","last_change":"2024-09-12T00:03:25.357883+0000","last_active":"2024-09-12T00:06:42.066812+0000","last_peered":"2024-09-12T00:06:42.066812+0000","last_clean":"2024-09-12T00:06:42.066812+0000","last_became_active":"2024-09-12T00:03:25.355174+0000","last_became_peered":"2024-09-12T00:03:25.355174+0000","last_unstale":"2024-09-12T00:06:42.066812+0000","last_undegraded":"2024-09-12T00:06:42.066812+0000","last_fullsized":"2024-09-12T00:06:42.066812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:26.621650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"96'21","reported_seq":85,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721209+0000","last_change":"2024-09-12T00:06:29.505713+0000","last_active":"2024-09-12T00:06:42.721209+0000","last_peered":"2024-09-12T00:06:42.721209+0000","last_clean":"2024-09-12T00:06:42.721209+0000","last_became_active":"2024-09-12T00:06:26.670936+0000","last_became_peered":"2024-09-12T00:06:26.670936+0000","last_unstale":"2024-09-12T00:06:42.721209+0000","last_undegraded":"2024-09-12T00:06:42.721209+0000","last_fullsized":"2024-09-12T00:06:42.721209+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:12.048117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813428+0000","last_change":"2024-09-12T00:03:27.347098+0000","last_active":"2024-09-12T00:06:41.813428+0000","last_peered":"2024-09-12T00:06:41.813428+0000","last_clean":"2024-09-12T00:06:41.813428+0000","last_became_active":"2024-09-12T00:03:27.346346+0000","last_became_peered":"2024-09-12T00:03:27.346346+0000","last_unstale":"2024-09-12T00:06:41.813428+0000","last_undegraded":"2024-09-12T00:06:41.813428+0000","last_fullsized":"2024-09-12T00:06:41.813428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:56.250627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'22","reported_seq":265,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812213+0000","last_change":"2024-09-12T00:06:27.562833+0000","last_active":"2024-09-12T00:06:41.812213+0000","last_peered":"2024-09-12T00:06:41.812213+0000","last_clean":"2024-09-12T00:06:41.812213+0000","last_became_active":"2024-09-12T00:06:26.654182+0000","last_became_peered":"2024-09-12T00:06:26.654182+0000","last_unstale":"2024-09-12T00:06:41.812213+0000","last_undegraded":"2024-09-12T00:06:41.812213+0000","last_fullsized":"2024-09-12T00:06:41.812213+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:01.211483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"106'139","reported_seq":361,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.724446+0000","last_change":"2024-09-12T00:06:30.699178+0000","last_active":"2024-09-12T00:06:42.724446+0000","last_peered":"2024-09-12T00:06:42.724446+0000","last_clean":"2024-09-12T00:06:42.724446+0000","last_became_active":"2024-09-12T00:06:30.698465+0000","last_became_peered":"2024-09-12T00:06:30.698465+0000","last_unstale":"2024-09-12T00:06:42.724446+0000","last_undegraded":"2024-09-12T00:06:42.724446+0000","last_fullsized":"2024-09-12T00:06:42.724446+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:48.150663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810365+0000","last_change":"2024-09-12T00:03:33.378439+0000","last_active":"2024-09-12T00:06:41.810365+0000","last_peered":"2024-09-12T00:06:41.810365+0000","last_clean":"2024-09-12T00:06:41.810365+0000","last_became_active":"2024-09-12T00:03:33.374453+0000","last_became_peered":"2024-09-12T00:03:33.374453+0000","last_unstale":"2024-09-12T00:06:41.810365+0000","last_undegraded":"2024-09-12T00:06:41.810365+0000","last_fullsized":"2024-09-12T00:06:41.810365+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"58'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067326+0000","last_change":"2024-09-12T00:03:25.356433+0000","last_active":"2024-09-12T00:06:42.067326+0000","last_peered":"2024-09-12T00:06:42.067326+0000","last_clean":"2024-09-12T00:06:42.067326+0000","last_became_active":"2024-09-12T00:03:25.354803+0000","last_became_peered":"2024-09-12T00:03:25.354803+0000","last_unstale":"2024-09-12T00:06:42.067326+0000","last_undegraded":"2024-09-12T00:06:42.067326+0000","last_fullsized":"2024-09-12T00:06:42.067326+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:00.419686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"96'23","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499086+0000","last_change":"2024-09-12T00:03:23.630527+0000","last_active":"2024-09-12T00:06:42.499086+0000","last_peered":"2024-09-12T00:06:42.499086+0000","last_clean":"2024-09-12T00:06:42.499086+0000","last_became_active":"2024-09-12T00:03:23.630183+0000","last_became_peered":"2024-09-12T00:03:23.630183+0000","last_unstale":"2024-09-12T00:06:42.499086+0000","last_undegraded":"2024-09-12T00:06:42.499086+0000","last_fullsized":"2024-09-12T00:06:42.499086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94371840,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721999+0000","last_change":"2024-09-12T00:06:26.671315+0000","last_active":"2024-09-12T00:06:42.721999+0000","last_peered":"2024-09-12T00:06:42.721999+0000","last_clean":"2024-09-12T00:06:42.721999+0000","last_became_active":"2024-09-12T00:06:26.669946+0000","last_became_peered":"2024-09-12T00:06:26.669946+0000","last_unstale":"2024-09-12T00:06:42.721999+0000","last_undegraded":"2024-09-12T00:06:42.721999+0000","last_fullsized":"2024-09-12T00:06:42.721999+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:53.569121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"96'23","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812548+0000","last_change":"2024-09-12T00:03:29.339735+0000","last_active":"2024-09-12T00:06:41.812548+0000","last_peered":"2024-09-12T00:06:41.812548+0000","last_clean":"2024-09-12T00:06:41.812548+0000","last_became_active":"2024-09-12T00:03:29.338810+0000","last_became_peered":"2024-09-12T00:03:29.338810+0000","last_unstale":"2024-09-12T00:06:41.812548+0000","last_undegraded":"2024-09-12T00:06:41.812548+0000","last_fullsized":"2024-09-12T00:06:41.812548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"96'134","reported_seq":431,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066934+0000","last_change":"2024-09-12T00:03:31.364647+0000","last_active":"2024-09-12T00:06:42.066934+0000","last_peered":"2024-09-12T00:06:42.066934+0000","last_clean":"2024-09-12T00:06:42.066934+0000","last_became_active":"2024-09-12T00:03:31.353547+0000","last_became_peered":"2024-09-12T00:03:31.353547+0000","last_unstale":"2024-09-12T00:06:42.066934+0000","last_undegraded":"2024-09-12T00:06:42.066934+0000","last_fullsized":"2024-09-12T00:06:42.066934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:20.795870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"63'4","reported_seq":47,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717416+0000","last_change":"2024-09-12T00:06:27.339590+0000","last_active":"2024-09-12T00:06:42.717416+0000","last_peered":"2024-09-12T00:06:42.717416+0000","last_clean":"2024-09-12T00:06:42.717416+0000","last_became_active":"2024-09-12T00:06:26.651618+0000","last_became_peered":"2024-09-12T00:06:26.651618+0000","last_unstale":"2024-09-12T00:06:42.717416+0000","last_undegraded":"2024-09-12T00:06:42.717416+0000","last_fullsized":"2024-09-12T00:06:42.717416+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:58.850777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"96'29","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.817312+0000","last_change":"2024-09-12T00:03:23.602206+0000","last_active":"2024-09-12T00:06:41.817312+0000","last_peered":"2024-09-12T00:06:41.817312+0000","last_clean":"2024-09-12T00:06:41.817312+0000","last_became_active":"2024-09-12T00:03:23.601898+0000","last_became_peered":"2024-09-12T00:03:23.601898+0000","last_unstale":"2024-09-12T00:06:41.817312+0000","last_undegraded":"2024-09-12T00:06:41.817312+0000","last_fullsized":"2024-09-12T00:06:41.817312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:52.625795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499596+0000","last_change":"2024-09-12T00:03:27.331111+0000","last_active":"2024-09-12T00:06:42.499596+0000","last_peered":"2024-09-12T00:06:42.499596+0000","last_clean":"2024-09-12T00:06:42.499596+0000","last_became_active":"2024-09-12T00:03:27.329672+0000","last_became_peered":"2024-09-12T00:03:27.329672+0000","last_unstale":"2024-09-12T00:06:42.499596+0000","last_undegraded":"2024-09-12T00:06:42.499596+0000","last_fullsized":"2024-09-12T00:06:42.499596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"96'34","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814758+0000","last_change":"2024-09-12T00:03:29.335931+0000","last_active":"2024-09-12T00:06:41.814758+0000","last_peered":"2024-09-12T00:06:41.814758+0000","last_clean":"2024-09-12T00:06:41.814758+0000","last_became_active":"2024-09-12T00:03:29.335044+0000","last_became_peered":"2024-09-12T00:03:29.335044+0000","last_unstale":"2024-09-12T00:06:41.814758+0000","last_undegraded":"2024-09-12T00:06:41.814758+0000","last_fullsized":"2024-09-12T00:06:41.814758+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:57.131209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719379+0000","last_change":"2024-09-12T00:03:31.355001+0000","last_active":"2024-09-12T00:06:42.719379+0000","last_peered":"2024-09-12T00:06:42.719379+0000","last_clean":"2024-09-12T00:06:42.719379+0000","last_became_active":"2024-09-12T00:03:31.354160+0000","last_became_peered":"2024-09-12T00:03:31.354160+0000","last_unstale":"2024-09-12T00:06:42.719379+0000","last_undegraded":"2024-09-12T00:06:42.719379+0000","last_fullsized":"2024-09-12T00:06:42.719379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:29.868141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810884+0000","last_change":"2024-09-12T00:06:26.664709+0000","last_active":"2024-09-12T00:06:41.810884+0000","last_peered":"2024-09-12T00:06:41.810884+0000","last_clean":"2024-09-12T00:06:41.810884+0000","last_became_active":"2024-09-12T00:06:26.664401+0000","last_became_peered":"2024-09-12T00:06:26.664401+0000","last_unstale":"2024-09-12T00:06:41.810884+0000","last_undegraded":"2024-09-12T00:06:41.810884+0000","last_fullsized":"2024-09-12T00:06:41.810884+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:17.791780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'2","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499737+0000","last_change":"2024-09-12T00:03:25.357300+0000","last_active":"2024-09-12T00:06:42.499737+0000","last_peered":"2024-09-12T00:06:42.499737+0000","last_clean":"2024-09-12T00:06:42.499737+0000","last_became_active":"2024-09-12T00:03:25.356970+0000","last_became_peered":"2024-09-12T00:03:25.356970+0000","last_unstale":"2024-09-12T00:06:42.499737+0000","last_undegraded":"2024-09-12T00:06:42.499737+0000","last_fullsized":"2024-09-12T00:06:42.499737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:04.193738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"96'19","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814414+0000","last_change":"2024-09-12T00:03:23.609700+0000","last_active":"2024-09-12T00:06:41.814414+0000","last_peered":"2024-09-12T00:06:41.814414+0000","last_clean":"2024-09-12T00:06:41.814414+0000","last_became_active":"2024-09-12T00:03:23.609435+0000","last_became_peered":"2024-09-12T00:03:23.609435+0000","last_unstale":"2024-09-12T00:06:41.814414+0000","last_undegraded":"2024-09-12T00:06:41.814414+0000","last_fullsized":"2024-09-12T00:06:41.814414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720734+0000","last_change":"2024-09-12T00:03:27.339670+0000","last_active":"2024-09-12T00:06:42.720734+0000","last_peered":"2024-09-12T00:06:42.720734+0000","last_clean":"2024-09-12T00:06:42.720734+0000","last_became_active":"2024-09-12T00:03:27.338880+0000","last_became_peered":"2024-09-12T00:03:27.338880+0000","last_unstale":"2024-09-12T00:06:42.720734+0000","last_undegraded":"2024-09-12T00:06:42.720734+0000","last_fullsized":"2024-09-12T00:06:42.720734+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:35.068652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"96'25","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811038+0000","last_change":"2024-09-12T00:03:29.337666+0000","last_active":"2024-09-12T00:06:41.811038+0000","last_peered":"2024-09-12T00:06:41.811038+0000","last_clean":"2024-09-12T00:06:41.811038+0000","last_became_active":"2024-09-12T00:03:29.336957+0000","last_became_peered":"2024-09-12T00:03:29.336957+0000","last_unstale":"2024-09-12T00:06:41.811038+0000","last_undegraded":"2024-09-12T00:06:41.811038+0000","last_fullsized":"2024-09-12T00:06:41.811038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:58.417315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":21,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810940+0000","last_change":"2024-09-12T00:03:31.348590+0000","last_active":"2024-09-12T00:06:41.810940+0000","last_peered":"2024-09-12T00:06:41.810940+0000","last_clean":"2024-09-12T00:06:41.810940+0000","last_became_active":"2024-09-12T00:03:31.347736+0000","last_became_peered":"2024-09-12T00:03:31.347736+0000","last_unstale":"2024-09-12T00:06:41.810940+0000","last_undegraded":"2024-09-12T00:06:41.810940+0000","last_fullsized":"2024-09-12T00:06:41.810940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:04.962492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"59'8","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500524+0000","last_change":"2024-09-12T00:03:33.379699+0000","last_active":"2024-09-12T00:06:42.500524+0000","last_peered":"2024-09-12T00:06:42.500524+0000","last_clean":"2024-09-12T00:06:42.500524+0000","last_became_active":"2024-09-12T00:03:33.378945+0000","last_became_peered":"2024-09-12T00:03:33.378945+0000","last_unstale":"2024-09-12T00:06:42.500524+0000","last_undegraded":"2024-09-12T00:06:42.500524+0000","last_fullsized":"2024-09-12T00:06:42.500524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:23.270488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'6","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812122+0000","last_change":"2024-09-12T00:06:28.326850+0000","last_active":"2024-09-12T00:06:41.812122+0000","last_peered":"2024-09-12T00:06:41.812122+0000","last_clean":"2024-09-12T00:06:41.812122+0000","last_became_active":"2024-09-12T00:06:26.668131+0000","last_became_peered":"2024-09-12T00:06:26.668131+0000","last_unstale":"2024-09-12T00:06:41.812122+0000","last_undegraded":"2024-09-12T00:06:41.812122+0000","last_fullsized":"2024-09-12T00:06:41.812122+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:18.255160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"95'17","reported_seq":77,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717787+0000","last_change":"2024-09-12T00:06:33.441486+0000","last_active":"2024-09-12T00:06:42.717787+0000","last_peered":"2024-09-12T00:06:42.717787+0000","last_clean":"2024-09-12T00:06:42.717787+0000","last_became_active":"2024-09-12T00:06:26.679723+0000","last_became_peered":"2024-09-12T00:06:26.679723+0000","last_unstale":"2024-09-12T00:06:42.717787+0000","last_undegraded":"2024-09-12T00:06:42.717787+0000","last_fullsized":"2024-09-12T00:06:42.717787+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:59.722762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065103+0000","last_change":"2024-09-12T00:03:27.348080+0000","last_active":"2024-09-12T00:06:42.065103+0000","last_peered":"2024-09-12T00:06:42.065103+0000","last_clean":"2024-09-12T00:06:42.065103+0000","last_became_active":"2024-09-12T00:03:27.347288+0000","last_became_peered":"2024-09-12T00:03:27.347288+0000","last_unstale":"2024-09-12T00:06:42.065103+0000","last_undegraded":"2024-09-12T00:06:42.065103+0000","last_fullsized":"2024-09-12T00:06:42.065103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:37.033224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"96'37","reported_seq":61,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720107+0000","last_change":"2024-09-12T00:06:28.360303+0000","last_active":"2024-09-12T00:06:42.720107+0000","last_peered":"2024-09-12T00:06:42.720107+0000","last_clean":"2024-09-12T00:06:42.720107+0000","last_became_active":"2024-09-12T00:06:26.668791+0000","last_became_peered":"2024-09-12T00:06:26.668791+0000","last_unstale":"2024-09-12T00:06:42.720107+0000","last_undegraded":"2024-09-12T00:06:42.720107+0000","last_fullsized":"2024-09-12T00:06:42.720107+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:49.033011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120747,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":45,"num_read_kb":34,"num_write":30,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":116871,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"96'134","reported_seq":350,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064561+0000","last_change":"2024-09-12T00:03:31.354114+0000","last_active":"2024-09-12T00:06:42.064561+0000","last_peered":"2024-09-12T00:06:42.064561+0000","last_clean":"2024-09-12T00:06:42.064561+0000","last_became_active":"2024-09-12T00:03:31.353358+0000","last_became_peered":"2024-09-12T00:03:31.353358+0000","last_unstale":"2024-09-12T00:06:42.064561+0000","last_undegraded":"2024-09-12T00:06:42.064561+0000","last_fullsized":"2024-09-12T00:06:42.064561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:56.624718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719909+0000","last_change":"2024-09-12T00:03:33.383917+0000","last_active":"2024-09-12T00:06:42.719909+0000","last_peered":"2024-09-12T00:06:42.719909+0000","last_clean":"2024-09-12T00:06:42.719909+0000","last_became_active":"2024-09-12T00:03:33.383199+0000","last_became_peered":"2024-09-12T00:03:33.383199+0000","last_unstale":"2024-09-12T00:06:42.719909+0000","last_undegraded":"2024-09-12T00:06:42.719909+0000","last_fullsized":"2024-09-12T00:06:42.719909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:37.428182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"84'10","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065948+0000","last_change":"2024-09-12T00:03:25.356706+0000","last_active":"2024-09-12T00:06:42.065948+0000","last_peered":"2024-09-12T00:06:42.065948+0000","last_clean":"2024-09-12T00:06:42.065948+0000","last_became_active":"2024-09-12T00:03:25.354555+0000","last_became_peered":"2024-09-12T00:03:25.354555+0000","last_unstale":"2024-09-12T00:06:42.065948+0000","last_undegraded":"2024-09-12T00:06:42.065948+0000","last_fullsized":"2024-09-12T00:06:42.065948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:55.543336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"96'39","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815809+0000","last_change":"2024-09-12T00:03:23.612430+0000","last_active":"2024-09-12T00:06:41.815809+0000","last_peered":"2024-09-12T00:06:41.815809+0000","last_clean":"2024-09-12T00:06:41.815809+0000","last_became_active":"2024-09-12T00:03:23.612165+0000","last_became_peered":"2024-09-12T00:03:23.612165+0000","last_unstale":"2024-09-12T00:06:41.815809+0000","last_undegraded":"2024-09-12T00:06:41.815809+0000","last_fullsized":"2024-09-12T00:06:41.815809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:31.444343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":159744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722313+0000","last_change":"2024-09-12T00:03:27.329228+0000","last_active":"2024-09-12T00:06:42.722313+0000","last_peered":"2024-09-12T00:06:42.722313+0000","last_clean":"2024-09-12T00:06:42.722313+0000","last_became_active":"2024-09-12T00:03:27.328497+0000","last_became_peered":"2024-09-12T00:03:27.328497+0000","last_unstale":"2024-09-12T00:06:42.722313+0000","last_undegraded":"2024-09-12T00:06:42.722313+0000","last_fullsized":"2024-09-12T00:06:42.722313+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"96'42","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810133+0000","last_change":"2024-09-12T00:03:29.332778+0000","last_active":"2024-09-12T00:06:41.810133+0000","last_peered":"2024-09-12T00:06:41.810133+0000","last_clean":"2024-09-12T00:06:41.810133+0000","last_became_active":"2024-09-12T00:03:29.332010+0000","last_became_peered":"2024-09-12T00:03:29.332010+0000","last_unstale":"2024-09-12T00:06:41.810133+0000","last_undegraded":"2024-09-12T00:06:41.810133+0000","last_fullsized":"2024-09-12T00:06:41.810133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:13.563107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125399,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":47,"num_read_kb":36,"num_write":30,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065300+0000","last_change":"2024-09-12T00:03:31.354374+0000","last_active":"2024-09-12T00:06:42.065300+0000","last_peered":"2024-09-12T00:06:42.065300+0000","last_clean":"2024-09-12T00:06:42.065300+0000","last_became_active":"2024-09-12T00:03:31.353407+0000","last_became_peered":"2024-09-12T00:03:31.353407+0000","last_unstale":"2024-09-12T00:06:42.065300+0000","last_undegraded":"2024-09-12T00:06:42.065300+0000","last_fullsized":"2024-09-12T00:06:42.065300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:30.520217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"93'7","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723759+0000","last_change":"2024-09-12T00:03:33.385373+0000","last_active":"2024-09-12T00:06:42.723759+0000","last_peered":"2024-09-12T00:06:42.723759+0000","last_clean":"2024-09-12T00:06:42.723759+0000","last_became_active":"2024-09-12T00:03:33.384559+0000","last_became_peered":"2024-09-12T00:03:33.384559+0000","last_unstale":"2024-09-12T00:06:42.723759+0000","last_undegraded":"2024-09-12T00:06:42.723759+0000","last_fullsized":"2024-09-12T00:06:42.723759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:55.924174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815429+0000","last_change":"2024-09-12T00:03:25.326677+0000","last_active":"2024-09-12T00:06:41.815429+0000","last_peered":"2024-09-12T00:06:41.815429+0000","last_clean":"2024-09-12T00:06:41.815429+0000","last_became_active":"2024-09-12T00:03:25.325840+0000","last_became_peered":"2024-09-12T00:03:25.325840+0000","last_unstale":"2024-09-12T00:06:41.815429+0000","last_undegraded":"2024-09-12T00:06:41.815429+0000","last_fullsized":"2024-09-12T00:06:41.815429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:07.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"95'22","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720457+0000","last_change":"2024-09-12T00:03:23.616943+0000","last_active":"2024-09-12T00:06:42.720457+0000","last_peered":"2024-09-12T00:06:42.720457+0000","last_clean":"2024-09-12T00:06:42.720457+0000","last_became_active":"2024-09-12T00:03:23.616200+0000","last_became_peered":"2024-09-12T00:03:23.616200+0000","last_unstale":"2024-09-12T00:06:42.720457+0000","last_undegraded":"2024-09-12T00:06:42.720457+0000","last_fullsized":"2024-09-12T00:06:42.720457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722289+0000","last_change":"2024-09-12T00:03:27.330506+0000","last_active":"2024-09-12T00:06:42.722289+0000","last_peered":"2024-09-12T00:06:42.722289+0000","last_clean":"2024-09-12T00:06:42.722289+0000","last_became_active":"2024-09-12T00:03:27.329830+0000","last_became_peered":"2024-09-12T00:03:27.329830+0000","last_unstale":"2024-09-12T00:06:42.722289+0000","last_undegraded":"2024-09-12T00:06:42.722289+0000","last_fullsized":"2024-09-12T00:06:42.722289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:03.446090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"96'25","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501739+0000","last_change":"2024-09-12T00:03:29.343655+0000","last_active":"2024-09-12T00:06:42.501739+0000","last_peered":"2024-09-12T00:06:42.501739+0000","last_clean":"2024-09-12T00:06:42.501739+0000","last_became_active":"2024-09-12T00:03:29.343178+0000","last_became_peered":"2024-09-12T00:03:29.343178+0000","last_unstale":"2024-09-12T00:06:42.501739+0000","last_undegraded":"2024-09-12T00:06:42.501739+0000","last_fullsized":"2024-09-12T00:06:42.501739+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723516+0000","last_change":"2024-09-12T00:03:31.358077+0000","last_active":"2024-09-12T00:06:42.723516+0000","last_peered":"2024-09-12T00:06:42.723516+0000","last_clean":"2024-09-12T00:06:42.723516+0000","last_became_active":"2024-09-12T00:03:31.357272+0000","last_became_peered":"2024-09-12T00:03:31.357272+0000","last_unstale":"2024-09-12T00:06:42.723516+0000","last_undegraded":"2024-09-12T00:06:42.723516+0000","last_fullsized":"2024-09-12T00:06:42.723516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:37.991682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"76'4","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065822+0000","last_change":"2024-09-12T00:06:26.690241+0000","last_active":"2024-09-12T00:06:42.065822+0000","last_peered":"2024-09-12T00:06:42.065822+0000","last_clean":"2024-09-12T00:06:42.065822+0000","last_became_active":"2024-09-12T00:06:26.653908+0000","last_became_peered":"2024-09-12T00:06:26.653908+0000","last_unstale":"2024-09-12T00:06:42.065822+0000","last_undegraded":"2024-09-12T00:06:42.065822+0000","last_fullsized":"2024-09-12T00:06:42.065822+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:12.338436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"76'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721025+0000","last_change":"2024-09-12T00:06:32.433900+0000","last_active":"2024-09-12T00:06:42.721025+0000","last_peered":"2024-09-12T00:06:42.721025+0000","last_clean":"2024-09-12T00:06:42.721025+0000","last_became_active":"2024-09-12T00:06:26.675405+0000","last_became_peered":"2024-09-12T00:06:26.675405+0000","last_unstale":"2024-09-12T00:06:42.721025+0000","last_undegraded":"2024-09-12T00:06:42.721025+0000","last_fullsized":"2024-09-12T00:06:42.721025+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:53.098500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"96'21","reported_seq":85,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721420+0000","last_change":"2024-09-12T00:06:32.375501+0000","last_active":"2024-09-12T00:06:42.721420+0000","last_peered":"2024-09-12T00:06:42.721420+0000","last_clean":"2024-09-12T00:06:42.721420+0000","last_became_active":"2024-09-12T00:06:26.663178+0000","last_became_peered":"2024-09-12T00:06:26.663178+0000","last_unstale":"2024-09-12T00:06:42.721420+0000","last_undegraded":"2024-09-12T00:06:42.721420+0000","last_fullsized":"2024-09-12T00:06:42.721420+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:27.738037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":138412032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065958+0000","last_change":"2024-09-12T00:03:27.342295+0000","last_active":"2024-09-12T00:06:42.065958+0000","last_peered":"2024-09-12T00:06:42.065958+0000","last_clean":"2024-09-12T00:06:42.065958+0000","last_became_active":"2024-09-12T00:03:27.341619+0000","last_became_peered":"2024-09-12T00:03:27.341619+0000","last_unstale":"2024-09-12T00:06:42.065958+0000","last_undegraded":"2024-09-12T00:06:42.065958+0000","last_fullsized":"2024-09-12T00:06:42.065958+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:00.908798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"96'23","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066215+0000","last_change":"2024-09-12T00:03:29.336391+0000","last_active":"2024-09-12T00:06:42.066215+0000","last_peered":"2024-09-12T00:06:42.066215+0000","last_clean":"2024-09-12T00:06:42.066215+0000","last_became_active":"2024-09-12T00:03:29.335679+0000","last_became_peered":"2024-09-12T00:03:29.335679+0000","last_unstale":"2024-09-12T00:06:42.066215+0000","last_undegraded":"2024-09-12T00:06:42.066215+0000","last_fullsized":"2024-09-12T00:06:42.066215+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:58.540539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"96'134","reported_seq":395,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723048+0000","last_change":"2024-09-12T00:03:31.351170+0000","last_active":"2024-09-12T00:06:42.723048+0000","last_peered":"2024-09-12T00:06:42.723048+0000","last_clean":"2024-09-12T00:06:42.723048+0000","last_became_active":"2024-09-12T00:03:31.350264+0000","last_became_peered":"2024-09-12T00:03:31.350264+0000","last_unstale":"2024-09-12T00:06:42.723048+0000","last_undegraded":"2024-09-12T00:06:42.723048+0000","last_fullsized":"2024-09-12T00:06:42.723048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:51.368815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"59'3","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719548+0000","last_change":"2024-09-12T00:03:33.368236+0000","last_active":"2024-09-12T00:06:42.719548+0000","last_peered":"2024-09-12T00:06:42.719548+0000","last_clean":"2024-09-12T00:06:42.719548+0000","last_became_active":"2024-09-12T00:03:33.367424+0000","last_became_peered":"2024-09-12T00:03:33.367424+0000","last_unstale":"2024-09-12T00:06:42.719548+0000","last_undegraded":"2024-09-12T00:06:42.719548+0000","last_fullsized":"2024-09-12T00:06:42.719548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"76'6","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813109+0000","last_change":"2024-09-12T00:06:28.869705+0000","last_active":"2024-09-12T00:06:41.813109+0000","last_peered":"2024-09-12T00:06:41.813109+0000","last_clean":"2024-09-12T00:06:41.813109+0000","last_became_active":"2024-09-12T00:06:26.671547+0000","last_became_peered":"2024-09-12T00:06:26.671547+0000","last_unstale":"2024-09-12T00:06:41.813109+0000","last_undegraded":"2024-09-12T00:06:41.813109+0000","last_fullsized":"2024-09-12T00:06:41.813109+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:55.946290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"96'22","reported_seq":87,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721098+0000","last_change":"2024-09-12T00:06:27.817806+0000","last_active":"2024-09-12T00:06:42.721098+0000","last_peered":"2024-09-12T00:06:42.721098+0000","last_clean":"2024-09-12T00:06:42.721098+0000","last_became_active":"2024-09-12T00:06:26.654104+0000","last_became_peered":"2024-09-12T00:06:26.654104+0000","last_unstale":"2024-09-12T00:06:42.721098+0000","last_undegraded":"2024-09-12T00:06:42.721098+0000","last_fullsized":"2024-09-12T00:06:42.721098+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:30.461829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":368,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501711+0000","last_change":"2024-09-12T00:03:27.331569+0000","last_active":"2024-09-12T00:06:42.501711+0000","last_peered":"2024-09-12T00:06:42.501711+0000","last_clean":"2024-09-12T00:06:42.501711+0000","last_became_active":"2024-09-12T00:03:27.330909+0000","last_became_peered":"2024-09-12T00:03:27.330909+0000","last_unstale":"2024-09-12T00:06:42.501711+0000","last_undegraded":"2024-09-12T00:06:42.501711+0000","last_fullsized":"2024-09-12T00:06:42.501711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"59'11","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720583+0000","last_change":"2024-09-12T00:03:29.338880+0000","last_active":"2024-09-12T00:06:42.720583+0000","last_peered":"2024-09-12T00:06:42.720583+0000","last_clean":"2024-09-12T00:06:42.720583+0000","last_became_active":"2024-09-12T00:03:29.338110+0000","last_became_peered":"2024-09-12T00:03:29.338110+0000","last_unstale":"2024-09-12T00:06:42.720583+0000","last_undegraded":"2024-09-12T00:06:42.720583+0000","last_fullsized":"2024-09-12T00:06:42.720583+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.054460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"96'134","reported_seq":401,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501292+0000","last_change":"2024-09-12T00:03:31.339117+0000","last_active":"2024-09-12T00:06:42.501292+0000","last_peered":"2024-09-12T00:06:42.501292+0000","last_clean":"2024-09-12T00:06:42.501292+0000","last_became_active":"2024-09-12T00:03:31.338426+0000","last_became_peered":"2024-09-12T00:03:31.338426+0000","last_unstale":"2024-09-12T00:06:42.501292+0000","last_undegraded":"2024-09-12T00:06:42.501292+0000","last_fullsized":"2024-09-12T00:06:42.501292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:19.304169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811106+0000","last_change":"2024-09-12T00:03:33.385051+0000","last_active":"2024-09-12T00:06:41.811106+0000","last_peered":"2024-09-12T00:06:41.811106+0000","last_clean":"2024-09-12T00:06:41.811106+0000","last_became_active":"2024-09-12T00:03:33.380088+0000","last_became_peered":"2024-09-12T00:03:33.380088+0000","last_unstale":"2024-09-12T00:06:41.811106+0000","last_undegraded":"2024-09-12T00:06:41.811106+0000","last_fullsized":"2024-09-12T00:06:41.811106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:02.972871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.724550+0000","last_change":"2024-09-12T00:03:25.336113+0000","last_active":"2024-09-12T00:06:42.724550+0000","last_peered":"2024-09-12T00:06:42.724550+0000","last_clean":"2024-09-12T00:06:42.724550+0000","last_became_active":"2024-09-12T00:03:25.335449+0000","last_became_peered":"2024-09-12T00:03:25.335449+0000","last_unstale":"2024-09-12T00:06:42.724550+0000","last_undegraded":"2024-09-12T00:06:42.724550+0000","last_fullsized":"2024-09-12T00:06:42.724550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:34.277614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"96'24","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811100+0000","last_change":"2024-09-12T00:03:23.619285+0000","last_active":"2024-09-12T00:06:41.811100+0000","last_peered":"2024-09-12T00:06:41.811100+0000","last_clean":"2024-09-12T00:06:41.811100+0000","last_became_active":"2024-09-12T00:03:23.614187+0000","last_became_peered":"2024-09-12T00:03:23.614187+0000","last_unstale":"2024-09-12T00:06:41.811100+0000","last_undegraded":"2024-09-12T00:06:41.811100+0000","last_fullsized":"2024-09-12T00:06:41.811100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720307+0000","last_change":"2024-09-12T00:06:26.673924+0000","last_active":"2024-09-12T00:06:42.720307+0000","last_peered":"2024-09-12T00:06:42.720307+0000","last_clean":"2024-09-12T00:06:42.720307+0000","last_became_active":"2024-09-12T00:06:26.670945+0000","last_became_peered":"2024-09-12T00:06:26.670945+0000","last_unstale":"2024-09-12T00:06:42.720307+0000","last_undegraded":"2024-09-12T00:06:42.720307+0000","last_fullsized":"2024-09-12T00:06:42.720307+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:56.956200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"96'25","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500794+0000","last_change":"2024-09-12T00:03:29.345719+0000","last_active":"2024-09-12T00:06:42.500794+0000","last_peered":"2024-09-12T00:06:42.500794+0000","last_clean":"2024-09-12T00:06:42.500794+0000","last_became_active":"2024-09-12T00:03:29.345243+0000","last_became_peered":"2024-09-12T00:03:29.345243+0000","last_unstale":"2024-09-12T00:06:42.500794+0000","last_undegraded":"2024-09-12T00:06:42.500794+0000","last_fullsized":"2024-09-12T00:06:42.500794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:41.153263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812258+0000","last_change":"2024-09-12T00:03:31.360630+0000","last_active":"2024-09-12T00:06:41.812258+0000","last_peered":"2024-09-12T00:06:41.812258+0000","last_clean":"2024-09-12T00:06:41.812258+0000","last_became_active":"2024-09-12T00:03:31.359763+0000","last_became_peered":"2024-09-12T00:03:31.359763+0000","last_unstale":"2024-09-12T00:06:41.812258+0000","last_undegraded":"2024-09-12T00:06:41.812258+0000","last_fullsized":"2024-09-12T00:06:41.812258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"84'6","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719339+0000","last_change":"2024-09-12T00:03:33.372178+0000","last_active":"2024-09-12T00:06:42.719339+0000","last_peered":"2024-09-12T00:06:42.719339+0000","last_clean":"2024-09-12T00:06:42.719339+0000","last_became_active":"2024-09-12T00:03:33.370562+0000","last_became_peered":"2024-09-12T00:03:33.370562+0000","last_unstale":"2024-09-12T00:06:42.719339+0000","last_undegraded":"2024-09-12T00:06:42.719339+0000","last_fullsized":"2024-09-12T00:06:42.719339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:31.888153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'10","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720452+0000","last_change":"2024-09-12T00:06:32.425494+0000","last_active":"2024-09-12T00:06:42.720452+0000","last_peered":"2024-09-12T00:06:42.720452+0000","last_clean":"2024-09-12T00:06:42.720452+0000","last_became_active":"2024-09-12T00:06:26.674937+0000","last_became_peered":"2024-09-12T00:06:26.674937+0000","last_unstale":"2024-09-12T00:06:42.720452+0000","last_undegraded":"2024-09-12T00:06:42.720452+0000","last_fullsized":"2024-09-12T00:06:42.720452+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:09.992203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":300,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499047+0000","last_change":"2024-09-12T00:03:11.770141+0000","last_active":"2024-09-12T00:06:42.499047+0000","last_peered":"2024-09-12T00:06:42.499047+0000","last_clean":"2024-09-12T00:06:42.499047+0000","last_became_active":"2024-09-12T00:03:11.767988+0000","last_became_peered":"2024-09-12T00:03:11.767988+0000","last_unstale":"2024-09-12T00:06:42.499047+0000","last_undegraded":"2024-09-12T00:06:42.499047+0000","last_fullsized":"2024-09-12T00:06:42.499047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_clean_scrub_stamp":"2024-09-12T00:03:10.462069+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:26.289955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717386+0000","last_change":"2024-09-12T00:06:28.888645+0000","last_active":"2024-09-12T00:06:42.717386+0000","last_peered":"2024-09-12T00:06:42.717386+0000","last_clean":"2024-09-12T00:06:42.717386+0000","last_became_active":"2024-09-12T00:06:26.671587+0000","last_became_peered":"2024-09-12T00:06:26.671587+0000","last_unstale":"2024-09-12T00:06:42.717386+0000","last_undegraded":"2024-09-12T00:06:42.717386+0000","last_fullsized":"2024-09-12T00:06:42.717386+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:03.325846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"95'24","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811486+0000","last_change":"2024-09-12T00:03:23.621849+0000","last_active":"2024-09-12T00:06:41.811486+0000","last_peered":"2024-09-12T00:06:41.811486+0000","last_clean":"2024-09-12T00:06:41.811486+0000","last_became_active":"2024-09-12T00:03:23.621146+0000","last_became_peered":"2024-09-12T00:03:23.621146+0000","last_unstale":"2024-09-12T00:06:41.811486+0000","last_undegraded":"2024-09-12T00:06:41.811486+0000","last_fullsized":"2024-09-12T00:06:41.811486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:38.426691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809414+0000","last_change":"2024-09-12T00:03:27.316175+0000","last_active":"2024-09-12T00:06:41.809414+0000","last_peered":"2024-09-12T00:06:41.809414+0000","last_clean":"2024-09-12T00:06:41.809414+0000","last_became_active":"2024-09-12T00:03:27.315502+0000","last_became_peered":"2024-09-12T00:03:27.315502+0000","last_unstale":"2024-09-12T00:06:41.809414+0000","last_undegraded":"2024-09-12T00:06:41.809414+0000","last_fullsized":"2024-09-12T00:06:41.809414+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:21.448686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"96'44","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720067+0000","last_change":"2024-09-12T00:06:28.900645+0000","last_active":"2024-09-12T00:06:42.720067+0000","last_peered":"2024-09-12T00:06:42.720067+0000","last_clean":"2024-09-12T00:06:42.720067+0000","last_became_active":"2024-09-12T00:06:26.667623+0000","last_became_peered":"2024-09-12T00:06:26.667623+0000","last_unstale":"2024-09-12T00:06:42.720067+0000","last_undegraded":"2024-09-12T00:06:42.720067+0000","last_fullsized":"2024-09-12T00:06:42.720067+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:36.584753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":38,"num_read_kb":26,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066468+0000","last_change":"2024-09-12T00:03:31.361408+0000","last_active":"2024-09-12T00:06:42.066468+0000","last_peered":"2024-09-12T00:06:42.066468+0000","last_clean":"2024-09-12T00:06:42.066468+0000","last_became_active":"2024-09-12T00:03:31.360462+0000","last_became_peered":"2024-09-12T00:03:31.360462+0000","last_unstale":"2024-09-12T00:06:42.066468+0000","last_undegraded":"2024-09-12T00:06:42.066468+0000","last_fullsized":"2024-09-12T00:06:42.066468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:58.407571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"59'4","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812851+0000","last_change":"2024-09-12T00:03:33.388253+0000","last_active":"2024-09-12T00:06:41.812851+0000","last_peered":"2024-09-12T00:06:41.812851+0000","last_clean":"2024-09-12T00:06:41.812851+0000","last_became_active":"2024-09-12T00:03:33.387457+0000","last_became_peered":"2024-09-12T00:03:33.387457+0000","last_unstale":"2024-09-12T00:06:41.812851+0000","last_undegraded":"2024-09-12T00:06:41.812851+0000","last_fullsized":"2024-09-12T00:06:41.812851+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:46.021740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066818+0000","last_change":"2024-09-12T00:03:25.357970+0000","last_active":"2024-09-12T00:06:42.066818+0000","last_peered":"2024-09-12T00:06:42.066818+0000","last_clean":"2024-09-12T00:06:42.066818+0000","last_became_active":"2024-09-12T00:03:25.355306+0000","last_became_peered":"2024-09-12T00:03:25.355306+0000","last_unstale":"2024-09-12T00:06:42.066818+0000","last_undegraded":"2024-09-12T00:06:42.066818+0000","last_fullsized":"2024-09-12T00:06:42.066818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:17.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717548+0000","last_change":"2024-09-12T00:06:26.654149+0000","last_active":"2024-09-12T00:06:42.717548+0000","last_peered":"2024-09-12T00:06:42.717548+0000","last_clean":"2024-09-12T00:06:42.717548+0000","last_became_active":"2024-09-12T00:06:26.653574+0000","last_became_peered":"2024-09-12T00:06:26.653574+0000","last_unstale":"2024-09-12T00:06:42.717548+0000","last_undegraded":"2024-09-12T00:06:42.717548+0000","last_fullsized":"2024-09-12T00:06:42.717548+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:55.656413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"96'28","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720943+0000","last_change":"2024-09-12T00:03:23.622111+0000","last_active":"2024-09-12T00:06:42.720943+0000","last_peered":"2024-09-12T00:06:42.720943+0000","last_clean":"2024-09-12T00:06:42.720943+0000","last_became_active":"2024-09-12T00:03:23.621358+0000","last_became_peered":"2024-09-12T00:03:23.621358+0000","last_unstale":"2024-09-12T00:06:42.720943+0000","last_undegraded":"2024-09-12T00:06:42.720943+0000","last_fullsized":"2024-09-12T00:06:42.720943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:02.202230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722205+0000","last_change":"2024-09-12T00:06:26.659401+0000","last_active":"2024-09-12T00:06:42.722205+0000","last_peered":"2024-09-12T00:06:42.722205+0000","last_clean":"2024-09-12T00:06:42.722205+0000","last_became_active":"2024-09-12T00:06:26.657376+0000","last_became_peered":"2024-09-12T00:06:26.657376+0000","last_unstale":"2024-09-12T00:06:42.722205+0000","last_undegraded":"2024-09-12T00:06:42.722205+0000","last_fullsized":"2024-09-12T00:06:42.722205+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:27.337831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"96'141","reported_seq":429,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721183+0000","last_change":"2024-09-12T00:03:29.346819+0000","last_active":"2024-09-12T00:06:42.721183+0000","last_peered":"2024-09-12T00:06:42.721183+0000","last_clean":"2024-09-12T00:06:42.721183+0000","last_became_active":"2024-09-12T00:03:29.346101+0000","last_became_peered":"2024-09-12T00:03:29.346101+0000","last_unstale":"2024-09-12T00:06:42.721183+0000","last_undegraded":"2024-09-12T00:06:42.721183+0000","last_fullsized":"2024-09-12T00:06:42.721183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:27.268327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":183,"num_read_kb":167,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721121+0000","last_change":"2024-09-12T00:06:26.679841+0000","last_active":"2024-09-12T00:06:42.721121+0000","last_peered":"2024-09-12T00:06:42.721121+0000","last_clean":"2024-09-12T00:06:42.721121+0000","last_became_active":"2024-09-12T00:06:26.675966+0000","last_became_peered":"2024-09-12T00:06:26.675966+0000","last_unstale":"2024-09-12T00:06:42.721121+0000","last_undegraded":"2024-09-12T00:06:42.721121+0000","last_fullsized":"2024-09-12T00:06:42.721121+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:39.439184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064787+0000","last_change":"2024-09-12T00:03:33.386144+0000","last_active":"2024-09-12T00:06:42.064787+0000","last_peered":"2024-09-12T00:06:42.064787+0000","last_clean":"2024-09-12T00:06:42.064787+0000","last_became_active":"2024-09-12T00:03:33.384951+0000","last_became_peered":"2024-09-12T00:03:33.384951+0000","last_unstale":"2024-09-12T00:06:42.064787+0000","last_undegraded":"2024-09-12T00:06:42.064787+0000","last_fullsized":"2024-09-12T00:06:42.064787+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:49.807501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"59'2","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720659+0000","last_change":"2024-09-12T00:03:25.332801+0000","last_active":"2024-09-12T00:06:42.720659+0000","last_peered":"2024-09-12T00:06:42.720659+0000","last_clean":"2024-09-12T00:06:42.720659+0000","last_became_active":"2024-09-12T00:03:25.331652+0000","last_became_peered":"2024-09-12T00:03:25.331652+0000","last_unstale":"2024-09-12T00:06:42.720659+0000","last_undegraded":"2024-09-12T00:06:42.720659+0000","last_fullsized":"2024-09-12T00:06:42.720659+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718983+0000","last_change":"2024-09-12T00:03:18.892423+0000","last_active":"2024-09-12T00:06:42.718983+0000","last_peered":"2024-09-12T00:06:42.718983+0000","last_clean":"2024-09-12T00:06:42.718983+0000","last_became_active":"2024-09-12T00:03:16.559698+0000","last_became_peered":"2024-09-12T00:03:16.559698+0000","last_unstale":"2024-09-12T00:06:42.718983+0000","last_undegraded":"2024-09-12T00:06:42.718983+0000","last_fullsized":"2024-09-12T00:06:42.718983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:21.453461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082440599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"95'22","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064436+0000","last_change":"2024-09-12T00:03:23.633606+0000","last_active":"2024-09-12T00:06:42.064436+0000","last_peered":"2024-09-12T00:06:42.064436+0000","last_clean":"2024-09-12T00:06:42.064436+0000","last_became_active":"2024-09-12T00:03:23.632795+0000","last_became_peered":"2024-09-12T00:03:23.632795+0000","last_unstale":"2024-09-12T00:06:42.064436+0000","last_undegraded":"2024-09-12T00:06:42.064436+0000","last_fullsized":"2024-09-12T00:06:42.064436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:08.214455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90177536,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723278+0000","last_change":"2024-09-12T00:03:27.326932+0000","last_active":"2024-09-12T00:06:42.723278+0000","last_peered":"2024-09-12T00:06:42.723278+0000","last_clean":"2024-09-12T00:06:42.723278+0000","last_became_active":"2024-09-12T00:03:27.326173+0000","last_became_peered":"2024-09-12T00:03:27.326173+0000","last_unstale":"2024-09-12T00:06:42.723278+0000","last_undegraded":"2024-09-12T00:06:42.723278+0000","last_fullsized":"2024-09-12T00:06:42.723278+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:12.286539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"58'16","reported_seq":245,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815957+0000","last_change":"2024-09-12T00:03:29.338829+0000","last_active":"2024-09-12T00:06:41.815957+0000","last_peered":"2024-09-12T00:06:41.815957+0000","last_clean":"2024-09-12T00:06:41.815957+0000","last_became_active":"2024-09-12T00:03:29.337364+0000","last_became_peered":"2024-09-12T00:03:29.337364+0000","last_unstale":"2024-09-12T00:06:41.815957+0000","last_undegraded":"2024-09-12T00:06:41.815957+0000","last_fullsized":"2024-09-12T00:06:41.815957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:01.584359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812645+0000","last_change":"2024-09-12T00:06:26.655001+0000","last_active":"2024-09-12T00:06:41.812645+0000","last_peered":"2024-09-12T00:06:41.812645+0000","last_clean":"2024-09-12T00:06:41.812645+0000","last_became_active":"2024-09-12T00:06:26.654068+0000","last_became_peered":"2024-09-12T00:06:26.654068+0000","last_unstale":"2024-09-12T00:06:41.812645+0000","last_undegraded":"2024-09-12T00:06:41.812645+0000","last_fullsized":"2024-09-12T00:06:41.812645+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:50.133218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810544+0000","last_change":"2024-09-12T00:03:33.354171+0000","last_active":"2024-09-12T00:06:41.810544+0000","last_peered":"2024-09-12T00:06:41.810544+0000","last_clean":"2024-09-12T00:06:41.810544+0000","last_became_active":"2024-09-12T00:03:33.353460+0000","last_became_peered":"2024-09-12T00:03:33.353460+0000","last_unstale":"2024-09-12T00:06:41.810544+0000","last_undegraded":"2024-09-12T00:06:41.810544+0000","last_fullsized":"2024-09-12T00:06:41.810544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:34.356970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"84'8","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721257+0000","last_change":"2024-09-12T00:03:25.336320+0000","last_active":"2024-09-12T00:06:42.721257+0000","last_peered":"2024-09-12T00:06:42.721257+0000","last_clean":"2024-09-12T00:06:42.721257+0000","last_became_active":"2024-09-12T00:03:25.333449+0000","last_became_peered":"2024-09-12T00:03:25.333449+0000","last_unstale":"2024-09-12T00:06:42.721257+0000","last_undegraded":"2024-09-12T00:06:42.721257+0000","last_fullsized":"2024-09-12T00:06:42.721257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722390+0000","last_change":"2024-09-12T00:06:32.408232+0000","last_active":"2024-09-12T00:06:42.722390+0000","last_peered":"2024-09-12T00:06:42.722390+0000","last_clean":"2024-09-12T00:06:42.722390+0000","last_became_active":"2024-09-12T00:06:26.677047+0000","last_became_peered":"2024-09-12T00:06:26.677047+0000","last_unstale":"2024-09-12T00:06:42.722390+0000","last_undegraded":"2024-09-12T00:06:42.722390+0000","last_fullsized":"2024-09-12T00:06:42.722390+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:52.555478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"96'21","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810342+0000","last_change":"2024-09-12T00:03:23.611064+0000","last_active":"2024-09-12T00:06:41.810342+0000","last_peered":"2024-09-12T00:06:41.810342+0000","last_clean":"2024-09-12T00:06:41.810342+0000","last_became_active":"2024-09-12T00:03:23.610612+0000","last_became_peered":"2024-09-12T00:03:23.610612+0000","last_unstale":"2024-09-12T00:06:41.810342+0000","last_undegraded":"2024-09-12T00:06:41.810342+0000","last_fullsized":"2024-09-12T00:06:41.810342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:04.201688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722466+0000","last_change":"2024-09-12T00:03:27.339197+0000","last_active":"2024-09-12T00:06:42.722466+0000","last_peered":"2024-09-12T00:06:42.722466+0000","last_clean":"2024-09-12T00:06:42.722466+0000","last_became_active":"2024-09-12T00:03:27.338508+0000","last_became_peered":"2024-09-12T00:03:27.338508+0000","last_unstale":"2024-09-12T00:06:42.722466+0000","last_undegraded":"2024-09-12T00:06:42.722466+0000","last_fullsized":"2024-09-12T00:06:42.722466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:08.306289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066551+0000","last_change":"2024-09-12T00:06:28.890041+0000","last_active":"2024-09-12T00:06:42.066551+0000","last_peered":"2024-09-12T00:06:42.066551+0000","last_clean":"2024-09-12T00:06:42.066551+0000","last_became_active":"2024-09-12T00:06:26.682354+0000","last_became_peered":"2024-09-12T00:06:26.682354+0000","last_unstale":"2024-09-12T00:06:42.066551+0000","last_undegraded":"2024-09-12T00:06:42.066551+0000","last_fullsized":"2024-09-12T00:06:42.066551+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:42.484131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722102+0000","last_change":"2024-09-12T00:06:26.675142+0000","last_active":"2024-09-12T00:06:42.722102+0000","last_peered":"2024-09-12T00:06:42.722102+0000","last_clean":"2024-09-12T00:06:42.722102+0000","last_became_active":"2024-09-12T00:06:26.669787+0000","last_became_peered":"2024-09-12T00:06:26.669787+0000","last_unstale":"2024-09-12T00:06:42.722102+0000","last_undegraded":"2024-09-12T00:06:42.722102+0000","last_fullsized":"2024-09-12T00:06:42.722102+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:34.635508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"63'7","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500245+0000","last_change":"2024-09-12T00:03:33.367035+0000","last_active":"2024-09-12T00:06:42.500245+0000","last_peered":"2024-09-12T00:06:42.500245+0000","last_clean":"2024-09-12T00:06:42.500245+0000","last_became_active":"2024-09-12T00:03:33.366311+0000","last_became_peered":"2024-09-12T00:03:33.366311+0000","last_unstale":"2024-09-12T00:06:42.500245+0000","last_undegraded":"2024-09-12T00:06:42.500245+0000","last_fullsized":"2024-09-12T00:06:42.500245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"96'8","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722537+0000","last_change":"2024-09-12T00:06:28.313486+0000","last_active":"2024-09-12T00:06:42.722537+0000","last_peered":"2024-09-12T00:06:42.722537+0000","last_clean":"2024-09-12T00:06:42.722537+0000","last_became_active":"2024-09-12T00:06:26.675442+0000","last_became_peered":"2024-09-12T00:06:26.675442+0000","last_unstale":"2024-09-12T00:06:42.722537+0000","last_undegraded":"2024-09-12T00:06:42.722537+0000","last_fullsized":"2024-09-12T00:06:42.722537+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:37.245286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"96'19","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812844+0000","last_change":"2024-09-12T00:03:23.619024+0000","last_active":"2024-09-12T00:06:41.812844+0000","last_peered":"2024-09-12T00:06:41.812844+0000","last_clean":"2024-09-12T00:06:41.812844+0000","last_became_active":"2024-09-12T00:03:23.618716+0000","last_became_peered":"2024-09-12T00:03:23.618716+0000","last_unstale":"2024-09-12T00:06:41.812844+0000","last_undegraded":"2024-09-12T00:06:41.812844+0000","last_fullsized":"2024-09-12T00:06:41.812844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067307+0000","last_change":"2024-09-12T00:03:18.562010+0000","last_active":"2024-09-12T00:06:42.067307+0000","last_peered":"2024-09-12T00:06:42.067307+0000","last_clean":"2024-09-12T00:06:42.067307+0000","last_became_active":"2024-09-12T00:03:16.561218+0000","last_became_peered":"2024-09-12T00:03:16.561218+0000","last_unstale":"2024-09-12T00:06:42.067307+0000","last_undegraded":"2024-09-12T00:06:42.067307+0000","last_fullsized":"2024-09-12T00:06:42.067307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:43.089686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084170299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811828+0000","last_change":"2024-09-12T00:03:27.341079+0000","last_active":"2024-09-12T00:06:41.811828+0000","last_peered":"2024-09-12T00:06:41.811828+0000","last_clean":"2024-09-12T00:06:41.811828+0000","last_became_active":"2024-09-12T00:03:27.340391+0000","last_became_peered":"2024-09-12T00:03:27.340391+0000","last_unstale":"2024-09-12T00:06:41.811828+0000","last_undegraded":"2024-09-12T00:06:41.811828+0000","last_fullsized":"2024-09-12T00:06:41.811828+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:10.048469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"96'49","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718472+0000","last_change":"2024-09-12T00:03:29.346823+0000","last_active":"2024-09-12T00:06:42.718472+0000","last_peered":"2024-09-12T00:06:42.718472+0000","last_clean":"2024-09-12T00:06:42.718472+0000","last_became_active":"2024-09-12T00:03:29.346066+0000","last_became_peered":"2024-09-12T00:03:29.346066+0000","last_unstale":"2024-09-12T00:06:42.718472+0000","last_undegraded":"2024-09-12T00:06:42.718472+0000","last_fullsized":"2024-09-12T00:06:42.718472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:12.080794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124550,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":47,"num_write":38,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810366+0000","last_change":"2024-09-12T00:03:31.348574+0000","last_active":"2024-09-12T00:06:41.810366+0000","last_peered":"2024-09-12T00:06:41.810366+0000","last_clean":"2024-09-12T00:06:41.810366+0000","last_became_active":"2024-09-12T00:03:31.346511+0000","last_became_peered":"2024-09-12T00:03:31.346511+0000","last_unstale":"2024-09-12T00:06:41.810366+0000","last_undegraded":"2024-09-12T00:06:41.810366+0000","last_fullsized":"2024-09-12T00:06:41.810366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:14.061486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"59'7","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066233+0000","last_change":"2024-09-12T00:03:33.385232+0000","last_active":"2024-09-12T00:06:42.066233+0000","last_peered":"2024-09-12T00:06:42.066233+0000","last_clean":"2024-09-12T00:06:42.066233+0000","last_became_active":"2024-09-12T00:03:33.384457+0000","last_became_peered":"2024-09-12T00:03:33.384457+0000","last_unstale":"2024-09-12T00:06:42.066233+0000","last_undegraded":"2024-09-12T00:06:42.066233+0000","last_fullsized":"2024-09-12T00:06:42.066233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:34.615256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"76'4","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721962+0000","last_change":"2024-09-12T00:03:25.334767+0000","last_active":"2024-09-12T00:06:42.721962+0000","last_peered":"2024-09-12T00:06:42.721962+0000","last_clean":"2024-09-12T00:06:42.721962+0000","last_became_active":"2024-09-12T00:03:25.332814+0000","last_became_peered":"2024-09-12T00:03:25.332814+0000","last_unstale":"2024-09-12T00:06:42.721962+0000","last_undegraded":"2024-09-12T00:06:42.721962+0000","last_fullsized":"2024-09-12T00:06:42.721962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"95'27","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721814+0000","last_change":"2024-09-12T00:03:23.628752+0000","last_active":"2024-09-12T00:06:42.721814+0000","last_peered":"2024-09-12T00:06:42.721814+0000","last_clean":"2024-09-12T00:06:42.721814+0000","last_became_active":"2024-09-12T00:03:23.628128+0000","last_became_peered":"2024-09-12T00:03:23.628128+0000","last_unstale":"2024-09-12T00:06:42.721814+0000","last_undegraded":"2024-09-12T00:06:42.721814+0000","last_fullsized":"2024-09-12T00:06:42.721814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720543+0000","last_change":"2024-09-12T00:06:26.679199+0000","last_active":"2024-09-12T00:06:42.720543+0000","last_peered":"2024-09-12T00:06:42.720543+0000","last_clean":"2024-09-12T00:06:42.720543+0000","last_became_active":"2024-09-12T00:06:26.675309+0000","last_became_peered":"2024-09-12T00:06:26.675309+0000","last_unstale":"2024-09-12T00:06:42.720543+0000","last_undegraded":"2024-09-12T00:06:42.720543+0000","last_fullsized":"2024-09-12T00:06:42.720543+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:56.980194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814664+0000","last_change":"2024-09-12T00:03:27.316317+0000","last_active":"2024-09-12T00:06:41.814664+0000","last_peered":"2024-09-12T00:06:41.814664+0000","last_clean":"2024-09-12T00:06:41.814664+0000","last_became_active":"2024-09-12T00:03:27.315704+0000","last_became_peered":"2024-09-12T00:03:27.315704+0000","last_unstale":"2024-09-12T00:06:41.814664+0000","last_undegraded":"2024-09-12T00:06:41.814664+0000","last_fullsized":"2024-09-12T00:06:41.814664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:07.883485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'20","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720264+0000","last_change":"2024-09-12T00:06:26.708588+0000","last_active":"2024-09-12T00:06:42.720264+0000","last_peered":"2024-09-12T00:06:42.720264+0000","last_clean":"2024-09-12T00:06:42.720264+0000","last_became_active":"2024-09-12T00:06:26.661284+0000","last_became_peered":"2024-09-12T00:06:26.661284+0000","last_unstale":"2024-09-12T00:06:42.720264+0000","last_undegraded":"2024-09-12T00:06:42.720264+0000","last_fullsized":"2024-09-12T00:06:42.720264+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:19.418779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"96'134","reported_seq":353,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499929+0000","last_change":"2024-09-12T00:03:31.357011+0000","last_active":"2024-09-12T00:06:42.499929+0000","last_peered":"2024-09-12T00:06:42.499929+0000","last_clean":"2024-09-12T00:06:42.499929+0000","last_became_active":"2024-09-12T00:03:31.356108+0000","last_became_peered":"2024-09-12T00:03:31.356108+0000","last_unstale":"2024-09-12T00:06:42.499929+0000","last_undegraded":"2024-09-12T00:06:42.499929+0000","last_fullsized":"2024-09-12T00:06:42.499929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"58'2","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723235+0000","last_change":"2024-09-12T00:03:33.372465+0000","last_active":"2024-09-12T00:06:42.723235+0000","last_peered":"2024-09-12T00:06:42.723235+0000","last_clean":"2024-09-12T00:06:42.723235+0000","last_became_active":"2024-09-12T00:03:33.371214+0000","last_became_peered":"2024-09-12T00:03:33.371214+0000","last_unstale":"2024-09-12T00:06:42.723235+0000","last_undegraded":"2024-09-12T00:06:42.723235+0000","last_fullsized":"2024-09-12T00:06:42.723235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:40.880933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"84'8","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810903+0000","last_change":"2024-09-12T00:03:25.332405+0000","last_active":"2024-09-12T00:06:41.810903+0000","last_peered":"2024-09-12T00:06:41.810903+0000","last_clean":"2024-09-12T00:06:41.810903+0000","last_became_active":"2024-09-12T00:03:25.331250+0000","last_became_peered":"2024-09-12T00:03:25.331250+0000","last_unstale":"2024-09-12T00:06:41.810903+0000","last_undegraded":"2024-09-12T00:06:41.810903+0000","last_fullsized":"2024-09-12T00:06:41.810903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"96'23","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813862+0000","last_change":"2024-09-12T00:03:23.602222+0000","last_active":"2024-09-12T00:06:41.813862+0000","last_peered":"2024-09-12T00:06:41.813862+0000","last_clean":"2024-09-12T00:06:41.813862+0000","last_became_active":"2024-09-12T00:03:23.601481+0000","last_became_peered":"2024-09-12T00:03:23.601481+0000","last_unstale":"2024-09-12T00:06:41.813862+0000","last_undegraded":"2024-09-12T00:06:41.813862+0000","last_fullsized":"2024-09-12T00:06:41.813862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:56.636638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813711+0000","last_change":"2024-09-12T00:03:18.716648+0000","last_active":"2024-09-12T00:06:41.813711+0000","last_peered":"2024-09-12T00:06:41.813711+0000","last_clean":"2024-09-12T00:06:41.813711+0000","last_became_active":"2024-09-12T00:03:16.594609+0000","last_became_peered":"2024-09-12T00:03:16.594609+0000","last_unstale":"2024-09-12T00:06:41.813711+0000","last_undegraded":"2024-09-12T00:06:41.813711+0000","last_fullsized":"2024-09-12T00:06:41.813711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:34.635008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010254439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721880+0000","last_change":"2024-09-12T00:06:26.648329+0000","last_active":"2024-09-12T00:06:42.721880+0000","last_peered":"2024-09-12T00:06:42.721880+0000","last_clean":"2024-09-12T00:06:42.721880+0000","last_became_active":"2024-09-12T00:06:26.647055+0000","last_became_peered":"2024-09-12T00:06:26.647055+0000","last_unstale":"2024-09-12T00:06:42.721880+0000","last_undegraded":"2024-09-12T00:06:42.721880+0000","last_fullsized":"2024-09-12T00:06:42.721880+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:35.147693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"58'18","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720951+0000","last_change":"2024-09-12T00:06:30.110628+0000","last_active":"2024-09-12T00:06:42.720951+0000","last_peered":"2024-09-12T00:06:42.720951+0000","last_clean":"2024-09-12T00:06:42.720951+0000","last_became_active":"2024-09-12T00:06:26.662450+0000","last_became_peered":"2024-09-12T00:06:26.662450+0000","last_unstale":"2024-09-12T00:06:42.720951+0000","last_undegraded":"2024-09-12T00:06:42.720951+0000","last_fullsized":"2024-09-12T00:06:42.720951+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:10.820458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'134","reported_seq":350,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066242+0000","last_change":"2024-09-12T00:03:31.361616+0000","last_active":"2024-09-12T00:06:42.066242+0000","last_peered":"2024-09-12T00:06:42.066242+0000","last_clean":"2024-09-12T00:06:42.066242+0000","last_became_active":"2024-09-12T00:03:31.360518+0000","last_became_peered":"2024-09-12T00:03:31.360518+0000","last_unstale":"2024-09-12T00:06:42.066242+0000","last_undegraded":"2024-09-12T00:06:42.066242+0000","last_fullsized":"2024-09-12T00:06:42.066242+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:40.640537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065311+0000","last_change":"2024-09-12T00:03:33.378417+0000","last_active":"2024-09-12T00:06:42.065311+0000","last_peered":"2024-09-12T00:06:42.065311+0000","last_clean":"2024-09-12T00:06:42.065311+0000","last_became_active":"2024-09-12T00:03:33.377669+0000","last_became_peered":"2024-09-12T00:03:33.377669+0000","last_unstale":"2024-09-12T00:06:42.065311+0000","last_undegraded":"2024-09-12T00:06:42.065311+0000","last_fullsized":"2024-09-12T00:06:42.065311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:04.623906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811103+0000","last_change":"2024-09-12T00:06:26.714198+0000","last_active":"2024-09-12T00:06:41.811103+0000","last_peered":"2024-09-12T00:06:41.811103+0000","last_clean":"2024-09-12T00:06:41.811103+0000","last_became_active":"2024-09-12T00:06:26.662114+0000","last_became_peered":"2024-09-12T00:06:26.662114+0000","last_unstale":"2024-09-12T00:06:41.811103+0000","last_undegraded":"2024-09-12T00:06:41.811103+0000","last_fullsized":"2024-09-12T00:06:41.811103+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:41.029559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"96'24","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813511+0000","last_change":"2024-09-12T00:03:23.616319+0000","last_active":"2024-09-12T00:06:41.813511+0000","last_peered":"2024-09-12T00:06:41.813511+0000","last_clean":"2024-09-12T00:06:41.813511+0000","last_became_active":"2024-09-12T00:03:23.615158+0000","last_became_peered":"2024-09-12T00:03:23.615158+0000","last_unstale":"2024-09-12T00:06:41.813511+0000","last_undegraded":"2024-09-12T00:06:41.813511+0000","last_fullsized":"2024-09-12T00:06:41.813511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:15.677228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719839+0000","last_change":"2024-09-12T00:06:26.680801+0000","last_active":"2024-09-12T00:06:42.719839+0000","last_peered":"2024-09-12T00:06:42.719839+0000","last_clean":"2024-09-12T00:06:42.719839+0000","last_became_active":"2024-09-12T00:06:26.677544+0000","last_became_peered":"2024-09-12T00:06:26.677544+0000","last_unstale":"2024-09-12T00:06:42.719839+0000","last_undegraded":"2024-09-12T00:06:42.719839+0000","last_fullsized":"2024-09-12T00:06:42.719839+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:43.976666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810348+0000","last_change":"2024-09-12T00:03:27.337359+0000","last_active":"2024-09-12T00:06:41.810348+0000","last_peered":"2024-09-12T00:06:41.810348+0000","last_clean":"2024-09-12T00:06:41.810348+0000","last_became_active":"2024-09-12T00:03:27.336289+0000","last_became_peered":"2024-09-12T00:03:27.336289+0000","last_unstale":"2024-09-12T00:06:41.810348+0000","last_undegraded":"2024-09-12T00:06:41.810348+0000","last_fullsized":"2024-09-12T00:06:41.810348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:39.147272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"96'50","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809455+0000","last_change":"2024-09-12T00:03:29.344621+0000","last_active":"2024-09-12T00:06:41.809455+0000","last_peered":"2024-09-12T00:06:41.809455+0000","last_clean":"2024-09-12T00:06:41.809455+0000","last_became_active":"2024-09-12T00:03:29.343779+0000","last_became_peered":"2024-09-12T00:03:29.343779+0000","last_unstale":"2024-09-12T00:06:41.809455+0000","last_undegraded":"2024-09-12T00:06:41.809455+0000","last_fullsized":"2024-09-12T00:06:41.809455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:49.518432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811176+0000","last_change":"2024-09-12T00:03:31.335460+0000","last_active":"2024-09-12T00:06:41.811176+0000","last_peered":"2024-09-12T00:06:41.811176+0000","last_clean":"2024-09-12T00:06:41.811176+0000","last_became_active":"2024-09-12T00:03:31.334701+0000","last_became_peered":"2024-09-12T00:03:31.334701+0000","last_unstale":"2024-09-12T00:06:41.811176+0000","last_undegraded":"2024-09-12T00:06:41.811176+0000","last_fullsized":"2024-09-12T00:06:41.811176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:28.484366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"58'4","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812236+0000","last_change":"2024-09-12T00:03:33.386404+0000","last_active":"2024-09-12T00:06:41.812236+0000","last_peered":"2024-09-12T00:06:41.812236+0000","last_clean":"2024-09-12T00:06:41.812236+0000","last_became_active":"2024-09-12T00:03:33.385090+0000","last_became_peered":"2024-09-12T00:03:33.385090+0000","last_unstale":"2024-09-12T00:06:41.812236+0000","last_undegraded":"2024-09-12T00:06:41.812236+0000","last_fullsized":"2024-09-12T00:06:41.812236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"96'2","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813204+0000","last_change":"2024-09-12T00:03:33.361690+0000","last_active":"2024-09-12T00:06:41.813204+0000","last_peered":"2024-09-12T00:06:41.813204+0000","last_clean":"2024-09-12T00:06:41.813204+0000","last_became_active":"2024-09-12T00:03:33.360980+0000","last_became_peered":"2024-09-12T00:03:33.360980+0000","last_unstale":"2024-09-12T00:06:41.813204+0000","last_undegraded":"2024-09-12T00:06:41.813204+0000","last_fullsized":"2024-09-12T00:06:41.813204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:24.954577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"59'2","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813869+0000","last_change":"2024-09-12T00:06:28.274587+0000","last_active":"2024-09-12T00:06:41.813869+0000","last_peered":"2024-09-12T00:06:41.813869+0000","last_clean":"2024-09-12T00:06:41.813869+0000","last_became_active":"2024-09-12T00:06:26.664337+0000","last_became_peered":"2024-09-12T00:06:26.664337+0000","last_unstale":"2024-09-12T00:06:41.813869+0000","last_undegraded":"2024-09-12T00:06:41.813869+0000","last_fullsized":"2024-09-12T00:06:41.813869+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:00.552692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"95'30","reported_seq":103,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717433+0000","last_change":"2024-09-12T00:06:30.093257+0000","last_active":"2024-09-12T00:06:42.717433+0000","last_peered":"2024-09-12T00:06:42.717433+0000","last_clean":"2024-09-12T00:06:42.717433+0000","last_became_active":"2024-09-12T00:06:26.671623+0000","last_became_peered":"2024-09-12T00:06:26.671623+0000","last_unstale":"2024-09-12T00:06:42.717433+0000","last_undegraded":"2024-09-12T00:06:42.717433+0000","last_fullsized":"2024-09-12T00:06:42.717433+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:02.454592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":201326592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"28'2","reported_seq":367,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722728+0000","last_change":"2024-09-12T00:03:27.332281+0000","last_active":"2024-09-12T00:06:42.722728+0000","last_peered":"2024-09-12T00:06:42.722728+0000","last_clean":"2024-09-12T00:06:42.722728+0000","last_became_active":"2024-09-12T00:03:27.331527+0000","last_became_peered":"2024-09-12T00:03:27.331527+0000","last_unstale":"2024-09-12T00:06:42.722728+0000","last_undegraded":"2024-09-12T00:06:42.722728+0000","last_fullsized":"2024-09-12T00:06:42.722728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":266,"num_read_kb":266,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"96'25","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720005+0000","last_change":"2024-09-12T00:03:29.338655+0000","last_active":"2024-09-12T00:06:42.720005+0000","last_peered":"2024-09-12T00:06:42.720005+0000","last_clean":"2024-09-12T00:06:42.720005+0000","last_became_active":"2024-09-12T00:03:29.337905+0000","last_became_peered":"2024-09-12T00:03:29.337905+0000","last_unstale":"2024-09-12T00:06:42.720005+0000","last_undegraded":"2024-09-12T00:06:42.720005+0000","last_fullsized":"2024-09-12T00:06:42.720005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718441+0000","last_change":"2024-09-12T00:03:31.351716+0000","last_active":"2024-09-12T00:06:42.718441+0000","last_peered":"2024-09-12T00:06:42.718441+0000","last_clean":"2024-09-12T00:06:42.718441+0000","last_became_active":"2024-09-12T00:03:31.350917+0000","last_became_peered":"2024-09-12T00:03:31.350917+0000","last_unstale":"2024-09-12T00:06:42.718441+0000","last_undegraded":"2024-09-12T00:06:42.718441+0000","last_fullsized":"2024-09-12T00:06:42.718441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:45.880820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722942+0000","last_change":"2024-09-12T00:03:33.374233+0000","last_active":"2024-09-12T00:06:42.722942+0000","last_peered":"2024-09-12T00:06:42.722942+0000","last_clean":"2024-09-12T00:06:42.722942+0000","last_became_active":"2024-09-12T00:03:33.373466+0000","last_became_peered":"2024-09-12T00:03:33.373466+0000","last_unstale":"2024-09-12T00:06:42.722942+0000","last_undegraded":"2024-09-12T00:06:42.722942+0000","last_fullsized":"2024-09-12T00:06:42.722942+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:55.598892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"59'2","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811077+0000","last_change":"2024-09-12T00:06:28.295394+0000","last_active":"2024-09-12T00:06:41.811077+0000","last_peered":"2024-09-12T00:06:41.811077+0000","last_clean":"2024-09-12T00:06:41.811077+0000","last_became_active":"2024-09-12T00:06:26.664003+0000","last_became_peered":"2024-09-12T00:06:26.664003+0000","last_unstale":"2024-09-12T00:06:41.811077+0000","last_undegraded":"2024-09-12T00:06:41.811077+0000","last_fullsized":"2024-09-12T00:06:41.811077+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:22.616662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"95'23","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816608+0000","last_change":"2024-09-12T00:03:23.613274+0000","last_active":"2024-09-12T00:06:41.816608+0000","last_peered":"2024-09-12T00:06:41.816608+0000","last_clean":"2024-09-12T00:06:41.816608+0000","last_became_active":"2024-09-12T00:03:23.612941+0000","last_became_peered":"2024-09-12T00:03:23.612941+0000","last_unstale":"2024-09-12T00:06:41.816608+0000","last_undegraded":"2024-09-12T00:06:41.816608+0000","last_fullsized":"2024-09-12T00:06:41.816608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:56.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811543+0000","last_change":"2024-09-12T00:03:27.336144+0000","last_active":"2024-09-12T00:06:41.811543+0000","last_peered":"2024-09-12T00:06:41.811543+0000","last_clean":"2024-09-12T00:06:41.811543+0000","last_became_active":"2024-09-12T00:03:27.335372+0000","last_became_peered":"2024-09-12T00:03:27.335372+0000","last_unstale":"2024-09-12T00:06:41.811543+0000","last_undegraded":"2024-09-12T00:06:41.811543+0000","last_fullsized":"2024-09-12T00:06:41.811543+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:33.978665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"108'11","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809960+0000","last_change":"2024-09-12T00:03:29.332051+0000","last_active":"2024-09-12T00:06:41.809960+0000","last_peered":"2024-09-12T00:06:41.809960+0000","last_clean":"2024-09-12T00:06:41.809960+0000","last_became_active":"2024-09-12T00:03:29.331243+0000","last_became_peered":"2024-09-12T00:03:29.331243+0000","last_unstale":"2024-09-12T00:06:41.809960+0000","last_undegraded":"2024-09-12T00:06:41.809960+0000","last_fullsized":"2024-09-12T00:06:41.809960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:52.544770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810109+0000","last_change":"2024-09-12T00:03:31.347021+0000","last_active":"2024-09-12T00:06:41.810109+0000","last_peered":"2024-09-12T00:06:41.810109+0000","last_clean":"2024-09-12T00:06:41.810109+0000","last_became_active":"2024-09-12T00:03:31.344407+0000","last_became_peered":"2024-09-12T00:03:31.344407+0000","last_unstale":"2024-09-12T00:06:41.810109+0000","last_undegraded":"2024-09-12T00:06:41.810109+0000","last_fullsized":"2024-09-12T00:06:41.810109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:32.139742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"84'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719370+0000","last_change":"2024-09-12T00:03:33.370271+0000","last_active":"2024-09-12T00:06:42.719370+0000","last_peered":"2024-09-12T00:06:42.719370+0000","last_clean":"2024-09-12T00:06:42.719370+0000","last_became_active":"2024-09-12T00:03:33.369538+0000","last_became_peered":"2024-09-12T00:03:33.369538+0000","last_unstale":"2024-09-12T00:06:42.719370+0000","last_undegraded":"2024-09-12T00:06:42.719370+0000","last_fullsized":"2024-09-12T00:06:42.719370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"59'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810693+0000","last_change":"2024-09-12T00:03:25.341025+0000","last_active":"2024-09-12T00:06:41.810693+0000","last_peered":"2024-09-12T00:06:41.810693+0000","last_clean":"2024-09-12T00:06:41.810693+0000","last_became_active":"2024-09-12T00:03:25.340288+0000","last_became_peered":"2024-09-12T00:03:25.340288+0000","last_unstale":"2024-09-12T00:06:41.810693+0000","last_undegraded":"2024-09-12T00:06:41.810693+0000","last_fullsized":"2024-09-12T00:06:41.810693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"96'29","reported_seq":330,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814348+0000","last_change":"2024-09-12T00:06:30.098997+0000","last_active":"2024-09-12T00:06:41.814348+0000","last_peered":"2024-09-12T00:06:41.814348+0000","last_clean":"2024-09-12T00:06:41.814348+0000","last_became_active":"2024-09-12T00:06:26.672172+0000","last_became_peered":"2024-09-12T00:06:26.672172+0000","last_unstale":"2024-09-12T00:06:41.814348+0000","last_undegraded":"2024-09-12T00:06:41.814348+0000","last_fullsized":"2024-09-12T00:06:41.814348+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:32.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810614+0000","last_change":"2024-09-12T00:03:27.329869+0000","last_active":"2024-09-12T00:06:41.810614+0000","last_peered":"2024-09-12T00:06:41.810614+0000","last_clean":"2024-09-12T00:06:41.810614+0000","last_became_active":"2024-09-12T00:03:27.329077+0000","last_became_peered":"2024-09-12T00:03:27.329077+0000","last_unstale":"2024-09-12T00:06:41.810614+0000","last_undegraded":"2024-09-12T00:06:41.810614+0000","last_fullsized":"2024-09-12T00:06:41.810614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"96'19","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720203+0000","last_change":"2024-09-12T00:03:29.346878+0000","last_active":"2024-09-12T00:06:42.720203+0000","last_peered":"2024-09-12T00:06:42.720203+0000","last_clean":"2024-09-12T00:06:42.720203+0000","last_became_active":"2024-09-12T00:03:29.345990+0000","last_became_peered":"2024-09-12T00:03:29.345990+0000","last_unstale":"2024-09-12T00:06:42.720203+0000","last_undegraded":"2024-09-12T00:06:42.720203+0000","last_fullsized":"2024-09-12T00:06:42.720203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:06.398979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499961+0000","last_change":"2024-09-12T00:03:31.363658+0000","last_active":"2024-09-12T00:06:42.499961+0000","last_peered":"2024-09-12T00:06:42.499961+0000","last_clean":"2024-09-12T00:06:42.499961+0000","last_became_active":"2024-09-12T00:03:31.363080+0000","last_became_peered":"2024-09-12T00:03:31.363080+0000","last_unstale":"2024-09-12T00:06:42.499961+0000","last_undegraded":"2024-09-12T00:06:42.499961+0000","last_fullsized":"2024-09-12T00:06:42.499961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:05.901608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717550+0000","last_change":"2024-09-12T00:06:26.673691+0000","last_active":"2024-09-12T00:06:42.717550+0000","last_peered":"2024-09-12T00:06:42.717550+0000","last_clean":"2024-09-12T00:06:42.717550+0000","last_became_active":"2024-09-12T00:06:26.669877+0000","last_became_peered":"2024-09-12T00:06:26.669877+0000","last_unstale":"2024-09-12T00:06:42.717550+0000","last_undegraded":"2024-09-12T00:06:42.717550+0000","last_fullsized":"2024-09-12T00:06:42.717550+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:02.798560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"59'2","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718800+0000","last_change":"2024-09-12T00:06:26.687219+0000","last_active":"2024-09-12T00:06:42.718800+0000","last_peered":"2024-09-12T00:06:42.718800+0000","last_clean":"2024-09-12T00:06:42.718800+0000","last_became_active":"2024-09-12T00:06:26.655483+0000","last_became_peered":"2024-09-12T00:06:26.655483+0000","last_unstale":"2024-09-12T00:06:42.718800+0000","last_undegraded":"2024-09-12T00:06:42.718800+0000","last_fullsized":"2024-09-12T00:06:42.718800+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:21.199336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"96'22","reported_seq":299,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067870+0000","last_change":"2024-09-12T00:06:27.905793+0000","last_active":"2024-09-12T00:06:42.067870+0000","last_peered":"2024-09-12T00:06:42.067870+0000","last_clean":"2024-09-12T00:06:42.067870+0000","last_became_active":"2024-09-12T00:06:26.664617+0000","last_became_peered":"2024-09-12T00:06:26.664617+0000","last_unstale":"2024-09-12T00:06:42.067870+0000","last_undegraded":"2024-09-12T00:06:42.067870+0000","last_fullsized":"2024-09-12T00:06:42.067870+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:23.455040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":142606336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717842+0000","last_change":"2024-09-12T00:06:26.663673+0000","last_active":"2024-09-12T00:06:42.717842+0000","last_peered":"2024-09-12T00:06:42.717842+0000","last_clean":"2024-09-12T00:06:42.717842+0000","last_became_active":"2024-09-12T00:06:26.663351+0000","last_became_peered":"2024-09-12T00:06:26.663351+0000","last_unstale":"2024-09-12T00:06:42.717842+0000","last_undegraded":"2024-09-12T00:06:42.717842+0000","last_fullsized":"2024-09-12T00:06:42.717842+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:58.342457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"96'18","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814520+0000","last_change":"2024-09-12T00:03:29.346312+0000","last_active":"2024-09-12T00:06:41.814520+0000","last_peered":"2024-09-12T00:06:41.814520+0000","last_clean":"2024-09-12T00:06:41.814520+0000","last_became_active":"2024-09-12T00:03:29.345883+0000","last_became_peered":"2024-09-12T00:03:29.345883+0000","last_unstale":"2024-09-12T00:06:41.814520+0000","last_undegraded":"2024-09-12T00:06:41.814520+0000","last_fullsized":"2024-09-12T00:06:41.814520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:46.723370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719592+0000","last_change":"2024-09-12T00:03:31.358786+0000","last_active":"2024-09-12T00:06:42.719592+0000","last_peered":"2024-09-12T00:06:42.719592+0000","last_clean":"2024-09-12T00:06:42.719592+0000","last_became_active":"2024-09-12T00:03:31.358011+0000","last_became_peered":"2024-09-12T00:03:31.358011+0000","last_unstale":"2024-09-12T00:06:42.719592+0000","last_undegraded":"2024-09-12T00:06:42.719592+0000","last_fullsized":"2024-09-12T00:06:42.719592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:29.394163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"59'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720085+0000","last_change":"2024-09-12T00:06:28.364181+0000","last_active":"2024-09-12T00:06:42.720085+0000","last_peered":"2024-09-12T00:06:42.720085+0000","last_clean":"2024-09-12T00:06:42.720085+0000","last_became_active":"2024-09-12T00:06:26.667552+0000","last_became_peered":"2024-09-12T00:06:26.667552+0000","last_unstale":"2024-09-12T00:06:42.720085+0000","last_undegraded":"2024-09-12T00:06:42.720085+0000","last_fullsized":"2024-09-12T00:06:42.720085+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:19.435061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"96'23","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064267+0000","last_change":"2024-09-12T00:03:23.627584+0000","last_active":"2024-09-12T00:06:42.064267+0000","last_peered":"2024-09-12T00:06:42.064267+0000","last_clean":"2024-09-12T00:06:42.064267+0000","last_became_active":"2024-09-12T00:03:23.626026+0000","last_became_peered":"2024-09-12T00:03:23.626026+0000","last_unstale":"2024-09-12T00:06:42.064267+0000","last_undegraded":"2024-09-12T00:06:42.064267+0000","last_fullsized":"2024-09-12T00:06:42.064267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:38.192583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720246+0000","last_change":"2024-09-12T00:06:26.671971+0000","last_active":"2024-09-12T00:06:42.720246+0000","last_peered":"2024-09-12T00:06:42.720246+0000","last_clean":"2024-09-12T00:06:42.720246+0000","last_became_active":"2024-09-12T00:06:26.671427+0000","last_became_peered":"2024-09-12T00:06:26.671427+0000","last_unstale":"2024-09-12T00:06:42.720246+0000","last_undegraded":"2024-09-12T00:06:42.720246+0000","last_fullsized":"2024-09-12T00:06:42.720246+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:22.897492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"96'35","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720971+0000","last_change":"2024-09-12T00:03:29.340387+0000","last_active":"2024-09-12T00:06:42.720971+0000","last_peered":"2024-09-12T00:06:42.720971+0000","last_clean":"2024-09-12T00:06:42.720971+0000","last_became_active":"2024-09-12T00:03:29.339781+0000","last_became_peered":"2024-09-12T00:03:29.339781+0000","last_unstale":"2024-09-12T00:06:42.720971+0000","last_undegraded":"2024-09-12T00:06:42.720971+0000","last_fullsized":"2024-09-12T00:06:42.720971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:30.132716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811392+0000","last_change":"2024-09-12T00:03:31.350303+0000","last_active":"2024-09-12T00:06:41.811392+0000","last_peered":"2024-09-12T00:06:41.811392+0000","last_clean":"2024-09-12T00:06:41.811392+0000","last_became_active":"2024-09-12T00:03:31.349591+0000","last_became_peered":"2024-09-12T00:03:31.349591+0000","last_unstale":"2024-09-12T00:06:41.811392+0000","last_undegraded":"2024-09-12T00:06:41.811392+0000","last_fullsized":"2024-09-12T00:06:41.811392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:00.263644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"96'4","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065021+0000","last_change":"2024-09-12T00:03:33.385028+0000","last_active":"2024-09-12T00:06:42.065021+0000","last_peered":"2024-09-12T00:06:42.065021+0000","last_clean":"2024-09-12T00:06:42.065021+0000","last_became_active":"2024-09-12T00:03:33.384274+0000","last_became_peered":"2024-09-12T00:03:33.384274+0000","last_unstale":"2024-09-12T00:06:42.065021+0000","last_undegraded":"2024-09-12T00:06:42.065021+0000","last_fullsized":"2024-09-12T00:06:42.065021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:11.634604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"58'2","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813365+0000","last_change":"2024-09-12T00:03:25.329888+0000","last_active":"2024-09-12T00:06:41.813365+0000","last_peered":"2024-09-12T00:06:41.813365+0000","last_clean":"2024-09-12T00:06:41.813365+0000","last_became_active":"2024-09-12T00:03:25.329151+0000","last_became_peered":"2024-09-12T00:03:25.329151+0000","last_unstale":"2024-09-12T00:06:41.813365+0000","last_undegraded":"2024-09-12T00:06:41.813365+0000","last_fullsized":"2024-09-12T00:06:41.813365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:47.272383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"96'25","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811321+0000","last_change":"2024-09-12T00:03:23.600146+0000","last_active":"2024-09-12T00:06:41.811321+0000","last_peered":"2024-09-12T00:06:41.811321+0000","last_clean":"2024-09-12T00:06:41.811321+0000","last_became_active":"2024-09-12T00:03:23.598862+0000","last_became_peered":"2024-09-12T00:03:23.598862+0000","last_unstale":"2024-09-12T00:06:41.811321+0000","last_undegraded":"2024-09-12T00:06:41.811321+0000","last_fullsized":"2024-09-12T00:06:41.811321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:13.330852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813925+0000","last_change":"2024-09-12T00:03:27.341032+0000","last_active":"2024-09-12T00:06:41.813925+0000","last_peered":"2024-09-12T00:06:41.813925+0000","last_clean":"2024-09-12T00:06:41.813925+0000","last_became_active":"2024-09-12T00:03:27.340199+0000","last_became_peered":"2024-09-12T00:03:27.340199+0000","last_unstale":"2024-09-12T00:06:41.813925+0000","last_undegraded":"2024-09-12T00:06:41.813925+0000","last_fullsized":"2024-09-12T00:06:41.813925+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:23.673080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"96'24","reported_seq":57,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717487+0000","last_change":"2024-09-12T00:06:31.054703+0000","last_active":"2024-09-12T00:06:42.717487+0000","last_peered":"2024-09-12T00:06:42.717487+0000","last_clean":"2024-09-12T00:06:42.717487+0000","last_became_active":"2024-09-12T00:06:26.675513+0000","last_became_peered":"2024-09-12T00:06:26.675513+0000","last_unstale":"2024-09-12T00:06:42.717487+0000","last_undegraded":"2024-09-12T00:06:42.717487+0000","last_fullsized":"2024-09-12T00:06:42.717487+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:56.604086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065828+0000","last_change":"2024-09-12T00:06:26.678166+0000","last_active":"2024-09-12T00:06:42.065828+0000","last_peered":"2024-09-12T00:06:42.065828+0000","last_clean":"2024-09-12T00:06:42.065828+0000","last_became_active":"2024-09-12T00:06:26.677049+0000","last_became_peered":"2024-09-12T00:06:26.677049+0000","last_unstale":"2024-09-12T00:06:42.065828+0000","last_undegraded":"2024-09-12T00:06:42.065828+0000","last_fullsized":"2024-09-12T00:06:42.065828+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:26.729678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"59'3","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721092+0000","last_change":"2024-09-12T00:06:32.445889+0000","last_active":"2024-09-12T00:06:42.721092+0000","last_peered":"2024-09-12T00:06:42.721092+0000","last_clean":"2024-09-12T00:06:42.721092+0000","last_became_active":"2024-09-12T00:06:26.677859+0000","last_became_peered":"2024-09-12T00:06:26.677859+0000","last_unstale":"2024-09-12T00:06:42.721092+0000","last_undegraded":"2024-09-12T00:06:42.721092+0000","last_fullsized":"2024-09-12T00:06:42.721092+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:56.789846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"59'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722541+0000","last_change":"2024-09-12T00:03:25.360355+0000","last_active":"2024-09-12T00:06:42.722541+0000","last_peered":"2024-09-12T00:06:42.722541+0000","last_clean":"2024-09-12T00:06:42.722541+0000","last_became_active":"2024-09-12T00:03:25.359682+0000","last_became_peered":"2024-09-12T00:03:25.359682+0000","last_unstale":"2024-09-12T00:06:42.722541+0000","last_undegraded":"2024-09-12T00:06:42.722541+0000","last_fullsized":"2024-09-12T00:06:42.722541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:11.808081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"96'20","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500616+0000","last_change":"2024-09-12T00:03:23.621199+0000","last_active":"2024-09-12T00:06:42.500616+0000","last_peered":"2024-09-12T00:06:42.500616+0000","last_clean":"2024-09-12T00:06:42.500616+0000","last_became_active":"2024-09-12T00:03:23.620961+0000","last_became_peered":"2024-09-12T00:03:23.620961+0000","last_unstale":"2024-09-12T00:06:42.500616+0000","last_undegraded":"2024-09-12T00:06:42.500616+0000","last_fullsized":"2024-09-12T00:06:42.500616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811166+0000","last_change":"2024-09-12T00:03:27.336918+0000","last_active":"2024-09-12T00:06:41.811166+0000","last_peered":"2024-09-12T00:06:41.811166+0000","last_clean":"2024-09-12T00:06:41.811166+0000","last_became_active":"2024-09-12T00:03:27.336045+0000","last_became_peered":"2024-09-12T00:03:27.336045+0000","last_unstale":"2024-09-12T00:06:41.811166+0000","last_undegraded":"2024-09-12T00:06:41.811166+0000","last_fullsized":"2024-09-12T00:06:41.811166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"96'25","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720072+0000","last_change":"2024-09-12T00:03:29.338667+0000","last_active":"2024-09-12T00:06:42.720072+0000","last_peered":"2024-09-12T00:06:42.720072+0000","last_clean":"2024-09-12T00:06:42.720072+0000","last_became_active":"2024-09-12T00:03:29.338010+0000","last_became_peered":"2024-09-12T00:03:29.338010+0000","last_unstale":"2024-09-12T00:06:42.720072+0000","last_undegraded":"2024-09-12T00:06:42.720072+0000","last_fullsized":"2024-09-12T00:06:42.720072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:58.256619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722902+0000","last_change":"2024-09-12T00:03:31.352823+0000","last_active":"2024-09-12T00:06:42.722902+0000","last_peered":"2024-09-12T00:06:42.722902+0000","last_clean":"2024-09-12T00:06:42.722902+0000","last_became_active":"2024-09-12T00:03:31.352143+0000","last_became_peered":"2024-09-12T00:03:31.352143+0000","last_unstale":"2024-09-12T00:06:42.722902+0000","last_undegraded":"2024-09-12T00:06:42.722902+0000","last_fullsized":"2024-09-12T00:06:42.722902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:25.168692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"76'8","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721671+0000","last_change":"2024-09-12T00:06:27.901313+0000","last_active":"2024-09-12T00:06:42.721671+0000","last_peered":"2024-09-12T00:06:42.721671+0000","last_clean":"2024-09-12T00:06:42.721671+0000","last_became_active":"2024-09-12T00:06:26.658281+0000","last_became_peered":"2024-09-12T00:06:26.658281+0000","last_unstale":"2024-09-12T00:06:42.721671+0000","last_undegraded":"2024-09-12T00:06:42.721671+0000","last_fullsized":"2024-09-12T00:06:42.721671+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:54.959771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"58'2","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812806+0000","last_change":"2024-09-12T00:03:25.325094+0000","last_active":"2024-09-12T00:06:41.812806+0000","last_peered":"2024-09-12T00:06:41.812806+0000","last_clean":"2024-09-12T00:06:41.812806+0000","last_became_active":"2024-09-12T00:03:25.324315+0000","last_became_peered":"2024-09-12T00:03:25.324315+0000","last_unstale":"2024-09-12T00:06:41.812806+0000","last_undegraded":"2024-09-12T00:06:41.812806+0000","last_fullsized":"2024-09-12T00:06:41.812806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:18.727732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"96'27","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812410+0000","last_change":"2024-09-12T00:03:23.606163+0000","last_active":"2024-09-12T00:06:41.812410+0000","last_peered":"2024-09-12T00:06:41.812410+0000","last_clean":"2024-09-12T00:06:41.812410+0000","last_became_active":"2024-09-12T00:03:23.605402+0000","last_became_peered":"2024-09-12T00:03:23.605402+0000","last_unstale":"2024-09-12T00:06:41.812410+0000","last_undegraded":"2024-09-12T00:06:41.812410+0000","last_fullsized":"2024-09-12T00:06:41.812410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:02.432313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812917+0000","last_change":"2024-09-12T00:03:27.336716+0000","last_active":"2024-09-12T00:06:41.812917+0000","last_peered":"2024-09-12T00:06:41.812917+0000","last_clean":"2024-09-12T00:06:41.812917+0000","last_became_active":"2024-09-12T00:03:27.335658+0000","last_became_peered":"2024-09-12T00:03:27.335658+0000","last_unstale":"2024-09-12T00:06:41.812917+0000","last_undegraded":"2024-09-12T00:06:41.812917+0000","last_fullsized":"2024-09-12T00:06:41.812917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:47.355798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"35'16","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720503+0000","last_change":"2024-09-12T00:06:29.533440+0000","last_active":"2024-09-12T00:06:42.720503+0000","last_peered":"2024-09-12T00:06:42.720503+0000","last_clean":"2024-09-12T00:06:42.720503+0000","last_became_active":"2024-09-12T00:06:26.671893+0000","last_became_peered":"2024-09-12T00:06:26.671893+0000","last_unstale":"2024-09-12T00:06:42.720503+0000","last_undegraded":"2024-09-12T00:06:42.720503+0000","last_fullsized":"2024-09-12T00:06:42.720503+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:10.667822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"96'134","reported_seq":353,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816434+0000","last_change":"2024-09-12T00:03:31.351362+0000","last_active":"2024-09-12T00:06:41.816434+0000","last_peered":"2024-09-12T00:06:41.816434+0000","last_clean":"2024-09-12T00:06:41.816434+0000","last_became_active":"2024-09-12T00:03:31.350925+0000","last_became_peered":"2024-09-12T00:03:31.350925+0000","last_unstale":"2024-09-12T00:06:41.816434+0000","last_undegraded":"2024-09-12T00:06:41.816434+0000","last_fullsized":"2024-09-12T00:06:41.816434+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:03.147968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719766+0000","last_change":"2024-09-12T00:06:26.675599+0000","last_active":"2024-09-12T00:06:42.719766+0000","last_peered":"2024-09-12T00:06:42.719766+0000","last_clean":"2024-09-12T00:06:42.719766+0000","last_became_active":"2024-09-12T00:06:26.675234+0000","last_became_peered":"2024-09-12T00:06:26.675234+0000","last_unstale":"2024-09-12T00:06:42.719766+0000","last_undegraded":"2024-09-12T00:06:42.719766+0000","last_fullsized":"2024-09-12T00:06:42.719766+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:28.887412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"59'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812590+0000","last_change":"2024-09-12T00:03:25.357999+0000","last_active":"2024-09-12T00:06:41.812590+0000","last_peered":"2024-09-12T00:06:41.812590+0000","last_clean":"2024-09-12T00:06:41.812590+0000","last_became_active":"2024-09-12T00:03:25.357623+0000","last_became_peered":"2024-09-12T00:03:25.357623+0000","last_unstale":"2024-09-12T00:06:41.812590+0000","last_undegraded":"2024-09-12T00:06:41.812590+0000","last_fullsized":"2024-09-12T00:06:41.812590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"96'29","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500852+0000","last_change":"2024-09-12T00:03:23.605954+0000","last_active":"2024-09-12T00:06:42.500852+0000","last_peered":"2024-09-12T00:06:42.500852+0000","last_clean":"2024-09-12T00:06:42.500852+0000","last_became_active":"2024-09-12T00:03:23.604773+0000","last_became_peered":"2024-09-12T00:03:23.604773+0000","last_unstale":"2024-09-12T00:06:42.500852+0000","last_undegraded":"2024-09-12T00:06:42.500852+0000","last_fullsized":"2024-09-12T00:06:42.500852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500071+0000","last_change":"2024-09-12T00:03:27.346785+0000","last_active":"2024-09-12T00:06:42.500071+0000","last_peered":"2024-09-12T00:06:42.500071+0000","last_clean":"2024-09-12T00:06:42.500071+0000","last_became_active":"2024-09-12T00:03:27.346168+0000","last_became_peered":"2024-09-12T00:03:27.346168+0000","last_unstale":"2024-09-12T00:06:42.500071+0000","last_undegraded":"2024-09-12T00:06:42.500071+0000","last_fullsized":"2024-09-12T00:06:42.500071+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"96'49","reported_seq":267,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811988+0000","last_change":"2024-09-12T00:03:29.343942+0000","last_active":"2024-09-12T00:06:41.811988+0000","last_peered":"2024-09-12T00:06:41.811988+0000","last_clean":"2024-09-12T00:06:41.811988+0000","last_became_active":"2024-09-12T00:03:29.343238+0000","last_became_peered":"2024-09-12T00:03:29.343238+0000","last_unstale":"2024-09-12T00:06:41.811988+0000","last_undegraded":"2024-09-12T00:06:41.811988+0000","last_fullsized":"2024-09-12T00:06:41.811988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:30.949892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810193+0000","last_change":"2024-09-12T00:06:26.655176+0000","last_active":"2024-09-12T00:06:41.810193+0000","last_peered":"2024-09-12T00:06:41.810193+0000","last_clean":"2024-09-12T00:06:41.810193+0000","last_became_active":"2024-09-12T00:06:26.654187+0000","last_became_peered":"2024-09-12T00:06:26.654187+0000","last_unstale":"2024-09-12T00:06:41.810193+0000","last_undegraded":"2024-09-12T00:06:41.810193+0000","last_fullsized":"2024-09-12T00:06:41.810193+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:58.719162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501328+0000","last_change":"2024-09-12T00:03:33.363188+0000","last_active":"2024-09-12T00:06:42.501328+0000","last_peered":"2024-09-12T00:06:42.501328+0000","last_clean":"2024-09-12T00:06:42.501328+0000","last_became_active":"2024-09-12T00:03:33.360672+0000","last_became_peered":"2024-09-12T00:03:33.360672+0000","last_unstale":"2024-09-12T00:06:42.501328+0000","last_undegraded":"2024-09-12T00:06:42.501328+0000","last_fullsized":"2024-09-12T00:06:42.501328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:33.646117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"59'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811812+0000","last_change":"2024-09-12T00:03:25.336626+0000","last_active":"2024-09-12T00:06:41.811812+0000","last_peered":"2024-09-12T00:06:41.811812+0000","last_clean":"2024-09-12T00:06:41.811812+0000","last_became_active":"2024-09-12T00:03:25.336095+0000","last_became_peered":"2024-09-12T00:03:25.336095+0000","last_unstale":"2024-09-12T00:06:41.811812+0000","last_undegraded":"2024-09-12T00:06:41.811812+0000","last_fullsized":"2024-09-12T00:06:41.811812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"95'26","reported_seq":95,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720356+0000","last_change":"2024-09-12T00:06:32.976777+0000","last_active":"2024-09-12T00:06:42.720356+0000","last_peered":"2024-09-12T00:06:42.720356+0000","last_clean":"2024-09-12T00:06:42.720356+0000","last_became_active":"2024-09-12T00:06:26.678646+0000","last_became_peered":"2024-09-12T00:06:26.678646+0000","last_unstale":"2024-09-12T00:06:42.720356+0000","last_undegraded":"2024-09-12T00:06:42.720356+0000","last_fullsized":"2024-09-12T00:06:42.720356+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:02.624469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":192937984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812464+0000","last_change":"2024-09-12T00:03:27.326174+0000","last_active":"2024-09-12T00:06:41.812464+0000","last_peered":"2024-09-12T00:06:41.812464+0000","last_clean":"2024-09-12T00:06:41.812464+0000","last_became_active":"2024-09-12T00:03:27.325336+0000","last_became_peered":"2024-09-12T00:03:27.325336+0000","last_unstale":"2024-09-12T00:06:41.812464+0000","last_undegraded":"2024-09-12T00:06:41.812464+0000","last_fullsized":"2024-09-12T00:06:41.812464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:08.659813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"96'23","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810811+0000","last_change":"2024-09-12T00:03:29.335957+0000","last_active":"2024-09-12T00:06:41.810811+0000","last_peered":"2024-09-12T00:06:41.810811+0000","last_clean":"2024-09-12T00:06:41.810811+0000","last_became_active":"2024-09-12T00:03:29.335186+0000","last_became_peered":"2024-09-12T00:03:29.335186+0000","last_unstale":"2024-09-12T00:06:41.810811+0000","last_undegraded":"2024-09-12T00:06:41.810811+0000","last_fullsized":"2024-09-12T00:06:41.810811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:20.551758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721804+0000","last_change":"2024-09-12T00:06:26.671154+0000","last_active":"2024-09-12T00:06:42.721804+0000","last_peered":"2024-09-12T00:06:42.721804+0000","last_clean":"2024-09-12T00:06:42.721804+0000","last_became_active":"2024-09-12T00:06:26.667486+0000","last_became_peered":"2024-09-12T00:06:26.667486+0000","last_unstale":"2024-09-12T00:06:42.721804+0000","last_undegraded":"2024-09-12T00:06:42.721804+0000","last_fullsized":"2024-09-12T00:06:42.721804+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:31.291883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066037+0000","last_change":"2024-09-12T00:03:33.385037+0000","last_active":"2024-09-12T00:06:42.066037+0000","last_peered":"2024-09-12T00:06:42.066037+0000","last_clean":"2024-09-12T00:06:42.066037+0000","last_became_active":"2024-09-12T00:03:33.384379+0000","last_became_peered":"2024-09-12T00:03:33.384379+0000","last_unstale":"2024-09-12T00:06:42.066037+0000","last_undegraded":"2024-09-12T00:06:42.066037+0000","last_fullsized":"2024-09-12T00:06:42.066037+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:00.153475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"96'10","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718737+0000","last_change":"2024-09-12T00:03:25.339110+0000","last_active":"2024-09-12T00:06:42.718737+0000","last_peered":"2024-09-12T00:06:42.718737+0000","last_clean":"2024-09-12T00:06:42.718737+0000","last_became_active":"2024-09-12T00:03:25.338417+0000","last_became_peered":"2024-09-12T00:03:25.338417+0000","last_unstale":"2024-09-12T00:06:42.718737+0000","last_undegraded":"2024-09-12T00:06:42.718737+0000","last_fullsized":"2024-09-12T00:06:42.718737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:48.866021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"96'31","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067362+0000","last_change":"2024-09-12T00:03:23.625514+0000","last_active":"2024-09-12T00:06:42.067362+0000","last_peered":"2024-09-12T00:06:42.067362+0000","last_clean":"2024-09-12T00:06:42.067362+0000","last_became_active":"2024-09-12T00:03:23.621654+0000","last_became_peered":"2024-09-12T00:03:23.621654+0000","last_unstale":"2024-09-12T00:06:42.067362+0000","last_undegraded":"2024-09-12T00:06:42.067362+0000","last_fullsized":"2024-09-12T00:06:42.067362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:43.784497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500172+0000","last_change":"2024-09-12T00:03:27.330377+0000","last_active":"2024-09-12T00:06:42.500172+0000","last_peered":"2024-09-12T00:06:42.500172+0000","last_clean":"2024-09-12T00:06:42.500172+0000","last_became_active":"2024-09-12T00:03:27.329713+0000","last_became_peered":"2024-09-12T00:03:27.329713+0000","last_unstale":"2024-09-12T00:06:42.500172+0000","last_undegraded":"2024-09-12T00:06:42.500172+0000","last_fullsized":"2024-09-12T00:06:42.500172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"96'19","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721448+0000","last_change":"2024-09-12T00:03:29.337028+0000","last_active":"2024-09-12T00:06:42.721448+0000","last_peered":"2024-09-12T00:06:42.721448+0000","last_clean":"2024-09-12T00:06:42.721448+0000","last_became_active":"2024-09-12T00:03:29.335440+0000","last_became_peered":"2024-09-12T00:03:29.335440+0000","last_unstale":"2024-09-12T00:06:42.721448+0000","last_undegraded":"2024-09-12T00:06:42.721448+0000","last_fullsized":"2024-09-12T00:06:42.721448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:19.288395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721524+0000","last_change":"2024-09-12T00:06:26.674200+0000","last_active":"2024-09-12T00:06:42.721524+0000","last_peered":"2024-09-12T00:06:42.721524+0000","last_clean":"2024-09-12T00:06:42.721524+0000","last_became_active":"2024-09-12T00:06:26.660173+0000","last_became_peered":"2024-09-12T00:06:26.660173+0000","last_unstale":"2024-09-12T00:06:42.721524+0000","last_undegraded":"2024-09-12T00:06:42.721524+0000","last_fullsized":"2024-09-12T00:06:42.721524+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:56.674961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"58'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720918+0000","last_change":"2024-09-12T00:06:32.449370+0000","last_active":"2024-09-12T00:06:42.720918+0000","last_peered":"2024-09-12T00:06:42.720918+0000","last_clean":"2024-09-12T00:06:42.720918+0000","last_became_active":"2024-09-12T00:06:26.677210+0000","last_became_peered":"2024-09-12T00:06:26.677210+0000","last_unstale":"2024-09-12T00:06:42.720918+0000","last_undegraded":"2024-09-12T00:06:42.720918+0000","last_fullsized":"2024-09-12T00:06:42.720918+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:13.086869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"96'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810877+0000","last_change":"2024-09-12T00:03:25.337999+0000","last_active":"2024-09-12T00:06:41.810877+0000","last_peered":"2024-09-12T00:06:41.810877+0000","last_clean":"2024-09-12T00:06:41.810877+0000","last_became_active":"2024-09-12T00:03:25.337237+0000","last_became_peered":"2024-09-12T00:03:25.337237+0000","last_unstale":"2024-09-12T00:06:41.810877+0000","last_undegraded":"2024-09-12T00:06:41.810877+0000","last_fullsized":"2024-09-12T00:06:41.810877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"96'29","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067739+0000","last_change":"2024-09-12T00:03:23.631744+0000","last_active":"2024-09-12T00:06:42.067739+0000","last_peered":"2024-09-12T00:06:42.067739+0000","last_clean":"2024-09-12T00:06:42.067739+0000","last_became_active":"2024-09-12T00:03:23.630928+0000","last_became_peered":"2024-09-12T00:03:23.630928+0000","last_unstale":"2024-09-12T00:06:42.067739+0000","last_undegraded":"2024-09-12T00:06:42.067739+0000","last_fullsized":"2024-09-12T00:06:42.067739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:35.772832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810384+0000","last_change":"2024-09-12T00:06:26.683708+0000","last_active":"2024-09-12T00:06:41.810384+0000","last_peered":"2024-09-12T00:06:41.810384+0000","last_clean":"2024-09-12T00:06:41.810384+0000","last_became_active":"2024-09-12T00:06:26.651342+0000","last_became_peered":"2024-09-12T00:06:26.651342+0000","last_unstale":"2024-09-12T00:06:41.810384+0000","last_undegraded":"2024-09-12T00:06:41.810384+0000","last_fullsized":"2024-09-12T00:06:41.810384+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:06.251275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"96'29","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721214+0000","last_change":"2024-09-12T00:06:33.464772+0000","last_active":"2024-09-12T00:06:42.721214+0000","last_peered":"2024-09-12T00:06:42.721214+0000","last_clean":"2024-09-12T00:06:42.721214+0000","last_became_active":"2024-09-12T00:06:26.680856+0000","last_became_peered":"2024-09-12T00:06:26.680856+0000","last_unstale":"2024-09-12T00:06:42.721214+0000","last_undegraded":"2024-09-12T00:06:42.721214+0000","last_fullsized":"2024-09-12T00:06:42.721214+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:08.755659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":26,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811844+0000","last_change":"2024-09-12T00:03:31.355300+0000","last_active":"2024-09-12T00:06:41.811844+0000","last_peered":"2024-09-12T00:06:41.811844+0000","last_clean":"2024-09-12T00:06:41.811844+0000","last_became_active":"2024-09-12T00:03:31.354506+0000","last_became_peered":"2024-09-12T00:03:31.354506+0000","last_unstale":"2024-09-12T00:06:41.811844+0000","last_undegraded":"2024-09-12T00:06:41.811844+0000","last_fullsized":"2024-09-12T00:06:41.811844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:51.564710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"58'1","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815779+0000","last_change":"2024-09-12T00:03:33.384262+0000","last_active":"2024-09-12T00:06:41.815779+0000","last_peered":"2024-09-12T00:06:41.815779+0000","last_clean":"2024-09-12T00:06:41.815779+0000","last_became_active":"2024-09-12T00:03:33.383358+0000","last_became_peered":"2024-09-12T00:03:33.383358+0000","last_unstale":"2024-09-12T00:06:41.815779+0000","last_undegraded":"2024-09-12T00:06:41.815779+0000","last_fullsized":"2024-09-12T00:06:41.815779+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:45.060131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"84'4","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813832+0000","last_change":"2024-09-12T00:06:28.849788+0000","last_active":"2024-09-12T00:06:41.813832+0000","last_peered":"2024-09-12T00:06:41.813832+0000","last_clean":"2024-09-12T00:06:41.813832+0000","last_became_active":"2024-09-12T00:06:26.664077+0000","last_became_peered":"2024-09-12T00:06:26.664077+0000","last_unstale":"2024-09-12T00:06:41.813832+0000","last_undegraded":"2024-09-12T00:06:41.813832+0000","last_fullsized":"2024-09-12T00:06:41.813832+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:24.431791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"96'31","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811482+0000","last_change":"2024-09-12T00:03:23.617643+0000","last_active":"2024-09-12T00:06:41.811482+0000","last_peered":"2024-09-12T00:06:41.811482+0000","last_clean":"2024-09-12T00:06:41.811482+0000","last_became_active":"2024-09-12T00:03:23.617138+0000","last_became_peered":"2024-09-12T00:03:23.617138+0000","last_unstale":"2024-09-12T00:06:41.811482+0000","last_undegraded":"2024-09-12T00:06:41.811482+0000","last_fullsized":"2024-09-12T00:06:41.811482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127926272,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":124928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"59'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723414+0000","last_change":"2024-09-12T00:03:25.335650+0000","last_active":"2024-09-12T00:06:42.723414+0000","last_peered":"2024-09-12T00:06:42.723414+0000","last_clean":"2024-09-12T00:06:42.723414+0000","last_became_active":"2024-09-12T00:03:25.334965+0000","last_became_peered":"2024-09-12T00:03:25.334965+0000","last_unstale":"2024-09-12T00:06:42.723414+0000","last_undegraded":"2024-09-12T00:06:42.723414+0000","last_fullsized":"2024-09-12T00:06:42.723414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:13.501672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"96'26","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718679+0000","last_change":"2024-09-12T00:03:23.618651+0000","last_active":"2024-09-12T00:06:42.718679+0000","last_peered":"2024-09-12T00:06:42.718679+0000","last_clean":"2024-09-12T00:06:42.718679+0000","last_became_active":"2024-09-12T00:03:23.612542+0000","last_became_peered":"2024-09-12T00:03:23.612542+0000","last_unstale":"2024-09-12T00:06:42.718679+0000","last_undegraded":"2024-09-12T00:06:42.718679+0000","last_fullsized":"2024-09-12T00:06:42.718679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"96'4","reported_seq":47,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717901+0000","last_change":"2024-09-12T00:06:32.454921+0000","last_active":"2024-09-12T00:06:42.717901+0000","last_peered":"2024-09-12T00:06:42.717901+0000","last_clean":"2024-09-12T00:06:42.717901+0000","last_became_active":"2024-09-12T00:06:26.677698+0000","last_became_peered":"2024-09-12T00:06:26.677698+0000","last_unstale":"2024-09-12T00:06:42.717901+0000","last_undegraded":"2024-09-12T00:06:42.717901+0000","last_fullsized":"2024-09-12T00:06:42.717901+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:31.889100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"96'30","reported_seq":103,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721342+0000","last_change":"2024-09-12T00:06:30.842710+0000","last_active":"2024-09-12T00:06:42.721342+0000","last_peered":"2024-09-12T00:06:42.721342+0000","last_clean":"2024-09-12T00:06:42.721342+0000","last_became_active":"2024-09-12T00:06:26.666582+0000","last_became_peered":"2024-09-12T00:06:26.666582+0000","last_unstale":"2024-09-12T00:06:42.721342+0000","last_undegraded":"2024-09-12T00:06:42.721342+0000","last_fullsized":"2024-09-12T00:06:42.721342+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:15.209092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":201326592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"63'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066906+0000","last_change":"2024-09-12T00:03:25.354015+0000","last_active":"2024-09-12T00:06:42.066906+0000","last_peered":"2024-09-12T00:06:42.066906+0000","last_clean":"2024-09-12T00:06:42.066906+0000","last_became_active":"2024-09-12T00:03:25.352319+0000","last_became_peered":"2024-09-12T00:03:25.352319+0000","last_unstale":"2024-09-12T00:06:42.066906+0000","last_undegraded":"2024-09-12T00:06:42.066906+0000","last_fullsized":"2024-09-12T00:06:42.066906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:08.033834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"96'17","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066879+0000","last_change":"2024-09-12T00:03:23.633614+0000","last_active":"2024-09-12T00:06:42.066879+0000","last_peered":"2024-09-12T00:06:42.066879+0000","last_clean":"2024-09-12T00:06:42.066879+0000","last_became_active":"2024-09-12T00:03:23.632850+0000","last_became_peered":"2024-09-12T00:03:23.632850+0000","last_unstale":"2024-09-12T00:06:42.066879+0000","last_undegraded":"2024-09-12T00:06:42.066879+0000","last_fullsized":"2024-09-12T00:06:42.066879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065662+0000","last_change":"2024-09-12T00:03:25.357453+0000","last_active":"2024-09-12T00:06:42.065662+0000","last_peered":"2024-09-12T00:06:42.065662+0000","last_clean":"2024-09-12T00:06:42.065662+0000","last_became_active":"2024-09-12T00:03:25.353815+0000","last_became_peered":"2024-09-12T00:03:25.353815+0000","last_unstale":"2024-09-12T00:06:42.065662+0000","last_undegraded":"2024-09-12T00:06:42.065662+0000","last_fullsized":"2024-09-12T00:06:42.065662+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:27.562174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"96'22","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721565+0000","last_change":"2024-09-12T00:03:23.609055+0000","last_active":"2024-09-12T00:06:42.721565+0000","last_peered":"2024-09-12T00:06:42.721565+0000","last_clean":"2024-09-12T00:06:42.721565+0000","last_became_active":"2024-09-12T00:03:23.608101+0000","last_became_peered":"2024-09-12T00:03:23.608101+0000","last_unstale":"2024-09-12T00:06:42.721565+0000","last_undegraded":"2024-09-12T00:06:42.721565+0000","last_fullsized":"2024-09-12T00:06:42.721565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"96'10","reported_seq":268,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814861+0000","last_change":"2024-09-12T00:06:28.290549+0000","last_active":"2024-09-12T00:06:41.814861+0000","last_peered":"2024-09-12T00:06:41.814861+0000","last_clean":"2024-09-12T00:06:41.814861+0000","last_became_active":"2024-09-12T00:06:26.681882+0000","last_became_peered":"2024-09-12T00:06:26.681882+0000","last_unstale":"2024-09-12T00:06:41.814861+0000","last_undegraded":"2024-09-12T00:06:41.814861+0000","last_fullsized":"2024-09-12T00:06:41.814861+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:12.272800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"96'26","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721650+0000","last_change":"2024-09-12T00:03:23.616706+0000","last_active":"2024-09-12T00:06:42.721650+0000","last_peered":"2024-09-12T00:06:42.721650+0000","last_clean":"2024-09-12T00:06:42.721650+0000","last_became_active":"2024-09-12T00:03:23.615970+0000","last_became_peered":"2024-09-12T00:03:23.615970+0000","last_unstale":"2024-09-12T00:06:42.721650+0000","last_undegraded":"2024-09-12T00:06:42.721650+0000","last_fullsized":"2024-09-12T00:06:42.721650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"63'8","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720621+0000","last_change":"2024-09-12T00:03:25.343716+0000","last_active":"2024-09-12T00:06:42.720621+0000","last_peered":"2024-09-12T00:06:42.720621+0000","last_clean":"2024-09-12T00:06:42.720621+0000","last_became_active":"2024-09-12T00:03:25.342930+0000","last_became_peered":"2024-09-12T00:03:25.342930+0000","last_unstale":"2024-09-12T00:06:42.720621+0000","last_undegraded":"2024-09-12T00:06:42.720621+0000","last_fullsized":"2024-09-12T00:06:42.720621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"95'25","reported_seq":321,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814202+0000","last_change":"2024-09-12T00:06:29.602896+0000","last_active":"2024-09-12T00:06:41.814202+0000","last_peered":"2024-09-12T00:06:41.814202+0000","last_clean":"2024-09-12T00:06:41.814202+0000","last_became_active":"2024-09-12T00:06:26.672080+0000","last_became_peered":"2024-09-12T00:06:26.672080+0000","last_unstale":"2024-09-12T00:06:41.814202+0000","last_undegraded":"2024-09-12T00:06:41.814202+0000","last_fullsized":"2024-09-12T00:06:41.814202+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:47.695274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"96'10","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499716+0000","last_change":"2024-09-12T00:03:25.326620+0000","last_active":"2024-09-12T00:06:42.499716+0000","last_peered":"2024-09-12T00:06:42.499716+0000","last_clean":"2024-09-12T00:06:42.499716+0000","last_became_active":"2024-09-12T00:03:25.326262+0000","last_became_peered":"2024-09-12T00:03:25.326262+0000","last_unstale":"2024-09-12T00:06:42.499716+0000","last_undegraded":"2024-09-12T00:06:42.499716+0000","last_fullsized":"2024-09-12T00:06:42.499716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"96'16","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067549+0000","last_change":"2024-09-12T00:03:23.632200+0000","last_active":"2024-09-12T00:06:42.067549+0000","last_peered":"2024-09-12T00:06:42.067549+0000","last_clean":"2024-09-12T00:06:42.067549+0000","last_became_active":"2024-09-12T00:03:23.631510+0000","last_became_peered":"2024-09-12T00:03:23.631510+0000","last_unstale":"2024-09-12T00:06:42.067549+0000","last_undegraded":"2024-09-12T00:06:42.067549+0000","last_fullsized":"2024-09-12T00:06:42.067549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:07.177242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"58'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.724304+0000","last_change":"2024-09-12T00:03:25.342763+0000","last_active":"2024-09-12T00:06:42.724304+0000","last_peered":"2024-09-12T00:06:42.724304+0000","last_clean":"2024-09-12T00:06:42.724304+0000","last_became_active":"2024-09-12T00:03:25.337834+0000","last_became_peered":"2024-09-12T00:03:25.337834+0000","last_unstale":"2024-09-12T00:06:42.724304+0000","last_undegraded":"2024-09-12T00:06:42.724304+0000","last_fullsized":"2024-09-12T00:06:42.724304+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:35.920599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"95'16","reported_seq":75,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717915+0000","last_change":"2024-09-12T00:06:28.323950+0000","last_active":"2024-09-12T00:06:42.717915+0000","last_peered":"2024-09-12T00:06:42.717915+0000","last_clean":"2024-09-12T00:06:42.717915+0000","last_became_active":"2024-09-12T00:06:26.666889+0000","last_became_peered":"2024-09-12T00:06:26.666889+0000","last_unstale":"2024-09-12T00:06:42.717915+0000","last_undegraded":"2024-09-12T00:06:42.717915+0000","last_fullsized":"2024-09-12T00:06:42.717915+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:12.167901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816185+0000","last_change":"2024-09-12T00:03:25.339910+0000","last_active":"2024-09-12T00:06:41.816185+0000","last_peered":"2024-09-12T00:06:41.816185+0000","last_clean":"2024-09-12T00:06:41.816185+0000","last_became_active":"2024-09-12T00:03:25.336511+0000","last_became_peered":"2024-09-12T00:03:25.336511+0000","last_unstale":"2024-09-12T00:06:41.816185+0000","last_undegraded":"2024-09-12T00:06:41.816185+0000","last_fullsized":"2024-09-12T00:06:41.816185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:30.647474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"96'28","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065464+0000","last_change":"2024-09-12T00:03:23.626232+0000","last_active":"2024-09-12T00:06:42.065464+0000","last_peered":"2024-09-12T00:06:42.065464+0000","last_clean":"2024-09-12T00:06:42.065464+0000","last_became_active":"2024-09-12T00:03:23.621761+0000","last_became_peered":"2024-09-12T00:03:23.621761+0000","last_unstale":"2024-09-12T00:06:42.065464+0000","last_undegraded":"2024-09-12T00:06:42.065464+0000","last_fullsized":"2024-09-12T00:06:42.065464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:31.587668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"59'4","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066619+0000","last_change":"2024-09-12T00:06:28.859921+0000","last_active":"2024-09-12T00:06:42.066619+0000","last_peered":"2024-09-12T00:06:42.066619+0000","last_clean":"2024-09-12T00:06:42.066619+0000","last_became_active":"2024-09-12T00:06:26.677331+0000","last_became_peered":"2024-09-12T00:06:26.677331+0000","last_unstale":"2024-09-12T00:06:42.066619+0000","last_undegraded":"2024-09-12T00:06:42.066619+0000","last_fullsized":"2024-09-12T00:06:42.066619+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:05.062779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"96'24","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500399+0000","last_change":"2024-09-12T00:03:23.600956+0000","last_active":"2024-09-12T00:06:42.500399+0000","last_peered":"2024-09-12T00:06:42.500399+0000","last_clean":"2024-09-12T00:06:42.500399+0000","last_became_active":"2024-09-12T00:03:23.600673+0000","last_became_peered":"2024-09-12T00:03:23.600673+0000","last_unstale":"2024-09-12T00:06:42.500399+0000","last_undegraded":"2024-09-12T00:06:42.500399+0000","last_fullsized":"2024-09-12T00:06:42.500399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"96'6","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500670+0000","last_change":"2024-09-12T00:03:25.325088+0000","last_active":"2024-09-12T00:06:42.500670+0000","last_peered":"2024-09-12T00:06:42.500670+0000","last_clean":"2024-09-12T00:06:42.500670+0000","last_became_active":"2024-09-12T00:03:25.324597+0000","last_became_peered":"2024-09-12T00:03:25.324597+0000","last_unstale":"2024-09-12T00:06:42.500670+0000","last_undegraded":"2024-09-12T00:06:42.500670+0000","last_fullsized":"2024-09-12T00:06:42.500670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"95'19","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812155+0000","last_change":"2024-09-12T00:03:23.621791+0000","last_active":"2024-09-12T00:06:41.812155+0000","last_peered":"2024-09-12T00:06:41.812155+0000","last_clean":"2024-09-12T00:06:41.812155+0000","last_became_active":"2024-09-12T00:03:23.621063+0000","last_became_peered":"2024-09-12T00:03:23.621063+0000","last_unstale":"2024-09-12T00:06:41.812155+0000","last_undegraded":"2024-09-12T00:06:41.812155+0000","last_fullsized":"2024-09-12T00:06:41.812155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:33.234598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77594624,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":75776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500368+0000","last_change":"2024-09-12T00:03:25.357605+0000","last_active":"2024-09-12T00:06:42.500368+0000","last_peered":"2024-09-12T00:06:42.500368+0000","last_clean":"2024-09-12T00:06:42.500368+0000","last_became_active":"2024-09-12T00:03:25.357286+0000","last_became_peered":"2024-09-12T00:03:25.357286+0000","last_unstale":"2024-09-12T00:06:42.500368+0000","last_undegraded":"2024-09-12T00:06:42.500368+0000","last_fullsized":"2024-09-12T00:06:42.500368+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"96'21","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815686+0000","last_change":"2024-09-12T00:03:23.600931+0000","last_active":"2024-09-12T00:06:41.815686+0000","last_peered":"2024-09-12T00:06:41.815686+0000","last_clean":"2024-09-12T00:06:41.815686+0000","last_became_active":"2024-09-12T00:03:23.600591+0000","last_became_peered":"2024-09-12T00:03:23.600591+0000","last_unstale":"2024-09-12T00:06:41.815686+0000","last_undegraded":"2024-09-12T00:06:41.815686+0000","last_fullsized":"2024-09-12T00:06:41.815686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"84'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719420+0000","last_change":"2024-09-12T00:03:25.330869+0000","last_active":"2024-09-12T00:06:42.719420+0000","last_peered":"2024-09-12T00:06:42.719420+0000","last_clean":"2024-09-12T00:06:42.719420+0000","last_became_active":"2024-09-12T00:03:25.329742+0000","last_became_peered":"2024-09-12T00:03:25.329742+0000","last_unstale":"2024-09-12T00:06:42.719420+0000","last_undegraded":"2024-09-12T00:06:42.719420+0000","last_fullsized":"2024-09-12T00:06:42.719420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:01.365985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"95'32","reported_seq":105,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720260+0000","last_change":"2024-09-12T00:06:31.824748+0000","last_active":"2024-09-12T00:06:42.720260+0000","last_peered":"2024-09-12T00:06:42.720260+0000","last_clean":"2024-09-12T00:06:42.720260+0000","last_became_active":"2024-09-12T00:06:26.668022+0000","last_became_peered":"2024-09-12T00:06:26.668022+0000","last_unstale":"2024-09-12T00:06:42.720260+0000","last_undegraded":"2024-09-12T00:06:42.720260+0000","last_fullsized":"2024-09-12T00:06:42.720260+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:57.178468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":40,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":222298112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"59'4","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811470+0000","last_change":"2024-09-12T00:03:25.347570+0000","last_active":"2024-09-12T00:06:41.811470+0000","last_peered":"2024-09-12T00:06:41.811470+0000","last_clean":"2024-09-12T00:06:41.811470+0000","last_became_active":"2024-09-12T00:03:25.346874+0000","last_became_peered":"2024-09-12T00:03:25.346874+0000","last_unstale":"2024-09-12T00:06:41.811470+0000","last_undegraded":"2024-09-12T00:06:41.811470+0000","last_fullsized":"2024-09-12T00:06:41.811470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"96'23","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723730+0000","last_change":"2024-09-12T00:03:23.623417+0000","last_active":"2024-09-12T00:06:42.723730+0000","last_peered":"2024-09-12T00:06:42.723730+0000","last_clean":"2024-09-12T00:06:42.723730+0000","last_became_active":"2024-09-12T00:03:23.620261+0000","last_became_peered":"2024-09-12T00:03:23.620261+0000","last_unstale":"2024-09-12T00:06:42.723730+0000","last_undegraded":"2024-09-12T00:06:42.723730+0000","last_fullsized":"2024-09-12T00:06:42.723730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"63'8","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499989+0000","last_change":"2024-09-12T00:03:25.357492+0000","last_active":"2024-09-12T00:06:42.499989+0000","last_peered":"2024-09-12T00:06:42.499989+0000","last_clean":"2024-09-12T00:06:42.499989+0000","last_became_active":"2024-09-12T00:03:25.357186+0000","last_became_peered":"2024-09-12T00:03:25.357186+0000","last_unstale":"2024-09-12T00:06:42.499989+0000","last_undegraded":"2024-09-12T00:06:42.499989+0000","last_fullsized":"2024-09-12T00:06:42.499989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"96'26","reported_seq":95,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719726+0000","last_change":"2024-09-12T00:06:34.105256+0000","last_active":"2024-09-12T00:06:42.719726+0000","last_peered":"2024-09-12T00:06:42.719726+0000","last_clean":"2024-09-12T00:06:42.719726+0000","last_became_active":"2024-09-12T00:06:26.677360+0000","last_became_peered":"2024-09-12T00:06:26.677360+0000","last_unstale":"2024-09-12T00:06:42.719726+0000","last_undegraded":"2024-09-12T00:06:42.719726+0000","last_fullsized":"2024-09-12T00:06:42.719726+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:18.563619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":163577856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"96'27","reported_seq":97,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717277+0000","last_change":"2024-09-12T00:06:28.886144+0000","last_active":"2024-09-12T00:06:42.717277+0000","last_peered":"2024-09-12T00:06:42.717277+0000","last_clean":"2024-09-12T00:06:42.717277+0000","last_became_active":"2024-09-12T00:06:26.669830+0000","last_became_peered":"2024-09-12T00:06:26.669830+0000","last_unstale":"2024-09-12T00:06:42.717277+0000","last_undegraded":"2024-09-12T00:06:42.717277+0000","last_fullsized":"2024-09-12T00:06:42.717277+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:37.229011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":192937984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"84'6","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813636+0000","last_change":"2024-09-12T00:03:25.350116+0000","last_active":"2024-09-12T00:06:41.813636+0000","last_peered":"2024-09-12T00:06:41.813636+0000","last_clean":"2024-09-12T00:06:41.813636+0000","last_became_active":"2024-09-12T00:03:25.349281+0000","last_became_peered":"2024-09-12T00:03:25.349281+0000","last_unstale":"2024-09-12T00:06:41.813636+0000","last_undegraded":"2024-09-12T00:06:41.813636+0000","last_fullsized":"2024-09-12T00:06:41.813636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:33.350458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"96'20","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065234+0000","last_change":"2024-09-12T00:03:23.619574+0000","last_active":"2024-09-12T00:06:42.065234+0000","last_peered":"2024-09-12T00:06:42.065234+0000","last_clean":"2024-09-12T00:06:42.065234+0000","last_became_active":"2024-09-12T00:03:23.616154+0000","last_became_peered":"2024-09-12T00:03:23.616154+0000","last_unstale":"2024-09-12T00:06:42.065234+0000","last_undegraded":"2024-09-12T00:06:42.065234+0000","last_fullsized":"2024-09-12T00:06:42.065234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:46.335775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"58'2","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.502147+0000","last_change":"2024-09-12T00:03:25.345327+0000","last_active":"2024-09-12T00:06:42.502147+0000","last_peered":"2024-09-12T00:06:42.502147+0000","last_clean":"2024-09-12T00:06:42.502147+0000","last_became_active":"2024-09-12T00:03:25.344917+0000","last_became_peered":"2024-09-12T00:03:25.344917+0000","last_unstale":"2024-09-12T00:06:42.502147+0000","last_undegraded":"2024-09-12T00:06:42.502147+0000","last_fullsized":"2024-09-12T00:06:42.502147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":339,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1077,"ondisk_log_size":1077,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382934,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1135,"num_read_kb":865,"num_write":659,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":117531,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":951,"ondisk_log_size":951,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1444,"num_read_kb":1412,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1584,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":721,"num_bytes_recovered":3007315968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542192,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1112000,"kb_used_data":1080808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93259840,"statfs":{"total":96636764160,"available":95498076160,"internally_reserved":0,"allocated":1106747392,"data_stored":1106113870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542192,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1329084,"kb_used_data":1297892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93042756,"statfs":{"total":96636764160,"available":95275782144,"internally_reserved":0,"allocated":1329041408,"data_stored":1328412810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542192,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1794504,"kb_used_data":1759152,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92577336,"statfs":{"total":96636764160,"available":94799192064,"internally_reserved":0,"allocated":1801371648,"data_stored":1800744781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542192,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1329272,"kb_used_data":1293920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93042568,"statfs":{"total":96636764160,"available":95275589632,"internally_reserved":0,"allocated":1324974080,"data_stored":1324334685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542192,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1830964,"kb_used_data":1791448,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":92540876,"statfs":{"total":96636764160,"available":94761857024,"internally_reserved":0,"allocated":1834442752,"data_stored":1833824839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542193,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1806124,"kb_used_data":1774932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92565716,"statfs":{"total":96636764160,"available":94787293184,"internally_reserved":0,"allocated":1817530368,"data_stored":1816930588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542192,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1305184,"kb_used_data":1269832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93066656,"statfs":{"total":96636764160,"available":95300255744,"internally_reserved":0,"allocated":1300307968,"data_stored":1299644748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542191,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2084768,"kb_used_data":2049416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92287072,"statfs":{"total":96636764160,"available":94501961728,"internally_reserved":0,"allocated":2098601984,"data_stored":2097950685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2097152000,"data_stored":2097152000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1298137088,"data_stored":1298137088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1816133632,"data_stored":1816133632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1832910848,"data_stored":1832910848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1323302912,"data_stored":1323302912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1799356416,"data_stored":1799356416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1327497216,"data_stored":1327497216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1105199104,"data_stored":1105199104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":119156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":117311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":235112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":117531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":117713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:06:45.831 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T00:06:45.831 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-12T00:06:46.182 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T00:06:46.196 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T00:06:46.196 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:06:46.197 INFO:tasks.rgw.client.0.smithi019.stdout:2024-09-12T00:06:46.195+0000 7f2a09bb4640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 32721) UID: 0 2024-09-12T00:06:46.197 INFO:tasks.rgw.client.0.smithi019.stdout:2024-09-12T00:06:46.195+0000 7f2a0d3fca40 -1 shutting down 2024-09-12T00:07:10.601 INFO:tasks.rgw.client.0:Stopped 2024-09-12T00:07:10.602 DEBUG:teuthology.orchestra.run.smithi019:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T00:07:10.608 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T00:07:10.667 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T00:07:10.722 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T00:07:10.722 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T00:07:10.723 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T00:07:12.015 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T00:07:12.120 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:07:12.120 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:07:12.471 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:07:12.512 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T00:07:12.514 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2024-09-12T00:07:10.475888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300819945,"num_objects":1736,"num_object_clones":0,"num_object_copies":3472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1736,"num_whiteouts":0,"num_read":3480,"num_read_kb":3139,"num_write":2967,"num_write_kb":6187128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":928,"num_bytes_recovered":3007433610,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4057,"ondisk_log_size":4057,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12591860,"kb_used_data":12317400,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":742382860,"statfs":{"total":773094113280,"available":760200048640,"internally_reserved":0,"allocated":12613017600,"data_stored":12607957006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":280874546},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005798"},"pg_stats":[{"pgid":"3.3f","version":"95'16","reported_seq":286,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.817134+0000","last_change":"2024-09-12T00:06:27.539898+0000","last_active":"2024-09-12T00:06:41.817134+0000","last_peered":"2024-09-12T00:06:41.817134+0000","last_clean":"2024-09-12T00:06:41.817134+0000","last_became_active":"2024-09-12T00:06:26.678792+0000","last_became_peered":"2024-09-12T00:06:26.678792+0000","last_unstale":"2024-09-12T00:06:41.817134+0000","last_undegraded":"2024-09-12T00:06:41.817134+0000","last_fullsized":"2024-09-12T00:06:41.817134+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:23.434133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'2","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499351+0000","last_change":"2024-09-12T00:03:25.337244+0000","last_active":"2024-09-12T00:06:42.499351+0000","last_peered":"2024-09-12T00:06:42.499351+0000","last_clean":"2024-09-12T00:06:42.499351+0000","last_became_active":"2024-09-12T00:03:25.335964+0000","last_became_peered":"2024-09-12T00:03:25.335964+0000","last_unstale":"2024-09-12T00:06:42.499351+0000","last_undegraded":"2024-09-12T00:06:42.499351+0000","last_fullsized":"2024-09-12T00:06:42.499351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"96'24","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067343+0000","last_change":"2024-09-12T00:03:23.628328+0000","last_active":"2024-09-12T00:06:42.067343+0000","last_peered":"2024-09-12T00:06:42.067343+0000","last_clean":"2024-09-12T00:06:42.067343+0000","last_became_active":"2024-09-12T00:03:23.627630+0000","last_became_peered":"2024-09-12T00:03:23.627630+0000","last_unstale":"2024-09-12T00:06:42.067343+0000","last_undegraded":"2024-09-12T00:06:42.067343+0000","last_fullsized":"2024-09-12T00:06:42.067343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:00.573006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"76'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717726+0000","last_change":"2024-09-12T00:06:27.903337+0000","last_active":"2024-09-12T00:06:42.717726+0000","last_peered":"2024-09-12T00:06:42.717726+0000","last_clean":"2024-09-12T00:06:42.717726+0000","last_became_active":"2024-09-12T00:06:26.660419+0000","last_became_peered":"2024-09-12T00:06:26.660419+0000","last_unstale":"2024-09-12T00:06:42.717726+0000","last_undegraded":"2024-09-12T00:06:42.717726+0000","last_fullsized":"2024-09-12T00:06:42.717726+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:43.714019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"96'29","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066706+0000","last_change":"2024-09-12T00:03:23.626533+0000","last_active":"2024-09-12T00:06:42.066706+0000","last_peered":"2024-09-12T00:06:42.066706+0000","last_clean":"2024-09-12T00:06:42.066706+0000","last_became_active":"2024-09-12T00:03:23.625728+0000","last_became_peered":"2024-09-12T00:03:23.625728+0000","last_unstale":"2024-09-12T00:06:42.066706+0000","last_undegraded":"2024-09-12T00:06:42.066706+0000","last_fullsized":"2024-09-12T00:06:42.066706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:31.772442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"96'4","reported_seq":47,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721615+0000","last_change":"2024-09-12T00:06:32.442375+0000","last_active":"2024-09-12T00:06:42.721615+0000","last_peered":"2024-09-12T00:06:42.721615+0000","last_clean":"2024-09-12T00:06:42.721615+0000","last_became_active":"2024-09-12T00:06:26.677271+0000","last_became_peered":"2024-09-12T00:06:26.677271+0000","last_unstale":"2024-09-12T00:06:42.721615+0000","last_undegraded":"2024-09-12T00:06:42.721615+0000","last_fullsized":"2024-09-12T00:06:42.721615+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:34.385926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"96'22","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812538+0000","last_change":"2024-09-12T00:03:23.609828+0000","last_active":"2024-09-12T00:06:41.812538+0000","last_peered":"2024-09-12T00:06:41.812538+0000","last_clean":"2024-09-12T00:06:41.812538+0000","last_became_active":"2024-09-12T00:03:23.609326+0000","last_became_peered":"2024-09-12T00:03:23.609326+0000","last_unstale":"2024-09-12T00:06:41.812538+0000","last_undegraded":"2024-09-12T00:06:41.812538+0000","last_fullsized":"2024-09-12T00:06:41.812538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:25.491620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'8","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812256+0000","last_change":"2024-09-12T00:03:25.339518+0000","last_active":"2024-09-12T00:06:41.812256+0000","last_peered":"2024-09-12T00:06:41.812256+0000","last_clean":"2024-09-12T00:06:41.812256+0000","last_became_active":"2024-09-12T00:03:25.338805+0000","last_became_peered":"2024-09-12T00:03:25.338805+0000","last_unstale":"2024-09-12T00:06:41.812256+0000","last_undegraded":"2024-09-12T00:06:41.812256+0000","last_fullsized":"2024-09-12T00:06:41.812256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"96'26","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810071+0000","last_change":"2024-09-12T00:03:23.633978+0000","last_active":"2024-09-12T00:06:41.810071+0000","last_peered":"2024-09-12T00:06:41.810071+0000","last_clean":"2024-09-12T00:06:41.810071+0000","last_became_active":"2024-09-12T00:03:23.633580+0000","last_became_peered":"2024-09-12T00:03:23.633580+0000","last_unstale":"2024-09-12T00:06:41.810071+0000","last_undegraded":"2024-09-12T00:06:41.810071+0000","last_fullsized":"2024-09-12T00:06:41.810071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:01.872688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809540+0000","last_change":"2024-09-12T00:03:25.324424+0000","last_active":"2024-09-12T00:06:41.809540+0000","last_peered":"2024-09-12T00:06:41.809540+0000","last_clean":"2024-09-12T00:06:41.809540+0000","last_became_active":"2024-09-12T00:03:25.324138+0000","last_became_peered":"2024-09-12T00:03:25.324138+0000","last_unstale":"2024-09-12T00:06:41.809540+0000","last_undegraded":"2024-09-12T00:06:41.809540+0000","last_fullsized":"2024-09-12T00:06:41.809540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:09.954252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"96'21","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812953+0000","last_change":"2024-09-12T00:03:23.610136+0000","last_active":"2024-09-12T00:06:41.812953+0000","last_peered":"2024-09-12T00:06:41.812953+0000","last_clean":"2024-09-12T00:06:41.812953+0000","last_became_active":"2024-09-12T00:03:23.609509+0000","last_became_peered":"2024-09-12T00:03:23.609509+0000","last_unstale":"2024-09-12T00:06:41.812953+0000","last_undegraded":"2024-09-12T00:06:41.812953+0000","last_fullsized":"2024-09-12T00:06:41.812953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"96'12","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.817127+0000","last_change":"2024-09-12T00:03:25.355256+0000","last_active":"2024-09-12T00:06:41.817127+0000","last_peered":"2024-09-12T00:06:41.817127+0000","last_clean":"2024-09-12T00:06:41.817127+0000","last_became_active":"2024-09-12T00:03:25.355002+0000","last_became_peered":"2024-09-12T00:03:25.355002+0000","last_unstale":"2024-09-12T00:06:41.817127+0000","last_undegraded":"2024-09-12T00:06:41.817127+0000","last_fullsized":"2024-09-12T00:06:41.817127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:50.488869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"96'28","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813544+0000","last_change":"2024-09-12T00:03:23.606780+0000","last_active":"2024-09-12T00:06:41.813544+0000","last_peered":"2024-09-12T00:06:41.813544+0000","last_clean":"2024-09-12T00:06:41.813544+0000","last_became_active":"2024-09-12T00:03:23.606143+0000","last_became_peered":"2024-09-12T00:03:23.606143+0000","last_unstale":"2024-09-12T00:06:41.813544+0000","last_undegraded":"2024-09-12T00:06:41.813544+0000","last_fullsized":"2024-09-12T00:06:41.813544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:22.889982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813590+0000","last_change":"2024-09-12T00:03:25.330195+0000","last_active":"2024-09-12T00:06:41.813590+0000","last_peered":"2024-09-12T00:06:41.813590+0000","last_clean":"2024-09-12T00:06:41.813590+0000","last_became_active":"2024-09-12T00:03:25.329625+0000","last_became_peered":"2024-09-12T00:03:25.329625+0000","last_unstale":"2024-09-12T00:06:41.813590+0000","last_undegraded":"2024-09-12T00:06:41.813590+0000","last_fullsized":"2024-09-12T00:06:41.813590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"96'27","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064982+0000","last_change":"2024-09-12T00:03:23.626723+0000","last_active":"2024-09-12T00:06:42.064982+0000","last_peered":"2024-09-12T00:06:42.064982+0000","last_clean":"2024-09-12T00:06:42.064982+0000","last_became_active":"2024-09-12T00:03:23.626018+0000","last_became_peered":"2024-09-12T00:03:23.626018+0000","last_unstale":"2024-09-12T00:06:42.064982+0000","last_undegraded":"2024-09-12T00:06:42.064982+0000","last_fullsized":"2024-09-12T00:06:42.064982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"59'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067823+0000","last_change":"2024-09-12T00:03:25.352418+0000","last_active":"2024-09-12T00:06:42.067823+0000","last_peered":"2024-09-12T00:06:42.067823+0000","last_clean":"2024-09-12T00:06:42.067823+0000","last_became_active":"2024-09-12T00:03:25.347902+0000","last_became_peered":"2024-09-12T00:03:25.347902+0000","last_unstale":"2024-09-12T00:06:42.067823+0000","last_undegraded":"2024-09-12T00:06:42.067823+0000","last_fullsized":"2024-09-12T00:06:42.067823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:29.611790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"59'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719921+0000","last_change":"2024-09-12T00:06:27.342563+0000","last_active":"2024-09-12T00:06:42.719921+0000","last_peered":"2024-09-12T00:06:42.719921+0000","last_clean":"2024-09-12T00:06:42.719921+0000","last_became_active":"2024-09-12T00:06:26.653851+0000","last_became_peered":"2024-09-12T00:06:26.653851+0000","last_unstale":"2024-09-12T00:06:42.719921+0000","last_undegraded":"2024-09-12T00:06:42.719921+0000","last_fullsized":"2024-09-12T00:06:42.719921+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:14.109429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"95'17","reported_seq":285,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501969+0000","last_change":"2024-09-12T00:06:27.069520+0000","last_active":"2024-09-12T00:06:42.501969+0000","last_peered":"2024-09-12T00:06:42.501969+0000","last_clean":"2024-09-12T00:06:42.501969+0000","last_became_active":"2024-09-12T00:06:26.664959+0000","last_became_peered":"2024-09-12T00:06:26.664959+0000","last_unstale":"2024-09-12T00:06:42.501969+0000","last_undegraded":"2024-09-12T00:06:42.501969+0000","last_fullsized":"2024-09-12T00:06:42.501969+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:35.231503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813150+0000","last_change":"2024-09-12T00:03:25.334966+0000","last_active":"2024-09-12T00:06:41.813150+0000","last_peered":"2024-09-12T00:06:41.813150+0000","last_clean":"2024-09-12T00:06:41.813150+0000","last_became_active":"2024-09-12T00:03:25.334375+0000","last_became_peered":"2024-09-12T00:03:25.334375+0000","last_unstale":"2024-09-12T00:06:41.813150+0000","last_undegraded":"2024-09-12T00:06:41.813150+0000","last_fullsized":"2024-09-12T00:06:41.813150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:52.828056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"96'20","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816433+0000","last_change":"2024-09-12T00:03:23.614289+0000","last_active":"2024-09-12T00:06:41.816433+0000","last_peered":"2024-09-12T00:06:41.816433+0000","last_clean":"2024-09-12T00:06:41.816433+0000","last_became_active":"2024-09-12T00:03:23.614019+0000","last_became_peered":"2024-09-12T00:03:23.614019+0000","last_unstale":"2024-09-12T00:06:41.816433+0000","last_undegraded":"2024-09-12T00:06:41.816433+0000","last_fullsized":"2024-09-12T00:06:41.816433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:00.847027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"96'12","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500281+0000","last_change":"2024-09-12T00:03:25.357938+0000","last_active":"2024-09-12T00:06:42.500281+0000","last_peered":"2024-09-12T00:06:42.500281+0000","last_clean":"2024-09-12T00:06:42.500281+0000","last_became_active":"2024-09-12T00:03:25.357571+0000","last_became_peered":"2024-09-12T00:03:25.357571+0000","last_unstale":"2024-09-12T00:06:42.500281+0000","last_undegraded":"2024-09-12T00:06:42.500281+0000","last_fullsized":"2024-09-12T00:06:42.500281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:05.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"95'23","reported_seq":315,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816438+0000","last_change":"2024-09-12T00:06:28.845144+0000","last_active":"2024-09-12T00:06:41.816438+0000","last_peered":"2024-09-12T00:06:41.816438+0000","last_clean":"2024-09-12T00:06:41.816438+0000","last_became_active":"2024-09-12T00:06:26.682027+0000","last_became_peered":"2024-09-12T00:06:26.682027+0000","last_unstale":"2024-09-12T00:06:41.816438+0000","last_undegraded":"2024-09-12T00:06:41.816438+0000","last_fullsized":"2024-09-12T00:06:41.816438+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:24.330401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":167772160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'8","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721712+0000","last_change":"2024-09-12T00:03:25.345717+0000","last_active":"2024-09-12T00:06:42.721712+0000","last_peered":"2024-09-12T00:06:42.721712+0000","last_clean":"2024-09-12T00:06:42.721712+0000","last_became_active":"2024-09-12T00:03:25.344959+0000","last_became_peered":"2024-09-12T00:03:25.344959+0000","last_unstale":"2024-09-12T00:06:42.721712+0000","last_undegraded":"2024-09-12T00:06:42.721712+0000","last_fullsized":"2024-09-12T00:06:42.721712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"96'17","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815332+0000","last_change":"2024-09-12T00:03:23.602960+0000","last_active":"2024-09-12T00:06:41.815332+0000","last_peered":"2024-09-12T00:06:41.815332+0000","last_clean":"2024-09-12T00:06:41.815332+0000","last_became_active":"2024-09-12T00:03:23.602640+0000","last_became_peered":"2024-09-12T00:03:23.602640+0000","last_unstale":"2024-09-12T00:06:41.815332+0000","last_undegraded":"2024-09-12T00:06:41.815332+0000","last_fullsized":"2024-09-12T00:06:41.815332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"59'2","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066326+0000","last_change":"2024-09-12T00:06:28.300294+0000","last_active":"2024-09-12T00:06:42.066326+0000","last_peered":"2024-09-12T00:06:42.066326+0000","last_clean":"2024-09-12T00:06:42.066326+0000","last_became_active":"2024-09-12T00:06:26.665307+0000","last_became_peered":"2024-09-12T00:06:26.665307+0000","last_unstale":"2024-09-12T00:06:42.066326+0000","last_undegraded":"2024-09-12T00:06:42.066326+0000","last_fullsized":"2024-09-12T00:06:42.066326+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:18.349268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"96'23","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722623+0000","last_change":"2024-09-12T00:03:23.604732+0000","last_active":"2024-09-12T00:06:42.722623+0000","last_peered":"2024-09-12T00:06:42.722623+0000","last_clean":"2024-09-12T00:06:42.722623+0000","last_became_active":"2024-09-12T00:03:23.603932+0000","last_became_peered":"2024-09-12T00:03:23.603932+0000","last_unstale":"2024-09-12T00:06:42.722623+0000","last_undegraded":"2024-09-12T00:06:42.722623+0000","last_fullsized":"2024-09-12T00:06:42.722623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:14.913580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"76'4","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501143+0000","last_change":"2024-09-12T00:03:25.341332+0000","last_active":"2024-09-12T00:06:42.501143+0000","last_peered":"2024-09-12T00:06:42.501143+0000","last_clean":"2024-09-12T00:06:42.501143+0000","last_became_active":"2024-09-12T00:03:25.340828+0000","last_became_peered":"2024-09-12T00:03:25.340828+0000","last_unstale":"2024-09-12T00:06:42.501143+0000","last_undegraded":"2024-09-12T00:06:42.501143+0000","last_fullsized":"2024-09-12T00:06:42.501143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"95'18","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722863+0000","last_change":"2024-09-12T00:03:23.602687+0000","last_active":"2024-09-12T00:06:42.722863+0000","last_peered":"2024-09-12T00:06:42.722863+0000","last_clean":"2024-09-12T00:06:42.722863+0000","last_became_active":"2024-09-12T00:03:23.601892+0000","last_became_peered":"2024-09-12T00:03:23.601892+0000","last_unstale":"2024-09-12T00:06:42.722863+0000","last_undegraded":"2024-09-12T00:06:42.722863+0000","last_fullsized":"2024-09-12T00:06:42.722863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.808845+0000","last_change":"2024-09-12T00:03:33.354850+0000","last_active":"2024-09-12T00:06:41.808845+0000","last_peered":"2024-09-12T00:06:41.808845+0000","last_clean":"2024-09-12T00:06:41.808845+0000","last_became_active":"2024-09-12T00:03:33.351917+0000","last_became_peered":"2024-09-12T00:03:33.351917+0000","last_unstale":"2024-09-12T00:06:41.808845+0000","last_undegraded":"2024-09-12T00:06:41.808845+0000","last_fullsized":"2024-09-12T00:06:41.808845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:00.466863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"59'6","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721027+0000","last_change":"2024-09-12T00:03:25.323174+0000","last_active":"2024-09-12T00:06:42.721027+0000","last_peered":"2024-09-12T00:06:42.721027+0000","last_clean":"2024-09-12T00:06:42.721027+0000","last_became_active":"2024-09-12T00:03:25.322456+0000","last_became_peered":"2024-09-12T00:03:25.322456+0000","last_unstale":"2024-09-12T00:06:42.721027+0000","last_undegraded":"2024-09-12T00:06:42.721027+0000","last_fullsized":"2024-09-12T00:06:42.721027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"96'27","reported_seq":97,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721346+0000","last_change":"2024-09-12T00:06:27.333722+0000","last_active":"2024-09-12T00:06:42.721346+0000","last_peered":"2024-09-12T00:06:42.721346+0000","last_clean":"2024-09-12T00:06:42.721346+0000","last_became_active":"2024-09-12T00:06:26.648460+0000","last_became_peered":"2024-09-12T00:06:26.648460+0000","last_unstale":"2024-09-12T00:06:42.721346+0000","last_undegraded":"2024-09-12T00:06:42.721346+0000","last_fullsized":"2024-09-12T00:06:42.721346+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:17.751627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717693+0000","last_change":"2024-09-12T00:06:26.675813+0000","last_active":"2024-09-12T00:06:42.717693+0000","last_peered":"2024-09-12T00:06:42.717693+0000","last_clean":"2024-09-12T00:06:42.717693+0000","last_became_active":"2024-09-12T00:06:26.663654+0000","last_became_peered":"2024-09-12T00:06:26.663654+0000","last_unstale":"2024-09-12T00:06:42.717693+0000","last_undegraded":"2024-09-12T00:06:42.717693+0000","last_fullsized":"2024-09-12T00:06:42.717693+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:22.865255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"96'29","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812965+0000","last_change":"2024-09-12T00:03:29.347224+0000","last_active":"2024-09-12T00:06:41.812965+0000","last_peered":"2024-09-12T00:06:41.812965+0000","last_clean":"2024-09-12T00:06:41.812965+0000","last_became_active":"2024-09-12T00:03:29.346662+0000","last_became_peered":"2024-09-12T00:03:29.346662+0000","last_unstale":"2024-09-12T00:06:41.812965+0000","last_undegraded":"2024-09-12T00:06:41.812965+0000","last_fullsized":"2024-09-12T00:06:41.812965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:28.258932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501404+0000","last_change":"2024-09-12T00:03:31.337219+0000","last_active":"2024-09-12T00:06:42.501404+0000","last_peered":"2024-09-12T00:06:42.501404+0000","last_clean":"2024-09-12T00:06:42.501404+0000","last_became_active":"2024-09-12T00:03:31.336317+0000","last_became_peered":"2024-09-12T00:03:31.336317+0000","last_unstale":"2024-09-12T00:06:42.501404+0000","last_undegraded":"2024-09-12T00:06:42.501404+0000","last_fullsized":"2024-09-12T00:06:42.501404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:50.954053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"96'48","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499219+0000","last_change":"2024-09-12T00:03:33.376628+0000","last_active":"2024-09-12T00:06:42.499219+0000","last_peered":"2024-09-12T00:06:42.499219+0000","last_clean":"2024-09-12T00:06:42.499219+0000","last_became_active":"2024-09-12T00:03:33.375938+0000","last_became_peered":"2024-09-12T00:03:33.375938+0000","last_unstale":"2024-09-12T00:06:42.499219+0000","last_undegraded":"2024-09-12T00:06:42.499219+0000","last_fullsized":"2024-09-12T00:06:42.499219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:31.105042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"84'8","reported_seq":51,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717938+0000","last_change":"2024-09-12T00:06:32.981663+0000","last_active":"2024-09-12T00:06:42.717938+0000","last_peered":"2024-09-12T00:06:42.717938+0000","last_clean":"2024-09-12T00:06:42.717938+0000","last_became_active":"2024-09-12T00:06:26.679390+0000","last_became_peered":"2024-09-12T00:06:26.679390+0000","last_unstale":"2024-09-12T00:06:42.717938+0000","last_undegraded":"2024-09-12T00:06:42.717938+0000","last_fullsized":"2024-09-12T00:06:42.717938+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.655318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"96'14","reported_seq":267,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723059+0000","last_change":"2024-09-12T00:06:28.270104+0000","last_active":"2024-09-12T00:06:42.723059+0000","last_peered":"2024-09-12T00:06:42.723059+0000","last_clean":"2024-09-12T00:06:42.723059+0000","last_became_active":"2024-09-12T00:06:26.675473+0000","last_became_peered":"2024-09-12T00:06:26.675473+0000","last_unstale":"2024-09-12T00:06:42.723059+0000","last_undegraded":"2024-09-12T00:06:42.723059+0000","last_fullsized":"2024-09-12T00:06:42.723059+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:45.446239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812081+0000","last_change":"2024-09-12T00:03:27.336108+0000","last_active":"2024-09-12T00:06:41.812081+0000","last_peered":"2024-09-12T00:06:41.812081+0000","last_clean":"2024-09-12T00:06:41.812081+0000","last_became_active":"2024-09-12T00:03:27.335308+0000","last_became_peered":"2024-09-12T00:03:27.335308+0000","last_unstale":"2024-09-12T00:06:41.812081+0000","last_undegraded":"2024-09-12T00:06:41.812081+0000","last_fullsized":"2024-09-12T00:06:41.812081+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:39.812803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'12","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501517+0000","last_change":"2024-09-12T00:03:29.352496+0000","last_active":"2024-09-12T00:06:42.501517+0000","last_peered":"2024-09-12T00:06:42.501517+0000","last_clean":"2024-09-12T00:06:42.501517+0000","last_became_active":"2024-09-12T00:03:29.351783+0000","last_became_peered":"2024-09-12T00:03:29.351783+0000","last_unstale":"2024-09-12T00:06:42.501517+0000","last_undegraded":"2024-09-12T00:06:42.501517+0000","last_fullsized":"2024-09-12T00:06:42.501517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501338+0000","last_change":"2024-09-12T00:03:31.350279+0000","last_active":"2024-09-12T00:06:42.501338+0000","last_peered":"2024-09-12T00:06:42.501338+0000","last_clean":"2024-09-12T00:06:42.501338+0000","last_became_active":"2024-09-12T00:03:31.349244+0000","last_became_peered":"2024-09-12T00:03:31.349244+0000","last_unstale":"2024-09-12T00:06:42.501338+0000","last_undegraded":"2024-09-12T00:06:42.501338+0000","last_fullsized":"2024-09-12T00:06:42.501338+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.420974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719171+0000","last_change":"2024-09-12T00:03:33.382726+0000","last_active":"2024-09-12T00:06:42.719171+0000","last_peered":"2024-09-12T00:06:42.719171+0000","last_clean":"2024-09-12T00:06:42.719171+0000","last_became_active":"2024-09-12T00:03:33.381875+0000","last_became_peered":"2024-09-12T00:03:33.381875+0000","last_unstale":"2024-09-12T00:06:42.719171+0000","last_undegraded":"2024-09-12T00:06:42.719171+0000","last_fullsized":"2024-09-12T00:06:42.719171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"63'12","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066812+0000","last_change":"2024-09-12T00:03:25.357883+0000","last_active":"2024-09-12T00:06:42.066812+0000","last_peered":"2024-09-12T00:06:42.066812+0000","last_clean":"2024-09-12T00:06:42.066812+0000","last_became_active":"2024-09-12T00:03:25.355174+0000","last_became_peered":"2024-09-12T00:03:25.355174+0000","last_unstale":"2024-09-12T00:06:42.066812+0000","last_undegraded":"2024-09-12T00:06:42.066812+0000","last_fullsized":"2024-09-12T00:06:42.066812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:26.621650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"96'21","reported_seq":85,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721209+0000","last_change":"2024-09-12T00:06:29.505713+0000","last_active":"2024-09-12T00:06:42.721209+0000","last_peered":"2024-09-12T00:06:42.721209+0000","last_clean":"2024-09-12T00:06:42.721209+0000","last_became_active":"2024-09-12T00:06:26.670936+0000","last_became_peered":"2024-09-12T00:06:26.670936+0000","last_unstale":"2024-09-12T00:06:42.721209+0000","last_undegraded":"2024-09-12T00:06:42.721209+0000","last_fullsized":"2024-09-12T00:06:42.721209+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:12.048117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813428+0000","last_change":"2024-09-12T00:03:27.347098+0000","last_active":"2024-09-12T00:06:41.813428+0000","last_peered":"2024-09-12T00:06:41.813428+0000","last_clean":"2024-09-12T00:06:41.813428+0000","last_became_active":"2024-09-12T00:03:27.346346+0000","last_became_peered":"2024-09-12T00:03:27.346346+0000","last_unstale":"2024-09-12T00:06:41.813428+0000","last_undegraded":"2024-09-12T00:06:41.813428+0000","last_fullsized":"2024-09-12T00:06:41.813428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:56.250627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'22","reported_seq":265,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812213+0000","last_change":"2024-09-12T00:06:27.562833+0000","last_active":"2024-09-12T00:06:41.812213+0000","last_peered":"2024-09-12T00:06:41.812213+0000","last_clean":"2024-09-12T00:06:41.812213+0000","last_became_active":"2024-09-12T00:06:26.654182+0000","last_became_peered":"2024-09-12T00:06:26.654182+0000","last_unstale":"2024-09-12T00:06:41.812213+0000","last_undegraded":"2024-09-12T00:06:41.812213+0000","last_fullsized":"2024-09-12T00:06:41.812213+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:01.211483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"116'140","reported_seq":362,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.724494+0000","last_change":"2024-09-12T00:06:30.699178+0000","last_active":"2024-09-12T00:06:42.724494+0000","last_peered":"2024-09-12T00:06:42.724494+0000","last_clean":"2024-09-12T00:06:42.724494+0000","last_became_active":"2024-09-12T00:06:30.698465+0000","last_became_peered":"2024-09-12T00:06:30.698465+0000","last_unstale":"2024-09-12T00:06:42.724494+0000","last_undegraded":"2024-09-12T00:06:42.724494+0000","last_fullsized":"2024-09-12T00:06:42.724494+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:48.150663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810365+0000","last_change":"2024-09-12T00:03:33.378439+0000","last_active":"2024-09-12T00:06:41.810365+0000","last_peered":"2024-09-12T00:06:41.810365+0000","last_clean":"2024-09-12T00:06:41.810365+0000","last_became_active":"2024-09-12T00:03:33.374453+0000","last_became_peered":"2024-09-12T00:03:33.374453+0000","last_unstale":"2024-09-12T00:06:41.810365+0000","last_undegraded":"2024-09-12T00:06:41.810365+0000","last_fullsized":"2024-09-12T00:06:41.810365+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"58'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067326+0000","last_change":"2024-09-12T00:03:25.356433+0000","last_active":"2024-09-12T00:06:42.067326+0000","last_peered":"2024-09-12T00:06:42.067326+0000","last_clean":"2024-09-12T00:06:42.067326+0000","last_became_active":"2024-09-12T00:03:25.354803+0000","last_became_peered":"2024-09-12T00:03:25.354803+0000","last_unstale":"2024-09-12T00:06:42.067326+0000","last_undegraded":"2024-09-12T00:06:42.067326+0000","last_fullsized":"2024-09-12T00:06:42.067326+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:00.419686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"96'23","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499086+0000","last_change":"2024-09-12T00:03:23.630527+0000","last_active":"2024-09-12T00:06:42.499086+0000","last_peered":"2024-09-12T00:06:42.499086+0000","last_clean":"2024-09-12T00:06:42.499086+0000","last_became_active":"2024-09-12T00:03:23.630183+0000","last_became_peered":"2024-09-12T00:03:23.630183+0000","last_unstale":"2024-09-12T00:06:42.499086+0000","last_undegraded":"2024-09-12T00:06:42.499086+0000","last_fullsized":"2024-09-12T00:06:42.499086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94371840,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721999+0000","last_change":"2024-09-12T00:06:26.671315+0000","last_active":"2024-09-12T00:06:42.721999+0000","last_peered":"2024-09-12T00:06:42.721999+0000","last_clean":"2024-09-12T00:06:42.721999+0000","last_became_active":"2024-09-12T00:06:26.669946+0000","last_became_peered":"2024-09-12T00:06:26.669946+0000","last_unstale":"2024-09-12T00:06:42.721999+0000","last_undegraded":"2024-09-12T00:06:42.721999+0000","last_fullsized":"2024-09-12T00:06:42.721999+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:53.569121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"96'23","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812548+0000","last_change":"2024-09-12T00:03:29.339735+0000","last_active":"2024-09-12T00:06:41.812548+0000","last_peered":"2024-09-12T00:06:41.812548+0000","last_clean":"2024-09-12T00:06:41.812548+0000","last_became_active":"2024-09-12T00:03:29.338810+0000","last_became_peered":"2024-09-12T00:03:29.338810+0000","last_unstale":"2024-09-12T00:06:41.812548+0000","last_undegraded":"2024-09-12T00:06:41.812548+0000","last_fullsized":"2024-09-12T00:06:41.812548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"116'135","reported_seq":432,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.585527+0000","last_change":"2024-09-12T00:03:31.364647+0000","last_active":"2024-09-12T00:06:42.585527+0000","last_peered":"2024-09-12T00:06:42.585527+0000","last_clean":"2024-09-12T00:06:42.585527+0000","last_became_active":"2024-09-12T00:03:31.353547+0000","last_became_peered":"2024-09-12T00:03:31.353547+0000","last_unstale":"2024-09-12T00:06:42.585527+0000","last_undegraded":"2024-09-12T00:06:42.585527+0000","last_fullsized":"2024-09-12T00:06:42.585527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:20.795870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"63'4","reported_seq":47,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717416+0000","last_change":"2024-09-12T00:06:27.339590+0000","last_active":"2024-09-12T00:06:42.717416+0000","last_peered":"2024-09-12T00:06:42.717416+0000","last_clean":"2024-09-12T00:06:42.717416+0000","last_became_active":"2024-09-12T00:06:26.651618+0000","last_became_peered":"2024-09-12T00:06:26.651618+0000","last_unstale":"2024-09-12T00:06:42.717416+0000","last_undegraded":"2024-09-12T00:06:42.717416+0000","last_fullsized":"2024-09-12T00:06:42.717416+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:58.850777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"96'29","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.817312+0000","last_change":"2024-09-12T00:03:23.602206+0000","last_active":"2024-09-12T00:06:41.817312+0000","last_peered":"2024-09-12T00:06:41.817312+0000","last_clean":"2024-09-12T00:06:41.817312+0000","last_became_active":"2024-09-12T00:03:23.601898+0000","last_became_peered":"2024-09-12T00:03:23.601898+0000","last_unstale":"2024-09-12T00:06:41.817312+0000","last_undegraded":"2024-09-12T00:06:41.817312+0000","last_fullsized":"2024-09-12T00:06:41.817312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:52.625795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499596+0000","last_change":"2024-09-12T00:03:27.331111+0000","last_active":"2024-09-12T00:06:42.499596+0000","last_peered":"2024-09-12T00:06:42.499596+0000","last_clean":"2024-09-12T00:06:42.499596+0000","last_became_active":"2024-09-12T00:03:27.329672+0000","last_became_peered":"2024-09-12T00:03:27.329672+0000","last_unstale":"2024-09-12T00:06:42.499596+0000","last_undegraded":"2024-09-12T00:06:42.499596+0000","last_fullsized":"2024-09-12T00:06:42.499596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"96'34","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814758+0000","last_change":"2024-09-12T00:03:29.335931+0000","last_active":"2024-09-12T00:06:41.814758+0000","last_peered":"2024-09-12T00:06:41.814758+0000","last_clean":"2024-09-12T00:06:41.814758+0000","last_became_active":"2024-09-12T00:03:29.335044+0000","last_became_peered":"2024-09-12T00:03:29.335044+0000","last_unstale":"2024-09-12T00:06:41.814758+0000","last_undegraded":"2024-09-12T00:06:41.814758+0000","last_fullsized":"2024-09-12T00:06:41.814758+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:57.131209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719379+0000","last_change":"2024-09-12T00:03:31.355001+0000","last_active":"2024-09-12T00:06:42.719379+0000","last_peered":"2024-09-12T00:06:42.719379+0000","last_clean":"2024-09-12T00:06:42.719379+0000","last_became_active":"2024-09-12T00:03:31.354160+0000","last_became_peered":"2024-09-12T00:03:31.354160+0000","last_unstale":"2024-09-12T00:06:42.719379+0000","last_undegraded":"2024-09-12T00:06:42.719379+0000","last_fullsized":"2024-09-12T00:06:42.719379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:29.868141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810884+0000","last_change":"2024-09-12T00:06:26.664709+0000","last_active":"2024-09-12T00:06:41.810884+0000","last_peered":"2024-09-12T00:06:41.810884+0000","last_clean":"2024-09-12T00:06:41.810884+0000","last_became_active":"2024-09-12T00:06:26.664401+0000","last_became_peered":"2024-09-12T00:06:26.664401+0000","last_unstale":"2024-09-12T00:06:41.810884+0000","last_undegraded":"2024-09-12T00:06:41.810884+0000","last_fullsized":"2024-09-12T00:06:41.810884+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:17.791780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'2","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499737+0000","last_change":"2024-09-12T00:03:25.357300+0000","last_active":"2024-09-12T00:06:42.499737+0000","last_peered":"2024-09-12T00:06:42.499737+0000","last_clean":"2024-09-12T00:06:42.499737+0000","last_became_active":"2024-09-12T00:03:25.356970+0000","last_became_peered":"2024-09-12T00:03:25.356970+0000","last_unstale":"2024-09-12T00:06:42.499737+0000","last_undegraded":"2024-09-12T00:06:42.499737+0000","last_fullsized":"2024-09-12T00:06:42.499737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:04.193738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"96'19","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814414+0000","last_change":"2024-09-12T00:03:23.609700+0000","last_active":"2024-09-12T00:06:41.814414+0000","last_peered":"2024-09-12T00:06:41.814414+0000","last_clean":"2024-09-12T00:06:41.814414+0000","last_became_active":"2024-09-12T00:03:23.609435+0000","last_became_peered":"2024-09-12T00:03:23.609435+0000","last_unstale":"2024-09-12T00:06:41.814414+0000","last_undegraded":"2024-09-12T00:06:41.814414+0000","last_fullsized":"2024-09-12T00:06:41.814414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720734+0000","last_change":"2024-09-12T00:03:27.339670+0000","last_active":"2024-09-12T00:06:42.720734+0000","last_peered":"2024-09-12T00:06:42.720734+0000","last_clean":"2024-09-12T00:06:42.720734+0000","last_became_active":"2024-09-12T00:03:27.338880+0000","last_became_peered":"2024-09-12T00:03:27.338880+0000","last_unstale":"2024-09-12T00:06:42.720734+0000","last_undegraded":"2024-09-12T00:06:42.720734+0000","last_fullsized":"2024-09-12T00:06:42.720734+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:35.068652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"96'25","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811038+0000","last_change":"2024-09-12T00:03:29.337666+0000","last_active":"2024-09-12T00:06:41.811038+0000","last_peered":"2024-09-12T00:06:41.811038+0000","last_clean":"2024-09-12T00:06:41.811038+0000","last_became_active":"2024-09-12T00:03:29.336957+0000","last_became_peered":"2024-09-12T00:03:29.336957+0000","last_unstale":"2024-09-12T00:06:41.811038+0000","last_undegraded":"2024-09-12T00:06:41.811038+0000","last_fullsized":"2024-09-12T00:06:41.811038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:58.417315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":21,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810940+0000","last_change":"2024-09-12T00:03:31.348590+0000","last_active":"2024-09-12T00:06:41.810940+0000","last_peered":"2024-09-12T00:06:41.810940+0000","last_clean":"2024-09-12T00:06:41.810940+0000","last_became_active":"2024-09-12T00:03:31.347736+0000","last_became_peered":"2024-09-12T00:03:31.347736+0000","last_unstale":"2024-09-12T00:06:41.810940+0000","last_undegraded":"2024-09-12T00:06:41.810940+0000","last_fullsized":"2024-09-12T00:06:41.810940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:04.962492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"59'8","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500524+0000","last_change":"2024-09-12T00:03:33.379699+0000","last_active":"2024-09-12T00:06:42.500524+0000","last_peered":"2024-09-12T00:06:42.500524+0000","last_clean":"2024-09-12T00:06:42.500524+0000","last_became_active":"2024-09-12T00:03:33.378945+0000","last_became_peered":"2024-09-12T00:03:33.378945+0000","last_unstale":"2024-09-12T00:06:42.500524+0000","last_undegraded":"2024-09-12T00:06:42.500524+0000","last_fullsized":"2024-09-12T00:06:42.500524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:23.270488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'6","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812122+0000","last_change":"2024-09-12T00:06:28.326850+0000","last_active":"2024-09-12T00:06:41.812122+0000","last_peered":"2024-09-12T00:06:41.812122+0000","last_clean":"2024-09-12T00:06:41.812122+0000","last_became_active":"2024-09-12T00:06:26.668131+0000","last_became_peered":"2024-09-12T00:06:26.668131+0000","last_unstale":"2024-09-12T00:06:41.812122+0000","last_undegraded":"2024-09-12T00:06:41.812122+0000","last_fullsized":"2024-09-12T00:06:41.812122+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:18.255160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"95'17","reported_seq":77,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717787+0000","last_change":"2024-09-12T00:06:33.441486+0000","last_active":"2024-09-12T00:06:42.717787+0000","last_peered":"2024-09-12T00:06:42.717787+0000","last_clean":"2024-09-12T00:06:42.717787+0000","last_became_active":"2024-09-12T00:06:26.679723+0000","last_became_peered":"2024-09-12T00:06:26.679723+0000","last_unstale":"2024-09-12T00:06:42.717787+0000","last_undegraded":"2024-09-12T00:06:42.717787+0000","last_fullsized":"2024-09-12T00:06:42.717787+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:59.722762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065103+0000","last_change":"2024-09-12T00:03:27.348080+0000","last_active":"2024-09-12T00:06:42.065103+0000","last_peered":"2024-09-12T00:06:42.065103+0000","last_clean":"2024-09-12T00:06:42.065103+0000","last_became_active":"2024-09-12T00:03:27.347288+0000","last_became_peered":"2024-09-12T00:03:27.347288+0000","last_unstale":"2024-09-12T00:06:42.065103+0000","last_undegraded":"2024-09-12T00:06:42.065103+0000","last_fullsized":"2024-09-12T00:06:42.065103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:37.033224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"96'37","reported_seq":61,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720107+0000","last_change":"2024-09-12T00:06:28.360303+0000","last_active":"2024-09-12T00:06:42.720107+0000","last_peered":"2024-09-12T00:06:42.720107+0000","last_clean":"2024-09-12T00:06:42.720107+0000","last_became_active":"2024-09-12T00:06:26.668791+0000","last_became_peered":"2024-09-12T00:06:26.668791+0000","last_unstale":"2024-09-12T00:06:42.720107+0000","last_undegraded":"2024-09-12T00:06:42.720107+0000","last_fullsized":"2024-09-12T00:06:42.720107+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:49.033011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120747,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":45,"num_read_kb":34,"num_write":30,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":116871,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"116'135","reported_seq":351,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.585603+0000","last_change":"2024-09-12T00:03:31.354114+0000","last_active":"2024-09-12T00:06:42.585603+0000","last_peered":"2024-09-12T00:06:42.585603+0000","last_clean":"2024-09-12T00:06:42.585603+0000","last_became_active":"2024-09-12T00:03:31.353358+0000","last_became_peered":"2024-09-12T00:03:31.353358+0000","last_unstale":"2024-09-12T00:06:42.585603+0000","last_undegraded":"2024-09-12T00:06:42.585603+0000","last_fullsized":"2024-09-12T00:06:42.585603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:56.624718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719909+0000","last_change":"2024-09-12T00:03:33.383917+0000","last_active":"2024-09-12T00:06:42.719909+0000","last_peered":"2024-09-12T00:06:42.719909+0000","last_clean":"2024-09-12T00:06:42.719909+0000","last_became_active":"2024-09-12T00:03:33.383199+0000","last_became_peered":"2024-09-12T00:03:33.383199+0000","last_unstale":"2024-09-12T00:06:42.719909+0000","last_undegraded":"2024-09-12T00:06:42.719909+0000","last_fullsized":"2024-09-12T00:06:42.719909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:37.428182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"84'10","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065948+0000","last_change":"2024-09-12T00:03:25.356706+0000","last_active":"2024-09-12T00:06:42.065948+0000","last_peered":"2024-09-12T00:06:42.065948+0000","last_clean":"2024-09-12T00:06:42.065948+0000","last_became_active":"2024-09-12T00:03:25.354555+0000","last_became_peered":"2024-09-12T00:03:25.354555+0000","last_unstale":"2024-09-12T00:06:42.065948+0000","last_undegraded":"2024-09-12T00:06:42.065948+0000","last_fullsized":"2024-09-12T00:06:42.065948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:55.543336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"96'39","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815809+0000","last_change":"2024-09-12T00:03:23.612430+0000","last_active":"2024-09-12T00:06:41.815809+0000","last_peered":"2024-09-12T00:06:41.815809+0000","last_clean":"2024-09-12T00:06:41.815809+0000","last_became_active":"2024-09-12T00:03:23.612165+0000","last_became_peered":"2024-09-12T00:03:23.612165+0000","last_unstale":"2024-09-12T00:06:41.815809+0000","last_undegraded":"2024-09-12T00:06:41.815809+0000","last_fullsized":"2024-09-12T00:06:41.815809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:31.444343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":159744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722313+0000","last_change":"2024-09-12T00:03:27.329228+0000","last_active":"2024-09-12T00:06:42.722313+0000","last_peered":"2024-09-12T00:06:42.722313+0000","last_clean":"2024-09-12T00:06:42.722313+0000","last_became_active":"2024-09-12T00:03:27.328497+0000","last_became_peered":"2024-09-12T00:03:27.328497+0000","last_unstale":"2024-09-12T00:06:42.722313+0000","last_undegraded":"2024-09-12T00:06:42.722313+0000","last_fullsized":"2024-09-12T00:06:42.722313+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"96'42","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810133+0000","last_change":"2024-09-12T00:03:29.332778+0000","last_active":"2024-09-12T00:06:41.810133+0000","last_peered":"2024-09-12T00:06:41.810133+0000","last_clean":"2024-09-12T00:06:41.810133+0000","last_became_active":"2024-09-12T00:03:29.332010+0000","last_became_peered":"2024-09-12T00:03:29.332010+0000","last_unstale":"2024-09-12T00:06:41.810133+0000","last_undegraded":"2024-09-12T00:06:41.810133+0000","last_fullsized":"2024-09-12T00:06:41.810133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:13.563107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125399,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":47,"num_read_kb":36,"num_write":30,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065300+0000","last_change":"2024-09-12T00:03:31.354374+0000","last_active":"2024-09-12T00:06:42.065300+0000","last_peered":"2024-09-12T00:06:42.065300+0000","last_clean":"2024-09-12T00:06:42.065300+0000","last_became_active":"2024-09-12T00:03:31.353407+0000","last_became_peered":"2024-09-12T00:03:31.353407+0000","last_unstale":"2024-09-12T00:06:42.065300+0000","last_undegraded":"2024-09-12T00:06:42.065300+0000","last_fullsized":"2024-09-12T00:06:42.065300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:30.520217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"93'7","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723759+0000","last_change":"2024-09-12T00:03:33.385373+0000","last_active":"2024-09-12T00:06:42.723759+0000","last_peered":"2024-09-12T00:06:42.723759+0000","last_clean":"2024-09-12T00:06:42.723759+0000","last_became_active":"2024-09-12T00:03:33.384559+0000","last_became_peered":"2024-09-12T00:03:33.384559+0000","last_unstale":"2024-09-12T00:06:42.723759+0000","last_undegraded":"2024-09-12T00:06:42.723759+0000","last_fullsized":"2024-09-12T00:06:42.723759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:55.924174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815429+0000","last_change":"2024-09-12T00:03:25.326677+0000","last_active":"2024-09-12T00:06:41.815429+0000","last_peered":"2024-09-12T00:06:41.815429+0000","last_clean":"2024-09-12T00:06:41.815429+0000","last_became_active":"2024-09-12T00:03:25.325840+0000","last_became_peered":"2024-09-12T00:03:25.325840+0000","last_unstale":"2024-09-12T00:06:41.815429+0000","last_undegraded":"2024-09-12T00:06:41.815429+0000","last_fullsized":"2024-09-12T00:06:41.815429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:07.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"95'22","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720457+0000","last_change":"2024-09-12T00:03:23.616943+0000","last_active":"2024-09-12T00:06:42.720457+0000","last_peered":"2024-09-12T00:06:42.720457+0000","last_clean":"2024-09-12T00:06:42.720457+0000","last_became_active":"2024-09-12T00:03:23.616200+0000","last_became_peered":"2024-09-12T00:03:23.616200+0000","last_unstale":"2024-09-12T00:06:42.720457+0000","last_undegraded":"2024-09-12T00:06:42.720457+0000","last_fullsized":"2024-09-12T00:06:42.720457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722289+0000","last_change":"2024-09-12T00:03:27.330506+0000","last_active":"2024-09-12T00:06:42.722289+0000","last_peered":"2024-09-12T00:06:42.722289+0000","last_clean":"2024-09-12T00:06:42.722289+0000","last_became_active":"2024-09-12T00:03:27.329830+0000","last_became_peered":"2024-09-12T00:03:27.329830+0000","last_unstale":"2024-09-12T00:06:42.722289+0000","last_undegraded":"2024-09-12T00:06:42.722289+0000","last_fullsized":"2024-09-12T00:06:42.722289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:03.446090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"96'25","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501739+0000","last_change":"2024-09-12T00:03:29.343655+0000","last_active":"2024-09-12T00:06:42.501739+0000","last_peered":"2024-09-12T00:06:42.501739+0000","last_clean":"2024-09-12T00:06:42.501739+0000","last_became_active":"2024-09-12T00:03:29.343178+0000","last_became_peered":"2024-09-12T00:03:29.343178+0000","last_unstale":"2024-09-12T00:06:42.501739+0000","last_undegraded":"2024-09-12T00:06:42.501739+0000","last_fullsized":"2024-09-12T00:06:42.501739+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723516+0000","last_change":"2024-09-12T00:03:31.358077+0000","last_active":"2024-09-12T00:06:42.723516+0000","last_peered":"2024-09-12T00:06:42.723516+0000","last_clean":"2024-09-12T00:06:42.723516+0000","last_became_active":"2024-09-12T00:03:31.357272+0000","last_became_peered":"2024-09-12T00:03:31.357272+0000","last_unstale":"2024-09-12T00:06:42.723516+0000","last_undegraded":"2024-09-12T00:06:42.723516+0000","last_fullsized":"2024-09-12T00:06:42.723516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:37.991682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"76'4","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065822+0000","last_change":"2024-09-12T00:06:26.690241+0000","last_active":"2024-09-12T00:06:42.065822+0000","last_peered":"2024-09-12T00:06:42.065822+0000","last_clean":"2024-09-12T00:06:42.065822+0000","last_became_active":"2024-09-12T00:06:26.653908+0000","last_became_peered":"2024-09-12T00:06:26.653908+0000","last_unstale":"2024-09-12T00:06:42.065822+0000","last_undegraded":"2024-09-12T00:06:42.065822+0000","last_fullsized":"2024-09-12T00:06:42.065822+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:12.338436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"76'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721025+0000","last_change":"2024-09-12T00:06:32.433900+0000","last_active":"2024-09-12T00:06:42.721025+0000","last_peered":"2024-09-12T00:06:42.721025+0000","last_clean":"2024-09-12T00:06:42.721025+0000","last_became_active":"2024-09-12T00:06:26.675405+0000","last_became_peered":"2024-09-12T00:06:26.675405+0000","last_unstale":"2024-09-12T00:06:42.721025+0000","last_undegraded":"2024-09-12T00:06:42.721025+0000","last_fullsized":"2024-09-12T00:06:42.721025+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:53.098500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"96'21","reported_seq":85,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721420+0000","last_change":"2024-09-12T00:06:32.375501+0000","last_active":"2024-09-12T00:06:42.721420+0000","last_peered":"2024-09-12T00:06:42.721420+0000","last_clean":"2024-09-12T00:06:42.721420+0000","last_became_active":"2024-09-12T00:06:26.663178+0000","last_became_peered":"2024-09-12T00:06:26.663178+0000","last_unstale":"2024-09-12T00:06:42.721420+0000","last_undegraded":"2024-09-12T00:06:42.721420+0000","last_fullsized":"2024-09-12T00:06:42.721420+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:27.738037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":138412032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065958+0000","last_change":"2024-09-12T00:03:27.342295+0000","last_active":"2024-09-12T00:06:42.065958+0000","last_peered":"2024-09-12T00:06:42.065958+0000","last_clean":"2024-09-12T00:06:42.065958+0000","last_became_active":"2024-09-12T00:03:27.341619+0000","last_became_peered":"2024-09-12T00:03:27.341619+0000","last_unstale":"2024-09-12T00:06:42.065958+0000","last_undegraded":"2024-09-12T00:06:42.065958+0000","last_fullsized":"2024-09-12T00:06:42.065958+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:00.908798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"96'23","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066215+0000","last_change":"2024-09-12T00:03:29.336391+0000","last_active":"2024-09-12T00:06:42.066215+0000","last_peered":"2024-09-12T00:06:42.066215+0000","last_clean":"2024-09-12T00:06:42.066215+0000","last_became_active":"2024-09-12T00:03:29.335679+0000","last_became_peered":"2024-09-12T00:03:29.335679+0000","last_unstale":"2024-09-12T00:06:42.066215+0000","last_undegraded":"2024-09-12T00:06:42.066215+0000","last_fullsized":"2024-09-12T00:06:42.066215+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:58.540539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"116'135","reported_seq":396,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723110+0000","last_change":"2024-09-12T00:03:31.351170+0000","last_active":"2024-09-12T00:06:42.723110+0000","last_peered":"2024-09-12T00:06:42.723110+0000","last_clean":"2024-09-12T00:06:42.723110+0000","last_became_active":"2024-09-12T00:03:31.350264+0000","last_became_peered":"2024-09-12T00:03:31.350264+0000","last_unstale":"2024-09-12T00:06:42.723110+0000","last_undegraded":"2024-09-12T00:06:42.723110+0000","last_fullsized":"2024-09-12T00:06:42.723110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:51.368815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"59'3","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719548+0000","last_change":"2024-09-12T00:03:33.368236+0000","last_active":"2024-09-12T00:06:42.719548+0000","last_peered":"2024-09-12T00:06:42.719548+0000","last_clean":"2024-09-12T00:06:42.719548+0000","last_became_active":"2024-09-12T00:03:33.367424+0000","last_became_peered":"2024-09-12T00:03:33.367424+0000","last_unstale":"2024-09-12T00:06:42.719548+0000","last_undegraded":"2024-09-12T00:06:42.719548+0000","last_fullsized":"2024-09-12T00:06:42.719548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"76'6","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813109+0000","last_change":"2024-09-12T00:06:28.869705+0000","last_active":"2024-09-12T00:06:41.813109+0000","last_peered":"2024-09-12T00:06:41.813109+0000","last_clean":"2024-09-12T00:06:41.813109+0000","last_became_active":"2024-09-12T00:06:26.671547+0000","last_became_peered":"2024-09-12T00:06:26.671547+0000","last_unstale":"2024-09-12T00:06:41.813109+0000","last_undegraded":"2024-09-12T00:06:41.813109+0000","last_fullsized":"2024-09-12T00:06:41.813109+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:55.946290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"96'22","reported_seq":87,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721098+0000","last_change":"2024-09-12T00:06:27.817806+0000","last_active":"2024-09-12T00:06:42.721098+0000","last_peered":"2024-09-12T00:06:42.721098+0000","last_clean":"2024-09-12T00:06:42.721098+0000","last_became_active":"2024-09-12T00:06:26.654104+0000","last_became_peered":"2024-09-12T00:06:26.654104+0000","last_unstale":"2024-09-12T00:06:42.721098+0000","last_undegraded":"2024-09-12T00:06:42.721098+0000","last_fullsized":"2024-09-12T00:06:42.721098+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:30.461829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":368,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501711+0000","last_change":"2024-09-12T00:03:27.331569+0000","last_active":"2024-09-12T00:06:42.501711+0000","last_peered":"2024-09-12T00:06:42.501711+0000","last_clean":"2024-09-12T00:06:42.501711+0000","last_became_active":"2024-09-12T00:03:27.330909+0000","last_became_peered":"2024-09-12T00:03:27.330909+0000","last_unstale":"2024-09-12T00:06:42.501711+0000","last_undegraded":"2024-09-12T00:06:42.501711+0000","last_fullsized":"2024-09-12T00:06:42.501711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"59'11","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720583+0000","last_change":"2024-09-12T00:03:29.338880+0000","last_active":"2024-09-12T00:06:42.720583+0000","last_peered":"2024-09-12T00:06:42.720583+0000","last_clean":"2024-09-12T00:06:42.720583+0000","last_became_active":"2024-09-12T00:03:29.338110+0000","last_became_peered":"2024-09-12T00:03:29.338110+0000","last_unstale":"2024-09-12T00:06:42.720583+0000","last_undegraded":"2024-09-12T00:06:42.720583+0000","last_fullsized":"2024-09-12T00:06:42.720583+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.054460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"116'135","reported_seq":402,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.585555+0000","last_change":"2024-09-12T00:03:31.339117+0000","last_active":"2024-09-12T00:06:42.585555+0000","last_peered":"2024-09-12T00:06:42.585555+0000","last_clean":"2024-09-12T00:06:42.585555+0000","last_became_active":"2024-09-12T00:03:31.338426+0000","last_became_peered":"2024-09-12T00:03:31.338426+0000","last_unstale":"2024-09-12T00:06:42.585555+0000","last_undegraded":"2024-09-12T00:06:42.585555+0000","last_fullsized":"2024-09-12T00:06:42.585555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:19.304169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811106+0000","last_change":"2024-09-12T00:03:33.385051+0000","last_active":"2024-09-12T00:06:41.811106+0000","last_peered":"2024-09-12T00:06:41.811106+0000","last_clean":"2024-09-12T00:06:41.811106+0000","last_became_active":"2024-09-12T00:03:33.380088+0000","last_became_peered":"2024-09-12T00:03:33.380088+0000","last_unstale":"2024-09-12T00:06:41.811106+0000","last_undegraded":"2024-09-12T00:06:41.811106+0000","last_fullsized":"2024-09-12T00:06:41.811106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:02.972871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.724550+0000","last_change":"2024-09-12T00:03:25.336113+0000","last_active":"2024-09-12T00:06:42.724550+0000","last_peered":"2024-09-12T00:06:42.724550+0000","last_clean":"2024-09-12T00:06:42.724550+0000","last_became_active":"2024-09-12T00:03:25.335449+0000","last_became_peered":"2024-09-12T00:03:25.335449+0000","last_unstale":"2024-09-12T00:06:42.724550+0000","last_undegraded":"2024-09-12T00:06:42.724550+0000","last_fullsized":"2024-09-12T00:06:42.724550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:34.277614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"96'24","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811100+0000","last_change":"2024-09-12T00:03:23.619285+0000","last_active":"2024-09-12T00:06:41.811100+0000","last_peered":"2024-09-12T00:06:41.811100+0000","last_clean":"2024-09-12T00:06:41.811100+0000","last_became_active":"2024-09-12T00:03:23.614187+0000","last_became_peered":"2024-09-12T00:03:23.614187+0000","last_unstale":"2024-09-12T00:06:41.811100+0000","last_undegraded":"2024-09-12T00:06:41.811100+0000","last_fullsized":"2024-09-12T00:06:41.811100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720307+0000","last_change":"2024-09-12T00:06:26.673924+0000","last_active":"2024-09-12T00:06:42.720307+0000","last_peered":"2024-09-12T00:06:42.720307+0000","last_clean":"2024-09-12T00:06:42.720307+0000","last_became_active":"2024-09-12T00:06:26.670945+0000","last_became_peered":"2024-09-12T00:06:26.670945+0000","last_unstale":"2024-09-12T00:06:42.720307+0000","last_undegraded":"2024-09-12T00:06:42.720307+0000","last_fullsized":"2024-09-12T00:06:42.720307+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:56.956200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"96'25","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500794+0000","last_change":"2024-09-12T00:03:29.345719+0000","last_active":"2024-09-12T00:06:42.500794+0000","last_peered":"2024-09-12T00:06:42.500794+0000","last_clean":"2024-09-12T00:06:42.500794+0000","last_became_active":"2024-09-12T00:03:29.345243+0000","last_became_peered":"2024-09-12T00:03:29.345243+0000","last_unstale":"2024-09-12T00:06:42.500794+0000","last_undegraded":"2024-09-12T00:06:42.500794+0000","last_fullsized":"2024-09-12T00:06:42.500794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:41.153263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812258+0000","last_change":"2024-09-12T00:03:31.360630+0000","last_active":"2024-09-12T00:06:41.812258+0000","last_peered":"2024-09-12T00:06:41.812258+0000","last_clean":"2024-09-12T00:06:41.812258+0000","last_became_active":"2024-09-12T00:03:31.359763+0000","last_became_peered":"2024-09-12T00:03:31.359763+0000","last_unstale":"2024-09-12T00:06:41.812258+0000","last_undegraded":"2024-09-12T00:06:41.812258+0000","last_fullsized":"2024-09-12T00:06:41.812258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"84'6","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719339+0000","last_change":"2024-09-12T00:03:33.372178+0000","last_active":"2024-09-12T00:06:42.719339+0000","last_peered":"2024-09-12T00:06:42.719339+0000","last_clean":"2024-09-12T00:06:42.719339+0000","last_became_active":"2024-09-12T00:03:33.370562+0000","last_became_peered":"2024-09-12T00:03:33.370562+0000","last_unstale":"2024-09-12T00:06:42.719339+0000","last_undegraded":"2024-09-12T00:06:42.719339+0000","last_fullsized":"2024-09-12T00:06:42.719339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:31.888153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'10","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720452+0000","last_change":"2024-09-12T00:06:32.425494+0000","last_active":"2024-09-12T00:06:42.720452+0000","last_peered":"2024-09-12T00:06:42.720452+0000","last_clean":"2024-09-12T00:06:42.720452+0000","last_became_active":"2024-09-12T00:06:26.674937+0000","last_became_peered":"2024-09-12T00:06:26.674937+0000","last_unstale":"2024-09-12T00:06:42.720452+0000","last_undegraded":"2024-09-12T00:06:42.720452+0000","last_fullsized":"2024-09-12T00:06:42.720452+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:09.992203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":300,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499047+0000","last_change":"2024-09-12T00:03:11.770141+0000","last_active":"2024-09-12T00:06:42.499047+0000","last_peered":"2024-09-12T00:06:42.499047+0000","last_clean":"2024-09-12T00:06:42.499047+0000","last_became_active":"2024-09-12T00:03:11.767988+0000","last_became_peered":"2024-09-12T00:03:11.767988+0000","last_unstale":"2024-09-12T00:06:42.499047+0000","last_undegraded":"2024-09-12T00:06:42.499047+0000","last_fullsized":"2024-09-12T00:06:42.499047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_clean_scrub_stamp":"2024-09-12T00:03:10.462069+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:26.289955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717386+0000","last_change":"2024-09-12T00:06:28.888645+0000","last_active":"2024-09-12T00:06:42.717386+0000","last_peered":"2024-09-12T00:06:42.717386+0000","last_clean":"2024-09-12T00:06:42.717386+0000","last_became_active":"2024-09-12T00:06:26.671587+0000","last_became_peered":"2024-09-12T00:06:26.671587+0000","last_unstale":"2024-09-12T00:06:42.717386+0000","last_undegraded":"2024-09-12T00:06:42.717386+0000","last_fullsized":"2024-09-12T00:06:42.717386+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:03.325846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"95'24","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811486+0000","last_change":"2024-09-12T00:03:23.621849+0000","last_active":"2024-09-12T00:06:41.811486+0000","last_peered":"2024-09-12T00:06:41.811486+0000","last_clean":"2024-09-12T00:06:41.811486+0000","last_became_active":"2024-09-12T00:03:23.621146+0000","last_became_peered":"2024-09-12T00:03:23.621146+0000","last_unstale":"2024-09-12T00:06:41.811486+0000","last_undegraded":"2024-09-12T00:06:41.811486+0000","last_fullsized":"2024-09-12T00:06:41.811486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:38.426691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809414+0000","last_change":"2024-09-12T00:03:27.316175+0000","last_active":"2024-09-12T00:06:41.809414+0000","last_peered":"2024-09-12T00:06:41.809414+0000","last_clean":"2024-09-12T00:06:41.809414+0000","last_became_active":"2024-09-12T00:03:27.315502+0000","last_became_peered":"2024-09-12T00:03:27.315502+0000","last_unstale":"2024-09-12T00:06:41.809414+0000","last_undegraded":"2024-09-12T00:06:41.809414+0000","last_fullsized":"2024-09-12T00:06:41.809414+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:21.448686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"96'44","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720067+0000","last_change":"2024-09-12T00:06:28.900645+0000","last_active":"2024-09-12T00:06:42.720067+0000","last_peered":"2024-09-12T00:06:42.720067+0000","last_clean":"2024-09-12T00:06:42.720067+0000","last_became_active":"2024-09-12T00:06:26.667623+0000","last_became_peered":"2024-09-12T00:06:26.667623+0000","last_unstale":"2024-09-12T00:06:42.720067+0000","last_undegraded":"2024-09-12T00:06:42.720067+0000","last_fullsized":"2024-09-12T00:06:42.720067+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:36.584753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":38,"num_read_kb":26,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066468+0000","last_change":"2024-09-12T00:03:31.361408+0000","last_active":"2024-09-12T00:06:42.066468+0000","last_peered":"2024-09-12T00:06:42.066468+0000","last_clean":"2024-09-12T00:06:42.066468+0000","last_became_active":"2024-09-12T00:03:31.360462+0000","last_became_peered":"2024-09-12T00:03:31.360462+0000","last_unstale":"2024-09-12T00:06:42.066468+0000","last_undegraded":"2024-09-12T00:06:42.066468+0000","last_fullsized":"2024-09-12T00:06:42.066468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:58.407571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"59'4","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812851+0000","last_change":"2024-09-12T00:03:33.388253+0000","last_active":"2024-09-12T00:06:41.812851+0000","last_peered":"2024-09-12T00:06:41.812851+0000","last_clean":"2024-09-12T00:06:41.812851+0000","last_became_active":"2024-09-12T00:03:33.387457+0000","last_became_peered":"2024-09-12T00:03:33.387457+0000","last_unstale":"2024-09-12T00:06:41.812851+0000","last_undegraded":"2024-09-12T00:06:41.812851+0000","last_fullsized":"2024-09-12T00:06:41.812851+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:46.021740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066818+0000","last_change":"2024-09-12T00:03:25.357970+0000","last_active":"2024-09-12T00:06:42.066818+0000","last_peered":"2024-09-12T00:06:42.066818+0000","last_clean":"2024-09-12T00:06:42.066818+0000","last_became_active":"2024-09-12T00:03:25.355306+0000","last_became_peered":"2024-09-12T00:03:25.355306+0000","last_unstale":"2024-09-12T00:06:42.066818+0000","last_undegraded":"2024-09-12T00:06:42.066818+0000","last_fullsized":"2024-09-12T00:06:42.066818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:17.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717548+0000","last_change":"2024-09-12T00:06:26.654149+0000","last_active":"2024-09-12T00:06:42.717548+0000","last_peered":"2024-09-12T00:06:42.717548+0000","last_clean":"2024-09-12T00:06:42.717548+0000","last_became_active":"2024-09-12T00:06:26.653574+0000","last_became_peered":"2024-09-12T00:06:26.653574+0000","last_unstale":"2024-09-12T00:06:42.717548+0000","last_undegraded":"2024-09-12T00:06:42.717548+0000","last_fullsized":"2024-09-12T00:06:42.717548+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:55.656413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"96'28","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720943+0000","last_change":"2024-09-12T00:03:23.622111+0000","last_active":"2024-09-12T00:06:42.720943+0000","last_peered":"2024-09-12T00:06:42.720943+0000","last_clean":"2024-09-12T00:06:42.720943+0000","last_became_active":"2024-09-12T00:03:23.621358+0000","last_became_peered":"2024-09-12T00:03:23.621358+0000","last_unstale":"2024-09-12T00:06:42.720943+0000","last_undegraded":"2024-09-12T00:06:42.720943+0000","last_fullsized":"2024-09-12T00:06:42.720943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:02.202230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722205+0000","last_change":"2024-09-12T00:06:26.659401+0000","last_active":"2024-09-12T00:06:42.722205+0000","last_peered":"2024-09-12T00:06:42.722205+0000","last_clean":"2024-09-12T00:06:42.722205+0000","last_became_active":"2024-09-12T00:06:26.657376+0000","last_became_peered":"2024-09-12T00:06:26.657376+0000","last_unstale":"2024-09-12T00:06:42.722205+0000","last_undegraded":"2024-09-12T00:06:42.722205+0000","last_fullsized":"2024-09-12T00:06:42.722205+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:27.337831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"116'142","reported_seq":430,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721300+0000","last_change":"2024-09-12T00:03:29.346819+0000","last_active":"2024-09-12T00:06:42.721300+0000","last_peered":"2024-09-12T00:06:42.721300+0000","last_clean":"2024-09-12T00:06:42.721300+0000","last_became_active":"2024-09-12T00:03:29.346101+0000","last_became_peered":"2024-09-12T00:03:29.346101+0000","last_unstale":"2024-09-12T00:06:42.721300+0000","last_undegraded":"2024-09-12T00:06:42.721300+0000","last_fullsized":"2024-09-12T00:06:42.721300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:27.268327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":183,"num_read_kb":167,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721121+0000","last_change":"2024-09-12T00:06:26.679841+0000","last_active":"2024-09-12T00:06:42.721121+0000","last_peered":"2024-09-12T00:06:42.721121+0000","last_clean":"2024-09-12T00:06:42.721121+0000","last_became_active":"2024-09-12T00:06:26.675966+0000","last_became_peered":"2024-09-12T00:06:26.675966+0000","last_unstale":"2024-09-12T00:06:42.721121+0000","last_undegraded":"2024-09-12T00:06:42.721121+0000","last_fullsized":"2024-09-12T00:06:42.721121+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:39.439184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064787+0000","last_change":"2024-09-12T00:03:33.386144+0000","last_active":"2024-09-12T00:06:42.064787+0000","last_peered":"2024-09-12T00:06:42.064787+0000","last_clean":"2024-09-12T00:06:42.064787+0000","last_became_active":"2024-09-12T00:03:33.384951+0000","last_became_peered":"2024-09-12T00:03:33.384951+0000","last_unstale":"2024-09-12T00:06:42.064787+0000","last_undegraded":"2024-09-12T00:06:42.064787+0000","last_fullsized":"2024-09-12T00:06:42.064787+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:49.807501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"59'2","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720659+0000","last_change":"2024-09-12T00:03:25.332801+0000","last_active":"2024-09-12T00:06:42.720659+0000","last_peered":"2024-09-12T00:06:42.720659+0000","last_clean":"2024-09-12T00:06:42.720659+0000","last_became_active":"2024-09-12T00:03:25.331652+0000","last_became_peered":"2024-09-12T00:03:25.331652+0000","last_unstale":"2024-09-12T00:06:42.720659+0000","last_undegraded":"2024-09-12T00:06:42.720659+0000","last_fullsized":"2024-09-12T00:06:42.720659+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718983+0000","last_change":"2024-09-12T00:03:18.892423+0000","last_active":"2024-09-12T00:06:42.718983+0000","last_peered":"2024-09-12T00:06:42.718983+0000","last_clean":"2024-09-12T00:06:42.718983+0000","last_became_active":"2024-09-12T00:03:16.559698+0000","last_became_peered":"2024-09-12T00:03:16.559698+0000","last_unstale":"2024-09-12T00:06:42.718983+0000","last_undegraded":"2024-09-12T00:06:42.718983+0000","last_fullsized":"2024-09-12T00:06:42.718983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:21.453461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082440599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"95'22","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064436+0000","last_change":"2024-09-12T00:03:23.633606+0000","last_active":"2024-09-12T00:06:42.064436+0000","last_peered":"2024-09-12T00:06:42.064436+0000","last_clean":"2024-09-12T00:06:42.064436+0000","last_became_active":"2024-09-12T00:03:23.632795+0000","last_became_peered":"2024-09-12T00:03:23.632795+0000","last_unstale":"2024-09-12T00:06:42.064436+0000","last_undegraded":"2024-09-12T00:06:42.064436+0000","last_fullsized":"2024-09-12T00:06:42.064436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:08.214455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90177536,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723278+0000","last_change":"2024-09-12T00:03:27.326932+0000","last_active":"2024-09-12T00:06:42.723278+0000","last_peered":"2024-09-12T00:06:42.723278+0000","last_clean":"2024-09-12T00:06:42.723278+0000","last_became_active":"2024-09-12T00:03:27.326173+0000","last_became_peered":"2024-09-12T00:03:27.326173+0000","last_unstale":"2024-09-12T00:06:42.723278+0000","last_undegraded":"2024-09-12T00:06:42.723278+0000","last_fullsized":"2024-09-12T00:06:42.723278+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:12.286539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"116'17","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.585643+0000","last_change":"2024-09-12T00:03:29.338829+0000","last_active":"2024-09-12T00:06:42.585643+0000","last_peered":"2024-09-12T00:06:42.585643+0000","last_clean":"2024-09-12T00:06:42.585643+0000","last_became_active":"2024-09-12T00:03:29.337364+0000","last_became_peered":"2024-09-12T00:03:29.337364+0000","last_unstale":"2024-09-12T00:06:42.585643+0000","last_undegraded":"2024-09-12T00:06:42.585643+0000","last_fullsized":"2024-09-12T00:06:42.585643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:01.584359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812645+0000","last_change":"2024-09-12T00:06:26.655001+0000","last_active":"2024-09-12T00:06:41.812645+0000","last_peered":"2024-09-12T00:06:41.812645+0000","last_clean":"2024-09-12T00:06:41.812645+0000","last_became_active":"2024-09-12T00:06:26.654068+0000","last_became_peered":"2024-09-12T00:06:26.654068+0000","last_unstale":"2024-09-12T00:06:41.812645+0000","last_undegraded":"2024-09-12T00:06:41.812645+0000","last_fullsized":"2024-09-12T00:06:41.812645+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:50.133218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810544+0000","last_change":"2024-09-12T00:03:33.354171+0000","last_active":"2024-09-12T00:06:41.810544+0000","last_peered":"2024-09-12T00:06:41.810544+0000","last_clean":"2024-09-12T00:06:41.810544+0000","last_became_active":"2024-09-12T00:03:33.353460+0000","last_became_peered":"2024-09-12T00:03:33.353460+0000","last_unstale":"2024-09-12T00:06:41.810544+0000","last_undegraded":"2024-09-12T00:06:41.810544+0000","last_fullsized":"2024-09-12T00:06:41.810544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:34.356970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"84'8","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721257+0000","last_change":"2024-09-12T00:03:25.336320+0000","last_active":"2024-09-12T00:06:42.721257+0000","last_peered":"2024-09-12T00:06:42.721257+0000","last_clean":"2024-09-12T00:06:42.721257+0000","last_became_active":"2024-09-12T00:03:25.333449+0000","last_became_peered":"2024-09-12T00:03:25.333449+0000","last_unstale":"2024-09-12T00:06:42.721257+0000","last_undegraded":"2024-09-12T00:06:42.721257+0000","last_fullsized":"2024-09-12T00:06:42.721257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722390+0000","last_change":"2024-09-12T00:06:32.408232+0000","last_active":"2024-09-12T00:06:42.722390+0000","last_peered":"2024-09-12T00:06:42.722390+0000","last_clean":"2024-09-12T00:06:42.722390+0000","last_became_active":"2024-09-12T00:06:26.677047+0000","last_became_peered":"2024-09-12T00:06:26.677047+0000","last_unstale":"2024-09-12T00:06:42.722390+0000","last_undegraded":"2024-09-12T00:06:42.722390+0000","last_fullsized":"2024-09-12T00:06:42.722390+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:52.555478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"96'21","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810342+0000","last_change":"2024-09-12T00:03:23.611064+0000","last_active":"2024-09-12T00:06:41.810342+0000","last_peered":"2024-09-12T00:06:41.810342+0000","last_clean":"2024-09-12T00:06:41.810342+0000","last_became_active":"2024-09-12T00:03:23.610612+0000","last_became_peered":"2024-09-12T00:03:23.610612+0000","last_unstale":"2024-09-12T00:06:41.810342+0000","last_undegraded":"2024-09-12T00:06:41.810342+0000","last_fullsized":"2024-09-12T00:06:41.810342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:04.201688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722466+0000","last_change":"2024-09-12T00:03:27.339197+0000","last_active":"2024-09-12T00:06:42.722466+0000","last_peered":"2024-09-12T00:06:42.722466+0000","last_clean":"2024-09-12T00:06:42.722466+0000","last_became_active":"2024-09-12T00:03:27.338508+0000","last_became_peered":"2024-09-12T00:03:27.338508+0000","last_unstale":"2024-09-12T00:06:42.722466+0000","last_undegraded":"2024-09-12T00:06:42.722466+0000","last_fullsized":"2024-09-12T00:06:42.722466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:08.306289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066551+0000","last_change":"2024-09-12T00:06:28.890041+0000","last_active":"2024-09-12T00:06:42.066551+0000","last_peered":"2024-09-12T00:06:42.066551+0000","last_clean":"2024-09-12T00:06:42.066551+0000","last_became_active":"2024-09-12T00:06:26.682354+0000","last_became_peered":"2024-09-12T00:06:26.682354+0000","last_unstale":"2024-09-12T00:06:42.066551+0000","last_undegraded":"2024-09-12T00:06:42.066551+0000","last_fullsized":"2024-09-12T00:06:42.066551+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:42.484131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722102+0000","last_change":"2024-09-12T00:06:26.675142+0000","last_active":"2024-09-12T00:06:42.722102+0000","last_peered":"2024-09-12T00:06:42.722102+0000","last_clean":"2024-09-12T00:06:42.722102+0000","last_became_active":"2024-09-12T00:06:26.669787+0000","last_became_peered":"2024-09-12T00:06:26.669787+0000","last_unstale":"2024-09-12T00:06:42.722102+0000","last_undegraded":"2024-09-12T00:06:42.722102+0000","last_fullsized":"2024-09-12T00:06:42.722102+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:34.635508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"63'7","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500245+0000","last_change":"2024-09-12T00:03:33.367035+0000","last_active":"2024-09-12T00:06:42.500245+0000","last_peered":"2024-09-12T00:06:42.500245+0000","last_clean":"2024-09-12T00:06:42.500245+0000","last_became_active":"2024-09-12T00:03:33.366311+0000","last_became_peered":"2024-09-12T00:03:33.366311+0000","last_unstale":"2024-09-12T00:06:42.500245+0000","last_undegraded":"2024-09-12T00:06:42.500245+0000","last_fullsized":"2024-09-12T00:06:42.500245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"96'8","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722537+0000","last_change":"2024-09-12T00:06:28.313486+0000","last_active":"2024-09-12T00:06:42.722537+0000","last_peered":"2024-09-12T00:06:42.722537+0000","last_clean":"2024-09-12T00:06:42.722537+0000","last_became_active":"2024-09-12T00:06:26.675442+0000","last_became_peered":"2024-09-12T00:06:26.675442+0000","last_unstale":"2024-09-12T00:06:42.722537+0000","last_undegraded":"2024-09-12T00:06:42.722537+0000","last_fullsized":"2024-09-12T00:06:42.722537+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:37.245286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"96'19","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812844+0000","last_change":"2024-09-12T00:03:23.619024+0000","last_active":"2024-09-12T00:06:41.812844+0000","last_peered":"2024-09-12T00:06:41.812844+0000","last_clean":"2024-09-12T00:06:41.812844+0000","last_became_active":"2024-09-12T00:03:23.618716+0000","last_became_peered":"2024-09-12T00:03:23.618716+0000","last_unstale":"2024-09-12T00:06:41.812844+0000","last_undegraded":"2024-09-12T00:06:41.812844+0000","last_fullsized":"2024-09-12T00:06:41.812844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067307+0000","last_change":"2024-09-12T00:03:18.562010+0000","last_active":"2024-09-12T00:06:42.067307+0000","last_peered":"2024-09-12T00:06:42.067307+0000","last_clean":"2024-09-12T00:06:42.067307+0000","last_became_active":"2024-09-12T00:03:16.561218+0000","last_became_peered":"2024-09-12T00:03:16.561218+0000","last_unstale":"2024-09-12T00:06:42.067307+0000","last_undegraded":"2024-09-12T00:06:42.067307+0000","last_fullsized":"2024-09-12T00:06:42.067307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:43.089686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084170299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811828+0000","last_change":"2024-09-12T00:03:27.341079+0000","last_active":"2024-09-12T00:06:41.811828+0000","last_peered":"2024-09-12T00:06:41.811828+0000","last_clean":"2024-09-12T00:06:41.811828+0000","last_became_active":"2024-09-12T00:03:27.340391+0000","last_became_peered":"2024-09-12T00:03:27.340391+0000","last_unstale":"2024-09-12T00:06:41.811828+0000","last_undegraded":"2024-09-12T00:06:41.811828+0000","last_fullsized":"2024-09-12T00:06:41.811828+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:10.048469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"96'49","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718472+0000","last_change":"2024-09-12T00:03:29.346823+0000","last_active":"2024-09-12T00:06:42.718472+0000","last_peered":"2024-09-12T00:06:42.718472+0000","last_clean":"2024-09-12T00:06:42.718472+0000","last_became_active":"2024-09-12T00:03:29.346066+0000","last_became_peered":"2024-09-12T00:03:29.346066+0000","last_unstale":"2024-09-12T00:06:42.718472+0000","last_undegraded":"2024-09-12T00:06:42.718472+0000","last_fullsized":"2024-09-12T00:06:42.718472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:12.080794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124550,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":47,"num_write":38,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810366+0000","last_change":"2024-09-12T00:03:31.348574+0000","last_active":"2024-09-12T00:06:41.810366+0000","last_peered":"2024-09-12T00:06:41.810366+0000","last_clean":"2024-09-12T00:06:41.810366+0000","last_became_active":"2024-09-12T00:03:31.346511+0000","last_became_peered":"2024-09-12T00:03:31.346511+0000","last_unstale":"2024-09-12T00:06:41.810366+0000","last_undegraded":"2024-09-12T00:06:41.810366+0000","last_fullsized":"2024-09-12T00:06:41.810366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:14.061486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"59'7","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066233+0000","last_change":"2024-09-12T00:03:33.385232+0000","last_active":"2024-09-12T00:06:42.066233+0000","last_peered":"2024-09-12T00:06:42.066233+0000","last_clean":"2024-09-12T00:06:42.066233+0000","last_became_active":"2024-09-12T00:03:33.384457+0000","last_became_peered":"2024-09-12T00:03:33.384457+0000","last_unstale":"2024-09-12T00:06:42.066233+0000","last_undegraded":"2024-09-12T00:06:42.066233+0000","last_fullsized":"2024-09-12T00:06:42.066233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:34.615256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"76'4","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721962+0000","last_change":"2024-09-12T00:03:25.334767+0000","last_active":"2024-09-12T00:06:42.721962+0000","last_peered":"2024-09-12T00:06:42.721962+0000","last_clean":"2024-09-12T00:06:42.721962+0000","last_became_active":"2024-09-12T00:03:25.332814+0000","last_became_peered":"2024-09-12T00:03:25.332814+0000","last_unstale":"2024-09-12T00:06:42.721962+0000","last_undegraded":"2024-09-12T00:06:42.721962+0000","last_fullsized":"2024-09-12T00:06:42.721962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"95'27","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721814+0000","last_change":"2024-09-12T00:03:23.628752+0000","last_active":"2024-09-12T00:06:42.721814+0000","last_peered":"2024-09-12T00:06:42.721814+0000","last_clean":"2024-09-12T00:06:42.721814+0000","last_became_active":"2024-09-12T00:03:23.628128+0000","last_became_peered":"2024-09-12T00:03:23.628128+0000","last_unstale":"2024-09-12T00:06:42.721814+0000","last_undegraded":"2024-09-12T00:06:42.721814+0000","last_fullsized":"2024-09-12T00:06:42.721814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720543+0000","last_change":"2024-09-12T00:06:26.679199+0000","last_active":"2024-09-12T00:06:42.720543+0000","last_peered":"2024-09-12T00:06:42.720543+0000","last_clean":"2024-09-12T00:06:42.720543+0000","last_became_active":"2024-09-12T00:06:26.675309+0000","last_became_peered":"2024-09-12T00:06:26.675309+0000","last_unstale":"2024-09-12T00:06:42.720543+0000","last_undegraded":"2024-09-12T00:06:42.720543+0000","last_fullsized":"2024-09-12T00:06:42.720543+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:56.980194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814664+0000","last_change":"2024-09-12T00:03:27.316317+0000","last_active":"2024-09-12T00:06:41.814664+0000","last_peered":"2024-09-12T00:06:41.814664+0000","last_clean":"2024-09-12T00:06:41.814664+0000","last_became_active":"2024-09-12T00:03:27.315704+0000","last_became_peered":"2024-09-12T00:03:27.315704+0000","last_unstale":"2024-09-12T00:06:41.814664+0000","last_undegraded":"2024-09-12T00:06:41.814664+0000","last_fullsized":"2024-09-12T00:06:41.814664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:07.883485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'20","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720264+0000","last_change":"2024-09-12T00:06:26.708588+0000","last_active":"2024-09-12T00:06:42.720264+0000","last_peered":"2024-09-12T00:06:42.720264+0000","last_clean":"2024-09-12T00:06:42.720264+0000","last_became_active":"2024-09-12T00:06:26.661284+0000","last_became_peered":"2024-09-12T00:06:26.661284+0000","last_unstale":"2024-09-12T00:06:42.720264+0000","last_undegraded":"2024-09-12T00:06:42.720264+0000","last_fullsized":"2024-09-12T00:06:42.720264+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:19.418779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"116'135","reported_seq":354,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.586307+0000","last_change":"2024-09-12T00:03:31.357011+0000","last_active":"2024-09-12T00:06:42.586307+0000","last_peered":"2024-09-12T00:06:42.586307+0000","last_clean":"2024-09-12T00:06:42.586307+0000","last_became_active":"2024-09-12T00:03:31.356108+0000","last_became_peered":"2024-09-12T00:03:31.356108+0000","last_unstale":"2024-09-12T00:06:42.586307+0000","last_undegraded":"2024-09-12T00:06:42.586307+0000","last_fullsized":"2024-09-12T00:06:42.586307+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"58'2","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723235+0000","last_change":"2024-09-12T00:03:33.372465+0000","last_active":"2024-09-12T00:06:42.723235+0000","last_peered":"2024-09-12T00:06:42.723235+0000","last_clean":"2024-09-12T00:06:42.723235+0000","last_became_active":"2024-09-12T00:03:33.371214+0000","last_became_peered":"2024-09-12T00:03:33.371214+0000","last_unstale":"2024-09-12T00:06:42.723235+0000","last_undegraded":"2024-09-12T00:06:42.723235+0000","last_fullsized":"2024-09-12T00:06:42.723235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:40.880933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"84'8","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810903+0000","last_change":"2024-09-12T00:03:25.332405+0000","last_active":"2024-09-12T00:06:41.810903+0000","last_peered":"2024-09-12T00:06:41.810903+0000","last_clean":"2024-09-12T00:06:41.810903+0000","last_became_active":"2024-09-12T00:03:25.331250+0000","last_became_peered":"2024-09-12T00:03:25.331250+0000","last_unstale":"2024-09-12T00:06:41.810903+0000","last_undegraded":"2024-09-12T00:06:41.810903+0000","last_fullsized":"2024-09-12T00:06:41.810903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"96'23","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813862+0000","last_change":"2024-09-12T00:03:23.602222+0000","last_active":"2024-09-12T00:06:41.813862+0000","last_peered":"2024-09-12T00:06:41.813862+0000","last_clean":"2024-09-12T00:06:41.813862+0000","last_became_active":"2024-09-12T00:03:23.601481+0000","last_became_peered":"2024-09-12T00:03:23.601481+0000","last_unstale":"2024-09-12T00:06:41.813862+0000","last_undegraded":"2024-09-12T00:06:41.813862+0000","last_fullsized":"2024-09-12T00:06:41.813862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:56.636638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813711+0000","last_change":"2024-09-12T00:03:18.716648+0000","last_active":"2024-09-12T00:06:41.813711+0000","last_peered":"2024-09-12T00:06:41.813711+0000","last_clean":"2024-09-12T00:06:41.813711+0000","last_became_active":"2024-09-12T00:03:16.594609+0000","last_became_peered":"2024-09-12T00:03:16.594609+0000","last_unstale":"2024-09-12T00:06:41.813711+0000","last_undegraded":"2024-09-12T00:06:41.813711+0000","last_fullsized":"2024-09-12T00:06:41.813711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:34.635008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010254439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721880+0000","last_change":"2024-09-12T00:06:26.648329+0000","last_active":"2024-09-12T00:06:42.721880+0000","last_peered":"2024-09-12T00:06:42.721880+0000","last_clean":"2024-09-12T00:06:42.721880+0000","last_became_active":"2024-09-12T00:06:26.647055+0000","last_became_peered":"2024-09-12T00:06:26.647055+0000","last_unstale":"2024-09-12T00:06:42.721880+0000","last_undegraded":"2024-09-12T00:06:42.721880+0000","last_fullsized":"2024-09-12T00:06:42.721880+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:35.147693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"58'18","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720951+0000","last_change":"2024-09-12T00:06:30.110628+0000","last_active":"2024-09-12T00:06:42.720951+0000","last_peered":"2024-09-12T00:06:42.720951+0000","last_clean":"2024-09-12T00:06:42.720951+0000","last_became_active":"2024-09-12T00:06:26.662450+0000","last_became_peered":"2024-09-12T00:06:26.662450+0000","last_unstale":"2024-09-12T00:06:42.720951+0000","last_undegraded":"2024-09-12T00:06:42.720951+0000","last_fullsized":"2024-09-12T00:06:42.720951+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:10.820458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"116'135","reported_seq":351,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.585684+0000","last_change":"2024-09-12T00:03:31.361616+0000","last_active":"2024-09-12T00:06:42.585684+0000","last_peered":"2024-09-12T00:06:42.585684+0000","last_clean":"2024-09-12T00:06:42.585684+0000","last_became_active":"2024-09-12T00:03:31.360518+0000","last_became_peered":"2024-09-12T00:03:31.360518+0000","last_unstale":"2024-09-12T00:06:42.585684+0000","last_undegraded":"2024-09-12T00:06:42.585684+0000","last_fullsized":"2024-09-12T00:06:42.585684+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:40.640537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065311+0000","last_change":"2024-09-12T00:03:33.378417+0000","last_active":"2024-09-12T00:06:42.065311+0000","last_peered":"2024-09-12T00:06:42.065311+0000","last_clean":"2024-09-12T00:06:42.065311+0000","last_became_active":"2024-09-12T00:03:33.377669+0000","last_became_peered":"2024-09-12T00:03:33.377669+0000","last_unstale":"2024-09-12T00:06:42.065311+0000","last_undegraded":"2024-09-12T00:06:42.065311+0000","last_fullsized":"2024-09-12T00:06:42.065311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:04.623906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811103+0000","last_change":"2024-09-12T00:06:26.714198+0000","last_active":"2024-09-12T00:06:41.811103+0000","last_peered":"2024-09-12T00:06:41.811103+0000","last_clean":"2024-09-12T00:06:41.811103+0000","last_became_active":"2024-09-12T00:06:26.662114+0000","last_became_peered":"2024-09-12T00:06:26.662114+0000","last_unstale":"2024-09-12T00:06:41.811103+0000","last_undegraded":"2024-09-12T00:06:41.811103+0000","last_fullsized":"2024-09-12T00:06:41.811103+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:41.029559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"96'24","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813511+0000","last_change":"2024-09-12T00:03:23.616319+0000","last_active":"2024-09-12T00:06:41.813511+0000","last_peered":"2024-09-12T00:06:41.813511+0000","last_clean":"2024-09-12T00:06:41.813511+0000","last_became_active":"2024-09-12T00:03:23.615158+0000","last_became_peered":"2024-09-12T00:03:23.615158+0000","last_unstale":"2024-09-12T00:06:41.813511+0000","last_undegraded":"2024-09-12T00:06:41.813511+0000","last_fullsized":"2024-09-12T00:06:41.813511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:15.677228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719839+0000","last_change":"2024-09-12T00:06:26.680801+0000","last_active":"2024-09-12T00:06:42.719839+0000","last_peered":"2024-09-12T00:06:42.719839+0000","last_clean":"2024-09-12T00:06:42.719839+0000","last_became_active":"2024-09-12T00:06:26.677544+0000","last_became_peered":"2024-09-12T00:06:26.677544+0000","last_unstale":"2024-09-12T00:06:42.719839+0000","last_undegraded":"2024-09-12T00:06:42.719839+0000","last_fullsized":"2024-09-12T00:06:42.719839+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:43.976666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810348+0000","last_change":"2024-09-12T00:03:27.337359+0000","last_active":"2024-09-12T00:06:41.810348+0000","last_peered":"2024-09-12T00:06:41.810348+0000","last_clean":"2024-09-12T00:06:41.810348+0000","last_became_active":"2024-09-12T00:03:27.336289+0000","last_became_peered":"2024-09-12T00:03:27.336289+0000","last_unstale":"2024-09-12T00:06:41.810348+0000","last_undegraded":"2024-09-12T00:06:41.810348+0000","last_fullsized":"2024-09-12T00:06:41.810348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:39.147272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"96'50","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809455+0000","last_change":"2024-09-12T00:03:29.344621+0000","last_active":"2024-09-12T00:06:41.809455+0000","last_peered":"2024-09-12T00:06:41.809455+0000","last_clean":"2024-09-12T00:06:41.809455+0000","last_became_active":"2024-09-12T00:03:29.343779+0000","last_became_peered":"2024-09-12T00:03:29.343779+0000","last_unstale":"2024-09-12T00:06:41.809455+0000","last_undegraded":"2024-09-12T00:06:41.809455+0000","last_fullsized":"2024-09-12T00:06:41.809455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:49.518432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811176+0000","last_change":"2024-09-12T00:03:31.335460+0000","last_active":"2024-09-12T00:06:41.811176+0000","last_peered":"2024-09-12T00:06:41.811176+0000","last_clean":"2024-09-12T00:06:41.811176+0000","last_became_active":"2024-09-12T00:03:31.334701+0000","last_became_peered":"2024-09-12T00:03:31.334701+0000","last_unstale":"2024-09-12T00:06:41.811176+0000","last_undegraded":"2024-09-12T00:06:41.811176+0000","last_fullsized":"2024-09-12T00:06:41.811176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:28.484366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"58'4","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812236+0000","last_change":"2024-09-12T00:03:33.386404+0000","last_active":"2024-09-12T00:06:41.812236+0000","last_peered":"2024-09-12T00:06:41.812236+0000","last_clean":"2024-09-12T00:06:41.812236+0000","last_became_active":"2024-09-12T00:03:33.385090+0000","last_became_peered":"2024-09-12T00:03:33.385090+0000","last_unstale":"2024-09-12T00:06:41.812236+0000","last_undegraded":"2024-09-12T00:06:41.812236+0000","last_fullsized":"2024-09-12T00:06:41.812236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"96'2","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813204+0000","last_change":"2024-09-12T00:03:33.361690+0000","last_active":"2024-09-12T00:06:41.813204+0000","last_peered":"2024-09-12T00:06:41.813204+0000","last_clean":"2024-09-12T00:06:41.813204+0000","last_became_active":"2024-09-12T00:03:33.360980+0000","last_became_peered":"2024-09-12T00:03:33.360980+0000","last_unstale":"2024-09-12T00:06:41.813204+0000","last_undegraded":"2024-09-12T00:06:41.813204+0000","last_fullsized":"2024-09-12T00:06:41.813204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:24.954577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"59'2","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813869+0000","last_change":"2024-09-12T00:06:28.274587+0000","last_active":"2024-09-12T00:06:41.813869+0000","last_peered":"2024-09-12T00:06:41.813869+0000","last_clean":"2024-09-12T00:06:41.813869+0000","last_became_active":"2024-09-12T00:06:26.664337+0000","last_became_peered":"2024-09-12T00:06:26.664337+0000","last_unstale":"2024-09-12T00:06:41.813869+0000","last_undegraded":"2024-09-12T00:06:41.813869+0000","last_fullsized":"2024-09-12T00:06:41.813869+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:00.552692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"95'30","reported_seq":103,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717433+0000","last_change":"2024-09-12T00:06:30.093257+0000","last_active":"2024-09-12T00:06:42.717433+0000","last_peered":"2024-09-12T00:06:42.717433+0000","last_clean":"2024-09-12T00:06:42.717433+0000","last_became_active":"2024-09-12T00:06:26.671623+0000","last_became_peered":"2024-09-12T00:06:26.671623+0000","last_unstale":"2024-09-12T00:06:42.717433+0000","last_undegraded":"2024-09-12T00:06:42.717433+0000","last_fullsized":"2024-09-12T00:06:42.717433+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:02.454592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":201326592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"28'2","reported_seq":367,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722728+0000","last_change":"2024-09-12T00:03:27.332281+0000","last_active":"2024-09-12T00:06:42.722728+0000","last_peered":"2024-09-12T00:06:42.722728+0000","last_clean":"2024-09-12T00:06:42.722728+0000","last_became_active":"2024-09-12T00:03:27.331527+0000","last_became_peered":"2024-09-12T00:03:27.331527+0000","last_unstale":"2024-09-12T00:06:42.722728+0000","last_undegraded":"2024-09-12T00:06:42.722728+0000","last_fullsized":"2024-09-12T00:06:42.722728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":266,"num_read_kb":266,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"96'25","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720005+0000","last_change":"2024-09-12T00:03:29.338655+0000","last_active":"2024-09-12T00:06:42.720005+0000","last_peered":"2024-09-12T00:06:42.720005+0000","last_clean":"2024-09-12T00:06:42.720005+0000","last_became_active":"2024-09-12T00:03:29.337905+0000","last_became_peered":"2024-09-12T00:03:29.337905+0000","last_unstale":"2024-09-12T00:06:42.720005+0000","last_undegraded":"2024-09-12T00:06:42.720005+0000","last_fullsized":"2024-09-12T00:06:42.720005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718441+0000","last_change":"2024-09-12T00:03:31.351716+0000","last_active":"2024-09-12T00:06:42.718441+0000","last_peered":"2024-09-12T00:06:42.718441+0000","last_clean":"2024-09-12T00:06:42.718441+0000","last_became_active":"2024-09-12T00:03:31.350917+0000","last_became_peered":"2024-09-12T00:03:31.350917+0000","last_unstale":"2024-09-12T00:06:42.718441+0000","last_undegraded":"2024-09-12T00:06:42.718441+0000","last_fullsized":"2024-09-12T00:06:42.718441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:45.880820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722942+0000","last_change":"2024-09-12T00:03:33.374233+0000","last_active":"2024-09-12T00:06:42.722942+0000","last_peered":"2024-09-12T00:06:42.722942+0000","last_clean":"2024-09-12T00:06:42.722942+0000","last_became_active":"2024-09-12T00:03:33.373466+0000","last_became_peered":"2024-09-12T00:03:33.373466+0000","last_unstale":"2024-09-12T00:06:42.722942+0000","last_undegraded":"2024-09-12T00:06:42.722942+0000","last_fullsized":"2024-09-12T00:06:42.722942+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:55.598892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"59'2","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811077+0000","last_change":"2024-09-12T00:06:28.295394+0000","last_active":"2024-09-12T00:06:41.811077+0000","last_peered":"2024-09-12T00:06:41.811077+0000","last_clean":"2024-09-12T00:06:41.811077+0000","last_became_active":"2024-09-12T00:06:26.664003+0000","last_became_peered":"2024-09-12T00:06:26.664003+0000","last_unstale":"2024-09-12T00:06:41.811077+0000","last_undegraded":"2024-09-12T00:06:41.811077+0000","last_fullsized":"2024-09-12T00:06:41.811077+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:22.616662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"95'23","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816608+0000","last_change":"2024-09-12T00:03:23.613274+0000","last_active":"2024-09-12T00:06:41.816608+0000","last_peered":"2024-09-12T00:06:41.816608+0000","last_clean":"2024-09-12T00:06:41.816608+0000","last_became_active":"2024-09-12T00:03:23.612941+0000","last_became_peered":"2024-09-12T00:03:23.612941+0000","last_unstale":"2024-09-12T00:06:41.816608+0000","last_undegraded":"2024-09-12T00:06:41.816608+0000","last_fullsized":"2024-09-12T00:06:41.816608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:56.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811543+0000","last_change":"2024-09-12T00:03:27.336144+0000","last_active":"2024-09-12T00:06:41.811543+0000","last_peered":"2024-09-12T00:06:41.811543+0000","last_clean":"2024-09-12T00:06:41.811543+0000","last_became_active":"2024-09-12T00:03:27.335372+0000","last_became_peered":"2024-09-12T00:03:27.335372+0000","last_unstale":"2024-09-12T00:06:41.811543+0000","last_undegraded":"2024-09-12T00:06:41.811543+0000","last_fullsized":"2024-09-12T00:06:41.811543+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:33.978665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"108'11","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809960+0000","last_change":"2024-09-12T00:03:29.332051+0000","last_active":"2024-09-12T00:06:41.809960+0000","last_peered":"2024-09-12T00:06:41.809960+0000","last_clean":"2024-09-12T00:06:41.809960+0000","last_became_active":"2024-09-12T00:03:29.331243+0000","last_became_peered":"2024-09-12T00:03:29.331243+0000","last_unstale":"2024-09-12T00:06:41.809960+0000","last_undegraded":"2024-09-12T00:06:41.809960+0000","last_fullsized":"2024-09-12T00:06:41.809960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:52.544770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810109+0000","last_change":"2024-09-12T00:03:31.347021+0000","last_active":"2024-09-12T00:06:41.810109+0000","last_peered":"2024-09-12T00:06:41.810109+0000","last_clean":"2024-09-12T00:06:41.810109+0000","last_became_active":"2024-09-12T00:03:31.344407+0000","last_became_peered":"2024-09-12T00:03:31.344407+0000","last_unstale":"2024-09-12T00:06:41.810109+0000","last_undegraded":"2024-09-12T00:06:41.810109+0000","last_fullsized":"2024-09-12T00:06:41.810109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:32.139742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"84'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719370+0000","last_change":"2024-09-12T00:03:33.370271+0000","last_active":"2024-09-12T00:06:42.719370+0000","last_peered":"2024-09-12T00:06:42.719370+0000","last_clean":"2024-09-12T00:06:42.719370+0000","last_became_active":"2024-09-12T00:03:33.369538+0000","last_became_peered":"2024-09-12T00:03:33.369538+0000","last_unstale":"2024-09-12T00:06:42.719370+0000","last_undegraded":"2024-09-12T00:06:42.719370+0000","last_fullsized":"2024-09-12T00:06:42.719370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"59'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810693+0000","last_change":"2024-09-12T00:03:25.341025+0000","last_active":"2024-09-12T00:06:41.810693+0000","last_peered":"2024-09-12T00:06:41.810693+0000","last_clean":"2024-09-12T00:06:41.810693+0000","last_became_active":"2024-09-12T00:03:25.340288+0000","last_became_peered":"2024-09-12T00:03:25.340288+0000","last_unstale":"2024-09-12T00:06:41.810693+0000","last_undegraded":"2024-09-12T00:06:41.810693+0000","last_fullsized":"2024-09-12T00:06:41.810693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"96'29","reported_seq":330,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814348+0000","last_change":"2024-09-12T00:06:30.098997+0000","last_active":"2024-09-12T00:06:41.814348+0000","last_peered":"2024-09-12T00:06:41.814348+0000","last_clean":"2024-09-12T00:06:41.814348+0000","last_became_active":"2024-09-12T00:06:26.672172+0000","last_became_peered":"2024-09-12T00:06:26.672172+0000","last_unstale":"2024-09-12T00:06:41.814348+0000","last_undegraded":"2024-09-12T00:06:41.814348+0000","last_fullsized":"2024-09-12T00:06:41.814348+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:32.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810614+0000","last_change":"2024-09-12T00:03:27.329869+0000","last_active":"2024-09-12T00:06:41.810614+0000","last_peered":"2024-09-12T00:06:41.810614+0000","last_clean":"2024-09-12T00:06:41.810614+0000","last_became_active":"2024-09-12T00:03:27.329077+0000","last_became_peered":"2024-09-12T00:03:27.329077+0000","last_unstale":"2024-09-12T00:06:41.810614+0000","last_undegraded":"2024-09-12T00:06:41.810614+0000","last_fullsized":"2024-09-12T00:06:41.810614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"96'19","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720203+0000","last_change":"2024-09-12T00:03:29.346878+0000","last_active":"2024-09-12T00:06:42.720203+0000","last_peered":"2024-09-12T00:06:42.720203+0000","last_clean":"2024-09-12T00:06:42.720203+0000","last_became_active":"2024-09-12T00:03:29.345990+0000","last_became_peered":"2024-09-12T00:03:29.345990+0000","last_unstale":"2024-09-12T00:06:42.720203+0000","last_undegraded":"2024-09-12T00:06:42.720203+0000","last_fullsized":"2024-09-12T00:06:42.720203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:06.398979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499961+0000","last_change":"2024-09-12T00:03:31.363658+0000","last_active":"2024-09-12T00:06:42.499961+0000","last_peered":"2024-09-12T00:06:42.499961+0000","last_clean":"2024-09-12T00:06:42.499961+0000","last_became_active":"2024-09-12T00:03:31.363080+0000","last_became_peered":"2024-09-12T00:03:31.363080+0000","last_unstale":"2024-09-12T00:06:42.499961+0000","last_undegraded":"2024-09-12T00:06:42.499961+0000","last_fullsized":"2024-09-12T00:06:42.499961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:05.901608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717550+0000","last_change":"2024-09-12T00:06:26.673691+0000","last_active":"2024-09-12T00:06:42.717550+0000","last_peered":"2024-09-12T00:06:42.717550+0000","last_clean":"2024-09-12T00:06:42.717550+0000","last_became_active":"2024-09-12T00:06:26.669877+0000","last_became_peered":"2024-09-12T00:06:26.669877+0000","last_unstale":"2024-09-12T00:06:42.717550+0000","last_undegraded":"2024-09-12T00:06:42.717550+0000","last_fullsized":"2024-09-12T00:06:42.717550+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:02.798560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"59'2","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718800+0000","last_change":"2024-09-12T00:06:26.687219+0000","last_active":"2024-09-12T00:06:42.718800+0000","last_peered":"2024-09-12T00:06:42.718800+0000","last_clean":"2024-09-12T00:06:42.718800+0000","last_became_active":"2024-09-12T00:06:26.655483+0000","last_became_peered":"2024-09-12T00:06:26.655483+0000","last_unstale":"2024-09-12T00:06:42.718800+0000","last_undegraded":"2024-09-12T00:06:42.718800+0000","last_fullsized":"2024-09-12T00:06:42.718800+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:21.199336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"96'22","reported_seq":299,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067870+0000","last_change":"2024-09-12T00:06:27.905793+0000","last_active":"2024-09-12T00:06:42.067870+0000","last_peered":"2024-09-12T00:06:42.067870+0000","last_clean":"2024-09-12T00:06:42.067870+0000","last_became_active":"2024-09-12T00:06:26.664617+0000","last_became_peered":"2024-09-12T00:06:26.664617+0000","last_unstale":"2024-09-12T00:06:42.067870+0000","last_undegraded":"2024-09-12T00:06:42.067870+0000","last_fullsized":"2024-09-12T00:06:42.067870+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:23.455040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":142606336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717842+0000","last_change":"2024-09-12T00:06:26.663673+0000","last_active":"2024-09-12T00:06:42.717842+0000","last_peered":"2024-09-12T00:06:42.717842+0000","last_clean":"2024-09-12T00:06:42.717842+0000","last_became_active":"2024-09-12T00:06:26.663351+0000","last_became_peered":"2024-09-12T00:06:26.663351+0000","last_unstale":"2024-09-12T00:06:42.717842+0000","last_undegraded":"2024-09-12T00:06:42.717842+0000","last_fullsized":"2024-09-12T00:06:42.717842+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:58.342457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"96'18","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814520+0000","last_change":"2024-09-12T00:03:29.346312+0000","last_active":"2024-09-12T00:06:41.814520+0000","last_peered":"2024-09-12T00:06:41.814520+0000","last_clean":"2024-09-12T00:06:41.814520+0000","last_became_active":"2024-09-12T00:03:29.345883+0000","last_became_peered":"2024-09-12T00:03:29.345883+0000","last_unstale":"2024-09-12T00:06:41.814520+0000","last_undegraded":"2024-09-12T00:06:41.814520+0000","last_fullsized":"2024-09-12T00:06:41.814520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:46.723370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719592+0000","last_change":"2024-09-12T00:03:31.358786+0000","last_active":"2024-09-12T00:06:42.719592+0000","last_peered":"2024-09-12T00:06:42.719592+0000","last_clean":"2024-09-12T00:06:42.719592+0000","last_became_active":"2024-09-12T00:03:31.358011+0000","last_became_peered":"2024-09-12T00:03:31.358011+0000","last_unstale":"2024-09-12T00:06:42.719592+0000","last_undegraded":"2024-09-12T00:06:42.719592+0000","last_fullsized":"2024-09-12T00:06:42.719592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:29.394163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"59'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720085+0000","last_change":"2024-09-12T00:06:28.364181+0000","last_active":"2024-09-12T00:06:42.720085+0000","last_peered":"2024-09-12T00:06:42.720085+0000","last_clean":"2024-09-12T00:06:42.720085+0000","last_became_active":"2024-09-12T00:06:26.667552+0000","last_became_peered":"2024-09-12T00:06:26.667552+0000","last_unstale":"2024-09-12T00:06:42.720085+0000","last_undegraded":"2024-09-12T00:06:42.720085+0000","last_fullsized":"2024-09-12T00:06:42.720085+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:19.435061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"96'23","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064267+0000","last_change":"2024-09-12T00:03:23.627584+0000","last_active":"2024-09-12T00:06:42.064267+0000","last_peered":"2024-09-12T00:06:42.064267+0000","last_clean":"2024-09-12T00:06:42.064267+0000","last_became_active":"2024-09-12T00:03:23.626026+0000","last_became_peered":"2024-09-12T00:03:23.626026+0000","last_unstale":"2024-09-12T00:06:42.064267+0000","last_undegraded":"2024-09-12T00:06:42.064267+0000","last_fullsized":"2024-09-12T00:06:42.064267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:38.192583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720246+0000","last_change":"2024-09-12T00:06:26.671971+0000","last_active":"2024-09-12T00:06:42.720246+0000","last_peered":"2024-09-12T00:06:42.720246+0000","last_clean":"2024-09-12T00:06:42.720246+0000","last_became_active":"2024-09-12T00:06:26.671427+0000","last_became_peered":"2024-09-12T00:06:26.671427+0000","last_unstale":"2024-09-12T00:06:42.720246+0000","last_undegraded":"2024-09-12T00:06:42.720246+0000","last_fullsized":"2024-09-12T00:06:42.720246+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:22.897492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"96'35","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720971+0000","last_change":"2024-09-12T00:03:29.340387+0000","last_active":"2024-09-12T00:06:42.720971+0000","last_peered":"2024-09-12T00:06:42.720971+0000","last_clean":"2024-09-12T00:06:42.720971+0000","last_became_active":"2024-09-12T00:03:29.339781+0000","last_became_peered":"2024-09-12T00:03:29.339781+0000","last_unstale":"2024-09-12T00:06:42.720971+0000","last_undegraded":"2024-09-12T00:06:42.720971+0000","last_fullsized":"2024-09-12T00:06:42.720971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:30.132716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811392+0000","last_change":"2024-09-12T00:03:31.350303+0000","last_active":"2024-09-12T00:06:41.811392+0000","last_peered":"2024-09-12T00:06:41.811392+0000","last_clean":"2024-09-12T00:06:41.811392+0000","last_became_active":"2024-09-12T00:03:31.349591+0000","last_became_peered":"2024-09-12T00:03:31.349591+0000","last_unstale":"2024-09-12T00:06:41.811392+0000","last_undegraded":"2024-09-12T00:06:41.811392+0000","last_fullsized":"2024-09-12T00:06:41.811392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:00.263644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"96'4","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065021+0000","last_change":"2024-09-12T00:03:33.385028+0000","last_active":"2024-09-12T00:06:42.065021+0000","last_peered":"2024-09-12T00:06:42.065021+0000","last_clean":"2024-09-12T00:06:42.065021+0000","last_became_active":"2024-09-12T00:03:33.384274+0000","last_became_peered":"2024-09-12T00:03:33.384274+0000","last_unstale":"2024-09-12T00:06:42.065021+0000","last_undegraded":"2024-09-12T00:06:42.065021+0000","last_fullsized":"2024-09-12T00:06:42.065021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:11.634604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"58'2","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813365+0000","last_change":"2024-09-12T00:03:25.329888+0000","last_active":"2024-09-12T00:06:41.813365+0000","last_peered":"2024-09-12T00:06:41.813365+0000","last_clean":"2024-09-12T00:06:41.813365+0000","last_became_active":"2024-09-12T00:03:25.329151+0000","last_became_peered":"2024-09-12T00:03:25.329151+0000","last_unstale":"2024-09-12T00:06:41.813365+0000","last_undegraded":"2024-09-12T00:06:41.813365+0000","last_fullsized":"2024-09-12T00:06:41.813365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:47.272383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"96'25","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811321+0000","last_change":"2024-09-12T00:03:23.600146+0000","last_active":"2024-09-12T00:06:41.811321+0000","last_peered":"2024-09-12T00:06:41.811321+0000","last_clean":"2024-09-12T00:06:41.811321+0000","last_became_active":"2024-09-12T00:03:23.598862+0000","last_became_peered":"2024-09-12T00:03:23.598862+0000","last_unstale":"2024-09-12T00:06:41.811321+0000","last_undegraded":"2024-09-12T00:06:41.811321+0000","last_fullsized":"2024-09-12T00:06:41.811321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:13.330852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813925+0000","last_change":"2024-09-12T00:03:27.341032+0000","last_active":"2024-09-12T00:06:41.813925+0000","last_peered":"2024-09-12T00:06:41.813925+0000","last_clean":"2024-09-12T00:06:41.813925+0000","last_became_active":"2024-09-12T00:03:27.340199+0000","last_became_peered":"2024-09-12T00:03:27.340199+0000","last_unstale":"2024-09-12T00:06:41.813925+0000","last_undegraded":"2024-09-12T00:06:41.813925+0000","last_fullsized":"2024-09-12T00:06:41.813925+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:23.673080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"96'24","reported_seq":57,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717487+0000","last_change":"2024-09-12T00:06:31.054703+0000","last_active":"2024-09-12T00:06:42.717487+0000","last_peered":"2024-09-12T00:06:42.717487+0000","last_clean":"2024-09-12T00:06:42.717487+0000","last_became_active":"2024-09-12T00:06:26.675513+0000","last_became_peered":"2024-09-12T00:06:26.675513+0000","last_unstale":"2024-09-12T00:06:42.717487+0000","last_undegraded":"2024-09-12T00:06:42.717487+0000","last_fullsized":"2024-09-12T00:06:42.717487+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:56.604086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065828+0000","last_change":"2024-09-12T00:06:26.678166+0000","last_active":"2024-09-12T00:06:42.065828+0000","last_peered":"2024-09-12T00:06:42.065828+0000","last_clean":"2024-09-12T00:06:42.065828+0000","last_became_active":"2024-09-12T00:06:26.677049+0000","last_became_peered":"2024-09-12T00:06:26.677049+0000","last_unstale":"2024-09-12T00:06:42.065828+0000","last_undegraded":"2024-09-12T00:06:42.065828+0000","last_fullsized":"2024-09-12T00:06:42.065828+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:26.729678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"59'3","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721092+0000","last_change":"2024-09-12T00:06:32.445889+0000","last_active":"2024-09-12T00:06:42.721092+0000","last_peered":"2024-09-12T00:06:42.721092+0000","last_clean":"2024-09-12T00:06:42.721092+0000","last_became_active":"2024-09-12T00:06:26.677859+0000","last_became_peered":"2024-09-12T00:06:26.677859+0000","last_unstale":"2024-09-12T00:06:42.721092+0000","last_undegraded":"2024-09-12T00:06:42.721092+0000","last_fullsized":"2024-09-12T00:06:42.721092+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:56.789846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"59'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722541+0000","last_change":"2024-09-12T00:03:25.360355+0000","last_active":"2024-09-12T00:06:42.722541+0000","last_peered":"2024-09-12T00:06:42.722541+0000","last_clean":"2024-09-12T00:06:42.722541+0000","last_became_active":"2024-09-12T00:03:25.359682+0000","last_became_peered":"2024-09-12T00:03:25.359682+0000","last_unstale":"2024-09-12T00:06:42.722541+0000","last_undegraded":"2024-09-12T00:06:42.722541+0000","last_fullsized":"2024-09-12T00:06:42.722541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:11.808081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"96'20","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500616+0000","last_change":"2024-09-12T00:03:23.621199+0000","last_active":"2024-09-12T00:06:42.500616+0000","last_peered":"2024-09-12T00:06:42.500616+0000","last_clean":"2024-09-12T00:06:42.500616+0000","last_became_active":"2024-09-12T00:03:23.620961+0000","last_became_peered":"2024-09-12T00:03:23.620961+0000","last_unstale":"2024-09-12T00:06:42.500616+0000","last_undegraded":"2024-09-12T00:06:42.500616+0000","last_fullsized":"2024-09-12T00:06:42.500616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811166+0000","last_change":"2024-09-12T00:03:27.336918+0000","last_active":"2024-09-12T00:06:41.811166+0000","last_peered":"2024-09-12T00:06:41.811166+0000","last_clean":"2024-09-12T00:06:41.811166+0000","last_became_active":"2024-09-12T00:03:27.336045+0000","last_became_peered":"2024-09-12T00:03:27.336045+0000","last_unstale":"2024-09-12T00:06:41.811166+0000","last_undegraded":"2024-09-12T00:06:41.811166+0000","last_fullsized":"2024-09-12T00:06:41.811166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"96'25","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720072+0000","last_change":"2024-09-12T00:03:29.338667+0000","last_active":"2024-09-12T00:06:42.720072+0000","last_peered":"2024-09-12T00:06:42.720072+0000","last_clean":"2024-09-12T00:06:42.720072+0000","last_became_active":"2024-09-12T00:03:29.338010+0000","last_became_peered":"2024-09-12T00:03:29.338010+0000","last_unstale":"2024-09-12T00:06:42.720072+0000","last_undegraded":"2024-09-12T00:06:42.720072+0000","last_fullsized":"2024-09-12T00:06:42.720072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:58.256619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722902+0000","last_change":"2024-09-12T00:03:31.352823+0000","last_active":"2024-09-12T00:06:42.722902+0000","last_peered":"2024-09-12T00:06:42.722902+0000","last_clean":"2024-09-12T00:06:42.722902+0000","last_became_active":"2024-09-12T00:03:31.352143+0000","last_became_peered":"2024-09-12T00:03:31.352143+0000","last_unstale":"2024-09-12T00:06:42.722902+0000","last_undegraded":"2024-09-12T00:06:42.722902+0000","last_fullsized":"2024-09-12T00:06:42.722902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:25.168692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"76'8","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721671+0000","last_change":"2024-09-12T00:06:27.901313+0000","last_active":"2024-09-12T00:06:42.721671+0000","last_peered":"2024-09-12T00:06:42.721671+0000","last_clean":"2024-09-12T00:06:42.721671+0000","last_became_active":"2024-09-12T00:06:26.658281+0000","last_became_peered":"2024-09-12T00:06:26.658281+0000","last_unstale":"2024-09-12T00:06:42.721671+0000","last_undegraded":"2024-09-12T00:06:42.721671+0000","last_fullsized":"2024-09-12T00:06:42.721671+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:54.959771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"58'2","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812806+0000","last_change":"2024-09-12T00:03:25.325094+0000","last_active":"2024-09-12T00:06:41.812806+0000","last_peered":"2024-09-12T00:06:41.812806+0000","last_clean":"2024-09-12T00:06:41.812806+0000","last_became_active":"2024-09-12T00:03:25.324315+0000","last_became_peered":"2024-09-12T00:03:25.324315+0000","last_unstale":"2024-09-12T00:06:41.812806+0000","last_undegraded":"2024-09-12T00:06:41.812806+0000","last_fullsized":"2024-09-12T00:06:41.812806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:18.727732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"96'27","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812410+0000","last_change":"2024-09-12T00:03:23.606163+0000","last_active":"2024-09-12T00:06:41.812410+0000","last_peered":"2024-09-12T00:06:41.812410+0000","last_clean":"2024-09-12T00:06:41.812410+0000","last_became_active":"2024-09-12T00:03:23.605402+0000","last_became_peered":"2024-09-12T00:03:23.605402+0000","last_unstale":"2024-09-12T00:06:41.812410+0000","last_undegraded":"2024-09-12T00:06:41.812410+0000","last_fullsized":"2024-09-12T00:06:41.812410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:02.432313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812917+0000","last_change":"2024-09-12T00:03:27.336716+0000","last_active":"2024-09-12T00:06:41.812917+0000","last_peered":"2024-09-12T00:06:41.812917+0000","last_clean":"2024-09-12T00:06:41.812917+0000","last_became_active":"2024-09-12T00:03:27.335658+0000","last_became_peered":"2024-09-12T00:03:27.335658+0000","last_unstale":"2024-09-12T00:06:41.812917+0000","last_undegraded":"2024-09-12T00:06:41.812917+0000","last_fullsized":"2024-09-12T00:06:41.812917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:47.355798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"35'16","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720503+0000","last_change":"2024-09-12T00:06:29.533440+0000","last_active":"2024-09-12T00:06:42.720503+0000","last_peered":"2024-09-12T00:06:42.720503+0000","last_clean":"2024-09-12T00:06:42.720503+0000","last_became_active":"2024-09-12T00:06:26.671893+0000","last_became_peered":"2024-09-12T00:06:26.671893+0000","last_unstale":"2024-09-12T00:06:42.720503+0000","last_undegraded":"2024-09-12T00:06:42.720503+0000","last_fullsized":"2024-09-12T00:06:42.720503+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:10.667822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"116'135","reported_seq":354,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.585763+0000","last_change":"2024-09-12T00:03:31.351362+0000","last_active":"2024-09-12T00:06:42.585763+0000","last_peered":"2024-09-12T00:06:42.585763+0000","last_clean":"2024-09-12T00:06:42.585763+0000","last_became_active":"2024-09-12T00:03:31.350925+0000","last_became_peered":"2024-09-12T00:03:31.350925+0000","last_unstale":"2024-09-12T00:06:42.585763+0000","last_undegraded":"2024-09-12T00:06:42.585763+0000","last_fullsized":"2024-09-12T00:06:42.585763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:03.147968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719766+0000","last_change":"2024-09-12T00:06:26.675599+0000","last_active":"2024-09-12T00:06:42.719766+0000","last_peered":"2024-09-12T00:06:42.719766+0000","last_clean":"2024-09-12T00:06:42.719766+0000","last_became_active":"2024-09-12T00:06:26.675234+0000","last_became_peered":"2024-09-12T00:06:26.675234+0000","last_unstale":"2024-09-12T00:06:42.719766+0000","last_undegraded":"2024-09-12T00:06:42.719766+0000","last_fullsized":"2024-09-12T00:06:42.719766+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:28.887412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"59'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812590+0000","last_change":"2024-09-12T00:03:25.357999+0000","last_active":"2024-09-12T00:06:41.812590+0000","last_peered":"2024-09-12T00:06:41.812590+0000","last_clean":"2024-09-12T00:06:41.812590+0000","last_became_active":"2024-09-12T00:03:25.357623+0000","last_became_peered":"2024-09-12T00:03:25.357623+0000","last_unstale":"2024-09-12T00:06:41.812590+0000","last_undegraded":"2024-09-12T00:06:41.812590+0000","last_fullsized":"2024-09-12T00:06:41.812590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"96'29","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500852+0000","last_change":"2024-09-12T00:03:23.605954+0000","last_active":"2024-09-12T00:06:42.500852+0000","last_peered":"2024-09-12T00:06:42.500852+0000","last_clean":"2024-09-12T00:06:42.500852+0000","last_became_active":"2024-09-12T00:03:23.604773+0000","last_became_peered":"2024-09-12T00:03:23.604773+0000","last_unstale":"2024-09-12T00:06:42.500852+0000","last_undegraded":"2024-09-12T00:06:42.500852+0000","last_fullsized":"2024-09-12T00:06:42.500852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500071+0000","last_change":"2024-09-12T00:03:27.346785+0000","last_active":"2024-09-12T00:06:42.500071+0000","last_peered":"2024-09-12T00:06:42.500071+0000","last_clean":"2024-09-12T00:06:42.500071+0000","last_became_active":"2024-09-12T00:03:27.346168+0000","last_became_peered":"2024-09-12T00:03:27.346168+0000","last_unstale":"2024-09-12T00:06:42.500071+0000","last_undegraded":"2024-09-12T00:06:42.500071+0000","last_fullsized":"2024-09-12T00:06:42.500071+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"96'49","reported_seq":267,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811988+0000","last_change":"2024-09-12T00:03:29.343942+0000","last_active":"2024-09-12T00:06:41.811988+0000","last_peered":"2024-09-12T00:06:41.811988+0000","last_clean":"2024-09-12T00:06:41.811988+0000","last_became_active":"2024-09-12T00:03:29.343238+0000","last_became_peered":"2024-09-12T00:03:29.343238+0000","last_unstale":"2024-09-12T00:06:41.811988+0000","last_undegraded":"2024-09-12T00:06:41.811988+0000","last_fullsized":"2024-09-12T00:06:41.811988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:30.949892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810193+0000","last_change":"2024-09-12T00:06:26.655176+0000","last_active":"2024-09-12T00:06:41.810193+0000","last_peered":"2024-09-12T00:06:41.810193+0000","last_clean":"2024-09-12T00:06:41.810193+0000","last_became_active":"2024-09-12T00:06:26.654187+0000","last_became_peered":"2024-09-12T00:06:26.654187+0000","last_unstale":"2024-09-12T00:06:41.810193+0000","last_undegraded":"2024-09-12T00:06:41.810193+0000","last_fullsized":"2024-09-12T00:06:41.810193+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:58.719162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501328+0000","last_change":"2024-09-12T00:03:33.363188+0000","last_active":"2024-09-12T00:06:42.501328+0000","last_peered":"2024-09-12T00:06:42.501328+0000","last_clean":"2024-09-12T00:06:42.501328+0000","last_became_active":"2024-09-12T00:03:33.360672+0000","last_became_peered":"2024-09-12T00:03:33.360672+0000","last_unstale":"2024-09-12T00:06:42.501328+0000","last_undegraded":"2024-09-12T00:06:42.501328+0000","last_fullsized":"2024-09-12T00:06:42.501328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:33.646117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"59'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811812+0000","last_change":"2024-09-12T00:03:25.336626+0000","last_active":"2024-09-12T00:06:41.811812+0000","last_peered":"2024-09-12T00:06:41.811812+0000","last_clean":"2024-09-12T00:06:41.811812+0000","last_became_active":"2024-09-12T00:03:25.336095+0000","last_became_peered":"2024-09-12T00:03:25.336095+0000","last_unstale":"2024-09-12T00:06:41.811812+0000","last_undegraded":"2024-09-12T00:06:41.811812+0000","last_fullsized":"2024-09-12T00:06:41.811812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"95'26","reported_seq":95,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720356+0000","last_change":"2024-09-12T00:06:32.976777+0000","last_active":"2024-09-12T00:06:42.720356+0000","last_peered":"2024-09-12T00:06:42.720356+0000","last_clean":"2024-09-12T00:06:42.720356+0000","last_became_active":"2024-09-12T00:06:26.678646+0000","last_became_peered":"2024-09-12T00:06:26.678646+0000","last_unstale":"2024-09-12T00:06:42.720356+0000","last_undegraded":"2024-09-12T00:06:42.720356+0000","last_fullsized":"2024-09-12T00:06:42.720356+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:02.624469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":192937984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812464+0000","last_change":"2024-09-12T00:03:27.326174+0000","last_active":"2024-09-12T00:06:41.812464+0000","last_peered":"2024-09-12T00:06:41.812464+0000","last_clean":"2024-09-12T00:06:41.812464+0000","last_became_active":"2024-09-12T00:03:27.325336+0000","last_became_peered":"2024-09-12T00:03:27.325336+0000","last_unstale":"2024-09-12T00:06:41.812464+0000","last_undegraded":"2024-09-12T00:06:41.812464+0000","last_fullsized":"2024-09-12T00:06:41.812464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:08.659813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"96'23","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810811+0000","last_change":"2024-09-12T00:03:29.335957+0000","last_active":"2024-09-12T00:06:41.810811+0000","last_peered":"2024-09-12T00:06:41.810811+0000","last_clean":"2024-09-12T00:06:41.810811+0000","last_became_active":"2024-09-12T00:03:29.335186+0000","last_became_peered":"2024-09-12T00:03:29.335186+0000","last_unstale":"2024-09-12T00:06:41.810811+0000","last_undegraded":"2024-09-12T00:06:41.810811+0000","last_fullsized":"2024-09-12T00:06:41.810811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:20.551758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721804+0000","last_change":"2024-09-12T00:06:26.671154+0000","last_active":"2024-09-12T00:06:42.721804+0000","last_peered":"2024-09-12T00:06:42.721804+0000","last_clean":"2024-09-12T00:06:42.721804+0000","last_became_active":"2024-09-12T00:06:26.667486+0000","last_became_peered":"2024-09-12T00:06:26.667486+0000","last_unstale":"2024-09-12T00:06:42.721804+0000","last_undegraded":"2024-09-12T00:06:42.721804+0000","last_fullsized":"2024-09-12T00:06:42.721804+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:31.291883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066037+0000","last_change":"2024-09-12T00:03:33.385037+0000","last_active":"2024-09-12T00:06:42.066037+0000","last_peered":"2024-09-12T00:06:42.066037+0000","last_clean":"2024-09-12T00:06:42.066037+0000","last_became_active":"2024-09-12T00:03:33.384379+0000","last_became_peered":"2024-09-12T00:03:33.384379+0000","last_unstale":"2024-09-12T00:06:42.066037+0000","last_undegraded":"2024-09-12T00:06:42.066037+0000","last_fullsized":"2024-09-12T00:06:42.066037+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:00.153475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"96'10","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718737+0000","last_change":"2024-09-12T00:03:25.339110+0000","last_active":"2024-09-12T00:06:42.718737+0000","last_peered":"2024-09-12T00:06:42.718737+0000","last_clean":"2024-09-12T00:06:42.718737+0000","last_became_active":"2024-09-12T00:03:25.338417+0000","last_became_peered":"2024-09-12T00:03:25.338417+0000","last_unstale":"2024-09-12T00:06:42.718737+0000","last_undegraded":"2024-09-12T00:06:42.718737+0000","last_fullsized":"2024-09-12T00:06:42.718737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:48.866021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"96'31","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067362+0000","last_change":"2024-09-12T00:03:23.625514+0000","last_active":"2024-09-12T00:06:42.067362+0000","last_peered":"2024-09-12T00:06:42.067362+0000","last_clean":"2024-09-12T00:06:42.067362+0000","last_became_active":"2024-09-12T00:03:23.621654+0000","last_became_peered":"2024-09-12T00:03:23.621654+0000","last_unstale":"2024-09-12T00:06:42.067362+0000","last_undegraded":"2024-09-12T00:06:42.067362+0000","last_fullsized":"2024-09-12T00:06:42.067362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:43.784497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500172+0000","last_change":"2024-09-12T00:03:27.330377+0000","last_active":"2024-09-12T00:06:42.500172+0000","last_peered":"2024-09-12T00:06:42.500172+0000","last_clean":"2024-09-12T00:06:42.500172+0000","last_became_active":"2024-09-12T00:03:27.329713+0000","last_became_peered":"2024-09-12T00:03:27.329713+0000","last_unstale":"2024-09-12T00:06:42.500172+0000","last_undegraded":"2024-09-12T00:06:42.500172+0000","last_fullsized":"2024-09-12T00:06:42.500172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"96'19","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721448+0000","last_change":"2024-09-12T00:03:29.337028+0000","last_active":"2024-09-12T00:06:42.721448+0000","last_peered":"2024-09-12T00:06:42.721448+0000","last_clean":"2024-09-12T00:06:42.721448+0000","last_became_active":"2024-09-12T00:03:29.335440+0000","last_became_peered":"2024-09-12T00:03:29.335440+0000","last_unstale":"2024-09-12T00:06:42.721448+0000","last_undegraded":"2024-09-12T00:06:42.721448+0000","last_fullsized":"2024-09-12T00:06:42.721448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:19.288395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721524+0000","last_change":"2024-09-12T00:06:26.674200+0000","last_active":"2024-09-12T00:06:42.721524+0000","last_peered":"2024-09-12T00:06:42.721524+0000","last_clean":"2024-09-12T00:06:42.721524+0000","last_became_active":"2024-09-12T00:06:26.660173+0000","last_became_peered":"2024-09-12T00:06:26.660173+0000","last_unstale":"2024-09-12T00:06:42.721524+0000","last_undegraded":"2024-09-12T00:06:42.721524+0000","last_fullsized":"2024-09-12T00:06:42.721524+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:56.674961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"58'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720918+0000","last_change":"2024-09-12T00:06:32.449370+0000","last_active":"2024-09-12T00:06:42.720918+0000","last_peered":"2024-09-12T00:06:42.720918+0000","last_clean":"2024-09-12T00:06:42.720918+0000","last_became_active":"2024-09-12T00:06:26.677210+0000","last_became_peered":"2024-09-12T00:06:26.677210+0000","last_unstale":"2024-09-12T00:06:42.720918+0000","last_undegraded":"2024-09-12T00:06:42.720918+0000","last_fullsized":"2024-09-12T00:06:42.720918+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:13.086869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"96'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810877+0000","last_change":"2024-09-12T00:03:25.337999+0000","last_active":"2024-09-12T00:06:41.810877+0000","last_peered":"2024-09-12T00:06:41.810877+0000","last_clean":"2024-09-12T00:06:41.810877+0000","last_became_active":"2024-09-12T00:03:25.337237+0000","last_became_peered":"2024-09-12T00:03:25.337237+0000","last_unstale":"2024-09-12T00:06:41.810877+0000","last_undegraded":"2024-09-12T00:06:41.810877+0000","last_fullsized":"2024-09-12T00:06:41.810877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"96'29","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067739+0000","last_change":"2024-09-12T00:03:23.631744+0000","last_active":"2024-09-12T00:06:42.067739+0000","last_peered":"2024-09-12T00:06:42.067739+0000","last_clean":"2024-09-12T00:06:42.067739+0000","last_became_active":"2024-09-12T00:03:23.630928+0000","last_became_peered":"2024-09-12T00:03:23.630928+0000","last_unstale":"2024-09-12T00:06:42.067739+0000","last_undegraded":"2024-09-12T00:06:42.067739+0000","last_fullsized":"2024-09-12T00:06:42.067739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:35.772832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810384+0000","last_change":"2024-09-12T00:06:26.683708+0000","last_active":"2024-09-12T00:06:41.810384+0000","last_peered":"2024-09-12T00:06:41.810384+0000","last_clean":"2024-09-12T00:06:41.810384+0000","last_became_active":"2024-09-12T00:06:26.651342+0000","last_became_peered":"2024-09-12T00:06:26.651342+0000","last_unstale":"2024-09-12T00:06:41.810384+0000","last_undegraded":"2024-09-12T00:06:41.810384+0000","last_fullsized":"2024-09-12T00:06:41.810384+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:06.251275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"96'29","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721214+0000","last_change":"2024-09-12T00:06:33.464772+0000","last_active":"2024-09-12T00:06:42.721214+0000","last_peered":"2024-09-12T00:06:42.721214+0000","last_clean":"2024-09-12T00:06:42.721214+0000","last_became_active":"2024-09-12T00:06:26.680856+0000","last_became_peered":"2024-09-12T00:06:26.680856+0000","last_unstale":"2024-09-12T00:06:42.721214+0000","last_undegraded":"2024-09-12T00:06:42.721214+0000","last_fullsized":"2024-09-12T00:06:42.721214+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:08.755659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":26,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811844+0000","last_change":"2024-09-12T00:03:31.355300+0000","last_active":"2024-09-12T00:06:41.811844+0000","last_peered":"2024-09-12T00:06:41.811844+0000","last_clean":"2024-09-12T00:06:41.811844+0000","last_became_active":"2024-09-12T00:03:31.354506+0000","last_became_peered":"2024-09-12T00:03:31.354506+0000","last_unstale":"2024-09-12T00:06:41.811844+0000","last_undegraded":"2024-09-12T00:06:41.811844+0000","last_fullsized":"2024-09-12T00:06:41.811844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:51.564710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"58'1","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815779+0000","last_change":"2024-09-12T00:03:33.384262+0000","last_active":"2024-09-12T00:06:41.815779+0000","last_peered":"2024-09-12T00:06:41.815779+0000","last_clean":"2024-09-12T00:06:41.815779+0000","last_became_active":"2024-09-12T00:03:33.383358+0000","last_became_peered":"2024-09-12T00:03:33.383358+0000","last_unstale":"2024-09-12T00:06:41.815779+0000","last_undegraded":"2024-09-12T00:06:41.815779+0000","last_fullsized":"2024-09-12T00:06:41.815779+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:45.060131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"84'4","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813832+0000","last_change":"2024-09-12T00:06:28.849788+0000","last_active":"2024-09-12T00:06:41.813832+0000","last_peered":"2024-09-12T00:06:41.813832+0000","last_clean":"2024-09-12T00:06:41.813832+0000","last_became_active":"2024-09-12T00:06:26.664077+0000","last_became_peered":"2024-09-12T00:06:26.664077+0000","last_unstale":"2024-09-12T00:06:41.813832+0000","last_undegraded":"2024-09-12T00:06:41.813832+0000","last_fullsized":"2024-09-12T00:06:41.813832+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:24.431791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"96'31","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811482+0000","last_change":"2024-09-12T00:03:23.617643+0000","last_active":"2024-09-12T00:06:41.811482+0000","last_peered":"2024-09-12T00:06:41.811482+0000","last_clean":"2024-09-12T00:06:41.811482+0000","last_became_active":"2024-09-12T00:03:23.617138+0000","last_became_peered":"2024-09-12T00:03:23.617138+0000","last_unstale":"2024-09-12T00:06:41.811482+0000","last_undegraded":"2024-09-12T00:06:41.811482+0000","last_fullsized":"2024-09-12T00:06:41.811482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127926272,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":124928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"59'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723414+0000","last_change":"2024-09-12T00:03:25.335650+0000","last_active":"2024-09-12T00:06:42.723414+0000","last_peered":"2024-09-12T00:06:42.723414+0000","last_clean":"2024-09-12T00:06:42.723414+0000","last_became_active":"2024-09-12T00:03:25.334965+0000","last_became_peered":"2024-09-12T00:03:25.334965+0000","last_unstale":"2024-09-12T00:06:42.723414+0000","last_undegraded":"2024-09-12T00:06:42.723414+0000","last_fullsized":"2024-09-12T00:06:42.723414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:13.501672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"96'26","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718679+0000","last_change":"2024-09-12T00:03:23.618651+0000","last_active":"2024-09-12T00:06:42.718679+0000","last_peered":"2024-09-12T00:06:42.718679+0000","last_clean":"2024-09-12T00:06:42.718679+0000","last_became_active":"2024-09-12T00:03:23.612542+0000","last_became_peered":"2024-09-12T00:03:23.612542+0000","last_unstale":"2024-09-12T00:06:42.718679+0000","last_undegraded":"2024-09-12T00:06:42.718679+0000","last_fullsized":"2024-09-12T00:06:42.718679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"96'4","reported_seq":47,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717901+0000","last_change":"2024-09-12T00:06:32.454921+0000","last_active":"2024-09-12T00:06:42.717901+0000","last_peered":"2024-09-12T00:06:42.717901+0000","last_clean":"2024-09-12T00:06:42.717901+0000","last_became_active":"2024-09-12T00:06:26.677698+0000","last_became_peered":"2024-09-12T00:06:26.677698+0000","last_unstale":"2024-09-12T00:06:42.717901+0000","last_undegraded":"2024-09-12T00:06:42.717901+0000","last_fullsized":"2024-09-12T00:06:42.717901+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:31.889100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"96'30","reported_seq":103,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721342+0000","last_change":"2024-09-12T00:06:30.842710+0000","last_active":"2024-09-12T00:06:42.721342+0000","last_peered":"2024-09-12T00:06:42.721342+0000","last_clean":"2024-09-12T00:06:42.721342+0000","last_became_active":"2024-09-12T00:06:26.666582+0000","last_became_peered":"2024-09-12T00:06:26.666582+0000","last_unstale":"2024-09-12T00:06:42.721342+0000","last_undegraded":"2024-09-12T00:06:42.721342+0000","last_fullsized":"2024-09-12T00:06:42.721342+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:15.209092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":201326592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"63'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066906+0000","last_change":"2024-09-12T00:03:25.354015+0000","last_active":"2024-09-12T00:06:42.066906+0000","last_peered":"2024-09-12T00:06:42.066906+0000","last_clean":"2024-09-12T00:06:42.066906+0000","last_became_active":"2024-09-12T00:03:25.352319+0000","last_became_peered":"2024-09-12T00:03:25.352319+0000","last_unstale":"2024-09-12T00:06:42.066906+0000","last_undegraded":"2024-09-12T00:06:42.066906+0000","last_fullsized":"2024-09-12T00:06:42.066906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:08.033834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"96'17","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066879+0000","last_change":"2024-09-12T00:03:23.633614+0000","last_active":"2024-09-12T00:06:42.066879+0000","last_peered":"2024-09-12T00:06:42.066879+0000","last_clean":"2024-09-12T00:06:42.066879+0000","last_became_active":"2024-09-12T00:03:23.632850+0000","last_became_peered":"2024-09-12T00:03:23.632850+0000","last_unstale":"2024-09-12T00:06:42.066879+0000","last_undegraded":"2024-09-12T00:06:42.066879+0000","last_fullsized":"2024-09-12T00:06:42.066879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065662+0000","last_change":"2024-09-12T00:03:25.357453+0000","last_active":"2024-09-12T00:06:42.065662+0000","last_peered":"2024-09-12T00:06:42.065662+0000","last_clean":"2024-09-12T00:06:42.065662+0000","last_became_active":"2024-09-12T00:03:25.353815+0000","last_became_peered":"2024-09-12T00:03:25.353815+0000","last_unstale":"2024-09-12T00:06:42.065662+0000","last_undegraded":"2024-09-12T00:06:42.065662+0000","last_fullsized":"2024-09-12T00:06:42.065662+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:27.562174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"96'22","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721565+0000","last_change":"2024-09-12T00:03:23.609055+0000","last_active":"2024-09-12T00:06:42.721565+0000","last_peered":"2024-09-12T00:06:42.721565+0000","last_clean":"2024-09-12T00:06:42.721565+0000","last_became_active":"2024-09-12T00:03:23.608101+0000","last_became_peered":"2024-09-12T00:03:23.608101+0000","last_unstale":"2024-09-12T00:06:42.721565+0000","last_undegraded":"2024-09-12T00:06:42.721565+0000","last_fullsized":"2024-09-12T00:06:42.721565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"96'10","reported_seq":268,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814861+0000","last_change":"2024-09-12T00:06:28.290549+0000","last_active":"2024-09-12T00:06:41.814861+0000","last_peered":"2024-09-12T00:06:41.814861+0000","last_clean":"2024-09-12T00:06:41.814861+0000","last_became_active":"2024-09-12T00:06:26.681882+0000","last_became_peered":"2024-09-12T00:06:26.681882+0000","last_unstale":"2024-09-12T00:06:41.814861+0000","last_undegraded":"2024-09-12T00:06:41.814861+0000","last_fullsized":"2024-09-12T00:06:41.814861+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:12.272800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"96'26","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721650+0000","last_change":"2024-09-12T00:03:23.616706+0000","last_active":"2024-09-12T00:06:42.721650+0000","last_peered":"2024-09-12T00:06:42.721650+0000","last_clean":"2024-09-12T00:06:42.721650+0000","last_became_active":"2024-09-12T00:03:23.615970+0000","last_became_peered":"2024-09-12T00:03:23.615970+0000","last_unstale":"2024-09-12T00:06:42.721650+0000","last_undegraded":"2024-09-12T00:06:42.721650+0000","last_fullsized":"2024-09-12T00:06:42.721650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"63'8","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720621+0000","last_change":"2024-09-12T00:03:25.343716+0000","last_active":"2024-09-12T00:06:42.720621+0000","last_peered":"2024-09-12T00:06:42.720621+0000","last_clean":"2024-09-12T00:06:42.720621+0000","last_became_active":"2024-09-12T00:03:25.342930+0000","last_became_peered":"2024-09-12T00:03:25.342930+0000","last_unstale":"2024-09-12T00:06:42.720621+0000","last_undegraded":"2024-09-12T00:06:42.720621+0000","last_fullsized":"2024-09-12T00:06:42.720621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"95'25","reported_seq":321,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814202+0000","last_change":"2024-09-12T00:06:29.602896+0000","last_active":"2024-09-12T00:06:41.814202+0000","last_peered":"2024-09-12T00:06:41.814202+0000","last_clean":"2024-09-12T00:06:41.814202+0000","last_became_active":"2024-09-12T00:06:26.672080+0000","last_became_peered":"2024-09-12T00:06:26.672080+0000","last_unstale":"2024-09-12T00:06:41.814202+0000","last_undegraded":"2024-09-12T00:06:41.814202+0000","last_fullsized":"2024-09-12T00:06:41.814202+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:47.695274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"96'10","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499716+0000","last_change":"2024-09-12T00:03:25.326620+0000","last_active":"2024-09-12T00:06:42.499716+0000","last_peered":"2024-09-12T00:06:42.499716+0000","last_clean":"2024-09-12T00:06:42.499716+0000","last_became_active":"2024-09-12T00:03:25.326262+0000","last_became_peered":"2024-09-12T00:03:25.326262+0000","last_unstale":"2024-09-12T00:06:42.499716+0000","last_undegraded":"2024-09-12T00:06:42.499716+0000","last_fullsized":"2024-09-12T00:06:42.499716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"96'16","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067549+0000","last_change":"2024-09-12T00:03:23.632200+0000","last_active":"2024-09-12T00:06:42.067549+0000","last_peered":"2024-09-12T00:06:42.067549+0000","last_clean":"2024-09-12T00:06:42.067549+0000","last_became_active":"2024-09-12T00:03:23.631510+0000","last_became_peered":"2024-09-12T00:03:23.631510+0000","last_unstale":"2024-09-12T00:06:42.067549+0000","last_undegraded":"2024-09-12T00:06:42.067549+0000","last_fullsized":"2024-09-12T00:06:42.067549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:07.177242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"58'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.724304+0000","last_change":"2024-09-12T00:03:25.342763+0000","last_active":"2024-09-12T00:06:42.724304+0000","last_peered":"2024-09-12T00:06:42.724304+0000","last_clean":"2024-09-12T00:06:42.724304+0000","last_became_active":"2024-09-12T00:03:25.337834+0000","last_became_peered":"2024-09-12T00:03:25.337834+0000","last_unstale":"2024-09-12T00:06:42.724304+0000","last_undegraded":"2024-09-12T00:06:42.724304+0000","last_fullsized":"2024-09-12T00:06:42.724304+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:35.920599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"95'16","reported_seq":75,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717915+0000","last_change":"2024-09-12T00:06:28.323950+0000","last_active":"2024-09-12T00:06:42.717915+0000","last_peered":"2024-09-12T00:06:42.717915+0000","last_clean":"2024-09-12T00:06:42.717915+0000","last_became_active":"2024-09-12T00:06:26.666889+0000","last_became_peered":"2024-09-12T00:06:26.666889+0000","last_unstale":"2024-09-12T00:06:42.717915+0000","last_undegraded":"2024-09-12T00:06:42.717915+0000","last_fullsized":"2024-09-12T00:06:42.717915+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:12.167901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816185+0000","last_change":"2024-09-12T00:03:25.339910+0000","last_active":"2024-09-12T00:06:41.816185+0000","last_peered":"2024-09-12T00:06:41.816185+0000","last_clean":"2024-09-12T00:06:41.816185+0000","last_became_active":"2024-09-12T00:03:25.336511+0000","last_became_peered":"2024-09-12T00:03:25.336511+0000","last_unstale":"2024-09-12T00:06:41.816185+0000","last_undegraded":"2024-09-12T00:06:41.816185+0000","last_fullsized":"2024-09-12T00:06:41.816185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:30.647474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"96'28","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065464+0000","last_change":"2024-09-12T00:03:23.626232+0000","last_active":"2024-09-12T00:06:42.065464+0000","last_peered":"2024-09-12T00:06:42.065464+0000","last_clean":"2024-09-12T00:06:42.065464+0000","last_became_active":"2024-09-12T00:03:23.621761+0000","last_became_peered":"2024-09-12T00:03:23.621761+0000","last_unstale":"2024-09-12T00:06:42.065464+0000","last_undegraded":"2024-09-12T00:06:42.065464+0000","last_fullsized":"2024-09-12T00:06:42.065464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:31.587668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"59'4","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066619+0000","last_change":"2024-09-12T00:06:28.859921+0000","last_active":"2024-09-12T00:06:42.066619+0000","last_peered":"2024-09-12T00:06:42.066619+0000","last_clean":"2024-09-12T00:06:42.066619+0000","last_became_active":"2024-09-12T00:06:26.677331+0000","last_became_peered":"2024-09-12T00:06:26.677331+0000","last_unstale":"2024-09-12T00:06:42.066619+0000","last_undegraded":"2024-09-12T00:06:42.066619+0000","last_fullsized":"2024-09-12T00:06:42.066619+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:05.062779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"96'24","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500399+0000","last_change":"2024-09-12T00:03:23.600956+0000","last_active":"2024-09-12T00:06:42.500399+0000","last_peered":"2024-09-12T00:06:42.500399+0000","last_clean":"2024-09-12T00:06:42.500399+0000","last_became_active":"2024-09-12T00:03:23.600673+0000","last_became_peered":"2024-09-12T00:03:23.600673+0000","last_unstale":"2024-09-12T00:06:42.500399+0000","last_undegraded":"2024-09-12T00:06:42.500399+0000","last_fullsized":"2024-09-12T00:06:42.500399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"96'6","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500670+0000","last_change":"2024-09-12T00:03:25.325088+0000","last_active":"2024-09-12T00:06:42.500670+0000","last_peered":"2024-09-12T00:06:42.500670+0000","last_clean":"2024-09-12T00:06:42.500670+0000","last_became_active":"2024-09-12T00:03:25.324597+0000","last_became_peered":"2024-09-12T00:03:25.324597+0000","last_unstale":"2024-09-12T00:06:42.500670+0000","last_undegraded":"2024-09-12T00:06:42.500670+0000","last_fullsized":"2024-09-12T00:06:42.500670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"95'19","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812155+0000","last_change":"2024-09-12T00:03:23.621791+0000","last_active":"2024-09-12T00:06:41.812155+0000","last_peered":"2024-09-12T00:06:41.812155+0000","last_clean":"2024-09-12T00:06:41.812155+0000","last_became_active":"2024-09-12T00:03:23.621063+0000","last_became_peered":"2024-09-12T00:03:23.621063+0000","last_unstale":"2024-09-12T00:06:41.812155+0000","last_undegraded":"2024-09-12T00:06:41.812155+0000","last_fullsized":"2024-09-12T00:06:41.812155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:33.234598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77594624,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":75776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500368+0000","last_change":"2024-09-12T00:03:25.357605+0000","last_active":"2024-09-12T00:06:42.500368+0000","last_peered":"2024-09-12T00:06:42.500368+0000","last_clean":"2024-09-12T00:06:42.500368+0000","last_became_active":"2024-09-12T00:03:25.357286+0000","last_became_peered":"2024-09-12T00:03:25.357286+0000","last_unstale":"2024-09-12T00:06:42.500368+0000","last_undegraded":"2024-09-12T00:06:42.500368+0000","last_fullsized":"2024-09-12T00:06:42.500368+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"96'21","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815686+0000","last_change":"2024-09-12T00:03:23.600931+0000","last_active":"2024-09-12T00:06:41.815686+0000","last_peered":"2024-09-12T00:06:41.815686+0000","last_clean":"2024-09-12T00:06:41.815686+0000","last_became_active":"2024-09-12T00:03:23.600591+0000","last_became_peered":"2024-09-12T00:03:23.600591+0000","last_unstale":"2024-09-12T00:06:41.815686+0000","last_undegraded":"2024-09-12T00:06:41.815686+0000","last_fullsized":"2024-09-12T00:06:41.815686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"84'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719420+0000","last_change":"2024-09-12T00:03:25.330869+0000","last_active":"2024-09-12T00:06:42.719420+0000","last_peered":"2024-09-12T00:06:42.719420+0000","last_clean":"2024-09-12T00:06:42.719420+0000","last_became_active":"2024-09-12T00:03:25.329742+0000","last_became_peered":"2024-09-12T00:03:25.329742+0000","last_unstale":"2024-09-12T00:06:42.719420+0000","last_undegraded":"2024-09-12T00:06:42.719420+0000","last_fullsized":"2024-09-12T00:06:42.719420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:01.365985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"95'32","reported_seq":105,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720260+0000","last_change":"2024-09-12T00:06:31.824748+0000","last_active":"2024-09-12T00:06:42.720260+0000","last_peered":"2024-09-12T00:06:42.720260+0000","last_clean":"2024-09-12T00:06:42.720260+0000","last_became_active":"2024-09-12T00:06:26.668022+0000","last_became_peered":"2024-09-12T00:06:26.668022+0000","last_unstale":"2024-09-12T00:06:42.720260+0000","last_undegraded":"2024-09-12T00:06:42.720260+0000","last_fullsized":"2024-09-12T00:06:42.720260+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:57.178468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":40,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":222298112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"59'4","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811470+0000","last_change":"2024-09-12T00:03:25.347570+0000","last_active":"2024-09-12T00:06:41.811470+0000","last_peered":"2024-09-12T00:06:41.811470+0000","last_clean":"2024-09-12T00:06:41.811470+0000","last_became_active":"2024-09-12T00:03:25.346874+0000","last_became_peered":"2024-09-12T00:03:25.346874+0000","last_unstale":"2024-09-12T00:06:41.811470+0000","last_undegraded":"2024-09-12T00:06:41.811470+0000","last_fullsized":"2024-09-12T00:06:41.811470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"96'23","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723730+0000","last_change":"2024-09-12T00:03:23.623417+0000","last_active":"2024-09-12T00:06:42.723730+0000","last_peered":"2024-09-12T00:06:42.723730+0000","last_clean":"2024-09-12T00:06:42.723730+0000","last_became_active":"2024-09-12T00:03:23.620261+0000","last_became_peered":"2024-09-12T00:03:23.620261+0000","last_unstale":"2024-09-12T00:06:42.723730+0000","last_undegraded":"2024-09-12T00:06:42.723730+0000","last_fullsized":"2024-09-12T00:06:42.723730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"63'8","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499989+0000","last_change":"2024-09-12T00:03:25.357492+0000","last_active":"2024-09-12T00:06:42.499989+0000","last_peered":"2024-09-12T00:06:42.499989+0000","last_clean":"2024-09-12T00:06:42.499989+0000","last_became_active":"2024-09-12T00:03:25.357186+0000","last_became_peered":"2024-09-12T00:03:25.357186+0000","last_unstale":"2024-09-12T00:06:42.499989+0000","last_undegraded":"2024-09-12T00:06:42.499989+0000","last_fullsized":"2024-09-12T00:06:42.499989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"96'26","reported_seq":95,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719726+0000","last_change":"2024-09-12T00:06:34.105256+0000","last_active":"2024-09-12T00:06:42.719726+0000","last_peered":"2024-09-12T00:06:42.719726+0000","last_clean":"2024-09-12T00:06:42.719726+0000","last_became_active":"2024-09-12T00:06:26.677360+0000","last_became_peered":"2024-09-12T00:06:26.677360+0000","last_unstale":"2024-09-12T00:06:42.719726+0000","last_undegraded":"2024-09-12T00:06:42.719726+0000","last_fullsized":"2024-09-12T00:06:42.719726+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:18.563619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":163577856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"96'27","reported_seq":97,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717277+0000","last_change":"2024-09-12T00:06:28.886144+0000","last_active":"2024-09-12T00:06:42.717277+0000","last_peered":"2024-09-12T00:06:42.717277+0000","last_clean":"2024-09-12T00:06:42.717277+0000","last_became_active":"2024-09-12T00:06:26.669830+0000","last_became_peered":"2024-09-12T00:06:26.669830+0000","last_unstale":"2024-09-12T00:06:42.717277+0000","last_undegraded":"2024-09-12T00:06:42.717277+0000","last_fullsized":"2024-09-12T00:06:42.717277+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:37.229011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":192937984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"84'6","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813636+0000","last_change":"2024-09-12T00:03:25.350116+0000","last_active":"2024-09-12T00:06:41.813636+0000","last_peered":"2024-09-12T00:06:41.813636+0000","last_clean":"2024-09-12T00:06:41.813636+0000","last_became_active":"2024-09-12T00:03:25.349281+0000","last_became_peered":"2024-09-12T00:03:25.349281+0000","last_unstale":"2024-09-12T00:06:41.813636+0000","last_undegraded":"2024-09-12T00:06:41.813636+0000","last_fullsized":"2024-09-12T00:06:41.813636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:33.350458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"96'20","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065234+0000","last_change":"2024-09-12T00:03:23.619574+0000","last_active":"2024-09-12T00:06:42.065234+0000","last_peered":"2024-09-12T00:06:42.065234+0000","last_clean":"2024-09-12T00:06:42.065234+0000","last_became_active":"2024-09-12T00:03:23.616154+0000","last_became_peered":"2024-09-12T00:03:23.616154+0000","last_unstale":"2024-09-12T00:06:42.065234+0000","last_undegraded":"2024-09-12T00:06:42.065234+0000","last_fullsized":"2024-09-12T00:06:42.065234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:46.335775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"58'2","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.502147+0000","last_change":"2024-09-12T00:03:25.345327+0000","last_active":"2024-09-12T00:06:42.502147+0000","last_peered":"2024-09-12T00:06:42.502147+0000","last_clean":"2024-09-12T00:06:42.502147+0000","last_became_active":"2024-09-12T00:03:25.344917+0000","last_became_peered":"2024-09-12T00:03:25.344917+0000","last_unstale":"2024-09-12T00:06:42.502147+0000","last_undegraded":"2024-09-12T00:06:42.502147+0000","last_fullsized":"2024-09-12T00:06:42.502147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":339,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1085,"ondisk_log_size":1085,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382934,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1135,"num_read_kb":865,"num_write":659,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":117531,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":953,"ondisk_log_size":953,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1444,"num_read_kb":1412,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1584,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":721,"num_bytes_recovered":3007315968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542197,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1111992,"kb_used_data":1080808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93259848,"statfs":{"total":96636764160,"available":95498084352,"internally_reserved":0,"allocated":1106747392,"data_stored":1106113870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542197,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1329084,"kb_used_data":1297892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93042756,"statfs":{"total":96636764160,"available":95275782144,"internally_reserved":0,"allocated":1329041408,"data_stored":1328412810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542197,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1794496,"kb_used_data":1759152,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92577344,"statfs":{"total":96636764160,"available":94799200256,"internally_reserved":0,"allocated":1801371648,"data_stored":1800744781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542197,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1329264,"kb_used_data":1293920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93042576,"statfs":{"total":96636764160,"available":95275597824,"internally_reserved":0,"allocated":1324974080,"data_stored":1324334685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542197,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1830964,"kb_used_data":1791448,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":92540876,"statfs":{"total":96636764160,"available":94761857024,"internally_reserved":0,"allocated":1834442752,"data_stored":1833824839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542198,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1806124,"kb_used_data":1774932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92565716,"statfs":{"total":96636764160,"available":94787293184,"internally_reserved":0,"allocated":1817530368,"data_stored":1816930588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542197,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1305176,"kb_used_data":1269832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93066664,"statfs":{"total":96636764160,"available":95300263936,"internally_reserved":0,"allocated":1300307968,"data_stored":1299644748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542196,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2084760,"kb_used_data":2049416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92287080,"statfs":{"total":96636764160,"available":94501969920,"internally_reserved":0,"allocated":2098601984,"data_stored":2097950685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2097152000,"data_stored":2097152000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1298137088,"data_stored":1298137088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1816133632,"data_stored":1816133632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1832910848,"data_stored":1832910848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1323302912,"data_stored":1323302912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1799356416,"data_stored":1799356416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1327497216,"data_stored":1327497216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1105199104,"data_stored":1105199104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":119156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":117311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":235112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":117531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":117713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:07:12.525 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:07:12.888 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:07:12.895 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T00:07:12.907 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":231,"stamp":"2024-09-12T00:07:12.477540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300819945,"num_objects":1736,"num_object_clones":0,"num_object_copies":3472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1736,"num_whiteouts":0,"num_read":3480,"num_read_kb":3139,"num_write":2967,"num_write_kb":6187128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":928,"num_bytes_recovered":3007433610,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4057,"ondisk_log_size":4057,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12591860,"kb_used_data":12317400,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":742382860,"statfs":{"total":773094113280,"available":760200048640,"internally_reserved":0,"allocated":12613017600,"data_stored":12607957006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":280874546},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006723"},"pg_stats":[{"pgid":"3.3f","version":"95'16","reported_seq":286,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.817134+0000","last_change":"2024-09-12T00:06:27.539898+0000","last_active":"2024-09-12T00:06:41.817134+0000","last_peered":"2024-09-12T00:06:41.817134+0000","last_clean":"2024-09-12T00:06:41.817134+0000","last_became_active":"2024-09-12T00:06:26.678792+0000","last_became_peered":"2024-09-12T00:06:26.678792+0000","last_unstale":"2024-09-12T00:06:41.817134+0000","last_undegraded":"2024-09-12T00:06:41.817134+0000","last_fullsized":"2024-09-12T00:06:41.817134+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:23.434133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'2","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499351+0000","last_change":"2024-09-12T00:03:25.337244+0000","last_active":"2024-09-12T00:06:42.499351+0000","last_peered":"2024-09-12T00:06:42.499351+0000","last_clean":"2024-09-12T00:06:42.499351+0000","last_became_active":"2024-09-12T00:03:25.335964+0000","last_became_peered":"2024-09-12T00:03:25.335964+0000","last_unstale":"2024-09-12T00:06:42.499351+0000","last_undegraded":"2024-09-12T00:06:42.499351+0000","last_fullsized":"2024-09-12T00:06:42.499351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"96'24","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067343+0000","last_change":"2024-09-12T00:03:23.628328+0000","last_active":"2024-09-12T00:06:42.067343+0000","last_peered":"2024-09-12T00:06:42.067343+0000","last_clean":"2024-09-12T00:06:42.067343+0000","last_became_active":"2024-09-12T00:03:23.627630+0000","last_became_peered":"2024-09-12T00:03:23.627630+0000","last_unstale":"2024-09-12T00:06:42.067343+0000","last_undegraded":"2024-09-12T00:06:42.067343+0000","last_fullsized":"2024-09-12T00:06:42.067343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:00.573006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"76'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717726+0000","last_change":"2024-09-12T00:06:27.903337+0000","last_active":"2024-09-12T00:06:42.717726+0000","last_peered":"2024-09-12T00:06:42.717726+0000","last_clean":"2024-09-12T00:06:42.717726+0000","last_became_active":"2024-09-12T00:06:26.660419+0000","last_became_peered":"2024-09-12T00:06:26.660419+0000","last_unstale":"2024-09-12T00:06:42.717726+0000","last_undegraded":"2024-09-12T00:06:42.717726+0000","last_fullsized":"2024-09-12T00:06:42.717726+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:43.714019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"96'29","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066706+0000","last_change":"2024-09-12T00:03:23.626533+0000","last_active":"2024-09-12T00:06:42.066706+0000","last_peered":"2024-09-12T00:06:42.066706+0000","last_clean":"2024-09-12T00:06:42.066706+0000","last_became_active":"2024-09-12T00:03:23.625728+0000","last_became_peered":"2024-09-12T00:03:23.625728+0000","last_unstale":"2024-09-12T00:06:42.066706+0000","last_undegraded":"2024-09-12T00:06:42.066706+0000","last_fullsized":"2024-09-12T00:06:42.066706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:31.772442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"96'4","reported_seq":47,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721615+0000","last_change":"2024-09-12T00:06:32.442375+0000","last_active":"2024-09-12T00:06:42.721615+0000","last_peered":"2024-09-12T00:06:42.721615+0000","last_clean":"2024-09-12T00:06:42.721615+0000","last_became_active":"2024-09-12T00:06:26.677271+0000","last_became_peered":"2024-09-12T00:06:26.677271+0000","last_unstale":"2024-09-12T00:06:42.721615+0000","last_undegraded":"2024-09-12T00:06:42.721615+0000","last_fullsized":"2024-09-12T00:06:42.721615+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:34.385926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"96'22","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812538+0000","last_change":"2024-09-12T00:03:23.609828+0000","last_active":"2024-09-12T00:06:41.812538+0000","last_peered":"2024-09-12T00:06:41.812538+0000","last_clean":"2024-09-12T00:06:41.812538+0000","last_became_active":"2024-09-12T00:03:23.609326+0000","last_became_peered":"2024-09-12T00:03:23.609326+0000","last_unstale":"2024-09-12T00:06:41.812538+0000","last_undegraded":"2024-09-12T00:06:41.812538+0000","last_fullsized":"2024-09-12T00:06:41.812538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:25.491620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'8","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812256+0000","last_change":"2024-09-12T00:03:25.339518+0000","last_active":"2024-09-12T00:06:41.812256+0000","last_peered":"2024-09-12T00:06:41.812256+0000","last_clean":"2024-09-12T00:06:41.812256+0000","last_became_active":"2024-09-12T00:03:25.338805+0000","last_became_peered":"2024-09-12T00:03:25.338805+0000","last_unstale":"2024-09-12T00:06:41.812256+0000","last_undegraded":"2024-09-12T00:06:41.812256+0000","last_fullsized":"2024-09-12T00:06:41.812256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"96'26","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810071+0000","last_change":"2024-09-12T00:03:23.633978+0000","last_active":"2024-09-12T00:06:41.810071+0000","last_peered":"2024-09-12T00:06:41.810071+0000","last_clean":"2024-09-12T00:06:41.810071+0000","last_became_active":"2024-09-12T00:03:23.633580+0000","last_became_peered":"2024-09-12T00:03:23.633580+0000","last_unstale":"2024-09-12T00:06:41.810071+0000","last_undegraded":"2024-09-12T00:06:41.810071+0000","last_fullsized":"2024-09-12T00:06:41.810071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:01.872688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809540+0000","last_change":"2024-09-12T00:03:25.324424+0000","last_active":"2024-09-12T00:06:41.809540+0000","last_peered":"2024-09-12T00:06:41.809540+0000","last_clean":"2024-09-12T00:06:41.809540+0000","last_became_active":"2024-09-12T00:03:25.324138+0000","last_became_peered":"2024-09-12T00:03:25.324138+0000","last_unstale":"2024-09-12T00:06:41.809540+0000","last_undegraded":"2024-09-12T00:06:41.809540+0000","last_fullsized":"2024-09-12T00:06:41.809540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:09.954252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"96'21","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812953+0000","last_change":"2024-09-12T00:03:23.610136+0000","last_active":"2024-09-12T00:06:41.812953+0000","last_peered":"2024-09-12T00:06:41.812953+0000","last_clean":"2024-09-12T00:06:41.812953+0000","last_became_active":"2024-09-12T00:03:23.609509+0000","last_became_peered":"2024-09-12T00:03:23.609509+0000","last_unstale":"2024-09-12T00:06:41.812953+0000","last_undegraded":"2024-09-12T00:06:41.812953+0000","last_fullsized":"2024-09-12T00:06:41.812953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"96'12","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.817127+0000","last_change":"2024-09-12T00:03:25.355256+0000","last_active":"2024-09-12T00:06:41.817127+0000","last_peered":"2024-09-12T00:06:41.817127+0000","last_clean":"2024-09-12T00:06:41.817127+0000","last_became_active":"2024-09-12T00:03:25.355002+0000","last_became_peered":"2024-09-12T00:03:25.355002+0000","last_unstale":"2024-09-12T00:06:41.817127+0000","last_undegraded":"2024-09-12T00:06:41.817127+0000","last_fullsized":"2024-09-12T00:06:41.817127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:50.488869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"96'28","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813544+0000","last_change":"2024-09-12T00:03:23.606780+0000","last_active":"2024-09-12T00:06:41.813544+0000","last_peered":"2024-09-12T00:06:41.813544+0000","last_clean":"2024-09-12T00:06:41.813544+0000","last_became_active":"2024-09-12T00:03:23.606143+0000","last_became_peered":"2024-09-12T00:03:23.606143+0000","last_unstale":"2024-09-12T00:06:41.813544+0000","last_undegraded":"2024-09-12T00:06:41.813544+0000","last_fullsized":"2024-09-12T00:06:41.813544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:22.889982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813590+0000","last_change":"2024-09-12T00:03:25.330195+0000","last_active":"2024-09-12T00:06:41.813590+0000","last_peered":"2024-09-12T00:06:41.813590+0000","last_clean":"2024-09-12T00:06:41.813590+0000","last_became_active":"2024-09-12T00:03:25.329625+0000","last_became_peered":"2024-09-12T00:03:25.329625+0000","last_unstale":"2024-09-12T00:06:41.813590+0000","last_undegraded":"2024-09-12T00:06:41.813590+0000","last_fullsized":"2024-09-12T00:06:41.813590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"96'27","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064982+0000","last_change":"2024-09-12T00:03:23.626723+0000","last_active":"2024-09-12T00:06:42.064982+0000","last_peered":"2024-09-12T00:06:42.064982+0000","last_clean":"2024-09-12T00:06:42.064982+0000","last_became_active":"2024-09-12T00:03:23.626018+0000","last_became_peered":"2024-09-12T00:03:23.626018+0000","last_unstale":"2024-09-12T00:06:42.064982+0000","last_undegraded":"2024-09-12T00:06:42.064982+0000","last_fullsized":"2024-09-12T00:06:42.064982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"59'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067823+0000","last_change":"2024-09-12T00:03:25.352418+0000","last_active":"2024-09-12T00:06:42.067823+0000","last_peered":"2024-09-12T00:06:42.067823+0000","last_clean":"2024-09-12T00:06:42.067823+0000","last_became_active":"2024-09-12T00:03:25.347902+0000","last_became_peered":"2024-09-12T00:03:25.347902+0000","last_unstale":"2024-09-12T00:06:42.067823+0000","last_undegraded":"2024-09-12T00:06:42.067823+0000","last_fullsized":"2024-09-12T00:06:42.067823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:29.611790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"59'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719921+0000","last_change":"2024-09-12T00:06:27.342563+0000","last_active":"2024-09-12T00:06:42.719921+0000","last_peered":"2024-09-12T00:06:42.719921+0000","last_clean":"2024-09-12T00:06:42.719921+0000","last_became_active":"2024-09-12T00:06:26.653851+0000","last_became_peered":"2024-09-12T00:06:26.653851+0000","last_unstale":"2024-09-12T00:06:42.719921+0000","last_undegraded":"2024-09-12T00:06:42.719921+0000","last_fullsized":"2024-09-12T00:06:42.719921+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:14.109429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"95'17","reported_seq":285,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501969+0000","last_change":"2024-09-12T00:06:27.069520+0000","last_active":"2024-09-12T00:06:42.501969+0000","last_peered":"2024-09-12T00:06:42.501969+0000","last_clean":"2024-09-12T00:06:42.501969+0000","last_became_active":"2024-09-12T00:06:26.664959+0000","last_became_peered":"2024-09-12T00:06:26.664959+0000","last_unstale":"2024-09-12T00:06:42.501969+0000","last_undegraded":"2024-09-12T00:06:42.501969+0000","last_fullsized":"2024-09-12T00:06:42.501969+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:35.231503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813150+0000","last_change":"2024-09-12T00:03:25.334966+0000","last_active":"2024-09-12T00:06:41.813150+0000","last_peered":"2024-09-12T00:06:41.813150+0000","last_clean":"2024-09-12T00:06:41.813150+0000","last_became_active":"2024-09-12T00:03:25.334375+0000","last_became_peered":"2024-09-12T00:03:25.334375+0000","last_unstale":"2024-09-12T00:06:41.813150+0000","last_undegraded":"2024-09-12T00:06:41.813150+0000","last_fullsized":"2024-09-12T00:06:41.813150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:52.828056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"96'20","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816433+0000","last_change":"2024-09-12T00:03:23.614289+0000","last_active":"2024-09-12T00:06:41.816433+0000","last_peered":"2024-09-12T00:06:41.816433+0000","last_clean":"2024-09-12T00:06:41.816433+0000","last_became_active":"2024-09-12T00:03:23.614019+0000","last_became_peered":"2024-09-12T00:03:23.614019+0000","last_unstale":"2024-09-12T00:06:41.816433+0000","last_undegraded":"2024-09-12T00:06:41.816433+0000","last_fullsized":"2024-09-12T00:06:41.816433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:00.847027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"96'12","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500281+0000","last_change":"2024-09-12T00:03:25.357938+0000","last_active":"2024-09-12T00:06:42.500281+0000","last_peered":"2024-09-12T00:06:42.500281+0000","last_clean":"2024-09-12T00:06:42.500281+0000","last_became_active":"2024-09-12T00:03:25.357571+0000","last_became_peered":"2024-09-12T00:03:25.357571+0000","last_unstale":"2024-09-12T00:06:42.500281+0000","last_undegraded":"2024-09-12T00:06:42.500281+0000","last_fullsized":"2024-09-12T00:06:42.500281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:05.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"95'23","reported_seq":315,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816438+0000","last_change":"2024-09-12T00:06:28.845144+0000","last_active":"2024-09-12T00:06:41.816438+0000","last_peered":"2024-09-12T00:06:41.816438+0000","last_clean":"2024-09-12T00:06:41.816438+0000","last_became_active":"2024-09-12T00:06:26.682027+0000","last_became_peered":"2024-09-12T00:06:26.682027+0000","last_unstale":"2024-09-12T00:06:41.816438+0000","last_undegraded":"2024-09-12T00:06:41.816438+0000","last_fullsized":"2024-09-12T00:06:41.816438+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:24.330401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":167772160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'8","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721712+0000","last_change":"2024-09-12T00:03:25.345717+0000","last_active":"2024-09-12T00:06:42.721712+0000","last_peered":"2024-09-12T00:06:42.721712+0000","last_clean":"2024-09-12T00:06:42.721712+0000","last_became_active":"2024-09-12T00:03:25.344959+0000","last_became_peered":"2024-09-12T00:03:25.344959+0000","last_unstale":"2024-09-12T00:06:42.721712+0000","last_undegraded":"2024-09-12T00:06:42.721712+0000","last_fullsized":"2024-09-12T00:06:42.721712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"96'17","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815332+0000","last_change":"2024-09-12T00:03:23.602960+0000","last_active":"2024-09-12T00:06:41.815332+0000","last_peered":"2024-09-12T00:06:41.815332+0000","last_clean":"2024-09-12T00:06:41.815332+0000","last_became_active":"2024-09-12T00:03:23.602640+0000","last_became_peered":"2024-09-12T00:03:23.602640+0000","last_unstale":"2024-09-12T00:06:41.815332+0000","last_undegraded":"2024-09-12T00:06:41.815332+0000","last_fullsized":"2024-09-12T00:06:41.815332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"59'2","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066326+0000","last_change":"2024-09-12T00:06:28.300294+0000","last_active":"2024-09-12T00:06:42.066326+0000","last_peered":"2024-09-12T00:06:42.066326+0000","last_clean":"2024-09-12T00:06:42.066326+0000","last_became_active":"2024-09-12T00:06:26.665307+0000","last_became_peered":"2024-09-12T00:06:26.665307+0000","last_unstale":"2024-09-12T00:06:42.066326+0000","last_undegraded":"2024-09-12T00:06:42.066326+0000","last_fullsized":"2024-09-12T00:06:42.066326+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:18.349268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"96'23","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722623+0000","last_change":"2024-09-12T00:03:23.604732+0000","last_active":"2024-09-12T00:06:42.722623+0000","last_peered":"2024-09-12T00:06:42.722623+0000","last_clean":"2024-09-12T00:06:42.722623+0000","last_became_active":"2024-09-12T00:03:23.603932+0000","last_became_peered":"2024-09-12T00:03:23.603932+0000","last_unstale":"2024-09-12T00:06:42.722623+0000","last_undegraded":"2024-09-12T00:06:42.722623+0000","last_fullsized":"2024-09-12T00:06:42.722623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:14.913580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"76'4","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501143+0000","last_change":"2024-09-12T00:03:25.341332+0000","last_active":"2024-09-12T00:06:42.501143+0000","last_peered":"2024-09-12T00:06:42.501143+0000","last_clean":"2024-09-12T00:06:42.501143+0000","last_became_active":"2024-09-12T00:03:25.340828+0000","last_became_peered":"2024-09-12T00:03:25.340828+0000","last_unstale":"2024-09-12T00:06:42.501143+0000","last_undegraded":"2024-09-12T00:06:42.501143+0000","last_fullsized":"2024-09-12T00:06:42.501143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"95'18","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722863+0000","last_change":"2024-09-12T00:03:23.602687+0000","last_active":"2024-09-12T00:06:42.722863+0000","last_peered":"2024-09-12T00:06:42.722863+0000","last_clean":"2024-09-12T00:06:42.722863+0000","last_became_active":"2024-09-12T00:03:23.601892+0000","last_became_peered":"2024-09-12T00:03:23.601892+0000","last_unstale":"2024-09-12T00:06:42.722863+0000","last_undegraded":"2024-09-12T00:06:42.722863+0000","last_fullsized":"2024-09-12T00:06:42.722863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.808845+0000","last_change":"2024-09-12T00:03:33.354850+0000","last_active":"2024-09-12T00:06:41.808845+0000","last_peered":"2024-09-12T00:06:41.808845+0000","last_clean":"2024-09-12T00:06:41.808845+0000","last_became_active":"2024-09-12T00:03:33.351917+0000","last_became_peered":"2024-09-12T00:03:33.351917+0000","last_unstale":"2024-09-12T00:06:41.808845+0000","last_undegraded":"2024-09-12T00:06:41.808845+0000","last_fullsized":"2024-09-12T00:06:41.808845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:00.466863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"59'6","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721027+0000","last_change":"2024-09-12T00:03:25.323174+0000","last_active":"2024-09-12T00:06:42.721027+0000","last_peered":"2024-09-12T00:06:42.721027+0000","last_clean":"2024-09-12T00:06:42.721027+0000","last_became_active":"2024-09-12T00:03:25.322456+0000","last_became_peered":"2024-09-12T00:03:25.322456+0000","last_unstale":"2024-09-12T00:06:42.721027+0000","last_undegraded":"2024-09-12T00:06:42.721027+0000","last_fullsized":"2024-09-12T00:06:42.721027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"96'27","reported_seq":97,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721346+0000","last_change":"2024-09-12T00:06:27.333722+0000","last_active":"2024-09-12T00:06:42.721346+0000","last_peered":"2024-09-12T00:06:42.721346+0000","last_clean":"2024-09-12T00:06:42.721346+0000","last_became_active":"2024-09-12T00:06:26.648460+0000","last_became_peered":"2024-09-12T00:06:26.648460+0000","last_unstale":"2024-09-12T00:06:42.721346+0000","last_undegraded":"2024-09-12T00:06:42.721346+0000","last_fullsized":"2024-09-12T00:06:42.721346+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:17.751627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717693+0000","last_change":"2024-09-12T00:06:26.675813+0000","last_active":"2024-09-12T00:06:42.717693+0000","last_peered":"2024-09-12T00:06:42.717693+0000","last_clean":"2024-09-12T00:06:42.717693+0000","last_became_active":"2024-09-12T00:06:26.663654+0000","last_became_peered":"2024-09-12T00:06:26.663654+0000","last_unstale":"2024-09-12T00:06:42.717693+0000","last_undegraded":"2024-09-12T00:06:42.717693+0000","last_fullsized":"2024-09-12T00:06:42.717693+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:22.865255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"96'29","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812965+0000","last_change":"2024-09-12T00:03:29.347224+0000","last_active":"2024-09-12T00:06:41.812965+0000","last_peered":"2024-09-12T00:06:41.812965+0000","last_clean":"2024-09-12T00:06:41.812965+0000","last_became_active":"2024-09-12T00:03:29.346662+0000","last_became_peered":"2024-09-12T00:03:29.346662+0000","last_unstale":"2024-09-12T00:06:41.812965+0000","last_undegraded":"2024-09-12T00:06:41.812965+0000","last_fullsized":"2024-09-12T00:06:41.812965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:28.258932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501404+0000","last_change":"2024-09-12T00:03:31.337219+0000","last_active":"2024-09-12T00:06:42.501404+0000","last_peered":"2024-09-12T00:06:42.501404+0000","last_clean":"2024-09-12T00:06:42.501404+0000","last_became_active":"2024-09-12T00:03:31.336317+0000","last_became_peered":"2024-09-12T00:03:31.336317+0000","last_unstale":"2024-09-12T00:06:42.501404+0000","last_undegraded":"2024-09-12T00:06:42.501404+0000","last_fullsized":"2024-09-12T00:06:42.501404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:50.954053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"96'48","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499219+0000","last_change":"2024-09-12T00:03:33.376628+0000","last_active":"2024-09-12T00:06:42.499219+0000","last_peered":"2024-09-12T00:06:42.499219+0000","last_clean":"2024-09-12T00:06:42.499219+0000","last_became_active":"2024-09-12T00:03:33.375938+0000","last_became_peered":"2024-09-12T00:03:33.375938+0000","last_unstale":"2024-09-12T00:06:42.499219+0000","last_undegraded":"2024-09-12T00:06:42.499219+0000","last_fullsized":"2024-09-12T00:06:42.499219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:31.105042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"84'8","reported_seq":51,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717938+0000","last_change":"2024-09-12T00:06:32.981663+0000","last_active":"2024-09-12T00:06:42.717938+0000","last_peered":"2024-09-12T00:06:42.717938+0000","last_clean":"2024-09-12T00:06:42.717938+0000","last_became_active":"2024-09-12T00:06:26.679390+0000","last_became_peered":"2024-09-12T00:06:26.679390+0000","last_unstale":"2024-09-12T00:06:42.717938+0000","last_undegraded":"2024-09-12T00:06:42.717938+0000","last_fullsized":"2024-09-12T00:06:42.717938+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.655318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"96'14","reported_seq":267,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723059+0000","last_change":"2024-09-12T00:06:28.270104+0000","last_active":"2024-09-12T00:06:42.723059+0000","last_peered":"2024-09-12T00:06:42.723059+0000","last_clean":"2024-09-12T00:06:42.723059+0000","last_became_active":"2024-09-12T00:06:26.675473+0000","last_became_peered":"2024-09-12T00:06:26.675473+0000","last_unstale":"2024-09-12T00:06:42.723059+0000","last_undegraded":"2024-09-12T00:06:42.723059+0000","last_fullsized":"2024-09-12T00:06:42.723059+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:45.446239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812081+0000","last_change":"2024-09-12T00:03:27.336108+0000","last_active":"2024-09-12T00:06:41.812081+0000","last_peered":"2024-09-12T00:06:41.812081+0000","last_clean":"2024-09-12T00:06:41.812081+0000","last_became_active":"2024-09-12T00:03:27.335308+0000","last_became_peered":"2024-09-12T00:03:27.335308+0000","last_unstale":"2024-09-12T00:06:41.812081+0000","last_undegraded":"2024-09-12T00:06:41.812081+0000","last_fullsized":"2024-09-12T00:06:41.812081+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:39.812803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'12","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501517+0000","last_change":"2024-09-12T00:03:29.352496+0000","last_active":"2024-09-12T00:06:42.501517+0000","last_peered":"2024-09-12T00:06:42.501517+0000","last_clean":"2024-09-12T00:06:42.501517+0000","last_became_active":"2024-09-12T00:03:29.351783+0000","last_became_peered":"2024-09-12T00:03:29.351783+0000","last_unstale":"2024-09-12T00:06:42.501517+0000","last_undegraded":"2024-09-12T00:06:42.501517+0000","last_fullsized":"2024-09-12T00:06:42.501517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501338+0000","last_change":"2024-09-12T00:03:31.350279+0000","last_active":"2024-09-12T00:06:42.501338+0000","last_peered":"2024-09-12T00:06:42.501338+0000","last_clean":"2024-09-12T00:06:42.501338+0000","last_became_active":"2024-09-12T00:03:31.349244+0000","last_became_peered":"2024-09-12T00:03:31.349244+0000","last_unstale":"2024-09-12T00:06:42.501338+0000","last_undegraded":"2024-09-12T00:06:42.501338+0000","last_fullsized":"2024-09-12T00:06:42.501338+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.420974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719171+0000","last_change":"2024-09-12T00:03:33.382726+0000","last_active":"2024-09-12T00:06:42.719171+0000","last_peered":"2024-09-12T00:06:42.719171+0000","last_clean":"2024-09-12T00:06:42.719171+0000","last_became_active":"2024-09-12T00:03:33.381875+0000","last_became_peered":"2024-09-12T00:03:33.381875+0000","last_unstale":"2024-09-12T00:06:42.719171+0000","last_undegraded":"2024-09-12T00:06:42.719171+0000","last_fullsized":"2024-09-12T00:06:42.719171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"63'12","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066812+0000","last_change":"2024-09-12T00:03:25.357883+0000","last_active":"2024-09-12T00:06:42.066812+0000","last_peered":"2024-09-12T00:06:42.066812+0000","last_clean":"2024-09-12T00:06:42.066812+0000","last_became_active":"2024-09-12T00:03:25.355174+0000","last_became_peered":"2024-09-12T00:03:25.355174+0000","last_unstale":"2024-09-12T00:06:42.066812+0000","last_undegraded":"2024-09-12T00:06:42.066812+0000","last_fullsized":"2024-09-12T00:06:42.066812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:26.621650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"96'21","reported_seq":85,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721209+0000","last_change":"2024-09-12T00:06:29.505713+0000","last_active":"2024-09-12T00:06:42.721209+0000","last_peered":"2024-09-12T00:06:42.721209+0000","last_clean":"2024-09-12T00:06:42.721209+0000","last_became_active":"2024-09-12T00:06:26.670936+0000","last_became_peered":"2024-09-12T00:06:26.670936+0000","last_unstale":"2024-09-12T00:06:42.721209+0000","last_undegraded":"2024-09-12T00:06:42.721209+0000","last_fullsized":"2024-09-12T00:06:42.721209+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:12.048117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813428+0000","last_change":"2024-09-12T00:03:27.347098+0000","last_active":"2024-09-12T00:06:41.813428+0000","last_peered":"2024-09-12T00:06:41.813428+0000","last_clean":"2024-09-12T00:06:41.813428+0000","last_became_active":"2024-09-12T00:03:27.346346+0000","last_became_peered":"2024-09-12T00:03:27.346346+0000","last_unstale":"2024-09-12T00:06:41.813428+0000","last_undegraded":"2024-09-12T00:06:41.813428+0000","last_fullsized":"2024-09-12T00:06:41.813428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:56.250627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'22","reported_seq":265,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812213+0000","last_change":"2024-09-12T00:06:27.562833+0000","last_active":"2024-09-12T00:06:41.812213+0000","last_peered":"2024-09-12T00:06:41.812213+0000","last_clean":"2024-09-12T00:06:41.812213+0000","last_became_active":"2024-09-12T00:06:26.654182+0000","last_became_peered":"2024-09-12T00:06:26.654182+0000","last_unstale":"2024-09-12T00:06:41.812213+0000","last_undegraded":"2024-09-12T00:06:41.812213+0000","last_fullsized":"2024-09-12T00:06:41.812213+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:01.211483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"116'140","reported_seq":362,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.724494+0000","last_change":"2024-09-12T00:06:30.699178+0000","last_active":"2024-09-12T00:06:42.724494+0000","last_peered":"2024-09-12T00:06:42.724494+0000","last_clean":"2024-09-12T00:06:42.724494+0000","last_became_active":"2024-09-12T00:06:30.698465+0000","last_became_peered":"2024-09-12T00:06:30.698465+0000","last_unstale":"2024-09-12T00:06:42.724494+0000","last_undegraded":"2024-09-12T00:06:42.724494+0000","last_fullsized":"2024-09-12T00:06:42.724494+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:48.150663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810365+0000","last_change":"2024-09-12T00:03:33.378439+0000","last_active":"2024-09-12T00:06:41.810365+0000","last_peered":"2024-09-12T00:06:41.810365+0000","last_clean":"2024-09-12T00:06:41.810365+0000","last_became_active":"2024-09-12T00:03:33.374453+0000","last_became_peered":"2024-09-12T00:03:33.374453+0000","last_unstale":"2024-09-12T00:06:41.810365+0000","last_undegraded":"2024-09-12T00:06:41.810365+0000","last_fullsized":"2024-09-12T00:06:41.810365+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"58'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067326+0000","last_change":"2024-09-12T00:03:25.356433+0000","last_active":"2024-09-12T00:06:42.067326+0000","last_peered":"2024-09-12T00:06:42.067326+0000","last_clean":"2024-09-12T00:06:42.067326+0000","last_became_active":"2024-09-12T00:03:25.354803+0000","last_became_peered":"2024-09-12T00:03:25.354803+0000","last_unstale":"2024-09-12T00:06:42.067326+0000","last_undegraded":"2024-09-12T00:06:42.067326+0000","last_fullsized":"2024-09-12T00:06:42.067326+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:00.419686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"96'23","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499086+0000","last_change":"2024-09-12T00:03:23.630527+0000","last_active":"2024-09-12T00:06:42.499086+0000","last_peered":"2024-09-12T00:06:42.499086+0000","last_clean":"2024-09-12T00:06:42.499086+0000","last_became_active":"2024-09-12T00:03:23.630183+0000","last_became_peered":"2024-09-12T00:03:23.630183+0000","last_unstale":"2024-09-12T00:06:42.499086+0000","last_undegraded":"2024-09-12T00:06:42.499086+0000","last_fullsized":"2024-09-12T00:06:42.499086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94371840,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721999+0000","last_change":"2024-09-12T00:06:26.671315+0000","last_active":"2024-09-12T00:06:42.721999+0000","last_peered":"2024-09-12T00:06:42.721999+0000","last_clean":"2024-09-12T00:06:42.721999+0000","last_became_active":"2024-09-12T00:06:26.669946+0000","last_became_peered":"2024-09-12T00:06:26.669946+0000","last_unstale":"2024-09-12T00:06:42.721999+0000","last_undegraded":"2024-09-12T00:06:42.721999+0000","last_fullsized":"2024-09-12T00:06:42.721999+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:53.569121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"96'23","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812548+0000","last_change":"2024-09-12T00:03:29.339735+0000","last_active":"2024-09-12T00:06:41.812548+0000","last_peered":"2024-09-12T00:06:41.812548+0000","last_clean":"2024-09-12T00:06:41.812548+0000","last_became_active":"2024-09-12T00:03:29.338810+0000","last_became_peered":"2024-09-12T00:03:29.338810+0000","last_unstale":"2024-09-12T00:06:41.812548+0000","last_undegraded":"2024-09-12T00:06:41.812548+0000","last_fullsized":"2024-09-12T00:06:41.812548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"116'135","reported_seq":432,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.585527+0000","last_change":"2024-09-12T00:03:31.364647+0000","last_active":"2024-09-12T00:06:42.585527+0000","last_peered":"2024-09-12T00:06:42.585527+0000","last_clean":"2024-09-12T00:06:42.585527+0000","last_became_active":"2024-09-12T00:03:31.353547+0000","last_became_peered":"2024-09-12T00:03:31.353547+0000","last_unstale":"2024-09-12T00:06:42.585527+0000","last_undegraded":"2024-09-12T00:06:42.585527+0000","last_fullsized":"2024-09-12T00:06:42.585527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:20.795870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"63'4","reported_seq":47,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717416+0000","last_change":"2024-09-12T00:06:27.339590+0000","last_active":"2024-09-12T00:06:42.717416+0000","last_peered":"2024-09-12T00:06:42.717416+0000","last_clean":"2024-09-12T00:06:42.717416+0000","last_became_active":"2024-09-12T00:06:26.651618+0000","last_became_peered":"2024-09-12T00:06:26.651618+0000","last_unstale":"2024-09-12T00:06:42.717416+0000","last_undegraded":"2024-09-12T00:06:42.717416+0000","last_fullsized":"2024-09-12T00:06:42.717416+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:58.850777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"96'29","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.817312+0000","last_change":"2024-09-12T00:03:23.602206+0000","last_active":"2024-09-12T00:06:41.817312+0000","last_peered":"2024-09-12T00:06:41.817312+0000","last_clean":"2024-09-12T00:06:41.817312+0000","last_became_active":"2024-09-12T00:03:23.601898+0000","last_became_peered":"2024-09-12T00:03:23.601898+0000","last_unstale":"2024-09-12T00:06:41.817312+0000","last_undegraded":"2024-09-12T00:06:41.817312+0000","last_fullsized":"2024-09-12T00:06:41.817312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:52.625795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499596+0000","last_change":"2024-09-12T00:03:27.331111+0000","last_active":"2024-09-12T00:06:42.499596+0000","last_peered":"2024-09-12T00:06:42.499596+0000","last_clean":"2024-09-12T00:06:42.499596+0000","last_became_active":"2024-09-12T00:03:27.329672+0000","last_became_peered":"2024-09-12T00:03:27.329672+0000","last_unstale":"2024-09-12T00:06:42.499596+0000","last_undegraded":"2024-09-12T00:06:42.499596+0000","last_fullsized":"2024-09-12T00:06:42.499596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"96'34","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814758+0000","last_change":"2024-09-12T00:03:29.335931+0000","last_active":"2024-09-12T00:06:41.814758+0000","last_peered":"2024-09-12T00:06:41.814758+0000","last_clean":"2024-09-12T00:06:41.814758+0000","last_became_active":"2024-09-12T00:03:29.335044+0000","last_became_peered":"2024-09-12T00:03:29.335044+0000","last_unstale":"2024-09-12T00:06:41.814758+0000","last_undegraded":"2024-09-12T00:06:41.814758+0000","last_fullsized":"2024-09-12T00:06:41.814758+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:57.131209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719379+0000","last_change":"2024-09-12T00:03:31.355001+0000","last_active":"2024-09-12T00:06:42.719379+0000","last_peered":"2024-09-12T00:06:42.719379+0000","last_clean":"2024-09-12T00:06:42.719379+0000","last_became_active":"2024-09-12T00:03:31.354160+0000","last_became_peered":"2024-09-12T00:03:31.354160+0000","last_unstale":"2024-09-12T00:06:42.719379+0000","last_undegraded":"2024-09-12T00:06:42.719379+0000","last_fullsized":"2024-09-12T00:06:42.719379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:29.868141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810884+0000","last_change":"2024-09-12T00:06:26.664709+0000","last_active":"2024-09-12T00:06:41.810884+0000","last_peered":"2024-09-12T00:06:41.810884+0000","last_clean":"2024-09-12T00:06:41.810884+0000","last_became_active":"2024-09-12T00:06:26.664401+0000","last_became_peered":"2024-09-12T00:06:26.664401+0000","last_unstale":"2024-09-12T00:06:41.810884+0000","last_undegraded":"2024-09-12T00:06:41.810884+0000","last_fullsized":"2024-09-12T00:06:41.810884+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:17.791780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'2","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499737+0000","last_change":"2024-09-12T00:03:25.357300+0000","last_active":"2024-09-12T00:06:42.499737+0000","last_peered":"2024-09-12T00:06:42.499737+0000","last_clean":"2024-09-12T00:06:42.499737+0000","last_became_active":"2024-09-12T00:03:25.356970+0000","last_became_peered":"2024-09-12T00:03:25.356970+0000","last_unstale":"2024-09-12T00:06:42.499737+0000","last_undegraded":"2024-09-12T00:06:42.499737+0000","last_fullsized":"2024-09-12T00:06:42.499737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:04.193738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"96'19","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814414+0000","last_change":"2024-09-12T00:03:23.609700+0000","last_active":"2024-09-12T00:06:41.814414+0000","last_peered":"2024-09-12T00:06:41.814414+0000","last_clean":"2024-09-12T00:06:41.814414+0000","last_became_active":"2024-09-12T00:03:23.609435+0000","last_became_peered":"2024-09-12T00:03:23.609435+0000","last_unstale":"2024-09-12T00:06:41.814414+0000","last_undegraded":"2024-09-12T00:06:41.814414+0000","last_fullsized":"2024-09-12T00:06:41.814414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720734+0000","last_change":"2024-09-12T00:03:27.339670+0000","last_active":"2024-09-12T00:06:42.720734+0000","last_peered":"2024-09-12T00:06:42.720734+0000","last_clean":"2024-09-12T00:06:42.720734+0000","last_became_active":"2024-09-12T00:03:27.338880+0000","last_became_peered":"2024-09-12T00:03:27.338880+0000","last_unstale":"2024-09-12T00:06:42.720734+0000","last_undegraded":"2024-09-12T00:06:42.720734+0000","last_fullsized":"2024-09-12T00:06:42.720734+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:35.068652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"96'25","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811038+0000","last_change":"2024-09-12T00:03:29.337666+0000","last_active":"2024-09-12T00:06:41.811038+0000","last_peered":"2024-09-12T00:06:41.811038+0000","last_clean":"2024-09-12T00:06:41.811038+0000","last_became_active":"2024-09-12T00:03:29.336957+0000","last_became_peered":"2024-09-12T00:03:29.336957+0000","last_unstale":"2024-09-12T00:06:41.811038+0000","last_undegraded":"2024-09-12T00:06:41.811038+0000","last_fullsized":"2024-09-12T00:06:41.811038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:58.417315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":21,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810940+0000","last_change":"2024-09-12T00:03:31.348590+0000","last_active":"2024-09-12T00:06:41.810940+0000","last_peered":"2024-09-12T00:06:41.810940+0000","last_clean":"2024-09-12T00:06:41.810940+0000","last_became_active":"2024-09-12T00:03:31.347736+0000","last_became_peered":"2024-09-12T00:03:31.347736+0000","last_unstale":"2024-09-12T00:06:41.810940+0000","last_undegraded":"2024-09-12T00:06:41.810940+0000","last_fullsized":"2024-09-12T00:06:41.810940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:04.962492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"59'8","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500524+0000","last_change":"2024-09-12T00:03:33.379699+0000","last_active":"2024-09-12T00:06:42.500524+0000","last_peered":"2024-09-12T00:06:42.500524+0000","last_clean":"2024-09-12T00:06:42.500524+0000","last_became_active":"2024-09-12T00:03:33.378945+0000","last_became_peered":"2024-09-12T00:03:33.378945+0000","last_unstale":"2024-09-12T00:06:42.500524+0000","last_undegraded":"2024-09-12T00:06:42.500524+0000","last_fullsized":"2024-09-12T00:06:42.500524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:23.270488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'6","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812122+0000","last_change":"2024-09-12T00:06:28.326850+0000","last_active":"2024-09-12T00:06:41.812122+0000","last_peered":"2024-09-12T00:06:41.812122+0000","last_clean":"2024-09-12T00:06:41.812122+0000","last_became_active":"2024-09-12T00:06:26.668131+0000","last_became_peered":"2024-09-12T00:06:26.668131+0000","last_unstale":"2024-09-12T00:06:41.812122+0000","last_undegraded":"2024-09-12T00:06:41.812122+0000","last_fullsized":"2024-09-12T00:06:41.812122+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:18.255160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"95'17","reported_seq":77,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717787+0000","last_change":"2024-09-12T00:06:33.441486+0000","last_active":"2024-09-12T00:06:42.717787+0000","last_peered":"2024-09-12T00:06:42.717787+0000","last_clean":"2024-09-12T00:06:42.717787+0000","last_became_active":"2024-09-12T00:06:26.679723+0000","last_became_peered":"2024-09-12T00:06:26.679723+0000","last_unstale":"2024-09-12T00:06:42.717787+0000","last_undegraded":"2024-09-12T00:06:42.717787+0000","last_fullsized":"2024-09-12T00:06:42.717787+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:59.722762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065103+0000","last_change":"2024-09-12T00:03:27.348080+0000","last_active":"2024-09-12T00:06:42.065103+0000","last_peered":"2024-09-12T00:06:42.065103+0000","last_clean":"2024-09-12T00:06:42.065103+0000","last_became_active":"2024-09-12T00:03:27.347288+0000","last_became_peered":"2024-09-12T00:03:27.347288+0000","last_unstale":"2024-09-12T00:06:42.065103+0000","last_undegraded":"2024-09-12T00:06:42.065103+0000","last_fullsized":"2024-09-12T00:06:42.065103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:37.033224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"96'37","reported_seq":61,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720107+0000","last_change":"2024-09-12T00:06:28.360303+0000","last_active":"2024-09-12T00:06:42.720107+0000","last_peered":"2024-09-12T00:06:42.720107+0000","last_clean":"2024-09-12T00:06:42.720107+0000","last_became_active":"2024-09-12T00:06:26.668791+0000","last_became_peered":"2024-09-12T00:06:26.668791+0000","last_unstale":"2024-09-12T00:06:42.720107+0000","last_undegraded":"2024-09-12T00:06:42.720107+0000","last_fullsized":"2024-09-12T00:06:42.720107+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:49.033011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120747,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":45,"num_read_kb":34,"num_write":30,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":116871,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"116'135","reported_seq":351,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.585603+0000","last_change":"2024-09-12T00:03:31.354114+0000","last_active":"2024-09-12T00:06:42.585603+0000","last_peered":"2024-09-12T00:06:42.585603+0000","last_clean":"2024-09-12T00:06:42.585603+0000","last_became_active":"2024-09-12T00:03:31.353358+0000","last_became_peered":"2024-09-12T00:03:31.353358+0000","last_unstale":"2024-09-12T00:06:42.585603+0000","last_undegraded":"2024-09-12T00:06:42.585603+0000","last_fullsized":"2024-09-12T00:06:42.585603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:56.624718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719909+0000","last_change":"2024-09-12T00:03:33.383917+0000","last_active":"2024-09-12T00:06:42.719909+0000","last_peered":"2024-09-12T00:06:42.719909+0000","last_clean":"2024-09-12T00:06:42.719909+0000","last_became_active":"2024-09-12T00:03:33.383199+0000","last_became_peered":"2024-09-12T00:03:33.383199+0000","last_unstale":"2024-09-12T00:06:42.719909+0000","last_undegraded":"2024-09-12T00:06:42.719909+0000","last_fullsized":"2024-09-12T00:06:42.719909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:37.428182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"84'10","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065948+0000","last_change":"2024-09-12T00:03:25.356706+0000","last_active":"2024-09-12T00:06:42.065948+0000","last_peered":"2024-09-12T00:06:42.065948+0000","last_clean":"2024-09-12T00:06:42.065948+0000","last_became_active":"2024-09-12T00:03:25.354555+0000","last_became_peered":"2024-09-12T00:03:25.354555+0000","last_unstale":"2024-09-12T00:06:42.065948+0000","last_undegraded":"2024-09-12T00:06:42.065948+0000","last_fullsized":"2024-09-12T00:06:42.065948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:55.543336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"96'39","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815809+0000","last_change":"2024-09-12T00:03:23.612430+0000","last_active":"2024-09-12T00:06:41.815809+0000","last_peered":"2024-09-12T00:06:41.815809+0000","last_clean":"2024-09-12T00:06:41.815809+0000","last_became_active":"2024-09-12T00:03:23.612165+0000","last_became_peered":"2024-09-12T00:03:23.612165+0000","last_unstale":"2024-09-12T00:06:41.815809+0000","last_undegraded":"2024-09-12T00:06:41.815809+0000","last_fullsized":"2024-09-12T00:06:41.815809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:31.444343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":159744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722313+0000","last_change":"2024-09-12T00:03:27.329228+0000","last_active":"2024-09-12T00:06:42.722313+0000","last_peered":"2024-09-12T00:06:42.722313+0000","last_clean":"2024-09-12T00:06:42.722313+0000","last_became_active":"2024-09-12T00:03:27.328497+0000","last_became_peered":"2024-09-12T00:03:27.328497+0000","last_unstale":"2024-09-12T00:06:42.722313+0000","last_undegraded":"2024-09-12T00:06:42.722313+0000","last_fullsized":"2024-09-12T00:06:42.722313+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"96'42","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810133+0000","last_change":"2024-09-12T00:03:29.332778+0000","last_active":"2024-09-12T00:06:41.810133+0000","last_peered":"2024-09-12T00:06:41.810133+0000","last_clean":"2024-09-12T00:06:41.810133+0000","last_became_active":"2024-09-12T00:03:29.332010+0000","last_became_peered":"2024-09-12T00:03:29.332010+0000","last_unstale":"2024-09-12T00:06:41.810133+0000","last_undegraded":"2024-09-12T00:06:41.810133+0000","last_fullsized":"2024-09-12T00:06:41.810133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:13.563107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125399,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":47,"num_read_kb":36,"num_write":30,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065300+0000","last_change":"2024-09-12T00:03:31.354374+0000","last_active":"2024-09-12T00:06:42.065300+0000","last_peered":"2024-09-12T00:06:42.065300+0000","last_clean":"2024-09-12T00:06:42.065300+0000","last_became_active":"2024-09-12T00:03:31.353407+0000","last_became_peered":"2024-09-12T00:03:31.353407+0000","last_unstale":"2024-09-12T00:06:42.065300+0000","last_undegraded":"2024-09-12T00:06:42.065300+0000","last_fullsized":"2024-09-12T00:06:42.065300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:30.520217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"93'7","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723759+0000","last_change":"2024-09-12T00:03:33.385373+0000","last_active":"2024-09-12T00:06:42.723759+0000","last_peered":"2024-09-12T00:06:42.723759+0000","last_clean":"2024-09-12T00:06:42.723759+0000","last_became_active":"2024-09-12T00:03:33.384559+0000","last_became_peered":"2024-09-12T00:03:33.384559+0000","last_unstale":"2024-09-12T00:06:42.723759+0000","last_undegraded":"2024-09-12T00:06:42.723759+0000","last_fullsized":"2024-09-12T00:06:42.723759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:55.924174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815429+0000","last_change":"2024-09-12T00:03:25.326677+0000","last_active":"2024-09-12T00:06:41.815429+0000","last_peered":"2024-09-12T00:06:41.815429+0000","last_clean":"2024-09-12T00:06:41.815429+0000","last_became_active":"2024-09-12T00:03:25.325840+0000","last_became_peered":"2024-09-12T00:03:25.325840+0000","last_unstale":"2024-09-12T00:06:41.815429+0000","last_undegraded":"2024-09-12T00:06:41.815429+0000","last_fullsized":"2024-09-12T00:06:41.815429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:07.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"95'22","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720457+0000","last_change":"2024-09-12T00:03:23.616943+0000","last_active":"2024-09-12T00:06:42.720457+0000","last_peered":"2024-09-12T00:06:42.720457+0000","last_clean":"2024-09-12T00:06:42.720457+0000","last_became_active":"2024-09-12T00:03:23.616200+0000","last_became_peered":"2024-09-12T00:03:23.616200+0000","last_unstale":"2024-09-12T00:06:42.720457+0000","last_undegraded":"2024-09-12T00:06:42.720457+0000","last_fullsized":"2024-09-12T00:06:42.720457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722289+0000","last_change":"2024-09-12T00:03:27.330506+0000","last_active":"2024-09-12T00:06:42.722289+0000","last_peered":"2024-09-12T00:06:42.722289+0000","last_clean":"2024-09-12T00:06:42.722289+0000","last_became_active":"2024-09-12T00:03:27.329830+0000","last_became_peered":"2024-09-12T00:03:27.329830+0000","last_unstale":"2024-09-12T00:06:42.722289+0000","last_undegraded":"2024-09-12T00:06:42.722289+0000","last_fullsized":"2024-09-12T00:06:42.722289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:03.446090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"96'25","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501739+0000","last_change":"2024-09-12T00:03:29.343655+0000","last_active":"2024-09-12T00:06:42.501739+0000","last_peered":"2024-09-12T00:06:42.501739+0000","last_clean":"2024-09-12T00:06:42.501739+0000","last_became_active":"2024-09-12T00:03:29.343178+0000","last_became_peered":"2024-09-12T00:03:29.343178+0000","last_unstale":"2024-09-12T00:06:42.501739+0000","last_undegraded":"2024-09-12T00:06:42.501739+0000","last_fullsized":"2024-09-12T00:06:42.501739+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723516+0000","last_change":"2024-09-12T00:03:31.358077+0000","last_active":"2024-09-12T00:06:42.723516+0000","last_peered":"2024-09-12T00:06:42.723516+0000","last_clean":"2024-09-12T00:06:42.723516+0000","last_became_active":"2024-09-12T00:03:31.357272+0000","last_became_peered":"2024-09-12T00:03:31.357272+0000","last_unstale":"2024-09-12T00:06:42.723516+0000","last_undegraded":"2024-09-12T00:06:42.723516+0000","last_fullsized":"2024-09-12T00:06:42.723516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:37.991682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"76'4","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065822+0000","last_change":"2024-09-12T00:06:26.690241+0000","last_active":"2024-09-12T00:06:42.065822+0000","last_peered":"2024-09-12T00:06:42.065822+0000","last_clean":"2024-09-12T00:06:42.065822+0000","last_became_active":"2024-09-12T00:06:26.653908+0000","last_became_peered":"2024-09-12T00:06:26.653908+0000","last_unstale":"2024-09-12T00:06:42.065822+0000","last_undegraded":"2024-09-12T00:06:42.065822+0000","last_fullsized":"2024-09-12T00:06:42.065822+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:12.338436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"76'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721025+0000","last_change":"2024-09-12T00:06:32.433900+0000","last_active":"2024-09-12T00:06:42.721025+0000","last_peered":"2024-09-12T00:06:42.721025+0000","last_clean":"2024-09-12T00:06:42.721025+0000","last_became_active":"2024-09-12T00:06:26.675405+0000","last_became_peered":"2024-09-12T00:06:26.675405+0000","last_unstale":"2024-09-12T00:06:42.721025+0000","last_undegraded":"2024-09-12T00:06:42.721025+0000","last_fullsized":"2024-09-12T00:06:42.721025+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:53.098500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"96'21","reported_seq":85,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721420+0000","last_change":"2024-09-12T00:06:32.375501+0000","last_active":"2024-09-12T00:06:42.721420+0000","last_peered":"2024-09-12T00:06:42.721420+0000","last_clean":"2024-09-12T00:06:42.721420+0000","last_became_active":"2024-09-12T00:06:26.663178+0000","last_became_peered":"2024-09-12T00:06:26.663178+0000","last_unstale":"2024-09-12T00:06:42.721420+0000","last_undegraded":"2024-09-12T00:06:42.721420+0000","last_fullsized":"2024-09-12T00:06:42.721420+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:27.738037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":138412032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065958+0000","last_change":"2024-09-12T00:03:27.342295+0000","last_active":"2024-09-12T00:06:42.065958+0000","last_peered":"2024-09-12T00:06:42.065958+0000","last_clean":"2024-09-12T00:06:42.065958+0000","last_became_active":"2024-09-12T00:03:27.341619+0000","last_became_peered":"2024-09-12T00:03:27.341619+0000","last_unstale":"2024-09-12T00:06:42.065958+0000","last_undegraded":"2024-09-12T00:06:42.065958+0000","last_fullsized":"2024-09-12T00:06:42.065958+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:00.908798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"96'23","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066215+0000","last_change":"2024-09-12T00:03:29.336391+0000","last_active":"2024-09-12T00:06:42.066215+0000","last_peered":"2024-09-12T00:06:42.066215+0000","last_clean":"2024-09-12T00:06:42.066215+0000","last_became_active":"2024-09-12T00:03:29.335679+0000","last_became_peered":"2024-09-12T00:03:29.335679+0000","last_unstale":"2024-09-12T00:06:42.066215+0000","last_undegraded":"2024-09-12T00:06:42.066215+0000","last_fullsized":"2024-09-12T00:06:42.066215+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:58.540539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"116'135","reported_seq":396,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723110+0000","last_change":"2024-09-12T00:03:31.351170+0000","last_active":"2024-09-12T00:06:42.723110+0000","last_peered":"2024-09-12T00:06:42.723110+0000","last_clean":"2024-09-12T00:06:42.723110+0000","last_became_active":"2024-09-12T00:03:31.350264+0000","last_became_peered":"2024-09-12T00:03:31.350264+0000","last_unstale":"2024-09-12T00:06:42.723110+0000","last_undegraded":"2024-09-12T00:06:42.723110+0000","last_fullsized":"2024-09-12T00:06:42.723110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:51.368815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"59'3","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719548+0000","last_change":"2024-09-12T00:03:33.368236+0000","last_active":"2024-09-12T00:06:42.719548+0000","last_peered":"2024-09-12T00:06:42.719548+0000","last_clean":"2024-09-12T00:06:42.719548+0000","last_became_active":"2024-09-12T00:03:33.367424+0000","last_became_peered":"2024-09-12T00:03:33.367424+0000","last_unstale":"2024-09-12T00:06:42.719548+0000","last_undegraded":"2024-09-12T00:06:42.719548+0000","last_fullsized":"2024-09-12T00:06:42.719548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"76'6","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813109+0000","last_change":"2024-09-12T00:06:28.869705+0000","last_active":"2024-09-12T00:06:41.813109+0000","last_peered":"2024-09-12T00:06:41.813109+0000","last_clean":"2024-09-12T00:06:41.813109+0000","last_became_active":"2024-09-12T00:06:26.671547+0000","last_became_peered":"2024-09-12T00:06:26.671547+0000","last_unstale":"2024-09-12T00:06:41.813109+0000","last_undegraded":"2024-09-12T00:06:41.813109+0000","last_fullsized":"2024-09-12T00:06:41.813109+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:55.946290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"96'22","reported_seq":87,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721098+0000","last_change":"2024-09-12T00:06:27.817806+0000","last_active":"2024-09-12T00:06:42.721098+0000","last_peered":"2024-09-12T00:06:42.721098+0000","last_clean":"2024-09-12T00:06:42.721098+0000","last_became_active":"2024-09-12T00:06:26.654104+0000","last_became_peered":"2024-09-12T00:06:26.654104+0000","last_unstale":"2024-09-12T00:06:42.721098+0000","last_undegraded":"2024-09-12T00:06:42.721098+0000","last_fullsized":"2024-09-12T00:06:42.721098+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:30.461829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":368,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501711+0000","last_change":"2024-09-12T00:03:27.331569+0000","last_active":"2024-09-12T00:06:42.501711+0000","last_peered":"2024-09-12T00:06:42.501711+0000","last_clean":"2024-09-12T00:06:42.501711+0000","last_became_active":"2024-09-12T00:03:27.330909+0000","last_became_peered":"2024-09-12T00:03:27.330909+0000","last_unstale":"2024-09-12T00:06:42.501711+0000","last_undegraded":"2024-09-12T00:06:42.501711+0000","last_fullsized":"2024-09-12T00:06:42.501711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"59'11","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720583+0000","last_change":"2024-09-12T00:03:29.338880+0000","last_active":"2024-09-12T00:06:42.720583+0000","last_peered":"2024-09-12T00:06:42.720583+0000","last_clean":"2024-09-12T00:06:42.720583+0000","last_became_active":"2024-09-12T00:03:29.338110+0000","last_became_peered":"2024-09-12T00:03:29.338110+0000","last_unstale":"2024-09-12T00:06:42.720583+0000","last_undegraded":"2024-09-12T00:06:42.720583+0000","last_fullsized":"2024-09-12T00:06:42.720583+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.054460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"116'135","reported_seq":402,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.585555+0000","last_change":"2024-09-12T00:03:31.339117+0000","last_active":"2024-09-12T00:06:42.585555+0000","last_peered":"2024-09-12T00:06:42.585555+0000","last_clean":"2024-09-12T00:06:42.585555+0000","last_became_active":"2024-09-12T00:03:31.338426+0000","last_became_peered":"2024-09-12T00:03:31.338426+0000","last_unstale":"2024-09-12T00:06:42.585555+0000","last_undegraded":"2024-09-12T00:06:42.585555+0000","last_fullsized":"2024-09-12T00:06:42.585555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:19.304169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811106+0000","last_change":"2024-09-12T00:03:33.385051+0000","last_active":"2024-09-12T00:06:41.811106+0000","last_peered":"2024-09-12T00:06:41.811106+0000","last_clean":"2024-09-12T00:06:41.811106+0000","last_became_active":"2024-09-12T00:03:33.380088+0000","last_became_peered":"2024-09-12T00:03:33.380088+0000","last_unstale":"2024-09-12T00:06:41.811106+0000","last_undegraded":"2024-09-12T00:06:41.811106+0000","last_fullsized":"2024-09-12T00:06:41.811106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:02.972871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.724550+0000","last_change":"2024-09-12T00:03:25.336113+0000","last_active":"2024-09-12T00:06:42.724550+0000","last_peered":"2024-09-12T00:06:42.724550+0000","last_clean":"2024-09-12T00:06:42.724550+0000","last_became_active":"2024-09-12T00:03:25.335449+0000","last_became_peered":"2024-09-12T00:03:25.335449+0000","last_unstale":"2024-09-12T00:06:42.724550+0000","last_undegraded":"2024-09-12T00:06:42.724550+0000","last_fullsized":"2024-09-12T00:06:42.724550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:34.277614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"96'24","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811100+0000","last_change":"2024-09-12T00:03:23.619285+0000","last_active":"2024-09-12T00:06:41.811100+0000","last_peered":"2024-09-12T00:06:41.811100+0000","last_clean":"2024-09-12T00:06:41.811100+0000","last_became_active":"2024-09-12T00:03:23.614187+0000","last_became_peered":"2024-09-12T00:03:23.614187+0000","last_unstale":"2024-09-12T00:06:41.811100+0000","last_undegraded":"2024-09-12T00:06:41.811100+0000","last_fullsized":"2024-09-12T00:06:41.811100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720307+0000","last_change":"2024-09-12T00:06:26.673924+0000","last_active":"2024-09-12T00:06:42.720307+0000","last_peered":"2024-09-12T00:06:42.720307+0000","last_clean":"2024-09-12T00:06:42.720307+0000","last_became_active":"2024-09-12T00:06:26.670945+0000","last_became_peered":"2024-09-12T00:06:26.670945+0000","last_unstale":"2024-09-12T00:06:42.720307+0000","last_undegraded":"2024-09-12T00:06:42.720307+0000","last_fullsized":"2024-09-12T00:06:42.720307+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:56.956200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"96'25","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500794+0000","last_change":"2024-09-12T00:03:29.345719+0000","last_active":"2024-09-12T00:06:42.500794+0000","last_peered":"2024-09-12T00:06:42.500794+0000","last_clean":"2024-09-12T00:06:42.500794+0000","last_became_active":"2024-09-12T00:03:29.345243+0000","last_became_peered":"2024-09-12T00:03:29.345243+0000","last_unstale":"2024-09-12T00:06:42.500794+0000","last_undegraded":"2024-09-12T00:06:42.500794+0000","last_fullsized":"2024-09-12T00:06:42.500794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:41.153263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812258+0000","last_change":"2024-09-12T00:03:31.360630+0000","last_active":"2024-09-12T00:06:41.812258+0000","last_peered":"2024-09-12T00:06:41.812258+0000","last_clean":"2024-09-12T00:06:41.812258+0000","last_became_active":"2024-09-12T00:03:31.359763+0000","last_became_peered":"2024-09-12T00:03:31.359763+0000","last_unstale":"2024-09-12T00:06:41.812258+0000","last_undegraded":"2024-09-12T00:06:41.812258+0000","last_fullsized":"2024-09-12T00:06:41.812258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"84'6","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719339+0000","last_change":"2024-09-12T00:03:33.372178+0000","last_active":"2024-09-12T00:06:42.719339+0000","last_peered":"2024-09-12T00:06:42.719339+0000","last_clean":"2024-09-12T00:06:42.719339+0000","last_became_active":"2024-09-12T00:03:33.370562+0000","last_became_peered":"2024-09-12T00:03:33.370562+0000","last_unstale":"2024-09-12T00:06:42.719339+0000","last_undegraded":"2024-09-12T00:06:42.719339+0000","last_fullsized":"2024-09-12T00:06:42.719339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:31.888153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'10","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720452+0000","last_change":"2024-09-12T00:06:32.425494+0000","last_active":"2024-09-12T00:06:42.720452+0000","last_peered":"2024-09-12T00:06:42.720452+0000","last_clean":"2024-09-12T00:06:42.720452+0000","last_became_active":"2024-09-12T00:06:26.674937+0000","last_became_peered":"2024-09-12T00:06:26.674937+0000","last_unstale":"2024-09-12T00:06:42.720452+0000","last_undegraded":"2024-09-12T00:06:42.720452+0000","last_fullsized":"2024-09-12T00:06:42.720452+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:09.992203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":300,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499047+0000","last_change":"2024-09-12T00:03:11.770141+0000","last_active":"2024-09-12T00:06:42.499047+0000","last_peered":"2024-09-12T00:06:42.499047+0000","last_clean":"2024-09-12T00:06:42.499047+0000","last_became_active":"2024-09-12T00:03:11.767988+0000","last_became_peered":"2024-09-12T00:03:11.767988+0000","last_unstale":"2024-09-12T00:06:42.499047+0000","last_undegraded":"2024-09-12T00:06:42.499047+0000","last_fullsized":"2024-09-12T00:06:42.499047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_clean_scrub_stamp":"2024-09-12T00:03:10.462069+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:26.289955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717386+0000","last_change":"2024-09-12T00:06:28.888645+0000","last_active":"2024-09-12T00:06:42.717386+0000","last_peered":"2024-09-12T00:06:42.717386+0000","last_clean":"2024-09-12T00:06:42.717386+0000","last_became_active":"2024-09-12T00:06:26.671587+0000","last_became_peered":"2024-09-12T00:06:26.671587+0000","last_unstale":"2024-09-12T00:06:42.717386+0000","last_undegraded":"2024-09-12T00:06:42.717386+0000","last_fullsized":"2024-09-12T00:06:42.717386+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:03.325846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"95'24","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811486+0000","last_change":"2024-09-12T00:03:23.621849+0000","last_active":"2024-09-12T00:06:41.811486+0000","last_peered":"2024-09-12T00:06:41.811486+0000","last_clean":"2024-09-12T00:06:41.811486+0000","last_became_active":"2024-09-12T00:03:23.621146+0000","last_became_peered":"2024-09-12T00:03:23.621146+0000","last_unstale":"2024-09-12T00:06:41.811486+0000","last_undegraded":"2024-09-12T00:06:41.811486+0000","last_fullsized":"2024-09-12T00:06:41.811486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:38.426691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809414+0000","last_change":"2024-09-12T00:03:27.316175+0000","last_active":"2024-09-12T00:06:41.809414+0000","last_peered":"2024-09-12T00:06:41.809414+0000","last_clean":"2024-09-12T00:06:41.809414+0000","last_became_active":"2024-09-12T00:03:27.315502+0000","last_became_peered":"2024-09-12T00:03:27.315502+0000","last_unstale":"2024-09-12T00:06:41.809414+0000","last_undegraded":"2024-09-12T00:06:41.809414+0000","last_fullsized":"2024-09-12T00:06:41.809414+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:21.448686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"96'44","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720067+0000","last_change":"2024-09-12T00:06:28.900645+0000","last_active":"2024-09-12T00:06:42.720067+0000","last_peered":"2024-09-12T00:06:42.720067+0000","last_clean":"2024-09-12T00:06:42.720067+0000","last_became_active":"2024-09-12T00:06:26.667623+0000","last_became_peered":"2024-09-12T00:06:26.667623+0000","last_unstale":"2024-09-12T00:06:42.720067+0000","last_undegraded":"2024-09-12T00:06:42.720067+0000","last_fullsized":"2024-09-12T00:06:42.720067+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:36.584753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":38,"num_read_kb":26,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066468+0000","last_change":"2024-09-12T00:03:31.361408+0000","last_active":"2024-09-12T00:06:42.066468+0000","last_peered":"2024-09-12T00:06:42.066468+0000","last_clean":"2024-09-12T00:06:42.066468+0000","last_became_active":"2024-09-12T00:03:31.360462+0000","last_became_peered":"2024-09-12T00:03:31.360462+0000","last_unstale":"2024-09-12T00:06:42.066468+0000","last_undegraded":"2024-09-12T00:06:42.066468+0000","last_fullsized":"2024-09-12T00:06:42.066468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:58.407571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"59'4","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812851+0000","last_change":"2024-09-12T00:03:33.388253+0000","last_active":"2024-09-12T00:06:41.812851+0000","last_peered":"2024-09-12T00:06:41.812851+0000","last_clean":"2024-09-12T00:06:41.812851+0000","last_became_active":"2024-09-12T00:03:33.387457+0000","last_became_peered":"2024-09-12T00:03:33.387457+0000","last_unstale":"2024-09-12T00:06:41.812851+0000","last_undegraded":"2024-09-12T00:06:41.812851+0000","last_fullsized":"2024-09-12T00:06:41.812851+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:46.021740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066818+0000","last_change":"2024-09-12T00:03:25.357970+0000","last_active":"2024-09-12T00:06:42.066818+0000","last_peered":"2024-09-12T00:06:42.066818+0000","last_clean":"2024-09-12T00:06:42.066818+0000","last_became_active":"2024-09-12T00:03:25.355306+0000","last_became_peered":"2024-09-12T00:03:25.355306+0000","last_unstale":"2024-09-12T00:06:42.066818+0000","last_undegraded":"2024-09-12T00:06:42.066818+0000","last_fullsized":"2024-09-12T00:06:42.066818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:17.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717548+0000","last_change":"2024-09-12T00:06:26.654149+0000","last_active":"2024-09-12T00:06:42.717548+0000","last_peered":"2024-09-12T00:06:42.717548+0000","last_clean":"2024-09-12T00:06:42.717548+0000","last_became_active":"2024-09-12T00:06:26.653574+0000","last_became_peered":"2024-09-12T00:06:26.653574+0000","last_unstale":"2024-09-12T00:06:42.717548+0000","last_undegraded":"2024-09-12T00:06:42.717548+0000","last_fullsized":"2024-09-12T00:06:42.717548+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:55.656413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"96'28","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720943+0000","last_change":"2024-09-12T00:03:23.622111+0000","last_active":"2024-09-12T00:06:42.720943+0000","last_peered":"2024-09-12T00:06:42.720943+0000","last_clean":"2024-09-12T00:06:42.720943+0000","last_became_active":"2024-09-12T00:03:23.621358+0000","last_became_peered":"2024-09-12T00:03:23.621358+0000","last_unstale":"2024-09-12T00:06:42.720943+0000","last_undegraded":"2024-09-12T00:06:42.720943+0000","last_fullsized":"2024-09-12T00:06:42.720943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:02.202230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722205+0000","last_change":"2024-09-12T00:06:26.659401+0000","last_active":"2024-09-12T00:06:42.722205+0000","last_peered":"2024-09-12T00:06:42.722205+0000","last_clean":"2024-09-12T00:06:42.722205+0000","last_became_active":"2024-09-12T00:06:26.657376+0000","last_became_peered":"2024-09-12T00:06:26.657376+0000","last_unstale":"2024-09-12T00:06:42.722205+0000","last_undegraded":"2024-09-12T00:06:42.722205+0000","last_fullsized":"2024-09-12T00:06:42.722205+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:27.337831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"116'142","reported_seq":430,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721300+0000","last_change":"2024-09-12T00:03:29.346819+0000","last_active":"2024-09-12T00:06:42.721300+0000","last_peered":"2024-09-12T00:06:42.721300+0000","last_clean":"2024-09-12T00:06:42.721300+0000","last_became_active":"2024-09-12T00:03:29.346101+0000","last_became_peered":"2024-09-12T00:03:29.346101+0000","last_unstale":"2024-09-12T00:06:42.721300+0000","last_undegraded":"2024-09-12T00:06:42.721300+0000","last_fullsized":"2024-09-12T00:06:42.721300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:27.268327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":183,"num_read_kb":167,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721121+0000","last_change":"2024-09-12T00:06:26.679841+0000","last_active":"2024-09-12T00:06:42.721121+0000","last_peered":"2024-09-12T00:06:42.721121+0000","last_clean":"2024-09-12T00:06:42.721121+0000","last_became_active":"2024-09-12T00:06:26.675966+0000","last_became_peered":"2024-09-12T00:06:26.675966+0000","last_unstale":"2024-09-12T00:06:42.721121+0000","last_undegraded":"2024-09-12T00:06:42.721121+0000","last_fullsized":"2024-09-12T00:06:42.721121+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:39.439184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064787+0000","last_change":"2024-09-12T00:03:33.386144+0000","last_active":"2024-09-12T00:06:42.064787+0000","last_peered":"2024-09-12T00:06:42.064787+0000","last_clean":"2024-09-12T00:06:42.064787+0000","last_became_active":"2024-09-12T00:03:33.384951+0000","last_became_peered":"2024-09-12T00:03:33.384951+0000","last_unstale":"2024-09-12T00:06:42.064787+0000","last_undegraded":"2024-09-12T00:06:42.064787+0000","last_fullsized":"2024-09-12T00:06:42.064787+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:49.807501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"59'2","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720659+0000","last_change":"2024-09-12T00:03:25.332801+0000","last_active":"2024-09-12T00:06:42.720659+0000","last_peered":"2024-09-12T00:06:42.720659+0000","last_clean":"2024-09-12T00:06:42.720659+0000","last_became_active":"2024-09-12T00:03:25.331652+0000","last_became_peered":"2024-09-12T00:03:25.331652+0000","last_unstale":"2024-09-12T00:06:42.720659+0000","last_undegraded":"2024-09-12T00:06:42.720659+0000","last_fullsized":"2024-09-12T00:06:42.720659+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718983+0000","last_change":"2024-09-12T00:03:18.892423+0000","last_active":"2024-09-12T00:06:42.718983+0000","last_peered":"2024-09-12T00:06:42.718983+0000","last_clean":"2024-09-12T00:06:42.718983+0000","last_became_active":"2024-09-12T00:03:16.559698+0000","last_became_peered":"2024-09-12T00:03:16.559698+0000","last_unstale":"2024-09-12T00:06:42.718983+0000","last_undegraded":"2024-09-12T00:06:42.718983+0000","last_fullsized":"2024-09-12T00:06:42.718983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:21.453461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082440599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"95'22","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064436+0000","last_change":"2024-09-12T00:03:23.633606+0000","last_active":"2024-09-12T00:06:42.064436+0000","last_peered":"2024-09-12T00:06:42.064436+0000","last_clean":"2024-09-12T00:06:42.064436+0000","last_became_active":"2024-09-12T00:03:23.632795+0000","last_became_peered":"2024-09-12T00:03:23.632795+0000","last_unstale":"2024-09-12T00:06:42.064436+0000","last_undegraded":"2024-09-12T00:06:42.064436+0000","last_fullsized":"2024-09-12T00:06:42.064436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:08.214455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90177536,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723278+0000","last_change":"2024-09-12T00:03:27.326932+0000","last_active":"2024-09-12T00:06:42.723278+0000","last_peered":"2024-09-12T00:06:42.723278+0000","last_clean":"2024-09-12T00:06:42.723278+0000","last_became_active":"2024-09-12T00:03:27.326173+0000","last_became_peered":"2024-09-12T00:03:27.326173+0000","last_unstale":"2024-09-12T00:06:42.723278+0000","last_undegraded":"2024-09-12T00:06:42.723278+0000","last_fullsized":"2024-09-12T00:06:42.723278+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:12.286539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"116'17","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.585643+0000","last_change":"2024-09-12T00:03:29.338829+0000","last_active":"2024-09-12T00:06:42.585643+0000","last_peered":"2024-09-12T00:06:42.585643+0000","last_clean":"2024-09-12T00:06:42.585643+0000","last_became_active":"2024-09-12T00:03:29.337364+0000","last_became_peered":"2024-09-12T00:03:29.337364+0000","last_unstale":"2024-09-12T00:06:42.585643+0000","last_undegraded":"2024-09-12T00:06:42.585643+0000","last_fullsized":"2024-09-12T00:06:42.585643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:01.584359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812645+0000","last_change":"2024-09-12T00:06:26.655001+0000","last_active":"2024-09-12T00:06:41.812645+0000","last_peered":"2024-09-12T00:06:41.812645+0000","last_clean":"2024-09-12T00:06:41.812645+0000","last_became_active":"2024-09-12T00:06:26.654068+0000","last_became_peered":"2024-09-12T00:06:26.654068+0000","last_unstale":"2024-09-12T00:06:41.812645+0000","last_undegraded":"2024-09-12T00:06:41.812645+0000","last_fullsized":"2024-09-12T00:06:41.812645+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:50.133218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810544+0000","last_change":"2024-09-12T00:03:33.354171+0000","last_active":"2024-09-12T00:06:41.810544+0000","last_peered":"2024-09-12T00:06:41.810544+0000","last_clean":"2024-09-12T00:06:41.810544+0000","last_became_active":"2024-09-12T00:03:33.353460+0000","last_became_peered":"2024-09-12T00:03:33.353460+0000","last_unstale":"2024-09-12T00:06:41.810544+0000","last_undegraded":"2024-09-12T00:06:41.810544+0000","last_fullsized":"2024-09-12T00:06:41.810544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:34.356970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"84'8","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721257+0000","last_change":"2024-09-12T00:03:25.336320+0000","last_active":"2024-09-12T00:06:42.721257+0000","last_peered":"2024-09-12T00:06:42.721257+0000","last_clean":"2024-09-12T00:06:42.721257+0000","last_became_active":"2024-09-12T00:03:25.333449+0000","last_became_peered":"2024-09-12T00:03:25.333449+0000","last_unstale":"2024-09-12T00:06:42.721257+0000","last_undegraded":"2024-09-12T00:06:42.721257+0000","last_fullsized":"2024-09-12T00:06:42.721257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722390+0000","last_change":"2024-09-12T00:06:32.408232+0000","last_active":"2024-09-12T00:06:42.722390+0000","last_peered":"2024-09-12T00:06:42.722390+0000","last_clean":"2024-09-12T00:06:42.722390+0000","last_became_active":"2024-09-12T00:06:26.677047+0000","last_became_peered":"2024-09-12T00:06:26.677047+0000","last_unstale":"2024-09-12T00:06:42.722390+0000","last_undegraded":"2024-09-12T00:06:42.722390+0000","last_fullsized":"2024-09-12T00:06:42.722390+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:52.555478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"96'21","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810342+0000","last_change":"2024-09-12T00:03:23.611064+0000","last_active":"2024-09-12T00:06:41.810342+0000","last_peered":"2024-09-12T00:06:41.810342+0000","last_clean":"2024-09-12T00:06:41.810342+0000","last_became_active":"2024-09-12T00:03:23.610612+0000","last_became_peered":"2024-09-12T00:03:23.610612+0000","last_unstale":"2024-09-12T00:06:41.810342+0000","last_undegraded":"2024-09-12T00:06:41.810342+0000","last_fullsized":"2024-09-12T00:06:41.810342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:04.201688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722466+0000","last_change":"2024-09-12T00:03:27.339197+0000","last_active":"2024-09-12T00:06:42.722466+0000","last_peered":"2024-09-12T00:06:42.722466+0000","last_clean":"2024-09-12T00:06:42.722466+0000","last_became_active":"2024-09-12T00:03:27.338508+0000","last_became_peered":"2024-09-12T00:03:27.338508+0000","last_unstale":"2024-09-12T00:06:42.722466+0000","last_undegraded":"2024-09-12T00:06:42.722466+0000","last_fullsized":"2024-09-12T00:06:42.722466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:08.306289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066551+0000","last_change":"2024-09-12T00:06:28.890041+0000","last_active":"2024-09-12T00:06:42.066551+0000","last_peered":"2024-09-12T00:06:42.066551+0000","last_clean":"2024-09-12T00:06:42.066551+0000","last_became_active":"2024-09-12T00:06:26.682354+0000","last_became_peered":"2024-09-12T00:06:26.682354+0000","last_unstale":"2024-09-12T00:06:42.066551+0000","last_undegraded":"2024-09-12T00:06:42.066551+0000","last_fullsized":"2024-09-12T00:06:42.066551+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:42.484131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722102+0000","last_change":"2024-09-12T00:06:26.675142+0000","last_active":"2024-09-12T00:06:42.722102+0000","last_peered":"2024-09-12T00:06:42.722102+0000","last_clean":"2024-09-12T00:06:42.722102+0000","last_became_active":"2024-09-12T00:06:26.669787+0000","last_became_peered":"2024-09-12T00:06:26.669787+0000","last_unstale":"2024-09-12T00:06:42.722102+0000","last_undegraded":"2024-09-12T00:06:42.722102+0000","last_fullsized":"2024-09-12T00:06:42.722102+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:34.635508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"63'7","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500245+0000","last_change":"2024-09-12T00:03:33.367035+0000","last_active":"2024-09-12T00:06:42.500245+0000","last_peered":"2024-09-12T00:06:42.500245+0000","last_clean":"2024-09-12T00:06:42.500245+0000","last_became_active":"2024-09-12T00:03:33.366311+0000","last_became_peered":"2024-09-12T00:03:33.366311+0000","last_unstale":"2024-09-12T00:06:42.500245+0000","last_undegraded":"2024-09-12T00:06:42.500245+0000","last_fullsized":"2024-09-12T00:06:42.500245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"96'8","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722537+0000","last_change":"2024-09-12T00:06:28.313486+0000","last_active":"2024-09-12T00:06:42.722537+0000","last_peered":"2024-09-12T00:06:42.722537+0000","last_clean":"2024-09-12T00:06:42.722537+0000","last_became_active":"2024-09-12T00:06:26.675442+0000","last_became_peered":"2024-09-12T00:06:26.675442+0000","last_unstale":"2024-09-12T00:06:42.722537+0000","last_undegraded":"2024-09-12T00:06:42.722537+0000","last_fullsized":"2024-09-12T00:06:42.722537+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:37.245286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"96'19","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812844+0000","last_change":"2024-09-12T00:03:23.619024+0000","last_active":"2024-09-12T00:06:41.812844+0000","last_peered":"2024-09-12T00:06:41.812844+0000","last_clean":"2024-09-12T00:06:41.812844+0000","last_became_active":"2024-09-12T00:03:23.618716+0000","last_became_peered":"2024-09-12T00:03:23.618716+0000","last_unstale":"2024-09-12T00:06:41.812844+0000","last_undegraded":"2024-09-12T00:06:41.812844+0000","last_fullsized":"2024-09-12T00:06:41.812844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067307+0000","last_change":"2024-09-12T00:03:18.562010+0000","last_active":"2024-09-12T00:06:42.067307+0000","last_peered":"2024-09-12T00:06:42.067307+0000","last_clean":"2024-09-12T00:06:42.067307+0000","last_became_active":"2024-09-12T00:03:16.561218+0000","last_became_peered":"2024-09-12T00:03:16.561218+0000","last_unstale":"2024-09-12T00:06:42.067307+0000","last_undegraded":"2024-09-12T00:06:42.067307+0000","last_fullsized":"2024-09-12T00:06:42.067307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:43.089686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084170299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811828+0000","last_change":"2024-09-12T00:03:27.341079+0000","last_active":"2024-09-12T00:06:41.811828+0000","last_peered":"2024-09-12T00:06:41.811828+0000","last_clean":"2024-09-12T00:06:41.811828+0000","last_became_active":"2024-09-12T00:03:27.340391+0000","last_became_peered":"2024-09-12T00:03:27.340391+0000","last_unstale":"2024-09-12T00:06:41.811828+0000","last_undegraded":"2024-09-12T00:06:41.811828+0000","last_fullsized":"2024-09-12T00:06:41.811828+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:10.048469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"96'49","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718472+0000","last_change":"2024-09-12T00:03:29.346823+0000","last_active":"2024-09-12T00:06:42.718472+0000","last_peered":"2024-09-12T00:06:42.718472+0000","last_clean":"2024-09-12T00:06:42.718472+0000","last_became_active":"2024-09-12T00:03:29.346066+0000","last_became_peered":"2024-09-12T00:03:29.346066+0000","last_unstale":"2024-09-12T00:06:42.718472+0000","last_undegraded":"2024-09-12T00:06:42.718472+0000","last_fullsized":"2024-09-12T00:06:42.718472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:12.080794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124550,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":47,"num_write":38,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810366+0000","last_change":"2024-09-12T00:03:31.348574+0000","last_active":"2024-09-12T00:06:41.810366+0000","last_peered":"2024-09-12T00:06:41.810366+0000","last_clean":"2024-09-12T00:06:41.810366+0000","last_became_active":"2024-09-12T00:03:31.346511+0000","last_became_peered":"2024-09-12T00:03:31.346511+0000","last_unstale":"2024-09-12T00:06:41.810366+0000","last_undegraded":"2024-09-12T00:06:41.810366+0000","last_fullsized":"2024-09-12T00:06:41.810366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:14.061486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"59'7","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066233+0000","last_change":"2024-09-12T00:03:33.385232+0000","last_active":"2024-09-12T00:06:42.066233+0000","last_peered":"2024-09-12T00:06:42.066233+0000","last_clean":"2024-09-12T00:06:42.066233+0000","last_became_active":"2024-09-12T00:03:33.384457+0000","last_became_peered":"2024-09-12T00:03:33.384457+0000","last_unstale":"2024-09-12T00:06:42.066233+0000","last_undegraded":"2024-09-12T00:06:42.066233+0000","last_fullsized":"2024-09-12T00:06:42.066233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:34.615256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"76'4","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721962+0000","last_change":"2024-09-12T00:03:25.334767+0000","last_active":"2024-09-12T00:06:42.721962+0000","last_peered":"2024-09-12T00:06:42.721962+0000","last_clean":"2024-09-12T00:06:42.721962+0000","last_became_active":"2024-09-12T00:03:25.332814+0000","last_became_peered":"2024-09-12T00:03:25.332814+0000","last_unstale":"2024-09-12T00:06:42.721962+0000","last_undegraded":"2024-09-12T00:06:42.721962+0000","last_fullsized":"2024-09-12T00:06:42.721962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"95'27","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721814+0000","last_change":"2024-09-12T00:03:23.628752+0000","last_active":"2024-09-12T00:06:42.721814+0000","last_peered":"2024-09-12T00:06:42.721814+0000","last_clean":"2024-09-12T00:06:42.721814+0000","last_became_active":"2024-09-12T00:03:23.628128+0000","last_became_peered":"2024-09-12T00:03:23.628128+0000","last_unstale":"2024-09-12T00:06:42.721814+0000","last_undegraded":"2024-09-12T00:06:42.721814+0000","last_fullsized":"2024-09-12T00:06:42.721814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720543+0000","last_change":"2024-09-12T00:06:26.679199+0000","last_active":"2024-09-12T00:06:42.720543+0000","last_peered":"2024-09-12T00:06:42.720543+0000","last_clean":"2024-09-12T00:06:42.720543+0000","last_became_active":"2024-09-12T00:06:26.675309+0000","last_became_peered":"2024-09-12T00:06:26.675309+0000","last_unstale":"2024-09-12T00:06:42.720543+0000","last_undegraded":"2024-09-12T00:06:42.720543+0000","last_fullsized":"2024-09-12T00:06:42.720543+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:56.980194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814664+0000","last_change":"2024-09-12T00:03:27.316317+0000","last_active":"2024-09-12T00:06:41.814664+0000","last_peered":"2024-09-12T00:06:41.814664+0000","last_clean":"2024-09-12T00:06:41.814664+0000","last_became_active":"2024-09-12T00:03:27.315704+0000","last_became_peered":"2024-09-12T00:03:27.315704+0000","last_unstale":"2024-09-12T00:06:41.814664+0000","last_undegraded":"2024-09-12T00:06:41.814664+0000","last_fullsized":"2024-09-12T00:06:41.814664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:07.883485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'20","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720264+0000","last_change":"2024-09-12T00:06:26.708588+0000","last_active":"2024-09-12T00:06:42.720264+0000","last_peered":"2024-09-12T00:06:42.720264+0000","last_clean":"2024-09-12T00:06:42.720264+0000","last_became_active":"2024-09-12T00:06:26.661284+0000","last_became_peered":"2024-09-12T00:06:26.661284+0000","last_unstale":"2024-09-12T00:06:42.720264+0000","last_undegraded":"2024-09-12T00:06:42.720264+0000","last_fullsized":"2024-09-12T00:06:42.720264+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:19.418779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"116'135","reported_seq":354,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.586307+0000","last_change":"2024-09-12T00:03:31.357011+0000","last_active":"2024-09-12T00:06:42.586307+0000","last_peered":"2024-09-12T00:06:42.586307+0000","last_clean":"2024-09-12T00:06:42.586307+0000","last_became_active":"2024-09-12T00:03:31.356108+0000","last_became_peered":"2024-09-12T00:03:31.356108+0000","last_unstale":"2024-09-12T00:06:42.586307+0000","last_undegraded":"2024-09-12T00:06:42.586307+0000","last_fullsized":"2024-09-12T00:06:42.586307+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"58'2","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723235+0000","last_change":"2024-09-12T00:03:33.372465+0000","last_active":"2024-09-12T00:06:42.723235+0000","last_peered":"2024-09-12T00:06:42.723235+0000","last_clean":"2024-09-12T00:06:42.723235+0000","last_became_active":"2024-09-12T00:03:33.371214+0000","last_became_peered":"2024-09-12T00:03:33.371214+0000","last_unstale":"2024-09-12T00:06:42.723235+0000","last_undegraded":"2024-09-12T00:06:42.723235+0000","last_fullsized":"2024-09-12T00:06:42.723235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:40.880933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"84'8","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810903+0000","last_change":"2024-09-12T00:03:25.332405+0000","last_active":"2024-09-12T00:06:41.810903+0000","last_peered":"2024-09-12T00:06:41.810903+0000","last_clean":"2024-09-12T00:06:41.810903+0000","last_became_active":"2024-09-12T00:03:25.331250+0000","last_became_peered":"2024-09-12T00:03:25.331250+0000","last_unstale":"2024-09-12T00:06:41.810903+0000","last_undegraded":"2024-09-12T00:06:41.810903+0000","last_fullsized":"2024-09-12T00:06:41.810903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"96'23","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813862+0000","last_change":"2024-09-12T00:03:23.602222+0000","last_active":"2024-09-12T00:06:41.813862+0000","last_peered":"2024-09-12T00:06:41.813862+0000","last_clean":"2024-09-12T00:06:41.813862+0000","last_became_active":"2024-09-12T00:03:23.601481+0000","last_became_peered":"2024-09-12T00:03:23.601481+0000","last_unstale":"2024-09-12T00:06:41.813862+0000","last_undegraded":"2024-09-12T00:06:41.813862+0000","last_fullsized":"2024-09-12T00:06:41.813862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:56.636638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813711+0000","last_change":"2024-09-12T00:03:18.716648+0000","last_active":"2024-09-12T00:06:41.813711+0000","last_peered":"2024-09-12T00:06:41.813711+0000","last_clean":"2024-09-12T00:06:41.813711+0000","last_became_active":"2024-09-12T00:03:16.594609+0000","last_became_peered":"2024-09-12T00:03:16.594609+0000","last_unstale":"2024-09-12T00:06:41.813711+0000","last_undegraded":"2024-09-12T00:06:41.813711+0000","last_fullsized":"2024-09-12T00:06:41.813711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:34.635008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010254439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721880+0000","last_change":"2024-09-12T00:06:26.648329+0000","last_active":"2024-09-12T00:06:42.721880+0000","last_peered":"2024-09-12T00:06:42.721880+0000","last_clean":"2024-09-12T00:06:42.721880+0000","last_became_active":"2024-09-12T00:06:26.647055+0000","last_became_peered":"2024-09-12T00:06:26.647055+0000","last_unstale":"2024-09-12T00:06:42.721880+0000","last_undegraded":"2024-09-12T00:06:42.721880+0000","last_fullsized":"2024-09-12T00:06:42.721880+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:35.147693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"58'18","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720951+0000","last_change":"2024-09-12T00:06:30.110628+0000","last_active":"2024-09-12T00:06:42.720951+0000","last_peered":"2024-09-12T00:06:42.720951+0000","last_clean":"2024-09-12T00:06:42.720951+0000","last_became_active":"2024-09-12T00:06:26.662450+0000","last_became_peered":"2024-09-12T00:06:26.662450+0000","last_unstale":"2024-09-12T00:06:42.720951+0000","last_undegraded":"2024-09-12T00:06:42.720951+0000","last_fullsized":"2024-09-12T00:06:42.720951+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:10.820458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"116'135","reported_seq":351,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.585684+0000","last_change":"2024-09-12T00:03:31.361616+0000","last_active":"2024-09-12T00:06:42.585684+0000","last_peered":"2024-09-12T00:06:42.585684+0000","last_clean":"2024-09-12T00:06:42.585684+0000","last_became_active":"2024-09-12T00:03:31.360518+0000","last_became_peered":"2024-09-12T00:03:31.360518+0000","last_unstale":"2024-09-12T00:06:42.585684+0000","last_undegraded":"2024-09-12T00:06:42.585684+0000","last_fullsized":"2024-09-12T00:06:42.585684+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:40.640537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065311+0000","last_change":"2024-09-12T00:03:33.378417+0000","last_active":"2024-09-12T00:06:42.065311+0000","last_peered":"2024-09-12T00:06:42.065311+0000","last_clean":"2024-09-12T00:06:42.065311+0000","last_became_active":"2024-09-12T00:03:33.377669+0000","last_became_peered":"2024-09-12T00:03:33.377669+0000","last_unstale":"2024-09-12T00:06:42.065311+0000","last_undegraded":"2024-09-12T00:06:42.065311+0000","last_fullsized":"2024-09-12T00:06:42.065311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:04.623906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811103+0000","last_change":"2024-09-12T00:06:26.714198+0000","last_active":"2024-09-12T00:06:41.811103+0000","last_peered":"2024-09-12T00:06:41.811103+0000","last_clean":"2024-09-12T00:06:41.811103+0000","last_became_active":"2024-09-12T00:06:26.662114+0000","last_became_peered":"2024-09-12T00:06:26.662114+0000","last_unstale":"2024-09-12T00:06:41.811103+0000","last_undegraded":"2024-09-12T00:06:41.811103+0000","last_fullsized":"2024-09-12T00:06:41.811103+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:41.029559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"96'24","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813511+0000","last_change":"2024-09-12T00:03:23.616319+0000","last_active":"2024-09-12T00:06:41.813511+0000","last_peered":"2024-09-12T00:06:41.813511+0000","last_clean":"2024-09-12T00:06:41.813511+0000","last_became_active":"2024-09-12T00:03:23.615158+0000","last_became_peered":"2024-09-12T00:03:23.615158+0000","last_unstale":"2024-09-12T00:06:41.813511+0000","last_undegraded":"2024-09-12T00:06:41.813511+0000","last_fullsized":"2024-09-12T00:06:41.813511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:15.677228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719839+0000","last_change":"2024-09-12T00:06:26.680801+0000","last_active":"2024-09-12T00:06:42.719839+0000","last_peered":"2024-09-12T00:06:42.719839+0000","last_clean":"2024-09-12T00:06:42.719839+0000","last_became_active":"2024-09-12T00:06:26.677544+0000","last_became_peered":"2024-09-12T00:06:26.677544+0000","last_unstale":"2024-09-12T00:06:42.719839+0000","last_undegraded":"2024-09-12T00:06:42.719839+0000","last_fullsized":"2024-09-12T00:06:42.719839+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:43.976666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810348+0000","last_change":"2024-09-12T00:03:27.337359+0000","last_active":"2024-09-12T00:06:41.810348+0000","last_peered":"2024-09-12T00:06:41.810348+0000","last_clean":"2024-09-12T00:06:41.810348+0000","last_became_active":"2024-09-12T00:03:27.336289+0000","last_became_peered":"2024-09-12T00:03:27.336289+0000","last_unstale":"2024-09-12T00:06:41.810348+0000","last_undegraded":"2024-09-12T00:06:41.810348+0000","last_fullsized":"2024-09-12T00:06:41.810348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:39.147272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"96'50","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809455+0000","last_change":"2024-09-12T00:03:29.344621+0000","last_active":"2024-09-12T00:06:41.809455+0000","last_peered":"2024-09-12T00:06:41.809455+0000","last_clean":"2024-09-12T00:06:41.809455+0000","last_became_active":"2024-09-12T00:03:29.343779+0000","last_became_peered":"2024-09-12T00:03:29.343779+0000","last_unstale":"2024-09-12T00:06:41.809455+0000","last_undegraded":"2024-09-12T00:06:41.809455+0000","last_fullsized":"2024-09-12T00:06:41.809455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:49.518432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811176+0000","last_change":"2024-09-12T00:03:31.335460+0000","last_active":"2024-09-12T00:06:41.811176+0000","last_peered":"2024-09-12T00:06:41.811176+0000","last_clean":"2024-09-12T00:06:41.811176+0000","last_became_active":"2024-09-12T00:03:31.334701+0000","last_became_peered":"2024-09-12T00:03:31.334701+0000","last_unstale":"2024-09-12T00:06:41.811176+0000","last_undegraded":"2024-09-12T00:06:41.811176+0000","last_fullsized":"2024-09-12T00:06:41.811176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:28.484366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"58'4","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812236+0000","last_change":"2024-09-12T00:03:33.386404+0000","last_active":"2024-09-12T00:06:41.812236+0000","last_peered":"2024-09-12T00:06:41.812236+0000","last_clean":"2024-09-12T00:06:41.812236+0000","last_became_active":"2024-09-12T00:03:33.385090+0000","last_became_peered":"2024-09-12T00:03:33.385090+0000","last_unstale":"2024-09-12T00:06:41.812236+0000","last_undegraded":"2024-09-12T00:06:41.812236+0000","last_fullsized":"2024-09-12T00:06:41.812236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"96'2","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813204+0000","last_change":"2024-09-12T00:03:33.361690+0000","last_active":"2024-09-12T00:06:41.813204+0000","last_peered":"2024-09-12T00:06:41.813204+0000","last_clean":"2024-09-12T00:06:41.813204+0000","last_became_active":"2024-09-12T00:03:33.360980+0000","last_became_peered":"2024-09-12T00:03:33.360980+0000","last_unstale":"2024-09-12T00:06:41.813204+0000","last_undegraded":"2024-09-12T00:06:41.813204+0000","last_fullsized":"2024-09-12T00:06:41.813204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:24.954577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"59'2","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813869+0000","last_change":"2024-09-12T00:06:28.274587+0000","last_active":"2024-09-12T00:06:41.813869+0000","last_peered":"2024-09-12T00:06:41.813869+0000","last_clean":"2024-09-12T00:06:41.813869+0000","last_became_active":"2024-09-12T00:06:26.664337+0000","last_became_peered":"2024-09-12T00:06:26.664337+0000","last_unstale":"2024-09-12T00:06:41.813869+0000","last_undegraded":"2024-09-12T00:06:41.813869+0000","last_fullsized":"2024-09-12T00:06:41.813869+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:00.552692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"95'30","reported_seq":103,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717433+0000","last_change":"2024-09-12T00:06:30.093257+0000","last_active":"2024-09-12T00:06:42.717433+0000","last_peered":"2024-09-12T00:06:42.717433+0000","last_clean":"2024-09-12T00:06:42.717433+0000","last_became_active":"2024-09-12T00:06:26.671623+0000","last_became_peered":"2024-09-12T00:06:26.671623+0000","last_unstale":"2024-09-12T00:06:42.717433+0000","last_undegraded":"2024-09-12T00:06:42.717433+0000","last_fullsized":"2024-09-12T00:06:42.717433+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:02.454592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":201326592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"28'2","reported_seq":367,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722728+0000","last_change":"2024-09-12T00:03:27.332281+0000","last_active":"2024-09-12T00:06:42.722728+0000","last_peered":"2024-09-12T00:06:42.722728+0000","last_clean":"2024-09-12T00:06:42.722728+0000","last_became_active":"2024-09-12T00:03:27.331527+0000","last_became_peered":"2024-09-12T00:03:27.331527+0000","last_unstale":"2024-09-12T00:06:42.722728+0000","last_undegraded":"2024-09-12T00:06:42.722728+0000","last_fullsized":"2024-09-12T00:06:42.722728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":266,"num_read_kb":266,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"96'25","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720005+0000","last_change":"2024-09-12T00:03:29.338655+0000","last_active":"2024-09-12T00:06:42.720005+0000","last_peered":"2024-09-12T00:06:42.720005+0000","last_clean":"2024-09-12T00:06:42.720005+0000","last_became_active":"2024-09-12T00:03:29.337905+0000","last_became_peered":"2024-09-12T00:03:29.337905+0000","last_unstale":"2024-09-12T00:06:42.720005+0000","last_undegraded":"2024-09-12T00:06:42.720005+0000","last_fullsized":"2024-09-12T00:06:42.720005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718441+0000","last_change":"2024-09-12T00:03:31.351716+0000","last_active":"2024-09-12T00:06:42.718441+0000","last_peered":"2024-09-12T00:06:42.718441+0000","last_clean":"2024-09-12T00:06:42.718441+0000","last_became_active":"2024-09-12T00:03:31.350917+0000","last_became_peered":"2024-09-12T00:03:31.350917+0000","last_unstale":"2024-09-12T00:06:42.718441+0000","last_undegraded":"2024-09-12T00:06:42.718441+0000","last_fullsized":"2024-09-12T00:06:42.718441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:45.880820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722942+0000","last_change":"2024-09-12T00:03:33.374233+0000","last_active":"2024-09-12T00:06:42.722942+0000","last_peered":"2024-09-12T00:06:42.722942+0000","last_clean":"2024-09-12T00:06:42.722942+0000","last_became_active":"2024-09-12T00:03:33.373466+0000","last_became_peered":"2024-09-12T00:03:33.373466+0000","last_unstale":"2024-09-12T00:06:42.722942+0000","last_undegraded":"2024-09-12T00:06:42.722942+0000","last_fullsized":"2024-09-12T00:06:42.722942+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:55.598892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"59'2","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811077+0000","last_change":"2024-09-12T00:06:28.295394+0000","last_active":"2024-09-12T00:06:41.811077+0000","last_peered":"2024-09-12T00:06:41.811077+0000","last_clean":"2024-09-12T00:06:41.811077+0000","last_became_active":"2024-09-12T00:06:26.664003+0000","last_became_peered":"2024-09-12T00:06:26.664003+0000","last_unstale":"2024-09-12T00:06:41.811077+0000","last_undegraded":"2024-09-12T00:06:41.811077+0000","last_fullsized":"2024-09-12T00:06:41.811077+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:22.616662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"95'23","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816608+0000","last_change":"2024-09-12T00:03:23.613274+0000","last_active":"2024-09-12T00:06:41.816608+0000","last_peered":"2024-09-12T00:06:41.816608+0000","last_clean":"2024-09-12T00:06:41.816608+0000","last_became_active":"2024-09-12T00:03:23.612941+0000","last_became_peered":"2024-09-12T00:03:23.612941+0000","last_unstale":"2024-09-12T00:06:41.816608+0000","last_undegraded":"2024-09-12T00:06:41.816608+0000","last_fullsized":"2024-09-12T00:06:41.816608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:56.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811543+0000","last_change":"2024-09-12T00:03:27.336144+0000","last_active":"2024-09-12T00:06:41.811543+0000","last_peered":"2024-09-12T00:06:41.811543+0000","last_clean":"2024-09-12T00:06:41.811543+0000","last_became_active":"2024-09-12T00:03:27.335372+0000","last_became_peered":"2024-09-12T00:03:27.335372+0000","last_unstale":"2024-09-12T00:06:41.811543+0000","last_undegraded":"2024-09-12T00:06:41.811543+0000","last_fullsized":"2024-09-12T00:06:41.811543+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:33.978665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"108'11","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809960+0000","last_change":"2024-09-12T00:03:29.332051+0000","last_active":"2024-09-12T00:06:41.809960+0000","last_peered":"2024-09-12T00:06:41.809960+0000","last_clean":"2024-09-12T00:06:41.809960+0000","last_became_active":"2024-09-12T00:03:29.331243+0000","last_became_peered":"2024-09-12T00:03:29.331243+0000","last_unstale":"2024-09-12T00:06:41.809960+0000","last_undegraded":"2024-09-12T00:06:41.809960+0000","last_fullsized":"2024-09-12T00:06:41.809960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:52.544770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810109+0000","last_change":"2024-09-12T00:03:31.347021+0000","last_active":"2024-09-12T00:06:41.810109+0000","last_peered":"2024-09-12T00:06:41.810109+0000","last_clean":"2024-09-12T00:06:41.810109+0000","last_became_active":"2024-09-12T00:03:31.344407+0000","last_became_peered":"2024-09-12T00:03:31.344407+0000","last_unstale":"2024-09-12T00:06:41.810109+0000","last_undegraded":"2024-09-12T00:06:41.810109+0000","last_fullsized":"2024-09-12T00:06:41.810109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:32.139742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"84'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719370+0000","last_change":"2024-09-12T00:03:33.370271+0000","last_active":"2024-09-12T00:06:42.719370+0000","last_peered":"2024-09-12T00:06:42.719370+0000","last_clean":"2024-09-12T00:06:42.719370+0000","last_became_active":"2024-09-12T00:03:33.369538+0000","last_became_peered":"2024-09-12T00:03:33.369538+0000","last_unstale":"2024-09-12T00:06:42.719370+0000","last_undegraded":"2024-09-12T00:06:42.719370+0000","last_fullsized":"2024-09-12T00:06:42.719370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"59'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810693+0000","last_change":"2024-09-12T00:03:25.341025+0000","last_active":"2024-09-12T00:06:41.810693+0000","last_peered":"2024-09-12T00:06:41.810693+0000","last_clean":"2024-09-12T00:06:41.810693+0000","last_became_active":"2024-09-12T00:03:25.340288+0000","last_became_peered":"2024-09-12T00:03:25.340288+0000","last_unstale":"2024-09-12T00:06:41.810693+0000","last_undegraded":"2024-09-12T00:06:41.810693+0000","last_fullsized":"2024-09-12T00:06:41.810693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"96'29","reported_seq":330,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814348+0000","last_change":"2024-09-12T00:06:30.098997+0000","last_active":"2024-09-12T00:06:41.814348+0000","last_peered":"2024-09-12T00:06:41.814348+0000","last_clean":"2024-09-12T00:06:41.814348+0000","last_became_active":"2024-09-12T00:06:26.672172+0000","last_became_peered":"2024-09-12T00:06:26.672172+0000","last_unstale":"2024-09-12T00:06:41.814348+0000","last_undegraded":"2024-09-12T00:06:41.814348+0000","last_fullsized":"2024-09-12T00:06:41.814348+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:32.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810614+0000","last_change":"2024-09-12T00:03:27.329869+0000","last_active":"2024-09-12T00:06:41.810614+0000","last_peered":"2024-09-12T00:06:41.810614+0000","last_clean":"2024-09-12T00:06:41.810614+0000","last_became_active":"2024-09-12T00:03:27.329077+0000","last_became_peered":"2024-09-12T00:03:27.329077+0000","last_unstale":"2024-09-12T00:06:41.810614+0000","last_undegraded":"2024-09-12T00:06:41.810614+0000","last_fullsized":"2024-09-12T00:06:41.810614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"96'19","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720203+0000","last_change":"2024-09-12T00:03:29.346878+0000","last_active":"2024-09-12T00:06:42.720203+0000","last_peered":"2024-09-12T00:06:42.720203+0000","last_clean":"2024-09-12T00:06:42.720203+0000","last_became_active":"2024-09-12T00:03:29.345990+0000","last_became_peered":"2024-09-12T00:03:29.345990+0000","last_unstale":"2024-09-12T00:06:42.720203+0000","last_undegraded":"2024-09-12T00:06:42.720203+0000","last_fullsized":"2024-09-12T00:06:42.720203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:06.398979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499961+0000","last_change":"2024-09-12T00:03:31.363658+0000","last_active":"2024-09-12T00:06:42.499961+0000","last_peered":"2024-09-12T00:06:42.499961+0000","last_clean":"2024-09-12T00:06:42.499961+0000","last_became_active":"2024-09-12T00:03:31.363080+0000","last_became_peered":"2024-09-12T00:03:31.363080+0000","last_unstale":"2024-09-12T00:06:42.499961+0000","last_undegraded":"2024-09-12T00:06:42.499961+0000","last_fullsized":"2024-09-12T00:06:42.499961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:05.901608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717550+0000","last_change":"2024-09-12T00:06:26.673691+0000","last_active":"2024-09-12T00:06:42.717550+0000","last_peered":"2024-09-12T00:06:42.717550+0000","last_clean":"2024-09-12T00:06:42.717550+0000","last_became_active":"2024-09-12T00:06:26.669877+0000","last_became_peered":"2024-09-12T00:06:26.669877+0000","last_unstale":"2024-09-12T00:06:42.717550+0000","last_undegraded":"2024-09-12T00:06:42.717550+0000","last_fullsized":"2024-09-12T00:06:42.717550+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:02.798560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"59'2","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718800+0000","last_change":"2024-09-12T00:06:26.687219+0000","last_active":"2024-09-12T00:06:42.718800+0000","last_peered":"2024-09-12T00:06:42.718800+0000","last_clean":"2024-09-12T00:06:42.718800+0000","last_became_active":"2024-09-12T00:06:26.655483+0000","last_became_peered":"2024-09-12T00:06:26.655483+0000","last_unstale":"2024-09-12T00:06:42.718800+0000","last_undegraded":"2024-09-12T00:06:42.718800+0000","last_fullsized":"2024-09-12T00:06:42.718800+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:21.199336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"96'22","reported_seq":299,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067870+0000","last_change":"2024-09-12T00:06:27.905793+0000","last_active":"2024-09-12T00:06:42.067870+0000","last_peered":"2024-09-12T00:06:42.067870+0000","last_clean":"2024-09-12T00:06:42.067870+0000","last_became_active":"2024-09-12T00:06:26.664617+0000","last_became_peered":"2024-09-12T00:06:26.664617+0000","last_unstale":"2024-09-12T00:06:42.067870+0000","last_undegraded":"2024-09-12T00:06:42.067870+0000","last_fullsized":"2024-09-12T00:06:42.067870+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:23.455040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":142606336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717842+0000","last_change":"2024-09-12T00:06:26.663673+0000","last_active":"2024-09-12T00:06:42.717842+0000","last_peered":"2024-09-12T00:06:42.717842+0000","last_clean":"2024-09-12T00:06:42.717842+0000","last_became_active":"2024-09-12T00:06:26.663351+0000","last_became_peered":"2024-09-12T00:06:26.663351+0000","last_unstale":"2024-09-12T00:06:42.717842+0000","last_undegraded":"2024-09-12T00:06:42.717842+0000","last_fullsized":"2024-09-12T00:06:42.717842+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:58.342457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"96'18","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814520+0000","last_change":"2024-09-12T00:03:29.346312+0000","last_active":"2024-09-12T00:06:41.814520+0000","last_peered":"2024-09-12T00:06:41.814520+0000","last_clean":"2024-09-12T00:06:41.814520+0000","last_became_active":"2024-09-12T00:03:29.345883+0000","last_became_peered":"2024-09-12T00:03:29.345883+0000","last_unstale":"2024-09-12T00:06:41.814520+0000","last_undegraded":"2024-09-12T00:06:41.814520+0000","last_fullsized":"2024-09-12T00:06:41.814520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:46.723370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719592+0000","last_change":"2024-09-12T00:03:31.358786+0000","last_active":"2024-09-12T00:06:42.719592+0000","last_peered":"2024-09-12T00:06:42.719592+0000","last_clean":"2024-09-12T00:06:42.719592+0000","last_became_active":"2024-09-12T00:03:31.358011+0000","last_became_peered":"2024-09-12T00:03:31.358011+0000","last_unstale":"2024-09-12T00:06:42.719592+0000","last_undegraded":"2024-09-12T00:06:42.719592+0000","last_fullsized":"2024-09-12T00:06:42.719592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:29.394163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"59'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720085+0000","last_change":"2024-09-12T00:06:28.364181+0000","last_active":"2024-09-12T00:06:42.720085+0000","last_peered":"2024-09-12T00:06:42.720085+0000","last_clean":"2024-09-12T00:06:42.720085+0000","last_became_active":"2024-09-12T00:06:26.667552+0000","last_became_peered":"2024-09-12T00:06:26.667552+0000","last_unstale":"2024-09-12T00:06:42.720085+0000","last_undegraded":"2024-09-12T00:06:42.720085+0000","last_fullsized":"2024-09-12T00:06:42.720085+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:19.435061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"96'23","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064267+0000","last_change":"2024-09-12T00:03:23.627584+0000","last_active":"2024-09-12T00:06:42.064267+0000","last_peered":"2024-09-12T00:06:42.064267+0000","last_clean":"2024-09-12T00:06:42.064267+0000","last_became_active":"2024-09-12T00:03:23.626026+0000","last_became_peered":"2024-09-12T00:03:23.626026+0000","last_unstale":"2024-09-12T00:06:42.064267+0000","last_undegraded":"2024-09-12T00:06:42.064267+0000","last_fullsized":"2024-09-12T00:06:42.064267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:38.192583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720246+0000","last_change":"2024-09-12T00:06:26.671971+0000","last_active":"2024-09-12T00:06:42.720246+0000","last_peered":"2024-09-12T00:06:42.720246+0000","last_clean":"2024-09-12T00:06:42.720246+0000","last_became_active":"2024-09-12T00:06:26.671427+0000","last_became_peered":"2024-09-12T00:06:26.671427+0000","last_unstale":"2024-09-12T00:06:42.720246+0000","last_undegraded":"2024-09-12T00:06:42.720246+0000","last_fullsized":"2024-09-12T00:06:42.720246+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:22.897492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"96'35","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720971+0000","last_change":"2024-09-12T00:03:29.340387+0000","last_active":"2024-09-12T00:06:42.720971+0000","last_peered":"2024-09-12T00:06:42.720971+0000","last_clean":"2024-09-12T00:06:42.720971+0000","last_became_active":"2024-09-12T00:03:29.339781+0000","last_became_peered":"2024-09-12T00:03:29.339781+0000","last_unstale":"2024-09-12T00:06:42.720971+0000","last_undegraded":"2024-09-12T00:06:42.720971+0000","last_fullsized":"2024-09-12T00:06:42.720971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:30.132716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811392+0000","last_change":"2024-09-12T00:03:31.350303+0000","last_active":"2024-09-12T00:06:41.811392+0000","last_peered":"2024-09-12T00:06:41.811392+0000","last_clean":"2024-09-12T00:06:41.811392+0000","last_became_active":"2024-09-12T00:03:31.349591+0000","last_became_peered":"2024-09-12T00:03:31.349591+0000","last_unstale":"2024-09-12T00:06:41.811392+0000","last_undegraded":"2024-09-12T00:06:41.811392+0000","last_fullsized":"2024-09-12T00:06:41.811392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:00.263644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"96'4","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065021+0000","last_change":"2024-09-12T00:03:33.385028+0000","last_active":"2024-09-12T00:06:42.065021+0000","last_peered":"2024-09-12T00:06:42.065021+0000","last_clean":"2024-09-12T00:06:42.065021+0000","last_became_active":"2024-09-12T00:03:33.384274+0000","last_became_peered":"2024-09-12T00:03:33.384274+0000","last_unstale":"2024-09-12T00:06:42.065021+0000","last_undegraded":"2024-09-12T00:06:42.065021+0000","last_fullsized":"2024-09-12T00:06:42.065021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:11.634604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"58'2","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813365+0000","last_change":"2024-09-12T00:03:25.329888+0000","last_active":"2024-09-12T00:06:41.813365+0000","last_peered":"2024-09-12T00:06:41.813365+0000","last_clean":"2024-09-12T00:06:41.813365+0000","last_became_active":"2024-09-12T00:03:25.329151+0000","last_became_peered":"2024-09-12T00:03:25.329151+0000","last_unstale":"2024-09-12T00:06:41.813365+0000","last_undegraded":"2024-09-12T00:06:41.813365+0000","last_fullsized":"2024-09-12T00:06:41.813365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:47.272383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"96'25","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811321+0000","last_change":"2024-09-12T00:03:23.600146+0000","last_active":"2024-09-12T00:06:41.811321+0000","last_peered":"2024-09-12T00:06:41.811321+0000","last_clean":"2024-09-12T00:06:41.811321+0000","last_became_active":"2024-09-12T00:03:23.598862+0000","last_became_peered":"2024-09-12T00:03:23.598862+0000","last_unstale":"2024-09-12T00:06:41.811321+0000","last_undegraded":"2024-09-12T00:06:41.811321+0000","last_fullsized":"2024-09-12T00:06:41.811321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:13.330852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813925+0000","last_change":"2024-09-12T00:03:27.341032+0000","last_active":"2024-09-12T00:06:41.813925+0000","last_peered":"2024-09-12T00:06:41.813925+0000","last_clean":"2024-09-12T00:06:41.813925+0000","last_became_active":"2024-09-12T00:03:27.340199+0000","last_became_peered":"2024-09-12T00:03:27.340199+0000","last_unstale":"2024-09-12T00:06:41.813925+0000","last_undegraded":"2024-09-12T00:06:41.813925+0000","last_fullsized":"2024-09-12T00:06:41.813925+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:23.673080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"96'24","reported_seq":57,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717487+0000","last_change":"2024-09-12T00:06:31.054703+0000","last_active":"2024-09-12T00:06:42.717487+0000","last_peered":"2024-09-12T00:06:42.717487+0000","last_clean":"2024-09-12T00:06:42.717487+0000","last_became_active":"2024-09-12T00:06:26.675513+0000","last_became_peered":"2024-09-12T00:06:26.675513+0000","last_unstale":"2024-09-12T00:06:42.717487+0000","last_undegraded":"2024-09-12T00:06:42.717487+0000","last_fullsized":"2024-09-12T00:06:42.717487+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:56.604086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065828+0000","last_change":"2024-09-12T00:06:26.678166+0000","last_active":"2024-09-12T00:06:42.065828+0000","last_peered":"2024-09-12T00:06:42.065828+0000","last_clean":"2024-09-12T00:06:42.065828+0000","last_became_active":"2024-09-12T00:06:26.677049+0000","last_became_peered":"2024-09-12T00:06:26.677049+0000","last_unstale":"2024-09-12T00:06:42.065828+0000","last_undegraded":"2024-09-12T00:06:42.065828+0000","last_fullsized":"2024-09-12T00:06:42.065828+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:26.729678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"59'3","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721092+0000","last_change":"2024-09-12T00:06:32.445889+0000","last_active":"2024-09-12T00:06:42.721092+0000","last_peered":"2024-09-12T00:06:42.721092+0000","last_clean":"2024-09-12T00:06:42.721092+0000","last_became_active":"2024-09-12T00:06:26.677859+0000","last_became_peered":"2024-09-12T00:06:26.677859+0000","last_unstale":"2024-09-12T00:06:42.721092+0000","last_undegraded":"2024-09-12T00:06:42.721092+0000","last_fullsized":"2024-09-12T00:06:42.721092+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:56.789846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"59'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722541+0000","last_change":"2024-09-12T00:03:25.360355+0000","last_active":"2024-09-12T00:06:42.722541+0000","last_peered":"2024-09-12T00:06:42.722541+0000","last_clean":"2024-09-12T00:06:42.722541+0000","last_became_active":"2024-09-12T00:03:25.359682+0000","last_became_peered":"2024-09-12T00:03:25.359682+0000","last_unstale":"2024-09-12T00:06:42.722541+0000","last_undegraded":"2024-09-12T00:06:42.722541+0000","last_fullsized":"2024-09-12T00:06:42.722541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:11.808081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"96'20","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500616+0000","last_change":"2024-09-12T00:03:23.621199+0000","last_active":"2024-09-12T00:06:42.500616+0000","last_peered":"2024-09-12T00:06:42.500616+0000","last_clean":"2024-09-12T00:06:42.500616+0000","last_became_active":"2024-09-12T00:03:23.620961+0000","last_became_peered":"2024-09-12T00:03:23.620961+0000","last_unstale":"2024-09-12T00:06:42.500616+0000","last_undegraded":"2024-09-12T00:06:42.500616+0000","last_fullsized":"2024-09-12T00:06:42.500616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811166+0000","last_change":"2024-09-12T00:03:27.336918+0000","last_active":"2024-09-12T00:06:41.811166+0000","last_peered":"2024-09-12T00:06:41.811166+0000","last_clean":"2024-09-12T00:06:41.811166+0000","last_became_active":"2024-09-12T00:03:27.336045+0000","last_became_peered":"2024-09-12T00:03:27.336045+0000","last_unstale":"2024-09-12T00:06:41.811166+0000","last_undegraded":"2024-09-12T00:06:41.811166+0000","last_fullsized":"2024-09-12T00:06:41.811166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"96'25","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720072+0000","last_change":"2024-09-12T00:03:29.338667+0000","last_active":"2024-09-12T00:06:42.720072+0000","last_peered":"2024-09-12T00:06:42.720072+0000","last_clean":"2024-09-12T00:06:42.720072+0000","last_became_active":"2024-09-12T00:03:29.338010+0000","last_became_peered":"2024-09-12T00:03:29.338010+0000","last_unstale":"2024-09-12T00:06:42.720072+0000","last_undegraded":"2024-09-12T00:06:42.720072+0000","last_fullsized":"2024-09-12T00:06:42.720072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:58.256619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722902+0000","last_change":"2024-09-12T00:03:31.352823+0000","last_active":"2024-09-12T00:06:42.722902+0000","last_peered":"2024-09-12T00:06:42.722902+0000","last_clean":"2024-09-12T00:06:42.722902+0000","last_became_active":"2024-09-12T00:03:31.352143+0000","last_became_peered":"2024-09-12T00:03:31.352143+0000","last_unstale":"2024-09-12T00:06:42.722902+0000","last_undegraded":"2024-09-12T00:06:42.722902+0000","last_fullsized":"2024-09-12T00:06:42.722902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:25.168692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"76'8","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721671+0000","last_change":"2024-09-12T00:06:27.901313+0000","last_active":"2024-09-12T00:06:42.721671+0000","last_peered":"2024-09-12T00:06:42.721671+0000","last_clean":"2024-09-12T00:06:42.721671+0000","last_became_active":"2024-09-12T00:06:26.658281+0000","last_became_peered":"2024-09-12T00:06:26.658281+0000","last_unstale":"2024-09-12T00:06:42.721671+0000","last_undegraded":"2024-09-12T00:06:42.721671+0000","last_fullsized":"2024-09-12T00:06:42.721671+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:54.959771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"58'2","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812806+0000","last_change":"2024-09-12T00:03:25.325094+0000","last_active":"2024-09-12T00:06:41.812806+0000","last_peered":"2024-09-12T00:06:41.812806+0000","last_clean":"2024-09-12T00:06:41.812806+0000","last_became_active":"2024-09-12T00:03:25.324315+0000","last_became_peered":"2024-09-12T00:03:25.324315+0000","last_unstale":"2024-09-12T00:06:41.812806+0000","last_undegraded":"2024-09-12T00:06:41.812806+0000","last_fullsized":"2024-09-12T00:06:41.812806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:18.727732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"96'27","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812410+0000","last_change":"2024-09-12T00:03:23.606163+0000","last_active":"2024-09-12T00:06:41.812410+0000","last_peered":"2024-09-12T00:06:41.812410+0000","last_clean":"2024-09-12T00:06:41.812410+0000","last_became_active":"2024-09-12T00:03:23.605402+0000","last_became_peered":"2024-09-12T00:03:23.605402+0000","last_unstale":"2024-09-12T00:06:41.812410+0000","last_undegraded":"2024-09-12T00:06:41.812410+0000","last_fullsized":"2024-09-12T00:06:41.812410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:02.432313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812917+0000","last_change":"2024-09-12T00:03:27.336716+0000","last_active":"2024-09-12T00:06:41.812917+0000","last_peered":"2024-09-12T00:06:41.812917+0000","last_clean":"2024-09-12T00:06:41.812917+0000","last_became_active":"2024-09-12T00:03:27.335658+0000","last_became_peered":"2024-09-12T00:03:27.335658+0000","last_unstale":"2024-09-12T00:06:41.812917+0000","last_undegraded":"2024-09-12T00:06:41.812917+0000","last_fullsized":"2024-09-12T00:06:41.812917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:47.355798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"35'16","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720503+0000","last_change":"2024-09-12T00:06:29.533440+0000","last_active":"2024-09-12T00:06:42.720503+0000","last_peered":"2024-09-12T00:06:42.720503+0000","last_clean":"2024-09-12T00:06:42.720503+0000","last_became_active":"2024-09-12T00:06:26.671893+0000","last_became_peered":"2024-09-12T00:06:26.671893+0000","last_unstale":"2024-09-12T00:06:42.720503+0000","last_undegraded":"2024-09-12T00:06:42.720503+0000","last_fullsized":"2024-09-12T00:06:42.720503+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:10.667822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"116'135","reported_seq":354,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.585763+0000","last_change":"2024-09-12T00:03:31.351362+0000","last_active":"2024-09-12T00:06:42.585763+0000","last_peered":"2024-09-12T00:06:42.585763+0000","last_clean":"2024-09-12T00:06:42.585763+0000","last_became_active":"2024-09-12T00:03:31.350925+0000","last_became_peered":"2024-09-12T00:03:31.350925+0000","last_unstale":"2024-09-12T00:06:42.585763+0000","last_undegraded":"2024-09-12T00:06:42.585763+0000","last_fullsized":"2024-09-12T00:06:42.585763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:03.147968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719766+0000","last_change":"2024-09-12T00:06:26.675599+0000","last_active":"2024-09-12T00:06:42.719766+0000","last_peered":"2024-09-12T00:06:42.719766+0000","last_clean":"2024-09-12T00:06:42.719766+0000","last_became_active":"2024-09-12T00:06:26.675234+0000","last_became_peered":"2024-09-12T00:06:26.675234+0000","last_unstale":"2024-09-12T00:06:42.719766+0000","last_undegraded":"2024-09-12T00:06:42.719766+0000","last_fullsized":"2024-09-12T00:06:42.719766+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:28.887412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"59'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812590+0000","last_change":"2024-09-12T00:03:25.357999+0000","last_active":"2024-09-12T00:06:41.812590+0000","last_peered":"2024-09-12T00:06:41.812590+0000","last_clean":"2024-09-12T00:06:41.812590+0000","last_became_active":"2024-09-12T00:03:25.357623+0000","last_became_peered":"2024-09-12T00:03:25.357623+0000","last_unstale":"2024-09-12T00:06:41.812590+0000","last_undegraded":"2024-09-12T00:06:41.812590+0000","last_fullsized":"2024-09-12T00:06:41.812590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"96'29","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500852+0000","last_change":"2024-09-12T00:03:23.605954+0000","last_active":"2024-09-12T00:06:42.500852+0000","last_peered":"2024-09-12T00:06:42.500852+0000","last_clean":"2024-09-12T00:06:42.500852+0000","last_became_active":"2024-09-12T00:03:23.604773+0000","last_became_peered":"2024-09-12T00:03:23.604773+0000","last_unstale":"2024-09-12T00:06:42.500852+0000","last_undegraded":"2024-09-12T00:06:42.500852+0000","last_fullsized":"2024-09-12T00:06:42.500852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500071+0000","last_change":"2024-09-12T00:03:27.346785+0000","last_active":"2024-09-12T00:06:42.500071+0000","last_peered":"2024-09-12T00:06:42.500071+0000","last_clean":"2024-09-12T00:06:42.500071+0000","last_became_active":"2024-09-12T00:03:27.346168+0000","last_became_peered":"2024-09-12T00:03:27.346168+0000","last_unstale":"2024-09-12T00:06:42.500071+0000","last_undegraded":"2024-09-12T00:06:42.500071+0000","last_fullsized":"2024-09-12T00:06:42.500071+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"96'49","reported_seq":267,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811988+0000","last_change":"2024-09-12T00:03:29.343942+0000","last_active":"2024-09-12T00:06:41.811988+0000","last_peered":"2024-09-12T00:06:41.811988+0000","last_clean":"2024-09-12T00:06:41.811988+0000","last_became_active":"2024-09-12T00:03:29.343238+0000","last_became_peered":"2024-09-12T00:03:29.343238+0000","last_unstale":"2024-09-12T00:06:41.811988+0000","last_undegraded":"2024-09-12T00:06:41.811988+0000","last_fullsized":"2024-09-12T00:06:41.811988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:30.949892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810193+0000","last_change":"2024-09-12T00:06:26.655176+0000","last_active":"2024-09-12T00:06:41.810193+0000","last_peered":"2024-09-12T00:06:41.810193+0000","last_clean":"2024-09-12T00:06:41.810193+0000","last_became_active":"2024-09-12T00:06:26.654187+0000","last_became_peered":"2024-09-12T00:06:26.654187+0000","last_unstale":"2024-09-12T00:06:41.810193+0000","last_undegraded":"2024-09-12T00:06:41.810193+0000","last_fullsized":"2024-09-12T00:06:41.810193+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:58.719162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501328+0000","last_change":"2024-09-12T00:03:33.363188+0000","last_active":"2024-09-12T00:06:42.501328+0000","last_peered":"2024-09-12T00:06:42.501328+0000","last_clean":"2024-09-12T00:06:42.501328+0000","last_became_active":"2024-09-12T00:03:33.360672+0000","last_became_peered":"2024-09-12T00:03:33.360672+0000","last_unstale":"2024-09-12T00:06:42.501328+0000","last_undegraded":"2024-09-12T00:06:42.501328+0000","last_fullsized":"2024-09-12T00:06:42.501328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:33.646117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"59'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811812+0000","last_change":"2024-09-12T00:03:25.336626+0000","last_active":"2024-09-12T00:06:41.811812+0000","last_peered":"2024-09-12T00:06:41.811812+0000","last_clean":"2024-09-12T00:06:41.811812+0000","last_became_active":"2024-09-12T00:03:25.336095+0000","last_became_peered":"2024-09-12T00:03:25.336095+0000","last_unstale":"2024-09-12T00:06:41.811812+0000","last_undegraded":"2024-09-12T00:06:41.811812+0000","last_fullsized":"2024-09-12T00:06:41.811812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"95'26","reported_seq":95,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720356+0000","last_change":"2024-09-12T00:06:32.976777+0000","last_active":"2024-09-12T00:06:42.720356+0000","last_peered":"2024-09-12T00:06:42.720356+0000","last_clean":"2024-09-12T00:06:42.720356+0000","last_became_active":"2024-09-12T00:06:26.678646+0000","last_became_peered":"2024-09-12T00:06:26.678646+0000","last_unstale":"2024-09-12T00:06:42.720356+0000","last_undegraded":"2024-09-12T00:06:42.720356+0000","last_fullsized":"2024-09-12T00:06:42.720356+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:02.624469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":192937984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812464+0000","last_change":"2024-09-12T00:03:27.326174+0000","last_active":"2024-09-12T00:06:41.812464+0000","last_peered":"2024-09-12T00:06:41.812464+0000","last_clean":"2024-09-12T00:06:41.812464+0000","last_became_active":"2024-09-12T00:03:27.325336+0000","last_became_peered":"2024-09-12T00:03:27.325336+0000","last_unstale":"2024-09-12T00:06:41.812464+0000","last_undegraded":"2024-09-12T00:06:41.812464+0000","last_fullsized":"2024-09-12T00:06:41.812464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:08.659813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"96'23","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810811+0000","last_change":"2024-09-12T00:03:29.335957+0000","last_active":"2024-09-12T00:06:41.810811+0000","last_peered":"2024-09-12T00:06:41.810811+0000","last_clean":"2024-09-12T00:06:41.810811+0000","last_became_active":"2024-09-12T00:03:29.335186+0000","last_became_peered":"2024-09-12T00:03:29.335186+0000","last_unstale":"2024-09-12T00:06:41.810811+0000","last_undegraded":"2024-09-12T00:06:41.810811+0000","last_fullsized":"2024-09-12T00:06:41.810811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:20.551758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721804+0000","last_change":"2024-09-12T00:06:26.671154+0000","last_active":"2024-09-12T00:06:42.721804+0000","last_peered":"2024-09-12T00:06:42.721804+0000","last_clean":"2024-09-12T00:06:42.721804+0000","last_became_active":"2024-09-12T00:06:26.667486+0000","last_became_peered":"2024-09-12T00:06:26.667486+0000","last_unstale":"2024-09-12T00:06:42.721804+0000","last_undegraded":"2024-09-12T00:06:42.721804+0000","last_fullsized":"2024-09-12T00:06:42.721804+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:31.291883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066037+0000","last_change":"2024-09-12T00:03:33.385037+0000","last_active":"2024-09-12T00:06:42.066037+0000","last_peered":"2024-09-12T00:06:42.066037+0000","last_clean":"2024-09-12T00:06:42.066037+0000","last_became_active":"2024-09-12T00:03:33.384379+0000","last_became_peered":"2024-09-12T00:03:33.384379+0000","last_unstale":"2024-09-12T00:06:42.066037+0000","last_undegraded":"2024-09-12T00:06:42.066037+0000","last_fullsized":"2024-09-12T00:06:42.066037+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:00.153475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"96'10","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718737+0000","last_change":"2024-09-12T00:03:25.339110+0000","last_active":"2024-09-12T00:06:42.718737+0000","last_peered":"2024-09-12T00:06:42.718737+0000","last_clean":"2024-09-12T00:06:42.718737+0000","last_became_active":"2024-09-12T00:03:25.338417+0000","last_became_peered":"2024-09-12T00:03:25.338417+0000","last_unstale":"2024-09-12T00:06:42.718737+0000","last_undegraded":"2024-09-12T00:06:42.718737+0000","last_fullsized":"2024-09-12T00:06:42.718737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:48.866021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"96'31","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067362+0000","last_change":"2024-09-12T00:03:23.625514+0000","last_active":"2024-09-12T00:06:42.067362+0000","last_peered":"2024-09-12T00:06:42.067362+0000","last_clean":"2024-09-12T00:06:42.067362+0000","last_became_active":"2024-09-12T00:03:23.621654+0000","last_became_peered":"2024-09-12T00:03:23.621654+0000","last_unstale":"2024-09-12T00:06:42.067362+0000","last_undegraded":"2024-09-12T00:06:42.067362+0000","last_fullsized":"2024-09-12T00:06:42.067362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:43.784497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500172+0000","last_change":"2024-09-12T00:03:27.330377+0000","last_active":"2024-09-12T00:06:42.500172+0000","last_peered":"2024-09-12T00:06:42.500172+0000","last_clean":"2024-09-12T00:06:42.500172+0000","last_became_active":"2024-09-12T00:03:27.329713+0000","last_became_peered":"2024-09-12T00:03:27.329713+0000","last_unstale":"2024-09-12T00:06:42.500172+0000","last_undegraded":"2024-09-12T00:06:42.500172+0000","last_fullsized":"2024-09-12T00:06:42.500172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"96'19","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721448+0000","last_change":"2024-09-12T00:03:29.337028+0000","last_active":"2024-09-12T00:06:42.721448+0000","last_peered":"2024-09-12T00:06:42.721448+0000","last_clean":"2024-09-12T00:06:42.721448+0000","last_became_active":"2024-09-12T00:03:29.335440+0000","last_became_peered":"2024-09-12T00:03:29.335440+0000","last_unstale":"2024-09-12T00:06:42.721448+0000","last_undegraded":"2024-09-12T00:06:42.721448+0000","last_fullsized":"2024-09-12T00:06:42.721448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:19.288395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721524+0000","last_change":"2024-09-12T00:06:26.674200+0000","last_active":"2024-09-12T00:06:42.721524+0000","last_peered":"2024-09-12T00:06:42.721524+0000","last_clean":"2024-09-12T00:06:42.721524+0000","last_became_active":"2024-09-12T00:06:26.660173+0000","last_became_peered":"2024-09-12T00:06:26.660173+0000","last_unstale":"2024-09-12T00:06:42.721524+0000","last_undegraded":"2024-09-12T00:06:42.721524+0000","last_fullsized":"2024-09-12T00:06:42.721524+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:56.674961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"58'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720918+0000","last_change":"2024-09-12T00:06:32.449370+0000","last_active":"2024-09-12T00:06:42.720918+0000","last_peered":"2024-09-12T00:06:42.720918+0000","last_clean":"2024-09-12T00:06:42.720918+0000","last_became_active":"2024-09-12T00:06:26.677210+0000","last_became_peered":"2024-09-12T00:06:26.677210+0000","last_unstale":"2024-09-12T00:06:42.720918+0000","last_undegraded":"2024-09-12T00:06:42.720918+0000","last_fullsized":"2024-09-12T00:06:42.720918+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:13.086869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"96'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810877+0000","last_change":"2024-09-12T00:03:25.337999+0000","last_active":"2024-09-12T00:06:41.810877+0000","last_peered":"2024-09-12T00:06:41.810877+0000","last_clean":"2024-09-12T00:06:41.810877+0000","last_became_active":"2024-09-12T00:03:25.337237+0000","last_became_peered":"2024-09-12T00:03:25.337237+0000","last_unstale":"2024-09-12T00:06:41.810877+0000","last_undegraded":"2024-09-12T00:06:41.810877+0000","last_fullsized":"2024-09-12T00:06:41.810877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"96'29","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067739+0000","last_change":"2024-09-12T00:03:23.631744+0000","last_active":"2024-09-12T00:06:42.067739+0000","last_peered":"2024-09-12T00:06:42.067739+0000","last_clean":"2024-09-12T00:06:42.067739+0000","last_became_active":"2024-09-12T00:03:23.630928+0000","last_became_peered":"2024-09-12T00:03:23.630928+0000","last_unstale":"2024-09-12T00:06:42.067739+0000","last_undegraded":"2024-09-12T00:06:42.067739+0000","last_fullsized":"2024-09-12T00:06:42.067739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:35.772832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810384+0000","last_change":"2024-09-12T00:06:26.683708+0000","last_active":"2024-09-12T00:06:41.810384+0000","last_peered":"2024-09-12T00:06:41.810384+0000","last_clean":"2024-09-12T00:06:41.810384+0000","last_became_active":"2024-09-12T00:06:26.651342+0000","last_became_peered":"2024-09-12T00:06:26.651342+0000","last_unstale":"2024-09-12T00:06:41.810384+0000","last_undegraded":"2024-09-12T00:06:41.810384+0000","last_fullsized":"2024-09-12T00:06:41.810384+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:06.251275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"96'29","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721214+0000","last_change":"2024-09-12T00:06:33.464772+0000","last_active":"2024-09-12T00:06:42.721214+0000","last_peered":"2024-09-12T00:06:42.721214+0000","last_clean":"2024-09-12T00:06:42.721214+0000","last_became_active":"2024-09-12T00:06:26.680856+0000","last_became_peered":"2024-09-12T00:06:26.680856+0000","last_unstale":"2024-09-12T00:06:42.721214+0000","last_undegraded":"2024-09-12T00:06:42.721214+0000","last_fullsized":"2024-09-12T00:06:42.721214+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:08.755659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":26,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811844+0000","last_change":"2024-09-12T00:03:31.355300+0000","last_active":"2024-09-12T00:06:41.811844+0000","last_peered":"2024-09-12T00:06:41.811844+0000","last_clean":"2024-09-12T00:06:41.811844+0000","last_became_active":"2024-09-12T00:03:31.354506+0000","last_became_peered":"2024-09-12T00:03:31.354506+0000","last_unstale":"2024-09-12T00:06:41.811844+0000","last_undegraded":"2024-09-12T00:06:41.811844+0000","last_fullsized":"2024-09-12T00:06:41.811844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:51.564710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"58'1","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815779+0000","last_change":"2024-09-12T00:03:33.384262+0000","last_active":"2024-09-12T00:06:41.815779+0000","last_peered":"2024-09-12T00:06:41.815779+0000","last_clean":"2024-09-12T00:06:41.815779+0000","last_became_active":"2024-09-12T00:03:33.383358+0000","last_became_peered":"2024-09-12T00:03:33.383358+0000","last_unstale":"2024-09-12T00:06:41.815779+0000","last_undegraded":"2024-09-12T00:06:41.815779+0000","last_fullsized":"2024-09-12T00:06:41.815779+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:45.060131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"84'4","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813832+0000","last_change":"2024-09-12T00:06:28.849788+0000","last_active":"2024-09-12T00:06:41.813832+0000","last_peered":"2024-09-12T00:06:41.813832+0000","last_clean":"2024-09-12T00:06:41.813832+0000","last_became_active":"2024-09-12T00:06:26.664077+0000","last_became_peered":"2024-09-12T00:06:26.664077+0000","last_unstale":"2024-09-12T00:06:41.813832+0000","last_undegraded":"2024-09-12T00:06:41.813832+0000","last_fullsized":"2024-09-12T00:06:41.813832+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:24.431791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"96'31","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811482+0000","last_change":"2024-09-12T00:03:23.617643+0000","last_active":"2024-09-12T00:06:41.811482+0000","last_peered":"2024-09-12T00:06:41.811482+0000","last_clean":"2024-09-12T00:06:41.811482+0000","last_became_active":"2024-09-12T00:03:23.617138+0000","last_became_peered":"2024-09-12T00:03:23.617138+0000","last_unstale":"2024-09-12T00:06:41.811482+0000","last_undegraded":"2024-09-12T00:06:41.811482+0000","last_fullsized":"2024-09-12T00:06:41.811482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127926272,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":124928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"59'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723414+0000","last_change":"2024-09-12T00:03:25.335650+0000","last_active":"2024-09-12T00:06:42.723414+0000","last_peered":"2024-09-12T00:06:42.723414+0000","last_clean":"2024-09-12T00:06:42.723414+0000","last_became_active":"2024-09-12T00:03:25.334965+0000","last_became_peered":"2024-09-12T00:03:25.334965+0000","last_unstale":"2024-09-12T00:06:42.723414+0000","last_undegraded":"2024-09-12T00:06:42.723414+0000","last_fullsized":"2024-09-12T00:06:42.723414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:13.501672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"96'26","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718679+0000","last_change":"2024-09-12T00:03:23.618651+0000","last_active":"2024-09-12T00:06:42.718679+0000","last_peered":"2024-09-12T00:06:42.718679+0000","last_clean":"2024-09-12T00:06:42.718679+0000","last_became_active":"2024-09-12T00:03:23.612542+0000","last_became_peered":"2024-09-12T00:03:23.612542+0000","last_unstale":"2024-09-12T00:06:42.718679+0000","last_undegraded":"2024-09-12T00:06:42.718679+0000","last_fullsized":"2024-09-12T00:06:42.718679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"96'4","reported_seq":47,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717901+0000","last_change":"2024-09-12T00:06:32.454921+0000","last_active":"2024-09-12T00:06:42.717901+0000","last_peered":"2024-09-12T00:06:42.717901+0000","last_clean":"2024-09-12T00:06:42.717901+0000","last_became_active":"2024-09-12T00:06:26.677698+0000","last_became_peered":"2024-09-12T00:06:26.677698+0000","last_unstale":"2024-09-12T00:06:42.717901+0000","last_undegraded":"2024-09-12T00:06:42.717901+0000","last_fullsized":"2024-09-12T00:06:42.717901+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:31.889100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"96'30","reported_seq":103,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721342+0000","last_change":"2024-09-12T00:06:30.842710+0000","last_active":"2024-09-12T00:06:42.721342+0000","last_peered":"2024-09-12T00:06:42.721342+0000","last_clean":"2024-09-12T00:06:42.721342+0000","last_became_active":"2024-09-12T00:06:26.666582+0000","last_became_peered":"2024-09-12T00:06:26.666582+0000","last_unstale":"2024-09-12T00:06:42.721342+0000","last_undegraded":"2024-09-12T00:06:42.721342+0000","last_fullsized":"2024-09-12T00:06:42.721342+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:15.209092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":201326592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"63'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066906+0000","last_change":"2024-09-12T00:03:25.354015+0000","last_active":"2024-09-12T00:06:42.066906+0000","last_peered":"2024-09-12T00:06:42.066906+0000","last_clean":"2024-09-12T00:06:42.066906+0000","last_became_active":"2024-09-12T00:03:25.352319+0000","last_became_peered":"2024-09-12T00:03:25.352319+0000","last_unstale":"2024-09-12T00:06:42.066906+0000","last_undegraded":"2024-09-12T00:06:42.066906+0000","last_fullsized":"2024-09-12T00:06:42.066906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:08.033834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"96'17","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066879+0000","last_change":"2024-09-12T00:03:23.633614+0000","last_active":"2024-09-12T00:06:42.066879+0000","last_peered":"2024-09-12T00:06:42.066879+0000","last_clean":"2024-09-12T00:06:42.066879+0000","last_became_active":"2024-09-12T00:03:23.632850+0000","last_became_peered":"2024-09-12T00:03:23.632850+0000","last_unstale":"2024-09-12T00:06:42.066879+0000","last_undegraded":"2024-09-12T00:06:42.066879+0000","last_fullsized":"2024-09-12T00:06:42.066879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065662+0000","last_change":"2024-09-12T00:03:25.357453+0000","last_active":"2024-09-12T00:06:42.065662+0000","last_peered":"2024-09-12T00:06:42.065662+0000","last_clean":"2024-09-12T00:06:42.065662+0000","last_became_active":"2024-09-12T00:03:25.353815+0000","last_became_peered":"2024-09-12T00:03:25.353815+0000","last_unstale":"2024-09-12T00:06:42.065662+0000","last_undegraded":"2024-09-12T00:06:42.065662+0000","last_fullsized":"2024-09-12T00:06:42.065662+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:27.562174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"96'22","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721565+0000","last_change":"2024-09-12T00:03:23.609055+0000","last_active":"2024-09-12T00:06:42.721565+0000","last_peered":"2024-09-12T00:06:42.721565+0000","last_clean":"2024-09-12T00:06:42.721565+0000","last_became_active":"2024-09-12T00:03:23.608101+0000","last_became_peered":"2024-09-12T00:03:23.608101+0000","last_unstale":"2024-09-12T00:06:42.721565+0000","last_undegraded":"2024-09-12T00:06:42.721565+0000","last_fullsized":"2024-09-12T00:06:42.721565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"96'10","reported_seq":268,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814861+0000","last_change":"2024-09-12T00:06:28.290549+0000","last_active":"2024-09-12T00:06:41.814861+0000","last_peered":"2024-09-12T00:06:41.814861+0000","last_clean":"2024-09-12T00:06:41.814861+0000","last_became_active":"2024-09-12T00:06:26.681882+0000","last_became_peered":"2024-09-12T00:06:26.681882+0000","last_unstale":"2024-09-12T00:06:41.814861+0000","last_undegraded":"2024-09-12T00:06:41.814861+0000","last_fullsized":"2024-09-12T00:06:41.814861+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:12.272800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"96'26","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721650+0000","last_change":"2024-09-12T00:03:23.616706+0000","last_active":"2024-09-12T00:06:42.721650+0000","last_peered":"2024-09-12T00:06:42.721650+0000","last_clean":"2024-09-12T00:06:42.721650+0000","last_became_active":"2024-09-12T00:03:23.615970+0000","last_became_peered":"2024-09-12T00:03:23.615970+0000","last_unstale":"2024-09-12T00:06:42.721650+0000","last_undegraded":"2024-09-12T00:06:42.721650+0000","last_fullsized":"2024-09-12T00:06:42.721650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"63'8","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720621+0000","last_change":"2024-09-12T00:03:25.343716+0000","last_active":"2024-09-12T00:06:42.720621+0000","last_peered":"2024-09-12T00:06:42.720621+0000","last_clean":"2024-09-12T00:06:42.720621+0000","last_became_active":"2024-09-12T00:03:25.342930+0000","last_became_peered":"2024-09-12T00:03:25.342930+0000","last_unstale":"2024-09-12T00:06:42.720621+0000","last_undegraded":"2024-09-12T00:06:42.720621+0000","last_fullsized":"2024-09-12T00:06:42.720621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"95'25","reported_seq":321,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814202+0000","last_change":"2024-09-12T00:06:29.602896+0000","last_active":"2024-09-12T00:06:41.814202+0000","last_peered":"2024-09-12T00:06:41.814202+0000","last_clean":"2024-09-12T00:06:41.814202+0000","last_became_active":"2024-09-12T00:06:26.672080+0000","last_became_peered":"2024-09-12T00:06:26.672080+0000","last_unstale":"2024-09-12T00:06:41.814202+0000","last_undegraded":"2024-09-12T00:06:41.814202+0000","last_fullsized":"2024-09-12T00:06:41.814202+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:47.695274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"96'10","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499716+0000","last_change":"2024-09-12T00:03:25.326620+0000","last_active":"2024-09-12T00:06:42.499716+0000","last_peered":"2024-09-12T00:06:42.499716+0000","last_clean":"2024-09-12T00:06:42.499716+0000","last_became_active":"2024-09-12T00:03:25.326262+0000","last_became_peered":"2024-09-12T00:03:25.326262+0000","last_unstale":"2024-09-12T00:06:42.499716+0000","last_undegraded":"2024-09-12T00:06:42.499716+0000","last_fullsized":"2024-09-12T00:06:42.499716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"96'16","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067549+0000","last_change":"2024-09-12T00:03:23.632200+0000","last_active":"2024-09-12T00:06:42.067549+0000","last_peered":"2024-09-12T00:06:42.067549+0000","last_clean":"2024-09-12T00:06:42.067549+0000","last_became_active":"2024-09-12T00:03:23.631510+0000","last_became_peered":"2024-09-12T00:03:23.631510+0000","last_unstale":"2024-09-12T00:06:42.067549+0000","last_undegraded":"2024-09-12T00:06:42.067549+0000","last_fullsized":"2024-09-12T00:06:42.067549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:07.177242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"58'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.724304+0000","last_change":"2024-09-12T00:03:25.342763+0000","last_active":"2024-09-12T00:06:42.724304+0000","last_peered":"2024-09-12T00:06:42.724304+0000","last_clean":"2024-09-12T00:06:42.724304+0000","last_became_active":"2024-09-12T00:03:25.337834+0000","last_became_peered":"2024-09-12T00:03:25.337834+0000","last_unstale":"2024-09-12T00:06:42.724304+0000","last_undegraded":"2024-09-12T00:06:42.724304+0000","last_fullsized":"2024-09-12T00:06:42.724304+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:35.920599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"95'16","reported_seq":75,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717915+0000","last_change":"2024-09-12T00:06:28.323950+0000","last_active":"2024-09-12T00:06:42.717915+0000","last_peered":"2024-09-12T00:06:42.717915+0000","last_clean":"2024-09-12T00:06:42.717915+0000","last_became_active":"2024-09-12T00:06:26.666889+0000","last_became_peered":"2024-09-12T00:06:26.666889+0000","last_unstale":"2024-09-12T00:06:42.717915+0000","last_undegraded":"2024-09-12T00:06:42.717915+0000","last_fullsized":"2024-09-12T00:06:42.717915+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:12.167901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816185+0000","last_change":"2024-09-12T00:03:25.339910+0000","last_active":"2024-09-12T00:06:41.816185+0000","last_peered":"2024-09-12T00:06:41.816185+0000","last_clean":"2024-09-12T00:06:41.816185+0000","last_became_active":"2024-09-12T00:03:25.336511+0000","last_became_peered":"2024-09-12T00:03:25.336511+0000","last_unstale":"2024-09-12T00:06:41.816185+0000","last_undegraded":"2024-09-12T00:06:41.816185+0000","last_fullsized":"2024-09-12T00:06:41.816185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:30.647474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"96'28","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065464+0000","last_change":"2024-09-12T00:03:23.626232+0000","last_active":"2024-09-12T00:06:42.065464+0000","last_peered":"2024-09-12T00:06:42.065464+0000","last_clean":"2024-09-12T00:06:42.065464+0000","last_became_active":"2024-09-12T00:03:23.621761+0000","last_became_peered":"2024-09-12T00:03:23.621761+0000","last_unstale":"2024-09-12T00:06:42.065464+0000","last_undegraded":"2024-09-12T00:06:42.065464+0000","last_fullsized":"2024-09-12T00:06:42.065464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:31.587668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"59'4","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066619+0000","last_change":"2024-09-12T00:06:28.859921+0000","last_active":"2024-09-12T00:06:42.066619+0000","last_peered":"2024-09-12T00:06:42.066619+0000","last_clean":"2024-09-12T00:06:42.066619+0000","last_became_active":"2024-09-12T00:06:26.677331+0000","last_became_peered":"2024-09-12T00:06:26.677331+0000","last_unstale":"2024-09-12T00:06:42.066619+0000","last_undegraded":"2024-09-12T00:06:42.066619+0000","last_fullsized":"2024-09-12T00:06:42.066619+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:05.062779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"96'24","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500399+0000","last_change":"2024-09-12T00:03:23.600956+0000","last_active":"2024-09-12T00:06:42.500399+0000","last_peered":"2024-09-12T00:06:42.500399+0000","last_clean":"2024-09-12T00:06:42.500399+0000","last_became_active":"2024-09-12T00:03:23.600673+0000","last_became_peered":"2024-09-12T00:03:23.600673+0000","last_unstale":"2024-09-12T00:06:42.500399+0000","last_undegraded":"2024-09-12T00:06:42.500399+0000","last_fullsized":"2024-09-12T00:06:42.500399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"96'6","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500670+0000","last_change":"2024-09-12T00:03:25.325088+0000","last_active":"2024-09-12T00:06:42.500670+0000","last_peered":"2024-09-12T00:06:42.500670+0000","last_clean":"2024-09-12T00:06:42.500670+0000","last_became_active":"2024-09-12T00:03:25.324597+0000","last_became_peered":"2024-09-12T00:03:25.324597+0000","last_unstale":"2024-09-12T00:06:42.500670+0000","last_undegraded":"2024-09-12T00:06:42.500670+0000","last_fullsized":"2024-09-12T00:06:42.500670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"95'19","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812155+0000","last_change":"2024-09-12T00:03:23.621791+0000","last_active":"2024-09-12T00:06:41.812155+0000","last_peered":"2024-09-12T00:06:41.812155+0000","last_clean":"2024-09-12T00:06:41.812155+0000","last_became_active":"2024-09-12T00:03:23.621063+0000","last_became_peered":"2024-09-12T00:03:23.621063+0000","last_unstale":"2024-09-12T00:06:41.812155+0000","last_undegraded":"2024-09-12T00:06:41.812155+0000","last_fullsized":"2024-09-12T00:06:41.812155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:33.234598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77594624,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":75776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500368+0000","last_change":"2024-09-12T00:03:25.357605+0000","last_active":"2024-09-12T00:06:42.500368+0000","last_peered":"2024-09-12T00:06:42.500368+0000","last_clean":"2024-09-12T00:06:42.500368+0000","last_became_active":"2024-09-12T00:03:25.357286+0000","last_became_peered":"2024-09-12T00:03:25.357286+0000","last_unstale":"2024-09-12T00:06:42.500368+0000","last_undegraded":"2024-09-12T00:06:42.500368+0000","last_fullsized":"2024-09-12T00:06:42.500368+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"96'21","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815686+0000","last_change":"2024-09-12T00:03:23.600931+0000","last_active":"2024-09-12T00:06:41.815686+0000","last_peered":"2024-09-12T00:06:41.815686+0000","last_clean":"2024-09-12T00:06:41.815686+0000","last_became_active":"2024-09-12T00:03:23.600591+0000","last_became_peered":"2024-09-12T00:03:23.600591+0000","last_unstale":"2024-09-12T00:06:41.815686+0000","last_undegraded":"2024-09-12T00:06:41.815686+0000","last_fullsized":"2024-09-12T00:06:41.815686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"84'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719420+0000","last_change":"2024-09-12T00:03:25.330869+0000","last_active":"2024-09-12T00:06:42.719420+0000","last_peered":"2024-09-12T00:06:42.719420+0000","last_clean":"2024-09-12T00:06:42.719420+0000","last_became_active":"2024-09-12T00:03:25.329742+0000","last_became_peered":"2024-09-12T00:03:25.329742+0000","last_unstale":"2024-09-12T00:06:42.719420+0000","last_undegraded":"2024-09-12T00:06:42.719420+0000","last_fullsized":"2024-09-12T00:06:42.719420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:01.365985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"95'32","reported_seq":105,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720260+0000","last_change":"2024-09-12T00:06:31.824748+0000","last_active":"2024-09-12T00:06:42.720260+0000","last_peered":"2024-09-12T00:06:42.720260+0000","last_clean":"2024-09-12T00:06:42.720260+0000","last_became_active":"2024-09-12T00:06:26.668022+0000","last_became_peered":"2024-09-12T00:06:26.668022+0000","last_unstale":"2024-09-12T00:06:42.720260+0000","last_undegraded":"2024-09-12T00:06:42.720260+0000","last_fullsized":"2024-09-12T00:06:42.720260+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:57.178468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":40,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":222298112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"59'4","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811470+0000","last_change":"2024-09-12T00:03:25.347570+0000","last_active":"2024-09-12T00:06:41.811470+0000","last_peered":"2024-09-12T00:06:41.811470+0000","last_clean":"2024-09-12T00:06:41.811470+0000","last_became_active":"2024-09-12T00:03:25.346874+0000","last_became_peered":"2024-09-12T00:03:25.346874+0000","last_unstale":"2024-09-12T00:06:41.811470+0000","last_undegraded":"2024-09-12T00:06:41.811470+0000","last_fullsized":"2024-09-12T00:06:41.811470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"96'23","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723730+0000","last_change":"2024-09-12T00:03:23.623417+0000","last_active":"2024-09-12T00:06:42.723730+0000","last_peered":"2024-09-12T00:06:42.723730+0000","last_clean":"2024-09-12T00:06:42.723730+0000","last_became_active":"2024-09-12T00:03:23.620261+0000","last_became_peered":"2024-09-12T00:03:23.620261+0000","last_unstale":"2024-09-12T00:06:42.723730+0000","last_undegraded":"2024-09-12T00:06:42.723730+0000","last_fullsized":"2024-09-12T00:06:42.723730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"63'8","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499989+0000","last_change":"2024-09-12T00:03:25.357492+0000","last_active":"2024-09-12T00:06:42.499989+0000","last_peered":"2024-09-12T00:06:42.499989+0000","last_clean":"2024-09-12T00:06:42.499989+0000","last_became_active":"2024-09-12T00:03:25.357186+0000","last_became_peered":"2024-09-12T00:03:25.357186+0000","last_unstale":"2024-09-12T00:06:42.499989+0000","last_undegraded":"2024-09-12T00:06:42.499989+0000","last_fullsized":"2024-09-12T00:06:42.499989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"96'26","reported_seq":95,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719726+0000","last_change":"2024-09-12T00:06:34.105256+0000","last_active":"2024-09-12T00:06:42.719726+0000","last_peered":"2024-09-12T00:06:42.719726+0000","last_clean":"2024-09-12T00:06:42.719726+0000","last_became_active":"2024-09-12T00:06:26.677360+0000","last_became_peered":"2024-09-12T00:06:26.677360+0000","last_unstale":"2024-09-12T00:06:42.719726+0000","last_undegraded":"2024-09-12T00:06:42.719726+0000","last_fullsized":"2024-09-12T00:06:42.719726+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:18.563619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":163577856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"96'27","reported_seq":97,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717277+0000","last_change":"2024-09-12T00:06:28.886144+0000","last_active":"2024-09-12T00:06:42.717277+0000","last_peered":"2024-09-12T00:06:42.717277+0000","last_clean":"2024-09-12T00:06:42.717277+0000","last_became_active":"2024-09-12T00:06:26.669830+0000","last_became_peered":"2024-09-12T00:06:26.669830+0000","last_unstale":"2024-09-12T00:06:42.717277+0000","last_undegraded":"2024-09-12T00:06:42.717277+0000","last_fullsized":"2024-09-12T00:06:42.717277+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:37.229011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":192937984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"84'6","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813636+0000","last_change":"2024-09-12T00:03:25.350116+0000","last_active":"2024-09-12T00:06:41.813636+0000","last_peered":"2024-09-12T00:06:41.813636+0000","last_clean":"2024-09-12T00:06:41.813636+0000","last_became_active":"2024-09-12T00:03:25.349281+0000","last_became_peered":"2024-09-12T00:03:25.349281+0000","last_unstale":"2024-09-12T00:06:41.813636+0000","last_undegraded":"2024-09-12T00:06:41.813636+0000","last_fullsized":"2024-09-12T00:06:41.813636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:33.350458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"96'20","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065234+0000","last_change":"2024-09-12T00:03:23.619574+0000","last_active":"2024-09-12T00:06:42.065234+0000","last_peered":"2024-09-12T00:06:42.065234+0000","last_clean":"2024-09-12T00:06:42.065234+0000","last_became_active":"2024-09-12T00:03:23.616154+0000","last_became_peered":"2024-09-12T00:03:23.616154+0000","last_unstale":"2024-09-12T00:06:42.065234+0000","last_undegraded":"2024-09-12T00:06:42.065234+0000","last_fullsized":"2024-09-12T00:06:42.065234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:46.335775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"58'2","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.502147+0000","last_change":"2024-09-12T00:03:25.345327+0000","last_active":"2024-09-12T00:06:42.502147+0000","last_peered":"2024-09-12T00:06:42.502147+0000","last_clean":"2024-09-12T00:06:42.502147+0000","last_became_active":"2024-09-12T00:03:25.344917+0000","last_became_peered":"2024-09-12T00:03:25.344917+0000","last_unstale":"2024-09-12T00:06:42.502147+0000","last_undegraded":"2024-09-12T00:06:42.502147+0000","last_fullsized":"2024-09-12T00:06:42.502147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":339,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1085,"ondisk_log_size":1085,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382934,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1135,"num_read_kb":865,"num_write":659,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":117531,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":953,"ondisk_log_size":953,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1444,"num_read_kb":1412,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1584,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":721,"num_bytes_recovered":3007315968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542197,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1111992,"kb_used_data":1080808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93259848,"statfs":{"total":96636764160,"available":95498084352,"internally_reserved":0,"allocated":1106747392,"data_stored":1106113870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542197,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1329084,"kb_used_data":1297892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93042756,"statfs":{"total":96636764160,"available":95275782144,"internally_reserved":0,"allocated":1329041408,"data_stored":1328412810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542197,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1794496,"kb_used_data":1759152,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92577344,"statfs":{"total":96636764160,"available":94799200256,"internally_reserved":0,"allocated":1801371648,"data_stored":1800744781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542197,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1329264,"kb_used_data":1293920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93042576,"statfs":{"total":96636764160,"available":95275597824,"internally_reserved":0,"allocated":1324974080,"data_stored":1324334685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542197,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1830964,"kb_used_data":1791448,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":92540876,"statfs":{"total":96636764160,"available":94761857024,"internally_reserved":0,"allocated":1834442752,"data_stored":1833824839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542198,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1806124,"kb_used_data":1774932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92565716,"statfs":{"total":96636764160,"available":94787293184,"internally_reserved":0,"allocated":1817530368,"data_stored":1816930588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542197,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1305176,"kb_used_data":1269832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93066664,"statfs":{"total":96636764160,"available":95300263936,"internally_reserved":0,"allocated":1300307968,"data_stored":1299644748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542196,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2084760,"kb_used_data":2049416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92287080,"statfs":{"total":96636764160,"available":94501969920,"internally_reserved":0,"allocated":2098601984,"data_stored":2097950685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2097152000,"data_stored":2097152000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1298137088,"data_stored":1298137088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1816133632,"data_stored":1816133632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1832910848,"data_stored":1832910848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1323302912,"data_stored":1323302912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1799356416,"data_stored":1799356416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1327497216,"data_stored":1327497216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1105199104,"data_stored":1105199104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":119156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":117311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":235112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":117531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":117713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:07:12.976 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:07:12.976 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:07:13.323 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:07:13.330 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T00:07:13.341 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":231,"stamp":"2024-09-12T00:07:12.477540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300819945,"num_objects":1736,"num_object_clones":0,"num_object_copies":3472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1736,"num_whiteouts":0,"num_read":3480,"num_read_kb":3139,"num_write":2967,"num_write_kb":6187128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":928,"num_bytes_recovered":3007433610,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4057,"ondisk_log_size":4057,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12591860,"kb_used_data":12317400,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":742382860,"statfs":{"total":773094113280,"available":760200048640,"internally_reserved":0,"allocated":12613017600,"data_stored":12607957006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":280874546},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006723"},"pg_stats":[{"pgid":"3.3f","version":"95'16","reported_seq":286,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.817134+0000","last_change":"2024-09-12T00:06:27.539898+0000","last_active":"2024-09-12T00:06:41.817134+0000","last_peered":"2024-09-12T00:06:41.817134+0000","last_clean":"2024-09-12T00:06:41.817134+0000","last_became_active":"2024-09-12T00:06:26.678792+0000","last_became_peered":"2024-09-12T00:06:26.678792+0000","last_unstale":"2024-09-12T00:06:41.817134+0000","last_undegraded":"2024-09-12T00:06:41.817134+0000","last_fullsized":"2024-09-12T00:06:41.817134+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:23.434133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'2","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499351+0000","last_change":"2024-09-12T00:03:25.337244+0000","last_active":"2024-09-12T00:06:42.499351+0000","last_peered":"2024-09-12T00:06:42.499351+0000","last_clean":"2024-09-12T00:06:42.499351+0000","last_became_active":"2024-09-12T00:03:25.335964+0000","last_became_peered":"2024-09-12T00:03:25.335964+0000","last_unstale":"2024-09-12T00:06:42.499351+0000","last_undegraded":"2024-09-12T00:06:42.499351+0000","last_fullsized":"2024-09-12T00:06:42.499351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"96'24","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067343+0000","last_change":"2024-09-12T00:03:23.628328+0000","last_active":"2024-09-12T00:06:42.067343+0000","last_peered":"2024-09-12T00:06:42.067343+0000","last_clean":"2024-09-12T00:06:42.067343+0000","last_became_active":"2024-09-12T00:03:23.627630+0000","last_became_peered":"2024-09-12T00:03:23.627630+0000","last_unstale":"2024-09-12T00:06:42.067343+0000","last_undegraded":"2024-09-12T00:06:42.067343+0000","last_fullsized":"2024-09-12T00:06:42.067343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:00.573006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"76'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717726+0000","last_change":"2024-09-12T00:06:27.903337+0000","last_active":"2024-09-12T00:06:42.717726+0000","last_peered":"2024-09-12T00:06:42.717726+0000","last_clean":"2024-09-12T00:06:42.717726+0000","last_became_active":"2024-09-12T00:06:26.660419+0000","last_became_peered":"2024-09-12T00:06:26.660419+0000","last_unstale":"2024-09-12T00:06:42.717726+0000","last_undegraded":"2024-09-12T00:06:42.717726+0000","last_fullsized":"2024-09-12T00:06:42.717726+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:43.714019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"96'29","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066706+0000","last_change":"2024-09-12T00:03:23.626533+0000","last_active":"2024-09-12T00:06:42.066706+0000","last_peered":"2024-09-12T00:06:42.066706+0000","last_clean":"2024-09-12T00:06:42.066706+0000","last_became_active":"2024-09-12T00:03:23.625728+0000","last_became_peered":"2024-09-12T00:03:23.625728+0000","last_unstale":"2024-09-12T00:06:42.066706+0000","last_undegraded":"2024-09-12T00:06:42.066706+0000","last_fullsized":"2024-09-12T00:06:42.066706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:31.772442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"96'4","reported_seq":47,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721615+0000","last_change":"2024-09-12T00:06:32.442375+0000","last_active":"2024-09-12T00:06:42.721615+0000","last_peered":"2024-09-12T00:06:42.721615+0000","last_clean":"2024-09-12T00:06:42.721615+0000","last_became_active":"2024-09-12T00:06:26.677271+0000","last_became_peered":"2024-09-12T00:06:26.677271+0000","last_unstale":"2024-09-12T00:06:42.721615+0000","last_undegraded":"2024-09-12T00:06:42.721615+0000","last_fullsized":"2024-09-12T00:06:42.721615+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:34.385926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"96'22","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812538+0000","last_change":"2024-09-12T00:03:23.609828+0000","last_active":"2024-09-12T00:06:41.812538+0000","last_peered":"2024-09-12T00:06:41.812538+0000","last_clean":"2024-09-12T00:06:41.812538+0000","last_became_active":"2024-09-12T00:03:23.609326+0000","last_became_peered":"2024-09-12T00:03:23.609326+0000","last_unstale":"2024-09-12T00:06:41.812538+0000","last_undegraded":"2024-09-12T00:06:41.812538+0000","last_fullsized":"2024-09-12T00:06:41.812538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:25.491620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'8","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812256+0000","last_change":"2024-09-12T00:03:25.339518+0000","last_active":"2024-09-12T00:06:41.812256+0000","last_peered":"2024-09-12T00:06:41.812256+0000","last_clean":"2024-09-12T00:06:41.812256+0000","last_became_active":"2024-09-12T00:03:25.338805+0000","last_became_peered":"2024-09-12T00:03:25.338805+0000","last_unstale":"2024-09-12T00:06:41.812256+0000","last_undegraded":"2024-09-12T00:06:41.812256+0000","last_fullsized":"2024-09-12T00:06:41.812256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"96'26","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810071+0000","last_change":"2024-09-12T00:03:23.633978+0000","last_active":"2024-09-12T00:06:41.810071+0000","last_peered":"2024-09-12T00:06:41.810071+0000","last_clean":"2024-09-12T00:06:41.810071+0000","last_became_active":"2024-09-12T00:03:23.633580+0000","last_became_peered":"2024-09-12T00:03:23.633580+0000","last_unstale":"2024-09-12T00:06:41.810071+0000","last_undegraded":"2024-09-12T00:06:41.810071+0000","last_fullsized":"2024-09-12T00:06:41.810071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:01.872688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809540+0000","last_change":"2024-09-12T00:03:25.324424+0000","last_active":"2024-09-12T00:06:41.809540+0000","last_peered":"2024-09-12T00:06:41.809540+0000","last_clean":"2024-09-12T00:06:41.809540+0000","last_became_active":"2024-09-12T00:03:25.324138+0000","last_became_peered":"2024-09-12T00:03:25.324138+0000","last_unstale":"2024-09-12T00:06:41.809540+0000","last_undegraded":"2024-09-12T00:06:41.809540+0000","last_fullsized":"2024-09-12T00:06:41.809540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:09.954252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"96'21","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812953+0000","last_change":"2024-09-12T00:03:23.610136+0000","last_active":"2024-09-12T00:06:41.812953+0000","last_peered":"2024-09-12T00:06:41.812953+0000","last_clean":"2024-09-12T00:06:41.812953+0000","last_became_active":"2024-09-12T00:03:23.609509+0000","last_became_peered":"2024-09-12T00:03:23.609509+0000","last_unstale":"2024-09-12T00:06:41.812953+0000","last_undegraded":"2024-09-12T00:06:41.812953+0000","last_fullsized":"2024-09-12T00:06:41.812953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"96'12","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.817127+0000","last_change":"2024-09-12T00:03:25.355256+0000","last_active":"2024-09-12T00:06:41.817127+0000","last_peered":"2024-09-12T00:06:41.817127+0000","last_clean":"2024-09-12T00:06:41.817127+0000","last_became_active":"2024-09-12T00:03:25.355002+0000","last_became_peered":"2024-09-12T00:03:25.355002+0000","last_unstale":"2024-09-12T00:06:41.817127+0000","last_undegraded":"2024-09-12T00:06:41.817127+0000","last_fullsized":"2024-09-12T00:06:41.817127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:50.488869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"96'28","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813544+0000","last_change":"2024-09-12T00:03:23.606780+0000","last_active":"2024-09-12T00:06:41.813544+0000","last_peered":"2024-09-12T00:06:41.813544+0000","last_clean":"2024-09-12T00:06:41.813544+0000","last_became_active":"2024-09-12T00:03:23.606143+0000","last_became_peered":"2024-09-12T00:03:23.606143+0000","last_unstale":"2024-09-12T00:06:41.813544+0000","last_undegraded":"2024-09-12T00:06:41.813544+0000","last_fullsized":"2024-09-12T00:06:41.813544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:22.889982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813590+0000","last_change":"2024-09-12T00:03:25.330195+0000","last_active":"2024-09-12T00:06:41.813590+0000","last_peered":"2024-09-12T00:06:41.813590+0000","last_clean":"2024-09-12T00:06:41.813590+0000","last_became_active":"2024-09-12T00:03:25.329625+0000","last_became_peered":"2024-09-12T00:03:25.329625+0000","last_unstale":"2024-09-12T00:06:41.813590+0000","last_undegraded":"2024-09-12T00:06:41.813590+0000","last_fullsized":"2024-09-12T00:06:41.813590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"96'27","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064982+0000","last_change":"2024-09-12T00:03:23.626723+0000","last_active":"2024-09-12T00:06:42.064982+0000","last_peered":"2024-09-12T00:06:42.064982+0000","last_clean":"2024-09-12T00:06:42.064982+0000","last_became_active":"2024-09-12T00:03:23.626018+0000","last_became_peered":"2024-09-12T00:03:23.626018+0000","last_unstale":"2024-09-12T00:06:42.064982+0000","last_undegraded":"2024-09-12T00:06:42.064982+0000","last_fullsized":"2024-09-12T00:06:42.064982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"59'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067823+0000","last_change":"2024-09-12T00:03:25.352418+0000","last_active":"2024-09-12T00:06:42.067823+0000","last_peered":"2024-09-12T00:06:42.067823+0000","last_clean":"2024-09-12T00:06:42.067823+0000","last_became_active":"2024-09-12T00:03:25.347902+0000","last_became_peered":"2024-09-12T00:03:25.347902+0000","last_unstale":"2024-09-12T00:06:42.067823+0000","last_undegraded":"2024-09-12T00:06:42.067823+0000","last_fullsized":"2024-09-12T00:06:42.067823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:29.611790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"59'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719921+0000","last_change":"2024-09-12T00:06:27.342563+0000","last_active":"2024-09-12T00:06:42.719921+0000","last_peered":"2024-09-12T00:06:42.719921+0000","last_clean":"2024-09-12T00:06:42.719921+0000","last_became_active":"2024-09-12T00:06:26.653851+0000","last_became_peered":"2024-09-12T00:06:26.653851+0000","last_unstale":"2024-09-12T00:06:42.719921+0000","last_undegraded":"2024-09-12T00:06:42.719921+0000","last_fullsized":"2024-09-12T00:06:42.719921+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:14.109429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"95'17","reported_seq":285,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501969+0000","last_change":"2024-09-12T00:06:27.069520+0000","last_active":"2024-09-12T00:06:42.501969+0000","last_peered":"2024-09-12T00:06:42.501969+0000","last_clean":"2024-09-12T00:06:42.501969+0000","last_became_active":"2024-09-12T00:06:26.664959+0000","last_became_peered":"2024-09-12T00:06:26.664959+0000","last_unstale":"2024-09-12T00:06:42.501969+0000","last_undegraded":"2024-09-12T00:06:42.501969+0000","last_fullsized":"2024-09-12T00:06:42.501969+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:35.231503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813150+0000","last_change":"2024-09-12T00:03:25.334966+0000","last_active":"2024-09-12T00:06:41.813150+0000","last_peered":"2024-09-12T00:06:41.813150+0000","last_clean":"2024-09-12T00:06:41.813150+0000","last_became_active":"2024-09-12T00:03:25.334375+0000","last_became_peered":"2024-09-12T00:03:25.334375+0000","last_unstale":"2024-09-12T00:06:41.813150+0000","last_undegraded":"2024-09-12T00:06:41.813150+0000","last_fullsized":"2024-09-12T00:06:41.813150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:52.828056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"96'20","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816433+0000","last_change":"2024-09-12T00:03:23.614289+0000","last_active":"2024-09-12T00:06:41.816433+0000","last_peered":"2024-09-12T00:06:41.816433+0000","last_clean":"2024-09-12T00:06:41.816433+0000","last_became_active":"2024-09-12T00:03:23.614019+0000","last_became_peered":"2024-09-12T00:03:23.614019+0000","last_unstale":"2024-09-12T00:06:41.816433+0000","last_undegraded":"2024-09-12T00:06:41.816433+0000","last_fullsized":"2024-09-12T00:06:41.816433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:00.847027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"96'12","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500281+0000","last_change":"2024-09-12T00:03:25.357938+0000","last_active":"2024-09-12T00:06:42.500281+0000","last_peered":"2024-09-12T00:06:42.500281+0000","last_clean":"2024-09-12T00:06:42.500281+0000","last_became_active":"2024-09-12T00:03:25.357571+0000","last_became_peered":"2024-09-12T00:03:25.357571+0000","last_unstale":"2024-09-12T00:06:42.500281+0000","last_undegraded":"2024-09-12T00:06:42.500281+0000","last_fullsized":"2024-09-12T00:06:42.500281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:05.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"95'23","reported_seq":315,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816438+0000","last_change":"2024-09-12T00:06:28.845144+0000","last_active":"2024-09-12T00:06:41.816438+0000","last_peered":"2024-09-12T00:06:41.816438+0000","last_clean":"2024-09-12T00:06:41.816438+0000","last_became_active":"2024-09-12T00:06:26.682027+0000","last_became_peered":"2024-09-12T00:06:26.682027+0000","last_unstale":"2024-09-12T00:06:41.816438+0000","last_undegraded":"2024-09-12T00:06:41.816438+0000","last_fullsized":"2024-09-12T00:06:41.816438+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:24.330401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":167772160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'8","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721712+0000","last_change":"2024-09-12T00:03:25.345717+0000","last_active":"2024-09-12T00:06:42.721712+0000","last_peered":"2024-09-12T00:06:42.721712+0000","last_clean":"2024-09-12T00:06:42.721712+0000","last_became_active":"2024-09-12T00:03:25.344959+0000","last_became_peered":"2024-09-12T00:03:25.344959+0000","last_unstale":"2024-09-12T00:06:42.721712+0000","last_undegraded":"2024-09-12T00:06:42.721712+0000","last_fullsized":"2024-09-12T00:06:42.721712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"96'17","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815332+0000","last_change":"2024-09-12T00:03:23.602960+0000","last_active":"2024-09-12T00:06:41.815332+0000","last_peered":"2024-09-12T00:06:41.815332+0000","last_clean":"2024-09-12T00:06:41.815332+0000","last_became_active":"2024-09-12T00:03:23.602640+0000","last_became_peered":"2024-09-12T00:03:23.602640+0000","last_unstale":"2024-09-12T00:06:41.815332+0000","last_undegraded":"2024-09-12T00:06:41.815332+0000","last_fullsized":"2024-09-12T00:06:41.815332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"59'2","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066326+0000","last_change":"2024-09-12T00:06:28.300294+0000","last_active":"2024-09-12T00:06:42.066326+0000","last_peered":"2024-09-12T00:06:42.066326+0000","last_clean":"2024-09-12T00:06:42.066326+0000","last_became_active":"2024-09-12T00:06:26.665307+0000","last_became_peered":"2024-09-12T00:06:26.665307+0000","last_unstale":"2024-09-12T00:06:42.066326+0000","last_undegraded":"2024-09-12T00:06:42.066326+0000","last_fullsized":"2024-09-12T00:06:42.066326+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:18.349268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"96'23","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722623+0000","last_change":"2024-09-12T00:03:23.604732+0000","last_active":"2024-09-12T00:06:42.722623+0000","last_peered":"2024-09-12T00:06:42.722623+0000","last_clean":"2024-09-12T00:06:42.722623+0000","last_became_active":"2024-09-12T00:03:23.603932+0000","last_became_peered":"2024-09-12T00:03:23.603932+0000","last_unstale":"2024-09-12T00:06:42.722623+0000","last_undegraded":"2024-09-12T00:06:42.722623+0000","last_fullsized":"2024-09-12T00:06:42.722623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:14.913580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"76'4","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501143+0000","last_change":"2024-09-12T00:03:25.341332+0000","last_active":"2024-09-12T00:06:42.501143+0000","last_peered":"2024-09-12T00:06:42.501143+0000","last_clean":"2024-09-12T00:06:42.501143+0000","last_became_active":"2024-09-12T00:03:25.340828+0000","last_became_peered":"2024-09-12T00:03:25.340828+0000","last_unstale":"2024-09-12T00:06:42.501143+0000","last_undegraded":"2024-09-12T00:06:42.501143+0000","last_fullsized":"2024-09-12T00:06:42.501143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"95'18","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722863+0000","last_change":"2024-09-12T00:03:23.602687+0000","last_active":"2024-09-12T00:06:42.722863+0000","last_peered":"2024-09-12T00:06:42.722863+0000","last_clean":"2024-09-12T00:06:42.722863+0000","last_became_active":"2024-09-12T00:03:23.601892+0000","last_became_peered":"2024-09-12T00:03:23.601892+0000","last_unstale":"2024-09-12T00:06:42.722863+0000","last_undegraded":"2024-09-12T00:06:42.722863+0000","last_fullsized":"2024-09-12T00:06:42.722863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.808845+0000","last_change":"2024-09-12T00:03:33.354850+0000","last_active":"2024-09-12T00:06:41.808845+0000","last_peered":"2024-09-12T00:06:41.808845+0000","last_clean":"2024-09-12T00:06:41.808845+0000","last_became_active":"2024-09-12T00:03:33.351917+0000","last_became_peered":"2024-09-12T00:03:33.351917+0000","last_unstale":"2024-09-12T00:06:41.808845+0000","last_undegraded":"2024-09-12T00:06:41.808845+0000","last_fullsized":"2024-09-12T00:06:41.808845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:00.466863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"59'6","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721027+0000","last_change":"2024-09-12T00:03:25.323174+0000","last_active":"2024-09-12T00:06:42.721027+0000","last_peered":"2024-09-12T00:06:42.721027+0000","last_clean":"2024-09-12T00:06:42.721027+0000","last_became_active":"2024-09-12T00:03:25.322456+0000","last_became_peered":"2024-09-12T00:03:25.322456+0000","last_unstale":"2024-09-12T00:06:42.721027+0000","last_undegraded":"2024-09-12T00:06:42.721027+0000","last_fullsized":"2024-09-12T00:06:42.721027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"96'27","reported_seq":97,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721346+0000","last_change":"2024-09-12T00:06:27.333722+0000","last_active":"2024-09-12T00:06:42.721346+0000","last_peered":"2024-09-12T00:06:42.721346+0000","last_clean":"2024-09-12T00:06:42.721346+0000","last_became_active":"2024-09-12T00:06:26.648460+0000","last_became_peered":"2024-09-12T00:06:26.648460+0000","last_unstale":"2024-09-12T00:06:42.721346+0000","last_undegraded":"2024-09-12T00:06:42.721346+0000","last_fullsized":"2024-09-12T00:06:42.721346+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:17.751627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717693+0000","last_change":"2024-09-12T00:06:26.675813+0000","last_active":"2024-09-12T00:06:42.717693+0000","last_peered":"2024-09-12T00:06:42.717693+0000","last_clean":"2024-09-12T00:06:42.717693+0000","last_became_active":"2024-09-12T00:06:26.663654+0000","last_became_peered":"2024-09-12T00:06:26.663654+0000","last_unstale":"2024-09-12T00:06:42.717693+0000","last_undegraded":"2024-09-12T00:06:42.717693+0000","last_fullsized":"2024-09-12T00:06:42.717693+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:22.865255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"96'29","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812965+0000","last_change":"2024-09-12T00:03:29.347224+0000","last_active":"2024-09-12T00:06:41.812965+0000","last_peered":"2024-09-12T00:06:41.812965+0000","last_clean":"2024-09-12T00:06:41.812965+0000","last_became_active":"2024-09-12T00:03:29.346662+0000","last_became_peered":"2024-09-12T00:03:29.346662+0000","last_unstale":"2024-09-12T00:06:41.812965+0000","last_undegraded":"2024-09-12T00:06:41.812965+0000","last_fullsized":"2024-09-12T00:06:41.812965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:28.258932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501404+0000","last_change":"2024-09-12T00:03:31.337219+0000","last_active":"2024-09-12T00:06:42.501404+0000","last_peered":"2024-09-12T00:06:42.501404+0000","last_clean":"2024-09-12T00:06:42.501404+0000","last_became_active":"2024-09-12T00:03:31.336317+0000","last_became_peered":"2024-09-12T00:03:31.336317+0000","last_unstale":"2024-09-12T00:06:42.501404+0000","last_undegraded":"2024-09-12T00:06:42.501404+0000","last_fullsized":"2024-09-12T00:06:42.501404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:50.954053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"96'48","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499219+0000","last_change":"2024-09-12T00:03:33.376628+0000","last_active":"2024-09-12T00:06:42.499219+0000","last_peered":"2024-09-12T00:06:42.499219+0000","last_clean":"2024-09-12T00:06:42.499219+0000","last_became_active":"2024-09-12T00:03:33.375938+0000","last_became_peered":"2024-09-12T00:03:33.375938+0000","last_unstale":"2024-09-12T00:06:42.499219+0000","last_undegraded":"2024-09-12T00:06:42.499219+0000","last_fullsized":"2024-09-12T00:06:42.499219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:31.105042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"84'8","reported_seq":51,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717938+0000","last_change":"2024-09-12T00:06:32.981663+0000","last_active":"2024-09-12T00:06:42.717938+0000","last_peered":"2024-09-12T00:06:42.717938+0000","last_clean":"2024-09-12T00:06:42.717938+0000","last_became_active":"2024-09-12T00:06:26.679390+0000","last_became_peered":"2024-09-12T00:06:26.679390+0000","last_unstale":"2024-09-12T00:06:42.717938+0000","last_undegraded":"2024-09-12T00:06:42.717938+0000","last_fullsized":"2024-09-12T00:06:42.717938+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.655318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"96'14","reported_seq":267,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723059+0000","last_change":"2024-09-12T00:06:28.270104+0000","last_active":"2024-09-12T00:06:42.723059+0000","last_peered":"2024-09-12T00:06:42.723059+0000","last_clean":"2024-09-12T00:06:42.723059+0000","last_became_active":"2024-09-12T00:06:26.675473+0000","last_became_peered":"2024-09-12T00:06:26.675473+0000","last_unstale":"2024-09-12T00:06:42.723059+0000","last_undegraded":"2024-09-12T00:06:42.723059+0000","last_fullsized":"2024-09-12T00:06:42.723059+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:45.446239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812081+0000","last_change":"2024-09-12T00:03:27.336108+0000","last_active":"2024-09-12T00:06:41.812081+0000","last_peered":"2024-09-12T00:06:41.812081+0000","last_clean":"2024-09-12T00:06:41.812081+0000","last_became_active":"2024-09-12T00:03:27.335308+0000","last_became_peered":"2024-09-12T00:03:27.335308+0000","last_unstale":"2024-09-12T00:06:41.812081+0000","last_undegraded":"2024-09-12T00:06:41.812081+0000","last_fullsized":"2024-09-12T00:06:41.812081+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:39.812803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'12","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501517+0000","last_change":"2024-09-12T00:03:29.352496+0000","last_active":"2024-09-12T00:06:42.501517+0000","last_peered":"2024-09-12T00:06:42.501517+0000","last_clean":"2024-09-12T00:06:42.501517+0000","last_became_active":"2024-09-12T00:03:29.351783+0000","last_became_peered":"2024-09-12T00:03:29.351783+0000","last_unstale":"2024-09-12T00:06:42.501517+0000","last_undegraded":"2024-09-12T00:06:42.501517+0000","last_fullsized":"2024-09-12T00:06:42.501517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501338+0000","last_change":"2024-09-12T00:03:31.350279+0000","last_active":"2024-09-12T00:06:42.501338+0000","last_peered":"2024-09-12T00:06:42.501338+0000","last_clean":"2024-09-12T00:06:42.501338+0000","last_became_active":"2024-09-12T00:03:31.349244+0000","last_became_peered":"2024-09-12T00:03:31.349244+0000","last_unstale":"2024-09-12T00:06:42.501338+0000","last_undegraded":"2024-09-12T00:06:42.501338+0000","last_fullsized":"2024-09-12T00:06:42.501338+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.420974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719171+0000","last_change":"2024-09-12T00:03:33.382726+0000","last_active":"2024-09-12T00:06:42.719171+0000","last_peered":"2024-09-12T00:06:42.719171+0000","last_clean":"2024-09-12T00:06:42.719171+0000","last_became_active":"2024-09-12T00:03:33.381875+0000","last_became_peered":"2024-09-12T00:03:33.381875+0000","last_unstale":"2024-09-12T00:06:42.719171+0000","last_undegraded":"2024-09-12T00:06:42.719171+0000","last_fullsized":"2024-09-12T00:06:42.719171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"63'12","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066812+0000","last_change":"2024-09-12T00:03:25.357883+0000","last_active":"2024-09-12T00:06:42.066812+0000","last_peered":"2024-09-12T00:06:42.066812+0000","last_clean":"2024-09-12T00:06:42.066812+0000","last_became_active":"2024-09-12T00:03:25.355174+0000","last_became_peered":"2024-09-12T00:03:25.355174+0000","last_unstale":"2024-09-12T00:06:42.066812+0000","last_undegraded":"2024-09-12T00:06:42.066812+0000","last_fullsized":"2024-09-12T00:06:42.066812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:26.621650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"96'21","reported_seq":85,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721209+0000","last_change":"2024-09-12T00:06:29.505713+0000","last_active":"2024-09-12T00:06:42.721209+0000","last_peered":"2024-09-12T00:06:42.721209+0000","last_clean":"2024-09-12T00:06:42.721209+0000","last_became_active":"2024-09-12T00:06:26.670936+0000","last_became_peered":"2024-09-12T00:06:26.670936+0000","last_unstale":"2024-09-12T00:06:42.721209+0000","last_undegraded":"2024-09-12T00:06:42.721209+0000","last_fullsized":"2024-09-12T00:06:42.721209+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:12.048117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813428+0000","last_change":"2024-09-12T00:03:27.347098+0000","last_active":"2024-09-12T00:06:41.813428+0000","last_peered":"2024-09-12T00:06:41.813428+0000","last_clean":"2024-09-12T00:06:41.813428+0000","last_became_active":"2024-09-12T00:03:27.346346+0000","last_became_peered":"2024-09-12T00:03:27.346346+0000","last_unstale":"2024-09-12T00:06:41.813428+0000","last_undegraded":"2024-09-12T00:06:41.813428+0000","last_fullsized":"2024-09-12T00:06:41.813428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:56.250627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'22","reported_seq":265,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812213+0000","last_change":"2024-09-12T00:06:27.562833+0000","last_active":"2024-09-12T00:06:41.812213+0000","last_peered":"2024-09-12T00:06:41.812213+0000","last_clean":"2024-09-12T00:06:41.812213+0000","last_became_active":"2024-09-12T00:06:26.654182+0000","last_became_peered":"2024-09-12T00:06:26.654182+0000","last_unstale":"2024-09-12T00:06:41.812213+0000","last_undegraded":"2024-09-12T00:06:41.812213+0000","last_fullsized":"2024-09-12T00:06:41.812213+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:01.211483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"116'140","reported_seq":362,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.724494+0000","last_change":"2024-09-12T00:06:30.699178+0000","last_active":"2024-09-12T00:06:42.724494+0000","last_peered":"2024-09-12T00:06:42.724494+0000","last_clean":"2024-09-12T00:06:42.724494+0000","last_became_active":"2024-09-12T00:06:30.698465+0000","last_became_peered":"2024-09-12T00:06:30.698465+0000","last_unstale":"2024-09-12T00:06:42.724494+0000","last_undegraded":"2024-09-12T00:06:42.724494+0000","last_fullsized":"2024-09-12T00:06:42.724494+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:48.150663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810365+0000","last_change":"2024-09-12T00:03:33.378439+0000","last_active":"2024-09-12T00:06:41.810365+0000","last_peered":"2024-09-12T00:06:41.810365+0000","last_clean":"2024-09-12T00:06:41.810365+0000","last_became_active":"2024-09-12T00:03:33.374453+0000","last_became_peered":"2024-09-12T00:03:33.374453+0000","last_unstale":"2024-09-12T00:06:41.810365+0000","last_undegraded":"2024-09-12T00:06:41.810365+0000","last_fullsized":"2024-09-12T00:06:41.810365+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"58'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067326+0000","last_change":"2024-09-12T00:03:25.356433+0000","last_active":"2024-09-12T00:06:42.067326+0000","last_peered":"2024-09-12T00:06:42.067326+0000","last_clean":"2024-09-12T00:06:42.067326+0000","last_became_active":"2024-09-12T00:03:25.354803+0000","last_became_peered":"2024-09-12T00:03:25.354803+0000","last_unstale":"2024-09-12T00:06:42.067326+0000","last_undegraded":"2024-09-12T00:06:42.067326+0000","last_fullsized":"2024-09-12T00:06:42.067326+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:00.419686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"96'23","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499086+0000","last_change":"2024-09-12T00:03:23.630527+0000","last_active":"2024-09-12T00:06:42.499086+0000","last_peered":"2024-09-12T00:06:42.499086+0000","last_clean":"2024-09-12T00:06:42.499086+0000","last_became_active":"2024-09-12T00:03:23.630183+0000","last_became_peered":"2024-09-12T00:03:23.630183+0000","last_unstale":"2024-09-12T00:06:42.499086+0000","last_undegraded":"2024-09-12T00:06:42.499086+0000","last_fullsized":"2024-09-12T00:06:42.499086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94371840,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721999+0000","last_change":"2024-09-12T00:06:26.671315+0000","last_active":"2024-09-12T00:06:42.721999+0000","last_peered":"2024-09-12T00:06:42.721999+0000","last_clean":"2024-09-12T00:06:42.721999+0000","last_became_active":"2024-09-12T00:06:26.669946+0000","last_became_peered":"2024-09-12T00:06:26.669946+0000","last_unstale":"2024-09-12T00:06:42.721999+0000","last_undegraded":"2024-09-12T00:06:42.721999+0000","last_fullsized":"2024-09-12T00:06:42.721999+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:53.569121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"96'23","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812548+0000","last_change":"2024-09-12T00:03:29.339735+0000","last_active":"2024-09-12T00:06:41.812548+0000","last_peered":"2024-09-12T00:06:41.812548+0000","last_clean":"2024-09-12T00:06:41.812548+0000","last_became_active":"2024-09-12T00:03:29.338810+0000","last_became_peered":"2024-09-12T00:03:29.338810+0000","last_unstale":"2024-09-12T00:06:41.812548+0000","last_undegraded":"2024-09-12T00:06:41.812548+0000","last_fullsized":"2024-09-12T00:06:41.812548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"116'135","reported_seq":432,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.585527+0000","last_change":"2024-09-12T00:03:31.364647+0000","last_active":"2024-09-12T00:06:42.585527+0000","last_peered":"2024-09-12T00:06:42.585527+0000","last_clean":"2024-09-12T00:06:42.585527+0000","last_became_active":"2024-09-12T00:03:31.353547+0000","last_became_peered":"2024-09-12T00:03:31.353547+0000","last_unstale":"2024-09-12T00:06:42.585527+0000","last_undegraded":"2024-09-12T00:06:42.585527+0000","last_fullsized":"2024-09-12T00:06:42.585527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:20.795870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"63'4","reported_seq":47,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717416+0000","last_change":"2024-09-12T00:06:27.339590+0000","last_active":"2024-09-12T00:06:42.717416+0000","last_peered":"2024-09-12T00:06:42.717416+0000","last_clean":"2024-09-12T00:06:42.717416+0000","last_became_active":"2024-09-12T00:06:26.651618+0000","last_became_peered":"2024-09-12T00:06:26.651618+0000","last_unstale":"2024-09-12T00:06:42.717416+0000","last_undegraded":"2024-09-12T00:06:42.717416+0000","last_fullsized":"2024-09-12T00:06:42.717416+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:58.850777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"96'29","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.817312+0000","last_change":"2024-09-12T00:03:23.602206+0000","last_active":"2024-09-12T00:06:41.817312+0000","last_peered":"2024-09-12T00:06:41.817312+0000","last_clean":"2024-09-12T00:06:41.817312+0000","last_became_active":"2024-09-12T00:03:23.601898+0000","last_became_peered":"2024-09-12T00:03:23.601898+0000","last_unstale":"2024-09-12T00:06:41.817312+0000","last_undegraded":"2024-09-12T00:06:41.817312+0000","last_fullsized":"2024-09-12T00:06:41.817312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:52.625795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499596+0000","last_change":"2024-09-12T00:03:27.331111+0000","last_active":"2024-09-12T00:06:42.499596+0000","last_peered":"2024-09-12T00:06:42.499596+0000","last_clean":"2024-09-12T00:06:42.499596+0000","last_became_active":"2024-09-12T00:03:27.329672+0000","last_became_peered":"2024-09-12T00:03:27.329672+0000","last_unstale":"2024-09-12T00:06:42.499596+0000","last_undegraded":"2024-09-12T00:06:42.499596+0000","last_fullsized":"2024-09-12T00:06:42.499596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"96'34","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814758+0000","last_change":"2024-09-12T00:03:29.335931+0000","last_active":"2024-09-12T00:06:41.814758+0000","last_peered":"2024-09-12T00:06:41.814758+0000","last_clean":"2024-09-12T00:06:41.814758+0000","last_became_active":"2024-09-12T00:03:29.335044+0000","last_became_peered":"2024-09-12T00:03:29.335044+0000","last_unstale":"2024-09-12T00:06:41.814758+0000","last_undegraded":"2024-09-12T00:06:41.814758+0000","last_fullsized":"2024-09-12T00:06:41.814758+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:57.131209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719379+0000","last_change":"2024-09-12T00:03:31.355001+0000","last_active":"2024-09-12T00:06:42.719379+0000","last_peered":"2024-09-12T00:06:42.719379+0000","last_clean":"2024-09-12T00:06:42.719379+0000","last_became_active":"2024-09-12T00:03:31.354160+0000","last_became_peered":"2024-09-12T00:03:31.354160+0000","last_unstale":"2024-09-12T00:06:42.719379+0000","last_undegraded":"2024-09-12T00:06:42.719379+0000","last_fullsized":"2024-09-12T00:06:42.719379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:29.868141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810884+0000","last_change":"2024-09-12T00:06:26.664709+0000","last_active":"2024-09-12T00:06:41.810884+0000","last_peered":"2024-09-12T00:06:41.810884+0000","last_clean":"2024-09-12T00:06:41.810884+0000","last_became_active":"2024-09-12T00:06:26.664401+0000","last_became_peered":"2024-09-12T00:06:26.664401+0000","last_unstale":"2024-09-12T00:06:41.810884+0000","last_undegraded":"2024-09-12T00:06:41.810884+0000","last_fullsized":"2024-09-12T00:06:41.810884+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:17.791780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'2","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499737+0000","last_change":"2024-09-12T00:03:25.357300+0000","last_active":"2024-09-12T00:06:42.499737+0000","last_peered":"2024-09-12T00:06:42.499737+0000","last_clean":"2024-09-12T00:06:42.499737+0000","last_became_active":"2024-09-12T00:03:25.356970+0000","last_became_peered":"2024-09-12T00:03:25.356970+0000","last_unstale":"2024-09-12T00:06:42.499737+0000","last_undegraded":"2024-09-12T00:06:42.499737+0000","last_fullsized":"2024-09-12T00:06:42.499737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:04.193738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"96'19","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814414+0000","last_change":"2024-09-12T00:03:23.609700+0000","last_active":"2024-09-12T00:06:41.814414+0000","last_peered":"2024-09-12T00:06:41.814414+0000","last_clean":"2024-09-12T00:06:41.814414+0000","last_became_active":"2024-09-12T00:03:23.609435+0000","last_became_peered":"2024-09-12T00:03:23.609435+0000","last_unstale":"2024-09-12T00:06:41.814414+0000","last_undegraded":"2024-09-12T00:06:41.814414+0000","last_fullsized":"2024-09-12T00:06:41.814414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720734+0000","last_change":"2024-09-12T00:03:27.339670+0000","last_active":"2024-09-12T00:06:42.720734+0000","last_peered":"2024-09-12T00:06:42.720734+0000","last_clean":"2024-09-12T00:06:42.720734+0000","last_became_active":"2024-09-12T00:03:27.338880+0000","last_became_peered":"2024-09-12T00:03:27.338880+0000","last_unstale":"2024-09-12T00:06:42.720734+0000","last_undegraded":"2024-09-12T00:06:42.720734+0000","last_fullsized":"2024-09-12T00:06:42.720734+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:35.068652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"96'25","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811038+0000","last_change":"2024-09-12T00:03:29.337666+0000","last_active":"2024-09-12T00:06:41.811038+0000","last_peered":"2024-09-12T00:06:41.811038+0000","last_clean":"2024-09-12T00:06:41.811038+0000","last_became_active":"2024-09-12T00:03:29.336957+0000","last_became_peered":"2024-09-12T00:03:29.336957+0000","last_unstale":"2024-09-12T00:06:41.811038+0000","last_undegraded":"2024-09-12T00:06:41.811038+0000","last_fullsized":"2024-09-12T00:06:41.811038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:58.417315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":21,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810940+0000","last_change":"2024-09-12T00:03:31.348590+0000","last_active":"2024-09-12T00:06:41.810940+0000","last_peered":"2024-09-12T00:06:41.810940+0000","last_clean":"2024-09-12T00:06:41.810940+0000","last_became_active":"2024-09-12T00:03:31.347736+0000","last_became_peered":"2024-09-12T00:03:31.347736+0000","last_unstale":"2024-09-12T00:06:41.810940+0000","last_undegraded":"2024-09-12T00:06:41.810940+0000","last_fullsized":"2024-09-12T00:06:41.810940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:04.962492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"59'8","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500524+0000","last_change":"2024-09-12T00:03:33.379699+0000","last_active":"2024-09-12T00:06:42.500524+0000","last_peered":"2024-09-12T00:06:42.500524+0000","last_clean":"2024-09-12T00:06:42.500524+0000","last_became_active":"2024-09-12T00:03:33.378945+0000","last_became_peered":"2024-09-12T00:03:33.378945+0000","last_unstale":"2024-09-12T00:06:42.500524+0000","last_undegraded":"2024-09-12T00:06:42.500524+0000","last_fullsized":"2024-09-12T00:06:42.500524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:23.270488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'6","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812122+0000","last_change":"2024-09-12T00:06:28.326850+0000","last_active":"2024-09-12T00:06:41.812122+0000","last_peered":"2024-09-12T00:06:41.812122+0000","last_clean":"2024-09-12T00:06:41.812122+0000","last_became_active":"2024-09-12T00:06:26.668131+0000","last_became_peered":"2024-09-12T00:06:26.668131+0000","last_unstale":"2024-09-12T00:06:41.812122+0000","last_undegraded":"2024-09-12T00:06:41.812122+0000","last_fullsized":"2024-09-12T00:06:41.812122+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:18.255160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"95'17","reported_seq":77,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717787+0000","last_change":"2024-09-12T00:06:33.441486+0000","last_active":"2024-09-12T00:06:42.717787+0000","last_peered":"2024-09-12T00:06:42.717787+0000","last_clean":"2024-09-12T00:06:42.717787+0000","last_became_active":"2024-09-12T00:06:26.679723+0000","last_became_peered":"2024-09-12T00:06:26.679723+0000","last_unstale":"2024-09-12T00:06:42.717787+0000","last_undegraded":"2024-09-12T00:06:42.717787+0000","last_fullsized":"2024-09-12T00:06:42.717787+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:59.722762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065103+0000","last_change":"2024-09-12T00:03:27.348080+0000","last_active":"2024-09-12T00:06:42.065103+0000","last_peered":"2024-09-12T00:06:42.065103+0000","last_clean":"2024-09-12T00:06:42.065103+0000","last_became_active":"2024-09-12T00:03:27.347288+0000","last_became_peered":"2024-09-12T00:03:27.347288+0000","last_unstale":"2024-09-12T00:06:42.065103+0000","last_undegraded":"2024-09-12T00:06:42.065103+0000","last_fullsized":"2024-09-12T00:06:42.065103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:37.033224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"96'37","reported_seq":61,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720107+0000","last_change":"2024-09-12T00:06:28.360303+0000","last_active":"2024-09-12T00:06:42.720107+0000","last_peered":"2024-09-12T00:06:42.720107+0000","last_clean":"2024-09-12T00:06:42.720107+0000","last_became_active":"2024-09-12T00:06:26.668791+0000","last_became_peered":"2024-09-12T00:06:26.668791+0000","last_unstale":"2024-09-12T00:06:42.720107+0000","last_undegraded":"2024-09-12T00:06:42.720107+0000","last_fullsized":"2024-09-12T00:06:42.720107+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:49.033011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120747,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":45,"num_read_kb":34,"num_write":30,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":116871,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"116'135","reported_seq":351,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.585603+0000","last_change":"2024-09-12T00:03:31.354114+0000","last_active":"2024-09-12T00:06:42.585603+0000","last_peered":"2024-09-12T00:06:42.585603+0000","last_clean":"2024-09-12T00:06:42.585603+0000","last_became_active":"2024-09-12T00:03:31.353358+0000","last_became_peered":"2024-09-12T00:03:31.353358+0000","last_unstale":"2024-09-12T00:06:42.585603+0000","last_undegraded":"2024-09-12T00:06:42.585603+0000","last_fullsized":"2024-09-12T00:06:42.585603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:56.624718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719909+0000","last_change":"2024-09-12T00:03:33.383917+0000","last_active":"2024-09-12T00:06:42.719909+0000","last_peered":"2024-09-12T00:06:42.719909+0000","last_clean":"2024-09-12T00:06:42.719909+0000","last_became_active":"2024-09-12T00:03:33.383199+0000","last_became_peered":"2024-09-12T00:03:33.383199+0000","last_unstale":"2024-09-12T00:06:42.719909+0000","last_undegraded":"2024-09-12T00:06:42.719909+0000","last_fullsized":"2024-09-12T00:06:42.719909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:37.428182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"84'10","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065948+0000","last_change":"2024-09-12T00:03:25.356706+0000","last_active":"2024-09-12T00:06:42.065948+0000","last_peered":"2024-09-12T00:06:42.065948+0000","last_clean":"2024-09-12T00:06:42.065948+0000","last_became_active":"2024-09-12T00:03:25.354555+0000","last_became_peered":"2024-09-12T00:03:25.354555+0000","last_unstale":"2024-09-12T00:06:42.065948+0000","last_undegraded":"2024-09-12T00:06:42.065948+0000","last_fullsized":"2024-09-12T00:06:42.065948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:55.543336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"96'39","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815809+0000","last_change":"2024-09-12T00:03:23.612430+0000","last_active":"2024-09-12T00:06:41.815809+0000","last_peered":"2024-09-12T00:06:41.815809+0000","last_clean":"2024-09-12T00:06:41.815809+0000","last_became_active":"2024-09-12T00:03:23.612165+0000","last_became_peered":"2024-09-12T00:03:23.612165+0000","last_unstale":"2024-09-12T00:06:41.815809+0000","last_undegraded":"2024-09-12T00:06:41.815809+0000","last_fullsized":"2024-09-12T00:06:41.815809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:31.444343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":159744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722313+0000","last_change":"2024-09-12T00:03:27.329228+0000","last_active":"2024-09-12T00:06:42.722313+0000","last_peered":"2024-09-12T00:06:42.722313+0000","last_clean":"2024-09-12T00:06:42.722313+0000","last_became_active":"2024-09-12T00:03:27.328497+0000","last_became_peered":"2024-09-12T00:03:27.328497+0000","last_unstale":"2024-09-12T00:06:42.722313+0000","last_undegraded":"2024-09-12T00:06:42.722313+0000","last_fullsized":"2024-09-12T00:06:42.722313+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"96'42","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810133+0000","last_change":"2024-09-12T00:03:29.332778+0000","last_active":"2024-09-12T00:06:41.810133+0000","last_peered":"2024-09-12T00:06:41.810133+0000","last_clean":"2024-09-12T00:06:41.810133+0000","last_became_active":"2024-09-12T00:03:29.332010+0000","last_became_peered":"2024-09-12T00:03:29.332010+0000","last_unstale":"2024-09-12T00:06:41.810133+0000","last_undegraded":"2024-09-12T00:06:41.810133+0000","last_fullsized":"2024-09-12T00:06:41.810133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:13.563107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125399,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":47,"num_read_kb":36,"num_write":30,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065300+0000","last_change":"2024-09-12T00:03:31.354374+0000","last_active":"2024-09-12T00:06:42.065300+0000","last_peered":"2024-09-12T00:06:42.065300+0000","last_clean":"2024-09-12T00:06:42.065300+0000","last_became_active":"2024-09-12T00:03:31.353407+0000","last_became_peered":"2024-09-12T00:03:31.353407+0000","last_unstale":"2024-09-12T00:06:42.065300+0000","last_undegraded":"2024-09-12T00:06:42.065300+0000","last_fullsized":"2024-09-12T00:06:42.065300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:30.520217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"93'7","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723759+0000","last_change":"2024-09-12T00:03:33.385373+0000","last_active":"2024-09-12T00:06:42.723759+0000","last_peered":"2024-09-12T00:06:42.723759+0000","last_clean":"2024-09-12T00:06:42.723759+0000","last_became_active":"2024-09-12T00:03:33.384559+0000","last_became_peered":"2024-09-12T00:03:33.384559+0000","last_unstale":"2024-09-12T00:06:42.723759+0000","last_undegraded":"2024-09-12T00:06:42.723759+0000","last_fullsized":"2024-09-12T00:06:42.723759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:55.924174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815429+0000","last_change":"2024-09-12T00:03:25.326677+0000","last_active":"2024-09-12T00:06:41.815429+0000","last_peered":"2024-09-12T00:06:41.815429+0000","last_clean":"2024-09-12T00:06:41.815429+0000","last_became_active":"2024-09-12T00:03:25.325840+0000","last_became_peered":"2024-09-12T00:03:25.325840+0000","last_unstale":"2024-09-12T00:06:41.815429+0000","last_undegraded":"2024-09-12T00:06:41.815429+0000","last_fullsized":"2024-09-12T00:06:41.815429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:07.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"95'22","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720457+0000","last_change":"2024-09-12T00:03:23.616943+0000","last_active":"2024-09-12T00:06:42.720457+0000","last_peered":"2024-09-12T00:06:42.720457+0000","last_clean":"2024-09-12T00:06:42.720457+0000","last_became_active":"2024-09-12T00:03:23.616200+0000","last_became_peered":"2024-09-12T00:03:23.616200+0000","last_unstale":"2024-09-12T00:06:42.720457+0000","last_undegraded":"2024-09-12T00:06:42.720457+0000","last_fullsized":"2024-09-12T00:06:42.720457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722289+0000","last_change":"2024-09-12T00:03:27.330506+0000","last_active":"2024-09-12T00:06:42.722289+0000","last_peered":"2024-09-12T00:06:42.722289+0000","last_clean":"2024-09-12T00:06:42.722289+0000","last_became_active":"2024-09-12T00:03:27.329830+0000","last_became_peered":"2024-09-12T00:03:27.329830+0000","last_unstale":"2024-09-12T00:06:42.722289+0000","last_undegraded":"2024-09-12T00:06:42.722289+0000","last_fullsized":"2024-09-12T00:06:42.722289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:03.446090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"96'25","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501739+0000","last_change":"2024-09-12T00:03:29.343655+0000","last_active":"2024-09-12T00:06:42.501739+0000","last_peered":"2024-09-12T00:06:42.501739+0000","last_clean":"2024-09-12T00:06:42.501739+0000","last_became_active":"2024-09-12T00:03:29.343178+0000","last_became_peered":"2024-09-12T00:03:29.343178+0000","last_unstale":"2024-09-12T00:06:42.501739+0000","last_undegraded":"2024-09-12T00:06:42.501739+0000","last_fullsized":"2024-09-12T00:06:42.501739+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723516+0000","last_change":"2024-09-12T00:03:31.358077+0000","last_active":"2024-09-12T00:06:42.723516+0000","last_peered":"2024-09-12T00:06:42.723516+0000","last_clean":"2024-09-12T00:06:42.723516+0000","last_became_active":"2024-09-12T00:03:31.357272+0000","last_became_peered":"2024-09-12T00:03:31.357272+0000","last_unstale":"2024-09-12T00:06:42.723516+0000","last_undegraded":"2024-09-12T00:06:42.723516+0000","last_fullsized":"2024-09-12T00:06:42.723516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:37.991682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"76'4","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065822+0000","last_change":"2024-09-12T00:06:26.690241+0000","last_active":"2024-09-12T00:06:42.065822+0000","last_peered":"2024-09-12T00:06:42.065822+0000","last_clean":"2024-09-12T00:06:42.065822+0000","last_became_active":"2024-09-12T00:06:26.653908+0000","last_became_peered":"2024-09-12T00:06:26.653908+0000","last_unstale":"2024-09-12T00:06:42.065822+0000","last_undegraded":"2024-09-12T00:06:42.065822+0000","last_fullsized":"2024-09-12T00:06:42.065822+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:12.338436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"76'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721025+0000","last_change":"2024-09-12T00:06:32.433900+0000","last_active":"2024-09-12T00:06:42.721025+0000","last_peered":"2024-09-12T00:06:42.721025+0000","last_clean":"2024-09-12T00:06:42.721025+0000","last_became_active":"2024-09-12T00:06:26.675405+0000","last_became_peered":"2024-09-12T00:06:26.675405+0000","last_unstale":"2024-09-12T00:06:42.721025+0000","last_undegraded":"2024-09-12T00:06:42.721025+0000","last_fullsized":"2024-09-12T00:06:42.721025+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:53.098500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"96'21","reported_seq":85,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721420+0000","last_change":"2024-09-12T00:06:32.375501+0000","last_active":"2024-09-12T00:06:42.721420+0000","last_peered":"2024-09-12T00:06:42.721420+0000","last_clean":"2024-09-12T00:06:42.721420+0000","last_became_active":"2024-09-12T00:06:26.663178+0000","last_became_peered":"2024-09-12T00:06:26.663178+0000","last_unstale":"2024-09-12T00:06:42.721420+0000","last_undegraded":"2024-09-12T00:06:42.721420+0000","last_fullsized":"2024-09-12T00:06:42.721420+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:27.738037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":138412032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065958+0000","last_change":"2024-09-12T00:03:27.342295+0000","last_active":"2024-09-12T00:06:42.065958+0000","last_peered":"2024-09-12T00:06:42.065958+0000","last_clean":"2024-09-12T00:06:42.065958+0000","last_became_active":"2024-09-12T00:03:27.341619+0000","last_became_peered":"2024-09-12T00:03:27.341619+0000","last_unstale":"2024-09-12T00:06:42.065958+0000","last_undegraded":"2024-09-12T00:06:42.065958+0000","last_fullsized":"2024-09-12T00:06:42.065958+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:00.908798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"96'23","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066215+0000","last_change":"2024-09-12T00:03:29.336391+0000","last_active":"2024-09-12T00:06:42.066215+0000","last_peered":"2024-09-12T00:06:42.066215+0000","last_clean":"2024-09-12T00:06:42.066215+0000","last_became_active":"2024-09-12T00:03:29.335679+0000","last_became_peered":"2024-09-12T00:03:29.335679+0000","last_unstale":"2024-09-12T00:06:42.066215+0000","last_undegraded":"2024-09-12T00:06:42.066215+0000","last_fullsized":"2024-09-12T00:06:42.066215+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:58.540539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"116'135","reported_seq":396,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723110+0000","last_change":"2024-09-12T00:03:31.351170+0000","last_active":"2024-09-12T00:06:42.723110+0000","last_peered":"2024-09-12T00:06:42.723110+0000","last_clean":"2024-09-12T00:06:42.723110+0000","last_became_active":"2024-09-12T00:03:31.350264+0000","last_became_peered":"2024-09-12T00:03:31.350264+0000","last_unstale":"2024-09-12T00:06:42.723110+0000","last_undegraded":"2024-09-12T00:06:42.723110+0000","last_fullsized":"2024-09-12T00:06:42.723110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:51.368815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"59'3","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719548+0000","last_change":"2024-09-12T00:03:33.368236+0000","last_active":"2024-09-12T00:06:42.719548+0000","last_peered":"2024-09-12T00:06:42.719548+0000","last_clean":"2024-09-12T00:06:42.719548+0000","last_became_active":"2024-09-12T00:03:33.367424+0000","last_became_peered":"2024-09-12T00:03:33.367424+0000","last_unstale":"2024-09-12T00:06:42.719548+0000","last_undegraded":"2024-09-12T00:06:42.719548+0000","last_fullsized":"2024-09-12T00:06:42.719548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"76'6","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813109+0000","last_change":"2024-09-12T00:06:28.869705+0000","last_active":"2024-09-12T00:06:41.813109+0000","last_peered":"2024-09-12T00:06:41.813109+0000","last_clean":"2024-09-12T00:06:41.813109+0000","last_became_active":"2024-09-12T00:06:26.671547+0000","last_became_peered":"2024-09-12T00:06:26.671547+0000","last_unstale":"2024-09-12T00:06:41.813109+0000","last_undegraded":"2024-09-12T00:06:41.813109+0000","last_fullsized":"2024-09-12T00:06:41.813109+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:55.946290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"96'22","reported_seq":87,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721098+0000","last_change":"2024-09-12T00:06:27.817806+0000","last_active":"2024-09-12T00:06:42.721098+0000","last_peered":"2024-09-12T00:06:42.721098+0000","last_clean":"2024-09-12T00:06:42.721098+0000","last_became_active":"2024-09-12T00:06:26.654104+0000","last_became_peered":"2024-09-12T00:06:26.654104+0000","last_unstale":"2024-09-12T00:06:42.721098+0000","last_undegraded":"2024-09-12T00:06:42.721098+0000","last_fullsized":"2024-09-12T00:06:42.721098+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:30.461829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":368,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501711+0000","last_change":"2024-09-12T00:03:27.331569+0000","last_active":"2024-09-12T00:06:42.501711+0000","last_peered":"2024-09-12T00:06:42.501711+0000","last_clean":"2024-09-12T00:06:42.501711+0000","last_became_active":"2024-09-12T00:03:27.330909+0000","last_became_peered":"2024-09-12T00:03:27.330909+0000","last_unstale":"2024-09-12T00:06:42.501711+0000","last_undegraded":"2024-09-12T00:06:42.501711+0000","last_fullsized":"2024-09-12T00:06:42.501711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"59'11","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720583+0000","last_change":"2024-09-12T00:03:29.338880+0000","last_active":"2024-09-12T00:06:42.720583+0000","last_peered":"2024-09-12T00:06:42.720583+0000","last_clean":"2024-09-12T00:06:42.720583+0000","last_became_active":"2024-09-12T00:03:29.338110+0000","last_became_peered":"2024-09-12T00:03:29.338110+0000","last_unstale":"2024-09-12T00:06:42.720583+0000","last_undegraded":"2024-09-12T00:06:42.720583+0000","last_fullsized":"2024-09-12T00:06:42.720583+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.054460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"116'135","reported_seq":402,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.585555+0000","last_change":"2024-09-12T00:03:31.339117+0000","last_active":"2024-09-12T00:06:42.585555+0000","last_peered":"2024-09-12T00:06:42.585555+0000","last_clean":"2024-09-12T00:06:42.585555+0000","last_became_active":"2024-09-12T00:03:31.338426+0000","last_became_peered":"2024-09-12T00:03:31.338426+0000","last_unstale":"2024-09-12T00:06:42.585555+0000","last_undegraded":"2024-09-12T00:06:42.585555+0000","last_fullsized":"2024-09-12T00:06:42.585555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:19.304169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811106+0000","last_change":"2024-09-12T00:03:33.385051+0000","last_active":"2024-09-12T00:06:41.811106+0000","last_peered":"2024-09-12T00:06:41.811106+0000","last_clean":"2024-09-12T00:06:41.811106+0000","last_became_active":"2024-09-12T00:03:33.380088+0000","last_became_peered":"2024-09-12T00:03:33.380088+0000","last_unstale":"2024-09-12T00:06:41.811106+0000","last_undegraded":"2024-09-12T00:06:41.811106+0000","last_fullsized":"2024-09-12T00:06:41.811106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:02.972871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.724550+0000","last_change":"2024-09-12T00:03:25.336113+0000","last_active":"2024-09-12T00:06:42.724550+0000","last_peered":"2024-09-12T00:06:42.724550+0000","last_clean":"2024-09-12T00:06:42.724550+0000","last_became_active":"2024-09-12T00:03:25.335449+0000","last_became_peered":"2024-09-12T00:03:25.335449+0000","last_unstale":"2024-09-12T00:06:42.724550+0000","last_undegraded":"2024-09-12T00:06:42.724550+0000","last_fullsized":"2024-09-12T00:06:42.724550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:34.277614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"96'24","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811100+0000","last_change":"2024-09-12T00:03:23.619285+0000","last_active":"2024-09-12T00:06:41.811100+0000","last_peered":"2024-09-12T00:06:41.811100+0000","last_clean":"2024-09-12T00:06:41.811100+0000","last_became_active":"2024-09-12T00:03:23.614187+0000","last_became_peered":"2024-09-12T00:03:23.614187+0000","last_unstale":"2024-09-12T00:06:41.811100+0000","last_undegraded":"2024-09-12T00:06:41.811100+0000","last_fullsized":"2024-09-12T00:06:41.811100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720307+0000","last_change":"2024-09-12T00:06:26.673924+0000","last_active":"2024-09-12T00:06:42.720307+0000","last_peered":"2024-09-12T00:06:42.720307+0000","last_clean":"2024-09-12T00:06:42.720307+0000","last_became_active":"2024-09-12T00:06:26.670945+0000","last_became_peered":"2024-09-12T00:06:26.670945+0000","last_unstale":"2024-09-12T00:06:42.720307+0000","last_undegraded":"2024-09-12T00:06:42.720307+0000","last_fullsized":"2024-09-12T00:06:42.720307+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:56.956200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"96'25","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500794+0000","last_change":"2024-09-12T00:03:29.345719+0000","last_active":"2024-09-12T00:06:42.500794+0000","last_peered":"2024-09-12T00:06:42.500794+0000","last_clean":"2024-09-12T00:06:42.500794+0000","last_became_active":"2024-09-12T00:03:29.345243+0000","last_became_peered":"2024-09-12T00:03:29.345243+0000","last_unstale":"2024-09-12T00:06:42.500794+0000","last_undegraded":"2024-09-12T00:06:42.500794+0000","last_fullsized":"2024-09-12T00:06:42.500794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:41.153263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812258+0000","last_change":"2024-09-12T00:03:31.360630+0000","last_active":"2024-09-12T00:06:41.812258+0000","last_peered":"2024-09-12T00:06:41.812258+0000","last_clean":"2024-09-12T00:06:41.812258+0000","last_became_active":"2024-09-12T00:03:31.359763+0000","last_became_peered":"2024-09-12T00:03:31.359763+0000","last_unstale":"2024-09-12T00:06:41.812258+0000","last_undegraded":"2024-09-12T00:06:41.812258+0000","last_fullsized":"2024-09-12T00:06:41.812258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"84'6","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719339+0000","last_change":"2024-09-12T00:03:33.372178+0000","last_active":"2024-09-12T00:06:42.719339+0000","last_peered":"2024-09-12T00:06:42.719339+0000","last_clean":"2024-09-12T00:06:42.719339+0000","last_became_active":"2024-09-12T00:03:33.370562+0000","last_became_peered":"2024-09-12T00:03:33.370562+0000","last_unstale":"2024-09-12T00:06:42.719339+0000","last_undegraded":"2024-09-12T00:06:42.719339+0000","last_fullsized":"2024-09-12T00:06:42.719339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:31.888153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'10","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720452+0000","last_change":"2024-09-12T00:06:32.425494+0000","last_active":"2024-09-12T00:06:42.720452+0000","last_peered":"2024-09-12T00:06:42.720452+0000","last_clean":"2024-09-12T00:06:42.720452+0000","last_became_active":"2024-09-12T00:06:26.674937+0000","last_became_peered":"2024-09-12T00:06:26.674937+0000","last_unstale":"2024-09-12T00:06:42.720452+0000","last_undegraded":"2024-09-12T00:06:42.720452+0000","last_fullsized":"2024-09-12T00:06:42.720452+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:09.992203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":300,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499047+0000","last_change":"2024-09-12T00:03:11.770141+0000","last_active":"2024-09-12T00:06:42.499047+0000","last_peered":"2024-09-12T00:06:42.499047+0000","last_clean":"2024-09-12T00:06:42.499047+0000","last_became_active":"2024-09-12T00:03:11.767988+0000","last_became_peered":"2024-09-12T00:03:11.767988+0000","last_unstale":"2024-09-12T00:06:42.499047+0000","last_undegraded":"2024-09-12T00:06:42.499047+0000","last_fullsized":"2024-09-12T00:06:42.499047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_clean_scrub_stamp":"2024-09-12T00:03:10.462069+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:26.289955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717386+0000","last_change":"2024-09-12T00:06:28.888645+0000","last_active":"2024-09-12T00:06:42.717386+0000","last_peered":"2024-09-12T00:06:42.717386+0000","last_clean":"2024-09-12T00:06:42.717386+0000","last_became_active":"2024-09-12T00:06:26.671587+0000","last_became_peered":"2024-09-12T00:06:26.671587+0000","last_unstale":"2024-09-12T00:06:42.717386+0000","last_undegraded":"2024-09-12T00:06:42.717386+0000","last_fullsized":"2024-09-12T00:06:42.717386+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:03.325846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"95'24","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811486+0000","last_change":"2024-09-12T00:03:23.621849+0000","last_active":"2024-09-12T00:06:41.811486+0000","last_peered":"2024-09-12T00:06:41.811486+0000","last_clean":"2024-09-12T00:06:41.811486+0000","last_became_active":"2024-09-12T00:03:23.621146+0000","last_became_peered":"2024-09-12T00:03:23.621146+0000","last_unstale":"2024-09-12T00:06:41.811486+0000","last_undegraded":"2024-09-12T00:06:41.811486+0000","last_fullsized":"2024-09-12T00:06:41.811486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:38.426691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809414+0000","last_change":"2024-09-12T00:03:27.316175+0000","last_active":"2024-09-12T00:06:41.809414+0000","last_peered":"2024-09-12T00:06:41.809414+0000","last_clean":"2024-09-12T00:06:41.809414+0000","last_became_active":"2024-09-12T00:03:27.315502+0000","last_became_peered":"2024-09-12T00:03:27.315502+0000","last_unstale":"2024-09-12T00:06:41.809414+0000","last_undegraded":"2024-09-12T00:06:41.809414+0000","last_fullsized":"2024-09-12T00:06:41.809414+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:21.448686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"96'44","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720067+0000","last_change":"2024-09-12T00:06:28.900645+0000","last_active":"2024-09-12T00:06:42.720067+0000","last_peered":"2024-09-12T00:06:42.720067+0000","last_clean":"2024-09-12T00:06:42.720067+0000","last_became_active":"2024-09-12T00:06:26.667623+0000","last_became_peered":"2024-09-12T00:06:26.667623+0000","last_unstale":"2024-09-12T00:06:42.720067+0000","last_undegraded":"2024-09-12T00:06:42.720067+0000","last_fullsized":"2024-09-12T00:06:42.720067+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:36.584753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":38,"num_read_kb":26,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066468+0000","last_change":"2024-09-12T00:03:31.361408+0000","last_active":"2024-09-12T00:06:42.066468+0000","last_peered":"2024-09-12T00:06:42.066468+0000","last_clean":"2024-09-12T00:06:42.066468+0000","last_became_active":"2024-09-12T00:03:31.360462+0000","last_became_peered":"2024-09-12T00:03:31.360462+0000","last_unstale":"2024-09-12T00:06:42.066468+0000","last_undegraded":"2024-09-12T00:06:42.066468+0000","last_fullsized":"2024-09-12T00:06:42.066468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:58.407571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"59'4","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812851+0000","last_change":"2024-09-12T00:03:33.388253+0000","last_active":"2024-09-12T00:06:41.812851+0000","last_peered":"2024-09-12T00:06:41.812851+0000","last_clean":"2024-09-12T00:06:41.812851+0000","last_became_active":"2024-09-12T00:03:33.387457+0000","last_became_peered":"2024-09-12T00:03:33.387457+0000","last_unstale":"2024-09-12T00:06:41.812851+0000","last_undegraded":"2024-09-12T00:06:41.812851+0000","last_fullsized":"2024-09-12T00:06:41.812851+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:46.021740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066818+0000","last_change":"2024-09-12T00:03:25.357970+0000","last_active":"2024-09-12T00:06:42.066818+0000","last_peered":"2024-09-12T00:06:42.066818+0000","last_clean":"2024-09-12T00:06:42.066818+0000","last_became_active":"2024-09-12T00:03:25.355306+0000","last_became_peered":"2024-09-12T00:03:25.355306+0000","last_unstale":"2024-09-12T00:06:42.066818+0000","last_undegraded":"2024-09-12T00:06:42.066818+0000","last_fullsized":"2024-09-12T00:06:42.066818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:17.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717548+0000","last_change":"2024-09-12T00:06:26.654149+0000","last_active":"2024-09-12T00:06:42.717548+0000","last_peered":"2024-09-12T00:06:42.717548+0000","last_clean":"2024-09-12T00:06:42.717548+0000","last_became_active":"2024-09-12T00:06:26.653574+0000","last_became_peered":"2024-09-12T00:06:26.653574+0000","last_unstale":"2024-09-12T00:06:42.717548+0000","last_undegraded":"2024-09-12T00:06:42.717548+0000","last_fullsized":"2024-09-12T00:06:42.717548+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:55.656413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"96'28","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720943+0000","last_change":"2024-09-12T00:03:23.622111+0000","last_active":"2024-09-12T00:06:42.720943+0000","last_peered":"2024-09-12T00:06:42.720943+0000","last_clean":"2024-09-12T00:06:42.720943+0000","last_became_active":"2024-09-12T00:03:23.621358+0000","last_became_peered":"2024-09-12T00:03:23.621358+0000","last_unstale":"2024-09-12T00:06:42.720943+0000","last_undegraded":"2024-09-12T00:06:42.720943+0000","last_fullsized":"2024-09-12T00:06:42.720943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:02.202230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722205+0000","last_change":"2024-09-12T00:06:26.659401+0000","last_active":"2024-09-12T00:06:42.722205+0000","last_peered":"2024-09-12T00:06:42.722205+0000","last_clean":"2024-09-12T00:06:42.722205+0000","last_became_active":"2024-09-12T00:06:26.657376+0000","last_became_peered":"2024-09-12T00:06:26.657376+0000","last_unstale":"2024-09-12T00:06:42.722205+0000","last_undegraded":"2024-09-12T00:06:42.722205+0000","last_fullsized":"2024-09-12T00:06:42.722205+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:27.337831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"116'142","reported_seq":430,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721300+0000","last_change":"2024-09-12T00:03:29.346819+0000","last_active":"2024-09-12T00:06:42.721300+0000","last_peered":"2024-09-12T00:06:42.721300+0000","last_clean":"2024-09-12T00:06:42.721300+0000","last_became_active":"2024-09-12T00:03:29.346101+0000","last_became_peered":"2024-09-12T00:03:29.346101+0000","last_unstale":"2024-09-12T00:06:42.721300+0000","last_undegraded":"2024-09-12T00:06:42.721300+0000","last_fullsized":"2024-09-12T00:06:42.721300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:27.268327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":183,"num_read_kb":167,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721121+0000","last_change":"2024-09-12T00:06:26.679841+0000","last_active":"2024-09-12T00:06:42.721121+0000","last_peered":"2024-09-12T00:06:42.721121+0000","last_clean":"2024-09-12T00:06:42.721121+0000","last_became_active":"2024-09-12T00:06:26.675966+0000","last_became_peered":"2024-09-12T00:06:26.675966+0000","last_unstale":"2024-09-12T00:06:42.721121+0000","last_undegraded":"2024-09-12T00:06:42.721121+0000","last_fullsized":"2024-09-12T00:06:42.721121+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:39.439184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064787+0000","last_change":"2024-09-12T00:03:33.386144+0000","last_active":"2024-09-12T00:06:42.064787+0000","last_peered":"2024-09-12T00:06:42.064787+0000","last_clean":"2024-09-12T00:06:42.064787+0000","last_became_active":"2024-09-12T00:03:33.384951+0000","last_became_peered":"2024-09-12T00:03:33.384951+0000","last_unstale":"2024-09-12T00:06:42.064787+0000","last_undegraded":"2024-09-12T00:06:42.064787+0000","last_fullsized":"2024-09-12T00:06:42.064787+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:49.807501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"59'2","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720659+0000","last_change":"2024-09-12T00:03:25.332801+0000","last_active":"2024-09-12T00:06:42.720659+0000","last_peered":"2024-09-12T00:06:42.720659+0000","last_clean":"2024-09-12T00:06:42.720659+0000","last_became_active":"2024-09-12T00:03:25.331652+0000","last_became_peered":"2024-09-12T00:03:25.331652+0000","last_unstale":"2024-09-12T00:06:42.720659+0000","last_undegraded":"2024-09-12T00:06:42.720659+0000","last_fullsized":"2024-09-12T00:06:42.720659+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718983+0000","last_change":"2024-09-12T00:03:18.892423+0000","last_active":"2024-09-12T00:06:42.718983+0000","last_peered":"2024-09-12T00:06:42.718983+0000","last_clean":"2024-09-12T00:06:42.718983+0000","last_became_active":"2024-09-12T00:03:16.559698+0000","last_became_peered":"2024-09-12T00:03:16.559698+0000","last_unstale":"2024-09-12T00:06:42.718983+0000","last_undegraded":"2024-09-12T00:06:42.718983+0000","last_fullsized":"2024-09-12T00:06:42.718983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:21.453461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082440599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"95'22","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064436+0000","last_change":"2024-09-12T00:03:23.633606+0000","last_active":"2024-09-12T00:06:42.064436+0000","last_peered":"2024-09-12T00:06:42.064436+0000","last_clean":"2024-09-12T00:06:42.064436+0000","last_became_active":"2024-09-12T00:03:23.632795+0000","last_became_peered":"2024-09-12T00:03:23.632795+0000","last_unstale":"2024-09-12T00:06:42.064436+0000","last_undegraded":"2024-09-12T00:06:42.064436+0000","last_fullsized":"2024-09-12T00:06:42.064436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:08.214455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90177536,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723278+0000","last_change":"2024-09-12T00:03:27.326932+0000","last_active":"2024-09-12T00:06:42.723278+0000","last_peered":"2024-09-12T00:06:42.723278+0000","last_clean":"2024-09-12T00:06:42.723278+0000","last_became_active":"2024-09-12T00:03:27.326173+0000","last_became_peered":"2024-09-12T00:03:27.326173+0000","last_unstale":"2024-09-12T00:06:42.723278+0000","last_undegraded":"2024-09-12T00:06:42.723278+0000","last_fullsized":"2024-09-12T00:06:42.723278+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:12.286539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"116'17","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.585643+0000","last_change":"2024-09-12T00:03:29.338829+0000","last_active":"2024-09-12T00:06:42.585643+0000","last_peered":"2024-09-12T00:06:42.585643+0000","last_clean":"2024-09-12T00:06:42.585643+0000","last_became_active":"2024-09-12T00:03:29.337364+0000","last_became_peered":"2024-09-12T00:03:29.337364+0000","last_unstale":"2024-09-12T00:06:42.585643+0000","last_undegraded":"2024-09-12T00:06:42.585643+0000","last_fullsized":"2024-09-12T00:06:42.585643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:01.584359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812645+0000","last_change":"2024-09-12T00:06:26.655001+0000","last_active":"2024-09-12T00:06:41.812645+0000","last_peered":"2024-09-12T00:06:41.812645+0000","last_clean":"2024-09-12T00:06:41.812645+0000","last_became_active":"2024-09-12T00:06:26.654068+0000","last_became_peered":"2024-09-12T00:06:26.654068+0000","last_unstale":"2024-09-12T00:06:41.812645+0000","last_undegraded":"2024-09-12T00:06:41.812645+0000","last_fullsized":"2024-09-12T00:06:41.812645+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:50.133218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810544+0000","last_change":"2024-09-12T00:03:33.354171+0000","last_active":"2024-09-12T00:06:41.810544+0000","last_peered":"2024-09-12T00:06:41.810544+0000","last_clean":"2024-09-12T00:06:41.810544+0000","last_became_active":"2024-09-12T00:03:33.353460+0000","last_became_peered":"2024-09-12T00:03:33.353460+0000","last_unstale":"2024-09-12T00:06:41.810544+0000","last_undegraded":"2024-09-12T00:06:41.810544+0000","last_fullsized":"2024-09-12T00:06:41.810544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:34.356970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"84'8","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721257+0000","last_change":"2024-09-12T00:03:25.336320+0000","last_active":"2024-09-12T00:06:42.721257+0000","last_peered":"2024-09-12T00:06:42.721257+0000","last_clean":"2024-09-12T00:06:42.721257+0000","last_became_active":"2024-09-12T00:03:25.333449+0000","last_became_peered":"2024-09-12T00:03:25.333449+0000","last_unstale":"2024-09-12T00:06:42.721257+0000","last_undegraded":"2024-09-12T00:06:42.721257+0000","last_fullsized":"2024-09-12T00:06:42.721257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722390+0000","last_change":"2024-09-12T00:06:32.408232+0000","last_active":"2024-09-12T00:06:42.722390+0000","last_peered":"2024-09-12T00:06:42.722390+0000","last_clean":"2024-09-12T00:06:42.722390+0000","last_became_active":"2024-09-12T00:06:26.677047+0000","last_became_peered":"2024-09-12T00:06:26.677047+0000","last_unstale":"2024-09-12T00:06:42.722390+0000","last_undegraded":"2024-09-12T00:06:42.722390+0000","last_fullsized":"2024-09-12T00:06:42.722390+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:52.555478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"96'21","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810342+0000","last_change":"2024-09-12T00:03:23.611064+0000","last_active":"2024-09-12T00:06:41.810342+0000","last_peered":"2024-09-12T00:06:41.810342+0000","last_clean":"2024-09-12T00:06:41.810342+0000","last_became_active":"2024-09-12T00:03:23.610612+0000","last_became_peered":"2024-09-12T00:03:23.610612+0000","last_unstale":"2024-09-12T00:06:41.810342+0000","last_undegraded":"2024-09-12T00:06:41.810342+0000","last_fullsized":"2024-09-12T00:06:41.810342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:04.201688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722466+0000","last_change":"2024-09-12T00:03:27.339197+0000","last_active":"2024-09-12T00:06:42.722466+0000","last_peered":"2024-09-12T00:06:42.722466+0000","last_clean":"2024-09-12T00:06:42.722466+0000","last_became_active":"2024-09-12T00:03:27.338508+0000","last_became_peered":"2024-09-12T00:03:27.338508+0000","last_unstale":"2024-09-12T00:06:42.722466+0000","last_undegraded":"2024-09-12T00:06:42.722466+0000","last_fullsized":"2024-09-12T00:06:42.722466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:08.306289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066551+0000","last_change":"2024-09-12T00:06:28.890041+0000","last_active":"2024-09-12T00:06:42.066551+0000","last_peered":"2024-09-12T00:06:42.066551+0000","last_clean":"2024-09-12T00:06:42.066551+0000","last_became_active":"2024-09-12T00:06:26.682354+0000","last_became_peered":"2024-09-12T00:06:26.682354+0000","last_unstale":"2024-09-12T00:06:42.066551+0000","last_undegraded":"2024-09-12T00:06:42.066551+0000","last_fullsized":"2024-09-12T00:06:42.066551+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:42.484131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722102+0000","last_change":"2024-09-12T00:06:26.675142+0000","last_active":"2024-09-12T00:06:42.722102+0000","last_peered":"2024-09-12T00:06:42.722102+0000","last_clean":"2024-09-12T00:06:42.722102+0000","last_became_active":"2024-09-12T00:06:26.669787+0000","last_became_peered":"2024-09-12T00:06:26.669787+0000","last_unstale":"2024-09-12T00:06:42.722102+0000","last_undegraded":"2024-09-12T00:06:42.722102+0000","last_fullsized":"2024-09-12T00:06:42.722102+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:34.635508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"63'7","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500245+0000","last_change":"2024-09-12T00:03:33.367035+0000","last_active":"2024-09-12T00:06:42.500245+0000","last_peered":"2024-09-12T00:06:42.500245+0000","last_clean":"2024-09-12T00:06:42.500245+0000","last_became_active":"2024-09-12T00:03:33.366311+0000","last_became_peered":"2024-09-12T00:03:33.366311+0000","last_unstale":"2024-09-12T00:06:42.500245+0000","last_undegraded":"2024-09-12T00:06:42.500245+0000","last_fullsized":"2024-09-12T00:06:42.500245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"96'8","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722537+0000","last_change":"2024-09-12T00:06:28.313486+0000","last_active":"2024-09-12T00:06:42.722537+0000","last_peered":"2024-09-12T00:06:42.722537+0000","last_clean":"2024-09-12T00:06:42.722537+0000","last_became_active":"2024-09-12T00:06:26.675442+0000","last_became_peered":"2024-09-12T00:06:26.675442+0000","last_unstale":"2024-09-12T00:06:42.722537+0000","last_undegraded":"2024-09-12T00:06:42.722537+0000","last_fullsized":"2024-09-12T00:06:42.722537+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:37.245286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"96'19","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812844+0000","last_change":"2024-09-12T00:03:23.619024+0000","last_active":"2024-09-12T00:06:41.812844+0000","last_peered":"2024-09-12T00:06:41.812844+0000","last_clean":"2024-09-12T00:06:41.812844+0000","last_became_active":"2024-09-12T00:03:23.618716+0000","last_became_peered":"2024-09-12T00:03:23.618716+0000","last_unstale":"2024-09-12T00:06:41.812844+0000","last_undegraded":"2024-09-12T00:06:41.812844+0000","last_fullsized":"2024-09-12T00:06:41.812844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067307+0000","last_change":"2024-09-12T00:03:18.562010+0000","last_active":"2024-09-12T00:06:42.067307+0000","last_peered":"2024-09-12T00:06:42.067307+0000","last_clean":"2024-09-12T00:06:42.067307+0000","last_became_active":"2024-09-12T00:03:16.561218+0000","last_became_peered":"2024-09-12T00:03:16.561218+0000","last_unstale":"2024-09-12T00:06:42.067307+0000","last_undegraded":"2024-09-12T00:06:42.067307+0000","last_fullsized":"2024-09-12T00:06:42.067307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:43.089686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084170299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811828+0000","last_change":"2024-09-12T00:03:27.341079+0000","last_active":"2024-09-12T00:06:41.811828+0000","last_peered":"2024-09-12T00:06:41.811828+0000","last_clean":"2024-09-12T00:06:41.811828+0000","last_became_active":"2024-09-12T00:03:27.340391+0000","last_became_peered":"2024-09-12T00:03:27.340391+0000","last_unstale":"2024-09-12T00:06:41.811828+0000","last_undegraded":"2024-09-12T00:06:41.811828+0000","last_fullsized":"2024-09-12T00:06:41.811828+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:10.048469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"96'49","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718472+0000","last_change":"2024-09-12T00:03:29.346823+0000","last_active":"2024-09-12T00:06:42.718472+0000","last_peered":"2024-09-12T00:06:42.718472+0000","last_clean":"2024-09-12T00:06:42.718472+0000","last_became_active":"2024-09-12T00:03:29.346066+0000","last_became_peered":"2024-09-12T00:03:29.346066+0000","last_unstale":"2024-09-12T00:06:42.718472+0000","last_undegraded":"2024-09-12T00:06:42.718472+0000","last_fullsized":"2024-09-12T00:06:42.718472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:12.080794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124550,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":47,"num_write":38,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810366+0000","last_change":"2024-09-12T00:03:31.348574+0000","last_active":"2024-09-12T00:06:41.810366+0000","last_peered":"2024-09-12T00:06:41.810366+0000","last_clean":"2024-09-12T00:06:41.810366+0000","last_became_active":"2024-09-12T00:03:31.346511+0000","last_became_peered":"2024-09-12T00:03:31.346511+0000","last_unstale":"2024-09-12T00:06:41.810366+0000","last_undegraded":"2024-09-12T00:06:41.810366+0000","last_fullsized":"2024-09-12T00:06:41.810366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:14.061486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"59'7","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066233+0000","last_change":"2024-09-12T00:03:33.385232+0000","last_active":"2024-09-12T00:06:42.066233+0000","last_peered":"2024-09-12T00:06:42.066233+0000","last_clean":"2024-09-12T00:06:42.066233+0000","last_became_active":"2024-09-12T00:03:33.384457+0000","last_became_peered":"2024-09-12T00:03:33.384457+0000","last_unstale":"2024-09-12T00:06:42.066233+0000","last_undegraded":"2024-09-12T00:06:42.066233+0000","last_fullsized":"2024-09-12T00:06:42.066233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:34.615256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"76'4","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721962+0000","last_change":"2024-09-12T00:03:25.334767+0000","last_active":"2024-09-12T00:06:42.721962+0000","last_peered":"2024-09-12T00:06:42.721962+0000","last_clean":"2024-09-12T00:06:42.721962+0000","last_became_active":"2024-09-12T00:03:25.332814+0000","last_became_peered":"2024-09-12T00:03:25.332814+0000","last_unstale":"2024-09-12T00:06:42.721962+0000","last_undegraded":"2024-09-12T00:06:42.721962+0000","last_fullsized":"2024-09-12T00:06:42.721962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"95'27","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721814+0000","last_change":"2024-09-12T00:03:23.628752+0000","last_active":"2024-09-12T00:06:42.721814+0000","last_peered":"2024-09-12T00:06:42.721814+0000","last_clean":"2024-09-12T00:06:42.721814+0000","last_became_active":"2024-09-12T00:03:23.628128+0000","last_became_peered":"2024-09-12T00:03:23.628128+0000","last_unstale":"2024-09-12T00:06:42.721814+0000","last_undegraded":"2024-09-12T00:06:42.721814+0000","last_fullsized":"2024-09-12T00:06:42.721814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720543+0000","last_change":"2024-09-12T00:06:26.679199+0000","last_active":"2024-09-12T00:06:42.720543+0000","last_peered":"2024-09-12T00:06:42.720543+0000","last_clean":"2024-09-12T00:06:42.720543+0000","last_became_active":"2024-09-12T00:06:26.675309+0000","last_became_peered":"2024-09-12T00:06:26.675309+0000","last_unstale":"2024-09-12T00:06:42.720543+0000","last_undegraded":"2024-09-12T00:06:42.720543+0000","last_fullsized":"2024-09-12T00:06:42.720543+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:56.980194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814664+0000","last_change":"2024-09-12T00:03:27.316317+0000","last_active":"2024-09-12T00:06:41.814664+0000","last_peered":"2024-09-12T00:06:41.814664+0000","last_clean":"2024-09-12T00:06:41.814664+0000","last_became_active":"2024-09-12T00:03:27.315704+0000","last_became_peered":"2024-09-12T00:03:27.315704+0000","last_unstale":"2024-09-12T00:06:41.814664+0000","last_undegraded":"2024-09-12T00:06:41.814664+0000","last_fullsized":"2024-09-12T00:06:41.814664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:07.883485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'20","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720264+0000","last_change":"2024-09-12T00:06:26.708588+0000","last_active":"2024-09-12T00:06:42.720264+0000","last_peered":"2024-09-12T00:06:42.720264+0000","last_clean":"2024-09-12T00:06:42.720264+0000","last_became_active":"2024-09-12T00:06:26.661284+0000","last_became_peered":"2024-09-12T00:06:26.661284+0000","last_unstale":"2024-09-12T00:06:42.720264+0000","last_undegraded":"2024-09-12T00:06:42.720264+0000","last_fullsized":"2024-09-12T00:06:42.720264+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:19.418779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"116'135","reported_seq":354,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.586307+0000","last_change":"2024-09-12T00:03:31.357011+0000","last_active":"2024-09-12T00:06:42.586307+0000","last_peered":"2024-09-12T00:06:42.586307+0000","last_clean":"2024-09-12T00:06:42.586307+0000","last_became_active":"2024-09-12T00:03:31.356108+0000","last_became_peered":"2024-09-12T00:03:31.356108+0000","last_unstale":"2024-09-12T00:06:42.586307+0000","last_undegraded":"2024-09-12T00:06:42.586307+0000","last_fullsized":"2024-09-12T00:06:42.586307+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"58'2","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723235+0000","last_change":"2024-09-12T00:03:33.372465+0000","last_active":"2024-09-12T00:06:42.723235+0000","last_peered":"2024-09-12T00:06:42.723235+0000","last_clean":"2024-09-12T00:06:42.723235+0000","last_became_active":"2024-09-12T00:03:33.371214+0000","last_became_peered":"2024-09-12T00:03:33.371214+0000","last_unstale":"2024-09-12T00:06:42.723235+0000","last_undegraded":"2024-09-12T00:06:42.723235+0000","last_fullsized":"2024-09-12T00:06:42.723235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:40.880933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"84'8","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810903+0000","last_change":"2024-09-12T00:03:25.332405+0000","last_active":"2024-09-12T00:06:41.810903+0000","last_peered":"2024-09-12T00:06:41.810903+0000","last_clean":"2024-09-12T00:06:41.810903+0000","last_became_active":"2024-09-12T00:03:25.331250+0000","last_became_peered":"2024-09-12T00:03:25.331250+0000","last_unstale":"2024-09-12T00:06:41.810903+0000","last_undegraded":"2024-09-12T00:06:41.810903+0000","last_fullsized":"2024-09-12T00:06:41.810903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"96'23","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813862+0000","last_change":"2024-09-12T00:03:23.602222+0000","last_active":"2024-09-12T00:06:41.813862+0000","last_peered":"2024-09-12T00:06:41.813862+0000","last_clean":"2024-09-12T00:06:41.813862+0000","last_became_active":"2024-09-12T00:03:23.601481+0000","last_became_peered":"2024-09-12T00:03:23.601481+0000","last_unstale":"2024-09-12T00:06:41.813862+0000","last_undegraded":"2024-09-12T00:06:41.813862+0000","last_fullsized":"2024-09-12T00:06:41.813862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:56.636638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813711+0000","last_change":"2024-09-12T00:03:18.716648+0000","last_active":"2024-09-12T00:06:41.813711+0000","last_peered":"2024-09-12T00:06:41.813711+0000","last_clean":"2024-09-12T00:06:41.813711+0000","last_became_active":"2024-09-12T00:03:16.594609+0000","last_became_peered":"2024-09-12T00:03:16.594609+0000","last_unstale":"2024-09-12T00:06:41.813711+0000","last_undegraded":"2024-09-12T00:06:41.813711+0000","last_fullsized":"2024-09-12T00:06:41.813711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:34.635008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010254439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721880+0000","last_change":"2024-09-12T00:06:26.648329+0000","last_active":"2024-09-12T00:06:42.721880+0000","last_peered":"2024-09-12T00:06:42.721880+0000","last_clean":"2024-09-12T00:06:42.721880+0000","last_became_active":"2024-09-12T00:06:26.647055+0000","last_became_peered":"2024-09-12T00:06:26.647055+0000","last_unstale":"2024-09-12T00:06:42.721880+0000","last_undegraded":"2024-09-12T00:06:42.721880+0000","last_fullsized":"2024-09-12T00:06:42.721880+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:35.147693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"58'18","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720951+0000","last_change":"2024-09-12T00:06:30.110628+0000","last_active":"2024-09-12T00:06:42.720951+0000","last_peered":"2024-09-12T00:06:42.720951+0000","last_clean":"2024-09-12T00:06:42.720951+0000","last_became_active":"2024-09-12T00:06:26.662450+0000","last_became_peered":"2024-09-12T00:06:26.662450+0000","last_unstale":"2024-09-12T00:06:42.720951+0000","last_undegraded":"2024-09-12T00:06:42.720951+0000","last_fullsized":"2024-09-12T00:06:42.720951+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:10.820458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"116'135","reported_seq":351,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.585684+0000","last_change":"2024-09-12T00:03:31.361616+0000","last_active":"2024-09-12T00:06:42.585684+0000","last_peered":"2024-09-12T00:06:42.585684+0000","last_clean":"2024-09-12T00:06:42.585684+0000","last_became_active":"2024-09-12T00:03:31.360518+0000","last_became_peered":"2024-09-12T00:03:31.360518+0000","last_unstale":"2024-09-12T00:06:42.585684+0000","last_undegraded":"2024-09-12T00:06:42.585684+0000","last_fullsized":"2024-09-12T00:06:42.585684+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:40.640537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065311+0000","last_change":"2024-09-12T00:03:33.378417+0000","last_active":"2024-09-12T00:06:42.065311+0000","last_peered":"2024-09-12T00:06:42.065311+0000","last_clean":"2024-09-12T00:06:42.065311+0000","last_became_active":"2024-09-12T00:03:33.377669+0000","last_became_peered":"2024-09-12T00:03:33.377669+0000","last_unstale":"2024-09-12T00:06:42.065311+0000","last_undegraded":"2024-09-12T00:06:42.065311+0000","last_fullsized":"2024-09-12T00:06:42.065311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:04.623906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811103+0000","last_change":"2024-09-12T00:06:26.714198+0000","last_active":"2024-09-12T00:06:41.811103+0000","last_peered":"2024-09-12T00:06:41.811103+0000","last_clean":"2024-09-12T00:06:41.811103+0000","last_became_active":"2024-09-12T00:06:26.662114+0000","last_became_peered":"2024-09-12T00:06:26.662114+0000","last_unstale":"2024-09-12T00:06:41.811103+0000","last_undegraded":"2024-09-12T00:06:41.811103+0000","last_fullsized":"2024-09-12T00:06:41.811103+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:41.029559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"96'24","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813511+0000","last_change":"2024-09-12T00:03:23.616319+0000","last_active":"2024-09-12T00:06:41.813511+0000","last_peered":"2024-09-12T00:06:41.813511+0000","last_clean":"2024-09-12T00:06:41.813511+0000","last_became_active":"2024-09-12T00:03:23.615158+0000","last_became_peered":"2024-09-12T00:03:23.615158+0000","last_unstale":"2024-09-12T00:06:41.813511+0000","last_undegraded":"2024-09-12T00:06:41.813511+0000","last_fullsized":"2024-09-12T00:06:41.813511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:15.677228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719839+0000","last_change":"2024-09-12T00:06:26.680801+0000","last_active":"2024-09-12T00:06:42.719839+0000","last_peered":"2024-09-12T00:06:42.719839+0000","last_clean":"2024-09-12T00:06:42.719839+0000","last_became_active":"2024-09-12T00:06:26.677544+0000","last_became_peered":"2024-09-12T00:06:26.677544+0000","last_unstale":"2024-09-12T00:06:42.719839+0000","last_undegraded":"2024-09-12T00:06:42.719839+0000","last_fullsized":"2024-09-12T00:06:42.719839+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:43.976666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810348+0000","last_change":"2024-09-12T00:03:27.337359+0000","last_active":"2024-09-12T00:06:41.810348+0000","last_peered":"2024-09-12T00:06:41.810348+0000","last_clean":"2024-09-12T00:06:41.810348+0000","last_became_active":"2024-09-12T00:03:27.336289+0000","last_became_peered":"2024-09-12T00:03:27.336289+0000","last_unstale":"2024-09-12T00:06:41.810348+0000","last_undegraded":"2024-09-12T00:06:41.810348+0000","last_fullsized":"2024-09-12T00:06:41.810348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:39.147272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"96'50","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809455+0000","last_change":"2024-09-12T00:03:29.344621+0000","last_active":"2024-09-12T00:06:41.809455+0000","last_peered":"2024-09-12T00:06:41.809455+0000","last_clean":"2024-09-12T00:06:41.809455+0000","last_became_active":"2024-09-12T00:03:29.343779+0000","last_became_peered":"2024-09-12T00:03:29.343779+0000","last_unstale":"2024-09-12T00:06:41.809455+0000","last_undegraded":"2024-09-12T00:06:41.809455+0000","last_fullsized":"2024-09-12T00:06:41.809455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:49.518432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811176+0000","last_change":"2024-09-12T00:03:31.335460+0000","last_active":"2024-09-12T00:06:41.811176+0000","last_peered":"2024-09-12T00:06:41.811176+0000","last_clean":"2024-09-12T00:06:41.811176+0000","last_became_active":"2024-09-12T00:03:31.334701+0000","last_became_peered":"2024-09-12T00:03:31.334701+0000","last_unstale":"2024-09-12T00:06:41.811176+0000","last_undegraded":"2024-09-12T00:06:41.811176+0000","last_fullsized":"2024-09-12T00:06:41.811176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:28.484366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"58'4","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812236+0000","last_change":"2024-09-12T00:03:33.386404+0000","last_active":"2024-09-12T00:06:41.812236+0000","last_peered":"2024-09-12T00:06:41.812236+0000","last_clean":"2024-09-12T00:06:41.812236+0000","last_became_active":"2024-09-12T00:03:33.385090+0000","last_became_peered":"2024-09-12T00:03:33.385090+0000","last_unstale":"2024-09-12T00:06:41.812236+0000","last_undegraded":"2024-09-12T00:06:41.812236+0000","last_fullsized":"2024-09-12T00:06:41.812236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"96'2","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813204+0000","last_change":"2024-09-12T00:03:33.361690+0000","last_active":"2024-09-12T00:06:41.813204+0000","last_peered":"2024-09-12T00:06:41.813204+0000","last_clean":"2024-09-12T00:06:41.813204+0000","last_became_active":"2024-09-12T00:03:33.360980+0000","last_became_peered":"2024-09-12T00:03:33.360980+0000","last_unstale":"2024-09-12T00:06:41.813204+0000","last_undegraded":"2024-09-12T00:06:41.813204+0000","last_fullsized":"2024-09-12T00:06:41.813204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:24.954577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"59'2","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813869+0000","last_change":"2024-09-12T00:06:28.274587+0000","last_active":"2024-09-12T00:06:41.813869+0000","last_peered":"2024-09-12T00:06:41.813869+0000","last_clean":"2024-09-12T00:06:41.813869+0000","last_became_active":"2024-09-12T00:06:26.664337+0000","last_became_peered":"2024-09-12T00:06:26.664337+0000","last_unstale":"2024-09-12T00:06:41.813869+0000","last_undegraded":"2024-09-12T00:06:41.813869+0000","last_fullsized":"2024-09-12T00:06:41.813869+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:00.552692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"95'30","reported_seq":103,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717433+0000","last_change":"2024-09-12T00:06:30.093257+0000","last_active":"2024-09-12T00:06:42.717433+0000","last_peered":"2024-09-12T00:06:42.717433+0000","last_clean":"2024-09-12T00:06:42.717433+0000","last_became_active":"2024-09-12T00:06:26.671623+0000","last_became_peered":"2024-09-12T00:06:26.671623+0000","last_unstale":"2024-09-12T00:06:42.717433+0000","last_undegraded":"2024-09-12T00:06:42.717433+0000","last_fullsized":"2024-09-12T00:06:42.717433+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:02.454592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":201326592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"28'2","reported_seq":367,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722728+0000","last_change":"2024-09-12T00:03:27.332281+0000","last_active":"2024-09-12T00:06:42.722728+0000","last_peered":"2024-09-12T00:06:42.722728+0000","last_clean":"2024-09-12T00:06:42.722728+0000","last_became_active":"2024-09-12T00:03:27.331527+0000","last_became_peered":"2024-09-12T00:03:27.331527+0000","last_unstale":"2024-09-12T00:06:42.722728+0000","last_undegraded":"2024-09-12T00:06:42.722728+0000","last_fullsized":"2024-09-12T00:06:42.722728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":266,"num_read_kb":266,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"96'25","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720005+0000","last_change":"2024-09-12T00:03:29.338655+0000","last_active":"2024-09-12T00:06:42.720005+0000","last_peered":"2024-09-12T00:06:42.720005+0000","last_clean":"2024-09-12T00:06:42.720005+0000","last_became_active":"2024-09-12T00:03:29.337905+0000","last_became_peered":"2024-09-12T00:03:29.337905+0000","last_unstale":"2024-09-12T00:06:42.720005+0000","last_undegraded":"2024-09-12T00:06:42.720005+0000","last_fullsized":"2024-09-12T00:06:42.720005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718441+0000","last_change":"2024-09-12T00:03:31.351716+0000","last_active":"2024-09-12T00:06:42.718441+0000","last_peered":"2024-09-12T00:06:42.718441+0000","last_clean":"2024-09-12T00:06:42.718441+0000","last_became_active":"2024-09-12T00:03:31.350917+0000","last_became_peered":"2024-09-12T00:03:31.350917+0000","last_unstale":"2024-09-12T00:06:42.718441+0000","last_undegraded":"2024-09-12T00:06:42.718441+0000","last_fullsized":"2024-09-12T00:06:42.718441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:45.880820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722942+0000","last_change":"2024-09-12T00:03:33.374233+0000","last_active":"2024-09-12T00:06:42.722942+0000","last_peered":"2024-09-12T00:06:42.722942+0000","last_clean":"2024-09-12T00:06:42.722942+0000","last_became_active":"2024-09-12T00:03:33.373466+0000","last_became_peered":"2024-09-12T00:03:33.373466+0000","last_unstale":"2024-09-12T00:06:42.722942+0000","last_undegraded":"2024-09-12T00:06:42.722942+0000","last_fullsized":"2024-09-12T00:06:42.722942+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:55.598892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"59'2","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811077+0000","last_change":"2024-09-12T00:06:28.295394+0000","last_active":"2024-09-12T00:06:41.811077+0000","last_peered":"2024-09-12T00:06:41.811077+0000","last_clean":"2024-09-12T00:06:41.811077+0000","last_became_active":"2024-09-12T00:06:26.664003+0000","last_became_peered":"2024-09-12T00:06:26.664003+0000","last_unstale":"2024-09-12T00:06:41.811077+0000","last_undegraded":"2024-09-12T00:06:41.811077+0000","last_fullsized":"2024-09-12T00:06:41.811077+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:22.616662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"95'23","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816608+0000","last_change":"2024-09-12T00:03:23.613274+0000","last_active":"2024-09-12T00:06:41.816608+0000","last_peered":"2024-09-12T00:06:41.816608+0000","last_clean":"2024-09-12T00:06:41.816608+0000","last_became_active":"2024-09-12T00:03:23.612941+0000","last_became_peered":"2024-09-12T00:03:23.612941+0000","last_unstale":"2024-09-12T00:06:41.816608+0000","last_undegraded":"2024-09-12T00:06:41.816608+0000","last_fullsized":"2024-09-12T00:06:41.816608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:56.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811543+0000","last_change":"2024-09-12T00:03:27.336144+0000","last_active":"2024-09-12T00:06:41.811543+0000","last_peered":"2024-09-12T00:06:41.811543+0000","last_clean":"2024-09-12T00:06:41.811543+0000","last_became_active":"2024-09-12T00:03:27.335372+0000","last_became_peered":"2024-09-12T00:03:27.335372+0000","last_unstale":"2024-09-12T00:06:41.811543+0000","last_undegraded":"2024-09-12T00:06:41.811543+0000","last_fullsized":"2024-09-12T00:06:41.811543+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:33.978665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"108'11","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809960+0000","last_change":"2024-09-12T00:03:29.332051+0000","last_active":"2024-09-12T00:06:41.809960+0000","last_peered":"2024-09-12T00:06:41.809960+0000","last_clean":"2024-09-12T00:06:41.809960+0000","last_became_active":"2024-09-12T00:03:29.331243+0000","last_became_peered":"2024-09-12T00:03:29.331243+0000","last_unstale":"2024-09-12T00:06:41.809960+0000","last_undegraded":"2024-09-12T00:06:41.809960+0000","last_fullsized":"2024-09-12T00:06:41.809960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:52.544770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810109+0000","last_change":"2024-09-12T00:03:31.347021+0000","last_active":"2024-09-12T00:06:41.810109+0000","last_peered":"2024-09-12T00:06:41.810109+0000","last_clean":"2024-09-12T00:06:41.810109+0000","last_became_active":"2024-09-12T00:03:31.344407+0000","last_became_peered":"2024-09-12T00:03:31.344407+0000","last_unstale":"2024-09-12T00:06:41.810109+0000","last_undegraded":"2024-09-12T00:06:41.810109+0000","last_fullsized":"2024-09-12T00:06:41.810109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:32.139742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"84'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719370+0000","last_change":"2024-09-12T00:03:33.370271+0000","last_active":"2024-09-12T00:06:42.719370+0000","last_peered":"2024-09-12T00:06:42.719370+0000","last_clean":"2024-09-12T00:06:42.719370+0000","last_became_active":"2024-09-12T00:03:33.369538+0000","last_became_peered":"2024-09-12T00:03:33.369538+0000","last_unstale":"2024-09-12T00:06:42.719370+0000","last_undegraded":"2024-09-12T00:06:42.719370+0000","last_fullsized":"2024-09-12T00:06:42.719370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"59'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810693+0000","last_change":"2024-09-12T00:03:25.341025+0000","last_active":"2024-09-12T00:06:41.810693+0000","last_peered":"2024-09-12T00:06:41.810693+0000","last_clean":"2024-09-12T00:06:41.810693+0000","last_became_active":"2024-09-12T00:03:25.340288+0000","last_became_peered":"2024-09-12T00:03:25.340288+0000","last_unstale":"2024-09-12T00:06:41.810693+0000","last_undegraded":"2024-09-12T00:06:41.810693+0000","last_fullsized":"2024-09-12T00:06:41.810693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"96'29","reported_seq":330,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814348+0000","last_change":"2024-09-12T00:06:30.098997+0000","last_active":"2024-09-12T00:06:41.814348+0000","last_peered":"2024-09-12T00:06:41.814348+0000","last_clean":"2024-09-12T00:06:41.814348+0000","last_became_active":"2024-09-12T00:06:26.672172+0000","last_became_peered":"2024-09-12T00:06:26.672172+0000","last_unstale":"2024-09-12T00:06:41.814348+0000","last_undegraded":"2024-09-12T00:06:41.814348+0000","last_fullsized":"2024-09-12T00:06:41.814348+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:32.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810614+0000","last_change":"2024-09-12T00:03:27.329869+0000","last_active":"2024-09-12T00:06:41.810614+0000","last_peered":"2024-09-12T00:06:41.810614+0000","last_clean":"2024-09-12T00:06:41.810614+0000","last_became_active":"2024-09-12T00:03:27.329077+0000","last_became_peered":"2024-09-12T00:03:27.329077+0000","last_unstale":"2024-09-12T00:06:41.810614+0000","last_undegraded":"2024-09-12T00:06:41.810614+0000","last_fullsized":"2024-09-12T00:06:41.810614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"96'19","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720203+0000","last_change":"2024-09-12T00:03:29.346878+0000","last_active":"2024-09-12T00:06:42.720203+0000","last_peered":"2024-09-12T00:06:42.720203+0000","last_clean":"2024-09-12T00:06:42.720203+0000","last_became_active":"2024-09-12T00:03:29.345990+0000","last_became_peered":"2024-09-12T00:03:29.345990+0000","last_unstale":"2024-09-12T00:06:42.720203+0000","last_undegraded":"2024-09-12T00:06:42.720203+0000","last_fullsized":"2024-09-12T00:06:42.720203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:06.398979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499961+0000","last_change":"2024-09-12T00:03:31.363658+0000","last_active":"2024-09-12T00:06:42.499961+0000","last_peered":"2024-09-12T00:06:42.499961+0000","last_clean":"2024-09-12T00:06:42.499961+0000","last_became_active":"2024-09-12T00:03:31.363080+0000","last_became_peered":"2024-09-12T00:03:31.363080+0000","last_unstale":"2024-09-12T00:06:42.499961+0000","last_undegraded":"2024-09-12T00:06:42.499961+0000","last_fullsized":"2024-09-12T00:06:42.499961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:05.901608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717550+0000","last_change":"2024-09-12T00:06:26.673691+0000","last_active":"2024-09-12T00:06:42.717550+0000","last_peered":"2024-09-12T00:06:42.717550+0000","last_clean":"2024-09-12T00:06:42.717550+0000","last_became_active":"2024-09-12T00:06:26.669877+0000","last_became_peered":"2024-09-12T00:06:26.669877+0000","last_unstale":"2024-09-12T00:06:42.717550+0000","last_undegraded":"2024-09-12T00:06:42.717550+0000","last_fullsized":"2024-09-12T00:06:42.717550+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:02.798560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"59'2","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718800+0000","last_change":"2024-09-12T00:06:26.687219+0000","last_active":"2024-09-12T00:06:42.718800+0000","last_peered":"2024-09-12T00:06:42.718800+0000","last_clean":"2024-09-12T00:06:42.718800+0000","last_became_active":"2024-09-12T00:06:26.655483+0000","last_became_peered":"2024-09-12T00:06:26.655483+0000","last_unstale":"2024-09-12T00:06:42.718800+0000","last_undegraded":"2024-09-12T00:06:42.718800+0000","last_fullsized":"2024-09-12T00:06:42.718800+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:21.199336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"96'22","reported_seq":299,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067870+0000","last_change":"2024-09-12T00:06:27.905793+0000","last_active":"2024-09-12T00:06:42.067870+0000","last_peered":"2024-09-12T00:06:42.067870+0000","last_clean":"2024-09-12T00:06:42.067870+0000","last_became_active":"2024-09-12T00:06:26.664617+0000","last_became_peered":"2024-09-12T00:06:26.664617+0000","last_unstale":"2024-09-12T00:06:42.067870+0000","last_undegraded":"2024-09-12T00:06:42.067870+0000","last_fullsized":"2024-09-12T00:06:42.067870+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:23.455040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":142606336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717842+0000","last_change":"2024-09-12T00:06:26.663673+0000","last_active":"2024-09-12T00:06:42.717842+0000","last_peered":"2024-09-12T00:06:42.717842+0000","last_clean":"2024-09-12T00:06:42.717842+0000","last_became_active":"2024-09-12T00:06:26.663351+0000","last_became_peered":"2024-09-12T00:06:26.663351+0000","last_unstale":"2024-09-12T00:06:42.717842+0000","last_undegraded":"2024-09-12T00:06:42.717842+0000","last_fullsized":"2024-09-12T00:06:42.717842+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:58.342457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"96'18","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814520+0000","last_change":"2024-09-12T00:03:29.346312+0000","last_active":"2024-09-12T00:06:41.814520+0000","last_peered":"2024-09-12T00:06:41.814520+0000","last_clean":"2024-09-12T00:06:41.814520+0000","last_became_active":"2024-09-12T00:03:29.345883+0000","last_became_peered":"2024-09-12T00:03:29.345883+0000","last_unstale":"2024-09-12T00:06:41.814520+0000","last_undegraded":"2024-09-12T00:06:41.814520+0000","last_fullsized":"2024-09-12T00:06:41.814520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:46.723370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719592+0000","last_change":"2024-09-12T00:03:31.358786+0000","last_active":"2024-09-12T00:06:42.719592+0000","last_peered":"2024-09-12T00:06:42.719592+0000","last_clean":"2024-09-12T00:06:42.719592+0000","last_became_active":"2024-09-12T00:03:31.358011+0000","last_became_peered":"2024-09-12T00:03:31.358011+0000","last_unstale":"2024-09-12T00:06:42.719592+0000","last_undegraded":"2024-09-12T00:06:42.719592+0000","last_fullsized":"2024-09-12T00:06:42.719592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:29.394163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"59'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720085+0000","last_change":"2024-09-12T00:06:28.364181+0000","last_active":"2024-09-12T00:06:42.720085+0000","last_peered":"2024-09-12T00:06:42.720085+0000","last_clean":"2024-09-12T00:06:42.720085+0000","last_became_active":"2024-09-12T00:06:26.667552+0000","last_became_peered":"2024-09-12T00:06:26.667552+0000","last_unstale":"2024-09-12T00:06:42.720085+0000","last_undegraded":"2024-09-12T00:06:42.720085+0000","last_fullsized":"2024-09-12T00:06:42.720085+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:19.435061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"96'23","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064267+0000","last_change":"2024-09-12T00:03:23.627584+0000","last_active":"2024-09-12T00:06:42.064267+0000","last_peered":"2024-09-12T00:06:42.064267+0000","last_clean":"2024-09-12T00:06:42.064267+0000","last_became_active":"2024-09-12T00:03:23.626026+0000","last_became_peered":"2024-09-12T00:03:23.626026+0000","last_unstale":"2024-09-12T00:06:42.064267+0000","last_undegraded":"2024-09-12T00:06:42.064267+0000","last_fullsized":"2024-09-12T00:06:42.064267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:38.192583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720246+0000","last_change":"2024-09-12T00:06:26.671971+0000","last_active":"2024-09-12T00:06:42.720246+0000","last_peered":"2024-09-12T00:06:42.720246+0000","last_clean":"2024-09-12T00:06:42.720246+0000","last_became_active":"2024-09-12T00:06:26.671427+0000","last_became_peered":"2024-09-12T00:06:26.671427+0000","last_unstale":"2024-09-12T00:06:42.720246+0000","last_undegraded":"2024-09-12T00:06:42.720246+0000","last_fullsized":"2024-09-12T00:06:42.720246+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:22.897492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"96'35","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720971+0000","last_change":"2024-09-12T00:03:29.340387+0000","last_active":"2024-09-12T00:06:42.720971+0000","last_peered":"2024-09-12T00:06:42.720971+0000","last_clean":"2024-09-12T00:06:42.720971+0000","last_became_active":"2024-09-12T00:03:29.339781+0000","last_became_peered":"2024-09-12T00:03:29.339781+0000","last_unstale":"2024-09-12T00:06:42.720971+0000","last_undegraded":"2024-09-12T00:06:42.720971+0000","last_fullsized":"2024-09-12T00:06:42.720971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:30.132716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811392+0000","last_change":"2024-09-12T00:03:31.350303+0000","last_active":"2024-09-12T00:06:41.811392+0000","last_peered":"2024-09-12T00:06:41.811392+0000","last_clean":"2024-09-12T00:06:41.811392+0000","last_became_active":"2024-09-12T00:03:31.349591+0000","last_became_peered":"2024-09-12T00:03:31.349591+0000","last_unstale":"2024-09-12T00:06:41.811392+0000","last_undegraded":"2024-09-12T00:06:41.811392+0000","last_fullsized":"2024-09-12T00:06:41.811392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:00.263644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"96'4","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065021+0000","last_change":"2024-09-12T00:03:33.385028+0000","last_active":"2024-09-12T00:06:42.065021+0000","last_peered":"2024-09-12T00:06:42.065021+0000","last_clean":"2024-09-12T00:06:42.065021+0000","last_became_active":"2024-09-12T00:03:33.384274+0000","last_became_peered":"2024-09-12T00:03:33.384274+0000","last_unstale":"2024-09-12T00:06:42.065021+0000","last_undegraded":"2024-09-12T00:06:42.065021+0000","last_fullsized":"2024-09-12T00:06:42.065021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:11.634604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"58'2","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813365+0000","last_change":"2024-09-12T00:03:25.329888+0000","last_active":"2024-09-12T00:06:41.813365+0000","last_peered":"2024-09-12T00:06:41.813365+0000","last_clean":"2024-09-12T00:06:41.813365+0000","last_became_active":"2024-09-12T00:03:25.329151+0000","last_became_peered":"2024-09-12T00:03:25.329151+0000","last_unstale":"2024-09-12T00:06:41.813365+0000","last_undegraded":"2024-09-12T00:06:41.813365+0000","last_fullsized":"2024-09-12T00:06:41.813365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:47.272383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"96'25","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811321+0000","last_change":"2024-09-12T00:03:23.600146+0000","last_active":"2024-09-12T00:06:41.811321+0000","last_peered":"2024-09-12T00:06:41.811321+0000","last_clean":"2024-09-12T00:06:41.811321+0000","last_became_active":"2024-09-12T00:03:23.598862+0000","last_became_peered":"2024-09-12T00:03:23.598862+0000","last_unstale":"2024-09-12T00:06:41.811321+0000","last_undegraded":"2024-09-12T00:06:41.811321+0000","last_fullsized":"2024-09-12T00:06:41.811321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:13.330852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813925+0000","last_change":"2024-09-12T00:03:27.341032+0000","last_active":"2024-09-12T00:06:41.813925+0000","last_peered":"2024-09-12T00:06:41.813925+0000","last_clean":"2024-09-12T00:06:41.813925+0000","last_became_active":"2024-09-12T00:03:27.340199+0000","last_became_peered":"2024-09-12T00:03:27.340199+0000","last_unstale":"2024-09-12T00:06:41.813925+0000","last_undegraded":"2024-09-12T00:06:41.813925+0000","last_fullsized":"2024-09-12T00:06:41.813925+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:23.673080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"96'24","reported_seq":57,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717487+0000","last_change":"2024-09-12T00:06:31.054703+0000","last_active":"2024-09-12T00:06:42.717487+0000","last_peered":"2024-09-12T00:06:42.717487+0000","last_clean":"2024-09-12T00:06:42.717487+0000","last_became_active":"2024-09-12T00:06:26.675513+0000","last_became_peered":"2024-09-12T00:06:26.675513+0000","last_unstale":"2024-09-12T00:06:42.717487+0000","last_undegraded":"2024-09-12T00:06:42.717487+0000","last_fullsized":"2024-09-12T00:06:42.717487+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:56.604086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065828+0000","last_change":"2024-09-12T00:06:26.678166+0000","last_active":"2024-09-12T00:06:42.065828+0000","last_peered":"2024-09-12T00:06:42.065828+0000","last_clean":"2024-09-12T00:06:42.065828+0000","last_became_active":"2024-09-12T00:06:26.677049+0000","last_became_peered":"2024-09-12T00:06:26.677049+0000","last_unstale":"2024-09-12T00:06:42.065828+0000","last_undegraded":"2024-09-12T00:06:42.065828+0000","last_fullsized":"2024-09-12T00:06:42.065828+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:26.729678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"59'3","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721092+0000","last_change":"2024-09-12T00:06:32.445889+0000","last_active":"2024-09-12T00:06:42.721092+0000","last_peered":"2024-09-12T00:06:42.721092+0000","last_clean":"2024-09-12T00:06:42.721092+0000","last_became_active":"2024-09-12T00:06:26.677859+0000","last_became_peered":"2024-09-12T00:06:26.677859+0000","last_unstale":"2024-09-12T00:06:42.721092+0000","last_undegraded":"2024-09-12T00:06:42.721092+0000","last_fullsized":"2024-09-12T00:06:42.721092+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:56.789846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"59'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722541+0000","last_change":"2024-09-12T00:03:25.360355+0000","last_active":"2024-09-12T00:06:42.722541+0000","last_peered":"2024-09-12T00:06:42.722541+0000","last_clean":"2024-09-12T00:06:42.722541+0000","last_became_active":"2024-09-12T00:03:25.359682+0000","last_became_peered":"2024-09-12T00:03:25.359682+0000","last_unstale":"2024-09-12T00:06:42.722541+0000","last_undegraded":"2024-09-12T00:06:42.722541+0000","last_fullsized":"2024-09-12T00:06:42.722541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:11.808081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"96'20","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500616+0000","last_change":"2024-09-12T00:03:23.621199+0000","last_active":"2024-09-12T00:06:42.500616+0000","last_peered":"2024-09-12T00:06:42.500616+0000","last_clean":"2024-09-12T00:06:42.500616+0000","last_became_active":"2024-09-12T00:03:23.620961+0000","last_became_peered":"2024-09-12T00:03:23.620961+0000","last_unstale":"2024-09-12T00:06:42.500616+0000","last_undegraded":"2024-09-12T00:06:42.500616+0000","last_fullsized":"2024-09-12T00:06:42.500616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811166+0000","last_change":"2024-09-12T00:03:27.336918+0000","last_active":"2024-09-12T00:06:41.811166+0000","last_peered":"2024-09-12T00:06:41.811166+0000","last_clean":"2024-09-12T00:06:41.811166+0000","last_became_active":"2024-09-12T00:03:27.336045+0000","last_became_peered":"2024-09-12T00:03:27.336045+0000","last_unstale":"2024-09-12T00:06:41.811166+0000","last_undegraded":"2024-09-12T00:06:41.811166+0000","last_fullsized":"2024-09-12T00:06:41.811166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"96'25","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720072+0000","last_change":"2024-09-12T00:03:29.338667+0000","last_active":"2024-09-12T00:06:42.720072+0000","last_peered":"2024-09-12T00:06:42.720072+0000","last_clean":"2024-09-12T00:06:42.720072+0000","last_became_active":"2024-09-12T00:03:29.338010+0000","last_became_peered":"2024-09-12T00:03:29.338010+0000","last_unstale":"2024-09-12T00:06:42.720072+0000","last_undegraded":"2024-09-12T00:06:42.720072+0000","last_fullsized":"2024-09-12T00:06:42.720072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:58.256619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722902+0000","last_change":"2024-09-12T00:03:31.352823+0000","last_active":"2024-09-12T00:06:42.722902+0000","last_peered":"2024-09-12T00:06:42.722902+0000","last_clean":"2024-09-12T00:06:42.722902+0000","last_became_active":"2024-09-12T00:03:31.352143+0000","last_became_peered":"2024-09-12T00:03:31.352143+0000","last_unstale":"2024-09-12T00:06:42.722902+0000","last_undegraded":"2024-09-12T00:06:42.722902+0000","last_fullsized":"2024-09-12T00:06:42.722902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:25.168692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"76'8","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721671+0000","last_change":"2024-09-12T00:06:27.901313+0000","last_active":"2024-09-12T00:06:42.721671+0000","last_peered":"2024-09-12T00:06:42.721671+0000","last_clean":"2024-09-12T00:06:42.721671+0000","last_became_active":"2024-09-12T00:06:26.658281+0000","last_became_peered":"2024-09-12T00:06:26.658281+0000","last_unstale":"2024-09-12T00:06:42.721671+0000","last_undegraded":"2024-09-12T00:06:42.721671+0000","last_fullsized":"2024-09-12T00:06:42.721671+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:54.959771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"58'2","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812806+0000","last_change":"2024-09-12T00:03:25.325094+0000","last_active":"2024-09-12T00:06:41.812806+0000","last_peered":"2024-09-12T00:06:41.812806+0000","last_clean":"2024-09-12T00:06:41.812806+0000","last_became_active":"2024-09-12T00:03:25.324315+0000","last_became_peered":"2024-09-12T00:03:25.324315+0000","last_unstale":"2024-09-12T00:06:41.812806+0000","last_undegraded":"2024-09-12T00:06:41.812806+0000","last_fullsized":"2024-09-12T00:06:41.812806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:18.727732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"96'27","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812410+0000","last_change":"2024-09-12T00:03:23.606163+0000","last_active":"2024-09-12T00:06:41.812410+0000","last_peered":"2024-09-12T00:06:41.812410+0000","last_clean":"2024-09-12T00:06:41.812410+0000","last_became_active":"2024-09-12T00:03:23.605402+0000","last_became_peered":"2024-09-12T00:03:23.605402+0000","last_unstale":"2024-09-12T00:06:41.812410+0000","last_undegraded":"2024-09-12T00:06:41.812410+0000","last_fullsized":"2024-09-12T00:06:41.812410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:02.432313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812917+0000","last_change":"2024-09-12T00:03:27.336716+0000","last_active":"2024-09-12T00:06:41.812917+0000","last_peered":"2024-09-12T00:06:41.812917+0000","last_clean":"2024-09-12T00:06:41.812917+0000","last_became_active":"2024-09-12T00:03:27.335658+0000","last_became_peered":"2024-09-12T00:03:27.335658+0000","last_unstale":"2024-09-12T00:06:41.812917+0000","last_undegraded":"2024-09-12T00:06:41.812917+0000","last_fullsized":"2024-09-12T00:06:41.812917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:47.355798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"35'16","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720503+0000","last_change":"2024-09-12T00:06:29.533440+0000","last_active":"2024-09-12T00:06:42.720503+0000","last_peered":"2024-09-12T00:06:42.720503+0000","last_clean":"2024-09-12T00:06:42.720503+0000","last_became_active":"2024-09-12T00:06:26.671893+0000","last_became_peered":"2024-09-12T00:06:26.671893+0000","last_unstale":"2024-09-12T00:06:42.720503+0000","last_undegraded":"2024-09-12T00:06:42.720503+0000","last_fullsized":"2024-09-12T00:06:42.720503+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:10.667822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"116'135","reported_seq":354,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.585763+0000","last_change":"2024-09-12T00:03:31.351362+0000","last_active":"2024-09-12T00:06:42.585763+0000","last_peered":"2024-09-12T00:06:42.585763+0000","last_clean":"2024-09-12T00:06:42.585763+0000","last_became_active":"2024-09-12T00:03:31.350925+0000","last_became_peered":"2024-09-12T00:03:31.350925+0000","last_unstale":"2024-09-12T00:06:42.585763+0000","last_undegraded":"2024-09-12T00:06:42.585763+0000","last_fullsized":"2024-09-12T00:06:42.585763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:03.147968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719766+0000","last_change":"2024-09-12T00:06:26.675599+0000","last_active":"2024-09-12T00:06:42.719766+0000","last_peered":"2024-09-12T00:06:42.719766+0000","last_clean":"2024-09-12T00:06:42.719766+0000","last_became_active":"2024-09-12T00:06:26.675234+0000","last_became_peered":"2024-09-12T00:06:26.675234+0000","last_unstale":"2024-09-12T00:06:42.719766+0000","last_undegraded":"2024-09-12T00:06:42.719766+0000","last_fullsized":"2024-09-12T00:06:42.719766+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:28.887412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"59'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812590+0000","last_change":"2024-09-12T00:03:25.357999+0000","last_active":"2024-09-12T00:06:41.812590+0000","last_peered":"2024-09-12T00:06:41.812590+0000","last_clean":"2024-09-12T00:06:41.812590+0000","last_became_active":"2024-09-12T00:03:25.357623+0000","last_became_peered":"2024-09-12T00:03:25.357623+0000","last_unstale":"2024-09-12T00:06:41.812590+0000","last_undegraded":"2024-09-12T00:06:41.812590+0000","last_fullsized":"2024-09-12T00:06:41.812590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"96'29","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500852+0000","last_change":"2024-09-12T00:03:23.605954+0000","last_active":"2024-09-12T00:06:42.500852+0000","last_peered":"2024-09-12T00:06:42.500852+0000","last_clean":"2024-09-12T00:06:42.500852+0000","last_became_active":"2024-09-12T00:03:23.604773+0000","last_became_peered":"2024-09-12T00:03:23.604773+0000","last_unstale":"2024-09-12T00:06:42.500852+0000","last_undegraded":"2024-09-12T00:06:42.500852+0000","last_fullsized":"2024-09-12T00:06:42.500852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500071+0000","last_change":"2024-09-12T00:03:27.346785+0000","last_active":"2024-09-12T00:06:42.500071+0000","last_peered":"2024-09-12T00:06:42.500071+0000","last_clean":"2024-09-12T00:06:42.500071+0000","last_became_active":"2024-09-12T00:03:27.346168+0000","last_became_peered":"2024-09-12T00:03:27.346168+0000","last_unstale":"2024-09-12T00:06:42.500071+0000","last_undegraded":"2024-09-12T00:06:42.500071+0000","last_fullsized":"2024-09-12T00:06:42.500071+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"96'49","reported_seq":267,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811988+0000","last_change":"2024-09-12T00:03:29.343942+0000","last_active":"2024-09-12T00:06:41.811988+0000","last_peered":"2024-09-12T00:06:41.811988+0000","last_clean":"2024-09-12T00:06:41.811988+0000","last_became_active":"2024-09-12T00:03:29.343238+0000","last_became_peered":"2024-09-12T00:03:29.343238+0000","last_unstale":"2024-09-12T00:06:41.811988+0000","last_undegraded":"2024-09-12T00:06:41.811988+0000","last_fullsized":"2024-09-12T00:06:41.811988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:30.949892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810193+0000","last_change":"2024-09-12T00:06:26.655176+0000","last_active":"2024-09-12T00:06:41.810193+0000","last_peered":"2024-09-12T00:06:41.810193+0000","last_clean":"2024-09-12T00:06:41.810193+0000","last_became_active":"2024-09-12T00:06:26.654187+0000","last_became_peered":"2024-09-12T00:06:26.654187+0000","last_unstale":"2024-09-12T00:06:41.810193+0000","last_undegraded":"2024-09-12T00:06:41.810193+0000","last_fullsized":"2024-09-12T00:06:41.810193+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:58.719162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501328+0000","last_change":"2024-09-12T00:03:33.363188+0000","last_active":"2024-09-12T00:06:42.501328+0000","last_peered":"2024-09-12T00:06:42.501328+0000","last_clean":"2024-09-12T00:06:42.501328+0000","last_became_active":"2024-09-12T00:03:33.360672+0000","last_became_peered":"2024-09-12T00:03:33.360672+0000","last_unstale":"2024-09-12T00:06:42.501328+0000","last_undegraded":"2024-09-12T00:06:42.501328+0000","last_fullsized":"2024-09-12T00:06:42.501328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:33.646117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"59'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811812+0000","last_change":"2024-09-12T00:03:25.336626+0000","last_active":"2024-09-12T00:06:41.811812+0000","last_peered":"2024-09-12T00:06:41.811812+0000","last_clean":"2024-09-12T00:06:41.811812+0000","last_became_active":"2024-09-12T00:03:25.336095+0000","last_became_peered":"2024-09-12T00:03:25.336095+0000","last_unstale":"2024-09-12T00:06:41.811812+0000","last_undegraded":"2024-09-12T00:06:41.811812+0000","last_fullsized":"2024-09-12T00:06:41.811812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"95'26","reported_seq":95,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720356+0000","last_change":"2024-09-12T00:06:32.976777+0000","last_active":"2024-09-12T00:06:42.720356+0000","last_peered":"2024-09-12T00:06:42.720356+0000","last_clean":"2024-09-12T00:06:42.720356+0000","last_became_active":"2024-09-12T00:06:26.678646+0000","last_became_peered":"2024-09-12T00:06:26.678646+0000","last_unstale":"2024-09-12T00:06:42.720356+0000","last_undegraded":"2024-09-12T00:06:42.720356+0000","last_fullsized":"2024-09-12T00:06:42.720356+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:02.624469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":192937984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812464+0000","last_change":"2024-09-12T00:03:27.326174+0000","last_active":"2024-09-12T00:06:41.812464+0000","last_peered":"2024-09-12T00:06:41.812464+0000","last_clean":"2024-09-12T00:06:41.812464+0000","last_became_active":"2024-09-12T00:03:27.325336+0000","last_became_peered":"2024-09-12T00:03:27.325336+0000","last_unstale":"2024-09-12T00:06:41.812464+0000","last_undegraded":"2024-09-12T00:06:41.812464+0000","last_fullsized":"2024-09-12T00:06:41.812464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:08.659813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"96'23","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810811+0000","last_change":"2024-09-12T00:03:29.335957+0000","last_active":"2024-09-12T00:06:41.810811+0000","last_peered":"2024-09-12T00:06:41.810811+0000","last_clean":"2024-09-12T00:06:41.810811+0000","last_became_active":"2024-09-12T00:03:29.335186+0000","last_became_peered":"2024-09-12T00:03:29.335186+0000","last_unstale":"2024-09-12T00:06:41.810811+0000","last_undegraded":"2024-09-12T00:06:41.810811+0000","last_fullsized":"2024-09-12T00:06:41.810811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:20.551758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721804+0000","last_change":"2024-09-12T00:06:26.671154+0000","last_active":"2024-09-12T00:06:42.721804+0000","last_peered":"2024-09-12T00:06:42.721804+0000","last_clean":"2024-09-12T00:06:42.721804+0000","last_became_active":"2024-09-12T00:06:26.667486+0000","last_became_peered":"2024-09-12T00:06:26.667486+0000","last_unstale":"2024-09-12T00:06:42.721804+0000","last_undegraded":"2024-09-12T00:06:42.721804+0000","last_fullsized":"2024-09-12T00:06:42.721804+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:31.291883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066037+0000","last_change":"2024-09-12T00:03:33.385037+0000","last_active":"2024-09-12T00:06:42.066037+0000","last_peered":"2024-09-12T00:06:42.066037+0000","last_clean":"2024-09-12T00:06:42.066037+0000","last_became_active":"2024-09-12T00:03:33.384379+0000","last_became_peered":"2024-09-12T00:03:33.384379+0000","last_unstale":"2024-09-12T00:06:42.066037+0000","last_undegraded":"2024-09-12T00:06:42.066037+0000","last_fullsized":"2024-09-12T00:06:42.066037+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:00.153475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"96'10","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718737+0000","last_change":"2024-09-12T00:03:25.339110+0000","last_active":"2024-09-12T00:06:42.718737+0000","last_peered":"2024-09-12T00:06:42.718737+0000","last_clean":"2024-09-12T00:06:42.718737+0000","last_became_active":"2024-09-12T00:03:25.338417+0000","last_became_peered":"2024-09-12T00:03:25.338417+0000","last_unstale":"2024-09-12T00:06:42.718737+0000","last_undegraded":"2024-09-12T00:06:42.718737+0000","last_fullsized":"2024-09-12T00:06:42.718737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:48.866021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"96'31","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067362+0000","last_change":"2024-09-12T00:03:23.625514+0000","last_active":"2024-09-12T00:06:42.067362+0000","last_peered":"2024-09-12T00:06:42.067362+0000","last_clean":"2024-09-12T00:06:42.067362+0000","last_became_active":"2024-09-12T00:03:23.621654+0000","last_became_peered":"2024-09-12T00:03:23.621654+0000","last_unstale":"2024-09-12T00:06:42.067362+0000","last_undegraded":"2024-09-12T00:06:42.067362+0000","last_fullsized":"2024-09-12T00:06:42.067362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:43.784497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500172+0000","last_change":"2024-09-12T00:03:27.330377+0000","last_active":"2024-09-12T00:06:42.500172+0000","last_peered":"2024-09-12T00:06:42.500172+0000","last_clean":"2024-09-12T00:06:42.500172+0000","last_became_active":"2024-09-12T00:03:27.329713+0000","last_became_peered":"2024-09-12T00:03:27.329713+0000","last_unstale":"2024-09-12T00:06:42.500172+0000","last_undegraded":"2024-09-12T00:06:42.500172+0000","last_fullsized":"2024-09-12T00:06:42.500172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"96'19","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721448+0000","last_change":"2024-09-12T00:03:29.337028+0000","last_active":"2024-09-12T00:06:42.721448+0000","last_peered":"2024-09-12T00:06:42.721448+0000","last_clean":"2024-09-12T00:06:42.721448+0000","last_became_active":"2024-09-12T00:03:29.335440+0000","last_became_peered":"2024-09-12T00:03:29.335440+0000","last_unstale":"2024-09-12T00:06:42.721448+0000","last_undegraded":"2024-09-12T00:06:42.721448+0000","last_fullsized":"2024-09-12T00:06:42.721448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:19.288395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721524+0000","last_change":"2024-09-12T00:06:26.674200+0000","last_active":"2024-09-12T00:06:42.721524+0000","last_peered":"2024-09-12T00:06:42.721524+0000","last_clean":"2024-09-12T00:06:42.721524+0000","last_became_active":"2024-09-12T00:06:26.660173+0000","last_became_peered":"2024-09-12T00:06:26.660173+0000","last_unstale":"2024-09-12T00:06:42.721524+0000","last_undegraded":"2024-09-12T00:06:42.721524+0000","last_fullsized":"2024-09-12T00:06:42.721524+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:56.674961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"58'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720918+0000","last_change":"2024-09-12T00:06:32.449370+0000","last_active":"2024-09-12T00:06:42.720918+0000","last_peered":"2024-09-12T00:06:42.720918+0000","last_clean":"2024-09-12T00:06:42.720918+0000","last_became_active":"2024-09-12T00:06:26.677210+0000","last_became_peered":"2024-09-12T00:06:26.677210+0000","last_unstale":"2024-09-12T00:06:42.720918+0000","last_undegraded":"2024-09-12T00:06:42.720918+0000","last_fullsized":"2024-09-12T00:06:42.720918+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:13.086869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"96'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810877+0000","last_change":"2024-09-12T00:03:25.337999+0000","last_active":"2024-09-12T00:06:41.810877+0000","last_peered":"2024-09-12T00:06:41.810877+0000","last_clean":"2024-09-12T00:06:41.810877+0000","last_became_active":"2024-09-12T00:03:25.337237+0000","last_became_peered":"2024-09-12T00:03:25.337237+0000","last_unstale":"2024-09-12T00:06:41.810877+0000","last_undegraded":"2024-09-12T00:06:41.810877+0000","last_fullsized":"2024-09-12T00:06:41.810877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"96'29","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067739+0000","last_change":"2024-09-12T00:03:23.631744+0000","last_active":"2024-09-12T00:06:42.067739+0000","last_peered":"2024-09-12T00:06:42.067739+0000","last_clean":"2024-09-12T00:06:42.067739+0000","last_became_active":"2024-09-12T00:03:23.630928+0000","last_became_peered":"2024-09-12T00:03:23.630928+0000","last_unstale":"2024-09-12T00:06:42.067739+0000","last_undegraded":"2024-09-12T00:06:42.067739+0000","last_fullsized":"2024-09-12T00:06:42.067739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:35.772832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810384+0000","last_change":"2024-09-12T00:06:26.683708+0000","last_active":"2024-09-12T00:06:41.810384+0000","last_peered":"2024-09-12T00:06:41.810384+0000","last_clean":"2024-09-12T00:06:41.810384+0000","last_became_active":"2024-09-12T00:06:26.651342+0000","last_became_peered":"2024-09-12T00:06:26.651342+0000","last_unstale":"2024-09-12T00:06:41.810384+0000","last_undegraded":"2024-09-12T00:06:41.810384+0000","last_fullsized":"2024-09-12T00:06:41.810384+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:06.251275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"96'29","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721214+0000","last_change":"2024-09-12T00:06:33.464772+0000","last_active":"2024-09-12T00:06:42.721214+0000","last_peered":"2024-09-12T00:06:42.721214+0000","last_clean":"2024-09-12T00:06:42.721214+0000","last_became_active":"2024-09-12T00:06:26.680856+0000","last_became_peered":"2024-09-12T00:06:26.680856+0000","last_unstale":"2024-09-12T00:06:42.721214+0000","last_undegraded":"2024-09-12T00:06:42.721214+0000","last_fullsized":"2024-09-12T00:06:42.721214+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:08.755659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":26,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811844+0000","last_change":"2024-09-12T00:03:31.355300+0000","last_active":"2024-09-12T00:06:41.811844+0000","last_peered":"2024-09-12T00:06:41.811844+0000","last_clean":"2024-09-12T00:06:41.811844+0000","last_became_active":"2024-09-12T00:03:31.354506+0000","last_became_peered":"2024-09-12T00:03:31.354506+0000","last_unstale":"2024-09-12T00:06:41.811844+0000","last_undegraded":"2024-09-12T00:06:41.811844+0000","last_fullsized":"2024-09-12T00:06:41.811844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:51.564710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"58'1","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815779+0000","last_change":"2024-09-12T00:03:33.384262+0000","last_active":"2024-09-12T00:06:41.815779+0000","last_peered":"2024-09-12T00:06:41.815779+0000","last_clean":"2024-09-12T00:06:41.815779+0000","last_became_active":"2024-09-12T00:03:33.383358+0000","last_became_peered":"2024-09-12T00:03:33.383358+0000","last_unstale":"2024-09-12T00:06:41.815779+0000","last_undegraded":"2024-09-12T00:06:41.815779+0000","last_fullsized":"2024-09-12T00:06:41.815779+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:45.060131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"84'4","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813832+0000","last_change":"2024-09-12T00:06:28.849788+0000","last_active":"2024-09-12T00:06:41.813832+0000","last_peered":"2024-09-12T00:06:41.813832+0000","last_clean":"2024-09-12T00:06:41.813832+0000","last_became_active":"2024-09-12T00:06:26.664077+0000","last_became_peered":"2024-09-12T00:06:26.664077+0000","last_unstale":"2024-09-12T00:06:41.813832+0000","last_undegraded":"2024-09-12T00:06:41.813832+0000","last_fullsized":"2024-09-12T00:06:41.813832+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:24.431791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"96'31","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811482+0000","last_change":"2024-09-12T00:03:23.617643+0000","last_active":"2024-09-12T00:06:41.811482+0000","last_peered":"2024-09-12T00:06:41.811482+0000","last_clean":"2024-09-12T00:06:41.811482+0000","last_became_active":"2024-09-12T00:03:23.617138+0000","last_became_peered":"2024-09-12T00:03:23.617138+0000","last_unstale":"2024-09-12T00:06:41.811482+0000","last_undegraded":"2024-09-12T00:06:41.811482+0000","last_fullsized":"2024-09-12T00:06:41.811482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127926272,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":124928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"59'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723414+0000","last_change":"2024-09-12T00:03:25.335650+0000","last_active":"2024-09-12T00:06:42.723414+0000","last_peered":"2024-09-12T00:06:42.723414+0000","last_clean":"2024-09-12T00:06:42.723414+0000","last_became_active":"2024-09-12T00:03:25.334965+0000","last_became_peered":"2024-09-12T00:03:25.334965+0000","last_unstale":"2024-09-12T00:06:42.723414+0000","last_undegraded":"2024-09-12T00:06:42.723414+0000","last_fullsized":"2024-09-12T00:06:42.723414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:13.501672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"96'26","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718679+0000","last_change":"2024-09-12T00:03:23.618651+0000","last_active":"2024-09-12T00:06:42.718679+0000","last_peered":"2024-09-12T00:06:42.718679+0000","last_clean":"2024-09-12T00:06:42.718679+0000","last_became_active":"2024-09-12T00:03:23.612542+0000","last_became_peered":"2024-09-12T00:03:23.612542+0000","last_unstale":"2024-09-12T00:06:42.718679+0000","last_undegraded":"2024-09-12T00:06:42.718679+0000","last_fullsized":"2024-09-12T00:06:42.718679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"96'4","reported_seq":47,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717901+0000","last_change":"2024-09-12T00:06:32.454921+0000","last_active":"2024-09-12T00:06:42.717901+0000","last_peered":"2024-09-12T00:06:42.717901+0000","last_clean":"2024-09-12T00:06:42.717901+0000","last_became_active":"2024-09-12T00:06:26.677698+0000","last_became_peered":"2024-09-12T00:06:26.677698+0000","last_unstale":"2024-09-12T00:06:42.717901+0000","last_undegraded":"2024-09-12T00:06:42.717901+0000","last_fullsized":"2024-09-12T00:06:42.717901+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:31.889100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"96'30","reported_seq":103,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721342+0000","last_change":"2024-09-12T00:06:30.842710+0000","last_active":"2024-09-12T00:06:42.721342+0000","last_peered":"2024-09-12T00:06:42.721342+0000","last_clean":"2024-09-12T00:06:42.721342+0000","last_became_active":"2024-09-12T00:06:26.666582+0000","last_became_peered":"2024-09-12T00:06:26.666582+0000","last_unstale":"2024-09-12T00:06:42.721342+0000","last_undegraded":"2024-09-12T00:06:42.721342+0000","last_fullsized":"2024-09-12T00:06:42.721342+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:15.209092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":201326592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"63'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066906+0000","last_change":"2024-09-12T00:03:25.354015+0000","last_active":"2024-09-12T00:06:42.066906+0000","last_peered":"2024-09-12T00:06:42.066906+0000","last_clean":"2024-09-12T00:06:42.066906+0000","last_became_active":"2024-09-12T00:03:25.352319+0000","last_became_peered":"2024-09-12T00:03:25.352319+0000","last_unstale":"2024-09-12T00:06:42.066906+0000","last_undegraded":"2024-09-12T00:06:42.066906+0000","last_fullsized":"2024-09-12T00:06:42.066906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:08.033834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"96'17","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066879+0000","last_change":"2024-09-12T00:03:23.633614+0000","last_active":"2024-09-12T00:06:42.066879+0000","last_peered":"2024-09-12T00:06:42.066879+0000","last_clean":"2024-09-12T00:06:42.066879+0000","last_became_active":"2024-09-12T00:03:23.632850+0000","last_became_peered":"2024-09-12T00:03:23.632850+0000","last_unstale":"2024-09-12T00:06:42.066879+0000","last_undegraded":"2024-09-12T00:06:42.066879+0000","last_fullsized":"2024-09-12T00:06:42.066879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065662+0000","last_change":"2024-09-12T00:03:25.357453+0000","last_active":"2024-09-12T00:06:42.065662+0000","last_peered":"2024-09-12T00:06:42.065662+0000","last_clean":"2024-09-12T00:06:42.065662+0000","last_became_active":"2024-09-12T00:03:25.353815+0000","last_became_peered":"2024-09-12T00:03:25.353815+0000","last_unstale":"2024-09-12T00:06:42.065662+0000","last_undegraded":"2024-09-12T00:06:42.065662+0000","last_fullsized":"2024-09-12T00:06:42.065662+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:27.562174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"96'22","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721565+0000","last_change":"2024-09-12T00:03:23.609055+0000","last_active":"2024-09-12T00:06:42.721565+0000","last_peered":"2024-09-12T00:06:42.721565+0000","last_clean":"2024-09-12T00:06:42.721565+0000","last_became_active":"2024-09-12T00:03:23.608101+0000","last_became_peered":"2024-09-12T00:03:23.608101+0000","last_unstale":"2024-09-12T00:06:42.721565+0000","last_undegraded":"2024-09-12T00:06:42.721565+0000","last_fullsized":"2024-09-12T00:06:42.721565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"96'10","reported_seq":268,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814861+0000","last_change":"2024-09-12T00:06:28.290549+0000","last_active":"2024-09-12T00:06:41.814861+0000","last_peered":"2024-09-12T00:06:41.814861+0000","last_clean":"2024-09-12T00:06:41.814861+0000","last_became_active":"2024-09-12T00:06:26.681882+0000","last_became_peered":"2024-09-12T00:06:26.681882+0000","last_unstale":"2024-09-12T00:06:41.814861+0000","last_undegraded":"2024-09-12T00:06:41.814861+0000","last_fullsized":"2024-09-12T00:06:41.814861+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:12.272800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"96'26","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721650+0000","last_change":"2024-09-12T00:03:23.616706+0000","last_active":"2024-09-12T00:06:42.721650+0000","last_peered":"2024-09-12T00:06:42.721650+0000","last_clean":"2024-09-12T00:06:42.721650+0000","last_became_active":"2024-09-12T00:03:23.615970+0000","last_became_peered":"2024-09-12T00:03:23.615970+0000","last_unstale":"2024-09-12T00:06:42.721650+0000","last_undegraded":"2024-09-12T00:06:42.721650+0000","last_fullsized":"2024-09-12T00:06:42.721650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"63'8","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720621+0000","last_change":"2024-09-12T00:03:25.343716+0000","last_active":"2024-09-12T00:06:42.720621+0000","last_peered":"2024-09-12T00:06:42.720621+0000","last_clean":"2024-09-12T00:06:42.720621+0000","last_became_active":"2024-09-12T00:03:25.342930+0000","last_became_peered":"2024-09-12T00:03:25.342930+0000","last_unstale":"2024-09-12T00:06:42.720621+0000","last_undegraded":"2024-09-12T00:06:42.720621+0000","last_fullsized":"2024-09-12T00:06:42.720621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"95'25","reported_seq":321,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814202+0000","last_change":"2024-09-12T00:06:29.602896+0000","last_active":"2024-09-12T00:06:41.814202+0000","last_peered":"2024-09-12T00:06:41.814202+0000","last_clean":"2024-09-12T00:06:41.814202+0000","last_became_active":"2024-09-12T00:06:26.672080+0000","last_became_peered":"2024-09-12T00:06:26.672080+0000","last_unstale":"2024-09-12T00:06:41.814202+0000","last_undegraded":"2024-09-12T00:06:41.814202+0000","last_fullsized":"2024-09-12T00:06:41.814202+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:47.695274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"96'10","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499716+0000","last_change":"2024-09-12T00:03:25.326620+0000","last_active":"2024-09-12T00:06:42.499716+0000","last_peered":"2024-09-12T00:06:42.499716+0000","last_clean":"2024-09-12T00:06:42.499716+0000","last_became_active":"2024-09-12T00:03:25.326262+0000","last_became_peered":"2024-09-12T00:03:25.326262+0000","last_unstale":"2024-09-12T00:06:42.499716+0000","last_undegraded":"2024-09-12T00:06:42.499716+0000","last_fullsized":"2024-09-12T00:06:42.499716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"96'16","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067549+0000","last_change":"2024-09-12T00:03:23.632200+0000","last_active":"2024-09-12T00:06:42.067549+0000","last_peered":"2024-09-12T00:06:42.067549+0000","last_clean":"2024-09-12T00:06:42.067549+0000","last_became_active":"2024-09-12T00:03:23.631510+0000","last_became_peered":"2024-09-12T00:03:23.631510+0000","last_unstale":"2024-09-12T00:06:42.067549+0000","last_undegraded":"2024-09-12T00:06:42.067549+0000","last_fullsized":"2024-09-12T00:06:42.067549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:07.177242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"58'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.724304+0000","last_change":"2024-09-12T00:03:25.342763+0000","last_active":"2024-09-12T00:06:42.724304+0000","last_peered":"2024-09-12T00:06:42.724304+0000","last_clean":"2024-09-12T00:06:42.724304+0000","last_became_active":"2024-09-12T00:03:25.337834+0000","last_became_peered":"2024-09-12T00:03:25.337834+0000","last_unstale":"2024-09-12T00:06:42.724304+0000","last_undegraded":"2024-09-12T00:06:42.724304+0000","last_fullsized":"2024-09-12T00:06:42.724304+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:35.920599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"95'16","reported_seq":75,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717915+0000","last_change":"2024-09-12T00:06:28.323950+0000","last_active":"2024-09-12T00:06:42.717915+0000","last_peered":"2024-09-12T00:06:42.717915+0000","last_clean":"2024-09-12T00:06:42.717915+0000","last_became_active":"2024-09-12T00:06:26.666889+0000","last_became_peered":"2024-09-12T00:06:26.666889+0000","last_unstale":"2024-09-12T00:06:42.717915+0000","last_undegraded":"2024-09-12T00:06:42.717915+0000","last_fullsized":"2024-09-12T00:06:42.717915+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:12.167901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816185+0000","last_change":"2024-09-12T00:03:25.339910+0000","last_active":"2024-09-12T00:06:41.816185+0000","last_peered":"2024-09-12T00:06:41.816185+0000","last_clean":"2024-09-12T00:06:41.816185+0000","last_became_active":"2024-09-12T00:03:25.336511+0000","last_became_peered":"2024-09-12T00:03:25.336511+0000","last_unstale":"2024-09-12T00:06:41.816185+0000","last_undegraded":"2024-09-12T00:06:41.816185+0000","last_fullsized":"2024-09-12T00:06:41.816185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:30.647474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"96'28","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065464+0000","last_change":"2024-09-12T00:03:23.626232+0000","last_active":"2024-09-12T00:06:42.065464+0000","last_peered":"2024-09-12T00:06:42.065464+0000","last_clean":"2024-09-12T00:06:42.065464+0000","last_became_active":"2024-09-12T00:03:23.621761+0000","last_became_peered":"2024-09-12T00:03:23.621761+0000","last_unstale":"2024-09-12T00:06:42.065464+0000","last_undegraded":"2024-09-12T00:06:42.065464+0000","last_fullsized":"2024-09-12T00:06:42.065464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:31.587668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"59'4","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066619+0000","last_change":"2024-09-12T00:06:28.859921+0000","last_active":"2024-09-12T00:06:42.066619+0000","last_peered":"2024-09-12T00:06:42.066619+0000","last_clean":"2024-09-12T00:06:42.066619+0000","last_became_active":"2024-09-12T00:06:26.677331+0000","last_became_peered":"2024-09-12T00:06:26.677331+0000","last_unstale":"2024-09-12T00:06:42.066619+0000","last_undegraded":"2024-09-12T00:06:42.066619+0000","last_fullsized":"2024-09-12T00:06:42.066619+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:05.062779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"96'24","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500399+0000","last_change":"2024-09-12T00:03:23.600956+0000","last_active":"2024-09-12T00:06:42.500399+0000","last_peered":"2024-09-12T00:06:42.500399+0000","last_clean":"2024-09-12T00:06:42.500399+0000","last_became_active":"2024-09-12T00:03:23.600673+0000","last_became_peered":"2024-09-12T00:03:23.600673+0000","last_unstale":"2024-09-12T00:06:42.500399+0000","last_undegraded":"2024-09-12T00:06:42.500399+0000","last_fullsized":"2024-09-12T00:06:42.500399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"96'6","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500670+0000","last_change":"2024-09-12T00:03:25.325088+0000","last_active":"2024-09-12T00:06:42.500670+0000","last_peered":"2024-09-12T00:06:42.500670+0000","last_clean":"2024-09-12T00:06:42.500670+0000","last_became_active":"2024-09-12T00:03:25.324597+0000","last_became_peered":"2024-09-12T00:03:25.324597+0000","last_unstale":"2024-09-12T00:06:42.500670+0000","last_undegraded":"2024-09-12T00:06:42.500670+0000","last_fullsized":"2024-09-12T00:06:42.500670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"95'19","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812155+0000","last_change":"2024-09-12T00:03:23.621791+0000","last_active":"2024-09-12T00:06:41.812155+0000","last_peered":"2024-09-12T00:06:41.812155+0000","last_clean":"2024-09-12T00:06:41.812155+0000","last_became_active":"2024-09-12T00:03:23.621063+0000","last_became_peered":"2024-09-12T00:03:23.621063+0000","last_unstale":"2024-09-12T00:06:41.812155+0000","last_undegraded":"2024-09-12T00:06:41.812155+0000","last_fullsized":"2024-09-12T00:06:41.812155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:33.234598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77594624,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":75776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500368+0000","last_change":"2024-09-12T00:03:25.357605+0000","last_active":"2024-09-12T00:06:42.500368+0000","last_peered":"2024-09-12T00:06:42.500368+0000","last_clean":"2024-09-12T00:06:42.500368+0000","last_became_active":"2024-09-12T00:03:25.357286+0000","last_became_peered":"2024-09-12T00:03:25.357286+0000","last_unstale":"2024-09-12T00:06:42.500368+0000","last_undegraded":"2024-09-12T00:06:42.500368+0000","last_fullsized":"2024-09-12T00:06:42.500368+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"96'21","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815686+0000","last_change":"2024-09-12T00:03:23.600931+0000","last_active":"2024-09-12T00:06:41.815686+0000","last_peered":"2024-09-12T00:06:41.815686+0000","last_clean":"2024-09-12T00:06:41.815686+0000","last_became_active":"2024-09-12T00:03:23.600591+0000","last_became_peered":"2024-09-12T00:03:23.600591+0000","last_unstale":"2024-09-12T00:06:41.815686+0000","last_undegraded":"2024-09-12T00:06:41.815686+0000","last_fullsized":"2024-09-12T00:06:41.815686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"84'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719420+0000","last_change":"2024-09-12T00:03:25.330869+0000","last_active":"2024-09-12T00:06:42.719420+0000","last_peered":"2024-09-12T00:06:42.719420+0000","last_clean":"2024-09-12T00:06:42.719420+0000","last_became_active":"2024-09-12T00:03:25.329742+0000","last_became_peered":"2024-09-12T00:03:25.329742+0000","last_unstale":"2024-09-12T00:06:42.719420+0000","last_undegraded":"2024-09-12T00:06:42.719420+0000","last_fullsized":"2024-09-12T00:06:42.719420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:01.365985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"95'32","reported_seq":105,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720260+0000","last_change":"2024-09-12T00:06:31.824748+0000","last_active":"2024-09-12T00:06:42.720260+0000","last_peered":"2024-09-12T00:06:42.720260+0000","last_clean":"2024-09-12T00:06:42.720260+0000","last_became_active":"2024-09-12T00:06:26.668022+0000","last_became_peered":"2024-09-12T00:06:26.668022+0000","last_unstale":"2024-09-12T00:06:42.720260+0000","last_undegraded":"2024-09-12T00:06:42.720260+0000","last_fullsized":"2024-09-12T00:06:42.720260+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:57.178468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":40,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":222298112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"59'4","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811470+0000","last_change":"2024-09-12T00:03:25.347570+0000","last_active":"2024-09-12T00:06:41.811470+0000","last_peered":"2024-09-12T00:06:41.811470+0000","last_clean":"2024-09-12T00:06:41.811470+0000","last_became_active":"2024-09-12T00:03:25.346874+0000","last_became_peered":"2024-09-12T00:03:25.346874+0000","last_unstale":"2024-09-12T00:06:41.811470+0000","last_undegraded":"2024-09-12T00:06:41.811470+0000","last_fullsized":"2024-09-12T00:06:41.811470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"96'23","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723730+0000","last_change":"2024-09-12T00:03:23.623417+0000","last_active":"2024-09-12T00:06:42.723730+0000","last_peered":"2024-09-12T00:06:42.723730+0000","last_clean":"2024-09-12T00:06:42.723730+0000","last_became_active":"2024-09-12T00:03:23.620261+0000","last_became_peered":"2024-09-12T00:03:23.620261+0000","last_unstale":"2024-09-12T00:06:42.723730+0000","last_undegraded":"2024-09-12T00:06:42.723730+0000","last_fullsized":"2024-09-12T00:06:42.723730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"63'8","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499989+0000","last_change":"2024-09-12T00:03:25.357492+0000","last_active":"2024-09-12T00:06:42.499989+0000","last_peered":"2024-09-12T00:06:42.499989+0000","last_clean":"2024-09-12T00:06:42.499989+0000","last_became_active":"2024-09-12T00:03:25.357186+0000","last_became_peered":"2024-09-12T00:03:25.357186+0000","last_unstale":"2024-09-12T00:06:42.499989+0000","last_undegraded":"2024-09-12T00:06:42.499989+0000","last_fullsized":"2024-09-12T00:06:42.499989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"96'26","reported_seq":95,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719726+0000","last_change":"2024-09-12T00:06:34.105256+0000","last_active":"2024-09-12T00:06:42.719726+0000","last_peered":"2024-09-12T00:06:42.719726+0000","last_clean":"2024-09-12T00:06:42.719726+0000","last_became_active":"2024-09-12T00:06:26.677360+0000","last_became_peered":"2024-09-12T00:06:26.677360+0000","last_unstale":"2024-09-12T00:06:42.719726+0000","last_undegraded":"2024-09-12T00:06:42.719726+0000","last_fullsized":"2024-09-12T00:06:42.719726+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:18.563619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":163577856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"96'27","reported_seq":97,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717277+0000","last_change":"2024-09-12T00:06:28.886144+0000","last_active":"2024-09-12T00:06:42.717277+0000","last_peered":"2024-09-12T00:06:42.717277+0000","last_clean":"2024-09-12T00:06:42.717277+0000","last_became_active":"2024-09-12T00:06:26.669830+0000","last_became_peered":"2024-09-12T00:06:26.669830+0000","last_unstale":"2024-09-12T00:06:42.717277+0000","last_undegraded":"2024-09-12T00:06:42.717277+0000","last_fullsized":"2024-09-12T00:06:42.717277+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:37.229011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":192937984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"84'6","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813636+0000","last_change":"2024-09-12T00:03:25.350116+0000","last_active":"2024-09-12T00:06:41.813636+0000","last_peered":"2024-09-12T00:06:41.813636+0000","last_clean":"2024-09-12T00:06:41.813636+0000","last_became_active":"2024-09-12T00:03:25.349281+0000","last_became_peered":"2024-09-12T00:03:25.349281+0000","last_unstale":"2024-09-12T00:06:41.813636+0000","last_undegraded":"2024-09-12T00:06:41.813636+0000","last_fullsized":"2024-09-12T00:06:41.813636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:33.350458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"96'20","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065234+0000","last_change":"2024-09-12T00:03:23.619574+0000","last_active":"2024-09-12T00:06:42.065234+0000","last_peered":"2024-09-12T00:06:42.065234+0000","last_clean":"2024-09-12T00:06:42.065234+0000","last_became_active":"2024-09-12T00:03:23.616154+0000","last_became_peered":"2024-09-12T00:03:23.616154+0000","last_unstale":"2024-09-12T00:06:42.065234+0000","last_undegraded":"2024-09-12T00:06:42.065234+0000","last_fullsized":"2024-09-12T00:06:42.065234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:46.335775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"58'2","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.502147+0000","last_change":"2024-09-12T00:03:25.345327+0000","last_active":"2024-09-12T00:06:42.502147+0000","last_peered":"2024-09-12T00:06:42.502147+0000","last_clean":"2024-09-12T00:06:42.502147+0000","last_became_active":"2024-09-12T00:03:25.344917+0000","last_became_peered":"2024-09-12T00:03:25.344917+0000","last_unstale":"2024-09-12T00:06:42.502147+0000","last_undegraded":"2024-09-12T00:06:42.502147+0000","last_fullsized":"2024-09-12T00:06:42.502147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":339,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1085,"ondisk_log_size":1085,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382934,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1135,"num_read_kb":865,"num_write":659,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":117531,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":953,"ondisk_log_size":953,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1444,"num_read_kb":1412,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1584,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":721,"num_bytes_recovered":3007315968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542197,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1111992,"kb_used_data":1080808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93259848,"statfs":{"total":96636764160,"available":95498084352,"internally_reserved":0,"allocated":1106747392,"data_stored":1106113870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542197,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1329084,"kb_used_data":1297892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93042756,"statfs":{"total":96636764160,"available":95275782144,"internally_reserved":0,"allocated":1329041408,"data_stored":1328412810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542197,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1794496,"kb_used_data":1759152,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92577344,"statfs":{"total":96636764160,"available":94799200256,"internally_reserved":0,"allocated":1801371648,"data_stored":1800744781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542197,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1329264,"kb_used_data":1293920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93042576,"statfs":{"total":96636764160,"available":95275597824,"internally_reserved":0,"allocated":1324974080,"data_stored":1324334685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542197,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1830964,"kb_used_data":1791448,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":92540876,"statfs":{"total":96636764160,"available":94761857024,"internally_reserved":0,"allocated":1834442752,"data_stored":1833824839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542198,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1806124,"kb_used_data":1774932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92565716,"statfs":{"total":96636764160,"available":94787293184,"internally_reserved":0,"allocated":1817530368,"data_stored":1816930588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542197,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1305176,"kb_used_data":1269832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93066664,"statfs":{"total":96636764160,"available":95300263936,"internally_reserved":0,"allocated":1300307968,"data_stored":1299644748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542196,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2084760,"kb_used_data":2049416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92287080,"statfs":{"total":96636764160,"available":94501969920,"internally_reserved":0,"allocated":2098601984,"data_stored":2097950685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2097152000,"data_stored":2097152000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1298137088,"data_stored":1298137088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1816133632,"data_stored":1816133632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1832910848,"data_stored":1832910848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1323302912,"data_stored":1323302912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1799356416,"data_stored":1799356416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1327497216,"data_stored":1327497216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1105199104,"data_stored":1105199104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":119156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":117311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":235112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":117531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":117713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:07:13.350 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:07:13.695 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:07:13.695 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":116,"fsid":"e8cc2cf2-4ebe-41fb-ac6a-f09b6fd34589","created":"2024-09-12T00:02:55.594166+0000","modified":"2024-09-12T00:06:41.802141+0000","last_up_change":"2024-09-12T00:03:08.456127+0000","last_in_change":"2024-09-12T00:06:25.567588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:03:10.418576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:03:14.745863+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T00:03:22.360758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T00:03:23.944957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T00:03:25.559276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T00:03:27.471761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T00:03:29.369053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T00:03:31.499978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af1b1898-c45f-43f5-b9c5-26e491625211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6809","nonce":846638970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6811","nonce":846638970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6815","nonce":846638970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":846638970},{"type":"v1","addr":"172.21.15.19:6813","nonce":846638970}]},"public_addr":"172.21.15.19:6809/846638970","cluster_addr":"172.21.15.19:6811/846638970","heartbeat_back_addr":"172.21.15.19:6815/846638970","heartbeat_front_addr":"172.21.15.19:6813/846638970","state":["exists","up"]},{"osd":1,"uuid":"fe1aa63d-8e57-4163-98a5-0131e1a60680","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6801","nonce":889703096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6803","nonce":889703096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6807","nonce":889703096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":889703096},{"type":"v1","addr":"172.21.15.19:6805","nonce":889703096}]},"public_addr":"172.21.15.19:6801/889703096","cluster_addr":"172.21.15.19:6803/889703096","heartbeat_back_addr":"172.21.15.19:6807/889703096","heartbeat_front_addr":"172.21.15.19:6805/889703096","state":["exists","up"]},{"osd":2,"uuid":"1c97c435-1516-46e1-8fb9-fab9d7419774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6817","nonce":1847757189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6819","nonce":1847757189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6823","nonce":1847757189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1847757189},{"type":"v1","addr":"172.21.15.19:6821","nonce":1847757189}]},"public_addr":"172.21.15.19:6817/1847757189","cluster_addr":"172.21.15.19:6819/1847757189","heartbeat_back_addr":"172.21.15.19:6823/1847757189","heartbeat_front_addr":"172.21.15.19:6821/1847757189","state":["exists","up"]},{"osd":3,"uuid":"30dc8f77-54f0-4e5a-8adc-3ef4b1c08f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6825","nonce":2630062148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6827","nonce":2630062148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6831","nonce":2630062148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2630062148},{"type":"v1","addr":"172.21.15.19:6829","nonce":2630062148}]},"public_addr":"172.21.15.19:6825/2630062148","cluster_addr":"172.21.15.19:6827/2630062148","heartbeat_back_addr":"172.21.15.19:6831/2630062148","heartbeat_front_addr":"172.21.15.19:6829/2630062148","state":["exists","up"]},{"osd":4,"uuid":"0b4e8ec4-cb09-4c05-9ddb-fe1e664e8f03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6801","nonce":2966848021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6803","nonce":2966848021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6807","nonce":2966848021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2966848021},{"type":"v1","addr":"172.21.15.135:6805","nonce":2966848021}]},"public_addr":"172.21.15.135:6801/2966848021","cluster_addr":"172.21.15.135:6803/2966848021","heartbeat_back_addr":"172.21.15.135:6807/2966848021","heartbeat_front_addr":"172.21.15.135:6805/2966848021","state":["exists","up"]},{"osd":5,"uuid":"44796deb-5225-490a-a526-e0be07036b8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6827","nonce":3933885245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6829","nonce":3933885245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6833","nonce":3933885245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3933885245},{"type":"v1","addr":"172.21.15.135:6831","nonce":3933885245}]},"public_addr":"172.21.15.135:6827/3933885245","cluster_addr":"172.21.15.135:6829/3933885245","heartbeat_back_addr":"172.21.15.135:6833/3933885245","heartbeat_front_addr":"172.21.15.135:6831/3933885245","state":["exists","up"]},{"osd":6,"uuid":"cecfecf3-d6c7-44f3-9c08-259ae76571c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6817","nonce":951791611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6819","nonce":951791611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6823","nonce":951791611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":951791611},{"type":"v1","addr":"172.21.15.135:6821","nonce":951791611}]},"public_addr":"172.21.15.135:6817/951791611","cluster_addr":"172.21.15.135:6819/951791611","heartbeat_back_addr":"172.21.15.135:6823/951791611","heartbeat_front_addr":"172.21.15.135:6821/951791611","state":["exists","up"]},{"osd":7,"uuid":"df0b245a-9a80-4038-8e00-4931eaee68c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6809","nonce":3316717279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6811","nonce":3316717279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6815","nonce":3316717279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3316717279},{"type":"v1","addr":"172.21.15.135:6813","nonce":3316717279}]},"public_addr":"172.21.15.135:6809/3316717279","cluster_addr":"172.21.15.135:6811/3316717279","heartbeat_back_addr":"172.21.15.135:6815/3316717279","heartbeat_front_addr":"172.21.15.135:6813/3316717279","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:06.137315+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.222776+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.477878+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.530174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:04.779952+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.847174+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.445765+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:03:05.572805+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:07:14.715 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T00:07:14.715 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:07:14.880 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:07:14.880 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:07:14.880 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:07:14.897 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T00:07:15.200 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T00:07:15.220 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T00:07:15.221 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:07:15.373 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:07:15.373 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:07:15.373 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:07:15.391 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T00:07:15.694 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T00:07:15.713 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T00:07:15.713 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:07:15.855 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:07:15.856 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:07:15.856 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:07:15.871 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T00:07:16.178 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T00:07:16.200 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T00:07:16.201 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:07:16.352 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:07:16.352 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:07:16.352 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:07:16.369 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T00:07:16.674 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T00:07:16.694 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T00:07:16.695 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:07:16.849 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:07:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:07:16.850 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:07:16.867 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T00:07:17.169 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T00:07:17.187 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T00:07:17.187 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:07:17.342 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:07:17.342 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:07:17.342 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:07:17.360 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T00:07:17.662 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T00:07:17.681 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T00:07:17.681 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:07:17.837 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:07:17.837 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:07:17.837 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:07:17.854 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T00:07:18.153 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T00:07:18.172 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T00:07:18.172 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:07:18.325 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:07:18.325 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:07:18.325 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:07:18.340 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T00:07:18.637 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T00:07:18.656 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:07:18.977 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:07:18.984 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T00:07:18.993 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2024-09-12T00:07:18.480323+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":624007,"num_objects":232,"num_object_clones":0,"num_object_copies":464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":232,"num_whiteouts":0,"num_read":5210,"num_read_kb":4083,"num_write":4549,"num_write_kb":6187135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":928,"num_bytes_recovered":3007433610,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5690,"ondisk_log_size":5690,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":295768,"kb_used_data":12288,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754678952,"statfs":{"total":773094113280,"available":772791246848,"internally_reserved":0,"allocated":12582912,"data_stored":7565130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":289394226},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,2,5],"upper_bound":16},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6300195938,"num_objects":-1504,"num_object_clones":0,"num_object_copies":-3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1504,"num_whiteouts":0,"num_read":1730,"num_read_kb":944,"num_write":1582,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005729"},"pg_stats":[{"pgid":"3.3f","version":"116'32","reported_seq":302,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.754429+0000","last_change":"2024-09-12T00:06:27.539898+0000","last_active":"2024-09-12T00:07:11.754429+0000","last_peered":"2024-09-12T00:07:11.754429+0000","last_clean":"2024-09-12T00:07:11.754429+0000","last_became_active":"2024-09-12T00:06:26.678792+0000","last_became_peered":"2024-09-12T00:06:26.678792+0000","last_unstale":"2024-09-12T00:07:11.754429+0000","last_undegraded":"2024-09-12T00:07:11.754429+0000","last_fullsized":"2024-09-12T00:07:11.754429+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:23.434133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'2","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499351+0000","last_change":"2024-09-12T00:03:25.337244+0000","last_active":"2024-09-12T00:06:42.499351+0000","last_peered":"2024-09-12T00:06:42.499351+0000","last_clean":"2024-09-12T00:06:42.499351+0000","last_became_active":"2024-09-12T00:03:25.335964+0000","last_became_peered":"2024-09-12T00:03:25.335964+0000","last_unstale":"2024-09-12T00:06:42.499351+0000","last_undegraded":"2024-09-12T00:06:42.499351+0000","last_fullsized":"2024-09-12T00:06:42.499351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"116'48","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.923345+0000","last_change":"2024-09-12T00:03:23.628328+0000","last_active":"2024-09-12T00:07:11.923345+0000","last_peered":"2024-09-12T00:07:11.923345+0000","last_clean":"2024-09-12T00:07:11.923345+0000","last_became_active":"2024-09-12T00:03:23.627630+0000","last_became_peered":"2024-09-12T00:03:23.627630+0000","last_unstale":"2024-09-12T00:07:11.923345+0000","last_undegraded":"2024-09-12T00:07:11.923345+0000","last_fullsized":"2024-09-12T00:07:11.923345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:00.573006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"76'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717726+0000","last_change":"2024-09-12T00:06:27.903337+0000","last_active":"2024-09-12T00:06:42.717726+0000","last_peered":"2024-09-12T00:06:42.717726+0000","last_clean":"2024-09-12T00:06:42.717726+0000","last_became_active":"2024-09-12T00:06:26.660419+0000","last_became_peered":"2024-09-12T00:06:26.660419+0000","last_unstale":"2024-09-12T00:06:42.717726+0000","last_undegraded":"2024-09-12T00:06:42.717726+0000","last_fullsized":"2024-09-12T00:06:42.717726+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:43.714019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"116'58","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.946196+0000","last_change":"2024-09-12T00:03:23.626533+0000","last_active":"2024-09-12T00:07:11.946196+0000","last_peered":"2024-09-12T00:07:11.946196+0000","last_clean":"2024-09-12T00:07:11.946196+0000","last_became_active":"2024-09-12T00:03:23.625728+0000","last_became_peered":"2024-09-12T00:03:23.625728+0000","last_unstale":"2024-09-12T00:07:11.946196+0000","last_undegraded":"2024-09-12T00:07:11.946196+0000","last_fullsized":"2024-09-12T00:07:11.946196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:31.772442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"96'4","reported_seq":47,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721615+0000","last_change":"2024-09-12T00:06:32.442375+0000","last_active":"2024-09-12T00:06:42.721615+0000","last_peered":"2024-09-12T00:06:42.721615+0000","last_clean":"2024-09-12T00:06:42.721615+0000","last_became_active":"2024-09-12T00:06:26.677271+0000","last_became_peered":"2024-09-12T00:06:26.677271+0000","last_unstale":"2024-09-12T00:06:42.721615+0000","last_undegraded":"2024-09-12T00:06:42.721615+0000","last_fullsized":"2024-09-12T00:06:42.721615+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:34.385926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"116'44","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.877820+0000","last_change":"2024-09-12T00:03:23.609828+0000","last_active":"2024-09-12T00:07:11.877820+0000","last_peered":"2024-09-12T00:07:11.877820+0000","last_clean":"2024-09-12T00:07:11.877820+0000","last_became_active":"2024-09-12T00:03:23.609326+0000","last_became_peered":"2024-09-12T00:03:23.609326+0000","last_unstale":"2024-09-12T00:07:11.877820+0000","last_undegraded":"2024-09-12T00:07:11.877820+0000","last_fullsized":"2024-09-12T00:07:11.877820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:25.491620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'8","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812256+0000","last_change":"2024-09-12T00:03:25.339518+0000","last_active":"2024-09-12T00:06:41.812256+0000","last_peered":"2024-09-12T00:06:41.812256+0000","last_clean":"2024-09-12T00:06:41.812256+0000","last_became_active":"2024-09-12T00:03:25.338805+0000","last_became_peered":"2024-09-12T00:03:25.338805+0000","last_unstale":"2024-09-12T00:06:41.812256+0000","last_undegraded":"2024-09-12T00:06:41.812256+0000","last_fullsized":"2024-09-12T00:06:41.812256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"116'52","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.894234+0000","last_change":"2024-09-12T00:03:23.633978+0000","last_active":"2024-09-12T00:07:11.894234+0000","last_peered":"2024-09-12T00:07:11.894234+0000","last_clean":"2024-09-12T00:07:11.894234+0000","last_became_active":"2024-09-12T00:03:23.633580+0000","last_became_peered":"2024-09-12T00:03:23.633580+0000","last_unstale":"2024-09-12T00:07:11.894234+0000","last_undegraded":"2024-09-12T00:07:11.894234+0000","last_fullsized":"2024-09-12T00:07:11.894234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:01.872688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809540+0000","last_change":"2024-09-12T00:03:25.324424+0000","last_active":"2024-09-12T00:06:41.809540+0000","last_peered":"2024-09-12T00:06:41.809540+0000","last_clean":"2024-09-12T00:06:41.809540+0000","last_became_active":"2024-09-12T00:03:25.324138+0000","last_became_peered":"2024-09-12T00:03:25.324138+0000","last_unstale":"2024-09-12T00:06:41.809540+0000","last_undegraded":"2024-09-12T00:06:41.809540+0000","last_fullsized":"2024-09-12T00:06:41.809540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:09.954252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"116'42","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.909493+0000","last_change":"2024-09-12T00:03:23.610136+0000","last_active":"2024-09-12T00:07:11.909493+0000","last_peered":"2024-09-12T00:07:11.909493+0000","last_clean":"2024-09-12T00:07:11.909493+0000","last_became_active":"2024-09-12T00:03:23.609509+0000","last_became_peered":"2024-09-12T00:03:23.609509+0000","last_unstale":"2024-09-12T00:07:11.909493+0000","last_undegraded":"2024-09-12T00:07:11.909493+0000","last_fullsized":"2024-09-12T00:07:11.909493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"96'12","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.817127+0000","last_change":"2024-09-12T00:03:25.355256+0000","last_active":"2024-09-12T00:06:41.817127+0000","last_peered":"2024-09-12T00:06:41.817127+0000","last_clean":"2024-09-12T00:06:41.817127+0000","last_became_active":"2024-09-12T00:03:25.355002+0000","last_became_peered":"2024-09-12T00:03:25.355002+0000","last_unstale":"2024-09-12T00:06:41.817127+0000","last_undegraded":"2024-09-12T00:06:41.817127+0000","last_fullsized":"2024-09-12T00:06:41.817127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:50.488869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"116'56","reported_seq":252,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.875610+0000","last_change":"2024-09-12T00:03:23.606780+0000","last_active":"2024-09-12T00:07:11.875610+0000","last_peered":"2024-09-12T00:07:11.875610+0000","last_clean":"2024-09-12T00:07:11.875610+0000","last_became_active":"2024-09-12T00:03:23.606143+0000","last_became_peered":"2024-09-12T00:03:23.606143+0000","last_unstale":"2024-09-12T00:07:11.875610+0000","last_undegraded":"2024-09-12T00:07:11.875610+0000","last_fullsized":"2024-09-12T00:07:11.875610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:22.889982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813590+0000","last_change":"2024-09-12T00:03:25.330195+0000","last_active":"2024-09-12T00:06:41.813590+0000","last_peered":"2024-09-12T00:06:41.813590+0000","last_clean":"2024-09-12T00:06:41.813590+0000","last_became_active":"2024-09-12T00:03:25.329625+0000","last_became_peered":"2024-09-12T00:03:25.329625+0000","last_unstale":"2024-09-12T00:06:41.813590+0000","last_undegraded":"2024-09-12T00:06:41.813590+0000","last_fullsized":"2024-09-12T00:06:41.813590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"116'54","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.874033+0000","last_change":"2024-09-12T00:03:23.626723+0000","last_active":"2024-09-12T00:07:11.874033+0000","last_peered":"2024-09-12T00:07:11.874033+0000","last_clean":"2024-09-12T00:07:11.874033+0000","last_became_active":"2024-09-12T00:03:23.626018+0000","last_became_peered":"2024-09-12T00:03:23.626018+0000","last_unstale":"2024-09-12T00:07:11.874033+0000","last_undegraded":"2024-09-12T00:07:11.874033+0000","last_fullsized":"2024-09-12T00:07:11.874033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"59'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067823+0000","last_change":"2024-09-12T00:03:25.352418+0000","last_active":"2024-09-12T00:06:42.067823+0000","last_peered":"2024-09-12T00:06:42.067823+0000","last_clean":"2024-09-12T00:06:42.067823+0000","last_became_active":"2024-09-12T00:03:25.347902+0000","last_became_peered":"2024-09-12T00:03:25.347902+0000","last_unstale":"2024-09-12T00:06:42.067823+0000","last_undegraded":"2024-09-12T00:06:42.067823+0000","last_fullsized":"2024-09-12T00:06:42.067823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:29.611790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"59'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719921+0000","last_change":"2024-09-12T00:06:27.342563+0000","last_active":"2024-09-12T00:06:42.719921+0000","last_peered":"2024-09-12T00:06:42.719921+0000","last_clean":"2024-09-12T00:06:42.719921+0000","last_became_active":"2024-09-12T00:06:26.653851+0000","last_became_peered":"2024-09-12T00:06:26.653851+0000","last_unstale":"2024-09-12T00:06:42.719921+0000","last_undegraded":"2024-09-12T00:06:42.719921+0000","last_fullsized":"2024-09-12T00:06:42.719921+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:14.109429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"116'34","reported_seq":302,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.780451+0000","last_change":"2024-09-12T00:06:27.069520+0000","last_active":"2024-09-12T00:07:11.780451+0000","last_peered":"2024-09-12T00:07:11.780451+0000","last_clean":"2024-09-12T00:07:11.780451+0000","last_became_active":"2024-09-12T00:06:26.664959+0000","last_became_peered":"2024-09-12T00:06:26.664959+0000","last_unstale":"2024-09-12T00:07:11.780451+0000","last_undegraded":"2024-09-12T00:07:11.780451+0000","last_fullsized":"2024-09-12T00:07:11.780451+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:35.231503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813150+0000","last_change":"2024-09-12T00:03:25.334966+0000","last_active":"2024-09-12T00:06:41.813150+0000","last_peered":"2024-09-12T00:06:41.813150+0000","last_clean":"2024-09-12T00:06:41.813150+0000","last_became_active":"2024-09-12T00:03:25.334375+0000","last_became_peered":"2024-09-12T00:03:25.334375+0000","last_unstale":"2024-09-12T00:06:41.813150+0000","last_undegraded":"2024-09-12T00:06:41.813150+0000","last_fullsized":"2024-09-12T00:06:41.813150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:52.828056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"116'40","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.890545+0000","last_change":"2024-09-12T00:03:23.614289+0000","last_active":"2024-09-12T00:07:11.890545+0000","last_peered":"2024-09-12T00:07:11.890545+0000","last_clean":"2024-09-12T00:07:11.890545+0000","last_became_active":"2024-09-12T00:03:23.614019+0000","last_became_peered":"2024-09-12T00:03:23.614019+0000","last_unstale":"2024-09-12T00:07:11.890545+0000","last_undegraded":"2024-09-12T00:07:11.890545+0000","last_fullsized":"2024-09-12T00:07:11.890545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:00.847027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"96'12","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500281+0000","last_change":"2024-09-12T00:03:25.357938+0000","last_active":"2024-09-12T00:06:42.500281+0000","last_peered":"2024-09-12T00:06:42.500281+0000","last_clean":"2024-09-12T00:06:42.500281+0000","last_became_active":"2024-09-12T00:03:25.357571+0000","last_became_peered":"2024-09-12T00:03:25.357571+0000","last_unstale":"2024-09-12T00:06:42.500281+0000","last_undegraded":"2024-09-12T00:06:42.500281+0000","last_fullsized":"2024-09-12T00:06:42.500281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:05.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"116'46","reported_seq":338,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.881020+0000","last_change":"2024-09-12T00:06:28.845144+0000","last_active":"2024-09-12T00:07:11.881020+0000","last_peered":"2024-09-12T00:07:11.881020+0000","last_clean":"2024-09-12T00:07:11.881020+0000","last_became_active":"2024-09-12T00:06:26.682027+0000","last_became_peered":"2024-09-12T00:06:26.682027+0000","last_unstale":"2024-09-12T00:07:11.881020+0000","last_undegraded":"2024-09-12T00:07:11.881020+0000","last_fullsized":"2024-09-12T00:07:11.881020+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:24.330401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":167772160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'8","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721712+0000","last_change":"2024-09-12T00:03:25.345717+0000","last_active":"2024-09-12T00:06:42.721712+0000","last_peered":"2024-09-12T00:06:42.721712+0000","last_clean":"2024-09-12T00:06:42.721712+0000","last_became_active":"2024-09-12T00:03:25.344959+0000","last_became_peered":"2024-09-12T00:03:25.344959+0000","last_unstale":"2024-09-12T00:06:42.721712+0000","last_undegraded":"2024-09-12T00:06:42.721712+0000","last_fullsized":"2024-09-12T00:06:42.721712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"116'34","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.705869+0000","last_change":"2024-09-12T00:03:23.602960+0000","last_active":"2024-09-12T00:07:11.705869+0000","last_peered":"2024-09-12T00:07:11.705869+0000","last_clean":"2024-09-12T00:07:11.705869+0000","last_became_active":"2024-09-12T00:03:23.602640+0000","last_became_peered":"2024-09-12T00:03:23.602640+0000","last_unstale":"2024-09-12T00:07:11.705869+0000","last_undegraded":"2024-09-12T00:07:11.705869+0000","last_fullsized":"2024-09-12T00:07:11.705869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.137701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"59'2","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066326+0000","last_change":"2024-09-12T00:06:28.300294+0000","last_active":"2024-09-12T00:06:42.066326+0000","last_peered":"2024-09-12T00:06:42.066326+0000","last_clean":"2024-09-12T00:06:42.066326+0000","last_became_active":"2024-09-12T00:06:26.665307+0000","last_became_peered":"2024-09-12T00:06:26.665307+0000","last_unstale":"2024-09-12T00:06:42.066326+0000","last_undegraded":"2024-09-12T00:06:42.066326+0000","last_fullsized":"2024-09-12T00:06:42.066326+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:18.349268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"116'46","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.900200+0000","last_change":"2024-09-12T00:03:23.604732+0000","last_active":"2024-09-12T00:07:11.900200+0000","last_peered":"2024-09-12T00:07:11.900200+0000","last_clean":"2024-09-12T00:07:11.900200+0000","last_became_active":"2024-09-12T00:03:23.603932+0000","last_became_peered":"2024-09-12T00:03:23.603932+0000","last_unstale":"2024-09-12T00:07:11.900200+0000","last_undegraded":"2024-09-12T00:07:11.900200+0000","last_fullsized":"2024-09-12T00:07:11.900200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:14.913580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"76'4","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501143+0000","last_change":"2024-09-12T00:03:25.341332+0000","last_active":"2024-09-12T00:06:42.501143+0000","last_peered":"2024-09-12T00:06:42.501143+0000","last_clean":"2024-09-12T00:06:42.501143+0000","last_became_active":"2024-09-12T00:03:25.340828+0000","last_became_peered":"2024-09-12T00:03:25.340828+0000","last_unstale":"2024-09-12T00:06:42.501143+0000","last_undegraded":"2024-09-12T00:06:42.501143+0000","last_fullsized":"2024-09-12T00:06:42.501143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"116'36","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.928712+0000","last_change":"2024-09-12T00:03:23.602687+0000","last_active":"2024-09-12T00:07:11.928712+0000","last_peered":"2024-09-12T00:07:11.928712+0000","last_clean":"2024-09-12T00:07:11.928712+0000","last_became_active":"2024-09-12T00:03:23.601892+0000","last_became_peered":"2024-09-12T00:03:23.601892+0000","last_unstale":"2024-09-12T00:07:11.928712+0000","last_undegraded":"2024-09-12T00:07:11.928712+0000","last_fullsized":"2024-09-12T00:07:11.928712+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.808845+0000","last_change":"2024-09-12T00:03:33.354850+0000","last_active":"2024-09-12T00:06:41.808845+0000","last_peered":"2024-09-12T00:06:41.808845+0000","last_clean":"2024-09-12T00:06:41.808845+0000","last_became_active":"2024-09-12T00:03:33.351917+0000","last_became_peered":"2024-09-12T00:03:33.351917+0000","last_unstale":"2024-09-12T00:06:41.808845+0000","last_undegraded":"2024-09-12T00:06:41.808845+0000","last_fullsized":"2024-09-12T00:06:41.808845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:00.466863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"59'6","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721027+0000","last_change":"2024-09-12T00:03:25.323174+0000","last_active":"2024-09-12T00:06:42.721027+0000","last_peered":"2024-09-12T00:06:42.721027+0000","last_clean":"2024-09-12T00:06:42.721027+0000","last_became_active":"2024-09-12T00:03:25.322456+0000","last_became_peered":"2024-09-12T00:03:25.322456+0000","last_unstale":"2024-09-12T00:06:42.721027+0000","last_undegraded":"2024-09-12T00:06:42.721027+0000","last_fullsized":"2024-09-12T00:06:42.721027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"116'54","reported_seq":124,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.940925+0000","last_change":"2024-09-12T00:06:27.333722+0000","last_active":"2024-09-12T00:07:11.940925+0000","last_peered":"2024-09-12T00:07:11.940925+0000","last_clean":"2024-09-12T00:07:11.940925+0000","last_became_active":"2024-09-12T00:06:26.648460+0000","last_became_peered":"2024-09-12T00:06:26.648460+0000","last_unstale":"2024-09-12T00:07:11.940925+0000","last_undegraded":"2024-09-12T00:07:11.940925+0000","last_fullsized":"2024-09-12T00:07:11.940925+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:17.751627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717693+0000","last_change":"2024-09-12T00:06:26.675813+0000","last_active":"2024-09-12T00:06:42.717693+0000","last_peered":"2024-09-12T00:06:42.717693+0000","last_clean":"2024-09-12T00:06:42.717693+0000","last_became_active":"2024-09-12T00:06:26.663654+0000","last_became_peered":"2024-09-12T00:06:26.663654+0000","last_unstale":"2024-09-12T00:06:42.717693+0000","last_undegraded":"2024-09-12T00:06:42.717693+0000","last_fullsized":"2024-09-12T00:06:42.717693+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:22.865255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"116'32","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.977265+0000","last_change":"2024-09-12T00:03:29.347224+0000","last_active":"2024-09-12T00:07:11.977265+0000","last_peered":"2024-09-12T00:07:11.977265+0000","last_clean":"2024-09-12T00:07:11.977265+0000","last_became_active":"2024-09-12T00:03:29.346662+0000","last_became_peered":"2024-09-12T00:03:29.346662+0000","last_unstale":"2024-09-12T00:07:11.977265+0000","last_undegraded":"2024-09-12T00:07:11.977265+0000","last_fullsized":"2024-09-12T00:07:11.977265+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:28.258932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501404+0000","last_change":"2024-09-12T00:03:31.337219+0000","last_active":"2024-09-12T00:06:42.501404+0000","last_peered":"2024-09-12T00:06:42.501404+0000","last_clean":"2024-09-12T00:06:42.501404+0000","last_became_active":"2024-09-12T00:03:31.336317+0000","last_became_peered":"2024-09-12T00:03:31.336317+0000","last_unstale":"2024-09-12T00:06:42.501404+0000","last_undegraded":"2024-09-12T00:06:42.501404+0000","last_fullsized":"2024-09-12T00:06:42.501404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:50.954053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"96'48","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499219+0000","last_change":"2024-09-12T00:03:33.376628+0000","last_active":"2024-09-12T00:06:42.499219+0000","last_peered":"2024-09-12T00:06:42.499219+0000","last_clean":"2024-09-12T00:06:42.499219+0000","last_became_active":"2024-09-12T00:03:33.375938+0000","last_became_peered":"2024-09-12T00:03:33.375938+0000","last_unstale":"2024-09-12T00:06:42.499219+0000","last_undegraded":"2024-09-12T00:06:42.499219+0000","last_fullsized":"2024-09-12T00:06:42.499219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:31.105042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"84'8","reported_seq":51,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717938+0000","last_change":"2024-09-12T00:06:32.981663+0000","last_active":"2024-09-12T00:06:42.717938+0000","last_peered":"2024-09-12T00:06:42.717938+0000","last_clean":"2024-09-12T00:06:42.717938+0000","last_became_active":"2024-09-12T00:06:26.679390+0000","last_became_peered":"2024-09-12T00:06:26.679390+0000","last_unstale":"2024-09-12T00:06:42.717938+0000","last_undegraded":"2024-09-12T00:06:42.717938+0000","last_fullsized":"2024-09-12T00:06:42.717938+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.655318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"116'28","reported_seq":281,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.757304+0000","last_change":"2024-09-12T00:06:28.270104+0000","last_active":"2024-09-12T00:07:11.757304+0000","last_peered":"2024-09-12T00:07:11.757304+0000","last_clean":"2024-09-12T00:07:11.757304+0000","last_became_active":"2024-09-12T00:06:26.675473+0000","last_became_peered":"2024-09-12T00:06:26.675473+0000","last_unstale":"2024-09-12T00:07:11.757304+0000","last_undegraded":"2024-09-12T00:07:11.757304+0000","last_fullsized":"2024-09-12T00:07:11.757304+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:45.446239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812081+0000","last_change":"2024-09-12T00:03:27.336108+0000","last_active":"2024-09-12T00:06:41.812081+0000","last_peered":"2024-09-12T00:06:41.812081+0000","last_clean":"2024-09-12T00:06:41.812081+0000","last_became_active":"2024-09-12T00:03:27.335308+0000","last_became_peered":"2024-09-12T00:03:27.335308+0000","last_unstale":"2024-09-12T00:06:41.812081+0000","last_undegraded":"2024-09-12T00:06:41.812081+0000","last_fullsized":"2024-09-12T00:06:41.812081+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:39.812803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'12","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501517+0000","last_change":"2024-09-12T00:03:29.352496+0000","last_active":"2024-09-12T00:06:42.501517+0000","last_peered":"2024-09-12T00:06:42.501517+0000","last_clean":"2024-09-12T00:06:42.501517+0000","last_became_active":"2024-09-12T00:03:29.351783+0000","last_became_peered":"2024-09-12T00:03:29.351783+0000","last_unstale":"2024-09-12T00:06:42.501517+0000","last_undegraded":"2024-09-12T00:06:42.501517+0000","last_fullsized":"2024-09-12T00:06:42.501517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501338+0000","last_change":"2024-09-12T00:03:31.350279+0000","last_active":"2024-09-12T00:06:42.501338+0000","last_peered":"2024-09-12T00:06:42.501338+0000","last_clean":"2024-09-12T00:06:42.501338+0000","last_became_active":"2024-09-12T00:03:31.349244+0000","last_became_peered":"2024-09-12T00:03:31.349244+0000","last_unstale":"2024-09-12T00:06:42.501338+0000","last_undegraded":"2024-09-12T00:06:42.501338+0000","last_fullsized":"2024-09-12T00:06:42.501338+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.420974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719171+0000","last_change":"2024-09-12T00:03:33.382726+0000","last_active":"2024-09-12T00:06:42.719171+0000","last_peered":"2024-09-12T00:06:42.719171+0000","last_clean":"2024-09-12T00:06:42.719171+0000","last_became_active":"2024-09-12T00:03:33.381875+0000","last_became_peered":"2024-09-12T00:03:33.381875+0000","last_unstale":"2024-09-12T00:06:42.719171+0000","last_undegraded":"2024-09-12T00:06:42.719171+0000","last_fullsized":"2024-09-12T00:06:42.719171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"63'12","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066812+0000","last_change":"2024-09-12T00:03:25.357883+0000","last_active":"2024-09-12T00:06:42.066812+0000","last_peered":"2024-09-12T00:06:42.066812+0000","last_clean":"2024-09-12T00:06:42.066812+0000","last_became_active":"2024-09-12T00:03:25.355174+0000","last_became_peered":"2024-09-12T00:03:25.355174+0000","last_unstale":"2024-09-12T00:06:42.066812+0000","last_undegraded":"2024-09-12T00:06:42.066812+0000","last_fullsized":"2024-09-12T00:06:42.066812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:26.621650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"116'42","reported_seq":106,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.861953+0000","last_change":"2024-09-12T00:06:29.505713+0000","last_active":"2024-09-12T00:07:11.861953+0000","last_peered":"2024-09-12T00:07:11.861953+0000","last_clean":"2024-09-12T00:07:11.861953+0000","last_became_active":"2024-09-12T00:06:26.670936+0000","last_became_peered":"2024-09-12T00:06:26.670936+0000","last_unstale":"2024-09-12T00:07:11.861953+0000","last_undegraded":"2024-09-12T00:07:11.861953+0000","last_fullsized":"2024-09-12T00:07:11.861953+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:12.048117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813428+0000","last_change":"2024-09-12T00:03:27.347098+0000","last_active":"2024-09-12T00:06:41.813428+0000","last_peered":"2024-09-12T00:06:41.813428+0000","last_clean":"2024-09-12T00:06:41.813428+0000","last_became_active":"2024-09-12T00:03:27.346346+0000","last_became_peered":"2024-09-12T00:03:27.346346+0000","last_unstale":"2024-09-12T00:06:41.813428+0000","last_undegraded":"2024-09-12T00:06:41.813428+0000","last_fullsized":"2024-09-12T00:06:41.813428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:56.250627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'22","reported_seq":265,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812213+0000","last_change":"2024-09-12T00:06:27.562833+0000","last_active":"2024-09-12T00:06:41.812213+0000","last_peered":"2024-09-12T00:06:41.812213+0000","last_clean":"2024-09-12T00:06:41.812213+0000","last_became_active":"2024-09-12T00:06:26.654182+0000","last_became_peered":"2024-09-12T00:06:26.654182+0000","last_unstale":"2024-09-12T00:06:41.812213+0000","last_undegraded":"2024-09-12T00:06:41.812213+0000","last_fullsized":"2024-09-12T00:06:41.812213+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:01.211483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"116'143","reported_seq":365,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:10.885348+0000","last_change":"2024-09-12T00:06:30.699178+0000","last_active":"2024-09-12T00:07:10.885348+0000","last_peered":"2024-09-12T00:07:10.885348+0000","last_clean":"2024-09-12T00:07:10.885348+0000","last_became_active":"2024-09-12T00:06:30.698465+0000","last_became_peered":"2024-09-12T00:06:30.698465+0000","last_unstale":"2024-09-12T00:07:10.885348+0000","last_undegraded":"2024-09-12T00:07:10.885348+0000","last_fullsized":"2024-09-12T00:07:10.885348+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:48.150663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810365+0000","last_change":"2024-09-12T00:03:33.378439+0000","last_active":"2024-09-12T00:06:41.810365+0000","last_peered":"2024-09-12T00:06:41.810365+0000","last_clean":"2024-09-12T00:06:41.810365+0000","last_became_active":"2024-09-12T00:03:33.374453+0000","last_became_peered":"2024-09-12T00:03:33.374453+0000","last_unstale":"2024-09-12T00:06:41.810365+0000","last_undegraded":"2024-09-12T00:06:41.810365+0000","last_fullsized":"2024-09-12T00:06:41.810365+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"58'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067326+0000","last_change":"2024-09-12T00:03:25.356433+0000","last_active":"2024-09-12T00:06:42.067326+0000","last_peered":"2024-09-12T00:06:42.067326+0000","last_clean":"2024-09-12T00:06:42.067326+0000","last_became_active":"2024-09-12T00:03:25.354803+0000","last_became_peered":"2024-09-12T00:03:25.354803+0000","last_unstale":"2024-09-12T00:06:42.067326+0000","last_undegraded":"2024-09-12T00:06:42.067326+0000","last_fullsized":"2024-09-12T00:06:42.067326+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:00.419686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"116'46","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.954704+0000","last_change":"2024-09-12T00:03:23.630527+0000","last_active":"2024-09-12T00:07:11.954704+0000","last_peered":"2024-09-12T00:07:11.954704+0000","last_clean":"2024-09-12T00:07:11.954704+0000","last_became_active":"2024-09-12T00:03:23.630183+0000","last_became_peered":"2024-09-12T00:03:23.630183+0000","last_unstale":"2024-09-12T00:07:11.954704+0000","last_undegraded":"2024-09-12T00:07:11.954704+0000","last_fullsized":"2024-09-12T00:07:11.954704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721999+0000","last_change":"2024-09-12T00:06:26.671315+0000","last_active":"2024-09-12T00:06:42.721999+0000","last_peered":"2024-09-12T00:06:42.721999+0000","last_clean":"2024-09-12T00:06:42.721999+0000","last_became_active":"2024-09-12T00:06:26.669946+0000","last_became_peered":"2024-09-12T00:06:26.669946+0000","last_unstale":"2024-09-12T00:06:42.721999+0000","last_undegraded":"2024-09-12T00:06:42.721999+0000","last_fullsized":"2024-09-12T00:06:42.721999+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:53.569121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"116'26","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.823455+0000","last_change":"2024-09-12T00:03:29.339735+0000","last_active":"2024-09-12T00:07:11.823455+0000","last_peered":"2024-09-12T00:07:11.823455+0000","last_clean":"2024-09-12T00:07:11.823455+0000","last_became_active":"2024-09-12T00:03:29.338810+0000","last_became_peered":"2024-09-12T00:03:29.338810+0000","last_unstale":"2024-09-12T00:07:11.823455+0000","last_undegraded":"2024-09-12T00:07:11.823455+0000","last_fullsized":"2024-09-12T00:07:11.823455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"116'138","reported_seq":435,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:10.896150+0000","last_change":"2024-09-12T00:03:31.364647+0000","last_active":"2024-09-12T00:07:10.896150+0000","last_peered":"2024-09-12T00:07:10.896150+0000","last_clean":"2024-09-12T00:07:10.896150+0000","last_became_active":"2024-09-12T00:03:31.353547+0000","last_became_peered":"2024-09-12T00:03:31.353547+0000","last_unstale":"2024-09-12T00:07:10.896150+0000","last_undegraded":"2024-09-12T00:07:10.896150+0000","last_fullsized":"2024-09-12T00:07:10.896150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:20.795870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"63'4","reported_seq":47,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717416+0000","last_change":"2024-09-12T00:06:27.339590+0000","last_active":"2024-09-12T00:06:42.717416+0000","last_peered":"2024-09-12T00:06:42.717416+0000","last_clean":"2024-09-12T00:06:42.717416+0000","last_became_active":"2024-09-12T00:06:26.651618+0000","last_became_peered":"2024-09-12T00:06:26.651618+0000","last_unstale":"2024-09-12T00:06:42.717416+0000","last_undegraded":"2024-09-12T00:06:42.717416+0000","last_fullsized":"2024-09-12T00:06:42.717416+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:58.850777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"116'56","reported_seq":253,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.940786+0000","last_change":"2024-09-12T00:03:23.602206+0000","last_active":"2024-09-12T00:07:11.940786+0000","last_peered":"2024-09-12T00:07:11.940786+0000","last_clean":"2024-09-12T00:07:11.940786+0000","last_became_active":"2024-09-12T00:03:23.601898+0000","last_became_peered":"2024-09-12T00:03:23.601898+0000","last_unstale":"2024-09-12T00:07:11.940786+0000","last_undegraded":"2024-09-12T00:07:11.940786+0000","last_fullsized":"2024-09-12T00:07:11.940786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:52.625795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":64,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499596+0000","last_change":"2024-09-12T00:03:27.331111+0000","last_active":"2024-09-12T00:06:42.499596+0000","last_peered":"2024-09-12T00:06:42.499596+0000","last_clean":"2024-09-12T00:06:42.499596+0000","last_became_active":"2024-09-12T00:03:27.329672+0000","last_became_peered":"2024-09-12T00:03:27.329672+0000","last_unstale":"2024-09-12T00:06:42.499596+0000","last_undegraded":"2024-09-12T00:06:42.499596+0000","last_fullsized":"2024-09-12T00:06:42.499596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"116'37","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:10.997583+0000","last_change":"2024-09-12T00:03:29.335931+0000","last_active":"2024-09-12T00:07:10.997583+0000","last_peered":"2024-09-12T00:07:10.997583+0000","last_clean":"2024-09-12T00:07:10.997583+0000","last_became_active":"2024-09-12T00:03:29.335044+0000","last_became_peered":"2024-09-12T00:03:29.335044+0000","last_unstale":"2024-09-12T00:07:10.997583+0000","last_undegraded":"2024-09-12T00:07:10.997583+0000","last_fullsized":"2024-09-12T00:07:10.997583+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:57.131209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719379+0000","last_change":"2024-09-12T00:03:31.355001+0000","last_active":"2024-09-12T00:06:42.719379+0000","last_peered":"2024-09-12T00:06:42.719379+0000","last_clean":"2024-09-12T00:06:42.719379+0000","last_became_active":"2024-09-12T00:03:31.354160+0000","last_became_peered":"2024-09-12T00:03:31.354160+0000","last_unstale":"2024-09-12T00:06:42.719379+0000","last_undegraded":"2024-09-12T00:06:42.719379+0000","last_fullsized":"2024-09-12T00:06:42.719379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:29.868141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810884+0000","last_change":"2024-09-12T00:06:26.664709+0000","last_active":"2024-09-12T00:06:41.810884+0000","last_peered":"2024-09-12T00:06:41.810884+0000","last_clean":"2024-09-12T00:06:41.810884+0000","last_became_active":"2024-09-12T00:06:26.664401+0000","last_became_peered":"2024-09-12T00:06:26.664401+0000","last_unstale":"2024-09-12T00:06:41.810884+0000","last_undegraded":"2024-09-12T00:06:41.810884+0000","last_fullsized":"2024-09-12T00:06:41.810884+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:17.791780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'2","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499737+0000","last_change":"2024-09-12T00:03:25.357300+0000","last_active":"2024-09-12T00:06:42.499737+0000","last_peered":"2024-09-12T00:06:42.499737+0000","last_clean":"2024-09-12T00:06:42.499737+0000","last_became_active":"2024-09-12T00:03:25.356970+0000","last_became_peered":"2024-09-12T00:03:25.356970+0000","last_unstale":"2024-09-12T00:06:42.499737+0000","last_undegraded":"2024-09-12T00:06:42.499737+0000","last_fullsized":"2024-09-12T00:06:42.499737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:04.193738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"116'38","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.938137+0000","last_change":"2024-09-12T00:03:23.609700+0000","last_active":"2024-09-12T00:07:11.938137+0000","last_peered":"2024-09-12T00:07:11.938137+0000","last_clean":"2024-09-12T00:07:11.938137+0000","last_became_active":"2024-09-12T00:03:23.609435+0000","last_became_peered":"2024-09-12T00:03:23.609435+0000","last_unstale":"2024-09-12T00:07:11.938137+0000","last_undegraded":"2024-09-12T00:07:11.938137+0000","last_fullsized":"2024-09-12T00:07:11.938137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720734+0000","last_change":"2024-09-12T00:03:27.339670+0000","last_active":"2024-09-12T00:06:42.720734+0000","last_peered":"2024-09-12T00:06:42.720734+0000","last_clean":"2024-09-12T00:06:42.720734+0000","last_became_active":"2024-09-12T00:03:27.338880+0000","last_became_peered":"2024-09-12T00:03:27.338880+0000","last_unstale":"2024-09-12T00:06:42.720734+0000","last_undegraded":"2024-09-12T00:06:42.720734+0000","last_fullsized":"2024-09-12T00:06:42.720734+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:35.068652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"116'29","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.509812+0000","last_change":"2024-09-12T00:03:29.337666+0000","last_active":"2024-09-12T00:07:11.509812+0000","last_peered":"2024-09-12T00:07:11.509812+0000","last_clean":"2024-09-12T00:07:11.509812+0000","last_became_active":"2024-09-12T00:03:29.336957+0000","last_became_peered":"2024-09-12T00:03:29.336957+0000","last_unstale":"2024-09-12T00:07:11.509812+0000","last_undegraded":"2024-09-12T00:07:11.509812+0000","last_fullsized":"2024-09-12T00:07:11.509812+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:58.417315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":36,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810940+0000","last_change":"2024-09-12T00:03:31.348590+0000","last_active":"2024-09-12T00:06:41.810940+0000","last_peered":"2024-09-12T00:06:41.810940+0000","last_clean":"2024-09-12T00:06:41.810940+0000","last_became_active":"2024-09-12T00:03:31.347736+0000","last_became_peered":"2024-09-12T00:03:31.347736+0000","last_unstale":"2024-09-12T00:06:41.810940+0000","last_undegraded":"2024-09-12T00:06:41.810940+0000","last_fullsized":"2024-09-12T00:06:41.810940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:04.962492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"59'8","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500524+0000","last_change":"2024-09-12T00:03:33.379699+0000","last_active":"2024-09-12T00:06:42.500524+0000","last_peered":"2024-09-12T00:06:42.500524+0000","last_clean":"2024-09-12T00:06:42.500524+0000","last_became_active":"2024-09-12T00:03:33.378945+0000","last_became_peered":"2024-09-12T00:03:33.378945+0000","last_unstale":"2024-09-12T00:06:42.500524+0000","last_undegraded":"2024-09-12T00:06:42.500524+0000","last_fullsized":"2024-09-12T00:06:42.500524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:23.270488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'6","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812122+0000","last_change":"2024-09-12T00:06:28.326850+0000","last_active":"2024-09-12T00:06:41.812122+0000","last_peered":"2024-09-12T00:06:41.812122+0000","last_clean":"2024-09-12T00:06:41.812122+0000","last_became_active":"2024-09-12T00:06:26.668131+0000","last_became_peered":"2024-09-12T00:06:26.668131+0000","last_unstale":"2024-09-12T00:06:41.812122+0000","last_undegraded":"2024-09-12T00:06:41.812122+0000","last_fullsized":"2024-09-12T00:06:41.812122+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:18.255160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"116'34","reported_seq":94,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.925942+0000","last_change":"2024-09-12T00:06:33.441486+0000","last_active":"2024-09-12T00:07:11.925942+0000","last_peered":"2024-09-12T00:07:11.925942+0000","last_clean":"2024-09-12T00:07:11.925942+0000","last_became_active":"2024-09-12T00:06:26.679723+0000","last_became_peered":"2024-09-12T00:06:26.679723+0000","last_unstale":"2024-09-12T00:07:11.925942+0000","last_undegraded":"2024-09-12T00:07:11.925942+0000","last_fullsized":"2024-09-12T00:07:11.925942+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:59.722762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065103+0000","last_change":"2024-09-12T00:03:27.348080+0000","last_active":"2024-09-12T00:06:42.065103+0000","last_peered":"2024-09-12T00:06:42.065103+0000","last_clean":"2024-09-12T00:06:42.065103+0000","last_became_active":"2024-09-12T00:03:27.347288+0000","last_became_peered":"2024-09-12T00:03:27.347288+0000","last_unstale":"2024-09-12T00:06:42.065103+0000","last_undegraded":"2024-09-12T00:06:42.065103+0000","last_fullsized":"2024-09-12T00:06:42.065103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:37.033224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"116'41","reported_seq":69,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.324749+0000","last_change":"2024-09-12T00:06:28.360303+0000","last_active":"2024-09-12T00:07:11.324749+0000","last_peered":"2024-09-12T00:07:11.324749+0000","last_clean":"2024-09-12T00:07:11.324749+0000","last_became_active":"2024-09-12T00:06:26.668791+0000","last_became_peered":"2024-09-12T00:06:26.668791+0000","last_unstale":"2024-09-12T00:07:11.324749+0000","last_undegraded":"2024-09-12T00:07:11.324749+0000","last_fullsized":"2024-09-12T00:07:11.324749+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:49.033011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":54,"num_read_kb":275,"num_write":34,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":116871,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"116'138","reported_seq":354,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:10.898989+0000","last_change":"2024-09-12T00:03:31.354114+0000","last_active":"2024-09-12T00:07:10.898989+0000","last_peered":"2024-09-12T00:07:10.898989+0000","last_clean":"2024-09-12T00:07:10.898989+0000","last_became_active":"2024-09-12T00:03:31.353358+0000","last_became_peered":"2024-09-12T00:03:31.353358+0000","last_unstale":"2024-09-12T00:07:10.898989+0000","last_undegraded":"2024-09-12T00:07:10.898989+0000","last_fullsized":"2024-09-12T00:07:10.898989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:56.624718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719909+0000","last_change":"2024-09-12T00:03:33.383917+0000","last_active":"2024-09-12T00:06:42.719909+0000","last_peered":"2024-09-12T00:06:42.719909+0000","last_clean":"2024-09-12T00:06:42.719909+0000","last_became_active":"2024-09-12T00:03:33.383199+0000","last_became_peered":"2024-09-12T00:03:33.383199+0000","last_unstale":"2024-09-12T00:06:42.719909+0000","last_undegraded":"2024-09-12T00:06:42.719909+0000","last_fullsized":"2024-09-12T00:06:42.719909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:37.428182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"84'10","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065948+0000","last_change":"2024-09-12T00:03:25.356706+0000","last_active":"2024-09-12T00:06:42.065948+0000","last_peered":"2024-09-12T00:06:42.065948+0000","last_clean":"2024-09-12T00:06:42.065948+0000","last_became_active":"2024-09-12T00:03:25.354555+0000","last_became_peered":"2024-09-12T00:03:25.354555+0000","last_unstale":"2024-09-12T00:06:42.065948+0000","last_undegraded":"2024-09-12T00:06:42.065948+0000","last_fullsized":"2024-09-12T00:06:42.065948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:55.543336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"116'78","reported_seq":274,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.914309+0000","last_change":"2024-09-12T00:03:23.612430+0000","last_active":"2024-09-12T00:07:11.914309+0000","last_peered":"2024-09-12T00:07:11.914309+0000","last_clean":"2024-09-12T00:07:11.914309+0000","last_became_active":"2024-09-12T00:03:23.612165+0000","last_became_peered":"2024-09-12T00:03:23.612165+0000","last_unstale":"2024-09-12T00:07:11.914309+0000","last_undegraded":"2024-09-12T00:07:11.914309+0000","last_fullsized":"2024-09-12T00:07:11.914309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:31.444343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":78,"num_write_kb":159744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722313+0000","last_change":"2024-09-12T00:03:27.329228+0000","last_active":"2024-09-12T00:06:42.722313+0000","last_peered":"2024-09-12T00:06:42.722313+0000","last_clean":"2024-09-12T00:06:42.722313+0000","last_became_active":"2024-09-12T00:03:27.328497+0000","last_became_peered":"2024-09-12T00:03:27.328497+0000","last_unstale":"2024-09-12T00:06:42.722313+0000","last_undegraded":"2024-09-12T00:06:42.722313+0000","last_fullsized":"2024-09-12T00:06:42.722313+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"116'50","reported_seq":263,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.790389+0000","last_change":"2024-09-12T00:03:29.332778+0000","last_active":"2024-09-12T00:07:11.790389+0000","last_peered":"2024-09-12T00:07:11.790389+0000","last_clean":"2024-09-12T00:07:11.790389+0000","last_became_active":"2024-09-12T00:03:29.332010+0000","last_became_peered":"2024-09-12T00:03:29.332010+0000","last_unstale":"2024-09-12T00:07:11.790389+0000","last_undegraded":"2024-09-12T00:07:11.790389+0000","last_fullsized":"2024-09-12T00:07:11.790389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:13.563107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":65,"num_read_kb":292,"num_write":38,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065300+0000","last_change":"2024-09-12T00:03:31.354374+0000","last_active":"2024-09-12T00:06:42.065300+0000","last_peered":"2024-09-12T00:06:42.065300+0000","last_clean":"2024-09-12T00:06:42.065300+0000","last_became_active":"2024-09-12T00:03:31.353407+0000","last_became_peered":"2024-09-12T00:03:31.353407+0000","last_unstale":"2024-09-12T00:06:42.065300+0000","last_undegraded":"2024-09-12T00:06:42.065300+0000","last_fullsized":"2024-09-12T00:06:42.065300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:30.520217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"93'7","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723759+0000","last_change":"2024-09-12T00:03:33.385373+0000","last_active":"2024-09-12T00:06:42.723759+0000","last_peered":"2024-09-12T00:06:42.723759+0000","last_clean":"2024-09-12T00:06:42.723759+0000","last_became_active":"2024-09-12T00:03:33.384559+0000","last_became_peered":"2024-09-12T00:03:33.384559+0000","last_unstale":"2024-09-12T00:06:42.723759+0000","last_undegraded":"2024-09-12T00:06:42.723759+0000","last_fullsized":"2024-09-12T00:06:42.723759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:55.924174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815429+0000","last_change":"2024-09-12T00:03:25.326677+0000","last_active":"2024-09-12T00:06:41.815429+0000","last_peered":"2024-09-12T00:06:41.815429+0000","last_clean":"2024-09-12T00:06:41.815429+0000","last_became_active":"2024-09-12T00:03:25.325840+0000","last_became_peered":"2024-09-12T00:03:25.325840+0000","last_unstale":"2024-09-12T00:06:41.815429+0000","last_undegraded":"2024-09-12T00:06:41.815429+0000","last_fullsized":"2024-09-12T00:06:41.815429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:07.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"116'44","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.909042+0000","last_change":"2024-09-12T00:03:23.616943+0000","last_active":"2024-09-12T00:07:11.909042+0000","last_peered":"2024-09-12T00:07:11.909042+0000","last_clean":"2024-09-12T00:07:11.909042+0000","last_became_active":"2024-09-12T00:03:23.616200+0000","last_became_peered":"2024-09-12T00:03:23.616200+0000","last_unstale":"2024-09-12T00:07:11.909042+0000","last_undegraded":"2024-09-12T00:07:11.909042+0000","last_fullsized":"2024-09-12T00:07:11.909042+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722289+0000","last_change":"2024-09-12T00:03:27.330506+0000","last_active":"2024-09-12T00:06:42.722289+0000","last_peered":"2024-09-12T00:06:42.722289+0000","last_clean":"2024-09-12T00:06:42.722289+0000","last_became_active":"2024-09-12T00:03:27.329830+0000","last_became_peered":"2024-09-12T00:03:27.329830+0000","last_unstale":"2024-09-12T00:06:42.722289+0000","last_undegraded":"2024-09-12T00:06:42.722289+0000","last_fullsized":"2024-09-12T00:06:42.722289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:03.446090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"116'28","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.795295+0000","last_change":"2024-09-12T00:03:29.343655+0000","last_active":"2024-09-12T00:07:11.795295+0000","last_peered":"2024-09-12T00:07:11.795295+0000","last_clean":"2024-09-12T00:07:11.795295+0000","last_became_active":"2024-09-12T00:03:29.343178+0000","last_became_peered":"2024-09-12T00:03:29.343178+0000","last_unstale":"2024-09-12T00:07:11.795295+0000","last_undegraded":"2024-09-12T00:07:11.795295+0000","last_fullsized":"2024-09-12T00:07:11.795295+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723516+0000","last_change":"2024-09-12T00:03:31.358077+0000","last_active":"2024-09-12T00:06:42.723516+0000","last_peered":"2024-09-12T00:06:42.723516+0000","last_clean":"2024-09-12T00:06:42.723516+0000","last_became_active":"2024-09-12T00:03:31.357272+0000","last_became_peered":"2024-09-12T00:03:31.357272+0000","last_unstale":"2024-09-12T00:06:42.723516+0000","last_undegraded":"2024-09-12T00:06:42.723516+0000","last_fullsized":"2024-09-12T00:06:42.723516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:37.991682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"76'4","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065822+0000","last_change":"2024-09-12T00:06:26.690241+0000","last_active":"2024-09-12T00:06:42.065822+0000","last_peered":"2024-09-12T00:06:42.065822+0000","last_clean":"2024-09-12T00:06:42.065822+0000","last_became_active":"2024-09-12T00:06:26.653908+0000","last_became_peered":"2024-09-12T00:06:26.653908+0000","last_unstale":"2024-09-12T00:06:42.065822+0000","last_undegraded":"2024-09-12T00:06:42.065822+0000","last_fullsized":"2024-09-12T00:06:42.065822+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:12.338436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"76'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721025+0000","last_change":"2024-09-12T00:06:32.433900+0000","last_active":"2024-09-12T00:06:42.721025+0000","last_peered":"2024-09-12T00:06:42.721025+0000","last_clean":"2024-09-12T00:06:42.721025+0000","last_became_active":"2024-09-12T00:06:26.675405+0000","last_became_peered":"2024-09-12T00:06:26.675405+0000","last_unstale":"2024-09-12T00:06:42.721025+0000","last_undegraded":"2024-09-12T00:06:42.721025+0000","last_fullsized":"2024-09-12T00:06:42.721025+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:53.098500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"116'42","reported_seq":106,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.913248+0000","last_change":"2024-09-12T00:06:32.375501+0000","last_active":"2024-09-12T00:07:11.913248+0000","last_peered":"2024-09-12T00:07:11.913248+0000","last_clean":"2024-09-12T00:07:11.913248+0000","last_became_active":"2024-09-12T00:06:26.663178+0000","last_became_peered":"2024-09-12T00:06:26.663178+0000","last_unstale":"2024-09-12T00:07:11.913248+0000","last_undegraded":"2024-09-12T00:07:11.913248+0000","last_fullsized":"2024-09-12T00:07:11.913248+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:27.738037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":138412032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065958+0000","last_change":"2024-09-12T00:03:27.342295+0000","last_active":"2024-09-12T00:06:42.065958+0000","last_peered":"2024-09-12T00:06:42.065958+0000","last_clean":"2024-09-12T00:06:42.065958+0000","last_became_active":"2024-09-12T00:03:27.341619+0000","last_became_peered":"2024-09-12T00:03:27.341619+0000","last_unstale":"2024-09-12T00:06:42.065958+0000","last_undegraded":"2024-09-12T00:06:42.065958+0000","last_fullsized":"2024-09-12T00:06:42.065958+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:00.908798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"116'26","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.495371+0000","last_change":"2024-09-12T00:03:29.336391+0000","last_active":"2024-09-12T00:07:11.495371+0000","last_peered":"2024-09-12T00:07:11.495371+0000","last_clean":"2024-09-12T00:07:11.495371+0000","last_became_active":"2024-09-12T00:03:29.335679+0000","last_became_peered":"2024-09-12T00:03:29.335679+0000","last_unstale":"2024-09-12T00:07:11.495371+0000","last_undegraded":"2024-09-12T00:07:11.495371+0000","last_fullsized":"2024-09-12T00:07:11.495371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:58.540539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"116'138","reported_seq":399,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:10.890541+0000","last_change":"2024-09-12T00:03:31.351170+0000","last_active":"2024-09-12T00:07:10.890541+0000","last_peered":"2024-09-12T00:07:10.890541+0000","last_clean":"2024-09-12T00:07:10.890541+0000","last_became_active":"2024-09-12T00:03:31.350264+0000","last_became_peered":"2024-09-12T00:03:31.350264+0000","last_unstale":"2024-09-12T00:07:10.890541+0000","last_undegraded":"2024-09-12T00:07:10.890541+0000","last_fullsized":"2024-09-12T00:07:10.890541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:51.368815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"59'3","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719548+0000","last_change":"2024-09-12T00:03:33.368236+0000","last_active":"2024-09-12T00:06:42.719548+0000","last_peered":"2024-09-12T00:06:42.719548+0000","last_clean":"2024-09-12T00:06:42.719548+0000","last_became_active":"2024-09-12T00:03:33.367424+0000","last_became_peered":"2024-09-12T00:03:33.367424+0000","last_unstale":"2024-09-12T00:06:42.719548+0000","last_undegraded":"2024-09-12T00:06:42.719548+0000","last_fullsized":"2024-09-12T00:06:42.719548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"76'6","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813109+0000","last_change":"2024-09-12T00:06:28.869705+0000","last_active":"2024-09-12T00:06:41.813109+0000","last_peered":"2024-09-12T00:06:41.813109+0000","last_clean":"2024-09-12T00:06:41.813109+0000","last_became_active":"2024-09-12T00:06:26.671547+0000","last_became_peered":"2024-09-12T00:06:26.671547+0000","last_unstale":"2024-09-12T00:06:41.813109+0000","last_undegraded":"2024-09-12T00:06:41.813109+0000","last_fullsized":"2024-09-12T00:06:41.813109+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:55.946290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"116'44","reported_seq":109,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.899795+0000","last_change":"2024-09-12T00:06:27.817806+0000","last_active":"2024-09-12T00:07:11.899795+0000","last_peered":"2024-09-12T00:07:11.899795+0000","last_clean":"2024-09-12T00:07:11.899795+0000","last_became_active":"2024-09-12T00:06:26.654104+0000","last_became_peered":"2024-09-12T00:06:26.654104+0000","last_unstale":"2024-09-12T00:07:11.899795+0000","last_undegraded":"2024-09-12T00:07:11.899795+0000","last_fullsized":"2024-09-12T00:07:11.899795+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:30.461829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":372,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:10.852795+0000","last_change":"2024-09-12T00:03:27.331569+0000","last_active":"2024-09-12T00:07:10.852795+0000","last_peered":"2024-09-12T00:07:10.852795+0000","last_clean":"2024-09-12T00:07:10.852795+0000","last_became_active":"2024-09-12T00:03:27.330909+0000","last_became_peered":"2024-09-12T00:03:27.330909+0000","last_unstale":"2024-09-12T00:07:10.852795+0000","last_undegraded":"2024-09-12T00:07:10.852795+0000","last_fullsized":"2024-09-12T00:07:10.852795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"59'11","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720583+0000","last_change":"2024-09-12T00:03:29.338880+0000","last_active":"2024-09-12T00:06:42.720583+0000","last_peered":"2024-09-12T00:06:42.720583+0000","last_clean":"2024-09-12T00:06:42.720583+0000","last_became_active":"2024-09-12T00:03:29.338110+0000","last_became_peered":"2024-09-12T00:03:29.338110+0000","last_unstale":"2024-09-12T00:06:42.720583+0000","last_undegraded":"2024-09-12T00:06:42.720583+0000","last_fullsized":"2024-09-12T00:06:42.720583+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.054460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"116'138","reported_seq":405,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:10.892890+0000","last_change":"2024-09-12T00:03:31.339117+0000","last_active":"2024-09-12T00:07:10.892890+0000","last_peered":"2024-09-12T00:07:10.892890+0000","last_clean":"2024-09-12T00:07:10.892890+0000","last_became_active":"2024-09-12T00:03:31.338426+0000","last_became_peered":"2024-09-12T00:03:31.338426+0000","last_unstale":"2024-09-12T00:07:10.892890+0000","last_undegraded":"2024-09-12T00:07:10.892890+0000","last_fullsized":"2024-09-12T00:07:10.892890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:19.304169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811106+0000","last_change":"2024-09-12T00:03:33.385051+0000","last_active":"2024-09-12T00:06:41.811106+0000","last_peered":"2024-09-12T00:06:41.811106+0000","last_clean":"2024-09-12T00:06:41.811106+0000","last_became_active":"2024-09-12T00:03:33.380088+0000","last_became_peered":"2024-09-12T00:03:33.380088+0000","last_unstale":"2024-09-12T00:06:41.811106+0000","last_undegraded":"2024-09-12T00:06:41.811106+0000","last_fullsized":"2024-09-12T00:06:41.811106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:02.972871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.724550+0000","last_change":"2024-09-12T00:03:25.336113+0000","last_active":"2024-09-12T00:06:42.724550+0000","last_peered":"2024-09-12T00:06:42.724550+0000","last_clean":"2024-09-12T00:06:42.724550+0000","last_became_active":"2024-09-12T00:03:25.335449+0000","last_became_peered":"2024-09-12T00:03:25.335449+0000","last_unstale":"2024-09-12T00:06:42.724550+0000","last_undegraded":"2024-09-12T00:06:42.724550+0000","last_fullsized":"2024-09-12T00:06:42.724550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:34.277614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"116'48","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.912791+0000","last_change":"2024-09-12T00:03:23.619285+0000","last_active":"2024-09-12T00:07:11.912791+0000","last_peered":"2024-09-12T00:07:11.912791+0000","last_clean":"2024-09-12T00:07:11.912791+0000","last_became_active":"2024-09-12T00:03:23.614187+0000","last_became_peered":"2024-09-12T00:03:23.614187+0000","last_unstale":"2024-09-12T00:07:11.912791+0000","last_undegraded":"2024-09-12T00:07:11.912791+0000","last_fullsized":"2024-09-12T00:07:11.912791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720307+0000","last_change":"2024-09-12T00:06:26.673924+0000","last_active":"2024-09-12T00:06:42.720307+0000","last_peered":"2024-09-12T00:06:42.720307+0000","last_clean":"2024-09-12T00:06:42.720307+0000","last_became_active":"2024-09-12T00:06:26.670945+0000","last_became_peered":"2024-09-12T00:06:26.670945+0000","last_unstale":"2024-09-12T00:06:42.720307+0000","last_undegraded":"2024-09-12T00:06:42.720307+0000","last_fullsized":"2024-09-12T00:06:42.720307+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:56.956200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"116'28","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.982245+0000","last_change":"2024-09-12T00:03:29.345719+0000","last_active":"2024-09-12T00:07:11.982245+0000","last_peered":"2024-09-12T00:07:11.982245+0000","last_clean":"2024-09-12T00:07:11.982245+0000","last_became_active":"2024-09-12T00:03:29.345243+0000","last_became_peered":"2024-09-12T00:03:29.345243+0000","last_unstale":"2024-09-12T00:07:11.982245+0000","last_undegraded":"2024-09-12T00:07:11.982245+0000","last_fullsized":"2024-09-12T00:07:11.982245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:41.153263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812258+0000","last_change":"2024-09-12T00:03:31.360630+0000","last_active":"2024-09-12T00:06:41.812258+0000","last_peered":"2024-09-12T00:06:41.812258+0000","last_clean":"2024-09-12T00:06:41.812258+0000","last_became_active":"2024-09-12T00:03:31.359763+0000","last_became_peered":"2024-09-12T00:03:31.359763+0000","last_unstale":"2024-09-12T00:06:41.812258+0000","last_undegraded":"2024-09-12T00:06:41.812258+0000","last_fullsized":"2024-09-12T00:06:41.812258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"84'6","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719339+0000","last_change":"2024-09-12T00:03:33.372178+0000","last_active":"2024-09-12T00:06:42.719339+0000","last_peered":"2024-09-12T00:06:42.719339+0000","last_clean":"2024-09-12T00:06:42.719339+0000","last_became_active":"2024-09-12T00:03:33.370562+0000","last_became_peered":"2024-09-12T00:03:33.370562+0000","last_unstale":"2024-09-12T00:06:42.719339+0000","last_undegraded":"2024-09-12T00:06:42.719339+0000","last_fullsized":"2024-09-12T00:06:42.719339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:31.888153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'10","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720452+0000","last_change":"2024-09-12T00:06:32.425494+0000","last_active":"2024-09-12T00:06:42.720452+0000","last_peered":"2024-09-12T00:06:42.720452+0000","last_clean":"2024-09-12T00:06:42.720452+0000","last_became_active":"2024-09-12T00:06:26.674937+0000","last_became_peered":"2024-09-12T00:06:26.674937+0000","last_unstale":"2024-09-12T00:06:42.720452+0000","last_undegraded":"2024-09-12T00:06:42.720452+0000","last_fullsized":"2024-09-12T00:06:42.720452+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:09.992203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":301,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499167+0000","last_change":"2024-09-12T00:03:11.770141+0000","last_active":"2024-09-12T00:06:42.499167+0000","last_peered":"2024-09-12T00:06:42.499167+0000","last_clean":"2024-09-12T00:06:42.499167+0000","last_became_active":"2024-09-12T00:03:11.767988+0000","last_became_peered":"2024-09-12T00:03:11.767988+0000","last_unstale":"2024-09-12T00:06:42.499167+0000","last_undegraded":"2024-09-12T00:06:42.499167+0000","last_fullsized":"2024-09-12T00:06:42.499167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:10.462069+0000","last_clean_scrub_stamp":"2024-09-12T00:03:10.462069+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:26.289955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717386+0000","last_change":"2024-09-12T00:06:28.888645+0000","last_active":"2024-09-12T00:06:42.717386+0000","last_peered":"2024-09-12T00:06:42.717386+0000","last_clean":"2024-09-12T00:06:42.717386+0000","last_became_active":"2024-09-12T00:06:26.671587+0000","last_became_peered":"2024-09-12T00:06:26.671587+0000","last_unstale":"2024-09-12T00:06:42.717386+0000","last_undegraded":"2024-09-12T00:06:42.717386+0000","last_fullsized":"2024-09-12T00:06:42.717386+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:03.325846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"116'48","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.895951+0000","last_change":"2024-09-12T00:03:23.621849+0000","last_active":"2024-09-12T00:07:11.895951+0000","last_peered":"2024-09-12T00:07:11.895951+0000","last_clean":"2024-09-12T00:07:11.895951+0000","last_became_active":"2024-09-12T00:03:23.621146+0000","last_became_peered":"2024-09-12T00:03:23.621146+0000","last_unstale":"2024-09-12T00:07:11.895951+0000","last_undegraded":"2024-09-12T00:07:11.895951+0000","last_fullsized":"2024-09-12T00:07:11.895951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:38.426691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809414+0000","last_change":"2024-09-12T00:03:27.316175+0000","last_active":"2024-09-12T00:06:41.809414+0000","last_peered":"2024-09-12T00:06:41.809414+0000","last_clean":"2024-09-12T00:06:41.809414+0000","last_became_active":"2024-09-12T00:03:27.315502+0000","last_became_peered":"2024-09-12T00:03:27.315502+0000","last_unstale":"2024-09-12T00:06:41.809414+0000","last_undegraded":"2024-09-12T00:06:41.809414+0000","last_fullsized":"2024-09-12T00:06:41.809414+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:21.448686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"116'53","reported_seq":76,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.970073+0000","last_change":"2024-09-12T00:06:28.900645+0000","last_active":"2024-09-12T00:07:11.970073+0000","last_peered":"2024-09-12T00:07:11.970073+0000","last_clean":"2024-09-12T00:07:11.970073+0000","last_became_active":"2024-09-12T00:06:26.667623+0000","last_became_peered":"2024-09-12T00:06:26.667623+0000","last_unstale":"2024-09-12T00:07:11.970073+0000","last_undegraded":"2024-09-12T00:07:11.970073+0000","last_fullsized":"2024-09-12T00:07:11.970073+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:36.584753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":56,"num_read_kb":44,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066468+0000","last_change":"2024-09-12T00:03:31.361408+0000","last_active":"2024-09-12T00:06:42.066468+0000","last_peered":"2024-09-12T00:06:42.066468+0000","last_clean":"2024-09-12T00:06:42.066468+0000","last_became_active":"2024-09-12T00:03:31.360462+0000","last_became_peered":"2024-09-12T00:03:31.360462+0000","last_unstale":"2024-09-12T00:06:42.066468+0000","last_undegraded":"2024-09-12T00:06:42.066468+0000","last_fullsized":"2024-09-12T00:06:42.066468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:58.407571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"59'4","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812851+0000","last_change":"2024-09-12T00:03:33.388253+0000","last_active":"2024-09-12T00:06:41.812851+0000","last_peered":"2024-09-12T00:06:41.812851+0000","last_clean":"2024-09-12T00:06:41.812851+0000","last_became_active":"2024-09-12T00:03:33.387457+0000","last_became_peered":"2024-09-12T00:03:33.387457+0000","last_unstale":"2024-09-12T00:06:41.812851+0000","last_undegraded":"2024-09-12T00:06:41.812851+0000","last_fullsized":"2024-09-12T00:06:41.812851+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:46.021740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066818+0000","last_change":"2024-09-12T00:03:25.357970+0000","last_active":"2024-09-12T00:06:42.066818+0000","last_peered":"2024-09-12T00:06:42.066818+0000","last_clean":"2024-09-12T00:06:42.066818+0000","last_became_active":"2024-09-12T00:03:25.355306+0000","last_became_peered":"2024-09-12T00:03:25.355306+0000","last_unstale":"2024-09-12T00:06:42.066818+0000","last_undegraded":"2024-09-12T00:06:42.066818+0000","last_fullsized":"2024-09-12T00:06:42.066818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:17.090028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717548+0000","last_change":"2024-09-12T00:06:26.654149+0000","last_active":"2024-09-12T00:06:42.717548+0000","last_peered":"2024-09-12T00:06:42.717548+0000","last_clean":"2024-09-12T00:06:42.717548+0000","last_became_active":"2024-09-12T00:06:26.653574+0000","last_became_peered":"2024-09-12T00:06:26.653574+0000","last_unstale":"2024-09-12T00:06:42.717548+0000","last_undegraded":"2024-09-12T00:06:42.717548+0000","last_fullsized":"2024-09-12T00:06:42.717548+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:55.656413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"116'54","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.720544+0000","last_change":"2024-09-12T00:03:23.622111+0000","last_active":"2024-09-12T00:07:11.720544+0000","last_peered":"2024-09-12T00:07:11.720544+0000","last_clean":"2024-09-12T00:07:11.720544+0000","last_became_active":"2024-09-12T00:03:23.621358+0000","last_became_peered":"2024-09-12T00:03:23.621358+0000","last_unstale":"2024-09-12T00:07:11.720544+0000","last_undegraded":"2024-09-12T00:07:11.720544+0000","last_fullsized":"2024-09-12T00:07:11.720544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:02.202230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":62,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722205+0000","last_change":"2024-09-12T00:06:26.659401+0000","last_active":"2024-09-12T00:06:42.722205+0000","last_peered":"2024-09-12T00:06:42.722205+0000","last_clean":"2024-09-12T00:06:42.722205+0000","last_became_active":"2024-09-12T00:06:26.657376+0000","last_became_peered":"2024-09-12T00:06:26.657376+0000","last_unstale":"2024-09-12T00:06:42.722205+0000","last_undegraded":"2024-09-12T00:06:42.722205+0000","last_fullsized":"2024-09-12T00:06:42.722205+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:27.337831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"116'153","reported_seq":454,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.989582+0000","last_change":"2024-09-12T00:03:29.346819+0000","last_active":"2024-09-12T00:07:11.989582+0000","last_peered":"2024-09-12T00:07:11.989582+0000","last_clean":"2024-09-12T00:07:11.989582+0000","last_became_active":"2024-09-12T00:03:29.346101+0000","last_became_peered":"2024-09-12T00:03:29.346101+0000","last_unstale":"2024-09-12T00:07:11.989582+0000","last_undegraded":"2024-09-12T00:07:11.989582+0000","last_fullsized":"2024-09-12T00:07:11.989582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:27.268327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":204,"num_read_kb":188,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721121+0000","last_change":"2024-09-12T00:06:26.679841+0000","last_active":"2024-09-12T00:06:42.721121+0000","last_peered":"2024-09-12T00:06:42.721121+0000","last_clean":"2024-09-12T00:06:42.721121+0000","last_became_active":"2024-09-12T00:06:26.675966+0000","last_became_peered":"2024-09-12T00:06:26.675966+0000","last_unstale":"2024-09-12T00:06:42.721121+0000","last_undegraded":"2024-09-12T00:06:42.721121+0000","last_fullsized":"2024-09-12T00:06:42.721121+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:39.439184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064787+0000","last_change":"2024-09-12T00:03:33.386144+0000","last_active":"2024-09-12T00:06:42.064787+0000","last_peered":"2024-09-12T00:06:42.064787+0000","last_clean":"2024-09-12T00:06:42.064787+0000","last_became_active":"2024-09-12T00:03:33.384951+0000","last_became_peered":"2024-09-12T00:03:33.384951+0000","last_unstale":"2024-09-12T00:06:42.064787+0000","last_undegraded":"2024-09-12T00:06:42.064787+0000","last_fullsized":"2024-09-12T00:06:42.064787+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:49.807501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"59'2","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720659+0000","last_change":"2024-09-12T00:03:25.332801+0000","last_active":"2024-09-12T00:06:42.720659+0000","last_peered":"2024-09-12T00:06:42.720659+0000","last_clean":"2024-09-12T00:06:42.720659+0000","last_became_active":"2024-09-12T00:03:25.331652+0000","last_became_peered":"2024-09-12T00:03:25.331652+0000","last_unstale":"2024-09-12T00:06:42.720659+0000","last_undegraded":"2024-09-12T00:06:42.720659+0000","last_fullsized":"2024-09-12T00:06:42.720659+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718983+0000","last_change":"2024-09-12T00:03:18.892423+0000","last_active":"2024-09-12T00:06:42.718983+0000","last_peered":"2024-09-12T00:06:42.718983+0000","last_clean":"2024-09-12T00:06:42.718983+0000","last_became_active":"2024-09-12T00:03:16.559698+0000","last_became_peered":"2024-09-12T00:03:16.559698+0000","last_unstale":"2024-09-12T00:06:42.718983+0000","last_undegraded":"2024-09-12T00:06:42.718983+0000","last_fullsized":"2024-09-12T00:06:42.718983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:21.453461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082440599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"116'44","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.866565+0000","last_change":"2024-09-12T00:03:23.633606+0000","last_active":"2024-09-12T00:07:11.866565+0000","last_peered":"2024-09-12T00:07:11.866565+0000","last_clean":"2024-09-12T00:07:11.866565+0000","last_became_active":"2024-09-12T00:03:23.632795+0000","last_became_peered":"2024-09-12T00:03:23.632795+0000","last_unstale":"2024-09-12T00:07:11.866565+0000","last_undegraded":"2024-09-12T00:07:11.866565+0000","last_fullsized":"2024-09-12T00:07:11.866565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:08.214455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723278+0000","last_change":"2024-09-12T00:03:27.326932+0000","last_active":"2024-09-12T00:06:42.723278+0000","last_peered":"2024-09-12T00:06:42.723278+0000","last_clean":"2024-09-12T00:06:42.723278+0000","last_became_active":"2024-09-12T00:03:27.326173+0000","last_became_peered":"2024-09-12T00:03:27.326173+0000","last_unstale":"2024-09-12T00:06:42.723278+0000","last_undegraded":"2024-09-12T00:06:42.723278+0000","last_fullsized":"2024-09-12T00:06:42.723278+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:12.286539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"116'17","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.585643+0000","last_change":"2024-09-12T00:03:29.338829+0000","last_active":"2024-09-12T00:06:42.585643+0000","last_peered":"2024-09-12T00:06:42.585643+0000","last_clean":"2024-09-12T00:06:42.585643+0000","last_became_active":"2024-09-12T00:03:29.337364+0000","last_became_peered":"2024-09-12T00:03:29.337364+0000","last_unstale":"2024-09-12T00:06:42.585643+0000","last_undegraded":"2024-09-12T00:06:42.585643+0000","last_fullsized":"2024-09-12T00:06:42.585643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:01.584359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812645+0000","last_change":"2024-09-12T00:06:26.655001+0000","last_active":"2024-09-12T00:06:41.812645+0000","last_peered":"2024-09-12T00:06:41.812645+0000","last_clean":"2024-09-12T00:06:41.812645+0000","last_became_active":"2024-09-12T00:06:26.654068+0000","last_became_peered":"2024-09-12T00:06:26.654068+0000","last_unstale":"2024-09-12T00:06:41.812645+0000","last_undegraded":"2024-09-12T00:06:41.812645+0000","last_fullsized":"2024-09-12T00:06:41.812645+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:50.133218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810544+0000","last_change":"2024-09-12T00:03:33.354171+0000","last_active":"2024-09-12T00:06:41.810544+0000","last_peered":"2024-09-12T00:06:41.810544+0000","last_clean":"2024-09-12T00:06:41.810544+0000","last_became_active":"2024-09-12T00:03:33.353460+0000","last_became_peered":"2024-09-12T00:03:33.353460+0000","last_unstale":"2024-09-12T00:06:41.810544+0000","last_undegraded":"2024-09-12T00:06:41.810544+0000","last_fullsized":"2024-09-12T00:06:41.810544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:34.356970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"84'8","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721257+0000","last_change":"2024-09-12T00:03:25.336320+0000","last_active":"2024-09-12T00:06:42.721257+0000","last_peered":"2024-09-12T00:06:42.721257+0000","last_clean":"2024-09-12T00:06:42.721257+0000","last_became_active":"2024-09-12T00:03:25.333449+0000","last_became_peered":"2024-09-12T00:03:25.333449+0000","last_unstale":"2024-09-12T00:06:42.721257+0000","last_undegraded":"2024-09-12T00:06:42.721257+0000","last_fullsized":"2024-09-12T00:06:42.721257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722390+0000","last_change":"2024-09-12T00:06:32.408232+0000","last_active":"2024-09-12T00:06:42.722390+0000","last_peered":"2024-09-12T00:06:42.722390+0000","last_clean":"2024-09-12T00:06:42.722390+0000","last_became_active":"2024-09-12T00:06:26.677047+0000","last_became_peered":"2024-09-12T00:06:26.677047+0000","last_unstale":"2024-09-12T00:06:42.722390+0000","last_undegraded":"2024-09-12T00:06:42.722390+0000","last_fullsized":"2024-09-12T00:06:42.722390+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:52.555478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"116'42","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.890572+0000","last_change":"2024-09-12T00:03:23.611064+0000","last_active":"2024-09-12T00:07:11.890572+0000","last_peered":"2024-09-12T00:07:11.890572+0000","last_clean":"2024-09-12T00:07:11.890572+0000","last_became_active":"2024-09-12T00:03:23.610612+0000","last_became_peered":"2024-09-12T00:03:23.610612+0000","last_unstale":"2024-09-12T00:07:11.890572+0000","last_undegraded":"2024-09-12T00:07:11.890572+0000","last_fullsized":"2024-09-12T00:07:11.890572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:04.201688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722466+0000","last_change":"2024-09-12T00:03:27.339197+0000","last_active":"2024-09-12T00:06:42.722466+0000","last_peered":"2024-09-12T00:06:42.722466+0000","last_clean":"2024-09-12T00:06:42.722466+0000","last_became_active":"2024-09-12T00:03:27.338508+0000","last_became_peered":"2024-09-12T00:03:27.338508+0000","last_unstale":"2024-09-12T00:06:42.722466+0000","last_undegraded":"2024-09-12T00:06:42.722466+0000","last_fullsized":"2024-09-12T00:06:42.722466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:08.306289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066551+0000","last_change":"2024-09-12T00:06:28.890041+0000","last_active":"2024-09-12T00:06:42.066551+0000","last_peered":"2024-09-12T00:06:42.066551+0000","last_clean":"2024-09-12T00:06:42.066551+0000","last_became_active":"2024-09-12T00:06:26.682354+0000","last_became_peered":"2024-09-12T00:06:26.682354+0000","last_unstale":"2024-09-12T00:06:42.066551+0000","last_undegraded":"2024-09-12T00:06:42.066551+0000","last_fullsized":"2024-09-12T00:06:42.066551+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:42.484131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722102+0000","last_change":"2024-09-12T00:06:26.675142+0000","last_active":"2024-09-12T00:06:42.722102+0000","last_peered":"2024-09-12T00:06:42.722102+0000","last_clean":"2024-09-12T00:06:42.722102+0000","last_became_active":"2024-09-12T00:06:26.669787+0000","last_became_peered":"2024-09-12T00:06:26.669787+0000","last_unstale":"2024-09-12T00:06:42.722102+0000","last_undegraded":"2024-09-12T00:06:42.722102+0000","last_fullsized":"2024-09-12T00:06:42.722102+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:34.635508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"63'7","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500245+0000","last_change":"2024-09-12T00:03:33.367035+0000","last_active":"2024-09-12T00:06:42.500245+0000","last_peered":"2024-09-12T00:06:42.500245+0000","last_clean":"2024-09-12T00:06:42.500245+0000","last_became_active":"2024-09-12T00:03:33.366311+0000","last_became_peered":"2024-09-12T00:03:33.366311+0000","last_unstale":"2024-09-12T00:06:42.500245+0000","last_undegraded":"2024-09-12T00:06:42.500245+0000","last_fullsized":"2024-09-12T00:06:42.500245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"96'8","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722537+0000","last_change":"2024-09-12T00:06:28.313486+0000","last_active":"2024-09-12T00:06:42.722537+0000","last_peered":"2024-09-12T00:06:42.722537+0000","last_clean":"2024-09-12T00:06:42.722537+0000","last_became_active":"2024-09-12T00:06:26.675442+0000","last_became_peered":"2024-09-12T00:06:26.675442+0000","last_unstale":"2024-09-12T00:06:42.722537+0000","last_undegraded":"2024-09-12T00:06:42.722537+0000","last_fullsized":"2024-09-12T00:06:42.722537+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:37.245286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"116'38","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.903570+0000","last_change":"2024-09-12T00:03:23.619024+0000","last_active":"2024-09-12T00:07:11.903570+0000","last_peered":"2024-09-12T00:07:11.903570+0000","last_clean":"2024-09-12T00:07:11.903570+0000","last_became_active":"2024-09-12T00:03:23.618716+0000","last_became_peered":"2024-09-12T00:03:23.618716+0000","last_unstale":"2024-09-12T00:07:11.903570+0000","last_undegraded":"2024-09-12T00:07:11.903570+0000","last_fullsized":"2024-09-12T00:07:11.903570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067307+0000","last_change":"2024-09-12T00:03:18.562010+0000","last_active":"2024-09-12T00:06:42.067307+0000","last_peered":"2024-09-12T00:06:42.067307+0000","last_clean":"2024-09-12T00:06:42.067307+0000","last_became_active":"2024-09-12T00:03:16.561218+0000","last_became_peered":"2024-09-12T00:03:16.561218+0000","last_unstale":"2024-09-12T00:06:42.067307+0000","last_undegraded":"2024-09-12T00:06:42.067307+0000","last_fullsized":"2024-09-12T00:06:42.067307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:43.089686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084170299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811828+0000","last_change":"2024-09-12T00:03:27.341079+0000","last_active":"2024-09-12T00:06:41.811828+0000","last_peered":"2024-09-12T00:06:41.811828+0000","last_clean":"2024-09-12T00:06:41.811828+0000","last_became_active":"2024-09-12T00:03:27.340391+0000","last_became_peered":"2024-09-12T00:03:27.340391+0000","last_unstale":"2024-09-12T00:06:41.811828+0000","last_undegraded":"2024-09-12T00:06:41.811828+0000","last_fullsized":"2024-09-12T00:06:41.811828+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:10.048469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"116'57","reported_seq":272,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.963158+0000","last_change":"2024-09-12T00:03:29.346823+0000","last_active":"2024-09-12T00:07:11.963158+0000","last_peered":"2024-09-12T00:07:11.963158+0000","last_clean":"2024-09-12T00:07:11.963158+0000","last_became_active":"2024-09-12T00:03:29.346066+0000","last_became_peered":"2024-09-12T00:03:29.346066+0000","last_unstale":"2024-09-12T00:07:11.963158+0000","last_undegraded":"2024-09-12T00:07:11.963158+0000","last_fullsized":"2024-09-12T00:07:11.963158+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:12.080794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":76,"num_read_kb":301,"num_write":46,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810366+0000","last_change":"2024-09-12T00:03:31.348574+0000","last_active":"2024-09-12T00:06:41.810366+0000","last_peered":"2024-09-12T00:06:41.810366+0000","last_clean":"2024-09-12T00:06:41.810366+0000","last_became_active":"2024-09-12T00:03:31.346511+0000","last_became_peered":"2024-09-12T00:03:31.346511+0000","last_unstale":"2024-09-12T00:06:41.810366+0000","last_undegraded":"2024-09-12T00:06:41.810366+0000","last_fullsized":"2024-09-12T00:06:41.810366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:14.061486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"59'7","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066233+0000","last_change":"2024-09-12T00:03:33.385232+0000","last_active":"2024-09-12T00:06:42.066233+0000","last_peered":"2024-09-12T00:06:42.066233+0000","last_clean":"2024-09-12T00:06:42.066233+0000","last_became_active":"2024-09-12T00:03:33.384457+0000","last_became_peered":"2024-09-12T00:03:33.384457+0000","last_unstale":"2024-09-12T00:06:42.066233+0000","last_undegraded":"2024-09-12T00:06:42.066233+0000","last_fullsized":"2024-09-12T00:06:42.066233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:34.615256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"76'4","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721962+0000","last_change":"2024-09-12T00:03:25.334767+0000","last_active":"2024-09-12T00:06:42.721962+0000","last_peered":"2024-09-12T00:06:42.721962+0000","last_clean":"2024-09-12T00:06:42.721962+0000","last_became_active":"2024-09-12T00:03:25.332814+0000","last_became_peered":"2024-09-12T00:03:25.332814+0000","last_unstale":"2024-09-12T00:06:42.721962+0000","last_undegraded":"2024-09-12T00:06:42.721962+0000","last_fullsized":"2024-09-12T00:06:42.721962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"116'54","reported_seq":249,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.915962+0000","last_change":"2024-09-12T00:03:23.628752+0000","last_active":"2024-09-12T00:07:11.915962+0000","last_peered":"2024-09-12T00:07:11.915962+0000","last_clean":"2024-09-12T00:07:11.915962+0000","last_became_active":"2024-09-12T00:03:23.628128+0000","last_became_peered":"2024-09-12T00:03:23.628128+0000","last_unstale":"2024-09-12T00:07:11.915962+0000","last_undegraded":"2024-09-12T00:07:11.915962+0000","last_fullsized":"2024-09-12T00:07:11.915962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:59.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720543+0000","last_change":"2024-09-12T00:06:26.679199+0000","last_active":"2024-09-12T00:06:42.720543+0000","last_peered":"2024-09-12T00:06:42.720543+0000","last_clean":"2024-09-12T00:06:42.720543+0000","last_became_active":"2024-09-12T00:06:26.675309+0000","last_became_peered":"2024-09-12T00:06:26.675309+0000","last_unstale":"2024-09-12T00:06:42.720543+0000","last_undegraded":"2024-09-12T00:06:42.720543+0000","last_fullsized":"2024-09-12T00:06:42.720543+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:56.980194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814664+0000","last_change":"2024-09-12T00:03:27.316317+0000","last_active":"2024-09-12T00:06:41.814664+0000","last_peered":"2024-09-12T00:06:41.814664+0000","last_clean":"2024-09-12T00:06:41.814664+0000","last_became_active":"2024-09-12T00:03:27.315704+0000","last_became_peered":"2024-09-12T00:03:27.315704+0000","last_unstale":"2024-09-12T00:06:41.814664+0000","last_undegraded":"2024-09-12T00:06:41.814664+0000","last_fullsized":"2024-09-12T00:06:41.814664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:07.883485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'20","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720264+0000","last_change":"2024-09-12T00:06:26.708588+0000","last_active":"2024-09-12T00:06:42.720264+0000","last_peered":"2024-09-12T00:06:42.720264+0000","last_clean":"2024-09-12T00:06:42.720264+0000","last_became_active":"2024-09-12T00:06:26.661284+0000","last_became_peered":"2024-09-12T00:06:26.661284+0000","last_unstale":"2024-09-12T00:06:42.720264+0000","last_undegraded":"2024-09-12T00:06:42.720264+0000","last_fullsized":"2024-09-12T00:06:42.720264+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:19.418779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"116'138","reported_seq":357,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:10.882702+0000","last_change":"2024-09-12T00:03:31.357011+0000","last_active":"2024-09-12T00:07:10.882702+0000","last_peered":"2024-09-12T00:07:10.882702+0000","last_clean":"2024-09-12T00:07:10.882702+0000","last_became_active":"2024-09-12T00:03:31.356108+0000","last_became_peered":"2024-09-12T00:03:31.356108+0000","last_unstale":"2024-09-12T00:07:10.882702+0000","last_undegraded":"2024-09-12T00:07:10.882702+0000","last_fullsized":"2024-09-12T00:07:10.882702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"58'2","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723235+0000","last_change":"2024-09-12T00:03:33.372465+0000","last_active":"2024-09-12T00:06:42.723235+0000","last_peered":"2024-09-12T00:06:42.723235+0000","last_clean":"2024-09-12T00:06:42.723235+0000","last_became_active":"2024-09-12T00:03:33.371214+0000","last_became_peered":"2024-09-12T00:03:33.371214+0000","last_unstale":"2024-09-12T00:06:42.723235+0000","last_undegraded":"2024-09-12T00:06:42.723235+0000","last_fullsized":"2024-09-12T00:06:42.723235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:40.880933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"84'8","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810903+0000","last_change":"2024-09-12T00:03:25.332405+0000","last_active":"2024-09-12T00:06:41.810903+0000","last_peered":"2024-09-12T00:06:41.810903+0000","last_clean":"2024-09-12T00:06:41.810903+0000","last_became_active":"2024-09-12T00:03:25.331250+0000","last_became_peered":"2024-09-12T00:03:25.331250+0000","last_unstale":"2024-09-12T00:06:41.810903+0000","last_undegraded":"2024-09-12T00:06:41.810903+0000","last_fullsized":"2024-09-12T00:06:41.810903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"116'46","reported_seq":240,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.833478+0000","last_change":"2024-09-12T00:03:23.602222+0000","last_active":"2024-09-12T00:07:11.833478+0000","last_peered":"2024-09-12T00:07:11.833478+0000","last_clean":"2024-09-12T00:07:11.833478+0000","last_became_active":"2024-09-12T00:03:23.601481+0000","last_became_peered":"2024-09-12T00:03:23.601481+0000","last_unstale":"2024-09-12T00:07:11.833478+0000","last_undegraded":"2024-09-12T00:07:11.833478+0000","last_fullsized":"2024-09-12T00:07:11.833478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:56.636638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813711+0000","last_change":"2024-09-12T00:03:18.716648+0000","last_active":"2024-09-12T00:06:41.813711+0000","last_peered":"2024-09-12T00:06:41.813711+0000","last_clean":"2024-09-12T00:06:41.813711+0000","last_became_active":"2024-09-12T00:03:16.594609+0000","last_became_peered":"2024-09-12T00:03:16.594609+0000","last_unstale":"2024-09-12T00:06:41.813711+0000","last_undegraded":"2024-09-12T00:06:41.813711+0000","last_fullsized":"2024-09-12T00:06:41.813711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:34.635008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010254439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721880+0000","last_change":"2024-09-12T00:06:26.648329+0000","last_active":"2024-09-12T00:06:42.721880+0000","last_peered":"2024-09-12T00:06:42.721880+0000","last_clean":"2024-09-12T00:06:42.721880+0000","last_became_active":"2024-09-12T00:06:26.647055+0000","last_became_peered":"2024-09-12T00:06:26.647055+0000","last_unstale":"2024-09-12T00:06:42.721880+0000","last_undegraded":"2024-09-12T00:06:42.721880+0000","last_fullsized":"2024-09-12T00:06:42.721880+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:35.147693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"58'18","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720951+0000","last_change":"2024-09-12T00:06:30.110628+0000","last_active":"2024-09-12T00:06:42.720951+0000","last_peered":"2024-09-12T00:06:42.720951+0000","last_clean":"2024-09-12T00:06:42.720951+0000","last_became_active":"2024-09-12T00:06:26.662450+0000","last_became_peered":"2024-09-12T00:06:26.662450+0000","last_unstale":"2024-09-12T00:06:42.720951+0000","last_undegraded":"2024-09-12T00:06:42.720951+0000","last_fullsized":"2024-09-12T00:06:42.720951+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:10.820458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"116'138","reported_seq":354,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:10.893204+0000","last_change":"2024-09-12T00:03:31.361616+0000","last_active":"2024-09-12T00:07:10.893204+0000","last_peered":"2024-09-12T00:07:10.893204+0000","last_clean":"2024-09-12T00:07:10.893204+0000","last_became_active":"2024-09-12T00:03:31.360518+0000","last_became_peered":"2024-09-12T00:03:31.360518+0000","last_unstale":"2024-09-12T00:07:10.893204+0000","last_undegraded":"2024-09-12T00:07:10.893204+0000","last_fullsized":"2024-09-12T00:07:10.893204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:40.640537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065311+0000","last_change":"2024-09-12T00:03:33.378417+0000","last_active":"2024-09-12T00:06:42.065311+0000","last_peered":"2024-09-12T00:06:42.065311+0000","last_clean":"2024-09-12T00:06:42.065311+0000","last_became_active":"2024-09-12T00:03:33.377669+0000","last_became_peered":"2024-09-12T00:03:33.377669+0000","last_unstale":"2024-09-12T00:06:42.065311+0000","last_undegraded":"2024-09-12T00:06:42.065311+0000","last_fullsized":"2024-09-12T00:06:42.065311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:04.623906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811103+0000","last_change":"2024-09-12T00:06:26.714198+0000","last_active":"2024-09-12T00:06:41.811103+0000","last_peered":"2024-09-12T00:06:41.811103+0000","last_clean":"2024-09-12T00:06:41.811103+0000","last_became_active":"2024-09-12T00:06:26.662114+0000","last_became_peered":"2024-09-12T00:06:26.662114+0000","last_unstale":"2024-09-12T00:06:41.811103+0000","last_undegraded":"2024-09-12T00:06:41.811103+0000","last_fullsized":"2024-09-12T00:06:41.811103+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:41.029559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"116'46","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.746869+0000","last_change":"2024-09-12T00:03:23.616319+0000","last_active":"2024-09-12T00:07:11.746869+0000","last_peered":"2024-09-12T00:07:11.746869+0000","last_clean":"2024-09-12T00:07:11.746869+0000","last_became_active":"2024-09-12T00:03:23.615158+0000","last_became_peered":"2024-09-12T00:03:23.615158+0000","last_unstale":"2024-09-12T00:07:11.746869+0000","last_undegraded":"2024-09-12T00:07:11.746869+0000","last_fullsized":"2024-09-12T00:07:11.746869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:15.677228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":54,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719839+0000","last_change":"2024-09-12T00:06:26.680801+0000","last_active":"2024-09-12T00:06:42.719839+0000","last_peered":"2024-09-12T00:06:42.719839+0000","last_clean":"2024-09-12T00:06:42.719839+0000","last_became_active":"2024-09-12T00:06:26.677544+0000","last_became_peered":"2024-09-12T00:06:26.677544+0000","last_unstale":"2024-09-12T00:06:42.719839+0000","last_undegraded":"2024-09-12T00:06:42.719839+0000","last_fullsized":"2024-09-12T00:06:42.719839+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:15.518952+0000","last_clean_scrub_stamp":"2024-09-12T00:03:15.518952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:43.976666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810348+0000","last_change":"2024-09-12T00:03:27.337359+0000","last_active":"2024-09-12T00:06:41.810348+0000","last_peered":"2024-09-12T00:06:41.810348+0000","last_clean":"2024-09-12T00:06:41.810348+0000","last_became_active":"2024-09-12T00:03:27.336289+0000","last_became_peered":"2024-09-12T00:03:27.336289+0000","last_unstale":"2024-09-12T00:06:41.810348+0000","last_undegraded":"2024-09-12T00:06:41.810348+0000","last_fullsized":"2024-09-12T00:06:41.810348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:39.147272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"116'59","reported_seq":278,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.973364+0000","last_change":"2024-09-12T00:03:29.344621+0000","last_active":"2024-09-12T00:07:11.973364+0000","last_peered":"2024-09-12T00:07:11.973364+0000","last_clean":"2024-09-12T00:07:11.973364+0000","last_became_active":"2024-09-12T00:03:29.343779+0000","last_became_peered":"2024-09-12T00:03:29.343779+0000","last_unstale":"2024-09-12T00:07:11.973364+0000","last_undegraded":"2024-09-12T00:07:11.973364+0000","last_fullsized":"2024-09-12T00:07:11.973364+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:49.518432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811176+0000","last_change":"2024-09-12T00:03:31.335460+0000","last_active":"2024-09-12T00:06:41.811176+0000","last_peered":"2024-09-12T00:06:41.811176+0000","last_clean":"2024-09-12T00:06:41.811176+0000","last_became_active":"2024-09-12T00:03:31.334701+0000","last_became_peered":"2024-09-12T00:03:31.334701+0000","last_unstale":"2024-09-12T00:06:41.811176+0000","last_undegraded":"2024-09-12T00:06:41.811176+0000","last_fullsized":"2024-09-12T00:06:41.811176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:28.484366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"58'4","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812236+0000","last_change":"2024-09-12T00:03:33.386404+0000","last_active":"2024-09-12T00:06:41.812236+0000","last_peered":"2024-09-12T00:06:41.812236+0000","last_clean":"2024-09-12T00:06:41.812236+0000","last_became_active":"2024-09-12T00:03:33.385090+0000","last_became_peered":"2024-09-12T00:03:33.385090+0000","last_unstale":"2024-09-12T00:06:41.812236+0000","last_undegraded":"2024-09-12T00:06:41.812236+0000","last_fullsized":"2024-09-12T00:06:41.812236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"96'2","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813204+0000","last_change":"2024-09-12T00:03:33.361690+0000","last_active":"2024-09-12T00:06:41.813204+0000","last_peered":"2024-09-12T00:06:41.813204+0000","last_clean":"2024-09-12T00:06:41.813204+0000","last_became_active":"2024-09-12T00:03:33.360980+0000","last_became_peered":"2024-09-12T00:03:33.360980+0000","last_unstale":"2024-09-12T00:06:41.813204+0000","last_undegraded":"2024-09-12T00:06:41.813204+0000","last_fullsized":"2024-09-12T00:06:41.813204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:24.954577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"59'2","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813869+0000","last_change":"2024-09-12T00:06:28.274587+0000","last_active":"2024-09-12T00:06:41.813869+0000","last_peered":"2024-09-12T00:06:41.813869+0000","last_clean":"2024-09-12T00:06:41.813869+0000","last_became_active":"2024-09-12T00:06:26.664337+0000","last_became_peered":"2024-09-12T00:06:26.664337+0000","last_unstale":"2024-09-12T00:06:41.813869+0000","last_undegraded":"2024-09-12T00:06:41.813869+0000","last_fullsized":"2024-09-12T00:06:41.813869+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:00.552692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"116'60","reported_seq":133,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.948981+0000","last_change":"2024-09-12T00:06:30.093257+0000","last_active":"2024-09-12T00:07:11.948981+0000","last_peered":"2024-09-12T00:07:11.948981+0000","last_clean":"2024-09-12T00:07:11.948981+0000","last_became_active":"2024-09-12T00:06:26.671623+0000","last_became_peered":"2024-09-12T00:06:26.671623+0000","last_unstale":"2024-09-12T00:07:11.948981+0000","last_undegraded":"2024-09-12T00:07:11.948981+0000","last_fullsized":"2024-09-12T00:07:11.948981+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:02.454592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":201326592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"28'2","reported_seq":371,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:10.853248+0000","last_change":"2024-09-12T00:03:27.332281+0000","last_active":"2024-09-12T00:07:10.853248+0000","last_peered":"2024-09-12T00:07:10.853248+0000","last_clean":"2024-09-12T00:07:10.853248+0000","last_became_active":"2024-09-12T00:03:27.331527+0000","last_became_peered":"2024-09-12T00:03:27.331527+0000","last_unstale":"2024-09-12T00:07:10.853248+0000","last_undegraded":"2024-09-12T00:07:10.853248+0000","last_fullsized":"2024-09-12T00:07:10.853248+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":272,"num_read_kb":272,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"116'28","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.004590+0000","last_change":"2024-09-12T00:03:29.338655+0000","last_active":"2024-09-12T00:07:11.004590+0000","last_peered":"2024-09-12T00:07:11.004590+0000","last_clean":"2024-09-12T00:07:11.004590+0000","last_became_active":"2024-09-12T00:03:29.337905+0000","last_became_peered":"2024-09-12T00:03:29.337905+0000","last_unstale":"2024-09-12T00:07:11.004590+0000","last_undegraded":"2024-09-12T00:07:11.004590+0000","last_fullsized":"2024-09-12T00:07:11.004590+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718441+0000","last_change":"2024-09-12T00:03:31.351716+0000","last_active":"2024-09-12T00:06:42.718441+0000","last_peered":"2024-09-12T00:06:42.718441+0000","last_clean":"2024-09-12T00:06:42.718441+0000","last_became_active":"2024-09-12T00:03:31.350917+0000","last_became_peered":"2024-09-12T00:03:31.350917+0000","last_unstale":"2024-09-12T00:06:42.718441+0000","last_undegraded":"2024-09-12T00:06:42.718441+0000","last_fullsized":"2024-09-12T00:06:42.718441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:45.880820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722942+0000","last_change":"2024-09-12T00:03:33.374233+0000","last_active":"2024-09-12T00:06:42.722942+0000","last_peered":"2024-09-12T00:06:42.722942+0000","last_clean":"2024-09-12T00:06:42.722942+0000","last_became_active":"2024-09-12T00:03:33.373466+0000","last_became_peered":"2024-09-12T00:03:33.373466+0000","last_unstale":"2024-09-12T00:06:42.722942+0000","last_undegraded":"2024-09-12T00:06:42.722942+0000","last_fullsized":"2024-09-12T00:06:42.722942+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:55.598892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"59'2","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811077+0000","last_change":"2024-09-12T00:06:28.295394+0000","last_active":"2024-09-12T00:06:41.811077+0000","last_peered":"2024-09-12T00:06:41.811077+0000","last_clean":"2024-09-12T00:06:41.811077+0000","last_became_active":"2024-09-12T00:06:26.664003+0000","last_became_peered":"2024-09-12T00:06:26.664003+0000","last_unstale":"2024-09-12T00:06:41.811077+0000","last_undegraded":"2024-09-12T00:06:41.811077+0000","last_fullsized":"2024-09-12T00:06:41.811077+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:22.616662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"116'46","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.915211+0000","last_change":"2024-09-12T00:03:23.613274+0000","last_active":"2024-09-12T00:07:11.915211+0000","last_peered":"2024-09-12T00:07:11.915211+0000","last_clean":"2024-09-12T00:07:11.915211+0000","last_became_active":"2024-09-12T00:03:23.612941+0000","last_became_peered":"2024-09-12T00:03:23.612941+0000","last_unstale":"2024-09-12T00:07:11.915211+0000","last_undegraded":"2024-09-12T00:07:11.915211+0000","last_fullsized":"2024-09-12T00:07:11.915211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:56.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811543+0000","last_change":"2024-09-12T00:03:27.336144+0000","last_active":"2024-09-12T00:06:41.811543+0000","last_peered":"2024-09-12T00:06:41.811543+0000","last_clean":"2024-09-12T00:06:41.811543+0000","last_became_active":"2024-09-12T00:03:27.335372+0000","last_became_peered":"2024-09-12T00:03:27.335372+0000","last_unstale":"2024-09-12T00:06:41.811543+0000","last_undegraded":"2024-09-12T00:06:41.811543+0000","last_fullsized":"2024-09-12T00:06:41.811543+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:33.978665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"108'11","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809960+0000","last_change":"2024-09-12T00:03:29.332051+0000","last_active":"2024-09-12T00:06:41.809960+0000","last_peered":"2024-09-12T00:06:41.809960+0000","last_clean":"2024-09-12T00:06:41.809960+0000","last_became_active":"2024-09-12T00:03:29.331243+0000","last_became_peered":"2024-09-12T00:03:29.331243+0000","last_unstale":"2024-09-12T00:06:41.809960+0000","last_undegraded":"2024-09-12T00:06:41.809960+0000","last_fullsized":"2024-09-12T00:06:41.809960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:52.544770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810109+0000","last_change":"2024-09-12T00:03:31.347021+0000","last_active":"2024-09-12T00:06:41.810109+0000","last_peered":"2024-09-12T00:06:41.810109+0000","last_clean":"2024-09-12T00:06:41.810109+0000","last_became_active":"2024-09-12T00:03:31.344407+0000","last_became_peered":"2024-09-12T00:03:31.344407+0000","last_unstale":"2024-09-12T00:06:41.810109+0000","last_undegraded":"2024-09-12T00:06:41.810109+0000","last_fullsized":"2024-09-12T00:06:41.810109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:32.139742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"84'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719370+0000","last_change":"2024-09-12T00:03:33.370271+0000","last_active":"2024-09-12T00:06:42.719370+0000","last_peered":"2024-09-12T00:06:42.719370+0000","last_clean":"2024-09-12T00:06:42.719370+0000","last_became_active":"2024-09-12T00:03:33.369538+0000","last_became_peered":"2024-09-12T00:03:33.369538+0000","last_unstale":"2024-09-12T00:06:42.719370+0000","last_undegraded":"2024-09-12T00:06:42.719370+0000","last_fullsized":"2024-09-12T00:06:42.719370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"59'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810693+0000","last_change":"2024-09-12T00:03:25.341025+0000","last_active":"2024-09-12T00:06:41.810693+0000","last_peered":"2024-09-12T00:06:41.810693+0000","last_clean":"2024-09-12T00:06:41.810693+0000","last_became_active":"2024-09-12T00:03:25.340288+0000","last_became_peered":"2024-09-12T00:03:25.340288+0000","last_unstale":"2024-09-12T00:06:41.810693+0000","last_undegraded":"2024-09-12T00:06:41.810693+0000","last_fullsized":"2024-09-12T00:06:41.810693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"116'56","reported_seq":357,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.926559+0000","last_change":"2024-09-12T00:06:30.098997+0000","last_active":"2024-09-12T00:07:11.926559+0000","last_peered":"2024-09-12T00:07:11.926559+0000","last_clean":"2024-09-12T00:07:11.926559+0000","last_became_active":"2024-09-12T00:06:26.672172+0000","last_became_peered":"2024-09-12T00:06:26.672172+0000","last_unstale":"2024-09-12T00:07:11.926559+0000","last_undegraded":"2024-09-12T00:07:11.926559+0000","last_fullsized":"2024-09-12T00:07:11.926559+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:32.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":64,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810614+0000","last_change":"2024-09-12T00:03:27.329869+0000","last_active":"2024-09-12T00:06:41.810614+0000","last_peered":"2024-09-12T00:06:41.810614+0000","last_clean":"2024-09-12T00:06:41.810614+0000","last_became_active":"2024-09-12T00:03:27.329077+0000","last_became_peered":"2024-09-12T00:03:27.329077+0000","last_unstale":"2024-09-12T00:06:41.810614+0000","last_undegraded":"2024-09-12T00:06:41.810614+0000","last_fullsized":"2024-09-12T00:06:41.810614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"116'22","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.819640+0000","last_change":"2024-09-12T00:03:29.346878+0000","last_active":"2024-09-12T00:07:11.819640+0000","last_peered":"2024-09-12T00:07:11.819640+0000","last_clean":"2024-09-12T00:07:11.819640+0000","last_became_active":"2024-09-12T00:03:29.345990+0000","last_became_peered":"2024-09-12T00:03:29.345990+0000","last_unstale":"2024-09-12T00:07:11.819640+0000","last_undegraded":"2024-09-12T00:07:11.819640+0000","last_fullsized":"2024-09-12T00:07:11.819640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:06.398979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499961+0000","last_change":"2024-09-12T00:03:31.363658+0000","last_active":"2024-09-12T00:06:42.499961+0000","last_peered":"2024-09-12T00:06:42.499961+0000","last_clean":"2024-09-12T00:06:42.499961+0000","last_became_active":"2024-09-12T00:03:31.363080+0000","last_became_peered":"2024-09-12T00:03:31.363080+0000","last_unstale":"2024-09-12T00:06:42.499961+0000","last_undegraded":"2024-09-12T00:06:42.499961+0000","last_fullsized":"2024-09-12T00:06:42.499961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:05.901608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717550+0000","last_change":"2024-09-12T00:06:26.673691+0000","last_active":"2024-09-12T00:06:42.717550+0000","last_peered":"2024-09-12T00:06:42.717550+0000","last_clean":"2024-09-12T00:06:42.717550+0000","last_became_active":"2024-09-12T00:06:26.669877+0000","last_became_peered":"2024-09-12T00:06:26.669877+0000","last_unstale":"2024-09-12T00:06:42.717550+0000","last_undegraded":"2024-09-12T00:06:42.717550+0000","last_fullsized":"2024-09-12T00:06:42.717550+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:02.798560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"59'2","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718800+0000","last_change":"2024-09-12T00:06:26.687219+0000","last_active":"2024-09-12T00:06:42.718800+0000","last_peered":"2024-09-12T00:06:42.718800+0000","last_clean":"2024-09-12T00:06:42.718800+0000","last_became_active":"2024-09-12T00:06:26.655483+0000","last_became_peered":"2024-09-12T00:06:26.655483+0000","last_unstale":"2024-09-12T00:06:42.718800+0000","last_undegraded":"2024-09-12T00:06:42.718800+0000","last_fullsized":"2024-09-12T00:06:42.718800+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:21.199336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"116'44","reported_seq":321,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.712017+0000","last_change":"2024-09-12T00:06:27.905793+0000","last_active":"2024-09-12T00:07:11.712017+0000","last_peered":"2024-09-12T00:07:11.712017+0000","last_clean":"2024-09-12T00:07:11.712017+0000","last_became_active":"2024-09-12T00:06:26.664617+0000","last_became_peered":"2024-09-12T00:06:26.664617+0000","last_unstale":"2024-09-12T00:07:11.712017+0000","last_undegraded":"2024-09-12T00:07:11.712017+0000","last_fullsized":"2024-09-12T00:07:11.712017+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:23.455040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":142606336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717842+0000","last_change":"2024-09-12T00:06:26.663673+0000","last_active":"2024-09-12T00:06:42.717842+0000","last_peered":"2024-09-12T00:06:42.717842+0000","last_clean":"2024-09-12T00:06:42.717842+0000","last_became_active":"2024-09-12T00:06:26.663351+0000","last_became_peered":"2024-09-12T00:06:26.663351+0000","last_unstale":"2024-09-12T00:06:42.717842+0000","last_undegraded":"2024-09-12T00:06:42.717842+0000","last_fullsized":"2024-09-12T00:06:42.717842+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:58.342457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"116'22","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.808479+0000","last_change":"2024-09-12T00:03:29.346312+0000","last_active":"2024-09-12T00:07:11.808479+0000","last_peered":"2024-09-12T00:07:11.808479+0000","last_clean":"2024-09-12T00:07:11.808479+0000","last_became_active":"2024-09-12T00:03:29.345883+0000","last_became_peered":"2024-09-12T00:03:29.345883+0000","last_unstale":"2024-09-12T00:07:11.808479+0000","last_undegraded":"2024-09-12T00:07:11.808479+0000","last_fullsized":"2024-09-12T00:07:11.808479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:46.723370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719592+0000","last_change":"2024-09-12T00:03:31.358786+0000","last_active":"2024-09-12T00:06:42.719592+0000","last_peered":"2024-09-12T00:06:42.719592+0000","last_clean":"2024-09-12T00:06:42.719592+0000","last_became_active":"2024-09-12T00:03:31.358011+0000","last_became_peered":"2024-09-12T00:03:31.358011+0000","last_unstale":"2024-09-12T00:06:42.719592+0000","last_undegraded":"2024-09-12T00:06:42.719592+0000","last_fullsized":"2024-09-12T00:06:42.719592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:29.394163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"59'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720085+0000","last_change":"2024-09-12T00:06:28.364181+0000","last_active":"2024-09-12T00:06:42.720085+0000","last_peered":"2024-09-12T00:06:42.720085+0000","last_clean":"2024-09-12T00:06:42.720085+0000","last_became_active":"2024-09-12T00:06:26.667552+0000","last_became_peered":"2024-09-12T00:06:26.667552+0000","last_unstale":"2024-09-12T00:06:42.720085+0000","last_undegraded":"2024-09-12T00:06:42.720085+0000","last_fullsized":"2024-09-12T00:06:42.720085+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:19.435061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"116'46","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.915761+0000","last_change":"2024-09-12T00:03:23.627584+0000","last_active":"2024-09-12T00:07:11.915761+0000","last_peered":"2024-09-12T00:07:11.915761+0000","last_clean":"2024-09-12T00:07:11.915761+0000","last_became_active":"2024-09-12T00:03:23.626026+0000","last_became_peered":"2024-09-12T00:03:23.626026+0000","last_unstale":"2024-09-12T00:07:11.915761+0000","last_undegraded":"2024-09-12T00:07:11.915761+0000","last_fullsized":"2024-09-12T00:07:11.915761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:38.192583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720246+0000","last_change":"2024-09-12T00:06:26.671971+0000","last_active":"2024-09-12T00:06:42.720246+0000","last_peered":"2024-09-12T00:06:42.720246+0000","last_clean":"2024-09-12T00:06:42.720246+0000","last_became_active":"2024-09-12T00:06:26.671427+0000","last_became_peered":"2024-09-12T00:06:26.671427+0000","last_unstale":"2024-09-12T00:06:42.720246+0000","last_undegraded":"2024-09-12T00:06:42.720246+0000","last_fullsized":"2024-09-12T00:06:42.720246+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:22.897492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"116'41","reported_seq":249,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.799736+0000","last_change":"2024-09-12T00:03:29.340387+0000","last_active":"2024-09-12T00:07:11.799736+0000","last_peered":"2024-09-12T00:07:11.799736+0000","last_clean":"2024-09-12T00:07:11.799736+0000","last_became_active":"2024-09-12T00:03:29.339781+0000","last_became_peered":"2024-09-12T00:03:29.339781+0000","last_unstale":"2024-09-12T00:07:11.799736+0000","last_undegraded":"2024-09-12T00:07:11.799736+0000","last_fullsized":"2024-09-12T00:07:11.799736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:30.132716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811392+0000","last_change":"2024-09-12T00:03:31.350303+0000","last_active":"2024-09-12T00:06:41.811392+0000","last_peered":"2024-09-12T00:06:41.811392+0000","last_clean":"2024-09-12T00:06:41.811392+0000","last_became_active":"2024-09-12T00:03:31.349591+0000","last_became_peered":"2024-09-12T00:03:31.349591+0000","last_unstale":"2024-09-12T00:06:41.811392+0000","last_undegraded":"2024-09-12T00:06:41.811392+0000","last_fullsized":"2024-09-12T00:06:41.811392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:00.263644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"96'4","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065021+0000","last_change":"2024-09-12T00:03:33.385028+0000","last_active":"2024-09-12T00:06:42.065021+0000","last_peered":"2024-09-12T00:06:42.065021+0000","last_clean":"2024-09-12T00:06:42.065021+0000","last_became_active":"2024-09-12T00:03:33.384274+0000","last_became_peered":"2024-09-12T00:03:33.384274+0000","last_unstale":"2024-09-12T00:06:42.065021+0000","last_undegraded":"2024-09-12T00:06:42.065021+0000","last_fullsized":"2024-09-12T00:06:42.065021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:11.634604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"58'2","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813365+0000","last_change":"2024-09-12T00:03:25.329888+0000","last_active":"2024-09-12T00:06:41.813365+0000","last_peered":"2024-09-12T00:06:41.813365+0000","last_clean":"2024-09-12T00:06:41.813365+0000","last_became_active":"2024-09-12T00:03:25.329151+0000","last_became_peered":"2024-09-12T00:03:25.329151+0000","last_unstale":"2024-09-12T00:06:41.813365+0000","last_undegraded":"2024-09-12T00:06:41.813365+0000","last_fullsized":"2024-09-12T00:06:41.813365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:47.272383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"116'50","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.934985+0000","last_change":"2024-09-12T00:03:23.600146+0000","last_active":"2024-09-12T00:07:11.934985+0000","last_peered":"2024-09-12T00:07:11.934985+0000","last_clean":"2024-09-12T00:07:11.934985+0000","last_became_active":"2024-09-12T00:03:23.598862+0000","last_became_peered":"2024-09-12T00:03:23.598862+0000","last_unstale":"2024-09-12T00:07:11.934985+0000","last_undegraded":"2024-09-12T00:07:11.934985+0000","last_fullsized":"2024-09-12T00:07:11.934985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:13.330852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813925+0000","last_change":"2024-09-12T00:03:27.341032+0000","last_active":"2024-09-12T00:06:41.813925+0000","last_peered":"2024-09-12T00:06:41.813925+0000","last_clean":"2024-09-12T00:06:41.813925+0000","last_became_active":"2024-09-12T00:03:27.340199+0000","last_became_peered":"2024-09-12T00:03:27.340199+0000","last_unstale":"2024-09-12T00:06:41.813925+0000","last_undegraded":"2024-09-12T00:06:41.813925+0000","last_fullsized":"2024-09-12T00:06:41.813925+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:23.673080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"116'27","reported_seq":64,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.812247+0000","last_change":"2024-09-12T00:06:31.054703+0000","last_active":"2024-09-12T00:07:11.812247+0000","last_peered":"2024-09-12T00:07:11.812247+0000","last_clean":"2024-09-12T00:07:11.812247+0000","last_became_active":"2024-09-12T00:06:26.675513+0000","last_became_peered":"2024-09-12T00:06:26.675513+0000","last_unstale":"2024-09-12T00:07:11.812247+0000","last_undegraded":"2024-09-12T00:07:11.812247+0000","last_fullsized":"2024-09-12T00:07:11.812247+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:56.604086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065828+0000","last_change":"2024-09-12T00:06:26.678166+0000","last_active":"2024-09-12T00:06:42.065828+0000","last_peered":"2024-09-12T00:06:42.065828+0000","last_clean":"2024-09-12T00:06:42.065828+0000","last_became_active":"2024-09-12T00:06:26.677049+0000","last_became_peered":"2024-09-12T00:06:26.677049+0000","last_unstale":"2024-09-12T00:06:42.065828+0000","last_undegraded":"2024-09-12T00:06:42.065828+0000","last_fullsized":"2024-09-12T00:06:42.065828+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:26.729678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"59'3","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721092+0000","last_change":"2024-09-12T00:06:32.445889+0000","last_active":"2024-09-12T00:06:42.721092+0000","last_peered":"2024-09-12T00:06:42.721092+0000","last_clean":"2024-09-12T00:06:42.721092+0000","last_became_active":"2024-09-12T00:06:26.677859+0000","last_became_peered":"2024-09-12T00:06:26.677859+0000","last_unstale":"2024-09-12T00:06:42.721092+0000","last_undegraded":"2024-09-12T00:06:42.721092+0000","last_fullsized":"2024-09-12T00:06:42.721092+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:56.789846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"59'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722541+0000","last_change":"2024-09-12T00:03:25.360355+0000","last_active":"2024-09-12T00:06:42.722541+0000","last_peered":"2024-09-12T00:06:42.722541+0000","last_clean":"2024-09-12T00:06:42.722541+0000","last_became_active":"2024-09-12T00:03:25.359682+0000","last_became_peered":"2024-09-12T00:03:25.359682+0000","last_unstale":"2024-09-12T00:06:42.722541+0000","last_undegraded":"2024-09-12T00:06:42.722541+0000","last_fullsized":"2024-09-12T00:06:42.722541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:11.808081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"116'40","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.919797+0000","last_change":"2024-09-12T00:03:23.621199+0000","last_active":"2024-09-12T00:07:11.919797+0000","last_peered":"2024-09-12T00:07:11.919797+0000","last_clean":"2024-09-12T00:07:11.919797+0000","last_became_active":"2024-09-12T00:03:23.620961+0000","last_became_peered":"2024-09-12T00:03:23.620961+0000","last_unstale":"2024-09-12T00:07:11.919797+0000","last_undegraded":"2024-09-12T00:07:11.919797+0000","last_fullsized":"2024-09-12T00:07:11.919797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811166+0000","last_change":"2024-09-12T00:03:27.336918+0000","last_active":"2024-09-12T00:06:41.811166+0000","last_peered":"2024-09-12T00:06:41.811166+0000","last_clean":"2024-09-12T00:06:41.811166+0000","last_became_active":"2024-09-12T00:03:27.336045+0000","last_became_peered":"2024-09-12T00:03:27.336045+0000","last_unstale":"2024-09-12T00:06:41.811166+0000","last_undegraded":"2024-09-12T00:06:41.811166+0000","last_fullsized":"2024-09-12T00:06:41.811166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:15.733895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"116'28","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.339959+0000","last_change":"2024-09-12T00:03:29.338667+0000","last_active":"2024-09-12T00:07:11.339959+0000","last_peered":"2024-09-12T00:07:11.339959+0000","last_clean":"2024-09-12T00:07:11.339959+0000","last_became_active":"2024-09-12T00:03:29.338010+0000","last_became_peered":"2024-09-12T00:03:29.338010+0000","last_unstale":"2024-09-12T00:07:11.339959+0000","last_undegraded":"2024-09-12T00:07:11.339959+0000","last_fullsized":"2024-09-12T00:07:11.339959+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:58.256619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722902+0000","last_change":"2024-09-12T00:03:31.352823+0000","last_active":"2024-09-12T00:06:42.722902+0000","last_peered":"2024-09-12T00:06:42.722902+0000","last_clean":"2024-09-12T00:06:42.722902+0000","last_became_active":"2024-09-12T00:03:31.352143+0000","last_became_peered":"2024-09-12T00:03:31.352143+0000","last_unstale":"2024-09-12T00:06:42.722902+0000","last_undegraded":"2024-09-12T00:06:42.722902+0000","last_fullsized":"2024-09-12T00:06:42.722902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:25.168692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"76'8","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721671+0000","last_change":"2024-09-12T00:06:27.901313+0000","last_active":"2024-09-12T00:06:42.721671+0000","last_peered":"2024-09-12T00:06:42.721671+0000","last_clean":"2024-09-12T00:06:42.721671+0000","last_became_active":"2024-09-12T00:06:26.658281+0000","last_became_peered":"2024-09-12T00:06:26.658281+0000","last_unstale":"2024-09-12T00:06:42.721671+0000","last_undegraded":"2024-09-12T00:06:42.721671+0000","last_fullsized":"2024-09-12T00:06:42.721671+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:54.959771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"58'2","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812806+0000","last_change":"2024-09-12T00:03:25.325094+0000","last_active":"2024-09-12T00:06:41.812806+0000","last_peered":"2024-09-12T00:06:41.812806+0000","last_clean":"2024-09-12T00:06:41.812806+0000","last_became_active":"2024-09-12T00:03:25.324315+0000","last_became_peered":"2024-09-12T00:03:25.324315+0000","last_unstale":"2024-09-12T00:06:41.812806+0000","last_undegraded":"2024-09-12T00:06:41.812806+0000","last_fullsized":"2024-09-12T00:06:41.812806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:18.727732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"116'54","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.903821+0000","last_change":"2024-09-12T00:03:23.606163+0000","last_active":"2024-09-12T00:07:11.903821+0000","last_peered":"2024-09-12T00:07:11.903821+0000","last_clean":"2024-09-12T00:07:11.903821+0000","last_became_active":"2024-09-12T00:03:23.605402+0000","last_became_peered":"2024-09-12T00:03:23.605402+0000","last_unstale":"2024-09-12T00:07:11.903821+0000","last_undegraded":"2024-09-12T00:07:11.903821+0000","last_fullsized":"2024-09-12T00:07:11.903821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:02.432313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812917+0000","last_change":"2024-09-12T00:03:27.336716+0000","last_active":"2024-09-12T00:06:41.812917+0000","last_peered":"2024-09-12T00:06:41.812917+0000","last_clean":"2024-09-12T00:06:41.812917+0000","last_became_active":"2024-09-12T00:03:27.335658+0000","last_became_peered":"2024-09-12T00:03:27.335658+0000","last_unstale":"2024-09-12T00:06:41.812917+0000","last_undegraded":"2024-09-12T00:06:41.812917+0000","last_fullsized":"2024-09-12T00:06:41.812917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:47.355798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"35'16","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720503+0000","last_change":"2024-09-12T00:06:29.533440+0000","last_active":"2024-09-12T00:06:42.720503+0000","last_peered":"2024-09-12T00:06:42.720503+0000","last_clean":"2024-09-12T00:06:42.720503+0000","last_became_active":"2024-09-12T00:06:26.671893+0000","last_became_peered":"2024-09-12T00:06:26.671893+0000","last_unstale":"2024-09-12T00:06:42.720503+0000","last_undegraded":"2024-09-12T00:06:42.720503+0000","last_fullsized":"2024-09-12T00:06:42.720503+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:10.667822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"116'138","reported_seq":357,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:10.880655+0000","last_change":"2024-09-12T00:03:31.351362+0000","last_active":"2024-09-12T00:07:10.880655+0000","last_peered":"2024-09-12T00:07:10.880655+0000","last_clean":"2024-09-12T00:07:10.880655+0000","last_became_active":"2024-09-12T00:03:31.350925+0000","last_became_peered":"2024-09-12T00:03:31.350925+0000","last_unstale":"2024-09-12T00:07:10.880655+0000","last_undegraded":"2024-09-12T00:07:10.880655+0000","last_fullsized":"2024-09-12T00:07:10.880655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:03.147968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719766+0000","last_change":"2024-09-12T00:06:26.675599+0000","last_active":"2024-09-12T00:06:42.719766+0000","last_peered":"2024-09-12T00:06:42.719766+0000","last_clean":"2024-09-12T00:06:42.719766+0000","last_became_active":"2024-09-12T00:06:26.675234+0000","last_became_peered":"2024-09-12T00:06:26.675234+0000","last_unstale":"2024-09-12T00:06:42.719766+0000","last_undegraded":"2024-09-12T00:06:42.719766+0000","last_fullsized":"2024-09-12T00:06:42.719766+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:28.887412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"59'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812590+0000","last_change":"2024-09-12T00:03:25.357999+0000","last_active":"2024-09-12T00:06:41.812590+0000","last_peered":"2024-09-12T00:06:41.812590+0000","last_clean":"2024-09-12T00:06:41.812590+0000","last_became_active":"2024-09-12T00:03:25.357623+0000","last_became_peered":"2024-09-12T00:03:25.357623+0000","last_unstale":"2024-09-12T00:06:41.812590+0000","last_undegraded":"2024-09-12T00:06:41.812590+0000","last_fullsized":"2024-09-12T00:06:41.812590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:20.706421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"116'58","reported_seq":254,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.909741+0000","last_change":"2024-09-12T00:03:23.605954+0000","last_active":"2024-09-12T00:07:11.909741+0000","last_peered":"2024-09-12T00:07:11.909741+0000","last_clean":"2024-09-12T00:07:11.909741+0000","last_became_active":"2024-09-12T00:03:23.604773+0000","last_became_peered":"2024-09-12T00:03:23.604773+0000","last_unstale":"2024-09-12T00:07:11.909741+0000","last_undegraded":"2024-09-12T00:07:11.909741+0000","last_fullsized":"2024-09-12T00:07:11.909741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:21.549417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500071+0000","last_change":"2024-09-12T00:03:27.346785+0000","last_active":"2024-09-12T00:06:42.500071+0000","last_peered":"2024-09-12T00:06:42.500071+0000","last_clean":"2024-09-12T00:06:42.500071+0000","last_became_active":"2024-09-12T00:03:27.346168+0000","last_became_peered":"2024-09-12T00:03:27.346168+0000","last_unstale":"2024-09-12T00:06:42.500071+0000","last_undegraded":"2024-09-12T00:06:42.500071+0000","last_fullsized":"2024-09-12T00:06:42.500071+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"116'52","reported_seq":274,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.498723+0000","last_change":"2024-09-12T00:03:29.343942+0000","last_active":"2024-09-12T00:07:11.498723+0000","last_peered":"2024-09-12T00:07:11.498723+0000","last_clean":"2024-09-12T00:07:11.498723+0000","last_became_active":"2024-09-12T00:03:29.343238+0000","last_became_peered":"2024-09-12T00:03:29.343238+0000","last_unstale":"2024-09-12T00:07:11.498723+0000","last_undegraded":"2024-09-12T00:07:11.498723+0000","last_fullsized":"2024-09-12T00:07:11.498723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:30.949892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":68,"num_read_kb":55,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810193+0000","last_change":"2024-09-12T00:06:26.655176+0000","last_active":"2024-09-12T00:06:41.810193+0000","last_peered":"2024-09-12T00:06:41.810193+0000","last_clean":"2024-09-12T00:06:41.810193+0000","last_became_active":"2024-09-12T00:06:26.654187+0000","last_became_peered":"2024-09-12T00:06:26.654187+0000","last_unstale":"2024-09-12T00:06:41.810193+0000","last_undegraded":"2024-09-12T00:06:41.810193+0000","last_fullsized":"2024-09-12T00:06:41.810193+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:58.719162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501328+0000","last_change":"2024-09-12T00:03:33.363188+0000","last_active":"2024-09-12T00:06:42.501328+0000","last_peered":"2024-09-12T00:06:42.501328+0000","last_clean":"2024-09-12T00:06:42.501328+0000","last_became_active":"2024-09-12T00:03:33.360672+0000","last_became_peered":"2024-09-12T00:03:33.360672+0000","last_unstale":"2024-09-12T00:06:42.501328+0000","last_undegraded":"2024-09-12T00:06:42.501328+0000","last_fullsized":"2024-09-12T00:06:42.501328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:33.646117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"59'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811812+0000","last_change":"2024-09-12T00:03:25.336626+0000","last_active":"2024-09-12T00:06:41.811812+0000","last_peered":"2024-09-12T00:06:41.811812+0000","last_clean":"2024-09-12T00:06:41.811812+0000","last_became_active":"2024-09-12T00:03:25.336095+0000","last_became_peered":"2024-09-12T00:03:25.336095+0000","last_unstale":"2024-09-12T00:06:41.811812+0000","last_undegraded":"2024-09-12T00:06:41.811812+0000","last_fullsized":"2024-09-12T00:06:41.811812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"116'52","reported_seq":121,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.935191+0000","last_change":"2024-09-12T00:06:32.976777+0000","last_active":"2024-09-12T00:07:11.935191+0000","last_peered":"2024-09-12T00:07:11.935191+0000","last_clean":"2024-09-12T00:07:11.935191+0000","last_became_active":"2024-09-12T00:06:26.678646+0000","last_became_peered":"2024-09-12T00:06:26.678646+0000","last_unstale":"2024-09-12T00:07:11.935191+0000","last_undegraded":"2024-09-12T00:07:11.935191+0000","last_fullsized":"2024-09-12T00:07:11.935191+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:02.624469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":192937984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812464+0000","last_change":"2024-09-12T00:03:27.326174+0000","last_active":"2024-09-12T00:06:41.812464+0000","last_peered":"2024-09-12T00:06:41.812464+0000","last_clean":"2024-09-12T00:06:41.812464+0000","last_became_active":"2024-09-12T00:03:27.325336+0000","last_became_peered":"2024-09-12T00:03:27.325336+0000","last_unstale":"2024-09-12T00:06:41.812464+0000","last_undegraded":"2024-09-12T00:06:41.812464+0000","last_fullsized":"2024-09-12T00:06:41.812464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:08.659813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"116'26","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.502651+0000","last_change":"2024-09-12T00:03:29.335957+0000","last_active":"2024-09-12T00:07:11.502651+0000","last_peered":"2024-09-12T00:07:11.502651+0000","last_clean":"2024-09-12T00:07:11.502651+0000","last_became_active":"2024-09-12T00:03:29.335186+0000","last_became_peered":"2024-09-12T00:03:29.335186+0000","last_unstale":"2024-09-12T00:07:11.502651+0000","last_undegraded":"2024-09-12T00:07:11.502651+0000","last_fullsized":"2024-09-12T00:07:11.502651+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:20.551758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721804+0000","last_change":"2024-09-12T00:06:26.671154+0000","last_active":"2024-09-12T00:06:42.721804+0000","last_peered":"2024-09-12T00:06:42.721804+0000","last_clean":"2024-09-12T00:06:42.721804+0000","last_became_active":"2024-09-12T00:06:26.667486+0000","last_became_peered":"2024-09-12T00:06:26.667486+0000","last_unstale":"2024-09-12T00:06:42.721804+0000","last_undegraded":"2024-09-12T00:06:42.721804+0000","last_fullsized":"2024-09-12T00:06:42.721804+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:31.291883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066037+0000","last_change":"2024-09-12T00:03:33.385037+0000","last_active":"2024-09-12T00:06:42.066037+0000","last_peered":"2024-09-12T00:06:42.066037+0000","last_clean":"2024-09-12T00:06:42.066037+0000","last_became_active":"2024-09-12T00:03:33.384379+0000","last_became_peered":"2024-09-12T00:03:33.384379+0000","last_unstale":"2024-09-12T00:06:42.066037+0000","last_undegraded":"2024-09-12T00:06:42.066037+0000","last_fullsized":"2024-09-12T00:06:42.066037+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:00.153475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"96'10","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718737+0000","last_change":"2024-09-12T00:03:25.339110+0000","last_active":"2024-09-12T00:06:42.718737+0000","last_peered":"2024-09-12T00:06:42.718737+0000","last_clean":"2024-09-12T00:06:42.718737+0000","last_became_active":"2024-09-12T00:03:25.338417+0000","last_became_peered":"2024-09-12T00:03:25.338417+0000","last_unstale":"2024-09-12T00:06:42.718737+0000","last_undegraded":"2024-09-12T00:06:42.718737+0000","last_fullsized":"2024-09-12T00:06:42.718737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:48.866021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"116'62","reported_seq":255,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.943331+0000","last_change":"2024-09-12T00:03:23.625514+0000","last_active":"2024-09-12T00:07:11.943331+0000","last_peered":"2024-09-12T00:07:11.943331+0000","last_clean":"2024-09-12T00:07:11.943331+0000","last_became_active":"2024-09-12T00:03:23.621654+0000","last_became_peered":"2024-09-12T00:03:23.621654+0000","last_unstale":"2024-09-12T00:07:11.943331+0000","last_undegraded":"2024-09-12T00:07:11.943331+0000","last_fullsized":"2024-09-12T00:07:11.943331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:43.784497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500172+0000","last_change":"2024-09-12T00:03:27.330377+0000","last_active":"2024-09-12T00:06:42.500172+0000","last_peered":"2024-09-12T00:06:42.500172+0000","last_clean":"2024-09-12T00:06:42.500172+0000","last_became_active":"2024-09-12T00:03:27.329713+0000","last_became_peered":"2024-09-12T00:03:27.329713+0000","last_unstale":"2024-09-12T00:06:42.500172+0000","last_undegraded":"2024-09-12T00:06:42.500172+0000","last_fullsized":"2024-09-12T00:06:42.500172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"116'22","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.328386+0000","last_change":"2024-09-12T00:03:29.337028+0000","last_active":"2024-09-12T00:07:11.328386+0000","last_peered":"2024-09-12T00:07:11.328386+0000","last_clean":"2024-09-12T00:07:11.328386+0000","last_became_active":"2024-09-12T00:03:29.335440+0000","last_became_peered":"2024-09-12T00:03:29.335440+0000","last_unstale":"2024-09-12T00:07:11.328386+0000","last_undegraded":"2024-09-12T00:07:11.328386+0000","last_fullsized":"2024-09-12T00:07:11.328386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:19.288395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":21,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721524+0000","last_change":"2024-09-12T00:06:26.674200+0000","last_active":"2024-09-12T00:06:42.721524+0000","last_peered":"2024-09-12T00:06:42.721524+0000","last_clean":"2024-09-12T00:06:42.721524+0000","last_became_active":"2024-09-12T00:06:26.660173+0000","last_became_peered":"2024-09-12T00:06:26.660173+0000","last_unstale":"2024-09-12T00:06:42.721524+0000","last_undegraded":"2024-09-12T00:06:42.721524+0000","last_fullsized":"2024-09-12T00:06:42.721524+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:56.674961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"58'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720918+0000","last_change":"2024-09-12T00:06:32.449370+0000","last_active":"2024-09-12T00:06:42.720918+0000","last_peered":"2024-09-12T00:06:42.720918+0000","last_clean":"2024-09-12T00:06:42.720918+0000","last_became_active":"2024-09-12T00:06:26.677210+0000","last_became_peered":"2024-09-12T00:06:26.677210+0000","last_unstale":"2024-09-12T00:06:42.720918+0000","last_undegraded":"2024-09-12T00:06:42.720918+0000","last_fullsized":"2024-09-12T00:06:42.720918+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:13.086869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"96'4","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810877+0000","last_change":"2024-09-12T00:03:25.337999+0000","last_active":"2024-09-12T00:06:41.810877+0000","last_peered":"2024-09-12T00:06:41.810877+0000","last_clean":"2024-09-12T00:06:41.810877+0000","last_became_active":"2024-09-12T00:03:25.337237+0000","last_became_peered":"2024-09-12T00:03:25.337237+0000","last_unstale":"2024-09-12T00:06:41.810877+0000","last_undegraded":"2024-09-12T00:06:41.810877+0000","last_fullsized":"2024-09-12T00:06:41.810877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:39.011349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"116'58","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.897576+0000","last_change":"2024-09-12T00:03:23.631744+0000","last_active":"2024-09-12T00:07:11.897576+0000","last_peered":"2024-09-12T00:07:11.897576+0000","last_clean":"2024-09-12T00:07:11.897576+0000","last_became_active":"2024-09-12T00:03:23.630928+0000","last_became_peered":"2024-09-12T00:03:23.630928+0000","last_unstale":"2024-09-12T00:07:11.897576+0000","last_undegraded":"2024-09-12T00:07:11.897576+0000","last_fullsized":"2024-09-12T00:07:11.897576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:35.772832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810384+0000","last_change":"2024-09-12T00:06:26.683708+0000","last_active":"2024-09-12T00:06:41.810384+0000","last_peered":"2024-09-12T00:06:41.810384+0000","last_clean":"2024-09-12T00:06:41.810384+0000","last_became_active":"2024-09-12T00:06:26.651342+0000","last_became_peered":"2024-09-12T00:06:26.651342+0000","last_unstale":"2024-09-12T00:06:41.810384+0000","last_undegraded":"2024-09-12T00:06:41.810384+0000","last_fullsized":"2024-09-12T00:06:41.810384+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:06.251275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"116'32","reported_seq":62,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.344979+0000","last_change":"2024-09-12T00:06:33.464772+0000","last_active":"2024-09-12T00:07:11.344979+0000","last_peered":"2024-09-12T00:07:11.344979+0000","last_clean":"2024-09-12T00:07:11.344979+0000","last_became_active":"2024-09-12T00:06:26.680856+0000","last_became_peered":"2024-09-12T00:06:26.680856+0000","last_unstale":"2024-09-12T00:07:11.344979+0000","last_undegraded":"2024-09-12T00:07:11.344979+0000","last_fullsized":"2024-09-12T00:07:11.344979+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:08.755659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":32,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811844+0000","last_change":"2024-09-12T00:03:31.355300+0000","last_active":"2024-09-12T00:06:41.811844+0000","last_peered":"2024-09-12T00:06:41.811844+0000","last_clean":"2024-09-12T00:06:41.811844+0000","last_became_active":"2024-09-12T00:03:31.354506+0000","last_became_peered":"2024-09-12T00:03:31.354506+0000","last_unstale":"2024-09-12T00:06:41.811844+0000","last_undegraded":"2024-09-12T00:06:41.811844+0000","last_fullsized":"2024-09-12T00:06:41.811844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:51.564710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"58'1","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815779+0000","last_change":"2024-09-12T00:03:33.384262+0000","last_active":"2024-09-12T00:06:41.815779+0000","last_peered":"2024-09-12T00:06:41.815779+0000","last_clean":"2024-09-12T00:06:41.815779+0000","last_became_active":"2024-09-12T00:03:33.383358+0000","last_became_peered":"2024-09-12T00:03:33.383358+0000","last_unstale":"2024-09-12T00:06:41.815779+0000","last_undegraded":"2024-09-12T00:06:41.815779+0000","last_fullsized":"2024-09-12T00:06:41.815779+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:45.060131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"84'4","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813832+0000","last_change":"2024-09-12T00:06:28.849788+0000","last_active":"2024-09-12T00:06:41.813832+0000","last_peered":"2024-09-12T00:06:41.813832+0000","last_clean":"2024-09-12T00:06:41.813832+0000","last_became_active":"2024-09-12T00:06:26.664077+0000","last_became_peered":"2024-09-12T00:06:26.664077+0000","last_unstale":"2024-09-12T00:06:41.813832+0000","last_undegraded":"2024-09-12T00:06:41.813832+0000","last_fullsized":"2024-09-12T00:06:41.813832+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:24.431791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"116'62","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.924853+0000","last_change":"2024-09-12T00:03:23.617643+0000","last_active":"2024-09-12T00:07:11.924853+0000","last_peered":"2024-09-12T00:07:11.924853+0000","last_clean":"2024-09-12T00:07:11.924853+0000","last_became_active":"2024-09-12T00:03:23.617138+0000","last_became_peered":"2024-09-12T00:03:23.617138+0000","last_unstale":"2024-09-12T00:07:11.924853+0000","last_undegraded":"2024-09-12T00:07:11.924853+0000","last_fullsized":"2024-09-12T00:07:11.924853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:56.388986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":124928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"59'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723414+0000","last_change":"2024-09-12T00:03:25.335650+0000","last_active":"2024-09-12T00:06:42.723414+0000","last_peered":"2024-09-12T00:06:42.723414+0000","last_clean":"2024-09-12T00:06:42.723414+0000","last_became_active":"2024-09-12T00:03:25.334965+0000","last_became_peered":"2024-09-12T00:03:25.334965+0000","last_unstale":"2024-09-12T00:06:42.723414+0000","last_undegraded":"2024-09-12T00:06:42.723414+0000","last_fullsized":"2024-09-12T00:06:42.723414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:13.501672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"116'52","reported_seq":245,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.957983+0000","last_change":"2024-09-12T00:03:23.618651+0000","last_active":"2024-09-12T00:07:11.957983+0000","last_peered":"2024-09-12T00:07:11.957983+0000","last_clean":"2024-09-12T00:07:11.957983+0000","last_became_active":"2024-09-12T00:03:23.612542+0000","last_became_peered":"2024-09-12T00:03:23.612542+0000","last_unstale":"2024-09-12T00:07:11.957983+0000","last_undegraded":"2024-09-12T00:07:11.957983+0000","last_fullsized":"2024-09-12T00:07:11.957983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:52.649786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"96'4","reported_seq":47,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717901+0000","last_change":"2024-09-12T00:06:32.454921+0000","last_active":"2024-09-12T00:06:42.717901+0000","last_peered":"2024-09-12T00:06:42.717901+0000","last_clean":"2024-09-12T00:06:42.717901+0000","last_became_active":"2024-09-12T00:06:26.677698+0000","last_became_peered":"2024-09-12T00:06:26.677698+0000","last_unstale":"2024-09-12T00:06:42.717901+0000","last_undegraded":"2024-09-12T00:06:42.717901+0000","last_fullsized":"2024-09-12T00:06:42.717901+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:31.889100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"116'60","reported_seq":133,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.899854+0000","last_change":"2024-09-12T00:06:30.842710+0000","last_active":"2024-09-12T00:07:11.899854+0000","last_peered":"2024-09-12T00:07:11.899854+0000","last_clean":"2024-09-12T00:07:11.899854+0000","last_became_active":"2024-09-12T00:06:26.666582+0000","last_became_peered":"2024-09-12T00:06:26.666582+0000","last_unstale":"2024-09-12T00:07:11.899854+0000","last_undegraded":"2024-09-12T00:07:11.899854+0000","last_fullsized":"2024-09-12T00:07:11.899854+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:15.209092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":201326592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"63'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066906+0000","last_change":"2024-09-12T00:03:25.354015+0000","last_active":"2024-09-12T00:06:42.066906+0000","last_peered":"2024-09-12T00:06:42.066906+0000","last_clean":"2024-09-12T00:06:42.066906+0000","last_became_active":"2024-09-12T00:03:25.352319+0000","last_became_peered":"2024-09-12T00:03:25.352319+0000","last_unstale":"2024-09-12T00:06:42.066906+0000","last_undegraded":"2024-09-12T00:06:42.066906+0000","last_fullsized":"2024-09-12T00:06:42.066906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:08.033834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"116'34","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.940302+0000","last_change":"2024-09-12T00:03:23.633614+0000","last_active":"2024-09-12T00:07:11.940302+0000","last_peered":"2024-09-12T00:07:11.940302+0000","last_clean":"2024-09-12T00:07:11.940302+0000","last_became_active":"2024-09-12T00:03:23.632850+0000","last_became_peered":"2024-09-12T00:03:23.632850+0000","last_unstale":"2024-09-12T00:07:11.940302+0000","last_undegraded":"2024-09-12T00:07:11.940302+0000","last_fullsized":"2024-09-12T00:07:11.940302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065662+0000","last_change":"2024-09-12T00:03:25.357453+0000","last_active":"2024-09-12T00:06:42.065662+0000","last_peered":"2024-09-12T00:06:42.065662+0000","last_clean":"2024-09-12T00:06:42.065662+0000","last_became_active":"2024-09-12T00:03:25.353815+0000","last_became_peered":"2024-09-12T00:03:25.353815+0000","last_unstale":"2024-09-12T00:06:42.065662+0000","last_undegraded":"2024-09-12T00:06:42.065662+0000","last_fullsized":"2024-09-12T00:06:42.065662+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:27.562174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"116'42","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.915893+0000","last_change":"2024-09-12T00:03:23.609055+0000","last_active":"2024-09-12T00:07:11.915893+0000","last_peered":"2024-09-12T00:07:11.915893+0000","last_clean":"2024-09-12T00:07:11.915893+0000","last_became_active":"2024-09-12T00:03:23.608101+0000","last_became_peered":"2024-09-12T00:03:23.608101+0000","last_unstale":"2024-09-12T00:07:11.915893+0000","last_undegraded":"2024-09-12T00:07:11.915893+0000","last_fullsized":"2024-09-12T00:07:11.915893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.749840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":50,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"96'10","reported_seq":268,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814861+0000","last_change":"2024-09-12T00:06:28.290549+0000","last_active":"2024-09-12T00:06:41.814861+0000","last_peered":"2024-09-12T00:06:41.814861+0000","last_clean":"2024-09-12T00:06:41.814861+0000","last_became_active":"2024-09-12T00:06:26.681882+0000","last_became_peered":"2024-09-12T00:06:26.681882+0000","last_unstale":"2024-09-12T00:06:41.814861+0000","last_undegraded":"2024-09-12T00:06:41.814861+0000","last_fullsized":"2024-09-12T00:06:41.814861+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:12.272800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"116'50","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.905772+0000","last_change":"2024-09-12T00:03:23.616706+0000","last_active":"2024-09-12T00:07:11.905772+0000","last_peered":"2024-09-12T00:07:11.905772+0000","last_clean":"2024-09-12T00:07:11.905772+0000","last_became_active":"2024-09-12T00:03:23.615970+0000","last_became_peered":"2024-09-12T00:03:23.615970+0000","last_unstale":"2024-09-12T00:07:11.905772+0000","last_undegraded":"2024-09-12T00:07:11.905772+0000","last_fullsized":"2024-09-12T00:07:11.905772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:17.805710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":58,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"63'8","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720621+0000","last_change":"2024-09-12T00:03:25.343716+0000","last_active":"2024-09-12T00:06:42.720621+0000","last_peered":"2024-09-12T00:06:42.720621+0000","last_clean":"2024-09-12T00:06:42.720621+0000","last_became_active":"2024-09-12T00:03:25.342930+0000","last_became_peered":"2024-09-12T00:03:25.342930+0000","last_unstale":"2024-09-12T00:06:42.720621+0000","last_undegraded":"2024-09-12T00:06:42.720621+0000","last_fullsized":"2024-09-12T00:06:42.720621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:31.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"116'50","reported_seq":346,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.871052+0000","last_change":"2024-09-12T00:06:29.602896+0000","last_active":"2024-09-12T00:07:11.871052+0000","last_peered":"2024-09-12T00:07:11.871052+0000","last_clean":"2024-09-12T00:07:11.871052+0000","last_became_active":"2024-09-12T00:06:26.672080+0000","last_became_peered":"2024-09-12T00:06:26.672080+0000","last_unstale":"2024-09-12T00:07:11.871052+0000","last_undegraded":"2024-09-12T00:07:11.871052+0000","last_fullsized":"2024-09-12T00:07:11.871052+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:47.695274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"96'10","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499716+0000","last_change":"2024-09-12T00:03:25.326620+0000","last_active":"2024-09-12T00:06:42.499716+0000","last_peered":"2024-09-12T00:06:42.499716+0000","last_clean":"2024-09-12T00:06:42.499716+0000","last_became_active":"2024-09-12T00:03:25.326262+0000","last_became_peered":"2024-09-12T00:03:25.326262+0000","last_unstale":"2024-09-12T00:06:42.499716+0000","last_undegraded":"2024-09-12T00:06:42.499716+0000","last_fullsized":"2024-09-12T00:06:42.499716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:37.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"116'32","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.919381+0000","last_change":"2024-09-12T00:03:23.632200+0000","last_active":"2024-09-12T00:07:11.919381+0000","last_peered":"2024-09-12T00:07:11.919381+0000","last_clean":"2024-09-12T00:07:11.919381+0000","last_became_active":"2024-09-12T00:03:23.631510+0000","last_became_peered":"2024-09-12T00:03:23.631510+0000","last_unstale":"2024-09-12T00:07:11.919381+0000","last_undegraded":"2024-09-12T00:07:11.919381+0000","last_fullsized":"2024-09-12T00:07:11.919381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:07.177242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"58'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.724304+0000","last_change":"2024-09-12T00:03:25.342763+0000","last_active":"2024-09-12T00:06:42.724304+0000","last_peered":"2024-09-12T00:06:42.724304+0000","last_clean":"2024-09-12T00:06:42.724304+0000","last_became_active":"2024-09-12T00:03:25.337834+0000","last_became_peered":"2024-09-12T00:03:25.337834+0000","last_unstale":"2024-09-12T00:06:42.724304+0000","last_undegraded":"2024-09-12T00:06:42.724304+0000","last_fullsized":"2024-09-12T00:06:42.724304+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:35.920599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"116'32","reported_seq":91,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.916146+0000","last_change":"2024-09-12T00:06:28.323950+0000","last_active":"2024-09-12T00:07:11.916146+0000","last_peered":"2024-09-12T00:07:11.916146+0000","last_clean":"2024-09-12T00:07:11.916146+0000","last_became_active":"2024-09-12T00:06:26.666889+0000","last_became_peered":"2024-09-12T00:06:26.666889+0000","last_unstale":"2024-09-12T00:07:11.916146+0000","last_undegraded":"2024-09-12T00:07:11.916146+0000","last_fullsized":"2024-09-12T00:07:11.916146+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:12.167901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.816185+0000","last_change":"2024-09-12T00:03:25.339910+0000","last_active":"2024-09-12T00:06:41.816185+0000","last_peered":"2024-09-12T00:06:41.816185+0000","last_clean":"2024-09-12T00:06:41.816185+0000","last_became_active":"2024-09-12T00:03:25.336511+0000","last_became_peered":"2024-09-12T00:03:25.336511+0000","last_unstale":"2024-09-12T00:06:41.816185+0000","last_undegraded":"2024-09-12T00:06:41.816185+0000","last_fullsized":"2024-09-12T00:06:41.816185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:30.647474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"116'56","reported_seq":249,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.889670+0000","last_change":"2024-09-12T00:03:23.626232+0000","last_active":"2024-09-12T00:07:11.889670+0000","last_peered":"2024-09-12T00:07:11.889670+0000","last_clean":"2024-09-12T00:07:11.889670+0000","last_became_active":"2024-09-12T00:03:23.621761+0000","last_became_peered":"2024-09-12T00:03:23.621761+0000","last_unstale":"2024-09-12T00:07:11.889670+0000","last_undegraded":"2024-09-12T00:07:11.889670+0000","last_fullsized":"2024-09-12T00:07:11.889670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:31.587668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"59'4","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066619+0000","last_change":"2024-09-12T00:06:28.859921+0000","last_active":"2024-09-12T00:06:42.066619+0000","last_peered":"2024-09-12T00:06:42.066619+0000","last_clean":"2024-09-12T00:06:42.066619+0000","last_became_active":"2024-09-12T00:06:26.677331+0000","last_became_peered":"2024-09-12T00:06:26.677331+0000","last_unstale":"2024-09-12T00:06:42.066619+0000","last_undegraded":"2024-09-12T00:06:42.066619+0000","last_fullsized":"2024-09-12T00:06:42.066619+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:05.062779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"116'48","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.892817+0000","last_change":"2024-09-12T00:03:23.600956+0000","last_active":"2024-09-12T00:07:11.892817+0000","last_peered":"2024-09-12T00:07:11.892817+0000","last_clean":"2024-09-12T00:07:11.892817+0000","last_became_active":"2024-09-12T00:03:23.600673+0000","last_became_peered":"2024-09-12T00:03:23.600673+0000","last_unstale":"2024-09-12T00:07:11.892817+0000","last_undegraded":"2024-09-12T00:07:11.892817+0000","last_fullsized":"2024-09-12T00:07:11.892817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:04.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"96'6","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500670+0000","last_change":"2024-09-12T00:03:25.325088+0000","last_active":"2024-09-12T00:06:42.500670+0000","last_peered":"2024-09-12T00:06:42.500670+0000","last_clean":"2024-09-12T00:06:42.500670+0000","last_became_active":"2024-09-12T00:03:25.324597+0000","last_became_peered":"2024-09-12T00:03:25.324597+0000","last_unstale":"2024-09-12T00:06:42.500670+0000","last_undegraded":"2024-09-12T00:06:42.500670+0000","last_fullsized":"2024-09-12T00:06:42.500670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.823173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"116'38","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.879359+0000","last_change":"2024-09-12T00:03:23.621791+0000","last_active":"2024-09-12T00:07:11.879359+0000","last_peered":"2024-09-12T00:07:11.879359+0000","last_clean":"2024-09-12T00:07:11.879359+0000","last_became_active":"2024-09-12T00:03:23.621063+0000","last_became_peered":"2024-09-12T00:03:23.621063+0000","last_unstale":"2024-09-12T00:07:11.879359+0000","last_undegraded":"2024-09-12T00:07:11.879359+0000","last_fullsized":"2024-09-12T00:07:11.879359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:33.234598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":75776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500368+0000","last_change":"2024-09-12T00:03:25.357605+0000","last_active":"2024-09-12T00:06:42.500368+0000","last_peered":"2024-09-12T00:06:42.500368+0000","last_clean":"2024-09-12T00:06:42.500368+0000","last_became_active":"2024-09-12T00:03:25.357286+0000","last_became_peered":"2024-09-12T00:03:25.357286+0000","last_unstale":"2024-09-12T00:06:42.500368+0000","last_undegraded":"2024-09-12T00:06:42.500368+0000","last_fullsized":"2024-09-12T00:06:42.500368+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:45.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"116'40","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.884028+0000","last_change":"2024-09-12T00:03:23.600931+0000","last_active":"2024-09-12T00:07:11.884028+0000","last_peered":"2024-09-12T00:07:11.884028+0000","last_clean":"2024-09-12T00:07:11.884028+0000","last_became_active":"2024-09-12T00:03:23.600591+0000","last_became_peered":"2024-09-12T00:03:23.600591+0000","last_unstale":"2024-09-12T00:07:11.884028+0000","last_undegraded":"2024-09-12T00:07:11.884028+0000","last_fullsized":"2024-09-12T00:07:11.884028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:07.212740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":48,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"84'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719420+0000","last_change":"2024-09-12T00:03:25.330869+0000","last_active":"2024-09-12T00:06:42.719420+0000","last_peered":"2024-09-12T00:06:42.719420+0000","last_clean":"2024-09-12T00:06:42.719420+0000","last_became_active":"2024-09-12T00:03:25.329742+0000","last_became_peered":"2024-09-12T00:03:25.329742+0000","last_unstale":"2024-09-12T00:06:42.719420+0000","last_undegraded":"2024-09-12T00:06:42.719420+0000","last_fullsized":"2024-09-12T00:06:42.719420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:01.365985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"116'62","reported_seq":135,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.918501+0000","last_change":"2024-09-12T00:06:31.824748+0000","last_active":"2024-09-12T00:07:11.918501+0000","last_peered":"2024-09-12T00:07:11.918501+0000","last_clean":"2024-09-12T00:07:11.918501+0000","last_became_active":"2024-09-12T00:06:26.668022+0000","last_became_peered":"2024-09-12T00:06:26.668022+0000","last_unstale":"2024-09-12T00:07:11.918501+0000","last_undegraded":"2024-09-12T00:07:11.918501+0000","last_fullsized":"2024-09-12T00:07:11.918501+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:57.178468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":3,"num_write":70,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":222298112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"59'4","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811470+0000","last_change":"2024-09-12T00:03:25.347570+0000","last_active":"2024-09-12T00:06:41.811470+0000","last_peered":"2024-09-12T00:06:41.811470+0000","last_clean":"2024-09-12T00:06:41.811470+0000","last_became_active":"2024-09-12T00:03:25.346874+0000","last_became_peered":"2024-09-12T00:03:25.346874+0000","last_unstale":"2024-09-12T00:06:41.811470+0000","last_undegraded":"2024-09-12T00:06:41.811470+0000","last_fullsized":"2024-09-12T00:06:41.811470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"116'46","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.910075+0000","last_change":"2024-09-12T00:03:23.623417+0000","last_active":"2024-09-12T00:07:11.910075+0000","last_peered":"2024-09-12T00:07:11.910075+0000","last_clean":"2024-09-12T00:07:11.910075+0000","last_became_active":"2024-09-12T00:03:23.620261+0000","last_became_peered":"2024-09-12T00:03:23.620261+0000","last_unstale":"2024-09-12T00:07:11.910075+0000","last_undegraded":"2024-09-12T00:07:11.910075+0000","last_fullsized":"2024-09-12T00:07:11.910075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:03.449547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"63'8","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499989+0000","last_change":"2024-09-12T00:03:25.357492+0000","last_active":"2024-09-12T00:06:42.499989+0000","last_peered":"2024-09-12T00:06:42.499989+0000","last_clean":"2024-09-12T00:06:42.499989+0000","last_became_active":"2024-09-12T00:03:25.357186+0000","last_became_peered":"2024-09-12T00:03:25.357186+0000","last_unstale":"2024-09-12T00:06:42.499989+0000","last_undegraded":"2024-09-12T00:06:42.499989+0000","last_fullsized":"2024-09-12T00:06:42.499989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.743696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"116'52","reported_seq":121,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.899207+0000","last_change":"2024-09-12T00:06:34.105256+0000","last_active":"2024-09-12T00:07:11.899207+0000","last_peered":"2024-09-12T00:07:11.899207+0000","last_clean":"2024-09-12T00:07:11.899207+0000","last_became_active":"2024-09-12T00:06:26.677360+0000","last_became_peered":"2024-09-12T00:06:26.677360+0000","last_unstale":"2024-09-12T00:07:11.899207+0000","last_undegraded":"2024-09-12T00:07:11.899207+0000","last_fullsized":"2024-09-12T00:07:11.899207+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:18.563619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":163577856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"116'54","reported_seq":124,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.870158+0000","last_change":"2024-09-12T00:06:28.886144+0000","last_active":"2024-09-12T00:07:11.870158+0000","last_peered":"2024-09-12T00:07:11.870158+0000","last_clean":"2024-09-12T00:07:11.870158+0000","last_became_active":"2024-09-12T00:06:26.669830+0000","last_became_peered":"2024-09-12T00:06:26.669830+0000","last_unstale":"2024-09-12T00:07:11.870158+0000","last_undegraded":"2024-09-12T00:07:11.870158+0000","last_fullsized":"2024-09-12T00:07:11.870158+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:37.229011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":192937984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"84'6","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813636+0000","last_change":"2024-09-12T00:03:25.350116+0000","last_active":"2024-09-12T00:06:41.813636+0000","last_peered":"2024-09-12T00:06:41.813636+0000","last_clean":"2024-09-12T00:06:41.813636+0000","last_became_active":"2024-09-12T00:03:25.349281+0000","last_became_peered":"2024-09-12T00:03:25.349281+0000","last_unstale":"2024-09-12T00:06:41.813636+0000","last_undegraded":"2024-09-12T00:06:41.813636+0000","last_fullsized":"2024-09-12T00:06:41.813636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:33.350458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"116'40","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.909752+0000","last_change":"2024-09-12T00:03:23.619574+0000","last_active":"2024-09-12T00:07:11.909752+0000","last_peered":"2024-09-12T00:07:11.909752+0000","last_clean":"2024-09-12T00:07:11.909752+0000","last_became_active":"2024-09-12T00:03:23.616154+0000","last_became_peered":"2024-09-12T00:03:23.616154+0000","last_unstale":"2024-09-12T00:07:11.909752+0000","last_undegraded":"2024-09-12T00:07:11.909752+0000","last_fullsized":"2024-09-12T00:07:11.909752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:22.565909+0000","last_clean_scrub_stamp":"2024-09-12T00:03:22.565909+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:46.335775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"58'2","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.502147+0000","last_change":"2024-09-12T00:03:25.345327+0000","last_active":"2024-09-12T00:06:42.502147+0000","last_peered":"2024-09-12T00:06:42.502147+0000","last_clean":"2024-09-12T00:06:42.502147+0000","last_became_active":"2024-09-12T00:03:25.344917+0000","last_became_peered":"2024-09-12T00:03:25.344917+0000","last_unstale":"2024-09-12T00:06:42.502147+0000","last_undegraded":"2024-09-12T00:06:42.502147+0000","last_fullsized":"2024-09-12T00:06:42.502147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:30.701941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":339,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1109,"ondisk_log_size":1109,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":31604,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1351,"num_read_kb":1799,"num_write":737,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":117531,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1058,"ondisk_log_size":1058,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1444,"num_read_kb":1412,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3088,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":721,"num_bytes_recovered":3007315968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542198,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1421312,"data_stored":797851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542198,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1425408,"data_stored":798943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542198,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41472,"kb_used_data":1968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330368,"statfs":{"total":96636764160,"available":96594296832,"internally_reserved":0,"allocated":2015232,"data_stored":1388365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542198,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36976,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334864,"statfs":{"total":96636764160,"available":96598900736,"internally_reserved":0,"allocated":1421312,"data_stored":797651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542198,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41000,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330840,"statfs":{"total":96636764160,"available":96594780160,"internally_reserved":0,"allocated":1413120,"data_stored":797340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,5],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542199,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36708,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335132,"statfs":{"total":96636764160,"available":96599175168,"internally_reserved":0,"allocated":1396736,"data_stored":796956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542198,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37464,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334376,"statfs":{"total":96636764160,"available":96598401024,"internally_reserved":0,"allocated":2043904,"data_stored":1389896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542197,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36760,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335080,"statfs":{"total":96636764160,"available":96599121920,"internally_reserved":0,"allocated":1445888,"data_stored":798128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:07:19.009 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.009 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.010 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.010 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.010 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.010 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.010 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.010 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.010 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.011 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.011 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.011 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.011 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.011 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.011 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.011 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.011 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.012 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.012 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.012 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.012 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.012 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.012 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.012 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.012 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.012 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.013 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.013 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.013 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.013 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.013 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.013 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.013 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.013 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.013 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.014 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.014 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.014 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.014 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.014 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.014 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.014 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.014 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.014 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.015 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.015 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.015 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.015 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.015 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.015 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.015 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.015 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.015 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.016 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.016 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.016 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.016 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.016 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.016 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.016 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.016 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.016 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.017 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.017 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.017 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.017 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.017 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.017 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.017 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.017 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.017 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.018 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.018 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.018 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.018 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.018 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.018 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.018 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.018 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.018 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.019 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.019 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.019 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.019 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.019 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.019 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.019 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.019 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.020 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.020 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.020 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.020 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.020 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.020 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.020 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.020 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.020 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.021 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.021 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.021 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.021 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.021 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T00:03:10.462069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.021 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T00:03:15.518952+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.021 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.021 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.021 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.022 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.022 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.022 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.022 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T00:03:15.518952+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.022 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.022 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.022 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.022 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.022 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.023 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.023 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T00:03:15.518952+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.023 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.023 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.023 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.023 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.023 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.023 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.024 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T00:03:15.518952+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.024 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.024 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.024 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.024 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.024 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.024 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.024 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.024 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T00:03:15.518952+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.025 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.025 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.025 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.025 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.025 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.025 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.025 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T00:03:15.518952+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.025 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.025 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.026 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.026 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.026 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.026 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.026 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T00:03:15.518952+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.026 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.026 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.026 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.026 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.027 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.027 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.027 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T00:03:15.518952+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.027 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.027 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.027 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.027 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.027 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.027 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.028 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.028 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.028 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.028 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.028 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.028 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.028 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.028 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.028 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.029 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.029 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.029 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.029 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.029 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.029 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.029 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.029 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.029 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.030 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.030 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.030 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.030 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.030 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.030 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.030 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.030 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.030 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.031 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.031 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.031 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.031 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.031 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.031 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.031 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.031 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.032 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.032 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.032 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.032 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.032 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.032 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.033 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.033 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.033 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.033 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.033 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.033 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.033 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.033 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.033 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.034 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.034 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.034 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.034 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.034 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.034 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.034 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.034 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.034 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.035 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.035 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.035 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.035 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.035 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.035 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.035 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.036 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.036 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.036 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.036 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.036 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.036 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.036 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.036 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.037 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.037 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.037 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.037 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.037 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.037 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.037 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.037 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.037 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.038 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.038 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.038 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.038 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.038 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.038 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.038 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.038 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.038 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.039 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.039 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.039 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.039 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.039 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.039 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.039 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.039 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.039 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.040 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.040 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.040 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.040 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T00:03:22.565909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.040 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:19.040 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T00:07:39.042 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:07:39.399 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:07:39.410 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T00:07:39.419 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-09-12T00:07:38.490734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":624007,"num_objects":232,"num_object_clones":0,"num_object_copies":464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":232,"num_whiteouts":0,"num_read":5210,"num_read_kb":4083,"num_write":4549,"num_write_kb":6187135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":928,"num_bytes_recovered":3007433610,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5729,"ondisk_log_size":5729,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":299200,"kb_used_data":12288,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754675520,"statfs":{"total":773094113280,"available":772787732480,"internally_reserved":0,"allocated":12582912,"data_stored":7565130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":293654066},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005800"},"pg_stats":[{"pgid":"3.3f","version":"116'32","reported_seq":311,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.361272+0000","last_change":"2024-09-12T00:07:25.361131+0000","last_active":"2024-09-12T00:07:25.361272+0000","last_peered":"2024-09-12T00:07:25.361272+0000","last_clean":"2024-09-12T00:07:25.361272+0000","last_became_active":"2024-09-12T00:06:26.678792+0000","last_became_peered":"2024-09-12T00:06:26.678792+0000","last_unstale":"2024-09-12T00:07:25.361272+0000","last_undegraded":"2024-09-12T00:07:25.361272+0000","last_fullsized":"2024-09-12T00:07:25.361272+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-09-12T00:07:25.360823+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-09-12T00:07:25.360823+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.360823+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:20.400665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.078430+0000","last_change":"2024-09-12T00:07:32.078430+0000","last_active":"2024-09-12T00:07:32.078430+0000","last_peered":"2024-09-12T00:07:32.078430+0000","last_clean":"2024-09-12T00:07:32.078430+0000","last_became_active":"2024-09-12T00:03:25.335964+0000","last_became_peered":"2024-09-12T00:03:25.335964+0000","last_unstale":"2024-09-12T00:07:32.078430+0000","last_undegraded":"2024-09-12T00:07:32.078430+0000","last_fullsized":"2024-09-12T00:07:32.078430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-12T00:07:32.078212+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-12T00:07:32.078212+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.078212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:27.301937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"116'48","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.619915+0000","last_change":"2024-09-12T00:07:29.619769+0000","last_active":"2024-09-12T00:07:29.619915+0000","last_peered":"2024-09-12T00:07:29.619915+0000","last_clean":"2024-09-12T00:07:29.619915+0000","last_became_active":"2024-09-12T00:03:23.627630+0000","last_became_peered":"2024-09-12T00:03:23.627630+0000","last_unstale":"2024-09-12T00:07:29.619915+0000","last_undegraded":"2024-09-12T00:07:29.619915+0000","last_fullsized":"2024-09-12T00:07:29.619915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-09-12T00:07:29.619589+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-09-12T00:07:29.619589+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.619589+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:42.773035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"76'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717726+0000","last_change":"2024-09-12T00:06:27.903337+0000","last_active":"2024-09-12T00:06:42.717726+0000","last_peered":"2024-09-12T00:06:42.717726+0000","last_clean":"2024-09-12T00:06:42.717726+0000","last_became_active":"2024-09-12T00:06:26.660419+0000","last_became_peered":"2024-09-12T00:06:26.660419+0000","last_unstale":"2024-09-12T00:06:42.717726+0000","last_undegraded":"2024-09-12T00:06:42.717726+0000","last_fullsized":"2024-09-12T00:06:42.717726+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:43.714019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"116'58","reported_seq":260,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.669920+0000","last_change":"2024-09-12T00:07:28.669755+0000","last_active":"2024-09-12T00:07:28.669920+0000","last_peered":"2024-09-12T00:07:28.669920+0000","last_clean":"2024-09-12T00:07:28.669920+0000","last_became_active":"2024-09-12T00:03:23.625728+0000","last_became_peered":"2024-09-12T00:03:23.625728+0000","last_unstale":"2024-09-12T00:07:28.669920+0000","last_undegraded":"2024-09-12T00:07:28.669920+0000","last_fullsized":"2024-09-12T00:07:28.669920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'58","last_scrub_stamp":"2024-09-12T00:07:28.669563+0000","last_deep_scrub":"116'58","last_deep_scrub_stamp":"2024-09-12T00:07:28.669563+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.669563+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:18.098931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"96'4","reported_seq":47,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721615+0000","last_change":"2024-09-12T00:06:32.442375+0000","last_active":"2024-09-12T00:06:42.721615+0000","last_peered":"2024-09-12T00:06:42.721615+0000","last_clean":"2024-09-12T00:06:42.721615+0000","last_became_active":"2024-09-12T00:06:26.677271+0000","last_became_peered":"2024-09-12T00:06:26.677271+0000","last_unstale":"2024-09-12T00:06:42.721615+0000","last_undegraded":"2024-09-12T00:06:42.721615+0000","last_fullsized":"2024-09-12T00:06:42.721615+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:34.385926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"116'44","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.194854+0000","last_change":"2024-09-12T00:07:22.194710+0000","last_active":"2024-09-12T00:07:22.194854+0000","last_peered":"2024-09-12T00:07:22.194854+0000","last_clean":"2024-09-12T00:07:22.194854+0000","last_became_active":"2024-09-12T00:03:23.609326+0000","last_became_peered":"2024-09-12T00:03:23.609326+0000","last_unstale":"2024-09-12T00:07:22.194854+0000","last_undegraded":"2024-09-12T00:07:22.194854+0000","last_fullsized":"2024-09-12T00:07:22.194854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-09-12T00:07:22.194527+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-09-12T00:07:22.194527+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.194527+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:11.658941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'8","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.757581+0000","last_change":"2024-09-12T00:07:32.757581+0000","last_active":"2024-09-12T00:07:32.757581+0000","last_peered":"2024-09-12T00:07:32.757581+0000","last_clean":"2024-09-12T00:07:32.757581+0000","last_became_active":"2024-09-12T00:03:25.338805+0000","last_became_peered":"2024-09-12T00:03:25.338805+0000","last_unstale":"2024-09-12T00:07:32.757581+0000","last_undegraded":"2024-09-12T00:07:32.757581+0000","last_fullsized":"2024-09-12T00:07:32.757581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'8","last_scrub_stamp":"2024-09-12T00:07:32.757327+0000","last_deep_scrub":"59'8","last_deep_scrub_stamp":"2024-09-12T00:07:32.757327+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.757327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:22.657437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"116'52","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.408443+0000","last_change":"2024-09-12T00:07:24.408443+0000","last_active":"2024-09-12T00:07:24.408443+0000","last_peered":"2024-09-12T00:07:24.408443+0000","last_clean":"2024-09-12T00:07:24.408443+0000","last_became_active":"2024-09-12T00:03:23.633580+0000","last_became_peered":"2024-09-12T00:03:23.633580+0000","last_unstale":"2024-09-12T00:07:24.408443+0000","last_undegraded":"2024-09-12T00:07:24.408443+0000","last_fullsized":"2024-09-12T00:07:24.408443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'52","last_scrub_stamp":"2024-09-12T00:07:24.408218+0000","last_deep_scrub":"116'52","last_deep_scrub_stamp":"2024-09-12T00:07:24.408218+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.408218+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:51.856526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"59'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.373844+0000","last_change":"2024-09-12T00:07:31.373844+0000","last_active":"2024-09-12T00:07:31.373844+0000","last_peered":"2024-09-12T00:07:31.373844+0000","last_clean":"2024-09-12T00:07:31.373844+0000","last_became_active":"2024-09-12T00:03:25.324138+0000","last_became_peered":"2024-09-12T00:03:25.324138+0000","last_unstale":"2024-09-12T00:07:31.373844+0000","last_undegraded":"2024-09-12T00:07:31.373844+0000","last_fullsized":"2024-09-12T00:07:31.373844+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:31.373657+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:31.373657+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.373657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:41.146834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"116'42","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:17.194248+0000","last_change":"2024-09-12T00:07:17.194248+0000","last_active":"2024-09-12T00:07:17.194248+0000","last_peered":"2024-09-12T00:07:17.194248+0000","last_clean":"2024-09-12T00:07:17.194248+0000","last_became_active":"2024-09-12T00:03:23.609509+0000","last_became_peered":"2024-09-12T00:03:23.609509+0000","last_unstale":"2024-09-12T00:07:17.194248+0000","last_undegraded":"2024-09-12T00:07:17.194248+0000","last_fullsized":"2024-09-12T00:07:17.194248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-09-12T00:07:17.194144+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-09-12T00:07:17.194144+0000","last_clean_scrub_stamp":"2024-09-12T00:07:17.194144+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:20.566593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"96'12","reported_seq":249,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.360851+0000","last_change":"2024-09-12T00:07:30.360851+0000","last_active":"2024-09-12T00:07:30.360851+0000","last_peered":"2024-09-12T00:07:30.360851+0000","last_clean":"2024-09-12T00:07:30.360851+0000","last_became_active":"2024-09-12T00:03:25.355002+0000","last_became_peered":"2024-09-12T00:03:25.355002+0000","last_unstale":"2024-09-12T00:07:30.360851+0000","last_undegraded":"2024-09-12T00:07:30.360851+0000","last_fullsized":"2024-09-12T00:07:30.360851+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'12","last_scrub_stamp":"2024-09-12T00:07:30.360652+0000","last_deep_scrub":"96'12","last_deep_scrub_stamp":"2024-09-12T00:07:30.360652+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.360652+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:45.041553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"116'56","reported_seq":260,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.426625+0000","last_change":"2024-09-12T00:07:21.426625+0000","last_active":"2024-09-12T00:07:21.426625+0000","last_peered":"2024-09-12T00:07:21.426625+0000","last_clean":"2024-09-12T00:07:21.426625+0000","last_became_active":"2024-09-12T00:03:23.606143+0000","last_became_peered":"2024-09-12T00:03:23.606143+0000","last_unstale":"2024-09-12T00:07:21.426625+0000","last_undegraded":"2024-09-12T00:07:21.426625+0000","last_fullsized":"2024-09-12T00:07:21.426625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-09-12T00:07:21.426412+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-09-12T00:07:21.426412+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.426412+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:43.315445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:33.298975+0000","last_change":"2024-09-12T00:07:33.298975+0000","last_active":"2024-09-12T00:07:33.298975+0000","last_peered":"2024-09-12T00:07:33.298975+0000","last_clean":"2024-09-12T00:07:33.298975+0000","last_became_active":"2024-09-12T00:03:25.329625+0000","last_became_peered":"2024-09-12T00:03:25.329625+0000","last_unstale":"2024-09-12T00:07:33.298975+0000","last_undegraded":"2024-09-12T00:07:33.298975+0000","last_fullsized":"2024-09-12T00:07:33.298975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:33.298774+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:33.298774+0000","last_clean_scrub_stamp":"2024-09-12T00:07:33.298774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:14.492694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"116'54","reported_seq":255,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.615281+0000","last_change":"2024-09-12T00:07:32.615281+0000","last_active":"2024-09-12T00:07:32.615281+0000","last_peered":"2024-09-12T00:07:32.615281+0000","last_clean":"2024-09-12T00:07:32.615281+0000","last_became_active":"2024-09-12T00:03:23.626018+0000","last_became_peered":"2024-09-12T00:03:23.626018+0000","last_unstale":"2024-09-12T00:07:32.615281+0000","last_undegraded":"2024-09-12T00:07:32.615281+0000","last_fullsized":"2024-09-12T00:07:32.615281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'54","last_scrub_stamp":"2024-09-12T00:07:32.615096+0000","last_deep_scrub":"116'54","last_deep_scrub_stamp":"2024-09-12T00:07:32.615096+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.615096+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:50.011601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"59'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067823+0000","last_change":"2024-09-12T00:03:25.352418+0000","last_active":"2024-09-12T00:06:42.067823+0000","last_peered":"2024-09-12T00:06:42.067823+0000","last_clean":"2024-09-12T00:06:42.067823+0000","last_became_active":"2024-09-12T00:03:25.347902+0000","last_became_peered":"2024-09-12T00:03:25.347902+0000","last_unstale":"2024-09-12T00:06:42.067823+0000","last_undegraded":"2024-09-12T00:06:42.067823+0000","last_fullsized":"2024-09-12T00:06:42.067823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:29.611790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"59'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719921+0000","last_change":"2024-09-12T00:06:27.342563+0000","last_active":"2024-09-12T00:06:42.719921+0000","last_peered":"2024-09-12T00:06:42.719921+0000","last_clean":"2024-09-12T00:06:42.719921+0000","last_became_active":"2024-09-12T00:06:26.653851+0000","last_became_peered":"2024-09-12T00:06:26.653851+0000","last_unstale":"2024-09-12T00:06:42.719921+0000","last_undegraded":"2024-09-12T00:06:42.719921+0000","last_fullsized":"2024-09-12T00:06:42.719921+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:14.109429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"116'34","reported_seq":310,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.047258+0000","last_change":"2024-09-12T00:07:20.047258+0000","last_active":"2024-09-12T00:07:20.047258+0000","last_peered":"2024-09-12T00:07:20.047258+0000","last_clean":"2024-09-12T00:07:20.047258+0000","last_became_active":"2024-09-12T00:06:26.664959+0000","last_became_peered":"2024-09-12T00:06:26.664959+0000","last_unstale":"2024-09-12T00:07:20.047258+0000","last_undegraded":"2024-09-12T00:07:20.047258+0000","last_fullsized":"2024-09-12T00:07:20.047258+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'34","last_scrub_stamp":"2024-09-12T00:07:20.047081+0000","last_deep_scrub":"116'34","last_deep_scrub_stamp":"2024-09-12T00:07:20.047081+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.047081+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:54.885211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"59'2","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.352578+0000","last_change":"2024-09-12T00:07:29.352578+0000","last_active":"2024-09-12T00:07:29.352578+0000","last_peered":"2024-09-12T00:07:29.352578+0000","last_clean":"2024-09-12T00:07:29.352578+0000","last_became_active":"2024-09-12T00:03:25.334375+0000","last_became_peered":"2024-09-12T00:03:25.334375+0000","last_unstale":"2024-09-12T00:07:29.352578+0000","last_undegraded":"2024-09-12T00:07:29.352578+0000","last_fullsized":"2024-09-12T00:07:29.352578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:29.352370+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:29.352370+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.352370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:34.512492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"116'40","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.426222+0000","last_change":"2024-09-12T00:07:23.426222+0000","last_active":"2024-09-12T00:07:23.426222+0000","last_peered":"2024-09-12T00:07:23.426222+0000","last_clean":"2024-09-12T00:07:23.426222+0000","last_became_active":"2024-09-12T00:03:23.614019+0000","last_became_peered":"2024-09-12T00:03:23.614019+0000","last_unstale":"2024-09-12T00:07:23.426222+0000","last_undegraded":"2024-09-12T00:07:23.426222+0000","last_fullsized":"2024-09-12T00:07:23.426222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-09-12T00:07:23.426027+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-09-12T00:07:23.426027+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.426027+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:38.438913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"96'12","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.151228+0000","last_change":"2024-09-12T00:07:26.151228+0000","last_active":"2024-09-12T00:07:26.151228+0000","last_peered":"2024-09-12T00:07:26.151228+0000","last_clean":"2024-09-12T00:07:26.151228+0000","last_became_active":"2024-09-12T00:03:25.357571+0000","last_became_peered":"2024-09-12T00:03:25.357571+0000","last_unstale":"2024-09-12T00:07:26.151228+0000","last_undegraded":"2024-09-12T00:07:26.151228+0000","last_fullsized":"2024-09-12T00:07:26.151228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'12","last_scrub_stamp":"2024-09-12T00:07:26.151041+0000","last_deep_scrub":"96'12","last_deep_scrub_stamp":"2024-09-12T00:07:26.151041+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.151041+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:51.666529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"116'46","reported_seq":346,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.398246+0000","last_change":"2024-09-12T00:07:22.398246+0000","last_active":"2024-09-12T00:07:22.398246+0000","last_peered":"2024-09-12T00:07:22.398246+0000","last_clean":"2024-09-12T00:07:22.398246+0000","last_became_active":"2024-09-12T00:06:26.682027+0000","last_became_peered":"2024-09-12T00:06:26.682027+0000","last_unstale":"2024-09-12T00:07:22.398246+0000","last_undegraded":"2024-09-12T00:07:22.398246+0000","last_fullsized":"2024-09-12T00:07:22.398246+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:22.398067+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:22.398067+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.398067+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:27.681427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":167772160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'8","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.381628+0000","last_change":"2024-09-12T00:07:31.381628+0000","last_active":"2024-09-12T00:07:31.381628+0000","last_peered":"2024-09-12T00:07:31.381628+0000","last_clean":"2024-09-12T00:07:31.381628+0000","last_became_active":"2024-09-12T00:03:25.344959+0000","last_became_peered":"2024-09-12T00:03:25.344959+0000","last_unstale":"2024-09-12T00:07:31.381628+0000","last_undegraded":"2024-09-12T00:07:31.381628+0000","last_fullsized":"2024-09-12T00:07:31.381628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'8","last_scrub_stamp":"2024-09-12T00:07:31.381429+0000","last_deep_scrub":"63'8","last_deep_scrub_stamp":"2024-09-12T00:07:31.381429+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.381429+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:29.418399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"116'34","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.425570+0000","last_change":"2024-09-12T00:07:20.425570+0000","last_active":"2024-09-12T00:07:20.425570+0000","last_peered":"2024-09-12T00:07:20.425570+0000","last_clean":"2024-09-12T00:07:20.425570+0000","last_became_active":"2024-09-12T00:03:23.602640+0000","last_became_peered":"2024-09-12T00:03:23.602640+0000","last_unstale":"2024-09-12T00:07:20.425570+0000","last_undegraded":"2024-09-12T00:07:20.425570+0000","last_fullsized":"2024-09-12T00:07:20.425570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'34","last_scrub_stamp":"2024-09-12T00:07:20.425354+0000","last_deep_scrub":"116'34","last_deep_scrub_stamp":"2024-09-12T00:07:20.425354+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.425354+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:13.305799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"59'2","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066326+0000","last_change":"2024-09-12T00:06:28.300294+0000","last_active":"2024-09-12T00:06:42.066326+0000","last_peered":"2024-09-12T00:06:42.066326+0000","last_clean":"2024-09-12T00:06:42.066326+0000","last_became_active":"2024-09-12T00:06:26.665307+0000","last_became_peered":"2024-09-12T00:06:26.665307+0000","last_unstale":"2024-09-12T00:06:42.066326+0000","last_undegraded":"2024-09-12T00:06:42.066326+0000","last_fullsized":"2024-09-12T00:06:42.066326+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:18.349268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"116'46","reported_seq":249,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.363096+0000","last_change":"2024-09-12T00:07:24.363096+0000","last_active":"2024-09-12T00:07:24.363096+0000","last_peered":"2024-09-12T00:07:24.363096+0000","last_clean":"2024-09-12T00:07:24.363096+0000","last_became_active":"2024-09-12T00:03:23.603932+0000","last_became_peered":"2024-09-12T00:03:23.603932+0000","last_unstale":"2024-09-12T00:07:24.363096+0000","last_undegraded":"2024-09-12T00:07:24.363096+0000","last_fullsized":"2024-09-12T00:07:24.363096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:24.362915+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:24.362915+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.362915+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:05.312564+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"76'4","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.150664+0000","last_change":"2024-09-12T00:07:28.150664+0000","last_active":"2024-09-12T00:07:28.150664+0000","last_peered":"2024-09-12T00:07:28.150664+0000","last_clean":"2024-09-12T00:07:28.150664+0000","last_became_active":"2024-09-12T00:03:25.340828+0000","last_became_peered":"2024-09-12T00:03:25.340828+0000","last_unstale":"2024-09-12T00:07:28.150664+0000","last_undegraded":"2024-09-12T00:07:28.150664+0000","last_fullsized":"2024-09-12T00:07:28.150664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-12T00:07:28.150477+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-12T00:07:28.150477+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.150477+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:39.470463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"116'36","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.388542+0000","last_change":"2024-09-12T00:07:23.388542+0000","last_active":"2024-09-12T00:07:23.388542+0000","last_peered":"2024-09-12T00:07:23.388542+0000","last_clean":"2024-09-12T00:07:23.388542+0000","last_became_active":"2024-09-12T00:03:23.601892+0000","last_became_peered":"2024-09-12T00:03:23.601892+0000","last_unstale":"2024-09-12T00:07:23.388542+0000","last_undegraded":"2024-09-12T00:07:23.388542+0000","last_fullsized":"2024-09-12T00:07:23.388542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'36","last_scrub_stamp":"2024-09-12T00:07:23.388307+0000","last_deep_scrub":"116'36","last_deep_scrub_stamp":"2024-09-12T00:07:23.388307+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.388307+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:49.870399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.808845+0000","last_change":"2024-09-12T00:03:33.354850+0000","last_active":"2024-09-12T00:06:41.808845+0000","last_peered":"2024-09-12T00:06:41.808845+0000","last_clean":"2024-09-12T00:06:41.808845+0000","last_became_active":"2024-09-12T00:03:33.351917+0000","last_became_peered":"2024-09-12T00:03:33.351917+0000","last_unstale":"2024-09-12T00:06:41.808845+0000","last_undegraded":"2024-09-12T00:06:41.808845+0000","last_fullsized":"2024-09-12T00:06:41.808845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:00.466863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"59'6","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.387825+0000","last_change":"2024-09-12T00:07:29.387825+0000","last_active":"2024-09-12T00:07:29.387825+0000","last_peered":"2024-09-12T00:07:29.387825+0000","last_clean":"2024-09-12T00:07:29.387825+0000","last_became_active":"2024-09-12T00:03:25.322456+0000","last_became_peered":"2024-09-12T00:03:25.322456+0000","last_unstale":"2024-09-12T00:07:29.387825+0000","last_undegraded":"2024-09-12T00:07:29.387825+0000","last_fullsized":"2024-09-12T00:07:29.387825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2024-09-12T00:07:29.387638+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2024-09-12T00:07:29.387638+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.387638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:09.600578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"116'54","reported_seq":132,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.983716+0000","last_change":"2024-09-12T00:07:26.983716+0000","last_active":"2024-09-12T00:07:26.983716+0000","last_peered":"2024-09-12T00:07:26.983716+0000","last_clean":"2024-09-12T00:07:26.983716+0000","last_became_active":"2024-09-12T00:06:26.648460+0000","last_became_peered":"2024-09-12T00:06:26.648460+0000","last_unstale":"2024-09-12T00:07:26.983716+0000","last_undegraded":"2024-09-12T00:07:26.983716+0000","last_fullsized":"2024-09-12T00:07:26.983716+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'54","last_scrub_stamp":"2024-09-12T00:07:26.983503+0000","last_deep_scrub":"116'54","last_deep_scrub_stamp":"2024-09-12T00:07:26.983503+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.983503+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:54.178198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717693+0000","last_change":"2024-09-12T00:06:26.675813+0000","last_active":"2024-09-12T00:06:42.717693+0000","last_peered":"2024-09-12T00:06:42.717693+0000","last_clean":"2024-09-12T00:06:42.717693+0000","last_became_active":"2024-09-12T00:06:26.663654+0000","last_became_peered":"2024-09-12T00:06:26.663654+0000","last_unstale":"2024-09-12T00:06:42.717693+0000","last_undegraded":"2024-09-12T00:06:42.717693+0000","last_fullsized":"2024-09-12T00:06:42.717693+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:22.865255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"116'32","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.977265+0000","last_change":"2024-09-12T00:03:29.347224+0000","last_active":"2024-09-12T00:07:11.977265+0000","last_peered":"2024-09-12T00:07:11.977265+0000","last_clean":"2024-09-12T00:07:11.977265+0000","last_became_active":"2024-09-12T00:03:29.346662+0000","last_became_peered":"2024-09-12T00:03:29.346662+0000","last_unstale":"2024-09-12T00:07:11.977265+0000","last_undegraded":"2024-09-12T00:07:11.977265+0000","last_fullsized":"2024-09-12T00:07:11.977265+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:28.258932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501404+0000","last_change":"2024-09-12T00:03:31.337219+0000","last_active":"2024-09-12T00:06:42.501404+0000","last_peered":"2024-09-12T00:06:42.501404+0000","last_clean":"2024-09-12T00:06:42.501404+0000","last_became_active":"2024-09-12T00:03:31.336317+0000","last_became_peered":"2024-09-12T00:03:31.336317+0000","last_unstale":"2024-09-12T00:06:42.501404+0000","last_undegraded":"2024-09-12T00:06:42.501404+0000","last_fullsized":"2024-09-12T00:06:42.501404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:50.954053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"96'48","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499219+0000","last_change":"2024-09-12T00:03:33.376628+0000","last_active":"2024-09-12T00:06:42.499219+0000","last_peered":"2024-09-12T00:06:42.499219+0000","last_clean":"2024-09-12T00:06:42.499219+0000","last_became_active":"2024-09-12T00:03:33.375938+0000","last_became_peered":"2024-09-12T00:03:33.375938+0000","last_unstale":"2024-09-12T00:06:42.499219+0000","last_undegraded":"2024-09-12T00:06:42.499219+0000","last_fullsized":"2024-09-12T00:06:42.499219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:31.105042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"84'8","reported_seq":51,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717938+0000","last_change":"2024-09-12T00:06:32.981663+0000","last_active":"2024-09-12T00:06:42.717938+0000","last_peered":"2024-09-12T00:06:42.717938+0000","last_clean":"2024-09-12T00:06:42.717938+0000","last_became_active":"2024-09-12T00:06:26.679390+0000","last_became_peered":"2024-09-12T00:06:26.679390+0000","last_unstale":"2024-09-12T00:06:42.717938+0000","last_undegraded":"2024-09-12T00:06:42.717938+0000","last_fullsized":"2024-09-12T00:06:42.717938+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.655318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"116'28","reported_seq":289,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.365269+0000","last_change":"2024-09-12T00:07:18.365269+0000","last_active":"2024-09-12T00:07:18.365269+0000","last_peered":"2024-09-12T00:07:18.365269+0000","last_clean":"2024-09-12T00:07:18.365269+0000","last_became_active":"2024-09-12T00:06:26.675473+0000","last_became_peered":"2024-09-12T00:06:26.675473+0000","last_unstale":"2024-09-12T00:07:18.365269+0000","last_undegraded":"2024-09-12T00:07:18.365269+0000","last_fullsized":"2024-09-12T00:07:18.365269+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-09-12T00:07:18.365092+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-09-12T00:07:18.365092+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.365092+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:28.752797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812081+0000","last_change":"2024-09-12T00:03:27.336108+0000","last_active":"2024-09-12T00:06:41.812081+0000","last_peered":"2024-09-12T00:06:41.812081+0000","last_clean":"2024-09-12T00:06:41.812081+0000","last_became_active":"2024-09-12T00:03:27.335308+0000","last_became_peered":"2024-09-12T00:03:27.335308+0000","last_unstale":"2024-09-12T00:06:41.812081+0000","last_undegraded":"2024-09-12T00:06:41.812081+0000","last_fullsized":"2024-09-12T00:06:41.812081+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:39.812803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'12","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501517+0000","last_change":"2024-09-12T00:03:29.352496+0000","last_active":"2024-09-12T00:06:42.501517+0000","last_peered":"2024-09-12T00:06:42.501517+0000","last_clean":"2024-09-12T00:06:42.501517+0000","last_became_active":"2024-09-12T00:03:29.351783+0000","last_became_peered":"2024-09-12T00:03:29.351783+0000","last_unstale":"2024-09-12T00:06:42.501517+0000","last_undegraded":"2024-09-12T00:06:42.501517+0000","last_fullsized":"2024-09-12T00:06:42.501517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501338+0000","last_change":"2024-09-12T00:03:31.350279+0000","last_active":"2024-09-12T00:06:42.501338+0000","last_peered":"2024-09-12T00:06:42.501338+0000","last_clean":"2024-09-12T00:06:42.501338+0000","last_became_active":"2024-09-12T00:03:31.349244+0000","last_became_peered":"2024-09-12T00:03:31.349244+0000","last_unstale":"2024-09-12T00:06:42.501338+0000","last_undegraded":"2024-09-12T00:06:42.501338+0000","last_fullsized":"2024-09-12T00:06:42.501338+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.420974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719171+0000","last_change":"2024-09-12T00:03:33.382726+0000","last_active":"2024-09-12T00:06:42.719171+0000","last_peered":"2024-09-12T00:06:42.719171+0000","last_clean":"2024-09-12T00:06:42.719171+0000","last_became_active":"2024-09-12T00:03:33.381875+0000","last_became_peered":"2024-09-12T00:03:33.381875+0000","last_unstale":"2024-09-12T00:06:42.719171+0000","last_undegraded":"2024-09-12T00:06:42.719171+0000","last_fullsized":"2024-09-12T00:06:42.719171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"63'12","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:33.626384+0000","last_change":"2024-09-12T00:07:33.626384+0000","last_active":"2024-09-12T00:07:33.626384+0000","last_peered":"2024-09-12T00:07:33.626384+0000","last_clean":"2024-09-12T00:07:33.626384+0000","last_became_active":"2024-09-12T00:03:25.355174+0000","last_became_peered":"2024-09-12T00:03:25.355174+0000","last_unstale":"2024-09-12T00:07:33.626384+0000","last_undegraded":"2024-09-12T00:07:33.626384+0000","last_fullsized":"2024-09-12T00:07:33.626384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'12","last_scrub_stamp":"2024-09-12T00:07:33.626194+0000","last_deep_scrub":"63'12","last_deep_scrub_stamp":"2024-09-12T00:07:33.626194+0000","last_clean_scrub_stamp":"2024-09-12T00:07:33.626194+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:12.596617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"116'42","reported_seq":114,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.948934+0000","last_change":"2024-09-12T00:07:25.948934+0000","last_active":"2024-09-12T00:07:25.948934+0000","last_peered":"2024-09-12T00:07:25.948934+0000","last_clean":"2024-09-12T00:07:25.948934+0000","last_became_active":"2024-09-12T00:06:26.670936+0000","last_became_peered":"2024-09-12T00:06:26.670936+0000","last_unstale":"2024-09-12T00:07:25.948934+0000","last_undegraded":"2024-09-12T00:07:25.948934+0000","last_fullsized":"2024-09-12T00:07:25.948934+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-09-12T00:07:25.948727+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-09-12T00:07:25.948727+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.948727+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:09.232455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813428+0000","last_change":"2024-09-12T00:03:27.347098+0000","last_active":"2024-09-12T00:06:41.813428+0000","last_peered":"2024-09-12T00:06:41.813428+0000","last_clean":"2024-09-12T00:06:41.813428+0000","last_became_active":"2024-09-12T00:03:27.346346+0000","last_became_peered":"2024-09-12T00:03:27.346346+0000","last_unstale":"2024-09-12T00:06:41.813428+0000","last_undegraded":"2024-09-12T00:06:41.813428+0000","last_fullsized":"2024-09-12T00:06:41.813428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:56.250627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'22","reported_seq":265,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812213+0000","last_change":"2024-09-12T00:06:27.562833+0000","last_active":"2024-09-12T00:06:41.812213+0000","last_peered":"2024-09-12T00:06:41.812213+0000","last_clean":"2024-09-12T00:06:41.812213+0000","last_became_active":"2024-09-12T00:06:26.654182+0000","last_became_peered":"2024-09-12T00:06:26.654182+0000","last_unstale":"2024-09-12T00:06:41.812213+0000","last_undegraded":"2024-09-12T00:06:41.812213+0000","last_fullsized":"2024-09-12T00:06:41.812213+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:01.211483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"116'143","reported_seq":365,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:10.885348+0000","last_change":"2024-09-12T00:06:30.699178+0000","last_active":"2024-09-12T00:07:10.885348+0000","last_peered":"2024-09-12T00:07:10.885348+0000","last_clean":"2024-09-12T00:07:10.885348+0000","last_became_active":"2024-09-12T00:06:30.698465+0000","last_became_peered":"2024-09-12T00:06:30.698465+0000","last_unstale":"2024-09-12T00:07:10.885348+0000","last_undegraded":"2024-09-12T00:07:10.885348+0000","last_fullsized":"2024-09-12T00:07:10.885348+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:48.150663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810365+0000","last_change":"2024-09-12T00:03:33.378439+0000","last_active":"2024-09-12T00:06:41.810365+0000","last_peered":"2024-09-12T00:06:41.810365+0000","last_clean":"2024-09-12T00:06:41.810365+0000","last_became_active":"2024-09-12T00:03:33.374453+0000","last_became_peered":"2024-09-12T00:03:33.374453+0000","last_unstale":"2024-09-12T00:06:41.810365+0000","last_undegraded":"2024-09-12T00:06:41.810365+0000","last_fullsized":"2024-09-12T00:06:41.810365+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:46.874457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"58'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.067326+0000","last_change":"2024-09-12T00:03:25.356433+0000","last_active":"2024-09-12T00:06:42.067326+0000","last_peered":"2024-09-12T00:06:42.067326+0000","last_clean":"2024-09-12T00:06:42.067326+0000","last_became_active":"2024-09-12T00:03:25.354803+0000","last_became_peered":"2024-09-12T00:03:25.354803+0000","last_unstale":"2024-09-12T00:06:42.067326+0000","last_undegraded":"2024-09-12T00:06:42.067326+0000","last_fullsized":"2024-09-12T00:06:42.067326+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:00.419686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"116'46","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.073913+0000","last_change":"2024-09-12T00:07:21.073913+0000","last_active":"2024-09-12T00:07:21.073913+0000","last_peered":"2024-09-12T00:07:21.073913+0000","last_clean":"2024-09-12T00:07:21.073913+0000","last_became_active":"2024-09-12T00:03:23.630183+0000","last_became_peered":"2024-09-12T00:03:23.630183+0000","last_unstale":"2024-09-12T00:07:21.073913+0000","last_undegraded":"2024-09-12T00:07:21.073913+0000","last_fullsized":"2024-09-12T00:07:21.073913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:21.073723+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:21.073723+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.073723+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:47.555815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721999+0000","last_change":"2024-09-12T00:06:26.671315+0000","last_active":"2024-09-12T00:06:42.721999+0000","last_peered":"2024-09-12T00:06:42.721999+0000","last_clean":"2024-09-12T00:06:42.721999+0000","last_became_active":"2024-09-12T00:06:26.669946+0000","last_became_peered":"2024-09-12T00:06:26.669946+0000","last_unstale":"2024-09-12T00:06:42.721999+0000","last_undegraded":"2024-09-12T00:06:42.721999+0000","last_fullsized":"2024-09-12T00:06:42.721999+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:53.569121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"116'30","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.273166+0000","last_change":"2024-09-12T00:07:32.273166+0000","last_active":"2024-09-12T00:07:32.273166+0000","last_peered":"2024-09-12T00:07:32.273166+0000","last_clean":"2024-09-12T00:07:32.273166+0000","last_became_active":"2024-09-12T00:03:29.338810+0000","last_became_peered":"2024-09-12T00:03:29.338810+0000","last_unstale":"2024-09-12T00:07:32.273166+0000","last_undegraded":"2024-09-12T00:07:32.273166+0000","last_fullsized":"2024-09-12T00:07:32.273166+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'30","last_scrub_stamp":"2024-09-12T00:07:32.272962+0000","last_deep_scrub":"116'30","last_deep_scrub_stamp":"2024-09-12T00:07:32.272962+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.272962+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:29.833021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"116'138","reported_seq":435,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:10.896150+0000","last_change":"2024-09-12T00:03:31.364647+0000","last_active":"2024-09-12T00:07:10.896150+0000","last_peered":"2024-09-12T00:07:10.896150+0000","last_clean":"2024-09-12T00:07:10.896150+0000","last_became_active":"2024-09-12T00:03:31.353547+0000","last_became_peered":"2024-09-12T00:03:31.353547+0000","last_unstale":"2024-09-12T00:07:10.896150+0000","last_undegraded":"2024-09-12T00:07:10.896150+0000","last_fullsized":"2024-09-12T00:07:10.896150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:20.795870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"63'4","reported_seq":47,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717416+0000","last_change":"2024-09-12T00:06:27.339590+0000","last_active":"2024-09-12T00:06:42.717416+0000","last_peered":"2024-09-12T00:06:42.717416+0000","last_clean":"2024-09-12T00:06:42.717416+0000","last_became_active":"2024-09-12T00:06:26.651618+0000","last_became_peered":"2024-09-12T00:06:26.651618+0000","last_unstale":"2024-09-12T00:06:42.717416+0000","last_undegraded":"2024-09-12T00:06:42.717416+0000","last_fullsized":"2024-09-12T00:06:42.717416+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:58.850777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"116'56","reported_seq":261,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.444385+0000","last_change":"2024-09-12T00:07:18.444385+0000","last_active":"2024-09-12T00:07:18.444385+0000","last_peered":"2024-09-12T00:07:18.444385+0000","last_clean":"2024-09-12T00:07:18.444385+0000","last_became_active":"2024-09-12T00:03:23.601898+0000","last_became_peered":"2024-09-12T00:03:23.601898+0000","last_unstale":"2024-09-12T00:07:18.444385+0000","last_undegraded":"2024-09-12T00:07:18.444385+0000","last_fullsized":"2024-09-12T00:07:18.444385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-09-12T00:07:18.444202+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-09-12T00:07:18.444202+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.444202+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:27.955570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":64,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.151045+0000","last_change":"2024-09-12T00:07:29.151045+0000","last_active":"2024-09-12T00:07:29.151045+0000","last_peered":"2024-09-12T00:07:29.151045+0000","last_clean":"2024-09-12T00:07:29.151045+0000","last_became_active":"2024-09-12T00:03:27.329672+0000","last_became_peered":"2024-09-12T00:03:27.329672+0000","last_unstale":"2024-09-12T00:07:29.151045+0000","last_undegraded":"2024-09-12T00:07:29.151045+0000","last_fullsized":"2024-09-12T00:07:29.151045+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:29.150854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:29.150854+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.150854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:16.923691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"116'37","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:10.997583+0000","last_change":"2024-09-12T00:03:29.335931+0000","last_active":"2024-09-12T00:07:10.997583+0000","last_peered":"2024-09-12T00:07:10.997583+0000","last_clean":"2024-09-12T00:07:10.997583+0000","last_became_active":"2024-09-12T00:03:29.335044+0000","last_became_peered":"2024-09-12T00:03:29.335044+0000","last_unstale":"2024-09-12T00:07:10.997583+0000","last_undegraded":"2024-09-12T00:07:10.997583+0000","last_fullsized":"2024-09-12T00:07:10.997583+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:57.131209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719379+0000","last_change":"2024-09-12T00:03:31.355001+0000","last_active":"2024-09-12T00:06:42.719379+0000","last_peered":"2024-09-12T00:06:42.719379+0000","last_clean":"2024-09-12T00:06:42.719379+0000","last_became_active":"2024-09-12T00:03:31.354160+0000","last_became_peered":"2024-09-12T00:03:31.354160+0000","last_unstale":"2024-09-12T00:06:42.719379+0000","last_undegraded":"2024-09-12T00:06:42.719379+0000","last_fullsized":"2024-09-12T00:06:42.719379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:29.868141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810884+0000","last_change":"2024-09-12T00:06:26.664709+0000","last_active":"2024-09-12T00:06:41.810884+0000","last_peered":"2024-09-12T00:06:41.810884+0000","last_clean":"2024-09-12T00:06:41.810884+0000","last_became_active":"2024-09-12T00:06:26.664401+0000","last_became_peered":"2024-09-12T00:06:26.664401+0000","last_unstale":"2024-09-12T00:06:41.810884+0000","last_undegraded":"2024-09-12T00:06:41.810884+0000","last_fullsized":"2024-09-12T00:06:41.810884+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:17.791780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.072730+0000","last_change":"2024-09-12T00:07:22.072730+0000","last_active":"2024-09-12T00:07:22.072730+0000","last_peered":"2024-09-12T00:07:22.072730+0000","last_clean":"2024-09-12T00:07:22.072730+0000","last_became_active":"2024-09-12T00:03:25.356970+0000","last_became_peered":"2024-09-12T00:03:25.356970+0000","last_unstale":"2024-09-12T00:07:22.072730+0000","last_undegraded":"2024-09-12T00:07:22.072730+0000","last_fullsized":"2024-09-12T00:07:22.072730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:22.072506+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:22.072506+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.072506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:03.022155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"116'38","reported_seq":240,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.219294+0000","last_change":"2024-09-12T00:07:18.219294+0000","last_active":"2024-09-12T00:07:18.219294+0000","last_peered":"2024-09-12T00:07:18.219294+0000","last_clean":"2024-09-12T00:07:18.219294+0000","last_became_active":"2024-09-12T00:03:23.609435+0000","last_became_peered":"2024-09-12T00:03:23.609435+0000","last_unstale":"2024-09-12T00:07:18.219294+0000","last_undegraded":"2024-09-12T00:07:18.219294+0000","last_fullsized":"2024-09-12T00:07:18.219294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'38","last_scrub_stamp":"2024-09-12T00:07:18.219203+0000","last_deep_scrub":"116'38","last_deep_scrub_stamp":"2024-09-12T00:07:18.219203+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.219203+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:10.654482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.397357+0000","last_change":"2024-09-12T00:07:32.397357+0000","last_active":"2024-09-12T00:07:32.397357+0000","last_peered":"2024-09-12T00:07:32.397357+0000","last_clean":"2024-09-12T00:07:32.397357+0000","last_became_active":"2024-09-12T00:03:27.338880+0000","last_became_peered":"2024-09-12T00:03:27.338880+0000","last_unstale":"2024-09-12T00:07:32.397357+0000","last_undegraded":"2024-09-12T00:07:32.397357+0000","last_fullsized":"2024-09-12T00:07:32.397357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:32.397180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:32.397180+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.397180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:00.449041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"116'29","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.509812+0000","last_change":"2024-09-12T00:03:29.337666+0000","last_active":"2024-09-12T00:07:11.509812+0000","last_peered":"2024-09-12T00:07:11.509812+0000","last_clean":"2024-09-12T00:07:11.509812+0000","last_became_active":"2024-09-12T00:03:29.336957+0000","last_became_peered":"2024-09-12T00:03:29.336957+0000","last_unstale":"2024-09-12T00:07:11.509812+0000","last_undegraded":"2024-09-12T00:07:11.509812+0000","last_fullsized":"2024-09-12T00:07:11.509812+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:58.417315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":36,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810940+0000","last_change":"2024-09-12T00:03:31.348590+0000","last_active":"2024-09-12T00:06:41.810940+0000","last_peered":"2024-09-12T00:06:41.810940+0000","last_clean":"2024-09-12T00:06:41.810940+0000","last_became_active":"2024-09-12T00:03:31.347736+0000","last_became_peered":"2024-09-12T00:03:31.347736+0000","last_unstale":"2024-09-12T00:06:41.810940+0000","last_undegraded":"2024-09-12T00:06:41.810940+0000","last_fullsized":"2024-09-12T00:06:41.810940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:04.962492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"59'8","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500524+0000","last_change":"2024-09-12T00:03:33.379699+0000","last_active":"2024-09-12T00:06:42.500524+0000","last_peered":"2024-09-12T00:06:42.500524+0000","last_clean":"2024-09-12T00:06:42.500524+0000","last_became_active":"2024-09-12T00:03:33.378945+0000","last_became_peered":"2024-09-12T00:03:33.378945+0000","last_unstale":"2024-09-12T00:06:42.500524+0000","last_undegraded":"2024-09-12T00:06:42.500524+0000","last_fullsized":"2024-09-12T00:06:42.500524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:23.270488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'6","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.164572+0000","last_change":"2024-09-12T00:07:23.164572+0000","last_active":"2024-09-12T00:07:23.164572+0000","last_peered":"2024-09-12T00:07:23.164572+0000","last_clean":"2024-09-12T00:07:23.164572+0000","last_became_active":"2024-09-12T00:06:26.668131+0000","last_became_peered":"2024-09-12T00:06:26.668131+0000","last_unstale":"2024-09-12T00:07:23.164572+0000","last_undegraded":"2024-09-12T00:07:23.164572+0000","last_fullsized":"2024-09-12T00:07:23.164572+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-09-12T00:07:23.164381+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-09-12T00:07:23.164381+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.164381+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:10.937218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"116'34","reported_seq":102,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.919676+0000","last_change":"2024-09-12T00:07:23.919676+0000","last_active":"2024-09-12T00:07:23.919676+0000","last_peered":"2024-09-12T00:07:23.919676+0000","last_clean":"2024-09-12T00:07:23.919676+0000","last_became_active":"2024-09-12T00:06:26.679723+0000","last_became_peered":"2024-09-12T00:06:26.679723+0000","last_unstale":"2024-09-12T00:07:23.919676+0000","last_undegraded":"2024-09-12T00:07:23.919676+0000","last_fullsized":"2024-09-12T00:07:23.919676+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'34","last_scrub_stamp":"2024-09-12T00:07:23.919458+0000","last_deep_scrub":"116'34","last_deep_scrub_stamp":"2024-09-12T00:07:23.919458+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.919458+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:33.257574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065103+0000","last_change":"2024-09-12T00:03:27.348080+0000","last_active":"2024-09-12T00:06:42.065103+0000","last_peered":"2024-09-12T00:06:42.065103+0000","last_clean":"2024-09-12T00:06:42.065103+0000","last_became_active":"2024-09-12T00:03:27.347288+0000","last_became_peered":"2024-09-12T00:03:27.347288+0000","last_unstale":"2024-09-12T00:06:42.065103+0000","last_undegraded":"2024-09-12T00:06:42.065103+0000","last_fullsized":"2024-09-12T00:06:42.065103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:37.033224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"116'41","reported_seq":69,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.324749+0000","last_change":"2024-09-12T00:06:28.360303+0000","last_active":"2024-09-12T00:07:11.324749+0000","last_peered":"2024-09-12T00:07:11.324749+0000","last_clean":"2024-09-12T00:07:11.324749+0000","last_became_active":"2024-09-12T00:06:26.668791+0000","last_became_peered":"2024-09-12T00:06:26.668791+0000","last_unstale":"2024-09-12T00:07:11.324749+0000","last_undegraded":"2024-09-12T00:07:11.324749+0000","last_fullsized":"2024-09-12T00:07:11.324749+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:49.033011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":54,"num_read_kb":275,"num_write":34,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":116871,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"116'138","reported_seq":354,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:10.898989+0000","last_change":"2024-09-12T00:03:31.354114+0000","last_active":"2024-09-12T00:07:10.898989+0000","last_peered":"2024-09-12T00:07:10.898989+0000","last_clean":"2024-09-12T00:07:10.898989+0000","last_became_active":"2024-09-12T00:03:31.353358+0000","last_became_peered":"2024-09-12T00:03:31.353358+0000","last_unstale":"2024-09-12T00:07:10.898989+0000","last_undegraded":"2024-09-12T00:07:10.898989+0000","last_fullsized":"2024-09-12T00:07:10.898989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:56.624718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719909+0000","last_change":"2024-09-12T00:03:33.383917+0000","last_active":"2024-09-12T00:06:42.719909+0000","last_peered":"2024-09-12T00:06:42.719909+0000","last_clean":"2024-09-12T00:06:42.719909+0000","last_became_active":"2024-09-12T00:03:33.383199+0000","last_became_peered":"2024-09-12T00:03:33.383199+0000","last_unstale":"2024-09-12T00:06:42.719909+0000","last_undegraded":"2024-09-12T00:06:42.719909+0000","last_fullsized":"2024-09-12T00:06:42.719909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:37.428182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"84'10","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.602399+0000","last_change":"2024-09-12T00:07:30.602399+0000","last_active":"2024-09-12T00:07:30.602399+0000","last_peered":"2024-09-12T00:07:30.602399+0000","last_clean":"2024-09-12T00:07:30.602399+0000","last_became_active":"2024-09-12T00:03:25.354555+0000","last_became_peered":"2024-09-12T00:03:25.354555+0000","last_unstale":"2024-09-12T00:07:30.602399+0000","last_undegraded":"2024-09-12T00:07:30.602399+0000","last_fullsized":"2024-09-12T00:07:30.602399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'10","last_scrub_stamp":"2024-09-12T00:07:30.602214+0000","last_deep_scrub":"84'10","last_deep_scrub_stamp":"2024-09-12T00:07:30.602214+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.602214+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:28.647997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"116'78","reported_seq":282,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:17.443738+0000","last_change":"2024-09-12T00:07:17.443738+0000","last_active":"2024-09-12T00:07:17.443738+0000","last_peered":"2024-09-12T00:07:17.443738+0000","last_clean":"2024-09-12T00:07:17.443738+0000","last_became_active":"2024-09-12T00:03:23.612165+0000","last_became_peered":"2024-09-12T00:03:23.612165+0000","last_unstale":"2024-09-12T00:07:17.443738+0000","last_undegraded":"2024-09-12T00:07:17.443738+0000","last_fullsized":"2024-09-12T00:07:17.443738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'78","last_scrub_stamp":"2024-09-12T00:07:17.443535+0000","last_deep_scrub":"116'78","last_deep_scrub_stamp":"2024-09-12T00:07:17.443535+0000","last_clean_scrub_stamp":"2024-09-12T00:07:17.443535+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:50.491633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":78,"num_write_kb":159744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:33.379002+0000","last_change":"2024-09-12T00:07:33.379002+0000","last_active":"2024-09-12T00:07:33.379002+0000","last_peered":"2024-09-12T00:07:33.379002+0000","last_clean":"2024-09-12T00:07:33.379002+0000","last_became_active":"2024-09-12T00:03:27.328497+0000","last_became_peered":"2024-09-12T00:03:27.328497+0000","last_unstale":"2024-09-12T00:07:33.379002+0000","last_undegraded":"2024-09-12T00:07:33.379002+0000","last_fullsized":"2024-09-12T00:07:33.379002+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:33.378826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:33.378826+0000","last_clean_scrub_stamp":"2024-09-12T00:07:33.378826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:30.180214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"116'50","reported_seq":263,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.790389+0000","last_change":"2024-09-12T00:03:29.332778+0000","last_active":"2024-09-12T00:07:11.790389+0000","last_peered":"2024-09-12T00:07:11.790389+0000","last_clean":"2024-09-12T00:07:11.790389+0000","last_became_active":"2024-09-12T00:03:29.332010+0000","last_became_peered":"2024-09-12T00:03:29.332010+0000","last_unstale":"2024-09-12T00:07:11.790389+0000","last_undegraded":"2024-09-12T00:07:11.790389+0000","last_fullsized":"2024-09-12T00:07:11.790389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:13.563107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":65,"num_read_kb":292,"num_write":38,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065300+0000","last_change":"2024-09-12T00:03:31.354374+0000","last_active":"2024-09-12T00:06:42.065300+0000","last_peered":"2024-09-12T00:06:42.065300+0000","last_clean":"2024-09-12T00:06:42.065300+0000","last_became_active":"2024-09-12T00:03:31.353407+0000","last_became_peered":"2024-09-12T00:03:31.353407+0000","last_unstale":"2024-09-12T00:06:42.065300+0000","last_undegraded":"2024-09-12T00:06:42.065300+0000","last_fullsized":"2024-09-12T00:06:42.065300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:30.520217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"93'7","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723759+0000","last_change":"2024-09-12T00:03:33.385373+0000","last_active":"2024-09-12T00:06:42.723759+0000","last_peered":"2024-09-12T00:06:42.723759+0000","last_clean":"2024-09-12T00:06:42.723759+0000","last_became_active":"2024-09-12T00:03:33.384559+0000","last_became_peered":"2024-09-12T00:03:33.384559+0000","last_unstale":"2024-09-12T00:06:42.723759+0000","last_undegraded":"2024-09-12T00:06:42.723759+0000","last_fullsized":"2024-09-12T00:06:42.723759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:55.924174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"59'2","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.361838+0000","last_change":"2024-09-12T00:07:26.361838+0000","last_active":"2024-09-12T00:07:26.361838+0000","last_peered":"2024-09-12T00:07:26.361838+0000","last_clean":"2024-09-12T00:07:26.361838+0000","last_became_active":"2024-09-12T00:03:25.325840+0000","last_became_peered":"2024-09-12T00:03:25.325840+0000","last_unstale":"2024-09-12T00:07:26.361838+0000","last_undegraded":"2024-09-12T00:07:26.361838+0000","last_fullsized":"2024-09-12T00:07:26.361838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:26.361654+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:26.361654+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.361654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:43.783340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"116'44","reported_seq":245,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.861508+0000","last_change":"2024-09-12T00:07:19.861508+0000","last_active":"2024-09-12T00:07:19.861508+0000","last_peered":"2024-09-12T00:07:19.861508+0000","last_clean":"2024-09-12T00:07:19.861508+0000","last_became_active":"2024-09-12T00:03:23.616200+0000","last_became_peered":"2024-09-12T00:03:23.616200+0000","last_unstale":"2024-09-12T00:07:19.861508+0000","last_undegraded":"2024-09-12T00:07:19.861508+0000","last_fullsized":"2024-09-12T00:07:19.861508+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-09-12T00:07:19.861326+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-09-12T00:07:19.861326+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.861326+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:33.997134+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.805445+0000","last_change":"2024-09-12T00:07:29.805445+0000","last_active":"2024-09-12T00:07:29.805445+0000","last_peered":"2024-09-12T00:07:29.805445+0000","last_clean":"2024-09-12T00:07:29.805445+0000","last_became_active":"2024-09-12T00:03:27.329830+0000","last_became_peered":"2024-09-12T00:03:27.329830+0000","last_unstale":"2024-09-12T00:07:29.805445+0000","last_undegraded":"2024-09-12T00:07:29.805445+0000","last_fullsized":"2024-09-12T00:07:29.805445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:29.805265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:29.805265+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.805265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:21.107215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"116'28","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.795295+0000","last_change":"2024-09-12T00:03:29.343655+0000","last_active":"2024-09-12T00:07:11.795295+0000","last_peered":"2024-09-12T00:07:11.795295+0000","last_clean":"2024-09-12T00:07:11.795295+0000","last_became_active":"2024-09-12T00:03:29.343178+0000","last_became_peered":"2024-09-12T00:03:29.343178+0000","last_unstale":"2024-09-12T00:07:11.795295+0000","last_undegraded":"2024-09-12T00:07:11.795295+0000","last_fullsized":"2024-09-12T00:07:11.795295+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:50.238954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723516+0000","last_change":"2024-09-12T00:03:31.358077+0000","last_active":"2024-09-12T00:06:42.723516+0000","last_peered":"2024-09-12T00:06:42.723516+0000","last_clean":"2024-09-12T00:06:42.723516+0000","last_became_active":"2024-09-12T00:03:31.357272+0000","last_became_peered":"2024-09-12T00:03:31.357272+0000","last_unstale":"2024-09-12T00:06:42.723516+0000","last_undegraded":"2024-09-12T00:06:42.723516+0000","last_fullsized":"2024-09-12T00:06:42.723516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:37.991682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"76'4","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065954+0000","last_change":"2024-09-12T00:06:26.690241+0000","last_active":"2024-09-12T00:06:42.065954+0000","last_peered":"2024-09-12T00:06:42.065954+0000","last_clean":"2024-09-12T00:06:42.065954+0000","last_became_active":"2024-09-12T00:06:26.653908+0000","last_became_peered":"2024-09-12T00:06:26.653908+0000","last_unstale":"2024-09-12T00:06:42.065954+0000","last_undegraded":"2024-09-12T00:06:42.065954+0000","last_fullsized":"2024-09-12T00:06:42.065954+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"76'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721025+0000","last_change":"2024-09-12T00:06:32.433900+0000","last_active":"2024-09-12T00:06:42.721025+0000","last_peered":"2024-09-12T00:06:42.721025+0000","last_clean":"2024-09-12T00:06:42.721025+0000","last_became_active":"2024-09-12T00:06:26.675405+0000","last_became_peered":"2024-09-12T00:06:26.675405+0000","last_unstale":"2024-09-12T00:06:42.721025+0000","last_undegraded":"2024-09-12T00:06:42.721025+0000","last_fullsized":"2024-09-12T00:06:42.721025+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:53.098500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"116'42","reported_seq":114,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.870208+0000","last_change":"2024-09-12T00:07:20.870208+0000","last_active":"2024-09-12T00:07:20.870208+0000","last_peered":"2024-09-12T00:07:20.870208+0000","last_clean":"2024-09-12T00:07:20.870208+0000","last_became_active":"2024-09-12T00:06:26.663178+0000","last_became_peered":"2024-09-12T00:06:26.663178+0000","last_unstale":"2024-09-12T00:07:20.870208+0000","last_undegraded":"2024-09-12T00:07:20.870208+0000","last_fullsized":"2024-09-12T00:07:20.870208+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-09-12T00:07:20.870024+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-09-12T00:07:20.870024+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.870024+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:43.356712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":138412032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065958+0000","last_change":"2024-09-12T00:03:27.342295+0000","last_active":"2024-09-12T00:06:42.065958+0000","last_peered":"2024-09-12T00:06:42.065958+0000","last_clean":"2024-09-12T00:06:42.065958+0000","last_became_active":"2024-09-12T00:03:27.341619+0000","last_became_peered":"2024-09-12T00:03:27.341619+0000","last_unstale":"2024-09-12T00:06:42.065958+0000","last_undegraded":"2024-09-12T00:06:42.065958+0000","last_fullsized":"2024-09-12T00:06:42.065958+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:00.908798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"116'26","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.495371+0000","last_change":"2024-09-12T00:03:29.336391+0000","last_active":"2024-09-12T00:07:11.495371+0000","last_peered":"2024-09-12T00:07:11.495371+0000","last_clean":"2024-09-12T00:07:11.495371+0000","last_became_active":"2024-09-12T00:03:29.335679+0000","last_became_peered":"2024-09-12T00:03:29.335679+0000","last_unstale":"2024-09-12T00:07:11.495371+0000","last_undegraded":"2024-09-12T00:07:11.495371+0000","last_fullsized":"2024-09-12T00:07:11.495371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:58.540539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"116'138","reported_seq":399,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:10.890541+0000","last_change":"2024-09-12T00:03:31.351170+0000","last_active":"2024-09-12T00:07:10.890541+0000","last_peered":"2024-09-12T00:07:10.890541+0000","last_clean":"2024-09-12T00:07:10.890541+0000","last_became_active":"2024-09-12T00:03:31.350264+0000","last_became_peered":"2024-09-12T00:03:31.350264+0000","last_unstale":"2024-09-12T00:07:10.890541+0000","last_undegraded":"2024-09-12T00:07:10.890541+0000","last_fullsized":"2024-09-12T00:07:10.890541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:51.368815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"59'3","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719548+0000","last_change":"2024-09-12T00:03:33.368236+0000","last_active":"2024-09-12T00:06:42.719548+0000","last_peered":"2024-09-12T00:06:42.719548+0000","last_clean":"2024-09-12T00:06:42.719548+0000","last_became_active":"2024-09-12T00:03:33.367424+0000","last_became_peered":"2024-09-12T00:03:33.367424+0000","last_unstale":"2024-09-12T00:06:42.719548+0000","last_undegraded":"2024-09-12T00:06:42.719548+0000","last_fullsized":"2024-09-12T00:06:42.719548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"76'6","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813109+0000","last_change":"2024-09-12T00:06:28.869705+0000","last_active":"2024-09-12T00:06:41.813109+0000","last_peered":"2024-09-12T00:06:41.813109+0000","last_clean":"2024-09-12T00:06:41.813109+0000","last_became_active":"2024-09-12T00:06:26.671547+0000","last_became_peered":"2024-09-12T00:06:26.671547+0000","last_unstale":"2024-09-12T00:06:41.813109+0000","last_undegraded":"2024-09-12T00:06:41.813109+0000","last_fullsized":"2024-09-12T00:06:41.813109+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:55.946290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"116'44","reported_seq":117,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.899518+0000","last_change":"2024-09-12T00:07:22.899518+0000","last_active":"2024-09-12T00:07:22.899518+0000","last_peered":"2024-09-12T00:07:22.899518+0000","last_clean":"2024-09-12T00:07:22.899518+0000","last_became_active":"2024-09-12T00:06:26.654104+0000","last_became_peered":"2024-09-12T00:06:26.654104+0000","last_unstale":"2024-09-12T00:07:22.899518+0000","last_undegraded":"2024-09-12T00:07:22.899518+0000","last_fullsized":"2024-09-12T00:07:22.899518+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-09-12T00:07:22.899334+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-09-12T00:07:22.899334+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.899334+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:43.870468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"116'4","reported_seq":382,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.122654+0000","last_change":"2024-09-12T00:07:31.122654+0000","last_active":"2024-09-12T00:07:31.122654+0000","last_peered":"2024-09-12T00:07:31.122654+0000","last_clean":"2024-09-12T00:07:31.122654+0000","last_became_active":"2024-09-12T00:03:27.330909+0000","last_became_peered":"2024-09-12T00:03:27.330909+0000","last_unstale":"2024-09-12T00:07:31.122654+0000","last_undegraded":"2024-09-12T00:07:31.122654+0000","last_fullsized":"2024-09-12T00:07:31.122654+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'4","last_scrub_stamp":"2024-09-12T00:07:31.122476+0000","last_deep_scrub":"116'4","last_deep_scrub_stamp":"2024-09-12T00:07:31.122476+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.122476+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:57.179433+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"59'11","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720583+0000","last_change":"2024-09-12T00:03:29.338880+0000","last_active":"2024-09-12T00:06:42.720583+0000","last_peered":"2024-09-12T00:06:42.720583+0000","last_clean":"2024-09-12T00:06:42.720583+0000","last_became_active":"2024-09-12T00:03:29.338110+0000","last_became_peered":"2024-09-12T00:03:29.338110+0000","last_unstale":"2024-09-12T00:06:42.720583+0000","last_undegraded":"2024-09-12T00:06:42.720583+0000","last_fullsized":"2024-09-12T00:06:42.720583+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.054460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"116'138","reported_seq":405,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:10.892890+0000","last_change":"2024-09-12T00:03:31.339117+0000","last_active":"2024-09-12T00:07:10.892890+0000","last_peered":"2024-09-12T00:07:10.892890+0000","last_clean":"2024-09-12T00:07:10.892890+0000","last_became_active":"2024-09-12T00:03:31.338426+0000","last_became_peered":"2024-09-12T00:03:31.338426+0000","last_unstale":"2024-09-12T00:07:10.892890+0000","last_undegraded":"2024-09-12T00:07:10.892890+0000","last_fullsized":"2024-09-12T00:07:10.892890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:19.304169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811106+0000","last_change":"2024-09-12T00:03:33.385051+0000","last_active":"2024-09-12T00:06:41.811106+0000","last_peered":"2024-09-12T00:06:41.811106+0000","last_clean":"2024-09-12T00:06:41.811106+0000","last_became_active":"2024-09-12T00:03:33.380088+0000","last_became_peered":"2024-09-12T00:03:33.380088+0000","last_unstale":"2024-09-12T00:06:41.811106+0000","last_undegraded":"2024-09-12T00:06:41.811106+0000","last_fullsized":"2024-09-12T00:06:41.811106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:02.972871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'4","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.795412+0000","last_change":"2024-09-12T00:07:22.795412+0000","last_active":"2024-09-12T00:07:22.795412+0000","last_peered":"2024-09-12T00:07:22.795412+0000","last_clean":"2024-09-12T00:07:22.795412+0000","last_became_active":"2024-09-12T00:03:25.335449+0000","last_became_peered":"2024-09-12T00:03:25.335449+0000","last_unstale":"2024-09-12T00:07:22.795412+0000","last_undegraded":"2024-09-12T00:07:22.795412+0000","last_fullsized":"2024-09-12T00:07:22.795412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-12T00:07:22.795197+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-12T00:07:22.795197+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.795197+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:58.768197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"116'48","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.773015+0000","last_change":"2024-09-12T00:07:21.773015+0000","last_active":"2024-09-12T00:07:21.773015+0000","last_peered":"2024-09-12T00:07:21.773015+0000","last_clean":"2024-09-12T00:07:21.773015+0000","last_became_active":"2024-09-12T00:03:23.614187+0000","last_became_peered":"2024-09-12T00:03:23.614187+0000","last_unstale":"2024-09-12T00:07:21.773015+0000","last_undegraded":"2024-09-12T00:07:21.773015+0000","last_fullsized":"2024-09-12T00:07:21.773015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-09-12T00:07:21.772812+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-09-12T00:07:21.772812+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.772812+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:50.277427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720307+0000","last_change":"2024-09-12T00:06:26.673924+0000","last_active":"2024-09-12T00:06:42.720307+0000","last_peered":"2024-09-12T00:06:42.720307+0000","last_clean":"2024-09-12T00:06:42.720307+0000","last_became_active":"2024-09-12T00:06:26.670945+0000","last_became_peered":"2024-09-12T00:06:26.670945+0000","last_unstale":"2024-09-12T00:06:42.720307+0000","last_undegraded":"2024-09-12T00:06:42.720307+0000","last_fullsized":"2024-09-12T00:06:42.720307+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:56.956200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"116'35","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:33.053460+0000","last_change":"2024-09-12T00:07:33.053460+0000","last_active":"2024-09-12T00:07:33.053460+0000","last_peered":"2024-09-12T00:07:33.053460+0000","last_clean":"2024-09-12T00:07:33.053460+0000","last_became_active":"2024-09-12T00:03:29.345243+0000","last_became_peered":"2024-09-12T00:03:29.345243+0000","last_unstale":"2024-09-12T00:07:33.053460+0000","last_undegraded":"2024-09-12T00:07:33.053460+0000","last_fullsized":"2024-09-12T00:07:33.053460+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'35","last_scrub_stamp":"2024-09-12T00:07:33.053267+0000","last_deep_scrub":"116'35","last_deep_scrub_stamp":"2024-09-12T00:07:33.053267+0000","last_clean_scrub_stamp":"2024-09-12T00:07:33.053267+0000","objects_scrubbed":8,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:21.156625+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812258+0000","last_change":"2024-09-12T00:03:31.360630+0000","last_active":"2024-09-12T00:06:41.812258+0000","last_peered":"2024-09-12T00:06:41.812258+0000","last_clean":"2024-09-12T00:06:41.812258+0000","last_became_active":"2024-09-12T00:03:31.359763+0000","last_became_peered":"2024-09-12T00:03:31.359763+0000","last_unstale":"2024-09-12T00:06:41.812258+0000","last_undegraded":"2024-09-12T00:06:41.812258+0000","last_fullsized":"2024-09-12T00:06:41.812258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.773040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"84'6","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719339+0000","last_change":"2024-09-12T00:03:33.372178+0000","last_active":"2024-09-12T00:06:42.719339+0000","last_peered":"2024-09-12T00:06:42.719339+0000","last_clean":"2024-09-12T00:06:42.719339+0000","last_became_active":"2024-09-12T00:03:33.370562+0000","last_became_peered":"2024-09-12T00:03:33.370562+0000","last_unstale":"2024-09-12T00:06:42.719339+0000","last_undegraded":"2024-09-12T00:06:42.719339+0000","last_fullsized":"2024-09-12T00:06:42.719339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:31.888153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'10","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720452+0000","last_change":"2024-09-12T00:06:32.425494+0000","last_active":"2024-09-12T00:06:42.720452+0000","last_peered":"2024-09-12T00:06:42.720452+0000","last_clean":"2024-09-12T00:06:42.720452+0000","last_became_active":"2024-09-12T00:06:26.674937+0000","last_became_peered":"2024-09-12T00:06:26.674937+0000","last_unstale":"2024-09-12T00:06:42.720452+0000","last_undegraded":"2024-09-12T00:06:42.720452+0000","last_fullsized":"2024-09-12T00:06:42.720452+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:09.992203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"116'74","reported_seq":311,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.028450+0000","last_change":"2024-09-12T00:07:18.028450+0000","last_active":"2024-09-12T00:07:18.028450+0000","last_peered":"2024-09-12T00:07:18.028450+0000","last_clean":"2024-09-12T00:07:18.028450+0000","last_became_active":"2024-09-12T00:03:11.767988+0000","last_became_peered":"2024-09-12T00:03:11.767988+0000","last_unstale":"2024-09-12T00:07:18.028450+0000","last_undegraded":"2024-09-12T00:07:18.028450+0000","last_fullsized":"2024-09-12T00:07:18.028450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'74","last_scrub_stamp":"2024-09-12T00:07:18.028259+0000","last_deep_scrub":"116'74","last_deep_scrub_stamp":"2024-09-12T00:07:18.028259+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.028259+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:46.777805+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"116'2","reported_seq":54,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.898811+0000","last_change":"2024-09-12T00:07:18.898811+0000","last_active":"2024-09-12T00:07:18.898811+0000","last_peered":"2024-09-12T00:07:18.898811+0000","last_clean":"2024-09-12T00:07:18.898811+0000","last_became_active":"2024-09-12T00:06:26.671587+0000","last_became_peered":"2024-09-12T00:06:26.671587+0000","last_unstale":"2024-09-12T00:07:18.898811+0000","last_undegraded":"2024-09-12T00:07:18.898811+0000","last_fullsized":"2024-09-12T00:07:18.898811+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-09-12T00:07:18.898634+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-09-12T00:07:18.898634+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.898634+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:20.037927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"116'48","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.814966+0000","last_change":"2024-09-12T00:07:19.814801+0000","last_active":"2024-09-12T00:07:19.814966+0000","last_peered":"2024-09-12T00:07:19.814966+0000","last_clean":"2024-09-12T00:07:19.814966+0000","last_became_active":"2024-09-12T00:03:23.621146+0000","last_became_peered":"2024-09-12T00:03:23.621146+0000","last_unstale":"2024-09-12T00:07:19.814966+0000","last_undegraded":"2024-09-12T00:07:19.814966+0000","last_fullsized":"2024-09-12T00:07:19.814966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-09-12T00:07:19.814610+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-09-12T00:07:19.814610+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.814610+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:47.085845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809414+0000","last_change":"2024-09-12T00:03:27.316175+0000","last_active":"2024-09-12T00:06:41.809414+0000","last_peered":"2024-09-12T00:06:41.809414+0000","last_clean":"2024-09-12T00:06:41.809414+0000","last_became_active":"2024-09-12T00:03:27.315502+0000","last_became_peered":"2024-09-12T00:03:27.315502+0000","last_unstale":"2024-09-12T00:06:41.809414+0000","last_undegraded":"2024-09-12T00:06:41.809414+0000","last_fullsized":"2024-09-12T00:06:41.809414+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:21.448686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"116'53","reported_seq":76,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.970073+0000","last_change":"2024-09-12T00:06:28.900645+0000","last_active":"2024-09-12T00:07:11.970073+0000","last_peered":"2024-09-12T00:07:11.970073+0000","last_clean":"2024-09-12T00:07:11.970073+0000","last_became_active":"2024-09-12T00:06:26.667623+0000","last_became_peered":"2024-09-12T00:06:26.667623+0000","last_unstale":"2024-09-12T00:07:11.970073+0000","last_undegraded":"2024-09-12T00:07:11.970073+0000","last_fullsized":"2024-09-12T00:07:11.970073+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:36.584753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":56,"num_read_kb":44,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066468+0000","last_change":"2024-09-12T00:03:31.361408+0000","last_active":"2024-09-12T00:06:42.066468+0000","last_peered":"2024-09-12T00:06:42.066468+0000","last_clean":"2024-09-12T00:06:42.066468+0000","last_became_active":"2024-09-12T00:03:31.360462+0000","last_became_peered":"2024-09-12T00:03:31.360462+0000","last_unstale":"2024-09-12T00:06:42.066468+0000","last_undegraded":"2024-09-12T00:06:42.066468+0000","last_fullsized":"2024-09-12T00:06:42.066468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:58.407571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"59'4","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812851+0000","last_change":"2024-09-12T00:03:33.388253+0000","last_active":"2024-09-12T00:06:41.812851+0000","last_peered":"2024-09-12T00:06:41.812851+0000","last_clean":"2024-09-12T00:06:41.812851+0000","last_became_active":"2024-09-12T00:03:33.387457+0000","last_became_peered":"2024-09-12T00:03:33.387457+0000","last_unstale":"2024-09-12T00:06:41.812851+0000","last_undegraded":"2024-09-12T00:06:41.812851+0000","last_fullsized":"2024-09-12T00:06:41.812851+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:46.021740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.584125+0000","last_change":"2024-09-12T00:07:31.584125+0000","last_active":"2024-09-12T00:07:31.584125+0000","last_peered":"2024-09-12T00:07:31.584125+0000","last_clean":"2024-09-12T00:07:31.584125+0000","last_became_active":"2024-09-12T00:03:25.355306+0000","last_became_peered":"2024-09-12T00:03:25.355306+0000","last_unstale":"2024-09-12T00:07:31.584125+0000","last_undegraded":"2024-09-12T00:07:31.584125+0000","last_fullsized":"2024-09-12T00:07:31.584125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:31.583850+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:31.583850+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.583850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:37.980847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:16.961431+0000","last_change":"2024-09-12T00:07:16.961431+0000","last_active":"2024-09-12T00:07:16.961431+0000","last_peered":"2024-09-12T00:07:16.961431+0000","last_clean":"2024-09-12T00:07:16.961431+0000","last_became_active":"2024-09-12T00:06:26.653574+0000","last_became_peered":"2024-09-12T00:06:26.653574+0000","last_unstale":"2024-09-12T00:07:16.961431+0000","last_undegraded":"2024-09-12T00:07:16.961431+0000","last_fullsized":"2024-09-12T00:07:16.961431+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:16.961256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:16.961256+0000","last_clean_scrub_stamp":"2024-09-12T00:07:16.961256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:28.506803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"116'54","reported_seq":259,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.320022+0000","last_change":"2024-09-12T00:07:19.319837+0000","last_active":"2024-09-12T00:07:19.320022+0000","last_peered":"2024-09-12T00:07:19.320022+0000","last_clean":"2024-09-12T00:07:19.320022+0000","last_became_active":"2024-09-12T00:03:23.621358+0000","last_became_peered":"2024-09-12T00:03:23.621358+0000","last_unstale":"2024-09-12T00:07:19.320022+0000","last_undegraded":"2024-09-12T00:07:19.320022+0000","last_fullsized":"2024-09-12T00:07:19.320022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'54","last_scrub_stamp":"2024-09-12T00:07:19.319642+0000","last_deep_scrub":"116'54","last_deep_scrub_stamp":"2024-09-12T00:07:19.319642+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.319642+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:14.283628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":62,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722205+0000","last_change":"2024-09-12T00:06:26.659401+0000","last_active":"2024-09-12T00:06:42.722205+0000","last_peered":"2024-09-12T00:06:42.722205+0000","last_clean":"2024-09-12T00:06:42.722205+0000","last_became_active":"2024-09-12T00:06:26.657376+0000","last_became_peered":"2024-09-12T00:06:26.657376+0000","last_unstale":"2024-09-12T00:06:42.722205+0000","last_undegraded":"2024-09-12T00:06:42.722205+0000","last_fullsized":"2024-09-12T00:06:42.722205+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:27.337831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"116'160","reported_seq":469,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.832980+0000","last_change":"2024-09-12T00:07:32.832980+0000","last_active":"2024-09-12T00:07:32.832980+0000","last_peered":"2024-09-12T00:07:32.832980+0000","last_clean":"2024-09-12T00:07:32.832980+0000","last_became_active":"2024-09-12T00:03:29.346101+0000","last_became_peered":"2024-09-12T00:03:29.346101+0000","last_unstale":"2024-09-12T00:07:32.832980+0000","last_undegraded":"2024-09-12T00:07:32.832980+0000","last_fullsized":"2024-09-12T00:07:32.832980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'160","last_scrub_stamp":"2024-09-12T00:07:32.832708+0000","last_deep_scrub":"116'160","last_deep_scrub_stamp":"2024-09-12T00:07:32.832708+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.832708+0000","objects_scrubbed":11,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:16.374934+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":204,"num_read_kb":188,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721121+0000","last_change":"2024-09-12T00:06:26.679841+0000","last_active":"2024-09-12T00:06:42.721121+0000","last_peered":"2024-09-12T00:06:42.721121+0000","last_clean":"2024-09-12T00:06:42.721121+0000","last_became_active":"2024-09-12T00:06:26.675966+0000","last_became_peered":"2024-09-12T00:06:26.675966+0000","last_unstale":"2024-09-12T00:06:42.721121+0000","last_undegraded":"2024-09-12T00:06:42.721121+0000","last_fullsized":"2024-09-12T00:06:42.721121+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:39.439184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.064787+0000","last_change":"2024-09-12T00:03:33.386144+0000","last_active":"2024-09-12T00:06:42.064787+0000","last_peered":"2024-09-12T00:06:42.064787+0000","last_clean":"2024-09-12T00:06:42.064787+0000","last_became_active":"2024-09-12T00:03:33.384951+0000","last_became_peered":"2024-09-12T00:03:33.384951+0000","last_unstale":"2024-09-12T00:06:42.064787+0000","last_undegraded":"2024-09-12T00:06:42.064787+0000","last_fullsized":"2024-09-12T00:06:42.064787+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:49.807501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"59'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.430633+0000","last_change":"2024-09-12T00:07:28.430633+0000","last_active":"2024-09-12T00:07:28.430633+0000","last_peered":"2024-09-12T00:07:28.430633+0000","last_clean":"2024-09-12T00:07:28.430633+0000","last_became_active":"2024-09-12T00:03:25.331652+0000","last_became_peered":"2024-09-12T00:03:25.331652+0000","last_unstale":"2024-09-12T00:07:28.430633+0000","last_undegraded":"2024-09-12T00:07:28.430633+0000","last_fullsized":"2024-09-12T00:07:28.430633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:28.430454+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:28.430454+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.430454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:53.945942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.885956+0000","last_change":"2024-09-12T00:07:18.885829+0000","last_active":"2024-09-12T00:07:18.885956+0000","last_peered":"2024-09-12T00:07:18.885956+0000","last_clean":"2024-09-12T00:07:18.885956+0000","last_became_active":"2024-09-12T00:03:16.559698+0000","last_became_peered":"2024-09-12T00:03:16.559698+0000","last_unstale":"2024-09-12T00:07:18.885956+0000","last_undegraded":"2024-09-12T00:07:18.885956+0000","last_fullsized":"2024-09-12T00:07:18.885956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:18.885652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:18.885652+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.885652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:31.551246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00082440599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"116'44","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.680345+0000","last_change":"2024-09-12T00:07:20.680175+0000","last_active":"2024-09-12T00:07:20.680345+0000","last_peered":"2024-09-12T00:07:20.680345+0000","last_clean":"2024-09-12T00:07:20.680345+0000","last_became_active":"2024-09-12T00:03:23.632795+0000","last_became_peered":"2024-09-12T00:03:23.632795+0000","last_unstale":"2024-09-12T00:07:20.680345+0000","last_undegraded":"2024-09-12T00:07:20.680345+0000","last_fullsized":"2024-09-12T00:07:20.680345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-09-12T00:07:20.679987+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-09-12T00:07:20.679987+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.679987+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:34.961364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"116'2","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.810675+0000","last_change":"2024-09-12T00:07:31.810675+0000","last_active":"2024-09-12T00:07:31.810675+0000","last_peered":"2024-09-12T00:07:31.810675+0000","last_clean":"2024-09-12T00:07:31.810675+0000","last_became_active":"2024-09-12T00:03:27.326173+0000","last_became_peered":"2024-09-12T00:03:27.326173+0000","last_unstale":"2024-09-12T00:07:31.810675+0000","last_undegraded":"2024-09-12T00:07:31.810675+0000","last_fullsized":"2024-09-12T00:07:31.810675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-09-12T00:07:31.810485+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-09-12T00:07:31.810485+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.810485+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:59.679817+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"116'25","reported_seq":262,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:33.386524+0000","last_change":"2024-09-12T00:07:33.386524+0000","last_active":"2024-09-12T00:07:33.386524+0000","last_peered":"2024-09-12T00:07:33.386524+0000","last_clean":"2024-09-12T00:07:33.386524+0000","last_became_active":"2024-09-12T00:03:29.337364+0000","last_became_peered":"2024-09-12T00:03:29.337364+0000","last_unstale":"2024-09-12T00:07:33.386524+0000","last_undegraded":"2024-09-12T00:07:33.386524+0000","last_fullsized":"2024-09-12T00:07:33.386524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'25","last_scrub_stamp":"2024-09-12T00:07:33.386081+0000","last_deep_scrub":"116'25","last_deep_scrub_stamp":"2024-09-12T00:07:33.386081+0000","last_clean_scrub_stamp":"2024-09-12T00:07:33.386081+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:51.980155+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812645+0000","last_change":"2024-09-12T00:06:26.655001+0000","last_active":"2024-09-12T00:06:41.812645+0000","last_peered":"2024-09-12T00:06:41.812645+0000","last_clean":"2024-09-12T00:06:41.812645+0000","last_became_active":"2024-09-12T00:06:26.654068+0000","last_became_peered":"2024-09-12T00:06:26.654068+0000","last_unstale":"2024-09-12T00:06:41.812645+0000","last_undegraded":"2024-09-12T00:06:41.812645+0000","last_fullsized":"2024-09-12T00:06:41.812645+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:50.133218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810544+0000","last_change":"2024-09-12T00:03:33.354171+0000","last_active":"2024-09-12T00:06:41.810544+0000","last_peered":"2024-09-12T00:06:41.810544+0000","last_clean":"2024-09-12T00:06:41.810544+0000","last_became_active":"2024-09-12T00:03:33.353460+0000","last_became_peered":"2024-09-12T00:03:33.353460+0000","last_unstale":"2024-09-12T00:06:41.810544+0000","last_undegraded":"2024-09-12T00:06:41.810544+0000","last_fullsized":"2024-09-12T00:06:41.810544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:34.356970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"84'8","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.395866+0000","last_change":"2024-09-12T00:07:27.395866+0000","last_active":"2024-09-12T00:07:27.395866+0000","last_peered":"2024-09-12T00:07:27.395866+0000","last_clean":"2024-09-12T00:07:27.395866+0000","last_became_active":"2024-09-12T00:03:25.333449+0000","last_became_peered":"2024-09-12T00:03:25.333449+0000","last_unstale":"2024-09-12T00:07:27.395866+0000","last_undegraded":"2024-09-12T00:07:27.395866+0000","last_fullsized":"2024-09-12T00:07:27.395866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'8","last_scrub_stamp":"2024-09-12T00:07:27.395672+0000","last_deep_scrub":"84'8","last_deep_scrub_stamp":"2024-09-12T00:07:27.395672+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.395672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:47.217988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"116'3","reported_seq":54,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:17.930005+0000","last_change":"2024-09-12T00:07:17.930005+0000","last_active":"2024-09-12T00:07:17.930005+0000","last_peered":"2024-09-12T00:07:17.930005+0000","last_clean":"2024-09-12T00:07:17.930005+0000","last_became_active":"2024-09-12T00:06:26.677047+0000","last_became_peered":"2024-09-12T00:06:26.677047+0000","last_unstale":"2024-09-12T00:07:17.930005+0000","last_undegraded":"2024-09-12T00:07:17.930005+0000","last_fullsized":"2024-09-12T00:07:17.930005+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'3","last_scrub_stamp":"2024-09-12T00:07:17.929893+0000","last_deep_scrub":"116'3","last_deep_scrub_stamp":"2024-09-12T00:07:17.929893+0000","last_clean_scrub_stamp":"2024-09-12T00:07:17.929893+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:22.176153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"116'42","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:15.478879+0000","last_change":"2024-09-12T00:07:15.478773+0000","last_active":"2024-09-12T00:07:15.478879+0000","last_peered":"2024-09-12T00:07:15.478879+0000","last_clean":"2024-09-12T00:07:15.478879+0000","last_became_active":"2024-09-12T00:03:23.610612+0000","last_became_peered":"2024-09-12T00:03:23.610612+0000","last_unstale":"2024-09-12T00:07:15.478879+0000","last_undegraded":"2024-09-12T00:07:15.478879+0000","last_fullsized":"2024-09-12T00:07:15.478879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-09-12T00:07:15.478642+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-09-12T00:07:15.478642+0000","last_clean_scrub_stamp":"2024-09-12T00:07:15.478642+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:48.811903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.848035+0000","last_change":"2024-09-12T00:07:30.848035+0000","last_active":"2024-09-12T00:07:30.848035+0000","last_peered":"2024-09-12T00:07:30.848035+0000","last_clean":"2024-09-12T00:07:30.848035+0000","last_became_active":"2024-09-12T00:03:27.338508+0000","last_became_peered":"2024-09-12T00:03:27.338508+0000","last_unstale":"2024-09-12T00:07:30.848035+0000","last_undegraded":"2024-09-12T00:07:30.848035+0000","last_fullsized":"2024-09-12T00:07:30.848035+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:30.847854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:30.847854+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.847854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:05.685985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066551+0000","last_change":"2024-09-12T00:06:28.890041+0000","last_active":"2024-09-12T00:06:42.066551+0000","last_peered":"2024-09-12T00:06:42.066551+0000","last_clean":"2024-09-12T00:06:42.066551+0000","last_became_active":"2024-09-12T00:06:26.682354+0000","last_became_peered":"2024-09-12T00:06:26.682354+0000","last_unstale":"2024-09-12T00:06:42.066551+0000","last_undegraded":"2024-09-12T00:06:42.066551+0000","last_fullsized":"2024-09-12T00:06:42.066551+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:42.484131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722102+0000","last_change":"2024-09-12T00:06:26.675142+0000","last_active":"2024-09-12T00:06:42.722102+0000","last_peered":"2024-09-12T00:06:42.722102+0000","last_clean":"2024-09-12T00:06:42.722102+0000","last_became_active":"2024-09-12T00:06:26.669787+0000","last_became_peered":"2024-09-12T00:06:26.669787+0000","last_unstale":"2024-09-12T00:06:42.722102+0000","last_undegraded":"2024-09-12T00:06:42.722102+0000","last_fullsized":"2024-09-12T00:06:42.722102+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:34.635508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"63'7","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500245+0000","last_change":"2024-09-12T00:03:33.367035+0000","last_active":"2024-09-12T00:06:42.500245+0000","last_peered":"2024-09-12T00:06:42.500245+0000","last_clean":"2024-09-12T00:06:42.500245+0000","last_became_active":"2024-09-12T00:03:33.366311+0000","last_became_peered":"2024-09-12T00:03:33.366311+0000","last_unstale":"2024-09-12T00:06:42.500245+0000","last_undegraded":"2024-09-12T00:06:42.500245+0000","last_fullsized":"2024-09-12T00:06:42.500245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"96'8","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.333356+0000","last_change":"2024-09-12T00:07:25.333356+0000","last_active":"2024-09-12T00:07:25.333356+0000","last_peered":"2024-09-12T00:07:25.333356+0000","last_clean":"2024-09-12T00:07:25.333356+0000","last_became_active":"2024-09-12T00:06:26.675442+0000","last_became_peered":"2024-09-12T00:06:26.675442+0000","last_unstale":"2024-09-12T00:07:25.333356+0000","last_undegraded":"2024-09-12T00:07:25.333356+0000","last_fullsized":"2024-09-12T00:07:25.333356+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'8","last_scrub_stamp":"2024-09-12T00:07:25.333161+0000","last_deep_scrub":"96'8","last_deep_scrub_stamp":"2024-09-12T00:07:25.333161+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.333161+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:08.133560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"116'38","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:16.236058+0000","last_change":"2024-09-12T00:07:16.235989+0000","last_active":"2024-09-12T00:07:16.236058+0000","last_peered":"2024-09-12T00:07:16.236058+0000","last_clean":"2024-09-12T00:07:16.236058+0000","last_became_active":"2024-09-12T00:03:23.618716+0000","last_became_peered":"2024-09-12T00:03:23.618716+0000","last_unstale":"2024-09-12T00:07:16.236058+0000","last_undegraded":"2024-09-12T00:07:16.236058+0000","last_fullsized":"2024-09-12T00:07:16.236058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'38","last_scrub_stamp":"2024-09-12T00:07:16.235890+0000","last_deep_scrub":"116'38","last_deep_scrub_stamp":"2024-09-12T00:07:16.235890+0000","last_clean_scrub_stamp":"2024-09-12T00:07:16.235890+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:58.241008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.612406+0000","last_change":"2024-09-12T00:07:18.612250+0000","last_active":"2024-09-12T00:07:18.612406+0000","last_peered":"2024-09-12T00:07:18.612406+0000","last_clean":"2024-09-12T00:07:18.612406+0000","last_became_active":"2024-09-12T00:03:16.561218+0000","last_became_peered":"2024-09-12T00:03:16.561218+0000","last_unstale":"2024-09-12T00:07:18.612406+0000","last_undegraded":"2024-09-12T00:07:18.612406+0000","last_fullsized":"2024-09-12T00:07:18.612406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:18.612067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:18.612067+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.612067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:00.405912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084170299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811828+0000","last_change":"2024-09-12T00:03:27.341079+0000","last_active":"2024-09-12T00:06:41.811828+0000","last_peered":"2024-09-12T00:06:41.811828+0000","last_clean":"2024-09-12T00:06:41.811828+0000","last_became_active":"2024-09-12T00:03:27.340391+0000","last_became_peered":"2024-09-12T00:03:27.340391+0000","last_unstale":"2024-09-12T00:06:41.811828+0000","last_undegraded":"2024-09-12T00:06:41.811828+0000","last_fullsized":"2024-09-12T00:06:41.811828+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:10.048469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"116'57","reported_seq":273,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.964222+0000","last_change":"2024-09-12T00:03:29.346823+0000","last_active":"2024-09-12T00:07:11.964222+0000","last_peered":"2024-09-12T00:07:11.964222+0000","last_clean":"2024-09-12T00:07:11.964222+0000","last_became_active":"2024-09-12T00:03:29.346066+0000","last_became_peered":"2024-09-12T00:03:29.346066+0000","last_unstale":"2024-09-12T00:07:11.964222+0000","last_undegraded":"2024-09-12T00:07:11.964222+0000","last_fullsized":"2024-09-12T00:07:11.964222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":76,"num_read_kb":301,"num_write":46,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810366+0000","last_change":"2024-09-12T00:03:31.348574+0000","last_active":"2024-09-12T00:06:41.810366+0000","last_peered":"2024-09-12T00:06:41.810366+0000","last_clean":"2024-09-12T00:06:41.810366+0000","last_became_active":"2024-09-12T00:03:31.346511+0000","last_became_peered":"2024-09-12T00:03:31.346511+0000","last_unstale":"2024-09-12T00:06:41.810366+0000","last_undegraded":"2024-09-12T00:06:41.810366+0000","last_fullsized":"2024-09-12T00:06:41.810366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:14.061486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"59'7","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066233+0000","last_change":"2024-09-12T00:03:33.385232+0000","last_active":"2024-09-12T00:06:42.066233+0000","last_peered":"2024-09-12T00:06:42.066233+0000","last_clean":"2024-09-12T00:06:42.066233+0000","last_became_active":"2024-09-12T00:03:33.384457+0000","last_became_peered":"2024-09-12T00:03:33.384457+0000","last_unstale":"2024-09-12T00:06:42.066233+0000","last_undegraded":"2024-09-12T00:06:42.066233+0000","last_fullsized":"2024-09-12T00:06:42.066233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:34.615256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"76'4","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.377897+0000","last_change":"2024-09-12T00:07:26.377897+0000","last_active":"2024-09-12T00:07:26.377897+0000","last_peered":"2024-09-12T00:07:26.377897+0000","last_clean":"2024-09-12T00:07:26.377897+0000","last_became_active":"2024-09-12T00:03:25.332814+0000","last_became_peered":"2024-09-12T00:03:25.332814+0000","last_unstale":"2024-09-12T00:07:26.377897+0000","last_undegraded":"2024-09-12T00:07:26.377897+0000","last_fullsized":"2024-09-12T00:07:26.377897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-12T00:07:26.377710+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-12T00:07:26.377710+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.377710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:53.843693+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"116'54","reported_seq":258,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.342369+0000","last_change":"2024-09-12T00:07:20.342225+0000","last_active":"2024-09-12T00:07:20.342369+0000","last_peered":"2024-09-12T00:07:20.342369+0000","last_clean":"2024-09-12T00:07:20.342369+0000","last_became_active":"2024-09-12T00:03:23.628128+0000","last_became_peered":"2024-09-12T00:03:23.628128+0000","last_unstale":"2024-09-12T00:07:20.342369+0000","last_undegraded":"2024-09-12T00:07:20.342369+0000","last_fullsized":"2024-09-12T00:07:20.342369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'54","last_scrub_stamp":"2024-09-12T00:07:20.342047+0000","last_deep_scrub":"116'54","last_deep_scrub_stamp":"2024-09-12T00:07:20.342047+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.342047+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:49.091593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.905666+0000","last_change":"2024-09-12T00:07:19.905666+0000","last_active":"2024-09-12T00:07:19.905666+0000","last_peered":"2024-09-12T00:07:19.905666+0000","last_clean":"2024-09-12T00:07:19.905666+0000","last_became_active":"2024-09-12T00:06:26.675309+0000","last_became_peered":"2024-09-12T00:06:26.675309+0000","last_unstale":"2024-09-12T00:07:19.905666+0000","last_undegraded":"2024-09-12T00:07:19.905666+0000","last_fullsized":"2024-09-12T00:07:19.905666+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:19.905470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:19.905470+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.905470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:53.120369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.814664+0000","last_change":"2024-09-12T00:03:27.316317+0000","last_active":"2024-09-12T00:06:41.814664+0000","last_peered":"2024-09-12T00:06:41.814664+0000","last_clean":"2024-09-12T00:06:41.814664+0000","last_became_active":"2024-09-12T00:03:27.315704+0000","last_became_peered":"2024-09-12T00:03:27.315704+0000","last_unstale":"2024-09-12T00:06:41.814664+0000","last_undegraded":"2024-09-12T00:06:41.814664+0000","last_fullsized":"2024-09-12T00:06:41.814664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:07.883485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'20","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720264+0000","last_change":"2024-09-12T00:06:26.708588+0000","last_active":"2024-09-12T00:06:42.720264+0000","last_peered":"2024-09-12T00:06:42.720264+0000","last_clean":"2024-09-12T00:06:42.720264+0000","last_became_active":"2024-09-12T00:06:26.661284+0000","last_became_peered":"2024-09-12T00:06:26.661284+0000","last_unstale":"2024-09-12T00:06:42.720264+0000","last_undegraded":"2024-09-12T00:06:42.720264+0000","last_fullsized":"2024-09-12T00:06:42.720264+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:19.418779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"116'138","reported_seq":358,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.994951+0000","last_change":"2024-09-12T00:03:31.357011+0000","last_active":"2024-09-12T00:07:11.994951+0000","last_peered":"2024-09-12T00:07:11.994951+0000","last_clean":"2024-09-12T00:07:11.994951+0000","last_became_active":"2024-09-12T00:03:31.356108+0000","last_became_peered":"2024-09-12T00:03:31.356108+0000","last_unstale":"2024-09-12T00:07:11.994951+0000","last_undegraded":"2024-09-12T00:07:11.994951+0000","last_fullsized":"2024-09-12T00:07:11.994951+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"58'2","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723235+0000","last_change":"2024-09-12T00:03:33.372465+0000","last_active":"2024-09-12T00:06:42.723235+0000","last_peered":"2024-09-12T00:06:42.723235+0000","last_clean":"2024-09-12T00:06:42.723235+0000","last_became_active":"2024-09-12T00:03:33.371214+0000","last_became_peered":"2024-09-12T00:03:33.371214+0000","last_unstale":"2024-09-12T00:06:42.723235+0000","last_undegraded":"2024-09-12T00:06:42.723235+0000","last_fullsized":"2024-09-12T00:06:42.723235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:40.880933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"84'8","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.825158+0000","last_change":"2024-09-12T00:07:26.825010+0000","last_active":"2024-09-12T00:07:26.825158+0000","last_peered":"2024-09-12T00:07:26.825158+0000","last_clean":"2024-09-12T00:07:26.825158+0000","last_became_active":"2024-09-12T00:03:25.331250+0000","last_became_peered":"2024-09-12T00:03:25.331250+0000","last_unstale":"2024-09-12T00:07:26.825158+0000","last_undegraded":"2024-09-12T00:07:26.825158+0000","last_fullsized":"2024-09-12T00:07:26.825158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'8","last_scrub_stamp":"2024-09-12T00:07:26.824802+0000","last_deep_scrub":"84'8","last_deep_scrub_stamp":"2024-09-12T00:07:26.824802+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.824802+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:24.673458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"116'46","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.804454+0000","last_change":"2024-09-12T00:07:20.804454+0000","last_active":"2024-09-12T00:07:20.804454+0000","last_peered":"2024-09-12T00:07:20.804454+0000","last_clean":"2024-09-12T00:07:20.804454+0000","last_became_active":"2024-09-12T00:03:23.601481+0000","last_became_peered":"2024-09-12T00:03:23.601481+0000","last_unstale":"2024-09-12T00:07:20.804454+0000","last_undegraded":"2024-09-12T00:07:20.804454+0000","last_fullsized":"2024-09-12T00:07:20.804454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:20.804249+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:20.804249+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.804249+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:51.271894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:17.867195+0000","last_change":"2024-09-12T00:07:17.867195+0000","last_active":"2024-09-12T00:07:17.867195+0000","last_peered":"2024-09-12T00:07:17.867195+0000","last_clean":"2024-09-12T00:07:17.867195+0000","last_became_active":"2024-09-12T00:03:16.594609+0000","last_became_peered":"2024-09-12T00:03:16.594609+0000","last_unstale":"2024-09-12T00:07:17.867195+0000","last_undegraded":"2024-09-12T00:07:17.867195+0000","last_fullsized":"2024-09-12T00:07:17.867195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:17.867017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:17.867017+0000","last_clean_scrub_stamp":"2024-09-12T00:07:17.867017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:30.089273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010254439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721880+0000","last_change":"2024-09-12T00:06:26.648329+0000","last_active":"2024-09-12T00:06:42.721880+0000","last_peered":"2024-09-12T00:06:42.721880+0000","last_clean":"2024-09-12T00:06:42.721880+0000","last_became_active":"2024-09-12T00:06:26.647055+0000","last_became_peered":"2024-09-12T00:06:26.647055+0000","last_unstale":"2024-09-12T00:06:42.721880+0000","last_undegraded":"2024-09-12T00:06:42.721880+0000","last_fullsized":"2024-09-12T00:06:42.721880+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:35.147693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"58'18","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720951+0000","last_change":"2024-09-12T00:06:30.110628+0000","last_active":"2024-09-12T00:06:42.720951+0000","last_peered":"2024-09-12T00:06:42.720951+0000","last_clean":"2024-09-12T00:06:42.720951+0000","last_became_active":"2024-09-12T00:06:26.662450+0000","last_became_peered":"2024-09-12T00:06:26.662450+0000","last_unstale":"2024-09-12T00:06:42.720951+0000","last_undegraded":"2024-09-12T00:06:42.720951+0000","last_fullsized":"2024-09-12T00:06:42.720951+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:10.820458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"116'138","reported_seq":354,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:10.893204+0000","last_change":"2024-09-12T00:03:31.361616+0000","last_active":"2024-09-12T00:07:10.893204+0000","last_peered":"2024-09-12T00:07:10.893204+0000","last_clean":"2024-09-12T00:07:10.893204+0000","last_became_active":"2024-09-12T00:03:31.360518+0000","last_became_peered":"2024-09-12T00:03:31.360518+0000","last_unstale":"2024-09-12T00:07:10.893204+0000","last_undegraded":"2024-09-12T00:07:10.893204+0000","last_fullsized":"2024-09-12T00:07:10.893204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:40.640537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065311+0000","last_change":"2024-09-12T00:03:33.378417+0000","last_active":"2024-09-12T00:06:42.065311+0000","last_peered":"2024-09-12T00:06:42.065311+0000","last_clean":"2024-09-12T00:06:42.065311+0000","last_became_active":"2024-09-12T00:03:33.377669+0000","last_became_peered":"2024-09-12T00:03:33.377669+0000","last_unstale":"2024-09-12T00:06:42.065311+0000","last_undegraded":"2024-09-12T00:06:42.065311+0000","last_fullsized":"2024-09-12T00:06:42.065311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:04.623906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":252,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.171336+0000","last_change":"2024-09-12T00:07:19.171336+0000","last_active":"2024-09-12T00:07:19.171336+0000","last_peered":"2024-09-12T00:07:19.171336+0000","last_clean":"2024-09-12T00:07:19.171336+0000","last_became_active":"2024-09-12T00:06:26.662114+0000","last_became_peered":"2024-09-12T00:06:26.662114+0000","last_unstale":"2024-09-12T00:07:19.171336+0000","last_undegraded":"2024-09-12T00:07:19.171336+0000","last_fullsized":"2024-09-12T00:07:19.171336+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2024-09-12T00:07:19.171030+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2024-09-12T00:07:19.171030+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.171030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:47.579289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"116'46","reported_seq":249,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.837245+0000","last_change":"2024-09-12T00:07:18.837245+0000","last_active":"2024-09-12T00:07:18.837245+0000","last_peered":"2024-09-12T00:07:18.837245+0000","last_clean":"2024-09-12T00:07:18.837245+0000","last_became_active":"2024-09-12T00:03:23.615158+0000","last_became_peered":"2024-09-12T00:03:23.615158+0000","last_unstale":"2024-09-12T00:07:18.837245+0000","last_undegraded":"2024-09-12T00:07:18.837245+0000","last_fullsized":"2024-09-12T00:07:18.837245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:18.837058+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:18.837058+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.837058+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:06.154923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":54,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.868118+0000","last_change":"2024-09-12T00:07:21.868118+0000","last_active":"2024-09-12T00:07:21.868118+0000","last_peered":"2024-09-12T00:07:21.868118+0000","last_clean":"2024-09-12T00:07:21.868118+0000","last_became_active":"2024-09-12T00:06:26.677544+0000","last_became_peered":"2024-09-12T00:06:26.677544+0000","last_unstale":"2024-09-12T00:07:21.868118+0000","last_undegraded":"2024-09-12T00:07:21.868118+0000","last_fullsized":"2024-09-12T00:07:21.868118+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:21.867941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:21.867941+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.867941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:07.516631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810455+0000","last_change":"2024-09-12T00:03:27.337359+0000","last_active":"2024-09-12T00:06:41.810455+0000","last_peered":"2024-09-12T00:06:41.810455+0000","last_clean":"2024-09-12T00:06:41.810455+0000","last_became_active":"2024-09-12T00:03:27.336289+0000","last_became_peered":"2024-09-12T00:03:27.336289+0000","last_unstale":"2024-09-12T00:06:41.810455+0000","last_undegraded":"2024-09-12T00:06:41.810455+0000","last_fullsized":"2024-09-12T00:06:41.810455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"116'65","reported_seq":292,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.358164+0000","last_change":"2024-09-12T00:07:32.358164+0000","last_active":"2024-09-12T00:07:32.358164+0000","last_peered":"2024-09-12T00:07:32.358164+0000","last_clean":"2024-09-12T00:07:32.358164+0000","last_became_active":"2024-09-12T00:03:29.343779+0000","last_became_peered":"2024-09-12T00:03:29.343779+0000","last_unstale":"2024-09-12T00:07:32.358164+0000","last_undegraded":"2024-09-12T00:07:32.358164+0000","last_fullsized":"2024-09-12T00:07:32.358164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'65","last_scrub_stamp":"2024-09-12T00:07:32.358046+0000","last_deep_scrub":"116'65","last_deep_scrub_stamp":"2024-09-12T00:07:32.358046+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.358046+0000","objects_scrubbed":9,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:33.247176+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811176+0000","last_change":"2024-09-12T00:03:31.335460+0000","last_active":"2024-09-12T00:06:41.811176+0000","last_peered":"2024-09-12T00:06:41.811176+0000","last_clean":"2024-09-12T00:06:41.811176+0000","last_became_active":"2024-09-12T00:03:31.334701+0000","last_became_peered":"2024-09-12T00:03:31.334701+0000","last_unstale":"2024-09-12T00:06:41.811176+0000","last_undegraded":"2024-09-12T00:06:41.811176+0000","last_fullsized":"2024-09-12T00:06:41.811176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:28.484366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"58'4","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812236+0000","last_change":"2024-09-12T00:03:33.386404+0000","last_active":"2024-09-12T00:06:41.812236+0000","last_peered":"2024-09-12T00:06:41.812236+0000","last_clean":"2024-09-12T00:06:41.812236+0000","last_became_active":"2024-09-12T00:03:33.385090+0000","last_became_peered":"2024-09-12T00:03:33.385090+0000","last_unstale":"2024-09-12T00:06:41.812236+0000","last_undegraded":"2024-09-12T00:06:41.812236+0000","last_fullsized":"2024-09-12T00:06:41.812236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:18.506865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"96'2","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813204+0000","last_change":"2024-09-12T00:03:33.361690+0000","last_active":"2024-09-12T00:06:41.813204+0000","last_peered":"2024-09-12T00:06:41.813204+0000","last_clean":"2024-09-12T00:06:41.813204+0000","last_became_active":"2024-09-12T00:03:33.360980+0000","last_became_peered":"2024-09-12T00:03:33.360980+0000","last_unstale":"2024-09-12T00:06:41.813204+0000","last_undegraded":"2024-09-12T00:06:41.813204+0000","last_fullsized":"2024-09-12T00:06:41.813204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:24.954577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"59'2","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.289411+0000","last_change":"2024-09-12T00:07:28.289411+0000","last_active":"2024-09-12T00:07:28.289411+0000","last_peered":"2024-09-12T00:07:28.289411+0000","last_clean":"2024-09-12T00:07:28.289411+0000","last_became_active":"2024-09-12T00:06:26.664337+0000","last_became_peered":"2024-09-12T00:06:26.664337+0000","last_unstale":"2024-09-12T00:07:28.289411+0000","last_undegraded":"2024-09-12T00:07:28.289411+0000","last_fullsized":"2024-09-12T00:07:28.289411+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:28.289212+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:28.289212+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.289212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:53.596793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"116'60","reported_seq":141,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.902261+0000","last_change":"2024-09-12T00:07:24.902261+0000","last_active":"2024-09-12T00:07:24.902261+0000","last_peered":"2024-09-12T00:07:24.902261+0000","last_clean":"2024-09-12T00:07:24.902261+0000","last_became_active":"2024-09-12T00:06:26.671623+0000","last_became_peered":"2024-09-12T00:06:26.671623+0000","last_unstale":"2024-09-12T00:07:24.902261+0000","last_undegraded":"2024-09-12T00:07:24.902261+0000","last_fullsized":"2024-09-12T00:07:24.902261+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'60","last_scrub_stamp":"2024-09-12T00:07:24.902070+0000","last_deep_scrub":"116'60","last_deep_scrub_stamp":"2024-09-12T00:07:24.902070+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.902070+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:19.416818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":201326592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"28'2","reported_seq":371,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:10.853248+0000","last_change":"2024-09-12T00:03:27.332281+0000","last_active":"2024-09-12T00:07:10.853248+0000","last_peered":"2024-09-12T00:07:10.853248+0000","last_clean":"2024-09-12T00:07:10.853248+0000","last_became_active":"2024-09-12T00:03:27.331527+0000","last_became_peered":"2024-09-12T00:03:27.331527+0000","last_unstale":"2024-09-12T00:07:10.853248+0000","last_undegraded":"2024-09-12T00:07:10.853248+0000","last_fullsized":"2024-09-12T00:07:10.853248+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:34.361112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":272,"num_read_kb":272,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"116'28","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.004590+0000","last_change":"2024-09-12T00:03:29.338655+0000","last_active":"2024-09-12T00:07:11.004590+0000","last_peered":"2024-09-12T00:07:11.004590+0000","last_clean":"2024-09-12T00:07:11.004590+0000","last_became_active":"2024-09-12T00:03:29.337905+0000","last_became_peered":"2024-09-12T00:03:29.337905+0000","last_unstale":"2024-09-12T00:07:11.004590+0000","last_undegraded":"2024-09-12T00:07:11.004590+0000","last_fullsized":"2024-09-12T00:07:11.004590+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:49.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.718441+0000","last_change":"2024-09-12T00:03:31.351716+0000","last_active":"2024-09-12T00:06:42.718441+0000","last_peered":"2024-09-12T00:06:42.718441+0000","last_clean":"2024-09-12T00:06:42.718441+0000","last_became_active":"2024-09-12T00:03:31.350917+0000","last_became_peered":"2024-09-12T00:03:31.350917+0000","last_unstale":"2024-09-12T00:06:42.718441+0000","last_undegraded":"2024-09-12T00:06:42.718441+0000","last_fullsized":"2024-09-12T00:06:42.718441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:45.880820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.723090+0000","last_change":"2024-09-12T00:03:33.374233+0000","last_active":"2024-09-12T00:06:42.723090+0000","last_peered":"2024-09-12T00:06:42.723090+0000","last_clean":"2024-09-12T00:06:42.723090+0000","last_became_active":"2024-09-12T00:03:33.373466+0000","last_became_peered":"2024-09-12T00:03:33.373466+0000","last_unstale":"2024-09-12T00:06:42.723090+0000","last_undegraded":"2024-09-12T00:06:42.723090+0000","last_fullsized":"2024-09-12T00:06:42.723090+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"59'2","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.787660+0000","last_change":"2024-09-12T00:07:27.787660+0000","last_active":"2024-09-12T00:07:27.787660+0000","last_peered":"2024-09-12T00:07:27.787660+0000","last_clean":"2024-09-12T00:07:27.787660+0000","last_became_active":"2024-09-12T00:06:26.664003+0000","last_became_peered":"2024-09-12T00:06:26.664003+0000","last_unstale":"2024-09-12T00:07:27.787660+0000","last_undegraded":"2024-09-12T00:07:27.787660+0000","last_fullsized":"2024-09-12T00:07:27.787660+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:27.787370+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:27.787370+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.787370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:28.484493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"116'46","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:16.450064+0000","last_change":"2024-09-12T00:07:16.450064+0000","last_active":"2024-09-12T00:07:16.450064+0000","last_peered":"2024-09-12T00:07:16.450064+0000","last_clean":"2024-09-12T00:07:16.450064+0000","last_became_active":"2024-09-12T00:03:23.612941+0000","last_became_peered":"2024-09-12T00:03:23.612941+0000","last_unstale":"2024-09-12T00:07:16.450064+0000","last_undegraded":"2024-09-12T00:07:16.450064+0000","last_fullsized":"2024-09-12T00:07:16.450064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:16.449941+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:16.449941+0000","last_clean_scrub_stamp":"2024-09-12T00:07:16.449941+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:25.970740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811543+0000","last_change":"2024-09-12T00:03:27.336144+0000","last_active":"2024-09-12T00:06:41.811543+0000","last_peered":"2024-09-12T00:06:41.811543+0000","last_clean":"2024-09-12T00:06:41.811543+0000","last_became_active":"2024-09-12T00:03:27.335372+0000","last_became_peered":"2024-09-12T00:03:27.335372+0000","last_unstale":"2024-09-12T00:06:41.811543+0000","last_undegraded":"2024-09-12T00:06:41.811543+0000","last_fullsized":"2024-09-12T00:06:41.811543+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:33.978665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"108'11","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.809960+0000","last_change":"2024-09-12T00:03:29.332051+0000","last_active":"2024-09-12T00:06:41.809960+0000","last_peered":"2024-09-12T00:06:41.809960+0000","last_clean":"2024-09-12T00:06:41.809960+0000","last_became_active":"2024-09-12T00:03:29.331243+0000","last_became_peered":"2024-09-12T00:03:29.331243+0000","last_unstale":"2024-09-12T00:06:41.809960+0000","last_undegraded":"2024-09-12T00:06:41.809960+0000","last_fullsized":"2024-09-12T00:06:41.809960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:52.544770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810109+0000","last_change":"2024-09-12T00:03:31.347021+0000","last_active":"2024-09-12T00:06:41.810109+0000","last_peered":"2024-09-12T00:06:41.810109+0000","last_clean":"2024-09-12T00:06:41.810109+0000","last_became_active":"2024-09-12T00:03:31.344407+0000","last_became_peered":"2024-09-12T00:03:31.344407+0000","last_unstale":"2024-09-12T00:06:41.810109+0000","last_undegraded":"2024-09-12T00:06:41.810109+0000","last_fullsized":"2024-09-12T00:06:41.810109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:32.139742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"84'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719370+0000","last_change":"2024-09-12T00:03:33.370271+0000","last_active":"2024-09-12T00:06:42.719370+0000","last_peered":"2024-09-12T00:06:42.719370+0000","last_clean":"2024-09-12T00:06:42.719370+0000","last_became_active":"2024-09-12T00:03:33.369538+0000","last_became_peered":"2024-09-12T00:03:33.369538+0000","last_unstale":"2024-09-12T00:06:42.719370+0000","last_undegraded":"2024-09-12T00:06:42.719370+0000","last_fullsized":"2024-09-12T00:06:42.719370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:24.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"59'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.781068+0000","last_change":"2024-09-12T00:07:25.781068+0000","last_active":"2024-09-12T00:07:25.781068+0000","last_peered":"2024-09-12T00:07:25.781068+0000","last_clean":"2024-09-12T00:07:25.781068+0000","last_became_active":"2024-09-12T00:03:25.340288+0000","last_became_peered":"2024-09-12T00:03:25.340288+0000","last_unstale":"2024-09-12T00:07:25.781068+0000","last_undegraded":"2024-09-12T00:07:25.781068+0000","last_fullsized":"2024-09-12T00:07:25.781068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:25.780854+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:25.780854+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.780854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:28.930968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"116'56","reported_seq":365,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.230279+0000","last_change":"2024-09-12T00:07:21.230279+0000","last_active":"2024-09-12T00:07:21.230279+0000","last_peered":"2024-09-12T00:07:21.230279+0000","last_clean":"2024-09-12T00:07:21.230279+0000","last_became_active":"2024-09-12T00:06:26.672172+0000","last_became_peered":"2024-09-12T00:06:26.672172+0000","last_unstale":"2024-09-12T00:07:21.230279+0000","last_undegraded":"2024-09-12T00:07:21.230279+0000","last_fullsized":"2024-09-12T00:07:21.230279+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-09-12T00:07:21.230102+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-09-12T00:07:21.230102+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.230102+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:54.137708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":64,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810614+0000","last_change":"2024-09-12T00:03:27.329869+0000","last_active":"2024-09-12T00:06:41.810614+0000","last_peered":"2024-09-12T00:06:41.810614+0000","last_clean":"2024-09-12T00:06:41.810614+0000","last_became_active":"2024-09-12T00:03:27.329077+0000","last_became_peered":"2024-09-12T00:03:27.329077+0000","last_unstale":"2024-09-12T00:06:41.810614+0000","last_undegraded":"2024-09-12T00:06:41.810614+0000","last_fullsized":"2024-09-12T00:06:41.810614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"116'22","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.819640+0000","last_change":"2024-09-12T00:03:29.346878+0000","last_active":"2024-09-12T00:07:11.819640+0000","last_peered":"2024-09-12T00:07:11.819640+0000","last_clean":"2024-09-12T00:07:11.819640+0000","last_became_active":"2024-09-12T00:03:29.345990+0000","last_became_peered":"2024-09-12T00:03:29.345990+0000","last_unstale":"2024-09-12T00:07:11.819640+0000","last_undegraded":"2024-09-12T00:07:11.819640+0000","last_fullsized":"2024-09-12T00:07:11.819640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:06.398979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.499961+0000","last_change":"2024-09-12T00:03:31.363658+0000","last_active":"2024-09-12T00:06:42.499961+0000","last_peered":"2024-09-12T00:06:42.499961+0000","last_clean":"2024-09-12T00:06:42.499961+0000","last_became_active":"2024-09-12T00:03:31.363080+0000","last_became_peered":"2024-09-12T00:03:31.363080+0000","last_unstale":"2024-09-12T00:06:42.499961+0000","last_undegraded":"2024-09-12T00:06:42.499961+0000","last_fullsized":"2024-09-12T00:06:42.499961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:05.901608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717550+0000","last_change":"2024-09-12T00:06:26.673691+0000","last_active":"2024-09-12T00:06:42.717550+0000","last_peered":"2024-09-12T00:06:42.717550+0000","last_clean":"2024-09-12T00:06:42.717550+0000","last_became_active":"2024-09-12T00:06:26.669877+0000","last_became_peered":"2024-09-12T00:06:26.669877+0000","last_unstale":"2024-09-12T00:06:42.717550+0000","last_undegraded":"2024-09-12T00:06:42.717550+0000","last_fullsized":"2024-09-12T00:06:42.717550+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:02.798560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"59'2","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.705703+0000","last_change":"2024-09-12T00:07:24.705703+0000","last_active":"2024-09-12T00:07:24.705703+0000","last_peered":"2024-09-12T00:07:24.705703+0000","last_clean":"2024-09-12T00:07:24.705703+0000","last_became_active":"2024-09-12T00:06:26.655483+0000","last_became_peered":"2024-09-12T00:06:26.655483+0000","last_unstale":"2024-09-12T00:07:24.705703+0000","last_undegraded":"2024-09-12T00:07:24.705703+0000","last_fullsized":"2024-09-12T00:07:24.705703+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:24.705412+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:24.705412+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.705412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:56.072009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"116'44","reported_seq":329,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.652983+0000","last_change":"2024-09-12T00:07:19.652983+0000","last_active":"2024-09-12T00:07:19.652983+0000","last_peered":"2024-09-12T00:07:19.652983+0000","last_clean":"2024-09-12T00:07:19.652983+0000","last_became_active":"2024-09-12T00:06:26.664617+0000","last_became_peered":"2024-09-12T00:06:26.664617+0000","last_unstale":"2024-09-12T00:07:19.652983+0000","last_undegraded":"2024-09-12T00:07:19.652983+0000","last_fullsized":"2024-09-12T00:07:19.652983+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-09-12T00:07:19.652771+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-09-12T00:07:19.652771+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.652771+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:28.003986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":142606336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717842+0000","last_change":"2024-09-12T00:06:26.663673+0000","last_active":"2024-09-12T00:06:42.717842+0000","last_peered":"2024-09-12T00:06:42.717842+0000","last_clean":"2024-09-12T00:06:42.717842+0000","last_became_active":"2024-09-12T00:06:26.663351+0000","last_became_peered":"2024-09-12T00:06:26.663351+0000","last_unstale":"2024-09-12T00:06:42.717842+0000","last_undegraded":"2024-09-12T00:06:42.717842+0000","last_fullsized":"2024-09-12T00:06:42.717842+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:58.342457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"116'22","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.808479+0000","last_change":"2024-09-12T00:03:29.346312+0000","last_active":"2024-09-12T00:07:11.808479+0000","last_peered":"2024-09-12T00:07:11.808479+0000","last_clean":"2024-09-12T00:07:11.808479+0000","last_became_active":"2024-09-12T00:03:29.345883+0000","last_became_peered":"2024-09-12T00:03:29.345883+0000","last_unstale":"2024-09-12T00:07:11.808479+0000","last_undegraded":"2024-09-12T00:07:11.808479+0000","last_fullsized":"2024-09-12T00:07:11.808479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:46.723370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719592+0000","last_change":"2024-09-12T00:03:31.358786+0000","last_active":"2024-09-12T00:06:42.719592+0000","last_peered":"2024-09-12T00:06:42.719592+0000","last_clean":"2024-09-12T00:06:42.719592+0000","last_became_active":"2024-09-12T00:03:31.358011+0000","last_became_peered":"2024-09-12T00:03:31.358011+0000","last_unstale":"2024-09-12T00:06:42.719592+0000","last_undegraded":"2024-09-12T00:06:42.719592+0000","last_fullsized":"2024-09-12T00:06:42.719592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:29.394163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"59'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720085+0000","last_change":"2024-09-12T00:06:28.364181+0000","last_active":"2024-09-12T00:06:42.720085+0000","last_peered":"2024-09-12T00:06:42.720085+0000","last_clean":"2024-09-12T00:06:42.720085+0000","last_became_active":"2024-09-12T00:06:26.667552+0000","last_became_peered":"2024-09-12T00:06:26.667552+0000","last_unstale":"2024-09-12T00:06:42.720085+0000","last_undegraded":"2024-09-12T00:06:42.720085+0000","last_fullsized":"2024-09-12T00:06:42.720085+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:19.435061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"116'46","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.656949+0000","last_change":"2024-09-12T00:07:21.656949+0000","last_active":"2024-09-12T00:07:21.656949+0000","last_peered":"2024-09-12T00:07:21.656949+0000","last_clean":"2024-09-12T00:07:21.656949+0000","last_became_active":"2024-09-12T00:03:23.626026+0000","last_became_peered":"2024-09-12T00:03:23.626026+0000","last_unstale":"2024-09-12T00:07:21.656949+0000","last_undegraded":"2024-09-12T00:07:21.656949+0000","last_fullsized":"2024-09-12T00:07:21.656949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:21.656651+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:21.656651+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.656651+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:07.882339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720318+0000","last_change":"2024-09-12T00:06:26.671971+0000","last_active":"2024-09-12T00:06:42.720318+0000","last_peered":"2024-09-12T00:06:42.720318+0000","last_clean":"2024-09-12T00:06:42.720318+0000","last_became_active":"2024-09-12T00:06:26.671427+0000","last_became_peered":"2024-09-12T00:06:26.671427+0000","last_unstale":"2024-09-12T00:06:42.720318+0000","last_undegraded":"2024-09-12T00:06:42.720318+0000","last_fullsized":"2024-09-12T00:06:42.720318+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"116'41","reported_seq":249,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.799736+0000","last_change":"2024-09-12T00:03:29.340387+0000","last_active":"2024-09-12T00:07:11.799736+0000","last_peered":"2024-09-12T00:07:11.799736+0000","last_clean":"2024-09-12T00:07:11.799736+0000","last_became_active":"2024-09-12T00:03:29.339781+0000","last_became_peered":"2024-09-12T00:03:29.339781+0000","last_unstale":"2024-09-12T00:07:11.799736+0000","last_undegraded":"2024-09-12T00:07:11.799736+0000","last_fullsized":"2024-09-12T00:07:11.799736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:30.132716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811392+0000","last_change":"2024-09-12T00:03:31.350303+0000","last_active":"2024-09-12T00:06:41.811392+0000","last_peered":"2024-09-12T00:06:41.811392+0000","last_clean":"2024-09-12T00:06:41.811392+0000","last_became_active":"2024-09-12T00:03:31.349591+0000","last_became_peered":"2024-09-12T00:03:31.349591+0000","last_unstale":"2024-09-12T00:06:41.811392+0000","last_undegraded":"2024-09-12T00:06:41.811392+0000","last_fullsized":"2024-09-12T00:06:41.811392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:00.263644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"96'4","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065021+0000","last_change":"2024-09-12T00:03:33.385028+0000","last_active":"2024-09-12T00:06:42.065021+0000","last_peered":"2024-09-12T00:06:42.065021+0000","last_clean":"2024-09-12T00:06:42.065021+0000","last_became_active":"2024-09-12T00:03:33.384274+0000","last_became_peered":"2024-09-12T00:03:33.384274+0000","last_unstale":"2024-09-12T00:06:42.065021+0000","last_undegraded":"2024-09-12T00:06:42.065021+0000","last_fullsized":"2024-09-12T00:06:42.065021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:11.634604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"58'2","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.736165+0000","last_change":"2024-09-12T00:07:29.736165+0000","last_active":"2024-09-12T00:07:29.736165+0000","last_peered":"2024-09-12T00:07:29.736165+0000","last_clean":"2024-09-12T00:07:29.736165+0000","last_became_active":"2024-09-12T00:03:25.329151+0000","last_became_peered":"2024-09-12T00:03:25.329151+0000","last_unstale":"2024-09-12T00:07:29.736165+0000","last_undegraded":"2024-09-12T00:07:29.736165+0000","last_fullsized":"2024-09-12T00:07:29.736165+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:29.735976+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:29.735976+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.735976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:05.059155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"116'50","reported_seq":252,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.759520+0000","last_change":"2024-09-12T00:07:22.759520+0000","last_active":"2024-09-12T00:07:22.759520+0000","last_peered":"2024-09-12T00:07:22.759520+0000","last_clean":"2024-09-12T00:07:22.759520+0000","last_became_active":"2024-09-12T00:03:23.598862+0000","last_became_peered":"2024-09-12T00:03:23.598862+0000","last_unstale":"2024-09-12T00:07:22.759520+0000","last_undegraded":"2024-09-12T00:07:22.759520+0000","last_fullsized":"2024-09-12T00:07:22.759520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'50","last_scrub_stamp":"2024-09-12T00:07:22.759337+0000","last_deep_scrub":"116'50","last_deep_scrub_stamp":"2024-09-12T00:07:22.759337+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.759337+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:53.269749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.188062+0000","last_change":"2024-09-12T00:07:24.188062+0000","last_active":"2024-09-12T00:07:24.188062+0000","last_peered":"2024-09-12T00:07:24.188062+0000","last_clean":"2024-09-12T00:07:24.188062+0000","last_became_active":"2024-09-12T00:03:27.340199+0000","last_became_peered":"2024-09-12T00:03:27.340199+0000","last_unstale":"2024-09-12T00:07:24.188062+0000","last_undegraded":"2024-09-12T00:07:24.188062+0000","last_fullsized":"2024-09-12T00:07:24.188062+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:24.187874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:24.187874+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.187874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:06.924717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"116'27","reported_seq":64,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.812247+0000","last_change":"2024-09-12T00:06:31.054703+0000","last_active":"2024-09-12T00:07:11.812247+0000","last_peered":"2024-09-12T00:07:11.812247+0000","last_clean":"2024-09-12T00:07:11.812247+0000","last_became_active":"2024-09-12T00:06:26.675513+0000","last_became_peered":"2024-09-12T00:06:26.675513+0000","last_unstale":"2024-09-12T00:07:11.812247+0000","last_undegraded":"2024-09-12T00:07:11.812247+0000","last_fullsized":"2024-09-12T00:07:11.812247+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:56.604086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065828+0000","last_change":"2024-09-12T00:06:26.678166+0000","last_active":"2024-09-12T00:06:42.065828+0000","last_peered":"2024-09-12T00:06:42.065828+0000","last_clean":"2024-09-12T00:06:42.065828+0000","last_became_active":"2024-09-12T00:06:26.677049+0000","last_became_peered":"2024-09-12T00:06:26.677049+0000","last_unstale":"2024-09-12T00:06:42.065828+0000","last_undegraded":"2024-09-12T00:06:42.065828+0000","last_fullsized":"2024-09-12T00:06:42.065828+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:26.729678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"59'3","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721092+0000","last_change":"2024-09-12T00:06:32.445889+0000","last_active":"2024-09-12T00:06:42.721092+0000","last_peered":"2024-09-12T00:06:42.721092+0000","last_clean":"2024-09-12T00:06:42.721092+0000","last_became_active":"2024-09-12T00:06:26.677859+0000","last_became_peered":"2024-09-12T00:06:26.677859+0000","last_unstale":"2024-09-12T00:06:42.721092+0000","last_undegraded":"2024-09-12T00:06:42.721092+0000","last_fullsized":"2024-09-12T00:06:42.721092+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:56.789846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"59'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.721417+0000","last_change":"2024-09-12T00:07:25.721417+0000","last_active":"2024-09-12T00:07:25.721417+0000","last_peered":"2024-09-12T00:07:25.721417+0000","last_clean":"2024-09-12T00:07:25.721417+0000","last_became_active":"2024-09-12T00:03:25.359682+0000","last_became_peered":"2024-09-12T00:03:25.359682+0000","last_unstale":"2024-09-12T00:07:25.721417+0000","last_undegraded":"2024-09-12T00:07:25.721417+0000","last_fullsized":"2024-09-12T00:07:25.721417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:25.721127+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:25.721127+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.721127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:50.850491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"116'40","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:16.004117+0000","last_change":"2024-09-12T00:07:16.004117+0000","last_active":"2024-09-12T00:07:16.004117+0000","last_peered":"2024-09-12T00:07:16.004117+0000","last_clean":"2024-09-12T00:07:16.004117+0000","last_became_active":"2024-09-12T00:03:23.620961+0000","last_became_peered":"2024-09-12T00:03:23.620961+0000","last_unstale":"2024-09-12T00:07:16.004117+0000","last_undegraded":"2024-09-12T00:07:16.004117+0000","last_fullsized":"2024-09-12T00:07:16.004117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-09-12T00:07:16.004043+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-09-12T00:07:16.004043+0000","last_clean_scrub_stamp":"2024-09-12T00:07:16.004043+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:26.391748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.228423+0000","last_change":"2024-09-12T00:07:26.228423+0000","last_active":"2024-09-12T00:07:26.228423+0000","last_peered":"2024-09-12T00:07:26.228423+0000","last_clean":"2024-09-12T00:07:26.228423+0000","last_became_active":"2024-09-12T00:03:27.336045+0000","last_became_peered":"2024-09-12T00:03:27.336045+0000","last_unstale":"2024-09-12T00:07:26.228423+0000","last_undegraded":"2024-09-12T00:07:26.228423+0000","last_fullsized":"2024-09-12T00:07:26.228423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:26.228243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:26.228243+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.228243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:14.331601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"116'28","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.339959+0000","last_change":"2024-09-12T00:03:29.338667+0000","last_active":"2024-09-12T00:07:11.339959+0000","last_peered":"2024-09-12T00:07:11.339959+0000","last_clean":"2024-09-12T00:07:11.339959+0000","last_became_active":"2024-09-12T00:03:29.338010+0000","last_became_peered":"2024-09-12T00:03:29.338010+0000","last_unstale":"2024-09-12T00:07:11.339959+0000","last_undegraded":"2024-09-12T00:07:11.339959+0000","last_fullsized":"2024-09-12T00:07:11.339959+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:58.256619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722955+0000","last_change":"2024-09-12T00:03:31.352823+0000","last_active":"2024-09-12T00:06:42.722955+0000","last_peered":"2024-09-12T00:06:42.722955+0000","last_clean":"2024-09-12T00:06:42.722955+0000","last_became_active":"2024-09-12T00:03:31.352143+0000","last_became_peered":"2024-09-12T00:03:31.352143+0000","last_unstale":"2024-09-12T00:06:42.722955+0000","last_undegraded":"2024-09-12T00:06:42.722955+0000","last_fullsized":"2024-09-12T00:06:42.722955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"76'8","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721671+0000","last_change":"2024-09-12T00:06:27.901313+0000","last_active":"2024-09-12T00:06:42.721671+0000","last_peered":"2024-09-12T00:06:42.721671+0000","last_clean":"2024-09-12T00:06:42.721671+0000","last_became_active":"2024-09-12T00:06:26.658281+0000","last_became_peered":"2024-09-12T00:06:26.658281+0000","last_unstale":"2024-09-12T00:06:42.721671+0000","last_undegraded":"2024-09-12T00:06:42.721671+0000","last_fullsized":"2024-09-12T00:06:42.721671+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:54.959771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"58'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.747618+0000","last_change":"2024-09-12T00:07:28.747618+0000","last_active":"2024-09-12T00:07:28.747618+0000","last_peered":"2024-09-12T00:07:28.747618+0000","last_clean":"2024-09-12T00:07:28.747618+0000","last_became_active":"2024-09-12T00:03:25.324315+0000","last_became_peered":"2024-09-12T00:03:25.324315+0000","last_unstale":"2024-09-12T00:07:28.747618+0000","last_undegraded":"2024-09-12T00:07:28.747618+0000","last_fullsized":"2024-09-12T00:07:28.747618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:28.747422+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:28.747422+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.747422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:06.054923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"116'54","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.729740+0000","last_change":"2024-09-12T00:07:23.729740+0000","last_active":"2024-09-12T00:07:23.729740+0000","last_peered":"2024-09-12T00:07:23.729740+0000","last_clean":"2024-09-12T00:07:23.729740+0000","last_became_active":"2024-09-12T00:03:23.605402+0000","last_became_peered":"2024-09-12T00:03:23.605402+0000","last_unstale":"2024-09-12T00:07:23.729740+0000","last_undegraded":"2024-09-12T00:07:23.729740+0000","last_fullsized":"2024-09-12T00:07:23.729740+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'54","last_scrub_stamp":"2024-09-12T00:07:23.729552+0000","last_deep_scrub":"116'54","last_deep_scrub_stamp":"2024-09-12T00:07:23.729552+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.729552+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:20.296921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.812917+0000","last_change":"2024-09-12T00:03:27.336716+0000","last_active":"2024-09-12T00:06:41.812917+0000","last_peered":"2024-09-12T00:06:41.812917+0000","last_clean":"2024-09-12T00:06:41.812917+0000","last_became_active":"2024-09-12T00:03:27.335658+0000","last_became_peered":"2024-09-12T00:03:27.335658+0000","last_unstale":"2024-09-12T00:06:41.812917+0000","last_undegraded":"2024-09-12T00:06:41.812917+0000","last_fullsized":"2024-09-12T00:06:41.812917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:47.355798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"35'16","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720503+0000","last_change":"2024-09-12T00:06:29.533440+0000","last_active":"2024-09-12T00:06:42.720503+0000","last_peered":"2024-09-12T00:06:42.720503+0000","last_clean":"2024-09-12T00:06:42.720503+0000","last_became_active":"2024-09-12T00:06:26.671893+0000","last_became_peered":"2024-09-12T00:06:26.671893+0000","last_unstale":"2024-09-12T00:06:42.720503+0000","last_undegraded":"2024-09-12T00:06:42.720503+0000","last_fullsized":"2024-09-12T00:06:42.720503+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:10.667822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"116'138","reported_seq":357,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:10.880655+0000","last_change":"2024-09-12T00:03:31.351362+0000","last_active":"2024-09-12T00:07:10.880655+0000","last_peered":"2024-09-12T00:07:10.880655+0000","last_clean":"2024-09-12T00:07:10.880655+0000","last_became_active":"2024-09-12T00:03:31.350925+0000","last_became_peered":"2024-09-12T00:03:31.350925+0000","last_unstale":"2024-09-12T00:07:10.880655+0000","last_undegraded":"2024-09-12T00:07:10.880655+0000","last_fullsized":"2024-09-12T00:07:10.880655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:03.147968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719766+0000","last_change":"2024-09-12T00:06:26.675599+0000","last_active":"2024-09-12T00:06:42.719766+0000","last_peered":"2024-09-12T00:06:42.719766+0000","last_clean":"2024-09-12T00:06:42.719766+0000","last_became_active":"2024-09-12T00:06:26.675234+0000","last_became_peered":"2024-09-12T00:06:26.675234+0000","last_unstale":"2024-09-12T00:06:42.719766+0000","last_undegraded":"2024-09-12T00:06:42.719766+0000","last_fullsized":"2024-09-12T00:06:42.719766+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:28.887412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"59'4","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.258770+0000","last_change":"2024-09-12T00:07:27.258770+0000","last_active":"2024-09-12T00:07:27.258770+0000","last_peered":"2024-09-12T00:07:27.258770+0000","last_clean":"2024-09-12T00:07:27.258770+0000","last_became_active":"2024-09-12T00:03:25.357623+0000","last_became_peered":"2024-09-12T00:03:25.357623+0000","last_unstale":"2024-09-12T00:07:27.258770+0000","last_undegraded":"2024-09-12T00:07:27.258770+0000","last_fullsized":"2024-09-12T00:07:27.258770+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'4","last_scrub_stamp":"2024-09-12T00:07:27.258578+0000","last_deep_scrub":"59'4","last_deep_scrub_stamp":"2024-09-12T00:07:27.258578+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.258578+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:50.958109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"116'58","reported_seq":262,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:17.048519+0000","last_change":"2024-09-12T00:07:17.048519+0000","last_active":"2024-09-12T00:07:17.048519+0000","last_peered":"2024-09-12T00:07:17.048519+0000","last_clean":"2024-09-12T00:07:17.048519+0000","last_became_active":"2024-09-12T00:03:23.604773+0000","last_became_peered":"2024-09-12T00:03:23.604773+0000","last_unstale":"2024-09-12T00:07:17.048519+0000","last_undegraded":"2024-09-12T00:07:17.048519+0000","last_fullsized":"2024-09-12T00:07:17.048519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'58","last_scrub_stamp":"2024-09-12T00:07:17.048376+0000","last_deep_scrub":"116'58","last_deep_scrub_stamp":"2024-09-12T00:07:17.048376+0000","last_clean_scrub_stamp":"2024-09-12T00:07:17.048376+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:12.012361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500071+0000","last_change":"2024-09-12T00:03:27.346785+0000","last_active":"2024-09-12T00:06:42.500071+0000","last_peered":"2024-09-12T00:06:42.500071+0000","last_clean":"2024-09-12T00:06:42.500071+0000","last_became_active":"2024-09-12T00:03:27.346168+0000","last_became_peered":"2024-09-12T00:03:27.346168+0000","last_unstale":"2024-09-12T00:06:42.500071+0000","last_undegraded":"2024-09-12T00:06:42.500071+0000","last_fullsized":"2024-09-12T00:06:42.500071+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:12.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"116'52","reported_seq":274,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.498723+0000","last_change":"2024-09-12T00:03:29.343942+0000","last_active":"2024-09-12T00:07:11.498723+0000","last_peered":"2024-09-12T00:07:11.498723+0000","last_clean":"2024-09-12T00:07:11.498723+0000","last_became_active":"2024-09-12T00:03:29.343238+0000","last_became_peered":"2024-09-12T00:03:29.343238+0000","last_unstale":"2024-09-12T00:07:11.498723+0000","last_undegraded":"2024-09-12T00:07:11.498723+0000","last_fullsized":"2024-09-12T00:07:11.498723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:30.949892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":68,"num_read_kb":55,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810193+0000","last_change":"2024-09-12T00:06:26.655176+0000","last_active":"2024-09-12T00:06:41.810193+0000","last_peered":"2024-09-12T00:06:41.810193+0000","last_clean":"2024-09-12T00:06:41.810193+0000","last_became_active":"2024-09-12T00:06:26.654187+0000","last_became_peered":"2024-09-12T00:06:26.654187+0000","last_unstale":"2024-09-12T00:06:41.810193+0000","last_undegraded":"2024-09-12T00:06:41.810193+0000","last_fullsized":"2024-09-12T00:06:41.810193+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:58.719162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.501328+0000","last_change":"2024-09-12T00:03:33.363188+0000","last_active":"2024-09-12T00:06:42.501328+0000","last_peered":"2024-09-12T00:06:42.501328+0000","last_clean":"2024-09-12T00:06:42.501328+0000","last_became_active":"2024-09-12T00:03:33.360672+0000","last_became_peered":"2024-09-12T00:03:33.360672+0000","last_unstale":"2024-09-12T00:06:42.501328+0000","last_undegraded":"2024-09-12T00:06:42.501328+0000","last_fullsized":"2024-09-12T00:06:42.501328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:33.646117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"59'4","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.218379+0000","last_change":"2024-09-12T00:07:25.218379+0000","last_active":"2024-09-12T00:07:25.218379+0000","last_peered":"2024-09-12T00:07:25.218379+0000","last_clean":"2024-09-12T00:07:25.218379+0000","last_became_active":"2024-09-12T00:03:25.336095+0000","last_became_peered":"2024-09-12T00:03:25.336095+0000","last_unstale":"2024-09-12T00:07:25.218379+0000","last_undegraded":"2024-09-12T00:07:25.218379+0000","last_fullsized":"2024-09-12T00:07:25.218379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'4","last_scrub_stamp":"2024-09-12T00:07:25.218086+0000","last_deep_scrub":"59'4","last_deep_scrub_stamp":"2024-09-12T00:07:25.218086+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.218086+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:20.441811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"116'52","reported_seq":129,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.998780+0000","last_change":"2024-09-12T00:07:28.998780+0000","last_active":"2024-09-12T00:07:28.998780+0000","last_peered":"2024-09-12T00:07:28.998780+0000","last_clean":"2024-09-12T00:07:28.998780+0000","last_became_active":"2024-09-12T00:06:26.678646+0000","last_became_peered":"2024-09-12T00:06:26.678646+0000","last_unstale":"2024-09-12T00:07:28.998780+0000","last_undegraded":"2024-09-12T00:07:28.998780+0000","last_fullsized":"2024-09-12T00:07:28.998780+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'52","last_scrub_stamp":"2024-09-12T00:07:28.998593+0000","last_deep_scrub":"116'52","last_deep_scrub_stamp":"2024-09-12T00:07:28.998593+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.998593+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:22.996025+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":192937984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.309762+0000","last_change":"2024-09-12T00:07:31.309762+0000","last_active":"2024-09-12T00:07:31.309762+0000","last_peered":"2024-09-12T00:07:31.309762+0000","last_clean":"2024-09-12T00:07:31.309762+0000","last_became_active":"2024-09-12T00:03:27.325336+0000","last_became_peered":"2024-09-12T00:03:27.325336+0000","last_unstale":"2024-09-12T00:07:31.309762+0000","last_undegraded":"2024-09-12T00:07:31.309762+0000","last_fullsized":"2024-09-12T00:07:31.309762+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:31.309585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:31.309585+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.309585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:03.354156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"116'26","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.502651+0000","last_change":"2024-09-12T00:03:29.335957+0000","last_active":"2024-09-12T00:07:11.502651+0000","last_peered":"2024-09-12T00:07:11.502651+0000","last_clean":"2024-09-12T00:07:11.502651+0000","last_became_active":"2024-09-12T00:03:29.335186+0000","last_became_peered":"2024-09-12T00:03:29.335186+0000","last_unstale":"2024-09-12T00:07:11.502651+0000","last_undegraded":"2024-09-12T00:07:11.502651+0000","last_fullsized":"2024-09-12T00:07:11.502651+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:20.551758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721804+0000","last_change":"2024-09-12T00:06:26.671154+0000","last_active":"2024-09-12T00:06:42.721804+0000","last_peered":"2024-09-12T00:06:42.721804+0000","last_clean":"2024-09-12T00:06:42.721804+0000","last_became_active":"2024-09-12T00:06:26.667486+0000","last_became_peered":"2024-09-12T00:06:26.667486+0000","last_unstale":"2024-09-12T00:06:42.721804+0000","last_undegraded":"2024-09-12T00:06:42.721804+0000","last_fullsized":"2024-09-12T00:06:42.721804+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:31.291883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066037+0000","last_change":"2024-09-12T00:03:33.385037+0000","last_active":"2024-09-12T00:06:42.066037+0000","last_peered":"2024-09-12T00:06:42.066037+0000","last_clean":"2024-09-12T00:06:42.066037+0000","last_became_active":"2024-09-12T00:03:33.384379+0000","last_became_peered":"2024-09-12T00:03:33.384379+0000","last_unstale":"2024-09-12T00:06:42.066037+0000","last_undegraded":"2024-09-12T00:06:42.066037+0000","last_fullsized":"2024-09-12T00:06:42.066037+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:00.153475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"96'10","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.747972+0000","last_change":"2024-09-12T00:07:23.747972+0000","last_active":"2024-09-12T00:07:23.747972+0000","last_peered":"2024-09-12T00:07:23.747972+0000","last_clean":"2024-09-12T00:07:23.747972+0000","last_became_active":"2024-09-12T00:03:25.338417+0000","last_became_peered":"2024-09-12T00:03:25.338417+0000","last_unstale":"2024-09-12T00:07:23.747972+0000","last_undegraded":"2024-09-12T00:07:23.747972+0000","last_fullsized":"2024-09-12T00:07:23.747972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'10","last_scrub_stamp":"2024-09-12T00:07:23.747776+0000","last_deep_scrub":"96'10","last_deep_scrub_stamp":"2024-09-12T00:07:23.747776+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.747776+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:17.423244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"116'62","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.626384+0000","last_change":"2024-09-12T00:07:22.626131+0000","last_active":"2024-09-12T00:07:22.626384+0000","last_peered":"2024-09-12T00:07:22.626384+0000","last_clean":"2024-09-12T00:07:22.626384+0000","last_became_active":"2024-09-12T00:03:23.621654+0000","last_became_peered":"2024-09-12T00:03:23.621654+0000","last_unstale":"2024-09-12T00:07:22.626384+0000","last_undegraded":"2024-09-12T00:07:22.626384+0000","last_fullsized":"2024-09-12T00:07:22.626384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'62","last_scrub_stamp":"2024-09-12T00:07:22.625894+0000","last_deep_scrub":"116'62","last_deep_scrub_stamp":"2024-09-12T00:07:22.625894+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.625894+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:35.984413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.500172+0000","last_change":"2024-09-12T00:03:27.330377+0000","last_active":"2024-09-12T00:06:42.500172+0000","last_peered":"2024-09-12T00:06:42.500172+0000","last_clean":"2024-09-12T00:06:42.500172+0000","last_became_active":"2024-09-12T00:03:27.329713+0000","last_became_peered":"2024-09-12T00:03:27.329713+0000","last_unstale":"2024-09-12T00:06:42.500172+0000","last_undegraded":"2024-09-12T00:06:42.500172+0000","last_fullsized":"2024-09-12T00:06:42.500172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:24.507681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"116'22","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.328386+0000","last_change":"2024-09-12T00:03:29.337028+0000","last_active":"2024-09-12T00:07:11.328386+0000","last_peered":"2024-09-12T00:07:11.328386+0000","last_clean":"2024-09-12T00:07:11.328386+0000","last_became_active":"2024-09-12T00:03:29.335440+0000","last_became_peered":"2024-09-12T00:03:29.335440+0000","last_unstale":"2024-09-12T00:07:11.328386+0000","last_undegraded":"2024-09-12T00:07:11.328386+0000","last_fullsized":"2024-09-12T00:07:11.328386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:19.288395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":21,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721524+0000","last_change":"2024-09-12T00:06:26.674200+0000","last_active":"2024-09-12T00:06:42.721524+0000","last_peered":"2024-09-12T00:06:42.721524+0000","last_clean":"2024-09-12T00:06:42.721524+0000","last_became_active":"2024-09-12T00:06:26.660173+0000","last_became_peered":"2024-09-12T00:06:26.660173+0000","last_unstale":"2024-09-12T00:06:42.721524+0000","last_undegraded":"2024-09-12T00:06:42.721524+0000","last_fullsized":"2024-09-12T00:06:42.721524+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:56.674961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"58'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720918+0000","last_change":"2024-09-12T00:06:32.449370+0000","last_active":"2024-09-12T00:06:42.720918+0000","last_peered":"2024-09-12T00:06:42.720918+0000","last_clean":"2024-09-12T00:06:42.720918+0000","last_became_active":"2024-09-12T00:06:26.677210+0000","last_became_peered":"2024-09-12T00:06:26.677210+0000","last_unstale":"2024-09-12T00:06:42.720918+0000","last_undegraded":"2024-09-12T00:06:42.720918+0000","last_fullsized":"2024-09-12T00:06:42.720918+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:13.086869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"96'4","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.334645+0000","last_change":"2024-09-12T00:07:29.334645+0000","last_active":"2024-09-12T00:07:29.334645+0000","last_peered":"2024-09-12T00:07:29.334645+0000","last_clean":"2024-09-12T00:07:29.334645+0000","last_became_active":"2024-09-12T00:03:25.337237+0000","last_became_peered":"2024-09-12T00:03:25.337237+0000","last_unstale":"2024-09-12T00:07:29.334645+0000","last_undegraded":"2024-09-12T00:07:29.334645+0000","last_fullsized":"2024-09-12T00:07:29.334645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'4","last_scrub_stamp":"2024-09-12T00:07:29.334417+0000","last_deep_scrub":"96'4","last_deep_scrub_stamp":"2024-09-12T00:07:29.334417+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.334417+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:38.184224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"116'58","reported_seq":260,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.585293+0000","last_change":"2024-09-12T00:07:23.585065+0000","last_active":"2024-09-12T00:07:23.585293+0000","last_peered":"2024-09-12T00:07:23.585293+0000","last_clean":"2024-09-12T00:07:23.585293+0000","last_became_active":"2024-09-12T00:03:23.630928+0000","last_became_peered":"2024-09-12T00:03:23.630928+0000","last_unstale":"2024-09-12T00:07:23.585293+0000","last_undegraded":"2024-09-12T00:07:23.585293+0000","last_fullsized":"2024-09-12T00:07:23.585293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'58","last_scrub_stamp":"2024-09-12T00:07:23.584838+0000","last_deep_scrub":"116'58","last_deep_scrub_stamp":"2024-09-12T00:07:23.584838+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.584838+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:27.637020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810384+0000","last_change":"2024-09-12T00:06:26.683708+0000","last_active":"2024-09-12T00:06:41.810384+0000","last_peered":"2024-09-12T00:06:41.810384+0000","last_clean":"2024-09-12T00:06:41.810384+0000","last_became_active":"2024-09-12T00:06:26.651342+0000","last_became_peered":"2024-09-12T00:06:26.651342+0000","last_unstale":"2024-09-12T00:06:41.810384+0000","last_undegraded":"2024-09-12T00:06:41.810384+0000","last_fullsized":"2024-09-12T00:06:41.810384+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:26.297886+0000","last_clean_scrub_stamp":"2024-09-12T00:03:26.297886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:06.251275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"116'32","reported_seq":62,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:11.344979+0000","last_change":"2024-09-12T00:06:33.464772+0000","last_active":"2024-09-12T00:07:11.344979+0000","last_peered":"2024-09-12T00:07:11.344979+0000","last_clean":"2024-09-12T00:07:11.344979+0000","last_became_active":"2024-09-12T00:06:26.680856+0000","last_became_peered":"2024-09-12T00:06:26.680856+0000","last_unstale":"2024-09-12T00:07:11.344979+0000","last_undegraded":"2024-09-12T00:07:11.344979+0000","last_fullsized":"2024-09-12T00:07:11.344979+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:08.755659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":32,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.811844+0000","last_change":"2024-09-12T00:03:31.355300+0000","last_active":"2024-09-12T00:06:41.811844+0000","last_peered":"2024-09-12T00:06:41.811844+0000","last_clean":"2024-09-12T00:06:41.811844+0000","last_became_active":"2024-09-12T00:03:31.354506+0000","last_became_peered":"2024-09-12T00:03:31.354506+0000","last_unstale":"2024-09-12T00:06:41.811844+0000","last_undegraded":"2024-09-12T00:06:41.811844+0000","last_fullsized":"2024-09-12T00:06:41.811844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:51.564710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"58'1","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.815779+0000","last_change":"2024-09-12T00:03:33.384262+0000","last_active":"2024-09-12T00:06:41.815779+0000","last_peered":"2024-09-12T00:06:41.815779+0000","last_clean":"2024-09-12T00:06:41.815779+0000","last_became_active":"2024-09-12T00:03:33.383358+0000","last_became_peered":"2024-09-12T00:03:33.383358+0000","last_unstale":"2024-09-12T00:06:41.815779+0000","last_undegraded":"2024-09-12T00:06:41.815779+0000","last_fullsized":"2024-09-12T00:06:41.815779+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:45.060131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"84'4","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.733278+0000","last_change":"2024-09-12T00:07:30.733278+0000","last_active":"2024-09-12T00:07:30.733278+0000","last_peered":"2024-09-12T00:07:30.733278+0000","last_clean":"2024-09-12T00:07:30.733278+0000","last_became_active":"2024-09-12T00:06:26.664077+0000","last_became_peered":"2024-09-12T00:06:26.664077+0000","last_unstale":"2024-09-12T00:07:30.733278+0000","last_undegraded":"2024-09-12T00:07:30.733278+0000","last_fullsized":"2024-09-12T00:07:30.733278+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-09-12T00:07:30.733079+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-09-12T00:07:30.733079+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.733079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:38.628999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"116'62","reported_seq":265,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.185071+0000","last_change":"2024-09-12T00:07:20.184905+0000","last_active":"2024-09-12T00:07:20.185071+0000","last_peered":"2024-09-12T00:07:20.185071+0000","last_clean":"2024-09-12T00:07:20.185071+0000","last_became_active":"2024-09-12T00:03:23.617138+0000","last_became_peered":"2024-09-12T00:03:23.617138+0000","last_unstale":"2024-09-12T00:07:20.185071+0000","last_undegraded":"2024-09-12T00:07:20.185071+0000","last_fullsized":"2024-09-12T00:07:20.185071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'62","last_scrub_stamp":"2024-09-12T00:07:20.184692+0000","last_deep_scrub":"116'62","last_deep_scrub_stamp":"2024-09-12T00:07:20.184692+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.184692+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:00.138081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":124928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"59'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.714266+0000","last_change":"2024-09-12T00:07:26.714266+0000","last_active":"2024-09-12T00:07:26.714266+0000","last_peered":"2024-09-12T00:07:26.714266+0000","last_clean":"2024-09-12T00:07:26.714266+0000","last_became_active":"2024-09-12T00:03:25.334965+0000","last_became_peered":"2024-09-12T00:03:25.334965+0000","last_unstale":"2024-09-12T00:07:26.714266+0000","last_undegraded":"2024-09-12T00:07:26.714266+0000","last_fullsized":"2024-09-12T00:07:26.714266+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:26.714060+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:26.714060+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.714060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:37.101765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"116'52","reported_seq":254,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.829069+0000","last_change":"2024-09-12T00:07:20.828928+0000","last_active":"2024-09-12T00:07:20.829069+0000","last_peered":"2024-09-12T00:07:20.829069+0000","last_clean":"2024-09-12T00:07:20.829069+0000","last_became_active":"2024-09-12T00:03:23.612542+0000","last_became_peered":"2024-09-12T00:03:23.612542+0000","last_unstale":"2024-09-12T00:07:20.829069+0000","last_undegraded":"2024-09-12T00:07:20.829069+0000","last_fullsized":"2024-09-12T00:07:20.829069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'52","last_scrub_stamp":"2024-09-12T00:07:20.828733+0000","last_deep_scrub":"116'52","last_deep_scrub_stamp":"2024-09-12T00:07:20.828733+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.828733+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:06.289598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"96'4","reported_seq":47,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717901+0000","last_change":"2024-09-12T00:06:32.454921+0000","last_active":"2024-09-12T00:06:42.717901+0000","last_peered":"2024-09-12T00:06:42.717901+0000","last_clean":"2024-09-12T00:06:42.717901+0000","last_became_active":"2024-09-12T00:06:26.677698+0000","last_became_peered":"2024-09-12T00:06:26.677698+0000","last_unstale":"2024-09-12T00:06:42.717901+0000","last_undegraded":"2024-09-12T00:06:42.717901+0000","last_fullsized":"2024-09-12T00:06:42.717901+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:31.889100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"116'60","reported_seq":141,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.952705+0000","last_change":"2024-09-12T00:07:27.952705+0000","last_active":"2024-09-12T00:07:27.952705+0000","last_peered":"2024-09-12T00:07:27.952705+0000","last_clean":"2024-09-12T00:07:27.952705+0000","last_became_active":"2024-09-12T00:06:26.666582+0000","last_became_peered":"2024-09-12T00:06:26.666582+0000","last_unstale":"2024-09-12T00:07:27.952705+0000","last_undegraded":"2024-09-12T00:07:27.952705+0000","last_fullsized":"2024-09-12T00:07:27.952705+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'60","last_scrub_stamp":"2024-09-12T00:07:27.952522+0000","last_deep_scrub":"116'60","last_deep_scrub_stamp":"2024-09-12T00:07:27.952522+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.952522+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:37.239950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":201326592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"63'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066906+0000","last_change":"2024-09-12T00:03:25.354015+0000","last_active":"2024-09-12T00:06:42.066906+0000","last_peered":"2024-09-12T00:06:42.066906+0000","last_clean":"2024-09-12T00:06:42.066906+0000","last_became_active":"2024-09-12T00:03:25.352319+0000","last_became_peered":"2024-09-12T00:03:25.352319+0000","last_unstale":"2024-09-12T00:06:42.066906+0000","last_undegraded":"2024-09-12T00:06:42.066906+0000","last_fullsized":"2024-09-12T00:06:42.066906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:08.033834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"116'34","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.557672+0000","last_change":"2024-09-12T00:07:24.557514+0000","last_active":"2024-09-12T00:07:24.557672+0000","last_peered":"2024-09-12T00:07:24.557672+0000","last_clean":"2024-09-12T00:07:24.557672+0000","last_became_active":"2024-09-12T00:03:23.632850+0000","last_became_peered":"2024-09-12T00:03:23.632850+0000","last_unstale":"2024-09-12T00:07:24.557672+0000","last_undegraded":"2024-09-12T00:07:24.557672+0000","last_fullsized":"2024-09-12T00:07:24.557672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'34","last_scrub_stamp":"2024-09-12T00:07:24.557338+0000","last_deep_scrub":"116'34","last_deep_scrub_stamp":"2024-09-12T00:07:24.557338+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.557338+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:57.802661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065662+0000","last_change":"2024-09-12T00:03:25.357453+0000","last_active":"2024-09-12T00:06:42.065662+0000","last_peered":"2024-09-12T00:06:42.065662+0000","last_clean":"2024-09-12T00:06:42.065662+0000","last_became_active":"2024-09-12T00:03:25.353815+0000","last_became_peered":"2024-09-12T00:03:25.353815+0000","last_unstale":"2024-09-12T00:06:42.065662+0000","last_undegraded":"2024-09-12T00:06:42.065662+0000","last_fullsized":"2024-09-12T00:06:42.065662+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:27.562174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"116'42","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.379467+0000","last_change":"2024-09-12T00:07:21.379467+0000","last_active":"2024-09-12T00:07:21.379467+0000","last_peered":"2024-09-12T00:07:21.379467+0000","last_clean":"2024-09-12T00:07:21.379467+0000","last_became_active":"2024-09-12T00:03:23.608101+0000","last_became_peered":"2024-09-12T00:03:23.608101+0000","last_unstale":"2024-09-12T00:07:21.379467+0000","last_undegraded":"2024-09-12T00:07:21.379467+0000","last_fullsized":"2024-09-12T00:07:21.379467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-09-12T00:07:21.379278+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-09-12T00:07:21.379278+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.379278+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:12.681228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":50,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"96'10","reported_seq":276,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.334265+0000","last_change":"2024-09-12T00:07:27.334265+0000","last_active":"2024-09-12T00:07:27.334265+0000","last_peered":"2024-09-12T00:07:27.334265+0000","last_clean":"2024-09-12T00:07:27.334265+0000","last_became_active":"2024-09-12T00:06:26.681882+0000","last_became_peered":"2024-09-12T00:06:26.681882+0000","last_unstale":"2024-09-12T00:07:27.334265+0000","last_undegraded":"2024-09-12T00:07:27.334265+0000","last_fullsized":"2024-09-12T00:07:27.334265+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'10","last_scrub_stamp":"2024-09-12T00:07:27.334077+0000","last_deep_scrub":"96'10","last_deep_scrub_stamp":"2024-09-12T00:07:27.334077+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.334077+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:36.726266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"116'50","reported_seq":254,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.404633+0000","last_change":"2024-09-12T00:07:22.404633+0000","last_active":"2024-09-12T00:07:22.404633+0000","last_peered":"2024-09-12T00:07:22.404633+0000","last_clean":"2024-09-12T00:07:22.404633+0000","last_became_active":"2024-09-12T00:03:23.615970+0000","last_became_peered":"2024-09-12T00:03:23.615970+0000","last_unstale":"2024-09-12T00:07:22.404633+0000","last_undegraded":"2024-09-12T00:07:22.404633+0000","last_fullsized":"2024-09-12T00:07:22.404633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'50","last_scrub_stamp":"2024-09-12T00:07:22.404446+0000","last_deep_scrub":"116'50","last_deep_scrub_stamp":"2024-09-12T00:07:22.404446+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.404446+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:57.242577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":58,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"63'8","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.415697+0000","last_change":"2024-09-12T00:07:30.415697+0000","last_active":"2024-09-12T00:07:30.415697+0000","last_peered":"2024-09-12T00:07:30.415697+0000","last_clean":"2024-09-12T00:07:30.415697+0000","last_became_active":"2024-09-12T00:03:25.342930+0000","last_became_peered":"2024-09-12T00:03:25.342930+0000","last_unstale":"2024-09-12T00:07:30.415697+0000","last_undegraded":"2024-09-12T00:07:30.415697+0000","last_fullsized":"2024-09-12T00:07:30.415697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'8","last_scrub_stamp":"2024-09-12T00:07:30.415464+0000","last_deep_scrub":"63'8","last_deep_scrub_stamp":"2024-09-12T00:07:30.415464+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.415464+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:41.735451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"116'50","reported_seq":354,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.332514+0000","last_change":"2024-09-12T00:07:30.332514+0000","last_active":"2024-09-12T00:07:30.332514+0000","last_peered":"2024-09-12T00:07:30.332514+0000","last_clean":"2024-09-12T00:07:30.332514+0000","last_became_active":"2024-09-12T00:06:26.672080+0000","last_became_peered":"2024-09-12T00:06:26.672080+0000","last_unstale":"2024-09-12T00:07:30.332514+0000","last_undegraded":"2024-09-12T00:07:30.332514+0000","last_fullsized":"2024-09-12T00:07:30.332514+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'50","last_scrub_stamp":"2024-09-12T00:07:30.332323+0000","last_deep_scrub":"116'50","last_deep_scrub_stamp":"2024-09-12T00:07:30.332323+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.332323+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:10.469784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"96'10","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.101396+0000","last_change":"2024-09-12T00:07:23.101396+0000","last_active":"2024-09-12T00:07:23.101396+0000","last_peered":"2024-09-12T00:07:23.101396+0000","last_clean":"2024-09-12T00:07:23.101396+0000","last_became_active":"2024-09-12T00:03:25.326262+0000","last_became_peered":"2024-09-12T00:03:25.326262+0000","last_unstale":"2024-09-12T00:07:23.101396+0000","last_undegraded":"2024-09-12T00:07:23.101396+0000","last_fullsized":"2024-09-12T00:07:23.101396+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'10","last_scrub_stamp":"2024-09-12T00:07:23.101205+0000","last_deep_scrub":"96'10","last_deep_scrub_stamp":"2024-09-12T00:07:23.101205+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.101205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:05.106323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"116'32","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.566823+0000","last_change":"2024-09-12T00:07:25.566823+0000","last_active":"2024-09-12T00:07:25.566823+0000","last_peered":"2024-09-12T00:07:25.566823+0000","last_clean":"2024-09-12T00:07:25.566823+0000","last_became_active":"2024-09-12T00:03:23.631510+0000","last_became_peered":"2024-09-12T00:03:23.631510+0000","last_unstale":"2024-09-12T00:07:25.566823+0000","last_undegraded":"2024-09-12T00:07:25.566823+0000","last_fullsized":"2024-09-12T00:07:25.566823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-09-12T00:07:25.566638+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-09-12T00:07:25.566638+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.566638+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:24.452852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"58'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.798915+0000","last_change":"2024-09-12T00:07:28.798915+0000","last_active":"2024-09-12T00:07:28.798915+0000","last_peered":"2024-09-12T00:07:28.798915+0000","last_clean":"2024-09-12T00:07:28.798915+0000","last_became_active":"2024-09-12T00:03:25.337834+0000","last_became_peered":"2024-09-12T00:03:25.337834+0000","last_unstale":"2024-09-12T00:07:28.798915+0000","last_undegraded":"2024-09-12T00:07:28.798915+0000","last_fullsized":"2024-09-12T00:07:28.798915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:28.798730+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:28.798730+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.798730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:41.285633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"116'32","reported_seq":99,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.937148+0000","last_change":"2024-09-12T00:07:30.937148+0000","last_active":"2024-09-12T00:07:30.937148+0000","last_peered":"2024-09-12T00:07:30.937148+0000","last_clean":"2024-09-12T00:07:30.937148+0000","last_became_active":"2024-09-12T00:06:26.666889+0000","last_became_peered":"2024-09-12T00:06:26.666889+0000","last_unstale":"2024-09-12T00:07:30.937148+0000","last_undegraded":"2024-09-12T00:07:30.937148+0000","last_fullsized":"2024-09-12T00:07:30.937148+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-09-12T00:07:30.936954+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-09-12T00:07:30.936954+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.936954+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:35.026009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.348032+0000","last_change":"2024-09-12T00:07:28.348032+0000","last_active":"2024-09-12T00:07:28.348032+0000","last_peered":"2024-09-12T00:07:28.348032+0000","last_clean":"2024-09-12T00:07:28.348032+0000","last_became_active":"2024-09-12T00:03:25.336511+0000","last_became_peered":"2024-09-12T00:03:25.336511+0000","last_unstale":"2024-09-12T00:07:28.348032+0000","last_undegraded":"2024-09-12T00:07:28.348032+0000","last_fullsized":"2024-09-12T00:07:28.348032+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:28.347836+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:28.347836+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.347836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:06.273440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"116'56","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.587491+0000","last_change":"2024-09-12T00:07:26.587491+0000","last_active":"2024-09-12T00:07:26.587491+0000","last_peered":"2024-09-12T00:07:26.587491+0000","last_clean":"2024-09-12T00:07:26.587491+0000","last_became_active":"2024-09-12T00:03:23.621761+0000","last_became_peered":"2024-09-12T00:03:23.621761+0000","last_unstale":"2024-09-12T00:07:26.587491+0000","last_undegraded":"2024-09-12T00:07:26.587491+0000","last_fullsized":"2024-09-12T00:07:26.587491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-09-12T00:07:26.587314+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-09-12T00:07:26.587314+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.587314+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:13.090555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"59'4","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066619+0000","last_change":"2024-09-12T00:06:28.859921+0000","last_active":"2024-09-12T00:06:42.066619+0000","last_peered":"2024-09-12T00:06:42.066619+0000","last_clean":"2024-09-12T00:06:42.066619+0000","last_became_active":"2024-09-12T00:06:26.677331+0000","last_became_peered":"2024-09-12T00:06:26.677331+0000","last_unstale":"2024-09-12T00:06:42.066619+0000","last_undegraded":"2024-09-12T00:06:42.066619+0000","last_fullsized":"2024-09-12T00:06:42.066619+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:05.062779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"116'48","reported_seq":252,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.021467+0000","last_change":"2024-09-12T00:07:19.021467+0000","last_active":"2024-09-12T00:07:19.021467+0000","last_peered":"2024-09-12T00:07:19.021467+0000","last_clean":"2024-09-12T00:07:19.021467+0000","last_became_active":"2024-09-12T00:03:23.600673+0000","last_became_peered":"2024-09-12T00:03:23.600673+0000","last_unstale":"2024-09-12T00:07:19.021467+0000","last_undegraded":"2024-09-12T00:07:19.021467+0000","last_fullsized":"2024-09-12T00:07:19.021467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-09-12T00:07:19.021358+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-09-12T00:07:19.021358+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.021358+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:41.825822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"96'6","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.170482+0000","last_change":"2024-09-12T00:07:27.170482+0000","last_active":"2024-09-12T00:07:27.170482+0000","last_peered":"2024-09-12T00:07:27.170482+0000","last_clean":"2024-09-12T00:07:27.170482+0000","last_became_active":"2024-09-12T00:03:25.324597+0000","last_became_peered":"2024-09-12T00:03:25.324597+0000","last_unstale":"2024-09-12T00:07:27.170482+0000","last_undegraded":"2024-09-12T00:07:27.170482+0000","last_fullsized":"2024-09-12T00:07:27.170482+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'6","last_scrub_stamp":"2024-09-12T00:07:27.170254+0000","last_deep_scrub":"96'6","last_deep_scrub_stamp":"2024-09-12T00:07:27.170254+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.170254+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:07.383195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"116'38","reported_seq":240,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.753120+0000","last_change":"2024-09-12T00:07:24.753120+0000","last_active":"2024-09-12T00:07:24.753120+0000","last_peered":"2024-09-12T00:07:24.753120+0000","last_clean":"2024-09-12T00:07:24.753120+0000","last_became_active":"2024-09-12T00:03:23.621063+0000","last_became_peered":"2024-09-12T00:03:23.621063+0000","last_unstale":"2024-09-12T00:07:24.753120+0000","last_undegraded":"2024-09-12T00:07:24.753120+0000","last_fullsized":"2024-09-12T00:07:24.753120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'38","last_scrub_stamp":"2024-09-12T00:07:24.752946+0000","last_deep_scrub":"116'38","last_deep_scrub_stamp":"2024-09-12T00:07:24.752946+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.752946+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:29.077551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":75776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.152134+0000","last_change":"2024-09-12T00:07:25.152134+0000","last_active":"2024-09-12T00:07:25.152134+0000","last_peered":"2024-09-12T00:07:25.152134+0000","last_clean":"2024-09-12T00:07:25.152134+0000","last_became_active":"2024-09-12T00:03:25.357286+0000","last_became_peered":"2024-09-12T00:03:25.357286+0000","last_unstale":"2024-09-12T00:07:25.152134+0000","last_undegraded":"2024-09-12T00:07:25.152134+0000","last_fullsized":"2024-09-12T00:07:25.152134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:25.151922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:25.151922+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.151922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:11.429863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"116'40","reported_seq":245,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.429253+0000","last_change":"2024-09-12T00:07:19.429253+0000","last_active":"2024-09-12T00:07:19.429253+0000","last_peered":"2024-09-12T00:07:19.429253+0000","last_clean":"2024-09-12T00:07:19.429253+0000","last_became_active":"2024-09-12T00:03:23.600591+0000","last_became_peered":"2024-09-12T00:03:23.600591+0000","last_unstale":"2024-09-12T00:07:19.429253+0000","last_undegraded":"2024-09-12T00:07:19.429253+0000","last_fullsized":"2024-09-12T00:07:19.429253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-09-12T00:07:19.429061+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-09-12T00:07:19.429061+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.429061+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:32.448809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":48,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"84'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.750681+0000","last_change":"2024-09-12T00:07:27.750681+0000","last_active":"2024-09-12T00:07:27.750681+0000","last_peered":"2024-09-12T00:07:27.750681+0000","last_clean":"2024-09-12T00:07:27.750681+0000","last_became_active":"2024-09-12T00:03:25.329742+0000","last_became_peered":"2024-09-12T00:03:25.329742+0000","last_unstale":"2024-09-12T00:07:27.750681+0000","last_undegraded":"2024-09-12T00:07:27.750681+0000","last_fullsized":"2024-09-12T00:07:27.750681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-09-12T00:07:27.750492+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-09-12T00:07:27.750492+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.750492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:22.714477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"116'62","reported_seq":143,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.908089+0000","last_change":"2024-09-12T00:07:31.908089+0000","last_active":"2024-09-12T00:07:31.908089+0000","last_peered":"2024-09-12T00:07:31.908089+0000","last_clean":"2024-09-12T00:07:31.908089+0000","last_became_active":"2024-09-12T00:06:26.668022+0000","last_became_peered":"2024-09-12T00:06:26.668022+0000","last_unstale":"2024-09-12T00:07:31.908089+0000","last_undegraded":"2024-09-12T00:07:31.908089+0000","last_fullsized":"2024-09-12T00:07:31.908089+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'62","last_scrub_stamp":"2024-09-12T00:07:31.907903+0000","last_deep_scrub":"116'62","last_deep_scrub_stamp":"2024-09-12T00:07:31.907903+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.907903+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:36.717756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":3,"num_write":70,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":222298112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"59'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.744456+0000","last_change":"2024-09-12T00:07:31.744456+0000","last_active":"2024-09-12T00:07:31.744456+0000","last_peered":"2024-09-12T00:07:31.744456+0000","last_clean":"2024-09-12T00:07:31.744456+0000","last_became_active":"2024-09-12T00:03:25.346874+0000","last_became_peered":"2024-09-12T00:03:25.346874+0000","last_unstale":"2024-09-12T00:07:31.744456+0000","last_undegraded":"2024-09-12T00:07:31.744456+0000","last_fullsized":"2024-09-12T00:07:31.744456+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'4","last_scrub_stamp":"2024-09-12T00:07:31.744229+0000","last_deep_scrub":"59'4","last_deep_scrub_stamp":"2024-09-12T00:07:31.744229+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.744229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:54.373084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"116'46","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.788234+0000","last_change":"2024-09-12T00:07:21.788234+0000","last_active":"2024-09-12T00:07:21.788234+0000","last_peered":"2024-09-12T00:07:21.788234+0000","last_clean":"2024-09-12T00:07:21.788234+0000","last_became_active":"2024-09-12T00:03:23.620261+0000","last_became_peered":"2024-09-12T00:03:23.620261+0000","last_unstale":"2024-09-12T00:07:21.788234+0000","last_undegraded":"2024-09-12T00:07:21.788234+0000","last_fullsized":"2024-09-12T00:07:21.788234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:21.788057+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:21.788057+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.788057+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:38.237924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"63'8","reported_seq":234,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.119687+0000","last_change":"2024-09-12T00:07:24.119687+0000","last_active":"2024-09-12T00:07:24.119687+0000","last_peered":"2024-09-12T00:07:24.119687+0000","last_clean":"2024-09-12T00:07:24.119687+0000","last_became_active":"2024-09-12T00:03:25.357186+0000","last_became_peered":"2024-09-12T00:03:25.357186+0000","last_unstale":"2024-09-12T00:07:24.119687+0000","last_undegraded":"2024-09-12T00:07:24.119687+0000","last_fullsized":"2024-09-12T00:07:24.119687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'8","last_scrub_stamp":"2024-09-12T00:07:24.119490+0000","last_deep_scrub":"63'8","last_deep_scrub_stamp":"2024-09-12T00:07:24.119490+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.119490+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:16.554769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"116'52","reported_seq":129,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.967297+0000","last_change":"2024-09-12T00:07:29.967297+0000","last_active":"2024-09-12T00:07:29.967297+0000","last_peered":"2024-09-12T00:07:29.967297+0000","last_clean":"2024-09-12T00:07:29.967297+0000","last_became_active":"2024-09-12T00:06:26.677360+0000","last_became_peered":"2024-09-12T00:06:26.677360+0000","last_unstale":"2024-09-12T00:07:29.967297+0000","last_undegraded":"2024-09-12T00:07:29.967297+0000","last_fullsized":"2024-09-12T00:07:29.967297+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'52","last_scrub_stamp":"2024-09-12T00:07:29.967103+0000","last_deep_scrub":"116'52","last_deep_scrub_stamp":"2024-09-12T00:07:29.967103+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.967103+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:32.916886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":163577856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"116'54","reported_seq":132,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.902383+0000","last_change":"2024-09-12T00:07:32.902383+0000","last_active":"2024-09-12T00:07:32.902383+0000","last_peered":"2024-09-12T00:07:32.902383+0000","last_clean":"2024-09-12T00:07:32.902383+0000","last_became_active":"2024-09-12T00:06:26.669830+0000","last_became_peered":"2024-09-12T00:06:26.669830+0000","last_unstale":"2024-09-12T00:07:32.902383+0000","last_undegraded":"2024-09-12T00:07:32.902383+0000","last_fullsized":"2024-09-12T00:07:32.902383+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'54","last_scrub_stamp":"2024-09-12T00:07:32.902205+0000","last_deep_scrub":"116'54","last_deep_scrub_stamp":"2024-09-12T00:07:32.902205+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.902205+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:44.716783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":192937984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"84'6","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.813636+0000","last_change":"2024-09-12T00:03:25.350116+0000","last_active":"2024-09-12T00:06:41.813636+0000","last_peered":"2024-09-12T00:06:41.813636+0000","last_clean":"2024-09-12T00:06:41.813636+0000","last_became_active":"2024-09-12T00:03:25.349281+0000","last_became_peered":"2024-09-12T00:03:25.349281+0000","last_unstale":"2024-09-12T00:06:41.813636+0000","last_undegraded":"2024-09-12T00:06:41.813636+0000","last_fullsized":"2024-09-12T00:06:41.813636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:24.579692+0000","last_clean_scrub_stamp":"2024-09-12T00:03:24.579692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:33.350458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"116'40","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.635628+0000","last_change":"2024-09-12T00:07:27.635628+0000","last_active":"2024-09-12T00:07:27.635628+0000","last_peered":"2024-09-12T00:07:27.635628+0000","last_clean":"2024-09-12T00:07:27.635628+0000","last_became_active":"2024-09-12T00:03:23.616154+0000","last_became_peered":"2024-09-12T00:03:23.616154+0000","last_unstale":"2024-09-12T00:07:27.635628+0000","last_undegraded":"2024-09-12T00:07:27.635628+0000","last_fullsized":"2024-09-12T00:07:27.635628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-09-12T00:07:27.635444+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-09-12T00:07:27.635444+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.635444+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:56.025683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"58'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.105454+0000","last_change":"2024-09-12T00:07:30.105454+0000","last_active":"2024-09-12T00:07:30.105454+0000","last_peered":"2024-09-12T00:07:30.105454+0000","last_clean":"2024-09-12T00:07:30.105454+0000","last_became_active":"2024-09-12T00:03:25.344917+0000","last_became_peered":"2024-09-12T00:03:25.344917+0000","last_unstale":"2024-09-12T00:07:30.105454+0000","last_undegraded":"2024-09-12T00:07:30.105454+0000","last_fullsized":"2024-09-12T00:07:30.105454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:30.105274+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:30.105274+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.105274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:58.157135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":339,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1109,"ondisk_log_size":1109,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":31604,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1351,"num_read_kb":1799,"num_write":737,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":117531,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1090,"ondisk_log_size":1090,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1444,"num_read_kb":1412,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3088,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":721,"num_bytes_recovered":3007315968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542202,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36732,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335108,"statfs":{"total":96636764160,"available":96599150592,"internally_reserved":0,"allocated":1421312,"data_stored":797851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542202,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1425408,"data_stored":798943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542202,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41472,"kb_used_data":1968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330368,"statfs":{"total":96636764160,"available":96594296832,"internally_reserved":0,"allocated":2015232,"data_stored":1388365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542202,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36732,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335108,"statfs":{"total":96636764160,"available":96599150592,"internally_reserved":0,"allocated":1421312,"data_stored":797651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542202,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40884,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330956,"statfs":{"total":96636764160,"available":96594898944,"internally_reserved":0,"allocated":1413120,"data_stored":797340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542203,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36708,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335132,"statfs":{"total":96636764160,"available":96599175168,"internally_reserved":0,"allocated":1396736,"data_stored":796956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542202,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37340,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334500,"statfs":{"total":96636764160,"available":96598528000,"internally_reserved":0,"allocated":2043904,"data_stored":1389896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542201,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36756,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335084,"statfs":{"total":96636764160,"available":96599126016,"internally_reserved":0,"allocated":1445888,"data_stored":798128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:07:39.435 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.436 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.436 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.436 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.436 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.437 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.437 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.441 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.441 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.441 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.441 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.441 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.442 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.442 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.442 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.442 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.442 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.442 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.442 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.443 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.443 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.443 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.443 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.444 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.444 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.444 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.444 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.444 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.444 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.445 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.445 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.445 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.445 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.445 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.445 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.446 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.446 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.446 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.446 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.446 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.446 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.447 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.447 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.448 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.448 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.448 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.448 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.448 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.448 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.448 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.448 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.449 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.449 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.449 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.449 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.449 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.449 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.449 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.450 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.450 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.450 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.450 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.450 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.450 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.450 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.450 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.451 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.451 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.451 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.451 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.451 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.451 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.452 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.452 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.452 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.452 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.452 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.452 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.452 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.452 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.453 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.453 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.453 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.453 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.453 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.453 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.453 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.453 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.453 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.454 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.454 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.454 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.454 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.454 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.454 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.454 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.454 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.455 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.455 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.455 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.455 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.455 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.455 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.455 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.455 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.456 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.456 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.456 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.456 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.456 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.456 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.456 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.456 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.457 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.457 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.457 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.457 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.457 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.457 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.457 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.457 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.458 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:03:26.297886+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.458 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.458 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.458 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.458 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.458 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.458 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.459 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.459 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T00:03:24.579692+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:39.459 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T00:07:59.460 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:07:59.820 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:07:59.827 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T00:07:59.841 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-09-12T00:07:58.500937+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":624007,"num_objects":232,"num_object_clones":0,"num_object_copies":464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":232,"num_whiteouts":0,"num_read":5210,"num_read_kb":4083,"num_write":4549,"num_write_kb":6187135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":928,"num_bytes_recovered":3007433610,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5890,"ondisk_log_size":5890,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":307520,"kb_used_data":12288,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754667200,"statfs":{"total":773094113280,"available":772779212800,"internally_reserved":0,"allocated":12582912,"data_stored":7565130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":302173746},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005727"},"pg_stats":[{"pgid":"3.3f","version":"116'32","reported_seq":311,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.361272+0000","last_change":"2024-09-12T00:07:25.361131+0000","last_active":"2024-09-12T00:07:25.361272+0000","last_peered":"2024-09-12T00:07:25.361272+0000","last_clean":"2024-09-12T00:07:25.361272+0000","last_became_active":"2024-09-12T00:06:26.678792+0000","last_became_peered":"2024-09-12T00:06:26.678792+0000","last_unstale":"2024-09-12T00:07:25.361272+0000","last_undegraded":"2024-09-12T00:07:25.361272+0000","last_fullsized":"2024-09-12T00:07:25.361272+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-09-12T00:07:25.360823+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-09-12T00:07:25.360823+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.360823+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:20.400665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.078430+0000","last_change":"2024-09-12T00:07:32.078430+0000","last_active":"2024-09-12T00:07:32.078430+0000","last_peered":"2024-09-12T00:07:32.078430+0000","last_clean":"2024-09-12T00:07:32.078430+0000","last_became_active":"2024-09-12T00:03:25.335964+0000","last_became_peered":"2024-09-12T00:03:25.335964+0000","last_unstale":"2024-09-12T00:07:32.078430+0000","last_undegraded":"2024-09-12T00:07:32.078430+0000","last_fullsized":"2024-09-12T00:07:32.078430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-12T00:07:32.078212+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-12T00:07:32.078212+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.078212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:27.301937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"116'48","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.619915+0000","last_change":"2024-09-12T00:07:29.619769+0000","last_active":"2024-09-12T00:07:29.619915+0000","last_peered":"2024-09-12T00:07:29.619915+0000","last_clean":"2024-09-12T00:07:29.619915+0000","last_became_active":"2024-09-12T00:03:23.627630+0000","last_became_peered":"2024-09-12T00:03:23.627630+0000","last_unstale":"2024-09-12T00:07:29.619915+0000","last_undegraded":"2024-09-12T00:07:29.619915+0000","last_fullsized":"2024-09-12T00:07:29.619915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-09-12T00:07:29.619589+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-09-12T00:07:29.619589+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.619589+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:42.773035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"76'2","reported_seq":53,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:40.962746+0000","last_change":"2024-09-12T00:07:40.962746+0000","last_active":"2024-09-12T00:07:40.962746+0000","last_peered":"2024-09-12T00:07:40.962746+0000","last_clean":"2024-09-12T00:07:40.962746+0000","last_became_active":"2024-09-12T00:06:26.660419+0000","last_became_peered":"2024-09-12T00:06:26.660419+0000","last_unstale":"2024-09-12T00:07:40.962746+0000","last_undegraded":"2024-09-12T00:07:40.962746+0000","last_fullsized":"2024-09-12T00:07:40.962746+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-12T00:07:40.962547+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-12T00:07:40.962547+0000","last_clean_scrub_stamp":"2024-09-12T00:07:40.962547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:09.720504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"116'58","reported_seq":260,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.669920+0000","last_change":"2024-09-12T00:07:28.669755+0000","last_active":"2024-09-12T00:07:28.669920+0000","last_peered":"2024-09-12T00:07:28.669920+0000","last_clean":"2024-09-12T00:07:28.669920+0000","last_became_active":"2024-09-12T00:03:23.625728+0000","last_became_peered":"2024-09-12T00:03:23.625728+0000","last_unstale":"2024-09-12T00:07:28.669920+0000","last_undegraded":"2024-09-12T00:07:28.669920+0000","last_fullsized":"2024-09-12T00:07:28.669920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'58","last_scrub_stamp":"2024-09-12T00:07:28.669563+0000","last_deep_scrub":"116'58","last_deep_scrub_stamp":"2024-09-12T00:07:28.669563+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.669563+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:18.098931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"96'4","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:41.925750+0000","last_change":"2024-09-12T00:07:41.925750+0000","last_active":"2024-09-12T00:07:41.925750+0000","last_peered":"2024-09-12T00:07:41.925750+0000","last_clean":"2024-09-12T00:07:41.925750+0000","last_became_active":"2024-09-12T00:06:26.677271+0000","last_became_peered":"2024-09-12T00:06:26.677271+0000","last_unstale":"2024-09-12T00:07:41.925750+0000","last_undegraded":"2024-09-12T00:07:41.925750+0000","last_fullsized":"2024-09-12T00:07:41.925750+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'4","last_scrub_stamp":"2024-09-12T00:07:41.925554+0000","last_deep_scrub":"96'4","last_deep_scrub_stamp":"2024-09-12T00:07:41.925554+0000","last_clean_scrub_stamp":"2024-09-12T00:07:41.925554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:04.680943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"116'44","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.194854+0000","last_change":"2024-09-12T00:07:22.194710+0000","last_active":"2024-09-12T00:07:22.194854+0000","last_peered":"2024-09-12T00:07:22.194854+0000","last_clean":"2024-09-12T00:07:22.194854+0000","last_became_active":"2024-09-12T00:03:23.609326+0000","last_became_peered":"2024-09-12T00:03:23.609326+0000","last_unstale":"2024-09-12T00:07:22.194854+0000","last_undegraded":"2024-09-12T00:07:22.194854+0000","last_fullsized":"2024-09-12T00:07:22.194854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-09-12T00:07:22.194527+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-09-12T00:07:22.194527+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.194527+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:11.658941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'8","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.757581+0000","last_change":"2024-09-12T00:07:32.757581+0000","last_active":"2024-09-12T00:07:32.757581+0000","last_peered":"2024-09-12T00:07:32.757581+0000","last_clean":"2024-09-12T00:07:32.757581+0000","last_became_active":"2024-09-12T00:03:25.338805+0000","last_became_peered":"2024-09-12T00:03:25.338805+0000","last_unstale":"2024-09-12T00:07:32.757581+0000","last_undegraded":"2024-09-12T00:07:32.757581+0000","last_fullsized":"2024-09-12T00:07:32.757581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'8","last_scrub_stamp":"2024-09-12T00:07:32.757327+0000","last_deep_scrub":"59'8","last_deep_scrub_stamp":"2024-09-12T00:07:32.757327+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.757327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:22.657437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"116'52","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.408443+0000","last_change":"2024-09-12T00:07:24.408443+0000","last_active":"2024-09-12T00:07:24.408443+0000","last_peered":"2024-09-12T00:07:24.408443+0000","last_clean":"2024-09-12T00:07:24.408443+0000","last_became_active":"2024-09-12T00:03:23.633580+0000","last_became_peered":"2024-09-12T00:03:23.633580+0000","last_unstale":"2024-09-12T00:07:24.408443+0000","last_undegraded":"2024-09-12T00:07:24.408443+0000","last_fullsized":"2024-09-12T00:07:24.408443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'52","last_scrub_stamp":"2024-09-12T00:07:24.408218+0000","last_deep_scrub":"116'52","last_deep_scrub_stamp":"2024-09-12T00:07:24.408218+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.408218+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:51.856526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"59'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.373844+0000","last_change":"2024-09-12T00:07:31.373844+0000","last_active":"2024-09-12T00:07:31.373844+0000","last_peered":"2024-09-12T00:07:31.373844+0000","last_clean":"2024-09-12T00:07:31.373844+0000","last_became_active":"2024-09-12T00:03:25.324138+0000","last_became_peered":"2024-09-12T00:03:25.324138+0000","last_unstale":"2024-09-12T00:07:31.373844+0000","last_undegraded":"2024-09-12T00:07:31.373844+0000","last_fullsized":"2024-09-12T00:07:31.373844+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:31.373657+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:31.373657+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.373657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:41.146834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"116'42","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:17.194248+0000","last_change":"2024-09-12T00:07:17.194248+0000","last_active":"2024-09-12T00:07:17.194248+0000","last_peered":"2024-09-12T00:07:17.194248+0000","last_clean":"2024-09-12T00:07:17.194248+0000","last_became_active":"2024-09-12T00:03:23.609509+0000","last_became_peered":"2024-09-12T00:03:23.609509+0000","last_unstale":"2024-09-12T00:07:17.194248+0000","last_undegraded":"2024-09-12T00:07:17.194248+0000","last_fullsized":"2024-09-12T00:07:17.194248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-09-12T00:07:17.194144+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-09-12T00:07:17.194144+0000","last_clean_scrub_stamp":"2024-09-12T00:07:17.194144+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:20.566593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"96'12","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.361043+0000","last_change":"2024-09-12T00:07:30.360851+0000","last_active":"2024-09-12T00:07:30.361043+0000","last_peered":"2024-09-12T00:07:30.361043+0000","last_clean":"2024-09-12T00:07:30.361043+0000","last_became_active":"2024-09-12T00:03:25.355002+0000","last_became_peered":"2024-09-12T00:03:25.355002+0000","last_unstale":"2024-09-12T00:07:30.361043+0000","last_undegraded":"2024-09-12T00:07:30.361043+0000","last_fullsized":"2024-09-12T00:07:30.361043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'12","last_scrub_stamp":"2024-09-12T00:07:30.360652+0000","last_deep_scrub":"96'12","last_deep_scrub_stamp":"2024-09-12T00:07:30.360652+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.360652+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:45.041553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"116'56","reported_seq":260,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.426625+0000","last_change":"2024-09-12T00:07:21.426625+0000","last_active":"2024-09-12T00:07:21.426625+0000","last_peered":"2024-09-12T00:07:21.426625+0000","last_clean":"2024-09-12T00:07:21.426625+0000","last_became_active":"2024-09-12T00:03:23.606143+0000","last_became_peered":"2024-09-12T00:03:23.606143+0000","last_unstale":"2024-09-12T00:07:21.426625+0000","last_undegraded":"2024-09-12T00:07:21.426625+0000","last_fullsized":"2024-09-12T00:07:21.426625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-09-12T00:07:21.426412+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-09-12T00:07:21.426412+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.426412+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:43.315445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:33.299168+0000","last_change":"2024-09-12T00:07:33.298975+0000","last_active":"2024-09-12T00:07:33.299168+0000","last_peered":"2024-09-12T00:07:33.299168+0000","last_clean":"2024-09-12T00:07:33.299168+0000","last_became_active":"2024-09-12T00:03:25.329625+0000","last_became_peered":"2024-09-12T00:03:25.329625+0000","last_unstale":"2024-09-12T00:07:33.299168+0000","last_undegraded":"2024-09-12T00:07:33.299168+0000","last_fullsized":"2024-09-12T00:07:33.299168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:33.298774+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:33.298774+0000","last_clean_scrub_stamp":"2024-09-12T00:07:33.298774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:14.492694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"116'54","reported_seq":255,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.615281+0000","last_change":"2024-09-12T00:07:32.615281+0000","last_active":"2024-09-12T00:07:32.615281+0000","last_peered":"2024-09-12T00:07:32.615281+0000","last_clean":"2024-09-12T00:07:32.615281+0000","last_became_active":"2024-09-12T00:03:23.626018+0000","last_became_peered":"2024-09-12T00:03:23.626018+0000","last_unstale":"2024-09-12T00:07:32.615281+0000","last_undegraded":"2024-09-12T00:07:32.615281+0000","last_fullsized":"2024-09-12T00:07:32.615281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'54","last_scrub_stamp":"2024-09-12T00:07:32.615096+0000","last_deep_scrub":"116'54","last_deep_scrub_stamp":"2024-09-12T00:07:32.615096+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.615096+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:50.011601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"59'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:38.752164+0000","last_change":"2024-09-12T00:07:38.752000+0000","last_active":"2024-09-12T00:07:38.752164+0000","last_peered":"2024-09-12T00:07:38.752164+0000","last_clean":"2024-09-12T00:07:38.752164+0000","last_became_active":"2024-09-12T00:03:25.347902+0000","last_became_peered":"2024-09-12T00:03:25.347902+0000","last_unstale":"2024-09-12T00:07:38.752164+0000","last_undegraded":"2024-09-12T00:07:38.752164+0000","last_fullsized":"2024-09-12T00:07:38.752164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'4","last_scrub_stamp":"2024-09-12T00:07:38.751805+0000","last_deep_scrub":"59'4","last_deep_scrub_stamp":"2024-09-12T00:07:38.751805+0000","last_clean_scrub_stamp":"2024-09-12T00:07:38.751805+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:40.083198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"59'2","reported_seq":53,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:37.995364+0000","last_change":"2024-09-12T00:07:37.995364+0000","last_active":"2024-09-12T00:07:37.995364+0000","last_peered":"2024-09-12T00:07:37.995364+0000","last_clean":"2024-09-12T00:07:37.995364+0000","last_became_active":"2024-09-12T00:06:26.653851+0000","last_became_peered":"2024-09-12T00:06:26.653851+0000","last_unstale":"2024-09-12T00:07:37.995364+0000","last_undegraded":"2024-09-12T00:07:37.995364+0000","last_fullsized":"2024-09-12T00:07:37.995364+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:37.995173+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:37.995173+0000","last_clean_scrub_stamp":"2024-09-12T00:07:37.995173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:33.567238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"116'34","reported_seq":310,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.047258+0000","last_change":"2024-09-12T00:07:20.047258+0000","last_active":"2024-09-12T00:07:20.047258+0000","last_peered":"2024-09-12T00:07:20.047258+0000","last_clean":"2024-09-12T00:07:20.047258+0000","last_became_active":"2024-09-12T00:06:26.664959+0000","last_became_peered":"2024-09-12T00:06:26.664959+0000","last_unstale":"2024-09-12T00:07:20.047258+0000","last_undegraded":"2024-09-12T00:07:20.047258+0000","last_fullsized":"2024-09-12T00:07:20.047258+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'34","last_scrub_stamp":"2024-09-12T00:07:20.047081+0000","last_deep_scrub":"116'34","last_deep_scrub_stamp":"2024-09-12T00:07:20.047081+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.047081+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:54.885211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"59'2","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.352578+0000","last_change":"2024-09-12T00:07:29.352578+0000","last_active":"2024-09-12T00:07:29.352578+0000","last_peered":"2024-09-12T00:07:29.352578+0000","last_clean":"2024-09-12T00:07:29.352578+0000","last_became_active":"2024-09-12T00:03:25.334375+0000","last_became_peered":"2024-09-12T00:03:25.334375+0000","last_unstale":"2024-09-12T00:07:29.352578+0000","last_undegraded":"2024-09-12T00:07:29.352578+0000","last_fullsized":"2024-09-12T00:07:29.352578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:29.352370+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:29.352370+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.352370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:34.512492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"116'40","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.426222+0000","last_change":"2024-09-12T00:07:23.426222+0000","last_active":"2024-09-12T00:07:23.426222+0000","last_peered":"2024-09-12T00:07:23.426222+0000","last_clean":"2024-09-12T00:07:23.426222+0000","last_became_active":"2024-09-12T00:03:23.614019+0000","last_became_peered":"2024-09-12T00:03:23.614019+0000","last_unstale":"2024-09-12T00:07:23.426222+0000","last_undegraded":"2024-09-12T00:07:23.426222+0000","last_fullsized":"2024-09-12T00:07:23.426222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-09-12T00:07:23.426027+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-09-12T00:07:23.426027+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.426027+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:38.438913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"96'12","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.151228+0000","last_change":"2024-09-12T00:07:26.151228+0000","last_active":"2024-09-12T00:07:26.151228+0000","last_peered":"2024-09-12T00:07:26.151228+0000","last_clean":"2024-09-12T00:07:26.151228+0000","last_became_active":"2024-09-12T00:03:25.357571+0000","last_became_peered":"2024-09-12T00:03:25.357571+0000","last_unstale":"2024-09-12T00:07:26.151228+0000","last_undegraded":"2024-09-12T00:07:26.151228+0000","last_fullsized":"2024-09-12T00:07:26.151228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'12","last_scrub_stamp":"2024-09-12T00:07:26.151041+0000","last_deep_scrub":"96'12","last_deep_scrub_stamp":"2024-09-12T00:07:26.151041+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.151041+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:51.666529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"116'46","reported_seq":346,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.398246+0000","last_change":"2024-09-12T00:07:22.398246+0000","last_active":"2024-09-12T00:07:22.398246+0000","last_peered":"2024-09-12T00:07:22.398246+0000","last_clean":"2024-09-12T00:07:22.398246+0000","last_became_active":"2024-09-12T00:06:26.682027+0000","last_became_peered":"2024-09-12T00:06:26.682027+0000","last_unstale":"2024-09-12T00:07:22.398246+0000","last_undegraded":"2024-09-12T00:07:22.398246+0000","last_fullsized":"2024-09-12T00:07:22.398246+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:22.398067+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:22.398067+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.398067+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:27.681427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":167772160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'8","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.381628+0000","last_change":"2024-09-12T00:07:31.381628+0000","last_active":"2024-09-12T00:07:31.381628+0000","last_peered":"2024-09-12T00:07:31.381628+0000","last_clean":"2024-09-12T00:07:31.381628+0000","last_became_active":"2024-09-12T00:03:25.344959+0000","last_became_peered":"2024-09-12T00:03:25.344959+0000","last_unstale":"2024-09-12T00:07:31.381628+0000","last_undegraded":"2024-09-12T00:07:31.381628+0000","last_fullsized":"2024-09-12T00:07:31.381628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'8","last_scrub_stamp":"2024-09-12T00:07:31.381429+0000","last_deep_scrub":"63'8","last_deep_scrub_stamp":"2024-09-12T00:07:31.381429+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.381429+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:29.418399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"116'34","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.425570+0000","last_change":"2024-09-12T00:07:20.425570+0000","last_active":"2024-09-12T00:07:20.425570+0000","last_peered":"2024-09-12T00:07:20.425570+0000","last_clean":"2024-09-12T00:07:20.425570+0000","last_became_active":"2024-09-12T00:03:23.602640+0000","last_became_peered":"2024-09-12T00:03:23.602640+0000","last_unstale":"2024-09-12T00:07:20.425570+0000","last_undegraded":"2024-09-12T00:07:20.425570+0000","last_fullsized":"2024-09-12T00:07:20.425570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'34","last_scrub_stamp":"2024-09-12T00:07:20.425354+0000","last_deep_scrub":"116'34","last_deep_scrub_stamp":"2024-09-12T00:07:20.425354+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.425354+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:13.305799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"59'2","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:39.710516+0000","last_change":"2024-09-12T00:07:39.710516+0000","last_active":"2024-09-12T00:07:39.710516+0000","last_peered":"2024-09-12T00:07:39.710516+0000","last_clean":"2024-09-12T00:07:39.710516+0000","last_became_active":"2024-09-12T00:06:26.665307+0000","last_became_peered":"2024-09-12T00:06:26.665307+0000","last_unstale":"2024-09-12T00:07:39.710516+0000","last_undegraded":"2024-09-12T00:07:39.710516+0000","last_fullsized":"2024-09-12T00:07:39.710516+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:39.710322+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:39.710322+0000","last_clean_scrub_stamp":"2024-09-12T00:07:39.710322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:27.544957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"116'46","reported_seq":249,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.363096+0000","last_change":"2024-09-12T00:07:24.363096+0000","last_active":"2024-09-12T00:07:24.363096+0000","last_peered":"2024-09-12T00:07:24.363096+0000","last_clean":"2024-09-12T00:07:24.363096+0000","last_became_active":"2024-09-12T00:03:23.603932+0000","last_became_peered":"2024-09-12T00:03:23.603932+0000","last_unstale":"2024-09-12T00:07:24.363096+0000","last_undegraded":"2024-09-12T00:07:24.363096+0000","last_fullsized":"2024-09-12T00:07:24.363096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:24.362915+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:24.362915+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.362915+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:05.312564+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"76'4","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.150664+0000","last_change":"2024-09-12T00:07:28.150664+0000","last_active":"2024-09-12T00:07:28.150664+0000","last_peered":"2024-09-12T00:07:28.150664+0000","last_clean":"2024-09-12T00:07:28.150664+0000","last_became_active":"2024-09-12T00:03:25.340828+0000","last_became_peered":"2024-09-12T00:03:25.340828+0000","last_unstale":"2024-09-12T00:07:28.150664+0000","last_undegraded":"2024-09-12T00:07:28.150664+0000","last_fullsized":"2024-09-12T00:07:28.150664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-12T00:07:28.150477+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-12T00:07:28.150477+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.150477+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:39.470463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"116'36","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.388542+0000","last_change":"2024-09-12T00:07:23.388542+0000","last_active":"2024-09-12T00:07:23.388542+0000","last_peered":"2024-09-12T00:07:23.388542+0000","last_clean":"2024-09-12T00:07:23.388542+0000","last_became_active":"2024-09-12T00:03:23.601892+0000","last_became_peered":"2024-09-12T00:03:23.601892+0000","last_unstale":"2024-09-12T00:07:23.388542+0000","last_undegraded":"2024-09-12T00:07:23.388542+0000","last_fullsized":"2024-09-12T00:07:23.388542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'36","last_scrub_stamp":"2024-09-12T00:07:23.388307+0000","last_deep_scrub":"116'36","last_deep_scrub_stamp":"2024-09-12T00:07:23.388307+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.388307+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:49.870399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:40.352303+0000","last_change":"2024-09-12T00:07:40.352303+0000","last_active":"2024-09-12T00:07:40.352303+0000","last_peered":"2024-09-12T00:07:40.352303+0000","last_clean":"2024-09-12T00:07:40.352303+0000","last_became_active":"2024-09-12T00:03:33.351917+0000","last_became_peered":"2024-09-12T00:03:33.351917+0000","last_unstale":"2024-09-12T00:07:40.352303+0000","last_undegraded":"2024-09-12T00:07:40.352303+0000","last_fullsized":"2024-09-12T00:07:40.352303+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:40.352129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:40.352129+0000","last_clean_scrub_stamp":"2024-09-12T00:07:40.352129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:01.391278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"59'6","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.387825+0000","last_change":"2024-09-12T00:07:29.387825+0000","last_active":"2024-09-12T00:07:29.387825+0000","last_peered":"2024-09-12T00:07:29.387825+0000","last_clean":"2024-09-12T00:07:29.387825+0000","last_became_active":"2024-09-12T00:03:25.322456+0000","last_became_peered":"2024-09-12T00:03:25.322456+0000","last_unstale":"2024-09-12T00:07:29.387825+0000","last_undegraded":"2024-09-12T00:07:29.387825+0000","last_fullsized":"2024-09-12T00:07:29.387825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2024-09-12T00:07:29.387638+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2024-09-12T00:07:29.387638+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.387638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:09.600578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"116'54","reported_seq":132,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.983716+0000","last_change":"2024-09-12T00:07:26.983716+0000","last_active":"2024-09-12T00:07:26.983716+0000","last_peered":"2024-09-12T00:07:26.983716+0000","last_clean":"2024-09-12T00:07:26.983716+0000","last_became_active":"2024-09-12T00:06:26.648460+0000","last_became_peered":"2024-09-12T00:06:26.648460+0000","last_unstale":"2024-09-12T00:07:26.983716+0000","last_undegraded":"2024-09-12T00:07:26.983716+0000","last_fullsized":"2024-09-12T00:07:26.983716+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'54","last_scrub_stamp":"2024-09-12T00:07:26.983503+0000","last_deep_scrub":"116'54","last_deep_scrub_stamp":"2024-09-12T00:07:26.983503+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.983503+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:54.178198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:46.940295+0000","last_change":"2024-09-12T00:07:46.940295+0000","last_active":"2024-09-12T00:07:46.940295+0000","last_peered":"2024-09-12T00:07:46.940295+0000","last_clean":"2024-09-12T00:07:46.940295+0000","last_became_active":"2024-09-12T00:06:26.663654+0000","last_became_peered":"2024-09-12T00:06:26.663654+0000","last_unstale":"2024-09-12T00:07:46.940295+0000","last_undegraded":"2024-09-12T00:07:46.940295+0000","last_fullsized":"2024-09-12T00:07:46.940295+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:46.940082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:46.940082+0000","last_clean_scrub_stamp":"2024-09-12T00:07:46.940082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:37.951903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"116'38","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:46.942252+0000","last_change":"2024-09-12T00:07:46.942252+0000","last_active":"2024-09-12T00:07:46.942252+0000","last_peered":"2024-09-12T00:07:46.942252+0000","last_clean":"2024-09-12T00:07:46.942252+0000","last_became_active":"2024-09-12T00:03:29.346662+0000","last_became_peered":"2024-09-12T00:03:29.346662+0000","last_unstale":"2024-09-12T00:07:46.942252+0000","last_undegraded":"2024-09-12T00:07:46.942252+0000","last_fullsized":"2024-09-12T00:07:46.942252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'38","last_scrub_stamp":"2024-09-12T00:07:46.942017+0000","last_deep_scrub":"116'38","last_deep_scrub_stamp":"2024-09-12T00:07:46.942017+0000","last_clean_scrub_stamp":"2024-09-12T00:07:46.942017+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:52.114146+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:42.183260+0000","last_change":"2024-09-12T00:07:42.183260+0000","last_active":"2024-09-12T00:07:42.183260+0000","last_peered":"2024-09-12T00:07:42.183260+0000","last_clean":"2024-09-12T00:07:42.183260+0000","last_became_active":"2024-09-12T00:03:31.336317+0000","last_became_peered":"2024-09-12T00:03:31.336317+0000","last_unstale":"2024-09-12T00:07:42.183260+0000","last_undegraded":"2024-09-12T00:07:42.183260+0000","last_fullsized":"2024-09-12T00:07:42.183260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:42.183078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:42.183078+0000","last_clean_scrub_stamp":"2024-09-12T00:07:42.183078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:20.774300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"116'49","reported_seq":252,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:46.149975+0000","last_change":"2024-09-12T00:07:46.149975+0000","last_active":"2024-09-12T00:07:46.149975+0000","last_peered":"2024-09-12T00:07:46.149975+0000","last_clean":"2024-09-12T00:07:46.149975+0000","last_became_active":"2024-09-12T00:03:33.375938+0000","last_became_peered":"2024-09-12T00:03:33.375938+0000","last_unstale":"2024-09-12T00:07:46.149975+0000","last_undegraded":"2024-09-12T00:07:46.149975+0000","last_fullsized":"2024-09-12T00:07:46.149975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'49","last_scrub_stamp":"2024-09-12T00:07:46.149791+0000","last_deep_scrub":"116'49","last_deep_scrub_stamp":"2024-09-12T00:07:46.149791+0000","last_clean_scrub_stamp":"2024-09-12T00:07:46.149791+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:31.578561+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"84'8","reported_seq":59,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:38.977382+0000","last_change":"2024-09-12T00:07:38.977382+0000","last_active":"2024-09-12T00:07:38.977382+0000","last_peered":"2024-09-12T00:07:38.977382+0000","last_clean":"2024-09-12T00:07:38.977382+0000","last_became_active":"2024-09-12T00:06:26.679390+0000","last_became_peered":"2024-09-12T00:06:26.679390+0000","last_unstale":"2024-09-12T00:07:38.977382+0000","last_undegraded":"2024-09-12T00:07:38.977382+0000","last_fullsized":"2024-09-12T00:07:38.977382+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'8","last_scrub_stamp":"2024-09-12T00:07:38.977195+0000","last_deep_scrub":"84'8","last_deep_scrub_stamp":"2024-09-12T00:07:38.977195+0000","last_clean_scrub_stamp":"2024-09-12T00:07:38.977195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:49.948524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"116'28","reported_seq":289,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.365269+0000","last_change":"2024-09-12T00:07:18.365269+0000","last_active":"2024-09-12T00:07:18.365269+0000","last_peered":"2024-09-12T00:07:18.365269+0000","last_clean":"2024-09-12T00:07:18.365269+0000","last_became_active":"2024-09-12T00:06:26.675473+0000","last_became_peered":"2024-09-12T00:06:26.675473+0000","last_unstale":"2024-09-12T00:07:18.365269+0000","last_undegraded":"2024-09-12T00:07:18.365269+0000","last_fullsized":"2024-09-12T00:07:18.365269+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-09-12T00:07:18.365092+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-09-12T00:07:18.365092+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.365092+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:28.752797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:36.838675+0000","last_change":"2024-09-12T00:07:36.838675+0000","last_active":"2024-09-12T00:07:36.838675+0000","last_peered":"2024-09-12T00:07:36.838675+0000","last_clean":"2024-09-12T00:07:36.838675+0000","last_became_active":"2024-09-12T00:03:27.335308+0000","last_became_peered":"2024-09-12T00:03:27.335308+0000","last_unstale":"2024-09-12T00:07:36.838675+0000","last_undegraded":"2024-09-12T00:07:36.838675+0000","last_fullsized":"2024-09-12T00:07:36.838675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:36.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:36.838492+0000","last_clean_scrub_stamp":"2024-09-12T00:07:36.838492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:40.794762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"116'16","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:35.070360+0000","last_change":"2024-09-12T00:07:35.070360+0000","last_active":"2024-09-12T00:07:35.070360+0000","last_peered":"2024-09-12T00:07:35.070360+0000","last_clean":"2024-09-12T00:07:35.070360+0000","last_became_active":"2024-09-12T00:03:29.351783+0000","last_became_peered":"2024-09-12T00:03:29.351783+0000","last_unstale":"2024-09-12T00:07:35.070360+0000","last_undegraded":"2024-09-12T00:07:35.070360+0000","last_fullsized":"2024-09-12T00:07:35.070360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-09-12T00:07:35.070147+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-09-12T00:07:35.070147+0000","last_clean_scrub_stamp":"2024-09-12T00:07:35.070147+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:26.638990+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:41.202621+0000","last_change":"2024-09-12T00:07:41.202621+0000","last_active":"2024-09-12T00:07:41.202621+0000","last_peered":"2024-09-12T00:07:41.202621+0000","last_clean":"2024-09-12T00:07:41.202621+0000","last_became_active":"2024-09-12T00:03:31.349244+0000","last_became_peered":"2024-09-12T00:03:31.349244+0000","last_unstale":"2024-09-12T00:07:41.202621+0000","last_undegraded":"2024-09-12T00:07:41.202621+0000","last_fullsized":"2024-09-12T00:07:41.202621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:41.202410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:41.202410+0000","last_clean_scrub_stamp":"2024-09-12T00:07:41.202410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:22.396330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:45.278808+0000","last_change":"2024-09-12T00:07:45.278808+0000","last_active":"2024-09-12T00:07:45.278808+0000","last_peered":"2024-09-12T00:07:45.278808+0000","last_clean":"2024-09-12T00:07:45.278808+0000","last_became_active":"2024-09-12T00:03:33.381875+0000","last_became_peered":"2024-09-12T00:03:33.381875+0000","last_unstale":"2024-09-12T00:07:45.278808+0000","last_undegraded":"2024-09-12T00:07:45.278808+0000","last_fullsized":"2024-09-12T00:07:45.278808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:45.278639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:45.278639+0000","last_clean_scrub_stamp":"2024-09-12T00:07:45.278639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:15.789051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"63'12","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:33.626384+0000","last_change":"2024-09-12T00:07:33.626384+0000","last_active":"2024-09-12T00:07:33.626384+0000","last_peered":"2024-09-12T00:07:33.626384+0000","last_clean":"2024-09-12T00:07:33.626384+0000","last_became_active":"2024-09-12T00:03:25.355174+0000","last_became_peered":"2024-09-12T00:03:25.355174+0000","last_unstale":"2024-09-12T00:07:33.626384+0000","last_undegraded":"2024-09-12T00:07:33.626384+0000","last_fullsized":"2024-09-12T00:07:33.626384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'12","last_scrub_stamp":"2024-09-12T00:07:33.626194+0000","last_deep_scrub":"63'12","last_deep_scrub_stamp":"2024-09-12T00:07:33.626194+0000","last_clean_scrub_stamp":"2024-09-12T00:07:33.626194+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:12.596617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"116'42","reported_seq":114,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.948934+0000","last_change":"2024-09-12T00:07:25.948934+0000","last_active":"2024-09-12T00:07:25.948934+0000","last_peered":"2024-09-12T00:07:25.948934+0000","last_clean":"2024-09-12T00:07:25.948934+0000","last_became_active":"2024-09-12T00:06:26.670936+0000","last_became_peered":"2024-09-12T00:06:26.670936+0000","last_unstale":"2024-09-12T00:07:25.948934+0000","last_undegraded":"2024-09-12T00:07:25.948934+0000","last_fullsized":"2024-09-12T00:07:25.948934+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-09-12T00:07:25.948727+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-09-12T00:07:25.948727+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.948727+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:09.232455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:37.872571+0000","last_change":"2024-09-12T00:07:37.872571+0000","last_active":"2024-09-12T00:07:37.872571+0000","last_peered":"2024-09-12T00:07:37.872571+0000","last_clean":"2024-09-12T00:07:37.872571+0000","last_became_active":"2024-09-12T00:03:27.346346+0000","last_became_peered":"2024-09-12T00:03:27.346346+0000","last_unstale":"2024-09-12T00:07:37.872571+0000","last_undegraded":"2024-09-12T00:07:37.872571+0000","last_fullsized":"2024-09-12T00:07:37.872571+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:37.872404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:37.872404+0000","last_clean_scrub_stamp":"2024-09-12T00:07:37.872404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:45.893390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"116'29","reported_seq":280,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:44.922123+0000","last_change":"2024-09-12T00:07:44.922123+0000","last_active":"2024-09-12T00:07:44.922123+0000","last_peered":"2024-09-12T00:07:44.922123+0000","last_clean":"2024-09-12T00:07:44.922123+0000","last_became_active":"2024-09-12T00:06:26.654182+0000","last_became_peered":"2024-09-12T00:06:26.654182+0000","last_unstale":"2024-09-12T00:07:44.922123+0000","last_undegraded":"2024-09-12T00:07:44.922123+0000","last_fullsized":"2024-09-12T00:07:44.922123+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'29","last_scrub_stamp":"2024-09-12T00:07:44.921939+0000","last_deep_scrub":"116'29","last_deep_scrub_stamp":"2024-09-12T00:07:44.921939+0000","last_clean_scrub_stamp":"2024-09-12T00:07:44.921939+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:13.222147+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"116'143","reported_seq":365,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:10.885348+0000","last_change":"2024-09-12T00:06:30.699178+0000","last_active":"2024-09-12T00:07:10.885348+0000","last_peered":"2024-09-12T00:07:10.885348+0000","last_clean":"2024-09-12T00:07:10.885348+0000","last_became_active":"2024-09-12T00:06:30.698465+0000","last_became_peered":"2024-09-12T00:06:30.698465+0000","last_unstale":"2024-09-12T00:07:10.885348+0000","last_undegraded":"2024-09-12T00:07:10.885348+0000","last_fullsized":"2024-09-12T00:07:10.885348+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:48.150663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:41.362036+0000","last_change":"2024-09-12T00:07:41.362036+0000","last_active":"2024-09-12T00:07:41.362036+0000","last_peered":"2024-09-12T00:07:41.362036+0000","last_clean":"2024-09-12T00:07:41.362036+0000","last_became_active":"2024-09-12T00:03:33.374453+0000","last_became_peered":"2024-09-12T00:03:33.374453+0000","last_unstale":"2024-09-12T00:07:41.362036+0000","last_undegraded":"2024-09-12T00:07:41.362036+0000","last_fullsized":"2024-09-12T00:07:41.362036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:41.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:41.361864+0000","last_clean_scrub_stamp":"2024-09-12T00:07:41.361864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:42.058988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"58'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:34.648463+0000","last_change":"2024-09-12T00:07:34.648463+0000","last_active":"2024-09-12T00:07:34.648463+0000","last_peered":"2024-09-12T00:07:34.648463+0000","last_clean":"2024-09-12T00:07:34.648463+0000","last_became_active":"2024-09-12T00:03:25.354803+0000","last_became_peered":"2024-09-12T00:03:25.354803+0000","last_unstale":"2024-09-12T00:07:34.648463+0000","last_undegraded":"2024-09-12T00:07:34.648463+0000","last_fullsized":"2024-09-12T00:07:34.648463+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:34.648278+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:34.648278+0000","last_clean_scrub_stamp":"2024-09-12T00:07:34.648278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:59.844387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"116'46","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.073913+0000","last_change":"2024-09-12T00:07:21.073913+0000","last_active":"2024-09-12T00:07:21.073913+0000","last_peered":"2024-09-12T00:07:21.073913+0000","last_clean":"2024-09-12T00:07:21.073913+0000","last_became_active":"2024-09-12T00:03:23.630183+0000","last_became_peered":"2024-09-12T00:03:23.630183+0000","last_unstale":"2024-09-12T00:07:21.073913+0000","last_undegraded":"2024-09-12T00:07:21.073913+0000","last_fullsized":"2024-09-12T00:07:21.073913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:21.073723+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:21.073723+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.073723+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:47.555815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:47.930409+0000","last_change":"2024-09-12T00:07:47.930409+0000","last_active":"2024-09-12T00:07:47.930409+0000","last_peered":"2024-09-12T00:07:47.930409+0000","last_clean":"2024-09-12T00:07:47.930409+0000","last_became_active":"2024-09-12T00:06:26.669946+0000","last_became_peered":"2024-09-12T00:06:26.669946+0000","last_unstale":"2024-09-12T00:07:47.930409+0000","last_undegraded":"2024-09-12T00:07:47.930409+0000","last_fullsized":"2024-09-12T00:07:47.930409+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:47.930222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:47.930222+0000","last_clean_scrub_stamp":"2024-09-12T00:07:47.930222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:27.203595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"116'30","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.273166+0000","last_change":"2024-09-12T00:07:32.273166+0000","last_active":"2024-09-12T00:07:32.273166+0000","last_peered":"2024-09-12T00:07:32.273166+0000","last_clean":"2024-09-12T00:07:32.273166+0000","last_became_active":"2024-09-12T00:03:29.338810+0000","last_became_peered":"2024-09-12T00:03:29.338810+0000","last_unstale":"2024-09-12T00:07:32.273166+0000","last_undegraded":"2024-09-12T00:07:32.273166+0000","last_fullsized":"2024-09-12T00:07:32.273166+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'30","last_scrub_stamp":"2024-09-12T00:07:32.272962+0000","last_deep_scrub":"116'30","last_deep_scrub_stamp":"2024-09-12T00:07:32.272962+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.272962+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:29.833021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"116'139","reported_seq":444,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:48.698484+0000","last_change":"2024-09-12T00:07:48.698484+0000","last_active":"2024-09-12T00:07:48.698484+0000","last_peered":"2024-09-12T00:07:48.698484+0000","last_clean":"2024-09-12T00:07:48.698484+0000","last_became_active":"2024-09-12T00:03:31.353547+0000","last_became_peered":"2024-09-12T00:03:31.353547+0000","last_unstale":"2024-09-12T00:07:48.698484+0000","last_undegraded":"2024-09-12T00:07:48.698484+0000","last_fullsized":"2024-09-12T00:07:48.698484+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'139","last_scrub_stamp":"2024-09-12T00:07:48.698301+0000","last_deep_scrub":"116'139","last_deep_scrub_stamp":"2024-09-12T00:07:48.698301+0000","last_clean_scrub_stamp":"2024-09-12T00:07:48.698301+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:16.381262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"63'4","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:33.950171+0000","last_change":"2024-09-12T00:07:33.950171+0000","last_active":"2024-09-12T00:07:33.950171+0000","last_peered":"2024-09-12T00:07:33.950171+0000","last_clean":"2024-09-12T00:07:33.950171+0000","last_became_active":"2024-09-12T00:06:26.651618+0000","last_became_peered":"2024-09-12T00:06:26.651618+0000","last_unstale":"2024-09-12T00:07:33.950171+0000","last_undegraded":"2024-09-12T00:07:33.950171+0000","last_fullsized":"2024-09-12T00:07:33.950171+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'4","last_scrub_stamp":"2024-09-12T00:07:33.949941+0000","last_deep_scrub":"63'4","last_deep_scrub_stamp":"2024-09-12T00:07:33.949941+0000","last_clean_scrub_stamp":"2024-09-12T00:07:33.949941+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:33.740583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"116'56","reported_seq":262,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.444524+0000","last_change":"2024-09-12T00:07:18.444385+0000","last_active":"2024-09-12T00:07:18.444524+0000","last_peered":"2024-09-12T00:07:18.444524+0000","last_clean":"2024-09-12T00:07:18.444524+0000","last_became_active":"2024-09-12T00:03:23.601898+0000","last_became_peered":"2024-09-12T00:03:23.601898+0000","last_unstale":"2024-09-12T00:07:18.444524+0000","last_undegraded":"2024-09-12T00:07:18.444524+0000","last_fullsized":"2024-09-12T00:07:18.444524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-09-12T00:07:18.444202+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-09-12T00:07:18.444202+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.444202+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:27.955570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":64,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.151193+0000","last_change":"2024-09-12T00:07:29.151045+0000","last_active":"2024-09-12T00:07:29.151193+0000","last_peered":"2024-09-12T00:07:29.151193+0000","last_clean":"2024-09-12T00:07:29.151193+0000","last_became_active":"2024-09-12T00:03:27.329672+0000","last_became_peered":"2024-09-12T00:03:27.329672+0000","last_unstale":"2024-09-12T00:07:29.151193+0000","last_undegraded":"2024-09-12T00:07:29.151193+0000","last_fullsized":"2024-09-12T00:07:29.151193+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:29.150854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:29.150854+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.150854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:16.923691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"116'46","reported_seq":261,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:38.430202+0000","last_change":"2024-09-12T00:07:38.430007+0000","last_active":"2024-09-12T00:07:38.430202+0000","last_peered":"2024-09-12T00:07:38.430202+0000","last_clean":"2024-09-12T00:07:38.430202+0000","last_became_active":"2024-09-12T00:03:29.335044+0000","last_became_peered":"2024-09-12T00:03:29.335044+0000","last_unstale":"2024-09-12T00:07:38.430202+0000","last_undegraded":"2024-09-12T00:07:38.430202+0000","last_fullsized":"2024-09-12T00:07:38.430202+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:38.429810+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:38.429810+0000","last_clean_scrub_stamp":"2024-09-12T00:07:38.429810+0000","objects_scrubbed":10,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:15.268866+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:42.326451+0000","last_change":"2024-09-12T00:07:42.326451+0000","last_active":"2024-09-12T00:07:42.326451+0000","last_peered":"2024-09-12T00:07:42.326451+0000","last_clean":"2024-09-12T00:07:42.326451+0000","last_became_active":"2024-09-12T00:03:31.354160+0000","last_became_peered":"2024-09-12T00:03:31.354160+0000","last_unstale":"2024-09-12T00:07:42.326451+0000","last_undegraded":"2024-09-12T00:07:42.326451+0000","last_fullsized":"2024-09-12T00:07:42.326451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:42.326250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:42.326250+0000","last_clean_scrub_stamp":"2024-09-12T00:07:42.326250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:23.520170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:40.400209+0000","last_change":"2024-09-12T00:07:40.400069+0000","last_active":"2024-09-12T00:07:40.400209+0000","last_peered":"2024-09-12T00:07:40.400209+0000","last_clean":"2024-09-12T00:07:40.400209+0000","last_became_active":"2024-09-12T00:06:26.664401+0000","last_became_peered":"2024-09-12T00:06:26.664401+0000","last_unstale":"2024-09-12T00:07:40.400209+0000","last_undegraded":"2024-09-12T00:07:40.400209+0000","last_fullsized":"2024-09-12T00:07:40.400209+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:40.399856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:40.399856+0000","last_clean_scrub_stamp":"2024-09-12T00:07:40.399856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:38.248512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'2","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.072996+0000","last_change":"2024-09-12T00:07:22.072730+0000","last_active":"2024-09-12T00:07:22.072996+0000","last_peered":"2024-09-12T00:07:22.072996+0000","last_clean":"2024-09-12T00:07:22.072996+0000","last_became_active":"2024-09-12T00:03:25.356970+0000","last_became_peered":"2024-09-12T00:03:25.356970+0000","last_unstale":"2024-09-12T00:07:22.072996+0000","last_undegraded":"2024-09-12T00:07:22.072996+0000","last_fullsized":"2024-09-12T00:07:22.072996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:22.072506+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:22.072506+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.072506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:03.022155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"116'38","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.219384+0000","last_change":"2024-09-12T00:07:18.219294+0000","last_active":"2024-09-12T00:07:18.219384+0000","last_peered":"2024-09-12T00:07:18.219384+0000","last_clean":"2024-09-12T00:07:18.219384+0000","last_became_active":"2024-09-12T00:03:23.609435+0000","last_became_peered":"2024-09-12T00:03:23.609435+0000","last_unstale":"2024-09-12T00:07:18.219384+0000","last_undegraded":"2024-09-12T00:07:18.219384+0000","last_fullsized":"2024-09-12T00:07:18.219384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'38","last_scrub_stamp":"2024-09-12T00:07:18.219203+0000","last_deep_scrub":"116'38","last_deep_scrub_stamp":"2024-09-12T00:07:18.219203+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.219203+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:10.654482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.397532+0000","last_change":"2024-09-12T00:07:32.397357+0000","last_active":"2024-09-12T00:07:32.397532+0000","last_peered":"2024-09-12T00:07:32.397532+0000","last_clean":"2024-09-12T00:07:32.397532+0000","last_became_active":"2024-09-12T00:03:27.338880+0000","last_became_peered":"2024-09-12T00:03:27.338880+0000","last_unstale":"2024-09-12T00:07:32.397532+0000","last_undegraded":"2024-09-12T00:07:32.397532+0000","last_fullsized":"2024-09-12T00:07:32.397532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:32.397180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:32.397180+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.397180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:00.449041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"116'34","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:42.923136+0000","last_change":"2024-09-12T00:07:42.923136+0000","last_active":"2024-09-12T00:07:42.923136+0000","last_peered":"2024-09-12T00:07:42.923136+0000","last_clean":"2024-09-12T00:07:42.923136+0000","last_became_active":"2024-09-12T00:03:29.336957+0000","last_became_peered":"2024-09-12T00:03:29.336957+0000","last_unstale":"2024-09-12T00:07:42.923136+0000","last_undegraded":"2024-09-12T00:07:42.923136+0000","last_fullsized":"2024-09-12T00:07:42.923136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'34","last_scrub_stamp":"2024-09-12T00:07:42.922939+0000","last_deep_scrub":"116'34","last_deep_scrub_stamp":"2024-09-12T00:07:42.922939+0000","last_clean_scrub_stamp":"2024-09-12T00:07:42.922939+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:00.762698+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":36,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:48.921822+0000","last_change":"2024-09-12T00:07:48.921681+0000","last_active":"2024-09-12T00:07:48.921822+0000","last_peered":"2024-09-12T00:07:48.921822+0000","last_clean":"2024-09-12T00:07:48.921822+0000","last_became_active":"2024-09-12T00:03:31.347736+0000","last_became_peered":"2024-09-12T00:03:31.347736+0000","last_unstale":"2024-09-12T00:07:48.921822+0000","last_undegraded":"2024-09-12T00:07:48.921822+0000","last_fullsized":"2024-09-12T00:07:48.921822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:48.921505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:48.921505+0000","last_clean_scrub_stamp":"2024-09-12T00:07:48.921505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:44.064638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"59'8","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:44.183437+0000","last_change":"2024-09-12T00:07:44.183437+0000","last_active":"2024-09-12T00:07:44.183437+0000","last_peered":"2024-09-12T00:07:44.183437+0000","last_clean":"2024-09-12T00:07:44.183437+0000","last_became_active":"2024-09-12T00:03:33.378945+0000","last_became_peered":"2024-09-12T00:03:33.378945+0000","last_unstale":"2024-09-12T00:07:44.183437+0000","last_undegraded":"2024-09-12T00:07:44.183437+0000","last_fullsized":"2024-09-12T00:07:44.183437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'8","last_scrub_stamp":"2024-09-12T00:07:44.183239+0000","last_deep_scrub":"59'8","last_deep_scrub_stamp":"2024-09-12T00:07:44.183239+0000","last_clean_scrub_stamp":"2024-09-12T00:07:44.183239+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:14.693651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'6","reported_seq":252,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.164729+0000","last_change":"2024-09-12T00:07:23.164572+0000","last_active":"2024-09-12T00:07:23.164729+0000","last_peered":"2024-09-12T00:07:23.164729+0000","last_clean":"2024-09-12T00:07:23.164729+0000","last_became_active":"2024-09-12T00:06:26.668131+0000","last_became_peered":"2024-09-12T00:06:26.668131+0000","last_unstale":"2024-09-12T00:07:23.164729+0000","last_undegraded":"2024-09-12T00:07:23.164729+0000","last_fullsized":"2024-09-12T00:07:23.164729+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-09-12T00:07:23.164381+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-09-12T00:07:23.164381+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.164381+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:10.937218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"116'34","reported_seq":102,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.919676+0000","last_change":"2024-09-12T00:07:23.919676+0000","last_active":"2024-09-12T00:07:23.919676+0000","last_peered":"2024-09-12T00:07:23.919676+0000","last_clean":"2024-09-12T00:07:23.919676+0000","last_became_active":"2024-09-12T00:06:26.679723+0000","last_became_peered":"2024-09-12T00:06:26.679723+0000","last_unstale":"2024-09-12T00:07:23.919676+0000","last_undegraded":"2024-09-12T00:07:23.919676+0000","last_fullsized":"2024-09-12T00:07:23.919676+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'34","last_scrub_stamp":"2024-09-12T00:07:23.919458+0000","last_deep_scrub":"116'34","last_deep_scrub_stamp":"2024-09-12T00:07:23.919458+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.919458+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:33.257574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:42.634777+0000","last_change":"2024-09-12T00:07:42.634777+0000","last_active":"2024-09-12T00:07:42.634777+0000","last_peered":"2024-09-12T00:07:42.634777+0000","last_clean":"2024-09-12T00:07:42.634777+0000","last_became_active":"2024-09-12T00:03:27.347288+0000","last_became_peered":"2024-09-12T00:03:27.347288+0000","last_unstale":"2024-09-12T00:07:42.634777+0000","last_undegraded":"2024-09-12T00:07:42.634777+0000","last_fullsized":"2024-09-12T00:07:42.634777+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:42.634488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:42.634488+0000","last_clean_scrub_stamp":"2024-09-12T00:07:42.634488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:05.672734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"116'50","reported_seq":86,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:52.858695+0000","last_change":"2024-09-12T00:07:52.858695+0000","last_active":"2024-09-12T00:07:52.858695+0000","last_peered":"2024-09-12T00:07:52.858695+0000","last_clean":"2024-09-12T00:07:52.858695+0000","last_became_active":"2024-09-12T00:06:26.668791+0000","last_became_peered":"2024-09-12T00:06:26.668791+0000","last_unstale":"2024-09-12T00:07:52.858695+0000","last_undegraded":"2024-09-12T00:07:52.858695+0000","last_fullsized":"2024-09-12T00:07:52.858695+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'50","last_scrub_stamp":"2024-09-12T00:07:52.858509+0000","last_deep_scrub":"116'50","last_deep_scrub_stamp":"2024-09-12T00:07:52.858509+0000","last_clean_scrub_stamp":"2024-09-12T00:07:52.858509+0000","objects_scrubbed":9,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:53.507503+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":54,"num_read_kb":275,"num_write":34,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":116871,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"116'139","reported_seq":364,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:47.739523+0000","last_change":"2024-09-12T00:07:47.739361+0000","last_active":"2024-09-12T00:07:47.739523+0000","last_peered":"2024-09-12T00:07:47.739523+0000","last_clean":"2024-09-12T00:07:47.739523+0000","last_became_active":"2024-09-12T00:03:31.353358+0000","last_became_peered":"2024-09-12T00:03:31.353358+0000","last_unstale":"2024-09-12T00:07:47.739523+0000","last_undegraded":"2024-09-12T00:07:47.739523+0000","last_fullsized":"2024-09-12T00:07:47.739523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'139","last_scrub_stamp":"2024-09-12T00:07:47.739186+0000","last_deep_scrub":"116'139","last_deep_scrub_stamp":"2024-09-12T00:07:47.739186+0000","last_clean_scrub_stamp":"2024-09-12T00:07:47.739186+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:13.242982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:44.257168+0000","last_change":"2024-09-12T00:07:44.256922+0000","last_active":"2024-09-12T00:07:44.257168+0000","last_peered":"2024-09-12T00:07:44.257168+0000","last_clean":"2024-09-12T00:07:44.257168+0000","last_became_active":"2024-09-12T00:03:33.383199+0000","last_became_peered":"2024-09-12T00:03:33.383199+0000","last_unstale":"2024-09-12T00:07:44.257168+0000","last_undegraded":"2024-09-12T00:07:44.257168+0000","last_fullsized":"2024-09-12T00:07:44.257168+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:44.256700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:44.256700+0000","last_clean_scrub_stamp":"2024-09-12T00:07:44.256700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:12.761315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"84'10","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.602399+0000","last_change":"2024-09-12T00:07:30.602399+0000","last_active":"2024-09-12T00:07:30.602399+0000","last_peered":"2024-09-12T00:07:30.602399+0000","last_clean":"2024-09-12T00:07:30.602399+0000","last_became_active":"2024-09-12T00:03:25.354555+0000","last_became_peered":"2024-09-12T00:03:25.354555+0000","last_unstale":"2024-09-12T00:07:30.602399+0000","last_undegraded":"2024-09-12T00:07:30.602399+0000","last_fullsized":"2024-09-12T00:07:30.602399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'10","last_scrub_stamp":"2024-09-12T00:07:30.602214+0000","last_deep_scrub":"84'10","last_deep_scrub_stamp":"2024-09-12T00:07:30.602214+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.602214+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:28.647997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"116'78","reported_seq":283,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:17.443911+0000","last_change":"2024-09-12T00:07:17.443738+0000","last_active":"2024-09-12T00:07:17.443911+0000","last_peered":"2024-09-12T00:07:17.443911+0000","last_clean":"2024-09-12T00:07:17.443911+0000","last_became_active":"2024-09-12T00:03:23.612165+0000","last_became_peered":"2024-09-12T00:03:23.612165+0000","last_unstale":"2024-09-12T00:07:17.443911+0000","last_undegraded":"2024-09-12T00:07:17.443911+0000","last_fullsized":"2024-09-12T00:07:17.443911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'78","last_scrub_stamp":"2024-09-12T00:07:17.443535+0000","last_deep_scrub":"116'78","last_deep_scrub_stamp":"2024-09-12T00:07:17.443535+0000","last_clean_scrub_stamp":"2024-09-12T00:07:17.443535+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:50.491633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":78,"num_write_kb":159744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:33.379164+0000","last_change":"2024-09-12T00:07:33.379002+0000","last_active":"2024-09-12T00:07:33.379164+0000","last_peered":"2024-09-12T00:07:33.379164+0000","last_clean":"2024-09-12T00:07:33.379164+0000","last_became_active":"2024-09-12T00:03:27.328497+0000","last_became_peered":"2024-09-12T00:03:27.328497+0000","last_unstale":"2024-09-12T00:07:33.379164+0000","last_undegraded":"2024-09-12T00:07:33.379164+0000","last_fullsized":"2024-09-12T00:07:33.379164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:33.378826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:33.378826+0000","last_clean_scrub_stamp":"2024-09-12T00:07:33.378826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:30.180214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"116'57","reported_seq":279,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:41.923431+0000","last_change":"2024-09-12T00:07:41.923290+0000","last_active":"2024-09-12T00:07:41.923431+0000","last_peered":"2024-09-12T00:07:41.923431+0000","last_clean":"2024-09-12T00:07:41.923431+0000","last_became_active":"2024-09-12T00:03:29.332010+0000","last_became_peered":"2024-09-12T00:03:29.332010+0000","last_unstale":"2024-09-12T00:07:41.923431+0000","last_undegraded":"2024-09-12T00:07:41.923431+0000","last_fullsized":"2024-09-12T00:07:41.923431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'57","last_scrub_stamp":"2024-09-12T00:07:41.923099+0000","last_deep_scrub":"116'57","last_deep_scrub_stamp":"2024-09-12T00:07:41.923099+0000","last_clean_scrub_stamp":"2024-09-12T00:07:41.923099+0000","objects_scrubbed":7,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:59.119283+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":65,"num_read_kb":292,"num_write":38,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:46.711474+0000","last_change":"2024-09-12T00:07:46.711193+0000","last_active":"2024-09-12T00:07:46.711474+0000","last_peered":"2024-09-12T00:07:46.711474+0000","last_clean":"2024-09-12T00:07:46.711474+0000","last_became_active":"2024-09-12T00:03:31.353407+0000","last_became_peered":"2024-09-12T00:03:31.353407+0000","last_unstale":"2024-09-12T00:07:46.711474+0000","last_undegraded":"2024-09-12T00:07:46.711474+0000","last_fullsized":"2024-09-12T00:07:46.711474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:46.710931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:46.710931+0000","last_clean_scrub_stamp":"2024-09-12T00:07:46.710931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:30.181141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"116'8","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:39.906082+0000","last_change":"2024-09-12T00:07:39.905938+0000","last_active":"2024-09-12T00:07:39.906082+0000","last_peered":"2024-09-12T00:07:39.906082+0000","last_clean":"2024-09-12T00:07:39.906082+0000","last_became_active":"2024-09-12T00:03:33.384559+0000","last_became_peered":"2024-09-12T00:03:33.384559+0000","last_unstale":"2024-09-12T00:07:39.906082+0000","last_undegraded":"2024-09-12T00:07:39.906082+0000","last_fullsized":"2024-09-12T00:07:39.906082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'8","last_scrub_stamp":"2024-09-12T00:07:39.905739+0000","last_deep_scrub":"116'8","last_deep_scrub_stamp":"2024-09-12T00:07:39.905739+0000","last_clean_scrub_stamp":"2024-09-12T00:07:39.905739+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:37.942709+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"59'2","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.361838+0000","last_change":"2024-09-12T00:07:26.361838+0000","last_active":"2024-09-12T00:07:26.361838+0000","last_peered":"2024-09-12T00:07:26.361838+0000","last_clean":"2024-09-12T00:07:26.361838+0000","last_became_active":"2024-09-12T00:03:25.325840+0000","last_became_peered":"2024-09-12T00:03:25.325840+0000","last_unstale":"2024-09-12T00:07:26.361838+0000","last_undegraded":"2024-09-12T00:07:26.361838+0000","last_fullsized":"2024-09-12T00:07:26.361838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:26.361654+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:26.361654+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.361654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:43.783340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"116'44","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.861653+0000","last_change":"2024-09-12T00:07:19.861508+0000","last_active":"2024-09-12T00:07:19.861653+0000","last_peered":"2024-09-12T00:07:19.861653+0000","last_clean":"2024-09-12T00:07:19.861653+0000","last_became_active":"2024-09-12T00:03:23.616200+0000","last_became_peered":"2024-09-12T00:03:23.616200+0000","last_unstale":"2024-09-12T00:07:19.861653+0000","last_undegraded":"2024-09-12T00:07:19.861653+0000","last_fullsized":"2024-09-12T00:07:19.861653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-09-12T00:07:19.861326+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-09-12T00:07:19.861326+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.861326+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:33.997134+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.805445+0000","last_change":"2024-09-12T00:07:29.805445+0000","last_active":"2024-09-12T00:07:29.805445+0000","last_peered":"2024-09-12T00:07:29.805445+0000","last_clean":"2024-09-12T00:07:29.805445+0000","last_became_active":"2024-09-12T00:03:27.329830+0000","last_became_peered":"2024-09-12T00:03:27.329830+0000","last_unstale":"2024-09-12T00:07:29.805445+0000","last_undegraded":"2024-09-12T00:07:29.805445+0000","last_fullsized":"2024-09-12T00:07:29.805445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:29.805265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:29.805265+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.805265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:21.107215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"116'33","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:34.069199+0000","last_change":"2024-09-12T00:07:34.069199+0000","last_active":"2024-09-12T00:07:34.069199+0000","last_peered":"2024-09-12T00:07:34.069199+0000","last_clean":"2024-09-12T00:07:34.069199+0000","last_became_active":"2024-09-12T00:03:29.343178+0000","last_became_peered":"2024-09-12T00:03:29.343178+0000","last_unstale":"2024-09-12T00:07:34.069199+0000","last_undegraded":"2024-09-12T00:07:34.069199+0000","last_fullsized":"2024-09-12T00:07:34.069199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'33","last_scrub_stamp":"2024-09-12T00:07:34.068993+0000","last_deep_scrub":"116'33","last_deep_scrub_stamp":"2024-09-12T00:07:34.068993+0000","last_clean_scrub_stamp":"2024-09-12T00:07:34.068993+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:57.768524+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:36.912950+0000","last_change":"2024-09-12T00:07:36.912950+0000","last_active":"2024-09-12T00:07:36.912950+0000","last_peered":"2024-09-12T00:07:36.912950+0000","last_clean":"2024-09-12T00:07:36.912950+0000","last_became_active":"2024-09-12T00:03:31.357272+0000","last_became_peered":"2024-09-12T00:03:31.357272+0000","last_unstale":"2024-09-12T00:07:36.912950+0000","last_undegraded":"2024-09-12T00:07:36.912950+0000","last_fullsized":"2024-09-12T00:07:36.912950+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:36.912723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:36.912723+0000","last_clean_scrub_stamp":"2024-09-12T00:07:36.912723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:05.320982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"76'4","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:51.775293+0000","last_change":"2024-09-12T00:07:51.775293+0000","last_active":"2024-09-12T00:07:51.775293+0000","last_peered":"2024-09-12T00:07:51.775293+0000","last_clean":"2024-09-12T00:07:51.775293+0000","last_became_active":"2024-09-12T00:06:26.653908+0000","last_became_peered":"2024-09-12T00:06:26.653908+0000","last_unstale":"2024-09-12T00:07:51.775293+0000","last_undegraded":"2024-09-12T00:07:51.775293+0000","last_fullsized":"2024-09-12T00:07:51.775293+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-12T00:07:51.775086+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-12T00:07:51.775086+0000","last_clean_scrub_stamp":"2024-09-12T00:07:51.775086+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:31.559749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"76'2","reported_seq":53,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:35.958822+0000","last_change":"2024-09-12T00:07:35.958822+0000","last_active":"2024-09-12T00:07:35.958822+0000","last_peered":"2024-09-12T00:07:35.958822+0000","last_clean":"2024-09-12T00:07:35.958822+0000","last_became_active":"2024-09-12T00:06:26.675405+0000","last_became_peered":"2024-09-12T00:06:26.675405+0000","last_unstale":"2024-09-12T00:07:35.958822+0000","last_undegraded":"2024-09-12T00:07:35.958822+0000","last_fullsized":"2024-09-12T00:07:35.958822+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-12T00:07:35.958543+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-12T00:07:35.958543+0000","last_clean_scrub_stamp":"2024-09-12T00:07:35.958543+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:23.450105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"116'42","reported_seq":114,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.870208+0000","last_change":"2024-09-12T00:07:20.870208+0000","last_active":"2024-09-12T00:07:20.870208+0000","last_peered":"2024-09-12T00:07:20.870208+0000","last_clean":"2024-09-12T00:07:20.870208+0000","last_became_active":"2024-09-12T00:06:26.663178+0000","last_became_peered":"2024-09-12T00:06:26.663178+0000","last_unstale":"2024-09-12T00:07:20.870208+0000","last_undegraded":"2024-09-12T00:07:20.870208+0000","last_fullsized":"2024-09-12T00:07:20.870208+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-09-12T00:07:20.870024+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-09-12T00:07:20.870024+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.870024+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:43.356712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":138412032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:43.643480+0000","last_change":"2024-09-12T00:07:43.643480+0000","last_active":"2024-09-12T00:07:43.643480+0000","last_peered":"2024-09-12T00:07:43.643480+0000","last_clean":"2024-09-12T00:07:43.643480+0000","last_became_active":"2024-09-12T00:03:27.341619+0000","last_became_peered":"2024-09-12T00:03:27.341619+0000","last_unstale":"2024-09-12T00:07:43.643480+0000","last_undegraded":"2024-09-12T00:07:43.643480+0000","last_fullsized":"2024-09-12T00:07:43.643480+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:43.643277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:43.643277+0000","last_clean_scrub_stamp":"2024-09-12T00:07:43.643277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:48.517996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"116'32","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:40.681603+0000","last_change":"2024-09-12T00:07:40.681603+0000","last_active":"2024-09-12T00:07:40.681603+0000","last_peered":"2024-09-12T00:07:40.681603+0000","last_clean":"2024-09-12T00:07:40.681603+0000","last_became_active":"2024-09-12T00:03:29.335679+0000","last_became_peered":"2024-09-12T00:03:29.335679+0000","last_unstale":"2024-09-12T00:07:40.681603+0000","last_undegraded":"2024-09-12T00:07:40.681603+0000","last_fullsized":"2024-09-12T00:07:40.681603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-09-12T00:07:40.681265+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-09-12T00:07:40.681265+0000","last_clean_scrub_stamp":"2024-09-12T00:07:40.681265+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:56.906118+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"116'138","reported_seq":407,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:35.874898+0000","last_change":"2024-09-12T00:07:35.874898+0000","last_active":"2024-09-12T00:07:35.874898+0000","last_peered":"2024-09-12T00:07:35.874898+0000","last_clean":"2024-09-12T00:07:35.874898+0000","last_became_active":"2024-09-12T00:03:31.350264+0000","last_became_peered":"2024-09-12T00:03:31.350264+0000","last_unstale":"2024-09-12T00:07:35.874898+0000","last_undegraded":"2024-09-12T00:07:35.874898+0000","last_fullsized":"2024-09-12T00:07:35.874898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-09-12T00:07:35.874722+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-09-12T00:07:35.874722+0000","last_clean_scrub_stamp":"2024-09-12T00:07:35.874722+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:55.697038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"59'3","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:43.295187+0000","last_change":"2024-09-12T00:07:43.295021+0000","last_active":"2024-09-12T00:07:43.295187+0000","last_peered":"2024-09-12T00:07:43.295187+0000","last_clean":"2024-09-12T00:07:43.295187+0000","last_became_active":"2024-09-12T00:03:33.367424+0000","last_became_peered":"2024-09-12T00:03:33.367424+0000","last_unstale":"2024-09-12T00:07:43.295187+0000","last_undegraded":"2024-09-12T00:07:43.295187+0000","last_fullsized":"2024-09-12T00:07:43.295187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'3","last_scrub_stamp":"2024-09-12T00:07:43.294838+0000","last_deep_scrub":"59'3","last_deep_scrub_stamp":"2024-09-12T00:07:43.294838+0000","last_clean_scrub_stamp":"2024-09-12T00:07:43.294838+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:21.886060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"76'6","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:35.301546+0000","last_change":"2024-09-12T00:07:35.301546+0000","last_active":"2024-09-12T00:07:35.301546+0000","last_peered":"2024-09-12T00:07:35.301546+0000","last_clean":"2024-09-12T00:07:35.301546+0000","last_became_active":"2024-09-12T00:06:26.671547+0000","last_became_peered":"2024-09-12T00:06:26.671547+0000","last_unstale":"2024-09-12T00:07:35.301546+0000","last_undegraded":"2024-09-12T00:07:35.301546+0000","last_fullsized":"2024-09-12T00:07:35.301546+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'6","last_scrub_stamp":"2024-09-12T00:07:35.301343+0000","last_deep_scrub":"76'6","last_deep_scrub_stamp":"2024-09-12T00:07:35.301343+0000","last_clean_scrub_stamp":"2024-09-12T00:07:35.301343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:03.805958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"116'44","reported_seq":117,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.899518+0000","last_change":"2024-09-12T00:07:22.899518+0000","last_active":"2024-09-12T00:07:22.899518+0000","last_peered":"2024-09-12T00:07:22.899518+0000","last_clean":"2024-09-12T00:07:22.899518+0000","last_became_active":"2024-09-12T00:06:26.654104+0000","last_became_peered":"2024-09-12T00:06:26.654104+0000","last_unstale":"2024-09-12T00:07:22.899518+0000","last_undegraded":"2024-09-12T00:07:22.899518+0000","last_fullsized":"2024-09-12T00:07:22.899518+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-09-12T00:07:22.899334+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-09-12T00:07:22.899334+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.899334+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:43.870468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"116'4","reported_seq":382,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.122654+0000","last_change":"2024-09-12T00:07:31.122654+0000","last_active":"2024-09-12T00:07:31.122654+0000","last_peered":"2024-09-12T00:07:31.122654+0000","last_clean":"2024-09-12T00:07:31.122654+0000","last_became_active":"2024-09-12T00:03:27.330909+0000","last_became_peered":"2024-09-12T00:03:27.330909+0000","last_unstale":"2024-09-12T00:07:31.122654+0000","last_undegraded":"2024-09-12T00:07:31.122654+0000","last_fullsized":"2024-09-12T00:07:31.122654+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'4","last_scrub_stamp":"2024-09-12T00:07:31.122476+0000","last_deep_scrub":"116'4","last_deep_scrub_stamp":"2024-09-12T00:07:31.122476+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.122476+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:57.179433+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"116'16","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:37.335857+0000","last_change":"2024-09-12T00:07:37.335857+0000","last_active":"2024-09-12T00:07:37.335857+0000","last_peered":"2024-09-12T00:07:37.335857+0000","last_clean":"2024-09-12T00:07:37.335857+0000","last_became_active":"2024-09-12T00:03:29.338110+0000","last_became_peered":"2024-09-12T00:03:29.338110+0000","last_unstale":"2024-09-12T00:07:37.335857+0000","last_undegraded":"2024-09-12T00:07:37.335857+0000","last_fullsized":"2024-09-12T00:07:37.335857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-09-12T00:07:37.335663+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-09-12T00:07:37.335663+0000","last_clean_scrub_stamp":"2024-09-12T00:07:37.335663+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:34.672725+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"116'138","reported_seq":413,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:40.155175+0000","last_change":"2024-09-12T00:07:40.155175+0000","last_active":"2024-09-12T00:07:40.155175+0000","last_peered":"2024-09-12T00:07:40.155175+0000","last_clean":"2024-09-12T00:07:40.155175+0000","last_became_active":"2024-09-12T00:03:31.338426+0000","last_became_peered":"2024-09-12T00:03:31.338426+0000","last_unstale":"2024-09-12T00:07:40.155175+0000","last_undegraded":"2024-09-12T00:07:40.155175+0000","last_fullsized":"2024-09-12T00:07:40.155175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-09-12T00:07:40.154984+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-09-12T00:07:40.154984+0000","last_clean_scrub_stamp":"2024-09-12T00:07:40.154984+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:41.135963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:42.374363+0000","last_change":"2024-09-12T00:07:42.374193+0000","last_active":"2024-09-12T00:07:42.374363+0000","last_peered":"2024-09-12T00:07:42.374363+0000","last_clean":"2024-09-12T00:07:42.374363+0000","last_became_active":"2024-09-12T00:03:33.380088+0000","last_became_peered":"2024-09-12T00:03:33.380088+0000","last_unstale":"2024-09-12T00:07:42.374363+0000","last_undegraded":"2024-09-12T00:07:42.374363+0000","last_fullsized":"2024-09-12T00:07:42.374363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:42.374013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:42.374013+0000","last_clean_scrub_stamp":"2024-09-12T00:07:42.374013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:19.681514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'4","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.795412+0000","last_change":"2024-09-12T00:07:22.795412+0000","last_active":"2024-09-12T00:07:22.795412+0000","last_peered":"2024-09-12T00:07:22.795412+0000","last_clean":"2024-09-12T00:07:22.795412+0000","last_became_active":"2024-09-12T00:03:25.335449+0000","last_became_peered":"2024-09-12T00:03:25.335449+0000","last_unstale":"2024-09-12T00:07:22.795412+0000","last_undegraded":"2024-09-12T00:07:22.795412+0000","last_fullsized":"2024-09-12T00:07:22.795412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-12T00:07:22.795197+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-12T00:07:22.795197+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.795197+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:58.768197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"116'48","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.773156+0000","last_change":"2024-09-12T00:07:21.773015+0000","last_active":"2024-09-12T00:07:21.773156+0000","last_peered":"2024-09-12T00:07:21.773156+0000","last_clean":"2024-09-12T00:07:21.773156+0000","last_became_active":"2024-09-12T00:03:23.614187+0000","last_became_peered":"2024-09-12T00:03:23.614187+0000","last_unstale":"2024-09-12T00:07:21.773156+0000","last_undegraded":"2024-09-12T00:07:21.773156+0000","last_fullsized":"2024-09-12T00:07:21.773156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-09-12T00:07:21.772812+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-09-12T00:07:21.772812+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.772812+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:50.277427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:44.975805+0000","last_change":"2024-09-12T00:07:44.975805+0000","last_active":"2024-09-12T00:07:44.975805+0000","last_peered":"2024-09-12T00:07:44.975805+0000","last_clean":"2024-09-12T00:07:44.975805+0000","last_became_active":"2024-09-12T00:06:26.670945+0000","last_became_peered":"2024-09-12T00:06:26.670945+0000","last_unstale":"2024-09-12T00:07:44.975805+0000","last_undegraded":"2024-09-12T00:07:44.975805+0000","last_fullsized":"2024-09-12T00:07:44.975805+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:44.975616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:44.975616+0000","last_clean_scrub_stamp":"2024-09-12T00:07:44.975616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:14.769822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"116'35","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:33.053460+0000","last_change":"2024-09-12T00:07:33.053460+0000","last_active":"2024-09-12T00:07:33.053460+0000","last_peered":"2024-09-12T00:07:33.053460+0000","last_clean":"2024-09-12T00:07:33.053460+0000","last_became_active":"2024-09-12T00:03:29.345243+0000","last_became_peered":"2024-09-12T00:03:29.345243+0000","last_unstale":"2024-09-12T00:07:33.053460+0000","last_undegraded":"2024-09-12T00:07:33.053460+0000","last_fullsized":"2024-09-12T00:07:33.053460+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'35","last_scrub_stamp":"2024-09-12T00:07:33.053267+0000","last_deep_scrub":"116'35","last_deep_scrub_stamp":"2024-09-12T00:07:33.053267+0000","last_clean_scrub_stamp":"2024-09-12T00:07:33.053267+0000","objects_scrubbed":8,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:21.156625+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:36.308605+0000","last_change":"2024-09-12T00:07:36.308605+0000","last_active":"2024-09-12T00:07:36.308605+0000","last_peered":"2024-09-12T00:07:36.308605+0000","last_clean":"2024-09-12T00:07:36.308605+0000","last_became_active":"2024-09-12T00:03:31.359763+0000","last_became_peered":"2024-09-12T00:03:31.359763+0000","last_unstale":"2024-09-12T00:07:36.308605+0000","last_undegraded":"2024-09-12T00:07:36.308605+0000","last_fullsized":"2024-09-12T00:07:36.308605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:36.308410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:36.308410+0000","last_clean_scrub_stamp":"2024-09-12T00:07:36.308410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:06.818823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"84'6","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:41.887683+0000","last_change":"2024-09-12T00:07:41.887502+0000","last_active":"2024-09-12T00:07:41.887683+0000","last_peered":"2024-09-12T00:07:41.887683+0000","last_clean":"2024-09-12T00:07:41.887683+0000","last_became_active":"2024-09-12T00:03:33.370562+0000","last_became_peered":"2024-09-12T00:03:33.370562+0000","last_unstale":"2024-09-12T00:07:41.887683+0000","last_undegraded":"2024-09-12T00:07:41.887683+0000","last_fullsized":"2024-09-12T00:07:41.887683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'6","last_scrub_stamp":"2024-09-12T00:07:41.887301+0000","last_deep_scrub":"84'6","last_deep_scrub_stamp":"2024-09-12T00:07:41.887301+0000","last_clean_scrub_stamp":"2024-09-12T00:07:41.887301+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:38.688689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'10","reported_seq":57,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:34.962485+0000","last_change":"2024-09-12T00:07:34.962485+0000","last_active":"2024-09-12T00:07:34.962485+0000","last_peered":"2024-09-12T00:07:34.962485+0000","last_clean":"2024-09-12T00:07:34.962485+0000","last_became_active":"2024-09-12T00:06:26.674937+0000","last_became_peered":"2024-09-12T00:06:26.674937+0000","last_unstale":"2024-09-12T00:07:34.962485+0000","last_undegraded":"2024-09-12T00:07:34.962485+0000","last_fullsized":"2024-09-12T00:07:34.962485+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'10","last_scrub_stamp":"2024-09-12T00:07:34.962282+0000","last_deep_scrub":"84'10","last_deep_scrub_stamp":"2024-09-12T00:07:34.962282+0000","last_clean_scrub_stamp":"2024-09-12T00:07:34.962282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:16.072883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"116'74","reported_seq":311,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.028450+0000","last_change":"2024-09-12T00:07:18.028450+0000","last_active":"2024-09-12T00:07:18.028450+0000","last_peered":"2024-09-12T00:07:18.028450+0000","last_clean":"2024-09-12T00:07:18.028450+0000","last_became_active":"2024-09-12T00:03:11.767988+0000","last_became_peered":"2024-09-12T00:03:11.767988+0000","last_unstale":"2024-09-12T00:07:18.028450+0000","last_undegraded":"2024-09-12T00:07:18.028450+0000","last_fullsized":"2024-09-12T00:07:18.028450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'74","last_scrub_stamp":"2024-09-12T00:07:18.028259+0000","last_deep_scrub":"116'74","last_deep_scrub_stamp":"2024-09-12T00:07:18.028259+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.028259+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:46.777805+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"116'2","reported_seq":54,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.898811+0000","last_change":"2024-09-12T00:07:18.898811+0000","last_active":"2024-09-12T00:07:18.898811+0000","last_peered":"2024-09-12T00:07:18.898811+0000","last_clean":"2024-09-12T00:07:18.898811+0000","last_became_active":"2024-09-12T00:06:26.671587+0000","last_became_peered":"2024-09-12T00:06:26.671587+0000","last_unstale":"2024-09-12T00:07:18.898811+0000","last_undegraded":"2024-09-12T00:07:18.898811+0000","last_fullsized":"2024-09-12T00:07:18.898811+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-09-12T00:07:18.898634+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-09-12T00:07:18.898634+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.898634+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:20.037927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"116'48","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.814966+0000","last_change":"2024-09-12T00:07:19.814801+0000","last_active":"2024-09-12T00:07:19.814966+0000","last_peered":"2024-09-12T00:07:19.814966+0000","last_clean":"2024-09-12T00:07:19.814966+0000","last_became_active":"2024-09-12T00:03:23.621146+0000","last_became_peered":"2024-09-12T00:03:23.621146+0000","last_unstale":"2024-09-12T00:07:19.814966+0000","last_undegraded":"2024-09-12T00:07:19.814966+0000","last_fullsized":"2024-09-12T00:07:19.814966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-09-12T00:07:19.814610+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-09-12T00:07:19.814610+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.814610+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:47.085845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:35.387468+0000","last_change":"2024-09-12T00:07:35.387207+0000","last_active":"2024-09-12T00:07:35.387468+0000","last_peered":"2024-09-12T00:07:35.387468+0000","last_clean":"2024-09-12T00:07:35.387468+0000","last_became_active":"2024-09-12T00:03:27.315502+0000","last_became_peered":"2024-09-12T00:03:27.315502+0000","last_unstale":"2024-09-12T00:07:35.387468+0000","last_undegraded":"2024-09-12T00:07:35.387468+0000","last_fullsized":"2024-09-12T00:07:35.387468+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:35.386990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:35.386990+0000","last_clean_scrub_stamp":"2024-09-12T00:07:35.386990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:49.567244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"116'59","reported_seq":90,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:49.846690+0000","last_change":"2024-09-12T00:07:49.846690+0000","last_active":"2024-09-12T00:07:49.846690+0000","last_peered":"2024-09-12T00:07:49.846690+0000","last_clean":"2024-09-12T00:07:49.846690+0000","last_became_active":"2024-09-12T00:06:26.667623+0000","last_became_peered":"2024-09-12T00:06:26.667623+0000","last_unstale":"2024-09-12T00:07:49.846690+0000","last_undegraded":"2024-09-12T00:07:49.846690+0000","last_fullsized":"2024-09-12T00:07:49.846690+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'59","last_scrub_stamp":"2024-09-12T00:07:49.846493+0000","last_deep_scrub":"116'59","last_deep_scrub_stamp":"2024-09-12T00:07:49.846493+0000","last_clean_scrub_stamp":"2024-09-12T00:07:49.846493+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:09.460477+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":56,"num_read_kb":44,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:45.706262+0000","last_change":"2024-09-12T00:07:45.706123+0000","last_active":"2024-09-12T00:07:45.706262+0000","last_peered":"2024-09-12T00:07:45.706262+0000","last_clean":"2024-09-12T00:07:45.706262+0000","last_became_active":"2024-09-12T00:03:31.360462+0000","last_became_peered":"2024-09-12T00:03:31.360462+0000","last_unstale":"2024-09-12T00:07:45.706262+0000","last_undegraded":"2024-09-12T00:07:45.706262+0000","last_fullsized":"2024-09-12T00:07:45.706262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:45.705946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:45.705946+0000","last_clean_scrub_stamp":"2024-09-12T00:07:45.705946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:20.894083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"59'4","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:39.383982+0000","last_change":"2024-09-12T00:07:39.383812+0000","last_active":"2024-09-12T00:07:39.383982+0000","last_peered":"2024-09-12T00:07:39.383982+0000","last_clean":"2024-09-12T00:07:39.383982+0000","last_became_active":"2024-09-12T00:03:33.387457+0000","last_became_peered":"2024-09-12T00:03:33.387457+0000","last_unstale":"2024-09-12T00:07:39.383982+0000","last_undegraded":"2024-09-12T00:07:39.383982+0000","last_fullsized":"2024-09-12T00:07:39.383982+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'4","last_scrub_stamp":"2024-09-12T00:07:39.383661+0000","last_deep_scrub":"59'4","last_deep_scrub_stamp":"2024-09-12T00:07:39.383661+0000","last_clean_scrub_stamp":"2024-09-12T00:07:39.383661+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:21.270638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.584395+0000","last_change":"2024-09-12T00:07:31.584125+0000","last_active":"2024-09-12T00:07:31.584395+0000","last_peered":"2024-09-12T00:07:31.584395+0000","last_clean":"2024-09-12T00:07:31.584395+0000","last_became_active":"2024-09-12T00:03:25.355306+0000","last_became_peered":"2024-09-12T00:03:25.355306+0000","last_unstale":"2024-09-12T00:07:31.584395+0000","last_undegraded":"2024-09-12T00:07:31.584395+0000","last_fullsized":"2024-09-12T00:07:31.584395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:31.583850+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:31.583850+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.583850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:37.980847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:16.961431+0000","last_change":"2024-09-12T00:07:16.961431+0000","last_active":"2024-09-12T00:07:16.961431+0000","last_peered":"2024-09-12T00:07:16.961431+0000","last_clean":"2024-09-12T00:07:16.961431+0000","last_became_active":"2024-09-12T00:06:26.653574+0000","last_became_peered":"2024-09-12T00:06:26.653574+0000","last_unstale":"2024-09-12T00:07:16.961431+0000","last_undegraded":"2024-09-12T00:07:16.961431+0000","last_fullsized":"2024-09-12T00:07:16.961431+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:16.961256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:16.961256+0000","last_clean_scrub_stamp":"2024-09-12T00:07:16.961256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:28.506803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"116'54","reported_seq":259,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.320022+0000","last_change":"2024-09-12T00:07:19.319837+0000","last_active":"2024-09-12T00:07:19.320022+0000","last_peered":"2024-09-12T00:07:19.320022+0000","last_clean":"2024-09-12T00:07:19.320022+0000","last_became_active":"2024-09-12T00:03:23.621358+0000","last_became_peered":"2024-09-12T00:03:23.621358+0000","last_unstale":"2024-09-12T00:07:19.320022+0000","last_undegraded":"2024-09-12T00:07:19.320022+0000","last_fullsized":"2024-09-12T00:07:19.320022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'54","last_scrub_stamp":"2024-09-12T00:07:19.319642+0000","last_deep_scrub":"116'54","last_deep_scrub_stamp":"2024-09-12T00:07:19.319642+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.319642+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:14.283628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":62,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:44.003624+0000","last_change":"2024-09-12T00:07:44.003624+0000","last_active":"2024-09-12T00:07:44.003624+0000","last_peered":"2024-09-12T00:07:44.003624+0000","last_clean":"2024-09-12T00:07:44.003624+0000","last_became_active":"2024-09-12T00:06:26.657376+0000","last_became_peered":"2024-09-12T00:06:26.657376+0000","last_unstale":"2024-09-12T00:07:44.003624+0000","last_undegraded":"2024-09-12T00:07:44.003624+0000","last_fullsized":"2024-09-12T00:07:44.003624+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:44.003442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:44.003442+0000","last_clean_scrub_stamp":"2024-09-12T00:07:44.003442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:07.381318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"116'160","reported_seq":470,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.833266+0000","last_change":"2024-09-12T00:07:32.832980+0000","last_active":"2024-09-12T00:07:32.833266+0000","last_peered":"2024-09-12T00:07:32.833266+0000","last_clean":"2024-09-12T00:07:32.833266+0000","last_became_active":"2024-09-12T00:03:29.346101+0000","last_became_peered":"2024-09-12T00:03:29.346101+0000","last_unstale":"2024-09-12T00:07:32.833266+0000","last_undegraded":"2024-09-12T00:07:32.833266+0000","last_fullsized":"2024-09-12T00:07:32.833266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'160","last_scrub_stamp":"2024-09-12T00:07:32.832708+0000","last_deep_scrub":"116'160","last_deep_scrub_stamp":"2024-09-12T00:07:32.832708+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.832708+0000","objects_scrubbed":11,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:16.374934+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":204,"num_read_kb":188,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721121+0000","last_change":"2024-09-12T00:06:26.679841+0000","last_active":"2024-09-12T00:06:42.721121+0000","last_peered":"2024-09-12T00:06:42.721121+0000","last_clean":"2024-09-12T00:06:42.721121+0000","last_became_active":"2024-09-12T00:06:26.675966+0000","last_became_peered":"2024-09-12T00:06:26.675966+0000","last_unstale":"2024-09-12T00:06:42.721121+0000","last_undegraded":"2024-09-12T00:06:42.721121+0000","last_fullsized":"2024-09-12T00:06:42.721121+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:39.439184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:50.739008+0000","last_change":"2024-09-12T00:07:50.738840+0000","last_active":"2024-09-12T00:07:50.739008+0000","last_peered":"2024-09-12T00:07:50.739008+0000","last_clean":"2024-09-12T00:07:50.739008+0000","last_became_active":"2024-09-12T00:03:33.384951+0000","last_became_peered":"2024-09-12T00:03:33.384951+0000","last_unstale":"2024-09-12T00:07:50.739008+0000","last_undegraded":"2024-09-12T00:07:50.739008+0000","last_fullsized":"2024-09-12T00:07:50.739008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:50.738595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:50.738595+0000","last_clean_scrub_stamp":"2024-09-12T00:07:50.738595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:57.570402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"59'2","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.430776+0000","last_change":"2024-09-12T00:07:28.430633+0000","last_active":"2024-09-12T00:07:28.430776+0000","last_peered":"2024-09-12T00:07:28.430776+0000","last_clean":"2024-09-12T00:07:28.430776+0000","last_became_active":"2024-09-12T00:03:25.331652+0000","last_became_peered":"2024-09-12T00:03:25.331652+0000","last_unstale":"2024-09-12T00:07:28.430776+0000","last_undegraded":"2024-09-12T00:07:28.430776+0000","last_fullsized":"2024-09-12T00:07:28.430776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:28.430454+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:28.430454+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.430454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:53.945942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.885956+0000","last_change":"2024-09-12T00:07:18.885829+0000","last_active":"2024-09-12T00:07:18.885956+0000","last_peered":"2024-09-12T00:07:18.885956+0000","last_clean":"2024-09-12T00:07:18.885956+0000","last_became_active":"2024-09-12T00:03:16.559698+0000","last_became_peered":"2024-09-12T00:03:16.559698+0000","last_unstale":"2024-09-12T00:07:18.885956+0000","last_undegraded":"2024-09-12T00:07:18.885956+0000","last_fullsized":"2024-09-12T00:07:18.885956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:18.885652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:18.885652+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.885652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:31.551246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00082440599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"116'44","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.680345+0000","last_change":"2024-09-12T00:07:20.680175+0000","last_active":"2024-09-12T00:07:20.680345+0000","last_peered":"2024-09-12T00:07:20.680345+0000","last_clean":"2024-09-12T00:07:20.680345+0000","last_became_active":"2024-09-12T00:03:23.632795+0000","last_became_peered":"2024-09-12T00:03:23.632795+0000","last_unstale":"2024-09-12T00:07:20.680345+0000","last_undegraded":"2024-09-12T00:07:20.680345+0000","last_fullsized":"2024-09-12T00:07:20.680345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-09-12T00:07:20.679987+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-09-12T00:07:20.679987+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.679987+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:34.961364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"116'2","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.810826+0000","last_change":"2024-09-12T00:07:31.810675+0000","last_active":"2024-09-12T00:07:31.810826+0000","last_peered":"2024-09-12T00:07:31.810826+0000","last_clean":"2024-09-12T00:07:31.810826+0000","last_became_active":"2024-09-12T00:03:27.326173+0000","last_became_peered":"2024-09-12T00:03:27.326173+0000","last_unstale":"2024-09-12T00:07:31.810826+0000","last_undegraded":"2024-09-12T00:07:31.810826+0000","last_fullsized":"2024-09-12T00:07:31.810826+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-09-12T00:07:31.810485+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-09-12T00:07:31.810485+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.810485+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:59.679817+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"116'25","reported_seq":263,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:33.386784+0000","last_change":"2024-09-12T00:07:33.386524+0000","last_active":"2024-09-12T00:07:33.386784+0000","last_peered":"2024-09-12T00:07:33.386784+0000","last_clean":"2024-09-12T00:07:33.386784+0000","last_became_active":"2024-09-12T00:03:29.337364+0000","last_became_peered":"2024-09-12T00:03:29.337364+0000","last_unstale":"2024-09-12T00:07:33.386784+0000","last_undegraded":"2024-09-12T00:07:33.386784+0000","last_fullsized":"2024-09-12T00:07:33.386784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'25","last_scrub_stamp":"2024-09-12T00:07:33.386081+0000","last_deep_scrub":"116'25","last_deep_scrub_stamp":"2024-09-12T00:07:33.386081+0000","last_clean_scrub_stamp":"2024-09-12T00:07:33.386081+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:51.980155+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:49.923089+0000","last_change":"2024-09-12T00:07:49.923089+0000","last_active":"2024-09-12T00:07:49.923089+0000","last_peered":"2024-09-12T00:07:49.923089+0000","last_clean":"2024-09-12T00:07:49.923089+0000","last_became_active":"2024-09-12T00:06:26.654068+0000","last_became_peered":"2024-09-12T00:06:26.654068+0000","last_unstale":"2024-09-12T00:07:49.923089+0000","last_undegraded":"2024-09-12T00:07:49.923089+0000","last_fullsized":"2024-09-12T00:07:49.923089+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:49.922916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:49.922916+0000","last_clean_scrub_stamp":"2024-09-12T00:07:49.922916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:26.574952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:41.810544+0000","last_change":"2024-09-12T00:03:33.354171+0000","last_active":"2024-09-12T00:06:41.810544+0000","last_peered":"2024-09-12T00:06:41.810544+0000","last_clean":"2024-09-12T00:06:41.810544+0000","last_became_active":"2024-09-12T00:03:33.353460+0000","last_became_peered":"2024-09-12T00:03:33.353460+0000","last_unstale":"2024-09-12T00:06:41.810544+0000","last_undegraded":"2024-09-12T00:06:41.810544+0000","last_fullsized":"2024-09-12T00:06:41.810544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:34.356970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"84'8","reported_seq":234,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.396004+0000","last_change":"2024-09-12T00:07:27.395866+0000","last_active":"2024-09-12T00:07:27.396004+0000","last_peered":"2024-09-12T00:07:27.396004+0000","last_clean":"2024-09-12T00:07:27.396004+0000","last_became_active":"2024-09-12T00:03:25.333449+0000","last_became_peered":"2024-09-12T00:03:25.333449+0000","last_unstale":"2024-09-12T00:07:27.396004+0000","last_undegraded":"2024-09-12T00:07:27.396004+0000","last_fullsized":"2024-09-12T00:07:27.396004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'8","last_scrub_stamp":"2024-09-12T00:07:27.395672+0000","last_deep_scrub":"84'8","last_deep_scrub_stamp":"2024-09-12T00:07:27.395672+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.395672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:47.217988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"116'3","reported_seq":54,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:17.930005+0000","last_change":"2024-09-12T00:07:17.930005+0000","last_active":"2024-09-12T00:07:17.930005+0000","last_peered":"2024-09-12T00:07:17.930005+0000","last_clean":"2024-09-12T00:07:17.930005+0000","last_became_active":"2024-09-12T00:06:26.677047+0000","last_became_peered":"2024-09-12T00:06:26.677047+0000","last_unstale":"2024-09-12T00:07:17.930005+0000","last_undegraded":"2024-09-12T00:07:17.930005+0000","last_fullsized":"2024-09-12T00:07:17.930005+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'3","last_scrub_stamp":"2024-09-12T00:07:17.929893+0000","last_deep_scrub":"116'3","last_deep_scrub_stamp":"2024-09-12T00:07:17.929893+0000","last_clean_scrub_stamp":"2024-09-12T00:07:17.929893+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:22.176153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"116'42","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:15.478879+0000","last_change":"2024-09-12T00:07:15.478773+0000","last_active":"2024-09-12T00:07:15.478879+0000","last_peered":"2024-09-12T00:07:15.478879+0000","last_clean":"2024-09-12T00:07:15.478879+0000","last_became_active":"2024-09-12T00:03:23.610612+0000","last_became_peered":"2024-09-12T00:03:23.610612+0000","last_unstale":"2024-09-12T00:07:15.478879+0000","last_undegraded":"2024-09-12T00:07:15.478879+0000","last_fullsized":"2024-09-12T00:07:15.478879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-09-12T00:07:15.478642+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-09-12T00:07:15.478642+0000","last_clean_scrub_stamp":"2024-09-12T00:07:15.478642+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:48.811903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.848196+0000","last_change":"2024-09-12T00:07:30.848035+0000","last_active":"2024-09-12T00:07:30.848196+0000","last_peered":"2024-09-12T00:07:30.848196+0000","last_clean":"2024-09-12T00:07:30.848196+0000","last_became_active":"2024-09-12T00:03:27.338508+0000","last_became_peered":"2024-09-12T00:03:27.338508+0000","last_unstale":"2024-09-12T00:07:30.848196+0000","last_undegraded":"2024-09-12T00:07:30.848196+0000","last_fullsized":"2024-09-12T00:07:30.848196+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:30.847854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:30.847854+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.847854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:05.685985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"116'18","reported_seq":254,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:41.666142+0000","last_change":"2024-09-12T00:07:41.666008+0000","last_active":"2024-09-12T00:07:41.666142+0000","last_peered":"2024-09-12T00:07:41.666142+0000","last_clean":"2024-09-12T00:07:41.666142+0000","last_became_active":"2024-09-12T00:06:26.682354+0000","last_became_peered":"2024-09-12T00:06:26.682354+0000","last_unstale":"2024-09-12T00:07:41.666142+0000","last_undegraded":"2024-09-12T00:07:41.666142+0000","last_fullsized":"2024-09-12T00:07:41.666142+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'18","last_scrub_stamp":"2024-09-12T00:07:41.665819+0000","last_deep_scrub":"116'18","last_deep_scrub_stamp":"2024-09-12T00:07:41.665819+0000","last_clean_scrub_stamp":"2024-09-12T00:07:41.665819+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:51.550599+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.722102+0000","last_change":"2024-09-12T00:06:26.675142+0000","last_active":"2024-09-12T00:06:42.722102+0000","last_peered":"2024-09-12T00:06:42.722102+0000","last_clean":"2024-09-12T00:06:42.722102+0000","last_became_active":"2024-09-12T00:06:26.669787+0000","last_became_peered":"2024-09-12T00:06:26.669787+0000","last_unstale":"2024-09-12T00:06:42.722102+0000","last_undegraded":"2024-09-12T00:06:42.722102+0000","last_fullsized":"2024-09-12T00:06:42.722102+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:34.635508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"63'7","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:45.145135+0000","last_change":"2024-09-12T00:07:45.144997+0000","last_active":"2024-09-12T00:07:45.145135+0000","last_peered":"2024-09-12T00:07:45.145135+0000","last_clean":"2024-09-12T00:07:45.145135+0000","last_became_active":"2024-09-12T00:03:33.366311+0000","last_became_peered":"2024-09-12T00:03:33.366311+0000","last_unstale":"2024-09-12T00:07:45.145135+0000","last_undegraded":"2024-09-12T00:07:45.145135+0000","last_fullsized":"2024-09-12T00:07:45.145135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'7","last_scrub_stamp":"2024-09-12T00:07:45.144783+0000","last_deep_scrub":"63'7","last_deep_scrub_stamp":"2024-09-12T00:07:45.144783+0000","last_clean_scrub_stamp":"2024-09-12T00:07:45.144783+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:41.712153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"96'8","reported_seq":265,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.333497+0000","last_change":"2024-09-12T00:07:25.333356+0000","last_active":"2024-09-12T00:07:25.333497+0000","last_peered":"2024-09-12T00:07:25.333497+0000","last_clean":"2024-09-12T00:07:25.333497+0000","last_became_active":"2024-09-12T00:06:26.675442+0000","last_became_peered":"2024-09-12T00:06:26.675442+0000","last_unstale":"2024-09-12T00:07:25.333497+0000","last_undegraded":"2024-09-12T00:07:25.333497+0000","last_fullsized":"2024-09-12T00:07:25.333497+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'8","last_scrub_stamp":"2024-09-12T00:07:25.333161+0000","last_deep_scrub":"96'8","last_deep_scrub_stamp":"2024-09-12T00:07:25.333161+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.333161+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:08.133560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"116'38","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:16.236058+0000","last_change":"2024-09-12T00:07:16.235989+0000","last_active":"2024-09-12T00:07:16.236058+0000","last_peered":"2024-09-12T00:07:16.236058+0000","last_clean":"2024-09-12T00:07:16.236058+0000","last_became_active":"2024-09-12T00:03:23.618716+0000","last_became_peered":"2024-09-12T00:03:23.618716+0000","last_unstale":"2024-09-12T00:07:16.236058+0000","last_undegraded":"2024-09-12T00:07:16.236058+0000","last_fullsized":"2024-09-12T00:07:16.236058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'38","last_scrub_stamp":"2024-09-12T00:07:16.235890+0000","last_deep_scrub":"116'38","last_deep_scrub_stamp":"2024-09-12T00:07:16.235890+0000","last_clean_scrub_stamp":"2024-09-12T00:07:16.235890+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:58.241008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.612406+0000","last_change":"2024-09-12T00:07:18.612250+0000","last_active":"2024-09-12T00:07:18.612406+0000","last_peered":"2024-09-12T00:07:18.612406+0000","last_clean":"2024-09-12T00:07:18.612406+0000","last_became_active":"2024-09-12T00:03:16.561218+0000","last_became_peered":"2024-09-12T00:03:16.561218+0000","last_unstale":"2024-09-12T00:07:18.612406+0000","last_undegraded":"2024-09-12T00:07:18.612406+0000","last_fullsized":"2024-09-12T00:07:18.612406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:18.612067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:18.612067+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.612067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:00.405912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084170299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:34.787686+0000","last_change":"2024-09-12T00:07:34.787525+0000","last_active":"2024-09-12T00:07:34.787686+0000","last_peered":"2024-09-12T00:07:34.787686+0000","last_clean":"2024-09-12T00:07:34.787686+0000","last_became_active":"2024-09-12T00:03:27.340391+0000","last_became_peered":"2024-09-12T00:03:27.340391+0000","last_unstale":"2024-09-12T00:07:34.787686+0000","last_undegraded":"2024-09-12T00:07:34.787686+0000","last_fullsized":"2024-09-12T00:07:34.787686+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:34.787352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:34.787352+0000","last_clean_scrub_stamp":"2024-09-12T00:07:34.787352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:55.516485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"116'65","reported_seq":289,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:33.837358+0000","last_change":"2024-09-12T00:07:33.837358+0000","last_active":"2024-09-12T00:07:33.837358+0000","last_peered":"2024-09-12T00:07:33.837358+0000","last_clean":"2024-09-12T00:07:33.837358+0000","last_became_active":"2024-09-12T00:03:29.346066+0000","last_became_peered":"2024-09-12T00:03:29.346066+0000","last_unstale":"2024-09-12T00:07:33.837358+0000","last_undegraded":"2024-09-12T00:07:33.837358+0000","last_fullsized":"2024-09-12T00:07:33.837358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'65","last_scrub_stamp":"2024-09-12T00:07:33.837085+0000","last_deep_scrub":"116'65","last_deep_scrub_stamp":"2024-09-12T00:07:33.837085+0000","last_clean_scrub_stamp":"2024-09-12T00:07:33.837085+0000","objects_scrubbed":10,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:16.637484+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":76,"num_read_kb":301,"num_write":46,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:37.336422+0000","last_change":"2024-09-12T00:07:37.336263+0000","last_active":"2024-09-12T00:07:37.336422+0000","last_peered":"2024-09-12T00:07:37.336422+0000","last_clean":"2024-09-12T00:07:37.336422+0000","last_became_active":"2024-09-12T00:03:31.346511+0000","last_became_peered":"2024-09-12T00:03:31.346511+0000","last_unstale":"2024-09-12T00:07:37.336422+0000","last_undegraded":"2024-09-12T00:07:37.336422+0000","last_fullsized":"2024-09-12T00:07:37.336422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:37.335987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:37.335987+0000","last_clean_scrub_stamp":"2024-09-12T00:07:37.335987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:33.903356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"59'7","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066233+0000","last_change":"2024-09-12T00:03:33.385232+0000","last_active":"2024-09-12T00:06:42.066233+0000","last_peered":"2024-09-12T00:06:42.066233+0000","last_clean":"2024-09-12T00:06:42.066233+0000","last_became_active":"2024-09-12T00:03:33.384457+0000","last_became_peered":"2024-09-12T00:03:33.384457+0000","last_unstale":"2024-09-12T00:06:42.066233+0000","last_undegraded":"2024-09-12T00:06:42.066233+0000","last_fullsized":"2024-09-12T00:06:42.066233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:34.615256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"76'4","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.378056+0000","last_change":"2024-09-12T00:07:26.377897+0000","last_active":"2024-09-12T00:07:26.378056+0000","last_peered":"2024-09-12T00:07:26.378056+0000","last_clean":"2024-09-12T00:07:26.378056+0000","last_became_active":"2024-09-12T00:03:25.332814+0000","last_became_peered":"2024-09-12T00:03:25.332814+0000","last_unstale":"2024-09-12T00:07:26.378056+0000","last_undegraded":"2024-09-12T00:07:26.378056+0000","last_fullsized":"2024-09-12T00:07:26.378056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-12T00:07:26.377710+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-12T00:07:26.377710+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.377710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:53.843693+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"116'54","reported_seq":258,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.342369+0000","last_change":"2024-09-12T00:07:20.342225+0000","last_active":"2024-09-12T00:07:20.342369+0000","last_peered":"2024-09-12T00:07:20.342369+0000","last_clean":"2024-09-12T00:07:20.342369+0000","last_became_active":"2024-09-12T00:03:23.628128+0000","last_became_peered":"2024-09-12T00:03:23.628128+0000","last_unstale":"2024-09-12T00:07:20.342369+0000","last_undegraded":"2024-09-12T00:07:20.342369+0000","last_fullsized":"2024-09-12T00:07:20.342369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'54","last_scrub_stamp":"2024-09-12T00:07:20.342047+0000","last_deep_scrub":"116'54","last_deep_scrub_stamp":"2024-09-12T00:07:20.342047+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.342047+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:49.091593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.905666+0000","last_change":"2024-09-12T00:07:19.905666+0000","last_active":"2024-09-12T00:07:19.905666+0000","last_peered":"2024-09-12T00:07:19.905666+0000","last_clean":"2024-09-12T00:07:19.905666+0000","last_became_active":"2024-09-12T00:06:26.675309+0000","last_became_peered":"2024-09-12T00:06:26.675309+0000","last_unstale":"2024-09-12T00:07:19.905666+0000","last_undegraded":"2024-09-12T00:07:19.905666+0000","last_fullsized":"2024-09-12T00:07:19.905666+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:19.905470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:19.905470+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.905470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:53.120369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:34.364705+0000","last_change":"2024-09-12T00:07:34.364536+0000","last_active":"2024-09-12T00:07:34.364705+0000","last_peered":"2024-09-12T00:07:34.364705+0000","last_clean":"2024-09-12T00:07:34.364705+0000","last_became_active":"2024-09-12T00:03:27.315704+0000","last_became_peered":"2024-09-12T00:03:27.315704+0000","last_unstale":"2024-09-12T00:07:34.364705+0000","last_undegraded":"2024-09-12T00:07:34.364705+0000","last_fullsized":"2024-09-12T00:07:34.364705+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:34.364354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:34.364354+0000","last_clean_scrub_stamp":"2024-09-12T00:07:34.364354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:14.847442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"116'28","reported_seq":281,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:36.325130+0000","last_change":"2024-09-12T00:07:36.324986+0000","last_active":"2024-09-12T00:07:36.325130+0000","last_peered":"2024-09-12T00:07:36.325130+0000","last_clean":"2024-09-12T00:07:36.325130+0000","last_became_active":"2024-09-12T00:06:26.661284+0000","last_became_peered":"2024-09-12T00:06:26.661284+0000","last_unstale":"2024-09-12T00:07:36.325130+0000","last_undegraded":"2024-09-12T00:07:36.325130+0000","last_fullsized":"2024-09-12T00:07:36.325130+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-09-12T00:07:36.324760+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-09-12T00:07:36.324760+0000","last_clean_scrub_stamp":"2024-09-12T00:07:36.324760+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:01.632341+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"116'138","reported_seq":366,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:37.083533+0000","last_change":"2024-09-12T00:07:37.083533+0000","last_active":"2024-09-12T00:07:37.083533+0000","last_peered":"2024-09-12T00:07:37.083533+0000","last_clean":"2024-09-12T00:07:37.083533+0000","last_became_active":"2024-09-12T00:03:31.356108+0000","last_became_peered":"2024-09-12T00:03:31.356108+0000","last_unstale":"2024-09-12T00:07:37.083533+0000","last_undegraded":"2024-09-12T00:07:37.083533+0000","last_fullsized":"2024-09-12T00:07:37.083533+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-09-12T00:07:37.083321+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-09-12T00:07:37.083321+0000","last_clean_scrub_stamp":"2024-09-12T00:07:37.083321+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:17.220783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"58'2","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:42.873945+0000","last_change":"2024-09-12T00:07:42.873945+0000","last_active":"2024-09-12T00:07:42.873945+0000","last_peered":"2024-09-12T00:07:42.873945+0000","last_clean":"2024-09-12T00:07:42.873945+0000","last_became_active":"2024-09-12T00:03:33.371214+0000","last_became_peered":"2024-09-12T00:03:33.371214+0000","last_unstale":"2024-09-12T00:07:42.873945+0000","last_undegraded":"2024-09-12T00:07:42.873945+0000","last_fullsized":"2024-09-12T00:07:42.873945+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:42.873746+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:42.873746+0000","last_clean_scrub_stamp":"2024-09-12T00:07:42.873746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:31.735167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"84'8","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.825158+0000","last_change":"2024-09-12T00:07:26.825010+0000","last_active":"2024-09-12T00:07:26.825158+0000","last_peered":"2024-09-12T00:07:26.825158+0000","last_clean":"2024-09-12T00:07:26.825158+0000","last_became_active":"2024-09-12T00:03:25.331250+0000","last_became_peered":"2024-09-12T00:03:25.331250+0000","last_unstale":"2024-09-12T00:07:26.825158+0000","last_undegraded":"2024-09-12T00:07:26.825158+0000","last_fullsized":"2024-09-12T00:07:26.825158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'8","last_scrub_stamp":"2024-09-12T00:07:26.824802+0000","last_deep_scrub":"84'8","last_deep_scrub_stamp":"2024-09-12T00:07:26.824802+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.824802+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:24.673458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"116'46","reported_seq":249,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.804704+0000","last_change":"2024-09-12T00:07:20.804454+0000","last_active":"2024-09-12T00:07:20.804704+0000","last_peered":"2024-09-12T00:07:20.804704+0000","last_clean":"2024-09-12T00:07:20.804704+0000","last_became_active":"2024-09-12T00:03:23.601481+0000","last_became_peered":"2024-09-12T00:03:23.601481+0000","last_unstale":"2024-09-12T00:07:20.804704+0000","last_undegraded":"2024-09-12T00:07:20.804704+0000","last_fullsized":"2024-09-12T00:07:20.804704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:20.804249+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:20.804249+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.804249+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:51.271894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:17.867338+0000","last_change":"2024-09-12T00:07:17.867195+0000","last_active":"2024-09-12T00:07:17.867338+0000","last_peered":"2024-09-12T00:07:17.867338+0000","last_clean":"2024-09-12T00:07:17.867338+0000","last_became_active":"2024-09-12T00:03:16.594609+0000","last_became_peered":"2024-09-12T00:03:16.594609+0000","last_unstale":"2024-09-12T00:07:17.867338+0000","last_undegraded":"2024-09-12T00:07:17.867338+0000","last_fullsized":"2024-09-12T00:07:17.867338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:17.867017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:17.867017+0000","last_clean_scrub_stamp":"2024-09-12T00:07:17.867017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:30.089273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010254439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:42.970796+0000","last_change":"2024-09-12T00:07:42.970796+0000","last_active":"2024-09-12T00:07:42.970796+0000","last_peered":"2024-09-12T00:07:42.970796+0000","last_clean":"2024-09-12T00:07:42.970796+0000","last_became_active":"2024-09-12T00:06:26.647055+0000","last_became_peered":"2024-09-12T00:06:26.647055+0000","last_unstale":"2024-09-12T00:07:42.970796+0000","last_undegraded":"2024-09-12T00:07:42.970796+0000","last_fullsized":"2024-09-12T00:07:42.970796+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:42.970599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:42.970599+0000","last_clean_scrub_stamp":"2024-09-12T00:07:42.970599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:42.396029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"116'24","reported_seq":69,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:48.891886+0000","last_change":"2024-09-12T00:07:48.891886+0000","last_active":"2024-09-12T00:07:48.891886+0000","last_peered":"2024-09-12T00:07:48.891886+0000","last_clean":"2024-09-12T00:07:48.891886+0000","last_became_active":"2024-09-12T00:06:26.662450+0000","last_became_peered":"2024-09-12T00:06:26.662450+0000","last_unstale":"2024-09-12T00:07:48.891886+0000","last_undegraded":"2024-09-12T00:07:48.891886+0000","last_fullsized":"2024-09-12T00:07:48.891886+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'24","last_scrub_stamp":"2024-09-12T00:07:48.891689+0000","last_deep_scrub":"116'24","last_deep_scrub_stamp":"2024-09-12T00:07:48.891689+0000","last_clean_scrub_stamp":"2024-09-12T00:07:48.891689+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:14.055491+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"116'139","reported_seq":364,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:44.663882+0000","last_change":"2024-09-12T00:07:44.663882+0000","last_active":"2024-09-12T00:07:44.663882+0000","last_peered":"2024-09-12T00:07:44.663882+0000","last_clean":"2024-09-12T00:07:44.663882+0000","last_became_active":"2024-09-12T00:03:31.360518+0000","last_became_peered":"2024-09-12T00:03:31.360518+0000","last_unstale":"2024-09-12T00:07:44.663882+0000","last_undegraded":"2024-09-12T00:07:44.663882+0000","last_fullsized":"2024-09-12T00:07:44.663882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'139","last_scrub_stamp":"2024-09-12T00:07:44.663703+0000","last_deep_scrub":"116'139","last_deep_scrub_stamp":"2024-09-12T00:07:44.663703+0000","last_clean_scrub_stamp":"2024-09-12T00:07:44.663703+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:02.455335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:52.810119+0000","last_change":"2024-09-12T00:07:52.810119+0000","last_active":"2024-09-12T00:07:52.810119+0000","last_peered":"2024-09-12T00:07:52.810119+0000","last_clean":"2024-09-12T00:07:52.810119+0000","last_became_active":"2024-09-12T00:03:33.377669+0000","last_became_peered":"2024-09-12T00:03:33.377669+0000","last_unstale":"2024-09-12T00:07:52.810119+0000","last_undegraded":"2024-09-12T00:07:52.810119+0000","last_fullsized":"2024-09-12T00:07:52.810119+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:52.809915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:52.809915+0000","last_clean_scrub_stamp":"2024-09-12T00:07:52.809915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:49.071105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":253,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.171508+0000","last_change":"2024-09-12T00:07:19.171336+0000","last_active":"2024-09-12T00:07:19.171508+0000","last_peered":"2024-09-12T00:07:19.171508+0000","last_clean":"2024-09-12T00:07:19.171508+0000","last_became_active":"2024-09-12T00:06:26.662114+0000","last_became_peered":"2024-09-12T00:06:26.662114+0000","last_unstale":"2024-09-12T00:07:19.171508+0000","last_undegraded":"2024-09-12T00:07:19.171508+0000","last_fullsized":"2024-09-12T00:07:19.171508+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2024-09-12T00:07:19.171030+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2024-09-12T00:07:19.171030+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.171030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:47.579289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"116'46","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.837434+0000","last_change":"2024-09-12T00:07:18.837245+0000","last_active":"2024-09-12T00:07:18.837434+0000","last_peered":"2024-09-12T00:07:18.837434+0000","last_clean":"2024-09-12T00:07:18.837434+0000","last_became_active":"2024-09-12T00:03:23.615158+0000","last_became_peered":"2024-09-12T00:03:23.615158+0000","last_unstale":"2024-09-12T00:07:18.837434+0000","last_undegraded":"2024-09-12T00:07:18.837434+0000","last_fullsized":"2024-09-12T00:07:18.837434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:18.837058+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:18.837058+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.837058+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:06.154923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":54,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.868118+0000","last_change":"2024-09-12T00:07:21.868118+0000","last_active":"2024-09-12T00:07:21.868118+0000","last_peered":"2024-09-12T00:07:21.868118+0000","last_clean":"2024-09-12T00:07:21.868118+0000","last_became_active":"2024-09-12T00:06:26.677544+0000","last_became_peered":"2024-09-12T00:06:26.677544+0000","last_unstale":"2024-09-12T00:07:21.868118+0000","last_undegraded":"2024-09-12T00:07:21.868118+0000","last_fullsized":"2024-09-12T00:07:21.868118+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:21.867941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:21.867941+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.867941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:07.516631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:35.818291+0000","last_change":"2024-09-12T00:07:35.818291+0000","last_active":"2024-09-12T00:07:35.818291+0000","last_peered":"2024-09-12T00:07:35.818291+0000","last_clean":"2024-09-12T00:07:35.818291+0000","last_became_active":"2024-09-12T00:03:27.336289+0000","last_became_peered":"2024-09-12T00:03:27.336289+0000","last_unstale":"2024-09-12T00:07:35.818291+0000","last_undegraded":"2024-09-12T00:07:35.818291+0000","last_fullsized":"2024-09-12T00:07:35.818291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:35.818085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:35.818085+0000","last_clean_scrub_stamp":"2024-09-12T00:07:35.818085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:27.057630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"116'65","reported_seq":293,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.358250+0000","last_change":"2024-09-12T00:07:32.358164+0000","last_active":"2024-09-12T00:07:32.358250+0000","last_peered":"2024-09-12T00:07:32.358250+0000","last_clean":"2024-09-12T00:07:32.358250+0000","last_became_active":"2024-09-12T00:03:29.343779+0000","last_became_peered":"2024-09-12T00:03:29.343779+0000","last_unstale":"2024-09-12T00:07:32.358250+0000","last_undegraded":"2024-09-12T00:07:32.358250+0000","last_fullsized":"2024-09-12T00:07:32.358250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'65","last_scrub_stamp":"2024-09-12T00:07:32.358046+0000","last_deep_scrub":"116'65","last_deep_scrub_stamp":"2024-09-12T00:07:32.358046+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.358046+0000","objects_scrubbed":9,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:33.247176+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:45.897029+0000","last_change":"2024-09-12T00:07:45.897029+0000","last_active":"2024-09-12T00:07:45.897029+0000","last_peered":"2024-09-12T00:07:45.897029+0000","last_clean":"2024-09-12T00:07:45.897029+0000","last_became_active":"2024-09-12T00:03:31.334701+0000","last_became_peered":"2024-09-12T00:03:31.334701+0000","last_unstale":"2024-09-12T00:07:45.897029+0000","last_undegraded":"2024-09-12T00:07:45.897029+0000","last_fullsized":"2024-09-12T00:07:45.897029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:45.896838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:45.896838+0000","last_clean_scrub_stamp":"2024-09-12T00:07:45.896838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:20.509397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"58'4","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:43.378177+0000","last_change":"2024-09-12T00:07:43.378177+0000","last_active":"2024-09-12T00:07:43.378177+0000","last_peered":"2024-09-12T00:07:43.378177+0000","last_clean":"2024-09-12T00:07:43.378177+0000","last_became_active":"2024-09-12T00:03:33.385090+0000","last_became_peered":"2024-09-12T00:03:33.385090+0000","last_unstale":"2024-09-12T00:07:43.378177+0000","last_undegraded":"2024-09-12T00:07:43.378177+0000","last_fullsized":"2024-09-12T00:07:43.378177+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'4","last_scrub_stamp":"2024-09-12T00:07:43.377993+0000","last_deep_scrub":"58'4","last_deep_scrub_stamp":"2024-09-12T00:07:43.377993+0000","last_clean_scrub_stamp":"2024-09-12T00:07:43.377993+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:18.701171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"96'2","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:52.930903+0000","last_change":"2024-09-12T00:07:52.930903+0000","last_active":"2024-09-12T00:07:52.930903+0000","last_peered":"2024-09-12T00:07:52.930903+0000","last_clean":"2024-09-12T00:07:52.930903+0000","last_became_active":"2024-09-12T00:03:33.360980+0000","last_became_peered":"2024-09-12T00:03:33.360980+0000","last_unstale":"2024-09-12T00:07:52.930903+0000","last_undegraded":"2024-09-12T00:07:52.930903+0000","last_fullsized":"2024-09-12T00:07:52.930903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'2","last_scrub_stamp":"2024-09-12T00:07:52.930725+0000","last_deep_scrub":"96'2","last_deep_scrub_stamp":"2024-09-12T00:07:52.930725+0000","last_clean_scrub_stamp":"2024-09-12T00:07:52.930725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:45.117668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"59'2","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.289411+0000","last_change":"2024-09-12T00:07:28.289411+0000","last_active":"2024-09-12T00:07:28.289411+0000","last_peered":"2024-09-12T00:07:28.289411+0000","last_clean":"2024-09-12T00:07:28.289411+0000","last_became_active":"2024-09-12T00:06:26.664337+0000","last_became_peered":"2024-09-12T00:06:26.664337+0000","last_unstale":"2024-09-12T00:07:28.289411+0000","last_undegraded":"2024-09-12T00:07:28.289411+0000","last_fullsized":"2024-09-12T00:07:28.289411+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:28.289212+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:28.289212+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.289212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:53.596793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"116'60","reported_seq":141,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.902261+0000","last_change":"2024-09-12T00:07:24.902261+0000","last_active":"2024-09-12T00:07:24.902261+0000","last_peered":"2024-09-12T00:07:24.902261+0000","last_clean":"2024-09-12T00:07:24.902261+0000","last_became_active":"2024-09-12T00:06:26.671623+0000","last_became_peered":"2024-09-12T00:06:26.671623+0000","last_unstale":"2024-09-12T00:07:24.902261+0000","last_undegraded":"2024-09-12T00:07:24.902261+0000","last_fullsized":"2024-09-12T00:07:24.902261+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'60","last_scrub_stamp":"2024-09-12T00:07:24.902070+0000","last_deep_scrub":"116'60","last_deep_scrub_stamp":"2024-09-12T00:07:24.902070+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.902070+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:19.416818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":201326592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"116'4","reported_seq":381,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:34.352557+0000","last_change":"2024-09-12T00:07:34.352557+0000","last_active":"2024-09-12T00:07:34.352557+0000","last_peered":"2024-09-12T00:07:34.352557+0000","last_clean":"2024-09-12T00:07:34.352557+0000","last_became_active":"2024-09-12T00:03:27.331527+0000","last_became_peered":"2024-09-12T00:03:27.331527+0000","last_unstale":"2024-09-12T00:07:34.352557+0000","last_undegraded":"2024-09-12T00:07:34.352557+0000","last_fullsized":"2024-09-12T00:07:34.352557+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'4","last_scrub_stamp":"2024-09-12T00:07:34.352366+0000","last_deep_scrub":"116'4","last_deep_scrub_stamp":"2024-09-12T00:07:34.352366+0000","last_clean_scrub_stamp":"2024-09-12T00:07:34.352366+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:23.213786+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":272,"num_read_kb":272,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"116'33","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:38.332540+0000","last_change":"2024-09-12T00:07:38.332540+0000","last_active":"2024-09-12T00:07:38.332540+0000","last_peered":"2024-09-12T00:07:38.332540+0000","last_clean":"2024-09-12T00:07:38.332540+0000","last_became_active":"2024-09-12T00:03:29.337905+0000","last_became_peered":"2024-09-12T00:03:29.337905+0000","last_unstale":"2024-09-12T00:07:38.332540+0000","last_undegraded":"2024-09-12T00:07:38.332540+0000","last_fullsized":"2024-09-12T00:07:38.332540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'33","last_scrub_stamp":"2024-09-12T00:07:38.332295+0000","last_deep_scrub":"116'33","last_deep_scrub_stamp":"2024-09-12T00:07:38.332295+0000","last_clean_scrub_stamp":"2024-09-12T00:07:38.332295+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:11.906256+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:37.898462+0000","last_change":"2024-09-12T00:07:37.898462+0000","last_active":"2024-09-12T00:07:37.898462+0000","last_peered":"2024-09-12T00:07:37.898462+0000","last_clean":"2024-09-12T00:07:37.898462+0000","last_became_active":"2024-09-12T00:03:31.350917+0000","last_became_peered":"2024-09-12T00:03:31.350917+0000","last_unstale":"2024-09-12T00:07:37.898462+0000","last_undegraded":"2024-09-12T00:07:37.898462+0000","last_fullsized":"2024-09-12T00:07:37.898462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:37.898185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:37.898185+0000","last_clean_scrub_stamp":"2024-09-12T00:07:37.898185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:18.111126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:43.895069+0000","last_change":"2024-09-12T00:07:43.895069+0000","last_active":"2024-09-12T00:07:43.895069+0000","last_peered":"2024-09-12T00:07:43.895069+0000","last_clean":"2024-09-12T00:07:43.895069+0000","last_became_active":"2024-09-12T00:03:33.373466+0000","last_became_peered":"2024-09-12T00:03:33.373466+0000","last_unstale":"2024-09-12T00:07:43.895069+0000","last_undegraded":"2024-09-12T00:07:43.895069+0000","last_fullsized":"2024-09-12T00:07:43.895069+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:43.894895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:43.894895+0000","last_clean_scrub_stamp":"2024-09-12T00:07:43.894895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:42.720403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"59'2","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.787660+0000","last_change":"2024-09-12T00:07:27.787660+0000","last_active":"2024-09-12T00:07:27.787660+0000","last_peered":"2024-09-12T00:07:27.787660+0000","last_clean":"2024-09-12T00:07:27.787660+0000","last_became_active":"2024-09-12T00:06:26.664003+0000","last_became_peered":"2024-09-12T00:06:26.664003+0000","last_unstale":"2024-09-12T00:07:27.787660+0000","last_undegraded":"2024-09-12T00:07:27.787660+0000","last_fullsized":"2024-09-12T00:07:27.787660+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:27.787370+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:27.787370+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.787370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:28.484493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"116'46","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:16.450064+0000","last_change":"2024-09-12T00:07:16.450064+0000","last_active":"2024-09-12T00:07:16.450064+0000","last_peered":"2024-09-12T00:07:16.450064+0000","last_clean":"2024-09-12T00:07:16.450064+0000","last_became_active":"2024-09-12T00:03:23.612941+0000","last_became_peered":"2024-09-12T00:03:23.612941+0000","last_unstale":"2024-09-12T00:07:16.450064+0000","last_undegraded":"2024-09-12T00:07:16.450064+0000","last_fullsized":"2024-09-12T00:07:16.450064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:16.449941+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:16.449941+0000","last_clean_scrub_stamp":"2024-09-12T00:07:16.449941+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:25.970740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:38.909624+0000","last_change":"2024-09-12T00:07:38.909624+0000","last_active":"2024-09-12T00:07:38.909624+0000","last_peered":"2024-09-12T00:07:38.909624+0000","last_clean":"2024-09-12T00:07:38.909624+0000","last_became_active":"2024-09-12T00:03:27.335372+0000","last_became_peered":"2024-09-12T00:03:27.335372+0000","last_unstale":"2024-09-12T00:07:38.909624+0000","last_undegraded":"2024-09-12T00:07:38.909624+0000","last_fullsized":"2024-09-12T00:07:38.909624+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:38.909430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:38.909430+0000","last_clean_scrub_stamp":"2024-09-12T00:07:38.909430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:28.391637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"116'14","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:43.892344+0000","last_change":"2024-09-12T00:07:43.892344+0000","last_active":"2024-09-12T00:07:43.892344+0000","last_peered":"2024-09-12T00:07:43.892344+0000","last_clean":"2024-09-12T00:07:43.892344+0000","last_became_active":"2024-09-12T00:03:29.331243+0000","last_became_peered":"2024-09-12T00:03:29.331243+0000","last_unstale":"2024-09-12T00:07:43.892344+0000","last_undegraded":"2024-09-12T00:07:43.892344+0000","last_fullsized":"2024-09-12T00:07:43.892344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-09-12T00:07:43.892156+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-09-12T00:07:43.892156+0000","last_clean_scrub_stamp":"2024-09-12T00:07:43.892156+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:36.535339+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:39.394008+0000","last_change":"2024-09-12T00:07:39.394008+0000","last_active":"2024-09-12T00:07:39.394008+0000","last_peered":"2024-09-12T00:07:39.394008+0000","last_clean":"2024-09-12T00:07:39.394008+0000","last_became_active":"2024-09-12T00:03:31.344407+0000","last_became_peered":"2024-09-12T00:03:31.344407+0000","last_unstale":"2024-09-12T00:07:39.394008+0000","last_undegraded":"2024-09-12T00:07:39.394008+0000","last_fullsized":"2024-09-12T00:07:39.394008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:39.393945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:39.393945+0000","last_clean_scrub_stamp":"2024-09-12T00:07:39.393945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:42.544058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"84'2","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:46.299318+0000","last_change":"2024-09-12T00:07:46.299318+0000","last_active":"2024-09-12T00:07:46.299318+0000","last_peered":"2024-09-12T00:07:46.299318+0000","last_clean":"2024-09-12T00:07:46.299318+0000","last_became_active":"2024-09-12T00:03:33.369538+0000","last_became_peered":"2024-09-12T00:03:33.369538+0000","last_unstale":"2024-09-12T00:07:46.299318+0000","last_undegraded":"2024-09-12T00:07:46.299318+0000","last_fullsized":"2024-09-12T00:07:46.299318+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-09-12T00:07:46.299105+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-09-12T00:07:46.299105+0000","last_clean_scrub_stamp":"2024-09-12T00:07:46.299105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:42.866475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"59'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.781068+0000","last_change":"2024-09-12T00:07:25.781068+0000","last_active":"2024-09-12T00:07:25.781068+0000","last_peered":"2024-09-12T00:07:25.781068+0000","last_clean":"2024-09-12T00:07:25.781068+0000","last_became_active":"2024-09-12T00:03:25.340288+0000","last_became_peered":"2024-09-12T00:03:25.340288+0000","last_unstale":"2024-09-12T00:07:25.781068+0000","last_undegraded":"2024-09-12T00:07:25.781068+0000","last_fullsized":"2024-09-12T00:07:25.781068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:25.780854+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:25.780854+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.780854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:28.930968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"116'56","reported_seq":365,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.230279+0000","last_change":"2024-09-12T00:07:21.230279+0000","last_active":"2024-09-12T00:07:21.230279+0000","last_peered":"2024-09-12T00:07:21.230279+0000","last_clean":"2024-09-12T00:07:21.230279+0000","last_became_active":"2024-09-12T00:06:26.672172+0000","last_became_peered":"2024-09-12T00:06:26.672172+0000","last_unstale":"2024-09-12T00:07:21.230279+0000","last_undegraded":"2024-09-12T00:07:21.230279+0000","last_fullsized":"2024-09-12T00:07:21.230279+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-09-12T00:07:21.230102+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-09-12T00:07:21.230102+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.230102+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:54.137708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":64,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:34.324322+0000","last_change":"2024-09-12T00:07:34.324322+0000","last_active":"2024-09-12T00:07:34.324322+0000","last_peered":"2024-09-12T00:07:34.324322+0000","last_clean":"2024-09-12T00:07:34.324322+0000","last_became_active":"2024-09-12T00:03:27.329077+0000","last_became_peered":"2024-09-12T00:03:27.329077+0000","last_unstale":"2024-09-12T00:07:34.324322+0000","last_undegraded":"2024-09-12T00:07:34.324322+0000","last_fullsized":"2024-09-12T00:07:34.324322+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:34.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:34.324126+0000","last_clean_scrub_stamp":"2024-09-12T00:07:34.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:12.915348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"116'26","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:34.854512+0000","last_change":"2024-09-12T00:07:34.854512+0000","last_active":"2024-09-12T00:07:34.854512+0000","last_peered":"2024-09-12T00:07:34.854512+0000","last_clean":"2024-09-12T00:07:34.854512+0000","last_became_active":"2024-09-12T00:03:29.345990+0000","last_became_peered":"2024-09-12T00:03:29.345990+0000","last_unstale":"2024-09-12T00:07:34.854512+0000","last_undegraded":"2024-09-12T00:07:34.854512+0000","last_fullsized":"2024-09-12T00:07:34.854512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-09-12T00:07:34.854323+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-09-12T00:07:34.854323+0000","last_clean_scrub_stamp":"2024-09-12T00:07:34.854323+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:02.320306+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:38.130402+0000","last_change":"2024-09-12T00:07:38.130402+0000","last_active":"2024-09-12T00:07:38.130402+0000","last_peered":"2024-09-12T00:07:38.130402+0000","last_clean":"2024-09-12T00:07:38.130402+0000","last_became_active":"2024-09-12T00:03:31.363080+0000","last_became_peered":"2024-09-12T00:03:31.363080+0000","last_unstale":"2024-09-12T00:07:38.130402+0000","last_undegraded":"2024-09-12T00:07:38.130402+0000","last_fullsized":"2024-09-12T00:07:38.130402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:38.130201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:38.130201+0000","last_clean_scrub_stamp":"2024-09-12T00:07:38.130201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:39.170146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.717550+0000","last_change":"2024-09-12T00:06:26.673691+0000","last_active":"2024-09-12T00:06:42.717550+0000","last_peered":"2024-09-12T00:06:42.717550+0000","last_clean":"2024-09-12T00:06:42.717550+0000","last_became_active":"2024-09-12T00:06:26.669877+0000","last_became_peered":"2024-09-12T00:06:26.669877+0000","last_unstale":"2024-09-12T00:06:42.717550+0000","last_undegraded":"2024-09-12T00:06:42.717550+0000","last_fullsized":"2024-09-12T00:06:42.717550+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:02.798560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"59'2","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.705703+0000","last_change":"2024-09-12T00:07:24.705703+0000","last_active":"2024-09-12T00:07:24.705703+0000","last_peered":"2024-09-12T00:07:24.705703+0000","last_clean":"2024-09-12T00:07:24.705703+0000","last_became_active":"2024-09-12T00:06:26.655483+0000","last_became_peered":"2024-09-12T00:06:26.655483+0000","last_unstale":"2024-09-12T00:07:24.705703+0000","last_undegraded":"2024-09-12T00:07:24.705703+0000","last_fullsized":"2024-09-12T00:07:24.705703+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:24.705412+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:24.705412+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.705412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:56.072009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"116'44","reported_seq":329,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.652983+0000","last_change":"2024-09-12T00:07:19.652983+0000","last_active":"2024-09-12T00:07:19.652983+0000","last_peered":"2024-09-12T00:07:19.652983+0000","last_clean":"2024-09-12T00:07:19.652983+0000","last_became_active":"2024-09-12T00:06:26.664617+0000","last_became_peered":"2024-09-12T00:06:26.664617+0000","last_unstale":"2024-09-12T00:07:19.652983+0000","last_undegraded":"2024-09-12T00:07:19.652983+0000","last_fullsized":"2024-09-12T00:07:19.652983+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-09-12T00:07:19.652771+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-09-12T00:07:19.652771+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.652771+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:28.003986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":142606336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:45.942082+0000","last_change":"2024-09-12T00:07:45.942082+0000","last_active":"2024-09-12T00:07:45.942082+0000","last_peered":"2024-09-12T00:07:45.942082+0000","last_clean":"2024-09-12T00:07:45.942082+0000","last_became_active":"2024-09-12T00:06:26.663351+0000","last_became_peered":"2024-09-12T00:06:26.663351+0000","last_unstale":"2024-09-12T00:07:45.942082+0000","last_undegraded":"2024-09-12T00:07:45.942082+0000","last_fullsized":"2024-09-12T00:07:45.942082+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:45.941887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:45.941887+0000","last_clean_scrub_stamp":"2024-09-12T00:07:45.941887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:41.491797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"116'26","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:42.346724+0000","last_change":"2024-09-12T00:07:42.346724+0000","last_active":"2024-09-12T00:07:42.346724+0000","last_peered":"2024-09-12T00:07:42.346724+0000","last_clean":"2024-09-12T00:07:42.346724+0000","last_became_active":"2024-09-12T00:03:29.345883+0000","last_became_peered":"2024-09-12T00:03:29.345883+0000","last_unstale":"2024-09-12T00:07:42.346724+0000","last_undegraded":"2024-09-12T00:07:42.346724+0000","last_fullsized":"2024-09-12T00:07:42.346724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-09-12T00:07:42.346526+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-09-12T00:07:42.346526+0000","last_clean_scrub_stamp":"2024-09-12T00:07:42.346526+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:54.278965+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:40.862660+0000","last_change":"2024-09-12T00:07:40.862660+0000","last_active":"2024-09-12T00:07:40.862660+0000","last_peered":"2024-09-12T00:07:40.862660+0000","last_clean":"2024-09-12T00:07:40.862660+0000","last_became_active":"2024-09-12T00:03:31.358011+0000","last_became_peered":"2024-09-12T00:03:31.358011+0000","last_unstale":"2024-09-12T00:07:40.862660+0000","last_undegraded":"2024-09-12T00:07:40.862660+0000","last_fullsized":"2024-09-12T00:07:40.862660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:40.862475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:40.862475+0000","last_clean_scrub_stamp":"2024-09-12T00:07:40.862475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:08.914336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"59'2","reported_seq":53,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:36.950768+0000","last_change":"2024-09-12T00:07:36.950768+0000","last_active":"2024-09-12T00:07:36.950768+0000","last_peered":"2024-09-12T00:07:36.950768+0000","last_clean":"2024-09-12T00:07:36.950768+0000","last_became_active":"2024-09-12T00:06:26.667552+0000","last_became_peered":"2024-09-12T00:06:26.667552+0000","last_unstale":"2024-09-12T00:07:36.950768+0000","last_undegraded":"2024-09-12T00:07:36.950768+0000","last_fullsized":"2024-09-12T00:07:36.950768+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:36.950569+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:36.950569+0000","last_clean_scrub_stamp":"2024-09-12T00:07:36.950569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:06.950587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"116'46","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.656949+0000","last_change":"2024-09-12T00:07:21.656949+0000","last_active":"2024-09-12T00:07:21.656949+0000","last_peered":"2024-09-12T00:07:21.656949+0000","last_clean":"2024-09-12T00:07:21.656949+0000","last_became_active":"2024-09-12T00:03:23.626026+0000","last_became_peered":"2024-09-12T00:03:23.626026+0000","last_unstale":"2024-09-12T00:07:21.656949+0000","last_undegraded":"2024-09-12T00:07:21.656949+0000","last_fullsized":"2024-09-12T00:07:21.656949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:21.656651+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:21.656651+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.656651+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:07.882339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:35.341367+0000","last_change":"2024-09-12T00:07:35.341367+0000","last_active":"2024-09-12T00:07:35.341367+0000","last_peered":"2024-09-12T00:07:35.341367+0000","last_clean":"2024-09-12T00:07:35.341367+0000","last_became_active":"2024-09-12T00:06:26.671427+0000","last_became_peered":"2024-09-12T00:06:26.671427+0000","last_unstale":"2024-09-12T00:07:35.341367+0000","last_undegraded":"2024-09-12T00:07:35.341367+0000","last_fullsized":"2024-09-12T00:07:35.341367+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:35.341183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:35.341183+0000","last_clean_scrub_stamp":"2024-09-12T00:07:35.341183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:59.040714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"116'45","reported_seq":261,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:40.321918+0000","last_change":"2024-09-12T00:07:40.321918+0000","last_active":"2024-09-12T00:07:40.321918+0000","last_peered":"2024-09-12T00:07:40.321918+0000","last_clean":"2024-09-12T00:07:40.321918+0000","last_became_active":"2024-09-12T00:03:29.339781+0000","last_became_peered":"2024-09-12T00:03:29.339781+0000","last_unstale":"2024-09-12T00:07:40.321918+0000","last_undegraded":"2024-09-12T00:07:40.321918+0000","last_fullsized":"2024-09-12T00:07:40.321918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'45","last_scrub_stamp":"2024-09-12T00:07:40.321724+0000","last_deep_scrub":"116'45","last_deep_scrub_stamp":"2024-09-12T00:07:40.321724+0000","last_clean_scrub_stamp":"2024-09-12T00:07:40.321724+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:12.366295+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:38.350919+0000","last_change":"2024-09-12T00:07:38.350919+0000","last_active":"2024-09-12T00:07:38.350919+0000","last_peered":"2024-09-12T00:07:38.350919+0000","last_clean":"2024-09-12T00:07:38.350919+0000","last_became_active":"2024-09-12T00:03:31.349591+0000","last_became_peered":"2024-09-12T00:03:31.349591+0000","last_unstale":"2024-09-12T00:07:38.350919+0000","last_undegraded":"2024-09-12T00:07:38.350919+0000","last_fullsized":"2024-09-12T00:07:38.350919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:38.350731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:38.350731+0000","last_clean_scrub_stamp":"2024-09-12T00:07:38.350731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:42.675337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"96'4","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.065021+0000","last_change":"2024-09-12T00:03:33.385028+0000","last_active":"2024-09-12T00:06:42.065021+0000","last_peered":"2024-09-12T00:06:42.065021+0000","last_clean":"2024-09-12T00:06:42.065021+0000","last_became_active":"2024-09-12T00:03:33.384274+0000","last_became_peered":"2024-09-12T00:03:33.384274+0000","last_unstale":"2024-09-12T00:06:42.065021+0000","last_undegraded":"2024-09-12T00:06:42.065021+0000","last_fullsized":"2024-09-12T00:06:42.065021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:11.634604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"58'2","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.736165+0000","last_change":"2024-09-12T00:07:29.736165+0000","last_active":"2024-09-12T00:07:29.736165+0000","last_peered":"2024-09-12T00:07:29.736165+0000","last_clean":"2024-09-12T00:07:29.736165+0000","last_became_active":"2024-09-12T00:03:25.329151+0000","last_became_peered":"2024-09-12T00:03:25.329151+0000","last_unstale":"2024-09-12T00:07:29.736165+0000","last_undegraded":"2024-09-12T00:07:29.736165+0000","last_fullsized":"2024-09-12T00:07:29.736165+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:29.735976+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:29.735976+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.735976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:05.059155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"116'50","reported_seq":252,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.759520+0000","last_change":"2024-09-12T00:07:22.759520+0000","last_active":"2024-09-12T00:07:22.759520+0000","last_peered":"2024-09-12T00:07:22.759520+0000","last_clean":"2024-09-12T00:07:22.759520+0000","last_became_active":"2024-09-12T00:03:23.598862+0000","last_became_peered":"2024-09-12T00:03:23.598862+0000","last_unstale":"2024-09-12T00:07:22.759520+0000","last_undegraded":"2024-09-12T00:07:22.759520+0000","last_fullsized":"2024-09-12T00:07:22.759520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'50","last_scrub_stamp":"2024-09-12T00:07:22.759337+0000","last_deep_scrub":"116'50","last_deep_scrub_stamp":"2024-09-12T00:07:22.759337+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.759337+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:53.269749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.188244+0000","last_change":"2024-09-12T00:07:24.188062+0000","last_active":"2024-09-12T00:07:24.188244+0000","last_peered":"2024-09-12T00:07:24.188244+0000","last_clean":"2024-09-12T00:07:24.188244+0000","last_became_active":"2024-09-12T00:03:27.340199+0000","last_became_peered":"2024-09-12T00:03:27.340199+0000","last_unstale":"2024-09-12T00:07:24.188244+0000","last_undegraded":"2024-09-12T00:07:24.188244+0000","last_fullsized":"2024-09-12T00:07:24.188244+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:24.187874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:24.187874+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.187874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:06.924717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"116'34","reported_seq":79,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:51.811632+0000","last_change":"2024-09-12T00:07:51.811632+0000","last_active":"2024-09-12T00:07:51.811632+0000","last_peered":"2024-09-12T00:07:51.811632+0000","last_clean":"2024-09-12T00:07:51.811632+0000","last_became_active":"2024-09-12T00:06:26.675513+0000","last_became_peered":"2024-09-12T00:06:26.675513+0000","last_unstale":"2024-09-12T00:07:51.811632+0000","last_undegraded":"2024-09-12T00:07:51.811632+0000","last_fullsized":"2024-09-12T00:07:51.811632+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'34","last_scrub_stamp":"2024-09-12T00:07:51.811379+0000","last_deep_scrub":"116'34","last_deep_scrub_stamp":"2024-09-12T00:07:51.811379+0000","last_clean_scrub_stamp":"2024-09-12T00:07:51.811379+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:13.604581+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:49.721610+0000","last_change":"2024-09-12T00:07:49.721610+0000","last_active":"2024-09-12T00:07:49.721610+0000","last_peered":"2024-09-12T00:07:49.721610+0000","last_clean":"2024-09-12T00:07:49.721610+0000","last_became_active":"2024-09-12T00:06:26.677049+0000","last_became_peered":"2024-09-12T00:06:26.677049+0000","last_unstale":"2024-09-12T00:07:49.721610+0000","last_undegraded":"2024-09-12T00:07:49.721610+0000","last_fullsized":"2024-09-12T00:07:49.721610+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:49.721342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:49.721342+0000","last_clean_scrub_stamp":"2024-09-12T00:07:49.721342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:42.639840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"59'3","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721092+0000","last_change":"2024-09-12T00:06:32.445889+0000","last_active":"2024-09-12T00:06:42.721092+0000","last_peered":"2024-09-12T00:06:42.721092+0000","last_clean":"2024-09-12T00:06:42.721092+0000","last_became_active":"2024-09-12T00:06:26.677859+0000","last_became_peered":"2024-09-12T00:06:26.677859+0000","last_unstale":"2024-09-12T00:06:42.721092+0000","last_undegraded":"2024-09-12T00:06:42.721092+0000","last_fullsized":"2024-09-12T00:06:42.721092+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:56.789846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"59'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.721417+0000","last_change":"2024-09-12T00:07:25.721417+0000","last_active":"2024-09-12T00:07:25.721417+0000","last_peered":"2024-09-12T00:07:25.721417+0000","last_clean":"2024-09-12T00:07:25.721417+0000","last_became_active":"2024-09-12T00:03:25.359682+0000","last_became_peered":"2024-09-12T00:03:25.359682+0000","last_unstale":"2024-09-12T00:07:25.721417+0000","last_undegraded":"2024-09-12T00:07:25.721417+0000","last_fullsized":"2024-09-12T00:07:25.721417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:25.721127+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:25.721127+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.721127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:50.850491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"116'40","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:16.004117+0000","last_change":"2024-09-12T00:07:16.004117+0000","last_active":"2024-09-12T00:07:16.004117+0000","last_peered":"2024-09-12T00:07:16.004117+0000","last_clean":"2024-09-12T00:07:16.004117+0000","last_became_active":"2024-09-12T00:03:23.620961+0000","last_became_peered":"2024-09-12T00:03:23.620961+0000","last_unstale":"2024-09-12T00:07:16.004117+0000","last_undegraded":"2024-09-12T00:07:16.004117+0000","last_fullsized":"2024-09-12T00:07:16.004117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-09-12T00:07:16.004043+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-09-12T00:07:16.004043+0000","last_clean_scrub_stamp":"2024-09-12T00:07:16.004043+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:26.391748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.228423+0000","last_change":"2024-09-12T00:07:26.228423+0000","last_active":"2024-09-12T00:07:26.228423+0000","last_peered":"2024-09-12T00:07:26.228423+0000","last_clean":"2024-09-12T00:07:26.228423+0000","last_became_active":"2024-09-12T00:03:27.336045+0000","last_became_peered":"2024-09-12T00:03:27.336045+0000","last_unstale":"2024-09-12T00:07:26.228423+0000","last_undegraded":"2024-09-12T00:07:26.228423+0000","last_fullsized":"2024-09-12T00:07:26.228423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:26.228243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:26.228243+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.228243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:14.331601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"116'33","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:41.307620+0000","last_change":"2024-09-12T00:07:41.307620+0000","last_active":"2024-09-12T00:07:41.307620+0000","last_peered":"2024-09-12T00:07:41.307620+0000","last_clean":"2024-09-12T00:07:41.307620+0000","last_became_active":"2024-09-12T00:03:29.338010+0000","last_became_peered":"2024-09-12T00:03:29.338010+0000","last_unstale":"2024-09-12T00:07:41.307620+0000","last_undegraded":"2024-09-12T00:07:41.307620+0000","last_fullsized":"2024-09-12T00:07:41.307620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'33","last_scrub_stamp":"2024-09-12T00:07:41.307367+0000","last_deep_scrub":"116'33","last_deep_scrub_stamp":"2024-09-12T00:07:41.307367+0000","last_clean_scrub_stamp":"2024-09-12T00:07:41.307367+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:38.867426+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:38.940683+0000","last_change":"2024-09-12T00:07:38.940683+0000","last_active":"2024-09-12T00:07:38.940683+0000","last_peered":"2024-09-12T00:07:38.940683+0000","last_clean":"2024-09-12T00:07:38.940683+0000","last_became_active":"2024-09-12T00:03:31.352143+0000","last_became_peered":"2024-09-12T00:03:31.352143+0000","last_unstale":"2024-09-12T00:07:38.940683+0000","last_undegraded":"2024-09-12T00:07:38.940683+0000","last_fullsized":"2024-09-12T00:07:38.940683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:38.940498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:38.940498+0000","last_clean_scrub_stamp":"2024-09-12T00:07:38.940498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:50.260484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"76'8","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721671+0000","last_change":"2024-09-12T00:06:27.901313+0000","last_active":"2024-09-12T00:06:42.721671+0000","last_peered":"2024-09-12T00:06:42.721671+0000","last_clean":"2024-09-12T00:06:42.721671+0000","last_became_active":"2024-09-12T00:06:26.658281+0000","last_became_peered":"2024-09-12T00:06:26.658281+0000","last_unstale":"2024-09-12T00:06:42.721671+0000","last_undegraded":"2024-09-12T00:06:42.721671+0000","last_fullsized":"2024-09-12T00:06:42.721671+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:54.959771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"58'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.747618+0000","last_change":"2024-09-12T00:07:28.747618+0000","last_active":"2024-09-12T00:07:28.747618+0000","last_peered":"2024-09-12T00:07:28.747618+0000","last_clean":"2024-09-12T00:07:28.747618+0000","last_became_active":"2024-09-12T00:03:25.324315+0000","last_became_peered":"2024-09-12T00:03:25.324315+0000","last_unstale":"2024-09-12T00:07:28.747618+0000","last_undegraded":"2024-09-12T00:07:28.747618+0000","last_fullsized":"2024-09-12T00:07:28.747618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:28.747422+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:28.747422+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.747422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:06.054923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"116'54","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.729740+0000","last_change":"2024-09-12T00:07:23.729740+0000","last_active":"2024-09-12T00:07:23.729740+0000","last_peered":"2024-09-12T00:07:23.729740+0000","last_clean":"2024-09-12T00:07:23.729740+0000","last_became_active":"2024-09-12T00:03:23.605402+0000","last_became_peered":"2024-09-12T00:03:23.605402+0000","last_unstale":"2024-09-12T00:07:23.729740+0000","last_undegraded":"2024-09-12T00:07:23.729740+0000","last_fullsized":"2024-09-12T00:07:23.729740+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'54","last_scrub_stamp":"2024-09-12T00:07:23.729552+0000","last_deep_scrub":"116'54","last_deep_scrub_stamp":"2024-09-12T00:07:23.729552+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.729552+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:20.296921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:40.929452+0000","last_change":"2024-09-12T00:07:40.929452+0000","last_active":"2024-09-12T00:07:40.929452+0000","last_peered":"2024-09-12T00:07:40.929452+0000","last_clean":"2024-09-12T00:07:40.929452+0000","last_became_active":"2024-09-12T00:03:27.335658+0000","last_became_peered":"2024-09-12T00:03:27.335658+0000","last_unstale":"2024-09-12T00:07:40.929452+0000","last_undegraded":"2024-09-12T00:07:40.929452+0000","last_fullsized":"2024-09-12T00:07:40.929452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:40.929284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:40.929284+0000","last_clean_scrub_stamp":"2024-09-12T00:07:40.929284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:20.817967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"35'16","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720503+0000","last_change":"2024-09-12T00:06:29.533440+0000","last_active":"2024-09-12T00:06:42.720503+0000","last_peered":"2024-09-12T00:06:42.720503+0000","last_clean":"2024-09-12T00:06:42.720503+0000","last_became_active":"2024-09-12T00:06:26.671893+0000","last_became_peered":"2024-09-12T00:06:26.671893+0000","last_unstale":"2024-09-12T00:06:42.720503+0000","last_undegraded":"2024-09-12T00:06:42.720503+0000","last_fullsized":"2024-09-12T00:06:42.720503+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:28.303877+0000","last_clean_scrub_stamp":"2024-09-12T00:03:28.303877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:10.667822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"116'138","reported_seq":366,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:37.380461+0000","last_change":"2024-09-12T00:07:37.380285+0000","last_active":"2024-09-12T00:07:37.380461+0000","last_peered":"2024-09-12T00:07:37.380461+0000","last_clean":"2024-09-12T00:07:37.380461+0000","last_became_active":"2024-09-12T00:03:31.350925+0000","last_became_peered":"2024-09-12T00:03:31.350925+0000","last_unstale":"2024-09-12T00:07:37.380461+0000","last_undegraded":"2024-09-12T00:07:37.380461+0000","last_fullsized":"2024-09-12T00:07:37.380461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-09-12T00:07:37.380093+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-09-12T00:07:37.380093+0000","last_clean_scrub_stamp":"2024-09-12T00:07:37.380093+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:10.515743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.719766+0000","last_change":"2024-09-12T00:06:26.675599+0000","last_active":"2024-09-12T00:06:42.719766+0000","last_peered":"2024-09-12T00:06:42.719766+0000","last_clean":"2024-09-12T00:06:42.719766+0000","last_became_active":"2024-09-12T00:06:26.675234+0000","last_became_peered":"2024-09-12T00:06:26.675234+0000","last_unstale":"2024-09-12T00:06:42.719766+0000","last_undegraded":"2024-09-12T00:06:42.719766+0000","last_fullsized":"2024-09-12T00:06:42.719766+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:28.887412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"59'4","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.258770+0000","last_change":"2024-09-12T00:07:27.258770+0000","last_active":"2024-09-12T00:07:27.258770+0000","last_peered":"2024-09-12T00:07:27.258770+0000","last_clean":"2024-09-12T00:07:27.258770+0000","last_became_active":"2024-09-12T00:03:25.357623+0000","last_became_peered":"2024-09-12T00:03:25.357623+0000","last_unstale":"2024-09-12T00:07:27.258770+0000","last_undegraded":"2024-09-12T00:07:27.258770+0000","last_fullsized":"2024-09-12T00:07:27.258770+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'4","last_scrub_stamp":"2024-09-12T00:07:27.258578+0000","last_deep_scrub":"59'4","last_deep_scrub_stamp":"2024-09-12T00:07:27.258578+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.258578+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:50.958109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"116'58","reported_seq":262,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:17.048519+0000","last_change":"2024-09-12T00:07:17.048519+0000","last_active":"2024-09-12T00:07:17.048519+0000","last_peered":"2024-09-12T00:07:17.048519+0000","last_clean":"2024-09-12T00:07:17.048519+0000","last_became_active":"2024-09-12T00:03:23.604773+0000","last_became_peered":"2024-09-12T00:03:23.604773+0000","last_unstale":"2024-09-12T00:07:17.048519+0000","last_undegraded":"2024-09-12T00:07:17.048519+0000","last_fullsized":"2024-09-12T00:07:17.048519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'58","last_scrub_stamp":"2024-09-12T00:07:17.048376+0000","last_deep_scrub":"116'58","last_deep_scrub_stamp":"2024-09-12T00:07:17.048376+0000","last_clean_scrub_stamp":"2024-09-12T00:07:17.048376+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:12.012361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:36.044064+0000","last_change":"2024-09-12T00:07:36.044064+0000","last_active":"2024-09-12T00:07:36.044064+0000","last_peered":"2024-09-12T00:07:36.044064+0000","last_clean":"2024-09-12T00:07:36.044064+0000","last_became_active":"2024-09-12T00:03:27.346168+0000","last_became_peered":"2024-09-12T00:03:27.346168+0000","last_unstale":"2024-09-12T00:07:36.044064+0000","last_undegraded":"2024-09-12T00:07:36.044064+0000","last_fullsized":"2024-09-12T00:07:36.044064+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:36.043867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:36.043867+0000","last_clean_scrub_stamp":"2024-09-12T00:07:36.043867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:44.893673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"116'62","reported_seq":292,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:36.393614+0000","last_change":"2024-09-12T00:07:36.393614+0000","last_active":"2024-09-12T00:07:36.393614+0000","last_peered":"2024-09-12T00:07:36.393614+0000","last_clean":"2024-09-12T00:07:36.393614+0000","last_became_active":"2024-09-12T00:03:29.343238+0000","last_became_peered":"2024-09-12T00:03:29.343238+0000","last_unstale":"2024-09-12T00:07:36.393614+0000","last_undegraded":"2024-09-12T00:07:36.393614+0000","last_fullsized":"2024-09-12T00:07:36.393614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'62","last_scrub_stamp":"2024-09-12T00:07:36.393407+0000","last_deep_scrub":"116'62","last_deep_scrub_stamp":"2024-09-12T00:07:36.393407+0000","last_clean_scrub_stamp":"2024-09-12T00:07:36.393407+0000","objects_scrubbed":11,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:32.562644+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":68,"num_read_kb":55,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:51.926522+0000","last_change":"2024-09-12T00:07:51.926522+0000","last_active":"2024-09-12T00:07:51.926522+0000","last_peered":"2024-09-12T00:07:51.926522+0000","last_clean":"2024-09-12T00:07:51.926522+0000","last_became_active":"2024-09-12T00:06:26.654187+0000","last_became_peered":"2024-09-12T00:06:26.654187+0000","last_unstale":"2024-09-12T00:07:51.926522+0000","last_undegraded":"2024-09-12T00:07:51.926522+0000","last_fullsized":"2024-09-12T00:07:51.926522+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:51.926341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:51.926341+0000","last_clean_scrub_stamp":"2024-09-12T00:07:51.926341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:49.620936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:43.166136+0000","last_change":"2024-09-12T00:07:43.166136+0000","last_active":"2024-09-12T00:07:43.166136+0000","last_peered":"2024-09-12T00:07:43.166136+0000","last_clean":"2024-09-12T00:07:43.166136+0000","last_became_active":"2024-09-12T00:03:33.360672+0000","last_became_peered":"2024-09-12T00:03:33.360672+0000","last_unstale":"2024-09-12T00:07:43.166136+0000","last_undegraded":"2024-09-12T00:07:43.166136+0000","last_fullsized":"2024-09-12T00:07:43.166136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:43.165973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:43.165973+0000","last_clean_scrub_stamp":"2024-09-12T00:07:43.165973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:11.670588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"59'4","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.218379+0000","last_change":"2024-09-12T00:07:25.218379+0000","last_active":"2024-09-12T00:07:25.218379+0000","last_peered":"2024-09-12T00:07:25.218379+0000","last_clean":"2024-09-12T00:07:25.218379+0000","last_became_active":"2024-09-12T00:03:25.336095+0000","last_became_peered":"2024-09-12T00:03:25.336095+0000","last_unstale":"2024-09-12T00:07:25.218379+0000","last_undegraded":"2024-09-12T00:07:25.218379+0000","last_fullsized":"2024-09-12T00:07:25.218379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'4","last_scrub_stamp":"2024-09-12T00:07:25.218086+0000","last_deep_scrub":"59'4","last_deep_scrub_stamp":"2024-09-12T00:07:25.218086+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.218086+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:20.441811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"116'52","reported_seq":129,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.998780+0000","last_change":"2024-09-12T00:07:28.998780+0000","last_active":"2024-09-12T00:07:28.998780+0000","last_peered":"2024-09-12T00:07:28.998780+0000","last_clean":"2024-09-12T00:07:28.998780+0000","last_became_active":"2024-09-12T00:06:26.678646+0000","last_became_peered":"2024-09-12T00:06:26.678646+0000","last_unstale":"2024-09-12T00:07:28.998780+0000","last_undegraded":"2024-09-12T00:07:28.998780+0000","last_fullsized":"2024-09-12T00:07:28.998780+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'52","last_scrub_stamp":"2024-09-12T00:07:28.998593+0000","last_deep_scrub":"116'52","last_deep_scrub_stamp":"2024-09-12T00:07:28.998593+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.998593+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:22.996025+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":192937984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.309762+0000","last_change":"2024-09-12T00:07:31.309762+0000","last_active":"2024-09-12T00:07:31.309762+0000","last_peered":"2024-09-12T00:07:31.309762+0000","last_clean":"2024-09-12T00:07:31.309762+0000","last_became_active":"2024-09-12T00:03:27.325336+0000","last_became_peered":"2024-09-12T00:03:27.325336+0000","last_unstale":"2024-09-12T00:07:31.309762+0000","last_undegraded":"2024-09-12T00:07:31.309762+0000","last_fullsized":"2024-09-12T00:07:31.309762+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:31.309585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:31.309585+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.309585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:03.354156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"116'31","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:47.934189+0000","last_change":"2024-09-12T00:07:47.934189+0000","last_active":"2024-09-12T00:07:47.934189+0000","last_peered":"2024-09-12T00:07:47.934189+0000","last_clean":"2024-09-12T00:07:47.934189+0000","last_became_active":"2024-09-12T00:03:29.335186+0000","last_became_peered":"2024-09-12T00:03:29.335186+0000","last_unstale":"2024-09-12T00:07:47.934189+0000","last_undegraded":"2024-09-12T00:07:47.934189+0000","last_fullsized":"2024-09-12T00:07:47.934189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'31","last_scrub_stamp":"2024-09-12T00:07:47.933984+0000","last_deep_scrub":"116'31","last_deep_scrub_stamp":"2024-09-12T00:07:47.933984+0000","last_clean_scrub_stamp":"2024-09-12T00:07:47.933984+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:21.597423+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721804+0000","last_change":"2024-09-12T00:06:26.671154+0000","last_active":"2024-09-12T00:06:42.721804+0000","last_peered":"2024-09-12T00:06:42.721804+0000","last_clean":"2024-09-12T00:06:42.721804+0000","last_became_active":"2024-09-12T00:06:26.667486+0000","last_became_peered":"2024-09-12T00:06:26.667486+0000","last_unstale":"2024-09-12T00:06:42.721804+0000","last_undegraded":"2024-09-12T00:06:42.721804+0000","last_fullsized":"2024-09-12T00:06:42.721804+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:31.291883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.066037+0000","last_change":"2024-09-12T00:03:33.385037+0000","last_active":"2024-09-12T00:06:42.066037+0000","last_peered":"2024-09-12T00:06:42.066037+0000","last_clean":"2024-09-12T00:06:42.066037+0000","last_became_active":"2024-09-12T00:03:33.384379+0000","last_became_peered":"2024-09-12T00:03:33.384379+0000","last_unstale":"2024-09-12T00:06:42.066037+0000","last_undegraded":"2024-09-12T00:06:42.066037+0000","last_fullsized":"2024-09-12T00:06:42.066037+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:00.153475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"96'10","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.747972+0000","last_change":"2024-09-12T00:07:23.747972+0000","last_active":"2024-09-12T00:07:23.747972+0000","last_peered":"2024-09-12T00:07:23.747972+0000","last_clean":"2024-09-12T00:07:23.747972+0000","last_became_active":"2024-09-12T00:03:25.338417+0000","last_became_peered":"2024-09-12T00:03:25.338417+0000","last_unstale":"2024-09-12T00:07:23.747972+0000","last_undegraded":"2024-09-12T00:07:23.747972+0000","last_fullsized":"2024-09-12T00:07:23.747972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'10","last_scrub_stamp":"2024-09-12T00:07:23.747776+0000","last_deep_scrub":"96'10","last_deep_scrub_stamp":"2024-09-12T00:07:23.747776+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.747776+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:17.423244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"116'62","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.626384+0000","last_change":"2024-09-12T00:07:22.626131+0000","last_active":"2024-09-12T00:07:22.626384+0000","last_peered":"2024-09-12T00:07:22.626384+0000","last_clean":"2024-09-12T00:07:22.626384+0000","last_became_active":"2024-09-12T00:03:23.621654+0000","last_became_peered":"2024-09-12T00:03:23.621654+0000","last_unstale":"2024-09-12T00:07:22.626384+0000","last_undegraded":"2024-09-12T00:07:22.626384+0000","last_fullsized":"2024-09-12T00:07:22.626384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'62","last_scrub_stamp":"2024-09-12T00:07:22.625894+0000","last_deep_scrub":"116'62","last_deep_scrub_stamp":"2024-09-12T00:07:22.625894+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.625894+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:35.984413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:39.150153+0000","last_change":"2024-09-12T00:07:39.150153+0000","last_active":"2024-09-12T00:07:39.150153+0000","last_peered":"2024-09-12T00:07:39.150153+0000","last_clean":"2024-09-12T00:07:39.150153+0000","last_became_active":"2024-09-12T00:03:27.329713+0000","last_became_peered":"2024-09-12T00:03:27.329713+0000","last_unstale":"2024-09-12T00:07:39.150153+0000","last_undegraded":"2024-09-12T00:07:39.150153+0000","last_fullsized":"2024-09-12T00:07:39.150153+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:39.149865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:39.149865+0000","last_clean_scrub_stamp":"2024-09-12T00:07:39.149865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:11.194436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"116'24","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:39.305787+0000","last_change":"2024-09-12T00:07:39.305787+0000","last_active":"2024-09-12T00:07:39.305787+0000","last_peered":"2024-09-12T00:07:39.305787+0000","last_clean":"2024-09-12T00:07:39.305787+0000","last_became_active":"2024-09-12T00:03:29.335440+0000","last_became_peered":"2024-09-12T00:03:29.335440+0000","last_unstale":"2024-09-12T00:07:39.305787+0000","last_undegraded":"2024-09-12T00:07:39.305787+0000","last_fullsized":"2024-09-12T00:07:39.305787+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'24","last_scrub_stamp":"2024-09-12T00:07:39.305608+0000","last_deep_scrub":"116'24","last_deep_scrub_stamp":"2024-09-12T00:07:39.305608+0000","last_clean_scrub_stamp":"2024-09-12T00:07:39.305608+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:51.527864+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":21,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":41,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.721524+0000","last_change":"2024-09-12T00:06:26.674200+0000","last_active":"2024-09-12T00:06:42.721524+0000","last_peered":"2024-09-12T00:06:42.721524+0000","last_clean":"2024-09-12T00:06:42.721524+0000","last_became_active":"2024-09-12T00:06:26.660173+0000","last_became_peered":"2024-09-12T00:06:26.660173+0000","last_unstale":"2024-09-12T00:06:42.721524+0000","last_undegraded":"2024-09-12T00:06:42.721524+0000","last_fullsized":"2024-09-12T00:06:42.721524+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:30.310903+0000","last_clean_scrub_stamp":"2024-09-12T00:03:30.310903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:56.674961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"58'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:06:42.720918+0000","last_change":"2024-09-12T00:06:32.449370+0000","last_active":"2024-09-12T00:06:42.720918+0000","last_peered":"2024-09-12T00:06:42.720918+0000","last_clean":"2024-09-12T00:06:42.720918+0000","last_became_active":"2024-09-12T00:06:26.677210+0000","last_became_peered":"2024-09-12T00:06:26.677210+0000","last_unstale":"2024-09-12T00:06:42.720918+0000","last_undegraded":"2024-09-12T00:06:42.720918+0000","last_fullsized":"2024-09-12T00:06:42.720918+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:03:32.330915+0000","last_clean_scrub_stamp":"2024-09-12T00:03:32.330915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:13.086869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"96'4","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.334645+0000","last_change":"2024-09-12T00:07:29.334645+0000","last_active":"2024-09-12T00:07:29.334645+0000","last_peered":"2024-09-12T00:07:29.334645+0000","last_clean":"2024-09-12T00:07:29.334645+0000","last_became_active":"2024-09-12T00:03:25.337237+0000","last_became_peered":"2024-09-12T00:03:25.337237+0000","last_unstale":"2024-09-12T00:07:29.334645+0000","last_undegraded":"2024-09-12T00:07:29.334645+0000","last_fullsized":"2024-09-12T00:07:29.334645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'4","last_scrub_stamp":"2024-09-12T00:07:29.334417+0000","last_deep_scrub":"96'4","last_deep_scrub_stamp":"2024-09-12T00:07:29.334417+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.334417+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:38.184224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"116'58","reported_seq":260,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.585293+0000","last_change":"2024-09-12T00:07:23.585065+0000","last_active":"2024-09-12T00:07:23.585293+0000","last_peered":"2024-09-12T00:07:23.585293+0000","last_clean":"2024-09-12T00:07:23.585293+0000","last_became_active":"2024-09-12T00:03:23.630928+0000","last_became_peered":"2024-09-12T00:03:23.630928+0000","last_unstale":"2024-09-12T00:07:23.585293+0000","last_undegraded":"2024-09-12T00:07:23.585293+0000","last_fullsized":"2024-09-12T00:07:23.585293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'58","last_scrub_stamp":"2024-09-12T00:07:23.584838+0000","last_deep_scrub":"116'58","last_deep_scrub_stamp":"2024-09-12T00:07:23.584838+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.584838+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:27.637020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"116'2","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:39.891516+0000","last_change":"2024-09-12T00:07:39.891516+0000","last_active":"2024-09-12T00:07:39.891516+0000","last_peered":"2024-09-12T00:07:39.891516+0000","last_clean":"2024-09-12T00:07:39.891516+0000","last_became_active":"2024-09-12T00:06:26.651342+0000","last_became_peered":"2024-09-12T00:06:26.651342+0000","last_unstale":"2024-09-12T00:07:39.891516+0000","last_undegraded":"2024-09-12T00:07:39.891516+0000","last_fullsized":"2024-09-12T00:07:39.891516+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-09-12T00:07:39.891330+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-09-12T00:07:39.891330+0000","last_clean_scrub_stamp":"2024-09-12T00:07:39.891330+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:22.255275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"116'38","reported_seq":76,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:50.816222+0000","last_change":"2024-09-12T00:07:50.816222+0000","last_active":"2024-09-12T00:07:50.816222+0000","last_peered":"2024-09-12T00:07:50.816222+0000","last_clean":"2024-09-12T00:07:50.816222+0000","last_became_active":"2024-09-12T00:06:26.680856+0000","last_became_peered":"2024-09-12T00:06:26.680856+0000","last_unstale":"2024-09-12T00:07:50.816222+0000","last_undegraded":"2024-09-12T00:07:50.816222+0000","last_fullsized":"2024-09-12T00:07:50.816222+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'38","last_scrub_stamp":"2024-09-12T00:07:50.816023+0000","last_deep_scrub":"116'38","last_deep_scrub_stamp":"2024-09-12T00:07:50.816023+0000","last_clean_scrub_stamp":"2024-09-12T00:07:50.816023+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:20.751293+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":32,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:50.950114+0000","last_change":"2024-09-12T00:07:50.950114+0000","last_active":"2024-09-12T00:07:50.950114+0000","last_peered":"2024-09-12T00:07:50.950114+0000","last_clean":"2024-09-12T00:07:50.950114+0000","last_became_active":"2024-09-12T00:03:31.354506+0000","last_became_peered":"2024-09-12T00:03:31.354506+0000","last_unstale":"2024-09-12T00:07:50.950114+0000","last_undegraded":"2024-09-12T00:07:50.950114+0000","last_fullsized":"2024-09-12T00:07:50.950114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:50.949932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:50.949932+0000","last_clean_scrub_stamp":"2024-09-12T00:07:50.949932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:23.425010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"116'2","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:41.392736+0000","last_change":"2024-09-12T00:07:41.392736+0000","last_active":"2024-09-12T00:07:41.392736+0000","last_peered":"2024-09-12T00:07:41.392736+0000","last_clean":"2024-09-12T00:07:41.392736+0000","last_became_active":"2024-09-12T00:03:33.383358+0000","last_became_peered":"2024-09-12T00:03:33.383358+0000","last_unstale":"2024-09-12T00:07:41.392736+0000","last_undegraded":"2024-09-12T00:07:41.392736+0000","last_fullsized":"2024-09-12T00:07:41.392736+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-09-12T00:07:41.392528+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-09-12T00:07:41.392528+0000","last_clean_scrub_stamp":"2024-09-12T00:07:41.392528+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:46.461274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"84'4","reported_seq":240,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.733467+0000","last_change":"2024-09-12T00:07:30.733278+0000","last_active":"2024-09-12T00:07:30.733467+0000","last_peered":"2024-09-12T00:07:30.733467+0000","last_clean":"2024-09-12T00:07:30.733467+0000","last_became_active":"2024-09-12T00:06:26.664077+0000","last_became_peered":"2024-09-12T00:06:26.664077+0000","last_unstale":"2024-09-12T00:07:30.733467+0000","last_undegraded":"2024-09-12T00:07:30.733467+0000","last_fullsized":"2024-09-12T00:07:30.733467+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-09-12T00:07:30.733079+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-09-12T00:07:30.733079+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.733079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:38.628999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"116'62","reported_seq":265,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.185071+0000","last_change":"2024-09-12T00:07:20.184905+0000","last_active":"2024-09-12T00:07:20.185071+0000","last_peered":"2024-09-12T00:07:20.185071+0000","last_clean":"2024-09-12T00:07:20.185071+0000","last_became_active":"2024-09-12T00:03:23.617138+0000","last_became_peered":"2024-09-12T00:03:23.617138+0000","last_unstale":"2024-09-12T00:07:20.185071+0000","last_undegraded":"2024-09-12T00:07:20.185071+0000","last_fullsized":"2024-09-12T00:07:20.185071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'62","last_scrub_stamp":"2024-09-12T00:07:20.184692+0000","last_deep_scrub":"116'62","last_deep_scrub_stamp":"2024-09-12T00:07:20.184692+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.184692+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:00.138081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":124928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"59'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.714457+0000","last_change":"2024-09-12T00:07:26.714266+0000","last_active":"2024-09-12T00:07:26.714457+0000","last_peered":"2024-09-12T00:07:26.714457+0000","last_clean":"2024-09-12T00:07:26.714457+0000","last_became_active":"2024-09-12T00:03:25.334965+0000","last_became_peered":"2024-09-12T00:03:25.334965+0000","last_unstale":"2024-09-12T00:07:26.714457+0000","last_undegraded":"2024-09-12T00:07:26.714457+0000","last_fullsized":"2024-09-12T00:07:26.714457+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:26.714060+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:26.714060+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.714060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:37.101765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"116'52","reported_seq":254,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.829069+0000","last_change":"2024-09-12T00:07:20.828928+0000","last_active":"2024-09-12T00:07:20.829069+0000","last_peered":"2024-09-12T00:07:20.829069+0000","last_clean":"2024-09-12T00:07:20.829069+0000","last_became_active":"2024-09-12T00:03:23.612542+0000","last_became_peered":"2024-09-12T00:03:23.612542+0000","last_unstale":"2024-09-12T00:07:20.829069+0000","last_undegraded":"2024-09-12T00:07:20.829069+0000","last_fullsized":"2024-09-12T00:07:20.829069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'52","last_scrub_stamp":"2024-09-12T00:07:20.828733+0000","last_deep_scrub":"116'52","last_deep_scrub_stamp":"2024-09-12T00:07:20.828733+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.828733+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:06.289598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"96'4","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:39.967633+0000","last_change":"2024-09-12T00:07:39.967633+0000","last_active":"2024-09-12T00:07:39.967633+0000","last_peered":"2024-09-12T00:07:39.967633+0000","last_clean":"2024-09-12T00:07:39.967633+0000","last_became_active":"2024-09-12T00:06:26.677698+0000","last_became_peered":"2024-09-12T00:06:26.677698+0000","last_unstale":"2024-09-12T00:07:39.967633+0000","last_undegraded":"2024-09-12T00:07:39.967633+0000","last_fullsized":"2024-09-12T00:07:39.967633+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'4","last_scrub_stamp":"2024-09-12T00:07:39.967413+0000","last_deep_scrub":"96'4","last_deep_scrub_stamp":"2024-09-12T00:07:39.967413+0000","last_clean_scrub_stamp":"2024-09-12T00:07:39.967413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:18.133437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"116'60","reported_seq":141,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.952705+0000","last_change":"2024-09-12T00:07:27.952705+0000","last_active":"2024-09-12T00:07:27.952705+0000","last_peered":"2024-09-12T00:07:27.952705+0000","last_clean":"2024-09-12T00:07:27.952705+0000","last_became_active":"2024-09-12T00:06:26.666582+0000","last_became_peered":"2024-09-12T00:06:26.666582+0000","last_unstale":"2024-09-12T00:07:27.952705+0000","last_undegraded":"2024-09-12T00:07:27.952705+0000","last_fullsized":"2024-09-12T00:07:27.952705+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'60","last_scrub_stamp":"2024-09-12T00:07:27.952522+0000","last_deep_scrub":"116'60","last_deep_scrub_stamp":"2024-09-12T00:07:27.952522+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.952522+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:37.239950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":201326592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"63'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:37.733249+0000","last_change":"2024-09-12T00:07:37.732976+0000","last_active":"2024-09-12T00:07:37.733249+0000","last_peered":"2024-09-12T00:07:37.733249+0000","last_clean":"2024-09-12T00:07:37.733249+0000","last_became_active":"2024-09-12T00:03:25.352319+0000","last_became_peered":"2024-09-12T00:03:25.352319+0000","last_unstale":"2024-09-12T00:07:37.733249+0000","last_undegraded":"2024-09-12T00:07:37.733249+0000","last_fullsized":"2024-09-12T00:07:37.733249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-09-12T00:07:37.732654+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-09-12T00:07:37.732654+0000","last_clean_scrub_stamp":"2024-09-12T00:07:37.732654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:01.880330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"116'34","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.557672+0000","last_change":"2024-09-12T00:07:24.557514+0000","last_active":"2024-09-12T00:07:24.557672+0000","last_peered":"2024-09-12T00:07:24.557672+0000","last_clean":"2024-09-12T00:07:24.557672+0000","last_became_active":"2024-09-12T00:03:23.632850+0000","last_became_peered":"2024-09-12T00:03:23.632850+0000","last_unstale":"2024-09-12T00:07:24.557672+0000","last_undegraded":"2024-09-12T00:07:24.557672+0000","last_fullsized":"2024-09-12T00:07:24.557672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'34","last_scrub_stamp":"2024-09-12T00:07:24.557338+0000","last_deep_scrub":"116'34","last_deep_scrub_stamp":"2024-09-12T00:07:24.557338+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.557338+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:57.802661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"84'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:35.696302+0000","last_change":"2024-09-12T00:07:35.696058+0000","last_active":"2024-09-12T00:07:35.696302+0000","last_peered":"2024-09-12T00:07:35.696302+0000","last_clean":"2024-09-12T00:07:35.696302+0000","last_became_active":"2024-09-12T00:03:25.353815+0000","last_became_peered":"2024-09-12T00:03:25.353815+0000","last_unstale":"2024-09-12T00:07:35.696302+0000","last_undegraded":"2024-09-12T00:07:35.696302+0000","last_fullsized":"2024-09-12T00:07:35.696302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-09-12T00:07:35.695734+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-09-12T00:07:35.695734+0000","last_clean_scrub_stamp":"2024-09-12T00:07:35.695734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:42.608019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"116'42","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.379617+0000","last_change":"2024-09-12T00:07:21.379467+0000","last_active":"2024-09-12T00:07:21.379617+0000","last_peered":"2024-09-12T00:07:21.379617+0000","last_clean":"2024-09-12T00:07:21.379617+0000","last_became_active":"2024-09-12T00:03:23.608101+0000","last_became_peered":"2024-09-12T00:03:23.608101+0000","last_unstale":"2024-09-12T00:07:21.379617+0000","last_undegraded":"2024-09-12T00:07:21.379617+0000","last_fullsized":"2024-09-12T00:07:21.379617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-09-12T00:07:21.379278+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-09-12T00:07:21.379278+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.379278+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:12.681228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":50,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"96'10","reported_seq":277,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.334457+0000","last_change":"2024-09-12T00:07:27.334265+0000","last_active":"2024-09-12T00:07:27.334457+0000","last_peered":"2024-09-12T00:07:27.334457+0000","last_clean":"2024-09-12T00:07:27.334457+0000","last_became_active":"2024-09-12T00:06:26.681882+0000","last_became_peered":"2024-09-12T00:06:26.681882+0000","last_unstale":"2024-09-12T00:07:27.334457+0000","last_undegraded":"2024-09-12T00:07:27.334457+0000","last_fullsized":"2024-09-12T00:07:27.334457+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'10","last_scrub_stamp":"2024-09-12T00:07:27.334077+0000","last_deep_scrub":"96'10","last_deep_scrub_stamp":"2024-09-12T00:07:27.334077+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.334077+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:36.726266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"116'50","reported_seq":255,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.404802+0000","last_change":"2024-09-12T00:07:22.404633+0000","last_active":"2024-09-12T00:07:22.404802+0000","last_peered":"2024-09-12T00:07:22.404802+0000","last_clean":"2024-09-12T00:07:22.404802+0000","last_became_active":"2024-09-12T00:03:23.615970+0000","last_became_peered":"2024-09-12T00:03:23.615970+0000","last_unstale":"2024-09-12T00:07:22.404802+0000","last_undegraded":"2024-09-12T00:07:22.404802+0000","last_fullsized":"2024-09-12T00:07:22.404802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'50","last_scrub_stamp":"2024-09-12T00:07:22.404446+0000","last_deep_scrub":"116'50","last_deep_scrub_stamp":"2024-09-12T00:07:22.404446+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.404446+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:57.242577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":58,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"63'8","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.415975+0000","last_change":"2024-09-12T00:07:30.415697+0000","last_active":"2024-09-12T00:07:30.415975+0000","last_peered":"2024-09-12T00:07:30.415975+0000","last_clean":"2024-09-12T00:07:30.415975+0000","last_became_active":"2024-09-12T00:03:25.342930+0000","last_became_peered":"2024-09-12T00:03:25.342930+0000","last_unstale":"2024-09-12T00:07:30.415975+0000","last_undegraded":"2024-09-12T00:07:30.415975+0000","last_fullsized":"2024-09-12T00:07:30.415975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'8","last_scrub_stamp":"2024-09-12T00:07:30.415464+0000","last_deep_scrub":"63'8","last_deep_scrub_stamp":"2024-09-12T00:07:30.415464+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.415464+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:41.735451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"116'50","reported_seq":355,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.332647+0000","last_change":"2024-09-12T00:07:30.332514+0000","last_active":"2024-09-12T00:07:30.332647+0000","last_peered":"2024-09-12T00:07:30.332647+0000","last_clean":"2024-09-12T00:07:30.332647+0000","last_became_active":"2024-09-12T00:06:26.672080+0000","last_became_peered":"2024-09-12T00:06:26.672080+0000","last_unstale":"2024-09-12T00:07:30.332647+0000","last_undegraded":"2024-09-12T00:07:30.332647+0000","last_fullsized":"2024-09-12T00:07:30.332647+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'50","last_scrub_stamp":"2024-09-12T00:07:30.332323+0000","last_deep_scrub":"116'50","last_deep_scrub_stamp":"2024-09-12T00:07:30.332323+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.332323+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:10.469784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"96'10","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.101544+0000","last_change":"2024-09-12T00:07:23.101396+0000","last_active":"2024-09-12T00:07:23.101544+0000","last_peered":"2024-09-12T00:07:23.101544+0000","last_clean":"2024-09-12T00:07:23.101544+0000","last_became_active":"2024-09-12T00:03:25.326262+0000","last_became_peered":"2024-09-12T00:03:25.326262+0000","last_unstale":"2024-09-12T00:07:23.101544+0000","last_undegraded":"2024-09-12T00:07:23.101544+0000","last_fullsized":"2024-09-12T00:07:23.101544+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'10","last_scrub_stamp":"2024-09-12T00:07:23.101205+0000","last_deep_scrub":"96'10","last_deep_scrub_stamp":"2024-09-12T00:07:23.101205+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.101205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:05.106323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"116'32","reported_seq":234,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.566988+0000","last_change":"2024-09-12T00:07:25.566823+0000","last_active":"2024-09-12T00:07:25.566988+0000","last_peered":"2024-09-12T00:07:25.566988+0000","last_clean":"2024-09-12T00:07:25.566988+0000","last_became_active":"2024-09-12T00:03:23.631510+0000","last_became_peered":"2024-09-12T00:03:23.631510+0000","last_unstale":"2024-09-12T00:07:25.566988+0000","last_undegraded":"2024-09-12T00:07:25.566988+0000","last_fullsized":"2024-09-12T00:07:25.566988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-09-12T00:07:25.566638+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-09-12T00:07:25.566638+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.566638+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:24.452852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"58'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.798915+0000","last_change":"2024-09-12T00:07:28.798915+0000","last_active":"2024-09-12T00:07:28.798915+0000","last_peered":"2024-09-12T00:07:28.798915+0000","last_clean":"2024-09-12T00:07:28.798915+0000","last_became_active":"2024-09-12T00:03:25.337834+0000","last_became_peered":"2024-09-12T00:03:25.337834+0000","last_unstale":"2024-09-12T00:07:28.798915+0000","last_undegraded":"2024-09-12T00:07:28.798915+0000","last_fullsized":"2024-09-12T00:07:28.798915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:28.798730+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:28.798730+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.798730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:41.285633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"116'32","reported_seq":99,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.937148+0000","last_change":"2024-09-12T00:07:30.937148+0000","last_active":"2024-09-12T00:07:30.937148+0000","last_peered":"2024-09-12T00:07:30.937148+0000","last_clean":"2024-09-12T00:07:30.937148+0000","last_became_active":"2024-09-12T00:06:26.666889+0000","last_became_peered":"2024-09-12T00:06:26.666889+0000","last_unstale":"2024-09-12T00:07:30.937148+0000","last_undegraded":"2024-09-12T00:07:30.937148+0000","last_fullsized":"2024-09-12T00:07:30.937148+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-09-12T00:07:30.936954+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-09-12T00:07:30.936954+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.936954+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:35.026009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.348032+0000","last_change":"2024-09-12T00:07:28.348032+0000","last_active":"2024-09-12T00:07:28.348032+0000","last_peered":"2024-09-12T00:07:28.348032+0000","last_clean":"2024-09-12T00:07:28.348032+0000","last_became_active":"2024-09-12T00:03:25.336511+0000","last_became_peered":"2024-09-12T00:03:25.336511+0000","last_unstale":"2024-09-12T00:07:28.348032+0000","last_undegraded":"2024-09-12T00:07:28.348032+0000","last_fullsized":"2024-09-12T00:07:28.348032+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:28.347836+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:28.347836+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.347836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:06.273440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"116'56","reported_seq":258,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.587619+0000","last_change":"2024-09-12T00:07:26.587491+0000","last_active":"2024-09-12T00:07:26.587619+0000","last_peered":"2024-09-12T00:07:26.587619+0000","last_clean":"2024-09-12T00:07:26.587619+0000","last_became_active":"2024-09-12T00:03:23.621761+0000","last_became_peered":"2024-09-12T00:03:23.621761+0000","last_unstale":"2024-09-12T00:07:26.587619+0000","last_undegraded":"2024-09-12T00:07:26.587619+0000","last_fullsized":"2024-09-12T00:07:26.587619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-09-12T00:07:26.587314+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-09-12T00:07:26.587314+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.587314+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:13.090555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"59'4","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:36.721479+0000","last_change":"2024-09-12T00:07:36.721479+0000","last_active":"2024-09-12T00:07:36.721479+0000","last_peered":"2024-09-12T00:07:36.721479+0000","last_clean":"2024-09-12T00:07:36.721479+0000","last_became_active":"2024-09-12T00:06:26.677331+0000","last_became_peered":"2024-09-12T00:06:26.677331+0000","last_unstale":"2024-09-12T00:07:36.721479+0000","last_undegraded":"2024-09-12T00:07:36.721479+0000","last_fullsized":"2024-09-12T00:07:36.721479+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'4","last_scrub_stamp":"2024-09-12T00:07:36.721288+0000","last_deep_scrub":"59'4","last_deep_scrub_stamp":"2024-09-12T00:07:36.721288+0000","last_clean_scrub_stamp":"2024-09-12T00:07:36.721288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:01.956846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"116'48","reported_seq":253,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.021573+0000","last_change":"2024-09-12T00:07:19.021467+0000","last_active":"2024-09-12T00:07:19.021573+0000","last_peered":"2024-09-12T00:07:19.021573+0000","last_clean":"2024-09-12T00:07:19.021573+0000","last_became_active":"2024-09-12T00:03:23.600673+0000","last_became_peered":"2024-09-12T00:03:23.600673+0000","last_unstale":"2024-09-12T00:07:19.021573+0000","last_undegraded":"2024-09-12T00:07:19.021573+0000","last_fullsized":"2024-09-12T00:07:19.021573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-09-12T00:07:19.021358+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-09-12T00:07:19.021358+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.021358+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:41.825822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"96'6","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.170482+0000","last_change":"2024-09-12T00:07:27.170482+0000","last_active":"2024-09-12T00:07:27.170482+0000","last_peered":"2024-09-12T00:07:27.170482+0000","last_clean":"2024-09-12T00:07:27.170482+0000","last_became_active":"2024-09-12T00:03:25.324597+0000","last_became_peered":"2024-09-12T00:03:25.324597+0000","last_unstale":"2024-09-12T00:07:27.170482+0000","last_undegraded":"2024-09-12T00:07:27.170482+0000","last_fullsized":"2024-09-12T00:07:27.170482+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'6","last_scrub_stamp":"2024-09-12T00:07:27.170254+0000","last_deep_scrub":"96'6","last_deep_scrub_stamp":"2024-09-12T00:07:27.170254+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.170254+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:07.383195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"116'38","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.753268+0000","last_change":"2024-09-12T00:07:24.753120+0000","last_active":"2024-09-12T00:07:24.753268+0000","last_peered":"2024-09-12T00:07:24.753268+0000","last_clean":"2024-09-12T00:07:24.753268+0000","last_became_active":"2024-09-12T00:03:23.621063+0000","last_became_peered":"2024-09-12T00:03:23.621063+0000","last_unstale":"2024-09-12T00:07:24.753268+0000","last_undegraded":"2024-09-12T00:07:24.753268+0000","last_fullsized":"2024-09-12T00:07:24.753268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'38","last_scrub_stamp":"2024-09-12T00:07:24.752946+0000","last_deep_scrub":"116'38","last_deep_scrub_stamp":"2024-09-12T00:07:24.752946+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.752946+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:29.077551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":75776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.152134+0000","last_change":"2024-09-12T00:07:25.152134+0000","last_active":"2024-09-12T00:07:25.152134+0000","last_peered":"2024-09-12T00:07:25.152134+0000","last_clean":"2024-09-12T00:07:25.152134+0000","last_became_active":"2024-09-12T00:03:25.357286+0000","last_became_peered":"2024-09-12T00:03:25.357286+0000","last_unstale":"2024-09-12T00:07:25.152134+0000","last_undegraded":"2024-09-12T00:07:25.152134+0000","last_fullsized":"2024-09-12T00:07:25.152134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:25.151922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:25.151922+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.151922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:11.429863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"116'40","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.429402+0000","last_change":"2024-09-12T00:07:19.429253+0000","last_active":"2024-09-12T00:07:19.429402+0000","last_peered":"2024-09-12T00:07:19.429402+0000","last_clean":"2024-09-12T00:07:19.429402+0000","last_became_active":"2024-09-12T00:03:23.600591+0000","last_became_peered":"2024-09-12T00:03:23.600591+0000","last_unstale":"2024-09-12T00:07:19.429402+0000","last_undegraded":"2024-09-12T00:07:19.429402+0000","last_fullsized":"2024-09-12T00:07:19.429402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-09-12T00:07:19.429061+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-09-12T00:07:19.429061+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.429061+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:32.448809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":48,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"84'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.750681+0000","last_change":"2024-09-12T00:07:27.750681+0000","last_active":"2024-09-12T00:07:27.750681+0000","last_peered":"2024-09-12T00:07:27.750681+0000","last_clean":"2024-09-12T00:07:27.750681+0000","last_became_active":"2024-09-12T00:03:25.329742+0000","last_became_peered":"2024-09-12T00:03:25.329742+0000","last_unstale":"2024-09-12T00:07:27.750681+0000","last_undegraded":"2024-09-12T00:07:27.750681+0000","last_fullsized":"2024-09-12T00:07:27.750681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-09-12T00:07:27.750492+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-09-12T00:07:27.750492+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.750492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:22.714477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"116'62","reported_seq":143,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.908089+0000","last_change":"2024-09-12T00:07:31.908089+0000","last_active":"2024-09-12T00:07:31.908089+0000","last_peered":"2024-09-12T00:07:31.908089+0000","last_clean":"2024-09-12T00:07:31.908089+0000","last_became_active":"2024-09-12T00:06:26.668022+0000","last_became_peered":"2024-09-12T00:06:26.668022+0000","last_unstale":"2024-09-12T00:07:31.908089+0000","last_undegraded":"2024-09-12T00:07:31.908089+0000","last_fullsized":"2024-09-12T00:07:31.908089+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'62","last_scrub_stamp":"2024-09-12T00:07:31.907903+0000","last_deep_scrub":"116'62","last_deep_scrub_stamp":"2024-09-12T00:07:31.907903+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.907903+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:36.717756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":3,"num_write":70,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":222298112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"59'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.744456+0000","last_change":"2024-09-12T00:07:31.744456+0000","last_active":"2024-09-12T00:07:31.744456+0000","last_peered":"2024-09-12T00:07:31.744456+0000","last_clean":"2024-09-12T00:07:31.744456+0000","last_became_active":"2024-09-12T00:03:25.346874+0000","last_became_peered":"2024-09-12T00:03:25.346874+0000","last_unstale":"2024-09-12T00:07:31.744456+0000","last_undegraded":"2024-09-12T00:07:31.744456+0000","last_fullsized":"2024-09-12T00:07:31.744456+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'4","last_scrub_stamp":"2024-09-12T00:07:31.744229+0000","last_deep_scrub":"59'4","last_deep_scrub_stamp":"2024-09-12T00:07:31.744229+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.744229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:54.373084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"116'46","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.788234+0000","last_change":"2024-09-12T00:07:21.788234+0000","last_active":"2024-09-12T00:07:21.788234+0000","last_peered":"2024-09-12T00:07:21.788234+0000","last_clean":"2024-09-12T00:07:21.788234+0000","last_became_active":"2024-09-12T00:03:23.620261+0000","last_became_peered":"2024-09-12T00:03:23.620261+0000","last_unstale":"2024-09-12T00:07:21.788234+0000","last_undegraded":"2024-09-12T00:07:21.788234+0000","last_fullsized":"2024-09-12T00:07:21.788234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:21.788057+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:21.788057+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.788057+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:38.237924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"63'8","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.119877+0000","last_change":"2024-09-12T00:07:24.119687+0000","last_active":"2024-09-12T00:07:24.119877+0000","last_peered":"2024-09-12T00:07:24.119877+0000","last_clean":"2024-09-12T00:07:24.119877+0000","last_became_active":"2024-09-12T00:03:25.357186+0000","last_became_peered":"2024-09-12T00:03:25.357186+0000","last_unstale":"2024-09-12T00:07:24.119877+0000","last_undegraded":"2024-09-12T00:07:24.119877+0000","last_fullsized":"2024-09-12T00:07:24.119877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'8","last_scrub_stamp":"2024-09-12T00:07:24.119490+0000","last_deep_scrub":"63'8","last_deep_scrub_stamp":"2024-09-12T00:07:24.119490+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.119490+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:16.554769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"116'52","reported_seq":129,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.967297+0000","last_change":"2024-09-12T00:07:29.967297+0000","last_active":"2024-09-12T00:07:29.967297+0000","last_peered":"2024-09-12T00:07:29.967297+0000","last_clean":"2024-09-12T00:07:29.967297+0000","last_became_active":"2024-09-12T00:06:26.677360+0000","last_became_peered":"2024-09-12T00:06:26.677360+0000","last_unstale":"2024-09-12T00:07:29.967297+0000","last_undegraded":"2024-09-12T00:07:29.967297+0000","last_fullsized":"2024-09-12T00:07:29.967297+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'52","last_scrub_stamp":"2024-09-12T00:07:29.967103+0000","last_deep_scrub":"116'52","last_deep_scrub_stamp":"2024-09-12T00:07:29.967103+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.967103+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:32.916886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":163577856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"116'54","reported_seq":132,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.902383+0000","last_change":"2024-09-12T00:07:32.902383+0000","last_active":"2024-09-12T00:07:32.902383+0000","last_peered":"2024-09-12T00:07:32.902383+0000","last_clean":"2024-09-12T00:07:32.902383+0000","last_became_active":"2024-09-12T00:06:26.669830+0000","last_became_peered":"2024-09-12T00:06:26.669830+0000","last_unstale":"2024-09-12T00:07:32.902383+0000","last_undegraded":"2024-09-12T00:07:32.902383+0000","last_fullsized":"2024-09-12T00:07:32.902383+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'54","last_scrub_stamp":"2024-09-12T00:07:32.902205+0000","last_deep_scrub":"116'54","last_deep_scrub_stamp":"2024-09-12T00:07:32.902205+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.902205+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:44.716783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":192937984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"84'6","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:33.783295+0000","last_change":"2024-09-12T00:07:33.783295+0000","last_active":"2024-09-12T00:07:33.783295+0000","last_peered":"2024-09-12T00:07:33.783295+0000","last_clean":"2024-09-12T00:07:33.783295+0000","last_became_active":"2024-09-12T00:03:25.349281+0000","last_became_peered":"2024-09-12T00:03:25.349281+0000","last_unstale":"2024-09-12T00:07:33.783295+0000","last_undegraded":"2024-09-12T00:07:33.783295+0000","last_fullsized":"2024-09-12T00:07:33.783295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'6","last_scrub_stamp":"2024-09-12T00:07:33.783104+0000","last_deep_scrub":"84'6","last_deep_scrub_stamp":"2024-09-12T00:07:33.783104+0000","last_clean_scrub_stamp":"2024-09-12T00:07:33.783104+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:23.385096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"116'40","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.635628+0000","last_change":"2024-09-12T00:07:27.635628+0000","last_active":"2024-09-12T00:07:27.635628+0000","last_peered":"2024-09-12T00:07:27.635628+0000","last_clean":"2024-09-12T00:07:27.635628+0000","last_became_active":"2024-09-12T00:03:23.616154+0000","last_became_peered":"2024-09-12T00:03:23.616154+0000","last_unstale":"2024-09-12T00:07:27.635628+0000","last_undegraded":"2024-09-12T00:07:27.635628+0000","last_fullsized":"2024-09-12T00:07:27.635628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-09-12T00:07:27.635444+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-09-12T00:07:27.635444+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.635444+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:56.025683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"58'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.105454+0000","last_change":"2024-09-12T00:07:30.105454+0000","last_active":"2024-09-12T00:07:30.105454+0000","last_peered":"2024-09-12T00:07:30.105454+0000","last_clean":"2024-09-12T00:07:30.105454+0000","last_became_active":"2024-09-12T00:03:25.344917+0000","last_became_peered":"2024-09-12T00:03:25.344917+0000","last_unstale":"2024-09-12T00:07:30.105454+0000","last_undegraded":"2024-09-12T00:07:30.105454+0000","last_fullsized":"2024-09-12T00:07:30.105454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:30.105274+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:30.105274+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.105274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:58.157135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":339,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1112,"ondisk_log_size":1112,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":31604,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1351,"num_read_kb":1799,"num_write":737,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":117531,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1242,"ondisk_log_size":1242,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1444,"num_read_kb":1412,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3088,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":721,"num_bytes_recovered":3007315968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542206,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36732,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335108,"statfs":{"total":96636764160,"available":96599150592,"internally_reserved":0,"allocated":1421312,"data_stored":797851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542206,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36736,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335104,"statfs":{"total":96636764160,"available":96599146496,"internally_reserved":0,"allocated":1425408,"data_stored":798943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542206,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41472,"kb_used_data":1968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330368,"statfs":{"total":96636764160,"available":96594296832,"internally_reserved":0,"allocated":2015232,"data_stored":1388365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542206,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36732,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335108,"statfs":{"total":96636764160,"available":96599150592,"internally_reserved":0,"allocated":1421312,"data_stored":797651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542206,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45044,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326796,"statfs":{"total":96636764160,"available":96590639104,"internally_reserved":0,"allocated":1413120,"data_stored":797340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542207,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36708,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335132,"statfs":{"total":96636764160,"available":96599175168,"internally_reserved":0,"allocated":1396736,"data_stored":796956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542206,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37340,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334500,"statfs":{"total":96636764160,"available":96598528000,"internally_reserved":0,"allocated":2043904,"data_stored":1389896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542205,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36756,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335084,"statfs":{"total":96636764160,"available":96599126016,"internally_reserved":0,"allocated":1445888,"data_stored":798128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:07:59.859 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:59.860 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:59.860 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:59.861 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:59.861 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:59.862 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:59.862 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:59.862 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:59.862 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:59.863 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:03:28.303877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:59.863 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:59.863 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:59.863 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:59.863 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:03:30.310903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:59.863 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:03:32.330915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=3, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=7, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:07:59.864 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T00:08:19.865 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:08:20.222 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:08:20.228 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T00:08:20.244 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-09-12T00:08:18.511251+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":624007,"num_objects":232,"num_object_clones":0,"num_object_copies":464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":232,"num_whiteouts":0,"num_read":5210,"num_read_kb":4083,"num_write":4549,"num_write_kb":6187135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":928,"num_bytes_recovered":3007433610,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5897,"ondisk_log_size":5897,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":307520,"kb_used_data":12288,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754667200,"statfs":{"total":773094113280,"available":772779212800,"internally_reserved":0,"allocated":12582912,"data_stored":7565130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":302173746},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005812"},"pg_stats":[{"pgid":"3.3f","version":"116'32","reported_seq":311,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.361272+0000","last_change":"2024-09-12T00:07:25.361131+0000","last_active":"2024-09-12T00:07:25.361272+0000","last_peered":"2024-09-12T00:07:25.361272+0000","last_clean":"2024-09-12T00:07:25.361272+0000","last_became_active":"2024-09-12T00:06:26.678792+0000","last_became_peered":"2024-09-12T00:06:26.678792+0000","last_unstale":"2024-09-12T00:07:25.361272+0000","last_undegraded":"2024-09-12T00:07:25.361272+0000","last_fullsized":"2024-09-12T00:07:25.361272+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-09-12T00:07:25.360823+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-09-12T00:07:25.360823+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.360823+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:20.400665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.078430+0000","last_change":"2024-09-12T00:07:32.078430+0000","last_active":"2024-09-12T00:07:32.078430+0000","last_peered":"2024-09-12T00:07:32.078430+0000","last_clean":"2024-09-12T00:07:32.078430+0000","last_became_active":"2024-09-12T00:03:25.335964+0000","last_became_peered":"2024-09-12T00:03:25.335964+0000","last_unstale":"2024-09-12T00:07:32.078430+0000","last_undegraded":"2024-09-12T00:07:32.078430+0000","last_fullsized":"2024-09-12T00:07:32.078430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-12T00:07:32.078212+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-12T00:07:32.078212+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.078212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:27.301937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"116'48","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.619915+0000","last_change":"2024-09-12T00:07:29.619769+0000","last_active":"2024-09-12T00:07:29.619915+0000","last_peered":"2024-09-12T00:07:29.619915+0000","last_clean":"2024-09-12T00:07:29.619915+0000","last_became_active":"2024-09-12T00:03:23.627630+0000","last_became_peered":"2024-09-12T00:03:23.627630+0000","last_unstale":"2024-09-12T00:07:29.619915+0000","last_undegraded":"2024-09-12T00:07:29.619915+0000","last_fullsized":"2024-09-12T00:07:29.619915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-09-12T00:07:29.619589+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-09-12T00:07:29.619589+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.619589+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:42.773035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"76'2","reported_seq":53,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:40.962746+0000","last_change":"2024-09-12T00:07:40.962746+0000","last_active":"2024-09-12T00:07:40.962746+0000","last_peered":"2024-09-12T00:07:40.962746+0000","last_clean":"2024-09-12T00:07:40.962746+0000","last_became_active":"2024-09-12T00:06:26.660419+0000","last_became_peered":"2024-09-12T00:06:26.660419+0000","last_unstale":"2024-09-12T00:07:40.962746+0000","last_undegraded":"2024-09-12T00:07:40.962746+0000","last_fullsized":"2024-09-12T00:07:40.962746+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-12T00:07:40.962547+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-12T00:07:40.962547+0000","last_clean_scrub_stamp":"2024-09-12T00:07:40.962547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:09.720504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"116'58","reported_seq":260,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.669920+0000","last_change":"2024-09-12T00:07:28.669755+0000","last_active":"2024-09-12T00:07:28.669920+0000","last_peered":"2024-09-12T00:07:28.669920+0000","last_clean":"2024-09-12T00:07:28.669920+0000","last_became_active":"2024-09-12T00:03:23.625728+0000","last_became_peered":"2024-09-12T00:03:23.625728+0000","last_unstale":"2024-09-12T00:07:28.669920+0000","last_undegraded":"2024-09-12T00:07:28.669920+0000","last_fullsized":"2024-09-12T00:07:28.669920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'58","last_scrub_stamp":"2024-09-12T00:07:28.669563+0000","last_deep_scrub":"116'58","last_deep_scrub_stamp":"2024-09-12T00:07:28.669563+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.669563+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:18.098931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"96'4","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:41.925750+0000","last_change":"2024-09-12T00:07:41.925750+0000","last_active":"2024-09-12T00:07:41.925750+0000","last_peered":"2024-09-12T00:07:41.925750+0000","last_clean":"2024-09-12T00:07:41.925750+0000","last_became_active":"2024-09-12T00:06:26.677271+0000","last_became_peered":"2024-09-12T00:06:26.677271+0000","last_unstale":"2024-09-12T00:07:41.925750+0000","last_undegraded":"2024-09-12T00:07:41.925750+0000","last_fullsized":"2024-09-12T00:07:41.925750+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'4","last_scrub_stamp":"2024-09-12T00:07:41.925554+0000","last_deep_scrub":"96'4","last_deep_scrub_stamp":"2024-09-12T00:07:41.925554+0000","last_clean_scrub_stamp":"2024-09-12T00:07:41.925554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:04.680943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"116'44","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.194854+0000","last_change":"2024-09-12T00:07:22.194710+0000","last_active":"2024-09-12T00:07:22.194854+0000","last_peered":"2024-09-12T00:07:22.194854+0000","last_clean":"2024-09-12T00:07:22.194854+0000","last_became_active":"2024-09-12T00:03:23.609326+0000","last_became_peered":"2024-09-12T00:03:23.609326+0000","last_unstale":"2024-09-12T00:07:22.194854+0000","last_undegraded":"2024-09-12T00:07:22.194854+0000","last_fullsized":"2024-09-12T00:07:22.194854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-09-12T00:07:22.194527+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-09-12T00:07:22.194527+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.194527+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:11.658941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'8","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.757581+0000","last_change":"2024-09-12T00:07:32.757581+0000","last_active":"2024-09-12T00:07:32.757581+0000","last_peered":"2024-09-12T00:07:32.757581+0000","last_clean":"2024-09-12T00:07:32.757581+0000","last_became_active":"2024-09-12T00:03:25.338805+0000","last_became_peered":"2024-09-12T00:03:25.338805+0000","last_unstale":"2024-09-12T00:07:32.757581+0000","last_undegraded":"2024-09-12T00:07:32.757581+0000","last_fullsized":"2024-09-12T00:07:32.757581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'8","last_scrub_stamp":"2024-09-12T00:07:32.757327+0000","last_deep_scrub":"59'8","last_deep_scrub_stamp":"2024-09-12T00:07:32.757327+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.757327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:22.657437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"116'52","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.408443+0000","last_change":"2024-09-12T00:07:24.408443+0000","last_active":"2024-09-12T00:07:24.408443+0000","last_peered":"2024-09-12T00:07:24.408443+0000","last_clean":"2024-09-12T00:07:24.408443+0000","last_became_active":"2024-09-12T00:03:23.633580+0000","last_became_peered":"2024-09-12T00:03:23.633580+0000","last_unstale":"2024-09-12T00:07:24.408443+0000","last_undegraded":"2024-09-12T00:07:24.408443+0000","last_fullsized":"2024-09-12T00:07:24.408443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'52","last_scrub_stamp":"2024-09-12T00:07:24.408218+0000","last_deep_scrub":"116'52","last_deep_scrub_stamp":"2024-09-12T00:07:24.408218+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.408218+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:51.856526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"59'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.373844+0000","last_change":"2024-09-12T00:07:31.373844+0000","last_active":"2024-09-12T00:07:31.373844+0000","last_peered":"2024-09-12T00:07:31.373844+0000","last_clean":"2024-09-12T00:07:31.373844+0000","last_became_active":"2024-09-12T00:03:25.324138+0000","last_became_peered":"2024-09-12T00:03:25.324138+0000","last_unstale":"2024-09-12T00:07:31.373844+0000","last_undegraded":"2024-09-12T00:07:31.373844+0000","last_fullsized":"2024-09-12T00:07:31.373844+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:31.373657+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:31.373657+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.373657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:41.146834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"116'42","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:17.194248+0000","last_change":"2024-09-12T00:07:17.194248+0000","last_active":"2024-09-12T00:07:17.194248+0000","last_peered":"2024-09-12T00:07:17.194248+0000","last_clean":"2024-09-12T00:07:17.194248+0000","last_became_active":"2024-09-12T00:03:23.609509+0000","last_became_peered":"2024-09-12T00:03:23.609509+0000","last_unstale":"2024-09-12T00:07:17.194248+0000","last_undegraded":"2024-09-12T00:07:17.194248+0000","last_fullsized":"2024-09-12T00:07:17.194248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-09-12T00:07:17.194144+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-09-12T00:07:17.194144+0000","last_clean_scrub_stamp":"2024-09-12T00:07:17.194144+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:20.566593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"96'12","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.361043+0000","last_change":"2024-09-12T00:07:30.360851+0000","last_active":"2024-09-12T00:07:30.361043+0000","last_peered":"2024-09-12T00:07:30.361043+0000","last_clean":"2024-09-12T00:07:30.361043+0000","last_became_active":"2024-09-12T00:03:25.355002+0000","last_became_peered":"2024-09-12T00:03:25.355002+0000","last_unstale":"2024-09-12T00:07:30.361043+0000","last_undegraded":"2024-09-12T00:07:30.361043+0000","last_fullsized":"2024-09-12T00:07:30.361043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'12","last_scrub_stamp":"2024-09-12T00:07:30.360652+0000","last_deep_scrub":"96'12","last_deep_scrub_stamp":"2024-09-12T00:07:30.360652+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.360652+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:45.041553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"116'56","reported_seq":260,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.426625+0000","last_change":"2024-09-12T00:07:21.426625+0000","last_active":"2024-09-12T00:07:21.426625+0000","last_peered":"2024-09-12T00:07:21.426625+0000","last_clean":"2024-09-12T00:07:21.426625+0000","last_became_active":"2024-09-12T00:03:23.606143+0000","last_became_peered":"2024-09-12T00:03:23.606143+0000","last_unstale":"2024-09-12T00:07:21.426625+0000","last_undegraded":"2024-09-12T00:07:21.426625+0000","last_fullsized":"2024-09-12T00:07:21.426625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-09-12T00:07:21.426412+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-09-12T00:07:21.426412+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.426412+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:43.315445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:33.299168+0000","last_change":"2024-09-12T00:07:33.298975+0000","last_active":"2024-09-12T00:07:33.299168+0000","last_peered":"2024-09-12T00:07:33.299168+0000","last_clean":"2024-09-12T00:07:33.299168+0000","last_became_active":"2024-09-12T00:03:25.329625+0000","last_became_peered":"2024-09-12T00:03:25.329625+0000","last_unstale":"2024-09-12T00:07:33.299168+0000","last_undegraded":"2024-09-12T00:07:33.299168+0000","last_fullsized":"2024-09-12T00:07:33.299168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:33.298774+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:33.298774+0000","last_clean_scrub_stamp":"2024-09-12T00:07:33.298774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:14.492694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"116'54","reported_seq":255,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.615281+0000","last_change":"2024-09-12T00:07:32.615281+0000","last_active":"2024-09-12T00:07:32.615281+0000","last_peered":"2024-09-12T00:07:32.615281+0000","last_clean":"2024-09-12T00:07:32.615281+0000","last_became_active":"2024-09-12T00:03:23.626018+0000","last_became_peered":"2024-09-12T00:03:23.626018+0000","last_unstale":"2024-09-12T00:07:32.615281+0000","last_undegraded":"2024-09-12T00:07:32.615281+0000","last_fullsized":"2024-09-12T00:07:32.615281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'54","last_scrub_stamp":"2024-09-12T00:07:32.615096+0000","last_deep_scrub":"116'54","last_deep_scrub_stamp":"2024-09-12T00:07:32.615096+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.615096+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:50.011601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"59'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:38.752164+0000","last_change":"2024-09-12T00:07:38.752000+0000","last_active":"2024-09-12T00:07:38.752164+0000","last_peered":"2024-09-12T00:07:38.752164+0000","last_clean":"2024-09-12T00:07:38.752164+0000","last_became_active":"2024-09-12T00:03:25.347902+0000","last_became_peered":"2024-09-12T00:03:25.347902+0000","last_unstale":"2024-09-12T00:07:38.752164+0000","last_undegraded":"2024-09-12T00:07:38.752164+0000","last_fullsized":"2024-09-12T00:07:38.752164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'4","last_scrub_stamp":"2024-09-12T00:07:38.751805+0000","last_deep_scrub":"59'4","last_deep_scrub_stamp":"2024-09-12T00:07:38.751805+0000","last_clean_scrub_stamp":"2024-09-12T00:07:38.751805+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:40.083198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"59'2","reported_seq":53,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:37.995364+0000","last_change":"2024-09-12T00:07:37.995364+0000","last_active":"2024-09-12T00:07:37.995364+0000","last_peered":"2024-09-12T00:07:37.995364+0000","last_clean":"2024-09-12T00:07:37.995364+0000","last_became_active":"2024-09-12T00:06:26.653851+0000","last_became_peered":"2024-09-12T00:06:26.653851+0000","last_unstale":"2024-09-12T00:07:37.995364+0000","last_undegraded":"2024-09-12T00:07:37.995364+0000","last_fullsized":"2024-09-12T00:07:37.995364+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:37.995173+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:37.995173+0000","last_clean_scrub_stamp":"2024-09-12T00:07:37.995173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:33.567238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"116'34","reported_seq":311,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.047396+0000","last_change":"2024-09-12T00:07:20.047258+0000","last_active":"2024-09-12T00:07:20.047396+0000","last_peered":"2024-09-12T00:07:20.047396+0000","last_clean":"2024-09-12T00:07:20.047396+0000","last_became_active":"2024-09-12T00:06:26.664959+0000","last_became_peered":"2024-09-12T00:06:26.664959+0000","last_unstale":"2024-09-12T00:07:20.047396+0000","last_undegraded":"2024-09-12T00:07:20.047396+0000","last_fullsized":"2024-09-12T00:07:20.047396+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'34","last_scrub_stamp":"2024-09-12T00:07:20.047081+0000","last_deep_scrub":"116'34","last_deep_scrub_stamp":"2024-09-12T00:07:20.047081+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.047081+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:54.885211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"59'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.352727+0000","last_change":"2024-09-12T00:07:29.352578+0000","last_active":"2024-09-12T00:07:29.352727+0000","last_peered":"2024-09-12T00:07:29.352727+0000","last_clean":"2024-09-12T00:07:29.352727+0000","last_became_active":"2024-09-12T00:03:25.334375+0000","last_became_peered":"2024-09-12T00:03:25.334375+0000","last_unstale":"2024-09-12T00:07:29.352727+0000","last_undegraded":"2024-09-12T00:07:29.352727+0000","last_fullsized":"2024-09-12T00:07:29.352727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:29.352370+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:29.352370+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.352370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:34.512492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"116'40","reported_seq":245,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.426372+0000","last_change":"2024-09-12T00:07:23.426222+0000","last_active":"2024-09-12T00:07:23.426372+0000","last_peered":"2024-09-12T00:07:23.426372+0000","last_clean":"2024-09-12T00:07:23.426372+0000","last_became_active":"2024-09-12T00:03:23.614019+0000","last_became_peered":"2024-09-12T00:03:23.614019+0000","last_unstale":"2024-09-12T00:07:23.426372+0000","last_undegraded":"2024-09-12T00:07:23.426372+0000","last_fullsized":"2024-09-12T00:07:23.426372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-09-12T00:07:23.426027+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-09-12T00:07:23.426027+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.426027+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:38.438913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"96'12","reported_seq":240,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.151388+0000","last_change":"2024-09-12T00:07:26.151228+0000","last_active":"2024-09-12T00:07:26.151388+0000","last_peered":"2024-09-12T00:07:26.151388+0000","last_clean":"2024-09-12T00:07:26.151388+0000","last_became_active":"2024-09-12T00:03:25.357571+0000","last_became_peered":"2024-09-12T00:03:25.357571+0000","last_unstale":"2024-09-12T00:07:26.151388+0000","last_undegraded":"2024-09-12T00:07:26.151388+0000","last_fullsized":"2024-09-12T00:07:26.151388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'12","last_scrub_stamp":"2024-09-12T00:07:26.151041+0000","last_deep_scrub":"96'12","last_deep_scrub_stamp":"2024-09-12T00:07:26.151041+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.151041+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:51.666529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"116'46","reported_seq":347,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.398416+0000","last_change":"2024-09-12T00:07:22.398246+0000","last_active":"2024-09-12T00:07:22.398416+0000","last_peered":"2024-09-12T00:07:22.398416+0000","last_clean":"2024-09-12T00:07:22.398416+0000","last_became_active":"2024-09-12T00:06:26.682027+0000","last_became_peered":"2024-09-12T00:06:26.682027+0000","last_unstale":"2024-09-12T00:07:22.398416+0000","last_undegraded":"2024-09-12T00:07:22.398416+0000","last_fullsized":"2024-09-12T00:07:22.398416+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:22.398067+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:22.398067+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.398067+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:27.681427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":167772160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'8","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.381628+0000","last_change":"2024-09-12T00:07:31.381628+0000","last_active":"2024-09-12T00:07:31.381628+0000","last_peered":"2024-09-12T00:07:31.381628+0000","last_clean":"2024-09-12T00:07:31.381628+0000","last_became_active":"2024-09-12T00:03:25.344959+0000","last_became_peered":"2024-09-12T00:03:25.344959+0000","last_unstale":"2024-09-12T00:07:31.381628+0000","last_undegraded":"2024-09-12T00:07:31.381628+0000","last_fullsized":"2024-09-12T00:07:31.381628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'8","last_scrub_stamp":"2024-09-12T00:07:31.381429+0000","last_deep_scrub":"63'8","last_deep_scrub_stamp":"2024-09-12T00:07:31.381429+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.381429+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:29.418399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"116'34","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.425763+0000","last_change":"2024-09-12T00:07:20.425570+0000","last_active":"2024-09-12T00:07:20.425763+0000","last_peered":"2024-09-12T00:07:20.425763+0000","last_clean":"2024-09-12T00:07:20.425763+0000","last_became_active":"2024-09-12T00:03:23.602640+0000","last_became_peered":"2024-09-12T00:03:23.602640+0000","last_unstale":"2024-09-12T00:07:20.425763+0000","last_undegraded":"2024-09-12T00:07:20.425763+0000","last_fullsized":"2024-09-12T00:07:20.425763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'34","last_scrub_stamp":"2024-09-12T00:07:20.425354+0000","last_deep_scrub":"116'34","last_deep_scrub_stamp":"2024-09-12T00:07:20.425354+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.425354+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:13.305799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"59'2","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:39.710516+0000","last_change":"2024-09-12T00:07:39.710516+0000","last_active":"2024-09-12T00:07:39.710516+0000","last_peered":"2024-09-12T00:07:39.710516+0000","last_clean":"2024-09-12T00:07:39.710516+0000","last_became_active":"2024-09-12T00:06:26.665307+0000","last_became_peered":"2024-09-12T00:06:26.665307+0000","last_unstale":"2024-09-12T00:07:39.710516+0000","last_undegraded":"2024-09-12T00:07:39.710516+0000","last_fullsized":"2024-09-12T00:07:39.710516+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:39.710322+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:39.710322+0000","last_clean_scrub_stamp":"2024-09-12T00:07:39.710322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:27.544957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"116'46","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.363283+0000","last_change":"2024-09-12T00:07:24.363096+0000","last_active":"2024-09-12T00:07:24.363283+0000","last_peered":"2024-09-12T00:07:24.363283+0000","last_clean":"2024-09-12T00:07:24.363283+0000","last_became_active":"2024-09-12T00:03:23.603932+0000","last_became_peered":"2024-09-12T00:03:23.603932+0000","last_unstale":"2024-09-12T00:07:24.363283+0000","last_undegraded":"2024-09-12T00:07:24.363283+0000","last_fullsized":"2024-09-12T00:07:24.363283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:24.362915+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:24.362915+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.362915+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:05.312564+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"76'4","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.150664+0000","last_change":"2024-09-12T00:07:28.150664+0000","last_active":"2024-09-12T00:07:28.150664+0000","last_peered":"2024-09-12T00:07:28.150664+0000","last_clean":"2024-09-12T00:07:28.150664+0000","last_became_active":"2024-09-12T00:03:25.340828+0000","last_became_peered":"2024-09-12T00:03:25.340828+0000","last_unstale":"2024-09-12T00:07:28.150664+0000","last_undegraded":"2024-09-12T00:07:28.150664+0000","last_fullsized":"2024-09-12T00:07:28.150664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-12T00:07:28.150477+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-12T00:07:28.150477+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.150477+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:39.470463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"116'36","reported_seq":240,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.388798+0000","last_change":"2024-09-12T00:07:23.388542+0000","last_active":"2024-09-12T00:07:23.388798+0000","last_peered":"2024-09-12T00:07:23.388798+0000","last_clean":"2024-09-12T00:07:23.388798+0000","last_became_active":"2024-09-12T00:03:23.601892+0000","last_became_peered":"2024-09-12T00:03:23.601892+0000","last_unstale":"2024-09-12T00:07:23.388798+0000","last_undegraded":"2024-09-12T00:07:23.388798+0000","last_fullsized":"2024-09-12T00:07:23.388798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'36","last_scrub_stamp":"2024-09-12T00:07:23.388307+0000","last_deep_scrub":"116'36","last_deep_scrub_stamp":"2024-09-12T00:07:23.388307+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.388307+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:49.870399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:40.352303+0000","last_change":"2024-09-12T00:07:40.352303+0000","last_active":"2024-09-12T00:07:40.352303+0000","last_peered":"2024-09-12T00:07:40.352303+0000","last_clean":"2024-09-12T00:07:40.352303+0000","last_became_active":"2024-09-12T00:03:33.351917+0000","last_became_peered":"2024-09-12T00:03:33.351917+0000","last_unstale":"2024-09-12T00:07:40.352303+0000","last_undegraded":"2024-09-12T00:07:40.352303+0000","last_fullsized":"2024-09-12T00:07:40.352303+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:40.352129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:40.352129+0000","last_clean_scrub_stamp":"2024-09-12T00:07:40.352129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:01.391278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"59'6","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.387964+0000","last_change":"2024-09-12T00:07:29.387825+0000","last_active":"2024-09-12T00:07:29.387964+0000","last_peered":"2024-09-12T00:07:29.387964+0000","last_clean":"2024-09-12T00:07:29.387964+0000","last_became_active":"2024-09-12T00:03:25.322456+0000","last_became_peered":"2024-09-12T00:03:25.322456+0000","last_unstale":"2024-09-12T00:07:29.387964+0000","last_undegraded":"2024-09-12T00:07:29.387964+0000","last_fullsized":"2024-09-12T00:07:29.387964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2024-09-12T00:07:29.387638+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2024-09-12T00:07:29.387638+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.387638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:09.600578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"116'54","reported_seq":132,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.983716+0000","last_change":"2024-09-12T00:07:26.983716+0000","last_active":"2024-09-12T00:07:26.983716+0000","last_peered":"2024-09-12T00:07:26.983716+0000","last_clean":"2024-09-12T00:07:26.983716+0000","last_became_active":"2024-09-12T00:06:26.648460+0000","last_became_peered":"2024-09-12T00:06:26.648460+0000","last_unstale":"2024-09-12T00:07:26.983716+0000","last_undegraded":"2024-09-12T00:07:26.983716+0000","last_fullsized":"2024-09-12T00:07:26.983716+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'54","last_scrub_stamp":"2024-09-12T00:07:26.983503+0000","last_deep_scrub":"116'54","last_deep_scrub_stamp":"2024-09-12T00:07:26.983503+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.983503+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:54.178198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:46.940295+0000","last_change":"2024-09-12T00:07:46.940295+0000","last_active":"2024-09-12T00:07:46.940295+0000","last_peered":"2024-09-12T00:07:46.940295+0000","last_clean":"2024-09-12T00:07:46.940295+0000","last_became_active":"2024-09-12T00:06:26.663654+0000","last_became_peered":"2024-09-12T00:06:26.663654+0000","last_unstale":"2024-09-12T00:07:46.940295+0000","last_undegraded":"2024-09-12T00:07:46.940295+0000","last_fullsized":"2024-09-12T00:07:46.940295+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:46.940082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:46.940082+0000","last_clean_scrub_stamp":"2024-09-12T00:07:46.940082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:37.951903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"116'38","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:46.942252+0000","last_change":"2024-09-12T00:07:46.942252+0000","last_active":"2024-09-12T00:07:46.942252+0000","last_peered":"2024-09-12T00:07:46.942252+0000","last_clean":"2024-09-12T00:07:46.942252+0000","last_became_active":"2024-09-12T00:03:29.346662+0000","last_became_peered":"2024-09-12T00:03:29.346662+0000","last_unstale":"2024-09-12T00:07:46.942252+0000","last_undegraded":"2024-09-12T00:07:46.942252+0000","last_fullsized":"2024-09-12T00:07:46.942252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'38","last_scrub_stamp":"2024-09-12T00:07:46.942017+0000","last_deep_scrub":"116'38","last_deep_scrub_stamp":"2024-09-12T00:07:46.942017+0000","last_clean_scrub_stamp":"2024-09-12T00:07:46.942017+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:52.114146+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:42.183260+0000","last_change":"2024-09-12T00:07:42.183260+0000","last_active":"2024-09-12T00:07:42.183260+0000","last_peered":"2024-09-12T00:07:42.183260+0000","last_clean":"2024-09-12T00:07:42.183260+0000","last_became_active":"2024-09-12T00:03:31.336317+0000","last_became_peered":"2024-09-12T00:03:31.336317+0000","last_unstale":"2024-09-12T00:07:42.183260+0000","last_undegraded":"2024-09-12T00:07:42.183260+0000","last_fullsized":"2024-09-12T00:07:42.183260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:42.183078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:42.183078+0000","last_clean_scrub_stamp":"2024-09-12T00:07:42.183078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:20.774300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"116'49","reported_seq":252,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:46.149975+0000","last_change":"2024-09-12T00:07:46.149975+0000","last_active":"2024-09-12T00:07:46.149975+0000","last_peered":"2024-09-12T00:07:46.149975+0000","last_clean":"2024-09-12T00:07:46.149975+0000","last_became_active":"2024-09-12T00:03:33.375938+0000","last_became_peered":"2024-09-12T00:03:33.375938+0000","last_unstale":"2024-09-12T00:07:46.149975+0000","last_undegraded":"2024-09-12T00:07:46.149975+0000","last_fullsized":"2024-09-12T00:07:46.149975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'49","last_scrub_stamp":"2024-09-12T00:07:46.149791+0000","last_deep_scrub":"116'49","last_deep_scrub_stamp":"2024-09-12T00:07:46.149791+0000","last_clean_scrub_stamp":"2024-09-12T00:07:46.149791+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:31.578561+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"84'8","reported_seq":59,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:38.977382+0000","last_change":"2024-09-12T00:07:38.977382+0000","last_active":"2024-09-12T00:07:38.977382+0000","last_peered":"2024-09-12T00:07:38.977382+0000","last_clean":"2024-09-12T00:07:38.977382+0000","last_became_active":"2024-09-12T00:06:26.679390+0000","last_became_peered":"2024-09-12T00:06:26.679390+0000","last_unstale":"2024-09-12T00:07:38.977382+0000","last_undegraded":"2024-09-12T00:07:38.977382+0000","last_fullsized":"2024-09-12T00:07:38.977382+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'8","last_scrub_stamp":"2024-09-12T00:07:38.977195+0000","last_deep_scrub":"84'8","last_deep_scrub_stamp":"2024-09-12T00:07:38.977195+0000","last_clean_scrub_stamp":"2024-09-12T00:07:38.977195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:49.948524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"116'28","reported_seq":290,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.365423+0000","last_change":"2024-09-12T00:07:18.365269+0000","last_active":"2024-09-12T00:07:18.365423+0000","last_peered":"2024-09-12T00:07:18.365423+0000","last_clean":"2024-09-12T00:07:18.365423+0000","last_became_active":"2024-09-12T00:06:26.675473+0000","last_became_peered":"2024-09-12T00:06:26.675473+0000","last_unstale":"2024-09-12T00:07:18.365423+0000","last_undegraded":"2024-09-12T00:07:18.365423+0000","last_fullsized":"2024-09-12T00:07:18.365423+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-09-12T00:07:18.365092+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-09-12T00:07:18.365092+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.365092+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:28.752797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:36.838829+0000","last_change":"2024-09-12T00:07:36.838675+0000","last_active":"2024-09-12T00:07:36.838829+0000","last_peered":"2024-09-12T00:07:36.838829+0000","last_clean":"2024-09-12T00:07:36.838829+0000","last_became_active":"2024-09-12T00:03:27.335308+0000","last_became_peered":"2024-09-12T00:03:27.335308+0000","last_unstale":"2024-09-12T00:07:36.838829+0000","last_undegraded":"2024-09-12T00:07:36.838829+0000","last_fullsized":"2024-09-12T00:07:36.838829+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:36.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:36.838492+0000","last_clean_scrub_stamp":"2024-09-12T00:07:36.838492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:40.794762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"116'16","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:35.070360+0000","last_change":"2024-09-12T00:07:35.070360+0000","last_active":"2024-09-12T00:07:35.070360+0000","last_peered":"2024-09-12T00:07:35.070360+0000","last_clean":"2024-09-12T00:07:35.070360+0000","last_became_active":"2024-09-12T00:03:29.351783+0000","last_became_peered":"2024-09-12T00:03:29.351783+0000","last_unstale":"2024-09-12T00:07:35.070360+0000","last_undegraded":"2024-09-12T00:07:35.070360+0000","last_fullsized":"2024-09-12T00:07:35.070360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-09-12T00:07:35.070147+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-09-12T00:07:35.070147+0000","last_clean_scrub_stamp":"2024-09-12T00:07:35.070147+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:26.638990+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:41.202621+0000","last_change":"2024-09-12T00:07:41.202621+0000","last_active":"2024-09-12T00:07:41.202621+0000","last_peered":"2024-09-12T00:07:41.202621+0000","last_clean":"2024-09-12T00:07:41.202621+0000","last_became_active":"2024-09-12T00:03:31.349244+0000","last_became_peered":"2024-09-12T00:03:31.349244+0000","last_unstale":"2024-09-12T00:07:41.202621+0000","last_undegraded":"2024-09-12T00:07:41.202621+0000","last_fullsized":"2024-09-12T00:07:41.202621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:41.202410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:41.202410+0000","last_clean_scrub_stamp":"2024-09-12T00:07:41.202410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:22.396330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:45.278808+0000","last_change":"2024-09-12T00:07:45.278808+0000","last_active":"2024-09-12T00:07:45.278808+0000","last_peered":"2024-09-12T00:07:45.278808+0000","last_clean":"2024-09-12T00:07:45.278808+0000","last_became_active":"2024-09-12T00:03:33.381875+0000","last_became_peered":"2024-09-12T00:03:33.381875+0000","last_unstale":"2024-09-12T00:07:45.278808+0000","last_undegraded":"2024-09-12T00:07:45.278808+0000","last_fullsized":"2024-09-12T00:07:45.278808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:45.278639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:45.278639+0000","last_clean_scrub_stamp":"2024-09-12T00:07:45.278639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:15.789051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"63'12","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:33.626384+0000","last_change":"2024-09-12T00:07:33.626384+0000","last_active":"2024-09-12T00:07:33.626384+0000","last_peered":"2024-09-12T00:07:33.626384+0000","last_clean":"2024-09-12T00:07:33.626384+0000","last_became_active":"2024-09-12T00:03:25.355174+0000","last_became_peered":"2024-09-12T00:03:25.355174+0000","last_unstale":"2024-09-12T00:07:33.626384+0000","last_undegraded":"2024-09-12T00:07:33.626384+0000","last_fullsized":"2024-09-12T00:07:33.626384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'12","last_scrub_stamp":"2024-09-12T00:07:33.626194+0000","last_deep_scrub":"63'12","last_deep_scrub_stamp":"2024-09-12T00:07:33.626194+0000","last_clean_scrub_stamp":"2024-09-12T00:07:33.626194+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:12.596617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"116'42","reported_seq":114,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.948934+0000","last_change":"2024-09-12T00:07:25.948934+0000","last_active":"2024-09-12T00:07:25.948934+0000","last_peered":"2024-09-12T00:07:25.948934+0000","last_clean":"2024-09-12T00:07:25.948934+0000","last_became_active":"2024-09-12T00:06:26.670936+0000","last_became_peered":"2024-09-12T00:06:26.670936+0000","last_unstale":"2024-09-12T00:07:25.948934+0000","last_undegraded":"2024-09-12T00:07:25.948934+0000","last_fullsized":"2024-09-12T00:07:25.948934+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-09-12T00:07:25.948727+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-09-12T00:07:25.948727+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.948727+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:09.232455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:37.872571+0000","last_change":"2024-09-12T00:07:37.872571+0000","last_active":"2024-09-12T00:07:37.872571+0000","last_peered":"2024-09-12T00:07:37.872571+0000","last_clean":"2024-09-12T00:07:37.872571+0000","last_became_active":"2024-09-12T00:03:27.346346+0000","last_became_peered":"2024-09-12T00:03:27.346346+0000","last_unstale":"2024-09-12T00:07:37.872571+0000","last_undegraded":"2024-09-12T00:07:37.872571+0000","last_fullsized":"2024-09-12T00:07:37.872571+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:37.872404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:37.872404+0000","last_clean_scrub_stamp":"2024-09-12T00:07:37.872404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:45.893390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"116'29","reported_seq":281,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:44.922299+0000","last_change":"2024-09-12T00:07:44.922123+0000","last_active":"2024-09-12T00:07:44.922299+0000","last_peered":"2024-09-12T00:07:44.922299+0000","last_clean":"2024-09-12T00:07:44.922299+0000","last_became_active":"2024-09-12T00:06:26.654182+0000","last_became_peered":"2024-09-12T00:06:26.654182+0000","last_unstale":"2024-09-12T00:07:44.922299+0000","last_undegraded":"2024-09-12T00:07:44.922299+0000","last_fullsized":"2024-09-12T00:07:44.922299+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'29","last_scrub_stamp":"2024-09-12T00:07:44.921939+0000","last_deep_scrub":"116'29","last_deep_scrub_stamp":"2024-09-12T00:07:44.921939+0000","last_clean_scrub_stamp":"2024-09-12T00:07:44.921939+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:13.222147+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"116'144","reported_seq":374,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:55.896165+0000","last_change":"2024-09-12T00:07:55.896165+0000","last_active":"2024-09-12T00:07:55.896165+0000","last_peered":"2024-09-12T00:07:55.896165+0000","last_clean":"2024-09-12T00:07:55.896165+0000","last_became_active":"2024-09-12T00:06:30.698465+0000","last_became_peered":"2024-09-12T00:06:30.698465+0000","last_unstale":"2024-09-12T00:07:55.896165+0000","last_undegraded":"2024-09-12T00:07:55.896165+0000","last_fullsized":"2024-09-12T00:07:55.896165+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'144","last_scrub_stamp":"2024-09-12T00:07:55.895988+0000","last_deep_scrub":"116'144","last_deep_scrub_stamp":"2024-09-12T00:07:55.895988+0000","last_clean_scrub_stamp":"2024-09-12T00:07:55.895988+0000","objects_scrubbed":1,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:29.562333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:41.362036+0000","last_change":"2024-09-12T00:07:41.362036+0000","last_active":"2024-09-12T00:07:41.362036+0000","last_peered":"2024-09-12T00:07:41.362036+0000","last_clean":"2024-09-12T00:07:41.362036+0000","last_became_active":"2024-09-12T00:03:33.374453+0000","last_became_peered":"2024-09-12T00:03:33.374453+0000","last_unstale":"2024-09-12T00:07:41.362036+0000","last_undegraded":"2024-09-12T00:07:41.362036+0000","last_fullsized":"2024-09-12T00:07:41.362036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:41.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:41.361864+0000","last_clean_scrub_stamp":"2024-09-12T00:07:41.361864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:42.058988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"58'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:34.648463+0000","last_change":"2024-09-12T00:07:34.648463+0000","last_active":"2024-09-12T00:07:34.648463+0000","last_peered":"2024-09-12T00:07:34.648463+0000","last_clean":"2024-09-12T00:07:34.648463+0000","last_became_active":"2024-09-12T00:03:25.354803+0000","last_became_peered":"2024-09-12T00:03:25.354803+0000","last_unstale":"2024-09-12T00:07:34.648463+0000","last_undegraded":"2024-09-12T00:07:34.648463+0000","last_fullsized":"2024-09-12T00:07:34.648463+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:34.648278+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:34.648278+0000","last_clean_scrub_stamp":"2024-09-12T00:07:34.648278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:59.844387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"116'46","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.074049+0000","last_change":"2024-09-12T00:07:21.073913+0000","last_active":"2024-09-12T00:07:21.074049+0000","last_peered":"2024-09-12T00:07:21.074049+0000","last_clean":"2024-09-12T00:07:21.074049+0000","last_became_active":"2024-09-12T00:03:23.630183+0000","last_became_peered":"2024-09-12T00:03:23.630183+0000","last_unstale":"2024-09-12T00:07:21.074049+0000","last_undegraded":"2024-09-12T00:07:21.074049+0000","last_fullsized":"2024-09-12T00:07:21.074049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:21.073723+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:21.073723+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.073723+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:47.555815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:47.930409+0000","last_change":"2024-09-12T00:07:47.930409+0000","last_active":"2024-09-12T00:07:47.930409+0000","last_peered":"2024-09-12T00:07:47.930409+0000","last_clean":"2024-09-12T00:07:47.930409+0000","last_became_active":"2024-09-12T00:06:26.669946+0000","last_became_peered":"2024-09-12T00:06:26.669946+0000","last_unstale":"2024-09-12T00:07:47.930409+0000","last_undegraded":"2024-09-12T00:07:47.930409+0000","last_fullsized":"2024-09-12T00:07:47.930409+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:47.930222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:47.930222+0000","last_clean_scrub_stamp":"2024-09-12T00:07:47.930222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:27.203595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"116'30","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.273166+0000","last_change":"2024-09-12T00:07:32.273166+0000","last_active":"2024-09-12T00:07:32.273166+0000","last_peered":"2024-09-12T00:07:32.273166+0000","last_clean":"2024-09-12T00:07:32.273166+0000","last_became_active":"2024-09-12T00:03:29.338810+0000","last_became_peered":"2024-09-12T00:03:29.338810+0000","last_unstale":"2024-09-12T00:07:32.273166+0000","last_undegraded":"2024-09-12T00:07:32.273166+0000","last_fullsized":"2024-09-12T00:07:32.273166+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'30","last_scrub_stamp":"2024-09-12T00:07:32.272962+0000","last_deep_scrub":"116'30","last_deep_scrub_stamp":"2024-09-12T00:07:32.272962+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.272962+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:29.833021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"116'139","reported_seq":445,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:48.698615+0000","last_change":"2024-09-12T00:07:48.698484+0000","last_active":"2024-09-12T00:07:48.698615+0000","last_peered":"2024-09-12T00:07:48.698615+0000","last_clean":"2024-09-12T00:07:48.698615+0000","last_became_active":"2024-09-12T00:03:31.353547+0000","last_became_peered":"2024-09-12T00:03:31.353547+0000","last_unstale":"2024-09-12T00:07:48.698615+0000","last_undegraded":"2024-09-12T00:07:48.698615+0000","last_fullsized":"2024-09-12T00:07:48.698615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'139","last_scrub_stamp":"2024-09-12T00:07:48.698301+0000","last_deep_scrub":"116'139","last_deep_scrub_stamp":"2024-09-12T00:07:48.698301+0000","last_clean_scrub_stamp":"2024-09-12T00:07:48.698301+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:16.381262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"63'4","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:33.950171+0000","last_change":"2024-09-12T00:07:33.950171+0000","last_active":"2024-09-12T00:07:33.950171+0000","last_peered":"2024-09-12T00:07:33.950171+0000","last_clean":"2024-09-12T00:07:33.950171+0000","last_became_active":"2024-09-12T00:06:26.651618+0000","last_became_peered":"2024-09-12T00:06:26.651618+0000","last_unstale":"2024-09-12T00:07:33.950171+0000","last_undegraded":"2024-09-12T00:07:33.950171+0000","last_fullsized":"2024-09-12T00:07:33.950171+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'4","last_scrub_stamp":"2024-09-12T00:07:33.949941+0000","last_deep_scrub":"63'4","last_deep_scrub_stamp":"2024-09-12T00:07:33.949941+0000","last_clean_scrub_stamp":"2024-09-12T00:07:33.949941+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:33.740583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"116'56","reported_seq":262,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.444524+0000","last_change":"2024-09-12T00:07:18.444385+0000","last_active":"2024-09-12T00:07:18.444524+0000","last_peered":"2024-09-12T00:07:18.444524+0000","last_clean":"2024-09-12T00:07:18.444524+0000","last_became_active":"2024-09-12T00:03:23.601898+0000","last_became_peered":"2024-09-12T00:03:23.601898+0000","last_unstale":"2024-09-12T00:07:18.444524+0000","last_undegraded":"2024-09-12T00:07:18.444524+0000","last_fullsized":"2024-09-12T00:07:18.444524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-09-12T00:07:18.444202+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-09-12T00:07:18.444202+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.444202+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:27.955570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":64,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.151193+0000","last_change":"2024-09-12T00:07:29.151045+0000","last_active":"2024-09-12T00:07:29.151193+0000","last_peered":"2024-09-12T00:07:29.151193+0000","last_clean":"2024-09-12T00:07:29.151193+0000","last_became_active":"2024-09-12T00:03:27.329672+0000","last_became_peered":"2024-09-12T00:03:27.329672+0000","last_unstale":"2024-09-12T00:07:29.151193+0000","last_undegraded":"2024-09-12T00:07:29.151193+0000","last_fullsized":"2024-09-12T00:07:29.151193+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:29.150854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:29.150854+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.150854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:16.923691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"116'46","reported_seq":261,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:38.430202+0000","last_change":"2024-09-12T00:07:38.430007+0000","last_active":"2024-09-12T00:07:38.430202+0000","last_peered":"2024-09-12T00:07:38.430202+0000","last_clean":"2024-09-12T00:07:38.430202+0000","last_became_active":"2024-09-12T00:03:29.335044+0000","last_became_peered":"2024-09-12T00:03:29.335044+0000","last_unstale":"2024-09-12T00:07:38.430202+0000","last_undegraded":"2024-09-12T00:07:38.430202+0000","last_fullsized":"2024-09-12T00:07:38.430202+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:38.429810+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:38.429810+0000","last_clean_scrub_stamp":"2024-09-12T00:07:38.429810+0000","objects_scrubbed":10,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:15.268866+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:42.326677+0000","last_change":"2024-09-12T00:07:42.326451+0000","last_active":"2024-09-12T00:07:42.326677+0000","last_peered":"2024-09-12T00:07:42.326677+0000","last_clean":"2024-09-12T00:07:42.326677+0000","last_became_active":"2024-09-12T00:03:31.354160+0000","last_became_peered":"2024-09-12T00:03:31.354160+0000","last_unstale":"2024-09-12T00:07:42.326677+0000","last_undegraded":"2024-09-12T00:07:42.326677+0000","last_fullsized":"2024-09-12T00:07:42.326677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:42.326250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:42.326250+0000","last_clean_scrub_stamp":"2024-09-12T00:07:42.326250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:23.520170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:40.400209+0000","last_change":"2024-09-12T00:07:40.400069+0000","last_active":"2024-09-12T00:07:40.400209+0000","last_peered":"2024-09-12T00:07:40.400209+0000","last_clean":"2024-09-12T00:07:40.400209+0000","last_became_active":"2024-09-12T00:06:26.664401+0000","last_became_peered":"2024-09-12T00:06:26.664401+0000","last_unstale":"2024-09-12T00:07:40.400209+0000","last_undegraded":"2024-09-12T00:07:40.400209+0000","last_fullsized":"2024-09-12T00:07:40.400209+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:40.399856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:40.399856+0000","last_clean_scrub_stamp":"2024-09-12T00:07:40.399856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:38.248512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'2","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.072996+0000","last_change":"2024-09-12T00:07:22.072730+0000","last_active":"2024-09-12T00:07:22.072996+0000","last_peered":"2024-09-12T00:07:22.072996+0000","last_clean":"2024-09-12T00:07:22.072996+0000","last_became_active":"2024-09-12T00:03:25.356970+0000","last_became_peered":"2024-09-12T00:03:25.356970+0000","last_unstale":"2024-09-12T00:07:22.072996+0000","last_undegraded":"2024-09-12T00:07:22.072996+0000","last_fullsized":"2024-09-12T00:07:22.072996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:22.072506+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:22.072506+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.072506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:03.022155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"116'38","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.219384+0000","last_change":"2024-09-12T00:07:18.219294+0000","last_active":"2024-09-12T00:07:18.219384+0000","last_peered":"2024-09-12T00:07:18.219384+0000","last_clean":"2024-09-12T00:07:18.219384+0000","last_became_active":"2024-09-12T00:03:23.609435+0000","last_became_peered":"2024-09-12T00:03:23.609435+0000","last_unstale":"2024-09-12T00:07:18.219384+0000","last_undegraded":"2024-09-12T00:07:18.219384+0000","last_fullsized":"2024-09-12T00:07:18.219384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'38","last_scrub_stamp":"2024-09-12T00:07:18.219203+0000","last_deep_scrub":"116'38","last_deep_scrub_stamp":"2024-09-12T00:07:18.219203+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.219203+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:10.654482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.397532+0000","last_change":"2024-09-12T00:07:32.397357+0000","last_active":"2024-09-12T00:07:32.397532+0000","last_peered":"2024-09-12T00:07:32.397532+0000","last_clean":"2024-09-12T00:07:32.397532+0000","last_became_active":"2024-09-12T00:03:27.338880+0000","last_became_peered":"2024-09-12T00:03:27.338880+0000","last_unstale":"2024-09-12T00:07:32.397532+0000","last_undegraded":"2024-09-12T00:07:32.397532+0000","last_fullsized":"2024-09-12T00:07:32.397532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:32.397180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:32.397180+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.397180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:00.449041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"116'34","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:42.923291+0000","last_change":"2024-09-12T00:07:42.923136+0000","last_active":"2024-09-12T00:07:42.923291+0000","last_peered":"2024-09-12T00:07:42.923291+0000","last_clean":"2024-09-12T00:07:42.923291+0000","last_became_active":"2024-09-12T00:03:29.336957+0000","last_became_peered":"2024-09-12T00:03:29.336957+0000","last_unstale":"2024-09-12T00:07:42.923291+0000","last_undegraded":"2024-09-12T00:07:42.923291+0000","last_fullsized":"2024-09-12T00:07:42.923291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'34","last_scrub_stamp":"2024-09-12T00:07:42.922939+0000","last_deep_scrub":"116'34","last_deep_scrub_stamp":"2024-09-12T00:07:42.922939+0000","last_clean_scrub_stamp":"2024-09-12T00:07:42.922939+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:00.762698+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":36,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:48.921822+0000","last_change":"2024-09-12T00:07:48.921681+0000","last_active":"2024-09-12T00:07:48.921822+0000","last_peered":"2024-09-12T00:07:48.921822+0000","last_clean":"2024-09-12T00:07:48.921822+0000","last_became_active":"2024-09-12T00:03:31.347736+0000","last_became_peered":"2024-09-12T00:03:31.347736+0000","last_unstale":"2024-09-12T00:07:48.921822+0000","last_undegraded":"2024-09-12T00:07:48.921822+0000","last_fullsized":"2024-09-12T00:07:48.921822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:48.921505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:48.921505+0000","last_clean_scrub_stamp":"2024-09-12T00:07:48.921505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:44.064638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"59'8","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:44.183437+0000","last_change":"2024-09-12T00:07:44.183437+0000","last_active":"2024-09-12T00:07:44.183437+0000","last_peered":"2024-09-12T00:07:44.183437+0000","last_clean":"2024-09-12T00:07:44.183437+0000","last_became_active":"2024-09-12T00:03:33.378945+0000","last_became_peered":"2024-09-12T00:03:33.378945+0000","last_unstale":"2024-09-12T00:07:44.183437+0000","last_undegraded":"2024-09-12T00:07:44.183437+0000","last_fullsized":"2024-09-12T00:07:44.183437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'8","last_scrub_stamp":"2024-09-12T00:07:44.183239+0000","last_deep_scrub":"59'8","last_deep_scrub_stamp":"2024-09-12T00:07:44.183239+0000","last_clean_scrub_stamp":"2024-09-12T00:07:44.183239+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:14.693651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'6","reported_seq":252,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.164729+0000","last_change":"2024-09-12T00:07:23.164572+0000","last_active":"2024-09-12T00:07:23.164729+0000","last_peered":"2024-09-12T00:07:23.164729+0000","last_clean":"2024-09-12T00:07:23.164729+0000","last_became_active":"2024-09-12T00:06:26.668131+0000","last_became_peered":"2024-09-12T00:06:26.668131+0000","last_unstale":"2024-09-12T00:07:23.164729+0000","last_undegraded":"2024-09-12T00:07:23.164729+0000","last_fullsized":"2024-09-12T00:07:23.164729+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-09-12T00:07:23.164381+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-09-12T00:07:23.164381+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.164381+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:10.937218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"116'34","reported_seq":102,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.919676+0000","last_change":"2024-09-12T00:07:23.919676+0000","last_active":"2024-09-12T00:07:23.919676+0000","last_peered":"2024-09-12T00:07:23.919676+0000","last_clean":"2024-09-12T00:07:23.919676+0000","last_became_active":"2024-09-12T00:06:26.679723+0000","last_became_peered":"2024-09-12T00:06:26.679723+0000","last_unstale":"2024-09-12T00:07:23.919676+0000","last_undegraded":"2024-09-12T00:07:23.919676+0000","last_fullsized":"2024-09-12T00:07:23.919676+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'34","last_scrub_stamp":"2024-09-12T00:07:23.919458+0000","last_deep_scrub":"116'34","last_deep_scrub_stamp":"2024-09-12T00:07:23.919458+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.919458+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:33.257574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:42.635027+0000","last_change":"2024-09-12T00:07:42.634777+0000","last_active":"2024-09-12T00:07:42.635027+0000","last_peered":"2024-09-12T00:07:42.635027+0000","last_clean":"2024-09-12T00:07:42.635027+0000","last_became_active":"2024-09-12T00:03:27.347288+0000","last_became_peered":"2024-09-12T00:03:27.347288+0000","last_unstale":"2024-09-12T00:07:42.635027+0000","last_undegraded":"2024-09-12T00:07:42.635027+0000","last_fullsized":"2024-09-12T00:07:42.635027+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:42.634488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:42.634488+0000","last_clean_scrub_stamp":"2024-09-12T00:07:42.634488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:05.672734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"116'50","reported_seq":86,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:52.858695+0000","last_change":"2024-09-12T00:07:52.858695+0000","last_active":"2024-09-12T00:07:52.858695+0000","last_peered":"2024-09-12T00:07:52.858695+0000","last_clean":"2024-09-12T00:07:52.858695+0000","last_became_active":"2024-09-12T00:06:26.668791+0000","last_became_peered":"2024-09-12T00:06:26.668791+0000","last_unstale":"2024-09-12T00:07:52.858695+0000","last_undegraded":"2024-09-12T00:07:52.858695+0000","last_fullsized":"2024-09-12T00:07:52.858695+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'50","last_scrub_stamp":"2024-09-12T00:07:52.858509+0000","last_deep_scrub":"116'50","last_deep_scrub_stamp":"2024-09-12T00:07:52.858509+0000","last_clean_scrub_stamp":"2024-09-12T00:07:52.858509+0000","objects_scrubbed":9,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:53.507503+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":54,"num_read_kb":275,"num_write":34,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":116871,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"116'139","reported_seq":364,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:47.739523+0000","last_change":"2024-09-12T00:07:47.739361+0000","last_active":"2024-09-12T00:07:47.739523+0000","last_peered":"2024-09-12T00:07:47.739523+0000","last_clean":"2024-09-12T00:07:47.739523+0000","last_became_active":"2024-09-12T00:03:31.353358+0000","last_became_peered":"2024-09-12T00:03:31.353358+0000","last_unstale":"2024-09-12T00:07:47.739523+0000","last_undegraded":"2024-09-12T00:07:47.739523+0000","last_fullsized":"2024-09-12T00:07:47.739523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'139","last_scrub_stamp":"2024-09-12T00:07:47.739186+0000","last_deep_scrub":"116'139","last_deep_scrub_stamp":"2024-09-12T00:07:47.739186+0000","last_clean_scrub_stamp":"2024-09-12T00:07:47.739186+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:13.242982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:44.257168+0000","last_change":"2024-09-12T00:07:44.256922+0000","last_active":"2024-09-12T00:07:44.257168+0000","last_peered":"2024-09-12T00:07:44.257168+0000","last_clean":"2024-09-12T00:07:44.257168+0000","last_became_active":"2024-09-12T00:03:33.383199+0000","last_became_peered":"2024-09-12T00:03:33.383199+0000","last_unstale":"2024-09-12T00:07:44.257168+0000","last_undegraded":"2024-09-12T00:07:44.257168+0000","last_fullsized":"2024-09-12T00:07:44.257168+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:44.256700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:44.256700+0000","last_clean_scrub_stamp":"2024-09-12T00:07:44.256700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:12.761315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"84'10","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.602553+0000","last_change":"2024-09-12T00:07:30.602399+0000","last_active":"2024-09-12T00:07:30.602553+0000","last_peered":"2024-09-12T00:07:30.602553+0000","last_clean":"2024-09-12T00:07:30.602553+0000","last_became_active":"2024-09-12T00:03:25.354555+0000","last_became_peered":"2024-09-12T00:03:25.354555+0000","last_unstale":"2024-09-12T00:07:30.602553+0000","last_undegraded":"2024-09-12T00:07:30.602553+0000","last_fullsized":"2024-09-12T00:07:30.602553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'10","last_scrub_stamp":"2024-09-12T00:07:30.602214+0000","last_deep_scrub":"84'10","last_deep_scrub_stamp":"2024-09-12T00:07:30.602214+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.602214+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:28.647997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"116'78","reported_seq":283,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:17.443911+0000","last_change":"2024-09-12T00:07:17.443738+0000","last_active":"2024-09-12T00:07:17.443911+0000","last_peered":"2024-09-12T00:07:17.443911+0000","last_clean":"2024-09-12T00:07:17.443911+0000","last_became_active":"2024-09-12T00:03:23.612165+0000","last_became_peered":"2024-09-12T00:03:23.612165+0000","last_unstale":"2024-09-12T00:07:17.443911+0000","last_undegraded":"2024-09-12T00:07:17.443911+0000","last_fullsized":"2024-09-12T00:07:17.443911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'78","last_scrub_stamp":"2024-09-12T00:07:17.443535+0000","last_deep_scrub":"116'78","last_deep_scrub_stamp":"2024-09-12T00:07:17.443535+0000","last_clean_scrub_stamp":"2024-09-12T00:07:17.443535+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:50.491633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":78,"num_write_kb":159744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:33.379164+0000","last_change":"2024-09-12T00:07:33.379002+0000","last_active":"2024-09-12T00:07:33.379164+0000","last_peered":"2024-09-12T00:07:33.379164+0000","last_clean":"2024-09-12T00:07:33.379164+0000","last_became_active":"2024-09-12T00:03:27.328497+0000","last_became_peered":"2024-09-12T00:03:27.328497+0000","last_unstale":"2024-09-12T00:07:33.379164+0000","last_undegraded":"2024-09-12T00:07:33.379164+0000","last_fullsized":"2024-09-12T00:07:33.379164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:33.378826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:33.378826+0000","last_clean_scrub_stamp":"2024-09-12T00:07:33.378826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:30.180214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"116'57","reported_seq":279,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:41.923431+0000","last_change":"2024-09-12T00:07:41.923290+0000","last_active":"2024-09-12T00:07:41.923431+0000","last_peered":"2024-09-12T00:07:41.923431+0000","last_clean":"2024-09-12T00:07:41.923431+0000","last_became_active":"2024-09-12T00:03:29.332010+0000","last_became_peered":"2024-09-12T00:03:29.332010+0000","last_unstale":"2024-09-12T00:07:41.923431+0000","last_undegraded":"2024-09-12T00:07:41.923431+0000","last_fullsized":"2024-09-12T00:07:41.923431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'57","last_scrub_stamp":"2024-09-12T00:07:41.923099+0000","last_deep_scrub":"116'57","last_deep_scrub_stamp":"2024-09-12T00:07:41.923099+0000","last_clean_scrub_stamp":"2024-09-12T00:07:41.923099+0000","objects_scrubbed":7,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:59.119283+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":65,"num_read_kb":292,"num_write":38,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:46.711474+0000","last_change":"2024-09-12T00:07:46.711193+0000","last_active":"2024-09-12T00:07:46.711474+0000","last_peered":"2024-09-12T00:07:46.711474+0000","last_clean":"2024-09-12T00:07:46.711474+0000","last_became_active":"2024-09-12T00:03:31.353407+0000","last_became_peered":"2024-09-12T00:03:31.353407+0000","last_unstale":"2024-09-12T00:07:46.711474+0000","last_undegraded":"2024-09-12T00:07:46.711474+0000","last_fullsized":"2024-09-12T00:07:46.711474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:46.710931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:46.710931+0000","last_clean_scrub_stamp":"2024-09-12T00:07:46.710931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:30.181141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"116'8","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:39.906082+0000","last_change":"2024-09-12T00:07:39.905938+0000","last_active":"2024-09-12T00:07:39.906082+0000","last_peered":"2024-09-12T00:07:39.906082+0000","last_clean":"2024-09-12T00:07:39.906082+0000","last_became_active":"2024-09-12T00:03:33.384559+0000","last_became_peered":"2024-09-12T00:03:33.384559+0000","last_unstale":"2024-09-12T00:07:39.906082+0000","last_undegraded":"2024-09-12T00:07:39.906082+0000","last_fullsized":"2024-09-12T00:07:39.906082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'8","last_scrub_stamp":"2024-09-12T00:07:39.905739+0000","last_deep_scrub":"116'8","last_deep_scrub_stamp":"2024-09-12T00:07:39.905739+0000","last_clean_scrub_stamp":"2024-09-12T00:07:39.905739+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:37.942709+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"59'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.362035+0000","last_change":"2024-09-12T00:07:26.361838+0000","last_active":"2024-09-12T00:07:26.362035+0000","last_peered":"2024-09-12T00:07:26.362035+0000","last_clean":"2024-09-12T00:07:26.362035+0000","last_became_active":"2024-09-12T00:03:25.325840+0000","last_became_peered":"2024-09-12T00:03:25.325840+0000","last_unstale":"2024-09-12T00:07:26.362035+0000","last_undegraded":"2024-09-12T00:07:26.362035+0000","last_fullsized":"2024-09-12T00:07:26.362035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:26.361654+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:26.361654+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.361654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:43.783340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"116'44","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.861653+0000","last_change":"2024-09-12T00:07:19.861508+0000","last_active":"2024-09-12T00:07:19.861653+0000","last_peered":"2024-09-12T00:07:19.861653+0000","last_clean":"2024-09-12T00:07:19.861653+0000","last_became_active":"2024-09-12T00:03:23.616200+0000","last_became_peered":"2024-09-12T00:03:23.616200+0000","last_unstale":"2024-09-12T00:07:19.861653+0000","last_undegraded":"2024-09-12T00:07:19.861653+0000","last_fullsized":"2024-09-12T00:07:19.861653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-09-12T00:07:19.861326+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-09-12T00:07:19.861326+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.861326+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:33.997134+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.805590+0000","last_change":"2024-09-12T00:07:29.805445+0000","last_active":"2024-09-12T00:07:29.805590+0000","last_peered":"2024-09-12T00:07:29.805590+0000","last_clean":"2024-09-12T00:07:29.805590+0000","last_became_active":"2024-09-12T00:03:27.329830+0000","last_became_peered":"2024-09-12T00:03:27.329830+0000","last_unstale":"2024-09-12T00:07:29.805590+0000","last_undegraded":"2024-09-12T00:07:29.805590+0000","last_fullsized":"2024-09-12T00:07:29.805590+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:29.805265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:29.805265+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.805265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:21.107215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"116'33","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:34.069344+0000","last_change":"2024-09-12T00:07:34.069199+0000","last_active":"2024-09-12T00:07:34.069344+0000","last_peered":"2024-09-12T00:07:34.069344+0000","last_clean":"2024-09-12T00:07:34.069344+0000","last_became_active":"2024-09-12T00:03:29.343178+0000","last_became_peered":"2024-09-12T00:03:29.343178+0000","last_unstale":"2024-09-12T00:07:34.069344+0000","last_undegraded":"2024-09-12T00:07:34.069344+0000","last_fullsized":"2024-09-12T00:07:34.069344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'33","last_scrub_stamp":"2024-09-12T00:07:34.068993+0000","last_deep_scrub":"116'33","last_deep_scrub_stamp":"2024-09-12T00:07:34.068993+0000","last_clean_scrub_stamp":"2024-09-12T00:07:34.068993+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:57.768524+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:36.913172+0000","last_change":"2024-09-12T00:07:36.912950+0000","last_active":"2024-09-12T00:07:36.913172+0000","last_peered":"2024-09-12T00:07:36.913172+0000","last_clean":"2024-09-12T00:07:36.913172+0000","last_became_active":"2024-09-12T00:03:31.357272+0000","last_became_peered":"2024-09-12T00:03:31.357272+0000","last_unstale":"2024-09-12T00:07:36.913172+0000","last_undegraded":"2024-09-12T00:07:36.913172+0000","last_fullsized":"2024-09-12T00:07:36.913172+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:36.912723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:36.912723+0000","last_clean_scrub_stamp":"2024-09-12T00:07:36.912723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:05.320982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"76'4","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:51.775293+0000","last_change":"2024-09-12T00:07:51.775293+0000","last_active":"2024-09-12T00:07:51.775293+0000","last_peered":"2024-09-12T00:07:51.775293+0000","last_clean":"2024-09-12T00:07:51.775293+0000","last_became_active":"2024-09-12T00:06:26.653908+0000","last_became_peered":"2024-09-12T00:06:26.653908+0000","last_unstale":"2024-09-12T00:07:51.775293+0000","last_undegraded":"2024-09-12T00:07:51.775293+0000","last_fullsized":"2024-09-12T00:07:51.775293+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-12T00:07:51.775086+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-12T00:07:51.775086+0000","last_clean_scrub_stamp":"2024-09-12T00:07:51.775086+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:31.559749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"76'2","reported_seq":53,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:35.958822+0000","last_change":"2024-09-12T00:07:35.958822+0000","last_active":"2024-09-12T00:07:35.958822+0000","last_peered":"2024-09-12T00:07:35.958822+0000","last_clean":"2024-09-12T00:07:35.958822+0000","last_became_active":"2024-09-12T00:06:26.675405+0000","last_became_peered":"2024-09-12T00:06:26.675405+0000","last_unstale":"2024-09-12T00:07:35.958822+0000","last_undegraded":"2024-09-12T00:07:35.958822+0000","last_fullsized":"2024-09-12T00:07:35.958822+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-12T00:07:35.958543+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-12T00:07:35.958543+0000","last_clean_scrub_stamp":"2024-09-12T00:07:35.958543+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:23.450105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"116'42","reported_seq":114,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.870208+0000","last_change":"2024-09-12T00:07:20.870208+0000","last_active":"2024-09-12T00:07:20.870208+0000","last_peered":"2024-09-12T00:07:20.870208+0000","last_clean":"2024-09-12T00:07:20.870208+0000","last_became_active":"2024-09-12T00:06:26.663178+0000","last_became_peered":"2024-09-12T00:06:26.663178+0000","last_unstale":"2024-09-12T00:07:20.870208+0000","last_undegraded":"2024-09-12T00:07:20.870208+0000","last_fullsized":"2024-09-12T00:07:20.870208+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-09-12T00:07:20.870024+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-09-12T00:07:20.870024+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.870024+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:43.356712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":138412032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:43.643766+0000","last_change":"2024-09-12T00:07:43.643480+0000","last_active":"2024-09-12T00:07:43.643766+0000","last_peered":"2024-09-12T00:07:43.643766+0000","last_clean":"2024-09-12T00:07:43.643766+0000","last_became_active":"2024-09-12T00:03:27.341619+0000","last_became_peered":"2024-09-12T00:03:27.341619+0000","last_unstale":"2024-09-12T00:07:43.643766+0000","last_undegraded":"2024-09-12T00:07:43.643766+0000","last_fullsized":"2024-09-12T00:07:43.643766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:43.643277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:43.643277+0000","last_clean_scrub_stamp":"2024-09-12T00:07:43.643277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:48.517996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"116'32","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:40.681858+0000","last_change":"2024-09-12T00:07:40.681603+0000","last_active":"2024-09-12T00:07:40.681858+0000","last_peered":"2024-09-12T00:07:40.681858+0000","last_clean":"2024-09-12T00:07:40.681858+0000","last_became_active":"2024-09-12T00:03:29.335679+0000","last_became_peered":"2024-09-12T00:03:29.335679+0000","last_unstale":"2024-09-12T00:07:40.681858+0000","last_undegraded":"2024-09-12T00:07:40.681858+0000","last_fullsized":"2024-09-12T00:07:40.681858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-09-12T00:07:40.681265+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-09-12T00:07:40.681265+0000","last_clean_scrub_stamp":"2024-09-12T00:07:40.681265+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:56.906118+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"116'138","reported_seq":408,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:35.875095+0000","last_change":"2024-09-12T00:07:35.874898+0000","last_active":"2024-09-12T00:07:35.875095+0000","last_peered":"2024-09-12T00:07:35.875095+0000","last_clean":"2024-09-12T00:07:35.875095+0000","last_became_active":"2024-09-12T00:03:31.350264+0000","last_became_peered":"2024-09-12T00:03:31.350264+0000","last_unstale":"2024-09-12T00:07:35.875095+0000","last_undegraded":"2024-09-12T00:07:35.875095+0000","last_fullsized":"2024-09-12T00:07:35.875095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-09-12T00:07:35.874722+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-09-12T00:07:35.874722+0000","last_clean_scrub_stamp":"2024-09-12T00:07:35.874722+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:55.697038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"59'3","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:43.295187+0000","last_change":"2024-09-12T00:07:43.295021+0000","last_active":"2024-09-12T00:07:43.295187+0000","last_peered":"2024-09-12T00:07:43.295187+0000","last_clean":"2024-09-12T00:07:43.295187+0000","last_became_active":"2024-09-12T00:03:33.367424+0000","last_became_peered":"2024-09-12T00:03:33.367424+0000","last_unstale":"2024-09-12T00:07:43.295187+0000","last_undegraded":"2024-09-12T00:07:43.295187+0000","last_fullsized":"2024-09-12T00:07:43.295187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'3","last_scrub_stamp":"2024-09-12T00:07:43.294838+0000","last_deep_scrub":"59'3","last_deep_scrub_stamp":"2024-09-12T00:07:43.294838+0000","last_clean_scrub_stamp":"2024-09-12T00:07:43.294838+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:21.886060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"76'6","reported_seq":252,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:35.301705+0000","last_change":"2024-09-12T00:07:35.301546+0000","last_active":"2024-09-12T00:07:35.301705+0000","last_peered":"2024-09-12T00:07:35.301705+0000","last_clean":"2024-09-12T00:07:35.301705+0000","last_became_active":"2024-09-12T00:06:26.671547+0000","last_became_peered":"2024-09-12T00:06:26.671547+0000","last_unstale":"2024-09-12T00:07:35.301705+0000","last_undegraded":"2024-09-12T00:07:35.301705+0000","last_fullsized":"2024-09-12T00:07:35.301705+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'6","last_scrub_stamp":"2024-09-12T00:07:35.301343+0000","last_deep_scrub":"76'6","last_deep_scrub_stamp":"2024-09-12T00:07:35.301343+0000","last_clean_scrub_stamp":"2024-09-12T00:07:35.301343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:03.805958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"116'44","reported_seq":117,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.899518+0000","last_change":"2024-09-12T00:07:22.899518+0000","last_active":"2024-09-12T00:07:22.899518+0000","last_peered":"2024-09-12T00:07:22.899518+0000","last_clean":"2024-09-12T00:07:22.899518+0000","last_became_active":"2024-09-12T00:06:26.654104+0000","last_became_peered":"2024-09-12T00:06:26.654104+0000","last_unstale":"2024-09-12T00:07:22.899518+0000","last_undegraded":"2024-09-12T00:07:22.899518+0000","last_fullsized":"2024-09-12T00:07:22.899518+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-09-12T00:07:22.899334+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-09-12T00:07:22.899334+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.899334+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:43.870468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"116'4","reported_seq":383,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.122819+0000","last_change":"2024-09-12T00:07:31.122654+0000","last_active":"2024-09-12T00:07:31.122819+0000","last_peered":"2024-09-12T00:07:31.122819+0000","last_clean":"2024-09-12T00:07:31.122819+0000","last_became_active":"2024-09-12T00:03:27.330909+0000","last_became_peered":"2024-09-12T00:03:27.330909+0000","last_unstale":"2024-09-12T00:07:31.122819+0000","last_undegraded":"2024-09-12T00:07:31.122819+0000","last_fullsized":"2024-09-12T00:07:31.122819+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'4","last_scrub_stamp":"2024-09-12T00:07:31.122476+0000","last_deep_scrub":"116'4","last_deep_scrub_stamp":"2024-09-12T00:07:31.122476+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.122476+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:57.179433+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"116'16","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:37.336000+0000","last_change":"2024-09-12T00:07:37.335857+0000","last_active":"2024-09-12T00:07:37.336000+0000","last_peered":"2024-09-12T00:07:37.336000+0000","last_clean":"2024-09-12T00:07:37.336000+0000","last_became_active":"2024-09-12T00:03:29.338110+0000","last_became_peered":"2024-09-12T00:03:29.338110+0000","last_unstale":"2024-09-12T00:07:37.336000+0000","last_undegraded":"2024-09-12T00:07:37.336000+0000","last_fullsized":"2024-09-12T00:07:37.336000+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-09-12T00:07:37.335663+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-09-12T00:07:37.335663+0000","last_clean_scrub_stamp":"2024-09-12T00:07:37.335663+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:34.672725+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"116'138","reported_seq":414,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:40.155356+0000","last_change":"2024-09-12T00:07:40.155175+0000","last_active":"2024-09-12T00:07:40.155356+0000","last_peered":"2024-09-12T00:07:40.155356+0000","last_clean":"2024-09-12T00:07:40.155356+0000","last_became_active":"2024-09-12T00:03:31.338426+0000","last_became_peered":"2024-09-12T00:03:31.338426+0000","last_unstale":"2024-09-12T00:07:40.155356+0000","last_undegraded":"2024-09-12T00:07:40.155356+0000","last_fullsized":"2024-09-12T00:07:40.155356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-09-12T00:07:40.154984+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-09-12T00:07:40.154984+0000","last_clean_scrub_stamp":"2024-09-12T00:07:40.154984+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:41.135963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:42.374363+0000","last_change":"2024-09-12T00:07:42.374193+0000","last_active":"2024-09-12T00:07:42.374363+0000","last_peered":"2024-09-12T00:07:42.374363+0000","last_clean":"2024-09-12T00:07:42.374363+0000","last_became_active":"2024-09-12T00:03:33.380088+0000","last_became_peered":"2024-09-12T00:03:33.380088+0000","last_unstale":"2024-09-12T00:07:42.374363+0000","last_undegraded":"2024-09-12T00:07:42.374363+0000","last_fullsized":"2024-09-12T00:07:42.374363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:42.374013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:42.374013+0000","last_clean_scrub_stamp":"2024-09-12T00:07:42.374013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:19.681514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'4","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.795550+0000","last_change":"2024-09-12T00:07:22.795412+0000","last_active":"2024-09-12T00:07:22.795550+0000","last_peered":"2024-09-12T00:07:22.795550+0000","last_clean":"2024-09-12T00:07:22.795550+0000","last_became_active":"2024-09-12T00:03:25.335449+0000","last_became_peered":"2024-09-12T00:03:25.335449+0000","last_unstale":"2024-09-12T00:07:22.795550+0000","last_undegraded":"2024-09-12T00:07:22.795550+0000","last_fullsized":"2024-09-12T00:07:22.795550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-12T00:07:22.795197+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-12T00:07:22.795197+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.795197+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:58.768197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"116'48","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.773156+0000","last_change":"2024-09-12T00:07:21.773015+0000","last_active":"2024-09-12T00:07:21.773156+0000","last_peered":"2024-09-12T00:07:21.773156+0000","last_clean":"2024-09-12T00:07:21.773156+0000","last_became_active":"2024-09-12T00:03:23.614187+0000","last_became_peered":"2024-09-12T00:03:23.614187+0000","last_unstale":"2024-09-12T00:07:21.773156+0000","last_undegraded":"2024-09-12T00:07:21.773156+0000","last_fullsized":"2024-09-12T00:07:21.773156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-09-12T00:07:21.772812+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-09-12T00:07:21.772812+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.772812+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:50.277427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:44.975805+0000","last_change":"2024-09-12T00:07:44.975805+0000","last_active":"2024-09-12T00:07:44.975805+0000","last_peered":"2024-09-12T00:07:44.975805+0000","last_clean":"2024-09-12T00:07:44.975805+0000","last_became_active":"2024-09-12T00:06:26.670945+0000","last_became_peered":"2024-09-12T00:06:26.670945+0000","last_unstale":"2024-09-12T00:07:44.975805+0000","last_undegraded":"2024-09-12T00:07:44.975805+0000","last_fullsized":"2024-09-12T00:07:44.975805+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:44.975616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:44.975616+0000","last_clean_scrub_stamp":"2024-09-12T00:07:44.975616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:14.769822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"116'35","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:33.053625+0000","last_change":"2024-09-12T00:07:33.053460+0000","last_active":"2024-09-12T00:07:33.053625+0000","last_peered":"2024-09-12T00:07:33.053625+0000","last_clean":"2024-09-12T00:07:33.053625+0000","last_became_active":"2024-09-12T00:03:29.345243+0000","last_became_peered":"2024-09-12T00:03:29.345243+0000","last_unstale":"2024-09-12T00:07:33.053625+0000","last_undegraded":"2024-09-12T00:07:33.053625+0000","last_fullsized":"2024-09-12T00:07:33.053625+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'35","last_scrub_stamp":"2024-09-12T00:07:33.053267+0000","last_deep_scrub":"116'35","last_deep_scrub_stamp":"2024-09-12T00:07:33.053267+0000","last_clean_scrub_stamp":"2024-09-12T00:07:33.053267+0000","objects_scrubbed":8,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:21.156625+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:36.308763+0000","last_change":"2024-09-12T00:07:36.308605+0000","last_active":"2024-09-12T00:07:36.308763+0000","last_peered":"2024-09-12T00:07:36.308763+0000","last_clean":"2024-09-12T00:07:36.308763+0000","last_became_active":"2024-09-12T00:03:31.359763+0000","last_became_peered":"2024-09-12T00:03:31.359763+0000","last_unstale":"2024-09-12T00:07:36.308763+0000","last_undegraded":"2024-09-12T00:07:36.308763+0000","last_fullsized":"2024-09-12T00:07:36.308763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:36.308410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:36.308410+0000","last_clean_scrub_stamp":"2024-09-12T00:07:36.308410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:06.818823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"84'6","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:41.887683+0000","last_change":"2024-09-12T00:07:41.887502+0000","last_active":"2024-09-12T00:07:41.887683+0000","last_peered":"2024-09-12T00:07:41.887683+0000","last_clean":"2024-09-12T00:07:41.887683+0000","last_became_active":"2024-09-12T00:03:33.370562+0000","last_became_peered":"2024-09-12T00:03:33.370562+0000","last_unstale":"2024-09-12T00:07:41.887683+0000","last_undegraded":"2024-09-12T00:07:41.887683+0000","last_fullsized":"2024-09-12T00:07:41.887683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'6","last_scrub_stamp":"2024-09-12T00:07:41.887301+0000","last_deep_scrub":"84'6","last_deep_scrub_stamp":"2024-09-12T00:07:41.887301+0000","last_clean_scrub_stamp":"2024-09-12T00:07:41.887301+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:38.688689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'10","reported_seq":57,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:34.962485+0000","last_change":"2024-09-12T00:07:34.962485+0000","last_active":"2024-09-12T00:07:34.962485+0000","last_peered":"2024-09-12T00:07:34.962485+0000","last_clean":"2024-09-12T00:07:34.962485+0000","last_became_active":"2024-09-12T00:06:26.674937+0000","last_became_peered":"2024-09-12T00:06:26.674937+0000","last_unstale":"2024-09-12T00:07:34.962485+0000","last_undegraded":"2024-09-12T00:07:34.962485+0000","last_fullsized":"2024-09-12T00:07:34.962485+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'10","last_scrub_stamp":"2024-09-12T00:07:34.962282+0000","last_deep_scrub":"84'10","last_deep_scrub_stamp":"2024-09-12T00:07:34.962282+0000","last_clean_scrub_stamp":"2024-09-12T00:07:34.962282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:16.072883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"116'74","reported_seq":311,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.028450+0000","last_change":"2024-09-12T00:07:18.028450+0000","last_active":"2024-09-12T00:07:18.028450+0000","last_peered":"2024-09-12T00:07:18.028450+0000","last_clean":"2024-09-12T00:07:18.028450+0000","last_became_active":"2024-09-12T00:03:11.767988+0000","last_became_peered":"2024-09-12T00:03:11.767988+0000","last_unstale":"2024-09-12T00:07:18.028450+0000","last_undegraded":"2024-09-12T00:07:18.028450+0000","last_fullsized":"2024-09-12T00:07:18.028450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'74","last_scrub_stamp":"2024-09-12T00:07:18.028259+0000","last_deep_scrub":"116'74","last_deep_scrub_stamp":"2024-09-12T00:07:18.028259+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.028259+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:46.777805+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"116'2","reported_seq":54,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.898811+0000","last_change":"2024-09-12T00:07:18.898811+0000","last_active":"2024-09-12T00:07:18.898811+0000","last_peered":"2024-09-12T00:07:18.898811+0000","last_clean":"2024-09-12T00:07:18.898811+0000","last_became_active":"2024-09-12T00:06:26.671587+0000","last_became_peered":"2024-09-12T00:06:26.671587+0000","last_unstale":"2024-09-12T00:07:18.898811+0000","last_undegraded":"2024-09-12T00:07:18.898811+0000","last_fullsized":"2024-09-12T00:07:18.898811+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-09-12T00:07:18.898634+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-09-12T00:07:18.898634+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.898634+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:20.037927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"116'48","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.814966+0000","last_change":"2024-09-12T00:07:19.814801+0000","last_active":"2024-09-12T00:07:19.814966+0000","last_peered":"2024-09-12T00:07:19.814966+0000","last_clean":"2024-09-12T00:07:19.814966+0000","last_became_active":"2024-09-12T00:03:23.621146+0000","last_became_peered":"2024-09-12T00:03:23.621146+0000","last_unstale":"2024-09-12T00:07:19.814966+0000","last_undegraded":"2024-09-12T00:07:19.814966+0000","last_fullsized":"2024-09-12T00:07:19.814966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-09-12T00:07:19.814610+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-09-12T00:07:19.814610+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.814610+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:47.085845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:35.387468+0000","last_change":"2024-09-12T00:07:35.387207+0000","last_active":"2024-09-12T00:07:35.387468+0000","last_peered":"2024-09-12T00:07:35.387468+0000","last_clean":"2024-09-12T00:07:35.387468+0000","last_became_active":"2024-09-12T00:03:27.315502+0000","last_became_peered":"2024-09-12T00:03:27.315502+0000","last_unstale":"2024-09-12T00:07:35.387468+0000","last_undegraded":"2024-09-12T00:07:35.387468+0000","last_fullsized":"2024-09-12T00:07:35.387468+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:35.386990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:35.386990+0000","last_clean_scrub_stamp":"2024-09-12T00:07:35.386990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:49.567244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"116'59","reported_seq":90,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:49.846690+0000","last_change":"2024-09-12T00:07:49.846690+0000","last_active":"2024-09-12T00:07:49.846690+0000","last_peered":"2024-09-12T00:07:49.846690+0000","last_clean":"2024-09-12T00:07:49.846690+0000","last_became_active":"2024-09-12T00:06:26.667623+0000","last_became_peered":"2024-09-12T00:06:26.667623+0000","last_unstale":"2024-09-12T00:07:49.846690+0000","last_undegraded":"2024-09-12T00:07:49.846690+0000","last_fullsized":"2024-09-12T00:07:49.846690+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'59","last_scrub_stamp":"2024-09-12T00:07:49.846493+0000","last_deep_scrub":"116'59","last_deep_scrub_stamp":"2024-09-12T00:07:49.846493+0000","last_clean_scrub_stamp":"2024-09-12T00:07:49.846493+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:09.460477+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":56,"num_read_kb":44,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:45.706262+0000","last_change":"2024-09-12T00:07:45.706123+0000","last_active":"2024-09-12T00:07:45.706262+0000","last_peered":"2024-09-12T00:07:45.706262+0000","last_clean":"2024-09-12T00:07:45.706262+0000","last_became_active":"2024-09-12T00:03:31.360462+0000","last_became_peered":"2024-09-12T00:03:31.360462+0000","last_unstale":"2024-09-12T00:07:45.706262+0000","last_undegraded":"2024-09-12T00:07:45.706262+0000","last_fullsized":"2024-09-12T00:07:45.706262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:45.705946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:45.705946+0000","last_clean_scrub_stamp":"2024-09-12T00:07:45.705946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:20.894083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"59'4","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:39.383982+0000","last_change":"2024-09-12T00:07:39.383812+0000","last_active":"2024-09-12T00:07:39.383982+0000","last_peered":"2024-09-12T00:07:39.383982+0000","last_clean":"2024-09-12T00:07:39.383982+0000","last_became_active":"2024-09-12T00:03:33.387457+0000","last_became_peered":"2024-09-12T00:03:33.387457+0000","last_unstale":"2024-09-12T00:07:39.383982+0000","last_undegraded":"2024-09-12T00:07:39.383982+0000","last_fullsized":"2024-09-12T00:07:39.383982+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'4","last_scrub_stamp":"2024-09-12T00:07:39.383661+0000","last_deep_scrub":"59'4","last_deep_scrub_stamp":"2024-09-12T00:07:39.383661+0000","last_clean_scrub_stamp":"2024-09-12T00:07:39.383661+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:21.270638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.584395+0000","last_change":"2024-09-12T00:07:31.584125+0000","last_active":"2024-09-12T00:07:31.584395+0000","last_peered":"2024-09-12T00:07:31.584395+0000","last_clean":"2024-09-12T00:07:31.584395+0000","last_became_active":"2024-09-12T00:03:25.355306+0000","last_became_peered":"2024-09-12T00:03:25.355306+0000","last_unstale":"2024-09-12T00:07:31.584395+0000","last_undegraded":"2024-09-12T00:07:31.584395+0000","last_fullsized":"2024-09-12T00:07:31.584395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:31.583850+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:31.583850+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.583850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:37.980847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:16.961431+0000","last_change":"2024-09-12T00:07:16.961431+0000","last_active":"2024-09-12T00:07:16.961431+0000","last_peered":"2024-09-12T00:07:16.961431+0000","last_clean":"2024-09-12T00:07:16.961431+0000","last_became_active":"2024-09-12T00:06:26.653574+0000","last_became_peered":"2024-09-12T00:06:26.653574+0000","last_unstale":"2024-09-12T00:07:16.961431+0000","last_undegraded":"2024-09-12T00:07:16.961431+0000","last_fullsized":"2024-09-12T00:07:16.961431+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:16.961256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:16.961256+0000","last_clean_scrub_stamp":"2024-09-12T00:07:16.961256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:28.506803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"116'54","reported_seq":259,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.320022+0000","last_change":"2024-09-12T00:07:19.319837+0000","last_active":"2024-09-12T00:07:19.320022+0000","last_peered":"2024-09-12T00:07:19.320022+0000","last_clean":"2024-09-12T00:07:19.320022+0000","last_became_active":"2024-09-12T00:03:23.621358+0000","last_became_peered":"2024-09-12T00:03:23.621358+0000","last_unstale":"2024-09-12T00:07:19.320022+0000","last_undegraded":"2024-09-12T00:07:19.320022+0000","last_fullsized":"2024-09-12T00:07:19.320022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'54","last_scrub_stamp":"2024-09-12T00:07:19.319642+0000","last_deep_scrub":"116'54","last_deep_scrub_stamp":"2024-09-12T00:07:19.319642+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.319642+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:14.283628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":62,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:44.003624+0000","last_change":"2024-09-12T00:07:44.003624+0000","last_active":"2024-09-12T00:07:44.003624+0000","last_peered":"2024-09-12T00:07:44.003624+0000","last_clean":"2024-09-12T00:07:44.003624+0000","last_became_active":"2024-09-12T00:06:26.657376+0000","last_became_peered":"2024-09-12T00:06:26.657376+0000","last_unstale":"2024-09-12T00:07:44.003624+0000","last_undegraded":"2024-09-12T00:07:44.003624+0000","last_fullsized":"2024-09-12T00:07:44.003624+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:44.003442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:44.003442+0000","last_clean_scrub_stamp":"2024-09-12T00:07:44.003442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:07.381318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"116'160","reported_seq":470,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.833266+0000","last_change":"2024-09-12T00:07:32.832980+0000","last_active":"2024-09-12T00:07:32.833266+0000","last_peered":"2024-09-12T00:07:32.833266+0000","last_clean":"2024-09-12T00:07:32.833266+0000","last_became_active":"2024-09-12T00:03:29.346101+0000","last_became_peered":"2024-09-12T00:03:29.346101+0000","last_unstale":"2024-09-12T00:07:32.833266+0000","last_undegraded":"2024-09-12T00:07:32.833266+0000","last_fullsized":"2024-09-12T00:07:32.833266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'160","last_scrub_stamp":"2024-09-12T00:07:32.832708+0000","last_deep_scrub":"116'160","last_deep_scrub_stamp":"2024-09-12T00:07:32.832708+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.832708+0000","objects_scrubbed":11,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:16.374934+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":204,"num_read_kb":188,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:53.895038+0000","last_change":"2024-09-12T00:07:53.895038+0000","last_active":"2024-09-12T00:07:53.895038+0000","last_peered":"2024-09-12T00:07:53.895038+0000","last_clean":"2024-09-12T00:07:53.895038+0000","last_became_active":"2024-09-12T00:06:26.675966+0000","last_became_peered":"2024-09-12T00:06:26.675966+0000","last_unstale":"2024-09-12T00:07:53.895038+0000","last_undegraded":"2024-09-12T00:07:53.895038+0000","last_fullsized":"2024-09-12T00:07:53.895038+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:53.894866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:53.894866+0000","last_clean_scrub_stamp":"2024-09-12T00:07:53.894866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:51.863536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:50.739008+0000","last_change":"2024-09-12T00:07:50.738840+0000","last_active":"2024-09-12T00:07:50.739008+0000","last_peered":"2024-09-12T00:07:50.739008+0000","last_clean":"2024-09-12T00:07:50.739008+0000","last_became_active":"2024-09-12T00:03:33.384951+0000","last_became_peered":"2024-09-12T00:03:33.384951+0000","last_unstale":"2024-09-12T00:07:50.739008+0000","last_undegraded":"2024-09-12T00:07:50.739008+0000","last_fullsized":"2024-09-12T00:07:50.739008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:50.738595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:50.738595+0000","last_clean_scrub_stamp":"2024-09-12T00:07:50.738595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:57.570402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"59'2","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.430776+0000","last_change":"2024-09-12T00:07:28.430633+0000","last_active":"2024-09-12T00:07:28.430776+0000","last_peered":"2024-09-12T00:07:28.430776+0000","last_clean":"2024-09-12T00:07:28.430776+0000","last_became_active":"2024-09-12T00:03:25.331652+0000","last_became_peered":"2024-09-12T00:03:25.331652+0000","last_unstale":"2024-09-12T00:07:28.430776+0000","last_undegraded":"2024-09-12T00:07:28.430776+0000","last_fullsized":"2024-09-12T00:07:28.430776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:28.430454+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:28.430454+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.430454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:53.945942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.885956+0000","last_change":"2024-09-12T00:07:18.885829+0000","last_active":"2024-09-12T00:07:18.885956+0000","last_peered":"2024-09-12T00:07:18.885956+0000","last_clean":"2024-09-12T00:07:18.885956+0000","last_became_active":"2024-09-12T00:03:16.559698+0000","last_became_peered":"2024-09-12T00:03:16.559698+0000","last_unstale":"2024-09-12T00:07:18.885956+0000","last_undegraded":"2024-09-12T00:07:18.885956+0000","last_fullsized":"2024-09-12T00:07:18.885956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:18.885652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:18.885652+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.885652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:31.551246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00082440599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"116'44","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.680345+0000","last_change":"2024-09-12T00:07:20.680175+0000","last_active":"2024-09-12T00:07:20.680345+0000","last_peered":"2024-09-12T00:07:20.680345+0000","last_clean":"2024-09-12T00:07:20.680345+0000","last_became_active":"2024-09-12T00:03:23.632795+0000","last_became_peered":"2024-09-12T00:03:23.632795+0000","last_unstale":"2024-09-12T00:07:20.680345+0000","last_undegraded":"2024-09-12T00:07:20.680345+0000","last_fullsized":"2024-09-12T00:07:20.680345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-09-12T00:07:20.679987+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-09-12T00:07:20.679987+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.679987+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:34.961364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"116'2","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.810826+0000","last_change":"2024-09-12T00:07:31.810675+0000","last_active":"2024-09-12T00:07:31.810826+0000","last_peered":"2024-09-12T00:07:31.810826+0000","last_clean":"2024-09-12T00:07:31.810826+0000","last_became_active":"2024-09-12T00:03:27.326173+0000","last_became_peered":"2024-09-12T00:03:27.326173+0000","last_unstale":"2024-09-12T00:07:31.810826+0000","last_undegraded":"2024-09-12T00:07:31.810826+0000","last_fullsized":"2024-09-12T00:07:31.810826+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-09-12T00:07:31.810485+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-09-12T00:07:31.810485+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.810485+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:59.679817+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"116'25","reported_seq":263,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:33.386784+0000","last_change":"2024-09-12T00:07:33.386524+0000","last_active":"2024-09-12T00:07:33.386784+0000","last_peered":"2024-09-12T00:07:33.386784+0000","last_clean":"2024-09-12T00:07:33.386784+0000","last_became_active":"2024-09-12T00:03:29.337364+0000","last_became_peered":"2024-09-12T00:03:29.337364+0000","last_unstale":"2024-09-12T00:07:33.386784+0000","last_undegraded":"2024-09-12T00:07:33.386784+0000","last_fullsized":"2024-09-12T00:07:33.386784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'25","last_scrub_stamp":"2024-09-12T00:07:33.386081+0000","last_deep_scrub":"116'25","last_deep_scrub_stamp":"2024-09-12T00:07:33.386081+0000","last_clean_scrub_stamp":"2024-09-12T00:07:33.386081+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:51.980155+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:49.923089+0000","last_change":"2024-09-12T00:07:49.923089+0000","last_active":"2024-09-12T00:07:49.923089+0000","last_peered":"2024-09-12T00:07:49.923089+0000","last_clean":"2024-09-12T00:07:49.923089+0000","last_became_active":"2024-09-12T00:06:26.654068+0000","last_became_peered":"2024-09-12T00:06:26.654068+0000","last_unstale":"2024-09-12T00:07:49.923089+0000","last_undegraded":"2024-09-12T00:07:49.923089+0000","last_fullsized":"2024-09-12T00:07:49.923089+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:49.922916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:49.922916+0000","last_clean_scrub_stamp":"2024-09-12T00:07:49.922916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:26.574952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:53.929001+0000","last_change":"2024-09-12T00:07:53.928849+0000","last_active":"2024-09-12T00:07:53.929001+0000","last_peered":"2024-09-12T00:07:53.929001+0000","last_clean":"2024-09-12T00:07:53.929001+0000","last_became_active":"2024-09-12T00:03:33.353460+0000","last_became_peered":"2024-09-12T00:03:33.353460+0000","last_unstale":"2024-09-12T00:07:53.929001+0000","last_undegraded":"2024-09-12T00:07:53.929001+0000","last_fullsized":"2024-09-12T00:07:53.929001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:53.928670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:53.928670+0000","last_clean_scrub_stamp":"2024-09-12T00:07:53.928670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:48.568961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"84'8","reported_seq":234,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.396004+0000","last_change":"2024-09-12T00:07:27.395866+0000","last_active":"2024-09-12T00:07:27.396004+0000","last_peered":"2024-09-12T00:07:27.396004+0000","last_clean":"2024-09-12T00:07:27.396004+0000","last_became_active":"2024-09-12T00:03:25.333449+0000","last_became_peered":"2024-09-12T00:03:25.333449+0000","last_unstale":"2024-09-12T00:07:27.396004+0000","last_undegraded":"2024-09-12T00:07:27.396004+0000","last_fullsized":"2024-09-12T00:07:27.396004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'8","last_scrub_stamp":"2024-09-12T00:07:27.395672+0000","last_deep_scrub":"84'8","last_deep_scrub_stamp":"2024-09-12T00:07:27.395672+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.395672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:47.217988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"116'3","reported_seq":54,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:17.930005+0000","last_change":"2024-09-12T00:07:17.930005+0000","last_active":"2024-09-12T00:07:17.930005+0000","last_peered":"2024-09-12T00:07:17.930005+0000","last_clean":"2024-09-12T00:07:17.930005+0000","last_became_active":"2024-09-12T00:06:26.677047+0000","last_became_peered":"2024-09-12T00:06:26.677047+0000","last_unstale":"2024-09-12T00:07:17.930005+0000","last_undegraded":"2024-09-12T00:07:17.930005+0000","last_fullsized":"2024-09-12T00:07:17.930005+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'3","last_scrub_stamp":"2024-09-12T00:07:17.929893+0000","last_deep_scrub":"116'3","last_deep_scrub_stamp":"2024-09-12T00:07:17.929893+0000","last_clean_scrub_stamp":"2024-09-12T00:07:17.929893+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:22.176153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"116'42","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:15.478879+0000","last_change":"2024-09-12T00:07:15.478773+0000","last_active":"2024-09-12T00:07:15.478879+0000","last_peered":"2024-09-12T00:07:15.478879+0000","last_clean":"2024-09-12T00:07:15.478879+0000","last_became_active":"2024-09-12T00:03:23.610612+0000","last_became_peered":"2024-09-12T00:03:23.610612+0000","last_unstale":"2024-09-12T00:07:15.478879+0000","last_undegraded":"2024-09-12T00:07:15.478879+0000","last_fullsized":"2024-09-12T00:07:15.478879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-09-12T00:07:15.478642+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-09-12T00:07:15.478642+0000","last_clean_scrub_stamp":"2024-09-12T00:07:15.478642+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:48.811903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.848196+0000","last_change":"2024-09-12T00:07:30.848035+0000","last_active":"2024-09-12T00:07:30.848196+0000","last_peered":"2024-09-12T00:07:30.848196+0000","last_clean":"2024-09-12T00:07:30.848196+0000","last_became_active":"2024-09-12T00:03:27.338508+0000","last_became_peered":"2024-09-12T00:03:27.338508+0000","last_unstale":"2024-09-12T00:07:30.848196+0000","last_undegraded":"2024-09-12T00:07:30.848196+0000","last_fullsized":"2024-09-12T00:07:30.848196+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:30.847854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:30.847854+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.847854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:05.685985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"116'18","reported_seq":254,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:41.666142+0000","last_change":"2024-09-12T00:07:41.666008+0000","last_active":"2024-09-12T00:07:41.666142+0000","last_peered":"2024-09-12T00:07:41.666142+0000","last_clean":"2024-09-12T00:07:41.666142+0000","last_became_active":"2024-09-12T00:06:26.682354+0000","last_became_peered":"2024-09-12T00:06:26.682354+0000","last_unstale":"2024-09-12T00:07:41.666142+0000","last_undegraded":"2024-09-12T00:07:41.666142+0000","last_fullsized":"2024-09-12T00:07:41.666142+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'18","last_scrub_stamp":"2024-09-12T00:07:41.665819+0000","last_deep_scrub":"116'18","last_deep_scrub_stamp":"2024-09-12T00:07:41.665819+0000","last_clean_scrub_stamp":"2024-09-12T00:07:41.665819+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:51.550599+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:54.867402+0000","last_change":"2024-09-12T00:07:54.867402+0000","last_active":"2024-09-12T00:07:54.867402+0000","last_peered":"2024-09-12T00:07:54.867402+0000","last_clean":"2024-09-12T00:07:54.867402+0000","last_became_active":"2024-09-12T00:06:26.669787+0000","last_became_peered":"2024-09-12T00:06:26.669787+0000","last_unstale":"2024-09-12T00:07:54.867402+0000","last_undegraded":"2024-09-12T00:07:54.867402+0000","last_fullsized":"2024-09-12T00:07:54.867402+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:54.867209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:54.867209+0000","last_clean_scrub_stamp":"2024-09-12T00:07:54.867209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:29.394543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"63'7","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:45.145135+0000","last_change":"2024-09-12T00:07:45.144997+0000","last_active":"2024-09-12T00:07:45.145135+0000","last_peered":"2024-09-12T00:07:45.145135+0000","last_clean":"2024-09-12T00:07:45.145135+0000","last_became_active":"2024-09-12T00:03:33.366311+0000","last_became_peered":"2024-09-12T00:03:33.366311+0000","last_unstale":"2024-09-12T00:07:45.145135+0000","last_undegraded":"2024-09-12T00:07:45.145135+0000","last_fullsized":"2024-09-12T00:07:45.145135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'7","last_scrub_stamp":"2024-09-12T00:07:45.144783+0000","last_deep_scrub":"63'7","last_deep_scrub_stamp":"2024-09-12T00:07:45.144783+0000","last_clean_scrub_stamp":"2024-09-12T00:07:45.144783+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:41.712153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"96'8","reported_seq":265,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.333497+0000","last_change":"2024-09-12T00:07:25.333356+0000","last_active":"2024-09-12T00:07:25.333497+0000","last_peered":"2024-09-12T00:07:25.333497+0000","last_clean":"2024-09-12T00:07:25.333497+0000","last_became_active":"2024-09-12T00:06:26.675442+0000","last_became_peered":"2024-09-12T00:06:26.675442+0000","last_unstale":"2024-09-12T00:07:25.333497+0000","last_undegraded":"2024-09-12T00:07:25.333497+0000","last_fullsized":"2024-09-12T00:07:25.333497+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'8","last_scrub_stamp":"2024-09-12T00:07:25.333161+0000","last_deep_scrub":"96'8","last_deep_scrub_stamp":"2024-09-12T00:07:25.333161+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.333161+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:08.133560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"116'38","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:16.236058+0000","last_change":"2024-09-12T00:07:16.235989+0000","last_active":"2024-09-12T00:07:16.236058+0000","last_peered":"2024-09-12T00:07:16.236058+0000","last_clean":"2024-09-12T00:07:16.236058+0000","last_became_active":"2024-09-12T00:03:23.618716+0000","last_became_peered":"2024-09-12T00:03:23.618716+0000","last_unstale":"2024-09-12T00:07:16.236058+0000","last_undegraded":"2024-09-12T00:07:16.236058+0000","last_fullsized":"2024-09-12T00:07:16.236058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'38","last_scrub_stamp":"2024-09-12T00:07:16.235890+0000","last_deep_scrub":"116'38","last_deep_scrub_stamp":"2024-09-12T00:07:16.235890+0000","last_clean_scrub_stamp":"2024-09-12T00:07:16.235890+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:58.241008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.612406+0000","last_change":"2024-09-12T00:07:18.612250+0000","last_active":"2024-09-12T00:07:18.612406+0000","last_peered":"2024-09-12T00:07:18.612406+0000","last_clean":"2024-09-12T00:07:18.612406+0000","last_became_active":"2024-09-12T00:03:16.561218+0000","last_became_peered":"2024-09-12T00:03:16.561218+0000","last_unstale":"2024-09-12T00:07:18.612406+0000","last_undegraded":"2024-09-12T00:07:18.612406+0000","last_fullsized":"2024-09-12T00:07:18.612406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:18.612067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:18.612067+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.612067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:00.405912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084170299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:34.787686+0000","last_change":"2024-09-12T00:07:34.787525+0000","last_active":"2024-09-12T00:07:34.787686+0000","last_peered":"2024-09-12T00:07:34.787686+0000","last_clean":"2024-09-12T00:07:34.787686+0000","last_became_active":"2024-09-12T00:03:27.340391+0000","last_became_peered":"2024-09-12T00:03:27.340391+0000","last_unstale":"2024-09-12T00:07:34.787686+0000","last_undegraded":"2024-09-12T00:07:34.787686+0000","last_fullsized":"2024-09-12T00:07:34.787686+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:34.787352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:34.787352+0000","last_clean_scrub_stamp":"2024-09-12T00:07:34.787352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:55.516485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"116'65","reported_seq":289,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:33.837358+0000","last_change":"2024-09-12T00:07:33.837358+0000","last_active":"2024-09-12T00:07:33.837358+0000","last_peered":"2024-09-12T00:07:33.837358+0000","last_clean":"2024-09-12T00:07:33.837358+0000","last_became_active":"2024-09-12T00:03:29.346066+0000","last_became_peered":"2024-09-12T00:03:29.346066+0000","last_unstale":"2024-09-12T00:07:33.837358+0000","last_undegraded":"2024-09-12T00:07:33.837358+0000","last_fullsized":"2024-09-12T00:07:33.837358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'65","last_scrub_stamp":"2024-09-12T00:07:33.837085+0000","last_deep_scrub":"116'65","last_deep_scrub_stamp":"2024-09-12T00:07:33.837085+0000","last_clean_scrub_stamp":"2024-09-12T00:07:33.837085+0000","objects_scrubbed":10,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:16.637484+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":76,"num_read_kb":301,"num_write":46,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:37.336422+0000","last_change":"2024-09-12T00:07:37.336263+0000","last_active":"2024-09-12T00:07:37.336422+0000","last_peered":"2024-09-12T00:07:37.336422+0000","last_clean":"2024-09-12T00:07:37.336422+0000","last_became_active":"2024-09-12T00:03:31.346511+0000","last_became_peered":"2024-09-12T00:03:31.346511+0000","last_unstale":"2024-09-12T00:07:37.336422+0000","last_undegraded":"2024-09-12T00:07:37.336422+0000","last_fullsized":"2024-09-12T00:07:37.336422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:37.335987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:37.335987+0000","last_clean_scrub_stamp":"2024-09-12T00:07:37.335987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:33.903356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"59'7","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:53.822391+0000","last_change":"2024-09-12T00:07:53.822260+0000","last_active":"2024-09-12T00:07:53.822391+0000","last_peered":"2024-09-12T00:07:53.822391+0000","last_clean":"2024-09-12T00:07:53.822391+0000","last_became_active":"2024-09-12T00:03:33.384457+0000","last_became_peered":"2024-09-12T00:03:33.384457+0000","last_unstale":"2024-09-12T00:07:53.822391+0000","last_undegraded":"2024-09-12T00:07:53.822391+0000","last_fullsized":"2024-09-12T00:07:53.822391+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'7","last_scrub_stamp":"2024-09-12T00:07:53.822041+0000","last_deep_scrub":"59'7","last_deep_scrub_stamp":"2024-09-12T00:07:53.822041+0000","last_clean_scrub_stamp":"2024-09-12T00:07:53.822041+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:22.446796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"76'4","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.378056+0000","last_change":"2024-09-12T00:07:26.377897+0000","last_active":"2024-09-12T00:07:26.378056+0000","last_peered":"2024-09-12T00:07:26.378056+0000","last_clean":"2024-09-12T00:07:26.378056+0000","last_became_active":"2024-09-12T00:03:25.332814+0000","last_became_peered":"2024-09-12T00:03:25.332814+0000","last_unstale":"2024-09-12T00:07:26.378056+0000","last_undegraded":"2024-09-12T00:07:26.378056+0000","last_fullsized":"2024-09-12T00:07:26.378056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-12T00:07:26.377710+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-12T00:07:26.377710+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.377710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:53.843693+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"116'54","reported_seq":258,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.342369+0000","last_change":"2024-09-12T00:07:20.342225+0000","last_active":"2024-09-12T00:07:20.342369+0000","last_peered":"2024-09-12T00:07:20.342369+0000","last_clean":"2024-09-12T00:07:20.342369+0000","last_became_active":"2024-09-12T00:03:23.628128+0000","last_became_peered":"2024-09-12T00:03:23.628128+0000","last_unstale":"2024-09-12T00:07:20.342369+0000","last_undegraded":"2024-09-12T00:07:20.342369+0000","last_fullsized":"2024-09-12T00:07:20.342369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'54","last_scrub_stamp":"2024-09-12T00:07:20.342047+0000","last_deep_scrub":"116'54","last_deep_scrub_stamp":"2024-09-12T00:07:20.342047+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.342047+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:49.091593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.905666+0000","last_change":"2024-09-12T00:07:19.905666+0000","last_active":"2024-09-12T00:07:19.905666+0000","last_peered":"2024-09-12T00:07:19.905666+0000","last_clean":"2024-09-12T00:07:19.905666+0000","last_became_active":"2024-09-12T00:06:26.675309+0000","last_became_peered":"2024-09-12T00:06:26.675309+0000","last_unstale":"2024-09-12T00:07:19.905666+0000","last_undegraded":"2024-09-12T00:07:19.905666+0000","last_fullsized":"2024-09-12T00:07:19.905666+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:19.905470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:19.905470+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.905470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:53.120369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:34.364705+0000","last_change":"2024-09-12T00:07:34.364536+0000","last_active":"2024-09-12T00:07:34.364705+0000","last_peered":"2024-09-12T00:07:34.364705+0000","last_clean":"2024-09-12T00:07:34.364705+0000","last_became_active":"2024-09-12T00:03:27.315704+0000","last_became_peered":"2024-09-12T00:03:27.315704+0000","last_unstale":"2024-09-12T00:07:34.364705+0000","last_undegraded":"2024-09-12T00:07:34.364705+0000","last_fullsized":"2024-09-12T00:07:34.364705+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:34.364354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:34.364354+0000","last_clean_scrub_stamp":"2024-09-12T00:07:34.364354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:14.847442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"116'28","reported_seq":281,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:36.325130+0000","last_change":"2024-09-12T00:07:36.324986+0000","last_active":"2024-09-12T00:07:36.325130+0000","last_peered":"2024-09-12T00:07:36.325130+0000","last_clean":"2024-09-12T00:07:36.325130+0000","last_became_active":"2024-09-12T00:06:26.661284+0000","last_became_peered":"2024-09-12T00:06:26.661284+0000","last_unstale":"2024-09-12T00:07:36.325130+0000","last_undegraded":"2024-09-12T00:07:36.325130+0000","last_fullsized":"2024-09-12T00:07:36.325130+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-09-12T00:07:36.324760+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-09-12T00:07:36.324760+0000","last_clean_scrub_stamp":"2024-09-12T00:07:36.324760+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:01.632341+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"116'138","reported_seq":366,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:37.083533+0000","last_change":"2024-09-12T00:07:37.083533+0000","last_active":"2024-09-12T00:07:37.083533+0000","last_peered":"2024-09-12T00:07:37.083533+0000","last_clean":"2024-09-12T00:07:37.083533+0000","last_became_active":"2024-09-12T00:03:31.356108+0000","last_became_peered":"2024-09-12T00:03:31.356108+0000","last_unstale":"2024-09-12T00:07:37.083533+0000","last_undegraded":"2024-09-12T00:07:37.083533+0000","last_fullsized":"2024-09-12T00:07:37.083533+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-09-12T00:07:37.083321+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-09-12T00:07:37.083321+0000","last_clean_scrub_stamp":"2024-09-12T00:07:37.083321+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:17.220783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"58'2","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:42.874098+0000","last_change":"2024-09-12T00:07:42.873945+0000","last_active":"2024-09-12T00:07:42.874098+0000","last_peered":"2024-09-12T00:07:42.874098+0000","last_clean":"2024-09-12T00:07:42.874098+0000","last_became_active":"2024-09-12T00:03:33.371214+0000","last_became_peered":"2024-09-12T00:03:33.371214+0000","last_unstale":"2024-09-12T00:07:42.874098+0000","last_undegraded":"2024-09-12T00:07:42.874098+0000","last_fullsized":"2024-09-12T00:07:42.874098+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:42.873746+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:42.873746+0000","last_clean_scrub_stamp":"2024-09-12T00:07:42.873746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:31.735167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"84'8","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.825158+0000","last_change":"2024-09-12T00:07:26.825010+0000","last_active":"2024-09-12T00:07:26.825158+0000","last_peered":"2024-09-12T00:07:26.825158+0000","last_clean":"2024-09-12T00:07:26.825158+0000","last_became_active":"2024-09-12T00:03:25.331250+0000","last_became_peered":"2024-09-12T00:03:25.331250+0000","last_unstale":"2024-09-12T00:07:26.825158+0000","last_undegraded":"2024-09-12T00:07:26.825158+0000","last_fullsized":"2024-09-12T00:07:26.825158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'8","last_scrub_stamp":"2024-09-12T00:07:26.824802+0000","last_deep_scrub":"84'8","last_deep_scrub_stamp":"2024-09-12T00:07:26.824802+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.824802+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:24.673458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"116'46","reported_seq":249,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.804704+0000","last_change":"2024-09-12T00:07:20.804454+0000","last_active":"2024-09-12T00:07:20.804704+0000","last_peered":"2024-09-12T00:07:20.804704+0000","last_clean":"2024-09-12T00:07:20.804704+0000","last_became_active":"2024-09-12T00:03:23.601481+0000","last_became_peered":"2024-09-12T00:03:23.601481+0000","last_unstale":"2024-09-12T00:07:20.804704+0000","last_undegraded":"2024-09-12T00:07:20.804704+0000","last_fullsized":"2024-09-12T00:07:20.804704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:20.804249+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:20.804249+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.804249+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:51.271894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:17.867338+0000","last_change":"2024-09-12T00:07:17.867195+0000","last_active":"2024-09-12T00:07:17.867338+0000","last_peered":"2024-09-12T00:07:17.867338+0000","last_clean":"2024-09-12T00:07:17.867338+0000","last_became_active":"2024-09-12T00:03:16.594609+0000","last_became_peered":"2024-09-12T00:03:16.594609+0000","last_unstale":"2024-09-12T00:07:17.867338+0000","last_undegraded":"2024-09-12T00:07:17.867338+0000","last_fullsized":"2024-09-12T00:07:17.867338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:17.867017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:17.867017+0000","last_clean_scrub_stamp":"2024-09-12T00:07:17.867017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:30.089273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010254439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:42.970796+0000","last_change":"2024-09-12T00:07:42.970796+0000","last_active":"2024-09-12T00:07:42.970796+0000","last_peered":"2024-09-12T00:07:42.970796+0000","last_clean":"2024-09-12T00:07:42.970796+0000","last_became_active":"2024-09-12T00:06:26.647055+0000","last_became_peered":"2024-09-12T00:06:26.647055+0000","last_unstale":"2024-09-12T00:07:42.970796+0000","last_undegraded":"2024-09-12T00:07:42.970796+0000","last_fullsized":"2024-09-12T00:07:42.970796+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:42.970599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:42.970599+0000","last_clean_scrub_stamp":"2024-09-12T00:07:42.970599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:42.396029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"116'24","reported_seq":69,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:48.891886+0000","last_change":"2024-09-12T00:07:48.891886+0000","last_active":"2024-09-12T00:07:48.891886+0000","last_peered":"2024-09-12T00:07:48.891886+0000","last_clean":"2024-09-12T00:07:48.891886+0000","last_became_active":"2024-09-12T00:06:26.662450+0000","last_became_peered":"2024-09-12T00:06:26.662450+0000","last_unstale":"2024-09-12T00:07:48.891886+0000","last_undegraded":"2024-09-12T00:07:48.891886+0000","last_fullsized":"2024-09-12T00:07:48.891886+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'24","last_scrub_stamp":"2024-09-12T00:07:48.891689+0000","last_deep_scrub":"116'24","last_deep_scrub_stamp":"2024-09-12T00:07:48.891689+0000","last_clean_scrub_stamp":"2024-09-12T00:07:48.891689+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:14.055491+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"116'139","reported_seq":364,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:44.663882+0000","last_change":"2024-09-12T00:07:44.663882+0000","last_active":"2024-09-12T00:07:44.663882+0000","last_peered":"2024-09-12T00:07:44.663882+0000","last_clean":"2024-09-12T00:07:44.663882+0000","last_became_active":"2024-09-12T00:03:31.360518+0000","last_became_peered":"2024-09-12T00:03:31.360518+0000","last_unstale":"2024-09-12T00:07:44.663882+0000","last_undegraded":"2024-09-12T00:07:44.663882+0000","last_fullsized":"2024-09-12T00:07:44.663882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'139","last_scrub_stamp":"2024-09-12T00:07:44.663703+0000","last_deep_scrub":"116'139","last_deep_scrub_stamp":"2024-09-12T00:07:44.663703+0000","last_clean_scrub_stamp":"2024-09-12T00:07:44.663703+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:02.455335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:52.810382+0000","last_change":"2024-09-12T00:07:52.810119+0000","last_active":"2024-09-12T00:07:52.810382+0000","last_peered":"2024-09-12T00:07:52.810382+0000","last_clean":"2024-09-12T00:07:52.810382+0000","last_became_active":"2024-09-12T00:03:33.377669+0000","last_became_peered":"2024-09-12T00:03:33.377669+0000","last_unstale":"2024-09-12T00:07:52.810382+0000","last_undegraded":"2024-09-12T00:07:52.810382+0000","last_fullsized":"2024-09-12T00:07:52.810382+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:52.809915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:52.809915+0000","last_clean_scrub_stamp":"2024-09-12T00:07:52.809915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:49.071105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":253,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.171508+0000","last_change":"2024-09-12T00:07:19.171336+0000","last_active":"2024-09-12T00:07:19.171508+0000","last_peered":"2024-09-12T00:07:19.171508+0000","last_clean":"2024-09-12T00:07:19.171508+0000","last_became_active":"2024-09-12T00:06:26.662114+0000","last_became_peered":"2024-09-12T00:06:26.662114+0000","last_unstale":"2024-09-12T00:07:19.171508+0000","last_undegraded":"2024-09-12T00:07:19.171508+0000","last_fullsized":"2024-09-12T00:07:19.171508+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2024-09-12T00:07:19.171030+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2024-09-12T00:07:19.171030+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.171030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:47.579289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"116'46","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:18.837434+0000","last_change":"2024-09-12T00:07:18.837245+0000","last_active":"2024-09-12T00:07:18.837434+0000","last_peered":"2024-09-12T00:07:18.837434+0000","last_clean":"2024-09-12T00:07:18.837434+0000","last_became_active":"2024-09-12T00:03:23.615158+0000","last_became_peered":"2024-09-12T00:03:23.615158+0000","last_unstale":"2024-09-12T00:07:18.837434+0000","last_undegraded":"2024-09-12T00:07:18.837434+0000","last_fullsized":"2024-09-12T00:07:18.837434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:18.837058+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:18.837058+0000","last_clean_scrub_stamp":"2024-09-12T00:07:18.837058+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:06.154923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":54,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.868118+0000","last_change":"2024-09-12T00:07:21.868118+0000","last_active":"2024-09-12T00:07:21.868118+0000","last_peered":"2024-09-12T00:07:21.868118+0000","last_clean":"2024-09-12T00:07:21.868118+0000","last_became_active":"2024-09-12T00:06:26.677544+0000","last_became_peered":"2024-09-12T00:06:26.677544+0000","last_unstale":"2024-09-12T00:07:21.868118+0000","last_undegraded":"2024-09-12T00:07:21.868118+0000","last_fullsized":"2024-09-12T00:07:21.868118+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:21.867941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:21.867941+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.867941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:07.516631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:35.818291+0000","last_change":"2024-09-12T00:07:35.818291+0000","last_active":"2024-09-12T00:07:35.818291+0000","last_peered":"2024-09-12T00:07:35.818291+0000","last_clean":"2024-09-12T00:07:35.818291+0000","last_became_active":"2024-09-12T00:03:27.336289+0000","last_became_peered":"2024-09-12T00:03:27.336289+0000","last_unstale":"2024-09-12T00:07:35.818291+0000","last_undegraded":"2024-09-12T00:07:35.818291+0000","last_fullsized":"2024-09-12T00:07:35.818291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:35.818085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:35.818085+0000","last_clean_scrub_stamp":"2024-09-12T00:07:35.818085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:27.057630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"116'65","reported_seq":293,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.358250+0000","last_change":"2024-09-12T00:07:32.358164+0000","last_active":"2024-09-12T00:07:32.358250+0000","last_peered":"2024-09-12T00:07:32.358250+0000","last_clean":"2024-09-12T00:07:32.358250+0000","last_became_active":"2024-09-12T00:03:29.343779+0000","last_became_peered":"2024-09-12T00:03:29.343779+0000","last_unstale":"2024-09-12T00:07:32.358250+0000","last_undegraded":"2024-09-12T00:07:32.358250+0000","last_fullsized":"2024-09-12T00:07:32.358250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'65","last_scrub_stamp":"2024-09-12T00:07:32.358046+0000","last_deep_scrub":"116'65","last_deep_scrub_stamp":"2024-09-12T00:07:32.358046+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.358046+0000","objects_scrubbed":9,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:33.247176+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:45.897029+0000","last_change":"2024-09-12T00:07:45.897029+0000","last_active":"2024-09-12T00:07:45.897029+0000","last_peered":"2024-09-12T00:07:45.897029+0000","last_clean":"2024-09-12T00:07:45.897029+0000","last_became_active":"2024-09-12T00:03:31.334701+0000","last_became_peered":"2024-09-12T00:03:31.334701+0000","last_unstale":"2024-09-12T00:07:45.897029+0000","last_undegraded":"2024-09-12T00:07:45.897029+0000","last_fullsized":"2024-09-12T00:07:45.897029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:45.896838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:45.896838+0000","last_clean_scrub_stamp":"2024-09-12T00:07:45.896838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:20.509397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"58'4","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:43.378344+0000","last_change":"2024-09-12T00:07:43.378177+0000","last_active":"2024-09-12T00:07:43.378344+0000","last_peered":"2024-09-12T00:07:43.378344+0000","last_clean":"2024-09-12T00:07:43.378344+0000","last_became_active":"2024-09-12T00:03:33.385090+0000","last_became_peered":"2024-09-12T00:03:33.385090+0000","last_unstale":"2024-09-12T00:07:43.378344+0000","last_undegraded":"2024-09-12T00:07:43.378344+0000","last_fullsized":"2024-09-12T00:07:43.378344+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'4","last_scrub_stamp":"2024-09-12T00:07:43.377993+0000","last_deep_scrub":"58'4","last_deep_scrub_stamp":"2024-09-12T00:07:43.377993+0000","last_clean_scrub_stamp":"2024-09-12T00:07:43.377993+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:18.701171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"96'2","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:52.930903+0000","last_change":"2024-09-12T00:07:52.930903+0000","last_active":"2024-09-12T00:07:52.930903+0000","last_peered":"2024-09-12T00:07:52.930903+0000","last_clean":"2024-09-12T00:07:52.930903+0000","last_became_active":"2024-09-12T00:03:33.360980+0000","last_became_peered":"2024-09-12T00:03:33.360980+0000","last_unstale":"2024-09-12T00:07:52.930903+0000","last_undegraded":"2024-09-12T00:07:52.930903+0000","last_fullsized":"2024-09-12T00:07:52.930903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'2","last_scrub_stamp":"2024-09-12T00:07:52.930725+0000","last_deep_scrub":"96'2","last_deep_scrub_stamp":"2024-09-12T00:07:52.930725+0000","last_clean_scrub_stamp":"2024-09-12T00:07:52.930725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:45.117668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"59'2","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.289589+0000","last_change":"2024-09-12T00:07:28.289411+0000","last_active":"2024-09-12T00:07:28.289589+0000","last_peered":"2024-09-12T00:07:28.289589+0000","last_clean":"2024-09-12T00:07:28.289589+0000","last_became_active":"2024-09-12T00:06:26.664337+0000","last_became_peered":"2024-09-12T00:06:26.664337+0000","last_unstale":"2024-09-12T00:07:28.289589+0000","last_undegraded":"2024-09-12T00:07:28.289589+0000","last_fullsized":"2024-09-12T00:07:28.289589+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:28.289212+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:28.289212+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.289212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:53.596793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"116'60","reported_seq":141,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.902261+0000","last_change":"2024-09-12T00:07:24.902261+0000","last_active":"2024-09-12T00:07:24.902261+0000","last_peered":"2024-09-12T00:07:24.902261+0000","last_clean":"2024-09-12T00:07:24.902261+0000","last_became_active":"2024-09-12T00:06:26.671623+0000","last_became_peered":"2024-09-12T00:06:26.671623+0000","last_unstale":"2024-09-12T00:07:24.902261+0000","last_undegraded":"2024-09-12T00:07:24.902261+0000","last_fullsized":"2024-09-12T00:07:24.902261+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'60","last_scrub_stamp":"2024-09-12T00:07:24.902070+0000","last_deep_scrub":"116'60","last_deep_scrub_stamp":"2024-09-12T00:07:24.902070+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.902070+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:19.416818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":201326592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"116'4","reported_seq":382,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:34.352707+0000","last_change":"2024-09-12T00:07:34.352557+0000","last_active":"2024-09-12T00:07:34.352707+0000","last_peered":"2024-09-12T00:07:34.352707+0000","last_clean":"2024-09-12T00:07:34.352707+0000","last_became_active":"2024-09-12T00:03:27.331527+0000","last_became_peered":"2024-09-12T00:03:27.331527+0000","last_unstale":"2024-09-12T00:07:34.352707+0000","last_undegraded":"2024-09-12T00:07:34.352707+0000","last_fullsized":"2024-09-12T00:07:34.352707+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'4","last_scrub_stamp":"2024-09-12T00:07:34.352366+0000","last_deep_scrub":"116'4","last_deep_scrub_stamp":"2024-09-12T00:07:34.352366+0000","last_clean_scrub_stamp":"2024-09-12T00:07:34.352366+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:23.213786+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":272,"num_read_kb":272,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"116'33","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:38.332766+0000","last_change":"2024-09-12T00:07:38.332540+0000","last_active":"2024-09-12T00:07:38.332766+0000","last_peered":"2024-09-12T00:07:38.332766+0000","last_clean":"2024-09-12T00:07:38.332766+0000","last_became_active":"2024-09-12T00:03:29.337905+0000","last_became_peered":"2024-09-12T00:03:29.337905+0000","last_unstale":"2024-09-12T00:07:38.332766+0000","last_undegraded":"2024-09-12T00:07:38.332766+0000","last_fullsized":"2024-09-12T00:07:38.332766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'33","last_scrub_stamp":"2024-09-12T00:07:38.332295+0000","last_deep_scrub":"116'33","last_deep_scrub_stamp":"2024-09-12T00:07:38.332295+0000","last_clean_scrub_stamp":"2024-09-12T00:07:38.332295+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:11.906256+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:37.898682+0000","last_change":"2024-09-12T00:07:37.898462+0000","last_active":"2024-09-12T00:07:37.898682+0000","last_peered":"2024-09-12T00:07:37.898682+0000","last_clean":"2024-09-12T00:07:37.898682+0000","last_became_active":"2024-09-12T00:03:31.350917+0000","last_became_peered":"2024-09-12T00:03:31.350917+0000","last_unstale":"2024-09-12T00:07:37.898682+0000","last_undegraded":"2024-09-12T00:07:37.898682+0000","last_fullsized":"2024-09-12T00:07:37.898682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:37.898185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:37.898185+0000","last_clean_scrub_stamp":"2024-09-12T00:07:37.898185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:18.111126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:43.895069+0000","last_change":"2024-09-12T00:07:43.895069+0000","last_active":"2024-09-12T00:07:43.895069+0000","last_peered":"2024-09-12T00:07:43.895069+0000","last_clean":"2024-09-12T00:07:43.895069+0000","last_became_active":"2024-09-12T00:03:33.373466+0000","last_became_peered":"2024-09-12T00:03:33.373466+0000","last_unstale":"2024-09-12T00:07:43.895069+0000","last_undegraded":"2024-09-12T00:07:43.895069+0000","last_fullsized":"2024-09-12T00:07:43.895069+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:43.894895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:43.894895+0000","last_clean_scrub_stamp":"2024-09-12T00:07:43.894895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:42.720403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"59'2","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.787936+0000","last_change":"2024-09-12T00:07:27.787660+0000","last_active":"2024-09-12T00:07:27.787936+0000","last_peered":"2024-09-12T00:07:27.787936+0000","last_clean":"2024-09-12T00:07:27.787936+0000","last_became_active":"2024-09-12T00:06:26.664003+0000","last_became_peered":"2024-09-12T00:06:26.664003+0000","last_unstale":"2024-09-12T00:07:27.787936+0000","last_undegraded":"2024-09-12T00:07:27.787936+0000","last_fullsized":"2024-09-12T00:07:27.787936+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:27.787370+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:27.787370+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.787370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:28.484493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"116'46","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:16.450151+0000","last_change":"2024-09-12T00:07:16.450064+0000","last_active":"2024-09-12T00:07:16.450151+0000","last_peered":"2024-09-12T00:07:16.450151+0000","last_clean":"2024-09-12T00:07:16.450151+0000","last_became_active":"2024-09-12T00:03:23.612941+0000","last_became_peered":"2024-09-12T00:03:23.612941+0000","last_unstale":"2024-09-12T00:07:16.450151+0000","last_undegraded":"2024-09-12T00:07:16.450151+0000","last_fullsized":"2024-09-12T00:07:16.450151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:16.449941+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:16.449941+0000","last_clean_scrub_stamp":"2024-09-12T00:07:16.449941+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:25.970740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:38.909859+0000","last_change":"2024-09-12T00:07:38.909624+0000","last_active":"2024-09-12T00:07:38.909859+0000","last_peered":"2024-09-12T00:07:38.909859+0000","last_clean":"2024-09-12T00:07:38.909859+0000","last_became_active":"2024-09-12T00:03:27.335372+0000","last_became_peered":"2024-09-12T00:03:27.335372+0000","last_unstale":"2024-09-12T00:07:38.909859+0000","last_undegraded":"2024-09-12T00:07:38.909859+0000","last_fullsized":"2024-09-12T00:07:38.909859+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:38.909430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:38.909430+0000","last_clean_scrub_stamp":"2024-09-12T00:07:38.909430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:28.391637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"116'14","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:43.892471+0000","last_change":"2024-09-12T00:07:43.892344+0000","last_active":"2024-09-12T00:07:43.892471+0000","last_peered":"2024-09-12T00:07:43.892471+0000","last_clean":"2024-09-12T00:07:43.892471+0000","last_became_active":"2024-09-12T00:03:29.331243+0000","last_became_peered":"2024-09-12T00:03:29.331243+0000","last_unstale":"2024-09-12T00:07:43.892471+0000","last_undegraded":"2024-09-12T00:07:43.892471+0000","last_fullsized":"2024-09-12T00:07:43.892471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-09-12T00:07:43.892156+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-09-12T00:07:43.892156+0000","last_clean_scrub_stamp":"2024-09-12T00:07:43.892156+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:36.535339+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:39.394060+0000","last_change":"2024-09-12T00:07:39.394008+0000","last_active":"2024-09-12T00:07:39.394060+0000","last_peered":"2024-09-12T00:07:39.394060+0000","last_clean":"2024-09-12T00:07:39.394060+0000","last_became_active":"2024-09-12T00:03:31.344407+0000","last_became_peered":"2024-09-12T00:03:31.344407+0000","last_unstale":"2024-09-12T00:07:39.394060+0000","last_undegraded":"2024-09-12T00:07:39.394060+0000","last_fullsized":"2024-09-12T00:07:39.394060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:39.393945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:39.393945+0000","last_clean_scrub_stamp":"2024-09-12T00:07:39.393945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:42.544058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"84'2","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:46.299318+0000","last_change":"2024-09-12T00:07:46.299318+0000","last_active":"2024-09-12T00:07:46.299318+0000","last_peered":"2024-09-12T00:07:46.299318+0000","last_clean":"2024-09-12T00:07:46.299318+0000","last_became_active":"2024-09-12T00:03:33.369538+0000","last_became_peered":"2024-09-12T00:03:33.369538+0000","last_unstale":"2024-09-12T00:07:46.299318+0000","last_undegraded":"2024-09-12T00:07:46.299318+0000","last_fullsized":"2024-09-12T00:07:46.299318+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-09-12T00:07:46.299105+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-09-12T00:07:46.299105+0000","last_clean_scrub_stamp":"2024-09-12T00:07:46.299105+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:42.866475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"59'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.781227+0000","last_change":"2024-09-12T00:07:25.781068+0000","last_active":"2024-09-12T00:07:25.781227+0000","last_peered":"2024-09-12T00:07:25.781227+0000","last_clean":"2024-09-12T00:07:25.781227+0000","last_became_active":"2024-09-12T00:03:25.340288+0000","last_became_peered":"2024-09-12T00:03:25.340288+0000","last_unstale":"2024-09-12T00:07:25.781227+0000","last_undegraded":"2024-09-12T00:07:25.781227+0000","last_fullsized":"2024-09-12T00:07:25.781227+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:25.780854+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:25.780854+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.780854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:28.930968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"116'56","reported_seq":366,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.230440+0000","last_change":"2024-09-12T00:07:21.230279+0000","last_active":"2024-09-12T00:07:21.230440+0000","last_peered":"2024-09-12T00:07:21.230440+0000","last_clean":"2024-09-12T00:07:21.230440+0000","last_became_active":"2024-09-12T00:06:26.672172+0000","last_became_peered":"2024-09-12T00:06:26.672172+0000","last_unstale":"2024-09-12T00:07:21.230440+0000","last_undegraded":"2024-09-12T00:07:21.230440+0000","last_fullsized":"2024-09-12T00:07:21.230440+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-09-12T00:07:21.230102+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-09-12T00:07:21.230102+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.230102+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:54.137708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":64,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:34.324483+0000","last_change":"2024-09-12T00:07:34.324322+0000","last_active":"2024-09-12T00:07:34.324483+0000","last_peered":"2024-09-12T00:07:34.324483+0000","last_clean":"2024-09-12T00:07:34.324483+0000","last_became_active":"2024-09-12T00:03:27.329077+0000","last_became_peered":"2024-09-12T00:03:27.329077+0000","last_unstale":"2024-09-12T00:07:34.324483+0000","last_undegraded":"2024-09-12T00:07:34.324483+0000","last_fullsized":"2024-09-12T00:07:34.324483+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:34.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:34.324126+0000","last_clean_scrub_stamp":"2024-09-12T00:07:34.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:12.915348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"116'26","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:34.854669+0000","last_change":"2024-09-12T00:07:34.854512+0000","last_active":"2024-09-12T00:07:34.854669+0000","last_peered":"2024-09-12T00:07:34.854669+0000","last_clean":"2024-09-12T00:07:34.854669+0000","last_became_active":"2024-09-12T00:03:29.345990+0000","last_became_peered":"2024-09-12T00:03:29.345990+0000","last_unstale":"2024-09-12T00:07:34.854669+0000","last_undegraded":"2024-09-12T00:07:34.854669+0000","last_fullsized":"2024-09-12T00:07:34.854669+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-09-12T00:07:34.854323+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-09-12T00:07:34.854323+0000","last_clean_scrub_stamp":"2024-09-12T00:07:34.854323+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:02.320306+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:38.130650+0000","last_change":"2024-09-12T00:07:38.130402+0000","last_active":"2024-09-12T00:07:38.130650+0000","last_peered":"2024-09-12T00:07:38.130650+0000","last_clean":"2024-09-12T00:07:38.130650+0000","last_became_active":"2024-09-12T00:03:31.363080+0000","last_became_peered":"2024-09-12T00:03:31.363080+0000","last_unstale":"2024-09-12T00:07:38.130650+0000","last_undegraded":"2024-09-12T00:07:38.130650+0000","last_fullsized":"2024-09-12T00:07:38.130650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:38.130201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:38.130201+0000","last_clean_scrub_stamp":"2024-09-12T00:07:38.130201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:39.170146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:08:02.842067+0000","last_change":"2024-09-12T00:08:02.842067+0000","last_active":"2024-09-12T00:08:02.842067+0000","last_peered":"2024-09-12T00:08:02.842067+0000","last_clean":"2024-09-12T00:08:02.842067+0000","last_became_active":"2024-09-12T00:06:26.669877+0000","last_became_peered":"2024-09-12T00:06:26.669877+0000","last_unstale":"2024-09-12T00:08:02.842067+0000","last_undegraded":"2024-09-12T00:08:02.842067+0000","last_fullsized":"2024-09-12T00:08:02.842067+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:08:02.841866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:08:02.841866+0000","last_clean_scrub_stamp":"2024-09-12T00:08:02.841866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:04.971815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"59'2","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.705949+0000","last_change":"2024-09-12T00:07:24.705703+0000","last_active":"2024-09-12T00:07:24.705949+0000","last_peered":"2024-09-12T00:07:24.705949+0000","last_clean":"2024-09-12T00:07:24.705949+0000","last_became_active":"2024-09-12T00:06:26.655483+0000","last_became_peered":"2024-09-12T00:06:26.655483+0000","last_unstale":"2024-09-12T00:07:24.705949+0000","last_undegraded":"2024-09-12T00:07:24.705949+0000","last_fullsized":"2024-09-12T00:07:24.705949+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:24.705412+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:24.705412+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.705412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:56.072009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"116'44","reported_seq":330,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.653129+0000","last_change":"2024-09-12T00:07:19.652983+0000","last_active":"2024-09-12T00:07:19.653129+0000","last_peered":"2024-09-12T00:07:19.653129+0000","last_clean":"2024-09-12T00:07:19.653129+0000","last_became_active":"2024-09-12T00:06:26.664617+0000","last_became_peered":"2024-09-12T00:06:26.664617+0000","last_unstale":"2024-09-12T00:07:19.653129+0000","last_undegraded":"2024-09-12T00:07:19.653129+0000","last_fullsized":"2024-09-12T00:07:19.653129+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-09-12T00:07:19.652771+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-09-12T00:07:19.652771+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.652771+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:28.003986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":142606336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:45.942082+0000","last_change":"2024-09-12T00:07:45.942082+0000","last_active":"2024-09-12T00:07:45.942082+0000","last_peered":"2024-09-12T00:07:45.942082+0000","last_clean":"2024-09-12T00:07:45.942082+0000","last_became_active":"2024-09-12T00:06:26.663351+0000","last_became_peered":"2024-09-12T00:06:26.663351+0000","last_unstale":"2024-09-12T00:07:45.942082+0000","last_undegraded":"2024-09-12T00:07:45.942082+0000","last_fullsized":"2024-09-12T00:07:45.942082+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:45.941887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:45.941887+0000","last_clean_scrub_stamp":"2024-09-12T00:07:45.941887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:41.491797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"116'26","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:42.346881+0000","last_change":"2024-09-12T00:07:42.346724+0000","last_active":"2024-09-12T00:07:42.346881+0000","last_peered":"2024-09-12T00:07:42.346881+0000","last_clean":"2024-09-12T00:07:42.346881+0000","last_became_active":"2024-09-12T00:03:29.345883+0000","last_became_peered":"2024-09-12T00:03:29.345883+0000","last_unstale":"2024-09-12T00:07:42.346881+0000","last_undegraded":"2024-09-12T00:07:42.346881+0000","last_fullsized":"2024-09-12T00:07:42.346881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-09-12T00:07:42.346526+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-09-12T00:07:42.346526+0000","last_clean_scrub_stamp":"2024-09-12T00:07:42.346526+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:54.278965+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:40.862797+0000","last_change":"2024-09-12T00:07:40.862660+0000","last_active":"2024-09-12T00:07:40.862797+0000","last_peered":"2024-09-12T00:07:40.862797+0000","last_clean":"2024-09-12T00:07:40.862797+0000","last_became_active":"2024-09-12T00:03:31.358011+0000","last_became_peered":"2024-09-12T00:03:31.358011+0000","last_unstale":"2024-09-12T00:07:40.862797+0000","last_undegraded":"2024-09-12T00:07:40.862797+0000","last_fullsized":"2024-09-12T00:07:40.862797+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:40.862475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:40.862475+0000","last_clean_scrub_stamp":"2024-09-12T00:07:40.862475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:08.914336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"59'2","reported_seq":53,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:36.950768+0000","last_change":"2024-09-12T00:07:36.950768+0000","last_active":"2024-09-12T00:07:36.950768+0000","last_peered":"2024-09-12T00:07:36.950768+0000","last_clean":"2024-09-12T00:07:36.950768+0000","last_became_active":"2024-09-12T00:06:26.667552+0000","last_became_peered":"2024-09-12T00:06:26.667552+0000","last_unstale":"2024-09-12T00:07:36.950768+0000","last_undegraded":"2024-09-12T00:07:36.950768+0000","last_fullsized":"2024-09-12T00:07:36.950768+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:36.950569+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:36.950569+0000","last_clean_scrub_stamp":"2024-09-12T00:07:36.950569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:06.950587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"116'46","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.657182+0000","last_change":"2024-09-12T00:07:21.656949+0000","last_active":"2024-09-12T00:07:21.657182+0000","last_peered":"2024-09-12T00:07:21.657182+0000","last_clean":"2024-09-12T00:07:21.657182+0000","last_became_active":"2024-09-12T00:03:23.626026+0000","last_became_peered":"2024-09-12T00:03:23.626026+0000","last_unstale":"2024-09-12T00:07:21.657182+0000","last_undegraded":"2024-09-12T00:07:21.657182+0000","last_fullsized":"2024-09-12T00:07:21.657182+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:21.656651+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:21.656651+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.656651+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:07.882339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:35.341367+0000","last_change":"2024-09-12T00:07:35.341367+0000","last_active":"2024-09-12T00:07:35.341367+0000","last_peered":"2024-09-12T00:07:35.341367+0000","last_clean":"2024-09-12T00:07:35.341367+0000","last_became_active":"2024-09-12T00:06:26.671427+0000","last_became_peered":"2024-09-12T00:06:26.671427+0000","last_unstale":"2024-09-12T00:07:35.341367+0000","last_undegraded":"2024-09-12T00:07:35.341367+0000","last_fullsized":"2024-09-12T00:07:35.341367+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:35.341183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:35.341183+0000","last_clean_scrub_stamp":"2024-09-12T00:07:35.341183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:59.040714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"116'45","reported_seq":261,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:40.321918+0000","last_change":"2024-09-12T00:07:40.321918+0000","last_active":"2024-09-12T00:07:40.321918+0000","last_peered":"2024-09-12T00:07:40.321918+0000","last_clean":"2024-09-12T00:07:40.321918+0000","last_became_active":"2024-09-12T00:03:29.339781+0000","last_became_peered":"2024-09-12T00:03:29.339781+0000","last_unstale":"2024-09-12T00:07:40.321918+0000","last_undegraded":"2024-09-12T00:07:40.321918+0000","last_fullsized":"2024-09-12T00:07:40.321918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'45","last_scrub_stamp":"2024-09-12T00:07:40.321724+0000","last_deep_scrub":"116'45","last_deep_scrub_stamp":"2024-09-12T00:07:40.321724+0000","last_clean_scrub_stamp":"2024-09-12T00:07:40.321724+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:12.366295+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":46,"num_read_kb":36,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:38.350919+0000","last_change":"2024-09-12T00:07:38.350919+0000","last_active":"2024-09-12T00:07:38.350919+0000","last_peered":"2024-09-12T00:07:38.350919+0000","last_clean":"2024-09-12T00:07:38.350919+0000","last_became_active":"2024-09-12T00:03:31.349591+0000","last_became_peered":"2024-09-12T00:03:31.349591+0000","last_unstale":"2024-09-12T00:07:38.350919+0000","last_undegraded":"2024-09-12T00:07:38.350919+0000","last_fullsized":"2024-09-12T00:07:38.350919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:38.350731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:38.350731+0000","last_clean_scrub_stamp":"2024-09-12T00:07:38.350731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:42.675337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"96'4","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:54.836816+0000","last_change":"2024-09-12T00:07:54.836640+0000","last_active":"2024-09-12T00:07:54.836816+0000","last_peered":"2024-09-12T00:07:54.836816+0000","last_clean":"2024-09-12T00:07:54.836816+0000","last_became_active":"2024-09-12T00:03:33.384274+0000","last_became_peered":"2024-09-12T00:03:33.384274+0000","last_unstale":"2024-09-12T00:07:54.836816+0000","last_undegraded":"2024-09-12T00:07:54.836816+0000","last_fullsized":"2024-09-12T00:07:54.836816+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'4","last_scrub_stamp":"2024-09-12T00:07:54.836442+0000","last_deep_scrub":"96'4","last_deep_scrub_stamp":"2024-09-12T00:07:54.836442+0000","last_clean_scrub_stamp":"2024-09-12T00:07:54.836442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:44.176810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"58'2","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.736165+0000","last_change":"2024-09-12T00:07:29.736165+0000","last_active":"2024-09-12T00:07:29.736165+0000","last_peered":"2024-09-12T00:07:29.736165+0000","last_clean":"2024-09-12T00:07:29.736165+0000","last_became_active":"2024-09-12T00:03:25.329151+0000","last_became_peered":"2024-09-12T00:03:25.329151+0000","last_unstale":"2024-09-12T00:07:29.736165+0000","last_undegraded":"2024-09-12T00:07:29.736165+0000","last_fullsized":"2024-09-12T00:07:29.736165+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:29.735976+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:29.735976+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.735976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:05.059155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"116'50","reported_seq":253,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.759691+0000","last_change":"2024-09-12T00:07:22.759520+0000","last_active":"2024-09-12T00:07:22.759691+0000","last_peered":"2024-09-12T00:07:22.759691+0000","last_clean":"2024-09-12T00:07:22.759691+0000","last_became_active":"2024-09-12T00:03:23.598862+0000","last_became_peered":"2024-09-12T00:03:23.598862+0000","last_unstale":"2024-09-12T00:07:22.759691+0000","last_undegraded":"2024-09-12T00:07:22.759691+0000","last_fullsized":"2024-09-12T00:07:22.759691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'50","last_scrub_stamp":"2024-09-12T00:07:22.759337+0000","last_deep_scrub":"116'50","last_deep_scrub_stamp":"2024-09-12T00:07:22.759337+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.759337+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:53.269749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.188244+0000","last_change":"2024-09-12T00:07:24.188062+0000","last_active":"2024-09-12T00:07:24.188244+0000","last_peered":"2024-09-12T00:07:24.188244+0000","last_clean":"2024-09-12T00:07:24.188244+0000","last_became_active":"2024-09-12T00:03:27.340199+0000","last_became_peered":"2024-09-12T00:03:27.340199+0000","last_unstale":"2024-09-12T00:07:24.188244+0000","last_undegraded":"2024-09-12T00:07:24.188244+0000","last_fullsized":"2024-09-12T00:07:24.188244+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:24.187874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:24.187874+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.187874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:06.924717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"116'34","reported_seq":79,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:51.811632+0000","last_change":"2024-09-12T00:07:51.811632+0000","last_active":"2024-09-12T00:07:51.811632+0000","last_peered":"2024-09-12T00:07:51.811632+0000","last_clean":"2024-09-12T00:07:51.811632+0000","last_became_active":"2024-09-12T00:06:26.675513+0000","last_became_peered":"2024-09-12T00:06:26.675513+0000","last_unstale":"2024-09-12T00:07:51.811632+0000","last_undegraded":"2024-09-12T00:07:51.811632+0000","last_fullsized":"2024-09-12T00:07:51.811632+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'34","last_scrub_stamp":"2024-09-12T00:07:51.811379+0000","last_deep_scrub":"116'34","last_deep_scrub_stamp":"2024-09-12T00:07:51.811379+0000","last_clean_scrub_stamp":"2024-09-12T00:07:51.811379+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:13.604581+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:49.721610+0000","last_change":"2024-09-12T00:07:49.721610+0000","last_active":"2024-09-12T00:07:49.721610+0000","last_peered":"2024-09-12T00:07:49.721610+0000","last_clean":"2024-09-12T00:07:49.721610+0000","last_became_active":"2024-09-12T00:06:26.677049+0000","last_became_peered":"2024-09-12T00:06:26.677049+0000","last_unstale":"2024-09-12T00:07:49.721610+0000","last_undegraded":"2024-09-12T00:07:49.721610+0000","last_fullsized":"2024-09-12T00:07:49.721610+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:49.721342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:49.721342+0000","last_clean_scrub_stamp":"2024-09-12T00:07:49.721342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:42.639840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"59'3","reported_seq":53,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:08:01.806995+0000","last_change":"2024-09-12T00:08:01.806995+0000","last_active":"2024-09-12T00:08:01.806995+0000","last_peered":"2024-09-12T00:08:01.806995+0000","last_clean":"2024-09-12T00:08:01.806995+0000","last_became_active":"2024-09-12T00:06:26.677859+0000","last_became_peered":"2024-09-12T00:06:26.677859+0000","last_unstale":"2024-09-12T00:08:01.806995+0000","last_undegraded":"2024-09-12T00:08:01.806995+0000","last_fullsized":"2024-09-12T00:08:01.806995+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'3","last_scrub_stamp":"2024-09-12T00:08:01.806811+0000","last_deep_scrub":"59'3","last_deep_scrub_stamp":"2024-09-12T00:08:01.806811+0000","last_clean_scrub_stamp":"2024-09-12T00:08:01.806811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:33.739615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"59'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.721417+0000","last_change":"2024-09-12T00:07:25.721417+0000","last_active":"2024-09-12T00:07:25.721417+0000","last_peered":"2024-09-12T00:07:25.721417+0000","last_clean":"2024-09-12T00:07:25.721417+0000","last_became_active":"2024-09-12T00:03:25.359682+0000","last_became_peered":"2024-09-12T00:03:25.359682+0000","last_unstale":"2024-09-12T00:07:25.721417+0000","last_undegraded":"2024-09-12T00:07:25.721417+0000","last_fullsized":"2024-09-12T00:07:25.721417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:25.721127+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:25.721127+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.721127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:50.850491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"116'40","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:16.004117+0000","last_change":"2024-09-12T00:07:16.004117+0000","last_active":"2024-09-12T00:07:16.004117+0000","last_peered":"2024-09-12T00:07:16.004117+0000","last_clean":"2024-09-12T00:07:16.004117+0000","last_became_active":"2024-09-12T00:03:23.620961+0000","last_became_peered":"2024-09-12T00:03:23.620961+0000","last_unstale":"2024-09-12T00:07:16.004117+0000","last_undegraded":"2024-09-12T00:07:16.004117+0000","last_fullsized":"2024-09-12T00:07:16.004117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-09-12T00:07:16.004043+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-09-12T00:07:16.004043+0000","last_clean_scrub_stamp":"2024-09-12T00:07:16.004043+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:26.391748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.228423+0000","last_change":"2024-09-12T00:07:26.228423+0000","last_active":"2024-09-12T00:07:26.228423+0000","last_peered":"2024-09-12T00:07:26.228423+0000","last_clean":"2024-09-12T00:07:26.228423+0000","last_became_active":"2024-09-12T00:03:27.336045+0000","last_became_peered":"2024-09-12T00:03:27.336045+0000","last_unstale":"2024-09-12T00:07:26.228423+0000","last_undegraded":"2024-09-12T00:07:26.228423+0000","last_fullsized":"2024-09-12T00:07:26.228423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:26.228243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:26.228243+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.228243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:14.331601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"116'33","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:41.307620+0000","last_change":"2024-09-12T00:07:41.307620+0000","last_active":"2024-09-12T00:07:41.307620+0000","last_peered":"2024-09-12T00:07:41.307620+0000","last_clean":"2024-09-12T00:07:41.307620+0000","last_became_active":"2024-09-12T00:03:29.338010+0000","last_became_peered":"2024-09-12T00:03:29.338010+0000","last_unstale":"2024-09-12T00:07:41.307620+0000","last_undegraded":"2024-09-12T00:07:41.307620+0000","last_fullsized":"2024-09-12T00:07:41.307620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'33","last_scrub_stamp":"2024-09-12T00:07:41.307367+0000","last_deep_scrub":"116'33","last_deep_scrub_stamp":"2024-09-12T00:07:41.307367+0000","last_clean_scrub_stamp":"2024-09-12T00:07:41.307367+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:38.867426+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:38.940683+0000","last_change":"2024-09-12T00:07:38.940683+0000","last_active":"2024-09-12T00:07:38.940683+0000","last_peered":"2024-09-12T00:07:38.940683+0000","last_clean":"2024-09-12T00:07:38.940683+0000","last_became_active":"2024-09-12T00:03:31.352143+0000","last_became_peered":"2024-09-12T00:03:31.352143+0000","last_unstale":"2024-09-12T00:07:38.940683+0000","last_undegraded":"2024-09-12T00:07:38.940683+0000","last_fullsized":"2024-09-12T00:07:38.940683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:38.940498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:38.940498+0000","last_clean_scrub_stamp":"2024-09-12T00:07:38.940498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:50.260484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"76'8","reported_seq":57,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:59.813372+0000","last_change":"2024-09-12T00:07:59.813372+0000","last_active":"2024-09-12T00:07:59.813372+0000","last_peered":"2024-09-12T00:07:59.813372+0000","last_clean":"2024-09-12T00:07:59.813372+0000","last_became_active":"2024-09-12T00:06:26.658281+0000","last_became_peered":"2024-09-12T00:06:26.658281+0000","last_unstale":"2024-09-12T00:07:59.813372+0000","last_undegraded":"2024-09-12T00:07:59.813372+0000","last_fullsized":"2024-09-12T00:07:59.813372+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'8","last_scrub_stamp":"2024-09-12T00:07:59.813150+0000","last_deep_scrub":"76'8","last_deep_scrub_stamp":"2024-09-12T00:07:59.813150+0000","last_clean_scrub_stamp":"2024-09-12T00:07:59.813150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:19.256305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"58'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.747618+0000","last_change":"2024-09-12T00:07:28.747618+0000","last_active":"2024-09-12T00:07:28.747618+0000","last_peered":"2024-09-12T00:07:28.747618+0000","last_clean":"2024-09-12T00:07:28.747618+0000","last_became_active":"2024-09-12T00:03:25.324315+0000","last_became_peered":"2024-09-12T00:03:25.324315+0000","last_unstale":"2024-09-12T00:07:28.747618+0000","last_undegraded":"2024-09-12T00:07:28.747618+0000","last_fullsized":"2024-09-12T00:07:28.747618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:28.747422+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:28.747422+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.747422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:06.054923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"116'54","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.729740+0000","last_change":"2024-09-12T00:07:23.729740+0000","last_active":"2024-09-12T00:07:23.729740+0000","last_peered":"2024-09-12T00:07:23.729740+0000","last_clean":"2024-09-12T00:07:23.729740+0000","last_became_active":"2024-09-12T00:03:23.605402+0000","last_became_peered":"2024-09-12T00:03:23.605402+0000","last_unstale":"2024-09-12T00:07:23.729740+0000","last_undegraded":"2024-09-12T00:07:23.729740+0000","last_fullsized":"2024-09-12T00:07:23.729740+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'54","last_scrub_stamp":"2024-09-12T00:07:23.729552+0000","last_deep_scrub":"116'54","last_deep_scrub_stamp":"2024-09-12T00:07:23.729552+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.729552+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:20.296921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:40.929452+0000","last_change":"2024-09-12T00:07:40.929452+0000","last_active":"2024-09-12T00:07:40.929452+0000","last_peered":"2024-09-12T00:07:40.929452+0000","last_clean":"2024-09-12T00:07:40.929452+0000","last_became_active":"2024-09-12T00:03:27.335658+0000","last_became_peered":"2024-09-12T00:03:27.335658+0000","last_unstale":"2024-09-12T00:07:40.929452+0000","last_undegraded":"2024-09-12T00:07:40.929452+0000","last_fullsized":"2024-09-12T00:07:40.929452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:40.929284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:40.929284+0000","last_clean_scrub_stamp":"2024-09-12T00:07:40.929284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:20.817967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"116'22","reported_seq":69,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:56.884374+0000","last_change":"2024-09-12T00:07:56.884374+0000","last_active":"2024-09-12T00:07:56.884374+0000","last_peered":"2024-09-12T00:07:56.884374+0000","last_clean":"2024-09-12T00:07:56.884374+0000","last_became_active":"2024-09-12T00:06:26.671893+0000","last_became_peered":"2024-09-12T00:06:26.671893+0000","last_unstale":"2024-09-12T00:07:56.884374+0000","last_undegraded":"2024-09-12T00:07:56.884374+0000","last_fullsized":"2024-09-12T00:07:56.884374+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22","last_scrub_stamp":"2024-09-12T00:07:56.884150+0000","last_deep_scrub":"116'22","last_deep_scrub_stamp":"2024-09-12T00:07:56.884150+0000","last_clean_scrub_stamp":"2024-09-12T00:07:56.884150+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:45.598817+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"116'138","reported_seq":366,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:37.380461+0000","last_change":"2024-09-12T00:07:37.380285+0000","last_active":"2024-09-12T00:07:37.380461+0000","last_peered":"2024-09-12T00:07:37.380461+0000","last_clean":"2024-09-12T00:07:37.380461+0000","last_became_active":"2024-09-12T00:03:31.350925+0000","last_became_peered":"2024-09-12T00:03:31.350925+0000","last_unstale":"2024-09-12T00:07:37.380461+0000","last_undegraded":"2024-09-12T00:07:37.380461+0000","last_fullsized":"2024-09-12T00:07:37.380461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-09-12T00:07:37.380093+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-09-12T00:07:37.380093+0000","last_clean_scrub_stamp":"2024-09-12T00:07:37.380093+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:10.515743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:08:00.840697+0000","last_change":"2024-09-12T00:08:00.840697+0000","last_active":"2024-09-12T00:08:00.840697+0000","last_peered":"2024-09-12T00:08:00.840697+0000","last_clean":"2024-09-12T00:08:00.840697+0000","last_became_active":"2024-09-12T00:06:26.675234+0000","last_became_peered":"2024-09-12T00:06:26.675234+0000","last_unstale":"2024-09-12T00:08:00.840697+0000","last_undegraded":"2024-09-12T00:08:00.840697+0000","last_fullsized":"2024-09-12T00:08:00.840697+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:08:00.840477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:08:00.840477+0000","last_clean_scrub_stamp":"2024-09-12T00:08:00.840477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:07.609459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"59'4","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.258770+0000","last_change":"2024-09-12T00:07:27.258770+0000","last_active":"2024-09-12T00:07:27.258770+0000","last_peered":"2024-09-12T00:07:27.258770+0000","last_clean":"2024-09-12T00:07:27.258770+0000","last_became_active":"2024-09-12T00:03:25.357623+0000","last_became_peered":"2024-09-12T00:03:25.357623+0000","last_unstale":"2024-09-12T00:07:27.258770+0000","last_undegraded":"2024-09-12T00:07:27.258770+0000","last_fullsized":"2024-09-12T00:07:27.258770+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'4","last_scrub_stamp":"2024-09-12T00:07:27.258578+0000","last_deep_scrub":"59'4","last_deep_scrub_stamp":"2024-09-12T00:07:27.258578+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.258578+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:50.958109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"116'58","reported_seq":262,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:17.048519+0000","last_change":"2024-09-12T00:07:17.048519+0000","last_active":"2024-09-12T00:07:17.048519+0000","last_peered":"2024-09-12T00:07:17.048519+0000","last_clean":"2024-09-12T00:07:17.048519+0000","last_became_active":"2024-09-12T00:03:23.604773+0000","last_became_peered":"2024-09-12T00:03:23.604773+0000","last_unstale":"2024-09-12T00:07:17.048519+0000","last_undegraded":"2024-09-12T00:07:17.048519+0000","last_fullsized":"2024-09-12T00:07:17.048519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'58","last_scrub_stamp":"2024-09-12T00:07:17.048376+0000","last_deep_scrub":"116'58","last_deep_scrub_stamp":"2024-09-12T00:07:17.048376+0000","last_clean_scrub_stamp":"2024-09-12T00:07:17.048376+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:12.012361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:36.044064+0000","last_change":"2024-09-12T00:07:36.044064+0000","last_active":"2024-09-12T00:07:36.044064+0000","last_peered":"2024-09-12T00:07:36.044064+0000","last_clean":"2024-09-12T00:07:36.044064+0000","last_became_active":"2024-09-12T00:03:27.346168+0000","last_became_peered":"2024-09-12T00:03:27.346168+0000","last_unstale":"2024-09-12T00:07:36.044064+0000","last_undegraded":"2024-09-12T00:07:36.044064+0000","last_fullsized":"2024-09-12T00:07:36.044064+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:36.043867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:36.043867+0000","last_clean_scrub_stamp":"2024-09-12T00:07:36.043867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:44.893673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"116'62","reported_seq":292,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:36.393614+0000","last_change":"2024-09-12T00:07:36.393614+0000","last_active":"2024-09-12T00:07:36.393614+0000","last_peered":"2024-09-12T00:07:36.393614+0000","last_clean":"2024-09-12T00:07:36.393614+0000","last_became_active":"2024-09-12T00:03:29.343238+0000","last_became_peered":"2024-09-12T00:03:29.343238+0000","last_unstale":"2024-09-12T00:07:36.393614+0000","last_undegraded":"2024-09-12T00:07:36.393614+0000","last_fullsized":"2024-09-12T00:07:36.393614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'62","last_scrub_stamp":"2024-09-12T00:07:36.393407+0000","last_deep_scrub":"116'62","last_deep_scrub_stamp":"2024-09-12T00:07:36.393407+0000","last_clean_scrub_stamp":"2024-09-12T00:07:36.393407+0000","objects_scrubbed":11,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:32.562644+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":68,"num_read_kb":55,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:51.926522+0000","last_change":"2024-09-12T00:07:51.926522+0000","last_active":"2024-09-12T00:07:51.926522+0000","last_peered":"2024-09-12T00:07:51.926522+0000","last_clean":"2024-09-12T00:07:51.926522+0000","last_became_active":"2024-09-12T00:06:26.654187+0000","last_became_peered":"2024-09-12T00:06:26.654187+0000","last_unstale":"2024-09-12T00:07:51.926522+0000","last_undegraded":"2024-09-12T00:07:51.926522+0000","last_fullsized":"2024-09-12T00:07:51.926522+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:51.926341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:51.926341+0000","last_clean_scrub_stamp":"2024-09-12T00:07:51.926341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:49.620936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:43.166136+0000","last_change":"2024-09-12T00:07:43.166136+0000","last_active":"2024-09-12T00:07:43.166136+0000","last_peered":"2024-09-12T00:07:43.166136+0000","last_clean":"2024-09-12T00:07:43.166136+0000","last_became_active":"2024-09-12T00:03:33.360672+0000","last_became_peered":"2024-09-12T00:03:33.360672+0000","last_unstale":"2024-09-12T00:07:43.166136+0000","last_undegraded":"2024-09-12T00:07:43.166136+0000","last_fullsized":"2024-09-12T00:07:43.166136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:43.165973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:43.165973+0000","last_clean_scrub_stamp":"2024-09-12T00:07:43.165973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:11.670588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"59'4","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.218379+0000","last_change":"2024-09-12T00:07:25.218379+0000","last_active":"2024-09-12T00:07:25.218379+0000","last_peered":"2024-09-12T00:07:25.218379+0000","last_clean":"2024-09-12T00:07:25.218379+0000","last_became_active":"2024-09-12T00:03:25.336095+0000","last_became_peered":"2024-09-12T00:03:25.336095+0000","last_unstale":"2024-09-12T00:07:25.218379+0000","last_undegraded":"2024-09-12T00:07:25.218379+0000","last_fullsized":"2024-09-12T00:07:25.218379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'4","last_scrub_stamp":"2024-09-12T00:07:25.218086+0000","last_deep_scrub":"59'4","last_deep_scrub_stamp":"2024-09-12T00:07:25.218086+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.218086+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:20.441811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"116'52","reported_seq":129,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.998780+0000","last_change":"2024-09-12T00:07:28.998780+0000","last_active":"2024-09-12T00:07:28.998780+0000","last_peered":"2024-09-12T00:07:28.998780+0000","last_clean":"2024-09-12T00:07:28.998780+0000","last_became_active":"2024-09-12T00:06:26.678646+0000","last_became_peered":"2024-09-12T00:06:26.678646+0000","last_unstale":"2024-09-12T00:07:28.998780+0000","last_undegraded":"2024-09-12T00:07:28.998780+0000","last_fullsized":"2024-09-12T00:07:28.998780+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'52","last_scrub_stamp":"2024-09-12T00:07:28.998593+0000","last_deep_scrub":"116'52","last_deep_scrub_stamp":"2024-09-12T00:07:28.998593+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.998593+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:22.996025+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":192937984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.309762+0000","last_change":"2024-09-12T00:07:31.309762+0000","last_active":"2024-09-12T00:07:31.309762+0000","last_peered":"2024-09-12T00:07:31.309762+0000","last_clean":"2024-09-12T00:07:31.309762+0000","last_became_active":"2024-09-12T00:03:27.325336+0000","last_became_peered":"2024-09-12T00:03:27.325336+0000","last_unstale":"2024-09-12T00:07:31.309762+0000","last_undegraded":"2024-09-12T00:07:31.309762+0000","last_fullsized":"2024-09-12T00:07:31.309762+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:31.309585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:31.309585+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.309585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:03.354156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"116'31","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:47.934189+0000","last_change":"2024-09-12T00:07:47.934189+0000","last_active":"2024-09-12T00:07:47.934189+0000","last_peered":"2024-09-12T00:07:47.934189+0000","last_clean":"2024-09-12T00:07:47.934189+0000","last_became_active":"2024-09-12T00:03:29.335186+0000","last_became_peered":"2024-09-12T00:03:29.335186+0000","last_unstale":"2024-09-12T00:07:47.934189+0000","last_undegraded":"2024-09-12T00:07:47.934189+0000","last_fullsized":"2024-09-12T00:07:47.934189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'31","last_scrub_stamp":"2024-09-12T00:07:47.933984+0000","last_deep_scrub":"116'31","last_deep_scrub_stamp":"2024-09-12T00:07:47.933984+0000","last_clean_scrub_stamp":"2024-09-12T00:07:47.933984+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:21.597423+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:57.832614+0000","last_change":"2024-09-12T00:07:57.832614+0000","last_active":"2024-09-12T00:07:57.832614+0000","last_peered":"2024-09-12T00:07:57.832614+0000","last_clean":"2024-09-12T00:07:57.832614+0000","last_became_active":"2024-09-12T00:06:26.667486+0000","last_became_peered":"2024-09-12T00:06:26.667486+0000","last_unstale":"2024-09-12T00:07:57.832614+0000","last_undegraded":"2024-09-12T00:07:57.832614+0000","last_fullsized":"2024-09-12T00:07:57.832614+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:57.832419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:57.832419+0000","last_clean_scrub_stamp":"2024-09-12T00:07:57.832419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:09.924942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:55.844738+0000","last_change":"2024-09-12T00:07:55.844738+0000","last_active":"2024-09-12T00:07:55.844738+0000","last_peered":"2024-09-12T00:07:55.844738+0000","last_clean":"2024-09-12T00:07:55.844738+0000","last_became_active":"2024-09-12T00:03:33.384379+0000","last_became_peered":"2024-09-12T00:03:33.384379+0000","last_unstale":"2024-09-12T00:07:55.844738+0000","last_undegraded":"2024-09-12T00:07:55.844738+0000","last_fullsized":"2024-09-12T00:07:55.844738+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:55.844564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:55.844564+0000","last_clean_scrub_stamp":"2024-09-12T00:07:55.844564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:45.342896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"96'10","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.747972+0000","last_change":"2024-09-12T00:07:23.747972+0000","last_active":"2024-09-12T00:07:23.747972+0000","last_peered":"2024-09-12T00:07:23.747972+0000","last_clean":"2024-09-12T00:07:23.747972+0000","last_became_active":"2024-09-12T00:03:25.338417+0000","last_became_peered":"2024-09-12T00:03:25.338417+0000","last_unstale":"2024-09-12T00:07:23.747972+0000","last_undegraded":"2024-09-12T00:07:23.747972+0000","last_fullsized":"2024-09-12T00:07:23.747972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'10","last_scrub_stamp":"2024-09-12T00:07:23.747776+0000","last_deep_scrub":"96'10","last_deep_scrub_stamp":"2024-09-12T00:07:23.747776+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.747776+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:17.423244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"116'62","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.626384+0000","last_change":"2024-09-12T00:07:22.626131+0000","last_active":"2024-09-12T00:07:22.626384+0000","last_peered":"2024-09-12T00:07:22.626384+0000","last_clean":"2024-09-12T00:07:22.626384+0000","last_became_active":"2024-09-12T00:03:23.621654+0000","last_became_peered":"2024-09-12T00:03:23.621654+0000","last_unstale":"2024-09-12T00:07:22.626384+0000","last_undegraded":"2024-09-12T00:07:22.626384+0000","last_fullsized":"2024-09-12T00:07:22.626384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'62","last_scrub_stamp":"2024-09-12T00:07:22.625894+0000","last_deep_scrub":"116'62","last_deep_scrub_stamp":"2024-09-12T00:07:22.625894+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.625894+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:35.984413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:39.150153+0000","last_change":"2024-09-12T00:07:39.150153+0000","last_active":"2024-09-12T00:07:39.150153+0000","last_peered":"2024-09-12T00:07:39.150153+0000","last_clean":"2024-09-12T00:07:39.150153+0000","last_became_active":"2024-09-12T00:03:27.329713+0000","last_became_peered":"2024-09-12T00:03:27.329713+0000","last_unstale":"2024-09-12T00:07:39.150153+0000","last_undegraded":"2024-09-12T00:07:39.150153+0000","last_fullsized":"2024-09-12T00:07:39.150153+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:39.149865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:39.149865+0000","last_clean_scrub_stamp":"2024-09-12T00:07:39.149865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:11.194436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"116'24","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:39.305787+0000","last_change":"2024-09-12T00:07:39.305787+0000","last_active":"2024-09-12T00:07:39.305787+0000","last_peered":"2024-09-12T00:07:39.305787+0000","last_clean":"2024-09-12T00:07:39.305787+0000","last_became_active":"2024-09-12T00:03:29.335440+0000","last_became_peered":"2024-09-12T00:03:29.335440+0000","last_unstale":"2024-09-12T00:07:39.305787+0000","last_undegraded":"2024-09-12T00:07:39.305787+0000","last_fullsized":"2024-09-12T00:07:39.305787+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'24","last_scrub_stamp":"2024-09-12T00:07:39.305608+0000","last_deep_scrub":"116'24","last_deep_scrub_stamp":"2024-09-12T00:07:39.305608+0000","last_clean_scrub_stamp":"2024-09-12T00:07:39.305608+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:51.527864+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":21,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":49,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:58.800790+0000","last_change":"2024-09-12T00:07:58.800790+0000","last_active":"2024-09-12T00:07:58.800790+0000","last_peered":"2024-09-12T00:07:58.800790+0000","last_clean":"2024-09-12T00:07:58.800790+0000","last_became_active":"2024-09-12T00:06:26.660173+0000","last_became_peered":"2024-09-12T00:06:26.660173+0000","last_unstale":"2024-09-12T00:07:58.800790+0000","last_undegraded":"2024-09-12T00:07:58.800790+0000","last_fullsized":"2024-09-12T00:07:58.800790+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:58.800583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:58.800583+0000","last_clean_scrub_stamp":"2024-09-12T00:07:58.800583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:38.661133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"58'2","reported_seq":53,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:08:03.876108+0000","last_change":"2024-09-12T00:08:03.876108+0000","last_active":"2024-09-12T00:08:03.876108+0000","last_peered":"2024-09-12T00:08:03.876108+0000","last_clean":"2024-09-12T00:08:03.876108+0000","last_became_active":"2024-09-12T00:06:26.677210+0000","last_became_peered":"2024-09-12T00:06:26.677210+0000","last_unstale":"2024-09-12T00:08:03.876108+0000","last_undegraded":"2024-09-12T00:08:03.876108+0000","last_fullsized":"2024-09-12T00:08:03.876108+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:08:03.875895+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:08:03.875895+0000","last_clean_scrub_stamp":"2024-09-12T00:08:03.875895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:32.462946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"96'4","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.334645+0000","last_change":"2024-09-12T00:07:29.334645+0000","last_active":"2024-09-12T00:07:29.334645+0000","last_peered":"2024-09-12T00:07:29.334645+0000","last_clean":"2024-09-12T00:07:29.334645+0000","last_became_active":"2024-09-12T00:03:25.337237+0000","last_became_peered":"2024-09-12T00:03:25.337237+0000","last_unstale":"2024-09-12T00:07:29.334645+0000","last_undegraded":"2024-09-12T00:07:29.334645+0000","last_fullsized":"2024-09-12T00:07:29.334645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'4","last_scrub_stamp":"2024-09-12T00:07:29.334417+0000","last_deep_scrub":"96'4","last_deep_scrub_stamp":"2024-09-12T00:07:29.334417+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.334417+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:38.184224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"116'58","reported_seq":260,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.585293+0000","last_change":"2024-09-12T00:07:23.585065+0000","last_active":"2024-09-12T00:07:23.585293+0000","last_peered":"2024-09-12T00:07:23.585293+0000","last_clean":"2024-09-12T00:07:23.585293+0000","last_became_active":"2024-09-12T00:03:23.630928+0000","last_became_peered":"2024-09-12T00:03:23.630928+0000","last_unstale":"2024-09-12T00:07:23.585293+0000","last_undegraded":"2024-09-12T00:07:23.585293+0000","last_fullsized":"2024-09-12T00:07:23.585293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'58","last_scrub_stamp":"2024-09-12T00:07:23.584838+0000","last_deep_scrub":"116'58","last_deep_scrub_stamp":"2024-09-12T00:07:23.584838+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.584838+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:27.637020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"116'2","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:39.891516+0000","last_change":"2024-09-12T00:07:39.891516+0000","last_active":"2024-09-12T00:07:39.891516+0000","last_peered":"2024-09-12T00:07:39.891516+0000","last_clean":"2024-09-12T00:07:39.891516+0000","last_became_active":"2024-09-12T00:06:26.651342+0000","last_became_peered":"2024-09-12T00:06:26.651342+0000","last_unstale":"2024-09-12T00:07:39.891516+0000","last_undegraded":"2024-09-12T00:07:39.891516+0000","last_fullsized":"2024-09-12T00:07:39.891516+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-09-12T00:07:39.891330+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-09-12T00:07:39.891330+0000","last_clean_scrub_stamp":"2024-09-12T00:07:39.891330+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:22.255275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"116'38","reported_seq":76,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:50.816222+0000","last_change":"2024-09-12T00:07:50.816222+0000","last_active":"2024-09-12T00:07:50.816222+0000","last_peered":"2024-09-12T00:07:50.816222+0000","last_clean":"2024-09-12T00:07:50.816222+0000","last_became_active":"2024-09-12T00:06:26.680856+0000","last_became_peered":"2024-09-12T00:06:26.680856+0000","last_unstale":"2024-09-12T00:07:50.816222+0000","last_undegraded":"2024-09-12T00:07:50.816222+0000","last_fullsized":"2024-09-12T00:07:50.816222+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'38","last_scrub_stamp":"2024-09-12T00:07:50.816023+0000","last_deep_scrub":"116'38","last_deep_scrub_stamp":"2024-09-12T00:07:50.816023+0000","last_clean_scrub_stamp":"2024-09-12T00:07:50.816023+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:20.751293+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":32,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:50.950114+0000","last_change":"2024-09-12T00:07:50.950114+0000","last_active":"2024-09-12T00:07:50.950114+0000","last_peered":"2024-09-12T00:07:50.950114+0000","last_clean":"2024-09-12T00:07:50.950114+0000","last_became_active":"2024-09-12T00:03:31.354506+0000","last_became_peered":"2024-09-12T00:03:31.354506+0000","last_unstale":"2024-09-12T00:07:50.950114+0000","last_undegraded":"2024-09-12T00:07:50.950114+0000","last_fullsized":"2024-09-12T00:07:50.950114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:50.949932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:50.949932+0000","last_clean_scrub_stamp":"2024-09-12T00:07:50.949932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:23.425010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"116'2","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:41.392897+0000","last_change":"2024-09-12T00:07:41.392736+0000","last_active":"2024-09-12T00:07:41.392897+0000","last_peered":"2024-09-12T00:07:41.392897+0000","last_clean":"2024-09-12T00:07:41.392897+0000","last_became_active":"2024-09-12T00:03:33.383358+0000","last_became_peered":"2024-09-12T00:03:33.383358+0000","last_unstale":"2024-09-12T00:07:41.392897+0000","last_undegraded":"2024-09-12T00:07:41.392897+0000","last_fullsized":"2024-09-12T00:07:41.392897+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-09-12T00:07:41.392528+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-09-12T00:07:41.392528+0000","last_clean_scrub_stamp":"2024-09-12T00:07:41.392528+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:46.461274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"84'4","reported_seq":240,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.733467+0000","last_change":"2024-09-12T00:07:30.733278+0000","last_active":"2024-09-12T00:07:30.733467+0000","last_peered":"2024-09-12T00:07:30.733467+0000","last_clean":"2024-09-12T00:07:30.733467+0000","last_became_active":"2024-09-12T00:06:26.664077+0000","last_became_peered":"2024-09-12T00:06:26.664077+0000","last_unstale":"2024-09-12T00:07:30.733467+0000","last_undegraded":"2024-09-12T00:07:30.733467+0000","last_fullsized":"2024-09-12T00:07:30.733467+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-09-12T00:07:30.733079+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-09-12T00:07:30.733079+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.733079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:38.628999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"116'62","reported_seq":265,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.185071+0000","last_change":"2024-09-12T00:07:20.184905+0000","last_active":"2024-09-12T00:07:20.185071+0000","last_peered":"2024-09-12T00:07:20.185071+0000","last_clean":"2024-09-12T00:07:20.185071+0000","last_became_active":"2024-09-12T00:03:23.617138+0000","last_became_peered":"2024-09-12T00:03:23.617138+0000","last_unstale":"2024-09-12T00:07:20.185071+0000","last_undegraded":"2024-09-12T00:07:20.185071+0000","last_fullsized":"2024-09-12T00:07:20.185071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'62","last_scrub_stamp":"2024-09-12T00:07:20.184692+0000","last_deep_scrub":"116'62","last_deep_scrub_stamp":"2024-09-12T00:07:20.184692+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.184692+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:00.138081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":124928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"59'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.714457+0000","last_change":"2024-09-12T00:07:26.714266+0000","last_active":"2024-09-12T00:07:26.714457+0000","last_peered":"2024-09-12T00:07:26.714457+0000","last_clean":"2024-09-12T00:07:26.714457+0000","last_became_active":"2024-09-12T00:03:25.334965+0000","last_became_peered":"2024-09-12T00:03:25.334965+0000","last_unstale":"2024-09-12T00:07:26.714457+0000","last_undegraded":"2024-09-12T00:07:26.714457+0000","last_fullsized":"2024-09-12T00:07:26.714457+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:26.714060+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:26.714060+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.714060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:37.101765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"116'52","reported_seq":254,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:20.829069+0000","last_change":"2024-09-12T00:07:20.828928+0000","last_active":"2024-09-12T00:07:20.829069+0000","last_peered":"2024-09-12T00:07:20.829069+0000","last_clean":"2024-09-12T00:07:20.829069+0000","last_became_active":"2024-09-12T00:03:23.612542+0000","last_became_peered":"2024-09-12T00:03:23.612542+0000","last_unstale":"2024-09-12T00:07:20.829069+0000","last_undegraded":"2024-09-12T00:07:20.829069+0000","last_fullsized":"2024-09-12T00:07:20.829069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'52","last_scrub_stamp":"2024-09-12T00:07:20.828733+0000","last_deep_scrub":"116'52","last_deep_scrub_stamp":"2024-09-12T00:07:20.828733+0000","last_clean_scrub_stamp":"2024-09-12T00:07:20.828733+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:06.289598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"96'4","reported_seq":55,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:39.967633+0000","last_change":"2024-09-12T00:07:39.967633+0000","last_active":"2024-09-12T00:07:39.967633+0000","last_peered":"2024-09-12T00:07:39.967633+0000","last_clean":"2024-09-12T00:07:39.967633+0000","last_became_active":"2024-09-12T00:06:26.677698+0000","last_became_peered":"2024-09-12T00:06:26.677698+0000","last_unstale":"2024-09-12T00:07:39.967633+0000","last_undegraded":"2024-09-12T00:07:39.967633+0000","last_fullsized":"2024-09-12T00:07:39.967633+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'4","last_scrub_stamp":"2024-09-12T00:07:39.967413+0000","last_deep_scrub":"96'4","last_deep_scrub_stamp":"2024-09-12T00:07:39.967413+0000","last_clean_scrub_stamp":"2024-09-12T00:07:39.967413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:18.133437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"116'60","reported_seq":141,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.952705+0000","last_change":"2024-09-12T00:07:27.952705+0000","last_active":"2024-09-12T00:07:27.952705+0000","last_peered":"2024-09-12T00:07:27.952705+0000","last_clean":"2024-09-12T00:07:27.952705+0000","last_became_active":"2024-09-12T00:06:26.666582+0000","last_became_peered":"2024-09-12T00:06:26.666582+0000","last_unstale":"2024-09-12T00:07:27.952705+0000","last_undegraded":"2024-09-12T00:07:27.952705+0000","last_fullsized":"2024-09-12T00:07:27.952705+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'60","last_scrub_stamp":"2024-09-12T00:07:27.952522+0000","last_deep_scrub":"116'60","last_deep_scrub_stamp":"2024-09-12T00:07:27.952522+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.952522+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:37.239950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":201326592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"63'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:37.733249+0000","last_change":"2024-09-12T00:07:37.732976+0000","last_active":"2024-09-12T00:07:37.733249+0000","last_peered":"2024-09-12T00:07:37.733249+0000","last_clean":"2024-09-12T00:07:37.733249+0000","last_became_active":"2024-09-12T00:03:25.352319+0000","last_became_peered":"2024-09-12T00:03:25.352319+0000","last_unstale":"2024-09-12T00:07:37.733249+0000","last_undegraded":"2024-09-12T00:07:37.733249+0000","last_fullsized":"2024-09-12T00:07:37.733249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-09-12T00:07:37.732654+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-09-12T00:07:37.732654+0000","last_clean_scrub_stamp":"2024-09-12T00:07:37.732654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:01.880330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"116'34","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.557672+0000","last_change":"2024-09-12T00:07:24.557514+0000","last_active":"2024-09-12T00:07:24.557672+0000","last_peered":"2024-09-12T00:07:24.557672+0000","last_clean":"2024-09-12T00:07:24.557672+0000","last_became_active":"2024-09-12T00:03:23.632850+0000","last_became_peered":"2024-09-12T00:03:23.632850+0000","last_unstale":"2024-09-12T00:07:24.557672+0000","last_undegraded":"2024-09-12T00:07:24.557672+0000","last_fullsized":"2024-09-12T00:07:24.557672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'34","last_scrub_stamp":"2024-09-12T00:07:24.557338+0000","last_deep_scrub":"116'34","last_deep_scrub_stamp":"2024-09-12T00:07:24.557338+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.557338+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:57.802661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"84'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:35.696302+0000","last_change":"2024-09-12T00:07:35.696058+0000","last_active":"2024-09-12T00:07:35.696302+0000","last_peered":"2024-09-12T00:07:35.696302+0000","last_clean":"2024-09-12T00:07:35.696302+0000","last_became_active":"2024-09-12T00:03:25.353815+0000","last_became_peered":"2024-09-12T00:03:25.353815+0000","last_unstale":"2024-09-12T00:07:35.696302+0000","last_undegraded":"2024-09-12T00:07:35.696302+0000","last_fullsized":"2024-09-12T00:07:35.696302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-09-12T00:07:35.695734+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-09-12T00:07:35.695734+0000","last_clean_scrub_stamp":"2024-09-12T00:07:35.695734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:42.608019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"116'42","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.379617+0000","last_change":"2024-09-12T00:07:21.379467+0000","last_active":"2024-09-12T00:07:21.379617+0000","last_peered":"2024-09-12T00:07:21.379617+0000","last_clean":"2024-09-12T00:07:21.379617+0000","last_became_active":"2024-09-12T00:03:23.608101+0000","last_became_peered":"2024-09-12T00:03:23.608101+0000","last_unstale":"2024-09-12T00:07:21.379617+0000","last_undegraded":"2024-09-12T00:07:21.379617+0000","last_fullsized":"2024-09-12T00:07:21.379617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-09-12T00:07:21.379278+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-09-12T00:07:21.379278+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.379278+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:12.681228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":50,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"96'10","reported_seq":277,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.334457+0000","last_change":"2024-09-12T00:07:27.334265+0000","last_active":"2024-09-12T00:07:27.334457+0000","last_peered":"2024-09-12T00:07:27.334457+0000","last_clean":"2024-09-12T00:07:27.334457+0000","last_became_active":"2024-09-12T00:06:26.681882+0000","last_became_peered":"2024-09-12T00:06:26.681882+0000","last_unstale":"2024-09-12T00:07:27.334457+0000","last_undegraded":"2024-09-12T00:07:27.334457+0000","last_fullsized":"2024-09-12T00:07:27.334457+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'10","last_scrub_stamp":"2024-09-12T00:07:27.334077+0000","last_deep_scrub":"96'10","last_deep_scrub_stamp":"2024-09-12T00:07:27.334077+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.334077+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:36.726266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"116'50","reported_seq":255,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:22.404802+0000","last_change":"2024-09-12T00:07:22.404633+0000","last_active":"2024-09-12T00:07:22.404802+0000","last_peered":"2024-09-12T00:07:22.404802+0000","last_clean":"2024-09-12T00:07:22.404802+0000","last_became_active":"2024-09-12T00:03:23.615970+0000","last_became_peered":"2024-09-12T00:03:23.615970+0000","last_unstale":"2024-09-12T00:07:22.404802+0000","last_undegraded":"2024-09-12T00:07:22.404802+0000","last_fullsized":"2024-09-12T00:07:22.404802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'50","last_scrub_stamp":"2024-09-12T00:07:22.404446+0000","last_deep_scrub":"116'50","last_deep_scrub_stamp":"2024-09-12T00:07:22.404446+0000","last_clean_scrub_stamp":"2024-09-12T00:07:22.404446+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:57.242577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":58,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"63'8","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.415975+0000","last_change":"2024-09-12T00:07:30.415697+0000","last_active":"2024-09-12T00:07:30.415975+0000","last_peered":"2024-09-12T00:07:30.415975+0000","last_clean":"2024-09-12T00:07:30.415975+0000","last_became_active":"2024-09-12T00:03:25.342930+0000","last_became_peered":"2024-09-12T00:03:25.342930+0000","last_unstale":"2024-09-12T00:07:30.415975+0000","last_undegraded":"2024-09-12T00:07:30.415975+0000","last_fullsized":"2024-09-12T00:07:30.415975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'8","last_scrub_stamp":"2024-09-12T00:07:30.415464+0000","last_deep_scrub":"63'8","last_deep_scrub_stamp":"2024-09-12T00:07:30.415464+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.415464+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:41.735451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"116'50","reported_seq":355,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.332647+0000","last_change":"2024-09-12T00:07:30.332514+0000","last_active":"2024-09-12T00:07:30.332647+0000","last_peered":"2024-09-12T00:07:30.332647+0000","last_clean":"2024-09-12T00:07:30.332647+0000","last_became_active":"2024-09-12T00:06:26.672080+0000","last_became_peered":"2024-09-12T00:06:26.672080+0000","last_unstale":"2024-09-12T00:07:30.332647+0000","last_undegraded":"2024-09-12T00:07:30.332647+0000","last_fullsized":"2024-09-12T00:07:30.332647+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'50","last_scrub_stamp":"2024-09-12T00:07:30.332323+0000","last_deep_scrub":"116'50","last_deep_scrub_stamp":"2024-09-12T00:07:30.332323+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.332323+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:10.469784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":180355072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"96'10","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:23.101544+0000","last_change":"2024-09-12T00:07:23.101396+0000","last_active":"2024-09-12T00:07:23.101544+0000","last_peered":"2024-09-12T00:07:23.101544+0000","last_clean":"2024-09-12T00:07:23.101544+0000","last_became_active":"2024-09-12T00:03:25.326262+0000","last_became_peered":"2024-09-12T00:03:25.326262+0000","last_unstale":"2024-09-12T00:07:23.101544+0000","last_undegraded":"2024-09-12T00:07:23.101544+0000","last_fullsized":"2024-09-12T00:07:23.101544+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'10","last_scrub_stamp":"2024-09-12T00:07:23.101205+0000","last_deep_scrub":"96'10","last_deep_scrub_stamp":"2024-09-12T00:07:23.101205+0000","last_clean_scrub_stamp":"2024-09-12T00:07:23.101205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:05.106323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"116'32","reported_seq":234,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.566988+0000","last_change":"2024-09-12T00:07:25.566823+0000","last_active":"2024-09-12T00:07:25.566988+0000","last_peered":"2024-09-12T00:07:25.566988+0000","last_clean":"2024-09-12T00:07:25.566988+0000","last_became_active":"2024-09-12T00:03:23.631510+0000","last_became_peered":"2024-09-12T00:03:23.631510+0000","last_unstale":"2024-09-12T00:07:25.566988+0000","last_undegraded":"2024-09-12T00:07:25.566988+0000","last_fullsized":"2024-09-12T00:07:25.566988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-09-12T00:07:25.566638+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-09-12T00:07:25.566638+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.566638+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:24.452852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"58'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.799082+0000","last_change":"2024-09-12T00:07:28.798915+0000","last_active":"2024-09-12T00:07:28.799082+0000","last_peered":"2024-09-12T00:07:28.799082+0000","last_clean":"2024-09-12T00:07:28.799082+0000","last_became_active":"2024-09-12T00:03:25.337834+0000","last_became_peered":"2024-09-12T00:03:25.337834+0000","last_unstale":"2024-09-12T00:07:28.799082+0000","last_undegraded":"2024-09-12T00:07:28.799082+0000","last_fullsized":"2024-09-12T00:07:28.799082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:28.798730+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:28.798730+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.798730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:41.285633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"116'32","reported_seq":99,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.937148+0000","last_change":"2024-09-12T00:07:30.937148+0000","last_active":"2024-09-12T00:07:30.937148+0000","last_peered":"2024-09-12T00:07:30.937148+0000","last_clean":"2024-09-12T00:07:30.937148+0000","last_became_active":"2024-09-12T00:06:26.666889+0000","last_became_peered":"2024-09-12T00:06:26.666889+0000","last_unstale":"2024-09-12T00:07:30.937148+0000","last_undegraded":"2024-09-12T00:07:30.937148+0000","last_fullsized":"2024-09-12T00:07:30.937148+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-09-12T00:07:30.936954+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-09-12T00:07:30.936954+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.936954+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:35.026009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:28.348173+0000","last_change":"2024-09-12T00:07:28.348032+0000","last_active":"2024-09-12T00:07:28.348173+0000","last_peered":"2024-09-12T00:07:28.348173+0000","last_clean":"2024-09-12T00:07:28.348173+0000","last_became_active":"2024-09-12T00:03:25.336511+0000","last_became_peered":"2024-09-12T00:03:25.336511+0000","last_unstale":"2024-09-12T00:07:28.348173+0000","last_undegraded":"2024-09-12T00:07:28.348173+0000","last_fullsized":"2024-09-12T00:07:28.348173+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-09-12T00:07:28.347836+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-09-12T00:07:28.347836+0000","last_clean_scrub_stamp":"2024-09-12T00:07:28.347836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:06.273440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"116'56","reported_seq":258,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:26.587619+0000","last_change":"2024-09-12T00:07:26.587491+0000","last_active":"2024-09-12T00:07:26.587619+0000","last_peered":"2024-09-12T00:07:26.587619+0000","last_clean":"2024-09-12T00:07:26.587619+0000","last_became_active":"2024-09-12T00:03:23.621761+0000","last_became_peered":"2024-09-12T00:03:23.621761+0000","last_unstale":"2024-09-12T00:07:26.587619+0000","last_undegraded":"2024-09-12T00:07:26.587619+0000","last_fullsized":"2024-09-12T00:07:26.587619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-09-12T00:07:26.587314+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-09-12T00:07:26.587314+0000","last_clean_scrub_stamp":"2024-09-12T00:07:26.587314+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:13.090555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"59'4","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:36.721651+0000","last_change":"2024-09-12T00:07:36.721479+0000","last_active":"2024-09-12T00:07:36.721651+0000","last_peered":"2024-09-12T00:07:36.721651+0000","last_clean":"2024-09-12T00:07:36.721651+0000","last_became_active":"2024-09-12T00:06:26.677331+0000","last_became_peered":"2024-09-12T00:06:26.677331+0000","last_unstale":"2024-09-12T00:07:36.721651+0000","last_undegraded":"2024-09-12T00:07:36.721651+0000","last_fullsized":"2024-09-12T00:07:36.721651+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'4","last_scrub_stamp":"2024-09-12T00:07:36.721288+0000","last_deep_scrub":"59'4","last_deep_scrub_stamp":"2024-09-12T00:07:36.721288+0000","last_clean_scrub_stamp":"2024-09-12T00:07:36.721288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:01.956846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"116'48","reported_seq":253,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.021573+0000","last_change":"2024-09-12T00:07:19.021467+0000","last_active":"2024-09-12T00:07:19.021573+0000","last_peered":"2024-09-12T00:07:19.021573+0000","last_clean":"2024-09-12T00:07:19.021573+0000","last_became_active":"2024-09-12T00:03:23.600673+0000","last_became_peered":"2024-09-12T00:03:23.600673+0000","last_unstale":"2024-09-12T00:07:19.021573+0000","last_undegraded":"2024-09-12T00:07:19.021573+0000","last_fullsized":"2024-09-12T00:07:19.021573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-09-12T00:07:19.021358+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-09-12T00:07:19.021358+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.021358+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:41.825822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"96'6","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.170635+0000","last_change":"2024-09-12T00:07:27.170482+0000","last_active":"2024-09-12T00:07:27.170635+0000","last_peered":"2024-09-12T00:07:27.170635+0000","last_clean":"2024-09-12T00:07:27.170635+0000","last_became_active":"2024-09-12T00:03:25.324597+0000","last_became_peered":"2024-09-12T00:03:25.324597+0000","last_unstale":"2024-09-12T00:07:27.170635+0000","last_undegraded":"2024-09-12T00:07:27.170635+0000","last_fullsized":"2024-09-12T00:07:27.170635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"96'6","last_scrub_stamp":"2024-09-12T00:07:27.170254+0000","last_deep_scrub":"96'6","last_deep_scrub_stamp":"2024-09-12T00:07:27.170254+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.170254+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:07.383195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"116'38","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.753268+0000","last_change":"2024-09-12T00:07:24.753120+0000","last_active":"2024-09-12T00:07:24.753268+0000","last_peered":"2024-09-12T00:07:24.753268+0000","last_clean":"2024-09-12T00:07:24.753268+0000","last_became_active":"2024-09-12T00:03:23.621063+0000","last_became_peered":"2024-09-12T00:03:23.621063+0000","last_unstale":"2024-09-12T00:07:24.753268+0000","last_undegraded":"2024-09-12T00:07:24.753268+0000","last_fullsized":"2024-09-12T00:07:24.753268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'38","last_scrub_stamp":"2024-09-12T00:07:24.752946+0000","last_deep_scrub":"116'38","last_deep_scrub_stamp":"2024-09-12T00:07:24.752946+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.752946+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:29.077551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":75776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:25.152281+0000","last_change":"2024-09-12T00:07:25.152134+0000","last_active":"2024-09-12T00:07:25.152281+0000","last_peered":"2024-09-12T00:07:25.152281+0000","last_clean":"2024-09-12T00:07:25.152281+0000","last_became_active":"2024-09-12T00:03:25.357286+0000","last_became_peered":"2024-09-12T00:03:25.357286+0000","last_unstale":"2024-09-12T00:07:25.152281+0000","last_undegraded":"2024-09-12T00:07:25.152281+0000","last_fullsized":"2024-09-12T00:07:25.152281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:07:25.151922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:07:25.151922+0000","last_clean_scrub_stamp":"2024-09-12T00:07:25.151922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:11.429863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"116'40","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:19.429402+0000","last_change":"2024-09-12T00:07:19.429253+0000","last_active":"2024-09-12T00:07:19.429402+0000","last_peered":"2024-09-12T00:07:19.429402+0000","last_clean":"2024-09-12T00:07:19.429402+0000","last_became_active":"2024-09-12T00:03:23.600591+0000","last_became_peered":"2024-09-12T00:03:23.600591+0000","last_unstale":"2024-09-12T00:07:19.429402+0000","last_undegraded":"2024-09-12T00:07:19.429402+0000","last_fullsized":"2024-09-12T00:07:19.429402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-09-12T00:07:19.429061+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-09-12T00:07:19.429061+0000","last_clean_scrub_stamp":"2024-09-12T00:07:19.429061+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:32.448809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":48,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"84'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.750813+0000","last_change":"2024-09-12T00:07:27.750681+0000","last_active":"2024-09-12T00:07:27.750813+0000","last_peered":"2024-09-12T00:07:27.750813+0000","last_clean":"2024-09-12T00:07:27.750813+0000","last_became_active":"2024-09-12T00:03:25.329742+0000","last_became_peered":"2024-09-12T00:03:25.329742+0000","last_unstale":"2024-09-12T00:07:27.750813+0000","last_undegraded":"2024-09-12T00:07:27.750813+0000","last_fullsized":"2024-09-12T00:07:27.750813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-09-12T00:07:27.750492+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-09-12T00:07:27.750492+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.750492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:22.714477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"116'62","reported_seq":143,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.908089+0000","last_change":"2024-09-12T00:07:31.908089+0000","last_active":"2024-09-12T00:07:31.908089+0000","last_peered":"2024-09-12T00:07:31.908089+0000","last_clean":"2024-09-12T00:07:31.908089+0000","last_became_active":"2024-09-12T00:06:26.668022+0000","last_became_peered":"2024-09-12T00:06:26.668022+0000","last_unstale":"2024-09-12T00:07:31.908089+0000","last_undegraded":"2024-09-12T00:07:31.908089+0000","last_fullsized":"2024-09-12T00:07:31.908089+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'62","last_scrub_stamp":"2024-09-12T00:07:31.907903+0000","last_deep_scrub":"116'62","last_deep_scrub_stamp":"2024-09-12T00:07:31.907903+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.907903+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:36.717756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":3,"num_write":70,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":222298112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"59'4","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:31.744644+0000","last_change":"2024-09-12T00:07:31.744456+0000","last_active":"2024-09-12T00:07:31.744644+0000","last_peered":"2024-09-12T00:07:31.744644+0000","last_clean":"2024-09-12T00:07:31.744644+0000","last_became_active":"2024-09-12T00:03:25.346874+0000","last_became_peered":"2024-09-12T00:03:25.346874+0000","last_unstale":"2024-09-12T00:07:31.744644+0000","last_undegraded":"2024-09-12T00:07:31.744644+0000","last_fullsized":"2024-09-12T00:07:31.744644+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'4","last_scrub_stamp":"2024-09-12T00:07:31.744229+0000","last_deep_scrub":"59'4","last_deep_scrub_stamp":"2024-09-12T00:07:31.744229+0000","last_clean_scrub_stamp":"2024-09-12T00:07:31.744229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:54.373084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"116'46","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:21.788407+0000","last_change":"2024-09-12T00:07:21.788234+0000","last_active":"2024-09-12T00:07:21.788407+0000","last_peered":"2024-09-12T00:07:21.788407+0000","last_clean":"2024-09-12T00:07:21.788407+0000","last_became_active":"2024-09-12T00:03:23.620261+0000","last_became_peered":"2024-09-12T00:03:23.620261+0000","last_unstale":"2024-09-12T00:07:21.788407+0000","last_undegraded":"2024-09-12T00:07:21.788407+0000","last_fullsized":"2024-09-12T00:07:21.788407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-09-12T00:07:21.788057+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-09-12T00:07:21.788057+0000","last_clean_scrub_stamp":"2024-09-12T00:07:21.788057+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:38.237924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"63'8","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:24.119877+0000","last_change":"2024-09-12T00:07:24.119687+0000","last_active":"2024-09-12T00:07:24.119877+0000","last_peered":"2024-09-12T00:07:24.119877+0000","last_clean":"2024-09-12T00:07:24.119877+0000","last_became_active":"2024-09-12T00:03:25.357186+0000","last_became_peered":"2024-09-12T00:03:25.357186+0000","last_unstale":"2024-09-12T00:07:24.119877+0000","last_undegraded":"2024-09-12T00:07:24.119877+0000","last_fullsized":"2024-09-12T00:07:24.119877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'8","last_scrub_stamp":"2024-09-12T00:07:24.119490+0000","last_deep_scrub":"63'8","last_deep_scrub_stamp":"2024-09-12T00:07:24.119490+0000","last_clean_scrub_stamp":"2024-09-12T00:07:24.119490+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:16.554769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"116'52","reported_seq":129,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:29.967297+0000","last_change":"2024-09-12T00:07:29.967297+0000","last_active":"2024-09-12T00:07:29.967297+0000","last_peered":"2024-09-12T00:07:29.967297+0000","last_clean":"2024-09-12T00:07:29.967297+0000","last_became_active":"2024-09-12T00:06:26.677360+0000","last_became_peered":"2024-09-12T00:06:26.677360+0000","last_unstale":"2024-09-12T00:07:29.967297+0000","last_undegraded":"2024-09-12T00:07:29.967297+0000","last_fullsized":"2024-09-12T00:07:29.967297+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'52","last_scrub_stamp":"2024-09-12T00:07:29.967103+0000","last_deep_scrub":"116'52","last_deep_scrub_stamp":"2024-09-12T00:07:29.967103+0000","last_clean_scrub_stamp":"2024-09-12T00:07:29.967103+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:32.916886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":163577856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"116'54","reported_seq":132,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:32.902383+0000","last_change":"2024-09-12T00:07:32.902383+0000","last_active":"2024-09-12T00:07:32.902383+0000","last_peered":"2024-09-12T00:07:32.902383+0000","last_clean":"2024-09-12T00:07:32.902383+0000","last_became_active":"2024-09-12T00:06:26.669830+0000","last_became_peered":"2024-09-12T00:06:26.669830+0000","last_unstale":"2024-09-12T00:07:32.902383+0000","last_undegraded":"2024-09-12T00:07:32.902383+0000","last_fullsized":"2024-09-12T00:07:32.902383+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'54","last_scrub_stamp":"2024-09-12T00:07:32.902205+0000","last_deep_scrub":"116'54","last_deep_scrub_stamp":"2024-09-12T00:07:32.902205+0000","last_clean_scrub_stamp":"2024-09-12T00:07:32.902205+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:44.716783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":192937984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"84'6","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:33.783295+0000","last_change":"2024-09-12T00:07:33.783295+0000","last_active":"2024-09-12T00:07:33.783295+0000","last_peered":"2024-09-12T00:07:33.783295+0000","last_clean":"2024-09-12T00:07:33.783295+0000","last_became_active":"2024-09-12T00:03:25.349281+0000","last_became_peered":"2024-09-12T00:03:25.349281+0000","last_unstale":"2024-09-12T00:07:33.783295+0000","last_undegraded":"2024-09-12T00:07:33.783295+0000","last_fullsized":"2024-09-12T00:07:33.783295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'6","last_scrub_stamp":"2024-09-12T00:07:33.783104+0000","last_deep_scrub":"84'6","last_deep_scrub_stamp":"2024-09-12T00:07:33.783104+0000","last_clean_scrub_stamp":"2024-09-12T00:07:33.783104+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:23.385096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"116'40","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:27.635760+0000","last_change":"2024-09-12T00:07:27.635628+0000","last_active":"2024-09-12T00:07:27.635760+0000","last_peered":"2024-09-12T00:07:27.635760+0000","last_clean":"2024-09-12T00:07:27.635760+0000","last_became_active":"2024-09-12T00:03:23.616154+0000","last_became_peered":"2024-09-12T00:03:23.616154+0000","last_unstale":"2024-09-12T00:07:27.635760+0000","last_undegraded":"2024-09-12T00:07:27.635760+0000","last_fullsized":"2024-09-12T00:07:27.635760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-09-12T00:07:27.635444+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-09-12T00:07:27.635444+0000","last_clean_scrub_stamp":"2024-09-12T00:07:27.635444+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:56.025683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"58'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T00:07:30.105454+0000","last_change":"2024-09-12T00:07:30.105454+0000","last_active":"2024-09-12T00:07:30.105454+0000","last_peered":"2024-09-12T00:07:30.105454+0000","last_clean":"2024-09-12T00:07:30.105454+0000","last_became_active":"2024-09-12T00:03:25.344917+0000","last_became_peered":"2024-09-12T00:03:25.344917+0000","last_unstale":"2024-09-12T00:07:30.105454+0000","last_undegraded":"2024-09-12T00:07:30.105454+0000","last_fullsized":"2024-09-12T00:07:30.105454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-12T00:07:30.105274+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-12T00:07:30.105274+0000","last_clean_scrub_stamp":"2024-09-12T00:07:30.105274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:58.157135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":339,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1113,"ondisk_log_size":1113,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":31604,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1351,"num_read_kb":1799,"num_write":737,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":117531,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1248,"ondisk_log_size":1248,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1444,"num_read_kb":1412,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3088,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":721,"num_bytes_recovered":3007315968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542210,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36732,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335108,"statfs":{"total":96636764160,"available":96599150592,"internally_reserved":0,"allocated":1421312,"data_stored":797851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542210,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36736,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335104,"statfs":{"total":96636764160,"available":96599146496,"internally_reserved":0,"allocated":1425408,"data_stored":798943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542210,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41472,"kb_used_data":1968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330368,"statfs":{"total":96636764160,"available":96594296832,"internally_reserved":0,"allocated":2015232,"data_stored":1388365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542210,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36732,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335108,"statfs":{"total":96636764160,"available":96599150592,"internally_reserved":0,"allocated":1421312,"data_stored":797651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542210,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45044,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326796,"statfs":{"total":96636764160,"available":96590639104,"internally_reserved":0,"allocated":1413120,"data_stored":797340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542211,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36708,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335132,"statfs":{"total":96636764160,"available":96599175168,"internally_reserved":0,"allocated":1396736,"data_stored":796956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542210,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37340,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334500,"statfs":{"total":96636764160,"available":96598528000,"internally_reserved":0,"allocated":2043904,"data_stored":1389896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542209,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36756,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335084,"statfs":{"total":96636764160,"available":96599126016,"internally_reserved":0,"allocated":1445888,"data_stored":798128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:08:20.261 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T00:08:20.634 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T00:08:20.634 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T00:08:20.634 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T00:08:20.634 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:08:20.726 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T00:08:20.726 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T00:08:20.726 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:08:22.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-12T00:08:26.828 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T00:08:26.828 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T00:08:26.829 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:08:26.926 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T00:08:26.926 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T00:08:26.927 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:08:28.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-12T00:08:28.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-12T00:08:33.029 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T00:08:33.029 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T00:08:33.029 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:08:33.095 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T00:08:33.095 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T00:08:33.095 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:08:33.193 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T00:08:33.194 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T00:08:33.194 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:08:33.283 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T00:08:33.283 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T00:08:33.284 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:08:33.361 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T00:08:33.362 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T00:08:33.362 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T00:08:33.362 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:08:33.393 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T00:08:33.393 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T00:08:33.394 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:08:33.423 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T00:08:33.423 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T00:08:33.424 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T00:08:33.424 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:08:33.454 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T00:08:33.454 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T00:08:33.454 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:08:33.515 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T00:08:33.516 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T00:08:33.516 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:08:33.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-12T00:08:33.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-12T00:08:33.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-12T00:08:33.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-12T00:08:33.537 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T00:08:33.537 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T00:08:33.537 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-12T00:08:33.576 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T00:08:33.577 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T00:08:33.879 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T00:08:33.879 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T00:08:34.082 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T00:08:34.082 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T00:08:34.395 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T00:08:34.395 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T00:08:34.587 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T00:08:34.587 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T00:08:34.990 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T00:08:34.991 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T00:08:35.212 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T00:08:35.212 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T00:08:35.419 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T00:08:35.420 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T00:08:35.668 INFO:tasks.ceph:Archiving mon data... 2024-09-12T00:08:35.669 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901820/data/mon.a.tgz 2024-09-12T00:08:35.669 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-09-12T00:08:35.675 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.hb5nUXzbNw 2024-09-12T00:08:35.676 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.hb5nUXzbNw 2024-09-12T00:08:35.854 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.hb5nUXzbNw 2024-09-12T00:08:35.921 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.hb5nUXzbNw is 571KB 2024-09-12T00:08:35.992 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.hb5nUXzbNw 2024-09-12T00:08:35.997 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901820/data/mon.c.tgz 2024-09-12T00:08:35.998 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-09-12T00:08:36.046 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.IkNfPsV1NH 2024-09-12T00:08:36.046 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.IkNfPsV1NH 2024-09-12T00:08:36.274 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.IkNfPsV1NH 2024-09-12T00:08:36.339 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.IkNfPsV1NH is 743KB 2024-09-12T00:08:36.405 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.IkNfPsV1NH 2024-09-12T00:08:36.410 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901820/data/mon.b.tgz 2024-09-12T00:08:36.411 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-09-12T00:08:36.416 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.2uJ9vrwf9p 2024-09-12T00:08:36.417 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.2uJ9vrwf9p 2024-09-12T00:08:36.634 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.2uJ9vrwf9p 2024-09-12T00:08:36.697 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.2uJ9vrwf9p is 743KB 2024-09-12T00:08:36.775 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.2uJ9vrwf9p 2024-09-12T00:08:36.780 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T00:08:36.780 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T00:08:36.782 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T00:08:36.842 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T00:08:36.885 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T00:08:36.886 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T00:08:36.888 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901820/remote/smithi019/crash 2024-09-12T00:08:36.888 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T00:08:36.903 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901820/remote/smithi135/crash 2024-09-12T00:08:36.903 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T00:08:36.941 INFO:tasks.ceph:Compressing logs... 2024-09-12T00:08:36.941 DEBUG:teuthology.orchestra.run.smithi019:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T00:08:36.947 DEBUG:teuthology.orchestra.run.smithi135:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T00:08:36.969 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65554.log 2024-09-12T00:08:36.971 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66050.log 2024-09-12T00:08:36.971 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65554.log.gz 2024-09-12T00:08:36.971 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41645.log 2024-09-12T00:08:36.971 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66050.log.gz 2024-09-12T00:08:36.971 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65970.log 2024-09-12T00:08:36.976 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34962.log 2024-09-12T00:08:36.976 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41645.log.gz 2024-09-12T00:08:36.976 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65970.log.gz 2024-09-12T00:08:36.976 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64599.log 2024-09-12T00:08:36.976 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34962.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T00:08:36.976 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34962.log.gz 2024-09-12T00:08:36.976 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64599.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.64779.log -- replaced with /var/log/ceph/ceph-client.admin.64599.log.gz 2024-09-12T00:08:36.976 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T00:08:36.976 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58764.log 2024-09-12T00:08:36.977 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/rgw.ceph.client.0.log: /var/log/ceph/ceph-client.admin.64779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64779.log.gz 2024-09-12T00:08:36.977 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32139.log 2024-09-12T00:08:36.977 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T00:08:36.977 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58764.log.gz 2024-09-12T00:08:36.977 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60835.log 2024-09-12T00:08:36.977 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32139.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.32139.log.gz --verbose 2024-09-12T00:08:36.977 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.67842.log 2024-09-12T00:08:36.977 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61901.log 2024-09-12T00:08:36.977 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60835.log.gz 2024-09-12T00:08:36.977 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67842.log.gz 2024-09-12T00:08:36.977 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66646.log 2024-09-12T00:08:36.977 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61901.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T00:08:36.977 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61901.log.gz 2024-09-12T00:08:36.978 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66646.log.gz 2024-09-12T00:08:36.978 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67738.log 2024-09-12T00:08:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35335.log 2024-09-12T00:08:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33444.log 2024-09-12T00:08:36.984 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67738.log.gz 2024-09-12T00:08:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34494.log 2024-09-12T00:08:36.985 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35335.log.gz 2024-09-12T00:08:36.985 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32141.log 2024-09-12T00:08:36.985 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33444.log.gz 2024-09-12T00:08:36.985 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34494.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34494.log.gz 2024-09-12T00:08:36.985 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35653.log 2024-09-12T00:08:36.985 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58411.log 2024-09-12T00:08:36.985 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32141.log.gz 2024-09-12T00:08:36.985 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47025.log 2024-09-12T00:08:36.985 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35653.log.gz 2024-09-12T00:08:36.985 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34737.log 2024-09-12T00:08:36.985 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58411.log.gz 2024-09-12T00:08:36.985 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47025.log.gz 2024-09-12T00:08:36.985 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33632.log 2024-09-12T00:08:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46435.log 2024-09-12T00:08:36.986 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34737.log.gz 2024-09-12T00:08:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33632.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.33632.log.gz -- 2024-09-12T00:08:36.986 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.67608.log 2024-09-12T00:08:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33511.log 2024-09-12T00:08:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46435.log: 93.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T00:08:36.986 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46435.log.gz 2024-09-12T00:08:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67608.log.gz 2024-09-12T00:08:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66464.log 2024-09-12T00:08:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57173.log 2024-09-12T00:08:36.986 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33511.log.gz 2024-09-12T00:08:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66464.log.gz 2024-09-12T00:08:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57368.log 2024-09-12T00:08:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32334.log 2024-09-12T00:08:36.987 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57173.log.gz 2024-09-12T00:08:36.987 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34312.log 2024-09-12T00:08:36.987 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57368.log.gz 2024-09-12T00:08:36.987 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34987.log 2024-09-12T00:08:36.987 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32334.log.gz 2024-09-12T00:08:36.987 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34312.log.gz 2024-09-12T00:08:36.988 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T00:08:36.988 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33392.log 2024-09-12T00:08:36.988 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34987.log.gz 2024-09-12T00:08:36.988 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32145.log 2024-09-12T00:08:37.002 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61561.log 2024-09-12T00:08:37.002 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33392.log.gz 2024-09-12T00:08:37.002 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32130.log 2024-09-12T00:08:37.002 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32145.log.gz 2024-09-12T00:08:37.002 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33513.log 2024-09-12T00:08:37.002 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61561.log.gz 2024-09-12T00:08:37.002 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32130.log.gz 2024-09-12T00:08:37.002 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66246.log 2024-09-12T00:08:37.003 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34316.log 2024-09-12T00:08:37.003 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33513.log.gz 2024-09-12T00:08:37.003 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55933.log 2024-09-12T00:08:37.003 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66246.log.gz 2024-09-12T00:08:37.003 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32636.log 2024-09-12T00:08:37.003 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34316.log.gz 2024-09-12T00:08:37.003 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49975.log 2024-09-12T00:08:37.003 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55933.log.gz 2024-09-12T00:08:37.003 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66044.log 2024-09-12T00:08:37.003 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32636.log.gz 2024-09-12T00:08:37.003 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34250.log 2024-09-12T00:08:37.004 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49975.log.gz 2024-09-12T00:08:37.004 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34825.log 2024-09-12T00:08:37.004 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66044.log.gz 2024-09-12T00:08:37.004 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66459.log 2024-09-12T00:08:37.004 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34250.log.gz 2024-09-12T00:08:37.004 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5/var/log/ceph/ceph-client.admin.34825.log: --verbose -- /var/log/ceph/ceph-client.admin.66672.log 2024-09-12T00:08:37.004 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34825.log.gz 2024-09-12T00:08:37.004 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54574.log 2024-09-12T00:08:37.005 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66459.log.gz 2024-09-12T00:08:37.005 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66245.log 2024-09-12T00:08:37.005 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66672.log.gz 2024-09-12T00:08:37.005 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42832.log 2024-09-12T00:08:37.005 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54574.log.gz 2024-09-12T00:08:37.005 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32335.log 2024-09-12T00:08:37.005 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66245.log.gz 2024-09-12T00:08:37.005 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67450.log 2024-09-12T00:08:37.005 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42832.log.gz 2024-09-12T00:08:37.005 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58681.log 2024-09-12T00:08:37.005 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32335.log.gz 2024-09-12T00:08:37.005 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57637.log 2024-09-12T00:08:37.006 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67450.log.gz 2024-09-12T00:08:37.006 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66698.log 2024-09-12T00:08:37.006 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58681.log.gz 2024-09-12T00:08:37.006 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53068.log 2024-09-12T00:08:37.007 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57637.log.gz 2024-09-12T00:08:37.007 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57455.log 2024-09-12T00:08:37.007 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66698.log.gz 2024-09-12T00:08:37.007 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65399.log 2024-09-12T00:08:37.007 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53068.log.gz 2024-09-12T00:08:37.007 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35248.log 2024-09-12T00:08:37.007 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57455.log.gz 2024-09-12T00:08:37.007 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67476.log 2024-09-12T00:08:37.007 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65399.log.gz 2024-09-12T00:08:37.007 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35139.log 2024-09-12T00:08:37.007 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35248.log.gz 2024-09-12T00:08:37.007 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38605.log 2024-09-12T00:08:37.008 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67476.log.gz 2024-09-12T00:08:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34589.log 2024-09-12T00:08:37.008 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35139.log.gz 2024-09-12T00:08:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54052.log 2024-09-12T00:08:37.008 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38605.log.gz 2024-09-12T00:08:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32066.log 2024-09-12T00:08:37.008 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34589.log.gz 2024-09-12T00:08:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54052.log.gz 2024-09-12T00:08:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T00:08:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65840.log 2024-09-12T00:08:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32066.log.gz 2024-09-12T00:08:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54415.log 2024-09-12T00:08:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65375.log 2024-09-12T00:08:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65840.log.gz 2024-09-12T00:08:37.009 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35430.log 2024-09-12T00:08:37.009 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54415.log.gz 2024-09-12T00:08:37.009 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65710.log 2024-09-12T00:08:37.009 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65375.log.gz 2024-09-12T00:08:37.009 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32144.log 2024-09-12T00:08:37.009 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35430.log.gz 2024-09-12T00:08:37.009 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65710.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.65710.log.gz 2024-09-12T00:08:37.009 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32534.log 2024-09-12T00:08:37.009 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.32144.log: /var/log/ceph/ceph-client.admin.32586.log 2024-09-12T00:08:37.009 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32144.log.gz 2024-09-12T00:08:37.009 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60756.log 2024-09-12T00:08:37.009 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32534.log.gz 2024-09-12T00:08:37.009 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.admin.32586.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53043.log 2024-09-12T00:08:37.010 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32586.log.gz 2024-09-12T00:08:37.010 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60756.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T00:08:37.010 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60756.log.gz 2024-09-12T00:08:37.010 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32560.log 2024-09-12T00:08:37.010 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53043.log.gz 2024-09-12T00:08:37.028 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T00:08:37.028 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T00:08:37.028 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26479.log 2024-09-12T00:08:37.028 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26383.log 2024-09-12T00:08:37.028 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T00:08:37.029 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26479.log: /var/log/ceph/ceph-client.admin.26383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26431.log 2024-09-12T00:08:37.029 INFO:teuthology.orchestra.run.smithi135.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26479.log.gz 2024-09-12T00:08:37.029 INFO:teuthology.orchestra.run.smithi135.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26383.log.gz 2024-09-12T00:08:37.029 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T00:08:37.029 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T00:08:37.029 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26431.log.gz 2024-09-12T00:08:37.029 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26558.log 2024-09-12T00:08:37.029 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26455.log 2024-09-12T00:08:37.029 INFO:teuthology.orchestra.run.smithi135.stderr:gzip/var/log/ceph/ceph-client.admin.26558.log: -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T00:08:37.029 INFO:teuthology.orchestra.run.smithi135.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26558.log.gz 2024-09-12T00:08:37.029 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26534.log 2024-09-12T00:08:37.029 INFO:teuthology.orchestra.run.smithi135.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26455.log.gz 2024-09-12T00:08:37.030 INFO:teuthology.orchestra.run.smithi135.stderr:gzip/var/log/ceph/ceph.audit.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.26503.log 2024-09-12T00:08:37.030 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26534.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T00:08:37.030 INFO:teuthology.orchestra.run.smithi135.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26534.log.gz 2024-09-12T00:08:37.030 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26503.log.gz 2024-09-12T00:08:37.030 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T00:08:37.030 INFO:teuthology.orchestra.run.smithi135.stderr: 89.3%/var/log/ceph/ceph-mon.b.log: -- replaced with /var/log/ceph/ceph.audit.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26407.log 2024-09-12T00:08:37.030 INFO:teuthology.orchestra.run.smithi135.stderr: 86.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T00:08:37.030 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-09-12T00:08:37.030 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.26407.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26407.log.gz 2024-09-12T00:08:37.056 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32660.log 2024-09-12T00:08:37.056 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58643.log 2024-09-12T00:08:37.056 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32560.log.gz 2024-09-12T00:08:37.056 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60640.log 2024-09-12T00:08:37.056 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32660.log.gz 2024-09-12T00:08:37.056 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67790.log 2024-09-12T00:08:37.056 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58643.log.gz 2024-09-12T00:08:37.056 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60640.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.26422.log -- replaced with /var/log/ceph/ceph-client.admin.60640.log.gz 2024-09-12T00:08:37.056 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T00:08:37.056 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32354.log 2024-09-12T00:08:37.057 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67790.log.gz 2024-09-12T00:08:37.057 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.26422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26422.log.gz 2024-09-12T00:08:37.057 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31969.log 2024-09-12T00:08:37.057 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33814.log 2024-09-12T00:08:37.057 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32354.log.gz 2024-09-12T00:08:37.057 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34460.log 2024-09-12T00:08:37.057 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31969.log.gz 2024-09-12T00:08:37.057 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67424.log 2024-09-12T00:08:37.057 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33814.log.gz 2024-09-12T00:08:37.057 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34152.log 2024-09-12T00:08:37.057 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34460.log.gz 2024-09-12T00:08:37.057 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67424.log.gz 2024-09-12T00:08:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66040.log 2024-09-12T00:08:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57299.log 2024-09-12T00:08:37.058 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34152.log.gz 2024-09-12T00:08:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32146.log 2024-09-12T00:08:37.058 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66040.log.gz 2024-09-12T00:08:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33711.log 2024-09-12T00:08:37.058 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57299.log.gz 2024-09-12T00:08:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64719.log 2024-09-12T00:08:37.058 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32146.log.gz 2024-09-12T00:08:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34213.log 2024-09-12T00:08:37.058 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33711.log.gz 2024-09-12T00:08:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66460.log 2024-09-12T00:08:37.059 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64719.log.gz 2024-09-12T00:08:37.059 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66239.log 2024-09-12T00:08:37.059 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34213.log.gz 2024-09-12T00:08:37.059 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65814.log 2024-09-12T00:08:37.059 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66460.log.gz 2024-09-12T00:08:37.059 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66239.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.66239.log.gz 2024-09-12T00:08:37.059 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61628.log 2024-09-12T00:08:37.059 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54056.log 2024-09-12T00:08:37.059 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65814.log.gz 2024-09-12T00:08:37.059 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61628.log.gz 2024-09-12T00:08:37.059 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32346.log 2024-09-12T00:08:37.059 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57116.log 2024-09-12T00:08:37.060 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54056.log.gz 2024-09-12T00:08:37.060 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32346.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.32346.log.gz --verbose 2024-09-12T00:08:37.060 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.65736.log 2024-09-12T00:08:37.060 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33863.log 2024-09-12T00:08:37.060 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57116.log.gz 2024-09-12T00:08:37.060 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31994.log 2024-09-12T00:08:37.060 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65736.log.gz 2024-09-12T00:08:37.060 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54673.log 2024-09-12T00:08:37.060 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33863.log.gz 2024-09-12T00:08:37.060 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31994.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.31994.log.gz -5 2024-09-12T00:08:37.060 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54320.log 2024-09-12T00:08:37.061 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49385.log 2024-09-12T00:08:37.061 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54673.log.gz 2024-09-12T00:08:37.061 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57692.log 2024-09-12T00:08:37.061 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54320.log.gz 2024-09-12T00:08:37.061 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41567.log 2024-09-12T00:08:37.061 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49385.log.gz 2024-09-12T00:08:37.061 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57692.log.gz 2024-09-12T00:08:37.061 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65445.log 2024-09-12T00:08:37.061 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54159.log 2024-09-12T00:08:37.061 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41567.log.gz 2024-09-12T00:08:37.062 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67894.log 2024-09-12T00:08:37.062 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65445.log.gz 2024-09-12T00:08:37.062 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60932.log 2024-09-12T00:08:37.062 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54159.log.gz 2024-09-12T00:08:37.062 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67894.log.gz 2024-09-12T00:08:37.062 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65580.log 2024-09-12T00:08:37.062 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61719.log 2024-09-12T00:08:37.062 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60932.log.gz 2024-09-12T00:08:37.062 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35274.log 2024-09-12T00:08:37.062 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65580.log.gz 2024-09-12T00:08:37.062 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53267.log 2024-09-12T00:08:37.063 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61719.log.gz 2024-09-12T00:08:37.063 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61984.log 2024-09-12T00:08:37.063 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35274.log.gz 2024-09-12T00:08:37.063 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53267.log.gz 2024-09-12T00:08:37.063 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67582.log 2024-09-12T00:08:37.063 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35135.log 2024-09-12T00:08:37.063 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61984.log.gz 2024-09-12T00:08:37.063 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56523.log 2024-09-12T00:08:37.063 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67582.log.gz 2024-09-12T00:08:37.063 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35135.log.gzgzip 2024-09-12T00:08:37.063 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T00:08:37.063 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35377.log 2024-09-12T00:08:37.064 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56523.log: /var/log/ceph/ceph-osd.3.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56523.log.gz 2024-09-12T00:08:37.064 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54233.log 2024-09-12T00:08:37.064 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34700.log 2024-09-12T00:08:37.064 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35377.log.gz 2024-09-12T00:08:37.064 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63851.log 2024-09-12T00:08:37.064 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54233.log.gz 2024-09-12T00:08:37.064 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65658.log 2024-09-12T00:08:37.064 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34700.log.gz 2024-09-12T00:08:37.064 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.63851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65684.log 2024-09-12T00:08:37.064 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63851.log.gz 2024-09-12T00:08:37.064 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53368.log 2024-09-12T00:08:37.065 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65658.log.gz 2024-09-12T00:08:37.065 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67660.log 2024-09-12T00:08:37.065 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65684.log.gz 2024-09-12T00:08:37.065 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66256.log 2024-09-12T00:08:37.065 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53368.log.gz 2024-09-12T00:08:37.065 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65632.log 2024-09-12T00:08:37.065 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67660.log.gz 2024-09-12T00:08:37.065 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34654.log 2024-09-12T00:08:37.065 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66256.log.gz 2024-09-12T00:08:37.065 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53226.log 2024-09-12T00:08:37.065 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65632.log.gz 2024-09-12T00:08:37.066 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40428.log 2024-09-12T00:08:37.066 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34654.log.gz 2024-09-12T00:08:37.066 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53226.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T00:08:37.066 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53226.log.gz 2024-09-12T00:08:37.066 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26268.log 2024-09-12T00:08:37.066 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40428.log.gz 2024-09-12T00:08:37.066 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61537.log 2024-09-12T00:08:37.066 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.26268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35030.log 2024-09-12T00:08:37.067 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26268.log.gz 2024-09-12T00:08:37.067 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35097.log 2024-09-12T00:08:37.067 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61537.log.gz 2024-09-12T00:08:37.067 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35030.log.gz 2024-09-12T00:08:37.067 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52427.log 2024-09-12T00:08:37.067 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66047.log 2024-09-12T00:08:37.067 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35097.log.gz 2024-09-12T00:08:37.067 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52427.log.gz 2024-09-12T00:08:37.068 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66446.log 2024-09-12T00:08:37.068 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58342.log 2024-09-12T00:08:37.068 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66047.log.gz/var/log/ceph/ceph-client.admin.66446.log: 2024-09-12T00:08:37.068 INFO:teuthology.orchestra.run.smithi019.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66446.log.gz -5 2024-09-12T00:08:37.068 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32345.log 2024-09-12T00:08:37.068 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58342.log.gz 2024-09-12T00:08:37.068 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64686.log 2024-09-12T00:08:37.068 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55342.log 2024-09-12T00:08:37.068 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32345.log.gz 2024-09-12T00:08:37.068 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51833.log 2024-09-12T00:08:37.068 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64686.log.gz 2024-09-12T00:08:37.068 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55342.log.gz 2024-09-12T00:08:37.069 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67816.log 2024-09-12T00:08:37.069 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54475.log 2024-09-12T00:08:37.069 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51833.log.gz 2024-09-12T00:08:37.069 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67816.log.gz 2024-09-12T00:08:37.069 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53122.log 2024-09-12T00:08:37.069 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65918.log 2024-09-12T00:08:37.069 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54475.log.gz/var/log/ceph/ceph-client.admin.53122.log: 2024-09-12T00:08:37.069 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34539.log 2024-09-12T00:08:37.069 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53122.log.gz 2024-09-12T00:08:37.069 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65918.log.gz 2024-09-12T00:08:37.069 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61787.log 2024-09-12T00:08:37.069 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54508.log 2024-09-12T00:08:37.070 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34539.log.gz 2024-09-12T00:08:37.070 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35031.log 2024-09-12T00:08:37.070 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61787.log.gz 2024-09-12T00:08:37.070 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66233.log 2024-09-12T00:08:37.070 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54508.log: /var/log/ceph/ceph-client.admin.35031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66254.log 2024-09-12T00:08:37.070 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54508.log.gz 2024-09-12T00:08:37.070 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35031.log.gz 2024-09-12T00:08:37.070 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57480.log 2024-09-12T00:08:37.070 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66233.log.gz 2024-09-12T00:08:37.070 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67634.log 2024-09-12T00:08:37.070 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66254.log.gz 2024-09-12T00:08:37.070 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57480.log.gz 2024-09-12T00:08:37.071 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31882.log 2024-09-12T00:08:37.071 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51239.log 2024-09-12T00:08:37.071 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53968.log 2024-09-12T00:08:37.071 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31882.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31882.log.gz 2024-09-12T00:08:37.071 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67634.log.gz 2024-09-12T00:08:37.071 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51239.log.gz 2024-09-12T00:08:37.071 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34407.log 2024-09-12T00:08:37.071 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34065.log 2024-09-12T00:08:37.071 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35456.log 2024-09-12T00:08:37.071 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0%/var/log/ceph/ceph-client.admin.34407.log: -- replaced with /var/log/ceph/ceph-client.admin.53968.log.gz 2024-09-12T00:08:37.071 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34407.log.gz 2024-09-12T00:08:37.072 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34065.log.gz 2024-09-12T00:08:37.072 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44025.log 2024-09-12T00:08:37.072 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.35456.log: -- /var/log/ceph/ceph-client.admin.65996.log 2024-09-12T00:08:37.072 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35456.log.gz 2024-09-12T00:08:37.072 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65762.log 2024-09-12T00:08:37.072 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44025.log.gz 2024-09-12T00:08:37.072 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T00:08:37.072 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37424.log 2024-09-12T00:08:37.072 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65762.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65996.log.gz 2024-09-12T00:08:37.072 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65762.log.gz 2024-09-12T00:08:37.072 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53172.log 2024-09-12T00:08:37.072 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58760.log 2024-09-12T00:08:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37424.log.gz 2024-09-12T00:08:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53172.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61760.log 2024-09-12T00:08:37.073 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53172.log.gz 2024-09-12T00:08:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58760.log.gz 2024-09-12T00:08:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60790.log 2024-09-12T00:08:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34650.log 2024-09-12T00:08:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61760.log.gz 2024-09-12T00:08:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53305.log 2024-09-12T00:08:37.073 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60790.log.gz 2024-09-12T00:08:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34650.log: 92.2% 0.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T00:08:37.073 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34650.log.gz 2024-09-12T00:08:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36244.log 2024-09-12T00:08:37.074 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66438.log 2024-09-12T00:08:37.074 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53998.log 2024-09-12T00:08:37.074 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53305.log.gz 2024-09-12T00:08:37.074 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36244.log.gz 2024-09-12T00:08:37.074 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66438.log.gz 2024-09-12T00:08:37.074 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66445.log 2024-09-12T00:08:37.074 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57611.log 2024-09-12T00:08:37.074 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53998.log.gz 2024-09-12T00:08:37.074 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67320.log 2024-09-12T00:08:37.074 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66445.log.gz 2024-09-12T00:08:37.074 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34932.log 2024-09-12T00:08:37.074 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57611.log: /var/log/ceph/ceph-client.admin.67320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57611.log.gz 2024-09-12T00:08:37.075 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67320.log.gz 2024-09-12T00:08:37.075 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67502.log 2024-09-12T00:08:37.075 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67686.log 2024-09-12T00:08:37.075 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34932.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.67554.log -- replaced with /var/log/ceph/ceph-client.admin.34932.log.gz 2024-09-12T00:08:37.075 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T00:08:37.075 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67502.log.gz 2024-09-12T00:08:37.075 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67686.log.gz 2024-09-12T00:08:37.075 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58578.log 2024-09-12T00:08:37.075 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57273.log 2024-09-12T00:08:37.075 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67554.log.gz 2024-09-12T00:08:37.075 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33418.log 2024-09-12T00:08:37.075 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58578.log.gz 2024-09-12T00:08:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58384.log 2024-09-12T00:08:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57273.log: 0.0%/var/log/ceph/ceph-client.admin.33418.log: -- replaced with /var/log/ceph/ceph-client.admin.57273.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45806.log 2024-09-12T00:08:37.076 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T00:08:37.076 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33418.log.gz 2024-09-12T00:08:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58384.log.gz 2024-09-12T00:08:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58730.log 2024-09-12T00:08:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45806.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T00:08:37.076 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45806.log.gz 2024-09-12T00:08:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57405.log 2024-09-12T00:08:37.076 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58730.log.gz 2024-09-12T00:08:37.082 INFO:teuthology.orchestra.run.smithi135.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T00:08:37.111 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57570.log 2024-09-12T00:08:37.112 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.57405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61620.log 2024-09-12T00:08:37.112 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57405.log.gz 2024-09-12T00:08:37.112 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57570.log.gz 2024-09-12T00:08:37.112 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66258.log 2024-09-12T00:08:37.112 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65523.log 2024-09-12T00:08:37.112 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61620.log.gz 2024-09-12T00:08:37.112 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66258.log.gz 2024-09-12T00:08:37.112 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33366.log 2024-09-12T00:08:37.112 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64484.log 2024-09-12T00:08:37.112 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65523.log.gz 2024-09-12T00:08:37.113 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33366.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.33366.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.67712.log 2024-09-12T00:08:37.113 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T00:08:37.113 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64484.log.gz 2024-09-12T00:08:37.113 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65944.log 2024-09-12T00:08:37.113 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48795.log 2024-09-12T00:08:37.113 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67712.log.gz 2024-09-12T00:08:37.113 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65944.log.gz 2024-09-12T00:08:37.113 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67346.log 2024-09-12T00:08:37.113 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48795.log.gz 2024-09-12T00:08:37.113 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58540.log 2024-09-12T00:08:37.113 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62068.log 2024-09-12T00:08:37.113 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67346.log: /var/log/ceph/ceph-client.admin.58540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67346.log.gz 2024-09-12T00:08:37.114 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58540.log.gz 2024-09-12T00:08:37.114 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67944.log 2024-09-12T00:08:37.114 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59384.log 2024-09-12T00:08:37.114 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62068.log: /var/log/ceph/ceph-client.admin.67944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62068.log.gz 2024-09-12T00:08:37.114 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67944.log.gz 2024-09-12T00:08:37.114 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T00:08:37.114 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54105.log 2024-09-12T00:08:37.114 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59384.log: /var/log/ceph/ops-log-ceph-client.0.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59384.log.gz 2024-09-12T00:08:37.114 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32326.log 2024-09-12T00:08:37.114 INFO:teuthology.orchestra.run.smithi019.stderr: 92.0% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T00:08:37.114 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54105.log.gz 2024-09-12T00:08:37.114 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T00:08:37.115 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64625.log 2024-09-12T00:08:37.115 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32326.log: /var/log/ceph/ceph.audit.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32326.log.gz 2024-09-12T00:08:37.115 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33474.log 2024-09-12T00:08:37.115 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64625.log.gz 2024-09-12T00:08:37.115 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54730.log 2024-09-12T00:08:37.115 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33474.log.gz 2024-09-12T00:08:37.115 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62663.log 2024-09-12T00:08:37.115 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54730.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54730.log.gz 2024-09-12T00:08:37.115 INFO:teuthology.orchestra.run.smithi019.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T00:08:37.115 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35586.log 2024-09-12T00:08:37.115 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62663.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62663.log.gz 2024-09-12T00:08:37.116 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66466.log 2024-09-12T00:08:37.116 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50569.log 2024-09-12T00:08:37.116 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35586.log: /var/log/ceph/ceph-client.admin.66466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35586.log.gz 2024-09-12T00:08:37.116 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66466.log.gz 2024-09-12T00:08:37.116 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21474.log 2024-09-12T00:08:37.116 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65788.log 2024-09-12T00:08:37.116 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50569.log: /var/log/ceph/ceph.tmp-client.admin.21474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50569.log.gz 2024-09-12T00:08:37.116 INFO:teuthology.orchestra.run.smithi019.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21474.log.gz -5 2024-09-12T00:08:37.116 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.64443.log 2024-09-12T00:08:37.116 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65788.log.gz 2024-09-12T00:08:37.116 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32014.log 2024-09-12T00:08:37.117 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33970.log 2024-09-12T00:08:37.117 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64443.log: /var/log/ceph/ceph-client.admin.32014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64443.log.gz 2024-09-12T00:08:37.117 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32014.log.gz 2024-09-12T00:08:37.117 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34126.log 2024-09-12T00:08:37.117 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65892.log 2024-09-12T00:08:37.117 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33970.log: /var/log/ceph/ceph-client.admin.34126.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33970.log.gz 2024-09-12T00:08:37.117 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34126.log.gz 2024-09-12T00:08:37.117 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67868.log 2024-09-12T00:08:37.117 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32092.log 2024-09-12T00:08:37.117 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65892.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65892.log.gz 2024-09-12T00:08:37.117 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67868.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32131.log 2024-09-12T00:08:37.117 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67868.log.gz 2024-09-12T00:08:37.118 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32092.log.gz 2024-09-12T00:08:37.118 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39795.log 2024-09-12T00:08:37.118 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57215.log 2024-09-12T00:08:37.118 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32131.log: /var/log/ceph/ceph-client.admin.39795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32131.log.gz 2024-09-12T00:08:37.118 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39795.log.gz 2024-09-12T00:08:37.118 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32610.log 2024-09-12T00:08:37.118 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57215.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57215.log.gz 2024-09-12T00:08:37.118 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67764.log 2024-09-12T00:08:37.118 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66048.log 2024-09-12T00:08:37.118 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32610.log: /var/log/ceph/ceph-client.admin.67764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32610.log.gz 2024-09-12T00:08:37.118 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67764.log.gz 2024-09-12T00:08:37.118 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32040.log 2024-09-12T00:08:37.119 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44619.log 2024-09-12T00:08:37.119 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66048.log: /var/log/ceph/ceph-client.admin.32040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66048.log.gz 2024-09-12T00:08:37.119 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32040.log.gz 2024-09-12T00:08:37.119 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32134.log 2024-09-12T00:08:37.119 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31944.log 2024-09-12T00:08:37.119 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44619.log: /var/log/ceph/ceph-client.admin.32134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44619.log.gz 2024-09-12T00:08:37.119 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32134.log.gz 2024-09-12T00:08:37.119 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66465.log 2024-09-12T00:08:37.119 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38015.log 2024-09-12T00:08:37.119 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31944.log: /var/log/ceph/ceph-client.admin.66465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31944.log.gz 2024-09-12T00:08:37.119 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66465.log.gz 2024-09-12T00:08:37.120 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41027.log 2024-09-12T00:08:37.120 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33780.log 2024-09-12T00:08:37.120 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38015.log.gz 2024-09-12T00:08:37.120 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41027.log.gz 2024-09-12T00:08:37.120 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54195.log 2024-09-12T00:08:37.120 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33780.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33780.log.gz 2024-09-12T00:08:37.120 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65866.log 2024-09-12T00:08:37.120 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47615.log 2024-09-12T00:08:37.120 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54195.log.gz 2024-09-12T00:08:37.120 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65866.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54274.log 2024-09-12T00:08:37.120 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T00:08:37.121 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47615.log.gz 2024-09-12T00:08:37.121 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54385.log 2024-09-12T00:08:37.121 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33896.log 2024-09-12T00:08:37.121 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54274.log.gz 2024-09-12T00:08:37.121 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54385.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54385.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66049.log 2024-09-12T00:08:37.121 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T00:08:37.121 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33896.log.gz 2024-09-12T00:08:37.121 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33673.log 2024-09-12T00:08:37.121 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26512.log 2024-09-12T00:08:37.121 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66049.log: /var/log/ceph/ceph-client.admin.33673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66049.log.gz 2024-09-12T00:08:37.121 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33673.log.gz 2024-09-12T00:08:37.122 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51192.log 2024-09-12T00:08:37.122 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32339.log 2024-09-12T00:08:37.122 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.26512.log: /var/log/ceph/ceph-client.admin.51192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26512.log.gz 2024-09-12T00:08:37.122 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51192.log.gz 2024-09-12T00:08:37.122 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34827.log 2024-09-12T00:08:37.122 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66240.log 2024-09-12T00:08:37.122 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32339.log: /var/log/ceph/ceph-client.admin.34827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32339.log.gz 2024-09-12T00:08:37.122 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34827.log.gz 2024-09-12T00:08:37.122 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43430.log 2024-09-12T00:08:37.122 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65471.log 2024-09-12T00:08:37.122 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66240.log: /var/log/ceph/ceph-client.admin.43430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66240.log.gz 2024-09-12T00:08:37.122 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43430.log.gz 2024-09-12T00:08:37.123 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32686.log 2024-09-12T00:08:37.123 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39195.log 2024-09-12T00:08:37.123 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65471.log: /var/log/ceph/ceph-client.admin.32686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65471.log.gz 2024-09-12T00:08:37.123 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32686.log.gz 2024-09-12T00:08:37.123 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65497.log 2024-09-12T00:08:37.123 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34831.log 2024-09-12T00:08:37.123 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39195.log: /var/log/ceph/ceph-client.admin.65497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39195.log.gz 2024-09-12T00:08:37.123 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65497.log.gz 2024-09-12T00:08:37.123 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64537.log 2024-09-12T00:08:37.123 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61838.log 2024-09-12T00:08:37.123 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34831.log.gz 2024-09-12T00:08:37.123 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64537.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64537.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54732.log 2024-09-12T00:08:37.124 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T00:08:37.124 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61838.log.gz 2024-09-12T00:08:37.124 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50559.log 2024-09-12T00:08:37.124 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60872.log 2024-09-12T00:08:37.124 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54732.log.gz 2024-09-12T00:08:37.124 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50559.log.gz 2024-09-12T00:08:37.124 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67528.log 2024-09-12T00:08:37.124 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60872.log.gz 2024-09-12T00:08:37.124 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66727.log 2024-09-12T00:08:37.124 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45808.log 2024-09-12T00:08:37.124 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67528.log.gz 2024-09-12T00:08:37.124 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.66727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.66727.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63257.log 2024-09-12T00:08:37.125 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T00:08:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45808.log.gz 2024-09-12T00:08:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67920.log 2024-09-12T00:08:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36834.log 2024-09-12T00:08:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.63257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63257.log.gz 2024-09-12T00:08:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67920.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61926.log 2024-09-12T00:08:37.125 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67920.log.gz 2024-09-12T00:08:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36834.log.gz 2024-09-12T00:08:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66037.log 2024-09-12T00:08:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58499.log 2024-09-12T00:08:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61926.log.gz 2024-09-12T00:08:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66037.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.66037.log.gz 2024-09-12T00:08:37.126 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48205.log 2024-09-12T00:08:37.126 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58499.log.gz 2024-09-12T00:08:37.126 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34781.log 2024-09-12T00:08:37.126 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39740.log 2024-09-12T00:08:37.126 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48205.log: /var/log/ceph/ceph-client.admin.34781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48205.log.gz 2024-09-12T00:08:37.126 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34781.log.gz 2024-09-12T00:08:37.126 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60694.log 2024-09-12T00:08:37.126 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34011.log 2024-09-12T00:08:37.126 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39740.log: /var/log/ceph/ceph-client.admin.60694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39740.log.gz 2024-09-12T00:08:37.126 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60694.log.gz 2024-09-12T00:08:37.126 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45213.log 2024-09-12T00:08:37.126 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35554.log 2024-09-12T00:08:37.127 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45213.log: /var/log/ceph/ceph-client.admin.34011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34011.log.gz 2024-09-12T00:08:37.127 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45213.log.gz 2024-09-12T00:08:37.127 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60607.log 2024-09-12T00:08:37.127 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54611.log 2024-09-12T00:08:37.127 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35554.log.gz 2024-09-12T00:08:37.127 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60607.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35214.log 2024-09-12T00:08:37.127 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T00:08:37.127 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54611.log.gz 2024-09-12T00:08:37.131 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58301.log 2024-09-12T00:08:37.131 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32353.log 2024-09-12T00:08:37.131 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35214.log.gz 2024-09-12T00:08:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58301.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67398.log 2024-09-12T00:08:37.132 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T00:08:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32353.log.gz 2024-09-12T00:08:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67372.log 2024-09-12T00:08:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66031.log 2024-09-12T00:08:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67398.log: /var/log/ceph/ceph-client.admin.67372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67398.log.gz 2024-09-12T00:08:37.132 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67372.log.gz 2024-09-12T00:08:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59990.log 2024-09-12T00:08:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65606.log 2024-09-12T00:08:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66031.log: /var/log/ceph/ceph-client.admin.59990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66031.log.gz 2024-09-12T00:08:37.133 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59990.log.gz 2024-09-12T00:08:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62016.log 2024-09-12T00:08:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42235.log 2024-09-12T00:08:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65606.log: /var/log/ceph/ceph-client.admin.62016.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65606.log.gz 2024-09-12T00:08:37.133 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62016.log.gz 2024-09-12T00:08:37.133 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42235.log.gz 2024-09-12T00:08:37.165 INFO:teuthology.orchestra.run.smithi135.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T00:08:37.284 INFO:teuthology.orchestra.run.smithi019.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T00:08:37.359 INFO:teuthology.orchestra.run.smithi019.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T00:08:37.734 INFO:teuthology.orchestra.run.smithi135.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T00:08:37.790 INFO:teuthology.orchestra.run.smithi135.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T00:08:37.856 INFO:teuthology.orchestra.run.smithi019.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T00:08:37.916 INFO:teuthology.orchestra.run.smithi135.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T00:08:37.995 INFO:teuthology.orchestra.run.smithi019.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T00:08:38.001 INFO:teuthology.orchestra.run.smithi019.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T00:08:38.014 INFO:teuthology.orchestra.run.smithi135.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T00:08:38.015 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-09-12T00:08:38.016 INFO:teuthology.orchestra.run.smithi135.stderr:real 0m1.023s 2024-09-12T00:08:38.016 INFO:teuthology.orchestra.run.smithi135.stderr:user 0m3.472s 2024-09-12T00:08:38.016 INFO:teuthology.orchestra.run.smithi135.stderr:sys 0m0.168s 2024-09-12T00:08:38.198 INFO:teuthology.orchestra.run.smithi019.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T00:08:38.200 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T00:08:38.200 INFO:teuthology.orchestra.run.smithi019.stderr:real 0m1.251s 2024-09-12T00:08:38.200 INFO:teuthology.orchestra.run.smithi019.stderr:user 0m4.706s 2024-09-12T00:08:38.200 INFO:teuthology.orchestra.run.smithi019.stderr:sys 0m0.223s 2024-09-12T00:08:38.200 INFO:tasks.ceph:Archiving logs... 2024-09-12T00:08:38.200 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901820/remote/smithi019/log 2024-09-12T00:08:38.201 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T00:08:38.543 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-09-12T00:08:38.543 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-12T00:08:38.543 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-12T00:08:38.956 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901820/remote/smithi135/log 2024-09-12T00:08:38.957 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T00:08:39.397 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T00:08:39.409 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T00:08:39.409 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T00:08:39.411 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T00:08:39.495 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T00:08:39.505 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T00:08:39.505 DEBUG:teuthology.orchestra.run.smithi019:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:08:39.508 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:08:39.518 INFO:teuthology.orchestra.run.smithi019.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:08:39.518 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================== 2024-09-12T00:08:39.518 INFO:teuthology.orchestra.run.smithi019.stdout:*hv01.front.sepi 67.205.162.81 3 u 41 64 377 0.080 -2.972 0.782 2024-09-12T00:08:39.519 INFO:teuthology.orchestra.run.smithi019.stdout:+hv02.front.sepi 63.231.80.2 3 u 40 128 377 0.069 +0.046 0.464 2024-09-12T00:08:39.519 INFO:teuthology.orchestra.run.smithi019.stdout:+hv03.front.sepi 144.34.193.110 3 u 41 64 377 0.069 -0.056 1.046 2024-09-12T00:08:39.519 INFO:teuthology.orchestra.run.smithi019.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:08:39.522 INFO:teuthology.orchestra.run.smithi135.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:08:39.522 INFO:teuthology.orchestra.run.smithi135.stdout:============================================================================== 2024-09-12T00:08:39.522 INFO:teuthology.orchestra.run.smithi135.stdout:+hv01.front.sepi 67.205.162.81 3 u 43 64 377 0.061 -2.104 1.886 2024-09-12T00:08:39.522 INFO:teuthology.orchestra.run.smithi135.stdout:*hv02.front.sepi 63.231.80.2 3 u 40 64 377 0.079 +1.278 2.044 2024-09-12T00:08:39.522 INFO:teuthology.orchestra.run.smithi135.stdout:+hv03.front.sepi 144.34.193.110 3 u 40 64 377 0.068 +1.239 2.082 2024-09-12T00:08:39.523 INFO:teuthology.orchestra.run.smithi135.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:08:39.524 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T00:08:39.582 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T00:08:39.583 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T00:08:39.750 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T00:08:39.758 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T00:08:39.768 INFO:teuthology.task.internal:Duration was 968.634257 seconds 2024-09-12T00:08:39.769 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T00:08:39.783 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T00:08:39.784 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T00:08:39.788 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T00:08:39.827 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T00:08:39.827 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T00:08:39.827 DEBUG:teuthology.orchestra.run.smithi019:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T00:08:39.883 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T00:08:39.884 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T00:08:39.893 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T00:08:39.893 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T00:08:39.927 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T00:08:39.967 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T00:08:39.967 DEBUG:teuthology.orchestra.run.smithi019:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T00:08:39.998 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T00:08:40.075 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T00:08:40.089 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T00:08:40.089 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T00:08:40.103 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T00:08:40.116 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T00:08:40.139 DEBUG:teuthology.orchestra.run.smithi019:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:08:40.151 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:08:40.161 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = core 2024-09-12T00:08:40.172 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2024-09-12T00:08:40.270 DEBUG:teuthology.orchestra.run.smithi019:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:08:40.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:08:40.276 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:08:40.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:08:40.317 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T00:08:40.330 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T00:08:40.331 DEBUG:teuthology.misc:Transferring archived files from smithi019:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901820/remote/smithi019 2024-09-12T00:08:40.331 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T00:08:40.354 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901820/remote/smithi135 2024-09-12T00:08:40.354 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T00:08:40.381 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T00:08:40.381 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T00:08:40.395 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T00:08:40.429 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T00:08:40.440 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T00:08:40.440 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T00:08:40.450 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T00:08:40.450 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T00:08:40.453 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T00:08:40.456 INFO:teuthology.orchestra.run.smithi019.stdout: 658622 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 00:08 /home/ubuntu/cephtest 2024-09-12T00:08:40.477 INFO:teuthology.orchestra.run.smithi135.stdout: 658616 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 00:08 /home/ubuntu/cephtest 2024-09-12T00:08:40.478 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T00:08:40.489 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T00:08:40.534 INFO:teuthology.run:Summary data: description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} duration: 968.6342573165894 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T00:08:40.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T00:08:40.627 INFO:teuthology.run:pass